2023-10-24T00:13:26.966 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-24T00:13:26.967 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974 --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/orig.config.yaml 2023-10-24T00:13:27.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-24T00:13:27.089 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974 branch: wip-yuri7-testing-2023-10-23-1230-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: yweinste@redhat.com first_in_suite: false job_id: '7434974' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri7-testing-2023-10-23-1230-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2023-10-23-1230-pacific sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 owner: scheduled_yuriw@teuthology priority: 76 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7825 sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri7-testing-2023-10-23-1230-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUvSJx2mV8wRY0mjrjsB2wFIWM0U3RA04/sbTZZ7DVx3jNmuSHIqPuPWl+O9ttksx1eEywYLo2O/mkLZ6hX5Ns= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7UkzY9I5R+6v0hdWqah4Cxv5hlM06BlVbqL+Rn2biEpxYveWdLWwE2iptGdMMVe53t2WzcOo8nIinJZx9T3/I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-24_00:02:48 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-24T00:13:27.090 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/qa; will attempt to use it 2023-10-24T00:13:27.091 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/qa/tasks 2023-10-24T00:13:27.091 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-24T00:13:27.093 INFO:teuthology.task.internal:Checking packages... 2023-10-24T00:13:27.116 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0' 2023-10-24T00:13:27.116 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-24T00:13:27.116 INFO:teuthology.packaging:ref: None 2023-10-24T00:13:27.117 INFO:teuthology.packaging:tag: None 2023-10-24T00:13:27.117 INFO:teuthology.packaging:branch: wip-yuri7-testing-2023-10-23-1230-pacific 2023-10-24T00:13:27.117 INFO:teuthology.packaging:sha1: e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 2023-10-24T00:13:27.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri7-testing-2023-10-23-1230-pacific 2023-10-24T00:13:27.262 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-127.ge93d5f89 2023-10-24T00:13:27.262 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-24T00:13:27.269 INFO:teuthology.task.internal:no buildpackages task found 2023-10-24T00:13:27.269 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-24T00:13:27.310 INFO:teuthology.task.internal:Saving configuration 2023-10-24T00:13:27.327 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-24T00:13:27.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T00:13:27.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:12.306276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUvSJx2mV8wRY0mjrjsB2wFIWM0U3RA04/sbTZZ7DVx3jNmuSHIqPuPWl+O9ttksx1eEywYLo2O/mkLZ6hX5Ns='} 2023-10-24T00:13:27.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:12.304638', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7UkzY9I5R+6v0hdWqah4Cxv5hlM06BlVbqL+Rn2biEpxYveWdLWwE2iptGdMMVe53t2WzcOo8nIinJZx9T3/I='} 2023-10-24T00:13:27.383 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-24T00:13:27.389 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-24T00:13:27.390 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-24T00:13:27.390 INFO:teuthology.run_tasks:Running task console_log... 2023-10-24T00:13:27.487 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7a49f9bb80>, signals=[15]) 2023-10-24T00:13:27.488 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-24T00:13:27.494 INFO:teuthology.task.internal:Opening connections... 2023-10-24T00:13:27.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:13:27.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:13:27.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:13:27.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:13:27.632 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-24T00:13:27.639 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-24T00:13:27.655 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-24T00:13:27.656 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-24T00:13:27.712 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux" 2023-10-24T00:13:27.712 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.4 (Ootpa)" 2023-10-24T00:13:27.713 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel" 2023-10-24T00:13:27.713 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora" 2023-10-24T00:13:27.713 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.4" 2023-10-24T00:13:27.713 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8" 2023-10-24T00:13:27.714 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-24T00:13:27.714 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-10-24T00:13:27.714 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-24T00:13:27.714 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/" 2023-10-24T00:13:27.714 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-24T00:13:27.715 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-24T00:13:27.715 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:13:27.715 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-24T00:13:27.715 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-24T00:13:27.716 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-24T00:13:27.716 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-24T00:13:27.716 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-24T00:13:27.738 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-10-24T00:13:27.756 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-10-24T00:13:27.756 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-10-24T00:13:27.813 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-10-24T00:13:27.813 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)" 2023-10-24T00:13:27.813 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-10-24T00:13:27.813 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-10-24T00:13:27.814 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4" 2023-10-24T00:13:27.814 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-10-24T00:13:27.814 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-24T00:13:27.814 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-10-24T00:13:27.814 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-24T00:13:27.815 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-10-24T00:13:27.815 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-24T00:13:27.815 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-24T00:13:27.815 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:13:27.816 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-24T00:13:27.817 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-24T00:13:27.817 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-24T00:13:27.817 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-24T00:13:27.818 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-10-24T00:13:27.838 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-24T00:13:27.847 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-24T00:13:27.853 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-24T00:13:27.853 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-10-24T00:13:27.856 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2023-10-24T00:13:27.871 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-24T00:13:27.879 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-24T00:13:27.879 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-10-24T00:13:27.911 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2023-10-24T00:13:27.925 INFO:teuthology.orchestra.run.smithi148.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-24T00:13:27.928 INFO:teuthology.orchestra.run.smithi150.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-24T00:13:27.929 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-24T00:13:27.986 INFO:teuthology.run_tasks:Running task kernel... 2023-10-24T00:13:28.002 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-24T00:13:28.002 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-24T00:13:28.003 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-24T00:13:28.003 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-24T00:13:28.005 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-24T00:13:28.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:13:28.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:13:28.023 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-10-24T00:13:28.024 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-10-24T00:13:28.079 INFO:teuthology.orchestra.run.smithi148.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-24T00:13:28.079 INFO:teuthology.task.kernel:Running kernel on smithi148: 4.18.0-305.25.1.el8_4.x86_64 2023-10-24T00:13:28.080 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2023-10-24T00:13:28.081 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-24T00:13:28.081 INFO:teuthology.task.kernel:Running kernel on smithi150: 4.18.0-305.25.1.el8_4.x86_64 2023-10-24T00:13:28.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum install -y kernel 2023-10-24T00:13:29.465 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:29.465 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-24T00:13:29.494 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:29.495 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-10-24T00:13:30.978 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-10-24T00:13:31.006 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-24T00:13:31.573 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-24T00:13:31.862 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-24T00:13:34.909 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-24T00:13:35.356 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-24T00:13:35.610 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-24T00:13:35.611 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-24T00:13:35.611 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-24T00:13:35.760 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-10-24T00:13:35.761 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2023-10-24T00:13:35.761 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-10-24T00:13:35.877 DEBUG:teuthology.orchestra.run.smithi148:> echo no | sudo yum reinstall kernel || true 2023-10-24T00:13:36.101 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-24T00:13:36.101 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-24T00:13:36.102 INFO:teuthology.orchestra.run.smithi150.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-24T00:13:36.222 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:36.223 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-24T00:13:36.245 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-10-24T00:13:36.246 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2023-10-24T00:13:36.246 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-10-24T00:13:36.357 DEBUG:teuthology.orchestra.run.smithi150:> echo no | sudo yum reinstall kernel || true 2023-10-24T00:13:36.513 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Oct 2023 12:13:34 AM UTC. 2023-10-24T00:13:36.663 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-24T00:13:36.664 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:36.664 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:36.686 INFO:teuthology.orchestra.run.smithi148.stderr:Error: No packages marked for reinstall. 2023-10-24T00:13:36.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum reinstall -y kernel || true 2023-10-24T00:13:36.742 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:36.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-10-24T00:13:37.039 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Oct 2023 12:13:35 AM UTC. 2023-10-24T00:13:37.085 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:37.085 INFO:teuthology.orchestra.run.smithi148.stdout:Unable to read consumer identity 2023-10-24T00:13:37.171 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-24T00:13:37.172 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:37.172 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:37.199 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2023-10-24T00:13:37.250 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum reinstall -y kernel || true 2023-10-24T00:13:37.370 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:03 ago on Tue 24 Oct 2023 12:13:34 AM UTC. 2023-10-24T00:13:37.504 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-24T00:13:37.505 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:37.505 INFO:teuthology.orchestra.run.smithi148.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:37.519 INFO:teuthology.orchestra.run.smithi148.stderr:Error: No packages marked for reinstall. 2023-10-24T00:13:37.569 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-10-24T00:13:37.594 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-10-24T00:13:37.594 INFO:teuthology.orchestra.run.smithi150.stdout:Unable to read consumer identity 2023-10-24T00:13:37.695 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.695 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.696 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-24T00:13:37.696 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-24T00:13:37.696 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-24T00:13:37.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2023-10-24T00:13:37.697 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-10-24T00:13:37.822 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.822 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.823 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2023-10-24T00:13:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2023-10-24T00:13:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2023-10-24T00:13:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.02 2023-10-24T00:13:37.851 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 99.el8_4.1 2023-10-24T00:13:37.851 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2023-10-24T00:13:37.851 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-24T00:13:37.851 INFO:teuthology.orchestra.run.smithi148.stdout:Group : System Environment/Base 2023-10-24T00:13:37.851 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 9264631 2023-10-24T00:13:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2023-10-24T00:13:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-24T00:13:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-24T00:13:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-24T00:13:37.852 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-24T00:13:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Relocations : (not relocatable) 2023-10-24T00:13:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : Red Hat, Inc. 2023-10-24T00:13:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : Red Hat, Inc. 2023-10-24T00:13:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-24T00:13:37.854 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2023-10-24T00:13:37.854 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2023-10-24T00:13:37.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:13:37.854 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-24T00:13:37.855 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-24T00:13:37.855 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-24T00:13:37.855 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2023-10-24T00:13:37.855 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:13:37.855 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2023-10-24T00:13:37.856 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-24T00:13:37.857 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:37.857 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-24T00:13:37.877 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Oct 2023 12:13:35 AM UTC. 2023-10-24T00:13:38.031 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-24T00:13:38.032 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:38.032 INFO:teuthology.orchestra.run.smithi150.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-24T00:13:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:Error: No packages marked for reinstall. 2023-10-24T00:13:38.116 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2023-10-24T00:13:38.242 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.242 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.242 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.243 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-24T00:13:38.243 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-24T00:13:38.243 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-24T00:13:38.243 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2023-10-24T00:13:38.243 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q kernel | sort -rV | head -n 1 2023-10-24T00:13:38.368 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.369 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.369 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2023-10-24T00:13:38.396 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2023-10-24T00:13:38.396 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2023-10-24T00:13:38.396 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.02 2023-10-24T00:13:38.396 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 99.el8_4.1 2023-10-24T00:13:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2023-10-24T00:13:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-24T00:13:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:Group : System Environment/Base 2023-10-24T00:13:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 9264631 2023-10-24T00:13:38.397 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2023-10-24T00:13:38.398 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-24T00:13:38.398 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-24T00:13:38.398 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-24T00:13:38.398 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-24T00:13:38.398 INFO:teuthology.orchestra.run.smithi150.stdout:Relocations : (not relocatable) 2023-10-24T00:13:38.399 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : Red Hat, Inc. 2023-10-24T00:13:38.399 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : Red Hat, Inc. 2023-10-24T00:13:38.399 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-24T00:13:38.399 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2023-10-24T00:13:38.399 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2023-10-24T00:13:38.400 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:13:38.400 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-24T00:13:38.400 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-24T00:13:38.400 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-24T00:13:38.400 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2023-10-24T00:13:38.401 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:13:38.401 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2023-10-24T00:13:38.402 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-24T00:13:38.402 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:38.402 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-24T00:13:39.255 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-10-24T00:13:39.688 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-10-24T00:13:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-10-24T00:13:41.414 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-10-24T00:13:41.428 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.vCUPx5TcQE 2023-10-24T00:13:41.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vCUPx5TcQE 2023-10-24T00:13:41.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.vCUPx5TcQE 2023-10-24T00:13:41.664 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.vCUPx5TcQE is 6KB 2023-10-24T00:13:41.713 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.vCUPx5TcQE 2023-10-24T00:13:41.727 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2023-10-24T00:13:41.794 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-24T00:13:41.794 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-24T00:13:41.794 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-24T00:13:41.794 INFO:teuthology.orchestra.run.smithi148.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-24T00:13:41.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:41.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2023-10-24T00:13:42.048 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-10-24T00:13:42.049 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-10-24T00:13:42.080 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.BLGgaKh6V1 2023-10-24T00:13:42.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BLGgaKh6V1 2023-10-24T00:13:42.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.BLGgaKh6V1 2023-10-24T00:13:42.300 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.BLGgaKh6V1 is 6KB 2023-10-24T00:13:42.349 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.BLGgaKh6V1 2023-10-24T00:13:42.365 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2023-10-24T00:13:42.435 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-24T00:13:42.435 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-24T00:13:42.435 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-24T00:13:42.436 INFO:teuthology.orchestra.run.smithi150.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-24T00:13:42.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-24T00:13:42.614 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2023-10-24T00:14:11.994 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-24T00:14:11.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:14:11.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:14:12.618 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-24T00:14:12.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:14:12.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:14:30.523 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-24T00:14:31.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-10-24T00:14:39.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:14:39.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:14:40.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:14:40.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:14:42.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-24T00:14:43.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-10-24T00:14:54.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:14:54.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:14:55.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:14:55.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:15:13.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-10-24T00:15:28.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:15:28.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:15:29.326 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-10-24T00:15:29.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:15:29.772 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-24T00:15:29.772 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-10-24T00:15:29.786 INFO:teuthology.orchestra.run.smithi150.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-24T00:15:29.789 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:15:29.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-24T00:15:29.790 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-24T00:15:30.790 DEBUG:teuthology.parallel:result is None 2023-10-24T00:15:54.606 DEBUG:teuthology.orchestra.remote:timed out 2023-10-24T00:16:09.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:16:09.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:16:09.939 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-24T00:16:10.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:16:10.200 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-24T00:16:10.200 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-10-24T00:16:10.214 INFO:teuthology.orchestra.run.smithi148.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-24T00:16:10.214 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-24T00:16:10.215 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-24T00:16:10.215 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-24T00:16:11.216 DEBUG:teuthology.parallel:result is None 2023-10-24T00:16:11.217 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-24T00:16:11.278 INFO:teuthology.task.internal:Creating test directory... 2023-10-24T00:16:11.278 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-24T00:16:11.281 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-24T00:16:11.302 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-24T00:16:11.319 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-24T00:16:11.412 INFO:teuthology.task.internal:Creating archive directory... 2023-10-24T00:16:11.413 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-24T00:16:11.415 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-24T00:16:11.486 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-24T00:16:11.522 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-24T00:16:11.522 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-24T00:16:11.525 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-24T00:16:11.604 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-24T00:16:11.625 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-24T00:16:11.651 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-24T00:16:11.666 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-24T00:16:11.668 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-24T00:16:11.718 INFO:teuthology.task.internal:Configuring sudo... 2023-10-24T00:16:11.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-24T00:16:11.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-24T00:16:11.749 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-24T00:16:11.769 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-24T00:16:11.769 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-24T00:16:11.790 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-24T00:16:11.806 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-24T00:16:11.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-24T00:16:11.929 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-24T00:16:12.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-24T00:16:12.051 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:16:12.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-24T00:16:12.115 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-24T00:16:12.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-24T00:16:12.202 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-24T00:16:12.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-24T00:16:12.325 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:16:12.326 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-24T00:16:12.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-10-24T00:16:12.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2023-10-24T00:16:12.444 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-24T00:16:12.506 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-24T00:16:12.878 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-24T00:16:12.979 INFO:teuthology.task.internal:Starting timer... 2023-10-24T00:16:12.980 INFO:teuthology.run_tasks:Running task pcp... 2023-10-24T00:16:12.999 INFO:teuthology.run_tasks:Running task selinux... 2023-10-24T00:16:13.016 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-24T00:16:13.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2023-10-24T00:16:13.077 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: [ OK ] 2023-10-24T00:16:13.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2023-10-24T00:16:13.141 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: [ OK ] 2023-10-24T00:16:13.143 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-24T00:16:13.144 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2023-10-24T00:16:13.171 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2023-10-24T00:16:13.171 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2023-10-24T00:16:13.191 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2023-10-24T00:16:13.191 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2023-10-24T00:16:13.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-24T00:16:13.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:16:13.242 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-24T00:16:13.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:16:13.271 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-24T00:16:13.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2023-10-24T00:16:13.308 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2023-10-24T00:16:13.337 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-24T00:16:13.356 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-24T00:16:13.356 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-24T00:16:13.381 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-24T00:16:13.383 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-24T00:25:46.662 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2023-10-24T00:25:46.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:25:46.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:25:46.733 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-24T00:25:46.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-24T00:25:46.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:25:46.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-24T00:25:46.870 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-10-24T00:25:46.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-10-24T00:25:46.934 INFO:teuthology.run_tasks:Running task clock... 2023-10-24T00:25:46.946 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-24T00:25:46.947 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-24T00:25:46.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-24T00:25:46.950 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-24T00:25:46.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-24T00:25:46.976 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-24T00:25:46.990 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-24T00:25:47.001 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-24T00:25:47.015 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-24T00:25:47.029 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2023-10-24T00:25:47.038 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2023-10-24T00:25:47.051 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-24T00:25:47.057 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2023-10-24T00:25:47.065 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-24T00:25:47.067 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2023-10-24T00:25:47.081 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-24T00:25:47.094 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-24T00:25:47.128 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-10-24T00:25:47.131 INFO:teuthology.orchestra.run.smithi148.stdout:210 Number of sources = 4 2023-10-24T00:25:47.131 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-24T00:25:47.131 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-10-24T00:25:47.131 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.131 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.132 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.132 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.165 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-10-24T00:25:47.167 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2023-10-24T00:25:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-24T00:25:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-10-24T00:25:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.169 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T00:25:47.169 INFO:teuthology.run_tasks:Running task install... 2023-10-24T00:25:47.177 DEBUG:teuthology.task.install:project ceph 2023-10-24T00:25:47.177 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'}} 2023-10-24T00:25:47.178 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'} 2023-10-24T00:25:47.178 INFO:teuthology.task.install:Using flavor: default 2023-10-24T00:25:47.183 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-24T00:25:47.184 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-24T00:25:47.184 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0', 'tag': None, 'wait_for_package': False} 2023-10-24T00:25:47.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 2023-10-24T00:25:47.187 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0', 'tag': None, 'wait_for_package': False} 2023-10-24T00:25:47.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 2023-10-24T00:25:47.409 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/ 2023-10-24T00:25:47.409 INFO:teuthology.task.install.rpm:Package version is 16.2.14-127.ge93d5f89 2023-10-24T00:25:47.414 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/ 2023-10-24T00:25:47.414 INFO:teuthology.task.install.rpm:Package version is 16.2.14-127.ge93d5f89 2023-10-24T00:25:47.680 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-24T00:25:47.681 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:25:47.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-24T00:25:47.708 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-24T00:25:47.708 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-24T00:25:47.742 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-10-23-1230-pacific/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-24T00:25:47.743 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:25:47.743 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-24T00:25:47.770 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-24T00:25:47.770 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-24T00:25:47.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-24T00:25:47.836 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-24T00:25:47.848 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-24T00:25:47.911 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-24T00:25:47.912 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2023-10-24T00:25:47.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2023-10-24T00:25:47.977 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2023-10-24T00:25:47.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2023-10-24T00:25:48.304 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-24T00:25:48.379 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-10-24T00:25:49.307 INFO:teuthology.orchestra.run.smithi148.stdout:44 files removed 2023-10-24T00:25:49.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-24T00:25:49.410 INFO:teuthology.orchestra.run.smithi150.stdout:44 files removed 2023-10-24T00:25:49.465 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-24T00:25:49.710 INFO:teuthology.orchestra.run.smithi148.stdout:Updating Subscription Management repositories. 2023-10-24T00:25:49.821 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2023-10-24T00:25:51.364 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 201 kB/s | 76 kB 00:00 2023-10-24T00:25:51.441 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 264 kB/s | 76 kB 00:00 2023-10-24T00:25:51.710 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 50 kB/s | 15 kB 00:00 2023-10-24T00:25:51.791 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 49 kB/s | 15 kB 00:00 2023-10-24T00:25:51.931 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 7.5 kB/s | 1.4 kB 00:00 2023-10-24T00:25:52.057 INFO:teuthology.orchestra.run.smithi148.stdout:Copr repo for python3-asyncssh owned by ceph 36 kB/s | 3.5 kB 00:00 2023-10-24T00:25:52.128 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-10-24T00:25:52.240 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-24T00:25:52.616 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 30 MB/s | 16 MB 00:00 2023-10-24T00:25:53.956 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2023-10-24T00:25:55.910 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-24T00:25:56.466 INFO:teuthology.orchestra.run.smithi148.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 70 MB/s | 33 MB 00:00 2023-10-24T00:25:57.253 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-24T00:25:57.866 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 33 MB 00:00 2023-10-24T00:26:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 38 MB 00:00 2023-10-24T00:26:03.167 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 74 MB/s | 38 MB 00:00 2023-10-24T00:26:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-24T00:26:10.437 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-24T00:26:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-24T00:26:10.448 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-24T00:26:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-24T00:26:10.450 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-24T00:26:10.452 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-24T00:26:10.454 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-24T00:26:10.455 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-24T00:26:10.943 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-10-24T00:26:10.955 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-24T00:26:10.955 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2023-10-24T00:26:10.956 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-24T00:26:10.956 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2023-10-24T00:26:10.956 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-24T00:26:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 6.4 k 2023-10-24T00:26:10.957 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 6.1 M 2023-10-24T00:26:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 910 k 2023-10-24T00:26:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 161 k 2023-10-24T00:26:10.958 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 1.6 M 2023-10-24T00:26:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 116 k 2023-10-24T00:26:10.959 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 3.1 M 2023-10-24T00:26:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 8.6 M 2023-10-24T00:26:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 27 k 2023-10-24T00:26:10.960 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 12 M 2023-10-24T00:26:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 52 M 2023-10-24T00:26:10.961 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 85 k 2023-10-24T00:26:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 257 k 2023-10-24T00:26:10.962 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 19 k 2023-10-24T00:26:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-24T00:26:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-24T00:26:10.963 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-24T00:26:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 25 k 2023-10-24T00:26:10.964 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 824 k 2023-10-24T00:26:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 131 k 2023-10-24T00:26:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-24T00:26:10.965 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-24T00:26:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-24T00:26:10.966 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 215 k 2023-10-24T00:26:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 390 k 2023-10-24T00:26:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 369 k 2023-10-24T00:26:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 114 k 2023-10-24T00:26:10.967 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 88 k 2023-10-24T00:26:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.7 M 2023-10-24T00:26:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 173 k 2023-10-24T00:26:10.968 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-24T00:26:10.968 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2023-10-24T00:26:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.7 M 2023-10-24T00:26:10.969 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 4.2 M 2023-10-24T00:26:10.969 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2023-10-24T00:26:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-24T00:26:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 24 M 2023-10-24T00:26:10.970 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 24 k 2023-10-24T00:26:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 2.4 M 2023-10-24T00:26:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 245 k 2023-10-24T00:26:10.971 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 5.0 M 2023-10-24T00:26:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 18 M 2023-10-24T00:26:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 15 k 2023-10-24T00:26:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 26 k 2023-10-24T00:26:10.972 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-24T00:26:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-24T00:26:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-24T00:26:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-24T00:26:10.973 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-24T00:26:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-24T00:26:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 174 k 2023-10-24T00:26:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-24T00:26:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-24T00:26:10.974 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-24T00:26:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-24T00:26:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-24T00:26:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 494 k 2023-10-24T00:26:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-24T00:26:10.975 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.8 M 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-24T00:26:10.976 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-24T00:26:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-24T00:26:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-24T00:26:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-24T00:26:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-24T00:26:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-24T00:26:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-10-24T00:26:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-24T00:26:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-24T00:26:10.978 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-24T00:26:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-24T00:26:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 45 k 2023-10-24T00:26:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 99 k 2023-10-24T00:26:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-24T00:26:10.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-24T00:26:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-24T00:26:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-10-24T00:26:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-24T00:26:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-24T00:26:10.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-24T00:26:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-24T00:26:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-24T00:26:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-24T00:26:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-24T00:26:10.981 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-24T00:26:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-24T00:26:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-24T00:26:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-24T00:26:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-24T00:26:10.982 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-24T00:26:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-24T00:26:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-24T00:26:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-24T00:26:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-24T00:26:10.983 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-24T00:26:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-24T00:26:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-24T00:26:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-24T00:26:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-10-24T00:26:10.984 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-24T00:26:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-24T00:26:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-24T00:26:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-24T00:26:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-24T00:26:10.985 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-24T00:26:10.986 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-24T00:26:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-24T00:26:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-24T00:26:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-24T00:26:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-24T00:26:10.987 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-24T00:26:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-24T00:26:10.988 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:26:10.988 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-10-24T00:26:10.988 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================================================== 2023-10-24T00:26:10.988 INFO:teuthology.orchestra.run.smithi148.stdout:Install 118 Packages 2023-10-24T00:26:10.989 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2023-10-24T00:26:10.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:26:10.990 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 201 M 2023-10-24T00:26:10.990 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-10-24T00:26:11.327 INFO:teuthology.orchestra.run.smithi148.stdout:(1/120): ceph-16.2.14-127.ge93d5f89.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-10-24T00:26:11.419 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-24T00:26:11.420 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-24T00:26:11.430 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-24T00:26:11.431 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-24T00:26:11.432 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-24T00:26:11.433 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-24T00:26:11.435 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-24T00:26:11.437 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-24T00:26:11.438 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-24T00:26:11.849 INFO:teuthology.orchestra.run.smithi148.stdout:(2/120): ceph-fuse-16.2.14-127.ge93d5f89.el8.x8 1.7 MB/s | 910 kB 00:00 2023-10-24T00:26:11.914 INFO:teuthology.orchestra.run.smithi148.stdout:(3/120): ceph-immutable-object-cache-16.2.14-12 2.4 MB/s | 161 kB 00:00 2023-10-24T00:26:11.927 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2023-10-24T00:26:11.938 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-10-24T00:26:11.939 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2023-10-24T00:26:11.939 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-10-24T00:26:11.940 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2023-10-24T00:26:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-24T00:26:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 6.4 k 2023-10-24T00:26:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 6.1 M 2023-10-24T00:26:11.940 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 910 k 2023-10-24T00:26:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 161 k 2023-10-24T00:26:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 1.6 M 2023-10-24T00:26:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 116 k 2023-10-24T00:26:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 3.1 M 2023-10-24T00:26:11.941 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 8.6 M 2023-10-24T00:26:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 27 k 2023-10-24T00:26:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 12 M 2023-10-24T00:26:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 52 M 2023-10-24T00:26:11.942 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 85 k 2023-10-24T00:26:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 257 k 2023-10-24T00:26:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 19 k 2023-10-24T00:26:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-24T00:26:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-24T00:26:11.943 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-24T00:26:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 25 k 2023-10-24T00:26:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 824 k 2023-10-24T00:26:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 131 k 2023-10-24T00:26:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-24T00:26:11.944 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-24T00:26:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-24T00:26:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 215 k 2023-10-24T00:26:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 390 k 2023-10-24T00:26:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 369 k 2023-10-24T00:26:11.945 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 114 k 2023-10-24T00:26:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 88 k 2023-10-24T00:26:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.7 M 2023-10-24T00:26:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 173 k 2023-10-24T00:26:11.946 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-24T00:26:11.946 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.7 M 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 4.2 M 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 24 M 2023-10-24T00:26:11.947 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 24 k 2023-10-24T00:26:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 2.4 M 2023-10-24T00:26:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 245 k 2023-10-24T00:26:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 5.0 M 2023-10-24T00:26:11.948 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 18 M 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:16.2.14-127.ge93d5f89.el8 ceph-noarch 15 k 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 26 k 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-24T00:26:11.949 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-24T00:26:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-24T00:26:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-24T00:26:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 174 k 2023-10-24T00:26:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-24T00:26:11.950 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-24T00:26:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-24T00:26:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-24T00:26:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-24T00:26:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 494 k 2023-10-24T00:26:11.951 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-24T00:26:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 3.8 M 2023-10-24T00:26:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-24T00:26:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-24T00:26:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-24T00:26:11.952 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-24T00:26:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-24T00:26:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-24T00:26:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-24T00:26:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-24T00:26:11.953 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-24T00:26:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-24T00:26:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-24T00:26:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-10-24T00:26:11.954 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-24T00:26:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-24T00:26:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-24T00:26:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-24T00:26:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 45 k 2023-10-24T00:26:11.955 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:16.2.14-127.ge93d5f89.el8 ceph 99 k 2023-10-24T00:26:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-24T00:26:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-24T00:26:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-24T00:26:11.956 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-10-24T00:26:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-24T00:26:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-24T00:26:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-24T00:26:11.957 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-24T00:26:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-24T00:26:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-24T00:26:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-24T00:26:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-24T00:26:11.958 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-24T00:26:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-24T00:26:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-24T00:26:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-24T00:26:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-24T00:26:11.959 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-24T00:26:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-24T00:26:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-24T00:26:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-24T00:26:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-24T00:26:11.960 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-24T00:26:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-24T00:26:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-24T00:26:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-10-24T00:26:11.961 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-24T00:26:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-24T00:26:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-24T00:26:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-24T00:26:11.962 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-24T00:26:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-24T00:26:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-24T00:26:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-24T00:26:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-24T00:26:11.963 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-24T00:26:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-24T00:26:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-24T00:26:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-24T00:26:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-24T00:26:11.964 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-24T00:26:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-24T00:26:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-24T00:26:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-24T00:26:11.965 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:26:11.965 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2023-10-24T00:26:11.966 INFO:teuthology.orchestra.run.smithi150.stdout:====================================================================================================================== 2023-10-24T00:26:11.966 INFO:teuthology.orchestra.run.smithi150.stdout:Install 118 Packages 2023-10-24T00:26:11.966 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 2 Packages 2023-10-24T00:26:11.966 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:26:11.967 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 201 M 2023-10-24T00:26:11.967 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2023-10-24T00:26:12.450 INFO:teuthology.orchestra.run.smithi148.stdout:(4/120): ceph-mds-16.2.14-127.ge93d5f89.el8.x86 4.6 MB/s | 2.4 MB 00:00 2023-10-24T00:26:12.527 INFO:teuthology.orchestra.run.smithi150.stdout:(1/120): ceph-16.2.14-127.ge93d5f89.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-10-24T00:26:12.740 INFO:teuthology.orchestra.run.smithi148.stdout:(5/120): ceph-mgr-16.2.14-127.ge93d5f89.el8.x86 5.6 MB/s | 1.6 MB 00:00 2023-10-24T00:26:13.469 INFO:teuthology.orchestra.run.smithi148.stdout:(6/120): ceph-mon-16.2.14-127.ge93d5f89.el8.x86 6.9 MB/s | 5.0 MB 00:00 2023-10-24T00:26:13.641 INFO:teuthology.orchestra.run.smithi150.stdout:(2/120): ceph-fuse-16.2.14-127.ge93d5f89.el8.x8 819 kB/s | 910 kB 00:01 2023-10-24T00:26:13.766 INFO:teuthology.orchestra.run.smithi150.stdout:(3/120): ceph-immutable-object-cache-16.2.14-12 1.2 MB/s | 161 kB 00:00 2023-10-24T00:26:14.112 INFO:teuthology.orchestra.run.smithi148.stdout:(7/120): ceph-base-16.2.14-127.ge93d5f89.el8.x8 2.0 MB/s | 6.1 MB 00:03 2023-10-24T00:26:14.716 INFO:teuthology.orchestra.run.smithi150.stdout:(4/120): ceph-base-16.2.14-127.ge93d5f89.el8.x8 2.4 MB/s | 6.1 MB 00:02 2023-10-24T00:26:14.937 INFO:teuthology.orchestra.run.smithi150.stdout:(5/120): ceph-mds-16.2.14-127.ge93d5f89.el8.x86 2.1 MB/s | 2.4 MB 00:01 2023-10-24T00:26:15.348 INFO:teuthology.orchestra.run.smithi150.stdout:(6/120): ceph-mgr-16.2.14-127.ge93d5f89.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-10-24T00:26:16.264 INFO:teuthology.orchestra.run.smithi150.stdout:(7/120): ceph-mon-16.2.14-127.ge93d5f89.el8.x86 3.8 MB/s | 5.0 MB 00:01 2023-10-24T00:26:16.373 INFO:teuthology.orchestra.run.smithi148.stdout:(8/120): ceph-osd-16.2.14-127.ge93d5f89.el8.x86 6.3 MB/s | 18 MB 00:02 2023-10-24T00:26:16.425 INFO:teuthology.orchestra.run.smithi148.stdout:(9/120): ceph-selinux-16.2.14-127.ge93d5f89.el8 501 kB/s | 26 kB 00:00 2023-10-24T00:26:17.766 INFO:teuthology.orchestra.run.smithi150.stdout:(8/120): ceph-radosgw-16.2.14-127.ge93d5f89.el8 7.7 MB/s | 12 MB 00:01 2023-10-24T00:26:17.861 INFO:teuthology.orchestra.run.smithi150.stdout:(9/120): ceph-selinux-16.2.14-127.ge93d5f89.el8 271 kB/s | 26 kB 00:00 2023-10-24T00:26:19.272 INFO:teuthology.orchestra.run.smithi148.stdout:(10/120): ceph-radosgw-16.2.14-127.ge93d5f89.el 2.2 MB/s | 12 MB 00:05 2023-10-24T00:26:19.405 INFO:teuthology.orchestra.run.smithi148.stdout:(11/120): cephfs-mirror-16.2.14-127.ge93d5f89.e 1.9 MB/s | 257 kB 00:00 2023-10-24T00:26:19.471 INFO:teuthology.orchestra.run.smithi148.stdout:(12/120): libcephfs-devel-16.2.14-127.ge93d5f89 390 kB/s | 25 kB 00:00 2023-10-24T00:26:19.894 INFO:teuthology.orchestra.run.smithi148.stdout:(13/120): libcephfs2-16.2.14-127.ge93d5f89.el8. 1.9 MB/s | 824 kB 00:00 2023-10-24T00:26:20.038 INFO:teuthology.orchestra.run.smithi148.stdout:(14/120): libcephsqlite-16.2.14-127.ge93d5f89.e 1.2 MB/s | 174 kB 00:00 2023-10-24T00:26:20.113 INFO:teuthology.orchestra.run.smithi148.stdout:(15/120): librados-devel-16.2.14-127.ge93d5f89. 1.7 MB/s | 131 kB 00:00 2023-10-24T00:26:20.351 INFO:teuthology.orchestra.run.smithi148.stdout:(16/120): libradosstriper1-16.2.14-127.ge93d5f8 2.0 MB/s | 494 kB 00:00 2023-10-24T00:26:22.035 INFO:teuthology.orchestra.run.smithi148.stdout:(17/120): librgw2-16.2.14-127.ge93d5f89.el8.x86 2.3 MB/s | 3.8 MB 00:01 2023-10-24T00:26:22.113 INFO:teuthology.orchestra.run.smithi148.stdout:(18/120): python3-ceph-argparse-16.2.14-127.ge9 581 kB/s | 45 kB 00:00 2023-10-24T00:26:22.192 INFO:teuthology.orchestra.run.smithi148.stdout:(19/120): python3-ceph-common-16.2.14-127.ge93d 1.2 MB/s | 99 kB 00:00 2023-10-24T00:26:22.346 INFO:teuthology.orchestra.run.smithi148.stdout:(20/120): python3-cephfs-16.2.14-127.ge93d5f89. 1.4 MB/s | 215 kB 00:00 2023-10-24T00:26:22.557 INFO:teuthology.orchestra.run.smithi148.stdout:(21/120): python3-rados-16.2.14-127.ge93d5f89.e 1.8 MB/s | 390 kB 00:00 2023-10-24T00:26:22.777 INFO:teuthology.orchestra.run.smithi148.stdout:(22/120): python3-rbd-16.2.14-127.ge93d5f89.el8 1.6 MB/s | 369 kB 00:00 2023-10-24T00:26:22.851 INFO:teuthology.orchestra.run.smithi148.stdout:(23/120): python3-rgw-16.2.14-127.ge93d5f89.el8 1.5 MB/s | 114 kB 00:00 2023-10-24T00:26:22.927 INFO:teuthology.orchestra.run.smithi148.stdout:(24/120): rbd-fuse-16.2.14-127.ge93d5f89.el8.x8 1.1 MB/s | 88 kB 00:00 2023-10-24T00:26:23.192 INFO:teuthology.orchestra.run.smithi150.stdout:(10/120): ceph-common-16.2.14-127.ge93d5f89.el8 2.2 MB/s | 24 MB 00:11 2023-10-24T00:26:23.621 INFO:teuthology.orchestra.run.smithi150.stdout:(11/120): ceph-osd-16.2.14-127.ge93d5f89.el8.x8 2.2 MB/s | 18 MB 00:08 2023-10-24T00:26:23.669 INFO:teuthology.orchestra.run.smithi150.stdout:(12/120): cephfs-mirror-16.2.14-127.ge93d5f89.e 539 kB/s | 257 kB 00:00 2023-10-24T00:26:23.684 INFO:teuthology.orchestra.run.smithi150.stdout:(13/120): libcephfs-devel-16.2.14-127.ge93d5f89 402 kB/s | 25 kB 00:00 2023-10-24T00:26:23.829 INFO:teuthology.orchestra.run.smithi150.stdout:(14/120): libcephsqlite-16.2.14-127.ge93d5f89.e 1.2 MB/s | 174 kB 00:00 2023-10-24T00:26:23.977 INFO:teuthology.orchestra.run.smithi150.stdout:(15/120): librados-devel-16.2.14-127.ge93d5f89. 888 kB/s | 131 kB 00:00 2023-10-24T00:26:24.349 INFO:teuthology.orchestra.run.smithi150.stdout:(16/120): libradosstriper1-16.2.14-127.ge93d5f8 1.3 MB/s | 494 kB 00:00 2023-10-24T00:26:24.435 INFO:teuthology.orchestra.run.smithi148.stdout:(25/120): rbd-mirror-16.2.14-127.ge93d5f89.el8. 2.4 MB/s | 3.7 MB 00:01 2023-10-24T00:26:24.506 INFO:teuthology.orchestra.run.smithi148.stdout:(26/120): rbd-nbd-16.2.14-127.ge93d5f89.el8.x86 2.4 MB/s | 173 kB 00:00 2023-10-24T00:26:24.537 INFO:teuthology.orchestra.run.smithi150.stdout:(17/120): libcephfs2-16.2.14-127.ge93d5f89.el8. 949 kB/s | 824 kB 00:00 2023-10-24T00:26:24.573 INFO:teuthology.orchestra.run.smithi148.stdout:(27/120): ceph-grafana-dashboards-16.2.14-127.g 361 kB/s | 24 kB 00:00 2023-10-24T00:26:24.603 INFO:teuthology.orchestra.run.smithi150.stdout:(18/120): python3-ceph-argparse-16.2.14-127.ge9 688 kB/s | 45 kB 00:00 2023-10-24T00:26:24.640 INFO:teuthology.orchestra.run.smithi148.stdout:(28/120): ceph-mgr-cephadm-16.2.14-127.ge93d5f8 1.7 MB/s | 116 kB 00:00 2023-10-24T00:26:24.744 INFO:teuthology.orchestra.run.smithi150.stdout:(19/120): python3-ceph-common-16.2.14-127.ge93d 701 kB/s | 99 kB 00:00 2023-10-24T00:26:24.964 INFO:teuthology.orchestra.run.smithi150.stdout:(20/120): python3-cephfs-16.2.14-127.ge93d5f89. 977 kB/s | 215 kB 00:00 2023-10-24T00:26:25.222 INFO:teuthology.orchestra.run.smithi150.stdout:(21/120): python3-rados-16.2.14-127.ge93d5f89.e 1.5 MB/s | 390 kB 00:00 2023-10-24T00:26:25.422 INFO:teuthology.orchestra.run.smithi148.stdout:(29/120): ceph-common-16.2.14-127.ge93d5f89.el8 1.7 MB/s | 24 MB 00:14 2023-10-24T00:26:25.454 INFO:teuthology.orchestra.run.smithi150.stdout:(22/120): python3-rbd-16.2.14-127.ge93d5f89.el8 1.6 MB/s | 369 kB 00:00 2023-10-24T00:26:25.918 INFO:teuthology.orchestra.run.smithi148.stdout:(30/120): ceph-mgr-dashboard-16.2.14-127.ge93d5 2.4 MB/s | 3.1 MB 00:01 2023-10-24T00:26:26.055 INFO:teuthology.orchestra.run.smithi150.stdout:(23/120): python3-rgw-16.2.14-127.ge93d5f89.el8 190 kB/s | 114 kB 00:00 2023-10-24T00:26:26.066 INFO:teuthology.orchestra.run.smithi148.stdout:(31/120): ceph-mgr-modules-core-16.2.14-127.ge9 1.6 MB/s | 245 kB 00:00 2023-10-24T00:26:26.141 INFO:teuthology.orchestra.run.smithi148.stdout:(32/120): ceph-mgr-rook-16.2.14-127.ge93d5f89.e 368 kB/s | 27 kB 00:00 2023-10-24T00:26:26.204 INFO:teuthology.orchestra.run.smithi150.stdout:(24/120): rbd-fuse-16.2.14-127.ge93d5f89.el8.x8 597 kB/s | 88 kB 00:00 2023-10-24T00:26:26.213 INFO:teuthology.orchestra.run.smithi148.stdout:(33/120): ceph-prometheus-alerts-16.2.14-127.ge 206 kB/s | 15 kB 00:00 2023-10-24T00:26:26.256 INFO:teuthology.orchestra.run.smithi150.stdout:(25/120): librgw2-16.2.14-127.ge93d5f89.el8.x86 2.0 MB/s | 3.8 MB 00:01 2023-10-24T00:26:26.289 INFO:teuthology.orchestra.run.smithi148.stdout:(34/120): cephadm-16.2.14-127.ge93d5f89.el8.noa 1.1 MB/s | 85 kB 00:00 2023-10-24T00:26:26.366 INFO:teuthology.orchestra.run.smithi148.stdout:(35/120): cephfs-top-16.2.14-127.ge93d5f89.el8. 243 kB/s | 19 kB 00:00 2023-10-24T00:26:26.401 INFO:teuthology.orchestra.run.smithi150.stdout:(26/120): rbd-nbd-16.2.14-127.ge93d5f89.el8.x86 1.2 MB/s | 173 kB 00:00 2023-10-24T00:26:26.470 INFO:teuthology.orchestra.run.smithi150.stdout:(27/120): ceph-grafana-dashboards-16.2.14-127.g 354 kB/s | 24 kB 00:00 2023-10-24T00:26:26.526 INFO:teuthology.orchestra.run.smithi150.stdout:(28/120): ceph-mgr-cephadm-16.2.14-127.ge93d5f8 2.0 MB/s | 116 kB 00:00 2023-10-24T00:26:26.538 INFO:teuthology.orchestra.run.smithi148.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2023-10-24T00:26:26.598 INFO:teuthology.orchestra.run.smithi148.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 3.0 MB/s | 181 kB 00:00 2023-10-24T00:26:26.623 INFO:teuthology.orchestra.run.smithi148.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.2 MB/s | 59 kB 00:00 2023-10-24T00:26:26.641 INFO:teuthology.orchestra.run.smithi148.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 4.3 MB/s | 75 kB 00:00 2023-10-24T00:26:26.667 INFO:teuthology.orchestra.run.smithi148.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 824 kB/s | 21 kB 00:00 2023-10-24T00:26:26.691 INFO:teuthology.orchestra.run.smithi148.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.8 MB/s | 44 kB 00:00 2023-10-24T00:26:26.742 INFO:teuthology.orchestra.run.smithi148.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-10-24T00:26:26.767 INFO:teuthology.orchestra.run.smithi148.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.3 MB/s | 33 kB 00:00 2023-10-24T00:26:26.795 INFO:teuthology.orchestra.run.smithi148.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 585 kB/s | 16 kB 00:00 2023-10-24T00:26:26.853 INFO:teuthology.orchestra.run.smithi148.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-10-24T00:26:26.962 INFO:teuthology.orchestra.run.smithi148.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-10-24T00:26:27.078 INFO:teuthology.orchestra.run.smithi148.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 3.0 MB/s | 355 kB 00:00 2023-10-24T00:26:27.104 INFO:teuthology.orchestra.run.smithi148.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 3.2 MB/s | 81 kB 00:00 2023-10-24T00:26:27.121 INFO:teuthology.orchestra.run.smithi148.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 660 kB/s | 11 kB 00:00 2023-10-24T00:26:27.139 INFO:teuthology.orchestra.run.smithi148.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 1.0 MB/s | 18 kB 00:00 2023-10-24T00:26:27.455 INFO:teuthology.orchestra.run.smithi148.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-10-24T00:26:27.472 INFO:teuthology.orchestra.run.smithi148.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 2.7 MB/s | 49 kB 00:00 2023-10-24T00:26:27.490 INFO:teuthology.orchestra.run.smithi148.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 3.3 MB/s | 59 kB 00:00 2023-10-24T00:26:27.572 INFO:teuthology.orchestra.run.smithi148.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.4 MB/s | 283 kB 00:00 2023-10-24T00:26:27.589 INFO:teuthology.orchestra.run.smithi148.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 915 kB/s | 16 kB 00:00 2023-10-24T00:26:27.612 INFO:teuthology.orchestra.run.smithi148.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 2.1 MB/s | 49 kB 00:00 2023-10-24T00:26:27.637 INFO:teuthology.orchestra.run.smithi148.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.3 MB/s | 34 kB 00:00 2023-10-24T00:26:27.697 INFO:teuthology.orchestra.run.smithi148.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 3.2 MB/s | 196 kB 00:00 2023-10-24T00:26:27.722 INFO:teuthology.orchestra.run.smithi148.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.6 MB/s | 64 kB 00:00 2023-10-24T00:26:27.744 INFO:teuthology.orchestra.run.smithi148.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 854 kB/s | 19 kB 00:00 2023-10-24T00:26:27.761 INFO:teuthology.orchestra.run.smithi148.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2023-10-24T00:26:27.786 INFO:teuthology.orchestra.run.smithi148.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.2 MB/s | 29 kB 00:00 2023-10-24T00:26:27.803 INFO:teuthology.orchestra.run.smithi148.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2023-10-24T00:26:27.881 INFO:teuthology.orchestra.run.smithi148.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 3.2 MB/s | 255 kB 00:00 2023-10-24T00:26:27.924 INFO:teuthology.orchestra.run.smithi150.stdout:(29/120): ceph-mgr-dashboard-16.2.14-127.ge93d5 2.2 MB/s | 3.1 MB 00:01 2023-10-24T00:26:27.957 INFO:teuthology.orchestra.run.smithi148.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-10-24T00:26:27.986 INFO:teuthology.orchestra.run.smithi148.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 2.1 MB/s | 61 kB 00:00 2023-10-24T00:26:28.015 INFO:teuthology.orchestra.run.smithi148.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.9 MB/s | 85 kB 00:00 2023-10-24T00:26:28.034 INFO:teuthology.orchestra.run.smithi148.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-10-24T00:26:28.039 INFO:teuthology.orchestra.run.smithi148.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 MB/s | 70 kB 00:00 2023-10-24T00:26:28.306 INFO:teuthology.orchestra.run.smithi148.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 55 MB/s | 15 MB 00:00 2023-10-24T00:26:28.322 INFO:teuthology.orchestra.run.smithi148.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 2.7 MB/s | 44 kB 00:00 2023-10-24T00:26:28.336 INFO:teuthology.orchestra.run.smithi148.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-24T00:26:28.353 INFO:teuthology.orchestra.run.smithi148.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.7 MB/s | 161 kB 00:00 2023-10-24T00:26:28.370 INFO:teuthology.orchestra.run.smithi148.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-24T00:26:28.387 INFO:teuthology.orchestra.run.smithi148.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 26 MB/s | 457 kB 00:00 2023-10-24T00:26:28.452 INFO:teuthology.orchestra.run.smithi148.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 74 MB/s | 4.8 MB 00:00 2023-10-24T00:26:28.466 INFO:teuthology.orchestra.run.smithi148.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-24T00:26:28.486 INFO:teuthology.orchestra.run.smithi148.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 34 MB/s | 688 kB 00:00 2023-10-24T00:26:28.500 INFO:teuthology.orchestra.run.smithi148.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-10-24T00:26:28.514 INFO:teuthology.orchestra.run.smithi148.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 16 MB/s | 225 kB 00:00 2023-10-24T00:26:28.527 INFO:teuthology.orchestra.run.smithi148.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.5 MB/s | 126 kB 00:00 2023-10-24T00:26:28.579 INFO:teuthology.orchestra.run.smithi148.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 73 MB/s | 3.7 MB 00:00 2023-10-24T00:26:28.593 INFO:teuthology.orchestra.run.smithi148.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-24T00:26:28.610 INFO:teuthology.orchestra.run.smithi148.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 32 MB/s | 538 kB 00:00 2023-10-24T00:26:28.626 INFO:teuthology.orchestra.run.smithi148.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-10-24T00:26:28.639 INFO:teuthology.orchestra.run.smithi148.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-10-24T00:26:28.653 INFO:teuthology.orchestra.run.smithi148.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.7 MB/s | 110 kB 00:00 2023-10-24T00:26:28.666 INFO:teuthology.orchestra.run.smithi148.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 24 MB/s | 353 kB 00:00 2023-10-24T00:26:28.679 INFO:teuthology.orchestra.run.smithi148.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-10-24T00:26:28.697 INFO:teuthology.orchestra.run.smithi148.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 38 MB/s | 709 kB 00:00 2023-10-24T00:26:28.709 INFO:teuthology.orchestra.run.smithi148.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.5 MB/s | 54 kB 00:00 2023-10-24T00:26:28.771 INFO:teuthology.orchestra.run.smithi150.stdout:(30/120): rbd-mirror-16.2.14-127.ge93d5f89.el8. 1.4 MB/s | 3.7 MB 00:02 2023-10-24T00:26:28.772 INFO:teuthology.orchestra.run.smithi148.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 75 MB/s | 4.7 MB 00:00 2023-10-24T00:26:28.809 INFO:teuthology.orchestra.run.smithi148.stdout:(93/120): ceph-mgr-diskprediction-local-16.2.14 2.5 MB/s | 8.6 MB 00:03 2023-10-24T00:26:28.845 INFO:teuthology.orchestra.run.smithi148.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-10-24T00:26:28.857 INFO:teuthology.orchestra.run.smithi148.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.6 MB/s | 19 kB 00:00 2023-10-24T00:26:28.870 INFO:teuthology.orchestra.run.smithi148.stdout:(96/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-24T00:26:28.871 INFO:teuthology.orchestra.run.smithi148.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-10-24T00:26:28.883 INFO:teuthology.orchestra.run.smithi148.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 12 MB/s | 155 kB 00:00 2023-10-24T00:26:28.886 INFO:teuthology.orchestra.run.smithi148.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-24T00:26:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.8 MB/s | 48 kB 00:00 2023-10-24T00:26:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 16 MB/s | 229 kB 00:00 2023-10-24T00:26:28.910 INFO:teuthology.orchestra.run.smithi148.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.0 MB/s | 43 kB 00:00 2023-10-24T00:26:28.921 INFO:teuthology.orchestra.run.smithi148.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.6 MB/s | 18 kB 00:00 2023-10-24T00:26:28.941 INFO:teuthology.orchestra.run.smithi148.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 58 MB/s | 2.3 MB 00:00 2023-10-24T00:26:28.946 INFO:teuthology.orchestra.run.smithi148.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 25 MB/s | 605 kB 00:00 2023-10-24T00:26:28.955 INFO:teuthology.orchestra.run.smithi148.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 5.9 MB/s | 83 kB 00:00 2023-10-24T00:26:28.960 INFO:teuthology.orchestra.run.smithi148.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.1 MB/s | 59 kB 00:00 2023-10-24T00:26:28.970 INFO:teuthology.orchestra.run.smithi148.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-24T00:26:28.972 INFO:teuthology.orchestra.run.smithi150.stdout:(31/120): ceph-mgr-modules-core-16.2.14-127.ge9 1.2 MB/s | 245 kB 00:00 2023-10-24T00:26:28.973 INFO:teuthology.orchestra.run.smithi148.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.8 MB/s | 38 kB 00:00 2023-10-24T00:26:28.986 INFO:teuthology.orchestra.run.smithi148.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.5 MB/s | 86 kB 00:00 2023-10-24T00:26:28.987 INFO:teuthology.orchestra.run.smithi148.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-10-24T00:26:28.998 INFO:teuthology.orchestra.run.smithi148.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.6 MB/s | 47 kB 00:00 2023-10-24T00:26:29.005 INFO:teuthology.orchestra.run.smithi148.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 31 MB/s | 559 kB 00:00 2023-10-24T00:26:29.017 INFO:teuthology.orchestra.run.smithi148.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 34 MB/s | 639 kB 00:00 2023-10-24T00:26:29.018 INFO:teuthology.orchestra.run.smithi148.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.2 MB/s | 70 kB 00:00 2023-10-24T00:26:29.034 INFO:teuthology.orchestra.run.smithi148.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.2 MB/s | 97 kB 00:00 2023-10-24T00:26:29.034 INFO:teuthology.orchestra.run.smithi150.stdout:(32/120): ceph-mgr-rook-16.2.14-127.ge93d5f89.e 441 kB/s | 27 kB 00:00 2023-10-24T00:26:29.035 INFO:teuthology.orchestra.run.smithi148.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 11 MB/s | 200 kB 00:00 2023-10-24T00:26:29.101 INFO:teuthology.orchestra.run.smithi150.stdout:(33/120): ceph-prometheus-alerts-16.2.14-127.ge 224 kB/s | 15 kB 00:00 2023-10-24T00:26:29.246 INFO:teuthology.orchestra.run.smithi150.stdout:(34/120): cephadm-16.2.14-127.ge93d5f89.el8.noa 587 kB/s | 85 kB 00:00 2023-10-24T00:26:29.323 INFO:teuthology.orchestra.run.smithi150.stdout:(35/120): cephfs-top-16.2.14-127.ge93d5f89.el8. 244 kB/s | 19 kB 00:00 2023-10-24T00:26:29.605 INFO:teuthology.orchestra.run.smithi150.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-10-24T00:26:29.660 INFO:teuthology.orchestra.run.smithi150.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 3.2 MB/s | 181 kB 00:00 2023-10-24T00:26:29.703 INFO:teuthology.orchestra.run.smithi150.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-24T00:26:29.747 INFO:teuthology.orchestra.run.smithi150.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2023-10-24T00:26:29.786 INFO:teuthology.orchestra.run.smithi150.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 546 kB/s | 21 kB 00:00 2023-10-24T00:26:29.827 INFO:teuthology.orchestra.run.smithi150.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-10-24T00:26:29.881 INFO:teuthology.orchestra.run.smithi150.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 3.4 MB/s | 185 kB 00:00 2023-10-24T00:26:29.922 INFO:teuthology.orchestra.run.smithi150.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 813 kB/s | 33 kB 00:00 2023-10-24T00:26:29.960 INFO:teuthology.orchestra.run.smithi150.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 424 kB/s | 16 kB 00:00 2023-10-24T00:26:30.013 INFO:teuthology.orchestra.run.smithi150.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.2 MB/s | 173 kB 00:00 2023-10-24T00:26:30.095 INFO:teuthology.orchestra.run.smithi150.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.6 MB/s | 384 kB 00:00 2023-10-24T00:26:30.149 INFO:teuthology.orchestra.run.smithi150.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 6.5 MB/s | 355 kB 00:00 2023-10-24T00:26:30.192 INFO:teuthology.orchestra.run.smithi150.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-10-24T00:26:30.231 INFO:teuthology.orchestra.run.smithi150.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 283 kB/s | 11 kB 00:00 2023-10-24T00:26:30.270 INFO:teuthology.orchestra.run.smithi150.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 453 kB/s | 18 kB 00:00 2023-10-24T00:26:30.360 INFO:teuthology.orchestra.run.smithi150.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-10-24T00:26:30.399 INFO:teuthology.orchestra.run.smithi150.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2023-10-24T00:26:30.425 INFO:teuthology.orchestra.run.smithi148.stdout:(118/120): librados2-16.2.14-127.ge93d5f89.el8. 2.7 MB/s | 3.7 MB 00:01 2023-10-24T00:26:30.438 INFO:teuthology.orchestra.run.smithi150.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.5 MB/s | 59 kB 00:00 2023-10-24T00:26:30.481 INFO:teuthology.orchestra.run.smithi150.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 6.4 MB/s | 283 kB 00:00 2023-10-24T00:26:30.524 INFO:teuthology.orchestra.run.smithi150.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 367 kB/s | 16 kB 00:00 2023-10-24T00:26:30.563 INFO:teuthology.orchestra.run.smithi150.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 1.2 MB/s | 49 kB 00:00 2023-10-24T00:26:30.601 INFO:teuthology.orchestra.run.smithi150.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 883 kB/s | 34 kB 00:00 2023-10-24T00:26:30.644 INFO:teuthology.orchestra.run.smithi150.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 4.5 MB/s | 196 kB 00:00 2023-10-24T00:26:30.683 INFO:teuthology.orchestra.run.smithi150.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.6 MB/s | 64 kB 00:00 2023-10-24T00:26:30.721 INFO:teuthology.orchestra.run.smithi150.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 496 kB/s | 19 kB 00:00 2023-10-24T00:26:30.759 INFO:teuthology.orchestra.run.smithi150.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 632 kB/s | 24 kB 00:00 2023-10-24T00:26:30.797 INFO:teuthology.orchestra.run.smithi150.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 777 kB/s | 29 kB 00:00 2023-10-24T00:26:30.836 INFO:teuthology.orchestra.run.smithi150.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 714 kB/s | 27 kB 00:00 2023-10-24T00:26:30.880 INFO:teuthology.orchestra.run.smithi150.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 5.7 MB/s | 255 kB 00:00 2023-10-24T00:26:30.922 INFO:teuthology.orchestra.run.smithi150.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.8 MB/s | 251 kB 00:00 2023-10-24T00:26:30.963 INFO:teuthology.orchestra.run.smithi150.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2023-10-24T00:26:31.030 INFO:teuthology.orchestra.run.smithi150.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-10-24T00:26:31.070 INFO:teuthology.orchestra.run.smithi150.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 573 kB/s | 23 kB 00:00 2023-10-24T00:26:31.142 INFO:teuthology.orchestra.run.smithi150.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 977 kB/s | 70 kB 00:00 2023-10-24T00:26:31.349 INFO:teuthology.orchestra.run.smithi148.stdout:(119/120): ceph-test-16.2.14-127.ge93d5f89.el8. 3.5 MB/s | 52 MB 00:14 2023-10-24T00:26:31.365 INFO:teuthology.orchestra.run.smithi148.stdout:(120/120): librbd1-16.2.14-127.ge93d5f89.el8.x8 1.8 MB/s | 4.2 MB 00:02 2023-10-24T00:26:31.370 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-10-24T00:26:31.370 INFO:teuthology.orchestra.run.smithi148.stdout:Total 9.9 MB/s | 201 MB 00:20 2023-10-24T00:26:31.375 INFO:teuthology.orchestra.run.smithi150.stdout:(70/120): ceph-mgr-diskprediction-local-16.2.14 2.5 MB/s | 8.6 MB 00:03 2023-10-24T00:26:31.408 INFO:teuthology.orchestra.run.smithi150.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.6 MB/s | 44 kB 00:00 2023-10-24T00:26:31.422 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-10-24T00:26:31.424 INFO:teuthology.orchestra.run.smithi150.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-10-24T00:26:31.439 INFO:teuthology.orchestra.run.smithi150.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-24T00:26:31.457 INFO:teuthology.orchestra.run.smithi150.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-10-24T00:26:31.516 INFO:teuthology.orchestra.run.smithi150.stdout:(75/120): python3-scipy-1.0.0-20.module+el8.1.0 39 MB/s | 15 MB 00:00 2023-10-24T00:26:31.538 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-10-24T00:26:31.538 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-10-24T00:26:31.633 INFO:teuthology.orchestra.run.smithi150.stdout:(76/120): python3-werkzeug-0.12.2-4.el8.noarch. 2.5 MB/s | 457 kB 00:00 2023-10-24T00:26:31.647 INFO:teuthology.orchestra.run.smithi150.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-24T00:26:31.668 INFO:teuthology.orchestra.run.smithi150.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 32 MB/s | 688 kB 00:00 2023-10-24T00:26:31.693 INFO:teuthology.orchestra.run.smithi150.stdout:(79/120): python3-babel-2.5.1-5.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-10-24T00:26:31.696 INFO:teuthology.orchestra.run.smithi150.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.2 MB/s | 259 kB 00:00 2023-10-24T00:26:31.708 INFO:teuthology.orchestra.run.smithi150.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2023-10-24T00:26:31.710 INFO:teuthology.orchestra.run.smithi150.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.2 MB/s | 126 kB 00:00 2023-10-24T00:26:31.724 INFO:teuthology.orchestra.run.smithi150.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-24T00:26:31.743 INFO:teuthology.orchestra.run.smithi150.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 29 MB/s | 538 kB 00:00 2023-10-24T00:26:31.764 INFO:teuthology.orchestra.run.smithi150.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 67 MB/s | 3.7 MB 00:00 2023-10-24T00:26:31.767 INFO:teuthology.orchestra.run.smithi150.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2023-10-24T00:26:31.780 INFO:teuthology.orchestra.run.smithi150.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.8 MB/s | 157 kB 00:00 2023-10-24T00:26:31.781 INFO:teuthology.orchestra.run.smithi150.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.8 MB/s | 110 kB 00:00 2023-10-24T00:26:31.794 INFO:teuthology.orchestra.run.smithi150.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2023-10-24T00:26:31.796 INFO:teuthology.orchestra.run.smithi150.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-24T00:26:31.809 INFO:teuthology.orchestra.run.smithi150.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.3 MB/s | 54 kB 00:00 2023-10-24T00:26:31.814 INFO:teuthology.orchestra.run.smithi150.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-24T00:26:31.884 INFO:teuthology.orchestra.run.smithi150.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 63 MB/s | 4.7 MB 00:00 2023-10-24T00:26:31.901 INFO:teuthology.orchestra.run.smithi150.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-10-24T00:26:31.909 INFO:teuthology.orchestra.run.smithi150.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 28 MB/s | 713 kB 00:00 2023-10-24T00:26:31.913 INFO:teuthology.orchestra.run.smithi150.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.5 MB/s | 19 kB 00:00 2023-10-24T00:26:31.922 INFO:teuthology.orchestra.run.smithi150.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.2 MB/s | 43 kB 00:00 2023-10-24T00:26:31.927 INFO:teuthology.orchestra.run.smithi150.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-24T00:26:31.937 INFO:teuthology.orchestra.run.smithi150.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-10-24T00:26:31.940 INFO:teuthology.orchestra.run.smithi150.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.7 MB/s | 48 kB 00:00 2023-10-24T00:26:31.952 INFO:teuthology.orchestra.run.smithi150.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-24T00:26:31.953 INFO:teuthology.orchestra.run.smithi150.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.2 MB/s | 43 kB 00:00 2023-10-24T00:26:31.966 INFO:teuthology.orchestra.run.smithi150.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.4 MB/s | 18 kB 00:00 2023-10-24T00:26:31.987 INFO:teuthology.orchestra.run.smithi150.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2023-10-24T00:26:31.995 INFO:teuthology.orchestra.run.smithi150.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 55 MB/s | 2.3 MB 00:00 2023-10-24T00:26:32.002 INFO:teuthology.orchestra.run.smithi150.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 5.4 MB/s | 83 kB 00:00 2023-10-24T00:26:32.008 INFO:teuthology.orchestra.run.smithi150.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.2 MB/s | 59 kB 00:00 2023-10-24T00:26:32.016 INFO:teuthology.orchestra.run.smithi150.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-10-24T00:26:32.021 INFO:teuthology.orchestra.run.smithi150.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 3.0 MB/s | 38 kB 00:00 2023-10-24T00:26:32.030 INFO:teuthology.orchestra.run.smithi150.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.4 MB/s | 86 kB 00:00 2023-10-24T00:26:32.034 INFO:teuthology.orchestra.run.smithi150.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.5 MB/s | 58 kB 00:00 2023-10-24T00:26:32.046 INFO:teuthology.orchestra.run.smithi150.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.8 MB/s | 47 kB 00:00 2023-10-24T00:26:32.058 INFO:teuthology.orchestra.run.smithi150.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 22 MB/s | 559 kB 00:00 2023-10-24T00:26:32.065 INFO:teuthology.orchestra.run.smithi150.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 33 MB/s | 639 kB 00:00 2023-10-24T00:26:32.071 INFO:teuthology.orchestra.run.smithi150.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.5 MB/s | 70 kB 00:00 2023-10-24T00:26:32.081 INFO:teuthology.orchestra.run.smithi150.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-10-24T00:26:32.085 INFO:teuthology.orchestra.run.smithi150.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.8 MB/s | 97 kB 00:00 2023-10-24T00:26:33.017 INFO:teuthology.orchestra.run.smithi150.stdout:(118/120): ceph-test-16.2.14-127.ge93d5f89.el8. 3.4 MB/s | 52 MB 00:15 2023-10-24T00:26:33.158 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-10-24T00:26:33.161 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-10-24T00:26:33.227 INFO:teuthology.orchestra.run.smithi150.stdout:(119/120): librados2-16.2.14-127.ge93d5f89.el8. 3.3 MB/s | 3.7 MB 00:01 2023-10-24T00:26:33.702 INFO:teuthology.orchestra.run.smithi150.stdout:(120/120): librbd1-16.2.14-127.ge93d5f89.el8.x8 2.6 MB/s | 4.2 MB 00:01 2023-10-24T00:26:33.706 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2023-10-24T00:26:33.707 INFO:teuthology.orchestra.run.smithi150.stdout:Total 9.2 MB/s | 201 MB 00:21 2023-10-24T00:26:33.758 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2023-10-24T00:26:33.874 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2023-10-24T00:26:33.874 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2023-10-24T00:26:35.571 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2023-10-24T00:26:35.575 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2023-10-24T00:26:37.644 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-10-24T00:26:37.851 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-24T00:26:38.033 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-10-24T00:26:38.235 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-10-24T00:26:38.445 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-10-24T00:26:38.573 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-10-24T00:26:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-10-24T00:26:39.164 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-10-24T00:26:39.361 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:26:39.763 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:26:39.961 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:26:40.085 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:26:40.303 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:26:40.399 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:26:40.594 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2023-10-24T00:26:40.833 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-24T00:26:40.917 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 9/122 2023-10-24T00:26:41.015 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-10-24T00:26:41.111 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:26:41.215 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-10-24T00:26:41.221 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:26:41.435 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-10-24T00:26:41.482 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-24T00:26:41.559 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-10-24T00:26:41.643 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-24T00:26:41.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-10-24T00:26:41.836 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:26:41.956 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:26:42.077 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 14/122 2023-10-24T00:26:42.127 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-10-24T00:26:42.132 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 14/122 2023-10-24T00:26:42.253 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-24T00:26:42.436 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-24T00:26:42.558 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-24T00:26:42.685 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:26:42.744 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-24T00:26:43.095 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:26:43.301 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-24T00:26:43.343 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:26:43.451 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:26:43.477 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-24T00:26:43.634 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:26:43.714 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:26:43.991 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-24T00:26:44.177 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-24T00:26:44.240 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 9/122 2023-10-24T00:26:44.401 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:26:44.497 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:26:44.747 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-24T00:26:44.903 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-24T00:26:44.908 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-24T00:26:45.076 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:26:45.168 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:26:45.189 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-24T00:26:45.351 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 14/122 2023-10-24T00:26:45.359 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-24T00:26:45.432 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 14/122 2023-10-24T00:26:45.568 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-24T00:26:45.573 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-24T00:26:45.735 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-24T00:26:45.816 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-24T00:26:45.878 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-24T00:26:46.092 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-24T00:26:46.120 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-24T00:26:46.343 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-24T00:26:46.516 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:16.2.14-127.ge93d5f89.el8. 26/122 2023-10-24T00:26:46.627 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-24T00:26:46.657 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el 27/122 2023-10-24T00:26:46.793 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-24T00:26:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_6 28/122 2023-10-24T00:26:47.307 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-24T00:26:47.501 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-24T00:26:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-24T00:26:48.216 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-24T00:26:48.224 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-24T00:26:48.502 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-24T00:26:48.529 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-24T00:26:48.716 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-24T00:26:48.749 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-24T00:26:48.888 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-24T00:26:49.028 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-24T00:26:49.139 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-24T00:26:49.285 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-24T00:26:49.477 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-24T00:26:49.706 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-24T00:26:49.848 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:16.2.14-127.ge93d5f89.el8. 26/122 2023-10-24T00:26:49.997 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el 27/122 2023-10-24T00:26:50.232 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_6 28/122 2023-10-24T00:26:51.201 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-24T00:26:51.374 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-24T00:26:51.530 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-24T00:26:51.680 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-24T00:26:51.792 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-24T00:26:51.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-24T00:26:52.039 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-24T00:26:52.163 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-24T00:26:52.300 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-24T00:26:52.361 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 38/122 2023-10-24T00:26:52.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 39/122 2023-10-24T00:26:52.550 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-24T00:26:52.747 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_6 40/122 2023-10-24T00:26:52.925 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-24T00:26:53.073 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-24T00:26:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-24T00:26:53.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-24T00:26:53.605 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-24T00:26:53.774 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-24T00:26:53.920 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-24T00:26:54.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-24T00:26:54.465 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-24T00:26:54.624 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-24T00:26:54.702 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-24T00:26:54.953 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-24T00:26:55.036 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-24T00:26:55.206 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-24T00:26:55.249 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-24T00:26:55.411 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-24T00:26:55.466 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-24T00:26:55.642 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 38/122 2023-10-24T00:26:55.646 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-24T00:26:55.820 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-24T00:26:55.847 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 39/122 2023-10-24T00:26:55.975 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-24T00:26:56.018 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_6 40/122 2023-10-24T00:26:56.061 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-24T00:26:56.181 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-24T00:26:56.251 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-24T00:26:56.371 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-24T00:26:56.433 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-24T00:26:56.518 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-24T00:26:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-24T00:26:56.685 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-24T00:26:56.763 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-24T00:26:56.820 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-24T00:26:57.023 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-24T00:26:57.032 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-24T00:26:57.185 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-24T00:26:57.267 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-24T00:26:57.469 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-24T00:26:57.514 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-24T00:26:57.613 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-24T00:26:57.762 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-24T00:26:57.812 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-24T00:26:57.944 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-24T00:26:58.040 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-24T00:26:58.171 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-24T00:26:58.359 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-24T00:26:58.370 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-10-24T00:26:58.557 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-24T00:26:58.558 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-10-24T00:26:58.723 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-24T00:26:58.776 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-10-24T00:26:58.920 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-24T00:26:59.006 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-10-24T00:26:59.137 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-24T00:26:59.216 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-10-24T00:26:59.316 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-24T00:26:59.401 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-24T00:26:59.499 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-10-24T00:26:59.591 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-24T00:26:59.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-10-24T00:26:59.802 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-24T00:26:59.926 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-10-24T00:26:59.958 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-24T00:27:00.145 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-24T00:27:00.160 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-10-24T00:27:00.430 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-24T00:27:00.641 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-24T00:27:00.829 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-24T00:27:01.004 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-24T00:27:01.160 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-24T00:27:01.318 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-10-24T00:27:01.342 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-24T00:27:01.526 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-24T00:27:01.581 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-10-24T00:27:01.761 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-10-24T00:27:01.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-10-24T00:27:01.947 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-10-24T00:27:02.126 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-10-24T00:27:02.168 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-10-24T00:27:02.377 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-10-24T00:27:02.386 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-10-24T00:27:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-10-24T00:27:02.596 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-10-24T00:27:02.831 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-10-24T00:27:02.892 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-10-24T00:27:03.123 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-10-24T00:27:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-10-24T00:27:03.314 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-10-24T00:27:03.325 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-10-24T00:27:03.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-10-24T00:27:03.580 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-10-24T00:27:03.725 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-10-24T00:27:04.730 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-10-24T00:27:05.039 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-10-24T00:27:05.242 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-10-24T00:27:05.567 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-10-24T00:27:05.840 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-10-24T00:27:06.022 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-10-24T00:27:06.287 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-10-24T00:27:06.596 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-10-24T00:27:06.821 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-10-24T00:27:07.027 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-10-24T00:27:07.240 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-10-24T00:27:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:08.807 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:09.790 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 89/122 2023-10-24T00:27:09.887 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 89/122 2023-10-24T00:27:10.007 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 90/122 2023-10-24T00:27:12.291 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:12.541 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:13.246 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 88/122 2023-10-24T00:27:13.896 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 89/122 2023-10-24T00:27:14.477 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 89/122 2023-10-24T00:27:14.614 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 90/122 2023-10-24T00:27:28.464 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 90/122 2023-10-24T00:27:28.464 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2023-10-24T00:27:28.464 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2023-10-24T00:27:28.465 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-10-24T00:27:28.465 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /run 2023-10-24T00:27:28.465 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2023-10-24T00:27:28.465 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2023-10-24T00:27:28.465 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2023-10-24T00:27:28.466 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2023-10-24T00:27:28.466 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /dev 2023-10-24T00:27:28.466 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:27:28.821 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 91/122 2023-10-24T00:27:29.266 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 91/122 2023-10-24T00:27:29.412 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 92/122 2023-10-24T00:27:30.906 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 92/122 2023-10-24T00:27:31.120 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 93/122 2023-10-24T00:27:31.142 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 93/122 2023-10-24T00:27:32.681 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 90/122 2023-10-24T00:27:32.681 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2023-10-24T00:27:32.682 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2023-10-24T00:27:32.682 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-10-24T00:27:32.682 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2023-10-24T00:27:32.682 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2023-10-24T00:27:32.682 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2023-10-24T00:27:32.683 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2023-10-24T00:27:32.683 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2023-10-24T00:27:32.683 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2023-10-24T00:27:32.683 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:27:33.062 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 91/122 2023-10-24T00:27:33.497 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 91/122 2023-10-24T00:27:33.695 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 92/122 2023-10-24T00:27:33.890 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 94/122 2023-10-24T00:27:34.014 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 94/122 2023-10-24T00:27:34.202 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.e 95/122 2023-10-24T00:27:34.406 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89. 96/122 2023-10-24T00:27:34.611 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 97/122 2023-10-24T00:27:35.182 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 92/122 2023-10-24T00:27:35.362 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 93/122 2023-10-24T00:27:35.383 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 93/122 2023-10-24T00:27:35.582 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 97/122 2023-10-24T00:27:35.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 98/122 2023-10-24T00:27:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 98/122 2023-10-24T00:27:37.052 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 99/122 2023-10-24T00:27:37.152 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 99/122 2023-10-24T00:27:37.530 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el 100/122 2023-10-24T00:27:37.702 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 101/122 2023-10-24T00:27:37.730 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 101/122 2023-10-24T00:27:37.869 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 102/122 2023-10-24T00:27:37.881 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 102/122 2023-10-24T00:27:38.297 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 94/122 2023-10-24T00:27:38.455 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 94/122 2023-10-24T00:27:38.618 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.e 95/122 2023-10-24T00:27:38.805 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89. 96/122 2023-10-24T00:27:38.967 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 103/122 2023-10-24T00:27:39.002 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 97/122 2023-10-24T00:27:39.202 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 104/122 2023-10-24T00:27:39.293 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 104/122 2023-10-24T00:27:39.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-127.ge93d5 105/122 2023-10-24T00:27:39.471 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-127.ge93d5 105/122 2023-10-24T00:27:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 106/122 2023-10-24T00:27:39.959 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 106/122 2023-10-24T00:27:39.962 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 97/122 2023-10-24T00:27:40.119 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 107/122 2023-10-24T00:27:40.218 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 98/122 2023-10-24T00:27:41.270 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 98/122 2023-10-24T00:27:41.444 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 99/122 2023-10-24T00:27:41.539 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 99/122 2023-10-24T00:27:41.903 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el 100/122 2023-10-24T00:27:42.094 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 101/122 2023-10-24T00:27:42.120 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 101/122 2023-10-24T00:27:42.269 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 102/122 2023-10-24T00:27:42.280 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 102/122 2023-10-24T00:27:43.356 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 103/122 2023-10-24T00:27:43.610 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 104/122 2023-10-24T00:27:43.684 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 104/122 2023-10-24T00:27:43.819 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-127.ge93d5 105/122 2023-10-24T00:27:43.862 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-127.ge93d5 105/122 2023-10-24T00:27:43.977 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 106/122 2023-10-24T00:27:44.323 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 106/122 2023-10-24T00:27:44.486 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 107/122 2023-10-24T00:27:44.714 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 107/122 2023-10-24T00:27:45.001 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 108/122 2023-10-24T00:27:45.159 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-24T00:27:45.873 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-24T00:27:46.184 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-24T00:27:46.376 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 111/122 2023-10-24T00:27:46.538 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-24T00:27:46.664 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_ 113/122 2023-10-24T00:27:46.789 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-24T00:27:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 115/122 2023-10-24T00:27:47.120 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 116/122 2023-10-24T00:27:47.252 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 117/122 2023-10-24T00:27:47.468 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-24T00:27:47.634 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-24T00:27:47.693 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-24T00:27:47.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-24T00:27:47.852 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-24T00:27:47.852 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-24T00:27:48.079 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-24T00:27:48.079 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:48.887 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:48.888 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 1/122 2023-10-24T00:27:48.888 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 2/122 2023-10-24T00:27:48.888 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 3/122 2023-10-24T00:27:48.888 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 4/122 2023-10-24T00:27:48.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-127.ge93d5 5/122 2023-10-24T00:27:48.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:27:48.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:27:48.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:27:48.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 9/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 11/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 12/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_ 14/122 2023-10-24T00:27:48.890 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 15/122 2023-10-24T00:27:48.891 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 16/122 2023-10-24T00:27:48.891 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_6 17/122 2023-10-24T00:27:48.891 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 18/122 2023-10-24T00:27:48.891 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 19/122 2023-10-24T00:27:48.892 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el 20/122 2023-10-24T00:27:48.892 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:16.2.14-127.ge93d5f89.el8. 21/122 2023-10-24T00:27:48.892 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_6 22/122 2023-10-24T00:27:48.892 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 23/122 2023-10-24T00:27:48.892 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 24/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 25/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 26/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 27/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 28/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89. 29/122 2023-10-24T00:27:48.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 30/122 2023-10-24T00:27:48.901 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 31/122 2023-10-24T00:27:48.902 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 32/122 2023-10-24T00:27:48.902 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el 33/122 2023-10-24T00:27:48.902 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 34/122 2023-10-24T00:27:48.902 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.e 35/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 36/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 37/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-24T00:27:48.903 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-24T00:27:48.904 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-10-24T00:27:48.904 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-24T00:27:48.904 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-24T00:27:48.904 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-24T00:27:48.904 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-24T00:27:48.905 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-24T00:27:48.905 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-24T00:27:48.905 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-10-24T00:27:48.905 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-10-24T00:27:48.905 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-24T00:27:48.906 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-24T00:27:48.907 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-10-24T00:27:48.907 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-10-24T00:27:48.907 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-10-24T00:27:48.907 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-10-24T00:27:48.907 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-10-24T00:27:48.908 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-10-24T00:27:48.909 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-10-24T00:27:48.909 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-10-24T00:27:48.909 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-24T00:27:48.909 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-24T00:27:48.909 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-24T00:27:48.910 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-24T00:27:48.910 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-24T00:27:48.910 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-24T00:27:48.910 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-24T00:27:48.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-24T00:27:48.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-24T00:27:48.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-24T00:27:48.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-24T00:27:48.911 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-24T00:27:48.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-24T00:27:48.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-24T00:27:48.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-24T00:27:48.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-24T00:27:48.912 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-24T00:27:48.913 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-24T00:27:48.913 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-24T00:27:48.913 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-24T00:27:48.913 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-24T00:27:48.913 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-24T00:27:48.914 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-24T00:27:48.914 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-24T00:27:48.914 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-24T00:27:48.914 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-24T00:27:48.914 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-24T00:27:48.915 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-24T00:27:48.915 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-24T00:27:48.915 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-24T00:27:48.915 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-24T00:27:48.916 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-24T00:27:48.916 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-24T00:27:48.916 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-24T00:27:48.916 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-24T00:27:48.916 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-24T00:27:48.917 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-24T00:27:48.917 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-24T00:27:48.917 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-24T00:27:48.917 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-24T00:27:48.917 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-24T00:27:48.918 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-24T00:27:48.918 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-24T00:27:48.918 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-24T00:27:48.918 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-24T00:27:48.919 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-24T00:27:48.919 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-24T00:27:48.919 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-24T00:27:48.919 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 119/122 2023-10-24T00:27:48.919 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-24T00:27:48.920 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 121/122 2023-10-24T00:27:49.065 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 107/122 2023-10-24T00:27:49.400 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 108/122 2023-10-24T00:27:49.568 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-24T00:27:50.292 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-24T00:27:50.650 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-24T00:27:50.818 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 111/122 2023-10-24T00:27:50.988 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-24T00:27:51.122 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_ 113/122 2023-10-24T00:27:51.124 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:51.124 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Oct 2023 12:26:01 AM UTC. 2023-10-24T00:27:51.289 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-24T00:27:51.450 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 115/122 2023-10-24T00:27:51.616 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 116/122 2023-10-24T00:27:51.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 117/122 2023-10-24T00:27:51.995 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-24T00:27:52.175 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-24T00:27:52.233 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-24T00:27:52.409 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-24T00:27:52.418 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-24T00:27:52.418 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-24T00:27:52.620 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-24T00:27:52.620 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:53.177 INFO:teuthology.orchestra.run.smithi148.stdout:Installed products updated. 2023-10-24T00:27:53.331 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:27:53.331 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2023-10-24T00:27:53.331 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.332 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.332 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2023-10-24T00:27:53.332 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.1-7.el8.noarch 2023-10-24T00:27:53.332 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.0.4-10.el8.x86_64 2023-10-24T00:27:53.332 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.333 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.333 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.333 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.333 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.334 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.334 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.334 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.334 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.335 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.336 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.336 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.336 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.336 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-24T00:27:53.337 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.1-9.el8.x86_64 2023-10-24T00:27:53.338 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-24T00:27:53.338 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-24T00:27:53.338 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.5-12.el8.x86_64 2023-10-24T00:27:53.338 INFO:teuthology.orchestra.run.smithi148.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-24T00:27:53.338 INFO:teuthology.orchestra.run.smithi148.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-24T00:27:53.339 INFO:teuthology.orchestra.run.smithi148.stdout: leveldb-1.22-1.el8.x86_64 2023-10-24T00:27:53.339 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-24T00:27:53.339 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.339 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.339 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.340 INFO:teuthology.orchestra.run.smithi148.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-24T00:27:53.340 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-24T00:27:53.340 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-24T00:27:53.340 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-24T00:27:53.340 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-24T00:27:53.341 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.341 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.341 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-24T00:27:53.341 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.341 INFO:teuthology.orchestra.run.smithi148.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-24T00:27:53.342 INFO:teuthology.orchestra.run.smithi148.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-24T00:27:53.342 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-24T00:27:53.342 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-24T00:27:53.342 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-24T00:27:53.342 INFO:teuthology.orchestra.run.smithi148.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-24T00:27:53.343 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-24T00:27:53.343 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-24T00:27:53.343 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-24T00:27:53.343 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-24T00:27:53.343 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: python3-apipkg-1.5-6.el8.noarch 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-24T00:27:53.344 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-24T00:27:53.345 INFO:teuthology.orchestra.run.smithi148.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-24T00:27:53.345 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-24T00:27:53.345 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.345 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.345 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.346 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-24T00:27:53.346 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-24T00:27:53.346 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-24T00:27:53.346 INFO:teuthology.orchestra.run.smithi148.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-10-24T00:27:53.346 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-24T00:27:53.347 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-24T00:27:53.348 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-24T00:27:53.348 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-24T00:27:53.348 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-24T00:27:53.348 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-24T00:27:53.348 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-24T00:27:53.349 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-24T00:27:53.349 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-24T00:27:53.349 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-24T00:27:53.350 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-24T00:27:53.350 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-2.6-1.el8.noarch 2023-10-24T00:27:53.350 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-24T00:27:53.350 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-24T00:27:53.351 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-24T00:27:53.351 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-24T00:27:53.351 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.352 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.352 INFO:teuthology.orchestra.run.smithi148.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-10-24T00:27:53.352 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-24T00:27:53.353 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-24T00:27:53.353 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.353 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-24T00:27:53.353 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-24T00:27:53.353 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-24T00:27:53.354 INFO:teuthology.orchestra.run.smithi148.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-24T00:27:53.354 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-24T00:27:53.354 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-24T00:27:53.355 INFO:teuthology.orchestra.run.smithi148.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-24T00:27:53.355 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-24T00:27:53.355 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-24T00:27:53.355 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-24T00:27:53.356 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-24T00:27:53.356 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-24T00:27:53.356 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-24T00:27:53.356 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.357 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.357 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:53.357 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-24T00:27:53.357 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-24T00:27:53.357 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-24T00:27:53.358 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-24T00:27:53.358 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:27:53.358 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-10-24T00:27:53.479 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:53.479 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 1/122 2023-10-24T00:27:53.481 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 2/122 2023-10-24T00:27:53.482 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 3/122 2023-10-24T00:27:53.482 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 4/122 2023-10-24T00:27:53.482 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-127.ge93d5 5/122 2023-10-24T00:27:53.482 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 6/122 2023-10-24T00:27:53.483 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 7/122 2023-10-24T00:27:53.483 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 8/122 2023-10-24T00:27:53.483 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 9/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 10/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 11/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 12/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 13/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_ 14/122 2023-10-24T00:27:53.484 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 15/122 2023-10-24T00:27:53.485 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 16/122 2023-10-24T00:27:53.485 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_6 17/122 2023-10-24T00:27:53.485 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86 18/122 2023-10-24T00:27:53.485 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 19/122 2023-10-24T00:27:53.485 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el 20/122 2023-10-24T00:27:53.486 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:16.2.14-127.ge93d5f89.el8. 21/122 2023-10-24T00:27:53.486 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_6 22/122 2023-10-24T00:27:53.486 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 23/122 2023-10-24T00:27:53.486 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 24/122 2023-10-24T00:27:53.486 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 25/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 26/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 27/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 28/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89. 29/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noa 30/122 2023-10-24T00:27:53.487 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.n 31/122 2023-10-24T00:27:53.488 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-127.ge93 32/122 2023-10-24T00:27:53.488 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el 33/122 2023-10-24T00:27:53.488 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 34/122 2023-10-24T00:27:53.488 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.e 35/122 2023-10-24T00:27:53.488 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 36/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 37/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-24T00:27:53.489 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-10-24T00:27:53.490 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-24T00:27:53.490 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-24T00:27:53.490 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-24T00:27:53.490 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-24T00:27:53.490 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-24T00:27:53.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-24T00:27:53.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-10-24T00:27:53.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-10-24T00:27:53.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-10-24T00:27:53.491 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-10-24T00:27:53.492 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-10-24T00:27:53.492 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-10-24T00:27:53.492 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-10-24T00:27:53.492 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-24T00:27:53.492 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-10-24T00:27:53.493 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-10-24T00:27:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-10-24T00:27:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-10-24T00:27:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-10-24T00:27:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-10-24T00:27:53.494 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-10-24T00:27:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-10-24T00:27:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-10-24T00:27:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-24T00:27:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-24T00:27:53.495 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-24T00:27:53.496 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-24T00:27:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-24T00:27:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-24T00:27:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-24T00:27:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-24T00:27:53.497 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-24T00:27:53.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-24T00:27:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-24T00:27:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-24T00:27:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-24T00:27:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-24T00:27:53.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-24T00:27:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-24T00:27:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-24T00:27:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-24T00:27:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-24T00:27:53.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-24T00:27:53.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-24T00:27:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-24T00:27:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-24T00:27:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-24T00:27:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-24T00:27:53.502 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-24T00:27:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-24T00:27:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-24T00:27:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-24T00:27:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-24T00:27:53.503 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-24T00:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-24T00:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-24T00:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 119/122 2023-10-24T00:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-24T00:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 121/122 2023-10-24T00:27:53.577 DEBUG:teuthology.parallel:result is None 2023-10-24T00:27:55.751 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-24T00:27:55.752 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Oct 2023 12:26:03 AM UTC. 2023-10-24T00:27:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2023-10-24T00:27:57.970 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:27:57.970 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2023-10-24T00:27:57.971 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.971 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.971 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2023-10-24T00:27:57.971 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-7.el8.noarch 2023-10-24T00:27:57.972 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2023-10-24T00:27:57.972 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.972 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.972 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.972 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.973 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.973 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.973 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.973 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.973 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.974 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.974 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.974 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.974 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.975 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.975 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.975 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.975 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.975 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.976 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.976 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.976 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.976 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:16.2.14-127.ge93d5f89.el8.noarch 2023-10-24T00:27:57.976 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-24T00:27:57.977 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2023-10-24T00:27:57.977 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-24T00:27:57.977 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-24T00:27:57.977 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.5-12.el8.x86_64 2023-10-24T00:27:57.978 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-24T00:27:57.978 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-24T00:27:57.978 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb-1.22-1.el8.x86_64 2023-10-24T00:27:57.978 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-24T00:27:57.978 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.979 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.979 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.979 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-24T00:27:57.979 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-24T00:27:57.979 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-24T00:27:57.980 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-24T00:27:57.980 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-24T00:27:57.980 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.980 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.981 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-24T00:27:57.981 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.981 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-24T00:27:57.981 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-24T00:27:57.981 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-24T00:27:57.982 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-24T00:27:57.982 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-24T00:27:57.982 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-24T00:27:57.982 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-24T00:27:57.983 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-24T00:27:57.983 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-24T00:27:57.983 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-24T00:27:57.984 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-24T00:27:57.984 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-24T00:27:57.984 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-24T00:27:57.984 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-24T00:27:57.984 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg-1.5-6.el8.noarch 2023-10-24T00:27:57.985 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-24T00:27:57.985 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-24T00:27:57.985 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-24T00:27:57.985 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-24T00:27:57.985 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.986 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.986 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.986 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-24T00:27:57.986 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-24T00:27:57.987 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-24T00:27:57.987 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-10-24T00:27:57.987 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-24T00:27:57.987 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-24T00:27:57.987 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-24T00:27:57.988 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-24T00:27:57.988 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-24T00:27:57.988 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-24T00:27:57.988 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-24T00:27:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-24T00:27:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-24T00:27:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-24T00:27:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-24T00:27:57.989 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-24T00:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-24T00:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-24T00:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-24T00:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-24T00:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2023-10-24T00:27:57.991 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-24T00:27:57.991 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-24T00:27:57.991 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-24T00:27:57.991 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-24T00:27:57.991 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.993 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.993 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-10-24T00:27:57.993 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-24T00:27:57.994 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-24T00:27:57.995 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-24T00:27:57.995 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-24T00:27:57.995 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-24T00:27:57.995 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-24T00:27:57.995 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-24T00:27:57.996 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-24T00:27:57.996 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-24T00:27:57.996 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-24T00:27:57.996 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-24T00:27:57.996 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.997 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.997 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:16.2.14-127.ge93d5f89.el8.x86_64 2023-10-24T00:27:57.997 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-24T00:27:57.997 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-24T00:27:57.997 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-24T00:27:57.998 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-24T00:27:57.998 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:27:57.998 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2023-10-24T00:27:58.187 DEBUG:teuthology.parallel:result is None 2023-10-24T00:27:58.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 2023-10-24T00:27:58.524 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-24T00:27:58.548 INFO:teuthology.orchestra.run.smithi148.stdout:16.2.14-127.ge93d5f89.el8 2023-10-24T00:27:58.548 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-127.ge93d5f89.el8 2023-10-24T00:27:58.549 INFO:teuthology.task.install:The correct ceph version 16.2.14-127.ge93d5f89 is installed. 2023-10-24T00:27:58.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e93d5f89f73abf9fe386e9badf28c3d9b6d462c0 2023-10-24T00:27:58.693 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-24T00:27:58.714 INFO:teuthology.orchestra.run.smithi150.stdout:16.2.14-127.ge93d5f89.el8 2023-10-24T00:27:58.715 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-127.ge93d5f89.el8 2023-10-24T00:27:58.715 INFO:teuthology.task.install:The correct ceph version 16.2.14-127.ge93d5f89 is installed. 2023-10-24T00:27:58.716 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-24T00:27:58.716 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:27:58.716 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-24T00:27:58.758 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:27:58.758 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-24T00:27:58.796 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-24T00:27:58.797 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:27:58.797 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-10-24T00:27:58.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-24T00:27:58.889 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:27:58.890 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2023-10-24T00:27:58.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-24T00:27:58.978 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-24T00:27:58.979 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:27:58.979 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-24T00:27:59.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-24T00:27:59.069 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:27:59.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-24T00:27:59.094 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-24T00:27:59.158 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-24T00:27:59.159 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:27:59.160 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2023-10-24T00:27:59.184 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-24T00:27:59.248 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:27:59.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2023-10-24T00:27:59.273 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-24T00:27:59.337 INFO:teuthology.run_tasks:Running task ceph... 2023-10-24T00:27:59.404 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-24T00:27:59.405 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-10-24T00:27:59.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2023-10-24T00:27:59.431 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-24T00:27:59.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-24T00:27:59.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-24T00:27:59.496 INFO:tasks.ceph:Creating extra log directories... 2023-10-24T00:27:59.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-24T00:27:59.537 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-24T00:27:59.568 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-24T00:27:59.568 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-24T00:27:59.569 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-24T00:27:59.569 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:27:59.570 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-24T00:27:59.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-24T00:27:59.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-24T00:27:59.749 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:27:59.750 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-24T00:27:59.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-24T00:27:59.876 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-24T00:27:59.905 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-24T00:27:59.906 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-24T00:27:59.906 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974', 'branch': 'wip-yuri7-testing-2023-10-23-1230-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7434974', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2023-10-23-1230-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2023-10-23-1230-pacific', 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 76, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7825, 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri7-testing-2023-10-23-1230-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_e93d5f89f73abf9fe386e9badf28c3d9b6d462c0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0', 'targets': {'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUvSJx2mV8wRY0mjrjsB2wFIWM0U3RA04/sbTZZ7DVx3jNmuSHIqPuPWl+O9ttksx1eEywYLo2O/mkLZ6hX5Ns=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7UkzY9I5R+6v0hdWqah4Cxv5hlM06BlVbqL+Rn2biEpxYveWdLWwE2iptGdMMVe53t2WzcOo8nIinJZx9T3/I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'e93d5f89f73abf9fe386e9badf28c3d9b6d462c0'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-24_00:02:48', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-24T00:27:59.907 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-24T00:27:59.910 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-24T00:27:59.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-10-24T00:27:59.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2023-10-24T00:28:00.019 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:00.019 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-10-24T00:28:00.041 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-24T00:28:00.041 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-10-24T00:28:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-24T00:28:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.097 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 208728 Links: 1 2023-10-24T00:28:00.097 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.097 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.097 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-24 00:27:48.489161071 +0000 2023-10-24T00:28:00.098 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-24 00:25:09.936723157 +0000 2023-10-24T00:28:00.098 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-24 00:25:09.936723157 +0000 2023-10-24T00:28:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-24T00:28:00.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-24T00:28:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-24T00:28:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-24T00:28:00.159 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.00025389 s, 2.0 MB/s 2023-10-24T00:28:00.160 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-24T00:28:00.217 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-10-24T00:28:00.272 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-24T00:28:00.272 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.272 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 214390 Links: 1 2023-10-24T00:28:00.272 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.273 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.273 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-24 00:27:48.490161048 +0000 2023-10-24T00:28:00.273 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-24 00:25:10.453710693 +0000 2023-10-24T00:28:00.273 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-24 00:25:10.453710693 +0000 2023-10-24T00:28:00.273 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-24T00:28:00.274 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-24T00:28:00.335 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-24T00:28:00.335 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-24T00:28:00.336 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000279265 s, 1.8 MB/s 2023-10-24T00:28:00.337 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-24T00:28:00.393 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-10-24T00:28:00.448 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-24T00:28:00.448 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.448 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 211253 Links: 1 2023-10-24T00:28:00.449 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.449 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.449 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-24 00:27:48.490161048 +0000 2023-10-24T00:28:00.449 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-24 00:25:10.946698808 +0000 2023-10-24T00:28:00.449 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-24 00:25:10.946698808 +0000 2023-10-24T00:28:00.450 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-24T00:28:00.450 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-24T00:28:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-24T00:28:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-24T00:28:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000347708 s, 1.5 MB/s 2023-10-24T00:28:00.512 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-24T00:28:00.568 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-10-24T00:28:00.623 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-24T00:28:00.623 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 6h/6d Inode: 211323 Links: 1 2023-10-24T00:28:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-10-24 00:27:48.490161048 +0000 2023-10-24T00:28:00.624 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-10-24 00:25:11.422687333 +0000 2023-10-24T00:28:00.625 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-10-24 00:25:11.422687333 +0000 2023-10-24T00:28:00.625 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2023-10-24T00:28:00.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-24T00:28:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-10-24T00:28:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-10-24T00:28:00.687 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000193844 s, 2.6 MB/s 2023-10-24T00:28:00.688 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-24T00:28:00.743 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:00.744 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:00.744 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2023-10-24T00:28:00.759 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-24T00:28:00.760 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2023-10-24T00:28:00.814 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-24T00:28:00.815 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.815 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 215051 Links: 1 2023-10-24T00:28:00.815 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.815 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.816 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-10-24 00:27:53.044153891 +0000 2023-10-24T00:28:00.816 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-10-24 00:25:15.642633377 +0000 2023-10-24T00:28:00.816 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-10-24 00:25:15.642633377 +0000 2023-10-24T00:28:00.816 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-10-24T00:28:00.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-24T00:28:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-10-24T00:28:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-10-24T00:28:00.877 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00023582 s, 2.2 MB/s 2023-10-24T00:28:00.878 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-24T00:28:00.934 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2023-10-24T00:28:00.989 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-24T00:28:00.990 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:00.990 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 214397 Links: 1 2023-10-24T00:28:00.990 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:00.990 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:00.990 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-10-24 00:27:53.044153891 +0000 2023-10-24T00:28:00.991 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-10-24 00:25:16.143623220 +0000 2023-10-24T00:28:00.991 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-10-24 00:25:16.143623220 +0000 2023-10-24T00:28:00.991 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-10-24T00:28:00.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-24T00:28:01.052 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-10-24T00:28:01.053 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-10-24T00:28:01.053 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000243642 s, 2.1 MB/s 2023-10-24T00:28:01.054 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-24T00:28:01.110 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2023-10-24T00:28:01.165 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-24T00:28:01.165 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:01.165 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 215176 Links: 1 2023-10-24T00:28:01.166 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:01.166 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:01.166 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-10-24 00:27:53.044153891 +0000 2023-10-24T00:28:01.166 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-10-24 00:25:16.637613202 +0000 2023-10-24T00:28:01.166 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-10-24 00:25:16.637613202 +0000 2023-10-24T00:28:01.167 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-10-24T00:28:01.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-24T00:28:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-10-24T00:28:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-10-24T00:28:01.228 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000265682 s, 1.9 MB/s 2023-10-24T00:28:01.229 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-24T00:28:01.284 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2023-10-24T00:28:01.339 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-24T00:28:01.339 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-24T00:28:01.339 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 210502 Links: 1 2023-10-24T00:28:01.340 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-24T00:28:01.340 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2023-10-24T00:28:01.340 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2023-10-24 00:27:53.044153891 +0000 2023-10-24T00:28:01.340 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2023-10-24 00:25:17.131603185 +0000 2023-10-24T00:28:01.340 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2023-10-24 00:25:17.131603185 +0000 2023-10-24T00:28:01.341 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2023-10-24T00:28:01.341 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-24T00:28:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2023-10-24T00:28:01.402 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2023-10-24T00:28:01.403 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000190047 s, 2.7 MB/s 2023-10-24T00:28:01.404 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-24T00:28:01.459 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:01.459 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-24T00:28:01.459 INFO:tasks.ceph:Generating config... 2023-10-24T00:28:01.461 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-24T00:28:01.461 INFO:tasks.ceph:[client] debug client = 20 2023-10-24T00:28:01.461 INFO:tasks.ceph:[client] debug ms = 1 2023-10-24T00:28:01.462 INFO:tasks.ceph:[client] pid file = 2023-10-24T00:28:01.462 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-24T00:28:01.462 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-24T00:28:01.462 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-24T00:28:01.465 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-24T00:28:01.465 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-24T00:28:01.466 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-24T00:28:01.466 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-24T00:28:01.466 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-24T00:28:01.466 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-24T00:28:01.467 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-24T00:28:01.467 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-24T00:28:01.467 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-24T00:28:01.467 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-24T00:28:01.468 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-24T00:28:01.468 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-24T00:28:01.468 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-24T00:28:01.468 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-24T00:28:01.468 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-24T00:28:01.469 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-24T00:28:01.469 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-24T00:28:01.469 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-24T00:28:01.469 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-24T00:28:01.470 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-24T00:28:01.470 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-24T00:28:01.470 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-24T00:28:01.470 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-24T00:28:01.471 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-24T00:28:01.471 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-24T00:28:01.471 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-24T00:28:01.471 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-24T00:28:01.472 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-24T00:28:01.472 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-24T00:28:01.472 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-24T00:28:01.472 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-24T00:28:01.473 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-24T00:28:01.473 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-24T00:28:01.473 INFO:tasks.ceph:Setting up mon.a... 2023-10-24T00:28:01.474 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-24T00:28:01.535 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.keyring 2023-10-24T00:28:01.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-24T00:28:01.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-24T00:28:01.670 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.148'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2023-10-24T00:28:01.671 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.148,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-24T00:28:01.672 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:01.672 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-24T00:28:01.725 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.148 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:01.805 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:01.805 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: generated fsid 6bd5f15c-4d64-43f3-b461-75e4ec9f85f9 2023-10-24T00:28:01.806 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 0 2023-10-24T00:28:01.806 INFO:teuthology.orchestra.run.smithi148.stdout:fsid 6bd5f15c-4d64-43f3-b461-75e4ec9f85f9 2023-10-24T00:28:01.806 INFO:teuthology.orchestra.run.smithi148.stdout:last_changed 2023-10-24T00:28:01.804644+0000 2023-10-24T00:28:01.806 INFO:teuthology.orchestra.run.smithi148.stdout:created 2023-10-24T00:28:01.804644+0000 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:min_mon_release 0 (unknown) 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:election_strategy: 1 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2023-10-24T00:28:01.807 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-24T00:28:01.809 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-24T00:28:01.864 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6bd5f15c-4d64-43f3-b461-75e4ec9f85f9... 2023-10-24T00:28:01.865 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-24T00:28:01.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-24T00:28:01.946 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-10-24T00:28:01.946 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-10-24T00:28:01.947 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-24T00:28:01.947 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-10-24T00:28:01.947 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.947 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-10-24T00:28:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.949 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-10-24T00:28:01.949 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-10-24T00:28:01.949 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.949 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-24T00:28:01.949 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-10-24T00:28:01.950 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.950 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-10-24T00:28:01.950 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-24T00:28:01.950 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.950 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-10-24T00:28:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-10-24T00:28:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-10-24T00:28:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-10-24T00:28:01.951 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-10-24T00:28:01.952 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-10-24T00:28:01.952 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-10-24T00:28:01.952 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-10-24T00:28:01.952 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-24T00:28:01.952 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-24T00:28:01.953 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-10-24T00:28:01.953 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.953 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-24T00:28:01.953 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.953 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-10-24T00:28:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-10-24T00:28:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-10-24T00:28:01.954 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-10-24T00:28:01.955 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-10-24T00:28:01.955 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.148,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-10-24T00:28:01.955 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on skipped message = False 2023-10-24T00:28:01.955 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 6bd5f15c-4d64-43f3-b461-75e4ec9f85f9 2023-10-24T00:28:01.955 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.956 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-10-24T00:28:01.956 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-10-24T00:28:01.956 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.956 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-10-24T00:28:01.956 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-10-24T00:28:01.957 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-10-24T00:28:01.958 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-10-24T00:28:01.958 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.958 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-10-24T00:28:01.958 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-10-24T00:28:01.958 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.959 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-10-24T00:28:01.959 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.959 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-10-24T00:28:01.959 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.959 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-10-24T00:28:01.960 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.960 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-10-24T00:28:01.960 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-10-24T00:28:01.960 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.960 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-10-24T00:28:01.961 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-10-24T00:28:01.962 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2023-10-24T00:28:01.962 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2023-10-24T00:28:01.962 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-24T00:28:01.962 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-10-24T00:28:01.962 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2023-10-24T00:28:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-10-24T00:28:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-10-24T00:28:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-10-24T00:28:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2023-10-24T00:28:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-10-24T00:28:01.964 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-10-24T00:28:01.965 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-10-24T00:28:01.965 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-10-24T00:28:01.965 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-10-24T00:28:01.965 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-10-24T00:28:01.965 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-10-24T00:28:01.966 INFO:teuthology.orchestra.run.smithi148.stdout: debug finisher = 20 2023-10-24T00:28:01.966 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.966 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-10-24T00:28:01.966 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-24T00:28:01.966 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-10-24T00:28:01.967 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-10-24T00:28:01.968 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-10-24T00:28:01.968 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-10-24T00:28:01.968 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.968 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-24T00:28:01.968 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-24T00:28:01.969 INFO:teuthology.orchestra.run.smithi148.stdout: mon op complaint time = 120 2023-10-24T00:28:01.970 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:01.970 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-10-24T00:28:01.970 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-10-24T00:28:01.970 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-10-24T00:28:01.971 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-10-24T00:28:01.971 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-24T00:28:01.971 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-24T00:28:01.971 INFO:teuthology.orchestra.run.smithi148.stdout: client mount timeout = 600 2023-10-24T00:28:01.971 INFO:teuthology.orchestra.run.smithi148.stdout: debug client = 20 2023-10-24T00:28:01.972 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-24T00:28:01.972 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = "" 2023-10-24T00:28:01.972 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-10-24T00:28:01.972 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-10-24T00:28:01.972 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-10-24T00:28:01.973 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-10-24T00:28:01.974 INFO:teuthology.orchestra.run.smithi148.stdout:[mds] 2023-10-24T00:28:01.974 INFO:teuthology.orchestra.run.smithi148.stdout: debug mds = 20 2023-10-24T00:28:01.974 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-10-24T00:28:01.974 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug frag = True 2023-10-24T00:28:01.974 INFO:teuthology.orchestra.run.smithi148.stdout: mds debug scatterstat = True 2023-10-24T00:28:01.975 INFO:teuthology.orchestra.run.smithi148.stdout: mds op complaint time = 180 2023-10-24T00:28:01.975 INFO:teuthology.orchestra.run.smithi148.stdout: mds verify scatter = True 2023-10-24T00:28:01.975 INFO:teuthology.orchestra.run.smithi148.stdout: osd op complaint time = 180 2023-10-24T00:28:01.975 INFO:teuthology.orchestra.run.smithi148.stdout: rados mon op timeout = 900 2023-10-24T00:28:01.975 INFO:teuthology.orchestra.run.smithi148.stdout: rados osd op timeout = 900 2023-10-24T00:28:01.977 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2023-10-24T00:28:01.977 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2023-10-24T00:28:01.977 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-24T00:28:01.978 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2023-10-24T00:28:01.978 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.978 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2023-10-24T00:28:01.978 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.978 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2023-10-24T00:28:01.979 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.979 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2023-10-24T00:28:01.979 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2023-10-24T00:28:01.979 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.979 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2023-10-24T00:28:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2023-10-24T00:28:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-24T00:28:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2023-10-24T00:28:01.980 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.981 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2023-10-24T00:28:01.981 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-24T00:28:01.981 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.981 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2023-10-24T00:28:01.982 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.982 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2023-10-24T00:28:01.982 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2023-10-24T00:28:01.982 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2023-10-24T00:28:01.982 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2023-10-24T00:28:01.983 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2023-10-24T00:28:01.983 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2023-10-24T00:28:01.983 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2023-10-24T00:28:01.983 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-24T00:28:01.983 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2023-10-24T00:28:01.984 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.985 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2023-10-24T00:28:01.985 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.985 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2023-10-24T00:28:01.985 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2023-10-24T00:28:01.985 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2023-10-24T00:28:01.986 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.148,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2023-10-24T00:28:01.986 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2023-10-24T00:28:01.986 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 6bd5f15c-4d64-43f3-b461-75e4ec9f85f9 2023-10-24T00:28:01.986 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.986 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2023-10-24T00:28:01.987 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2023-10-24T00:28:01.987 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.987 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2023-10-24T00:28:01.987 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2023-10-24T00:28:01.987 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.988 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2023-10-24T00:28:01.988 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2023-10-24T00:28:01.988 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.988 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2023-10-24T00:28:01.988 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2023-10-24T00:28:01.989 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2023-10-24T00:28:01.989 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.989 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2023-10-24T00:28:01.989 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2023-10-24T00:28:01.989 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.990 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2023-10-24T00:28:01.990 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.990 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2023-10-24T00:28:01.990 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.990 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2023-10-24T00:28:01.991 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.991 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2023-10-24T00:28:01.991 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2023-10-24T00:28:01.991 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.991 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2023-10-24T00:28:01.992 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2023-10-24T00:28:01.993 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2023-10-24T00:28:01.993 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2023-10-24T00:28:01.993 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-10-24T00:28:01.993 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2023-10-24T00:28:01.993 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2023-10-24T00:28:01.994 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2023-10-24T00:28:01.994 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2023-10-24T00:28:01.994 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2023-10-24T00:28:01.994 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2023-10-24T00:28:01.994 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2023-10-24T00:28:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-10-24T00:28:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.995 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2023-10-24T00:28:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-10-24T00:28:01.995 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2023-10-24T00:28:01.996 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-10-24T00:28:01.996 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-10-24T00:28:01.996 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-10-24T00:28:01.996 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-10-24T00:28:01.996 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout: debug finisher = 20 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-10-24T00:28:01.997 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-10-24T00:28:01.998 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2023-10-24T00:28:01.998 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-10-24T00:28:01.998 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2023-10-24T00:28:01.998 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2023-10-24T00:28:01.998 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-10-24T00:28:01.999 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2023-10-24T00:28:01.999 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2023-10-24T00:28:01.999 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-10-24T00:28:01.999 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:01.999 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-24T00:28:02.000 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-24T00:28:02.001 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2023-10-24T00:28:02.001 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-10-24T00:28:02.001 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2023-10-24T00:28:02.001 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2023-10-24T00:28:02.001 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2023-10-24T00:28:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2023-10-24T00:28:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-24T00:28:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-24T00:28:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2023-10-24T00:28:02.002 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-10-24T00:28:02.003 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-10-24T00:28:02.003 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2023-10-24T00:28:02.003 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-10-24T00:28:02.003 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-10-24T00:28:02.003 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2023-10-24T00:28:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2023-10-24T00:28:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2023-10-24T00:28:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-10-24T00:28:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-10-24T00:28:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2023-10-24T00:28:02.005 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2023-10-24T00:28:02.006 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2023-10-24T00:28:02.006 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2023-10-24T00:28:02.006 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-10-24T00:28:02.006 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-10-24T00:28:02.007 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-10-24T00:28:02.007 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-24T00:28:02.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-24T00:28:02.067 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-24T00:28:02.067 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:02.067 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-24T00:28:02.082 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:02.082 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-24T00:28:02.137 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:28:02.137 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:02.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-24T00:28:02.138 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-24T00:28:02.211 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:02.211 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:02.265 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:28:02.266 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:02.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-24T00:28:02.266 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-24T00:28:02.301 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:02.302 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:02.356 INFO:tasks.ceph:Setting up mon nodes... 2023-10-24T00:28:02.356 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-24T00:28:02.357 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-24T00:28:02.404 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-24T00:28:02.406 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-24T00:28:02.474 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-24T00:28:02.476 INFO:tasks.ceph:Setting up mds nodes... 2023-10-24T00:28:02.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-24T00:28:02.523 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-24T00:28:02.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-24T00:28:02.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-24T00:28:02.637 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-24T00:28:02.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-24T00:28:02.663 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-24T00:28:02.711 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-24T00:28:02.713 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-24T00:28:02.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-24T00:28:02.824 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-24T00:28:02.826 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-24T00:28:02.851 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-24T00:28:02.851 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-24T00:28:02.889 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-24T00:28:02.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-24T00:28:02.978 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-24T00:28:02.990 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-24T00:28:03.027 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-24T00:28:03.040 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-24T00:28:03.117 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-24T00:28:03.129 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-24T00:28:03.130 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-24T00:28:03.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-24T00:28:03.155 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:03.155 INFO:tasks.ceph:role: osd.0 2023-10-24T00:28:03.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:28:03.156 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-24T00:28:03.226 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-24T00:28:03.227 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:03.227 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:03.228 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:03.228 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:03.228 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:03.228 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:03.668 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-24T00:28:03.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-24T00:28:03.671 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-24T00:28:03.817 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-24T00:28:03.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-24T00:28:03.915 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:03.916 INFO:tasks.ceph:role: osd.1 2023-10-24T00:28:03.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:28:03.916 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-24T00:28:03.986 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:03.986 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:03.987 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:03.987 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-24T00:28:03.987 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:03.987 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:03.987 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:03.988 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:03.988 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:03.988 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:04.405 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-24T00:28:04.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-24T00:28:04.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-24T00:28:04.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-24T00:28:04.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-24T00:28:04.614 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:04.615 INFO:tasks.ceph:role: osd.2 2023-10-24T00:28:04.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:28:04.615 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-24T00:28:04.686 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-24T00:28:04.687 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:04.687 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:04.688 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:04.688 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:04.688 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:04.688 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:05.140 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-24T00:28:05.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-24T00:28:05.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-24T00:28:05.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-24T00:28:05.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-24T00:28:05.416 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:05.416 INFO:tasks.ceph:role: osd.3 2023-10-24T00:28:05.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:28:05.417 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-24T00:28:05.489 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:05.489 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:05.489 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:05.490 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:05.491 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:05.934 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-10-24T00:28:05.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-10-24T00:28:05.936 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-24T00:28:06.088 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-24T00:28:06.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:06.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-24T00:28:06.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-24T00:28:06.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-24T00:28:06.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-24T00:28:06.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-24T00:28:06.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:06.243+0000 7f15722aa200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-24T00:28:09.097 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-24T00:28:09.126 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:09.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.207+0000 7f2c0b6b9200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-24T00:28:09.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.207+0000 7f2c0b6b9200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-24T00:28:09.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.207+0000 7f2c0b6b9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-24T00:28:09.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.207+0000 7f2c0b6b9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-24T00:28:09.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.207+0000 7f2c0b6b9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-24T00:28:09.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:09.208+0000 7f2c0b6b9200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-24T00:28:12.055 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-24T00:28:12.122 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-24T00:28:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-24T00:28:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-24T00:28:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-24T00:28:12.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-24T00:28:12.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:12.201+0000 7f7344d36200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-24T00:28:15.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-24T00:28:15.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:15.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.197+0000 7fb9ef474200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-24T00:28:15.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.197+0000 7fb9ef474200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-24T00:28:15.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.197+0000 7fb9ef474200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-24T00:28:15.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.197+0000 7fb9ef474200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-24T00:28:15.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.197+0000 7fb9ef474200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-24T00:28:15.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:15.198+0000 7fb9ef474200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-24T00:28:18.046 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-24T00:28:18.074 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-24T00:28:18.104 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:18.105 INFO:tasks.ceph:role: osd.4 2023-10-24T00:28:18.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:28:18.105 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-24T00:28:18.180 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:18.180 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:18.181 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:18.181 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-10-24T00:28:18.181 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:18.181 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:18.181 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:18.182 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:18.182 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:18.182 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:18.617 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-10-24T00:28:18.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-10-24T00:28:18.620 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-24T00:28:18.774 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-24T00:28:18.809 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-24T00:28:18.877 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:18.877 INFO:tasks.ceph:role: osd.5 2023-10-24T00:28:18.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:28:18.878 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-24T00:28:18.950 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:18.951 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:18.951 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:18.951 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-10-24T00:28:18.952 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:18.952 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:18.952 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:18.953 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:18.953 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:18.953 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:19.377 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-10-24T00:28:19.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-10-24T00:28:19.380 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-24T00:28:19.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-24T00:28:19.518 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-24T00:28:19.585 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:19.585 INFO:tasks.ceph:role: osd.6 2023-10-24T00:28:19.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:28:19.586 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-24T00:28:19.658 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:19.658 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-10-24T00:28:19.659 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:19.659 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:19.660 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:19.660 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:19.660 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:19.660 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:20.099 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-10-24T00:28:20.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-10-24T00:28:20.101 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-24T00:28:20.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-24T00:28:20.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-24T00:28:20.358 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-24T00:28:20.359 INFO:tasks.ceph:role: osd.7 2023-10-24T00:28:20.359 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:28:20.359 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-24T00:28:20.432 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-24T00:28:20.433 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-24T00:28:20.433 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-24T00:28:20.433 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2023-10-24T00:28:20.434 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-24T00:28:20.434 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2023-10-24T00:28:20.434 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-24T00:28:20.435 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-24T00:28:20.435 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-24T00:28:20.435 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-24T00:28:20.871 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2023-10-24T00:28:20.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2023-10-24T00:28:20.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-24T00:28:21.039 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-24T00:28:21.073 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:21.260 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.258+0000 7f65a1027200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-24T00:28:21.260 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.258+0000 7f65a1027200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-24T00:28:21.260 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.258+0000 7f65a1027200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-24T00:28:21.261 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.258+0000 7f65a1027200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-24T00:28:21.261 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.258+0000 7f65a1027200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-24T00:28:21.261 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:21.259+0000 7f65a1027200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-24T00:28:24.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-24T00:28:24.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:24.206 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.204+0000 7fd298a88200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-24T00:28:24.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.204+0000 7fd298a88200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-24T00:28:24.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.204+0000 7fd298a88200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-24T00:28:24.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.204+0000 7fd298a88200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-24T00:28:24.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.204+0000 7fd298a88200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-24T00:28:24.207 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:24.205+0000 7fd298a88200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-24T00:28:27.047 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-24T00:28:27.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:27.200 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.198+0000 7f294bd40200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-24T00:28:27.200 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.198+0000 7f294bd40200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-24T00:28:27.201 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.198+0000 7f294bd40200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-24T00:28:27.201 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.198+0000 7f294bd40200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-24T00:28:27.201 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.198+0000 7f294bd40200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-24T00:28:27.201 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:27.199+0000 7f294bd40200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-24T00:28:29.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:28:29.911 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:28:30.041 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-24T00:28:30.066 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:30.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.146+0000 7f8c9e38f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-24T00:28:30.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.146+0000 7f8c9e38f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-24T00:28:30.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.146+0000 7f8c9e38f200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-24T00:28:30.149 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.146+0000 7f8c9e38f200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-24T00:28:30.149 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.146+0000 7f8c9e38f200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-24T00:28:30.149 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:30.147+0000 7f8c9e38f200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-24T00:28:32.985 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-24T00:28:33.052 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-24T00:28:33.052 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-24T00:28:33.081 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.082 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-24T00:28:33.149 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-24T00:28:33.216 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-24T00:28:33.282 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.283 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-24T00:28:33.348 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-24T00:28:33.413 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-24T00:28:33.478 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-24T00:28:33.506 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-24T00:28:33.573 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-24T00:28:33.639 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-24T00:28:33.705 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-24T00:28:33.770 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.771 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-24T00:28:33.835 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.835 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-24T00:28:33.899 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.900 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-24T00:28:33.915 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:33.915 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-24T00:28:33.971 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.972 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-24T00:28:33.987 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:33.987 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-24T00:28:34.042 INFO:tasks.ceph:Adding keys to all mons... 2023-10-24T00:28:34.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-24T00:28:34.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-24T00:28:34.085 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-10-24T00:28:34.086 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ== 2023-10-24T00:28:34.086 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2023-10-24T00:28:34.086 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg== 2023-10-24T00:28:34.086 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.c] 2023-10-24T00:28:34.087 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g== 2023-10-24T00:28:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-10-24T00:28:34.087 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A== 2023-10-24T00:28:34.087 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q== 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw== 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw== 2023-10-24T00:28:34.088 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-10-24T00:28:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q== 2023-10-24T00:28:34.089 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.b] 2023-10-24T00:28:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw== 2023-10-24T00:28:34.089 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.d] 2023-10-24T00:28:34.089 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg== 2023-10-24T00:28:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-10-24T00:28:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ== 2023-10-24T00:28:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-10-24T00:28:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA== 2023-10-24T00:28:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-10-24T00:28:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg== 2023-10-24T00:28:34.091 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-10-24T00:28:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ== 2023-10-24T00:28:34.091 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-10-24T00:28:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg== 2023-10-24T00:28:34.092 INFO:teuthology.orchestra.run.smithi148.stdout:[client.2] 2023-10-24T00:28:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA== 2023-10-24T00:28:34.093 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-10-24T00:28:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ== 2023-10-24T00:28:34.094 INFO:teuthology.orchestra.run.smithi148.stdout:[client.3] 2023-10-24T00:28:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w== 2023-10-24T00:28:34.105 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2023-10-24T00:28:34.105 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ== 2023-10-24T00:28:34.105 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-10-24T00:28:34.105 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg== 2023-10-24T00:28:34.106 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-10-24T00:28:34.106 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g== 2023-10-24T00:28:34.106 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2023-10-24T00:28:34.106 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A== 2023-10-24T00:28:34.106 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2023-10-24T00:28:34.107 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q== 2023-10-24T00:28:34.107 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2023-10-24T00:28:34.107 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw== 2023-10-24T00:28:34.107 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2023-10-24T00:28:34.107 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw== 2023-10-24T00:28:34.108 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2023-10-24T00:28:34.108 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q== 2023-10-24T00:28:34.108 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-10-24T00:28:34.108 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw== 2023-10-24T00:28:34.108 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2023-10-24T00:28:34.109 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg== 2023-10-24T00:28:34.109 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2023-10-24T00:28:34.109 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ== 2023-10-24T00:28:34.109 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2023-10-24T00:28:34.109 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA== 2023-10-24T00:28:34.110 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2023-10-24T00:28:34.110 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg== 2023-10-24T00:28:34.110 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2023-10-24T00:28:34.110 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ== 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg== 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA== 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2023-10-24T00:28:34.111 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ== 2023-10-24T00:28:34.112 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2023-10-24T00:28:34.112 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w== 2023-10-24T00:28:34.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-24T00:28:34.139 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-24T00:28:34.199 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.303 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.349 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.351 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.450 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-24T00:28:34.500 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-24T00:28:34.546 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.549 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.597 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-24T00:28:34.649 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.651 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.699 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.748 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.798 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-24T00:28:34.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:34.999 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:35.001 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-24T00:28:35.051 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-24T00:28:35.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-24T00:28:35.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-24T00:28:35.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-24T00:28:35.191 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-24T00:28:35.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-24T00:28:35.307 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-24T00:28:35.331 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-24T00:28:35.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-24T00:28:35.488 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-24T00:28:35.512 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:35.515 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-24T00:28:35.567 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-24T00:28:35.567 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-24T00:28:35.568 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-24T00:28:35.570 INFO:tasks.ceph.mon.a:Started 2023-10-24T00:28:35.571 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-24T00:28:35.571 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-24T00:28:35.608 INFO:tasks.ceph.mon.b:Started 2023-10-24T00:28:35.609 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-24T00:28:35.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-24T00:28:35.611 INFO:tasks.ceph.mon.c:Started 2023-10-24T00:28:35.612 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-24T00:28:35.612 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-24T00:28:35.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-24T00:28:35.615 INFO:tasks.ceph.mgr.y:Started 2023-10-24T00:28:35.615 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-24T00:28:35.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-24T00:28:35.617 INFO:tasks.ceph.mgr.x:Started 2023-10-24T00:28:35.618 INFO:tasks.ceph:Setting crush tunables to default 2023-10-24T00:28:35.618 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd crush tunables default 2023-10-24T00:28:35.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.731+0000 7fc006134700 1 Processor -- start 2023-10-24T00:28:35.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.731+0000 7fc006134700 1 -- start start 2023-10-24T00:28:35.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fc006134700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 0x7fc000154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fc006134700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0000c71d0 con 0x7fc0000bffd0 2023-10-24T00:28:35.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fc006134700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0000c9410 con 0x7fc000098bd0 2023-10-24T00:28:35.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fc006134700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0000c6a10 con 0x7fc000154430 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbffffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc0000bffd0 0x7fc00015e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55884/0 (socket says 172.21.15.148:55884) 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbffffff700 1 -- 172.21.15.148:0/3306623547 learned_addr learned my addr 172.21.15.148:0/3306623547 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbfff7fe700 1 --2- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 0x7fc000154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbfff7fe700 1 -- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 msgr2=0x7fc000154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbfff7fe700 1 -- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 msgr2=0x7fc000154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-24T00:28:35.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbfff7fe700 1 --2- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 0x7fc000154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-24T00:28:35.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.732+0000 7fbfff7fe700 1 --2- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 0x7fc000154810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:28:35.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739800124 0 0) 0x7fc0000c71d0 con 0x7fc0000bffd0 2023-10-24T00:28:35.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe80033f0 con 0x7fc0000bffd0 2023-10-24T00:28:35.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951458105 0 0) 0x7fc0000c9410 con 0x7fc000098bd0 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0000c71d0 con 0x7fc000098bd0 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653662604 0 0) 0x7fbfe80033f0 con 0x7fc0000bffd0 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.930+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 msgr2=0x7fc000154810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 --2- 172.21.15.148:0/3306623547 >> v2:172.21.15.150:3300/0 conn(0x7fc000154430 0x7fc000154810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 >> v1:172.21.15.150:6789/0 conn(0x7fc000098bd0 legacy=0x7fc0000c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000ca8b0 con 0x7fc0000bffd0 2023-10-24T00:28:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fbff8001470 con 0x7fc0000bffd0 2023-10-24T00:28:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 >> v1:172.21.15.148:6789/0 conn(0x7fc0000bffd0 legacy=0x7fc00015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8003ac0 0x7fbfe8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 0x7fbfe8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe8005120 0x7fbfe800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000c6a10 con 0x7fbfe8004690 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe800c010 con 0x7fbfe8005120 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe800c1d0 con 0x7fbfe8003ac0 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbfff7fe700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8003ac0 0x7fbfe8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffffff700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe8005120 0x7fbfe800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 0x7fbfe8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 -- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8003ac0 msgr2=0x7fbfe8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:35.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8003ac0 0x7fbfe8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 -- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe8005120 msgr2=0x7fbfe800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:35.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe8005120 0x7fbfe800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 -- 172.21.15.148:0/3306623547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80033f0 con 0x7fbfe8004690 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffffff700 1 -- 172.21.15.148:0/3306623547 reap_dead start 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffeffd700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 0x7fbfe8004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fbff4001860 tx=0x7fbff4007bb0).ready entity=mon.0 client_cookie=50aa16b2dac98215 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007020 con 0x7fbfe8004690 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4007180 con 0x7fbfe8004690 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.931+0000 7fbffe7fc700 1 -- 172.21.15.148:0/3306623547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4007500 con 0x7fbfe8004690 2023-10-24T00:28:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 -- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 msgr2=0x7fbfe8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 0x7fbfe8004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fbff4001860 tx=0x7fbff4007bb0).stop 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 -- 172.21.15.148:0/3306623547 shutdown_connections 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 --2- 172.21.15.148:0/3306623547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfe8004690 0x7fbfe8004b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 -- 172.21.15.148:0/3306623547 >> 172.21.15.148:0/3306623547 conn(0x7fc0000cb070 msgr2=0x7fc0000cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 -- 172.21.15.148:0/3306623547 shutdown_connections 2023-10-24T00:28:35.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.932+0000 7fc006134700 1 -- 172.21.15.148:0/3306623547 wait complete. 2023-10-24T00:28:35.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.934+0000 7fc006134700 1 Processor -- start 2023-10-24T00:28:35.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.934+0000 7fc006134700 1 -- start start 2023-10-24T00:28:35.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8004690 0x7fc00014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000167c50 0x7fc0001680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0001685c0 con 0x7fc0000af9b0 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00014b0f0 con 0x7fc000167c50 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fc006134700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00014b390 con 0x7fbfe8004690 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbfff7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8004690 0x7fc00014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39300/0 (socket says 172.21.15.148:39300) 2023-10-24T00:28:35.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 -- 172.21.15.148:0/75334139 learned_addr learned my addr 172.21.15.148:0/75334139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:35.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffffff700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000167c50 0x7fc0001680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:35.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 -- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8004690 msgr2=0x7fc00014c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:35.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8004690 0x7fc00014c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 -- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000167c50 msgr2=0x7fc0001680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:35.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000167c50 0x7fc0001680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:35.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 -- 172.21.15.148:0/75334139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00014b670 con 0x7fc0000af9b0 2023-10-24T00:28:35.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.935+0000 7fbffeffd700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbff4001e50 tx=0x7fbff4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:35.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4006fa0 con 0x7fc0000af9b0 2023-10-24T00:28:35.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff401d400 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff401d570 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00014b950 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00014bf10 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbff4018020 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.936+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbff4012770 con 0x7fc0000af9b0 2023-10-24T00:28:35.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.937+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00006c6b0 con 0x7fc0000af9b0 2023-10-24T00:28:35.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:35.939+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fbff402b060 con 0x7fc0000af9b0 2023-10-24T00:28:36.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.013+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc0000c6c10 con 0x7fc0000af9b0 2023-10-24T00:28:36.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fbfe77fe700 1 -- 172.21.15.148:0/75334139 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbff4022070 con 0x7fc0000af9b0 2023-10-24T00:28:36.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 msgr2=0x7fc0000c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbff4001e50 tx=0x7fbff4015000).stop 2023-10-24T00:28:36.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 shutdown_connections 2023-10-24T00:28:36.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc000167c50 0x7fc0001680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe8004690 0x7fc00014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 --2- 172.21.15.148:0/75334139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc0000af9b0 0x7fc0000c4d60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.015+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 >> 172.21.15.148:0/75334139 conn(0x7fc0000cb070 msgr2=0x7fc000063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:36.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.016+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 shutdown_connections 2023-10-24T00:28:36.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:36.016+0000 7fc006134700 1 -- 172.21.15.148:0/75334139 wait complete. 2023-10-24T00:28:36.019 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2023-10-24T00:28:36.029 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-24T00:28:36.029 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:36.029 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-24T00:28:36.053 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:36.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-24T00:28:36.060 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:36.059+0000 7f32cb85e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:28:36.117 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:36.117 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-24T00:28:36.129 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:36.127+0000 7f32cb85e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:28:36.181 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-10-24T00:28:36.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-24T00:28:36.245 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:36.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-24T00:28:36.270 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:36.270 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-24T00:28:36.334 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:36.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-24T00:28:36.399 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-10-24T00:28:36.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-24T00:28:36.425 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:36.423+0000 7fb76f29c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:28:36.463 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 22239223-2239-46a9-9afd-3e4748b562cc 0 2023-10-24T00:28:36.494 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:36.493+0000 7fb76f29c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:28:36.618 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.616+0000 7f03052ef700 1 Processor -- start 2023-10-24T00:28:36.618 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.616+0000 7f03052ef700 1 -- start start 2023-10-24T00:28:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f03052ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 0x7f030014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f03052ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0300152350 con 0x7f0300151ec0 2023-10-24T00:28:36.625 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f03052ef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000627d0 con 0x7f030014e6e0 2023-10-24T00:28:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f03052ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0300062ab0 con 0x7f030006b380 2023-10-24T00:28:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fe7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 0x7f030014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02feffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f030014e6e0 0x7f03000aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45688/0 (socket says 172.21.15.150:45688) 2023-10-24T00:28:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02feffd700 1 -- 172.21.15.150:0/3298690988 learned_addr learned my addr 172.21.15.150:0/3298690988 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:28:36.626 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fdffb700 1 -- 172.21.15.150:0/3298690988 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398509156 0 0) 0x7f03000627d0 con 0x7f030014e6e0 2023-10-24T00:28:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fe7fc700 1 -- 172.21.15.150:0/3298690988 >> v1:172.21.15.150:6789/0 conn(0x7f030014e6e0 legacy=0x7f03000aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fe7fc700 1 -- 172.21.15.150:0/3298690988 >> v1:172.21.15.148:6789/0 conn(0x7f0300151ec0 legacy=0x7f0300063870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fe7fc700 1 -- 172.21.15.150:0/3298690988 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300062d90 con 0x7f030006b380 2023-10-24T00:28:36.627 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.617+0000 7f02fe7fc700 1 --2- 172.21.15.150:0/3298690988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 0x7f030014eac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f02e8009790 tx=0x7f02e8009060).ready entity=mon.2 client_cookie=a5688542cc6a4394 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f02fdffb700 1 -- 172.21.15.150:0/3298690988 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800b5a0 con 0x7f030006b380 2023-10-24T00:28:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f02fdffb700 1 -- 172.21.15.150:0/3298690988 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800b700 con 0x7f030006b380 2023-10-24T00:28:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f02fdffb700 1 -- 172.21.15.150:0/3298690988 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800ba80 con 0x7f030006b380 2023-10-24T00:28:36.628 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 -- 172.21.15.150:0/3298690988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 msgr2=0x7f030014eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.629 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 --2- 172.21.15.150:0/3298690988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 0x7f030014eac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f02e8009790 tx=0x7f02e8009060).stop 2023-10-24T00:28:36.629 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 -- 172.21.15.150:0/3298690988 shutdown_connections 2023-10-24T00:28:36.629 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 --2- 172.21.15.150:0/3298690988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f030006b380 0x7f030014eac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.629 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 -- 172.21.15.150:0/3298690988 >> 172.21.15.150:0/3298690988 conn(0x7f03000c7e20 msgr2=0x7f03000c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 -- 172.21.15.150:0/3298690988 shutdown_connections 2023-10-24T00:28:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.618+0000 7f03052ef700 1 -- 172.21.15.150:0/3298690988 wait complete. 2023-10-24T00:28:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 Processor -- start 2023-10-24T00:28:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 -- start start 2023-10-24T00:28:36.630 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f030014e6e0 0x7f03000c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 0x7f03001648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c1430 con 0x7f030014e6e0 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001651b0 con 0x7f030006b380 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f03052ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0300165490 con 0x7f0300151ec0 2023-10-24T00:28:36.631 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f02feffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f02feffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41746/0 (socket says 172.21.15.150:41746) 2023-10-24T00:28:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f02ff7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 0x7f03001648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.620+0000 7f02feffd700 1 -- 172.21.15.150:0/1117454348 learned_addr learned my addr 172.21.15.150:0/1117454348 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:36.632 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02fe7fc700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f030014e6e0 0x7f03000c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 -- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 msgr2=0x7f03001648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 0x7f03001648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 -- 172.21.15.150:0/1117454348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f030014e6e0 msgr2=0x7f03000c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f030014e6e0 0x7f03000c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 -- 172.21.15.150:0/1117454348 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80092a0 con 0x7f030006b380 2023-10-24T00:28:36.633 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02ff7fe700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 0x7f03001648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02feffd700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02f000c4c0 tx=0x7f02f0007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000ce30 con 0x7f030006b380 2023-10-24T00:28:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f00072e0 con 0x7f030006b380 2023-10-24T00:28:36.634 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0300165770 con 0x7f030006b380 2023-10-24T00:28:36.635 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f00057a0 con 0x7f030006b380 2023-10-24T00:28:36.635 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03000c5460 con 0x7f030006b380 2023-10-24T00:28:36.635 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f02f0013450 con 0x7f030006b380 2023-10-24T00:28:36.635 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.621+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f02f0005e30 con 0x7f030006b380 2023-10-24T00:28:36.636 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.622+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0300047480 con 0x7f030006b380 2023-10-24T00:28:36.636 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.624+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f02f0018070 con 0x7f030006b380 2023-10-24T00:28:36.652 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:36.651+0000 7f32cb85e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:28:36.707 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.705+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22239223-2239-46a9-9afd-3e4748b562cc", "id": 0} v 0) v1 -- 0x7f0300063070 con 0x7f030006b380 2023-10-24T00:28:36.712 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.711+0000 7f02f6ffd700 1 -- 172.21.15.150:0/1117454348 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22239223-2239-46a9-9afd-3e4748b562cc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f02f0013930 con 0x7f030006b380 2023-10-24T00:28:36.712 INFO:teuthology.orchestra.run.smithi150.stdout:0 2023-10-24T00:28:36.713 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 msgr2=0x7f03000c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.714 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02f000c4c0 tx=0x7f02f0007c10).stop 2023-10-24T00:28:36.714 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 shutdown_connections 2023-10-24T00:28:36.714 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0300151ec0 0x7f03001648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.714 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f030006b380 0x7f03000c28d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.715 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 --2- 172.21.15.150:0/1117454348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f030014e6e0 0x7f03000c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.715 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 >> 172.21.15.150:0/1117454348 conn(0x7f03000c7e20 msgr2=0x7f0300063770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:36.715 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 shutdown_connections 2023-10-24T00:28:36.715 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.712+0000 7f03052ef700 1 -- 172.21.15.150:0/1117454348 wait complete. 2023-10-24T00:28:36.725 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e5f408bc-4124-45d0-b456-bf910a591e15 1 2023-10-24T00:28:36.839 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.837+0000 7fbc29734700 1 Processor -- start 2023-10-24T00:28:36.839 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.837+0000 7fbc29734700 1 -- start start 2023-10-24T00:28:36.841 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc29734700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc24098bd0 0x7fbc24154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.842 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc29734700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc240bffd0 0x7fbc240c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.842 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc29734700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240c71d0 con 0x7fbc24154430 2023-10-24T00:28:36.842 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc29734700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240c6a10 con 0x7fbc24098bd0 2023-10-24T00:28:36.842 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc29734700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240c9410 con 0x7fbc240bffd0 2023-10-24T00:28:36.843 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc237fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc240bffd0 0x7fbc240c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.843 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc22ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbc24154430 0x7fbc240c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45692/0 (socket says 172.21.15.150:45692) 2023-10-24T00:28:36.843 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc22ffd700 1 -- 172.21.15.150:0/2489192330 learned_addr learned my addr 172.21.15.150:0/2489192330 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:28:36.843 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc227fc700 1 --2- 172.21.15.150:0/2489192330 >> v2:172.21.15.148:3300/0 conn(0x7fbc24098bd0 0x7fbc24154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.843 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc237fe700 1 -- 172.21.15.150:0/2489192330 >> v2:172.21.15.148:3300/0 conn(0x7fbc24098bd0 msgr2=0x7fbc24154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:36.844 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc237fe700 1 --2- 172.21.15.150:0/2489192330 >> v2:172.21.15.148:3300/0 conn(0x7fbc24098bd0 0x7fbc24154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.844 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc237fe700 1 -- 172.21.15.150:0/2489192330 >> v1:172.21.15.150:6789/0 conn(0x7fbc24154430 legacy=0x7fbc240c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.844 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc21ffb700 1 -- 172.21.15.150:0/2489192330 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302311243 0 0) 0x7fbc240c71d0 con 0x7fbc24154430 2023-10-24T00:28:36.844 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.838+0000 7fbc237fe700 1 -- 172.21.15.150:0/2489192330 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240c0950 con 0x7fbc240bffd0 2023-10-24T00:28:36.844 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc237fe700 1 --2- 172.21.15.150:0/2489192330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c0460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbc240aab20 tx=0x7fbc1c009780).ready entity=mon.1 client_cookie=999d0ef0460dcc22 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:36.845 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc21ffb700 1 -- 172.21.15.150:0/2489192330 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00e070 con 0x7fbc240bffd0 2023-10-24T00:28:36.845 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc21ffb700 1 -- 172.21.15.150:0/2489192330 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00bb60 con 0x7fbc240bffd0 2023-10-24T00:28:36.845 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc21ffb700 1 -- 172.21.15.150:0/2489192330 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c012410 con 0x7fbc240bffd0 2023-10-24T00:28:36.845 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 -- 172.21.15.150:0/2489192330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 msgr2=0x7fbc240c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.845 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 --2- 172.21.15.150:0/2489192330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c0460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbc240aab20 tx=0x7fbc1c009780).stop 2023-10-24T00:28:36.846 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 -- 172.21.15.150:0/2489192330 shutdown_connections 2023-10-24T00:28:36.846 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 --2- 172.21.15.150:0/2489192330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c0460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.846 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 --2- 172.21.15.150:0/2489192330 >> v2:172.21.15.148:3300/0 conn(0x7fbc24098bd0 0x7fbc24154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.846 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 -- 172.21.15.150:0/2489192330 >> 172.21.15.150:0/2489192330 conn(0x7fbc240cb070 msgr2=0x7fbc240cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:36.846 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 -- 172.21.15.150:0/2489192330 shutdown_connections 2023-10-24T00:28:36.847 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.839+0000 7fbc29734700 1 -- 172.21.15.150:0/2489192330 wait complete. 2023-10-24T00:28:36.849 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 Processor -- start 2023-10-24T00:28:36.849 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 -- start start 2023-10-24T00:28:36.849 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.850 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.850 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc24154430 0x7fbc240acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:36.850 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240ab670 con 0x7fbc24154430 2023-10-24T00:28:36.850 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2414f850 con 0x7fbc240bffd0 2023-10-24T00:28:36.851 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc29734700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc24153840 con 0x7fbc24098bd0 2023-10-24T00:28:36.851 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc22ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.851 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc227fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.851 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc22ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:34344/0 (socket says 172.21.15.150:34344) 2023-10-24T00:28:36.851 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.841+0000 7fbc22ffd700 1 -- 172.21.15.150:0/3205407516 learned_addr learned my addr 172.21.15.150:0/3205407516 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:36.852 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc237fe700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc24154430 0x7fbc240acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:36.852 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 -- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 msgr2=0x7fbc2414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.852 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.852 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 -- 172.21.15.150:0/3205407516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc24154430 msgr2=0x7fbc240acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.852 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc24154430 0x7fbc240acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 -- 172.21.15.150:0/3205407516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009a20 con 0x7fbc240bffd0 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc22ffd700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc227fc700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c3560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fbc1400e850 tx=0x7fbc14009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14012600 con 0x7fbc240bffd0 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14012760 con 0x7fbc240bffd0 2023-10-24T00:28:36.853 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14012ae0 con 0x7fbc240bffd0 2023-10-24T00:28:36.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240aad40 con 0x7fbc240bffd0 2023-10-24T00:28:36.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240ab300 con 0x7fbc240bffd0 2023-10-24T00:28:36.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbc1401b660 con 0x7fbc240bffd0 2023-10-24T00:28:36.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.842+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fbc1401a3b0 con 0x7fbc240bffd0 2023-10-24T00:28:36.854 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.843+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2406c6b0 con 0x7fbc240bffd0 2023-10-24T00:28:36.855 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.845+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fbc14016020 con 0x7fbc240bffd0 2023-10-24T00:28:36.927 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.925+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e5f408bc-4124-45d0-b456-bf910a591e15", "id": 1} v 0) v1 -- 0x7fbc240612f0 con 0x7fbc240bffd0 2023-10-24T00:28:36.937 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.935+0000 7fbc0affd700 1 -- 172.21.15.150:0/3205407516 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5f408bc-4124-45d0-b456-bf910a591e15", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc1401bba0 con 0x7fbc240bffd0 2023-10-24T00:28:36.938 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-10-24T00:28:36.939 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 msgr2=0x7fbc240c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:36.940 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c3560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fbc1400e850 tx=0x7fbc14009060).stop 2023-10-24T00:28:36.940 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 shutdown_connections 2023-10-24T00:28:36.941 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc24154430 0x7fbc240acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.941 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc24098bd0 0x7fbc2414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.941 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 --2- 172.21.15.150:0/3205407516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc240bffd0 0x7fbc240c3560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:36.942 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 >> 172.21.15.150:0/3205407516 conn(0x7fbc240cb070 msgr2=0x7fbc240a8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:36.942 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.936+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 shutdown_connections 2023-10-24T00:28:36.942 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:36.937+0000 7fbc29734700 1 -- 172.21.15.150:0/3205407516 wait complete. 2023-10-24T00:28:36.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new b041cba0-1b8b-48a1-94f2-bbe77888768c 2 2023-10-24T00:28:36.961 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:36.960+0000 7fb76f29c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:28:37.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.063+0000 7f60324ef700 1 Processor -- start 2023-10-24T00:28:37.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.063+0000 7f60324ef700 1 -- start start 2023-10-24T00:28:37.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f60324ef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602c154430 0x7f602c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f60324ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c0c71d0 con 0x7f602c098bd0 2023-10-24T00:28:37.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f60324ef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c0c9410 con 0x7f602c0bffd0 2023-10-24T00:28:37.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f60324ef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0c6a10 con 0x7f602c154430 2023-10-24T00:28:37.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f602bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602c154430 0x7f602c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.069 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f6030a8c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f602c0bffd0 0x7f602c15e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45706/0 (socket says 172.21.15.150:45706) 2023-10-24T00:28:37.069 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.064+0000 7f6030a8c700 1 -- 172.21.15.150:0/2749411311 learned_addr learned my addr 172.21.15.150:0/2749411311 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:28:37.069 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602bfff700 1 -- 172.21.15.150:0/2749411311 >> v1:172.21.15.150:6789/0 conn(0x7f602c0bffd0 legacy=0x7f602c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.069 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602bfff700 1 -- 172.21.15.150:0/2749411311 >> v1:172.21.15.148:6789/0 conn(0x7f602c098bd0 legacy=0x7f602c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.069 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602affd700 1 -- 172.21.15.150:0/2749411311 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076652330 0 0) 0x7f602c0c9410 con 0x7f602c0bffd0 2023-10-24T00:28:37.070 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602bfff700 1 -- 172.21.15.150:0/2749411311 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0ca8b0 con 0x7f602c154430 2023-10-24T00:28:37.070 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602bfff700 1 --2- 172.21.15.150:0/2749411311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c154430 0x7f602c154810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6020009760 tx=0x7f6020009060).ready entity=mon.1 client_cookie=32c669ccb57f33a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.070 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602affd700 1 -- 172.21.15.150:0/2749411311 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000b580 con 0x7f602c154430 2023-10-24T00:28:37.071 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602affd700 1 -- 172.21.15.150:0/2749411311 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602000b6e0 con 0x7f602c154430 2023-10-24T00:28:37.071 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f602affd700 1 -- 172.21.15.150:0/2749411311 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000ba60 con 0x7f602c154430 2023-10-24T00:28:37.071 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f60324ef700 1 -- 172.21.15.150:0/2749411311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c154430 msgr2=0x7f602c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.071 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f60324ef700 1 --2- 172.21.15.150:0/2749411311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c154430 0x7f602c154810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6020009760 tx=0x7f6020009060).stop 2023-10-24T00:28:37.071 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f60324ef700 1 -- 172.21.15.150:0/2749411311 shutdown_connections 2023-10-24T00:28:37.072 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.065+0000 7f60324ef700 1 --2- 172.21.15.150:0/2749411311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c154430 0x7f602c154810 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.072 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.066+0000 7f60324ef700 1 -- 172.21.15.150:0/2749411311 >> 172.21.15.150:0/2749411311 conn(0x7f602c0cb070 msgr2=0x7f602c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.072 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.066+0000 7f60324ef700 1 -- 172.21.15.150:0/2749411311 shutdown_connections 2023-10-24T00:28:37.072 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.066+0000 7f60324ef700 1 -- 172.21.15.150:0/2749411311 wait complete. 2023-10-24T00:28:37.075 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.067+0000 7f60324ef700 1 Processor -- start 2023-10-24T00:28:37.075 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.068+0000 7f60324ef700 1 -- start start 2023-10-24T00:28:37.075 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.075 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154430 0x7f602c167e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c158d10 con 0x7f602c154430 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c149890 con 0x7f602c0bffd0 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f60324ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c158100 con 0x7f602c098bd0 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.076 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:34360/0 (socket says 172.21.15.150:34360) 2023-10-24T00:28:37.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 -- 172.21.15.150:0/966327110 learned_addr learned my addr 172.21.15.150:0/966327110 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:37.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41776/0 (socket says 172.21.15.150:41776) 2023-10-24T00:28:37.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f6030a8c700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154430 0x7f602c167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.077 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 -- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 msgr2=0x7f602c1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 -- 172.21.15.150:0/966327110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154430 msgr2=0x7f602c167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154430 0x7f602c167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 -- 172.21.15.150:0/966327110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200092a0 con 0x7f602c098bd0 2023-10-24T00:28:37.078 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602b7fe700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:37.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.069+0000 7f602bfff700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6020009eb0 tx=0x7f6020017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000b850 con 0x7f602c098bd0 2023-10-24T00:28:37.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602000b9b0 con 0x7f602c098bd0 2023-10-24T00:28:37.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c1583e0 con 0x7f602c098bd0 2023-10-24T00:28:37.079 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602001b620 con 0x7f602c098bd0 2023-10-24T00:28:37.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c1589a0 con 0x7f602c098bd0 2023-10-24T00:28:37.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f602001bc30 con 0x7f602c098bd0 2023-10-24T00:28:37.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.070+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f6020024b20 con 0x7f602c098bd0 2023-10-24T00:28:37.080 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.071+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c158ff0 con 0x7f602c098bd0 2023-10-24T00:28:37.081 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.075+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f6020029060 con 0x7f602c098bd0 2023-10-24T00:28:37.158 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.156+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b041cba0-1b8b-48a1-94f2-bbe77888768c", "id": 2} v 0) v1 -- 0x7f602c06c6b0 con 0x7f602c098bd0 2023-10-24T00:28:37.166 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.165+0000 7f6013fff700 1 -- 172.21.15.150:0/966327110 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b041cba0-1b8b-48a1-94f2-bbe77888768c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f602001f070 con 0x7f602c098bd0 2023-10-24T00:28:37.167 INFO:teuthology.orchestra.run.smithi150.stdout:2 2023-10-24T00:28:37.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 msgr2=0x7f602c1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f6020009eb0 tx=0x7f6020017000).stop 2023-10-24T00:28:37.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 shutdown_connections 2023-10-24T00:28:37.168 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154430 0x7f602c167e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c098bd0 0x7f602c1493a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 --2- 172.21.15.150:0/966327110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c0bffd0 0x7f602c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 >> 172.21.15.150:0/966327110 conn(0x7f602c0cb070 msgr2=0x7f602c0aa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 shutdown_connections 2023-10-24T00:28:37.169 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.166+0000 7f60324ef700 1 -- 172.21.15.150:0/966327110 wait complete. 2023-10-24T00:28:37.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 83801106-019d-44bd-b8ee-a19b562cef62 3 2023-10-24T00:28:37.295 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 Processor -- start 2023-10-24T00:28:37.296 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 -- start start 2023-10-24T00:28:37.298 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a60098bd0 0x7f8a60154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.298 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a600bffd0 0x7f8a600c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.298 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600c71d0 con 0x7f8a60154430 2023-10-24T00:28:37.299 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600c6a10 con 0x7f8a60098bd0 2023-10-24T00:28:37.299 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.294+0000 7f8a66dd3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600c9410 con 0x7f8a600bffd0 2023-10-24T00:28:37.299 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a600bffd0 0x7f8a600c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.299 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a64b6f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8a60154430 0x7f8a600c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45722/0 (socket says 172.21.15.150:45722) 2023-10-24T00:28:37.299 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a600bffd0 0x7f8a600c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41782/0 (socket says 172.21.15.150:41782) 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a64b6f700 1 -- 172.21.15.150:0/3108022616 learned_addr learned my addr 172.21.15.150:0/3108022616 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a5ffff700 1 --2- 172.21.15.150:0/3108022616 >> v2:172.21.15.148:3300/0 conn(0x7f8a60098bd0 0x7f8a60154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 -- 172.21.15.150:0/3108022616 >> v2:172.21.15.148:3300/0 conn(0x7f8a60098bd0 msgr2=0x7f8a60154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 --2- 172.21.15.150:0/3108022616 >> v2:172.21.15.148:3300/0 conn(0x7f8a60098bd0 0x7f8a60154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 -- 172.21.15.150:0/3108022616 >> v1:172.21.15.150:6789/0 conn(0x7f8a60154430 legacy=0x7f8a600c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.300 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a5f7fe700 1 -- 172.21.15.150:0/3108022616 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043431149 0 0) 0x7f8a600c71d0 con 0x7f8a60154430 2023-10-24T00:28:37.301 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 -- 172.21.15.150:0/3108022616 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600c0950 con 0x7f8a600bffd0 2023-10-24T00:28:37.301 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a65370700 1 --2- 172.21.15.150:0/3108022616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600bffd0 0x7f8a600c0460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8a600aab20 tx=0x7f8a58009780).ready entity=mon.1 client_cookie=ac1a5e57bde8c984 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.301 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a5f7fe700 1 -- 172.21.15.150:0/3108022616 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800e070 con 0x7f8a600bffd0 2023-10-24T00:28:37.301 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a5f7fe700 1 -- 172.21.15.150:0/3108022616 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5800bb60 con 0x7f8a600bffd0 2023-10-24T00:28:37.301 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.295+0000 7f8a5f7fe700 1 -- 172.21.15.150:0/3108022616 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58012410 con 0x7f8a600bffd0 2023-10-24T00:28:37.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 -- 172.21.15.150:0/3108022616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600bffd0 msgr2=0x7f8a600c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/3108022616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600bffd0 0x7f8a600c0460 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8a600aab20 tx=0x7f8a58009780).stop 2023-10-24T00:28:37.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 -- 172.21.15.150:0/3108022616 shutdown_connections 2023-10-24T00:28:37.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/3108022616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a600bffd0 0x7f8a600c0460 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.302 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/3108022616 >> v2:172.21.15.148:3300/0 conn(0x7f8a60098bd0 0x7f8a60154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.303 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 -- 172.21.15.150:0/3108022616 >> 172.21.15.150:0/3108022616 conn(0x7f8a600cb070 msgr2=0x7f8a600cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.303 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 -- 172.21.15.150:0/3108022616 shutdown_connections 2023-10-24T00:28:37.303 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.296+0000 7f8a66dd3700 1 -- 172.21.15.150:0/3108022616 wait complete. 2023-10-24T00:28:37.305 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.297+0000 7f8a66dd3700 1 Processor -- start 2023-10-24T00:28:37.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.297+0000 7f8a66dd3700 1 -- start start 2023-10-24T00:28:37.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 0x7f8a60064620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a60154430 0x7f8a60064b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.306 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6014cc90 con 0x7f8a60154430 2023-10-24T00:28:37.307 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60065000 con 0x7f8a60098bd0 2023-10-24T00:28:37.307 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a66dd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600ab060 con 0x7f8a600bffd0 2023-10-24T00:28:37.307 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a64b6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.307 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 0x7f8a60064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.307 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a64b6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41798/0 (socket says 172.21.15.150:41798) 2023-10-24T00:28:37.308 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a64b6f700 1 -- 172.21.15.150:0/278547420 learned_addr learned my addr 172.21.15.150:0/278547420 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:37.308 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a65370700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a60154430 0x7f8a60064b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.308 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 -- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 msgr2=0x7f8a60149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.308 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.308 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 -- 172.21.15.150:0/278547420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a60154430 msgr2=0x7f8a60064b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a60154430 0x7f8a60064b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 -- 172.21.15.150:0/278547420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009a20 con 0x7f8a600bffd0 2023-10-24T00:28:37.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a64b6f700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:37.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5ffff700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 0x7f8a60064620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8a4c00e900 tx=0x7f8a4c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.309 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.298+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c009450 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c012600 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6014c6d0 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c012980 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600aacf0 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8a4c01b660 con 0x7f8a600bffd0 2023-10-24T00:28:37.310 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.299+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f8a4c012e30 con 0x7f8a600bffd0 2023-10-24T00:28:37.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.300+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a600aab50 con 0x7f8a600bffd0 2023-10-24T00:28:37.311 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.302+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8a600aab50 con 0x7f8a600bffd0 2023-10-24T00:28:37.416 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.415+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83801106-019d-44bd-b8ee-a19b562cef62", "id": 3} v 0) v1 -- 0x7f8a6006c6b0 con 0x7f8a600bffd0 2023-10-24T00:28:37.425 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.423+0000 7f8a5cff9700 1 -- 172.21.15.150:0/278547420 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83801106-019d-44bd-b8ee-a19b562cef62", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8a4c0290b0 con 0x7f8a600bffd0 2023-10-24T00:28:37.425 INFO:teuthology.orchestra.run.smithi150.stdout:3 2023-10-24T00:28:37.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 msgr2=0x7f8a60064620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.426 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 0x7f8a60064620 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8a4c00e900 tx=0x7f8a4c009060).stop 2023-10-24T00:28:37.427 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 shutdown_connections 2023-10-24T00:28:37.427 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a60154430 0x7f8a60064b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.427 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a60098bd0 0x7f8a60149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.427 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 --2- 172.21.15.150:0/278547420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a600bffd0 0x7f8a60064620 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.428 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 >> 172.21.15.150:0/278547420 conn(0x7f8a600cb070 msgr2=0x7f8a60063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.428 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 shutdown_connections 2023-10-24T00:28:37.428 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.424+0000 7f8a66dd3700 1 -- 172.21.15.150:0/278547420 wait complete. 2023-10-24T00:28:37.428 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:37.427+0000 7f32cb85e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:28:37.438 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 56d29a5f-17af-4ad3-8347-c4a5f011e2b4 4 2023-10-24T00:28:37.500 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:37.499+0000 7f32cb85e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:28:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.552+0000 7f3d19a32700 1 Processor -- start 2023-10-24T00:28:37.554 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.552+0000 7f3d19a32700 1 -- start start 2023-10-24T00:28:37.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d19a32700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d14098bd0 0x7f3d14154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d19a32700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140c71d0 con 0x7f3d140bffd0 2023-10-24T00:28:37.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d19a32700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140c9410 con 0x7f3d14154430 2023-10-24T00:28:37.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d19a32700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140c6a10 con 0x7f3d14098bd0 2023-10-24T00:28:37.557 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d127fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d14098bd0 0x7f3d14154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d12ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3d14154430 0x7f3d140c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45728/0 (socket says 172.21.15.150:45728) 2023-10-24T00:28:37.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d12ffd700 1 -- 172.21.15.150:0/4249349195 learned_addr learned my addr 172.21.15.150:0/4249349195 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:28:37.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d127fc700 1 -- 172.21.15.150:0/4249349195 >> v1:172.21.15.150:6789/0 conn(0x7f3d14154430 legacy=0x7f3d140c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.558 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d127fc700 1 -- 172.21.15.150:0/4249349195 >> v1:172.21.15.148:6789/0 conn(0x7f3d140bffd0 legacy=0x7f3d1415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d127fc700 1 -- 172.21.15.150:0/4249349195 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140ca8b0 con 0x7f3d14098bd0 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.553+0000 7f3d127fc700 1 --2- 172.21.15.150:0/4249349195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14154810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3d04009760 tx=0x7f3d04009060).ready entity=mon.1 client_cookie=2935484e2d677e1d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d11ffb700 1 -- 172.21.15.150:0/4249349195 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400b580 con 0x7f3d14098bd0 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d11ffb700 1 -- 172.21.15.150:0/4249349195 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400b6e0 con 0x7f3d14098bd0 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d11ffb700 1 -- 172.21.15.150:0/4249349195 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400ba60 con 0x7f3d14098bd0 2023-10-24T00:28:37.559 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 -- 172.21.15.150:0/4249349195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 msgr2=0x7f3d14154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 --2- 172.21.15.150:0/4249349195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14154810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3d04009760 tx=0x7f3d04009060).stop 2023-10-24T00:28:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 -- 172.21.15.150:0/4249349195 shutdown_connections 2023-10-24T00:28:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 --2- 172.21.15.150:0/4249349195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14154810 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 -- 172.21.15.150:0/4249349195 >> 172.21.15.150:0/4249349195 conn(0x7f3d140cb070 msgr2=0x7f3d140cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.560 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 -- 172.21.15.150:0/4249349195 shutdown_connections 2023-10-24T00:28:37.561 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.554+0000 7f3d19a32700 1 -- 172.21.15.150:0/4249349195 wait complete. 2023-10-24T00:28:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 Processor -- start 2023-10-24T00:28:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 -- start start 2023-10-24T00:28:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.564 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 0x7f3d14148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 0x7f3d14148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140c23e0 con 0x7f3d140bffd0 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14149300 con 0x7f3d14098bd0 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.556+0000 7f3d19a32700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14151700 con 0x7f3d14154430 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.565 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d137fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 0x7f3d14148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d127fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 0x7f3d14148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41814/0 (socket says 172.21.15.150:41814) 2023-10-24T00:28:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 -- 172.21.15.150:0/2878410014 learned_addr learned my addr 172.21.15.150:0/2878410014 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 -- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 msgr2=0x7f3d14148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.566 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 0x7f3d14148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 -- 172.21.15.150:0/2878410014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 msgr2=0x7f3d14148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 0x7f3d14148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 -- 172.21.15.150:0/2878410014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d040092a0 con 0x7f3d14098bd0 2023-10-24T00:28:37.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d137fe700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 0x7f3d14148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:37.567 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d127fc700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 0x7f3d14148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d12ffd700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3d08001eb0 tx=0x7f3d08007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080070d0 con 0x7f3d14098bd0 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d08007230 con 0x7f3d14098bd0 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080075d0 con 0x7f3d14098bd0 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d141519e0 con 0x7f3d14098bd0 2023-10-24T00:28:37.568 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d140c2990 con 0x7f3d14098bd0 2023-10-24T00:28:37.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.557+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3d08005c10 con 0x7f3d14098bd0 2023-10-24T00:28:37.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.558+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f3d08013d90 con 0x7f3d14098bd0 2023-10-24T00:28:37.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.558+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1406c6b0 con 0x7f3d14098bd0 2023-10-24T00:28:37.569 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.561+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3d08013450 con 0x7f3d14098bd0 2023-10-24T00:28:37.643 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.642+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56d29a5f-17af-4ad3-8347-c4a5f011e2b4", "id": 4} v 0) v1 -- 0x7f3d14062c40 con 0x7f3d14098bd0 2023-10-24T00:28:37.656 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.655+0000 7f3cfaffd700 1 -- 172.21.15.150:0/2878410014 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56d29a5f-17af-4ad3-8347-c4a5f011e2b4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3d08013860 con 0x7f3d14098bd0 2023-10-24T00:28:37.657 INFO:teuthology.orchestra.run.smithi150.stdout:4 2023-10-24T00:28:37.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 msgr2=0x7f3d14152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f3d08001eb0 tx=0x7f3d08007e50).stop 2023-10-24T00:28:37.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 shutdown_connections 2023-10-24T00:28:37.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d14154430 0x7f3d14148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.658 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d14098bd0 0x7f3d14152040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 --2- 172.21.15.150:0/2878410014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d140bffd0 0x7f3d14148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 >> 172.21.15.150:0/2878410014 conn(0x7f3d140cb070 msgr2=0x7f3d140a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 shutdown_connections 2023-10-24T00:28:37.659 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.656+0000 7f3d19a32700 1 -- 172.21.15.150:0/2878410014 wait complete. 2023-10-24T00:28:37.669 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0f85c3d2-3722-44ae-86b0-1d1f43eb6065 5 2023-10-24T00:28:37.683 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:37.681+0000 7fb76f29c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:28:37.702 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:37.700+0000 7f32cb85e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:28:37.750 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:37.747+0000 7fb76f29c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:28:37.784 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.783+0000 7f931a574700 1 Processor -- start 2023-10-24T00:28:37.785 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.783+0000 7f931a574700 1 -- start start 2023-10-24T00:28:37.787 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f931a574700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93140c1050 0x7f93140a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.787 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f931a574700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 0x7f931415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.787 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f931a574700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140a9830 con 0x7f9314154150 2023-10-24T00:28:37.788 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f931a574700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93140a8c20 con 0x7f93140c9e00 2023-10-24T00:28:37.788 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f931a574700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93140a8f00 con 0x7f93140c1050 2023-10-24T00:28:37.788 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93140c1050 0x7f93140a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.788 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93140c1050 0x7f93140a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41816/0 (socket says 172.21.15.150:41816) 2023-10-24T00:28:37.788 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 -- 172.21.15.150:0/4007874260 learned_addr learned my addr 172.21.15.150:0/4007874260 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:37.789 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9319d73700 1 --2- 172.21.15.150:0/4007874260 >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 0x7f931415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.789 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 -- 172.21.15.150:0/4007874260 >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 msgr2=0x7f931415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:37.789 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 --2- 172.21.15.150:0/4007874260 >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 0x7f931415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.789 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 -- 172.21.15.150:0/4007874260 >> v1:172.21.15.148:6789/0 conn(0x7f9314154150 legacy=0x7f93140c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.789 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9318d71700 1 -- 172.21.15.150:0/4007874260 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140a91e0 con 0x7f93140c1050 2023-10-24T00:28:37.790 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.784+0000 7f9319d73700 1 --2- 172.21.15.150:0/4007874260 >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 0x7f931415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:37.790 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f9318d71700 1 --2- 172.21.15.150:0/4007874260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f93140a8640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9314083af0 tx=0x7f93040090f0).ready entity=mon.1 client_cookie=d2cc49b778c99e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.790 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f930bfff700 1 -- 172.21.15.150:0/4007874260 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930400b600 con 0x7f93140c1050 2023-10-24T00:28:37.790 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f930bfff700 1 -- 172.21.15.150:0/4007874260 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930400b760 con 0x7f93140c1050 2023-10-24T00:28:37.790 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f930bfff700 1 -- 172.21.15.150:0/4007874260 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930400bae0 con 0x7f93140c1050 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 -- 172.21.15.150:0/4007874260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 msgr2=0x7f93140a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 --2- 172.21.15.150:0/4007874260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f93140a8640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9314083af0 tx=0x7f93040090f0).stop 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 -- 172.21.15.150:0/4007874260 shutdown_connections 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 --2- 172.21.15.150:0/4007874260 >> v2:172.21.15.148:3300/0 conn(0x7f93140c9e00 0x7f931415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 --2- 172.21.15.150:0/4007874260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f93140a8640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.791 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 -- 172.21.15.150:0/4007874260 >> 172.21.15.150:0/4007874260 conn(0x7f9314094500 msgr2=0x7f931406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.792 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 -- 172.21.15.150:0/4007874260 shutdown_connections 2023-10-24T00:28:37.792 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.785+0000 7f931a574700 1 -- 172.21.15.150:0/4007874260 wait complete. 2023-10-24T00:28:37.794 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.787+0000 7f931a574700 1 Processor -- start 2023-10-24T00:28:37.794 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.787+0000 7f931a574700 1 -- start start 2023-10-24T00:28:37.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.787+0000 7f931a574700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.787+0000 7f931a574700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93140c9e00 0x7f93140ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.787+0000 7f931a574700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314154150 0x7f93140aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:37.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f931a574700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314158310 con 0x7f9314154150 2023-10-24T00:28:37.795 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f931a574700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140c2e60 con 0x7f93140c1050 2023-10-24T00:28:37.796 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f931a574700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140c3140 con 0x7f93140c9e00 2023-10-24T00:28:37.796 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.796 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41826/0 (socket says 172.21.15.150:41826) 2023-10-24T00:28:37.796 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 -- 172.21.15.150:0/1024814646 learned_addr learned my addr 172.21.15.150:0/1024814646 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:37.796 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9318d71700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93140c9e00 0x7f93140ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319d73700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314154150 0x7f93140aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 -- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93140c9e00 msgr2=0x7f93140ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93140c9e00 0x7f93140ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 -- 172.21.15.150:0/1024814646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314154150 msgr2=0x7f93140aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314154150 0x7f93140aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.797 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 -- 172.21.15.150:0/1024814646 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304009370 con 0x7f93140c1050 2023-10-24T00:28:37.798 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f9319572700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f931000c440 tx=0x7f9310007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:37.798 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310007020 con 0x7f93140c1050 2023-10-24T00:28:37.798 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310007180 con 0x7f93140c1050 2023-10-24T00:28:37.798 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93140c3420 con 0x7f93140c1050 2023-10-24T00:28:37.798 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310007520 con 0x7f93140c1050 2023-10-24T00:28:37.799 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9314153240 con 0x7f93140c1050 2023-10-24T00:28:37.799 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9310006b60 con 0x7f93140c1050 2023-10-24T00:28:37.799 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.788+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f9310012dc0 con 0x7f93140c1050 2023-10-24T00:28:37.799 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.790+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314047480 con 0x7f93140c1050 2023-10-24T00:28:37.799 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.792+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9310020060 con 0x7f93140c1050 2023-10-24T00:28:37.873 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.872+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f85c3d2-3722-44ae-86b0-1d1f43eb6065", "id": 5} v 0) v1 -- 0x7f93140a94c0 con 0x7f93140c1050 2023-10-24T00:28:37.881 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.880+0000 7f93097fa700 1 -- 172.21.15.150:0/1024814646 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f85c3d2-3722-44ae-86b0-1d1f43eb6065", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9310012400 con 0x7f93140c1050 2023-10-24T00:28:37.882 INFO:teuthology.orchestra.run.smithi150.stdout:5 2023-10-24T00:28:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.880+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 msgr2=0x7f9314152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:37.883 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.880+0000 7f931a574700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f931000c440 tx=0x7f9310007e50).stop 2023-10-24T00:28:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 shutdown_connections 2023-10-24T00:28:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9314154150 0x7f93140aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.884 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93140c1050 0x7f9314152d50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 --2- 172.21.15.150:0/1024814646 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93140c9e00 0x7f93140ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 >> 172.21.15.150:0/1024814646 conn(0x7f9314094500 msgr2=0x7f93140c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:37.885 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 shutdown_connections 2023-10-24T00:28:37.886 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:37.881+0000 7f931a574700 1 -- 172.21.15.150:0/1024814646 wait complete. 2023-10-24T00:28:37.894 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 564f2578-d5d7-484d-b7c8-8b644552fd04 6 2023-10-24T00:28:37.940 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:37.937+0000 7fb76f29c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:28:38.049 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.048+0000 7f78a79f5700 1 Processor -- start 2023-10-24T00:28:38.050 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.048+0000 7f78a79f5700 1 -- start start 2023-10-24T00:28:38.052 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a79f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.052 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a79f5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 0x7f78a00c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.053 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a79f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00c0970 con 0x7f78a0098bd0 2023-10-24T00:28:38.053 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a79f5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00c6a10 con 0x7f78a00bffd0 2023-10-24T00:28:38.053 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a79f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00c71d0 con 0x7f78a0154430 2023-10-24T00:28:38.053 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.054 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:34390/0 (socket says 172.21.15.150:34390) 2023-10-24T00:28:38.054 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5f92700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 0x7f78a00c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.054 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 -- 172.21.15.150:0/2262557366 learned_addr learned my addr 172.21.15.150:0/2262557366 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:38.055 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 -- 172.21.15.150:0/2262557366 >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 msgr2=0x7f78a00c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:38.055 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 --2- 172.21.15.150:0/2262557366 >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 0x7f78a00c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.055 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 -- 172.21.15.150:0/2262557366 >> v1:172.21.15.150:6789/0 conn(0x7f78a0098bd0 legacy=0x7f78a00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.055 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f7897fff700 1 -- 172.21.15.150:0/2262557366 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756635343 0 0) 0x7f789c001110 con 0x7f78a0098bd0 2023-10-24T00:28:38.055 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 -- 172.21.15.150:0/2262557366 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00c9410 con 0x7f78a0154430 2023-10-24T00:28:38.056 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5f92700 1 --2- 172.21.15.150:0/2262557366 >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 0x7f78a00c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:38.056 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f78a5791700 1 --2- 172.21.15.150:0/2262557366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7890009830 tx=0x7f78900090f0).ready entity=mon.2 client_cookie=3b66e50952f2d17a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.056 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f7897fff700 1 -- 172.21.15.150:0/2262557366 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000b580 con 0x7f78a0154430 2023-10-24T00:28:38.057 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f7897fff700 1 -- 172.21.15.150:0/2262557366 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789000b6e0 con 0x7f78a0154430 2023-10-24T00:28:38.057 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.049+0000 7f7897fff700 1 -- 172.21.15.150:0/2262557366 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000ba60 con 0x7f78a0154430 2023-10-24T00:28:38.057 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 -- 172.21.15.150:0/2262557366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 msgr2=0x7f78a0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.057 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2262557366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7890009830 tx=0x7f78900090f0).stop 2023-10-24T00:28:38.057 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 -- 172.21.15.150:0/2262557366 shutdown_connections 2023-10-24T00:28:38.058 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2262557366 >> v2:172.21.15.150:3300/0 conn(0x7f78a00bffd0 0x7f78a00c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.058 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2262557366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a0154810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.058 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 -- 172.21.15.150:0/2262557366 >> 172.21.15.150:0/2262557366 conn(0x7f78a00cb070 msgr2=0x7f78a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.058 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 -- 172.21.15.150:0/2262557366 shutdown_connections 2023-10-24T00:28:38.059 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.050+0000 7f78a79f5700 1 -- 172.21.15.150:0/2262557366 wait complete. 2023-10-24T00:28:38.062 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.051+0000 7f78a79f5700 1 Processor -- start 2023-10-24T00:28:38.062 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.051+0000 7f78a79f5700 1 -- start start 2023-10-24T00:28:38.062 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 0x7f78a00ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.062 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 0x7f78a00c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00af780 con 0x7f78a00bffd0 2023-10-24T00:28:38.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00aeb70 con 0x7f78a0098bd0 2023-10-24T00:28:38.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a79f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00aee50 con 0x7f78a0154430 2023-10-24T00:28:38.063 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a5f92700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a5791700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 0x7f78a00ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a5f92700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:34392/0 (socket says 172.21.15.150:34392) 2023-10-24T00:28:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a5f92700 1 -- 172.21.15.150:0/2120734137 learned_addr learned my addr 172.21.15.150:0/2120734137 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.052+0000 7f78a4f90700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 0x7f78a00c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.064 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 -- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 msgr2=0x7f78a00ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 0x7f78a00ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 -- 172.21.15.150:0/2120734137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 msgr2=0x7f78a00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 0x7f78a00c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.065 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 -- 172.21.15.150:0/2120734137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009a20 con 0x7f78a0154430 2023-10-24T00:28:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5791700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 0x7f78a00ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a4f90700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 0x7f78a00c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a5f92700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7898009fc0 tx=0x7f789800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800cc80 con 0x7f78a0154430 2023-10-24T00:28:38.066 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789800f040 con 0x7f78a0154430 2023-10-24T00:28:38.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890009370 con 0x7f78a0154430 2023-10-24T00:28:38.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898013400 con 0x7f78a0154430 2023-10-24T00:28:38.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a00af410 con 0x7f78a0154430 2023-10-24T00:28:38.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f7898013a50 con 0x7f78a0154430 2023-10-24T00:28:38.067 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.053+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f789801b980 con 0x7f78a0154430 2023-10-24T00:28:38.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.054+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a00af8f0 con 0x7f78a0154430 2023-10-24T00:28:38.068 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.056+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f789801bce0 con 0x7f78a0154430 2023-10-24T00:28:38.138 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.136+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "564f2578-d5d7-484d-b7c8-8b644552fd04", "id": 6} v 0) v1 -- 0x7f78a006c6b0 con 0x7f78a0154430 2023-10-24T00:28:38.145 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.144+0000 7f78957fa700 1 -- 172.21.15.150:0/2120734137 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "564f2578-d5d7-484d-b7c8-8b644552fd04", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f789801be80 con 0x7f78a0154430 2023-10-24T00:28:38.146 INFO:teuthology.orchestra.run.smithi150.stdout:6 2023-10-24T00:28:38.147 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 msgr2=0x7f78a00c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.147 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7898009fc0 tx=0x7f789800b040).stop 2023-10-24T00:28:38.147 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 shutdown_connections 2023-10-24T00:28:38.147 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a0154430 0x7f78a00c2ac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a0098bd0 0x7f78a00ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 --2- 172.21.15.150:0/2120734137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a00bffd0 0x7f78a00c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 >> 172.21.15.150:0/2120734137 conn(0x7f78a00cb070 msgr2=0x7f78a00a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.148 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 shutdown_connections 2023-10-24T00:28:38.149 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.145+0000 7f78a79f5700 1 -- 172.21.15.150:0/2120734137 wait complete. 2023-10-24T00:28:38.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 91761957-26a3-4c1f-b2aa-9a8cd0f06b00 7 2023-10-24T00:28:38.166 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.164+0000 7f32cb85e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:28:38.273 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.272+0000 7f9ed27d8700 1 Processor -- start 2023-10-24T00:28:38.274 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.272+0000 7f9ed27d8700 1 -- start start 2023-10-24T00:28:38.274 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f32cb85e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:28:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ed27d8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ecc14ffb0 0x7f9ecc153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ed27d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ed27d8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0c64e0 con 0x7f9ecc0be570 2023-10-24T00:28:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ed27d8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c4ae0 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.277 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ed27d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc153960 con 0x7f9ecc0c4170 2023-10-24T00:28:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ecb7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ecb7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:34402/0 (socket says 172.21.15.150:34402) 2023-10-24T00:28:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ecb7fe700 1 -- 172.21.15.150:0/1373809662 learned_addr learned my addr 172.21.15.150:0/1373809662 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:38.278 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.273+0000 7f9ecbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ecc14ffb0 0x7f9ecc153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecbfff700 1 -- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 msgr2=0x7f9ecc0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecbfff700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecbfff700 1 -- 172.21.15.150:0/1373809662 >> v1:172.21.15.148:6789/0 conn(0x7f9ecc0be570 legacy=0x7f9ecc0bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecbfff700 1 -- 172.21.15.150:0/1373809662 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0c58d0 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.279 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecb7fe700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:38.280 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecbfff700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc153470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ebc009760 tx=0x7f9ebc009060).ready entity=mon.1 client_cookie=3ef762ef4b23eb9e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.280 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecaffd700 1 -- 172.21.15.150:0/1373809662 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0090d0 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.280 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecaffd700 1 -- 172.21.15.150:0/1373809662 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00f510 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.280 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ecaffd700 1 -- 172.21.15.150:0/1373809662 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00f890 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.280 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc14ffb0 msgr2=0x7f9ecc153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.281 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc153470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ebc009760 tx=0x7f9ebc009060).stop 2023-10-24T00:28:38.281 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1373809662 shutdown_connections 2023-10-24T00:28:38.281 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc153470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.281 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1373809662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.281 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1373809662 >> 172.21.15.150:0/1373809662 conn(0x7f9ecc092510 msgr2=0x7f9ecc062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.282 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1373809662 shutdown_connections 2023-10-24T00:28:38.282 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.274+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1373809662 wait complete. 2023-10-24T00:28:38.284 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.275+0000 7f9ed27d8700 1 Processor -- start 2023-10-24T00:28:38.285 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 -- start start 2023-10-24T00:28:38.285 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.285 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.285 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.285 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0ae8b0 con 0x7f9ecc14ffb0 2023-10-24T00:28:38.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1516b0 con 0x7f9ecc0be570 2023-10-24T00:28:38.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.276+0000 7f9ed27d8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1532e0 con 0x7f9ecc0c4170 2023-10-24T00:28:38.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.286 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:41878/0 (socket says 172.21.15.150:41878) 2023-10-24T00:28:38.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecbfff700 1 -- 172.21.15.150:0/1672780352 learned_addr learned my addr 172.21.15.150:0/1672780352 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:28:38.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ed0d75700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.287 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 -- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 msgr2=0x7f9ecc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 -- 172.21.15.150:0/1672780352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ecc14ffb0 msgr2=0x7f9ecc1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.288 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 -- 172.21.15.150:0/1672780352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009370 con 0x7f9ecc0c4170 2023-10-24T00:28:38.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecbfff700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:38.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ecb7fe700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc150cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9ec000ea00 tx=0x7f9ec00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000c6a0 con 0x7f9ecc0c4170 2023-10-24T00:28:38.289 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000c800 con 0x7f9ecc0c4170 2023-10-24T00:28:38.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc0092a0 con 0x7f9ecc0c4170 2023-10-24T00:28:38.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000cb80 con 0x7f9ecc0c4170 2023-10-24T00:28:38.290 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc0aecd0 con 0x7f9ecc0c4170 2023-10-24T00:28:38.291 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9ec001b660 con 0x7f9ecc0c4170 2023-10-24T00:28:38.291 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.277+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f9ec001b910 con 0x7f9ecc0c4170 2023-10-24T00:28:38.291 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.278+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc096d80 con 0x7f9ecc0c4170 2023-10-24T00:28:38.291 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.280+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9ec003ae50 con 0x7f9ecc0c4170 2023-10-24T00:28:38.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.361+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "91761957-26a3-4c1f-b2aa-9a8cd0f06b00", "id": 7} v 0) v1 -- 0x7f9ecc0c5bb0 con 0x7f9ecc0c4170 2023-10-24T00:28:38.370 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.369+0000 7f9eb3fff700 1 -- 172.21.15.150:0/1672780352 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91761957-26a3-4c1f-b2aa-9a8cd0f06b00", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ec0029070 con 0x7f9ecc0c4170 2023-10-24T00:28:38.370 INFO:teuthology.orchestra.run.smithi150.stdout:7 2023-10-24T00:28:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 msgr2=0x7f9ecc150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc150cd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f9ec000ea00 tx=0x7f9ec00090f0).stop 2023-10-24T00:28:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 shutdown_connections 2023-10-24T00:28:38.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ecc14ffb0 0x7f9ecc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ecc0be570 0x7f9ecc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 --2- 172.21.15.150:0/1672780352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ecc0c4170 0x7f9ecc150cd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 >> 172.21.15.150:0/1672780352 conn(0x7f9ecc092510 msgr2=0x7f9ecc0666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 shutdown_connections 2023-10-24T00:28:38.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:28:38.370+0000 7f9ed27d8700 1 -- 172.21.15.150:0/1672780352 wait complete. 2023-10-24T00:28:38.380 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:38.378+0000 7fb76f29c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:28:38.384 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-24T00:28:38.384 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-24T00:28:38.386 INFO:tasks.ceph.osd.0:Started 2023-10-24T00:28:38.387 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-24T00:28:38.387 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-24T00:28:38.389 INFO:tasks.ceph.osd.1:Started 2023-10-24T00:28:38.389 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-24T00:28:38.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-24T00:28:38.392 INFO:tasks.ceph.osd.2:Started 2023-10-24T00:28:38.392 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-24T00:28:38.393 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-24T00:28:38.395 INFO:tasks.ceph.osd.3:Started 2023-10-24T00:28:38.395 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-24T00:28:38.396 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-24T00:28:38.427 INFO:tasks.ceph.osd.4:Started 2023-10-24T00:28:38.428 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-24T00:28:38.429 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-24T00:28:38.432 INFO:tasks.ceph.osd.5:Started 2023-10-24T00:28:38.432 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-24T00:28:38.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-24T00:28:38.436 INFO:tasks.ceph.osd.6:Started 2023-10-24T00:28:38.437 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-24T00:28:38.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-24T00:28:38.438 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.434+0000 7f32cb85e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:28:38.441 INFO:tasks.ceph.osd.7:Started 2023-10-24T00:28:38.442 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:38.504 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:38.502+0000 7fb76f29c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:28:38.527 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.525+0000 7f32cb85e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:28:38.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.568+0000 7f8df7ec2700 1 Processor -- start 2023-10-24T00:28:38.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.568+0000 7f8df7ec2700 1 -- start start 2023-10-24T00:28:38.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df7ec2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8df00c9540 0x7f8df00bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df7ec2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8df0156660 0x7f8df00c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df7ec2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df0156dc0 con 0x7f8df0152310 2023-10-24T00:28:38.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df7ec2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00be100 con 0x7f8df0156660 2023-10-24T00:28:38.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df7ec2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00c5270 con 0x7f8df00c9540 2023-10-24T00:28:38.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df645f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8df0156660 0x7f8df00c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df645f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8df0156660 0x7f8df00c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39366/0 (socket says 172.21.15.148:39366) 2023-10-24T00:28:38.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df645f700 1 -- 172.21.15.148:0/314471358 learned_addr learned my addr 172.21.15.148:0/314471358 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:38.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.569+0000 7f8df545d700 1 --2- 172.21.15.148:0/314471358 >> v2:172.21.15.150:3300/0 conn(0x7f8df00c9540 0x7f8df00bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df645f700 1 -- 172.21.15.148:0/314471358 >> v2:172.21.15.150:3300/0 conn(0x7f8df00c9540 msgr2=0x7f8df00bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:38.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df645f700 1 --2- 172.21.15.148:0/314471358 >> v2:172.21.15.150:3300/0 conn(0x7f8df00c9540 0x7f8df00bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df645f700 1 -- 172.21.15.148:0/314471358 >> v1:172.21.15.150:6789/0 conn(0x7f8df0152310 legacy=0x7f8df0155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df645f700 1 -- 172.21.15.148:0/314471358 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00c5550 con 0x7f8df0156660 2023-10-24T00:28:38.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df645f700 1 --2- 172.21.15.148:0/314471358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0156660 0x7f8df00c6cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8df00c8e00 tx=0x7f8de8009840).ready entity=mon.0 client_cookie=d69ac4bbbb6c7ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df4c5c700 1 -- 172.21.15.148:0/314471358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800e070 con 0x7f8df0156660 2023-10-24T00:28:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df4c5c700 1 -- 172.21.15.148:0/314471358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de800ba20 con 0x7f8df0156660 2023-10-24T00:28:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.570+0000 7f8df4c5c700 1 -- 172.21.15.148:0/314471358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800bda0 con 0x7f8df0156660 2023-10-24T00:28:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 -- 172.21.15.148:0/314471358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0156660 msgr2=0x7f8df00c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/314471358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0156660 0x7f8df00c6cf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8df00c8e00 tx=0x7f8de8009840).stop 2023-10-24T00:28:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 -- 172.21.15.148:0/314471358 shutdown_connections 2023-10-24T00:28:38.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/314471358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0156660 0x7f8df00c6cf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/314471358 >> v2:172.21.15.150:3300/0 conn(0x7f8df00c9540 0x7f8df00bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 -- 172.21.15.148:0/314471358 >> 172.21.15.148:0/314471358 conn(0x7f8df00630f0 msgr2=0x7f8df00c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 -- 172.21.15.148:0/314471358 shutdown_connections 2023-10-24T00:28:38.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.571+0000 7f8df7ec2700 1 -- 172.21.15.148:0/314471358 wait complete. 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.572+0000 7f8df7ec2700 1 Processor -- start 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.572+0000 7f8df7ec2700 1 -- start start 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8df00c9540 0x7f8df00abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8df0156660 0x7f8df00adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00c0060 con 0x7f8df0152310 2023-10-24T00:28:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00ac4a0 con 0x7f8df0156660 2023-10-24T00:28:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df014d840 con 0x7f8df00c9540 2023-10-24T00:28:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39374/0 (socket says 172.21.15.148:39374) 2023-10-24T00:28:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 -- 172.21.15.148:0/438570126 learned_addr learned my addr 172.21.15.148:0/438570126 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df645f700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8df0156660 0x7f8df00adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df5c5e700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8df00c9540 0x7f8df00abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 -- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8df00c9540 msgr2=0x7f8df00abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8df00c9540 0x7f8df00abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 -- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8df0156660 msgr2=0x7f8df00adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8df0156660 0x7f8df00adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 -- 172.21.15.148:0/438570126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8009ae0 con 0x7f8df0152310 2023-10-24T00:28:38.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df545d700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8dec00e900 tx=0x7f8dec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:38.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec012600 con 0x7f8df0152310 2023-10-24T00:28:38.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec012760 con 0x7f8df0152310 2023-10-24T00:28:38.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df00a9e00 con 0x7f8df0152310 2023-10-24T00:28:38.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.573+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec012ae0 con 0x7f8df0152310 2023-10-24T00:28:38.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.574+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8dec01b660 con 0x7f8df0152310 2023-10-24T00:28:38.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.574+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df00aa3c0 con 0x7f8df0152310 2023-10-24T00:28:38.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.574+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f8dec01bb90 con 0x7f8df0152310 2023-10-24T00:28:38.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.575+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df006c6b0 con 0x7f8df0152310 2023-10-24T00:28:38.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.577+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8dec03ae50 con 0x7f8df0152310 2023-10-24T00:28:38.600 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.598+0000 7f32cb85e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:28:38.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.643+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8df00bdd90 con 0x7f8df0152310 2023-10-24T00:28:38.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.643+0000 7f8de5ffb700 1 -- 172.21.15.148:0/438570126 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f8dec029070 con 0x7f8df0152310 2023-10-24T00:28:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:38.647 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":10,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:38.362646+0000","last_up_change":"0.000000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:38.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 msgr2=0x7f8df00a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:38.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8dec00e900 tx=0x7f8dec009060).stop 2023-10-24T00:28:38.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 shutdown_connections 2023-10-24T00:28:38.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8df0156660 0x7f8df00adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8df00c9540 0x7f8df00abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 --2- 172.21.15.148:0/438570126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8df0152310 0x7f8df00a95f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:38.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 >> 172.21.15.148:0/438570126 conn(0x7f8df00630f0 msgr2=0x7f8df00666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:38.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 shutdown_connections 2023-10-24T00:28:38.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:38.644+0000 7f8df7ec2700 1 -- 172.21.15.148:0/438570126 wait complete. 2023-10-24T00:28:38.659 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-24T00:28:38.659 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-24T00:28:38.664 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:38.662+0000 7fb76f29c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:28:38.742 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:38.740+0000 7fb76f29c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:28:38.813 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:38.811+0000 7fb76f29c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:28:38.865 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:38.863+0000 7f32cb85e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:28:38.994 INFO:tasks.ceph.osd.0.smithi148.stderr:2023-10-24T00:28:38.991+0000 7ff389d0e200 -1 Falling back to public interface 2023-10-24T00:28:38.996 INFO:tasks.ceph.osd.3.smithi148.stderr:2023-10-24T00:28:38.993+0000 7f65d6fa4200 -1 Falling back to public interface 2023-10-24T00:28:39.002 INFO:tasks.ceph.osd.1.smithi148.stderr:2023-10-24T00:28:38.999+0000 7f7be5798200 -1 Falling back to public interface 2023-10-24T00:28:39.010 INFO:tasks.ceph.osd.2.smithi148.stderr:2023-10-24T00:28:39.008+0000 7f5b7f566200 -1 Falling back to public interface 2023-10-24T00:28:39.025 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-10-24T00:28:39.023+0000 7f0dcc3e9200 -1 Falling back to public interface 2023-10-24T00:28:39.030 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-10-24T00:28:39.028+0000 7f08284c1200 -1 Falling back to public interface 2023-10-24T00:28:39.059 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-10-24T00:28:39.057+0000 7fdb39f96200 -1 Falling back to public interface 2023-10-24T00:28:39.064 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-10-24T00:28:39.062+0000 7fcdd9810200 -1 Falling back to public interface 2023-10-24T00:28:39.066 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:39.065+0000 7f32cb85e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:28:39.081 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:39.079+0000 7fb76f29c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:28:39.278 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:39.276+0000 7fb76f29c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:28:39.465 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:39.572 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.570+0000 7ff32ed65700 1 Processor -- start 2023-10-24T00:28:39.573 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.570+0000 7ff32ed65700 1 -- start start 2023-10-24T00:28:39.575 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32ed65700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff328151300 0x7ff3280c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:39.575 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32ed65700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3281516e0 0x7ff3280c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:39.576 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32ed65700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32806ba70 con 0x7ff3280c4b00 2023-10-24T00:28:39.576 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32ed65700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3280c3e30 con 0x7ff3281516e0 2023-10-24T00:28:39.576 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32ed65700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32806b4b0 con 0x7ff328151300 2023-10-24T00:28:39.576 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3281516e0 0x7ff3280c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:39.576 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff327fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff3280c4b00 0x7ff328062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55906/0 (socket says 172.21.15.148:55906) 2023-10-24T00:28:39.577 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff3281516e0 0x7ff3280c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39386/0 (socket says 172.21.15.148:39386) 2023-10-24T00:28:39.577 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff327fff700 1 -- 172.21.15.148:0/1287307394 learned_addr learned my addr 172.21.15.148:0/1287307394 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:39.577 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32cb01700 1 --2- 172.21.15.148:0/1287307394 >> v2:172.21.15.150:3300/0 conn(0x7ff328151300 0x7ff3280c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:39.577 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 -- 172.21.15.148:0/1287307394 >> v2:172.21.15.150:3300/0 conn(0x7ff328151300 msgr2=0x7ff3280c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:39.577 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 --2- 172.21.15.148:0/1287307394 >> v2:172.21.15.150:3300/0 conn(0x7ff328151300 0x7ff3280c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.578 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 -- 172.21.15.148:0/1287307394 >> v1:172.21.15.148:6789/0 conn(0x7ff3280c4b00 legacy=0x7ff328062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:39.578 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 -- 172.21.15.148:0/1287307394 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32806b790 con 0x7ff3281516e0 2023-10-24T00:28:39.578 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff3277fe700 1 -- 172.21.15.148:0/1287307394 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275610900 0 0) 0x7ff318001110 con 0x7ff3280c4b00 2023-10-24T00:28:39.578 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff32d302700 1 --2- 172.21.15.148:0/1287307394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281516e0 0x7ff3280c5b40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff3280645f0 tx=0x7ff320009780).ready entity=mon.0 client_cookie=2ad850e693ee0560 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:39.578 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff3277fe700 1 -- 172.21.15.148:0/1287307394 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32000e070 con 0x7ff3281516e0 2023-10-24T00:28:39.579 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff3277fe700 1 -- 172.21.15.148:0/1287307394 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32000bb60 con 0x7ff3281516e0 2023-10-24T00:28:39.579 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.571+0000 7ff3277fe700 1 -- 172.21.15.148:0/1287307394 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320012410 con 0x7ff3281516e0 2023-10-24T00:28:39.579 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 -- 172.21.15.148:0/1287307394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281516e0 msgr2=0x7ff3280c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:39.579 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1287307394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281516e0 0x7ff3280c5b40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff3280645f0 tx=0x7ff320009780).stop 2023-10-24T00:28:39.579 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 -- 172.21.15.148:0/1287307394 shutdown_connections 2023-10-24T00:28:39.580 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1287307394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3281516e0 0x7ff3280c5b40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.580 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1287307394 >> v2:172.21.15.150:3300/0 conn(0x7ff328151300 0x7ff3280c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.580 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 -- 172.21.15.148:0/1287307394 >> 172.21.15.148:0/1287307394 conn(0x7ff3280c8110 msgr2=0x7ff3280c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:39.580 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 -- 172.21.15.148:0/1287307394 shutdown_connections 2023-10-24T00:28:39.581 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.572+0000 7ff32ed65700 1 -- 172.21.15.148:0/1287307394 wait complete. 2023-10-24T00:28:39.581 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.573+0000 7ff32ed65700 1 Processor -- start 2023-10-24T00:28:39.584 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.573+0000 7ff32ed65700 1 -- start start 2023-10-24T00:28:39.584 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 0x7ff32813dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:39.584 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:39.584 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3281516e0 0x7ff328064fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:39.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328154a80 con 0x7ff328151300 2023-10-24T00:28:39.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328150960 con 0x7ff3280c4b00 2023-10-24T00:28:39.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32ed65700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32814f8c0 con 0x7ff3281516e0 2023-10-24T00:28:39.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff327fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:39.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff327fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39392/0 (socket says 172.21.15.148:39392) 2023-10-24T00:28:39.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff327fff700 1 -- 172.21.15.148:0/1495095171 learned_addr learned my addr 172.21.15.148:0/1495095171 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:39.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32cb01700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 0x7ff32813dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:39.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32d302700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3281516e0 0x7ff328064fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:39.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32cb01700 1 -- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3281516e0 msgr2=0x7ff328064fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:39.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.574+0000 7ff32cb01700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3281516e0 0x7ff328064fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32cb01700 1 -- 172.21.15.148:0/1495095171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 msgr2=0x7ff328149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:39.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32cb01700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32cb01700 1 -- 172.21.15.148:0/1495095171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320009a20 con 0x7ff3280c4b00 2023-10-24T00:28:39.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff327fff700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:39.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32cb01700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 0x7ff32813dbc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff31000e850 tx=0x7ff310009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:39.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310009430 con 0x7ff3280c4b00 2023-10-24T00:28:39.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310012600 con 0x7ff3280c4b00 2023-10-24T00:28:39.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32814fba0 con 0x7ff3280c4b00 2023-10-24T00:28:39.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310012980 con 0x7ff3280c4b00 2023-10-24T00:28:39.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff328150160 con 0x7ff3280c4b00 2023-10-24T00:28:39.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff31001b400 con 0x7ff3280c4b00 2023-10-24T00:28:39.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.575+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7ff31001aab0 con 0x7ff3280c4b00 2023-10-24T00:28:39.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.576+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32806c6b0 con 0x7ff3280c4b00 2023-10-24T00:28:39.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.578+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff31003ae50 con 0x7ff3280c4b00 2023-10-24T00:28:39.646 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.644+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3280c5340 con 0x7ff3280c4b00 2023-10-24T00:28:39.647 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.645+0000 7ff324ff9700 1 -- 172.21.15.148:0/1495095171 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7ff310029070 con 0x7ff3280c4b00 2023-10-24T00:28:39.648 INFO:teuthology.misc.health.smithi148.stdout: 2023-10-24T00:28:39.648 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":10,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:38.362646+0000","last_up_change":"0.000000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:39.650 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 msgr2=0x7ff32813dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:39.650 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 0x7ff32813dbc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff31000e850 tx=0x7ff310009060).stop 2023-10-24T00:28:39.650 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 shutdown_connections 2023-10-24T00:28:39.650 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3281516e0 0x7ff328064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.650 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3280c4b00 0x7ff32813dbc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.651 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 --2- 172.21.15.148:0/1495095171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328151300 0x7ff328149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:39.651 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 >> 172.21.15.148:0/1495095171 conn(0x7ff3280c8110 msgr2=0x7ff328154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:39.651 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 shutdown_connections 2023-10-24T00:28:39.651 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:39.646+0000 7ff32ed65700 1 -- 172.21.15.148:0/1495095171 wait complete. 2023-10-24T00:28:39.659 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-24T00:28:39.747 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:39.745+0000 7f32cb85e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:28:39.817 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:39.815+0000 7f32cb85e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:28:39.898 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:39.896+0000 7f32cb85e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:28:39.964 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:39.961+0000 7fb76f29c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:28:40.033 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.031+0000 7fb76f29c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:28:40.048 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.046+0000 7f32cb85e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:28:40.114 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.111+0000 7fb76f29c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:28:40.121 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.119+0000 7f32cb85e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:28:40.239 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.237+0000 7f32cb85e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:28:40.263 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.260+0000 7fb76f29c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:28:40.335 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.332+0000 7fb76f29c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:28:40.348 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.346+0000 7f32cb85e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:28:40.454 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.452+0000 7fb76f29c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:28:40.564 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.561+0000 7fb76f29c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:28:40.673 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.672+0000 7f32cb85e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:28:40.746 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:40.745+0000 7f32cb85e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:28:40.914 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.912+0000 7fb76f29c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:28:40.987 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:28:40.984+0000 7fb76f29c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:28:41.777 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:41.776+0000 7f3281a82700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-24T00:28:41.779 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:28:41.778+0000 7f3281a82700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-24T00:28:42.505 INFO:tasks.ceph.osd.3.smithi148.stderr:2023-10-24T00:28:42.502+0000 7f65d6fa4200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-24T00:28:42.525 INFO:tasks.ceph.osd.1.smithi148.stderr:2023-10-24T00:28:42.522+0000 7f7be5798200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-24T00:28:42.543 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-10-24T00:28:42.542+0000 7f0dcc3e9200 -1 osd.4 0 log_to_monitors {default=true} 2023-10-24T00:28:42.580 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-10-24T00:28:42.579+0000 7fcdd9810200 -1 osd.6 0 log_to_monitors {default=true} 2023-10-24T00:28:42.738 INFO:tasks.ceph.osd.0.smithi148.stderr:2023-10-24T00:28:42.736+0000 7ff389d0e200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-24T00:28:42.789 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-10-24T00:28:42.787+0000 7f08284c1200 -1 osd.5 0 log_to_monitors {default=true} 2023-10-24T00:28:42.791 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-10-24T00:28:42.790+0000 7fdb39f96200 -1 osd.7 0 log_to_monitors {default=true} 2023-10-24T00:28:42.798 INFO:tasks.ceph.osd.2.smithi148.stderr:2023-10-24T00:28:42.796+0000 7f5b7f566200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-24T00:28:43.778 INFO:tasks.ceph.osd.3.smithi148.stderr:2023-10-24T00:28:43.775+0000 7f65cd962700 -1 osd.3 0 waiting for initial osdmap 2023-10-24T00:28:43.778 INFO:tasks.ceph.osd.1.smithi148.stderr:2023-10-24T00:28:43.776+0000 7f7bdd959700 -1 osd.1 0 waiting for initial osdmap 2023-10-24T00:28:43.780 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-10-24T00:28:43.778+0000 7f0dc2da7700 -1 osd.4 0 waiting for initial osdmap 2023-10-24T00:28:43.781 INFO:tasks.ceph.osd.0.smithi148.stderr:2023-10-24T00:28:43.778+0000 7ff3806cc700 -1 osd.0 0 waiting for initial osdmap 2023-10-24T00:28:43.781 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-10-24T00:28:43.778+0000 7fcdd01ce700 -1 osd.6 0 waiting for initial osdmap 2023-10-24T00:28:43.784 INFO:tasks.ceph.osd.1.smithi148.stderr:2023-10-24T00:28:43.782+0000 7f7bd88d2700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:43.785 INFO:tasks.ceph.osd.3.smithi148.stderr:2023-10-24T00:28:43.782+0000 7f65ca0de700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:43.787 INFO:tasks.ceph.osd.0.smithi148.stderr:2023-10-24T00:28:43.784+0000 7ff37ce48700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:43.787 INFO:tasks.ceph.osd.6.smithi150.stderr:2023-10-24T00:28:43.786+0000 7fcdcc94a700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:43.788 INFO:tasks.ceph.osd.4.smithi150.stderr:2023-10-24T00:28:43.786+0000 7f0dbf523700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:44.779 INFO:tasks.ceph.osd.2.smithi148.stderr:2023-10-24T00:28:44.776+0000 7f5b75f24700 -1 osd.2 0 waiting for initial osdmap 2023-10-24T00:28:44.783 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-10-24T00:28:44.781+0000 7fdb30954700 -1 osd.7 0 waiting for initial osdmap 2023-10-24T00:28:44.784 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-10-24T00:28:44.783+0000 7f081ee7f700 -1 osd.5 0 waiting for initial osdmap 2023-10-24T00:28:44.785 INFO:tasks.ceph.osd.2.smithi148.stderr:2023-10-24T00:28:44.782+0000 7f5b726a0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:44.788 INFO:tasks.ceph.osd.7.smithi150.stderr:2023-10-24T00:28:44.787+0000 7fdb2d0d0700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:44.789 INFO:tasks.ceph.osd.5.smithi150.stderr:2023-10-24T00:28:44.788+0000 7f081b5fb700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-24T00:28:46.465 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:46.581 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.579+0000 7f627a075700 1 Processor -- start 2023-10-24T00:28:46.582 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.579+0000 7f627a075700 1 -- start start 2023-10-24T00:28:46.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f627a075700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f627a075700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f627a075700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62740aad50 con 0x7f62740c6150 2023-10-24T00:28:46.585 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f627a075700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740c02c0 con 0x7f62740c65d0 2023-10-24T00:28:46.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f627a075700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6274158540 con 0x7f62741542e0 2023-10-24T00:28:46.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f6273fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f6272ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f62740c6150 0x7f6274064840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:45854/0 (socket says 172.21.15.148:45854) 2023-10-24T00:28:46.586 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:33344/0 (socket says 172.21.15.148:33344) 2023-10-24T00:28:46.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f6272ffd700 1 -- 172.21.15.148:0/2761273517 learned_addr learned my addr 172.21.15.148:0/2761273517 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:46.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f6273fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:42578/0 (socket says 172.21.15.148:42578) 2023-10-24T00:28:46.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 -- 172.21.15.148:0/2761273517 >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 msgr2=0x7f62740c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:46.587 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 --2- 172.21.15.148:0/2761273517 >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 -- 172.21.15.148:0/2761273517 >> v1:172.21.15.150:6789/0 conn(0x7f62740c6150 legacy=0x7f6274064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 -- 172.21.15.148:0/2761273517 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274158820 con 0x7f62741542e0 2023-10-24T00:28:46.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f6273fff700 1 --2- 172.21.15.148:0/2761273517 >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:46.588 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.580+0000 7f62737fe700 1 --2- 172.21.15.148:0/2761273517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6264009760 tx=0x7f6264009060).ready entity=mon.2 client_cookie=c127f3b1c7439c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f62727fc700 1 -- 172.21.15.148:0/2761273517 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400f510 con 0x7f62741542e0 2023-10-24T00:28:46.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f62727fc700 1 -- 172.21.15.148:0/2761273517 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400f670 con 0x7f62741542e0 2023-10-24T00:28:46.589 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f62727fc700 1 -- 172.21.15.148:0/2761273517 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400f9f0 con 0x7f62741542e0 2023-10-24T00:28:46.590 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 -- 172.21.15.148:0/2761273517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 msgr2=0x7f6274157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.590 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 --2- 172.21.15.148:0/2761273517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6264009760 tx=0x7f6264009060).stop 2023-10-24T00:28:46.590 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 -- 172.21.15.148:0/2761273517 shutdown_connections 2023-10-24T00:28:46.590 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 --2- 172.21.15.148:0/2761273517 >> v2:172.21.15.150:3300/0 conn(0x7f62740c65d0 0x7f62740c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.591 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 --2- 172.21.15.148:0/2761273517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62741542e0 0x7f6274157f80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.591 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 -- 172.21.15.148:0/2761273517 >> 172.21.15.148:0/2761273517 conn(0x7f627406a850 msgr2=0x7f62740caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:46.591 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 -- 172.21.15.148:0/2761273517 shutdown_connections 2023-10-24T00:28:46.592 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.581+0000 7f627a075700 1 -- 172.21.15.148:0/2761273517 wait complete. 2023-10-24T00:28:46.595 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 Processor -- start 2023-10-24T00:28:46.595 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 -- start start 2023-10-24T00:28:46.595 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62740c6150 0x7f6274168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.595 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62740c65d0 0x7f627414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.595 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.596 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62741646b0 con 0x7f62741542e0 2023-10-24T00:28:46.596 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740b0fb0 con 0x7f62740c65d0 2023-10-24T00:28:46.596 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.583+0000 7f627a075700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62740afa20 con 0x7f62740c6150 2023-10-24T00:28:46.596 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.596 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50588/0 (socket says 172.21.15.148:50588) 2023-10-24T00:28:46.597 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 -- 172.21.15.148:0/4086496139 learned_addr learned my addr 172.21.15.148:0/4086496139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:46.597 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6272ffd700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62740c65d0 0x7f627414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.597 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f62737fe700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62740c6150 0x7f6274168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.597 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 -- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62740c6150 msgr2=0x7f6274168650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.598 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62740c6150 0x7f6274168650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.598 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 -- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62740c65d0 msgr2=0x7f627414dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.598 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62740c65d0 0x7f627414dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.598 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 -- 172.21.15.148:0/4086496139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009a20 con 0x7f62741542e0 2023-10-24T00:28:46.598 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f6273fff700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f626c009fc0 tx=0x7f626c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.599 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c009d20 con 0x7f62741542e0 2023-10-24T00:28:46.599 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x7f62741542e0 2023-10-24T00:28:46.599 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00cde0 con 0x7f62741542e0 2023-10-24T00:28:46.599 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640092a0 con 0x7f62741542e0 2023-10-24T00:28:46.599 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.584+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62740b0790 con 0x7f62741542e0 2023-10-24T00:28:46.600 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.585+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274154ce0 con 0x7f62741542e0 2023-10-24T00:28:46.600 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.586+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f626c013610 con 0x7f62741542e0 2023-10-24T00:28:46.600 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.586+0000 7f625b7fe700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 0x7f6260061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.600 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.586+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f626c07a5a0 con 0x7f62741542e0 2023-10-24T00:28:46.600 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.586+0000 7f62737fe700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 0x7f6260061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.601 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.587+0000 7f62737fe700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 0x7f6260061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6264009fd0 tx=0x7f6264017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.601 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.590+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6274154ce0 con 0x7f62741542e0 2023-10-24T00:28:46.760 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.757+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6274154ce0 con 0x7f62741542e0 2023-10-24T00:28:46.760 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.758+0000 7f625b7fe700 1 -- 172.21.15.148:0/4086496139 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12159 (secure 0 0 0) 0x7f6274154ce0 con 0x7f62741542e0 2023-10-24T00:28:46.761 INFO:teuthology.misc.health.smithi148.stdout: 2023-10-24T00:28:46.761 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":14,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:45.779492+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:46.763 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 msgr2=0x7f6260061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.763 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 0x7f6260061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6264009fd0 tx=0x7f6264017000).stop 2023-10-24T00:28:46.763 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 msgr2=0x7f62740c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.763 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f626c009fc0 tx=0x7f626c00b040).stop 2023-10-24T00:28:46.763 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 shutdown_connections 2023-10-24T00:28:46.764 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f626005f150 0x7f6260061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.764 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f62741542e0 0x7f62740c0c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.764 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f62740c6150 0x7f6274168650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.764 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 --2- 172.21.15.148:0/4086496139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62740c65d0 0x7f627414dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.764 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 >> 172.21.15.148:0/4086496139 conn(0x7f627406a850 msgr2=0x7f6274065060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:46.765 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 shutdown_connections 2023-10-24T00:28:46.765 INFO:teuthology.misc.health.smithi148.stderr:2023-10-24T00:28:46.760+0000 7f627a075700 1 -- 172.21.15.148:0/4086496139 wait complete. 2023-10-24T00:28:46.774 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-24T00:28:46.774 INFO:tasks.ceph:Creating RBD pool 2023-10-24T00:28:46.775 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-24T00:28:46.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.887+0000 7f9adf1aa700 1 Processor -- start 2023-10-24T00:28:46.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 -- start start 2023-10-24T00:28:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ad80acc60 0x7f9ad8062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad80a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad8063bd0 con 0x7f9ad8062b40 2023-10-24T00:28:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad8064060 con 0x7f9ad80acc60 2023-10-24T00:28:46.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adf1aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8062fc0 con 0x7f9ad80a9fa0 2023-10-24T00:28:46.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.888+0000 7f9adcf46700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ad80acc60 0x7f9ad8062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9ad80acc60 0x7f9ad8062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50602/0 (socket says 172.21.15.148:50602) 2023-10-24T00:28:46.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 -- 172.21.15.148:0/3889555430 learned_addr learned my addr 172.21.15.148:0/3889555430 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:46.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 -- 172.21.15.148:0/3889555430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 msgr2=0x7f9ad80a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:46.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 --2- 172.21.15.148:0/3889555430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad80a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:46.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 -- 172.21.15.148:0/3889555430 >> v1:172.21.15.150:6789/0 conn(0x7f9ad8062b40 legacy=0x7f9ad8154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:46.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 -- 172.21.15.148:0/3889555430 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80632a0 con 0x7f9ad80acc60 2023-10-24T00:28:46.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adcf46700 1 --2- 172.21.15.148:0/3889555430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8062650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f9ad4009f20 tx=0x7f9ad4009840).ready entity=mon.0 client_cookie=dec0a70af92e5f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9acf7fe700 1 -- 172.21.15.148:0/3889555430 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e070 con 0x7f9ad80acc60 2023-10-24T00:28:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9acf7fe700 1 -- 172.21.15.148:0/3889555430 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400ba40 con 0x7f9ad80acc60 2023-10-24T00:28:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9acf7fe700 1 -- 172.21.15.148:0/3889555430 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400bdc0 con 0x7f9ad80acc60 2023-10-24T00:28:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adf1aa700 1 -- 172.21.15.148:0/3889555430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 msgr2=0x7f9ad8062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.889+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/3889555430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8062650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f9ad4009f20 tx=0x7f9ad4009840).stop 2023-10-24T00:28:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 -- 172.21.15.148:0/3889555430 shutdown_connections 2023-10-24T00:28:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/3889555430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad80a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/3889555430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8062650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 -- 172.21.15.148:0/3889555430 >> 172.21.15.148:0/3889555430 conn(0x7f9ad80c3f60 msgr2=0x7f9ad80c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 -- 172.21.15.148:0/3889555430 shutdown_connections 2023-10-24T00:28:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.890+0000 7f9adf1aa700 1 -- 172.21.15.148:0/3889555430 wait complete. 2023-10-24T00:28:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.891+0000 7f9adf1aa700 1 Processor -- start 2023-10-24T00:28:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.891+0000 7f9adf1aa700 1 -- start start 2023-10-24T00:28:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad8062b40 0x7f9ad80a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80a58f0 con 0x7f9ad80acc60 2023-10-24T00:28:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8164640 con 0x7f9ad8062b40 2023-10-24T00:28:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80a67f0 con 0x7f9ad80a9fa0 2023-10-24T00:28:46.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50618/0 (socket says 172.21.15.148:50618) 2023-10-24T00:28:46.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adcf46700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad8062b40 0x7f9ad80a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 -- 172.21.15.148:0/1221773172 learned_addr learned my addr 172.21.15.148:0/1221773172 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:46.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9acffff700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 -- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 msgr2=0x7f9ad814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad814e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 -- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad8062b40 msgr2=0x7f9ad80a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:46.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad8062b40 0x7f9ad80a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:46.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 -- 172.21.15.148:0/1221773172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009ae0 con 0x7f9ad80acc60 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9add747700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9ad000b490 tx=0x7f9ad0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000be40 con 0x7f9ad80acc60 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad0002320 con 0x7f9ad80acc60 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80a6330 con 0x7f9ad80acc60 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00026e0 con 0x7f9ad80acc60 2023-10-24T00:28:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.892+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80a5050 con 0x7f9ad80acc60 2023-10-24T00:28:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.893+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8063580 con 0x7f9ad80acc60 2023-10-24T00:28:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.894+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9ad0002a50 con 0x7f9ad80acc60 2023-10-24T00:28:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.894+0000 7f9accff9700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 0x7f9ac4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.894+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7f9ad00798e0 con 0x7f9ad80acc60 2023-10-24T00:28:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.894+0000 7f9adcf46700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 0x7f9ac4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.894+0000 7f9adcf46700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 0x7f9ac4061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9ad400c010 tx=0x7f9ad4009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:46.898+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9ad004b060 con 0x7f9ad80acc60 2023-10-24T00:28:47.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.062+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9ad80a6330 con 0x7f9ad80acc60 2023-10-24T00:28:47.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.795+0000 7f9accff9700 1 -- 172.21.15.148:0/1221773172 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9ad80a6330 con 0x7f9ad80acc60 2023-10-24T00:28:47.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 msgr2=0x7f9ac4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 0x7f9ac4061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9ad400c010 tx=0x7f9ad4009840).stop 2023-10-24T00:28:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 msgr2=0x7f9ad8064cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9ad000b490 tx=0x7f9ad0009060).stop 2023-10-24T00:28:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 shutdown_connections 2023-10-24T00:28:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ac405f150 0x7f9ac4061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad80acc60 0x7f9ad8064cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad8062b40 0x7f9ad80a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 --2- 172.21.15.148:0/1221773172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ad80a9fa0 0x7f9ad814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 >> 172.21.15.148:0/1221773172 conn(0x7f9ad80c3f60 msgr2=0x7f9ad8065de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 shutdown_connections 2023-10-24T00:28:47.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.797+0000 7f9adf1aa700 1 -- 172.21.15.148:0/1221773172 wait complete. 2023-10-24T00:28:47.803 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'rbd' created 2023-10-24T00:28:47.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-24T00:28:47.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.925+0000 7f3be1c5d700 1 Processor -- start 2023-10-24T00:28:47.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.925+0000 7f3be1c5d700 1 -- start start 2023-10-24T00:28:47.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be1c5d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3bdc064c80 0x7f3bdc065060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be1c5d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0bcb00 con 0x7f3bdc1564c0 2023-10-24T00:28:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be1c5d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc062b40 con 0x7f3bdc06b460 2023-10-24T00:28:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be1c5d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc0636e0 con 0x7f3bdc064c80 2023-10-24T00:28:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be0c5b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3bdc064c80 0x7f3bdc065060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be145c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3bdc1564c0 0x7f3bdc0aa3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43356/0 (socket says 172.21.15.148:43356) 2023-10-24T00:28:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be145c700 1 -- 172.21.15.148:0/611969942 learned_addr learned my addr 172.21.15.148:0/611969942 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.926+0000 7f3be0c5b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3bdc064c80 0x7f3bdc065060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50630/0 (socket says 172.21.15.148:50630) 2023-10-24T00:28:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be0c5b700 1 -- 172.21.15.148:0/611969942 >> v1:172.21.15.150:6789/0 conn(0x7f3bdc06b460 legacy=0x7f3bdc062fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be0c5b700 1 -- 172.21.15.148:0/611969942 >> v1:172.21.15.148:6789/0 conn(0x7f3bdc1564c0 legacy=0x7f3bdc0aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be0c5b700 1 -- 172.21.15.148:0/611969942 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc156920 con 0x7f3bdc064c80 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3bd37fe700 1 -- 172.21.15.148:0/611969942 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629216472 0 0) 0x7f3bd4001110 con 0x7f3bdc1564c0 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be0c5b700 1 --2- 172.21.15.148:0/611969942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc064c80 0x7f3bdc065060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3bd8009e60 tx=0x7f3bd8009780).ready entity=mon.0 client_cookie=32fd89cb7acdaeed server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3bd37fe700 1 -- 172.21.15.148:0/611969942 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800e070 con 0x7f3bdc064c80 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3bd37fe700 1 -- 172.21.15.148:0/611969942 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800bbf0 con 0x7f3bdc064c80 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3bd37fe700 1 -- 172.21.15.148:0/611969942 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8012410 con 0x7f3bdc064c80 2023-10-24T00:28:47.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be1c5d700 1 -- 172.21.15.148:0/611969942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc064c80 msgr2=0x7f3bdc065060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/611969942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc064c80 0x7f3bdc065060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3bd8009e60 tx=0x7f3bd8009780).stop 2023-10-24T00:28:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be1c5d700 1 -- 172.21.15.148:0/611969942 shutdown_connections 2023-10-24T00:28:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/611969942 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc064c80 0x7f3bdc065060 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.927+0000 7f3be1c5d700 1 -- 172.21.15.148:0/611969942 >> 172.21.15.148:0/611969942 conn(0x7f3bdc0c7250 msgr2=0x7f3bdc0c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:47.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.928+0000 7f3be1c5d700 1 -- 172.21.15.148:0/611969942 shutdown_connections 2023-10-24T00:28:47.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.928+0000 7f3be1c5d700 1 -- 172.21.15.148:0/611969942 wait complete. 2023-10-24T00:28:47.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.929+0000 7f3be1c5d700 1 Processor -- start 2023-10-24T00:28:47.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.929+0000 7f3be1c5d700 1 -- start start 2023-10-24T00:28:47.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.929+0000 7f3be1c5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bdc064c80 0x7f3bdc165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:47.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.929+0000 7f3be1c5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc06b460 0x7f3bdc162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:47.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:47.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc153620 con 0x7f3bdc1564c0 2023-10-24T00:28:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc153be0 con 0x7f3bdc06b460 2023-10-24T00:28:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc165660 con 0x7f3bdc064c80 2023-10-24T00:28:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50632/0 (socket says 172.21.15.148:50632) 2023-10-24T00:28:47.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 -- 172.21.15.148:0/390889289 learned_addr learned my addr 172.21.15.148:0/390889289 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be0c5b700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bdc064c80 0x7f3bdc165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3bd3fff700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc06b460 0x7f3bdc162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 -- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bdc064c80 msgr2=0x7f3bdc165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bdc064c80 0x7f3bdc165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 -- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc06b460 msgr2=0x7f3bdc162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc06b460 0x7f3bdc162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 -- 172.21.15.148:0/390889289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009a20 con 0x7f3bdc1564c0 2023-10-24T00:28:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be145c700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3bd400c460 tx=0x7f3bd4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40072e0 con 0x7f3bdc1564c0 2023-10-24T00:28:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4007440 con 0x7f3bdc1564c0 2023-10-24T00:28:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc162e20 con 0x7f3bdc1564c0 2023-10-24T00:28:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40057a0 con 0x7f3bdc1564c0 2023-10-24T00:28:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.930+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc153870 con 0x7f3bdc1564c0 2023-10-24T00:28:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.931+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc047480 con 0x7f3bdc1564c0 2023-10-24T00:28:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.932+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3bd4005b50 con 0x7f3bdc1564c0 2023-10-24T00:28:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.932+0000 7f3bd0ff9700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 0x7f3bc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.932+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f3bd40794e0 con 0x7f3bdc1564c0 2023-10-24T00:28:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.932+0000 7f3be0c5b700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 0x7f3bc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.932+0000 7f3be0c5b700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 0x7f3bc8061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3bdc0a9520 tx=0x7f3bd8009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:47.936+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3bd404ab10 con 0x7f3bdc1564c0 2023-10-24T00:28:48.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.103+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3bdc0bcb00 con 0x7f3bdc1564c0 2023-10-24T00:28:48.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.799+0000 7f3bd0ff9700 1 -- 172.21.15.148:0/390889289 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3bdc0bcb00 con 0x7f3bdc1564c0 2023-10-24T00:28:48.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 msgr2=0x7f3bc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:48.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 0x7f3bc8061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3bdc0a9520 tx=0x7f3bd8009780).stop 2023-10-24T00:28:48.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 msgr2=0x7f3bdc162780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:48.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3bd400c460 tx=0x7f3bd4007e10).stop 2023-10-24T00:28:48.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 shutdown_connections 2023-10-24T00:28:48.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3bc805f150 0x7f3bc8061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bdc1564c0 0x7f3bdc162780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bdc064c80 0x7f3bdc165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 --2- 172.21.15.148:0/390889289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bdc06b460 0x7f3bdc162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 >> 172.21.15.148:0/390889289 conn(0x7f3bdc0c7250 msgr2=0x7f3bdc068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:48.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 shutdown_connections 2023-10-24T00:28:48.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.802+0000 7f3be1c5d700 1 -- 172.21.15.148:0/390889289 wait complete. 2023-10-24T00:28:48.809 INFO:teuthology.orchestra.run.smithi148.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-24T00:28:48.819 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-24T00:28:48.820 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:28:48.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:28:48.823 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:28:48.824 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:28:48.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:28:48.826 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:28:48.826 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:28:48.827 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:28:48.829 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:28:48.830 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:28:48.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:28:48.832 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:28:48.832 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-24T00:28:48.833 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:48.897 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:28:48.898 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:28:48.911 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:28:48.911 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:28:48.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.952+0000 7f2e9329d700 1 Processor -- start 2023-10-24T00:28:48.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.952+0000 7f2e9329d700 1 -- start start 2023-10-24T00:28:48.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0aa140 0x7f2e8c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2e8c0ca110 0x7f2e8c0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c6410 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c1160 con 0x7f2e8c0ca110 2023-10-24T00:28:48.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9329d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0ca6e0 con 0x7f2e8c0aa140 2023-10-24T00:28:48.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50666/0 (socket says 172.21.15.148:50666) 2023-10-24T00:28:48.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 -- 172.21.15.148:0/3972063231 learned_addr learned my addr 172.21.15.148:0/3972063231 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:48.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e9229b700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0aa140 0x7f2e8c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e91a9a700 1 --2- 172.21.15.148:0/3972063231 >> v2:172.21.15.150:3300/0 conn(0x7f2e8c0ca110 0x7f2e8c0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 -- 172.21.15.148:0/3972063231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0aa140 msgr2=0x7f2e8c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:48.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0aa140 0x7f2e8c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 -- 172.21.15.148:0/3972063231 >> v2:172.21.15.150:3300/0 conn(0x7f2e8c0ca110 msgr2=0x7f2e8c0c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:48.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/3972063231 >> v2:172.21.15.150:3300/0 conn(0x7f2e8c0ca110 0x7f2e8c0c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 -- 172.21.15.148:0/3972063231 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0ca9c0 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.953+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e8c084050 tx=0x7f2e84009840).ready entity=mon.0 client_cookie=4e86568ff1220cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:48.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e91299700 1 -- 172.21.15.148:0/3972063231 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e91299700 1 -- 172.21.15.148:0/3972063231 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ba50 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e91299700 1 -- 172.21.15.148:0/3972063231 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400bdd0 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 -- 172.21.15.148:0/3972063231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0c0cd0 msgr2=0x7f2e8c157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:48.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e8c084050 tx=0x7f2e84009840).stop 2023-10-24T00:28:48.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 -- 172.21.15.148:0/3972063231 shutdown_connections 2023-10-24T00:28:48.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0c0cd0 0x7f2e8c157c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 --2- 172.21.15.148:0/3972063231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0aa140 0x7f2e8c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 --2- 172.21.15.148:0/3972063231 >> v2:172.21.15.150:3300/0 conn(0x7f2e8c0ca110 0x7f2e8c0c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 -- 172.21.15.148:0/3972063231 >> 172.21.15.148:0/3972063231 conn(0x7f2e8c0944a0 msgr2=0x7f2e8c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:48.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 -- 172.21.15.148:0/3972063231 shutdown_connections 2023-10-24T00:28:48.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.954+0000 7f2e9329d700 1 -- 172.21.15.148:0/3972063231 wait complete. 2023-10-24T00:28:48.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.955+0000 7f2e9329d700 1 Processor -- start 2023-10-24T00:28:48.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.955+0000 7f2e9329d700 1 -- start start 2023-10-24T00:28:48.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e8c0aa140 0x7f2e8c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0c0cd0 0x7f2e8c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0adf50 con 0x7f2e8c0ca110 2023-10-24T00:28:48.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0ae230 con 0x7f2e8c0aa140 2023-10-24T00:28:48.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9329d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0ae510 con 0x7f2e8c0c0cd0 2023-10-24T00:28:48.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50678/0 (socket says 172.21.15.148:50678) 2023-10-24T00:28:48.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 -- 172.21.15.148:0/4041669798 learned_addr learned my addr 172.21.15.148:0/4041669798 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:48.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e9229b700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e8c0aa140 0x7f2e8c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e91a9a700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0c0cd0 0x7f2e8c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 -- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0c0cd0 msgr2=0x7f2e8c0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:48.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0c0cd0 0x7f2e8c0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 -- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e8c0aa140 msgr2=0x7f2e8c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:48.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.956+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e8c0aa140 0x7f2e8c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:48.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e92a9c700 1 -- 172.21.15.148:0/4041669798 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009ae0 con 0x7f2e8c0ca110 2023-10-24T00:28:48.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e92a9c700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2e84009fd0 tx=0x7f2e84009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:48.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84013e60 con 0x7f2e8c0ca110 2023-10-24T00:28:48.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840092e0 con 0x7f2e8c0ca110 2023-10-24T00:28:48.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0ae7f0 con 0x7f2e8c0ca110 2023-10-24T00:28:48.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8401e6c0 con 0x7f2e8c0ca110 2023-10-24T00:28:48.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.957+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0ac230 con 0x7f2e8c0ca110 2023-10-24T00:28:48.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.958+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c047480 con 0x7f2e8c0ca110 2023-10-24T00:28:48.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.958+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2e84003040 con 0x7f2e8c0ca110 2023-10-24T00:28:48.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.958+0000 7f2e827fc700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 0x7f2e70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:48.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.959+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2e8407b3f0 con 0x7f2e8c0ca110 2023-10-24T00:28:48.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.959+0000 7f2e9229b700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 0x7f2e70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:48.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.959+0000 7f2e9229b700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 0x7f2e70061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2e8800bbc0 tx=0x7f2e88008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:48.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:48.963+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2e8404ca10 con 0x7f2e8c0ca110 2023-10-24T00:28:49.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.126+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e8c062c60 con 0x7f2e8c0ca110 2023-10-24T00:28:49.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.127+0000 7f2e827fc700 1 -- 172.21.15.148:0/4041669798 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f2e84023070 con 0x7f2e8c0ca110 2023-10-24T00:28:49.130 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:49.130 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":17,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:48.795085+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:49.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 msgr2=0x7f2e70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 0x7f2e70061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2e8800bbc0 tx=0x7f2e88008040).stop 2023-10-24T00:28:49.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 msgr2=0x7f2e8c143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2e84009fd0 tx=0x7f2e84009840).stop 2023-10-24T00:28:49.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 shutdown_connections 2023-10-24T00:28:49.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e7005f150 0x7f2e70061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e8c0ca110 0x7f2e8c143480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e8c0aa140 0x7f2e8c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 --2- 172.21.15.148:0/4041669798 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e8c0c0cd0 0x7f2e8c0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 >> 172.21.15.148:0/4041669798 conn(0x7f2e8c0944a0 msgr2=0x7f2e8c153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 shutdown_connections 2023-10-24T00:28:49.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.129+0000 7f2e9329d700 1 -- 172.21.15.148:0/4041669798 wait complete. 2023-10-24T00:28:49.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:28:49.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:28:49.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.257+0000 7fdb4c1a1700 1 Processor -- start 2023-10-24T00:28:49.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.257+0000 7fdb4c1a1700 1 -- start start 2023-10-24T00:28:49.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4c1a1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb44154430 0x7fdb44154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4c1a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdb440bffd0 0x7fdb440c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4c1a1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440c71d0 con 0x7fdb44098bd0 2023-10-24T00:28:49.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4c1a1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c6a10 con 0x7fdb44154430 2023-10-24T00:28:49.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4c1a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c9410 con 0x7fdb440bffd0 2023-10-24T00:28:49.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb49f3d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb44154430 0x7fdb44154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4973c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdb44098bd0 0x7fdb440c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43380/0 (socket says 172.21.15.148:43380) 2023-10-24T00:28:49.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4973c700 1 -- 172.21.15.148:0/762556544 learned_addr learned my addr 172.21.15.148:0/762556544 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:49.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.258+0000 7fdb4a73e700 1 --2- 172.21.15.148:0/762556544 >> v2:172.21.15.150:3300/0 conn(0x7fdb440bffd0 0x7fdb440c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb49f3d700 1 -- 172.21.15.148:0/762556544 >> v2:172.21.15.150:3300/0 conn(0x7fdb440bffd0 msgr2=0x7fdb440c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:49.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb49f3d700 1 --2- 172.21.15.148:0/762556544 >> v2:172.21.15.150:3300/0 conn(0x7fdb440bffd0 0x7fdb440c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb49f3d700 1 -- 172.21.15.148:0/762556544 >> v1:172.21.15.148:6789/0 conn(0x7fdb44098bd0 legacy=0x7fdb440c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb49f3d700 1 -- 172.21.15.148:0/762556544 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440c0950 con 0x7fdb44154430 2023-10-24T00:28:49.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb48f3b700 1 -- 172.21.15.148:0/762556544 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672807104 0 0) 0x7fdb440c71d0 con 0x7fdb44098bd0 2023-10-24T00:28:49.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb49f3d700 1 --2- 172.21.15.148:0/762556544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44154430 0x7fdb44154810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdb440aab20 tx=0x7fdb40009780).ready entity=mon.0 client_cookie=7cb1b90b7d1227f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb48f3b700 1 -- 172.21.15.148:0/762556544 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000e070 con 0x7fdb44154430 2023-10-24T00:28:49.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb48f3b700 1 -- 172.21.15.148:0/762556544 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4000bb60 con 0x7fdb44154430 2023-10-24T00:28:49.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb48f3b700 1 -- 172.21.15.148:0/762556544 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40012410 con 0x7fdb44154430 2023-10-24T00:28:49.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/762556544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44154430 msgr2=0x7fdb44154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/762556544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44154430 0x7fdb44154810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdb440aab20 tx=0x7fdb40009780).stop 2023-10-24T00:28:49.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/762556544 shutdown_connections 2023-10-24T00:28:49.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/762556544 >> v2:172.21.15.150:3300/0 conn(0x7fdb440bffd0 0x7fdb440c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/762556544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44154430 0x7fdb44154810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/762556544 >> 172.21.15.148:0/762556544 conn(0x7fdb440cb070 msgr2=0x7fdb440cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/762556544 shutdown_connections 2023-10-24T00:28:49.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.259+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/762556544 wait complete. 2023-10-24T00:28:49.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.260+0000 7fdb4c1a1700 1 Processor -- start 2023-10-24T00:28:49.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 -- start start 2023-10-24T00:28:49.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb440bffd0 0x7fdb441516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb44154430 0x7fdb440c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c5260 con 0x7fdb44098bd0 2023-10-24T00:28:49.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440b0980 con 0x7fdb440bffd0 2023-10-24T00:28:49.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4c1a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c3330 con 0x7fdb44154430 2023-10-24T00:28:49.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb49f3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb49f3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50702/0 (socket says 172.21.15.148:50702) 2023-10-24T00:28:49.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb49f3d700 1 -- 172.21.15.148:0/1165174213 learned_addr learned my addr 172.21.15.148:0/1165174213 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:49.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4a73e700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb44154430 0x7fdb440c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.261+0000 7fdb4973c700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb440bffd0 0x7fdb441516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 -- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb44154430 msgr2=0x7fdb440c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb44154430 0x7fdb440c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 -- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb440bffd0 msgr2=0x7fdb441516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb440bffd0 0x7fdb441516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 -- 172.21.15.148:0/1165174213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009a20 con 0x7fdb44098bd0 2023-10-24T00:28:49.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb49f3d700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdb4000b6c0 tx=0x7fdb40009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000bee0 con 0x7fdb44098bd0 2023-10-24T00:28:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4001d420 con 0x7fdb44098bd0 2023-10-24T00:28:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb44151bd0 con 0x7fdb44098bd0 2023-10-24T00:28:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4001d7c0 con 0x7fdb44098bd0 2023-10-24T00:28:49.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.262+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb440ada40 con 0x7fdb44098bd0 2023-10-24T00:28:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.263+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb440c3610 con 0x7fdb44098bd0 2023-10-24T00:28:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.263+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb4001db70 con 0x7fdb44098bd0 2023-10-24T00:28:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.264+0000 7fdb39ffb700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 0x7fdb28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.264+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdb4007bad0 con 0x7fdb44098bd0 2023-10-24T00:28:49.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.264+0000 7fdb4973c700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 0x7fdb28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.264+0000 7fdb4973c700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 0x7fdb28061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdb440c3ff0 tx=0x7fdb34007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.268+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb4004d0f0 con 0x7fdb44098bd0 2023-10-24T00:28:49.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.429+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdb4406c6b0 con 0x7fdb44098bd0 2023-10-24T00:28:49.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.430+0000 7fdb39ffb700 1 -- 172.21.15.148:0/1165174213 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdb40050710 con 0x7fdb44098bd0 2023-10-24T00:28:49.433 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:28:49.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 msgr2=0x7fdb28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 0x7fdb28061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdb440c3ff0 tx=0x7fdb34007bb0).stop 2023-10-24T00:28:49.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 msgr2=0x7fdb440c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdb4000b6c0 tx=0x7fdb40009780).stop 2023-10-24T00:28:49.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 shutdown_connections 2023-10-24T00:28:49.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb44154430 0x7fdb440c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb2805f150 0x7fdb28061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb44098bd0 0x7fdb440c4800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 --2- 172.21.15.148:0/1165174213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb440bffd0 0x7fdb441516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 >> 172.21.15.148:0/1165174213 conn(0x7fdb440cb070 msgr2=0x7fdb440aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 shutdown_connections 2023-10-24T00:28:49.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.432+0000 7fdb4c1a1700 1 -- 172.21.15.148:0/1165174213 wait complete. 2023-10-24T00:28:49.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:28:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.560+0000 7f5b98c57700 1 Processor -- start 2023-10-24T00:28:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.560+0000 7f5b98c57700 1 -- start start 2023-10-24T00:28:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b98c57700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5b94157780 0x7f5b940c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b98c57700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940c6770 con 0x7f5b940c0960 2023-10-24T00:28:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b98c57700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940c1120 con 0x7f5b940a9e60 2023-10-24T00:28:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b98c57700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b940c1400 con 0x7f5b94157780 2023-10-24T00:28:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5b94157780 0x7f5b940c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b92ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5b940c0960 0x7f5b940a7c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43390/0 (socket says 172.21.15.148:43390) 2023-10-24T00:28:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5b94157780 0x7f5b940c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50712/0 (socket says 172.21.15.148:50712) 2023-10-24T00:28:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b92ffd700 1 -- 172.21.15.148:0/2403709786 learned_addr learned my addr 172.21.15.148:0/2403709786 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 -- 172.21.15.148:0/2403709786 >> v1:172.21.15.150:6789/0 conn(0x7f5b940a9e60 legacy=0x7f5b940aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 -- 172.21.15.148:0/2403709786 >> v1:172.21.15.148:6789/0 conn(0x7f5b940c0960 legacy=0x7f5b940a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 -- 172.21.15.148:0/2403709786 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940c6120 con 0x7f5b94157780 2023-10-24T00:28:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b927fc700 1 -- 172.21.15.148:0/2403709786 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073383760 0 0) 0x7f5b940c6770 con 0x7f5b940c0960 2023-10-24T00:28:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b937fe700 1 --2- 172.21.15.148:0/2403709786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b94157780 0x7f5b940c8530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5b84006fd0 tx=0x7f5b84006f40).ready entity=mon.0 client_cookie=257a74d77f30b689 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b927fc700 1 -- 172.21.15.148:0/2403709786 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84005880 con 0x7f5b94157780 2023-10-24T00:28:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b927fc700 1 -- 172.21.15.148:0/2403709786 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b840059e0 con 0x7f5b94157780 2023-10-24T00:28:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.561+0000 7f5b927fc700 1 -- 172.21.15.148:0/2403709786 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84005d60 con 0x7f5b94157780 2023-10-24T00:28:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 -- 172.21.15.148:0/2403709786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b94157780 msgr2=0x7f5b940c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 --2- 172.21.15.148:0/2403709786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b94157780 0x7f5b940c8530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5b84006fd0 tx=0x7f5b84006f40).stop 2023-10-24T00:28:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 -- 172.21.15.148:0/2403709786 shutdown_connections 2023-10-24T00:28:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 --2- 172.21.15.148:0/2403709786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b94157780 0x7f5b940c8530 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 -- 172.21.15.148:0/2403709786 >> 172.21.15.148:0/2403709786 conn(0x7f5b94094570 msgr2=0x7f5b9406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 -- 172.21.15.148:0/2403709786 shutdown_connections 2023-10-24T00:28:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.562+0000 7f5b98c57700 1 -- 172.21.15.148:0/2403709786 wait complete. 2023-10-24T00:28:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.563+0000 7f5b98c57700 1 Processor -- start 2023-10-24T00:28:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.563+0000 7f5b98c57700 1 -- start start 2023-10-24T00:28:49.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b940c0960 0x7f5b940ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b94157780 0x7f5b940ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940c2340 con 0x7f5b940a9e60 2023-10-24T00:28:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940c25e0 con 0x7f5b94157780 2023-10-24T00:28:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b98c57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940c28c0 con 0x7f5b940c0960 2023-10-24T00:28:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50716/0 (socket says 172.21.15.148:50716) 2023-10-24T00:28:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 -- 172.21.15.148:0/1675579352 learned_addr learned my addr 172.21.15.148:0/1675579352 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b92ffd700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b940c0960 0x7f5b940ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b93fff700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b94157780 0x7f5b940ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 -- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b940c0960 msgr2=0x7f5b940ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b940c0960 0x7f5b940ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 -- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b94157780 msgr2=0x7f5b940ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b94157780 0x7f5b940ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 -- 172.21.15.148:0/1675579352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84009250 con 0x7f5b940a9e60 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b937fe700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5b84006fa0 tx=0x7f5b84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.564+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400b580 con 0x7f5b940a9e60 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.565+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8400b6e0 con 0x7f5b940a9e60 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.565+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b940c2ba0 con 0x7f5b940a9e60 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.565+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400ba80 con 0x7f5b940a9e60 2023-10-24T00:28:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.565+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b940ace00 con 0x7f5b940a9e60 2023-10-24T00:28:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.566+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b940c30c0 con 0x7f5b940a9e60 2023-10-24T00:28:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.566+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5b84011440 con 0x7f5b940a9e60 2023-10-24T00:28:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.566+0000 7f5b7b7fe700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 0x7f5b80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.566+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5b8407b1e0 con 0x7f5b940a9e60 2023-10-24T00:28:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.566+0000 7f5b92ffd700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 0x7f5b80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.567+0000 7f5b92ffd700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 0x7f5b80061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5b94064960 tx=0x7f5b88009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.570+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5b940c30c0 con 0x7f5b940a9e60 2023-10-24T00:28:49.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.733+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b94047480 con 0x7f5b940a9e60 2023-10-24T00:28:49.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.734+0000 7f5b7b7fe700 1 -- 172.21.15.148:0/1675579352 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b84022070 con 0x7f5b940a9e60 2023-10-24T00:28:49.737 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:28:49.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 msgr2=0x7f5b80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 0x7f5b80061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5b94064960 tx=0x7f5b88009040).stop 2023-10-24T00:28:49.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 msgr2=0x7f5b9413c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5b84006fa0 tx=0x7f5b84015000).stop 2023-10-24T00:28:49.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 shutdown_connections 2023-10-24T00:28:49.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b94157780 0x7f5b940ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b8005f150 0x7f5b80061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b940a9e60 0x7f5b9413c260 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 --2- 172.21.15.148:0/1675579352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b940c0960 0x7f5b940ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 >> 172.21.15.148:0/1675579352 conn(0x7f5b94094570 msgr2=0x7f5b94063260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.735+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 shutdown_connections 2023-10-24T00:28:49.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.736+0000 7f5b98c57700 1 -- 172.21.15.148:0/1675579352 wait complete. 2023-10-24T00:28:49.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:28:49.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.861+0000 7f2b1f682700 1 Processor -- start 2023-10-24T00:28:49.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.861+0000 7f2b1f682700 1 -- start start 2023-10-24T00:28:49.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1f682700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b180c7d20 0x7f2b180a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1f682700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180a6a50 con 0x7f2b180a6550 2023-10-24T00:28:49.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1f682700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180a6d30 con 0x7f2b180c86c0 2023-10-24T00:28:49.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1f682700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180bf350 con 0x7f2b180c7d20 2023-10-24T00:28:49.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1dc1f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2b180a6550 0x7f2b1815be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43392/0 (socket says 172.21.15.148:43392) 2023-10-24T00:28:49.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1dc1f700 1 -- 172.21.15.148:0/282267797 learned_addr learned my addr 172.21.15.148:0/282267797 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:49.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.862+0000 7f2b1cc1d700 1 --2- 172.21.15.148:0/282267797 >> v2:172.21.15.150:3300/0 conn(0x7f2b180c7d20 0x7f2b180a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301072530 0 0) 0x7f2b180a6a50 con 0x7f2b180a6550 2023-10-24T00:28:49.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b040033f0 con 0x7f2b180a6550 2023-10-24T00:28:49.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1cc1d700 1 -- 172.21.15.148:0/282267797 >> v1:172.21.15.150:6789/0 conn(0x7f2b180c86c0 legacy=0x7f2b180bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264641683 0 0) 0x7f2b180a6d30 con 0x7f2b180c86c0 2023-10-24T00:28:49.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1cc1d700 1 -- 172.21.15.148:0/282267797 >> v1:172.21.15.148:6789/0 conn(0x7f2b180a6550 legacy=0x7f2b1815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1cc1d700 1 -- 172.21.15.148:0/282267797 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180a7010 con 0x7f2b180c7d20 2023-10-24T00:28:49.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1cc1d700 1 --2- 172.21.15.148:0/282267797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180a7d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2b08009760 tx=0x7f2b08009060).ready entity=mon.1 client_cookie=95f5f097b337b94e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800f510 con 0x7f2b180c7d20 2023-10-24T00:28:49.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0800f670 con 0x7f2b180c7d20 2023-10-24T00:28:49.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b0ffff700 1 -- 172.21.15.148:0/282267797 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800f9f0 con 0x7f2b180c7d20 2023-10-24T00:28:49.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1f682700 1 -- 172.21.15.148:0/282267797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 msgr2=0x7f2b180a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.863+0000 7f2b1f682700 1 --2- 172.21.15.148:0/282267797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180a7d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2b08009760 tx=0x7f2b08009060).stop 2023-10-24T00:28:49.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.864+0000 7f2b1f682700 1 -- 172.21.15.148:0/282267797 shutdown_connections 2023-10-24T00:28:49.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.864+0000 7f2b1f682700 1 --2- 172.21.15.148:0/282267797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180a7d70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.864+0000 7f2b1f682700 1 -- 172.21.15.148:0/282267797 >> 172.21.15.148:0/282267797 conn(0x7f2b18092480 msgr2=0x7f2b18062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:49.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.864+0000 7f2b1f682700 1 -- 172.21.15.148:0/282267797 shutdown_connections 2023-10-24T00:28:49.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.864+0000 7f2b1f682700 1 -- 172.21.15.148:0/282267797 wait complete. 2023-10-24T00:28:49.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.865+0000 7f2b1f682700 1 Processor -- start 2023-10-24T00:28:49.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.865+0000 7f2b1f682700 1 -- start start 2023-10-24T00:28:49.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 0x7f2b1813e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ad670 con 0x7f2b180a6550 2023-10-24T00:28:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b18156230 con 0x7f2b180c7d20 2023-10-24T00:28:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180ade10 con 0x7f2b180c86c0 2023-10-24T00:28:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50728/0 (socket says 172.21.15.148:50728) 2023-10-24T00:28:49.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 -- 172.21.15.148:0/2451167934 learned_addr learned my addr 172.21.15.148:0/2451167934 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:49.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1cc1d700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1dc1f700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 0x7f2b1813e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 -- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 msgr2=0x7f2b1813e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 0x7f2b1813e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 -- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 msgr2=0x7f2b180c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:49.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:49.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 -- 172.21.15.148:0/2451167934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080092a0 con 0x7f2b180a6550 2023-10-24T00:28:49.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1dc1f700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 0x7f2b1813e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:28:49.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1d41e700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2b1400c860 tx=0x7f2b14001680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400a5f0 con 0x7f2b180a6550 2023-10-24T00:28:49.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1400a770 con 0x7f2b180a6550 2023-10-24T00:28:49.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400ab30 con 0x7f2b180a6550 2023-10-24T00:28:49.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b180c0570 con 0x7f2b180a6550 2023-10-24T00:28:49.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.866+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b180ad850 con 0x7f2b180a6550 2023-10-24T00:28:49.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.867+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1806c6b0 con 0x7f2b180a6550 2023-10-24T00:28:49.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.868+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2b1401b400 con 0x7f2b180a6550 2023-10-24T00:28:49.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.868+0000 7f2b0d7fa700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 0x7f2afc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:49.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.868+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2b14079e70 con 0x7f2b180a6550 2023-10-24T00:28:49.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.868+0000 7f2b1cc1d700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 0x7f2afc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:49.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.869+0000 7f2b1cc1d700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 0x7f2afc061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2b180c8140 tx=0x7f2b08017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:49.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:49.872+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2b1404b430 con 0x7f2b180a6550 2023-10-24T00:28:50.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.075+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b180a72f0 con 0x7f2b180a6550 2023-10-24T00:28:50.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.076+0000 7f2b0d7fa700 1 -- 172.21.15.148:0/2451167934 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f2b1404ea50 con 0x7f2b180a6550 2023-10-24T00:28:50.079 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:50.079 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-24T00:28:50.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 msgr2=0x7f2afc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 0x7f2afc061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2b180c8140 tx=0x7f2b08017000).stop 2023-10-24T00:28:50.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 msgr2=0x7f2b180ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2b1400c860 tx=0x7f2b14001680).stop 2023-10-24T00:28:50.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 shutdown_connections 2023-10-24T00:28:50.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180c86c0 0x7f2b1813e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2afc05f150 0x7f2afc061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b180a6550 0x7f2b180ad180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 --2- 172.21.15.148:0/2451167934 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b180c7d20 0x7f2b180c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 >> 172.21.15.148:0/2451167934 conn(0x7f2b18092480 msgr2=0x7f2b18150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 shutdown_connections 2023-10-24T00:28:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.078+0000 7f2b1f682700 1 -- 172.21.15.148:0/2451167934 wait complete. 2023-10-24T00:28:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 3 2023-10-24T00:28:50.093 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:50.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.203+0000 7f5e64335700 1 Processor -- start 2023-10-24T00:28:50.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.203+0000 7f5e64335700 1 -- start start 2023-10-24T00:28:50.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e64335700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e5c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e64335700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0c0960 con 0x7f5e5c0c6710 2023-10-24T00:28:50.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e64335700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0c0c40 con 0x7f5e5c0aa3f0 2023-10-24T00:28:50.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e64335700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0aa8a0 con 0x7f5e5c0aa010 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e618d0700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5e5c0c6710 0x7f5e5c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43402/0 (socket says 172.21.15.148:43402) 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e618d0700 1 -- 172.21.15.148:0/3214510477 learned_addr learned my addr 172.21.15.148:0/3214510477 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.204+0000 7f5e620d1700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e5c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6147217 0 0) 0x7f5e5c0c0960 con 0x7f5e5c0c6710 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e480033f0 con 0x7f5e5c0c6710 2023-10-24T00:28:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1310025721 0 0) 0x7f5e480033f0 con 0x7f5e5c0c6710 2023-10-24T00:28:50.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 msgr2=0x7f5e5c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e5c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 >> v1:172.21.15.150:6789/0 conn(0x7f5e5c0aa3f0 legacy=0x7f5e5c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0c0f20 con 0x7f5e5c0c6710 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f5e4c001470 con 0x7f5e5c0c6710 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 >> v1:172.21.15.148:6789/0 conn(0x7f5e5c0c6710 legacy=0x7f5e5c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e48003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e48003e40 0x7f5e48004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e48004b80 0x7f5e48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0aa8a0 con 0x7f5e48003e40 2023-10-24T00:28:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800b990 con 0x7f5e48004b80 2023-10-24T00:28:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800bb50 con 0x7f5e5c0aa010 2023-10-24T00:28:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e48003e40 0x7f5e48004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e620d1700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e48003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e628d2700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e48004b80 0x7f5e48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 -- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 msgr2=0x7f5e48003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e48003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 -- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e48004b80 msgr2=0x7f5e48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e48004b80 0x7f5e48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 -- 172.21.15.148:0/3214510477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480033f0 con 0x7f5e48003e40 2023-10-24T00:28:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e620d1700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e5c0aa010 0x7f5e48003910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:28:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.205+0000 7f5e618d0700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e48003e40 0x7f5e48004690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5e5c0adc70 tx=0x7f5e5c0c6390).ready entity=mon.0 client_cookie=2dbff8147570e5a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c00ca60 con 0x7f5e48003e40 2023-10-24T00:28:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c00cbc0 con 0x7f5e48003e40 2023-10-24T00:28:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e610cf700 1 -- 172.21.15.148:0/3214510477 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0070d0 con 0x7f5e48003e40 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 -- 172.21.15.148:0/3214510477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e48003e40 msgr2=0x7f5e48004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 --2- 172.21.15.148:0/3214510477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e48003e40 0x7f5e48004690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5e5c0adc70 tx=0x7f5e5c0c6390).stop 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e628d2700 1 -- 172.21.15.148:0/3214510477 reap_dead start 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 -- 172.21.15.148:0/3214510477 shutdown_connections 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 -- 172.21.15.148:0/3214510477 >> 172.21.15.148:0/3214510477 conn(0x7f5e5c0caf40 msgr2=0x7f5e5c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 -- 172.21.15.148:0/3214510477 shutdown_connections 2023-10-24T00:28:50.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.206+0000 7f5e64335700 1 -- 172.21.15.148:0/3214510477 wait complete. 2023-10-24T00:28:50.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.207+0000 7f5e64335700 1 Processor -- start 2023-10-24T00:28:50.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.207+0000 7f5e64335700 1 -- start start 2023-10-24T00:28:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e48003e40 0x7f5e5c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e5c157240 0x7f5e5c0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b0410 con 0x7f5e5c14bc70 2023-10-24T00:28:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b0ef0 con 0x7f5e5c157240 2023-10-24T00:28:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e64335700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0af180 con 0x7f5e48003e40 2023-10-24T00:28:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50748/0 (socket says 172.21.15.148:50748) 2023-10-24T00:28:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 -- 172.21.15.148:0/2446548692 learned_addr learned my addr 172.21.15.148:0/2446548692 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e620d1700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e48003e40 0x7f5e5c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e618d0700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e5c157240 0x7f5e5c0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 -- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e48003e40 msgr2=0x7f5e5c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e48003e40 0x7f5e5c0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 -- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e5c157240 msgr2=0x7f5e5c0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e5c157240 0x7f5e5c0b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.208+0000 7f5e628d2700 1 -- 172.21.15.148:0/2446548692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c1579b0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e628d2700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5e5c157d00 tx=0x7f5e54007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540114c0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54011620 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c0af440 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540119e0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.209+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c0afa00 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.210+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c0afd70 con 0x7f5e5c14bc70 2023-10-24T00:28:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.210+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e54011d50 con 0x7f5e5c14bc70 2023-10-24T00:28:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.210+0000 7f5e527fc700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 0x7f5e40061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.210+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5e54079780 con 0x7f5e5c14bc70 2023-10-24T00:28:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.211+0000 7f5e620d1700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 0x7f5e40061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.211+0000 7f5e620d1700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 0x7f5e40061640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5e580094d0 tx=0x7f5e5800b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.214+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e5404ada0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.377+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e5c06c6b0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.378+0000 7f5e527fc700 1 -- 172.21.15.148:0/2446548692 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7f5e5404e3c0 con 0x7f5e5c14bc70 2023-10-24T00:28:50.381 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:50.381 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":18,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:49.798963+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:50.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 msgr2=0x7f5e40061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 0x7f5e40061640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5e580094d0 tx=0x7f5e5800b040).stop 2023-10-24T00:28:50.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 msgr2=0x7f5e5c0c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5e5c157d00 tx=0x7f5e54007bb0).stop 2023-10-24T00:28:50.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 shutdown_connections 2023-10-24T00:28:50.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4005f180 0x7f5e40061640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e5c14bc70 0x7f5e5c0c8f60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e48003e40 0x7f5e5c0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 --2- 172.21.15.148:0/2446548692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e5c157240 0x7f5e5c0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 >> 172.21.15.148:0/2446548692 conn(0x7f5e5c0caf40 msgr2=0x7f5e5c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 shutdown_connections 2023-10-24T00:28:50.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.380+0000 7f5e64335700 1 -- 172.21.15.148:0/2446548692 wait complete. 2023-10-24T00:28:50.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:28:50.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:28:50.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.510+0000 7fa97cdc8700 1 Processor -- start 2023-10-24T00:28:50.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.510+0000 7fa97cdc8700 1 -- start start 2023-10-24T00:28:50.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa97cdc8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa978157780 0x7fa9780c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa97cdc8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9780c0960 0x7fa9780a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa97cdc8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780c6770 con 0x7fa9780a8120 2023-10-24T00:28:50.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa97cdc8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780c1120 con 0x7fa978157780 2023-10-24T00:28:50.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa97cdc8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c1400 con 0x7fa9780c0960 2023-10-24T00:28:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa978157780 0x7fa9780c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa978157780 0x7fa9780c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50762/0 (socket says 172.21.15.148:50762) 2023-10-24T00:28:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 -- 172.21.15.148:0/316560176 learned_addr learned my addr 172.21.15.148:0/316560176 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa977fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9780a8120 0x7fa9780a9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43414/0 (socket says 172.21.15.148:43414) 2023-10-24T00:28:50.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa976ffd700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9780c0960 0x7fa9780a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 -- 172.21.15.148:0/316560176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9780c0960 msgr2=0x7fa9780a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9780c0960 0x7fa9780a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 -- 172.21.15.148:0/316560176 >> v1:172.21.15.148:6789/0 conn(0x7fa9780a8120 legacy=0x7fa9780a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9767fc700 1 -- 172.21.15.148:0/316560176 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960504607 0 0) 0x7fa9780c6770 con 0x7fa9780a8120 2023-10-24T00:28:50.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 -- 172.21.15.148:0/316560176 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780c6120 con 0x7fa978157780 2023-10-24T00:28:50.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9777fe700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa978157780 0x7fa9780c8530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa970009f70 tx=0x7fa970009840).ready entity=mon.0 client_cookie=19b84fd6c022752f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9767fc700 1 -- 172.21.15.148:0/316560176 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000e070 con 0x7fa978157780 2023-10-24T00:28:50.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9767fc700 1 -- 172.21.15.148:0/316560176 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000ba20 con 0x7fa978157780 2023-10-24T00:28:50.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.511+0000 7fa9767fc700 1 -- 172.21.15.148:0/316560176 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000bda0 con 0x7fa978157780 2023-10-24T00:28:50.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 -- 172.21.15.148:0/316560176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa978157780 msgr2=0x7fa9780c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa978157780 0x7fa9780c8530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa970009f70 tx=0x7fa970009840).stop 2023-10-24T00:28:50.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 -- 172.21.15.148:0/316560176 shutdown_connections 2023-10-24T00:28:50.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa978157780 0x7fa9780c8530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/316560176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9780c0960 0x7fa9780a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 -- 172.21.15.148:0/316560176 >> 172.21.15.148:0/316560176 conn(0x7fa978094570 msgr2=0x7fa97806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 -- 172.21.15.148:0/316560176 shutdown_connections 2023-10-24T00:28:50.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.512+0000 7fa97cdc8700 1 -- 172.21.15.148:0/316560176 wait complete. 2023-10-24T00:28:50.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.513+0000 7fa97cdc8700 1 Processor -- start 2023-10-24T00:28:50.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.513+0000 7fa97cdc8700 1 -- start start 2023-10-24T00:28:50.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9780c0960 0x7fa9780c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa978157780 0x7fa9780639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978095b20 con 0x7fa9780a8120 2023-10-24T00:28:50.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97814f3c0 con 0x7fa9780c0960 2023-10-24T00:28:50.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa97cdc8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978095690 con 0x7fa978157780 2023-10-24T00:28:50.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50764/0 (socket says 172.21.15.148:50764) 2023-10-24T00:28:50.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa9777fe700 1 -- 172.21.15.148:0/2104852936 learned_addr learned my addr 172.21.15.148:0/2104852936 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:50.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa976ffd700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9780c0960 0x7fa9780c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.514+0000 7fa977fff700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa978157780 0x7fa9780639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 -- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa978157780 msgr2=0x7fa9780639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa978157780 0x7fa9780639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 -- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9780c0960 msgr2=0x7fa9780c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9780c0960 0x7fa9780c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 -- 172.21.15.148:0/2104852936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009ae0 con 0x7fa9780a8120 2023-10-24T00:28:50.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa9777fe700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa97805f980 tx=0x7fa970009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700092e0 con 0x7fa9780a8120 2023-10-24T00:28:50.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000bb90 con 0x7fa9780a8120 2023-10-24T00:28:50.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978094af0 con 0x7fa9780a8120 2023-10-24T00:28:50.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97001c650 con 0x7fa9780a8120 2023-10-24T00:28:50.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.515+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978095040 con 0x7fa9780a8120 2023-10-24T00:28:50.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.516+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978095970 con 0x7fa9780a8120 2023-10-24T00:28:50.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.516+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa97001ca00 con 0x7fa9780a8120 2023-10-24T00:28:50.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.516+0000 7fa96f7fe700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 0x7fa958061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.517+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa97007b6e0 con 0x7fa9780a8120 2023-10-24T00:28:50.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.517+0000 7fa976ffd700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 0x7fa958061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.517+0000 7fa976ffd700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 0x7fa958061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa9780ad7f0 tx=0x7fa960009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.520+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa97004cd00 con 0x7fa9780a8120 2023-10-24T00:28:50.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.684+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa978047480 con 0x7fa9780a8120 2023-10-24T00:28:50.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.684+0000 7fa96f7fe700 1 -- 172.21.15.148:0/2104852936 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa97001ccb0 con 0x7fa9780a8120 2023-10-24T00:28:50.687 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:28:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 msgr2=0x7fa958061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 0x7fa958061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa9780ad7f0 tx=0x7fa960009060).stop 2023-10-24T00:28:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 msgr2=0x7fa97814eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa97805f980 tx=0x7fa970009840).stop 2023-10-24T00:28:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 shutdown_connections 2023-10-24T00:28:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa978157780 0x7fa9780639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa95805f150 0x7fa958061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9780a8120 0x7fa97814eed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 --2- 172.21.15.148:0/2104852936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9780c0960 0x7fa9780c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 >> 172.21.15.148:0/2104852936 conn(0x7fa978094570 msgr2=0x7fa9780c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 shutdown_connections 2023-10-24T00:28:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.686+0000 7fa97cdc8700 1 -- 172.21.15.148:0/2104852936 wait complete. 2023-10-24T00:28:50.701 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:28:50.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.817+0000 7f7ef1f7f700 1 Processor -- start 2023-10-24T00:28:50.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.817+0000 7f7ef1f7f700 1 -- start start 2023-10-24T00:28:50.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7eec154430 0x7f7eec154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eec098bd0 0x7f7eec0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0c71d0 con 0x7f7eec098bd0 2023-10-24T00:28:50.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0c9410 con 0x7f7eec154430 2023-10-24T00:28:50.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7ef1f7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0c0950 con 0x7f7eec0bffd0 2023-10-24T00:28:50.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7eeaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eec098bd0 0x7f7eec0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7eeaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7eec098bd0 0x7f7eec0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50776/0 (socket says 172.21.15.148:50776) 2023-10-24T00:28:50.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7eeaffd700 1 -- 172.21.15.148:0/268708192 learned_addr learned my addr 172.21.15.148:0/268708192 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:50.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7eebfff700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.818+0000 7f7eeb7fe700 1 --2- 172.21.15.148:0/268708192 >> v2:172.21.15.150:3300/0 conn(0x7f7eec154430 0x7f7eec154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 -- 172.21.15.148:0/268708192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 msgr2=0x7f7eec0c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec0c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 -- 172.21.15.148:0/268708192 >> v2:172.21.15.150:3300/0 conn(0x7f7eec154430 msgr2=0x7f7eec154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:50.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/268708192 >> v2:172.21.15.150:3300/0 conn(0x7f7eec154430 0x7f7eec154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 -- 172.21.15.148:0/268708192 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0c6c10 con 0x7f7eec098bd0 2023-10-24T00:28:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec0c6300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7eec05ff70 tx=0x7f7ee00090f0).ready entity=mon.0 client_cookie=ab9172d285cfa586 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eea7fc700 1 -- 172.21.15.148:0/268708192 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000f510 con 0x7f7eec098bd0 2023-10-24T00:28:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eea7fc700 1 -- 172.21.15.148:0/268708192 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000f670 con 0x7f7eec098bd0 2023-10-24T00:28:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7eea7fc700 1 -- 172.21.15.148:0/268708192 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000fa10 con 0x7f7eec098bd0 2023-10-24T00:28:50.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/268708192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 msgr2=0x7f7eec0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec0c6300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f7eec05ff70 tx=0x7f7ee00090f0).stop 2023-10-24T00:28:50.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/268708192 shutdown_connections 2023-10-24T00:28:50.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec0c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/268708192 >> v2:172.21.15.150:3300/0 conn(0x7f7eec154430 0x7f7eec154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/268708192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec0c6300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/268708192 >> 172.21.15.148:0/268708192 conn(0x7f7eec0cb070 msgr2=0x7f7eec0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:50.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/268708192 shutdown_connections 2023-10-24T00:28:50.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.819+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/268708192 wait complete. 2023-10-24T00:28:50.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 Processor -- start 2023-10-24T00:28:50.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 -- start start 2023-10-24T00:28:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec154430 0x7f7eec0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0adc00 con 0x7f7eec098bd0 2023-10-24T00:28:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0af750 con 0x7f7eec154430 2023-10-24T00:28:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7ef1f7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0ad920 con 0x7f7eec0bffd0 2023-10-24T00:28:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7eeb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.821+0000 7f7eeb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50790/0 (socket says 172.21.15.148:50790) 2023-10-24T00:28:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 -- 172.21.15.148:0/985636838 learned_addr learned my addr 172.21.15.148:0/985636838 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eebfff700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec154430 0x7f7eec0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 -- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 msgr2=0x7f7eec142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 -- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec154430 msgr2=0x7f7eec0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec154430 0x7f7eec0aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 -- 172.21.15.148:0/985636838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009370 con 0x7f7eec098bd0 2023-10-24T00:28:50.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:28:50.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7eeb7fe700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7edc009e50 tx=0x7f7edc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc009b30 con 0x7f7eec098bd0 2023-10-24T00:28:50.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00f040 con 0x7f7eec098bd0 2023-10-24T00:28:50.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec0af100 con 0x7f7eec098bd0 2023-10-24T00:28:50.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00ce30 con 0x7f7eec098bd0 2023-10-24T00:28:50.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.822+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec142920 con 0x7f7eec098bd0 2023-10-24T00:28:50.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.823+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec0afa30 con 0x7f7eec098bd0 2023-10-24T00:28:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.823+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7edc013610 con 0x7f7eec098bd0 2023-10-24T00:28:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.824+0000 7f7ed37fe700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 0x7f7ed8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.824+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7edc07a6a0 con 0x7f7eec098bd0 2023-10-24T00:28:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.824+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 0x7f7ed8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.824+0000 7f7eeaffd700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 0x7f7ed8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7eec0b0c60 tx=0x7f7ee0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.828+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7edc04bcc0 con 0x7f7eec098bd0 2023-10-24T00:28:50.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.992+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7eec06c6b0 con 0x7f7eec098bd0 2023-10-24T00:28:50.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.993+0000 7f7ed37fe700 1 -- 172.21.15.148:0/985636838 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7edc04f2e0 con 0x7f7eec098bd0 2023-10-24T00:28:50.996 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:28:50.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 msgr2=0x7f7ed8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 0x7f7ed8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7eec0b0c60 tx=0x7f7ee0017000).stop 2023-10-24T00:28:50.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 msgr2=0x7f7eec151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:50.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7edc009e50 tx=0x7f7edc00b040).stop 2023-10-24T00:28:50.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 shutdown_connections 2023-10-24T00:28:50.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7eec154430 0x7f7eec0aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ed805f150 0x7f7ed8061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7eec098bd0 0x7f7eec151a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:50.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 --2- 172.21.15.148:0/985636838 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7eec0bffd0 0x7f7eec142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 >> 172.21.15.148:0/985636838 conn(0x7f7eec0cb070 msgr2=0x7f7eec0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 shutdown_connections 2023-10-24T00:28:51.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:50.995+0000 7f7ef1f7f700 1 -- 172.21.15.148:0/985636838 wait complete. 2023-10-24T00:28:51.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:28:51.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 Processor -- start 2023-10-24T00:28:51.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 -- start start 2023-10-24T00:28:51.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60e80aa010 0x7f60e80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80aa3f0 0x7f60e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80aa860 con 0x7f60e80c6710 2023-10-24T00:28:51.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80c0960 con 0x7f60e80aa010 2023-10-24T00:28:51.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.120+0000 7f60eeb28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c0c40 con 0x7f60e80aa3f0 2023-10-24T00:28:51.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60e80aa010 0x7f60e80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f60e80c6710 0x7f60e8158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43416/0 (socket says 172.21.15.148:43416) 2023-10-24T00:28:51.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e7fff700 1 -- 172.21.15.148:0/2040001263 learned_addr learned my addr 172.21.15.148:0/2040001263 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:51.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ed0c5700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80aa3f0 0x7f60e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 -- 172.21.15.148:0/2040001263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80aa3f0 msgr2=0x7f60e8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:51.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80aa3f0 0x7f60e8069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 -- 172.21.15.148:0/2040001263 >> v1:172.21.15.148:6789/0 conn(0x7f60e80c6710 legacy=0x7f60e8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 -- 172.21.15.148:0/2040001263 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80c0f20 con 0x7f60e80aa010 2023-10-24T00:28:51.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e77fe700 1 -- 172.21.15.148:0/2040001263 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274180614 0 0) 0x7f60e80aa860 con 0x7f60e80c6710 2023-10-24T00:28:51.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60ec8c4700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c1a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f60dc009760 tx=0x7f60dc009060).ready entity=mon.0 client_cookie=55874264f0143e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e77fe700 1 -- 172.21.15.148:0/2040001263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00f510 con 0x7f60e80aa010 2023-10-24T00:28:51.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e77fe700 1 -- 172.21.15.148:0/2040001263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00f670 con 0x7f60e80aa010 2023-10-24T00:28:51.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.121+0000 7f60e77fe700 1 -- 172.21.15.148:0/2040001263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00f9f0 con 0x7f60e80aa010 2023-10-24T00:28:51.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 -- 172.21.15.148:0/2040001263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 msgr2=0x7f60e80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c1a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f60dc009760 tx=0x7f60dc009060).stop 2023-10-24T00:28:51.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 -- 172.21.15.148:0/2040001263 shutdown_connections 2023-10-24T00:28:51.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80aa3f0 0x7f60e8069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 --2- 172.21.15.148:0/2040001263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c1a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 -- 172.21.15.148:0/2040001263 >> 172.21.15.148:0/2040001263 conn(0x7f60e80caf40 msgr2=0x7f60e80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 -- 172.21.15.148:0/2040001263 shutdown_connections 2023-10-24T00:28:51.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.122+0000 7f60eeb28700 1 -- 172.21.15.148:0/2040001263 wait complete. 2023-10-24T00:28:51.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.123+0000 7f60eeb28700 1 Processor -- start 2023-10-24T00:28:51.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.123+0000 7f60eeb28700 1 -- start start 2023-10-24T00:28:51.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 0x7f60e81649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80c6710 0x7f60e80c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80c3160 con 0x7f60e80aa010 2023-10-24T00:28:51.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8164ec0 con 0x7f60e80aa3f0 2023-10-24T00:28:51.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81523a0 con 0x7f60e80c6710 2023-10-24T00:28:51.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50818/0 (socket says 172.21.15.148:50818) 2023-10-24T00:28:51.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 -- 172.21.15.148:0/1732894368 learned_addr learned my addr 172.21.15.148:0/1732894368 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:51.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ed0c5700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80c6710 0x7f60e80c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60e7fff700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 0x7f60e81649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 -- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80c6710 msgr2=0x7f60e80c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80c6710 0x7f60e80c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 -- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 msgr2=0x7f60e81649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 0x7f60e81649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 -- 172.21.15.148:0/1732894368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0092a0 con 0x7f60e80aa010 2023-10-24T00:28:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60e7fff700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 0x7f60e81649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60ec8c4700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f60dc009e00 tx=0x7f60dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00f7e0 con 0x7f60e80aa010 2023-10-24T00:28:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00f960 con 0x7f60e80aa010 2023-10-24T00:28:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e80c2ee0 con 0x7f60e80aa010 2023-10-24T00:28:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.124+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc01b690 con 0x7f60e80aa010 2023-10-24T00:28:51.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.125+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8154cc0 con 0x7f60e80aa010 2023-10-24T00:28:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e806c6b0 con 0x7f60e80aa010 2023-10-24T00:28:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f60dc01ba00 con 0x7f60e80aa010 2023-10-24T00:28:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60e4ff9700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 0x7f60cc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f60dc07b4a0 con 0x7f60e80aa010 2023-10-24T00:28:51.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60e7fff700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 0x7f60cc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.126+0000 7f60e7fff700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 0x7f60cc061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f60d4007fd0 tx=0x7f60d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.130+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f60dc04cac0 con 0x7f60e80aa010 2023-10-24T00:28:51.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.293+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60e80c1200 con 0x7f60e80aa010 2023-10-24T00:28:51.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.293+0000 7f60e4ff9700 1 -- 172.21.15.148:0/1732894368 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f60dc01bcb0 con 0x7f60e80aa010 2023-10-24T00:28:51.296 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:51.297 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:28:51.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:28:51.297 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:28:51.297 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:28:51.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:28:51.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:28:51.298 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:28:51.298 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:28:51.298 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:28:51.299 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:28:51.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 msgr2=0x7f60cc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 0x7f60cc061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f60d4007fd0 tx=0x7f60d4009040).stop 2023-10-24T00:28:51.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 msgr2=0x7f60e80c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f60dc009e00 tx=0x7f60dc017000).stop 2023-10-24T00:28:51.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 shutdown_connections 2023-10-24T00:28:51.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60e80c6710 0x7f60e80c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f60cc05f150 0x7f60cc061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.295+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60e80aa010 0x7f60e80c4020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.296+0000 7f60eeb28700 1 --2- 172.21.15.148:0/1732894368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60e80aa3f0 0x7f60e81649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.296+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 >> 172.21.15.148:0/1732894368 conn(0x7f60e80caf40 msgr2=0x7f60e8153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.296+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 shutdown_connections 2023-10-24T00:28:51.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.296+0000 7f60eeb28700 1 -- 172.21.15.148:0/1732894368 wait complete. 2023-10-24T00:28:51.310 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:28:51.310 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:28:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.425+0000 7f3badc40700 1 Processor -- start 2023-10-24T00:28:51.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.425+0000 7f3badc40700 1 -- start start 2023-10-24T00:28:51.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3badc40700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ba8137570 0x7f3ba80665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3badc40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba80be080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3badc40700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba8137950 con 0x7f3ba8066ad0 2023-10-24T00:28:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3badc40700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba8066f50 con 0x7f3ba8137570 2023-10-24T00:28:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3badc40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8157fd0 con 0x7f3ba8063e70 2023-10-24T00:28:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3ba77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ba8137570 0x7f3ba80665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3ba77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3ba8137570 0x7f3ba80665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50834/0 (socket says 172.21.15.148:50834) 2023-10-24T00:28:51.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3ba6ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3ba8066ad0 0x7f3ba8063760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43430/0 (socket says 172.21.15.148:43430) 2023-10-24T00:28:51.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.426+0000 7f3ba77fe700 1 -- 172.21.15.148:0/850803258 learned_addr learned my addr 172.21.15.148:0/850803258 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:51.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba7fff700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba80be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba77fe700 1 -- 172.21.15.148:0/850803258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 msgr2=0x7f3ba80be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:51.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba77fe700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba80be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba77fe700 1 -- 172.21.15.148:0/850803258 >> v1:172.21.15.148:6789/0 conn(0x7f3ba8066ad0 legacy=0x7f3ba8063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba67fc700 1 -- 172.21.15.148:0/850803258 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618770800 0 0) 0x7f3ba8137950 con 0x7f3ba8066ad0 2023-10-24T00:28:51.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba77fe700 1 -- 172.21.15.148:0/850803258 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8158270 con 0x7f3ba8137570 2023-10-24T00:28:51.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba7fff700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba80be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:28:51.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba77fe700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80665e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3b98009f70 tx=0x7f3b98009840).ready entity=mon.0 client_cookie=58ceb0d8f03f8b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba67fc700 1 -- 172.21.15.148:0/850803258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800e070 con 0x7f3ba8137570 2023-10-24T00:28:51.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba67fc700 1 -- 172.21.15.148:0/850803258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9800bad0 con 0x7f3ba8137570 2023-10-24T00:28:51.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3ba67fc700 1 -- 172.21.15.148:0/850803258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800be50 con 0x7f3ba8137570 2023-10-24T00:28:51.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 -- 172.21.15.148:0/850803258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 msgr2=0x7f3ba80665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80665e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3b98009f70 tx=0x7f3b98009840).stop 2023-10-24T00:28:51.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 -- 172.21.15.148:0/850803258 shutdown_connections 2023-10-24T00:28:51.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba80be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 --2- 172.21.15.148:0/850803258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80665e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 -- 172.21.15.148:0/850803258 >> 172.21.15.148:0/850803258 conn(0x7f3ba8063120 msgr2=0x7f3ba80c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 -- 172.21.15.148:0/850803258 shutdown_connections 2023-10-24T00:28:51.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.427+0000 7f3badc40700 1 -- 172.21.15.148:0/850803258 wait complete. 2023-10-24T00:28:51.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 Processor -- start 2023-10-24T00:28:51.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 -- start start 2023-10-24T00:28:51.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 0x7f3ba80aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80ab290 con 0x7f3ba8137570 2023-10-24T00:28:51.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba814fb10 con 0x7f3ba8066ad0 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3badc40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba814f1e0 con 0x7f3ba8063e70 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3ba7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3ba7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50846/0 (socket says 172.21.15.148:50846) 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.429+0000 7f3ba7fff700 1 -- 172.21.15.148:0/756004547 learned_addr learned my addr 172.21.15.148:0/756004547 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba77fe700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba6ffd700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 0x7f3ba80aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 -- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 msgr2=0x7f3ba814e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba814e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 -- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 msgr2=0x7f3ba80aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 0x7f3ba80aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 -- 172.21.15.148:0/756004547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009ae0 con 0x7f3ba8137570 2023-10-24T00:28:51.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba6ffd700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 0x7f3ba80aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:28:51.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3ba7fff700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3ba000c850 tx=0x7f3ba0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000e510 con 0x7f3ba8137570 2023-10-24T00:28:51.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000e670 con 0x7f3ba8137570 2023-10-24T00:28:51.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba814f4c0 con 0x7f3ba8137570 2023-10-24T00:28:51.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000e9f0 con 0x7f3ba8137570 2023-10-24T00:28:51.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.430+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba814e6e0 con 0x7f3ba8137570 2023-10-24T00:28:51.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.431+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba806c6b0 con 0x7f3ba8137570 2023-10-24T00:28:51.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.431+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3ba00113d0 con 0x7f3ba8137570 2023-10-24T00:28:51.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.432+0000 7f3b8f7fe700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 0x7f3b94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.432+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3ba00798b0 con 0x7f3ba8137570 2023-10-24T00:28:51.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.432+0000 7f3ba77fe700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 0x7f3b94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.432+0000 7f3ba77fe700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 0x7f3b94061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3b9800baa0 tx=0x7f3b98009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.436+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3ba0048af0 con 0x7f3ba8137570 2023-10-24T00:28:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.601+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3ba8158550 con 0x7f3ba8137570 2023-10-24T00:28:51.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.810+0000 7f3b8f7fe700 1 -- 172.21.15.148:0/756004547 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3ba004af20 con 0x7f3ba8137570 2023-10-24T00:28:51.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 msgr2=0x7f3b94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 0x7f3b94061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3b9800baa0 tx=0x7f3b98009840).stop 2023-10-24T00:28:51.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 msgr2=0x7f3ba80aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3ba000c850 tx=0x7f3ba0008040).stop 2023-10-24T00:28:51.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 shutdown_connections 2023-10-24T00:28:51.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3b9405f150 0x7f3b94061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ba8137570 0x7f3ba80aca20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ba8063e70 0x7f3ba814e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 --2- 172.21.15.148:0/756004547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8066ad0 0x7f3ba80aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 >> 172.21.15.148:0/756004547 conn(0x7f3ba8063120 msgr2=0x7f3ba8136860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 shutdown_connections 2023-10-24T00:28:51.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.814+0000 7f3badc40700 1 -- 172.21.15.148:0/756004547 wait complete. 2023-10-24T00:28:51.819 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:28:51.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:28:51.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.949+0000 7efcf0592700 1 Processor -- start 2023-10-24T00:28:51.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.949+0000 7efcf0592700 1 -- start start 2023-10-24T00:28:51.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcf0592700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efce8098bd0 0x7efce8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcf0592700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efce80bffd0 0x7efce80c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcf0592700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80c71d0 con 0x7efce8154430 2023-10-24T00:28:51.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcf0592700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce80c6a10 con 0x7efce80bffd0 2023-10-24T00:28:51.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcf0592700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce80c9410 con 0x7efce8098bd0 2023-10-24T00:28:51.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efceeb2f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efce80bffd0 0x7efce80c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efceeb2f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efce80bffd0 0x7efce80c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50856/0 (socket says 172.21.15.148:50856) 2023-10-24T00:28:51.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efceeb2f700 1 -- 172.21.15.148:0/1594253357 learned_addr learned my addr 172.21.15.148:0/1594253357 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:51.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efcedb2d700 1 --2- 172.21.15.148:0/1594253357 >> v2:172.21.15.150:3300/0 conn(0x7efce8098bd0 0x7efce8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.950+0000 7efceeb2f700 1 -- 172.21.15.148:0/1594253357 >> v2:172.21.15.150:3300/0 conn(0x7efce8098bd0 msgr2=0x7efce8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:51.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efceeb2f700 1 --2- 172.21.15.148:0/1594253357 >> v2:172.21.15.150:3300/0 conn(0x7efce8098bd0 0x7efce8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efceeb2f700 1 -- 172.21.15.148:0/1594253357 >> v1:172.21.15.150:6789/0 conn(0x7efce8154430 legacy=0x7efce80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efceeb2f700 1 -- 172.21.15.148:0/1594253357 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80c0950 con 0x7efce80bffd0 2023-10-24T00:28:51.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efceeb2f700 1 --2- 172.21.15.148:0/1594253357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce80bffd0 0x7efce80c0460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efce80c23b0 tx=0x7efce00090f0).ready entity=mon.0 client_cookie=3bef1c45ae96bf03 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efced32c700 1 -- 172.21.15.148:0/1594253357 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000b520 con 0x7efce80bffd0 2023-10-24T00:28:51.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efced32c700 1 -- 172.21.15.148:0/1594253357 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000b680 con 0x7efce80bffd0 2023-10-24T00:28:51.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efced32c700 1 -- 172.21.15.148:0/1594253357 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000ba00 con 0x7efce80bffd0 2023-10-24T00:28:51.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 -- 172.21.15.148:0/1594253357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce80bffd0 msgr2=0x7efce80c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 --2- 172.21.15.148:0/1594253357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce80bffd0 0x7efce80c0460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7efce80c23b0 tx=0x7efce00090f0).stop 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 -- 172.21.15.148:0/1594253357 shutdown_connections 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 --2- 172.21.15.148:0/1594253357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce80bffd0 0x7efce80c0460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 --2- 172.21.15.148:0/1594253357 >> v2:172.21.15.150:3300/0 conn(0x7efce8098bd0 0x7efce8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 -- 172.21.15.148:0/1594253357 >> 172.21.15.148:0/1594253357 conn(0x7efce80cb070 msgr2=0x7efce80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 -- 172.21.15.148:0/1594253357 shutdown_connections 2023-10-24T00:28:51.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.951+0000 7efcf0592700 1 -- 172.21.15.148:0/1594253357 wait complete. 2023-10-24T00:28:51.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.952+0000 7efcf0592700 1 Processor -- start 2023-10-24T00:28:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 -- start start 2023-10-24T00:28:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce80bffd0 0x7efce814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efce8154430 0x7efce814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce814e620 con 0x7efce8098bd0 2023-10-24T00:28:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80ab1a0 con 0x7efce80bffd0 2023-10-24T00:28:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcf0592700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80b03b0 con 0x7efce8154430 2023-10-24T00:28:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcee32e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcee32e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50858/0 (socket says 172.21.15.148:50858) 2023-10-24T00:28:51.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcee32e700 1 -- 172.21.15.148:0/1928491475 learned_addr learned my addr 172.21.15.148:0/1928491475 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:51.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efcedb2d700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce80bffd0 0x7efce814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.953+0000 7efceeb2f700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efce8154430 0x7efce814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 -- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efce8154430 msgr2=0x7efce814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efce8154430 0x7efce814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 -- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce80bffd0 msgr2=0x7efce814dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce80bffd0 0x7efce814dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 -- 172.21.15.148:0/1928491475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0009370 con 0x7efce8098bd0 2023-10-24T00:28:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcee32e700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efce400c7c0 tx=0x7efce40015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4006a20 con 0x7efce8098bd0 2023-10-24T00:28:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4006b80 con 0x7efce8098bd0 2023-10-24T00:28:51.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce80b0690 con 0x7efce8098bd0 2023-10-24T00:28:51.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4007020 con 0x7efce8098bd0 2023-10-24T00:28:51.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.954+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce80aaeb0 con 0x7efce8098bd0 2023-10-24T00:28:51.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.955+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce806c6b0 con 0x7efce8098bd0 2023-10-24T00:28:51.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.955+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efce40073d0 con 0x7efce8098bd0 2023-10-24T00:28:51.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.956+0000 7efcde7fc700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 0x7efccc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:51.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.956+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7efce4079650 con 0x7efce8098bd0 2023-10-24T00:28:51.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.956+0000 7efcedb2d700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 0x7efccc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:51.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.956+0000 7efcedb2d700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 0x7efccc0615e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7efce80aa490 tx=0x7efcd8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:51.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:51.960+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efce4047af0 con 0x7efce8098bd0 2023-10-24T00:28:52.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.122+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efce80b0880 con 0x7efce8098bd0 2023-10-24T00:28:52.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.814+0000 7efcde7fc700 1 -- 172.21.15.148:0/1928491475 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7efce404aa40 con 0x7efce8098bd0 2023-10-24T00:28:52.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 msgr2=0x7efccc0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 0x7efccc0615e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7efce80aa490 tx=0x7efcd8009060).stop 2023-10-24T00:28:52.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 msgr2=0x7efce80ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7efce400c7c0 tx=0x7efce40015c0).stop 2023-10-24T00:28:52.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 shutdown_connections 2023-10-24T00:28:52.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efce8154430 0x7efce814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efccc05f120 0x7efccc0615e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efce8098bd0 0x7efce80ad400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 --2- 172.21.15.148:0/1928491475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efce80bffd0 0x7efce814dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.821+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 >> 172.21.15.148:0/1928491475 conn(0x7efce80cb070 msgr2=0x7efce80643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:52.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.822+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 shutdown_connections 2023-10-24T00:28:52.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.824+0000 7efcf0592700 1 -- 172.21.15.148:0/1928491475 wait complete. 2023-10-24T00:28:52.828 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:28:52.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:28:52.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.966+0000 7f51f4f38700 1 Processor -- start 2023-10-24T00:28:52.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.966+0000 7f51f4f38700 1 -- start start 2023-10-24T00:28:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51f4f38700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f51f00ac520 0x7f51f00ab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51f4f38700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f006ba70 con 0x7f51f006b590 2023-10-24T00:28:52.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51f4f38700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00655d0 con 0x7f51f00a9480 2023-10-24T00:28:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51f4f38700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00ad0f0 con 0x7f51f00ac520 2023-10-24T00:28:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51e5d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f51f006b590 0x7f51f0064ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43442/0 (socket says 172.21.15.148:43442) 2023-10-24T00:28:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51e5d9b700 1 -- 172.21.15.148:0/2266920644 learned_addr learned my addr 172.21.15.148:0/2266920644 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:52.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51ee59c700 1 --2- 172.21.15.148:0/2266920644 >> v2:172.21.15.150:3300/0 conn(0x7f51f00ac520 0x7f51f00ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686382085 0 0) 0x7f51d8001110 con 0x7f51f006b590 2023-10-24T00:28:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.967+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51dc0033f0 con 0x7f51f006b590 2023-10-24T00:28:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937803277 0 0) 0x7f51f00655d0 con 0x7f51f00a9480 2023-10-24T00:28:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d8001110 con 0x7f51f00a9480 2023-10-24T00:28:52.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3007673952 0 0) 0x7f51dc0033f0 con 0x7f51f006b590 2023-10-24T00:28:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51ee59c700 1 -- 172.21.15.148:0/2266920644 >> v1:172.21.15.150:6789/0 conn(0x7f51f00a9480 legacy=0x7f51f0062d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51ee59c700 1 -- 172.21.15.148:0/2266920644 >> v1:172.21.15.148:6789/0 conn(0x7f51f006b590 legacy=0x7f51f0064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51ee59c700 1 -- 172.21.15.148:0/2266920644 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00ad3d0 con 0x7f51f00ac520 2023-10-24T00:28:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51ee59c700 1 --2- 172.21.15.148:0/2266920644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f00ac520 0x7f51f00ab640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51e0009760 tx=0x7f51e0009060).ready entity=mon.1 client_cookie=5f44ea13cdb654c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:52.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8001600 con 0x7f51f00ac520 2023-10-24T00:28:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0011400 con 0x7f51f00ac520 2023-10-24T00:28:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51edd9b700 1 -- 172.21.15.148:0/2266920644 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0011780 con 0x7f51f00ac520 2023-10-24T00:28:52.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 -- 172.21.15.148:0/2266920644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f00ac520 msgr2=0x7f51f00ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 --2- 172.21.15.148:0/2266920644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f00ac520 0x7f51f00ab640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51e0009760 tx=0x7f51e0009060).stop 2023-10-24T00:28:52.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 -- 172.21.15.148:0/2266920644 shutdown_connections 2023-10-24T00:28:52.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 --2- 172.21.15.148:0/2266920644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f00ac520 0x7f51f00ab640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 -- 172.21.15.148:0/2266920644 >> 172.21.15.148:0/2266920644 conn(0x7f51f00c3f60 msgr2=0x7f51f00c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:52.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.968+0000 7f51f4f38700 1 -- 172.21.15.148:0/2266920644 shutdown_connections 2023-10-24T00:28:52.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.969+0000 7f51f4f38700 1 -- 172.21.15.148:0/2266920644 wait complete. 2023-10-24T00:28:52.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 Processor -- start 2023-10-24T00:28:52.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 -- start start 2023-10-24T00:28:52.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f006b590 0x7f51f00a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:52.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f00a9480 0x7f51f00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:52.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:52.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00a92f0 con 0x7f51f00ac520 2023-10-24T00:28:52.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00a7760 con 0x7f51f006b590 2023-10-24T00:28:52.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.970+0000 7f51f4f38700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f014ce40 con 0x7f51f00a9480 2023-10-24T00:28:52.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:52.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50868/0 (socket says 172.21.15.148:50868) 2023-10-24T00:28:52.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 -- 172.21.15.148:0/191086473 learned_addr learned my addr 172.21.15.148:0/191086473 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:52.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51e5d9b700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f00a9480 0x7f51f00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:52.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51ee59c700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f006b590 0x7f51f00a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:52.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 -- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f00a9480 msgr2=0x7f51f00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f00a9480 0x7f51f00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 -- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f006b590 msgr2=0x7f51f00a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:52.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f006b590 0x7f51f00a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:52.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 -- 172.21.15.148:0/191086473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00092a0 con 0x7f51f00ac520 2023-10-24T00:28:52.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51eed9d700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f51e800c710 tx=0x7f51e800cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:52.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8010510 con 0x7f51f00ac520 2023-10-24T00:28:52.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8010670 con 0x7f51f00ac520 2023-10-24T00:28:52.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f014abf0 con 0x7f51f00ac520 2023-10-24T00:28:52.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80109f0 con 0x7f51f00ac520 2023-10-24T00:28:52.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.971+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00a7c80 con 0x7f51f00ac520 2023-10-24T00:28:52.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.972+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f014d040 con 0x7f51f00ac520 2023-10-24T00:28:52.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.972+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f51e801b400 con 0x7f51f00ac520 2023-10-24T00:28:52.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.973+0000 7f51e6ffd700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 0x7f51d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:52.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.973+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f51e8079f80 con 0x7f51f00ac520 2023-10-24T00:28:52.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.973+0000 7f51ee59c700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 0x7f51d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:52.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.973+0000 7f51ee59c700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 0x7f51d0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f51e0009760 tx=0x7f51e0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:52.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:52.977+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51e80a8af0 con 0x7f51f00ac520 2023-10-24T00:28:53.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.183+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51f0062880 con 0x7f51f00ac520 2023-10-24T00:28:53.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.188+0000 7f51e6ffd700 1 -- 172.21.15.148:0/191086473 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51f014d040 con 0x7f51f00ac520 2023-10-24T00:28:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 msgr2=0x7f51d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 0x7f51d0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f51e0009760 tx=0x7f51e0016000).stop 2023-10-24T00:28:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 msgr2=0x7f51f014a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f51e800c710 tx=0x7f51e800cad0).stop 2023-10-24T00:28:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 shutdown_connections 2023-10-24T00:28:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51d005f150 0x7f51d0061610 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0x7f51e0009760 tx=0x7f51e0016000).stop 2023-10-24T00:28:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f00ac520 0x7f51f014a700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f006b590 0x7f51f00a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 --2- 172.21.15.148:0/191086473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f00a9480 0x7f51f00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.192+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 >> 172.21.15.148:0/191086473 conn(0x7f51f00c3f60 msgr2=0x7f51f00c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.193+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 shutdown_connections 2023-10-24T00:28:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.194+0000 7f51f4f38700 1 -- 172.21.15.148:0/191086473 wait complete. 2023-10-24T00:28:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 3 and data pool 4 2023-10-24T00:28:53.216 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:53.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.328+0000 7f529bbbe700 1 Processor -- start 2023-10-24T00:28:53.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 -- start start 2023-10-24T00:28:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5294154320 0x7f52940c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5294062d60 0x7f52940c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529406a040 con 0x7f5294153f40 2023-10-24T00:28:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940c88e0 con 0x7f5294062d60 2023-10-24T00:28:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.329+0000 7f529bbbe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940c6190 con 0x7f5294154320 2023-10-24T00:28:53.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5294062d60 0x7f52940c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5294062d60 0x7f52940c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58922/0 (socket says 172.21.15.148:58922) 2023-10-24T00:28:53.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 -- 172.21.15.148:0/1772870513 learned_addr learned my addr 172.21.15.148:0/1772870513 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:53.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f5299159700 1 --2- 172.21.15.148:0/1772870513 >> v2:172.21.15.150:3300/0 conn(0x7f5294154320 0x7f52940c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 -- 172.21.15.148:0/1772870513 >> v2:172.21.15.150:3300/0 conn(0x7f5294154320 msgr2=0x7f52940c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:53.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 --2- 172.21.15.148:0/1772870513 >> v2:172.21.15.150:3300/0 conn(0x7f5294154320 0x7f52940c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 -- 172.21.15.148:0/1772870513 >> v1:172.21.15.150:6789/0 conn(0x7f5294153f40 legacy=0x7f5294062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:53.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 -- 172.21.15.148:0/1772870513 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294069430 con 0x7f5294062d60 2023-10-24T00:28:53.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f529a15b700 1 --2- 172.21.15.148:0/1772870513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294062d60 0x7f52940c5ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f52940c84c0 tx=0x7f52840090f0).ready entity=mon.0 client_cookie=5d61f2be1d890cf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f5298958700 1 -- 172.21.15.148:0/1772870513 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400b5a0 con 0x7f5294062d60 2023-10-24T00:28:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f5298958700 1 -- 172.21.15.148:0/1772870513 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400b700 con 0x7f5294062d60 2023-10-24T00:28:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.330+0000 7f5298958700 1 -- 172.21.15.148:0/1772870513 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400baa0 con 0x7f5294062d60 2023-10-24T00:28:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 -- 172.21.15.148:0/1772870513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294062d60 msgr2=0x7f52940c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 --2- 172.21.15.148:0/1772870513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294062d60 0x7f52940c5ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f52940c84c0 tx=0x7f52840090f0).stop 2023-10-24T00:28:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 -- 172.21.15.148:0/1772870513 shutdown_connections 2023-10-24T00:28:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 --2- 172.21.15.148:0/1772870513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294062d60 0x7f52940c5ca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 --2- 172.21.15.148:0/1772870513 >> v2:172.21.15.150:3300/0 conn(0x7f5294154320 0x7f52940c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 -- 172.21.15.148:0/1772870513 >> 172.21.15.148:0/1772870513 conn(0x7f5294064200 msgr2=0x7f52940c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 -- 172.21.15.148:0/1772870513 shutdown_connections 2023-10-24T00:28:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.331+0000 7f529bbbe700 1 -- 172.21.15.148:0/1772870513 wait complete. 2023-10-24T00:28:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.332+0000 7f529bbbe700 1 Processor -- start 2023-10-24T00:28:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.332+0000 7f529bbbe700 1 -- start start 2023-10-24T00:28:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5294062d60 0x7f52940ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5294154320 0x7f5294152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940aa6f0 con 0x7f5294153f40 2023-10-24T00:28:53.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52941525d0 con 0x7f5294154320 2023-10-24T00:28:53.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940aa130 con 0x7f5294062d60 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58938/0 (socket says 172.21.15.148:58938) 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 -- 172.21.15.148:0/3975763212 learned_addr learned my addr 172.21.15.148:0/3975763212 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529a15b700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5294154320 0x7f5294152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529995a700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5294062d60 0x7f52940ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 -- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5294062d60 msgr2=0x7f52940ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5294062d60 0x7f52940ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 -- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5294154320 msgr2=0x7f5294152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5294154320 0x7f5294152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 -- 172.21.15.148:0/3975763212 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009370 con 0x7f5294153f40 2023-10-24T00:28:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5299159700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5288007fb0 tx=0x7f5288009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528800eb90 con 0x7f5294153f40 2023-10-24T00:28:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528800ecf0 con 0x7f5294153f40 2023-10-24T00:28:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288015620 con 0x7f5294153f40 2023-10-24T00:28:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940aa410 con 0x7f5294153f40 2023-10-24T00:28:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.333+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940abae0 con 0x7f5294153f40 2023-10-24T00:28:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.334+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529406c6b0 con 0x7f5294153f40 2023-10-24T00:28:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.335+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5288015990 con 0x7f5294153f40 2023-10-24T00:28:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.335+0000 7f5291ffb700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 0x7f5280061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.335+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f528807ab60 con 0x7f5294153f40 2023-10-24T00:28:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.335+0000 7f529995a700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 0x7f5280061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.335+0000 7f529995a700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 0x7f5280061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f528c0038b0 tx=0x7f528c007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.339+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f528804be30 con 0x7f5294153f40 2023-10-24T00:28:53.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.503+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5294061440 con 0x7f5294153f40 2023-10-24T00:28:53.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.504+0000 7f5291ffb700 1 -- 172.21.15.148:0/3975763212 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f528800ee60 con 0x7f5294153f40 2023-10-24T00:28:53.508 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:53.508 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":21,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:53.185627+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 msgr2=0x7f5280061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 0x7f5280061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f528c0038b0 tx=0x7f528c007d20).stop 2023-10-24T00:28:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 msgr2=0x7f529414f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5288007fb0 tx=0x7f5288009860).stop 2023-10-24T00:28:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 shutdown_connections 2023-10-24T00:28:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5294154320 0x7f5294152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5294062d60 0x7f52940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528005f150 0x7f5280061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 --2- 172.21.15.148:0/3975763212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5294153f40 0x7f529414f850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 >> 172.21.15.148:0/3975763212 conn(0x7f5294064200 msgr2=0x7f52940bddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 shutdown_connections 2023-10-24T00:28:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.506+0000 7f529bbbe700 1 -- 172.21.15.148:0/3975763212 wait complete. 2023-10-24T00:28:53.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:53.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.633+0000 7f47c27a9700 1 Processor -- start 2023-10-24T00:28:53.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.633+0000 7f47c27a9700 1 -- start start 2023-10-24T00:28:53.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47c27a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 0x7f47bc0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47c27a9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0a6a50 con 0x7f47bc0c86c0 2023-10-24T00:28:53.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47c27a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0a6d30 con 0x7f47bc0a6550 2023-10-24T00:28:53.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47c27a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0bf350 con 0x7f47bc0c7d20 2023-10-24T00:28:53.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bbfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f47bc0c86c0 0x7f47bc0bec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45614/0 (socket says 172.21.15.148:45614) 2023-10-24T00:28:53.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bbfff700 1 -- 172.21.15.148:0/837801280 learned_addr learned my addr 172.21.15.148:0/837801280 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:53.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bb7fe700 1 --2- 172.21.15.148:0/837801280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 0x7f47bc0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485539431 0 0) 0x7f47bc0a6a50 con 0x7f47bc0c86c0 2023-10-24T00:28:53.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a40033f0 con 0x7f47bc0c86c0 2023-10-24T00:28:53.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bb7fe700 1 -- 172.21.15.148:0/837801280 >> v1:172.21.15.150:6789/0 conn(0x7f47bc0a6550 legacy=0x7f47bc15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937261924 0 0) 0x7f47a40033f0 con 0x7f47bc0c86c0 2023-10-24T00:28:53.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bb7fe700 1 -- 172.21.15.148:0/837801280 >> v1:172.21.15.148:6789/0 conn(0x7f47bc0c86c0 legacy=0x7f47bc0bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bb7fe700 1 -- 172.21.15.148:0/837801280 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0a7010 con 0x7f47bc0c7d20 2023-10-24T00:28:53.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47bb7fe700 1 --2- 172.21.15.148:0/837801280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 0x7f47bc0a7d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f47b0009790 tx=0x7f47b0009060).ready entity=mon.2 client_cookie=77835ebf457724b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.634+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0015f0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0011400 con 0x7f47bc0c7d20 2023-10-24T00:28:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47baffd700 1 -- 172.21.15.148:0/837801280 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0011780 con 0x7f47bc0c7d20 2023-10-24T00:28:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 -- 172.21.15.148:0/837801280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 msgr2=0x7f47bc0a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 --2- 172.21.15.148:0/837801280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 0x7f47bc0a7d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f47b0009790 tx=0x7f47b0009060).stop 2023-10-24T00:28:53.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 -- 172.21.15.148:0/837801280 shutdown_connections 2023-10-24T00:28:53.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 --2- 172.21.15.148:0/837801280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0c7d20 0x7f47bc0a7d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 -- 172.21.15.148:0/837801280 >> 172.21.15.148:0/837801280 conn(0x7f47bc092480 msgr2=0x7f47bc062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 -- 172.21.15.148:0/837801280 shutdown_connections 2023-10-24T00:28:53.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.635+0000 7f47c27a9700 1 -- 172.21.15.148:0/837801280 wait complete. 2023-10-24T00:28:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.636+0000 7f47c27a9700 1 Processor -- start 2023-10-24T00:28:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.636+0000 7f47c27a9700 1 -- start start 2023-10-24T00:28:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0a6550 0x7f47bc0c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47bc0c86c0 0x7f47bc14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ae030 con 0x7f47bc0c7d20 2023-10-24T00:28:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ab320 con 0x7f47bc0c86c0 2023-10-24T00:28:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c27a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ad420 con 0x7f47bc0a6550 2023-10-24T00:28:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58944/0 (socket says 172.21.15.148:58944) 2023-10-24T00:28:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 -- 172.21.15.148:0/1189186310 learned_addr learned my addr 172.21.15.148:0/1189186310 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bbfff700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0a6550 0x7f47bc0c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 -- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0a6550 msgr2=0x7f47bc0c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47c0d46700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47bc0c86c0 0x7f47bc14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0a6550 0x7f47bc0c2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 -- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47bc0c86c0 msgr2=0x7f47bc14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.637+0000 7f47bb7fe700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47bc0c86c0 0x7f47bc14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47bb7fe700 1 -- 172.21.15.148:0/1189186310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00092a0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47bb7fe700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f47b0011fd0 tx=0x7f47b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00109a0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0010b00 con 0x7f47bc0c7d20 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0ad700 con 0x7f47bc0c7d20 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0010e80 con 0x7f47bc0c7d20 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.638+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0adcc0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.639+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0a88f0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.639+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f47b001d640 con 0x7f47bc0c7d20 2023-10-24T00:28:53.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.639+0000 7f47a3fff700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 0x7f47a8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.640+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f47b007b980 con 0x7f47bc0c7d20 2023-10-24T00:28:53.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.640+0000 7f47bbfff700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 0x7f47a8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.640+0000 7f47bbfff700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 0x7f47a8061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47ac001860 tx=0x7f47ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.644+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f47bc0a88f0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.805+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47bc0a88f0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.806+0000 7f47a3fff700 1 -- 172.21.15.148:0/1189186310 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f47bc0a88f0 con 0x7f47bc0c7d20 2023-10-24T00:28:53.809 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:53.810 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":21,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:53.185627+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:53.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.808+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 msgr2=0x7f47a8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.808+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 0x7f47a8061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47ac001860 tx=0x7f47ac009040).stop 2023-10-24T00:28:53.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.808+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 msgr2=0x7f47bc0acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.808+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f47b0011fd0 tx=0x7f47b0016000).stop 2023-10-24T00:28:53.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 shutdown_connections 2023-10-24T00:28:53.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47bc0c86c0 0x7f47bc14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47bc0a6550 0x7f47bc0c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f47a805f180 0x7f47a8061640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 --2- 172.21.15.148:0/1189186310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47bc0c7d20 0x7f47bc0acc40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 >> 172.21.15.148:0/1189186310 conn(0x7f47bc092480 msgr2=0x7f47bc151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 shutdown_connections 2023-10-24T00:28:53.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.809+0000 7f47c27a9700 1 -- 172.21.15.148:0/1189186310 wait complete. 2023-10-24T00:28:53.823 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:28:53.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.938+0000 7f5a4fa4c700 1 Processor -- start 2023-10-24T00:28:53.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.938+0000 7f5a4fa4c700 1 -- start start 2023-10-24T00:28:53.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4fa4c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a48098bd0 0x7f5a48154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4fa4c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480c71d0 con 0x7f5a480bffd0 2023-10-24T00:28:53.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4fa4c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a480c9410 con 0x7f5a48154430 2023-10-24T00:28:53.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4fa4c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480c6a10 con 0x7f5a48098bd0 2023-10-24T00:28:53.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4cfe7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a48098bd0 0x7f5a48154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4dfe9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5a480bffd0 0x7f5a4815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45616/0 (socket says 172.21.15.148:45616) 2023-10-24T00:28:53.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4cfe7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a48098bd0 0x7f5a48154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58954/0 (socket says 172.21.15.148:58954) 2023-10-24T00:28:53.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4dfe9700 1 -- 172.21.15.148:0/2682801462 learned_addr learned my addr 172.21.15.148:0/2682801462 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:53.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4cfe7700 1 -- 172.21.15.148:0/2682801462 >> v1:172.21.15.150:6789/0 conn(0x7f5a48154430 legacy=0x7f5a480c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4cfe7700 1 -- 172.21.15.148:0/2682801462 >> v1:172.21.15.148:6789/0 conn(0x7f5a480bffd0 legacy=0x7f5a4815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a4cfe7700 1 -- 172.21.15.148:0/2682801462 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480ca8b0 con 0x7f5a48098bd0 2023-10-24T00:28:53.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.939+0000 7f5a3ffff700 1 -- 172.21.15.148:0/2682801462 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081593661 0 0) 0x7f5a480c71d0 con 0x7f5a480bffd0 2023-10-24T00:28:53.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4cfe7700 1 --2- 172.21.15.148:0/2682801462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48098bd0 0x7f5a48154810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5a38009760 tx=0x7f5a38009060).ready entity=mon.0 client_cookie=fb16b04fb0cbbad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a3ffff700 1 -- 172.21.15.148:0/2682801462 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800b580 con 0x7f5a48098bd0 2023-10-24T00:28:53.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a3ffff700 1 -- 172.21.15.148:0/2682801462 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800b6e0 con 0x7f5a48098bd0 2023-10-24T00:28:53.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a3ffff700 1 -- 172.21.15.148:0/2682801462 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800ba60 con 0x7f5a48098bd0 2023-10-24T00:28:53.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/2682801462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48098bd0 msgr2=0x7f5a48154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/2682801462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48098bd0 0x7f5a48154810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5a38009760 tx=0x7f5a38009060).stop 2023-10-24T00:28:53.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/2682801462 shutdown_connections 2023-10-24T00:28:53.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/2682801462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48098bd0 0x7f5a48154810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/2682801462 >> 172.21.15.148:0/2682801462 conn(0x7f5a480cb070 msgr2=0x7f5a480cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:53.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/2682801462 shutdown_connections 2023-10-24T00:28:53.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.940+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/2682801462 wait complete. 2023-10-24T00:28:53.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.941+0000 7f5a4fa4c700 1 Processor -- start 2023-10-24T00:28:53.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 -- start start 2023-10-24T00:28:53.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a48098bd0 0x7f5a48148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 0x7f5a480c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48154d70 con 0x7f5a48154430 2023-10-24T00:28:53.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48155330 con 0x7f5a480bffd0 2023-10-24T00:28:53.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.942+0000 7f5a4fa4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480b02d0 con 0x7f5a48098bd0 2023-10-24T00:28:53.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58966/0 (socket says 172.21.15.148:58966) 2023-10-24T00:28:53.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 -- 172.21.15.148:0/952538115 learned_addr learned my addr 172.21.15.148:0/952538115 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:53.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4cfe7700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 0x7f5a480c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4d7e8700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a48098bd0 0x7f5a48148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 -- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a48098bd0 msgr2=0x7f5a48148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a48098bd0 0x7f5a48148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 -- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 msgr2=0x7f5a480c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:53.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 0x7f5a480c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:53.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 -- 172.21.15.148:0/952538115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380092a0 con 0x7f5a48154430 2023-10-24T00:28:53.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4cfe7700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 0x7f5a480c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:53.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4dfe9700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5a4000c7c0 tx=0x7f5a40007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40005d30 con 0x7f5a48154430 2023-10-24T00:28:53.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a40007110 con 0x7f5a48154430 2023-10-24T00:28:53.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480b05b0 con 0x7f5a48154430 2023-10-24T00:28:53.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400074d0 con 0x7f5a48154430 2023-10-24T00:28:53.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.943+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480af3b0 con 0x7f5a48154430 2023-10-24T00:28:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.944+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4806c6b0 con 0x7f5a48154430 2023-10-24T00:28:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.944+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5a40007840 con 0x7f5a48154430 2023-10-24T00:28:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.945+0000 7f5a3d7fa700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 0x7f5a2c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.945+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5a4007a1e0 con 0x7f5a48154430 2023-10-24T00:28:53.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.945+0000 7f5a4d7e8700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 0x7f5a2c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:53.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.945+0000 7f5a4d7e8700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 0x7f5a2c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5a480a8b00 tx=0x7f5a44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:53.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:53.949+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5a4004b4b0 con 0x7f5a48154430 2023-10-24T00:28:54.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.153+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a48062c40 con 0x7f5a48154430 2023-10-24T00:28:54.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.188+0000 7f5a3d7fa700 1 -- 172.21.15.148:0/952538115 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a4004ead0 con 0x7f5a48154430 2023-10-24T00:28:54.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.190+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 msgr2=0x7f5a2c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.190+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 0x7f5a2c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5a480a8b00 tx=0x7f5a44009040).stop 2023-10-24T00:28:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.190+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 msgr2=0x7f5a481482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.190+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5a4000c7c0 tx=0x7f5a40007f30).stop 2023-10-24T00:28:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 shutdown_connections 2023-10-24T00:28:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a2c05f150 0x7f5a2c061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a48154430 0x7f5a481482d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a48098bd0 0x7f5a48148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 --2- 172.21.15.148:0/952538115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a480bffd0 0x7f5a480c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 >> 172.21.15.148:0/952538115 conn(0x7f5a480cb070 msgr2=0x7f5a480a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 shutdown_connections 2023-10-24T00:28:54.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.191+0000 7f5a4fa4c700 1 -- 172.21.15.148:0/952538115 wait complete. 2023-10-24T00:28:54.205 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:28:54.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:28:54.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.320+0000 7f05b327d700 1 Processor -- start 2023-10-24T00:28:54.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.320+0000 7f05b327d700 1 -- start start 2023-10-24T00:28:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b327d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f05ac154430 0x7f05ac154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b327d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0c71d0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b327d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0c9410 con 0x7f05ac098bd0 2023-10-24T00:28:54.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b327d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0c6a10 con 0x7f05ac154430 2023-10-24T00:28:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b181a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f05ac0bffd0 0x7f05ac15e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45630/0 (socket says 172.21.15.148:45630) 2023-10-24T00:28:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b181a700 1 -- 172.21.15.148:0/3204945008 learned_addr learned my addr 172.21.15.148:0/3204945008 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05b1019700 1 --2- 172.21.15.148:0/3204945008 >> v2:172.21.15.150:3300/0 conn(0x7f05ac154430 0x7f05ac154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.321+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717855300 0 0) 0x7f05ac0c71d0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05980033f0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421634180 0 0) 0x7f05980033f0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 >> v2:172.21.15.150:3300/0 conn(0x7f05ac154430 msgr2=0x7f05ac154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 --2- 172.21.15.148:0/3204945008 >> v2:172.21.15.150:3300/0 conn(0x7f05ac154430 0x7f05ac154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 >> v1:172.21.15.150:6789/0 conn(0x7f05ac098bd0 legacy=0x7f05ac0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0ca8b0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f05a40017f0 con 0x7f05ac0bffd0 2023-10-24T00:28:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 >> v1:172.21.15.148:6789/0 conn(0x7f05ac0bffd0 legacy=0x7f05ac15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05980038e0 0x7f0598003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0598004690 0x7f0598004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 0x7f059800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c6a10 con 0x7f0598005000 2023-10-24T00:28:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059800bf60 con 0x7f05980038e0 2023-10-24T00:28:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059800c0f0 con 0x7f0598004690 2023-10-24T00:28:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 0x7f059800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b1019700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05980038e0 0x7f0598003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b0818700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0598004690 0x7f0598004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 -- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0598004690 msgr2=0x7f0598004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0598004690 0x7f0598004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 -- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05980038e0 msgr2=0x7f0598003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05980038e0 0x7f0598003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 -- 172.21.15.148:0/3204945008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980033f0 con 0x7f0598005000 2023-10-24T00:28:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 -- 172.21.15.148:0/3204945008 reap_dead start 2023-10-24T00:28:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05b181a700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 0x7f059800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f05a400c480 tx=0x7f05a400c790).ready entity=mon.0 client_cookie=457af7d3825e2b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.322+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4002030 con 0x7f0598005000 2023-10-24T00:28:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400ce20 con 0x7f0598005000 2023-10-24T00:28:54.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05a3fff700 1 -- 172.21.15.148:0/3204945008 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4005d30 con 0x7f0598005000 2023-10-24T00:28:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 -- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 msgr2=0x7f059800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 0x7f059800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f05a400c480 tx=0x7f05a400c790).stop 2023-10-24T00:28:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 -- 172.21.15.148:0/3204945008 shutdown_connections 2023-10-24T00:28:54.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 --2- 172.21.15.148:0/3204945008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0598005000 0x7f059800b8e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 -- 172.21.15.148:0/3204945008 >> 172.21.15.148:0/3204945008 conn(0x7f05ac0cb070 msgr2=0x7f05ac0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 -- 172.21.15.148:0/3204945008 shutdown_connections 2023-10-24T00:28:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.323+0000 7f05b327d700 1 -- 172.21.15.148:0/3204945008 wait complete. 2023-10-24T00:28:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.324+0000 7f05b327d700 1 Processor -- start 2023-10-24T00:28:54.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.324+0000 7f05b327d700 1 -- start start 2023-10-24T00:28:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 0x7f05ac0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05ac0c4550 0x7f05ac0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c2fb0 con 0x7f05ac14d8d0 2023-10-24T00:28:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c40c0 con 0x7f0598005000 2023-10-24T00:28:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b327d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0c3200 con 0x7f05ac0c4550 2023-10-24T00:28:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b0818700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b0818700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58984/0 (socket says 172.21.15.148:58984) 2023-10-24T00:28:54.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b0818700 1 -- 172.21.15.148:0/2382940136 learned_addr learned my addr 172.21.15.148:0/2382940136 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:54.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b1019700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 0x7f05ac0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.325+0000 7f05b181a700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05ac0c4550 0x7f05ac0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 -- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05ac0c4550 msgr2=0x7f05ac0c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05ac0c4550 0x7f05ac0c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 -- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 msgr2=0x7f05ac0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 0x7f05ac0b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 -- 172.21.15.148:0/2382940136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0c34e0 con 0x7f05ac14d8d0 2023-10-24T00:28:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b1019700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 0x7f05ac0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b0818700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f059c0028c0 tx=0x7f059c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:54.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00f6c0 con 0x7f05ac14d8d0 2023-10-24T00:28:54.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c00f820 con 0x7f05ac14d8d0 2023-10-24T00:28:54.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac0c3a70 con 0x7f05ac14d8d0 2023-10-24T00:28:54.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00fba0 con 0x7f05ac14d8d0 2023-10-24T00:28:54.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.326+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac14dd50 con 0x7f05ac14d8d0 2023-10-24T00:28:54.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.327+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac0c4270 con 0x7f05ac14d8d0 2023-10-24T00:28:54.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.327+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f059c01d3b0 con 0x7f05ac14d8d0 2023-10-24T00:28:54.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.327+0000 7f05a17fa700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 0x7f0590061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:54.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.328+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f059c079e90 con 0x7f05ac14d8d0 2023-10-24T00:28:54.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.328+0000 7f05b1019700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 0x7f0590061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:54.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.328+0000 7f05b1019700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 0x7f0590061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f05a8006d50 tx=0x7f05a8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:54.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.332+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f05ac0c4270 con 0x7f05ac14d8d0 2023-10-24T00:28:54.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:54.536+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05ac0c4230 con 0x7f05ac14d8d0 2023-10-24T00:28:54.909 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:28:54.906+0000 7f311db36700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:28:55.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.194+0000 7f05a17fa700 1 -- 172.21.15.148:0/2382940136 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f059c04b1b0 con 0x7f05ac14d8d0 2023-10-24T00:28:55.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 msgr2=0x7f0590061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 0x7f0590061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f05a8006d50 tx=0x7f05a8008040).stop 2023-10-24T00:28:55.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 msgr2=0x7f05ac0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f059c0028c0 tx=0x7f059c007bb0).stop 2023-10-24T00:28:55.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 shutdown_connections 2023-10-24T00:28:55.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05ac0c4550 0x7f05ac0c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0598005000 0x7f05ac0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f059005f150 0x7f0590061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 --2- 172.21.15.148:0/2382940136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05ac14d8d0 0x7f05ac0ae000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 >> 172.21.15.148:0/2382940136 conn(0x7f05ac0cb070 msgr2=0x7f05ac14fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 shutdown_connections 2023-10-24T00:28:55.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.196+0000 7f05b327d700 1 -- 172.21.15.148:0/2382940136 wait complete. 2023-10-24T00:28:55.211 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:28:55.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:28:55.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.323+0000 7f2cba2b1700 1 Processor -- start 2023-10-24T00:28:55.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.323+0000 7f2cba2b1700 1 -- start start 2023-10-24T00:28:55.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cba2b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2cb415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cba2b1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40c42a0 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cba2b1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40c3cc0 con 0x7f2cb40bec60 2023-10-24T00:28:55.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cba2b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4152300 con 0x7f2cb40a82d0 2023-10-24T00:28:55.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cb92af700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2cb40a7ef0 0x7f2cb40be550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45644/0 (socket says 172.21.15.148:45644) 2023-10-24T00:28:55.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cb92af700 1 -- 172.21.15.148:0/1226940855 learned_addr learned my addr 172.21.15.148:0/1226940855 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:55.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cb9ab0700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2cb415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065327498 0 0) 0x7f2cb40c42a0 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.324+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca00033f0 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624770278 0 0) 0x7f2ca00033f0 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 msgr2=0x7f2cb415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2cb415cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 >> v1:172.21.15.150:6789/0 conn(0x7f2cb40bec60 legacy=0x7f2cb40c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40c86b0 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f2cb0001470 con 0x7f2cb40a7ef0 2023-10-24T00:28:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 >> v1:172.21.15.148:6789/0 conn(0x7f2cb40a7ef0 legacy=0x7f2cb40be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0003910 0x7f2ca0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2ca0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0004b80 0x7f2ca0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4152300 con 0x7f2ca0004b80 2023-10-24T00:28:55.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000b910 con 0x7f2ca0003910 2023-10-24T00:28:55.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000bad0 con 0x7f2cb40a82d0 2023-10-24T00:28:55.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0004b80 0x7f2ca0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb92af700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0003910 0x7f2ca0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb8aae700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2ca0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 -- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 msgr2=0x7f2ca0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb40a82d0 0x7f2ca0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 -- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0003910 msgr2=0x7f2ca0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0003910 0x7f2ca0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 -- 172.21.15.148:0/1226940855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00033f0 con 0x7f2ca0004b80 2023-10-24T00:28:55.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cb9ab0700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0004b80 0x7f2ca0005000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2cac00e1c0 tx=0x7f2cac00b040).ready entity=mon.0 client_cookie=3961e97930c767c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac009ac0 con 0x7f2ca0004b80 2023-10-24T00:28:55.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00f040 con 0x7f2ca0004b80 2023-10-24T00:28:55.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.325+0000 7f2cabfff700 1 -- 172.21.15.148:0/1226940855 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00eca0 con 0x7f2ca0004b80 2023-10-24T00:28:55.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 -- 172.21.15.148:0/1226940855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0004b80 msgr2=0x7f2ca0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/1226940855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0004b80 0x7f2ca0005000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2cac00e1c0 tx=0x7f2cac00b040).stop 2023-10-24T00:28:55.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cb9ab0700 1 -- 172.21.15.148:0/1226940855 reap_dead start 2023-10-24T00:28:55.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 -- 172.21.15.148:0/1226940855 shutdown_connections 2023-10-24T00:28:55.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 -- 172.21.15.148:0/1226940855 >> 172.21.15.148:0/1226940855 conn(0x7f2cb40922e0 msgr2=0x7f2cb4062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 -- 172.21.15.148:0/1226940855 shutdown_connections 2023-10-24T00:28:55.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.326+0000 7f2cba2b1700 1 -- 172.21.15.148:0/1226940855 wait complete. 2023-10-24T00:28:55.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.327+0000 7f2cba2b1700 1 Processor -- start 2023-10-24T00:28:55.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.327+0000 7f2cba2b1700 1 -- start start 2023-10-24T00:28:55.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0004b80 0x7f2cb4141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb4165370 0x7f2cb41657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c5d80 con 0x7f2cb40abbd0 2023-10-24T00:28:55.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4165ca0 con 0x7f2ca0004b80 2023-10-24T00:28:55.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cba2b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c5170 con 0x7f2cb4165370 2023-10-24T00:28:55.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58998/0 (socket says 172.21.15.148:58998) 2023-10-24T00:28:55.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 -- 172.21.15.148:0/2649254717 learned_addr learned my addr 172.21.15.148:0/2649254717 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:55.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 -- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb4165370 msgr2=0x7f2cb41657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb4165370 0x7f2cb41657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:55.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 -- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0004b80 msgr2=0x7f2cb4141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0004b80 0x7f2cb4141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:55.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 -- 172.21.15.148:0/2649254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40c5450 con 0x7f2cb40abbd0 2023-10-24T00:28:55.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2cb8aae700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2ca4002690 tx=0x7f2ca4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011590 con 0x7f2cb40abbd0 2023-10-24T00:28:55.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.328+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca40116f0 con 0x7f2cb40abbd0 2023-10-24T00:28:55.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.329+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40c5730 con 0x7f2cb40abbd0 2023-10-24T00:28:55.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.329+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011a70 con 0x7f2cb40abbd0 2023-10-24T00:28:55.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.329+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb41660e0 con 0x7f2cb40abbd0 2023-10-24T00:28:55.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.330+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb4047480 con 0x7f2cb40abbd0 2023-10-24T00:28:55.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.330+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2ca40133f0 con 0x7f2cb40abbd0 2023-10-24T00:28:55.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.330+0000 7f2ca97fa700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 0x7f2c98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.330+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2ca4079b50 con 0x7f2cb40abbd0 2023-10-24T00:28:55.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.330+0000 7f2cb92af700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 0x7f2c98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.331+0000 7f2cb92af700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 0x7f2c98061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2cb0000e10 tx=0x7f2cb0001e50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.334+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ca4049af0 con 0x7f2cb40abbd0 2023-10-24T00:28:55.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.540+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cb40c3f30 con 0x7f2cb40abbd0 2023-10-24T00:28:55.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.540+0000 7f2ca97fa700 1 -- 172.21.15.148:0/2649254717 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f2ca4018030 con 0x7f2cb40abbd0 2023-10-24T00:28:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:55.544 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:28:55.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 msgr2=0x7f2c98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 0x7f2c98061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2cb0000e10 tx=0x7f2cb0001e50).stop 2023-10-24T00:28:55.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 msgr2=0x7f2cb40ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2ca4002690 tx=0x7f2ca4007bb0).stop 2023-10-24T00:28:55.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 shutdown_connections 2023-10-24T00:28:55.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cb4165370 0x7f2cb41657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:55.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0004b80 0x7f2cb4141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:55.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c9805f150 0x7f2c98061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 --2- 172.21.15.148:0/2649254717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cb40abbd0 0x7f2cb40ac050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 >> 172.21.15.148:0/2649254717 conn(0x7f2cb40922e0 msgr2=0x7f2cb40c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 shutdown_connections 2023-10-24T00:28:55.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.542+0000 7f2cba2b1700 1 -- 172.21.15.148:0/2649254717 wait complete. 2023-10-24T00:28:55.551 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:28:55.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:28:55.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.668+0000 7fb5e40fb700 1 Processor -- start 2023-10-24T00:28:55.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.668+0000 7fb5e40fb700 1 -- start start 2023-10-24T00:28:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e40fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 0x7fb5dc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e40fb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e40fb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0aa820 con 0x7fb5dc0aa010 2023-10-24T00:28:55.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e40fb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c0960 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e40fb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c0c40 con 0x7fb5dc0c6710 2023-10-24T00:28:55.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59010/0 (socket says 172.21.15.148:59010) 2023-10-24T00:28:55.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 -- 172.21.15.148:0/2509773016 learned_addr learned my addr 172.21.15.148:0/2509773016 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:55.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 -- 172.21.15.148:0/2509773016 >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 msgr2=0x7fb5dc0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e1696700 1 --2- 172.21.15.148:0/2509773016 >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 0x7fb5dc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 --2- 172.21.15.148:0/2509773016 >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 0x7fb5dc0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 -- 172.21.15.148:0/2509773016 >> v1:172.21.15.150:6789/0 conn(0x7fb5dc0aa010 legacy=0x7fb5dc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e2698700 1 -- 172.21.15.148:0/2509773016 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0c0f20 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.669+0000 7fb5e1696700 1 --2- 172.21.15.148:0/2509773016 >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 0x7fb5dc0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:28:55.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e2698700 1 --2- 172.21.15.148:0/2509773016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb5dc157d00 tx=0x7fb5d4009840).ready entity=mon.0 client_cookie=6b5ea2817684f450 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e0e95700 1 -- 172.21.15.148:0/2509773016 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400e070 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e0e95700 1 -- 172.21.15.148:0/2509773016 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400ba10 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e0e95700 1 -- 172.21.15.148:0/2509773016 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400bd90 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2509773016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 msgr2=0x7fb5dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2509773016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb5dc157d00 tx=0x7fb5d4009840).stop 2023-10-24T00:28:55.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2509773016 shutdown_connections 2023-10-24T00:28:55.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2509773016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc069d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2509773016 >> v2:172.21.15.150:3300/0 conn(0x7fb5dc0c6710 0x7fb5dc0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2509773016 >> 172.21.15.148:0/2509773016 conn(0x7fb5dc0caf40 msgr2=0x7fb5dc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2509773016 shutdown_connections 2023-10-24T00:28:55.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.670+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2509773016 wait complete. 2023-10-24T00:28:55.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.671+0000 7fb5e40fb700 1 Processor -- start 2023-10-24T00:28:55.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 -- start start 2023-10-24T00:28:55.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5dc0aa010 0x7fb5dc15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5dc0c6710 0x7fb5dc14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c34a0 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b01c0 con 0x7fb5dc0c6710 2023-10-24T00:28:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e40fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b0470 con 0x7fb5dc0aa010 2023-10-24T00:28:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e1696700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e1696700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59026/0 (socket says 172.21.15.148:59026) 2023-10-24T00:28:55.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.672+0000 7fb5e1696700 1 -- 172.21.15.148:0/2939172819 learned_addr learned my addr 172.21.15.148:0/2939172819 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:55.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1e97700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5dc0aa010 0x7fb5dc15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e2698700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5dc0c6710 0x7fb5dc14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 -- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5dc0aa010 msgr2=0x7fb5dc15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5dc0aa010 0x7fb5dc15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 -- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5dc0c6710 msgr2=0x7fb5dc14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5dc0c6710 0x7fb5dc14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 -- 172.21.15.148:0/2939172819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009ae0 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e1696700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb5cc00c880 tx=0x7fb5cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc010580 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc0106e0 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0b0750 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc010a60 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.673+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc150000 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.674+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0b0940 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.674+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5cc01b460 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.675+0000 7fb5d1ffb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 0x7fb5c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.675+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5cc07a1c0 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.675+0000 7fb5e1e97700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 0x7fb5c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.675+0000 7fb5e1e97700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 0x7fb5c0061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb5d80036e0 tx=0x7fb5d8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.679+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5cc04b430 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.843+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5dc06c6b0 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.844+0000 7fb5d1ffb700 1 -- 172.21.15.148:0/2939172819 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb5cc04ea50 con 0x7fb5dc0aa3f0 2023-10-24T00:28:55.847 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:55.847 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:28:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 msgr2=0x7fb5c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 0x7fb5c0061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb5d80036e0 tx=0x7fb5d8009040).stop 2023-10-24T00:28:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 msgr2=0x7fb5dc0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb5cc00c880 tx=0x7fb5cc008040).stop 2023-10-24T00:28:55.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 shutdown_connections 2023-10-24T00:28:55.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5dc0c6710 0x7fb5dc14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5dc0aa010 0x7fb5dc15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5c005f150 0x7fb5c0061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 --2- 172.21.15.148:0/2939172819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5dc0aa3f0 0x7fb5dc0afcd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 >> 172.21.15.148:0/2939172819 conn(0x7fb5dc0caf40 msgr2=0x7fb5dc063100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 shutdown_connections 2023-10-24T00:28:55.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.846+0000 7fb5e40fb700 1 -- 172.21.15.148:0/2939172819 wait complete. 2023-10-24T00:28:55.861 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:28:55.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:28:55.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.972+0000 7f30c5b7b700 1 Processor -- start 2023-10-24T00:28:55.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 -- start start 2023-10-24T00:28:55.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30c00be650 0x7f30c00a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30c00a8260 0x7f30c00a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00a5eb0 con 0x7f30c0154520 2023-10-24T00:28:55.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00a86b0 con 0x7f30c00be650 2023-10-24T00:28:55.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30c5b7b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00bec30 con 0x7f30c00a8260 2023-10-24T00:28:55.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30beffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30c00be650 0x7f30c00a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30bf7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f30c0154520 0x7f30c0064e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45646/0 (socket says 172.21.15.148:45646) 2023-10-24T00:28:55.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.973+0000 7f30bf7fe700 1 -- 172.21.15.148:0/1462641191 learned_addr learned my addr 172.21.15.148:0/1462641191 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:55.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30bffff700 1 --2- 172.21.15.148:0/1462641191 >> v2:172.21.15.150:3300/0 conn(0x7f30c00a8260 0x7f30c00a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30beffd700 1 -- 172.21.15.148:0/1462641191 >> v2:172.21.15.150:3300/0 conn(0x7f30c00a8260 msgr2=0x7f30c00a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:55.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30beffd700 1 --2- 172.21.15.148:0/1462641191 >> v2:172.21.15.150:3300/0 conn(0x7f30c00a8260 0x7f30c00a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30beffd700 1 -- 172.21.15.148:0/1462641191 >> v1:172.21.15.148:6789/0 conn(0x7f30c0154520 legacy=0x7f30c0064e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30beffd700 1 -- 172.21.15.148:0/1462641191 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00bef10 con 0x7f30c00be650 2023-10-24T00:28:55.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30be7fc700 1 -- 172.21.15.148:0/1462641191 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689006200 0 0) 0x7f30c00a5eb0 con 0x7f30c0154520 2023-10-24T00:28:55.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30beffd700 1 --2- 172.21.15.148:0/1462641191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00be650 0x7f30c00a7d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f30c0069590 tx=0x7f30b4009060).ready entity=mon.0 client_cookie=f47a9017632d7a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30be7fc700 1 -- 172.21.15.148:0/1462641191 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400b580 con 0x7f30c00be650 2023-10-24T00:28:55.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30be7fc700 1 -- 172.21.15.148:0/1462641191 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b400b6e0 con 0x7f30c00be650 2023-10-24T00:28:55.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30be7fc700 1 -- 172.21.15.148:0/1462641191 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b400ba60 con 0x7f30c00be650 2023-10-24T00:28:55.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1462641191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00be650 msgr2=0x7f30c00a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.974+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1462641191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00be650 0x7f30c00a7d70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f30c0069590 tx=0x7f30b4009060).stop 2023-10-24T00:28:55.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1462641191 shutdown_connections 2023-10-24T00:28:55.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1462641191 >> v2:172.21.15.150:3300/0 conn(0x7f30c00a8260 0x7f30c00a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1462641191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00be650 0x7f30c00a7d70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1462641191 >> 172.21.15.148:0/1462641191 conn(0x7f30c0082f60 msgr2=0x7f30c0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:55.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1462641191 shutdown_connections 2023-10-24T00:28:55.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.975+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1462641191 wait complete. 2023-10-24T00:28:55.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.976+0000 7f30c5b7b700 1 Processor -- start 2023-10-24T00:28:55.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.976+0000 7f30c5b7b700 1 -- start start 2023-10-24T00:28:55.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 0x7f30c00c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 0x7f30c014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c5ca0 con 0x7f30c00a8260 2023-10-24T00:28:55.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c4500 con 0x7f30c00be650 2023-10-24T00:28:55.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c5090 con 0x7f30c0154520 2023-10-24T00:28:55.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59042/0 (socket says 172.21.15.148:59042) 2023-10-24T00:28:55.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 -- 172.21.15.148:0/1868464301 learned_addr learned my addr 172.21.15.148:0/1868464301 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:55.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bffff700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 0x7f30c014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30beffd700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 0x7f30c00c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 -- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 msgr2=0x7f30c014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 0x7f30c014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 -- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 msgr2=0x7f30c00c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:55.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 0x7f30c00c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:55.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 -- 172.21.15.148:0/1868464301 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40092a0 con 0x7f30c00a8260 2023-10-24T00:28:55.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bffff700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 0x7f30c014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:55.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30beffd700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 0x7f30c00c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:55.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30bf7fe700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f30b000c810 tx=0x7f30b0001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0005d30 con 0x7f30c00a8260 2023-10-24T00:28:55.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0005e90 con 0x7f30c00a8260 2023-10-24T00:28:55.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c00c5370 con 0x7f30c00a8260 2023-10-24T00:28:55.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0007320 con 0x7f30c00a8260 2023-10-24T00:28:55.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.977+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00c5930 con 0x7f30c00a8260 2023-10-24T00:28:55.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.978+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c006c6b0 con 0x7f30c00a8260 2023-10-24T00:28:55.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.979+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f30b0007710 con 0x7f30c00a8260 2023-10-24T00:28:55.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.979+0000 7f30a77fe700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 0x7f30ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:55.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.979+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30b007a270 con 0x7f30c00a8260 2023-10-24T00:28:55.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.979+0000 7f30beffd700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 0x7f30ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:55.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.979+0000 7f30beffd700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 0x7f30ac061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f30b4009fd0 tx=0x7f30b4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:55.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:55.983+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f30b004b540 con 0x7f30c00a8260 2023-10-24T00:28:56.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.143+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30c00c5de0 con 0x7f30ac05f150 2023-10-24T00:28:56.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.153+0000 7f30a77fe700 1 -- 172.21.15.148:0/1868464301 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+323847 (secure 0 0 0) 0x7f30b400b850 con 0x7f30ac05f150 2023-10-24T00:28:56.159 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:56.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.155+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 msgr2=0x7f30ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 0x7f30ac061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f30b4009fd0 tx=0x7f30b4017000).stop 2023-10-24T00:28:56.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 msgr2=0x7f30c00c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f30b000c810 tx=0x7f30b0001570).stop 2023-10-24T00:28:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 shutdown_connections 2023-10-24T00:28:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30c0154520 0x7f30c014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f30ac05f150 0x7f30ac061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30c00a8260 0x7f30c00c4ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 --2- 172.21.15.148:0/1868464301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30c00be650 0x7f30c00c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 >> 172.21.15.148:0/1868464301 conn(0x7f30c0082f60 msgr2=0x7f30c00a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 shutdown_connections 2023-10-24T00:28:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.156+0000 7f30c5b7b700 1 -- 172.21.15.148:0/1868464301 wait complete. 2023-10-24T00:28:56.164 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:28:56.170 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-24T00:28:54.768323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378084,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596636,"statfs":{"total":773094113280,"available":770658955264,"internally_reserved":0,"allocated":1347584,"data_stored":438477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687303+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:49.687303+0000","last_peered":"2023-10-24T00:28:49.687303+0000","last_clean":"2023-10-24T00:28:49.687303+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:49.687303+0000","last_undegraded":"2023-10-24T00:28:49.687303+0000","last_fullsized":"2023-10-24T00:28:49.687303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.808396+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:48.808396+0000","last_peered":"2023-10-24T00:28:48.808396+0000","last_clean":"2023-10-24T00:28:48.808396+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:48.808396+0000","last_undegraded":"2023-10-24T00:28:48.808396+0000","last_fullsized":"2023-10-24T00:28:48.808396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.816160+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:48.816160+0000","last_peered":"2023-10-24T00:28:48.816160+0000","last_clean":"2023-10-24T00:28:48.816160+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:48.816160+0000","last_undegraded":"2023-10-24T00:28:48.816160+0000","last_fullsized":"2023-10-24T00:28:48.816160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.817408+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:48.817408+0000","last_peered":"2023-10-24T00:28:48.817408+0000","last_clean":"2023-10-24T00:28:48.817408+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:48.817408+0000","last_undegraded":"2023-10-24T00:28:48.817408+0000","last_fullsized":"2023-10-24T00:28:48.817408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.801645+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:48.801645+0000","last_peered":"2023-10-24T00:28:48.801645+0000","last_clean":"2023-10-24T00:28:48.801645+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:48.801645+0000","last_undegraded":"2023-10-24T00:28:48.801645+0000","last_fullsized":"2023-10-24T00:28:48.801645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.811277+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:48.811277+0000","last_peered":"2023-10-24T00:28:48.811277+0000","last_clean":"2023-10-24T00:28:48.811277+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:48.811277+0000","last_undegraded":"2023-10-24T00:28:48.811277+0000","last_fullsized":"2023-10-24T00:28:48.811277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687518+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:49.687518+0000","last_peered":"2023-10-24T00:28:49.687518+0000","last_clean":"2023-10-24T00:28:49.687518+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:49.687518+0000","last_undegraded":"2023-10-24T00:28:49.687518+0000","last_fullsized":"2023-10-24T00:28:49.687518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.807419+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:48.807419+0000","last_peered":"2023-10-24T00:28:48.807419+0000","last_clean":"2023-10-24T00:28:48.807419+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:48.807419+0000","last_undegraded":"2023-10-24T00:28:48.807419+0000","last_fullsized":"2023-10-24T00:28:48.807419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.807450+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:48.807450+0000","last_peered":"2023-10-24T00:28:48.807450+0000","last_clean":"2023-10-24T00:28:48.807450+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:48.807450+0000","last_undegraded":"2023-10-24T00:28:48.807450+0000","last_fullsized":"2023-10-24T00:28:48.807450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:28:56.177 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:28:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.320+0000 7f58c988f700 1 Processor -- start 2023-10-24T00:28:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.320+0000 7f58c988f700 1 -- start start 2023-10-24T00:28:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c4069380 0x7f58c40c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58c40bcbf0 0x7f58c4069760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40bdfe0 con 0x7f58c4069380 2023-10-24T00:28:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c4151350 con 0x7f58c40bcbf0 2023-10-24T00:28:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c988f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40bd3d0 con 0x7f58c4069c50 2023-10-24T00:28:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c4069380 0x7f58c40c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58c4069380 0x7f58c40c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59052/0 (socket says 172.21.15.148:59052) 2023-10-24T00:28:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.321+0000 7f58c2ffd700 1 -- 172.21.15.148:0/366380221 learned_addr learned my addr 172.21.15.148:0/366380221 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c37fe700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58ba7fc700 1 --2- 172.21.15.148:0/366380221 >> v2:172.21.15.150:3300/0 conn(0x7f58c40bcbf0 0x7f58c4069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 -- 172.21.15.148:0/366380221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 msgr2=0x7f58c40c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 -- 172.21.15.148:0/366380221 >> v2:172.21.15.150:3300/0 conn(0x7f58c40bcbf0 msgr2=0x7f58c4069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/366380221 >> v2:172.21.15.150:3300/0 conn(0x7f58c40bcbf0 0x7f58c4069760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 -- 172.21.15.148:0/366380221 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40bd6b0 con 0x7f58c4069380 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c4069380 0x7f58c40c3e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f58c40c8960 tx=0x7f58b400b3b0).ready entity=mon.0 client_cookie=4f49bd08a70d55e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c27fc700 1 -- 172.21.15.148:0/366380221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400db10 con 0x7f58c4069380 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c27fc700 1 -- 172.21.15.148:0/366380221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400dc70 con 0x7f58c4069380 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c27fc700 1 -- 172.21.15.148:0/366380221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4010470 con 0x7f58c4069380 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c988f700 1 -- 172.21.15.148:0/366380221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c4069380 msgr2=0x7f58c40c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.322+0000 7f58c988f700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c4069380 0x7f58c40c3e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f58c40c8960 tx=0x7f58b400b3b0).stop 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 -- 172.21.15.148:0/366380221 shutdown_connections 2023-10-24T00:28:56.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c4069380 0x7f58c40c3e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 --2- 172.21.15.148:0/366380221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 --2- 172.21.15.148:0/366380221 >> v2:172.21.15.150:3300/0 conn(0x7f58c40bcbf0 0x7f58c4069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 -- 172.21.15.148:0/366380221 >> 172.21.15.148:0/366380221 conn(0x7f58c40c5200 msgr2=0x7f58c40c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 -- 172.21.15.148:0/366380221 shutdown_connections 2023-10-24T00:28:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.323+0000 7f58c988f700 1 -- 172.21.15.148:0/366380221 wait complete. 2023-10-24T00:28:56.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.324+0000 7f58c988f700 1 Processor -- start 2023-10-24T00:28:56.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.324+0000 7f58c988f700 1 -- start start 2023-10-24T00:28:56.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4069380 0x7f58c414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c41492f0 con 0x7f58c40bcbf0 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a8ba0 con 0x7f58c4069380 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a8270 con 0x7f58c4069c50 2023-10-24T00:28:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59066/0 (socket says 172.21.15.148:59066) 2023-10-24T00:28:56.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 -- 172.21.15.148:0/3265879913 learned_addr learned my addr 172.21.15.148:0/3265879913 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:56.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58ba7fc700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4069380 0x7f58c414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 -- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 msgr2=0x7f58c40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 -- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4069380 msgr2=0x7f58c414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4069380 0x7f58c414bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 -- 172.21.15.148:0/3265879913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b400b610 con 0x7f58c40bcbf0 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c37fe700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f58bc00ceb0 tx=0x7f58bc007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00ad90 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc016400 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40a8870 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc016780 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.325+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40a7f90 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.326+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f58bc009030 con 0x7f58c40bcbf0 2023-10-24T00:28:56.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.326+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c40a8d30 con 0x7f58c40bcbf0 2023-10-24T00:28:56.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.327+0000 7f58bb7fe700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 0x7f58a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.327+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f58bc07a9b0 con 0x7f58c40bcbf0 2023-10-24T00:28:56.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.327+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 0x7f58a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.327+0000 7f58c2ffd700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 0x7f58a4061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f58b400bfd0 tx=0x7f58b400b3b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.331+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f58bc04bc80 con 0x7f58c40bcbf0 2023-10-24T00:28:56.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.490+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58c406c6b0 con 0x7f58a405f150 2023-10-24T00:28:56.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.498+0000 7f58bb7fe700 1 -- 172.21.15.148:0/3265879913 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+323847 (secure 0 0 0) 0x7f58c406c6b0 con 0x7f58a405f150 2023-10-24T00:28:56.505 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:56.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.501+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 msgr2=0x7f58a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 0x7f58a4061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f58b400bfd0 tx=0x7f58b400b3b0).stop 2023-10-24T00:28:56.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 msgr2=0x7f58c40a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f58bc00ceb0 tx=0x7f58bc007870).stop 2023-10-24T00:28:56.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 shutdown_connections 2023-10-24T00:28:56.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f58a405f150 0x7f58a4061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58c40bcbf0 0x7f58c40a76e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58c4069380 0x7f58c414bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 --2- 172.21.15.148:0/3265879913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58c4069c50 0x7f58c40a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 >> 172.21.15.148:0/3265879913 conn(0x7f58c40c5200 msgr2=0x7f58c40c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:56.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 shutdown_connections 2023-10-24T00:28:56.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.502+0000 7f58c988f700 1 -- 172.21.15.148:0/3265879913 wait complete. 2023-10-24T00:28:56.509 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:28:56.516 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-24T00:28:54.768323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378084,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596636,"statfs":{"total":773094113280,"available":770658955264,"internally_reserved":0,"allocated":1347584,"data_stored":438477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687303+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:49.687303+0000","last_peered":"2023-10-24T00:28:49.687303+0000","last_clean":"2023-10-24T00:28:49.687303+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:49.687303+0000","last_undegraded":"2023-10-24T00:28:49.687303+0000","last_fullsized":"2023-10-24T00:28:49.687303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.808396+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:48.808396+0000","last_peered":"2023-10-24T00:28:48.808396+0000","last_clean":"2023-10-24T00:28:48.808396+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:48.808396+0000","last_undegraded":"2023-10-24T00:28:48.808396+0000","last_fullsized":"2023-10-24T00:28:48.808396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.816160+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:48.816160+0000","last_peered":"2023-10-24T00:28:48.816160+0000","last_clean":"2023-10-24T00:28:48.816160+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:48.816160+0000","last_undegraded":"2023-10-24T00:28:48.816160+0000","last_fullsized":"2023-10-24T00:28:48.816160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.817408+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:48.817408+0000","last_peered":"2023-10-24T00:28:48.817408+0000","last_clean":"2023-10-24T00:28:48.817408+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:48.817408+0000","last_undegraded":"2023-10-24T00:28:48.817408+0000","last_fullsized":"2023-10-24T00:28:48.817408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.801645+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:48.801645+0000","last_peered":"2023-10-24T00:28:48.801645+0000","last_clean":"2023-10-24T00:28:48.801645+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:48.801645+0000","last_undegraded":"2023-10-24T00:28:48.801645+0000","last_fullsized":"2023-10-24T00:28:48.801645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.811277+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:48.811277+0000","last_peered":"2023-10-24T00:28:48.811277+0000","last_clean":"2023-10-24T00:28:48.811277+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:48.811277+0000","last_undegraded":"2023-10-24T00:28:48.811277+0000","last_fullsized":"2023-10-24T00:28:48.811277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687518+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:49.687518+0000","last_peered":"2023-10-24T00:28:49.687518+0000","last_clean":"2023-10-24T00:28:49.687518+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:49.687518+0000","last_undegraded":"2023-10-24T00:28:49.687518+0000","last_fullsized":"2023-10-24T00:28:49.687518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.807419+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:48.807419+0000","last_peered":"2023-10-24T00:28:48.807419+0000","last_clean":"2023-10-24T00:28:48.807419+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:48.807419+0000","last_undegraded":"2023-10-24T00:28:48.807419+0000","last_fullsized":"2023-10-24T00:28:48.807419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.807450+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:48.807450+0000","last_peered":"2023-10-24T00:28:48.807450+0000","last_clean":"2023-10-24T00:28:48.807450+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:48.807450+0000","last_undegraded":"2023-10-24T00:28:48.807450+0000","last_fullsized":"2023-10-24T00:28:48.807450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:28:56.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:28:56.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.669+0000 7fcd05c20700 1 Processor -- start 2023-10-24T00:28:56.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.669+0000 7fcd05c20700 1 -- start start 2023-10-24T00:28:56.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fcd05c20700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd00152360 0x7fcd000c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fcd05c20700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcd000a61b0 0x7fcd000c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fcd05c20700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000a4d10 con 0x7fcd000c5b90 2023-10-24T00:28:56.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fcd05c20700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd00063620 con 0x7fcd00152360 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fcd05c20700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000c6530 con 0x7fcd000a61b0 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd00152360 0x7fcd000c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd00152360 0x7fcd000c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59076/0 (socket says 172.21.15.148:59076) 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccf7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcd000c5b90 0x7fcd00069380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45658/0 (socket says 172.21.15.148:45658) 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 -- 172.21.15.148:0/1669144983 learned_addr learned my addr 172.21.15.148:0/1669144983 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:56.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccfffff700 1 --2- 172.21.15.148:0/1669144983 >> v2:172.21.15.150:3300/0 conn(0x7fcd000a61b0 0x7fcd000c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 -- 172.21.15.148:0/1669144983 >> v2:172.21.15.150:3300/0 conn(0x7fcd000a61b0 msgr2=0x7fcd000c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 --2- 172.21.15.148:0/1669144983 >> v2:172.21.15.150:3300/0 conn(0x7fcd000a61b0 0x7fcd000c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 -- 172.21.15.148:0/1669144983 >> v1:172.21.15.148:6789/0 conn(0x7fcd000c5b90 legacy=0x7fcd00069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 -- 172.21.15.148:0/1669144983 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00152740 con 0x7fcd00152360 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccfeffd700 1 -- 172.21.15.148:0/1669144983 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668396587 0 0) 0x7fcd000a4d10 con 0x7fcd000c5b90 2023-10-24T00:28:56.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccff7fe700 1 --2- 172.21.15.148:0/1669144983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd00152360 0x7fcd000c6ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcd000be520 tx=0x7fccf00090f0).ready entity=mon.0 client_cookie=733fe16e00d43242 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccfeffd700 1 -- 172.21.15.148:0/1669144983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000b520 con 0x7fcd00152360 2023-10-24T00:28:56.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccfeffd700 1 -- 172.21.15.148:0/1669144983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000b680 con 0x7fcd00152360 2023-10-24T00:28:56.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.670+0000 7fccfeffd700 1 -- 172.21.15.148:0/1669144983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000ba00 con 0x7fcd00152360 2023-10-24T00:28:56.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 -- 172.21.15.148:0/1669144983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd00152360 msgr2=0x7fcd000c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 --2- 172.21.15.148:0/1669144983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd00152360 0x7fcd000c6ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcd000be520 tx=0x7fccf00090f0).stop 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 -- 172.21.15.148:0/1669144983 shutdown_connections 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 --2- 172.21.15.148:0/1669144983 >> v2:172.21.15.150:3300/0 conn(0x7fcd000a61b0 0x7fcd000c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 --2- 172.21.15.148:0/1669144983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd00152360 0x7fcd000c6ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 -- 172.21.15.148:0/1669144983 >> 172.21.15.148:0/1669144983 conn(0x7fcd000c5200 msgr2=0x7fcd000c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 -- 172.21.15.148:0/1669144983 shutdown_connections 2023-10-24T00:28:56.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.671+0000 7fcd05c20700 1 -- 172.21.15.148:0/1669144983 wait complete. 2023-10-24T00:28:56.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.672+0000 7fcd05c20700 1 Processor -- start 2023-10-24T00:28:56.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.672+0000 7fcd05c20700 1 -- start start 2023-10-24T00:28:56.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 0x7fcd000aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd00152360 0x7fcd00155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000c3210 con 0x7fcd000a61b0 2023-10-24T00:28:56.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000ab110 con 0x7fcd000c5b90 2023-10-24T00:28:56.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd001557f0 con 0x7fcd00152360 2023-10-24T00:28:56.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59092/0 (socket says 172.21.15.148:59092) 2023-10-24T00:28:56.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 -- 172.21.15.148:0/2868734131 learned_addr learned my addr 172.21.15.148:0/2868734131 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccf7fff700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 0x7fcd000aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccfffff700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd00152360 0x7fcd00155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 -- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd00152360 msgr2=0x7fcd00155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd00152360 0x7fcd00155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 -- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 msgr2=0x7fcd000aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 0x7fcd000aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 -- 172.21.15.148:0/2868734131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009370 con 0x7fcd000a61b0 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccf7fff700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 0x7fcd000aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccff7fe700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fccf0009130 tx=0x7fccf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000be90 con 0x7fcd000a61b0 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000b7f0 con 0x7fcd000a61b0 2023-10-24T00:28:56.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000c2600 con 0x7fcd000a61b0 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf001c670 con 0x7fcd000a61b0 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.673+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000c2bc0 con 0x7fcd000a61b0 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0006c6b0 con 0x7fcd000a61b0 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fccf001c9e0 con 0x7fcd000a61b0 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fccf77fe700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 0x7fcce00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:56.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fccf007bff0 con 0x7fcd000a61b0 2023-10-24T00:28:56.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fccf7fff700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 0x7fcce00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:56.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.675+0000 7fccf7fff700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 0x7fcce00615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcd000aa6b0 tx=0x7fcce8007b10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:56.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.679+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fccf004d2c0 con 0x7fcd000a61b0 2023-10-24T00:28:56.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.839+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd000c7560 con 0x7fcce005f120 2023-10-24T00:28:56.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.849+0000 7fccf77fe700 1 -- 172.21.15.148:0/2868734131 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332647 (secure 0 0 0) 0x7fcd000c7560 con 0x7fcce005f120 2023-10-24T00:28:56.855 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:56.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 msgr2=0x7fcce00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 0x7fcce00615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcd000aa6b0 tx=0x7fcce8007b10).stop 2023-10-24T00:28:56.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 msgr2=0x7fcd0013ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:56.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fccf0009130 tx=0x7fccf0017000).stop 2023-10-24T00:28:56.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 shutdown_connections 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd00152360 0x7fcd00155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcce005f120 0x7fcce00615e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd000a61b0 0x7fcd0013ed30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 --2- 172.21.15.148:0/2868734131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd000c5b90 0x7fcd000aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 >> 172.21.15.148:0/2868734131 conn(0x7fcd000c5200 msgr2=0x7fcd00069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:56.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.852+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 shutdown_connections 2023-10-24T00:28:56.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:56.853+0000 7fcd05c20700 1 -- 172.21.15.148:0/2868734131 wait complete. 2023-10-24T00:28:56.860 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:28:56.867 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-24T00:28:56.768779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378404,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596316,"statfs":{"total":773094113280,"available":770658627584,"internally_reserved":0,"allocated":1675264,"data_stored":598716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202675+0000","last_change":"2023-10-24T00:28:53.197457+0000","last_active":"2023-10-24T00:28:53.202675+0000","last_peered":"2023-10-24T00:28:53.202675+0000","last_clean":"2023-10-24T00:28:53.202675+0000","last_became_active":"2023-10-24T00:28:53.197181+0000","last_became_peered":"2023-10-24T00:28:53.197181+0000","last_unstale":"2023-10-24T00:28:53.202675+0000","last_undegraded":"2023-10-24T00:28:53.202675+0000","last_fullsized":"2023-10-24T00:28:53.202675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196253+0000","last_change":"2023-10-24T00:28:52.832585+0000","last_active":"2023-10-24T00:28:53.196253+0000","last_peered":"2023-10-24T00:28:53.196253+0000","last_clean":"2023-10-24T00:28:53.196253+0000","last_became_active":"2023-10-24T00:28:52.832304+0000","last_became_peered":"2023-10-24T00:28:52.832304+0000","last_unstale":"2023-10-24T00:28:53.196253+0000","last_undegraded":"2023-10-24T00:28:53.196253+0000","last_fullsized":"2023-10-24T00:28:53.196253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219117+0000","last_change":"2023-10-24T00:28:53.216919+0000","last_active":"2023-10-24T00:28:53.219117+0000","last_peered":"2023-10-24T00:28:53.219117+0000","last_clean":"2023-10-24T00:28:53.219117+0000","last_became_active":"2023-10-24T00:28:53.216644+0000","last_became_peered":"2023-10-24T00:28:53.216644+0000","last_unstale":"2023-10-24T00:28:53.219117+0000","last_undegraded":"2023-10-24T00:28:53.219117+0000","last_fullsized":"2023-10-24T00:28:53.219117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189038+0000","last_change":"2023-10-24T00:28:52.834106+0000","last_active":"2023-10-24T00:28:53.189038+0000","last_peered":"2023-10-24T00:28:53.189038+0000","last_clean":"2023-10-24T00:28:53.189038+0000","last_became_active":"2023-10-24T00:28:52.833861+0000","last_became_peered":"2023-10-24T00:28:52.833861+0000","last_unstale":"2023-10-24T00:28:53.189038+0000","last_undegraded":"2023-10-24T00:28:53.189038+0000","last_fullsized":"2023-10-24T00:28:53.189038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219445+0000","last_change":"2023-10-24T00:28:53.215329+0000","last_active":"2023-10-24T00:28:53.219445+0000","last_peered":"2023-10-24T00:28:53.219445+0000","last_clean":"2023-10-24T00:28:53.219445+0000","last_became_active":"2023-10-24T00:28:53.215054+0000","last_became_peered":"2023-10-24T00:28:53.215054+0000","last_unstale":"2023-10-24T00:28:53.219445+0000","last_undegraded":"2023-10-24T00:28:53.219445+0000","last_fullsized":"2023-10-24T00:28:53.219445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192190+0000","last_change":"2023-10-24T00:28:52.839855+0000","last_active":"2023-10-24T00:28:53.192190+0000","last_peered":"2023-10-24T00:28:53.192190+0000","last_clean":"2023-10-24T00:28:53.192190+0000","last_became_active":"2023-10-24T00:28:52.839642+0000","last_became_peered":"2023-10-24T00:28:52.839642+0000","last_unstale":"2023-10-24T00:28:53.192190+0000","last_undegraded":"2023-10-24T00:28:53.192190+0000","last_fullsized":"2023-10-24T00:28:53.192190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208075+0000","last_change":"2023-10-24T00:28:53.198164+0000","last_active":"2023-10-24T00:28:53.208075+0000","last_peered":"2023-10-24T00:28:53.208075+0000","last_clean":"2023-10-24T00:28:53.208075+0000","last_became_active":"2023-10-24T00:28:53.197880+0000","last_became_peered":"2023-10-24T00:28:53.197880+0000","last_unstale":"2023-10-24T00:28:53.208075+0000","last_undegraded":"2023-10-24T00:28:53.208075+0000","last_fullsized":"2023-10-24T00:28:53.208075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213801+0000","last_change":"2023-10-24T00:28:52.841842+0000","last_active":"2023-10-24T00:28:53.213801+0000","last_peered":"2023-10-24T00:28:53.213801+0000","last_clean":"2023-10-24T00:28:53.213801+0000","last_became_active":"2023-10-24T00:28:52.841497+0000","last_became_peered":"2023-10-24T00:28:52.841497+0000","last_unstale":"2023-10-24T00:28:53.213801+0000","last_undegraded":"2023-10-24T00:28:53.213801+0000","last_fullsized":"2023-10-24T00:28:53.213801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211799+0000","last_change":"2023-10-24T00:28:53.206480+0000","last_active":"2023-10-24T00:28:53.211799+0000","last_peered":"2023-10-24T00:28:53.211799+0000","last_clean":"2023-10-24T00:28:53.211799+0000","last_became_active":"2023-10-24T00:28:53.206200+0000","last_became_peered":"2023-10-24T00:28:53.206200+0000","last_unstale":"2023-10-24T00:28:53.211799+0000","last_undegraded":"2023-10-24T00:28:53.211799+0000","last_fullsized":"2023-10-24T00:28:53.211799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216889+0000","last_change":"2023-10-24T00:28:53.214654+0000","last_active":"2023-10-24T00:28:53.216889+0000","last_peered":"2023-10-24T00:28:53.216889+0000","last_clean":"2023-10-24T00:28:53.216889+0000","last_became_active":"2023-10-24T00:28:53.214391+0000","last_became_peered":"2023-10-24T00:28:53.214391+0000","last_unstale":"2023-10-24T00:28:53.216889+0000","last_undegraded":"2023-10-24T00:28:53.216889+0000","last_fullsized":"2023-10-24T00:28:53.216889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214442+0000","last_change":"2023-10-24T00:28:53.208856+0000","last_active":"2023-10-24T00:28:53.214442+0000","last_peered":"2023-10-24T00:28:53.214442+0000","last_clean":"2023-10-24T00:28:53.214442+0000","last_became_active":"2023-10-24T00:28:53.208588+0000","last_became_peered":"2023-10-24T00:28:53.208588+0000","last_unstale":"2023-10-24T00:28:53.214442+0000","last_undegraded":"2023-10-24T00:28:53.214442+0000","last_fullsized":"2023-10-24T00:28:53.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216976+0000","last_change":"2023-10-24T00:28:52.829502+0000","last_active":"2023-10-24T00:28:53.216976+0000","last_peered":"2023-10-24T00:28:53.216976+0000","last_clean":"2023-10-24T00:28:53.216976+0000","last_became_active":"2023-10-24T00:28:52.829097+0000","last_became_peered":"2023-10-24T00:28:52.829097+0000","last_unstale":"2023-10-24T00:28:53.216976+0000","last_undegraded":"2023-10-24T00:28:53.216976+0000","last_fullsized":"2023-10-24T00:28:53.216976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207273+0000","last_change":"2023-10-24T00:28:53.197597+0000","last_active":"2023-10-24T00:28:53.207273+0000","last_peered":"2023-10-24T00:28:53.207273+0000","last_clean":"2023-10-24T00:28:53.207273+0000","last_became_active":"2023-10-24T00:28:53.197328+0000","last_became_peered":"2023-10-24T00:28:53.197328+0000","last_unstale":"2023-10-24T00:28:53.207273+0000","last_undegraded":"2023-10-24T00:28:53.207273+0000","last_fullsized":"2023-10-24T00:28:53.207273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208421+0000","last_change":"2023-10-24T00:28:52.844225+0000","last_active":"2023-10-24T00:28:53.208421+0000","last_peered":"2023-10-24T00:28:53.208421+0000","last_clean":"2023-10-24T00:28:53.208421+0000","last_became_active":"2023-10-24T00:28:52.843751+0000","last_became_peered":"2023-10-24T00:28:52.843751+0000","last_unstale":"2023-10-24T00:28:53.208421+0000","last_undegraded":"2023-10-24T00:28:53.208421+0000","last_fullsized":"2023-10-24T00:28:53.208421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218875+0000","last_change":"2023-10-24T00:28:53.214994+0000","last_active":"2023-10-24T00:28:53.218875+0000","last_peered":"2023-10-24T00:28:53.218875+0000","last_clean":"2023-10-24T00:28:53.218875+0000","last_became_active":"2023-10-24T00:28:53.214737+0000","last_became_peered":"2023-10-24T00:28:53.214737+0000","last_unstale":"2023-10-24T00:28:53.218875+0000","last_undegraded":"2023-10-24T00:28:53.218875+0000","last_fullsized":"2023-10-24T00:28:53.218875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209960+0000","last_change":"2023-10-24T00:28:53.207217+0000","last_active":"2023-10-24T00:28:53.209960+0000","last_peered":"2023-10-24T00:28:53.209960+0000","last_clean":"2023-10-24T00:28:53.209960+0000","last_became_active":"2023-10-24T00:28:53.206965+0000","last_became_peered":"2023-10-24T00:28:53.206965+0000","last_unstale":"2023-10-24T00:28:53.209960+0000","last_undegraded":"2023-10-24T00:28:53.209960+0000","last_fullsized":"2023-10-24T00:28:53.209960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219384+0000","last_change":"2023-10-24T00:28:52.842202+0000","last_active":"2023-10-24T00:28:53.219384+0000","last_peered":"2023-10-24T00:28:53.219384+0000","last_clean":"2023-10-24T00:28:53.219384+0000","last_became_active":"2023-10-24T00:28:52.841831+0000","last_became_peered":"2023-10-24T00:28:52.841831+0000","last_unstale":"2023-10-24T00:28:53.219384+0000","last_undegraded":"2023-10-24T00:28:53.219384+0000","last_fullsized":"2023-10-24T00:28:53.219384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214085+0000","last_change":"2023-10-24T00:28:53.201055+0000","last_active":"2023-10-24T00:28:53.214085+0000","last_peered":"2023-10-24T00:28:53.214085+0000","last_clean":"2023-10-24T00:28:53.214085+0000","last_became_active":"2023-10-24T00:28:53.200779+0000","last_became_peered":"2023-10-24T00:28:53.200779+0000","last_unstale":"2023-10-24T00:28:53.214085+0000","last_undegraded":"2023-10-24T00:28:53.214085+0000","last_fullsized":"2023-10-24T00:28:53.214085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217556+0000","last_change":"2023-10-24T00:28:53.211199+0000","last_active":"2023-10-24T00:28:53.217556+0000","last_peered":"2023-10-24T00:28:53.217556+0000","last_clean":"2023-10-24T00:28:53.217556+0000","last_became_active":"2023-10-24T00:28:53.210886+0000","last_became_peered":"2023-10-24T00:28:53.210886+0000","last_unstale":"2023-10-24T00:28:53.217556+0000","last_undegraded":"2023-10-24T00:28:53.217556+0000","last_fullsized":"2023-10-24T00:28:53.217556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218827+0000","last_change":"2023-10-24T00:28:53.213828+0000","last_active":"2023-10-24T00:28:53.218827+0000","last_peered":"2023-10-24T00:28:53.218827+0000","last_clean":"2023-10-24T00:28:53.218827+0000","last_became_active":"2023-10-24T00:28:53.213506+0000","last_became_peered":"2023-10-24T00:28:53.213506+0000","last_unstale":"2023-10-24T00:28:53.218827+0000","last_undegraded":"2023-10-24T00:28:53.218827+0000","last_fullsized":"2023-10-24T00:28:53.218827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215542+0000","last_change":"2023-10-24T00:28:53.210526+0000","last_active":"2023-10-24T00:28:53.215542+0000","last_peered":"2023-10-24T00:28:53.215542+0000","last_clean":"2023-10-24T00:28:53.215542+0000","last_became_active":"2023-10-24T00:28:53.210295+0000","last_became_peered":"2023-10-24T00:28:53.210295+0000","last_unstale":"2023-10-24T00:28:53.215542+0000","last_undegraded":"2023-10-24T00:28:53.215542+0000","last_fullsized":"2023-10-24T00:28:53.215542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202449+0000","last_change":"2023-10-24T00:28:52.842949+0000","last_active":"2023-10-24T00:28:53.202449+0000","last_peered":"2023-10-24T00:28:53.202449+0000","last_clean":"2023-10-24T00:28:53.202449+0000","last_became_active":"2023-10-24T00:28:52.842488+0000","last_became_peered":"2023-10-24T00:28:52.842488+0000","last_unstale":"2023-10-24T00:28:53.202449+0000","last_undegraded":"2023-10-24T00:28:53.202449+0000","last_fullsized":"2023-10-24T00:28:53.202449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218240+0000","last_change":"2023-10-24T00:28:53.213761+0000","last_active":"2023-10-24T00:28:53.218240+0000","last_peered":"2023-10-24T00:28:53.218240+0000","last_clean":"2023-10-24T00:28:53.218240+0000","last_became_active":"2023-10-24T00:28:53.213457+0000","last_became_peered":"2023-10-24T00:28:53.213457+0000","last_unstale":"2023-10-24T00:28:53.218240+0000","last_undegraded":"2023-10-24T00:28:53.218240+0000","last_fullsized":"2023-10-24T00:28:53.218240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205989+0000","last_change":"2023-10-24T00:28:52.836396+0000","last_active":"2023-10-24T00:28:53.205989+0000","last_peered":"2023-10-24T00:28:53.205989+0000","last_clean":"2023-10-24T00:28:53.205989+0000","last_became_active":"2023-10-24T00:28:52.836110+0000","last_became_peered":"2023-10-24T00:28:52.836110+0000","last_unstale":"2023-10-24T00:28:53.205989+0000","last_undegraded":"2023-10-24T00:28:53.205989+0000","last_fullsized":"2023-10-24T00:28:53.205989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218040+0000","last_change":"2023-10-24T00:28:53.213383+0000","last_active":"2023-10-24T00:28:53.218040+0000","last_peered":"2023-10-24T00:28:53.218040+0000","last_clean":"2023-10-24T00:28:53.218040+0000","last_became_active":"2023-10-24T00:28:53.212809+0000","last_became_peered":"2023-10-24T00:28:53.212809+0000","last_unstale":"2023-10-24T00:28:53.218040+0000","last_undegraded":"2023-10-24T00:28:53.218040+0000","last_fullsized":"2023-10-24T00:28:53.218040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196651+0000","last_change":"2023-10-24T00:28:52.833221+0000","last_active":"2023-10-24T00:28:53.196651+0000","last_peered":"2023-10-24T00:28:53.196651+0000","last_clean":"2023-10-24T00:28:53.196651+0000","last_became_active":"2023-10-24T00:28:52.832941+0000","last_became_peered":"2023-10-24T00:28:52.832941+0000","last_unstale":"2023-10-24T00:28:53.196651+0000","last_undegraded":"2023-10-24T00:28:53.196651+0000","last_fullsized":"2023-10-24T00:28:53.196651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.201868+0000","last_change":"2023-10-24T00:28:53.197450+0000","last_active":"2023-10-24T00:28:53.201868+0000","last_peered":"2023-10-24T00:28:53.201868+0000","last_clean":"2023-10-24T00:28:53.201868+0000","last_became_active":"2023-10-24T00:28:53.197178+0000","last_became_peered":"2023-10-24T00:28:53.197178+0000","last_unstale":"2023-10-24T00:28:53.201868+0000","last_undegraded":"2023-10-24T00:28:53.201868+0000","last_fullsized":"2023-10-24T00:28:53.201868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.191976+0000","last_change":"2023-10-24T00:28:52.832101+0000","last_active":"2023-10-24T00:28:53.191976+0000","last_peered":"2023-10-24T00:28:53.191976+0000","last_clean":"2023-10-24T00:28:53.191976+0000","last_became_active":"2023-10-24T00:28:52.831799+0000","last_became_peered":"2023-10-24T00:28:52.831799+0000","last_unstale":"2023-10-24T00:28:53.191976+0000","last_undegraded":"2023-10-24T00:28:53.191976+0000","last_fullsized":"2023-10-24T00:28:53.191976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189164+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:53.189164+0000","last_peered":"2023-10-24T00:28:53.189164+0000","last_clean":"2023-10-24T00:28:53.189164+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:53.189164+0000","last_undegraded":"2023-10-24T00:28:53.189164+0000","last_fullsized":"2023-10-24T00:28:53.189164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215067+0000","last_change":"2023-10-24T00:28:53.212561+0000","last_active":"2023-10-24T00:28:53.215067+0000","last_peered":"2023-10-24T00:28:53.215067+0000","last_clean":"2023-10-24T00:28:53.215067+0000","last_became_active":"2023-10-24T00:28:53.212213+0000","last_became_peered":"2023-10-24T00:28:53.212213+0000","last_unstale":"2023-10-24T00:28:53.215067+0000","last_undegraded":"2023-10-24T00:28:53.215067+0000","last_fullsized":"2023-10-24T00:28:53.215067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.808396+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:48.808396+0000","last_peered":"2023-10-24T00:28:48.808396+0000","last_clean":"2023-10-24T00:28:48.808396+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:48.808396+0000","last_undegraded":"2023-10-24T00:28:48.808396+0000","last_fullsized":"2023-10-24T00:28:48.808396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196733+0000","last_change":"2023-10-24T00:28:52.841779+0000","last_active":"2023-10-24T00:28:53.196733+0000","last_peered":"2023-10-24T00:28:53.196733+0000","last_clean":"2023-10-24T00:28:53.196733+0000","last_became_active":"2023-10-24T00:28:52.841486+0000","last_became_peered":"2023-10-24T00:28:52.841486+0000","last_unstale":"2023-10-24T00:28:53.196733+0000","last_undegraded":"2023-10-24T00:28:53.196733+0000","last_fullsized":"2023-10-24T00:28:53.196733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202018+0000","last_change":"2023-10-24T00:28:53.198838+0000","last_active":"2023-10-24T00:28:53.202018+0000","last_peered":"2023-10-24T00:28:53.202018+0000","last_clean":"2023-10-24T00:28:53.202018+0000","last_became_active":"2023-10-24T00:28:53.198572+0000","last_became_peered":"2023-10-24T00:28:53.198572+0000","last_unstale":"2023-10-24T00:28:53.202018+0000","last_undegraded":"2023-10-24T00:28:53.202018+0000","last_fullsized":"2023-10-24T00:28:53.202018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218830+0000","last_change":"2023-10-24T00:28:53.215991+0000","last_active":"2023-10-24T00:28:53.218830+0000","last_peered":"2023-10-24T00:28:53.218830+0000","last_clean":"2023-10-24T00:28:53.218830+0000","last_became_active":"2023-10-24T00:28:53.215724+0000","last_became_peered":"2023-10-24T00:28:53.215724+0000","last_unstale":"2023-10-24T00:28:53.218830+0000","last_undegraded":"2023-10-24T00:28:53.218830+0000","last_fullsized":"2023-10-24T00:28:53.218830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.816160+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:48.816160+0000","last_peered":"2023-10-24T00:28:48.816160+0000","last_clean":"2023-10-24T00:28:48.816160+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:48.816160+0000","last_undegraded":"2023-10-24T00:28:48.816160+0000","last_fullsized":"2023-10-24T00:28:48.816160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189062+0000","last_change":"2023-10-24T00:28:52.836290+0000","last_active":"2023-10-24T00:28:53.189062+0000","last_peered":"2023-10-24T00:28:53.189062+0000","last_clean":"2023-10-24T00:28:53.189062+0000","last_became_active":"2023-10-24T00:28:52.836025+0000","last_became_peered":"2023-10-24T00:28:52.836025+0000","last_unstale":"2023-10-24T00:28:53.189062+0000","last_undegraded":"2023-10-24T00:28:53.189062+0000","last_fullsized":"2023-10-24T00:28:53.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219556+0000","last_change":"2023-10-24T00:28:53.216794+0000","last_active":"2023-10-24T00:28:53.219556+0000","last_peered":"2023-10-24T00:28:53.219556+0000","last_clean":"2023-10-24T00:28:53.219556+0000","last_became_active":"2023-10-24T00:28:53.216522+0000","last_became_peered":"2023-10-24T00:28:53.216522+0000","last_unstale":"2023-10-24T00:28:53.219556+0000","last_undegraded":"2023-10-24T00:28:53.219556+0000","last_fullsized":"2023-10-24T00:28:53.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.817408+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:48.817408+0000","last_peered":"2023-10-24T00:28:48.817408+0000","last_clean":"2023-10-24T00:28:48.817408+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:48.817408+0000","last_undegraded":"2023-10-24T00:28:48.817408+0000","last_fullsized":"2023-10-24T00:28:48.817408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.801645+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:48.801645+0000","last_peered":"2023-10-24T00:28:48.801645+0000","last_clean":"2023-10-24T00:28:48.801645+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:48.801645+0000","last_undegraded":"2023-10-24T00:28:48.801645+0000","last_fullsized":"2023-10-24T00:28:48.801645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192193+0000","last_change":"2023-10-24T00:28:52.835633+0000","last_active":"2023-10-24T00:28:53.192193+0000","last_peered":"2023-10-24T00:28:53.192193+0000","last_clean":"2023-10-24T00:28:53.192193+0000","last_became_active":"2023-10-24T00:28:52.833208+0000","last_became_peered":"2023-10-24T00:28:52.833208+0000","last_unstale":"2023-10-24T00:28:53.192193+0000","last_undegraded":"2023-10-24T00:28:53.192193+0000","last_fullsized":"2023-10-24T00:28:53.192193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218638+0000","last_change":"2023-10-24T00:28:53.213575+0000","last_active":"2023-10-24T00:28:53.218638+0000","last_peered":"2023-10-24T00:28:53.218638+0000","last_clean":"2023-10-24T00:28:53.218638+0000","last_became_active":"2023-10-24T00:28:53.209567+0000","last_became_peered":"2023-10-24T00:28:53.209567+0000","last_unstale":"2023-10-24T00:28:53.218638+0000","last_undegraded":"2023-10-24T00:28:53.218638+0000","last_fullsized":"2023-10-24T00:28:53.218638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.811277+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:48.811277+0000","last_peered":"2023-10-24T00:28:48.811277+0000","last_clean":"2023-10-24T00:28:48.811277+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:48.811277+0000","last_undegraded":"2023-10-24T00:28:48.811277+0000","last_fullsized":"2023-10-24T00:28:48.811277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205869+0000","last_change":"2023-10-24T00:28:52.840006+0000","last_active":"2023-10-24T00:28:53.205869+0000","last_peered":"2023-10-24T00:28:53.205869+0000","last_clean":"2023-10-24T00:28:53.205869+0000","last_became_active":"2023-10-24T00:28:52.839452+0000","last_became_peered":"2023-10-24T00:28:52.839452+0000","last_unstale":"2023-10-24T00:28:53.205869+0000","last_undegraded":"2023-10-24T00:28:53.205869+0000","last_fullsized":"2023-10-24T00:28:53.205869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687518+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:49.687518+0000","last_peered":"2023-10-24T00:28:49.687518+0000","last_clean":"2023-10-24T00:28:49.687518+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:49.687518+0000","last_undegraded":"2023-10-24T00:28:49.687518+0000","last_fullsized":"2023-10-24T00:28:49.687518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189581+0000","last_change":"2023-10-24T00:28:52.832876+0000","last_active":"2023-10-24T00:28:53.189581+0000","last_peered":"2023-10-24T00:28:53.189581+0000","last_clean":"2023-10-24T00:28:53.189581+0000","last_became_active":"2023-10-24T00:28:52.832617+0000","last_became_peered":"2023-10-24T00:28:52.832617+0000","last_unstale":"2023-10-24T00:28:53.189581+0000","last_undegraded":"2023-10-24T00:28:53.189581+0000","last_fullsized":"2023-10-24T00:28:53.189581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219158+0000","last_change":"2023-10-24T00:28:53.217199+0000","last_active":"2023-10-24T00:28:53.219158+0000","last_peered":"2023-10-24T00:28:53.219158+0000","last_clean":"2023-10-24T00:28:53.219158+0000","last_became_active":"2023-10-24T00:28:53.216879+0000","last_became_peered":"2023-10-24T00:28:53.216879+0000","last_unstale":"2023-10-24T00:28:53.219158+0000","last_undegraded":"2023-10-24T00:28:53.219158+0000","last_fullsized":"2023-10-24T00:28:53.219158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207465+0000","last_change":"2023-10-24T00:28:52.831240+0000","last_active":"2023-10-24T00:28:53.207465+0000","last_peered":"2023-10-24T00:28:53.207465+0000","last_clean":"2023-10-24T00:28:53.207465+0000","last_became_active":"2023-10-24T00:28:52.830998+0000","last_became_peered":"2023-10-24T00:28:52.830998+0000","last_unstale":"2023-10-24T00:28:53.207465+0000","last_undegraded":"2023-10-24T00:28:53.207465+0000","last_fullsized":"2023-10-24T00:28:53.207465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189430+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:53.189430+0000","last_peered":"2023-10-24T00:28:53.189430+0000","last_clean":"2023-10-24T00:28:53.189430+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:53.189430+0000","last_undegraded":"2023-10-24T00:28:53.189430+0000","last_fullsized":"2023-10-24T00:28:53.189430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210569+0000","last_change":"2023-10-24T00:28:53.207984+0000","last_active":"2023-10-24T00:28:53.210569+0000","last_peered":"2023-10-24T00:28:53.210569+0000","last_clean":"2023-10-24T00:28:53.210569+0000","last_became_active":"2023-10-24T00:28:53.206306+0000","last_became_peered":"2023-10-24T00:28:53.206306+0000","last_unstale":"2023-10-24T00:28:53.210569+0000","last_undegraded":"2023-10-24T00:28:53.210569+0000","last_fullsized":"2023-10-24T00:28:53.210569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204049+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:53.204049+0000","last_peered":"2023-10-24T00:28:53.204049+0000","last_clean":"2023-10-24T00:28:53.204049+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:53.204049+0000","last_undegraded":"2023-10-24T00:28:53.204049+0000","last_fullsized":"2023-10-24T00:28:53.204049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213765+0000","last_change":"2023-10-24T00:28:52.845874+0000","last_active":"2023-10-24T00:28:53.213765+0000","last_peered":"2023-10-24T00:28:53.213765+0000","last_clean":"2023-10-24T00:28:53.213765+0000","last_became_active":"2023-10-24T00:28:52.845615+0000","last_became_peered":"2023-10-24T00:28:52.845615+0000","last_unstale":"2023-10-24T00:28:53.213765+0000","last_undegraded":"2023-10-24T00:28:53.213765+0000","last_fullsized":"2023-10-24T00:28:53.213765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217693+0000","last_change":"2023-10-24T00:28:53.212953+0000","last_active":"2023-10-24T00:28:53.217693+0000","last_peered":"2023-10-24T00:28:53.217693+0000","last_clean":"2023-10-24T00:28:53.217693+0000","last_became_active":"2023-10-24T00:28:53.212744+0000","last_became_peered":"2023-10-24T00:28:53.212744+0000","last_unstale":"2023-10-24T00:28:53.217693+0000","last_undegraded":"2023-10-24T00:28:53.217693+0000","last_fullsized":"2023-10-24T00:28:53.217693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209326+0000","last_change":"2023-10-24T00:28:52.841438+0000","last_active":"2023-10-24T00:28:53.209326+0000","last_peered":"2023-10-24T00:28:53.209326+0000","last_clean":"2023-10-24T00:28:53.209326+0000","last_became_active":"2023-10-24T00:28:52.840737+0000","last_became_peered":"2023-10-24T00:28:52.840737+0000","last_unstale":"2023-10-24T00:28:53.209326+0000","last_undegraded":"2023-10-24T00:28:53.209326+0000","last_fullsized":"2023-10-24T00:28:53.209326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221285+0000","last_change":"2023-10-24T00:28:53.214566+0000","last_active":"2023-10-24T00:28:53.221285+0000","last_peered":"2023-10-24T00:28:53.221285+0000","last_clean":"2023-10-24T00:28:53.221285+0000","last_became_active":"2023-10-24T00:28:53.213861+0000","last_became_peered":"2023-10-24T00:28:53.213861+0000","last_unstale":"2023-10-24T00:28:53.221285+0000","last_undegraded":"2023-10-24T00:28:53.221285+0000","last_fullsized":"2023-10-24T00:28:53.221285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214867+0000","last_change":"2023-10-24T00:28:53.202586+0000","last_active":"2023-10-24T00:28:53.214867+0000","last_peered":"2023-10-24T00:28:53.214867+0000","last_clean":"2023-10-24T00:28:53.214867+0000","last_became_active":"2023-10-24T00:28:53.202224+0000","last_became_peered":"2023-10-24T00:28:53.202224+0000","last_unstale":"2023-10-24T00:28:53.214867+0000","last_undegraded":"2023-10-24T00:28:53.214867+0000","last_fullsized":"2023-10-24T00:28:53.214867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211781+0000","last_change":"2023-10-24T00:28:53.198873+0000","last_active":"2023-10-24T00:28:53.211781+0000","last_peered":"2023-10-24T00:28:53.211781+0000","last_clean":"2023-10-24T00:28:53.211781+0000","last_became_active":"2023-10-24T00:28:53.198630+0000","last_became_peered":"2023-10-24T00:28:53.198630+0000","last_unstale":"2023-10-24T00:28:53.211781+0000","last_undegraded":"2023-10-24T00:28:53.211781+0000","last_fullsized":"2023-10-24T00:28:53.211781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203535+0000","last_change":"2023-10-24T00:28:52.830907+0000","last_active":"2023-10-24T00:28:53.203535+0000","last_peered":"2023-10-24T00:28:53.203535+0000","last_clean":"2023-10-24T00:28:53.203535+0000","last_became_active":"2023-10-24T00:28:52.830585+0000","last_became_peered":"2023-10-24T00:28:52.830585+0000","last_unstale":"2023-10-24T00:28:53.203535+0000","last_undegraded":"2023-10-24T00:28:53.203535+0000","last_fullsized":"2023-10-24T00:28:53.203535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214428+0000","last_change":"2023-10-24T00:28:53.207126+0000","last_active":"2023-10-24T00:28:53.214428+0000","last_peered":"2023-10-24T00:28:53.214428+0000","last_clean":"2023-10-24T00:28:53.214428+0000","last_became_active":"2023-10-24T00:28:53.206860+0000","last_became_peered":"2023-10-24T00:28:53.206860+0000","last_unstale":"2023-10-24T00:28:53.214428+0000","last_undegraded":"2023-10-24T00:28:53.214428+0000","last_fullsized":"2023-10-24T00:28:53.214428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219605+0000","last_change":"2023-10-24T00:28:52.839828+0000","last_active":"2023-10-24T00:28:53.219605+0000","last_peered":"2023-10-24T00:28:53.219605+0000","last_clean":"2023-10-24T00:28:53.219605+0000","last_became_active":"2023-10-24T00:28:52.839501+0000","last_became_peered":"2023-10-24T00:28:52.839501+0000","last_unstale":"2023-10-24T00:28:53.219605+0000","last_undegraded":"2023-10-24T00:28:53.219605+0000","last_fullsized":"2023-10-24T00:28:53.219605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208863+0000","last_change":"2023-10-24T00:28:53.207780+0000","last_active":"2023-10-24T00:28:53.208863+0000","last_peered":"2023-10-24T00:28:53.208863+0000","last_clean":"2023-10-24T00:28:53.208863+0000","last_became_active":"2023-10-24T00:28:53.207543+0000","last_became_peered":"2023-10-24T00:28:53.207543+0000","last_unstale":"2023-10-24T00:28:53.208863+0000","last_undegraded":"2023-10-24T00:28:53.208863+0000","last_fullsized":"2023-10-24T00:28:53.208863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202990+0000","last_change":"2023-10-24T00:28:52.841865+0000","last_active":"2023-10-24T00:28:53.202990+0000","last_peered":"2023-10-24T00:28:53.202990+0000","last_clean":"2023-10-24T00:28:53.202990+0000","last_became_active":"2023-10-24T00:28:52.841563+0000","last_became_peered":"2023-10-24T00:28:52.841563+0000","last_unstale":"2023-10-24T00:28:53.202990+0000","last_undegraded":"2023-10-24T00:28:53.202990+0000","last_fullsized":"2023-10-24T00:28:53.202990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210510+0000","last_change":"2023-10-24T00:28:53.209114+0000","last_active":"2023-10-24T00:28:53.210510+0000","last_peered":"2023-10-24T00:28:53.210510+0000","last_clean":"2023-10-24T00:28:53.210510+0000","last_became_active":"2023-10-24T00:28:53.208807+0000","last_became_peered":"2023-10-24T00:28:53.208807+0000","last_unstale":"2023-10-24T00:28:53.210510+0000","last_undegraded":"2023-10-24T00:28:53.210510+0000","last_fullsized":"2023-10-24T00:28:53.210510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214864+0000","last_change":"2023-10-24T00:28:53.211252+0000","last_active":"2023-10-24T00:28:53.214864+0000","last_peered":"2023-10-24T00:28:53.214864+0000","last_clean":"2023-10-24T00:28:53.214864+0000","last_became_active":"2023-10-24T00:28:53.210970+0000","last_became_peered":"2023-10-24T00:28:53.210970+0000","last_unstale":"2023-10-24T00:28:53.214864+0000","last_undegraded":"2023-10-24T00:28:53.214864+0000","last_fullsized":"2023-10-24T00:28:53.214864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206180+0000","last_change":"2023-10-24T00:28:52.841793+0000","last_active":"2023-10-24T00:28:53.206180+0000","last_peered":"2023-10-24T00:28:53.206180+0000","last_clean":"2023-10-24T00:28:53.206180+0000","last_became_active":"2023-10-24T00:28:52.841487+0000","last_became_peered":"2023-10-24T00:28:52.841487+0000","last_unstale":"2023-10-24T00:28:53.206180+0000","last_undegraded":"2023-10-24T00:28:53.206180+0000","last_fullsized":"2023-10-24T00:28:53.206180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210735+0000","last_change":"2023-10-24T00:28:53.208115+0000","last_active":"2023-10-24T00:28:53.210735+0000","last_peered":"2023-10-24T00:28:53.210735+0000","last_clean":"2023-10-24T00:28:53.210735+0000","last_became_active":"2023-10-24T00:28:53.207329+0000","last_became_peered":"2023-10-24T00:28:53.207329+0000","last_unstale":"2023-10-24T00:28:53.210735+0000","last_undegraded":"2023-10-24T00:28:53.210735+0000","last_fullsized":"2023-10-24T00:28:53.210735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195405+0000","last_change":"2023-10-24T00:28:52.833047+0000","last_active":"2023-10-24T00:28:53.195405+0000","last_peered":"2023-10-24T00:28:53.195405+0000","last_clean":"2023-10-24T00:28:53.195405+0000","last_became_active":"2023-10-24T00:28:52.832806+0000","last_became_peered":"2023-10-24T00:28:52.832806+0000","last_unstale":"2023-10-24T00:28:53.195405+0000","last_undegraded":"2023-10-24T00:28:53.195405+0000","last_fullsized":"2023-10-24T00:28:53.195405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221263+0000","last_change":"2023-10-24T00:28:53.214374+0000","last_active":"2023-10-24T00:28:53.221263+0000","last_peered":"2023-10-24T00:28:53.221263+0000","last_clean":"2023-10-24T00:28:53.221263+0000","last_became_active":"2023-10-24T00:28:53.214029+0000","last_became_peered":"2023-10-24T00:28:53.214029+0000","last_unstale":"2023-10-24T00:28:53.221263+0000","last_undegraded":"2023-10-24T00:28:53.221263+0000","last_fullsized":"2023-10-24T00:28:53.221263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189999+0000","last_change":"2023-10-24T00:28:52.831478+0000","last_active":"2023-10-24T00:28:53.189999+0000","last_peered":"2023-10-24T00:28:53.189999+0000","last_clean":"2023-10-24T00:28:53.189999+0000","last_became_active":"2023-10-24T00:28:52.831185+0000","last_became_peered":"2023-10-24T00:28:52.831185+0000","last_unstale":"2023-10-24T00:28:53.189999+0000","last_undegraded":"2023-10-24T00:28:53.189999+0000","last_fullsized":"2023-10-24T00:28:53.189999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203515+0000","last_change":"2023-10-24T00:28:53.197544+0000","last_active":"2023-10-24T00:28:53.203515+0000","last_peered":"2023-10-24T00:28:53.203515+0000","last_clean":"2023-10-24T00:28:53.203515+0000","last_became_active":"2023-10-24T00:28:53.197271+0000","last_became_peered":"2023-10-24T00:28:53.197271+0000","last_unstale":"2023-10-24T00:28:53.203515+0000","last_undegraded":"2023-10-24T00:28:53.203515+0000","last_fullsized":"2023-10-24T00:28:53.203515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203411+0000","last_change":"2023-10-24T00:28:52.835770+0000","last_active":"2023-10-24T00:28:53.203411+0000","last_peered":"2023-10-24T00:28:53.203411+0000","last_clean":"2023-10-24T00:28:53.203411+0000","last_became_active":"2023-10-24T00:28:52.835495+0000","last_became_peered":"2023-10-24T00:28:52.835495+0000","last_unstale":"2023-10-24T00:28:53.203411+0000","last_undegraded":"2023-10-24T00:28:53.203411+0000","last_fullsized":"2023-10-24T00:28:53.203411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216732+0000","last_change":"2023-10-24T00:28:53.210440+0000","last_active":"2023-10-24T00:28:53.216732+0000","last_peered":"2023-10-24T00:28:53.216732+0000","last_clean":"2023-10-24T00:28:53.216732+0000","last_became_active":"2023-10-24T00:28:53.210153+0000","last_became_peered":"2023-10-24T00:28:53.210153+0000","last_unstale":"2023-10-24T00:28:53.216732+0000","last_undegraded":"2023-10-24T00:28:53.216732+0000","last_fullsized":"2023-10-24T00:28:53.216732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195686+0000","last_change":"2023-10-24T00:28:52.834627+0000","last_active":"2023-10-24T00:28:53.195686+0000","last_peered":"2023-10-24T00:28:53.195686+0000","last_clean":"2023-10-24T00:28:53.195686+0000","last_became_active":"2023-10-24T00:28:52.834319+0000","last_became_peered":"2023-10-24T00:28:52.834319+0000","last_unstale":"2023-10-24T00:28:53.195686+0000","last_undegraded":"2023-10-24T00:28:53.195686+0000","last_fullsized":"2023-10-24T00:28:53.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218902+0000","last_change":"2023-10-24T00:28:53.215043+0000","last_active":"2023-10-24T00:28:53.218902+0000","last_peered":"2023-10-24T00:28:53.218902+0000","last_clean":"2023-10-24T00:28:53.218902+0000","last_became_active":"2023-10-24T00:28:53.214443+0000","last_became_peered":"2023-10-24T00:28:53.214443+0000","last_unstale":"2023-10-24T00:28:53.218902+0000","last_undegraded":"2023-10-24T00:28:53.218902+0000","last_fullsized":"2023-10-24T00:28:53.218902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218060+0000","last_change":"2023-10-24T00:28:53.213561+0000","last_active":"2023-10-24T00:28:53.218060+0000","last_peered":"2023-10-24T00:28:53.218060+0000","last_clean":"2023-10-24T00:28:53.218060+0000","last_became_active":"2023-10-24T00:28:53.213113+0000","last_became_peered":"2023-10-24T00:28:53.213113+0000","last_unstale":"2023-10-24T00:28:53.218060+0000","last_undegraded":"2023-10-24T00:28:53.218060+0000","last_fullsized":"2023-10-24T00:28:53.218060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.193241+0000","last_change":"2023-10-24T00:28:52.836152+0000","last_active":"2023-10-24T00:28:53.193241+0000","last_peered":"2023-10-24T00:28:53.193241+0000","last_clean":"2023-10-24T00:28:53.193241+0000","last_became_active":"2023-10-24T00:28:52.835876+0000","last_became_peered":"2023-10-24T00:28:52.835876+0000","last_unstale":"2023-10-24T00:28:53.193241+0000","last_undegraded":"2023-10-24T00:28:53.193241+0000","last_fullsized":"2023-10-24T00:28:53.193241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221391+0000","last_change":"2023-10-24T00:28:53.215101+0000","last_active":"2023-10-24T00:28:53.221391+0000","last_peered":"2023-10-24T00:28:53.221391+0000","last_clean":"2023-10-24T00:28:53.221391+0000","last_became_active":"2023-10-24T00:28:53.214824+0000","last_became_peered":"2023-10-24T00:28:53.214824+0000","last_unstale":"2023-10-24T00:28:53.221391+0000","last_undegraded":"2023-10-24T00:28:53.221391+0000","last_fullsized":"2023-10-24T00:28:53.221391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.220171+0000","last_change":"2023-10-24T00:28:52.841688+0000","last_active":"2023-10-24T00:28:53.220171+0000","last_peered":"2023-10-24T00:28:53.220171+0000","last_clean":"2023-10-24T00:28:53.220171+0000","last_became_active":"2023-10-24T00:28:52.841119+0000","last_became_peered":"2023-10-24T00:28:52.841119+0000","last_unstale":"2023-10-24T00:28:53.220171+0000","last_undegraded":"2023-10-24T00:28:53.220171+0000","last_fullsized":"2023-10-24T00:28:53.220171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206514+0000","last_change":"2023-10-24T00:28:52.837080+0000","last_active":"2023-10-24T00:28:53.206514+0000","last_peered":"2023-10-24T00:28:53.206514+0000","last_clean":"2023-10-24T00:28:53.206514+0000","last_became_active":"2023-10-24T00:28:52.836776+0000","last_became_peered":"2023-10-24T00:28:52.836776+0000","last_unstale":"2023-10-24T00:28:53.206514+0000","last_undegraded":"2023-10-24T00:28:53.206514+0000","last_fullsized":"2023-10-24T00:28:53.206514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218929+0000","last_change":"2023-10-24T00:28:53.216046+0000","last_active":"2023-10-24T00:28:53.218929+0000","last_peered":"2023-10-24T00:28:53.218929+0000","last_clean":"2023-10-24T00:28:53.218929+0000","last_became_active":"2023-10-24T00:28:53.213450+0000","last_became_peered":"2023-10-24T00:28:53.213450+0000","last_unstale":"2023-10-24T00:28:53.218929+0000","last_undegraded":"2023-10-24T00:28:53.218929+0000","last_fullsized":"2023-10-24T00:28:53.218929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211818+0000","last_change":"2023-10-24T00:28:53.208010+0000","last_active":"2023-10-24T00:28:53.211818+0000","last_peered":"2023-10-24T00:28:53.211818+0000","last_clean":"2023-10-24T00:28:53.211818+0000","last_became_active":"2023-10-24T00:28:53.207747+0000","last_became_peered":"2023-10-24T00:28:53.207747+0000","last_unstale":"2023-10-24T00:28:53.211818+0000","last_undegraded":"2023-10-24T00:28:53.211818+0000","last_fullsized":"2023-10-24T00:28:53.211818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218923+0000","last_change":"2023-10-24T00:28:53.215218+0000","last_active":"2023-10-24T00:28:53.218923+0000","last_peered":"2023-10-24T00:28:53.218923+0000","last_clean":"2023-10-24T00:28:53.218923+0000","last_became_active":"2023-10-24T00:28:53.214775+0000","last_became_peered":"2023-10-24T00:28:53.214775+0000","last_unstale":"2023-10-24T00:28:53.218923+0000","last_undegraded":"2023-10-24T00:28:53.218923+0000","last_fullsized":"2023-10-24T00:28:53.218923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189036+0000","last_change":"2023-10-24T00:28:52.830798+0000","last_active":"2023-10-24T00:28:53.189036+0000","last_peered":"2023-10-24T00:28:53.189036+0000","last_clean":"2023-10-24T00:28:53.189036+0000","last_became_active":"2023-10-24T00:28:52.830499+0000","last_became_peered":"2023-10-24T00:28:52.830499+0000","last_unstale":"2023-10-24T00:28:53.189036+0000","last_undegraded":"2023-10-24T00:28:53.189036+0000","last_fullsized":"2023-10-24T00:28:53.189036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221123+0000","last_change":"2023-10-24T00:28:53.214273+0000","last_active":"2023-10-24T00:28:53.221123+0000","last_peered":"2023-10-24T00:28:53.221123+0000","last_clean":"2023-10-24T00:28:53.221123+0000","last_became_active":"2023-10-24T00:28:53.213976+0000","last_became_peered":"2023-10-24T00:28:53.213976+0000","last_unstale":"2023-10-24T00:28:53.221123+0000","last_undegraded":"2023-10-24T00:28:53.221123+0000","last_fullsized":"2023-10-24T00:28:53.221123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208529+0000","last_change":"2023-10-24T00:28:52.844073+0000","last_active":"2023-10-24T00:28:53.208529+0000","last_peered":"2023-10-24T00:28:53.208529+0000","last_clean":"2023-10-24T00:28:53.208529+0000","last_became_active":"2023-10-24T00:28:52.843728+0000","last_became_peered":"2023-10-24T00:28:52.843728+0000","last_unstale":"2023-10-24T00:28:53.208529+0000","last_undegraded":"2023-10-24T00:28:53.208529+0000","last_fullsized":"2023-10-24T00:28:53.208529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204197+0000","last_change":"2023-10-24T00:28:52.831728+0000","last_active":"2023-10-24T00:28:53.204197+0000","last_peered":"2023-10-24T00:28:53.204197+0000","last_clean":"2023-10-24T00:28:53.204197+0000","last_became_active":"2023-10-24T00:28:52.831431+0000","last_became_peered":"2023-10-24T00:28:52.831431+0000","last_unstale":"2023-10-24T00:28:53.204197+0000","last_undegraded":"2023-10-24T00:28:53.204197+0000","last_fullsized":"2023-10-24T00:28:53.204197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221459+0000","last_change":"2023-10-24T00:28:52.830036+0000","last_active":"2023-10-24T00:28:53.221459+0000","last_peered":"2023-10-24T00:28:53.221459+0000","last_clean":"2023-10-24T00:28:53.221459+0000","last_became_active":"2023-10-24T00:28:52.829705+0000","last_became_peered":"2023-10-24T00:28:52.829705+0000","last_unstale":"2023-10-24T00:28:53.221459+0000","last_undegraded":"2023-10-24T00:28:53.221459+0000","last_fullsized":"2023-10-24T00:28:53.221459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206210+0000","last_change":"2023-10-24T00:28:52.834788+0000","last_active":"2023-10-24T00:28:53.206210+0000","last_peered":"2023-10-24T00:28:53.206210+0000","last_clean":"2023-10-24T00:28:53.206210+0000","last_became_active":"2023-10-24T00:28:52.834521+0000","last_became_peered":"2023-10-24T00:28:52.834521+0000","last_unstale":"2023-10-24T00:28:53.206210+0000","last_undegraded":"2023-10-24T00:28:53.206210+0000","last_fullsized":"2023-10-24T00:28:53.206210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203299+0000","last_change":"2023-10-24T00:28:52.834186+0000","last_active":"2023-10-24T00:28:53.203299+0000","last_peered":"2023-10-24T00:28:53.203299+0000","last_clean":"2023-10-24T00:28:53.203299+0000","last_became_active":"2023-10-24T00:28:52.833901+0000","last_became_peered":"2023-10-24T00:28:52.833901+0000","last_unstale":"2023-10-24T00:28:53.203299+0000","last_undegraded":"2023-10-24T00:28:53.203299+0000","last_fullsized":"2023-10-24T00:28:53.203299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214448+0000","last_change":"2023-10-24T00:28:53.210483+0000","last_active":"2023-10-24T00:28:53.214448+0000","last_peered":"2023-10-24T00:28:53.214448+0000","last_clean":"2023-10-24T00:28:53.214448+0000","last_became_active":"2023-10-24T00:28:53.210273+0000","last_became_peered":"2023-10-24T00:28:53.210273+0000","last_unstale":"2023-10-24T00:28:53.214448+0000","last_undegraded":"2023-10-24T00:28:53.214448+0000","last_fullsized":"2023-10-24T00:28:53.214448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192091+0000","last_change":"2023-10-24T00:28:52.834616+0000","last_active":"2023-10-24T00:28:53.192091+0000","last_peered":"2023-10-24T00:28:53.192091+0000","last_clean":"2023-10-24T00:28:53.192091+0000","last_became_active":"2023-10-24T00:28:52.834139+0000","last_became_peered":"2023-10-24T00:28:52.834139+0000","last_unstale":"2023-10-24T00:28:53.192091+0000","last_undegraded":"2023-10-24T00:28:53.192091+0000","last_fullsized":"2023-10-24T00:28:53.192091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221422+0000","last_change":"2023-10-24T00:28:53.215705+0000","last_active":"2023-10-24T00:28:53.221422+0000","last_peered":"2023-10-24T00:28:53.221422+0000","last_clean":"2023-10-24T00:28:53.221422+0000","last_became_active":"2023-10-24T00:28:53.214840+0000","last_became_peered":"2023-10-24T00:28:53.214840+0000","last_unstale":"2023-10-24T00:28:53.221422+0000","last_undegraded":"2023-10-24T00:28:53.221422+0000","last_fullsized":"2023-10-24T00:28:53.221422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221438+0000","last_change":"2023-10-24T00:28:53.219279+0000","last_active":"2023-10-24T00:28:53.221438+0000","last_peered":"2023-10-24T00:28:53.221438+0000","last_clean":"2023-10-24T00:28:53.221438+0000","last_became_active":"2023-10-24T00:28:53.218946+0000","last_became_peered":"2023-10-24T00:28:53.218946+0000","last_unstale":"2023-10-24T00:28:53.221438+0000","last_undegraded":"2023-10-24T00:28:53.221438+0000","last_fullsized":"2023-10-24T00:28:53.221438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219137+0000","last_change":"2023-10-24T00:28:53.217100+0000","last_active":"2023-10-24T00:28:53.219137+0000","last_peered":"2023-10-24T00:28:53.219137+0000","last_clean":"2023-10-24T00:28:53.219137+0000","last_became_active":"2023-10-24T00:28:53.216532+0000","last_became_peered":"2023-10-24T00:28:53.216532+0000","last_unstale":"2023-10-24T00:28:53.219137+0000","last_undegraded":"2023-10-24T00:28:53.219137+0000","last_fullsized":"2023-10-24T00:28:53.219137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.223749+0000","last_change":"2023-10-24T00:28:53.217865+0000","last_active":"2023-10-24T00:28:53.223749+0000","last_peered":"2023-10-24T00:28:53.223749+0000","last_clean":"2023-10-24T00:28:53.223749+0000","last_became_active":"2023-10-24T00:28:53.217135+0000","last_became_peered":"2023-10-24T00:28:53.217135+0000","last_unstale":"2023-10-24T00:28:53.223749+0000","last_undegraded":"2023-10-24T00:28:53.223749+0000","last_fullsized":"2023-10-24T00:28:53.223749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206256+0000","last_change":"2023-10-24T00:28:52.839792+0000","last_active":"2023-10-24T00:28:53.206256+0000","last_peered":"2023-10-24T00:28:53.206256+0000","last_clean":"2023-10-24T00:28:53.206256+0000","last_became_active":"2023-10-24T00:28:52.839474+0000","last_became_peered":"2023-10-24T00:28:52.839474+0000","last_unstale":"2023-10-24T00:28:53.206256+0000","last_undegraded":"2023-10-24T00:28:53.206256+0000","last_fullsized":"2023-10-24T00:28:53.206256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189600+0000","last_change":"2023-10-24T00:28:52.846124+0000","last_active":"2023-10-24T00:28:53.189600+0000","last_peered":"2023-10-24T00:28:53.189600+0000","last_clean":"2023-10-24T00:28:53.189600+0000","last_became_active":"2023-10-24T00:28:52.845781+0000","last_became_peered":"2023-10-24T00:28:52.845781+0000","last_unstale":"2023-10-24T00:28:53.189600+0000","last_undegraded":"2023-10-24T00:28:53.189600+0000","last_fullsized":"2023-10-24T00:28:53.189600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":78,"acting":78,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":86809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":86663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:28:56.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-24T00:28:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-24T00:28:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-24T00:28:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-24T00:28:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-24T00:28:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-24T00:28:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-24T00:28:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-24T00:28:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-24T00:28:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-24T00:28:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-24T00:28:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-24T00:28:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-24T00:28:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-24T00:28:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-24T00:28:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-24T00:28:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-24T00:28:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-24T00:28:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-10-24T00:28:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-24T00:28:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-10-24T00:28:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-24T00:28:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-24T00:28:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-10-24T00:28:56.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-24T00:28:56.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-24T00:28:56.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-10-24T00:28:56.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-10-24T00:28:56.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-10-24T00:28:56.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-10-24T00:28:56.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-10-24T00:28:56.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-24T00:28:56.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-10-24T00:28:56.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-10-24T00:28:56.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-24T00:28:56.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-24T00:28:56.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-24T00:28:56.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-24T00:28:56.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-24T00:28:56.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-10-24T00:28:56.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:52.808484+0000', 'last_change': '2023-10-24T00:28:52.808484+0000', 'last_active': '2023-10-24T00:28:52.808484+0000', 'last_peered': '2023-10-24T00:28:52.808484+0000', 'last_clean': '2023-10-24T00:28:52.808484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:52.808484+0000', 'last_undegraded': '2023-10-24T00:28:52.808484+0000', 'last_fullsized': '2023-10-24T00:28:52.808484+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:52.808484+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-24T00:28:56.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:28:51.806735+0000', 'last_change': '2023-10-24T00:28:51.806735+0000', 'last_active': '2023-10-24T00:28:51.806735+0000', 'last_peered': '2023-10-24T00:28:51.806735+0000', 'last_clean': '2023-10-24T00:28:51.806735+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:28:51.806735+0000', 'last_undegraded': '2023-10-24T00:28:51.806735+0000', 'last_fullsized': '2023-10-24T00:28:51.806735+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'last_clean_scrub_stamp': '2023-10-24T00:28:51.806735+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:28:56.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:28:57.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.017+0000 7f8dd6142700 1 Processor -- start 2023-10-24T00:28:57.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.017+0000 7f8dd6142700 1 -- start start 2023-10-24T00:28:57.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dd6142700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8dd0064f30 0x7f8dd00c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dd6142700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd0157fa0 con 0x7f8dd00c6430 2023-10-24T00:28:57.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dd6142700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00c6890 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dd6142700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd01581f0 con 0x7f8dd0064f30 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dceffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8dd0064f30 0x7f8dd00c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dcffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8dd00c6430 0x7f8dd01549d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45670/0 (socket says 172.21.15.148:45670) 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dceffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8dd0064f30 0x7f8dd00c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59102/0 (socket says 172.21.15.148:59102) 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dcffff700 1 -- 172.21.15.148:0/1399547610 learned_addr learned my addr 172.21.15.148:0/1399547610 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dceffd700 1 -- 172.21.15.148:0/1399547610 >> v1:172.21.15.150:6789/0 conn(0x7f8dd00aa2f0 legacy=0x7f8dd0064820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:57.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dceffd700 1 -- 172.21.15.148:0/1399547610 >> v1:172.21.15.148:6789/0 conn(0x7f8dd00c6430 legacy=0x7f8dd01549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dceffd700 1 -- 172.21.15.148:0/1399547610 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd01584d0 con 0x7f8dd0064f30 2023-10-24T00:28:57.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.018+0000 7f8dce7fc700 1 -- 172.21.15.148:0/1399547610 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243001440 0 0) 0x7f8dd0157fa0 con 0x7f8dd00c6430 2023-10-24T00:28:57.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dceffd700 1 --2- 172.21.15.148:0/1399547610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0064f30 0x7f8dd00c5f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8dc4009760 tx=0x7f8dc4009060).ready entity=mon.0 client_cookie=ca7574af20aca7bf server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dce7fc700 1 -- 172.21.15.148:0/1399547610 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400b580 con 0x7f8dd0064f30 2023-10-24T00:28:57.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dce7fc700 1 -- 172.21.15.148:0/1399547610 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc400b6e0 con 0x7f8dd0064f30 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dce7fc700 1 -- 172.21.15.148:0/1399547610 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400ba60 con 0x7f8dd0064f30 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 -- 172.21.15.148:0/1399547610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0064f30 msgr2=0x7f8dd00c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 --2- 172.21.15.148:0/1399547610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0064f30 0x7f8dd00c5f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8dc4009760 tx=0x7f8dc4009060).stop 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 -- 172.21.15.148:0/1399547610 shutdown_connections 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 --2- 172.21.15.148:0/1399547610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd0064f30 0x7f8dd00c5f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 -- 172.21.15.148:0/1399547610 >> 172.21.15.148:0/1399547610 conn(0x7f8dd00caf90 msgr2=0x7f8dd00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:57.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 -- 172.21.15.148:0/1399547610 shutdown_connections 2023-10-24T00:28:57.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.019+0000 7f8dd6142700 1 -- 172.21.15.148:0/1399547610 wait complete. 2023-10-24T00:28:57.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 Processor -- start 2023-10-24T00:28:57.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 -- start start 2023-10-24T00:28:57.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dd0064f30 0x7f8dd0149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dd00c6430 0x7f8dd014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0149630 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd014ea40 con 0x7f8dd00c6430 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dd6142700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd00c3060 con 0x7f8dd0064f30 2023-10-24T00:28:57.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dceffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dceffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59118/0 (socket says 172.21.15.148:59118) 2023-10-24T00:28:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.021+0000 7f8dceffd700 1 -- 172.21.15.148:0/531946255 learned_addr learned my addr 172.21.15.148:0/531946255 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 -- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dd0064f30 msgr2=0x7f8dd0149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dd0064f30 0x7f8dd0149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dcffff700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dd00c6430 0x7f8dd014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 -- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dd00c6430 msgr2=0x7f8dd014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dd00c6430 0x7f8dd014dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 -- 172.21.15.148:0/531946255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40092a0 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dceffd700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8dd0062e20 tx=0x7f8dc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400b850 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc400b9b0 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc401b620 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd00ae430 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.022+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd00c2a10 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.023+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd006c6b0 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.023+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8dc401ba50 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.024+0000 7f8db77fe700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 0x7f8dbc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.024+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8dc407be20 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.024+0000 7f8dcf7fe700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 0x7f8dbc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.024+0000 7f8dcf7fe700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 0x7f8dbc061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8dc0002c10 tx=0x7f8dc0007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.029+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8dc404d0f0 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.260+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8dd01587b0 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.260+0000 7f8db77fe700 1 -- 172.21.15.148:0/531946255 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7f8dc4028410 con 0x7f8dd00aa2f0 2023-10-24T00:28:57.263 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:57.263 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"unknown","count":41}],"num_pgs":137,"num_pools":4,"num_objects":9,"data_bytes":1536,"bytes_used":2435485696,"bytes_avail":770658627584,"bytes_total":773094113280,"unknown_pgs_ratio":0.29927006363868713},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4278}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-24T00:28:35.904950+0000","services":{}},"progress_events":{}} 2023-10-24T00:28:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 msgr2=0x7f8dbc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 0x7f8dbc061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8dc0002c10 tx=0x7f8dc0007d20).stop 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 msgr2=0x7f8dd00adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8dd0062e20 tx=0x7f8dc4017000).stop 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 shutdown_connections 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dd00c6430 0x7f8dd014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dd0064f30 0x7f8dd0149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:28:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8dbc05f150 0x7f8dbc061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 --2- 172.21.15.148:0/531946255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8dd00aa2f0 0x7f8dd00adf40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 >> 172.21.15.148:0/531946255 conn(0x7f8dd00caf90 msgr2=0x7f8dd0063e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 shutdown_connections 2023-10-24T00:28:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.262+0000 7f8dd6142700 1 -- 172.21.15.148:0/531946255 wait complete. 2023-10-24T00:28:57.276 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:28:57.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:28:57.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.388+0000 7f6161afc700 1 Processor -- start 2023-10-24T00:28:57.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.388+0000 7f6161afc700 1 -- start start 2023-10-24T00:28:57.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f6161afc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa010 0x7f615c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f6161afc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f615c0aa3f0 0x7f615c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f6161afc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0c0960 con 0x7f615c0c6710 2023-10-24T00:28:57.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f6161afc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c0aa8a0 con 0x7f615c0aa3f0 2023-10-24T00:28:57.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f6161afc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c0c40 con 0x7f615c0aa010 2023-10-24T00:28:57.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f615c0aa3f0 0x7f615c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f615c0aa3f0 0x7f615c069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59120/0 (socket says 172.21.15.148:59120) 2023-10-24T00:28:57.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 -- 172.21.15.148:0/2732599676 learned_addr learned my addr 172.21.15.148:0/2732599676 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615b7fe700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa010 0x7f615c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 -- 172.21.15.148:0/2732599676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa010 msgr2=0x7f615c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa010 0x7f615c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 -- 172.21.15.148:0/2732599676 >> v1:172.21.15.150:6789/0 conn(0x7f615c0c6710 legacy=0x7f615c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 -- 172.21.15.148:0/2732599676 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0c0f20 con 0x7f615c0aa3f0 2023-10-24T00:28:57.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615bfff700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa3f0 0x7f615c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6154009f20 tx=0x7f6154009840).ready entity=mon.0 client_cookie=d8ae3dc14bfb4d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615affd700 1 -- 172.21.15.148:0/2732599676 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400e070 con 0x7f615c0aa3f0 2023-10-24T00:28:57.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615affd700 1 -- 172.21.15.148:0/2732599676 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400b9d0 con 0x7f615c0aa3f0 2023-10-24T00:28:57.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.389+0000 7f615affd700 1 -- 172.21.15.148:0/2732599676 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400bd50 con 0x7f615c0aa3f0 2023-10-24T00:28:57.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 -- 172.21.15.148:0/2732599676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa3f0 msgr2=0x7f615c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa3f0 0x7f615c069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6154009f20 tx=0x7f6154009840).stop 2023-10-24T00:28:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 -- 172.21.15.148:0/2732599676 shutdown_connections 2023-10-24T00:28:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa010 0x7f615c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 --2- 172.21.15.148:0/2732599676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa3f0 0x7f615c069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 -- 172.21.15.148:0/2732599676 >> 172.21.15.148:0/2732599676 conn(0x7f615c0caf40 msgr2=0x7f615c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 -- 172.21.15.148:0/2732599676 shutdown_connections 2023-10-24T00:28:57.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.390+0000 7f6161afc700 1 -- 172.21.15.148:0/2732599676 wait complete. 2023-10-24T00:28:57.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.391+0000 7f6161afc700 1 Processor -- start 2023-10-24T00:28:57.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.391+0000 7f6161afc700 1 -- start start 2023-10-24T00:28:57.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa3f0 0x7f615c0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 0x7f615c0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c3cc0 con 0x7f615c0aa010 2023-10-24T00:28:57.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c3fa0 con 0x7f615c0c6710 2023-10-24T00:28:57.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c4280 con 0x7f615c0aa3f0 2023-10-24T00:28:57.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59136/0 (socket says 172.21.15.148:59136) 2023-10-24T00:28:57.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 -- 172.21.15.148:0/2893105959 learned_addr learned my addr 172.21.15.148:0/2893105959 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:28:57.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615bfff700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 0x7f615c0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6153fff700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa3f0 0x7f615c0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 -- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa3f0 msgr2=0x7f615c0c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa3f0 0x7f615c0c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 -- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 msgr2=0x7f615c0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 0x7f615c0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 -- 172.21.15.148:0/2893105959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154009ae0 con 0x7f615c0aa010 2023-10-24T00:28:57.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615bfff700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 0x7f615c0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:28:57.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f615b7fe700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f614c00e950 tx=0x7f614c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00c850 con 0x7f615c0aa010 2023-10-24T00:28:57.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00c9b0 con 0x7f615c0aa010 2023-10-24T00:28:57.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0c4560 con 0x7f615c0aa010 2023-10-24T00:28:57.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00cd30 con 0x7f615c0aa010 2023-10-24T00:28:57.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.393+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c14af10 con 0x7f615c0aa010 2023-10-24T00:28:57.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c06c6b0 con 0x7f615c0aa010 2023-10-24T00:28:57.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f614c012600 con 0x7f615c0aa010 2023-10-24T00:28:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f61537fe700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 0x7f613c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:28:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f614c07a800 con 0x7f615c0aa010 2023-10-24T00:28:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f6153fff700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 0x7f613c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:28:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.394+0000 7f6153fff700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 0x7f613c061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f615c0adc70 tx=0x7f6144009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:28:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.399+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f614c04bad0 con 0x7f615c0aa010 2023-10-24T00:28:57.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.556+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f615c0c1200 con 0x7f613c05f150 2023-10-24T00:28:57.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.565+0000 7f61537fe700 1 -- 172.21.15.148:0/2893105959 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332647 (secure 0 0 0) 0x7f615c0c1200 con 0x7f613c05f150 2023-10-24T00:28:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:28:57.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 msgr2=0x7f613c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 0x7f613c061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f615c0adc70 tx=0x7f6144009040).stop 2023-10-24T00:28:57.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 msgr2=0x7f615c14aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:28:57.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f614c00e950 tx=0x7f614c009060).stop 2023-10-24T00:28:57.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 shutdown_connections 2023-10-24T00:28:57.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f615c0c6710 0x7f615c0ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f613c05f150 0x7f613c061610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f615c0aa010 0x7f615c14aa20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 --2- 172.21.15.148:0/2893105959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f615c0aa3f0 0x7f615c0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:28:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 >> 172.21.15.148:0/2893105959 conn(0x7f615c0caf40 msgr2=0x7f615c1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:28:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 shutdown_connections 2023-10-24T00:28:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:28:57.568+0000 7f6161afc700 1 -- 172.21.15.148:0/2893105959 wait complete. 2023-10-24T00:28:57.576 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:28:57.583 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-24T00:28:56.768779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378404,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596316,"statfs":{"total":773094113280,"available":770658627584,"internally_reserved":0,"allocated":1675264,"data_stored":598716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202675+0000","last_change":"2023-10-24T00:28:53.197457+0000","last_active":"2023-10-24T00:28:53.202675+0000","last_peered":"2023-10-24T00:28:53.202675+0000","last_clean":"2023-10-24T00:28:53.202675+0000","last_became_active":"2023-10-24T00:28:53.197181+0000","last_became_peered":"2023-10-24T00:28:53.197181+0000","last_unstale":"2023-10-24T00:28:53.202675+0000","last_undegraded":"2023-10-24T00:28:53.202675+0000","last_fullsized":"2023-10-24T00:28:53.202675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196253+0000","last_change":"2023-10-24T00:28:52.832585+0000","last_active":"2023-10-24T00:28:53.196253+0000","last_peered":"2023-10-24T00:28:53.196253+0000","last_clean":"2023-10-24T00:28:53.196253+0000","last_became_active":"2023-10-24T00:28:52.832304+0000","last_became_peered":"2023-10-24T00:28:52.832304+0000","last_unstale":"2023-10-24T00:28:53.196253+0000","last_undegraded":"2023-10-24T00:28:53.196253+0000","last_fullsized":"2023-10-24T00:28:53.196253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219117+0000","last_change":"2023-10-24T00:28:53.216919+0000","last_active":"2023-10-24T00:28:53.219117+0000","last_peered":"2023-10-24T00:28:53.219117+0000","last_clean":"2023-10-24T00:28:53.219117+0000","last_became_active":"2023-10-24T00:28:53.216644+0000","last_became_peered":"2023-10-24T00:28:53.216644+0000","last_unstale":"2023-10-24T00:28:53.219117+0000","last_undegraded":"2023-10-24T00:28:53.219117+0000","last_fullsized":"2023-10-24T00:28:53.219117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189038+0000","last_change":"2023-10-24T00:28:52.834106+0000","last_active":"2023-10-24T00:28:53.189038+0000","last_peered":"2023-10-24T00:28:53.189038+0000","last_clean":"2023-10-24T00:28:53.189038+0000","last_became_active":"2023-10-24T00:28:52.833861+0000","last_became_peered":"2023-10-24T00:28:52.833861+0000","last_unstale":"2023-10-24T00:28:53.189038+0000","last_undegraded":"2023-10-24T00:28:53.189038+0000","last_fullsized":"2023-10-24T00:28:53.189038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219445+0000","last_change":"2023-10-24T00:28:53.215329+0000","last_active":"2023-10-24T00:28:53.219445+0000","last_peered":"2023-10-24T00:28:53.219445+0000","last_clean":"2023-10-24T00:28:53.219445+0000","last_became_active":"2023-10-24T00:28:53.215054+0000","last_became_peered":"2023-10-24T00:28:53.215054+0000","last_unstale":"2023-10-24T00:28:53.219445+0000","last_undegraded":"2023-10-24T00:28:53.219445+0000","last_fullsized":"2023-10-24T00:28:53.219445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192190+0000","last_change":"2023-10-24T00:28:52.839855+0000","last_active":"2023-10-24T00:28:53.192190+0000","last_peered":"2023-10-24T00:28:53.192190+0000","last_clean":"2023-10-24T00:28:53.192190+0000","last_became_active":"2023-10-24T00:28:52.839642+0000","last_became_peered":"2023-10-24T00:28:52.839642+0000","last_unstale":"2023-10-24T00:28:53.192190+0000","last_undegraded":"2023-10-24T00:28:53.192190+0000","last_fullsized":"2023-10-24T00:28:53.192190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208075+0000","last_change":"2023-10-24T00:28:53.198164+0000","last_active":"2023-10-24T00:28:53.208075+0000","last_peered":"2023-10-24T00:28:53.208075+0000","last_clean":"2023-10-24T00:28:53.208075+0000","last_became_active":"2023-10-24T00:28:53.197880+0000","last_became_peered":"2023-10-24T00:28:53.197880+0000","last_unstale":"2023-10-24T00:28:53.208075+0000","last_undegraded":"2023-10-24T00:28:53.208075+0000","last_fullsized":"2023-10-24T00:28:53.208075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213801+0000","last_change":"2023-10-24T00:28:52.841842+0000","last_active":"2023-10-24T00:28:53.213801+0000","last_peered":"2023-10-24T00:28:53.213801+0000","last_clean":"2023-10-24T00:28:53.213801+0000","last_became_active":"2023-10-24T00:28:52.841497+0000","last_became_peered":"2023-10-24T00:28:52.841497+0000","last_unstale":"2023-10-24T00:28:53.213801+0000","last_undegraded":"2023-10-24T00:28:53.213801+0000","last_fullsized":"2023-10-24T00:28:53.213801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211799+0000","last_change":"2023-10-24T00:28:53.206480+0000","last_active":"2023-10-24T00:28:53.211799+0000","last_peered":"2023-10-24T00:28:53.211799+0000","last_clean":"2023-10-24T00:28:53.211799+0000","last_became_active":"2023-10-24T00:28:53.206200+0000","last_became_peered":"2023-10-24T00:28:53.206200+0000","last_unstale":"2023-10-24T00:28:53.211799+0000","last_undegraded":"2023-10-24T00:28:53.211799+0000","last_fullsized":"2023-10-24T00:28:53.211799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216889+0000","last_change":"2023-10-24T00:28:53.214654+0000","last_active":"2023-10-24T00:28:53.216889+0000","last_peered":"2023-10-24T00:28:53.216889+0000","last_clean":"2023-10-24T00:28:53.216889+0000","last_became_active":"2023-10-24T00:28:53.214391+0000","last_became_peered":"2023-10-24T00:28:53.214391+0000","last_unstale":"2023-10-24T00:28:53.216889+0000","last_undegraded":"2023-10-24T00:28:53.216889+0000","last_fullsized":"2023-10-24T00:28:53.216889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214442+0000","last_change":"2023-10-24T00:28:53.208856+0000","last_active":"2023-10-24T00:28:53.214442+0000","last_peered":"2023-10-24T00:28:53.214442+0000","last_clean":"2023-10-24T00:28:53.214442+0000","last_became_active":"2023-10-24T00:28:53.208588+0000","last_became_peered":"2023-10-24T00:28:53.208588+0000","last_unstale":"2023-10-24T00:28:53.214442+0000","last_undegraded":"2023-10-24T00:28:53.214442+0000","last_fullsized":"2023-10-24T00:28:53.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216976+0000","last_change":"2023-10-24T00:28:52.829502+0000","last_active":"2023-10-24T00:28:53.216976+0000","last_peered":"2023-10-24T00:28:53.216976+0000","last_clean":"2023-10-24T00:28:53.216976+0000","last_became_active":"2023-10-24T00:28:52.829097+0000","last_became_peered":"2023-10-24T00:28:52.829097+0000","last_unstale":"2023-10-24T00:28:53.216976+0000","last_undegraded":"2023-10-24T00:28:53.216976+0000","last_fullsized":"2023-10-24T00:28:53.216976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207273+0000","last_change":"2023-10-24T00:28:53.197597+0000","last_active":"2023-10-24T00:28:53.207273+0000","last_peered":"2023-10-24T00:28:53.207273+0000","last_clean":"2023-10-24T00:28:53.207273+0000","last_became_active":"2023-10-24T00:28:53.197328+0000","last_became_peered":"2023-10-24T00:28:53.197328+0000","last_unstale":"2023-10-24T00:28:53.207273+0000","last_undegraded":"2023-10-24T00:28:53.207273+0000","last_fullsized":"2023-10-24T00:28:53.207273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208421+0000","last_change":"2023-10-24T00:28:52.844225+0000","last_active":"2023-10-24T00:28:53.208421+0000","last_peered":"2023-10-24T00:28:53.208421+0000","last_clean":"2023-10-24T00:28:53.208421+0000","last_became_active":"2023-10-24T00:28:52.843751+0000","last_became_peered":"2023-10-24T00:28:52.843751+0000","last_unstale":"2023-10-24T00:28:53.208421+0000","last_undegraded":"2023-10-24T00:28:53.208421+0000","last_fullsized":"2023-10-24T00:28:53.208421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218875+0000","last_change":"2023-10-24T00:28:53.214994+0000","last_active":"2023-10-24T00:28:53.218875+0000","last_peered":"2023-10-24T00:28:53.218875+0000","last_clean":"2023-10-24T00:28:53.218875+0000","last_became_active":"2023-10-24T00:28:53.214737+0000","last_became_peered":"2023-10-24T00:28:53.214737+0000","last_unstale":"2023-10-24T00:28:53.218875+0000","last_undegraded":"2023-10-24T00:28:53.218875+0000","last_fullsized":"2023-10-24T00:28:53.218875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209960+0000","last_change":"2023-10-24T00:28:53.207217+0000","last_active":"2023-10-24T00:28:53.209960+0000","last_peered":"2023-10-24T00:28:53.209960+0000","last_clean":"2023-10-24T00:28:53.209960+0000","last_became_active":"2023-10-24T00:28:53.206965+0000","last_became_peered":"2023-10-24T00:28:53.206965+0000","last_unstale":"2023-10-24T00:28:53.209960+0000","last_undegraded":"2023-10-24T00:28:53.209960+0000","last_fullsized":"2023-10-24T00:28:53.209960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219384+0000","last_change":"2023-10-24T00:28:52.842202+0000","last_active":"2023-10-24T00:28:53.219384+0000","last_peered":"2023-10-24T00:28:53.219384+0000","last_clean":"2023-10-24T00:28:53.219384+0000","last_became_active":"2023-10-24T00:28:52.841831+0000","last_became_peered":"2023-10-24T00:28:52.841831+0000","last_unstale":"2023-10-24T00:28:53.219384+0000","last_undegraded":"2023-10-24T00:28:53.219384+0000","last_fullsized":"2023-10-24T00:28:53.219384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214085+0000","last_change":"2023-10-24T00:28:53.201055+0000","last_active":"2023-10-24T00:28:53.214085+0000","last_peered":"2023-10-24T00:28:53.214085+0000","last_clean":"2023-10-24T00:28:53.214085+0000","last_became_active":"2023-10-24T00:28:53.200779+0000","last_became_peered":"2023-10-24T00:28:53.200779+0000","last_unstale":"2023-10-24T00:28:53.214085+0000","last_undegraded":"2023-10-24T00:28:53.214085+0000","last_fullsized":"2023-10-24T00:28:53.214085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217556+0000","last_change":"2023-10-24T00:28:53.211199+0000","last_active":"2023-10-24T00:28:53.217556+0000","last_peered":"2023-10-24T00:28:53.217556+0000","last_clean":"2023-10-24T00:28:53.217556+0000","last_became_active":"2023-10-24T00:28:53.210886+0000","last_became_peered":"2023-10-24T00:28:53.210886+0000","last_unstale":"2023-10-24T00:28:53.217556+0000","last_undegraded":"2023-10-24T00:28:53.217556+0000","last_fullsized":"2023-10-24T00:28:53.217556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218827+0000","last_change":"2023-10-24T00:28:53.213828+0000","last_active":"2023-10-24T00:28:53.218827+0000","last_peered":"2023-10-24T00:28:53.218827+0000","last_clean":"2023-10-24T00:28:53.218827+0000","last_became_active":"2023-10-24T00:28:53.213506+0000","last_became_peered":"2023-10-24T00:28:53.213506+0000","last_unstale":"2023-10-24T00:28:53.218827+0000","last_undegraded":"2023-10-24T00:28:53.218827+0000","last_fullsized":"2023-10-24T00:28:53.218827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215542+0000","last_change":"2023-10-24T00:28:53.210526+0000","last_active":"2023-10-24T00:28:53.215542+0000","last_peered":"2023-10-24T00:28:53.215542+0000","last_clean":"2023-10-24T00:28:53.215542+0000","last_became_active":"2023-10-24T00:28:53.210295+0000","last_became_peered":"2023-10-24T00:28:53.210295+0000","last_unstale":"2023-10-24T00:28:53.215542+0000","last_undegraded":"2023-10-24T00:28:53.215542+0000","last_fullsized":"2023-10-24T00:28:53.215542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202449+0000","last_change":"2023-10-24T00:28:52.842949+0000","last_active":"2023-10-24T00:28:53.202449+0000","last_peered":"2023-10-24T00:28:53.202449+0000","last_clean":"2023-10-24T00:28:53.202449+0000","last_became_active":"2023-10-24T00:28:52.842488+0000","last_became_peered":"2023-10-24T00:28:52.842488+0000","last_unstale":"2023-10-24T00:28:53.202449+0000","last_undegraded":"2023-10-24T00:28:53.202449+0000","last_fullsized":"2023-10-24T00:28:53.202449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218240+0000","last_change":"2023-10-24T00:28:53.213761+0000","last_active":"2023-10-24T00:28:53.218240+0000","last_peered":"2023-10-24T00:28:53.218240+0000","last_clean":"2023-10-24T00:28:53.218240+0000","last_became_active":"2023-10-24T00:28:53.213457+0000","last_became_peered":"2023-10-24T00:28:53.213457+0000","last_unstale":"2023-10-24T00:28:53.218240+0000","last_undegraded":"2023-10-24T00:28:53.218240+0000","last_fullsized":"2023-10-24T00:28:53.218240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205989+0000","last_change":"2023-10-24T00:28:52.836396+0000","last_active":"2023-10-24T00:28:53.205989+0000","last_peered":"2023-10-24T00:28:53.205989+0000","last_clean":"2023-10-24T00:28:53.205989+0000","last_became_active":"2023-10-24T00:28:52.836110+0000","last_became_peered":"2023-10-24T00:28:52.836110+0000","last_unstale":"2023-10-24T00:28:53.205989+0000","last_undegraded":"2023-10-24T00:28:53.205989+0000","last_fullsized":"2023-10-24T00:28:53.205989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218040+0000","last_change":"2023-10-24T00:28:53.213383+0000","last_active":"2023-10-24T00:28:53.218040+0000","last_peered":"2023-10-24T00:28:53.218040+0000","last_clean":"2023-10-24T00:28:53.218040+0000","last_became_active":"2023-10-24T00:28:53.212809+0000","last_became_peered":"2023-10-24T00:28:53.212809+0000","last_unstale":"2023-10-24T00:28:53.218040+0000","last_undegraded":"2023-10-24T00:28:53.218040+0000","last_fullsized":"2023-10-24T00:28:53.218040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196651+0000","last_change":"2023-10-24T00:28:52.833221+0000","last_active":"2023-10-24T00:28:53.196651+0000","last_peered":"2023-10-24T00:28:53.196651+0000","last_clean":"2023-10-24T00:28:53.196651+0000","last_became_active":"2023-10-24T00:28:52.832941+0000","last_became_peered":"2023-10-24T00:28:52.832941+0000","last_unstale":"2023-10-24T00:28:53.196651+0000","last_undegraded":"2023-10-24T00:28:53.196651+0000","last_fullsized":"2023-10-24T00:28:53.196651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.201868+0000","last_change":"2023-10-24T00:28:53.197450+0000","last_active":"2023-10-24T00:28:53.201868+0000","last_peered":"2023-10-24T00:28:53.201868+0000","last_clean":"2023-10-24T00:28:53.201868+0000","last_became_active":"2023-10-24T00:28:53.197178+0000","last_became_peered":"2023-10-24T00:28:53.197178+0000","last_unstale":"2023-10-24T00:28:53.201868+0000","last_undegraded":"2023-10-24T00:28:53.201868+0000","last_fullsized":"2023-10-24T00:28:53.201868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.191976+0000","last_change":"2023-10-24T00:28:52.832101+0000","last_active":"2023-10-24T00:28:53.191976+0000","last_peered":"2023-10-24T00:28:53.191976+0000","last_clean":"2023-10-24T00:28:53.191976+0000","last_became_active":"2023-10-24T00:28:52.831799+0000","last_became_peered":"2023-10-24T00:28:52.831799+0000","last_unstale":"2023-10-24T00:28:53.191976+0000","last_undegraded":"2023-10-24T00:28:53.191976+0000","last_fullsized":"2023-10-24T00:28:53.191976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189164+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:53.189164+0000","last_peered":"2023-10-24T00:28:53.189164+0000","last_clean":"2023-10-24T00:28:53.189164+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:53.189164+0000","last_undegraded":"2023-10-24T00:28:53.189164+0000","last_fullsized":"2023-10-24T00:28:53.189164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215067+0000","last_change":"2023-10-24T00:28:53.212561+0000","last_active":"2023-10-24T00:28:53.215067+0000","last_peered":"2023-10-24T00:28:53.215067+0000","last_clean":"2023-10-24T00:28:53.215067+0000","last_became_active":"2023-10-24T00:28:53.212213+0000","last_became_peered":"2023-10-24T00:28:53.212213+0000","last_unstale":"2023-10-24T00:28:53.215067+0000","last_undegraded":"2023-10-24T00:28:53.215067+0000","last_fullsized":"2023-10-24T00:28:53.215067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.808396+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:48.808396+0000","last_peered":"2023-10-24T00:28:48.808396+0000","last_clean":"2023-10-24T00:28:48.808396+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:48.808396+0000","last_undegraded":"2023-10-24T00:28:48.808396+0000","last_fullsized":"2023-10-24T00:28:48.808396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196733+0000","last_change":"2023-10-24T00:28:52.841779+0000","last_active":"2023-10-24T00:28:53.196733+0000","last_peered":"2023-10-24T00:28:53.196733+0000","last_clean":"2023-10-24T00:28:53.196733+0000","last_became_active":"2023-10-24T00:28:52.841486+0000","last_became_peered":"2023-10-24T00:28:52.841486+0000","last_unstale":"2023-10-24T00:28:53.196733+0000","last_undegraded":"2023-10-24T00:28:53.196733+0000","last_fullsized":"2023-10-24T00:28:53.196733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202018+0000","last_change":"2023-10-24T00:28:53.198838+0000","last_active":"2023-10-24T00:28:53.202018+0000","last_peered":"2023-10-24T00:28:53.202018+0000","last_clean":"2023-10-24T00:28:53.202018+0000","last_became_active":"2023-10-24T00:28:53.198572+0000","last_became_peered":"2023-10-24T00:28:53.198572+0000","last_unstale":"2023-10-24T00:28:53.202018+0000","last_undegraded":"2023-10-24T00:28:53.202018+0000","last_fullsized":"2023-10-24T00:28:53.202018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218830+0000","last_change":"2023-10-24T00:28:53.215991+0000","last_active":"2023-10-24T00:28:53.218830+0000","last_peered":"2023-10-24T00:28:53.218830+0000","last_clean":"2023-10-24T00:28:53.218830+0000","last_became_active":"2023-10-24T00:28:53.215724+0000","last_became_peered":"2023-10-24T00:28:53.215724+0000","last_unstale":"2023-10-24T00:28:53.218830+0000","last_undegraded":"2023-10-24T00:28:53.218830+0000","last_fullsized":"2023-10-24T00:28:53.218830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.816160+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:48.816160+0000","last_peered":"2023-10-24T00:28:48.816160+0000","last_clean":"2023-10-24T00:28:48.816160+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:48.816160+0000","last_undegraded":"2023-10-24T00:28:48.816160+0000","last_fullsized":"2023-10-24T00:28:48.816160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189062+0000","last_change":"2023-10-24T00:28:52.836290+0000","last_active":"2023-10-24T00:28:53.189062+0000","last_peered":"2023-10-24T00:28:53.189062+0000","last_clean":"2023-10-24T00:28:53.189062+0000","last_became_active":"2023-10-24T00:28:52.836025+0000","last_became_peered":"2023-10-24T00:28:52.836025+0000","last_unstale":"2023-10-24T00:28:53.189062+0000","last_undegraded":"2023-10-24T00:28:53.189062+0000","last_fullsized":"2023-10-24T00:28:53.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219556+0000","last_change":"2023-10-24T00:28:53.216794+0000","last_active":"2023-10-24T00:28:53.219556+0000","last_peered":"2023-10-24T00:28:53.219556+0000","last_clean":"2023-10-24T00:28:53.219556+0000","last_became_active":"2023-10-24T00:28:53.216522+0000","last_became_peered":"2023-10-24T00:28:53.216522+0000","last_unstale":"2023-10-24T00:28:53.219556+0000","last_undegraded":"2023-10-24T00:28:53.219556+0000","last_fullsized":"2023-10-24T00:28:53.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.817408+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:48.817408+0000","last_peered":"2023-10-24T00:28:48.817408+0000","last_clean":"2023-10-24T00:28:48.817408+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:48.817408+0000","last_undegraded":"2023-10-24T00:28:48.817408+0000","last_fullsized":"2023-10-24T00:28:48.817408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.801645+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:48.801645+0000","last_peered":"2023-10-24T00:28:48.801645+0000","last_clean":"2023-10-24T00:28:48.801645+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:48.801645+0000","last_undegraded":"2023-10-24T00:28:48.801645+0000","last_fullsized":"2023-10-24T00:28:48.801645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192193+0000","last_change":"2023-10-24T00:28:52.835633+0000","last_active":"2023-10-24T00:28:53.192193+0000","last_peered":"2023-10-24T00:28:53.192193+0000","last_clean":"2023-10-24T00:28:53.192193+0000","last_became_active":"2023-10-24T00:28:52.833208+0000","last_became_peered":"2023-10-24T00:28:52.833208+0000","last_unstale":"2023-10-24T00:28:53.192193+0000","last_undegraded":"2023-10-24T00:28:53.192193+0000","last_fullsized":"2023-10-24T00:28:53.192193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218638+0000","last_change":"2023-10-24T00:28:53.213575+0000","last_active":"2023-10-24T00:28:53.218638+0000","last_peered":"2023-10-24T00:28:53.218638+0000","last_clean":"2023-10-24T00:28:53.218638+0000","last_became_active":"2023-10-24T00:28:53.209567+0000","last_became_peered":"2023-10-24T00:28:53.209567+0000","last_unstale":"2023-10-24T00:28:53.218638+0000","last_undegraded":"2023-10-24T00:28:53.218638+0000","last_fullsized":"2023-10-24T00:28:53.218638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:48.811277+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:48.811277+0000","last_peered":"2023-10-24T00:28:48.811277+0000","last_clean":"2023-10-24T00:28:48.811277+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:48.811277+0000","last_undegraded":"2023-10-24T00:28:48.811277+0000","last_fullsized":"2023-10-24T00:28:48.811277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205869+0000","last_change":"2023-10-24T00:28:52.840006+0000","last_active":"2023-10-24T00:28:53.205869+0000","last_peered":"2023-10-24T00:28:53.205869+0000","last_clean":"2023-10-24T00:28:53.205869+0000","last_became_active":"2023-10-24T00:28:52.839452+0000","last_became_peered":"2023-10-24T00:28:52.839452+0000","last_unstale":"2023-10-24T00:28:53.205869+0000","last_undegraded":"2023-10-24T00:28:53.205869+0000","last_fullsized":"2023-10-24T00:28:53.205869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-24T00:28:49.687518+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:49.687518+0000","last_peered":"2023-10-24T00:28:49.687518+0000","last_clean":"2023-10-24T00:28:49.687518+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:49.687518+0000","last_undegraded":"2023-10-24T00:28:49.687518+0000","last_fullsized":"2023-10-24T00:28:49.687518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189581+0000","last_change":"2023-10-24T00:28:52.832876+0000","last_active":"2023-10-24T00:28:53.189581+0000","last_peered":"2023-10-24T00:28:53.189581+0000","last_clean":"2023-10-24T00:28:53.189581+0000","last_became_active":"2023-10-24T00:28:52.832617+0000","last_became_peered":"2023-10-24T00:28:52.832617+0000","last_unstale":"2023-10-24T00:28:53.189581+0000","last_undegraded":"2023-10-24T00:28:53.189581+0000","last_fullsized":"2023-10-24T00:28:53.189581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219158+0000","last_change":"2023-10-24T00:28:53.217199+0000","last_active":"2023-10-24T00:28:53.219158+0000","last_peered":"2023-10-24T00:28:53.219158+0000","last_clean":"2023-10-24T00:28:53.219158+0000","last_became_active":"2023-10-24T00:28:53.216879+0000","last_became_peered":"2023-10-24T00:28:53.216879+0000","last_unstale":"2023-10-24T00:28:53.219158+0000","last_undegraded":"2023-10-24T00:28:53.219158+0000","last_fullsized":"2023-10-24T00:28:53.219158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207465+0000","last_change":"2023-10-24T00:28:52.831240+0000","last_active":"2023-10-24T00:28:53.207465+0000","last_peered":"2023-10-24T00:28:53.207465+0000","last_clean":"2023-10-24T00:28:53.207465+0000","last_became_active":"2023-10-24T00:28:52.830998+0000","last_became_peered":"2023-10-24T00:28:52.830998+0000","last_unstale":"2023-10-24T00:28:53.207465+0000","last_undegraded":"2023-10-24T00:28:53.207465+0000","last_fullsized":"2023-10-24T00:28:53.207465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189430+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:53.189430+0000","last_peered":"2023-10-24T00:28:53.189430+0000","last_clean":"2023-10-24T00:28:53.189430+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:53.189430+0000","last_undegraded":"2023-10-24T00:28:53.189430+0000","last_fullsized":"2023-10-24T00:28:53.189430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210569+0000","last_change":"2023-10-24T00:28:53.207984+0000","last_active":"2023-10-24T00:28:53.210569+0000","last_peered":"2023-10-24T00:28:53.210569+0000","last_clean":"2023-10-24T00:28:53.210569+0000","last_became_active":"2023-10-24T00:28:53.206306+0000","last_became_peered":"2023-10-24T00:28:53.206306+0000","last_unstale":"2023-10-24T00:28:53.210569+0000","last_undegraded":"2023-10-24T00:28:53.210569+0000","last_fullsized":"2023-10-24T00:28:53.210569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204049+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:53.204049+0000","last_peered":"2023-10-24T00:28:53.204049+0000","last_clean":"2023-10-24T00:28:53.204049+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:53.204049+0000","last_undegraded":"2023-10-24T00:28:53.204049+0000","last_fullsized":"2023-10-24T00:28:53.204049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213765+0000","last_change":"2023-10-24T00:28:52.845874+0000","last_active":"2023-10-24T00:28:53.213765+0000","last_peered":"2023-10-24T00:28:53.213765+0000","last_clean":"2023-10-24T00:28:53.213765+0000","last_became_active":"2023-10-24T00:28:52.845615+0000","last_became_peered":"2023-10-24T00:28:52.845615+0000","last_unstale":"2023-10-24T00:28:53.213765+0000","last_undegraded":"2023-10-24T00:28:53.213765+0000","last_fullsized":"2023-10-24T00:28:53.213765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217693+0000","last_change":"2023-10-24T00:28:53.212953+0000","last_active":"2023-10-24T00:28:53.217693+0000","last_peered":"2023-10-24T00:28:53.217693+0000","last_clean":"2023-10-24T00:28:53.217693+0000","last_became_active":"2023-10-24T00:28:53.212744+0000","last_became_peered":"2023-10-24T00:28:53.212744+0000","last_unstale":"2023-10-24T00:28:53.217693+0000","last_undegraded":"2023-10-24T00:28:53.217693+0000","last_fullsized":"2023-10-24T00:28:53.217693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209326+0000","last_change":"2023-10-24T00:28:52.841438+0000","last_active":"2023-10-24T00:28:53.209326+0000","last_peered":"2023-10-24T00:28:53.209326+0000","last_clean":"2023-10-24T00:28:53.209326+0000","last_became_active":"2023-10-24T00:28:52.840737+0000","last_became_peered":"2023-10-24T00:28:52.840737+0000","last_unstale":"2023-10-24T00:28:53.209326+0000","last_undegraded":"2023-10-24T00:28:53.209326+0000","last_fullsized":"2023-10-24T00:28:53.209326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221285+0000","last_change":"2023-10-24T00:28:53.214566+0000","last_active":"2023-10-24T00:28:53.221285+0000","last_peered":"2023-10-24T00:28:53.221285+0000","last_clean":"2023-10-24T00:28:53.221285+0000","last_became_active":"2023-10-24T00:28:53.213861+0000","last_became_peered":"2023-10-24T00:28:53.213861+0000","last_unstale":"2023-10-24T00:28:53.221285+0000","last_undegraded":"2023-10-24T00:28:53.221285+0000","last_fullsized":"2023-10-24T00:28:53.221285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214867+0000","last_change":"2023-10-24T00:28:53.202586+0000","last_active":"2023-10-24T00:28:53.214867+0000","last_peered":"2023-10-24T00:28:53.214867+0000","last_clean":"2023-10-24T00:28:53.214867+0000","last_became_active":"2023-10-24T00:28:53.202224+0000","last_became_peered":"2023-10-24T00:28:53.202224+0000","last_unstale":"2023-10-24T00:28:53.214867+0000","last_undegraded":"2023-10-24T00:28:53.214867+0000","last_fullsized":"2023-10-24T00:28:53.214867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211781+0000","last_change":"2023-10-24T00:28:53.198873+0000","last_active":"2023-10-24T00:28:53.211781+0000","last_peered":"2023-10-24T00:28:53.211781+0000","last_clean":"2023-10-24T00:28:53.211781+0000","last_became_active":"2023-10-24T00:28:53.198630+0000","last_became_peered":"2023-10-24T00:28:53.198630+0000","last_unstale":"2023-10-24T00:28:53.211781+0000","last_undegraded":"2023-10-24T00:28:53.211781+0000","last_fullsized":"2023-10-24T00:28:53.211781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203535+0000","last_change":"2023-10-24T00:28:52.830907+0000","last_active":"2023-10-24T00:28:53.203535+0000","last_peered":"2023-10-24T00:28:53.203535+0000","last_clean":"2023-10-24T00:28:53.203535+0000","last_became_active":"2023-10-24T00:28:52.830585+0000","last_became_peered":"2023-10-24T00:28:52.830585+0000","last_unstale":"2023-10-24T00:28:53.203535+0000","last_undegraded":"2023-10-24T00:28:53.203535+0000","last_fullsized":"2023-10-24T00:28:53.203535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214428+0000","last_change":"2023-10-24T00:28:53.207126+0000","last_active":"2023-10-24T00:28:53.214428+0000","last_peered":"2023-10-24T00:28:53.214428+0000","last_clean":"2023-10-24T00:28:53.214428+0000","last_became_active":"2023-10-24T00:28:53.206860+0000","last_became_peered":"2023-10-24T00:28:53.206860+0000","last_unstale":"2023-10-24T00:28:53.214428+0000","last_undegraded":"2023-10-24T00:28:53.214428+0000","last_fullsized":"2023-10-24T00:28:53.214428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219605+0000","last_change":"2023-10-24T00:28:52.839828+0000","last_active":"2023-10-24T00:28:53.219605+0000","last_peered":"2023-10-24T00:28:53.219605+0000","last_clean":"2023-10-24T00:28:53.219605+0000","last_became_active":"2023-10-24T00:28:52.839501+0000","last_became_peered":"2023-10-24T00:28:52.839501+0000","last_unstale":"2023-10-24T00:28:53.219605+0000","last_undegraded":"2023-10-24T00:28:53.219605+0000","last_fullsized":"2023-10-24T00:28:53.219605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208863+0000","last_change":"2023-10-24T00:28:53.207780+0000","last_active":"2023-10-24T00:28:53.208863+0000","last_peered":"2023-10-24T00:28:53.208863+0000","last_clean":"2023-10-24T00:28:53.208863+0000","last_became_active":"2023-10-24T00:28:53.207543+0000","last_became_peered":"2023-10-24T00:28:53.207543+0000","last_unstale":"2023-10-24T00:28:53.208863+0000","last_undegraded":"2023-10-24T00:28:53.208863+0000","last_fullsized":"2023-10-24T00:28:53.208863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202990+0000","last_change":"2023-10-24T00:28:52.841865+0000","last_active":"2023-10-24T00:28:53.202990+0000","last_peered":"2023-10-24T00:28:53.202990+0000","last_clean":"2023-10-24T00:28:53.202990+0000","last_became_active":"2023-10-24T00:28:52.841563+0000","last_became_peered":"2023-10-24T00:28:52.841563+0000","last_unstale":"2023-10-24T00:28:53.202990+0000","last_undegraded":"2023-10-24T00:28:53.202990+0000","last_fullsized":"2023-10-24T00:28:53.202990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210510+0000","last_change":"2023-10-24T00:28:53.209114+0000","last_active":"2023-10-24T00:28:53.210510+0000","last_peered":"2023-10-24T00:28:53.210510+0000","last_clean":"2023-10-24T00:28:53.210510+0000","last_became_active":"2023-10-24T00:28:53.208807+0000","last_became_peered":"2023-10-24T00:28:53.208807+0000","last_unstale":"2023-10-24T00:28:53.210510+0000","last_undegraded":"2023-10-24T00:28:53.210510+0000","last_fullsized":"2023-10-24T00:28:53.210510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214864+0000","last_change":"2023-10-24T00:28:53.211252+0000","last_active":"2023-10-24T00:28:53.214864+0000","last_peered":"2023-10-24T00:28:53.214864+0000","last_clean":"2023-10-24T00:28:53.214864+0000","last_became_active":"2023-10-24T00:28:53.210970+0000","last_became_peered":"2023-10-24T00:28:53.210970+0000","last_unstale":"2023-10-24T00:28:53.214864+0000","last_undegraded":"2023-10-24T00:28:53.214864+0000","last_fullsized":"2023-10-24T00:28:53.214864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206180+0000","last_change":"2023-10-24T00:28:52.841793+0000","last_active":"2023-10-24T00:28:53.206180+0000","last_peered":"2023-10-24T00:28:53.206180+0000","last_clean":"2023-10-24T00:28:53.206180+0000","last_became_active":"2023-10-24T00:28:52.841487+0000","last_became_peered":"2023-10-24T00:28:52.841487+0000","last_unstale":"2023-10-24T00:28:53.206180+0000","last_undegraded":"2023-10-24T00:28:53.206180+0000","last_fullsized":"2023-10-24T00:28:53.206180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210735+0000","last_change":"2023-10-24T00:28:53.208115+0000","last_active":"2023-10-24T00:28:53.210735+0000","last_peered":"2023-10-24T00:28:53.210735+0000","last_clean":"2023-10-24T00:28:53.210735+0000","last_became_active":"2023-10-24T00:28:53.207329+0000","last_became_peered":"2023-10-24T00:28:53.207329+0000","last_unstale":"2023-10-24T00:28:53.210735+0000","last_undegraded":"2023-10-24T00:28:53.210735+0000","last_fullsized":"2023-10-24T00:28:53.210735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195405+0000","last_change":"2023-10-24T00:28:52.833047+0000","last_active":"2023-10-24T00:28:53.195405+0000","last_peered":"2023-10-24T00:28:53.195405+0000","last_clean":"2023-10-24T00:28:53.195405+0000","last_became_active":"2023-10-24T00:28:52.832806+0000","last_became_peered":"2023-10-24T00:28:52.832806+0000","last_unstale":"2023-10-24T00:28:53.195405+0000","last_undegraded":"2023-10-24T00:28:53.195405+0000","last_fullsized":"2023-10-24T00:28:53.195405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221263+0000","last_change":"2023-10-24T00:28:53.214374+0000","last_active":"2023-10-24T00:28:53.221263+0000","last_peered":"2023-10-24T00:28:53.221263+0000","last_clean":"2023-10-24T00:28:53.221263+0000","last_became_active":"2023-10-24T00:28:53.214029+0000","last_became_peered":"2023-10-24T00:28:53.214029+0000","last_unstale":"2023-10-24T00:28:53.221263+0000","last_undegraded":"2023-10-24T00:28:53.221263+0000","last_fullsized":"2023-10-24T00:28:53.221263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189999+0000","last_change":"2023-10-24T00:28:52.831478+0000","last_active":"2023-10-24T00:28:53.189999+0000","last_peered":"2023-10-24T00:28:53.189999+0000","last_clean":"2023-10-24T00:28:53.189999+0000","last_became_active":"2023-10-24T00:28:52.831185+0000","last_became_peered":"2023-10-24T00:28:52.831185+0000","last_unstale":"2023-10-24T00:28:53.189999+0000","last_undegraded":"2023-10-24T00:28:53.189999+0000","last_fullsized":"2023-10-24T00:28:53.189999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203515+0000","last_change":"2023-10-24T00:28:53.197544+0000","last_active":"2023-10-24T00:28:53.203515+0000","last_peered":"2023-10-24T00:28:53.203515+0000","last_clean":"2023-10-24T00:28:53.203515+0000","last_became_active":"2023-10-24T00:28:53.197271+0000","last_became_peered":"2023-10-24T00:28:53.197271+0000","last_unstale":"2023-10-24T00:28:53.203515+0000","last_undegraded":"2023-10-24T00:28:53.203515+0000","last_fullsized":"2023-10-24T00:28:53.203515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203411+0000","last_change":"2023-10-24T00:28:52.835770+0000","last_active":"2023-10-24T00:28:53.203411+0000","last_peered":"2023-10-24T00:28:53.203411+0000","last_clean":"2023-10-24T00:28:53.203411+0000","last_became_active":"2023-10-24T00:28:52.835495+0000","last_became_peered":"2023-10-24T00:28:52.835495+0000","last_unstale":"2023-10-24T00:28:53.203411+0000","last_undegraded":"2023-10-24T00:28:53.203411+0000","last_fullsized":"2023-10-24T00:28:53.203411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216732+0000","last_change":"2023-10-24T00:28:53.210440+0000","last_active":"2023-10-24T00:28:53.216732+0000","last_peered":"2023-10-24T00:28:53.216732+0000","last_clean":"2023-10-24T00:28:53.216732+0000","last_became_active":"2023-10-24T00:28:53.210153+0000","last_became_peered":"2023-10-24T00:28:53.210153+0000","last_unstale":"2023-10-24T00:28:53.216732+0000","last_undegraded":"2023-10-24T00:28:53.216732+0000","last_fullsized":"2023-10-24T00:28:53.216732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195686+0000","last_change":"2023-10-24T00:28:52.834627+0000","last_active":"2023-10-24T00:28:53.195686+0000","last_peered":"2023-10-24T00:28:53.195686+0000","last_clean":"2023-10-24T00:28:53.195686+0000","last_became_active":"2023-10-24T00:28:52.834319+0000","last_became_peered":"2023-10-24T00:28:52.834319+0000","last_unstale":"2023-10-24T00:28:53.195686+0000","last_undegraded":"2023-10-24T00:28:53.195686+0000","last_fullsized":"2023-10-24T00:28:53.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218902+0000","last_change":"2023-10-24T00:28:53.215043+0000","last_active":"2023-10-24T00:28:53.218902+0000","last_peered":"2023-10-24T00:28:53.218902+0000","last_clean":"2023-10-24T00:28:53.218902+0000","last_became_active":"2023-10-24T00:28:53.214443+0000","last_became_peered":"2023-10-24T00:28:53.214443+0000","last_unstale":"2023-10-24T00:28:53.218902+0000","last_undegraded":"2023-10-24T00:28:53.218902+0000","last_fullsized":"2023-10-24T00:28:53.218902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218060+0000","last_change":"2023-10-24T00:28:53.213561+0000","last_active":"2023-10-24T00:28:53.218060+0000","last_peered":"2023-10-24T00:28:53.218060+0000","last_clean":"2023-10-24T00:28:53.218060+0000","last_became_active":"2023-10-24T00:28:53.213113+0000","last_became_peered":"2023-10-24T00:28:53.213113+0000","last_unstale":"2023-10-24T00:28:53.218060+0000","last_undegraded":"2023-10-24T00:28:53.218060+0000","last_fullsized":"2023-10-24T00:28:53.218060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.193241+0000","last_change":"2023-10-24T00:28:52.836152+0000","last_active":"2023-10-24T00:28:53.193241+0000","last_peered":"2023-10-24T00:28:53.193241+0000","last_clean":"2023-10-24T00:28:53.193241+0000","last_became_active":"2023-10-24T00:28:52.835876+0000","last_became_peered":"2023-10-24T00:28:52.835876+0000","last_unstale":"2023-10-24T00:28:53.193241+0000","last_undegraded":"2023-10-24T00:28:53.193241+0000","last_fullsized":"2023-10-24T00:28:53.193241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221391+0000","last_change":"2023-10-24T00:28:53.215101+0000","last_active":"2023-10-24T00:28:53.221391+0000","last_peered":"2023-10-24T00:28:53.221391+0000","last_clean":"2023-10-24T00:28:53.221391+0000","last_became_active":"2023-10-24T00:28:53.214824+0000","last_became_peered":"2023-10-24T00:28:53.214824+0000","last_unstale":"2023-10-24T00:28:53.221391+0000","last_undegraded":"2023-10-24T00:28:53.221391+0000","last_fullsized":"2023-10-24T00:28:53.221391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.220171+0000","last_change":"2023-10-24T00:28:52.841688+0000","last_active":"2023-10-24T00:28:53.220171+0000","last_peered":"2023-10-24T00:28:53.220171+0000","last_clean":"2023-10-24T00:28:53.220171+0000","last_became_active":"2023-10-24T00:28:52.841119+0000","last_became_peered":"2023-10-24T00:28:52.841119+0000","last_unstale":"2023-10-24T00:28:53.220171+0000","last_undegraded":"2023-10-24T00:28:53.220171+0000","last_fullsized":"2023-10-24T00:28:53.220171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206514+0000","last_change":"2023-10-24T00:28:52.837080+0000","last_active":"2023-10-24T00:28:53.206514+0000","last_peered":"2023-10-24T00:28:53.206514+0000","last_clean":"2023-10-24T00:28:53.206514+0000","last_became_active":"2023-10-24T00:28:52.836776+0000","last_became_peered":"2023-10-24T00:28:52.836776+0000","last_unstale":"2023-10-24T00:28:53.206514+0000","last_undegraded":"2023-10-24T00:28:53.206514+0000","last_fullsized":"2023-10-24T00:28:53.206514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218929+0000","last_change":"2023-10-24T00:28:53.216046+0000","last_active":"2023-10-24T00:28:53.218929+0000","last_peered":"2023-10-24T00:28:53.218929+0000","last_clean":"2023-10-24T00:28:53.218929+0000","last_became_active":"2023-10-24T00:28:53.213450+0000","last_became_peered":"2023-10-24T00:28:53.213450+0000","last_unstale":"2023-10-24T00:28:53.218929+0000","last_undegraded":"2023-10-24T00:28:53.218929+0000","last_fullsized":"2023-10-24T00:28:53.218929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211818+0000","last_change":"2023-10-24T00:28:53.208010+0000","last_active":"2023-10-24T00:28:53.211818+0000","last_peered":"2023-10-24T00:28:53.211818+0000","last_clean":"2023-10-24T00:28:53.211818+0000","last_became_active":"2023-10-24T00:28:53.207747+0000","last_became_peered":"2023-10-24T00:28:53.207747+0000","last_unstale":"2023-10-24T00:28:53.211818+0000","last_undegraded":"2023-10-24T00:28:53.211818+0000","last_fullsized":"2023-10-24T00:28:53.211818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218923+0000","last_change":"2023-10-24T00:28:53.215218+0000","last_active":"2023-10-24T00:28:53.218923+0000","last_peered":"2023-10-24T00:28:53.218923+0000","last_clean":"2023-10-24T00:28:53.218923+0000","last_became_active":"2023-10-24T00:28:53.214775+0000","last_became_peered":"2023-10-24T00:28:53.214775+0000","last_unstale":"2023-10-24T00:28:53.218923+0000","last_undegraded":"2023-10-24T00:28:53.218923+0000","last_fullsized":"2023-10-24T00:28:53.218923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189036+0000","last_change":"2023-10-24T00:28:52.830798+0000","last_active":"2023-10-24T00:28:53.189036+0000","last_peered":"2023-10-24T00:28:53.189036+0000","last_clean":"2023-10-24T00:28:53.189036+0000","last_became_active":"2023-10-24T00:28:52.830499+0000","last_became_peered":"2023-10-24T00:28:52.830499+0000","last_unstale":"2023-10-24T00:28:53.189036+0000","last_undegraded":"2023-10-24T00:28:53.189036+0000","last_fullsized":"2023-10-24T00:28:53.189036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221123+0000","last_change":"2023-10-24T00:28:53.214273+0000","last_active":"2023-10-24T00:28:53.221123+0000","last_peered":"2023-10-24T00:28:53.221123+0000","last_clean":"2023-10-24T00:28:53.221123+0000","last_became_active":"2023-10-24T00:28:53.213976+0000","last_became_peered":"2023-10-24T00:28:53.213976+0000","last_unstale":"2023-10-24T00:28:53.221123+0000","last_undegraded":"2023-10-24T00:28:53.221123+0000","last_fullsized":"2023-10-24T00:28:53.221123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208529+0000","last_change":"2023-10-24T00:28:52.844073+0000","last_active":"2023-10-24T00:28:53.208529+0000","last_peered":"2023-10-24T00:28:53.208529+0000","last_clean":"2023-10-24T00:28:53.208529+0000","last_became_active":"2023-10-24T00:28:52.843728+0000","last_became_peered":"2023-10-24T00:28:52.843728+0000","last_unstale":"2023-10-24T00:28:53.208529+0000","last_undegraded":"2023-10-24T00:28:53.208529+0000","last_fullsized":"2023-10-24T00:28:53.208529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204197+0000","last_change":"2023-10-24T00:28:52.831728+0000","last_active":"2023-10-24T00:28:53.204197+0000","last_peered":"2023-10-24T00:28:53.204197+0000","last_clean":"2023-10-24T00:28:53.204197+0000","last_became_active":"2023-10-24T00:28:52.831431+0000","last_became_peered":"2023-10-24T00:28:52.831431+0000","last_unstale":"2023-10-24T00:28:53.204197+0000","last_undegraded":"2023-10-24T00:28:53.204197+0000","last_fullsized":"2023-10-24T00:28:53.204197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221459+0000","last_change":"2023-10-24T00:28:52.830036+0000","last_active":"2023-10-24T00:28:53.221459+0000","last_peered":"2023-10-24T00:28:53.221459+0000","last_clean":"2023-10-24T00:28:53.221459+0000","last_became_active":"2023-10-24T00:28:52.829705+0000","last_became_peered":"2023-10-24T00:28:52.829705+0000","last_unstale":"2023-10-24T00:28:53.221459+0000","last_undegraded":"2023-10-24T00:28:53.221459+0000","last_fullsized":"2023-10-24T00:28:53.221459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206210+0000","last_change":"2023-10-24T00:28:52.834788+0000","last_active":"2023-10-24T00:28:53.206210+0000","last_peered":"2023-10-24T00:28:53.206210+0000","last_clean":"2023-10-24T00:28:53.206210+0000","last_became_active":"2023-10-24T00:28:52.834521+0000","last_became_peered":"2023-10-24T00:28:52.834521+0000","last_unstale":"2023-10-24T00:28:53.206210+0000","last_undegraded":"2023-10-24T00:28:53.206210+0000","last_fullsized":"2023-10-24T00:28:53.206210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203299+0000","last_change":"2023-10-24T00:28:52.834186+0000","last_active":"2023-10-24T00:28:53.203299+0000","last_peered":"2023-10-24T00:28:53.203299+0000","last_clean":"2023-10-24T00:28:53.203299+0000","last_became_active":"2023-10-24T00:28:52.833901+0000","last_became_peered":"2023-10-24T00:28:52.833901+0000","last_unstale":"2023-10-24T00:28:53.203299+0000","last_undegraded":"2023-10-24T00:28:53.203299+0000","last_fullsized":"2023-10-24T00:28:53.203299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214448+0000","last_change":"2023-10-24T00:28:53.210483+0000","last_active":"2023-10-24T00:28:53.214448+0000","last_peered":"2023-10-24T00:28:53.214448+0000","last_clean":"2023-10-24T00:28:53.214448+0000","last_became_active":"2023-10-24T00:28:53.210273+0000","last_became_peered":"2023-10-24T00:28:53.210273+0000","last_unstale":"2023-10-24T00:28:53.214448+0000","last_undegraded":"2023-10-24T00:28:53.214448+0000","last_fullsized":"2023-10-24T00:28:53.214448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192091+0000","last_change":"2023-10-24T00:28:52.834616+0000","last_active":"2023-10-24T00:28:53.192091+0000","last_peered":"2023-10-24T00:28:53.192091+0000","last_clean":"2023-10-24T00:28:53.192091+0000","last_became_active":"2023-10-24T00:28:52.834139+0000","last_became_peered":"2023-10-24T00:28:52.834139+0000","last_unstale":"2023-10-24T00:28:53.192091+0000","last_undegraded":"2023-10-24T00:28:53.192091+0000","last_fullsized":"2023-10-24T00:28:53.192091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221422+0000","last_change":"2023-10-24T00:28:53.215705+0000","last_active":"2023-10-24T00:28:53.221422+0000","last_peered":"2023-10-24T00:28:53.221422+0000","last_clean":"2023-10-24T00:28:53.221422+0000","last_became_active":"2023-10-24T00:28:53.214840+0000","last_became_peered":"2023-10-24T00:28:53.214840+0000","last_unstale":"2023-10-24T00:28:53.221422+0000","last_undegraded":"2023-10-24T00:28:53.221422+0000","last_fullsized":"2023-10-24T00:28:53.221422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221438+0000","last_change":"2023-10-24T00:28:53.219279+0000","last_active":"2023-10-24T00:28:53.221438+0000","last_peered":"2023-10-24T00:28:53.221438+0000","last_clean":"2023-10-24T00:28:53.221438+0000","last_became_active":"2023-10-24T00:28:53.218946+0000","last_became_peered":"2023-10-24T00:28:53.218946+0000","last_unstale":"2023-10-24T00:28:53.221438+0000","last_undegraded":"2023-10-24T00:28:53.221438+0000","last_fullsized":"2023-10-24T00:28:53.221438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219137+0000","last_change":"2023-10-24T00:28:53.217100+0000","last_active":"2023-10-24T00:28:53.219137+0000","last_peered":"2023-10-24T00:28:53.219137+0000","last_clean":"2023-10-24T00:28:53.219137+0000","last_became_active":"2023-10-24T00:28:53.216532+0000","last_became_peered":"2023-10-24T00:28:53.216532+0000","last_unstale":"2023-10-24T00:28:53.219137+0000","last_undegraded":"2023-10-24T00:28:53.219137+0000","last_fullsized":"2023-10-24T00:28:53.219137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.223749+0000","last_change":"2023-10-24T00:28:53.217865+0000","last_active":"2023-10-24T00:28:53.223749+0000","last_peered":"2023-10-24T00:28:53.223749+0000","last_clean":"2023-10-24T00:28:53.223749+0000","last_became_active":"2023-10-24T00:28:53.217135+0000","last_became_peered":"2023-10-24T00:28:53.217135+0000","last_unstale":"2023-10-24T00:28:53.223749+0000","last_undegraded":"2023-10-24T00:28:53.223749+0000","last_fullsized":"2023-10-24T00:28:53.223749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206256+0000","last_change":"2023-10-24T00:28:52.839792+0000","last_active":"2023-10-24T00:28:53.206256+0000","last_peered":"2023-10-24T00:28:53.206256+0000","last_clean":"2023-10-24T00:28:53.206256+0000","last_became_active":"2023-10-24T00:28:52.839474+0000","last_became_peered":"2023-10-24T00:28:52.839474+0000","last_unstale":"2023-10-24T00:28:53.206256+0000","last_undegraded":"2023-10-24T00:28:53.206256+0000","last_fullsized":"2023-10-24T00:28:53.206256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189600+0000","last_change":"2023-10-24T00:28:52.846124+0000","last_active":"2023-10-24T00:28:53.189600+0000","last_peered":"2023-10-24T00:28:53.189600+0000","last_clean":"2023-10-24T00:28:53.189600+0000","last_became_active":"2023-10-24T00:28:52.845781+0000","last_became_peered":"2023-10-24T00:28:52.845781+0000","last_unstale":"2023-10-24T00:28:53.189600+0000","last_undegraded":"2023-10-24T00:28:53.189600+0000","last_fullsized":"2023-10-24T00:28:53.189600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:52.808484+0000","last_change":"2023-10-24T00:28:52.808484+0000","last_active":"2023-10-24T00:28:52.808484+0000","last_peered":"2023-10-24T00:28:52.808484+0000","last_clean":"2023-10-24T00:28:52.808484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:52.808484+0000","last_undegraded":"2023-10-24T00:28:52.808484+0000","last_fullsized":"2023-10-24T00:28:52.808484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:28:51.806735+0000","last_change":"2023-10-24T00:28:51.806735+0000","last_active":"2023-10-24T00:28:51.806735+0000","last_peered":"2023-10-24T00:28:51.806735+0000","last_clean":"2023-10-24T00:28:51.806735+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:28:51.806735+0000","last_undegraded":"2023-10-24T00:28:51.806735+0000","last_fullsized":"2023-10-24T00:28:51.806735+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":5},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":78,"acting":78,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":52635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":86809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":86663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":58434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:28:59.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:28:59.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:29:00.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:00.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.715+0000 7ff8896e6700 1 Processor -- start 2023-10-24T00:29:00.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.715+0000 7ff8896e6700 1 -- start start 2023-10-24T00:29:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.715+0000 7ff8896e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 0x7ff8840c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.715+0000 7ff8896e6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8840aa3f0 0x7ff884069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.715+0000 7ff8896e6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840aa820 con 0x7ff8840aa010 2023-10-24T00:29:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8896e6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840c0960 con 0x7ff8840aa3f0 2023-10-24T00:29:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8896e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840c0c40 con 0x7ff8840c6710 2023-10-24T00:29:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8840aa3f0 0x7ff884069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff882ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff8840aa010 0x7ff884158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45678/0 (socket says 172.21.15.148:45678) 2023-10-24T00:29:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff882ffd700 1 -- 172.21.15.148:0/451503052 learned_addr learned my addr 172.21.15.148:0/451503052 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8827fc700 1 --2- 172.21.15.148:0/451503052 >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 0x7ff8840c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 -- 172.21.15.148:0/451503052 >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 msgr2=0x7ff8840c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 --2- 172.21.15.148:0/451503052 >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 0x7ff8840c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 -- 172.21.15.148:0/451503052 >> v1:172.21.15.148:6789/0 conn(0x7ff8840aa010 legacy=0x7ff884158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 -- 172.21.15.148:0/451503052 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840c0f20 con 0x7ff8840aa3f0 2023-10-24T00:29:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff881ffb700 1 -- 172.21.15.148:0/451503052 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736048362 0 0) 0x7ff8840aa820 con 0x7ff8840aa010 2023-10-24T00:29:00.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8827fc700 1 --2- 172.21.15.148:0/451503052 >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 0x7ff8840c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:00.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff8837fe700 1 --2- 172.21.15.148:0/451503052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa3f0 0x7ff884069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff884157d00 tx=0x7ff87c009780).ready entity=mon.0 client_cookie=e0c8a2d3a5550458 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:00.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff881ffb700 1 -- 172.21.15.148:0/451503052 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00e070 con 0x7ff8840aa3f0 2023-10-24T00:29:00.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff881ffb700 1 -- 172.21.15.148:0/451503052 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00bc30 con 0x7ff8840aa3f0 2023-10-24T00:29:00.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.716+0000 7ff881ffb700 1 -- 172.21.15.148:0/451503052 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c012410 con 0x7ff8840aa3f0 2023-10-24T00:29:00.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 -- 172.21.15.148:0/451503052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa3f0 msgr2=0x7ff884069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 --2- 172.21.15.148:0/451503052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa3f0 0x7ff884069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff884157d00 tx=0x7ff87c009780).stop 2023-10-24T00:29:00.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 -- 172.21.15.148:0/451503052 shutdown_connections 2023-10-24T00:29:00.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 --2- 172.21.15.148:0/451503052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa3f0 0x7ff884069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 --2- 172.21.15.148:0/451503052 >> v2:172.21.15.150:3300/0 conn(0x7ff8840c6710 0x7ff8840c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 -- 172.21.15.148:0/451503052 >> 172.21.15.148:0/451503052 conn(0x7ff8840caf40 msgr2=0x7ff8840cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:00.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 -- 172.21.15.148:0/451503052 shutdown_connections 2023-10-24T00:29:00.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.717+0000 7ff8896e6700 1 -- 172.21.15.148:0/451503052 wait complete. 2023-10-24T00:29:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.718+0000 7ff8896e6700 1 Processor -- start 2023-10-24T00:29:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.718+0000 7ff8896e6700 1 -- start start 2023-10-24T00:29:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8840aa3f0 0x7ff884154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8840c6710 0x7ff88414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840c1fe0 con 0x7ff8840aa010 2023-10-24T00:29:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841682c0 con 0x7ff8840aa3f0 2023-10-24T00:29:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8896e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841685a0 con 0x7ff8840c6710 2023-10-24T00:29:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59144/0 (socket says 172.21.15.148:59144) 2023-10-24T00:29:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 -- 172.21.15.148:0/1218246436 learned_addr learned my addr 172.21.15.148:0/1218246436 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8827fc700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8840aa3f0 0x7ff884154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff8837fe700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8840c6710 0x7ff88414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 -- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8840c6710 msgr2=0x7ff88414cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8840c6710 0x7ff88414cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 -- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8840aa3f0 msgr2=0x7ff884154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8840aa3f0 0x7ff884154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 -- 172.21.15.148:0/1218246436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c009a20 con 0x7ff8840aa010 2023-10-24T00:29:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.719+0000 7ff882ffd700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff87400c4e0 tx=0x7ff874007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.720+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740072e0 con 0x7ff8840aa010 2023-10-24T00:29:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.720+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874007440 con 0x7ff8840aa010 2023-10-24T00:29:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.720+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884168880 con 0x7ff8840aa010 2023-10-24T00:29:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.720+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740057a0 con 0x7ff8840aa010 2023-10-24T00:29:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.720+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884167fd0 con 0x7ff8840aa010 2023-10-24T00:29:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.721+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88406c6b0 con 0x7ff8840aa010 2023-10-24T00:29:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.721+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff874005bd0 con 0x7ff8840aa010 2023-10-24T00:29:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.721+0000 7ff86affd700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 0x7ff8700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.721+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff874079a60 con 0x7ff8840aa010 2023-10-24T00:29:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.722+0000 7ff8827fc700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 0x7ff8700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.722+0000 7ff8827fc700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 0x7ff8700615e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff8840ab550 tx=0x7ff878008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.726+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff87404ad30 con 0x7ff8840aa010 2023-10-24T00:29:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.890+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8840c1200 con 0x7ff87005f120 2023-10-24T00:29:00.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.900+0000 7ff86affd700 1 -- 172.21.15.148:0/1218246436 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336471 (secure 0 0 0) 0x7ff8840c1200 con 0x7ff87005f120 2023-10-24T00:29:00.906 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:00.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 msgr2=0x7ff8700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 0x7ff8700615e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff8840ab550 tx=0x7ff878008040).stop 2023-10-24T00:29:00.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 msgr2=0x7ff884167ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:00.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff87400c4e0 tx=0x7ff874007c70).stop 2023-10-24T00:29:00.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 shutdown_connections 2023-10-24T00:29:00.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8840c6710 0x7ff88414cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff87005f120 0x7ff8700615e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8840aa010 0x7ff884167ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 --2- 172.21.15.148:0/1218246436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8840aa3f0 0x7ff884154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 >> 172.21.15.148:0/1218246436 conn(0x7ff8840caf40 msgr2=0x7ff884153750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 shutdown_connections 2023-10-24T00:29:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:00.903+0000 7ff8896e6700 1 -- 172.21.15.148:0/1218246436 wait complete. 2023-10-24T00:29:00.911 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:00.917 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:29:00.769957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":686348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001178"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202675+0000","last_change":"2023-10-24T00:28:53.197457+0000","last_active":"2023-10-24T00:28:53.202675+0000","last_peered":"2023-10-24T00:28:53.202675+0000","last_clean":"2023-10-24T00:28:53.202675+0000","last_became_active":"2023-10-24T00:28:53.197181+0000","last_became_peered":"2023-10-24T00:28:53.197181+0000","last_unstale":"2023-10-24T00:28:53.202675+0000","last_undegraded":"2023-10-24T00:28:53.202675+0000","last_fullsized":"2023-10-24T00:28:53.202675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196253+0000","last_change":"2023-10-24T00:28:52.832585+0000","last_active":"2023-10-24T00:28:53.196253+0000","last_peered":"2023-10-24T00:28:53.196253+0000","last_clean":"2023-10-24T00:28:53.196253+0000","last_became_active":"2023-10-24T00:28:52.832304+0000","last_became_peered":"2023-10-24T00:28:52.832304+0000","last_unstale":"2023-10-24T00:28:53.196253+0000","last_undegraded":"2023-10-24T00:28:53.196253+0000","last_fullsized":"2023-10-24T00:28:53.196253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219117+0000","last_change":"2023-10-24T00:28:53.216919+0000","last_active":"2023-10-24T00:28:53.219117+0000","last_peered":"2023-10-24T00:28:53.219117+0000","last_clean":"2023-10-24T00:28:53.219117+0000","last_became_active":"2023-10-24T00:28:53.216644+0000","last_became_peered":"2023-10-24T00:28:53.216644+0000","last_unstale":"2023-10-24T00:28:53.219117+0000","last_undegraded":"2023-10-24T00:28:53.219117+0000","last_fullsized":"2023-10-24T00:28:53.219117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189038+0000","last_change":"2023-10-24T00:28:52.834106+0000","last_active":"2023-10-24T00:28:53.189038+0000","last_peered":"2023-10-24T00:28:53.189038+0000","last_clean":"2023-10-24T00:28:53.189038+0000","last_became_active":"2023-10-24T00:28:52.833861+0000","last_became_peered":"2023-10-24T00:28:52.833861+0000","last_unstale":"2023-10-24T00:28:53.189038+0000","last_undegraded":"2023-10-24T00:28:53.189038+0000","last_fullsized":"2023-10-24T00:28:53.189038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219445+0000","last_change":"2023-10-24T00:28:53.215329+0000","last_active":"2023-10-24T00:28:53.219445+0000","last_peered":"2023-10-24T00:28:53.219445+0000","last_clean":"2023-10-24T00:28:53.219445+0000","last_became_active":"2023-10-24T00:28:53.215054+0000","last_became_peered":"2023-10-24T00:28:53.215054+0000","last_unstale":"2023-10-24T00:28:53.219445+0000","last_undegraded":"2023-10-24T00:28:53.219445+0000","last_fullsized":"2023-10-24T00:28:53.219445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192190+0000","last_change":"2023-10-24T00:28:52.839855+0000","last_active":"2023-10-24T00:28:53.192190+0000","last_peered":"2023-10-24T00:28:53.192190+0000","last_clean":"2023-10-24T00:28:53.192190+0000","last_became_active":"2023-10-24T00:28:52.839642+0000","last_became_peered":"2023-10-24T00:28:52.839642+0000","last_unstale":"2023-10-24T00:28:53.192190+0000","last_undegraded":"2023-10-24T00:28:53.192190+0000","last_fullsized":"2023-10-24T00:28:53.192190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208075+0000","last_change":"2023-10-24T00:28:53.198164+0000","last_active":"2023-10-24T00:28:53.208075+0000","last_peered":"2023-10-24T00:28:53.208075+0000","last_clean":"2023-10-24T00:28:53.208075+0000","last_became_active":"2023-10-24T00:28:53.197880+0000","last_became_peered":"2023-10-24T00:28:53.197880+0000","last_unstale":"2023-10-24T00:28:53.208075+0000","last_undegraded":"2023-10-24T00:28:53.208075+0000","last_fullsized":"2023-10-24T00:28:53.208075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213801+0000","last_change":"2023-10-24T00:28:52.841842+0000","last_active":"2023-10-24T00:28:53.213801+0000","last_peered":"2023-10-24T00:28:53.213801+0000","last_clean":"2023-10-24T00:28:53.213801+0000","last_became_active":"2023-10-24T00:28:52.841497+0000","last_became_peered":"2023-10-24T00:28:52.841497+0000","last_unstale":"2023-10-24T00:28:53.213801+0000","last_undegraded":"2023-10-24T00:28:53.213801+0000","last_fullsized":"2023-10-24T00:28:53.213801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211799+0000","last_change":"2023-10-24T00:28:53.206480+0000","last_active":"2023-10-24T00:28:53.211799+0000","last_peered":"2023-10-24T00:28:53.211799+0000","last_clean":"2023-10-24T00:28:53.211799+0000","last_became_active":"2023-10-24T00:28:53.206200+0000","last_became_peered":"2023-10-24T00:28:53.206200+0000","last_unstale":"2023-10-24T00:28:53.211799+0000","last_undegraded":"2023-10-24T00:28:53.211799+0000","last_fullsized":"2023-10-24T00:28:53.211799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208301+0000","last_change":"2023-10-24T00:28:52.837935+0000","last_active":"2023-10-24T00:28:53.208301+0000","last_peered":"2023-10-24T00:28:53.208301+0000","last_clean":"2023-10-24T00:28:53.208301+0000","last_became_active":"2023-10-24T00:28:52.837653+0000","last_became_peered":"2023-10-24T00:28:52.837653+0000","last_unstale":"2023-10-24T00:28:53.208301+0000","last_undegraded":"2023-10-24T00:28:53.208301+0000","last_fullsized":"2023-10-24T00:28:53.208301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216889+0000","last_change":"2023-10-24T00:28:53.214654+0000","last_active":"2023-10-24T00:28:53.216889+0000","last_peered":"2023-10-24T00:28:53.216889+0000","last_clean":"2023-10-24T00:28:53.216889+0000","last_became_active":"2023-10-24T00:28:53.214391+0000","last_became_peered":"2023-10-24T00:28:53.214391+0000","last_unstale":"2023-10-24T00:28:53.216889+0000","last_undegraded":"2023-10-24T00:28:53.216889+0000","last_fullsized":"2023-10-24T00:28:53.216889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219715+0000","last_change":"2023-10-24T00:28:52.831368+0000","last_active":"2023-10-24T00:28:53.219715+0000","last_peered":"2023-10-24T00:28:53.219715+0000","last_clean":"2023-10-24T00:28:53.219715+0000","last_became_active":"2023-10-24T00:28:52.831054+0000","last_became_peered":"2023-10-24T00:28:52.831054+0000","last_unstale":"2023-10-24T00:28:53.219715+0000","last_undegraded":"2023-10-24T00:28:53.219715+0000","last_fullsized":"2023-10-24T00:28:53.219715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214442+0000","last_change":"2023-10-24T00:28:53.208856+0000","last_active":"2023-10-24T00:28:53.214442+0000","last_peered":"2023-10-24T00:28:53.214442+0000","last_clean":"2023-10-24T00:28:53.214442+0000","last_became_active":"2023-10-24T00:28:53.208588+0000","last_became_peered":"2023-10-24T00:28:53.208588+0000","last_unstale":"2023-10-24T00:28:53.214442+0000","last_undegraded":"2023-10-24T00:28:53.214442+0000","last_fullsized":"2023-10-24T00:28:53.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216976+0000","last_change":"2023-10-24T00:28:52.829502+0000","last_active":"2023-10-24T00:28:53.216976+0000","last_peered":"2023-10-24T00:28:53.216976+0000","last_clean":"2023-10-24T00:28:53.216976+0000","last_became_active":"2023-10-24T00:28:52.829097+0000","last_became_peered":"2023-10-24T00:28:52.829097+0000","last_unstale":"2023-10-24T00:28:53.216976+0000","last_undegraded":"2023-10-24T00:28:53.216976+0000","last_fullsized":"2023-10-24T00:28:53.216976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207273+0000","last_change":"2023-10-24T00:28:53.197597+0000","last_active":"2023-10-24T00:28:53.207273+0000","last_peered":"2023-10-24T00:28:53.207273+0000","last_clean":"2023-10-24T00:28:53.207273+0000","last_became_active":"2023-10-24T00:28:53.197328+0000","last_became_peered":"2023-10-24T00:28:53.197328+0000","last_unstale":"2023-10-24T00:28:53.207273+0000","last_undegraded":"2023-10-24T00:28:53.207273+0000","last_fullsized":"2023-10-24T00:28:53.207273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214747+0000","last_change":"2023-10-24T00:28:52.830223+0000","last_active":"2023-10-24T00:28:53.214747+0000","last_peered":"2023-10-24T00:28:53.214747+0000","last_clean":"2023-10-24T00:28:53.214747+0000","last_became_active":"2023-10-24T00:28:52.829963+0000","last_became_peered":"2023-10-24T00:28:52.829963+0000","last_unstale":"2023-10-24T00:28:53.214747+0000","last_undegraded":"2023-10-24T00:28:53.214747+0000","last_fullsized":"2023-10-24T00:28:53.214747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221048+0000","last_change":"2023-10-24T00:28:53.218099+0000","last_active":"2023-10-24T00:28:53.221048+0000","last_peered":"2023-10-24T00:28:53.221048+0000","last_clean":"2023-10-24T00:28:53.221048+0000","last_became_active":"2023-10-24T00:28:53.217842+0000","last_became_peered":"2023-10-24T00:28:53.217842+0000","last_unstale":"2023-10-24T00:28:53.221048+0000","last_undegraded":"2023-10-24T00:28:53.221048+0000","last_fullsized":"2023-10-24T00:28:53.221048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208421+0000","last_change":"2023-10-24T00:28:52.844225+0000","last_active":"2023-10-24T00:28:53.208421+0000","last_peered":"2023-10-24T00:28:53.208421+0000","last_clean":"2023-10-24T00:28:53.208421+0000","last_became_active":"2023-10-24T00:28:52.843751+0000","last_became_peered":"2023-10-24T00:28:52.843751+0000","last_unstale":"2023-10-24T00:28:53.208421+0000","last_undegraded":"2023-10-24T00:28:53.208421+0000","last_fullsized":"2023-10-24T00:28:53.208421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218875+0000","last_change":"2023-10-24T00:28:53.214994+0000","last_active":"2023-10-24T00:28:53.218875+0000","last_peered":"2023-10-24T00:28:53.218875+0000","last_clean":"2023-10-24T00:28:53.218875+0000","last_became_active":"2023-10-24T00:28:53.214737+0000","last_became_peered":"2023-10-24T00:28:53.214737+0000","last_unstale":"2023-10-24T00:28:53.218875+0000","last_undegraded":"2023-10-24T00:28:53.218875+0000","last_fullsized":"2023-10-24T00:28:53.218875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195147+0000","last_change":"2023-10-24T00:28:52.833269+0000","last_active":"2023-10-24T00:28:53.195147+0000","last_peered":"2023-10-24T00:28:53.195147+0000","last_clean":"2023-10-24T00:28:53.195147+0000","last_became_active":"2023-10-24T00:28:52.832982+0000","last_became_peered":"2023-10-24T00:28:52.832982+0000","last_unstale":"2023-10-24T00:28:53.195147+0000","last_undegraded":"2023-10-24T00:28:53.195147+0000","last_fullsized":"2023-10-24T00:28:53.195147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209960+0000","last_change":"2023-10-24T00:28:53.207217+0000","last_active":"2023-10-24T00:28:53.209960+0000","last_peered":"2023-10-24T00:28:53.209960+0000","last_clean":"2023-10-24T00:28:53.209960+0000","last_became_active":"2023-10-24T00:28:53.206965+0000","last_became_peered":"2023-10-24T00:28:53.206965+0000","last_unstale":"2023-10-24T00:28:53.209960+0000","last_undegraded":"2023-10-24T00:28:53.209960+0000","last_fullsized":"2023-10-24T00:28:53.209960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219384+0000","last_change":"2023-10-24T00:28:52.842202+0000","last_active":"2023-10-24T00:28:53.219384+0000","last_peered":"2023-10-24T00:28:53.219384+0000","last_clean":"2023-10-24T00:28:53.219384+0000","last_became_active":"2023-10-24T00:28:52.841831+0000","last_became_peered":"2023-10-24T00:28:52.841831+0000","last_unstale":"2023-10-24T00:28:53.219384+0000","last_undegraded":"2023-10-24T00:28:53.219384+0000","last_fullsized":"2023-10-24T00:28:53.219384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219913+0000","last_change":"2023-10-24T00:28:53.212670+0000","last_active":"2023-10-24T00:28:53.219913+0000","last_peered":"2023-10-24T00:28:53.219913+0000","last_clean":"2023-10-24T00:28:53.219913+0000","last_became_active":"2023-10-24T00:28:53.212381+0000","last_became_peered":"2023-10-24T00:28:53.212381+0000","last_unstale":"2023-10-24T00:28:53.219913+0000","last_undegraded":"2023-10-24T00:28:53.219913+0000","last_fullsized":"2023-10-24T00:28:53.219913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216783+0000","last_change":"2023-10-24T00:28:52.828196+0000","last_active":"2023-10-24T00:28:53.216783+0000","last_peered":"2023-10-24T00:28:53.216783+0000","last_clean":"2023-10-24T00:28:53.216783+0000","last_became_active":"2023-10-24T00:28:52.827920+0000","last_became_peered":"2023-10-24T00:28:52.827920+0000","last_unstale":"2023-10-24T00:28:53.216783+0000","last_undegraded":"2023-10-24T00:28:53.216783+0000","last_fullsized":"2023-10-24T00:28:53.216783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214085+0000","last_change":"2023-10-24T00:28:53.201055+0000","last_active":"2023-10-24T00:28:53.214085+0000","last_peered":"2023-10-24T00:28:53.214085+0000","last_clean":"2023-10-24T00:28:53.214085+0000","last_became_active":"2023-10-24T00:28:53.200779+0000","last_became_peered":"2023-10-24T00:28:53.200779+0000","last_unstale":"2023-10-24T00:28:53.214085+0000","last_undegraded":"2023-10-24T00:28:53.214085+0000","last_fullsized":"2023-10-24T00:28:53.214085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215927+0000","last_change":"2023-10-24T00:28:52.827714+0000","last_active":"2023-10-24T00:28:53.215927+0000","last_peered":"2023-10-24T00:28:53.215927+0000","last_clean":"2023-10-24T00:28:53.215927+0000","last_became_active":"2023-10-24T00:28:52.827404+0000","last_became_peered":"2023-10-24T00:28:52.827404+0000","last_unstale":"2023-10-24T00:28:53.215927+0000","last_undegraded":"2023-10-24T00:28:53.215927+0000","last_fullsized":"2023-10-24T00:28:53.215927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217556+0000","last_change":"2023-10-24T00:28:53.211199+0000","last_active":"2023-10-24T00:28:53.217556+0000","last_peered":"2023-10-24T00:28:53.217556+0000","last_clean":"2023-10-24T00:28:53.217556+0000","last_became_active":"2023-10-24T00:28:53.210886+0000","last_became_peered":"2023-10-24T00:28:53.210886+0000","last_unstale":"2023-10-24T00:28:53.217556+0000","last_undegraded":"2023-10-24T00:28:53.217556+0000","last_fullsized":"2023-10-24T00:28:53.217556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198976+0000","last_change":"2023-10-24T00:28:52.832499+0000","last_active":"2023-10-24T00:28:53.198976+0000","last_peered":"2023-10-24T00:28:53.198976+0000","last_clean":"2023-10-24T00:28:53.198976+0000","last_became_active":"2023-10-24T00:28:52.832220+0000","last_became_peered":"2023-10-24T00:28:52.832220+0000","last_unstale":"2023-10-24T00:28:53.198976+0000","last_undegraded":"2023-10-24T00:28:53.198976+0000","last_fullsized":"2023-10-24T00:28:53.198976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218827+0000","last_change":"2023-10-24T00:28:53.213828+0000","last_active":"2023-10-24T00:28:53.218827+0000","last_peered":"2023-10-24T00:28:53.218827+0000","last_clean":"2023-10-24T00:28:53.218827+0000","last_became_active":"2023-10-24T00:28:53.213506+0000","last_became_peered":"2023-10-24T00:28:53.213506+0000","last_unstale":"2023-10-24T00:28:53.218827+0000","last_undegraded":"2023-10-24T00:28:53.218827+0000","last_fullsized":"2023-10-24T00:28:53.218827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207923+0000","last_change":"2023-10-24T00:28:52.835199+0000","last_active":"2023-10-24T00:28:53.207923+0000","last_peered":"2023-10-24T00:28:53.207923+0000","last_clean":"2023-10-24T00:28:53.207923+0000","last_became_active":"2023-10-24T00:28:52.834770+0000","last_became_peered":"2023-10-24T00:28:52.834770+0000","last_unstale":"2023-10-24T00:28:53.207923+0000","last_undegraded":"2023-10-24T00:28:53.207923+0000","last_fullsized":"2023-10-24T00:28:53.207923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215542+0000","last_change":"2023-10-24T00:28:53.210526+0000","last_active":"2023-10-24T00:28:53.215542+0000","last_peered":"2023-10-24T00:28:53.215542+0000","last_clean":"2023-10-24T00:28:53.215542+0000","last_became_active":"2023-10-24T00:28:53.210295+0000","last_became_peered":"2023-10-24T00:28:53.210295+0000","last_unstale":"2023-10-24T00:28:53.215542+0000","last_undegraded":"2023-10-24T00:28:53.215542+0000","last_fullsized":"2023-10-24T00:28:53.215542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202449+0000","last_change":"2023-10-24T00:28:52.842949+0000","last_active":"2023-10-24T00:28:53.202449+0000","last_peered":"2023-10-24T00:28:53.202449+0000","last_clean":"2023-10-24T00:28:53.202449+0000","last_became_active":"2023-10-24T00:28:52.842488+0000","last_became_peered":"2023-10-24T00:28:52.842488+0000","last_unstale":"2023-10-24T00:28:53.202449+0000","last_undegraded":"2023-10-24T00:28:53.202449+0000","last_fullsized":"2023-10-24T00:28:53.202449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218240+0000","last_change":"2023-10-24T00:28:53.213761+0000","last_active":"2023-10-24T00:28:53.218240+0000","last_peered":"2023-10-24T00:28:53.218240+0000","last_clean":"2023-10-24T00:28:53.218240+0000","last_became_active":"2023-10-24T00:28:53.213457+0000","last_became_peered":"2023-10-24T00:28:53.213457+0000","last_unstale":"2023-10-24T00:28:53.218240+0000","last_undegraded":"2023-10-24T00:28:53.218240+0000","last_fullsized":"2023-10-24T00:28:53.218240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205989+0000","last_change":"2023-10-24T00:28:52.836396+0000","last_active":"2023-10-24T00:28:53.205989+0000","last_peered":"2023-10-24T00:28:53.205989+0000","last_clean":"2023-10-24T00:28:53.205989+0000","last_became_active":"2023-10-24T00:28:52.836110+0000","last_became_peered":"2023-10-24T00:28:52.836110+0000","last_unstale":"2023-10-24T00:28:53.205989+0000","last_undegraded":"2023-10-24T00:28:53.205989+0000","last_fullsized":"2023-10-24T00:28:53.205989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218040+0000","last_change":"2023-10-24T00:28:53.213383+0000","last_active":"2023-10-24T00:28:53.218040+0000","last_peered":"2023-10-24T00:28:53.218040+0000","last_clean":"2023-10-24T00:28:53.218040+0000","last_became_active":"2023-10-24T00:28:53.212809+0000","last_became_peered":"2023-10-24T00:28:53.212809+0000","last_unstale":"2023-10-24T00:28:53.218040+0000","last_undegraded":"2023-10-24T00:28:53.218040+0000","last_fullsized":"2023-10-24T00:28:53.218040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196651+0000","last_change":"2023-10-24T00:28:52.833221+0000","last_active":"2023-10-24T00:28:53.196651+0000","last_peered":"2023-10-24T00:28:53.196651+0000","last_clean":"2023-10-24T00:28:53.196651+0000","last_became_active":"2023-10-24T00:28:52.832941+0000","last_became_peered":"2023-10-24T00:28:52.832941+0000","last_unstale":"2023-10-24T00:28:53.196651+0000","last_undegraded":"2023-10-24T00:28:53.196651+0000","last_fullsized":"2023-10-24T00:28:53.196651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.201868+0000","last_change":"2023-10-24T00:28:53.197450+0000","last_active":"2023-10-24T00:28:53.201868+0000","last_peered":"2023-10-24T00:28:53.201868+0000","last_clean":"2023-10-24T00:28:53.201868+0000","last_became_active":"2023-10-24T00:28:53.197178+0000","last_became_peered":"2023-10-24T00:28:53.197178+0000","last_unstale":"2023-10-24T00:28:53.201868+0000","last_undegraded":"2023-10-24T00:28:53.201868+0000","last_fullsized":"2023-10-24T00:28:53.201868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.191976+0000","last_change":"2023-10-24T00:28:52.832101+0000","last_active":"2023-10-24T00:28:53.191976+0000","last_peered":"2023-10-24T00:28:53.191976+0000","last_clean":"2023-10-24T00:28:53.191976+0000","last_became_active":"2023-10-24T00:28:52.831799+0000","last_became_peered":"2023-10-24T00:28:52.831799+0000","last_unstale":"2023-10-24T00:28:53.191976+0000","last_undegraded":"2023-10-24T00:28:53.191976+0000","last_fullsized":"2023-10-24T00:28:53.191976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189164+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:53.189164+0000","last_peered":"2023-10-24T00:28:53.189164+0000","last_clean":"2023-10-24T00:28:53.189164+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:53.189164+0000","last_undegraded":"2023-10-24T00:28:53.189164+0000","last_fullsized":"2023-10-24T00:28:53.189164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208258+0000","last_change":"2023-10-24T00:28:52.837352+0000","last_active":"2023-10-24T00:28:53.208258+0000","last_peered":"2023-10-24T00:28:53.208258+0000","last_clean":"2023-10-24T00:28:53.208258+0000","last_became_active":"2023-10-24T00:28:52.836889+0000","last_became_peered":"2023-10-24T00:28:52.836889+0000","last_unstale":"2023-10-24T00:28:53.208258+0000","last_undegraded":"2023-10-24T00:28:53.208258+0000","last_fullsized":"2023-10-24T00:28:53.208258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215067+0000","last_change":"2023-10-24T00:28:53.212561+0000","last_active":"2023-10-24T00:28:53.215067+0000","last_peered":"2023-10-24T00:28:53.215067+0000","last_clean":"2023-10-24T00:28:53.215067+0000","last_became_active":"2023-10-24T00:28:53.212213+0000","last_became_peered":"2023-10-24T00:28:53.212213+0000","last_unstale":"2023-10-24T00:28:53.215067+0000","last_undegraded":"2023-10-24T00:28:53.215067+0000","last_fullsized":"2023-10-24T00:28:53.215067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208145+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:53.208145+0000","last_peered":"2023-10-24T00:28:53.208145+0000","last_clean":"2023-10-24T00:28:53.208145+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:53.208145+0000","last_undegraded":"2023-10-24T00:28:53.208145+0000","last_fullsized":"2023-10-24T00:28:53.208145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196733+0000","last_change":"2023-10-24T00:28:52.841779+0000","last_active":"2023-10-24T00:28:53.196733+0000","last_peered":"2023-10-24T00:28:53.196733+0000","last_clean":"2023-10-24T00:28:53.196733+0000","last_became_active":"2023-10-24T00:28:52.841486+0000","last_became_peered":"2023-10-24T00:28:52.841486+0000","last_unstale":"2023-10-24T00:28:53.196733+0000","last_undegraded":"2023-10-24T00:28:53.196733+0000","last_fullsized":"2023-10-24T00:28:53.196733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202018+0000","last_change":"2023-10-24T00:28:53.198838+0000","last_active":"2023-10-24T00:28:53.202018+0000","last_peered":"2023-10-24T00:28:53.202018+0000","last_clean":"2023-10-24T00:28:53.202018+0000","last_became_active":"2023-10-24T00:28:53.198572+0000","last_became_peered":"2023-10-24T00:28:53.198572+0000","last_unstale":"2023-10-24T00:28:53.202018+0000","last_undegraded":"2023-10-24T00:28:53.202018+0000","last_fullsized":"2023-10-24T00:28:53.202018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218830+0000","last_change":"2023-10-24T00:28:53.215991+0000","last_active":"2023-10-24T00:28:53.218830+0000","last_peered":"2023-10-24T00:28:53.218830+0000","last_clean":"2023-10-24T00:28:53.218830+0000","last_became_active":"2023-10-24T00:28:53.215724+0000","last_became_peered":"2023-10-24T00:28:53.215724+0000","last_unstale":"2023-10-24T00:28:53.218830+0000","last_undegraded":"2023-10-24T00:28:53.218830+0000","last_fullsized":"2023-10-24T00:28:53.218830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194747+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:53.194747+0000","last_peered":"2023-10-24T00:28:53.194747+0000","last_clean":"2023-10-24T00:28:53.194747+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:53.194747+0000","last_undegraded":"2023-10-24T00:28:53.194747+0000","last_fullsized":"2023-10-24T00:28:53.194747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189062+0000","last_change":"2023-10-24T00:28:52.836290+0000","last_active":"2023-10-24T00:28:53.189062+0000","last_peered":"2023-10-24T00:28:53.189062+0000","last_clean":"2023-10-24T00:28:53.189062+0000","last_became_active":"2023-10-24T00:28:52.836025+0000","last_became_peered":"2023-10-24T00:28:52.836025+0000","last_unstale":"2023-10-24T00:28:53.189062+0000","last_undegraded":"2023-10-24T00:28:53.189062+0000","last_fullsized":"2023-10-24T00:28:53.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219556+0000","last_change":"2023-10-24T00:28:53.216794+0000","last_active":"2023-10-24T00:28:53.219556+0000","last_peered":"2023-10-24T00:28:53.219556+0000","last_clean":"2023-10-24T00:28:53.219556+0000","last_became_active":"2023-10-24T00:28:53.216522+0000","last_became_peered":"2023-10-24T00:28:53.216522+0000","last_unstale":"2023-10-24T00:28:53.219556+0000","last_undegraded":"2023-10-24T00:28:53.219556+0000","last_fullsized":"2023-10-24T00:28:53.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207961+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:53.207961+0000","last_peered":"2023-10-24T00:28:53.207961+0000","last_clean":"2023-10-24T00:28:53.207961+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:53.207961+0000","last_undegraded":"2023-10-24T00:28:53.207961+0000","last_fullsized":"2023-10-24T00:28:53.207961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196499+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:53.196499+0000","last_peered":"2023-10-24T00:28:53.196499+0000","last_clean":"2023-10-24T00:28:53.196499+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:53.196499+0000","last_undegraded":"2023-10-24T00:28:53.196499+0000","last_fullsized":"2023-10-24T00:28:53.196499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192193+0000","last_change":"2023-10-24T00:28:52.835633+0000","last_active":"2023-10-24T00:28:53.192193+0000","last_peered":"2023-10-24T00:28:53.192193+0000","last_clean":"2023-10-24T00:28:53.192193+0000","last_became_active":"2023-10-24T00:28:52.833208+0000","last_became_peered":"2023-10-24T00:28:52.833208+0000","last_unstale":"2023-10-24T00:28:53.192193+0000","last_undegraded":"2023-10-24T00:28:53.192193+0000","last_fullsized":"2023-10-24T00:28:53.192193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218638+0000","last_change":"2023-10-24T00:28:53.213575+0000","last_active":"2023-10-24T00:28:53.218638+0000","last_peered":"2023-10-24T00:28:53.218638+0000","last_clean":"2023-10-24T00:28:53.218638+0000","last_became_active":"2023-10-24T00:28:53.209567+0000","last_became_peered":"2023-10-24T00:28:53.209567+0000","last_unstale":"2023-10-24T00:28:53.218638+0000","last_undegraded":"2023-10-24T00:28:53.218638+0000","last_fullsized":"2023-10-24T00:28:53.218638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196975+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:53.196975+0000","last_peered":"2023-10-24T00:28:53.196975+0000","last_clean":"2023-10-24T00:28:53.196975+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:53.196975+0000","last_undegraded":"2023-10-24T00:28:53.196975+0000","last_fullsized":"2023-10-24T00:28:53.196975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205869+0000","last_change":"2023-10-24T00:28:52.840006+0000","last_active":"2023-10-24T00:28:53.205869+0000","last_peered":"2023-10-24T00:28:53.205869+0000","last_clean":"2023-10-24T00:28:53.205869+0000","last_became_active":"2023-10-24T00:28:52.839452+0000","last_became_peered":"2023-10-24T00:28:52.839452+0000","last_unstale":"2023-10-24T00:28:53.205869+0000","last_undegraded":"2023-10-24T00:28:53.205869+0000","last_fullsized":"2023-10-24T00:28:53.205869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198874+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:53.198874+0000","last_peered":"2023-10-24T00:28:53.198874+0000","last_clean":"2023-10-24T00:28:53.198874+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:53.198874+0000","last_undegraded":"2023-10-24T00:28:53.198874+0000","last_fullsized":"2023-10-24T00:28:53.198874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189581+0000","last_change":"2023-10-24T00:28:52.832876+0000","last_active":"2023-10-24T00:28:53.189581+0000","last_peered":"2023-10-24T00:28:53.189581+0000","last_clean":"2023-10-24T00:28:53.189581+0000","last_became_active":"2023-10-24T00:28:52.832617+0000","last_became_peered":"2023-10-24T00:28:52.832617+0000","last_unstale":"2023-10-24T00:28:53.189581+0000","last_undegraded":"2023-10-24T00:28:53.189581+0000","last_fullsized":"2023-10-24T00:28:53.189581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219158+0000","last_change":"2023-10-24T00:28:53.217199+0000","last_active":"2023-10-24T00:28:53.219158+0000","last_peered":"2023-10-24T00:28:53.219158+0000","last_clean":"2023-10-24T00:28:53.219158+0000","last_became_active":"2023-10-24T00:28:53.216879+0000","last_became_peered":"2023-10-24T00:28:53.216879+0000","last_unstale":"2023-10-24T00:28:53.219158+0000","last_undegraded":"2023-10-24T00:28:53.219158+0000","last_fullsized":"2023-10-24T00:28:53.219158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207465+0000","last_change":"2023-10-24T00:28:52.831240+0000","last_active":"2023-10-24T00:28:53.207465+0000","last_peered":"2023-10-24T00:28:53.207465+0000","last_clean":"2023-10-24T00:28:53.207465+0000","last_became_active":"2023-10-24T00:28:52.830998+0000","last_became_peered":"2023-10-24T00:28:52.830998+0000","last_unstale":"2023-10-24T00:28:53.207465+0000","last_undegraded":"2023-10-24T00:28:53.207465+0000","last_fullsized":"2023-10-24T00:28:53.207465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189430+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:53.189430+0000","last_peered":"2023-10-24T00:28:53.189430+0000","last_clean":"2023-10-24T00:28:53.189430+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:53.189430+0000","last_undegraded":"2023-10-24T00:28:53.189430+0000","last_fullsized":"2023-10-24T00:28:53.189430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210569+0000","last_change":"2023-10-24T00:28:53.207984+0000","last_active":"2023-10-24T00:28:53.210569+0000","last_peered":"2023-10-24T00:28:53.210569+0000","last_clean":"2023-10-24T00:28:53.210569+0000","last_became_active":"2023-10-24T00:28:53.206306+0000","last_became_peered":"2023-10-24T00:28:53.206306+0000","last_unstale":"2023-10-24T00:28:53.210569+0000","last_undegraded":"2023-10-24T00:28:53.210569+0000","last_fullsized":"2023-10-24T00:28:53.210569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204049+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:53.204049+0000","last_peered":"2023-10-24T00:28:53.204049+0000","last_clean":"2023-10-24T00:28:53.204049+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:53.204049+0000","last_undegraded":"2023-10-24T00:28:53.204049+0000","last_fullsized":"2023-10-24T00:28:53.204049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213765+0000","last_change":"2023-10-24T00:28:52.845874+0000","last_active":"2023-10-24T00:28:53.213765+0000","last_peered":"2023-10-24T00:28:53.213765+0000","last_clean":"2023-10-24T00:28:53.213765+0000","last_became_active":"2023-10-24T00:28:52.845615+0000","last_became_peered":"2023-10-24T00:28:52.845615+0000","last_unstale":"2023-10-24T00:28:53.213765+0000","last_undegraded":"2023-10-24T00:28:53.213765+0000","last_fullsized":"2023-10-24T00:28:53.213765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217693+0000","last_change":"2023-10-24T00:28:53.212953+0000","last_active":"2023-10-24T00:28:53.217693+0000","last_peered":"2023-10-24T00:28:53.217693+0000","last_clean":"2023-10-24T00:28:53.217693+0000","last_became_active":"2023-10-24T00:28:53.212744+0000","last_became_peered":"2023-10-24T00:28:53.212744+0000","last_unstale":"2023-10-24T00:28:53.217693+0000","last_undegraded":"2023-10-24T00:28:53.217693+0000","last_fullsized":"2023-10-24T00:28:53.217693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209183+0000","last_change":"2023-10-24T00:28:53.200428+0000","last_active":"2023-10-24T00:28:53.209183+0000","last_peered":"2023-10-24T00:28:53.209183+0000","last_clean":"2023-10-24T00:28:53.209183+0000","last_became_active":"2023-10-24T00:28:53.200188+0000","last_became_peered":"2023-10-24T00:28:53.200188+0000","last_unstale":"2023-10-24T00:28:53.209183+0000","last_undegraded":"2023-10-24T00:28:53.209183+0000","last_fullsized":"2023-10-24T00:28:53.209183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209326+0000","last_change":"2023-10-24T00:28:52.841438+0000","last_active":"2023-10-24T00:28:53.209326+0000","last_peered":"2023-10-24T00:28:53.209326+0000","last_clean":"2023-10-24T00:28:53.209326+0000","last_became_active":"2023-10-24T00:28:52.840737+0000","last_became_peered":"2023-10-24T00:28:52.840737+0000","last_unstale":"2023-10-24T00:28:53.209326+0000","last_undegraded":"2023-10-24T00:28:53.209326+0000","last_fullsized":"2023-10-24T00:28:53.209326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221285+0000","last_change":"2023-10-24T00:28:53.214566+0000","last_active":"2023-10-24T00:28:53.221285+0000","last_peered":"2023-10-24T00:28:53.221285+0000","last_clean":"2023-10-24T00:28:53.221285+0000","last_became_active":"2023-10-24T00:28:53.213861+0000","last_became_peered":"2023-10-24T00:28:53.213861+0000","last_unstale":"2023-10-24T00:28:53.221285+0000","last_undegraded":"2023-10-24T00:28:53.221285+0000","last_fullsized":"2023-10-24T00:28:53.221285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207937+0000","last_change":"2023-10-24T00:28:52.837316+0000","last_active":"2023-10-24T00:28:53.207937+0000","last_peered":"2023-10-24T00:28:53.207937+0000","last_clean":"2023-10-24T00:28:53.207937+0000","last_became_active":"2023-10-24T00:28:52.836698+0000","last_became_peered":"2023-10-24T00:28:52.836698+0000","last_unstale":"2023-10-24T00:28:53.207937+0000","last_undegraded":"2023-10-24T00:28:53.207937+0000","last_fullsized":"2023-10-24T00:28:53.207937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214867+0000","last_change":"2023-10-24T00:28:53.202586+0000","last_active":"2023-10-24T00:28:53.214867+0000","last_peered":"2023-10-24T00:28:53.214867+0000","last_clean":"2023-10-24T00:28:53.214867+0000","last_became_active":"2023-10-24T00:28:53.202224+0000","last_became_peered":"2023-10-24T00:28:53.202224+0000","last_unstale":"2023-10-24T00:28:53.214867+0000","last_undegraded":"2023-10-24T00:28:53.214867+0000","last_fullsized":"2023-10-24T00:28:53.214867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218867+0000","last_change":"2023-10-24T00:28:52.836652+0000","last_active":"2023-10-24T00:28:53.218867+0000","last_peered":"2023-10-24T00:28:53.218867+0000","last_clean":"2023-10-24T00:28:53.218867+0000","last_became_active":"2023-10-24T00:28:52.833453+0000","last_became_peered":"2023-10-24T00:28:52.833453+0000","last_unstale":"2023-10-24T00:28:53.218867+0000","last_undegraded":"2023-10-24T00:28:53.218867+0000","last_fullsized":"2023-10-24T00:28:53.218867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211781+0000","last_change":"2023-10-24T00:28:53.198873+0000","last_active":"2023-10-24T00:28:53.211781+0000","last_peered":"2023-10-24T00:28:53.211781+0000","last_clean":"2023-10-24T00:28:53.211781+0000","last_became_active":"2023-10-24T00:28:53.198630+0000","last_became_peered":"2023-10-24T00:28:53.198630+0000","last_unstale":"2023-10-24T00:28:53.211781+0000","last_undegraded":"2023-10-24T00:28:53.211781+0000","last_fullsized":"2023-10-24T00:28:53.211781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203535+0000","last_change":"2023-10-24T00:28:52.830907+0000","last_active":"2023-10-24T00:28:53.203535+0000","last_peered":"2023-10-24T00:28:53.203535+0000","last_clean":"2023-10-24T00:28:53.203535+0000","last_became_active":"2023-10-24T00:28:52.830585+0000","last_became_peered":"2023-10-24T00:28:52.830585+0000","last_unstale":"2023-10-24T00:28:53.203535+0000","last_undegraded":"2023-10-24T00:28:53.203535+0000","last_fullsized":"2023-10-24T00:28:53.203535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214428+0000","last_change":"2023-10-24T00:28:53.207126+0000","last_active":"2023-10-24T00:28:53.214428+0000","last_peered":"2023-10-24T00:28:53.214428+0000","last_clean":"2023-10-24T00:28:53.214428+0000","last_became_active":"2023-10-24T00:28:53.206860+0000","last_became_peered":"2023-10-24T00:28:53.206860+0000","last_unstale":"2023-10-24T00:28:53.214428+0000","last_undegraded":"2023-10-24T00:28:53.214428+0000","last_fullsized":"2023-10-24T00:28:53.214428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219605+0000","last_change":"2023-10-24T00:28:52.839828+0000","last_active":"2023-10-24T00:28:53.219605+0000","last_peered":"2023-10-24T00:28:53.219605+0000","last_clean":"2023-10-24T00:28:53.219605+0000","last_became_active":"2023-10-24T00:28:52.839501+0000","last_became_peered":"2023-10-24T00:28:52.839501+0000","last_unstale":"2023-10-24T00:28:53.219605+0000","last_undegraded":"2023-10-24T00:28:53.219605+0000","last_fullsized":"2023-10-24T00:28:53.219605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208863+0000","last_change":"2023-10-24T00:28:53.207780+0000","last_active":"2023-10-24T00:28:53.208863+0000","last_peered":"2023-10-24T00:28:53.208863+0000","last_clean":"2023-10-24T00:28:53.208863+0000","last_became_active":"2023-10-24T00:28:53.207543+0000","last_became_peered":"2023-10-24T00:28:53.207543+0000","last_unstale":"2023-10-24T00:28:53.208863+0000","last_undegraded":"2023-10-24T00:28:53.208863+0000","last_fullsized":"2023-10-24T00:28:53.208863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202990+0000","last_change":"2023-10-24T00:28:52.841865+0000","last_active":"2023-10-24T00:28:53.202990+0000","last_peered":"2023-10-24T00:28:53.202990+0000","last_clean":"2023-10-24T00:28:53.202990+0000","last_became_active":"2023-10-24T00:28:52.841563+0000","last_became_peered":"2023-10-24T00:28:52.841563+0000","last_unstale":"2023-10-24T00:28:53.202990+0000","last_undegraded":"2023-10-24T00:28:53.202990+0000","last_fullsized":"2023-10-24T00:28:53.202990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210510+0000","last_change":"2023-10-24T00:28:53.209114+0000","last_active":"2023-10-24T00:28:53.210510+0000","last_peered":"2023-10-24T00:28:53.210510+0000","last_clean":"2023-10-24T00:28:53.210510+0000","last_became_active":"2023-10-24T00:28:53.208807+0000","last_became_peered":"2023-10-24T00:28:53.208807+0000","last_unstale":"2023-10-24T00:28:53.210510+0000","last_undegraded":"2023-10-24T00:28:53.210510+0000","last_fullsized":"2023-10-24T00:28:53.210510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194668+0000","last_change":"2023-10-24T00:28:52.844739+0000","last_active":"2023-10-24T00:28:53.194668+0000","last_peered":"2023-10-24T00:28:53.194668+0000","last_clean":"2023-10-24T00:28:53.194668+0000","last_became_active":"2023-10-24T00:28:52.844439+0000","last_became_peered":"2023-10-24T00:28:52.844439+0000","last_unstale":"2023-10-24T00:28:53.194668+0000","last_undegraded":"2023-10-24T00:28:53.194668+0000","last_fullsized":"2023-10-24T00:28:53.194668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221397+0000","last_change":"2023-10-24T00:28:53.218085+0000","last_active":"2023-10-24T00:28:53.221397+0000","last_peered":"2023-10-24T00:28:53.221397+0000","last_clean":"2023-10-24T00:28:53.221397+0000","last_became_active":"2023-10-24T00:28:53.217721+0000","last_became_peered":"2023-10-24T00:28:53.217721+0000","last_unstale":"2023-10-24T00:28:53.221397+0000","last_undegraded":"2023-10-24T00:28:53.221397+0000","last_fullsized":"2023-10-24T00:28:53.221397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208057+0000","last_change":"2023-10-24T00:28:52.835851+0000","last_active":"2023-10-24T00:28:53.208057+0000","last_peered":"2023-10-24T00:28:53.208057+0000","last_clean":"2023-10-24T00:28:53.208057+0000","last_became_active":"2023-10-24T00:28:52.835454+0000","last_became_peered":"2023-10-24T00:28:52.835454+0000","last_unstale":"2023-10-24T00:28:53.208057+0000","last_undegraded":"2023-10-24T00:28:53.208057+0000","last_fullsized":"2023-10-24T00:28:53.208057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214864+0000","last_change":"2023-10-24T00:28:53.211252+0000","last_active":"2023-10-24T00:28:53.214864+0000","last_peered":"2023-10-24T00:28:53.214864+0000","last_clean":"2023-10-24T00:28:53.214864+0000","last_became_active":"2023-10-24T00:28:53.210970+0000","last_became_peered":"2023-10-24T00:28:53.210970+0000","last_unstale":"2023-10-24T00:28:53.214864+0000","last_undegraded":"2023-10-24T00:28:53.214864+0000","last_fullsized":"2023-10-24T00:28:53.214864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206180+0000","last_change":"2023-10-24T00:28:52.841793+0000","last_active":"2023-10-24T00:28:53.206180+0000","last_peered":"2023-10-24T00:28:53.206180+0000","last_clean":"2023-10-24T00:28:53.206180+0000","last_became_active":"2023-10-24T00:28:52.841487+0000","last_became_peered":"2023-10-24T00:28:52.841487+0000","last_unstale":"2023-10-24T00:28:53.206180+0000","last_undegraded":"2023-10-24T00:28:53.206180+0000","last_fullsized":"2023-10-24T00:28:53.206180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210735+0000","last_change":"2023-10-24T00:28:53.208115+0000","last_active":"2023-10-24T00:28:53.210735+0000","last_peered":"2023-10-24T00:28:53.210735+0000","last_clean":"2023-10-24T00:28:53.210735+0000","last_became_active":"2023-10-24T00:28:53.207329+0000","last_became_peered":"2023-10-24T00:28:53.207329+0000","last_unstale":"2023-10-24T00:28:53.210735+0000","last_undegraded":"2023-10-24T00:28:53.210735+0000","last_fullsized":"2023-10-24T00:28:53.210735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195405+0000","last_change":"2023-10-24T00:28:52.833047+0000","last_active":"2023-10-24T00:28:53.195405+0000","last_peered":"2023-10-24T00:28:53.195405+0000","last_clean":"2023-10-24T00:28:53.195405+0000","last_became_active":"2023-10-24T00:28:52.832806+0000","last_became_peered":"2023-10-24T00:28:52.832806+0000","last_unstale":"2023-10-24T00:28:53.195405+0000","last_undegraded":"2023-10-24T00:28:53.195405+0000","last_fullsized":"2023-10-24T00:28:53.195405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221263+0000","last_change":"2023-10-24T00:28:53.214374+0000","last_active":"2023-10-24T00:28:53.221263+0000","last_peered":"2023-10-24T00:28:53.221263+0000","last_clean":"2023-10-24T00:28:53.221263+0000","last_became_active":"2023-10-24T00:28:53.214029+0000","last_became_peered":"2023-10-24T00:28:53.214029+0000","last_unstale":"2023-10-24T00:28:53.221263+0000","last_undegraded":"2023-10-24T00:28:53.221263+0000","last_fullsized":"2023-10-24T00:28:53.221263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189999+0000","last_change":"2023-10-24T00:28:52.831478+0000","last_active":"2023-10-24T00:28:53.189999+0000","last_peered":"2023-10-24T00:28:53.189999+0000","last_clean":"2023-10-24T00:28:53.189999+0000","last_became_active":"2023-10-24T00:28:52.831185+0000","last_became_peered":"2023-10-24T00:28:52.831185+0000","last_unstale":"2023-10-24T00:28:53.189999+0000","last_undegraded":"2023-10-24T00:28:53.189999+0000","last_fullsized":"2023-10-24T00:28:53.189999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203515+0000","last_change":"2023-10-24T00:28:53.197544+0000","last_active":"2023-10-24T00:28:53.203515+0000","last_peered":"2023-10-24T00:28:53.203515+0000","last_clean":"2023-10-24T00:28:53.203515+0000","last_became_active":"2023-10-24T00:28:53.197271+0000","last_became_peered":"2023-10-24T00:28:53.197271+0000","last_unstale":"2023-10-24T00:28:53.203515+0000","last_undegraded":"2023-10-24T00:28:53.203515+0000","last_fullsized":"2023-10-24T00:28:53.203515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203411+0000","last_change":"2023-10-24T00:28:52.835770+0000","last_active":"2023-10-24T00:28:53.203411+0000","last_peered":"2023-10-24T00:28:53.203411+0000","last_clean":"2023-10-24T00:28:53.203411+0000","last_became_active":"2023-10-24T00:28:52.835495+0000","last_became_peered":"2023-10-24T00:28:52.835495+0000","last_unstale":"2023-10-24T00:28:53.203411+0000","last_undegraded":"2023-10-24T00:28:53.203411+0000","last_fullsized":"2023-10-24T00:28:53.203411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216732+0000","last_change":"2023-10-24T00:28:53.210440+0000","last_active":"2023-10-24T00:28:53.216732+0000","last_peered":"2023-10-24T00:28:53.216732+0000","last_clean":"2023-10-24T00:28:53.216732+0000","last_became_active":"2023-10-24T00:28:53.210153+0000","last_became_peered":"2023-10-24T00:28:53.210153+0000","last_unstale":"2023-10-24T00:28:53.216732+0000","last_undegraded":"2023-10-24T00:28:53.216732+0000","last_fullsized":"2023-10-24T00:28:53.216732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195686+0000","last_change":"2023-10-24T00:28:52.834627+0000","last_active":"2023-10-24T00:28:53.195686+0000","last_peered":"2023-10-24T00:28:53.195686+0000","last_clean":"2023-10-24T00:28:53.195686+0000","last_became_active":"2023-10-24T00:28:52.834319+0000","last_became_peered":"2023-10-24T00:28:52.834319+0000","last_unstale":"2023-10-24T00:28:53.195686+0000","last_undegraded":"2023-10-24T00:28:53.195686+0000","last_fullsized":"2023-10-24T00:28:53.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218902+0000","last_change":"2023-10-24T00:28:53.215043+0000","last_active":"2023-10-24T00:28:53.218902+0000","last_peered":"2023-10-24T00:28:53.218902+0000","last_clean":"2023-10-24T00:28:53.218902+0000","last_became_active":"2023-10-24T00:28:53.214443+0000","last_became_peered":"2023-10-24T00:28:53.214443+0000","last_unstale":"2023-10-24T00:28:53.218902+0000","last_undegraded":"2023-10-24T00:28:53.218902+0000","last_fullsized":"2023-10-24T00:28:53.218902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207692+0000","last_change":"2023-10-24T00:28:52.834431+0000","last_active":"2023-10-24T00:28:53.207692+0000","last_peered":"2023-10-24T00:28:53.207692+0000","last_clean":"2023-10-24T00:28:53.207692+0000","last_became_active":"2023-10-24T00:28:52.834148+0000","last_became_peered":"2023-10-24T00:28:52.834148+0000","last_unstale":"2023-10-24T00:28:53.207692+0000","last_undegraded":"2023-10-24T00:28:53.207692+0000","last_fullsized":"2023-10-24T00:28:53.207692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218060+0000","last_change":"2023-10-24T00:28:53.213561+0000","last_active":"2023-10-24T00:28:53.218060+0000","last_peered":"2023-10-24T00:28:53.218060+0000","last_clean":"2023-10-24T00:28:53.218060+0000","last_became_active":"2023-10-24T00:28:53.213113+0000","last_became_peered":"2023-10-24T00:28:53.213113+0000","last_unstale":"2023-10-24T00:28:53.218060+0000","last_undegraded":"2023-10-24T00:28:53.218060+0000","last_fullsized":"2023-10-24T00:28:53.218060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.193241+0000","last_change":"2023-10-24T00:28:52.836152+0000","last_active":"2023-10-24T00:28:53.193241+0000","last_peered":"2023-10-24T00:28:53.193241+0000","last_clean":"2023-10-24T00:28:53.193241+0000","last_became_active":"2023-10-24T00:28:52.835876+0000","last_became_peered":"2023-10-24T00:28:52.835876+0000","last_unstale":"2023-10-24T00:28:53.193241+0000","last_undegraded":"2023-10-24T00:28:53.193241+0000","last_fullsized":"2023-10-24T00:28:53.193241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218780+0000","last_change":"2023-10-24T00:28:53.215079+0000","last_active":"2023-10-24T00:28:53.218780+0000","last_peered":"2023-10-24T00:28:53.218780+0000","last_clean":"2023-10-24T00:28:53.218780+0000","last_became_active":"2023-10-24T00:28:53.214831+0000","last_became_peered":"2023-10-24T00:28:53.214831+0000","last_unstale":"2023-10-24T00:28:53.218780+0000","last_undegraded":"2023-10-24T00:28:53.218780+0000","last_fullsized":"2023-10-24T00:28:53.218780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208256+0000","last_change":"2023-10-24T00:28:52.836578+0000","last_active":"2023-10-24T00:28:53.208256+0000","last_peered":"2023-10-24T00:28:53.208256+0000","last_clean":"2023-10-24T00:28:53.208256+0000","last_became_active":"2023-10-24T00:28:52.836282+0000","last_became_peered":"2023-10-24T00:28:52.836282+0000","last_unstale":"2023-10-24T00:28:53.208256+0000","last_undegraded":"2023-10-24T00:28:53.208256+0000","last_fullsized":"2023-10-24T00:28:53.208256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221391+0000","last_change":"2023-10-24T00:28:53.215101+0000","last_active":"2023-10-24T00:28:53.221391+0000","last_peered":"2023-10-24T00:28:53.221391+0000","last_clean":"2023-10-24T00:28:53.221391+0000","last_became_active":"2023-10-24T00:28:53.214824+0000","last_became_peered":"2023-10-24T00:28:53.214824+0000","last_unstale":"2023-10-24T00:28:53.221391+0000","last_undegraded":"2023-10-24T00:28:53.221391+0000","last_fullsized":"2023-10-24T00:28:53.221391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.220171+0000","last_change":"2023-10-24T00:28:52.841688+0000","last_active":"2023-10-24T00:28:53.220171+0000","last_peered":"2023-10-24T00:28:53.220171+0000","last_clean":"2023-10-24T00:28:53.220171+0000","last_became_active":"2023-10-24T00:28:52.841119+0000","last_became_peered":"2023-10-24T00:28:52.841119+0000","last_unstale":"2023-10-24T00:28:53.220171+0000","last_undegraded":"2023-10-24T00:28:53.220171+0000","last_fullsized":"2023-10-24T00:28:53.220171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221472+0000","last_change":"2023-10-24T00:28:53.219544+0000","last_active":"2023-10-24T00:28:53.221472+0000","last_peered":"2023-10-24T00:28:53.221472+0000","last_clean":"2023-10-24T00:28:53.221472+0000","last_became_active":"2023-10-24T00:28:53.218846+0000","last_became_peered":"2023-10-24T00:28:53.218846+0000","last_unstale":"2023-10-24T00:28:53.221472+0000","last_undegraded":"2023-10-24T00:28:53.221472+0000","last_fullsized":"2023-10-24T00:28:53.221472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206514+0000","last_change":"2023-10-24T00:28:52.837080+0000","last_active":"2023-10-24T00:28:53.206514+0000","last_peered":"2023-10-24T00:28:53.206514+0000","last_clean":"2023-10-24T00:28:53.206514+0000","last_became_active":"2023-10-24T00:28:52.836776+0000","last_became_peered":"2023-10-24T00:28:52.836776+0000","last_unstale":"2023-10-24T00:28:53.206514+0000","last_undegraded":"2023-10-24T00:28:53.206514+0000","last_fullsized":"2023-10-24T00:28:53.206514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218929+0000","last_change":"2023-10-24T00:28:53.216046+0000","last_active":"2023-10-24T00:28:53.218929+0000","last_peered":"2023-10-24T00:28:53.218929+0000","last_clean":"2023-10-24T00:28:53.218929+0000","last_became_active":"2023-10-24T00:28:53.213450+0000","last_became_peered":"2023-10-24T00:28:53.213450+0000","last_unstale":"2023-10-24T00:28:53.218929+0000","last_undegraded":"2023-10-24T00:28:53.218929+0000","last_fullsized":"2023-10-24T00:28:53.218929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214964+0000","last_change":"2023-10-24T00:28:52.830778+0000","last_active":"2023-10-24T00:28:53.214964+0000","last_peered":"2023-10-24T00:28:53.214964+0000","last_clean":"2023-10-24T00:28:53.214964+0000","last_became_active":"2023-10-24T00:28:52.830521+0000","last_became_peered":"2023-10-24T00:28:52.830521+0000","last_unstale":"2023-10-24T00:28:53.214964+0000","last_undegraded":"2023-10-24T00:28:53.214964+0000","last_fullsized":"2023-10-24T00:28:53.214964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211818+0000","last_change":"2023-10-24T00:28:53.208010+0000","last_active":"2023-10-24T00:28:53.211818+0000","last_peered":"2023-10-24T00:28:53.211818+0000","last_clean":"2023-10-24T00:28:53.211818+0000","last_became_active":"2023-10-24T00:28:53.207747+0000","last_became_peered":"2023-10-24T00:28:53.207747+0000","last_unstale":"2023-10-24T00:28:53.211818+0000","last_undegraded":"2023-10-24T00:28:53.211818+0000","last_fullsized":"2023-10-24T00:28:53.211818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195211+0000","last_change":"2023-10-24T00:28:52.834362+0000","last_active":"2023-10-24T00:28:53.195211+0000","last_peered":"2023-10-24T00:28:53.195211+0000","last_clean":"2023-10-24T00:28:53.195211+0000","last_became_active":"2023-10-24T00:28:52.834075+0000","last_became_peered":"2023-10-24T00:28:52.834075+0000","last_unstale":"2023-10-24T00:28:53.195211+0000","last_undegraded":"2023-10-24T00:28:53.195211+0000","last_fullsized":"2023-10-24T00:28:53.195211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219214+0000","last_change":"2023-10-24T00:28:53.209612+0000","last_active":"2023-10-24T00:28:53.219214+0000","last_peered":"2023-10-24T00:28:53.219214+0000","last_clean":"2023-10-24T00:28:53.219214+0000","last_became_active":"2023-10-24T00:28:53.209308+0000","last_became_peered":"2023-10-24T00:28:53.209308+0000","last_unstale":"2023-10-24T00:28:53.219214+0000","last_undegraded":"2023-10-24T00:28:53.219214+0000","last_fullsized":"2023-10-24T00:28:53.219214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208307+0000","last_change":"2023-10-24T00:28:52.837004+0000","last_active":"2023-10-24T00:28:53.208307+0000","last_peered":"2023-10-24T00:28:53.208307+0000","last_clean":"2023-10-24T00:28:53.208307+0000","last_became_active":"2023-10-24T00:28:52.836745+0000","last_became_peered":"2023-10-24T00:28:52.836745+0000","last_unstale":"2023-10-24T00:28:53.208307+0000","last_undegraded":"2023-10-24T00:28:53.208307+0000","last_fullsized":"2023-10-24T00:28:53.208307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218923+0000","last_change":"2023-10-24T00:28:53.215218+0000","last_active":"2023-10-24T00:28:53.218923+0000","last_peered":"2023-10-24T00:28:53.218923+0000","last_clean":"2023-10-24T00:28:53.218923+0000","last_became_active":"2023-10-24T00:28:53.214775+0000","last_became_peered":"2023-10-24T00:28:53.214775+0000","last_unstale":"2023-10-24T00:28:53.218923+0000","last_undegraded":"2023-10-24T00:28:53.218923+0000","last_fullsized":"2023-10-24T00:28:53.218923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219822+0000","last_change":"2023-10-24T00:28:52.842419+0000","last_active":"2023-10-24T00:28:53.219822+0000","last_peered":"2023-10-24T00:28:53.219822+0000","last_clean":"2023-10-24T00:28:53.219822+0000","last_became_active":"2023-10-24T00:28:52.841163+0000","last_became_peered":"2023-10-24T00:28:52.841163+0000","last_unstale":"2023-10-24T00:28:53.219822+0000","last_undegraded":"2023-10-24T00:28:53.219822+0000","last_fullsized":"2023-10-24T00:28:53.219822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219805+0000","last_change":"2023-10-24T00:28:53.217175+0000","last_active":"2023-10-24T00:28:53.219805+0000","last_peered":"2023-10-24T00:28:53.219805+0000","last_clean":"2023-10-24T00:28:53.219805+0000","last_became_active":"2023-10-24T00:28:53.216835+0000","last_became_peered":"2023-10-24T00:28:53.216835+0000","last_unstale":"2023-10-24T00:28:53.219805+0000","last_undegraded":"2023-10-24T00:28:53.219805+0000","last_fullsized":"2023-10-24T00:28:53.219805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189036+0000","last_change":"2023-10-24T00:28:52.830798+0000","last_active":"2023-10-24T00:28:53.189036+0000","last_peered":"2023-10-24T00:28:53.189036+0000","last_clean":"2023-10-24T00:28:53.189036+0000","last_became_active":"2023-10-24T00:28:52.830499+0000","last_became_peered":"2023-10-24T00:28:52.830499+0000","last_unstale":"2023-10-24T00:28:53.189036+0000","last_undegraded":"2023-10-24T00:28:53.189036+0000","last_fullsized":"2023-10-24T00:28:53.189036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221123+0000","last_change":"2023-10-24T00:28:53.214273+0000","last_active":"2023-10-24T00:28:53.221123+0000","last_peered":"2023-10-24T00:28:53.221123+0000","last_clean":"2023-10-24T00:28:53.221123+0000","last_became_active":"2023-10-24T00:28:53.213976+0000","last_became_peered":"2023-10-24T00:28:53.213976+0000","last_unstale":"2023-10-24T00:28:53.221123+0000","last_undegraded":"2023-10-24T00:28:53.221123+0000","last_fullsized":"2023-10-24T00:28:53.221123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208529+0000","last_change":"2023-10-24T00:28:52.844073+0000","last_active":"2023-10-24T00:28:53.208529+0000","last_peered":"2023-10-24T00:28:53.208529+0000","last_clean":"2023-10-24T00:28:53.208529+0000","last_became_active":"2023-10-24T00:28:52.843728+0000","last_became_peered":"2023-10-24T00:28:52.843728+0000","last_unstale":"2023-10-24T00:28:53.208529+0000","last_undegraded":"2023-10-24T00:28:53.208529+0000","last_fullsized":"2023-10-24T00:28:53.208529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218774+0000","last_change":"2023-10-24T00:28:53.214608+0000","last_active":"2023-10-24T00:28:53.218774+0000","last_peered":"2023-10-24T00:28:53.218774+0000","last_clean":"2023-10-24T00:28:53.218774+0000","last_became_active":"2023-10-24T00:28:53.214109+0000","last_became_peered":"2023-10-24T00:28:53.214109+0000","last_unstale":"2023-10-24T00:28:53.218774+0000","last_undegraded":"2023-10-24T00:28:53.218774+0000","last_fullsized":"2023-10-24T00:28:53.218774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204197+0000","last_change":"2023-10-24T00:28:52.831728+0000","last_active":"2023-10-24T00:28:53.204197+0000","last_peered":"2023-10-24T00:28:53.204197+0000","last_clean":"2023-10-24T00:28:53.204197+0000","last_became_active":"2023-10-24T00:28:52.831431+0000","last_became_peered":"2023-10-24T00:28:52.831431+0000","last_unstale":"2023-10-24T00:28:53.204197+0000","last_undegraded":"2023-10-24T00:28:53.204197+0000","last_fullsized":"2023-10-24T00:28:53.204197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209657+0000","last_change":"2023-10-24T00:28:53.203483+0000","last_active":"2023-10-24T00:28:53.209657+0000","last_peered":"2023-10-24T00:28:53.209657+0000","last_clean":"2023-10-24T00:28:53.209657+0000","last_became_active":"2023-10-24T00:28:53.203186+0000","last_became_peered":"2023-10-24T00:28:53.203186+0000","last_unstale":"2023-10-24T00:28:53.209657+0000","last_undegraded":"2023-10-24T00:28:53.209657+0000","last_fullsized":"2023-10-24T00:28:53.209657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221459+0000","last_change":"2023-10-24T00:28:52.830036+0000","last_active":"2023-10-24T00:28:53.221459+0000","last_peered":"2023-10-24T00:28:53.221459+0000","last_clean":"2023-10-24T00:28:53.221459+0000","last_became_active":"2023-10-24T00:28:52.829705+0000","last_became_peered":"2023-10-24T00:28:52.829705+0000","last_unstale":"2023-10-24T00:28:53.221459+0000","last_undegraded":"2023-10-24T00:28:53.221459+0000","last_fullsized":"2023-10-24T00:28:53.221459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219887+0000","last_change":"2023-10-24T00:28:53.212603+0000","last_active":"2023-10-24T00:28:53.219887+0000","last_peered":"2023-10-24T00:28:53.219887+0000","last_clean":"2023-10-24T00:28:53.219887+0000","last_became_active":"2023-10-24T00:28:53.212009+0000","last_became_peered":"2023-10-24T00:28:53.212009+0000","last_unstale":"2023-10-24T00:28:53.219887+0000","last_undegraded":"2023-10-24T00:28:53.219887+0000","last_fullsized":"2023-10-24T00:28:53.219887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206210+0000","last_change":"2023-10-24T00:28:52.834788+0000","last_active":"2023-10-24T00:28:53.206210+0000","last_peered":"2023-10-24T00:28:53.206210+0000","last_clean":"2023-10-24T00:28:53.206210+0000","last_became_active":"2023-10-24T00:28:52.834521+0000","last_became_peered":"2023-10-24T00:28:52.834521+0000","last_unstale":"2023-10-24T00:28:53.206210+0000","last_undegraded":"2023-10-24T00:28:53.206210+0000","last_fullsized":"2023-10-24T00:28:53.206210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217102+0000","last_change":"2023-10-24T00:28:53.204703+0000","last_active":"2023-10-24T00:28:53.217102+0000","last_peered":"2023-10-24T00:28:53.217102+0000","last_clean":"2023-10-24T00:28:53.217102+0000","last_became_active":"2023-10-24T00:28:53.204271+0000","last_became_peered":"2023-10-24T00:28:53.204271+0000","last_unstale":"2023-10-24T00:28:53.217102+0000","last_undegraded":"2023-10-24T00:28:53.217102+0000","last_fullsized":"2023-10-24T00:28:53.217102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203299+0000","last_change":"2023-10-24T00:28:52.834186+0000","last_active":"2023-10-24T00:28:53.203299+0000","last_peered":"2023-10-24T00:28:53.203299+0000","last_clean":"2023-10-24T00:28:53.203299+0000","last_became_active":"2023-10-24T00:28:52.833901+0000","last_became_peered":"2023-10-24T00:28:52.833901+0000","last_unstale":"2023-10-24T00:28:53.203299+0000","last_undegraded":"2023-10-24T00:28:53.203299+0000","last_fullsized":"2023-10-24T00:28:53.203299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214448+0000","last_change":"2023-10-24T00:28:53.210483+0000","last_active":"2023-10-24T00:28:53.214448+0000","last_peered":"2023-10-24T00:28:53.214448+0000","last_clean":"2023-10-24T00:28:53.214448+0000","last_became_active":"2023-10-24T00:28:53.210273+0000","last_became_peered":"2023-10-24T00:28:53.210273+0000","last_unstale":"2023-10-24T00:28:53.214448+0000","last_undegraded":"2023-10-24T00:28:53.214448+0000","last_fullsized":"2023-10-24T00:28:53.214448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.199442+0000","last_change":"2023-10-24T00:28:52.832477+0000","last_active":"2023-10-24T00:28:53.199442+0000","last_peered":"2023-10-24T00:28:53.199442+0000","last_clean":"2023-10-24T00:28:53.199442+0000","last_became_active":"2023-10-24T00:28:52.832176+0000","last_became_peered":"2023-10-24T00:28:52.832176+0000","last_unstale":"2023-10-24T00:28:53.199442+0000","last_undegraded":"2023-10-24T00:28:53.199442+0000","last_fullsized":"2023-10-24T00:28:53.199442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209249+0000","last_change":"2023-10-24T00:28:53.202433+0000","last_active":"2023-10-24T00:28:53.209249+0000","last_peered":"2023-10-24T00:28:53.209249+0000","last_clean":"2023-10-24T00:28:53.209249+0000","last_became_active":"2023-10-24T00:28:53.202167+0000","last_became_peered":"2023-10-24T00:28:53.202167+0000","last_unstale":"2023-10-24T00:28:53.209249+0000","last_undegraded":"2023-10-24T00:28:53.209249+0000","last_fullsized":"2023-10-24T00:28:53.209249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192091+0000","last_change":"2023-10-24T00:28:52.834616+0000","last_active":"2023-10-24T00:28:53.192091+0000","last_peered":"2023-10-24T00:28:53.192091+0000","last_clean":"2023-10-24T00:28:53.192091+0000","last_became_active":"2023-10-24T00:28:52.834139+0000","last_became_peered":"2023-10-24T00:28:52.834139+0000","last_unstale":"2023-10-24T00:28:53.192091+0000","last_undegraded":"2023-10-24T00:28:53.192091+0000","last_fullsized":"2023-10-24T00:28:53.192091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218349+0000","last_change":"2023-10-24T00:28:53.212700+0000","last_active":"2023-10-24T00:28:53.218349+0000","last_peered":"2023-10-24T00:28:53.218349+0000","last_clean":"2023-10-24T00:28:53.218349+0000","last_became_active":"2023-10-24T00:28:53.212080+0000","last_became_peered":"2023-10-24T00:28:53.212080+0000","last_unstale":"2023-10-24T00:28:53.218349+0000","last_undegraded":"2023-10-24T00:28:53.218349+0000","last_fullsized":"2023-10-24T00:28:53.218349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195246+0000","last_change":"2023-10-24T00:28:52.840655+0000","last_active":"2023-10-24T00:28:53.195246+0000","last_peered":"2023-10-24T00:28:53.195246+0000","last_clean":"2023-10-24T00:28:53.195246+0000","last_became_active":"2023-10-24T00:28:52.840401+0000","last_became_peered":"2023-10-24T00:28:52.840401+0000","last_unstale":"2023-10-24T00:28:53.195246+0000","last_undegraded":"2023-10-24T00:28:53.195246+0000","last_fullsized":"2023-10-24T00:28:53.195246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221422+0000","last_change":"2023-10-24T00:28:53.215705+0000","last_active":"2023-10-24T00:28:53.221422+0000","last_peered":"2023-10-24T00:28:53.221422+0000","last_clean":"2023-10-24T00:28:53.221422+0000","last_became_active":"2023-10-24T00:28:53.214840+0000","last_became_peered":"2023-10-24T00:28:53.214840+0000","last_unstale":"2023-10-24T00:28:53.221422+0000","last_undegraded":"2023-10-24T00:28:53.221422+0000","last_fullsized":"2023-10-24T00:28:53.221422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219272+0000","last_change":"2023-10-24T00:28:52.844574+0000","last_active":"2023-10-24T00:28:53.219272+0000","last_peered":"2023-10-24T00:28:53.219272+0000","last_clean":"2023-10-24T00:28:53.219272+0000","last_became_active":"2023-10-24T00:28:52.844244+0000","last_became_peered":"2023-10-24T00:28:52.844244+0000","last_unstale":"2023-10-24T00:28:53.219272+0000","last_undegraded":"2023-10-24T00:28:53.219272+0000","last_fullsized":"2023-10-24T00:28:53.219272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221438+0000","last_change":"2023-10-24T00:28:53.219279+0000","last_active":"2023-10-24T00:28:53.221438+0000","last_peered":"2023-10-24T00:28:53.221438+0000","last_clean":"2023-10-24T00:28:53.221438+0000","last_became_active":"2023-10-24T00:28:53.218946+0000","last_became_peered":"2023-10-24T00:28:53.218946+0000","last_unstale":"2023-10-24T00:28:53.221438+0000","last_undegraded":"2023-10-24T00:28:53.221438+0000","last_fullsized":"2023-10-24T00:28:53.221438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210158+0000","last_change":"2023-10-24T00:28:52.835505+0000","last_active":"2023-10-24T00:28:53.210158+0000","last_peered":"2023-10-24T00:28:53.210158+0000","last_clean":"2023-10-24T00:28:53.210158+0000","last_became_active":"2023-10-24T00:28:52.835190+0000","last_became_peered":"2023-10-24T00:28:52.835190+0000","last_unstale":"2023-10-24T00:28:53.210158+0000","last_undegraded":"2023-10-24T00:28:53.210158+0000","last_fullsized":"2023-10-24T00:28:53.210158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219137+0000","last_change":"2023-10-24T00:28:53.217100+0000","last_active":"2023-10-24T00:28:53.219137+0000","last_peered":"2023-10-24T00:28:53.219137+0000","last_clean":"2023-10-24T00:28:53.219137+0000","last_became_active":"2023-10-24T00:28:53.216532+0000","last_became_peered":"2023-10-24T00:28:53.216532+0000","last_unstale":"2023-10-24T00:28:53.219137+0000","last_undegraded":"2023-10-24T00:28:53.219137+0000","last_fullsized":"2023-10-24T00:28:53.219137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217358+0000","last_change":"2023-10-24T00:28:52.835020+0000","last_active":"2023-10-24T00:28:53.217358+0000","last_peered":"2023-10-24T00:28:53.217358+0000","last_clean":"2023-10-24T00:28:53.217358+0000","last_became_active":"2023-10-24T00:28:52.834417+0000","last_became_peered":"2023-10-24T00:28:52.834417+0000","last_unstale":"2023-10-24T00:28:53.217358+0000","last_undegraded":"2023-10-24T00:28:53.217358+0000","last_fullsized":"2023-10-24T00:28:53.217358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.223749+0000","last_change":"2023-10-24T00:28:53.217865+0000","last_active":"2023-10-24T00:28:53.223749+0000","last_peered":"2023-10-24T00:28:53.223749+0000","last_clean":"2023-10-24T00:28:53.223749+0000","last_became_active":"2023-10-24T00:28:53.217135+0000","last_became_peered":"2023-10-24T00:28:53.217135+0000","last_unstale":"2023-10-24T00:28:53.223749+0000","last_undegraded":"2023-10-24T00:28:53.223749+0000","last_fullsized":"2023-10-24T00:28:53.223749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206256+0000","last_change":"2023-10-24T00:28:52.839792+0000","last_active":"2023-10-24T00:28:53.206256+0000","last_peered":"2023-10-24T00:28:53.206256+0000","last_clean":"2023-10-24T00:28:53.206256+0000","last_became_active":"2023-10-24T00:28:52.839474+0000","last_became_peered":"2023-10-24T00:28:52.839474+0000","last_unstale":"2023-10-24T00:28:53.206256+0000","last_undegraded":"2023-10-24T00:28:53.206256+0000","last_fullsized":"2023-10-24T00:28:53.206256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217081+0000","last_change":"2023-10-24T00:28:53.204551+0000","last_active":"2023-10-24T00:28:53.217081+0000","last_peered":"2023-10-24T00:28:53.217081+0000","last_clean":"2023-10-24T00:28:53.217081+0000","last_became_active":"2023-10-24T00:28:53.203979+0000","last_became_peered":"2023-10-24T00:28:53.203979+0000","last_unstale":"2023-10-24T00:28:53.217081+0000","last_undegraded":"2023-10-24T00:28:53.217081+0000","last_fullsized":"2023-10-24T00:28:53.217081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189600+0000","last_change":"2023-10-24T00:28:52.846124+0000","last_active":"2023-10-24T00:28:53.189600+0000","last_peered":"2023-10-24T00:28:53.189600+0000","last_clean":"2023-10-24T00:28:53.189600+0000","last_became_active":"2023-10-24T00:28:52.845781+0000","last_became_peered":"2023-10-24T00:28:52.845781+0000","last_unstale":"2023-10-24T00:28:53.189600+0000","last_undegraded":"2023-10-24T00:28:53.189600+0000","last_fullsized":"2023-10-24T00:28:53.189600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219930+0000","last_change":"2023-10-24T00:28:53.216003+0000","last_active":"2023-10-24T00:28:53.219930+0000","last_peered":"2023-10-24T00:28:53.219930+0000","last_clean":"2023-10-24T00:28:53.219930+0000","last_became_active":"2023-10-24T00:28:53.215711+0000","last_became_peered":"2023-10-24T00:28:53.215711+0000","last_unstale":"2023-10-24T00:28:53.219930+0000","last_undegraded":"2023-10-24T00:28:53.219930+0000","last_fullsized":"2023-10-24T00:28:53.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216700+0000","last_change":"2023-10-24T00:28:52.829842+0000","last_active":"2023-10-24T00:28:53.216700+0000","last_peered":"2023-10-24T00:28:53.216700+0000","last_clean":"2023-10-24T00:28:53.216700+0000","last_became_active":"2023-10-24T00:28:52.829018+0000","last_became_peered":"2023-10-24T00:28:52.829018+0000","last_unstale":"2023-10-24T00:28:53.216700+0000","last_undegraded":"2023-10-24T00:28:53.216700+0000","last_fullsized":"2023-10-24T00:28:53.216700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":86631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":86809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":86663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:00.924 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:29:00.925 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-24T00:29:00.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-24T00:29:00.925 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-24T00:29:00.926 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-24T00:29:01.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.069+0000 7f1b97a42700 1 Processor -- start 2023-10-24T00:29:01.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.069+0000 7f1b97a42700 1 -- start start 2023-10-24T00:29:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b97a42700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b900aa010 0x7f1b900c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b97a42700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b900c6710 0x7f1b900aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b97a42700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b900c0960 con 0x7f1b90158770 2023-10-24T00:29:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b97a42700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900aa8e0 con 0x7f1b900c6710 2023-10-24T00:29:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b97a42700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900c0c40 con 0x7f1b900aa010 2023-10-24T00:29:01.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b94fdd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b900c6710 0x7f1b900aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b95fdf700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1b90158770 0x7f1b90069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45694/0 (socket says 172.21.15.148:45694) 2023-10-24T00:29:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b94fdd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b900c6710 0x7f1b900aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59158/0 (socket says 172.21.15.148:59158) 2023-10-24T00:29:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b95fdf700 1 -- 172.21.15.148:0/3024133465 learned_addr learned my addr 172.21.15.148:0/3024133465 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.070+0000 7f1b957de700 1 --2- 172.21.15.148:0/3024133465 >> v2:172.21.15.150:3300/0 conn(0x7f1b900aa010 0x7f1b900c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b94fdd700 1 -- 172.21.15.148:0/3024133465 >> v2:172.21.15.150:3300/0 conn(0x7f1b900aa010 msgr2=0x7f1b900c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b94fdd700 1 --2- 172.21.15.148:0/3024133465 >> v2:172.21.15.150:3300/0 conn(0x7f1b900aa010 0x7f1b900c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b94fdd700 1 -- 172.21.15.148:0/3024133465 >> v1:172.21.15.148:6789/0 conn(0x7f1b90158770 legacy=0x7f1b90069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b87fff700 1 -- 172.21.15.148:0/3024133465 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289721533 0 0) 0x7f1b900c0960 con 0x7f1b90158770 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b94fdd700 1 -- 172.21.15.148:0/3024133465 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900c0f20 con 0x7f1b900c6710 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b94fdd700 1 --2- 172.21.15.148:0/3024133465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b900c6710 0x7f1b900aa3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1b90083e30 tx=0x7f1b80009060).ready entity=mon.0 client_cookie=1a1b72db97b62407 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b87fff700 1 -- 172.21.15.148:0/3024133465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000f510 con 0x7f1b900c6710 2023-10-24T00:29:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b87fff700 1 -- 172.21.15.148:0/3024133465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8000f670 con 0x7f1b900c6710 2023-10-24T00:29:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b87fff700 1 -- 172.21.15.148:0/3024133465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000f9f0 con 0x7f1b900c6710 2023-10-24T00:29:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b97a42700 1 -- 172.21.15.148:0/3024133465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b900c6710 msgr2=0x7f1b900aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.071+0000 7f1b97a42700 1 --2- 172.21.15.148:0/3024133465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b900c6710 0x7f1b900aa3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1b90083e30 tx=0x7f1b80009060).stop 2023-10-24T00:29:01.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 -- 172.21.15.148:0/3024133465 shutdown_connections 2023-10-24T00:29:01.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 --2- 172.21.15.148:0/3024133465 >> v2:172.21.15.150:3300/0 conn(0x7f1b900aa010 0x7f1b900c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 --2- 172.21.15.148:0/3024133465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b900c6710 0x7f1b900aa3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 -- 172.21.15.148:0/3024133465 >> 172.21.15.148:0/3024133465 conn(0x7f1b900caf40 msgr2=0x7f1b900cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 -- 172.21.15.148:0/3024133465 shutdown_connections 2023-10-24T00:29:01.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.072+0000 7f1b97a42700 1 -- 172.21.15.148:0/3024133465 wait complete. 2023-10-24T00:29:01.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.073+0000 7f1b97a42700 1 Processor -- start 2023-10-24T00:29:01.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.073+0000 7f1b97a42700 1 -- start start 2023-10-24T00:29:01.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b900aa010 0x7f1b90152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b900c6710 0x7f1b901557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900c5320 con 0x7f1b90158770 2023-10-24T00:29:01.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b90152830 con 0x7f1b900aa010 2023-10-24T00:29:01.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900c2210 con 0x7f1b900c6710 2023-10-24T00:29:01.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59162/0 (socket says 172.21.15.148:59162) 2023-10-24T00:29:01.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 -- 172.21.15.148:0/2442257277 learned_addr learned my addr 172.21.15.148:0/2442257277 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:01.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b94fdd700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b900c6710 0x7f1b901557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b957de700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b900aa010 0x7f1b90152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 -- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b900c6710 msgr2=0x7f1b901557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b900c6710 0x7f1b901557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 -- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b900aa010 msgr2=0x7f1b90152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b900aa010 0x7f1b90152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 -- 172.21.15.148:0/2442257277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800092a0 con 0x7f1b90158770 2023-10-24T00:29:01.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b95fdf700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1b8800c4c0 tx=0x7f1b88007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880070d0 con 0x7f1b90158770 2023-10-24T00:29:01.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88007230 con 0x7f1b90158770 2023-10-24T00:29:01.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b900c4a80 con 0x7f1b90158770 2023-10-24T00:29:01.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880075d0 con 0x7f1b90158770 2023-10-24T00:29:01.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.074+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b900c5040 con 0x7f1b90158770 2023-10-24T00:29:01.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.075+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b900c1fc0 con 0x7f1b90158770 2023-10-24T00:29:01.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.076+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b880059b0 con 0x7f1b90158770 2023-10-24T00:29:01.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.076+0000 7f1b857fa700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.076+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b88079800 con 0x7f1b90158770 2023-10-24T00:29:01.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.076+0000 7f1b957de700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.077+0000 7f1b957de700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 0x7f1b74061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1b8c009fd0 tx=0x7f1b8c00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.080+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b8804aad0 con 0x7f1b90158770 2023-10-24T00:29:01.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.293+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1b9006c6b0 con 0x7f1b90158770 2023-10-24T00:29:01.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.296+0000 7f1b857fa700 1 -- 172.21.15.148:0/2442257277 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148955 (secure 0 0 0) 0x7f1b88018070 con 0x7f1b90158770 2023-10-24T00:29:01.299 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:01.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 msgr2=0x7f1b74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 0x7f1b74061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1b8c009fd0 tx=0x7f1b8c00b040).stop 2023-10-24T00:29:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 msgr2=0x7f1b90156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1b8800c4c0 tx=0x7f1b88007dd0).stop 2023-10-24T00:29:01.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 shutdown_connections 2023-10-24T00:29:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b90158770 0x7f1b90156300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b900aa010 0x7f1b90152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 --2- 172.21.15.148:0/2442257277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b900c6710 0x7f1b901557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 >> 172.21.15.148:0/2442257277 conn(0x7f1b900caf40 msgr2=0x7f1b900c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 shutdown_connections 2023-10-24T00:29:01.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.298+0000 7f1b97a42700 1 -- 172.21.15.148:0/2442257277 wait complete. 2023-10-24T00:29:01.311 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":87479},{"type":"v1","addr":"172.21.15.150:6833","nonce":87479}]},"active_addr":"172.21.15.150:6833/87479","active_change":"2023-10-24T00:28:40.759209+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":2026137738}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3960475136}]}]} 2023-10-24T00:29:01.315 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-24T00:29:01.315 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-24T00:29:01.316 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.427+0000 7fe23e091700 1 Processor -- start 2023-10-24T00:29:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.427+0000 7fe23e091700 1 -- start start 2023-10-24T00:29:01.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe23e091700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2380c6710 0x7fe2380c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe23e091700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2380aa3f0 0x7fe238069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe23e091700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380aa820 con 0x7fe2380aa010 2023-10-24T00:29:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe23e091700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2380c0960 con 0x7fe2380c6710 2023-10-24T00:29:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe23e091700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2380c0c40 con 0x7fe2380aa3f0 2023-10-24T00:29:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2380c6710 0x7fe2380c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2380c6710 0x7fe2380c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59164/0 (socket says 172.21.15.148:59164) 2023-10-24T00:29:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe2377fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe2380aa010 0x7fe238158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45710/0 (socket says 172.21.15.148:45710) 2023-10-24T00:29:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 -- 172.21.15.148:0/744635266 learned_addr learned my addr 172.21.15.148:0/744635266 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe237fff700 1 --2- 172.21.15.148:0/744635266 >> v2:172.21.15.150:3300/0 conn(0x7fe2380aa3f0 0x7fe238069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 -- 172.21.15.148:0/744635266 >> v2:172.21.15.150:3300/0 conn(0x7fe2380aa3f0 msgr2=0x7fe238069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 --2- 172.21.15.148:0/744635266 >> v2:172.21.15.150:3300/0 conn(0x7fe2380aa3f0 0x7fe238069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 -- 172.21.15.148:0/744635266 >> v1:172.21.15.148:6789/0 conn(0x7fe2380aa010 legacy=0x7fe238158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe2367fc700 1 -- 172.21.15.148:0/744635266 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525661511 0 0) 0x7fe2380aa820 con 0x7fe2380aa010 2023-10-24T00:29:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 -- 172.21.15.148:0/744635266 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380c0f20 con 0x7fe2380c6710 2023-10-24T00:29:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe236ffd700 1 --2- 172.21.15.148:0/744635266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380c6710 0x7fe2380c1a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe238158e80 tx=0x7fe2280090f0).ready entity=mon.0 client_cookie=2d82d2be19a8d6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe2367fc700 1 -- 172.21.15.148:0/744635266 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800b600 con 0x7fe2380c6710 2023-10-24T00:29:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe2367fc700 1 -- 172.21.15.148:0/744635266 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22800b760 con 0x7fe2380c6710 2023-10-24T00:29:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.428+0000 7fe2367fc700 1 -- 172.21.15.148:0/744635266 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800bae0 con 0x7fe2380c6710 2023-10-24T00:29:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 -- 172.21.15.148:0/744635266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380c6710 msgr2=0x7fe2380c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 --2- 172.21.15.148:0/744635266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380c6710 0x7fe2380c1a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fe238158e80 tx=0x7fe2280090f0).stop 2023-10-24T00:29:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 -- 172.21.15.148:0/744635266 shutdown_connections 2023-10-24T00:29:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 --2- 172.21.15.148:0/744635266 >> v2:172.21.15.150:3300/0 conn(0x7fe2380aa3f0 0x7fe238069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 --2- 172.21.15.148:0/744635266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380c6710 0x7fe2380c1a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 -- 172.21.15.148:0/744635266 >> 172.21.15.148:0/744635266 conn(0x7fe2380caf40 msgr2=0x7fe2380cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 -- 172.21.15.148:0/744635266 shutdown_connections 2023-10-24T00:29:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.429+0000 7fe23e091700 1 -- 172.21.15.148:0/744635266 wait complete. 2023-10-24T00:29:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.430+0000 7fe23e091700 1 Processor -- start 2023-10-24T00:29:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.430+0000 7fe23e091700 1 -- start start 2023-10-24T00:29:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2380aa3f0 0x7fe238156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2380c6710 0x7fe238156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe238165720 con 0x7fe2380aa010 2023-10-24T00:29:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe238157370 con 0x7fe2380aa3f0 2023-10-24T00:29:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe23e091700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe238168520 con 0x7fe2380c6710 2023-10-24T00:29:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59166/0 (socket says 172.21.15.148:59166) 2023-10-24T00:29:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 -- 172.21.15.148:0/2707644199 learned_addr learned my addr 172.21.15.148:0/2707644199 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 -- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2380c6710 msgr2=0x7fe238156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe236ffd700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2380aa3f0 0x7fe238156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2380c6710 0x7fe238156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 -- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2380aa3f0 msgr2=0x7fe238156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2380aa3f0 0x7fe238156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 -- 172.21.15.148:0/2707644199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228009370 con 0x7fe2380aa010 2023-10-24T00:29:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.431+0000 7fe2377fe700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe22c00c560 tx=0x7fe22c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.432+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0072e0 con 0x7fe2380aa010 2023-10-24T00:29:01.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.432+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c007440 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.432+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c005930 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.432+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2380afbd0 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.432+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe238167ed0 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.433+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23806c6b0 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.433+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe22c005d20 con 0x7fe2380aa010 2023-10-24T00:29:01.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.433+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 0x7fe224061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.433+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe22c0799f0 con 0x7fe2380aa010 2023-10-24T00:29:01.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.433+0000 7fe236ffd700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 0x7fe224061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.434+0000 7fe236ffd700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 0x7fe224061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe2380b0ef0 tx=0x7fe228017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.437+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe22c04ad70 con 0x7fe2380aa010 2023-10-24T00:29:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.601+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2380c1200 con 0x7fe2380aa010 2023-10-24T00:29:01.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.601+0000 7fe21f7fe700 1 -- 172.21.15.148:0/2707644199 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fe22c04e390 con 0x7fe2380aa010 2023-10-24T00:29:01.603 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:01.604 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:01.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 msgr2=0x7fe224061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 0x7fe224061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe2380b0ef0 tx=0x7fe228017000).stop 2023-10-24T00:29:01.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 msgr2=0x7fe2380c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe22c00c560 tx=0x7fe22c007c90).stop 2023-10-24T00:29:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 shutdown_connections 2023-10-24T00:29:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2380c6710 0x7fe238156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe22405f150 0x7fe224061610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2380aa010 0x7fe2380c3710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 --2- 172.21.15.148:0/2707644199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2380aa3f0 0x7fe238156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 >> 172.21.15.148:0/2707644199 conn(0x7fe2380caf40 msgr2=0x7fe238153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 shutdown_connections 2023-10-24T00:29:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.603+0000 7fe23e091700 1 -- 172.21.15.148:0/2707644199 wait complete. 2023-10-24T00:29:01.617 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-24T00:29:01.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:01.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.730+0000 7fb5a4043700 1 Processor -- start 2023-10-24T00:29:01.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.730+0000 7fb5a4043700 1 -- start start 2023-10-24T00:29:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 0x7fb59c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb59c0c6710 0x7fb59c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0aa8e0 con 0x7fb59c0c6710 2023-10-24T00:29:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0c0960 con 0x7fb59c0aa010 2023-10-24T00:29:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a4043700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0c0c40 con 0x7fb59c158770 2023-10-24T00:29:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.731+0000 7fb5a15de700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb59c0c6710 0x7fb59c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb59c0c6710 0x7fb59c0aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59178/0 (socket says 172.21.15.148:59178) 2023-10-24T00:29:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 -- 172.21.15.148:0/2015001848 learned_addr learned my addr 172.21.15.148:0/2015001848 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a25e0700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a1ddf700 1 --2- 172.21.15.148:0/2015001848 >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 0x7fb59c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 -- 172.21.15.148:0/2015001848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 msgr2=0x7fb59c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 -- 172.21.15.148:0/2015001848 >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 msgr2=0x7fb59c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2015001848 >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 0x7fb59c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 -- 172.21.15.148:0/2015001848 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0c0f20 con 0x7fb59c0c6710 2023-10-24T00:29:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a1ddf700 1 --2- 172.21.15.148:0/2015001848 >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 0x7fb59c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0aa3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb59c083e30 tx=0x7fb58c0090f0).ready entity=mon.0 client_cookie=eab6961f479ed07 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a0ddd700 1 -- 172.21.15.148:0/2015001848 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00b520 con 0x7fb59c0c6710 2023-10-24T00:29:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a0ddd700 1 -- 172.21.15.148:0/2015001848 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00b680 con 0x7fb59c0c6710 2023-10-24T00:29:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.732+0000 7fb5a0ddd700 1 -- 172.21.15.148:0/2015001848 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00ba00 con 0x7fb59c0c6710 2023-10-24T00:29:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 -- 172.21.15.148:0/2015001848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 msgr2=0x7fb59c0aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0aa3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb59c083e30 tx=0x7fb58c0090f0).stop 2023-10-24T00:29:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 -- 172.21.15.148:0/2015001848 shutdown_connections 2023-10-24T00:29:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2015001848 >> v2:172.21.15.150:3300/0 conn(0x7fb59c0aa010 0x7fb59c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2015001848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0aa3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 -- 172.21.15.148:0/2015001848 >> 172.21.15.148:0/2015001848 conn(0x7fb59c0caf40 msgr2=0x7fb59c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 -- 172.21.15.148:0/2015001848 shutdown_connections 2023-10-24T00:29:01.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.733+0000 7fb5a4043700 1 -- 172.21.15.148:0/2015001848 wait complete. 2023-10-24T00:29:01.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.734+0000 7fb5a4043700 1 Processor -- start 2023-10-24T00:29:01.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.734+0000 7fb5a4043700 1 -- start start 2023-10-24T00:29:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c0aa010 0x7fb59c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c154bf0 con 0x7fb59c0c6710 2023-10-24T00:29:01.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0c2430 con 0x7fb59c0aa010 2023-10-24T00:29:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0c2710 con 0x7fb59c158770 2023-10-24T00:29:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59184/0 (socket says 172.21.15.148:59184) 2023-10-24T00:29:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 -- 172.21.15.148:0/2154254374 learned_addr learned my addr 172.21.15.148:0/2154254374 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:01.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a1ddf700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c0aa010 0x7fb59c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a25e0700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 -- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 msgr2=0x7fb59c1435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c1435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 -- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c0aa010 msgr2=0x7fb59c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c0aa010 0x7fb59c157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 -- 172.21.15.148:0/2154254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009370 con 0x7fb59c0c6710 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a15de700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb59c084230 tx=0x7fb58c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c000bc0 con 0x7fb59c0c6710 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00b7f0 con 0x7fb59c0c6710 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c000d20 con 0x7fb59c0c6710 2023-10-24T00:29:01.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.735+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c0c29f0 con 0x7fb59c0c6710 2023-10-24T00:29:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.736+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c0c1fe0 con 0x7fb59c0c6710 2023-10-24T00:29:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.737+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c06c6b0 con 0x7fb59c0c6710 2023-10-24T00:29:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.737+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb58c01c8c0 con 0x7fb59c0c6710 2023-10-24T00:29:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.737+0000 7fb591ffb700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 0x7fb5800615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:01.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.738+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb58c07bd90 con 0x7fb59c0c6710 2023-10-24T00:29:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.738+0000 7fb5a1ddf700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 0x7fb5800615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.738+0000 7fb5a1ddf700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 0x7fb5800615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb598006fd0 tx=0x7fb598008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:01.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.742+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb58c04d060 con 0x7fb59c0c6710 2023-10-24T00:29:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.904+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb59c0c1200 con 0x7fb59c0c6710 2023-10-24T00:29:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.905+0000 7fb591ffb700 1 -- 172.21.15.148:0/2154254374 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb58c02a030 con 0x7fb59c0c6710 2023-10-24T00:29:01.907 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:01.907 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 msgr2=0x7fb5800615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 0x7fb5800615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb598006fd0 tx=0x7fb598008040).stop 2023-10-24T00:29:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 msgr2=0x7fb59c0ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb59c084230 tx=0x7fb58c017000).stop 2023-10-24T00:29:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 shutdown_connections 2023-10-24T00:29:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c158770 0x7fb59c1435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c0aa010 0x7fb59c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58005f120 0x7fb5800615e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 --2- 172.21.15.148:0/2154254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c0c6710 0x7fb59c0ca1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 >> 172.21.15.148:0/2154254374 conn(0x7fb59c0caf40 msgr2=0x7fb59c152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 shutdown_connections 2023-10-24T00:29:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:01.907+0000 7fb5a4043700 1 -- 172.21.15.148:0/2154254374 wait complete. 2023-10-24T00:29:01.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-24T00:29:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.036+0000 7f521130e700 1 Processor -- start 2023-10-24T00:29:02.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.036+0000 7f521130e700 1 -- start start 2023-10-24T00:29:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f521130e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f520c152280 0x7f520c0a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f521130e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f520c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f521130e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0c3f10 con 0x7f520c0c6260 2023-10-24T00:29:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f521130e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0a87c0 con 0x7f520c152280 2023-10-24T00:29:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f521130e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0c5330 con 0x7f520c0be9c0 2023-10-24T00:29:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520a7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f520c0c6260 0x7f520c0c4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45712/0 (socket says 172.21.15.148:45712) 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520a7fc700 1 -- 172.21.15.148:0/846528367 learned_addr learned my addr 172.21.15.148:0/846528367 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520b7fe700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f520c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520affd700 1 --2- 172.21.15.148:0/846528367 >> v2:172.21.15.150:3300/0 conn(0x7f520c152280 0x7f520c0a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860879330 0 0) 0x7f520c0c3f10 con 0x7f520c0c6260 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40033f0 con 0x7f520c0c6260 2023-10-24T00:29:02.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069818156 0 0) 0x7f51f40033f0 con 0x7f520c0c6260 2023-10-24T00:29:02.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 msgr2=0x7f520c0bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f520c0bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 >> v2:172.21.15.150:3300/0 conn(0x7f520c152280 msgr2=0x7f520c0a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 --2- 172.21.15.148:0/846528367 >> v2:172.21.15.150:3300/0 conn(0x7f520c152280 0x7f520c0a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0bf300 con 0x7f520c0c6260 2023-10-24T00:29:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f5200001470 con 0x7f520c0c6260 2023-10-24T00:29:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 >> v1:172.21.15.148:6789/0 conn(0x7f520c0c6260 legacy=0x7f520c0c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f40038e0 0x7f51f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f4004690 0x7f51f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f51f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0a87c0 con 0x7f51f4004690 2023-10-24T00:29:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0c5330 con 0x7f51f40038e0 2023-10-24T00:29:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400b8e0 con 0x7f520c0be9c0 2023-10-24T00:29:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520a7fc700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f4004690 0x7f51f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.037+0000 7f520affd700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f40038e0 0x7f51f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520b7fe700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f51f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 -- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 msgr2=0x7f51f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f520c0be9c0 0x7f51f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 -- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f40038e0 msgr2=0x7f51f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51f40038e0 0x7f51f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 -- 172.21.15.148:0/846528367 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40033f0 con 0x7f51f4004690 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520a7fc700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f4004690 0x7f51f4004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f520000c210 tx=0x7f5200001e90).ready entity=mon.0 client_cookie=e55ea0943989e431 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200007a60 con 0x7f51f4004690 2023-10-24T00:29:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000cae0 con 0x7f51f4004690 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f5209ffb700 1 -- 172.21.15.148:0/846528367 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000ce60 con 0x7f51f4004690 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f521130e700 1 -- 172.21.15.148:0/846528367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f4004690 msgr2=0x7f51f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f521130e700 1 --2- 172.21.15.148:0/846528367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51f4004690 0x7f51f4004b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f520000c210 tx=0x7f5200001e90).stop 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f520b7fe700 1 -- 172.21.15.148:0/846528367 reap_dead start 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f521130e700 1 -- 172.21.15.148:0/846528367 shutdown_connections 2023-10-24T00:29:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f521130e700 1 -- 172.21.15.148:0/846528367 >> 172.21.15.148:0/846528367 conn(0x7f520c082f60 msgr2=0x7f520c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.038+0000 7f521130e700 1 -- 172.21.15.148:0/846528367 shutdown_connections 2023-10-24T00:29:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.039+0000 7f521130e700 1 -- 172.21.15.148:0/846528367 wait complete. 2023-10-24T00:29:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.040+0000 7f521130e700 1 Processor -- start 2023-10-24T00:29:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.040+0000 7f521130e700 1 -- start start 2023-10-24T00:29:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.040+0000 7f521130e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f4004690 0x7f520c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.040+0000 7f521130e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 0x7f520c063be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c0abe40 0x7f520c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0a90e0 con 0x7f520c063760 2023-10-24T00:29:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1428a0 con 0x7f520c0abe40 2023-10-24T00:29:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0640d0 con 0x7f51f4004690 2023-10-24T00:29:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 0x7f520c063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 0x7f520c063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59198/0 (socket says 172.21.15.148:59198) 2023-10-24T00:29:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 -- 172.21.15.148:0/3685605336 learned_addr learned my addr 172.21.15.148:0/3685605336 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520affd700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f4004690 0x7f520c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520b7fe700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c0abe40 0x7f520c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 -- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f4004690 msgr2=0x7f520c1423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51f4004690 0x7f520c1423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 -- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c0abe40 msgr2=0x7f520c0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c0abe40 0x7f520c0ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c064370 con 0x7f520c063760 2023-10-24T00:29:02.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520b7fe700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f520c0abe40 0x7f520c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f520a7fc700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 0x7f520c063be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f520000cab0 tx=0x7f5200015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200007640 con 0x7f520c063760 2023-10-24T00:29:02.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52000046b0 con 0x7f520c063760 2023-10-24T00:29:02.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200004a70 con 0x7f520c063760 2023-10-24T00:29:02.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c064650 con 0x7f520c063760 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.041+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c064c10 con 0x7f520c063760 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.042+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f520c06c6b0 con 0x7f520c063760 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.042+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5200020450 con 0x7f520c063760 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f51f2ffd700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51f805f150 0x7f51f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f520007aeb0 con 0x7f520c063760 2023-10-24T00:29:02.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f520affd700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51f805f150 0x7f51f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f51f2ffd700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7f51f80684f0 0x7f51f806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51f806afd0 con 0x7f51f80684f0 2023-10-24T00:29:02.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f520007d4d0 con 0x7f520c063760 2023-10-24T00:29:02.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f520b7fe700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7f51f80684f0 0x7f51f806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f520affd700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51f805f150 0x7f51f8061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f51fc006d20 tx=0x7f51fc006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.043+0000 7f520b7fe700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7f51f80684f0 0x7f51f806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.044+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== osd.0 v2:172.21.15.148:6800/87828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f51f806afd0 con 0x7f51f80684f0 2023-10-24T00:29:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 --> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f520c064f80 con 0x7f51f80684f0 2023-10-24T00:29:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f51f2ffd700 1 -- 172.21.15.148:0/3685605336 <== osd.0 v2:172.21.15.148:6800/87828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5204009e90 con 0x7f51f80684f0 2023-10-24T00:29:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7f51f80684f0 msgr2=0x7f51f806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7f51f80684f0 0x7f51f806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51f805f150 msgr2=0x7f51f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51f805f150 0x7f51f8061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f51fc006d20 tx=0x7f51fc006f40).stop 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 msgr2=0x7f520c063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 --2- 172.21.15.148:0/3685605336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f520c063760 0x7f520c063be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f520000cab0 tx=0x7f5200015000).stop 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f520b7fe700 1 -- 172.21.15.148:0/3685605336 reap_dead start 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 shutdown_connections 2023-10-24T00:29:02.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 >> 172.21.15.148:0/3685605336 conn(0x7f520c082f60 msgr2=0x7f520c0a6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 shutdown_connections 2023-10-24T00:29:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.058+0000 7f521130e700 1 -- 172.21.15.148:0/3685605336 wait complete. 2023-10-24T00:29:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:02.072 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-24T00:29:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.184+0000 7f2d613f8700 1 Processor -- start 2023-10-24T00:29:02.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.184+0000 7f2d613f8700 1 -- start start 2023-10-24T00:29:02.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d613f8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 0x7f2d5c0a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d613f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d5c062a30 0x7f2d5c062e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d613f8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c0a9db0 con 0x7f2d5c062650 2023-10-24T00:29:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d613f8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c150da0 con 0x7f2d5c062a30 2023-10-24T00:29:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d613f8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c064da0 con 0x7f2d5c0a7c80 2023-10-24T00:29:02.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d5b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d5c062a30 0x7f2d5c062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d5affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2d5c062650 0x7f2d5c0aa610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45714/0 (socket says 172.21.15.148:45714) 2023-10-24T00:29:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d5affd700 1 -- 172.21.15.148:0/681433705 learned_addr learned my addr 172.21.15.148:0/681433705 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.185+0000 7f2d527fc700 1 --2- 172.21.15.148:0/681433705 >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 0x7f2d5c0a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5b7fe700 1 -- 172.21.15.148:0/681433705 >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 msgr2=0x7f2d5c0a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5b7fe700 1 --2- 172.21.15.148:0/681433705 >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 0x7f2d5c0a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5b7fe700 1 -- 172.21.15.148:0/681433705 >> v1:172.21.15.148:6789/0 conn(0x7f2d5c062650 legacy=0x7f2d5c0aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5a7fc700 1 -- 172.21.15.148:0/681433705 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471356259 0 0) 0x7f2d4c001110 con 0x7f2d5c062650 2023-10-24T00:29:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5b7fe700 1 -- 172.21.15.148:0/681433705 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c065c00 con 0x7f2d5c062a30 2023-10-24T00:29:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d527fc700 1 --2- 172.21.15.148:0/681433705 >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 0x7f2d5c0a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5b7fe700 1 --2- 172.21.15.148:0/681433705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062a30 0x7f2d5c062e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2d5c0643d0 tx=0x7f2d54009780).ready entity=mon.0 client_cookie=2985324ea93f6414 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5a7fc700 1 -- 172.21.15.148:0/681433705 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400e070 con 0x7f2d5c062a30 2023-10-24T00:29:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5a7fc700 1 -- 172.21.15.148:0/681433705 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400bc30 con 0x7f2d5c062a30 2023-10-24T00:29:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d5a7fc700 1 -- 172.21.15.148:0/681433705 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012410 con 0x7f2d5c062a30 2023-10-24T00:29:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 -- 172.21.15.148:0/681433705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062a30 msgr2=0x7f2d5c062e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 --2- 172.21.15.148:0/681433705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062a30 0x7f2d5c062e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2d5c0643d0 tx=0x7f2d54009780).stop 2023-10-24T00:29:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 -- 172.21.15.148:0/681433705 shutdown_connections 2023-10-24T00:29:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 --2- 172.21.15.148:0/681433705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062a30 0x7f2d5c062e30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 --2- 172.21.15.148:0/681433705 >> v2:172.21.15.150:3300/0 conn(0x7f2d5c0a7c80 0x7f2d5c0a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 -- 172.21.15.148:0/681433705 >> 172.21.15.148:0/681433705 conn(0x7f2d5c0c3f60 msgr2=0x7f2d5c0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 -- 172.21.15.148:0/681433705 shutdown_connections 2023-10-24T00:29:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.186+0000 7f2d613f8700 1 -- 172.21.15.148:0/681433705 wait complete. 2023-10-24T00:29:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 Processor -- start 2023-10-24T00:29:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 -- start start 2023-10-24T00:29:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 0x7f2d5c150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d5c062a30 0x7f2d5c0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d5c0a7c80 0x7f2d5c14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0a6820 con 0x7f2d5c062650 2023-10-24T00:29:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1501a0 con 0x7f2d5c0a7c80 2023-10-24T00:29:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.188+0000 7f2d613f8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c14f600 con 0x7f2d5c062a30 2023-10-24T00:29:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 0x7f2d5c150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 0x7f2d5c150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59212/0 (socket says 172.21.15.148:59212) 2023-10-24T00:29:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 -- 172.21.15.148:0/1779303802 learned_addr learned my addr 172.21.15.148:0/1779303802 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d527fc700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d5c062a30 0x7f2d5c0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5b7fe700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d5c0a7c80 0x7f2d5c14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 -- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d5c062a30 msgr2=0x7f2d5c0ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d5c062a30 0x7f2d5c0ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 -- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d5c0a7c80 msgr2=0x7f2d5c14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d5c0a7c80 0x7f2d5c14d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54009a20 con 0x7f2d5c062650 2023-10-24T00:29:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d5affd700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 0x7f2d5c150630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2d4c001eb0 tx=0x7f2d4c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0070d0 con 0x7f2d5c062650 2023-10-24T00:29:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c007230 con 0x7f2d5c062650 2023-10-24T00:29:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c14f870 con 0x7f2d5c062650 2023-10-24T00:29:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0075d0 con 0x7f2d5c062650 2023-10-24T00:29:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.189+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c14fe30 con 0x7f2d5c062650 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.190+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d5c06c6b0 con 0x7f2d5c062650 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.190+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2d4c005bc0 con 0x7f2d5c062650 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d537fe700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3c05f120 0x7f2d3c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d4c0798a0 con 0x7f2d5c062650 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d527fc700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3c05f120 0x7f2d3c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d537fe700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f2d3c0684c0 0x7f2d3c06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d3c06afa0 con 0x7f2d3c0684c0 2023-10-24T00:29:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d4c07e220 con 0x7f2d5c062650 2023-10-24T00:29:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d5b7fe700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f2d3c0684c0 0x7f2d3c06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d527fc700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3c05f120 0x7f2d3c0615e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2d5c1490c0 tx=0x7f2d44008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.191+0000 7f2d5b7fe700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f2d3c0684c0 0x7f2d3c06a920 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.192+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== osd.1 v2:172.21.15.148:6816/87851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2d3c06afa0 con 0x7f2d3c0684c0 2023-10-24T00:29:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 --> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d5c0a9db0 con 0x7f2d3c0684c0 2023-10-24T00:29:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d537fe700 1 -- 172.21.15.148:0/1779303802 <== osd.1 v2:172.21.15.148:6816/87851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d5c0a9db0 con 0x7f2d3c0684c0 2023-10-24T00:29:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f2d3c0684c0 msgr2=0x7f2d3c06a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f2d3c0684c0 0x7f2d3c06a920 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3c05f120 msgr2=0x7f2d3c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3c05f120 0x7f2d3c0615e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2d5c1490c0 tx=0x7f2d44008040).stop 2023-10-24T00:29:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 msgr2=0x7f2d5c150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d613f8700 1 --2- 172.21.15.148:0/1779303802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d5c062650 0x7f2d5c150630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2d4c001eb0 tx=0x7f2d4c007e90).stop 2023-10-24T00:29:02.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.206+0000 7f2d5b7fe700 1 -- 172.21.15.148:0/1779303802 reap_dead start 2023-10-24T00:29:02.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.207+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 shutdown_connections 2023-10-24T00:29:02.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.207+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 >> 172.21.15.148:0/1779303802 conn(0x7f2d5c0c3f60 msgr2=0x7f2d5c0c6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.207+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 shutdown_connections 2023-10-24T00:29:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.207+0000 7f2d613f8700 1 -- 172.21.15.148:0/1779303802 wait complete. 2023-10-24T00:29:02.219 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:02.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-24T00:29:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.332+0000 7f805092c700 1 Processor -- start 2023-10-24T00:29:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.332+0000 7f805092c700 1 -- start start 2023-10-24T00:29:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f805092c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f804c0a8540 0x7f804c0641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f805092c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0befa0 0x7f804c0c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f805092c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c06a960 con 0x7f804c0c56c0 2023-10-24T00:29:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f805092c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c065640 con 0x7f804c0a8540 2023-10-24T00:29:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f805092c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c064a30 con 0x7f804c0befa0 2023-10-24T00:29:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f804a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f804c0a8540 0x7f804c0641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f8041d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f804c0c56c0 0x7f804c0be890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45724/0 (socket says 172.21.15.148:45724) 2023-10-24T00:29:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f8041d9b700 1 -- 172.21.15.148:0/3108586735 learned_addr learned my addr 172.21.15.148:0/3108586735 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.333+0000 7f804ad9d700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0befa0 0x7f804c0c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f804a59c700 1 -- 172.21.15.148:0/3108586735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0befa0 msgr2=0x7f804c0c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f804a59c700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0befa0 0x7f804c0c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f804a59c700 1 -- 172.21.15.148:0/3108586735 >> v1:172.21.15.148:6789/0 conn(0x7f804c0c56c0 legacy=0x7f804c0be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f8049d9b700 1 -- 172.21.15.148:0/3108586735 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951423986 0 0) 0x7f804c06a960 con 0x7f804c0c56c0 2023-10-24T00:29:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f804a59c700 1 -- 172.21.15.148:0/3108586735 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c064d10 con 0x7f804c0a8540 2023-10-24T00:29:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f804a59c700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0a8540 0x7f804c0641e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f803c006fd0 tx=0x7f803c006f40).ready entity=mon.0 client_cookie=51fe816d6fcdccdb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f8049d9b700 1 -- 172.21.15.148:0/3108586735 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c005880 con 0x7f804c0a8540 2023-10-24T00:29:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f8049d9b700 1 -- 172.21.15.148:0/3108586735 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c0059e0 con 0x7f804c0a8540 2023-10-24T00:29:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f8049d9b700 1 -- 172.21.15.148:0/3108586735 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c005d60 con 0x7f804c0a8540 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 -- 172.21.15.148:0/3108586735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0a8540 msgr2=0x7f804c0641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0a8540 0x7f804c0641e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f803c006fd0 tx=0x7f803c006f40).stop 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 -- 172.21.15.148:0/3108586735 shutdown_connections 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0befa0 0x7f804c0c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 --2- 172.21.15.148:0/3108586735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0a8540 0x7f804c0641e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 -- 172.21.15.148:0/3108586735 >> 172.21.15.148:0/3108586735 conn(0x7f804c082f60 msgr2=0x7f804c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 -- 172.21.15.148:0/3108586735 shutdown_connections 2023-10-24T00:29:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.334+0000 7f805092c700 1 -- 172.21.15.148:0/3108586735 wait complete. 2023-10-24T00:29:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 Processor -- start 2023-10-24T00:29:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 -- start start 2023-10-24T00:29:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f804c0a8540 0x7f804c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 0x7f804c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0c56c0 0x7f804c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c150ec0 con 0x7f804c0befa0 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c151a40 con 0x7f804c0a8540 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f805092c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c151110 con 0x7f804c0c56c0 2023-10-24T00:29:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.336+0000 7f8041d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 0x7f804c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 0x7f804c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59232/0 (socket says 172.21.15.148:59232) 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 -- 172.21.15.148:0/2905506922 learned_addr learned my addr 172.21.15.148:0/2905506922 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f804a59c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f804c0a8540 0x7f804c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f804ad9d700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0c56c0 0x7f804c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 -- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0c56c0 msgr2=0x7f804c14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0c56c0 0x7f804c14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 -- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f804c0a8540 msgr2=0x7f804c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f804c0a8540 0x7f804c14d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009250 con 0x7f804c0befa0 2023-10-24T00:29:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f804a59c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f804c0a8540 0x7f804c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f804ad9d700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f804c0c56c0 0x7f804c14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8041d9b700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 0x7f804c14df90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f803400c4e0 tx=0x7f8034007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340072e0 con 0x7f804c0befa0 2023-10-24T00:29:02.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034007440 con 0x7f804c0befa0 2023-10-24T00:29:02.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340057a0 con 0x7f804c0befa0 2023-10-24T00:29:02.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c1513f0 con 0x7f804c0befa0 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.337+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c14d590 con 0x7f804c0befa0 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.338+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f804c14d750 con 0x7f804c0befa0 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.338+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8034005bd0 con 0x7f804c0befa0 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f8042ffd700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f802c05f150 0x7f802c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8034079b20 con 0x7f804c0befa0 2023-10-24T00:29:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f804a59c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f802c05f150 0x7f802c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f8042ffd700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f802c0684f0 0x7f802c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f802c06afd0 con 0x7f802c0684f0 2023-10-24T00:29:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f803407e220 con 0x7f804c0befa0 2023-10-24T00:29:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f804ad9d700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f802c0684f0 0x7f802c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f804ad9d700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f802c0684f0 0x7f802c06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.339+0000 7f804a59c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f802c05f150 0x7f802c061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f803c006f80 tx=0x7f803c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.340+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== osd.2 v2:172.21.15.148:6824/87869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f802c06afd0 con 0x7f802c0684f0 2023-10-24T00:29:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 --> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f804c06c6b0 con 0x7f802c0684f0 2023-10-24T00:29:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f8042ffd700 1 -- 172.21.15.148:0/2905506922 <== osd.2 v2:172.21.15.148:6824/87869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f804c06c6b0 con 0x7f802c0684f0 2023-10-24T00:29:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f802c0684f0 msgr2=0x7f802c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f802c0684f0 0x7f802c06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f802c05f150 msgr2=0x7f802c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f802c05f150 0x7f802c061610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f803c006f80 tx=0x7f803c016000).stop 2023-10-24T00:29:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 msgr2=0x7f804c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 --2- 172.21.15.148:0/2905506922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f804c0befa0 0x7f804c14df90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f803400c4e0 tx=0x7f8034007c70).stop 2023-10-24T00:29:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f804ad9d700 1 -- 172.21.15.148:0/2905506922 reap_dead start 2023-10-24T00:29:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 shutdown_connections 2023-10-24T00:29:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 >> 172.21.15.148:0/2905506922 conn(0x7f804c082f60 msgr2=0x7f804c0be450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 shutdown_connections 2023-10-24T00:29:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.354+0000 7f805092c700 1 -- 172.21.15.148:0/2905506922 wait complete. 2023-10-24T00:29:02.367 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:02.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-24T00:29:02.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.480+0000 7f3171579700 1 Processor -- start 2023-10-24T00:29:02.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.480+0000 7f3171579700 1 -- start start 2023-10-24T00:29:02.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3171579700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f316c0c0de0 0x7f316c15ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3171579700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c0a7de0 con 0x7f316c154580 2023-10-24T00:29:02.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3171579700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c0c8840 con 0x7f316c1541a0 2023-10-24T00:29:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3171579700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c0aa7c0 con 0x7f316c0c0de0 2023-10-24T00:29:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f316c0c0de0 0x7f316c15ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f316b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f316c154580 0x7f316c0c06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45734/0 (socket says 172.21.15.148:45734) 2023-10-24T00:29:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f316b7fe700 1 -- 172.21.15.148:0/3505011886 learned_addr learned my addr 172.21.15.148:0/3505011886 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f316c0c0de0 0x7f316c15ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59242/0 (socket says 172.21.15.148:59242) 2023-10-24T00:29:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 -- 172.21.15.148:0/3505011886 >> v1:172.21.15.150:6789/0 conn(0x7f316c1541a0 legacy=0x7f316c0c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 -- 172.21.15.148:0/3505011886 >> v1:172.21.15.148:6789/0 conn(0x7f316c154580 legacy=0x7f316c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 -- 172.21.15.148:0/3505011886 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c0a9f20 con 0x7f316c0c0de0 2023-10-24T00:29:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f316affd700 1 -- 172.21.15.148:0/3505011886 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036673932 0 0) 0x7f316c0a7de0 con 0x7f316c154580 2023-10-24T00:29:02.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.481+0000 7f3170d78700 1 --2- 172.21.15.148:0/3505011886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c0c0de0 0x7f316c15ef70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3164009e60 tx=0x7f3164009780).ready entity=mon.0 client_cookie=4051fa4f8aca520e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f316affd700 1 -- 172.21.15.148:0/3505011886 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400e070 con 0x7f316c0c0de0 2023-10-24T00:29:02.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f316affd700 1 -- 172.21.15.148:0/3505011886 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400bc30 con 0x7f316c0c0de0 2023-10-24T00:29:02.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f316affd700 1 -- 172.21.15.148:0/3505011886 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164012410 con 0x7f316c0c0de0 2023-10-24T00:29:02.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 -- 172.21.15.148:0/3505011886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c0c0de0 msgr2=0x7f316c15ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 --2- 172.21.15.148:0/3505011886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c0c0de0 0x7f316c15ef70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3164009e60 tx=0x7f3164009780).stop 2023-10-24T00:29:02.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 -- 172.21.15.148:0/3505011886 shutdown_connections 2023-10-24T00:29:02.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 --2- 172.21.15.148:0/3505011886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c0c0de0 0x7f316c15ef70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 -- 172.21.15.148:0/3505011886 >> 172.21.15.148:0/3505011886 conn(0x7f316c0944f0 msgr2=0x7f316c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 -- 172.21.15.148:0/3505011886 shutdown_connections 2023-10-24T00:29:02.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.482+0000 7f3171579700 1 -- 172.21.15.148:0/3505011886 wait complete. 2023-10-24T00:29:02.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.483+0000 7f3171579700 1 Processor -- start 2023-10-24T00:29:02.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.483+0000 7f3171579700 1 -- start start 2023-10-24T00:29:02.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0c0de0 0x7f316c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 0x7f316c14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f316c154580 0x7f316c0c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c9ea0 con 0x7f316c1541a0 2023-10-24T00:29:02.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c14f210 con 0x7f316c0c0de0 2023-10-24T00:29:02.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3171579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0ca0f0 con 0x7f316c154580 2023-10-24T00:29:02.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 0x7f316c14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 0x7f316c14e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59256/0 (socket says 172.21.15.148:59256) 2023-10-24T00:29:02.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 -- 172.21.15.148:0/1900134632 learned_addr learned my addr 172.21.15.148:0/1900134632 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f3170d78700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f316c154580 0x7f316c0c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316bfff700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0c0de0 0x7f316c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 -- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f316c154580 msgr2=0x7f316c0c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f316c154580 0x7f316c0c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 -- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0c0de0 msgr2=0x7f316c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0c0de0 0x7f316c0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.484+0000 7f316b7fe700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164009a20 con 0x7f316c1541a0 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f316b7fe700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 0x7f316c14e600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3160001eb0 tx=0x7f3160007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600072e0 con 0x7f316c1541a0 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160007440 con 0x7f316c1541a0 2023-10-24T00:29:02.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c0ca3d0 con 0x7f316c1541a0 2023-10-24T00:29:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600057a0 con 0x7f316c1541a0 2023-10-24T00:29:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.485+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c0cac70 con 0x7f316c1541a0 2023-10-24T00:29:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f316c047480 con 0x7f316c1541a0 2023-10-24T00:29:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3160005b90 con 0x7f316c1541a0 2023-10-24T00:29:02.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f315805f150 0x7f3158061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3160079960 con 0x7f316c1541a0 2023-10-24T00:29:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7f31580684f0 0x7f315806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f315806afd0 con 0x7f31580684f0 2023-10-24T00:29:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f316007e220 con 0x7f316c1541a0 2023-10-24T00:29:02.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.486+0000 7f316bfff700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f315805f150 0x7f3158061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.487+0000 7f3170d78700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7f31580684f0 0x7f315806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.487+0000 7f3170d78700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7f31580684f0 0x7f315806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.487+0000 7f316bfff700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f315805f150 0x7f3158061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f316c0c9c60 tx=0x7f315c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.487+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== osd.3 v2:172.21.15.148:6808/87837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f315806afd0 con 0x7f31580684f0 2023-10-24T00:29:02.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 --> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f316c0cae90 con 0x7f31580684f0 2023-10-24T00:29:02.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3153fff700 1 -- 172.21.15.148:0/1900134632 <== osd.3 v2:172.21.15.148:6808/87837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f316c0cae90 con 0x7f31580684f0 2023-10-24T00:29:02.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7f31580684f0 msgr2=0x7f315806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7f31580684f0 0x7f315806a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f315805f150 msgr2=0x7f3158061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f315805f150 0x7f3158061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f316c0c9c60 tx=0x7f315c008040).stop 2023-10-24T00:29:02.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 msgr2=0x7f316c14e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 --2- 172.21.15.148:0/1900134632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f316c1541a0 0x7f316c14e600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f3160001eb0 tx=0x7f3160007e90).stop 2023-10-24T00:29:02.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3170d78700 1 -- 172.21.15.148:0/1900134632 reap_dead start 2023-10-24T00:29:02.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 shutdown_connections 2023-10-24T00:29:02.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 >> 172.21.15.148:0/1900134632 conn(0x7f316c0944f0 msgr2=0x7f316c063cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 shutdown_connections 2023-10-24T00:29:02.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.502+0000 7f3171579700 1 -- 172.21.15.148:0/1900134632 wait complete. 2023-10-24T00:29:02.515 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:02.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-24T00:29:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.629+0000 7f1cced30700 1 Processor -- start 2023-10-24T00:29:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.629+0000 7f1cced30700 1 -- start start 2023-10-24T00:29:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc8154400 0x7f1cc80c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1cc81547e0 0x7f1cc80a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80a82c0 0x7f1cc80c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc80aa960 con 0x7f1cc8154400 2023-10-24T00:29:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc80c01c0 con 0x7f1cc81547e0 2023-10-24T00:29:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cced30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80c6150 con 0x7f1cc80a82c0 2023-10-24T00:29:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc8154400 0x7f1cc80c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc8154400 0x7f1cc80c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59264/0 (socket says 172.21.15.148:59264) 2023-10-24T00:29:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 -- 172.21.15.148:0/299483166 learned_addr learned my addr 172.21.15.148:0/299483166 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cc7fff700 1 --2- 172.21.15.148:0/299483166 >> v2:172.21.15.150:3300/0 conn(0x7f1cc81547e0 0x7f1cc80a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1ccd2cd700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80a82c0 0x7f1cc80c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 -- 172.21.15.148:0/299483166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80a82c0 msgr2=0x7f1cc80c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80a82c0 0x7f1cc80c0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 -- 172.21.15.148:0/299483166 >> v2:172.21.15.150:3300/0 conn(0x7f1cc81547e0 msgr2=0x7f1cc80a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 --2- 172.21.15.148:0/299483166 >> v2:172.21.15.150:3300/0 conn(0x7f1cc81547e0 0x7f1cc80a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.630+0000 7f1cccacc700 1 -- 172.21.15.148:0/299483166 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80c66f0 con 0x7f1cc8154400 2023-10-24T00:29:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cccacc700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80c8310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1cc8085bc0 tx=0x7f1cb8009840).ready entity=mon.0 client_cookie=bb1fc54f5929849d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cc77fe700 1 -- 172.21.15.148:0/299483166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800e070 con 0x7f1cc8154400 2023-10-24T00:29:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cc77fe700 1 -- 172.21.15.148:0/299483166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800b970 con 0x7f1cc8154400 2023-10-24T00:29:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cc77fe700 1 -- 172.21.15.148:0/299483166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800bcf0 con 0x7f1cc8154400 2023-10-24T00:29:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 -- 172.21.15.148:0/299483166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 msgr2=0x7f1cc80c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80c8310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1cc8085bc0 tx=0x7f1cb8009840).stop 2023-10-24T00:29:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 -- 172.21.15.148:0/299483166 shutdown_connections 2023-10-24T00:29:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80c8310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 --2- 172.21.15.148:0/299483166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80a82c0 0x7f1cc80c0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 --2- 172.21.15.148:0/299483166 >> v2:172.21.15.150:3300/0 conn(0x7f1cc81547e0 0x7f1cc80a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 -- 172.21.15.148:0/299483166 >> 172.21.15.148:0/299483166 conn(0x7f1cc80946a0 msgr2=0x7f1cc806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 -- 172.21.15.148:0/299483166 shutdown_connections 2023-10-24T00:29:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.631+0000 7f1cced30700 1 -- 172.21.15.148:0/299483166 wait complete. 2023-10-24T00:29:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.632+0000 7f1cced30700 1 Processor -- start 2023-10-24T00:29:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 -- start start 2023-10-24T00:29:02.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80a82c0 0x7f1cc8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc81547e0 0x7f1cc8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80afe80 con 0x7f1cc8154400 2023-10-24T00:29:02.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8168a60 con 0x7f1cc80a82c0 2023-10-24T00:29:02.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cced30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8152f40 con 0x7f1cc81547e0 2023-10-24T00:29:02.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cc7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59268/0 (socket says 172.21.15.148:59268) 2023-10-24T00:29:02.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cc7fff700 1 -- 172.21.15.148:0/2822973419 learned_addr learned my addr 172.21.15.148:0/2822973419 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1cccacc700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80a82c0 0x7f1cc8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.633+0000 7f1ccd2cd700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc81547e0 0x7f1cc8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 -- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc81547e0 msgr2=0x7f1cc8157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc81547e0 0x7f1cc8157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 -- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80a82c0 msgr2=0x7f1cc8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80a82c0 0x7f1cc8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009ae0 con 0x7f1cc8154400 2023-10-24T00:29:02.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cccacc700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80a82c0 0x7f1cc8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc7fff700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80af990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1cbc00e900 tx=0x7f1cbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00c640 con 0x7f1cc8154400 2023-10-24T00:29:02.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00c7a0 con 0x7f1cc8154400 2023-10-24T00:29:02.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc8157d10 con 0x7f1cc8154400 2023-10-24T00:29:02.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00cb20 con 0x7f1cc8154400 2023-10-24T00:29:02.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.634+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc81534c0 con 0x7f1cc8154400 2023-10-24T00:29:02.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.635+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cc8168830 con 0x7f1cc8154400 2023-10-24T00:29:02.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.635+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1cbc01b400 con 0x7f1cc8154400 2023-10-24T00:29:02.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.635+0000 7f1cc4ff9700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cb405f120 0x7f1cb40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1cbc07a620 con 0x7f1cc8154400 2023-10-24T00:29:02.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cccacc700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cb405f120 0x7f1cb40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cc4ff9700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f1cb4068540 0x7f1cb406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cb406b020 con 0x7f1cb4068540 2023-10-24T00:29:02.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cbc07cb40 con 0x7f1cc8154400 2023-10-24T00:29:02.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1ccd2cd700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f1cb4068540 0x7f1cb406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1cccacc700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cb405f120 0x7f1cb40615e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1cc8085760 tx=0x7f1cb8009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.636+0000 7f1ccd2cd700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f1cb4068540 0x7f1cb406a9a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.637+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== osd.4 v2:172.21.15.150:6800/88069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1cb406b020 con 0x7f1cb4068540 2023-10-24T00:29:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.651+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 --> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cc81536e0 con 0x7f1cb4068540 2023-10-24T00:29:02.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.651+0000 7f1cc4ff9700 1 -- 172.21.15.148:0/2822973419 <== osd.4 v2:172.21.15.150:6800/88069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1cc81536e0 con 0x7f1cb4068540 2023-10-24T00:29:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f1cb4068540 msgr2=0x7f1cb406a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f1cb4068540 0x7f1cb406a9a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cb405f120 msgr2=0x7f1cb40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cb405f120 0x7f1cb40615e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1cc8085760 tx=0x7f1cb8009840).stop 2023-10-24T00:29:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 msgr2=0x7f1cc80af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 --2- 172.21.15.148:0/2822973419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc8154400 0x7f1cc80af990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1cbc00e900 tx=0x7f1cbc009060).stop 2023-10-24T00:29:02.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1ccd2cd700 1 -- 172.21.15.148:0/2822973419 reap_dead start 2023-10-24T00:29:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 shutdown_connections 2023-10-24T00:29:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 >> 172.21.15.148:0/2822973419 conn(0x7f1cc80946a0 msgr2=0x7f1cc80ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 shutdown_connections 2023-10-24T00:29:02.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.652+0000 7f1cced30700 1 -- 172.21.15.148:0/2822973419 wait complete. 2023-10-24T00:29:02.665 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:02.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-24T00:29:02.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.778+0000 7f709bfff700 1 Processor -- start 2023-10-24T00:29:02.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.778+0000 7f709bfff700 1 -- start start 2023-10-24T00:29:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f709c0c4090 0x7f709c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709bfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c066670 con 0x7f709c13a970 2023-10-24T00:29:02.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c34b0 con 0x7f709c069270 2023-10-24T00:29:02.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709bfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c32c0 con 0x7f709c0c4090 2023-10-24T00:29:02.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f70927fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f709c0c4090 0x7f709c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f709c13a970 0x7f709c0c2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45748/0 (socket says 172.21.15.148:45748) 2023-10-24T00:29:02.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f70927fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f709c0c4090 0x7f709c067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59278/0 (socket says 172.21.15.148:59278) 2023-10-24T00:29:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709affd700 1 -- 172.21.15.148:0/1362586782 learned_addr learned my addr 172.21.15.148:0/1362586782 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709a7fc700 1 -- 172.21.15.148:0/1362586782 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189263086 0 0) 0x7f709c066670 con 0x7f709c13a970 2023-10-24T00:29:02.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.779+0000 7f709a7fc700 1 -- 172.21.15.148:0/1362586782 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70880033f0 con 0x7f709c13a970 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f70927fc700 1 -- 172.21.15.148:0/1362586782 >> v1:172.21.15.150:6789/0 conn(0x7f709c069270 legacy=0x7f709c069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f70927fc700 1 -- 172.21.15.148:0/1362586782 >> v1:172.21.15.148:6789/0 conn(0x7f709c13a970 legacy=0x7f709c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f70927fc700 1 -- 172.21.15.148:0/1362586782 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0671d0 con 0x7f709c0c4090 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f70927fc700 1 --2- 172.21.15.148:0/1362586782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c067660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7084010c90 tx=0x7f70840090f0).ready entity=mon.0 client_cookie=72d2872dec095b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709a7fc700 1 -- 172.21.15.148:0/1362586782 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708400bb70 con 0x7f709c0c4090 2023-10-24T00:29:02.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709a7fc700 1 -- 172.21.15.148:0/1362586782 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708400bcd0 con 0x7f709c0c4090 2023-10-24T00:29:02.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709a7fc700 1 -- 172.21.15.148:0/1362586782 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084019650 con 0x7f709c0c4090 2023-10-24T00:29:02.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 -- 172.21.15.148:0/1362586782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 msgr2=0x7f709c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 --2- 172.21.15.148:0/1362586782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c067660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7084010c90 tx=0x7f70840090f0).stop 2023-10-24T00:29:02.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 -- 172.21.15.148:0/1362586782 shutdown_connections 2023-10-24T00:29:02.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 --2- 172.21.15.148:0/1362586782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c067660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 -- 172.21.15.148:0/1362586782 >> 172.21.15.148:0/1362586782 conn(0x7f709c0c7ba0 msgr2=0x7f709c0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 -- 172.21.15.148:0/1362586782 shutdown_connections 2023-10-24T00:29:02.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.780+0000 7f709bfff700 1 -- 172.21.15.148:0/1362586782 wait complete. 2023-10-24T00:29:02.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 Processor -- start 2023-10-24T00:29:02.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 -- start start 2023-10-24T00:29:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f709c069270 0x7f709c150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f709c13a970 0x7f709c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1563b0 con 0x7f709c0c4090 2023-10-24T00:29:02.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c155a80 con 0x7f709c13a970 2023-10-24T00:29:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f709bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c155d60 con 0x7f709c069270 2023-10-24T00:29:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f70927fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f70927fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c1538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59282/0 (socket says 172.21.15.148:59282) 2023-10-24T00:29:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.782+0000 7f70927fc700 1 -- 172.21.15.148:0/1928808769 learned_addr learned my addr 172.21.15.148:0/1928808769 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709affd700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f709c069270 0x7f709c150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709b7fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f709c13a970 0x7f709c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 -- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f709c069270 msgr2=0x7f709c150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f709c069270 0x7f709c150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 -- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f709c13a970 msgr2=0x7f709c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f709c13a970 0x7f709c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840107d0 con 0x7f709c0c4090 2023-10-24T00:29:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709b7fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f709c13a970 0x7f709c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709affd700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f709c069270 0x7f709c150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70927fc700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c1538c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7084012010 tx=0x7f7084019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840185b0 con 0x7f709c0c4090 2023-10-24T00:29:02.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084018730 con 0x7f709c0c4090 2023-10-24T00:29:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c156040 con 0x7f709c0c4090 2023-10-24T00:29:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084018af0 con 0x7f709c0c4090 2023-10-24T00:29:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.783+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c137d80 con 0x7f709c0c4090 2023-10-24T00:29:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.784+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f709c047480 con 0x7f709c0c4090 2023-10-24T00:29:02.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.784+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7084023430 con 0x7f709c0c4090 2023-10-24T00:29:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f70937fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f707c05f150 0x7f707c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f708407f900 con 0x7f709c0c4090 2023-10-24T00:29:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f709affd700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f707c05f150 0x7f707c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f70937fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7f707c0684f0 0x7f707c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f707c06afd0 con 0x7f707c0684f0 2023-10-24T00:29:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7084084220 con 0x7f709c0c4090 2023-10-24T00:29:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f709b7fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7f707c0684f0 0x7f707c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f709affd700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f707c05f150 0x7f707c061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f708c007fd0 tx=0x7f708c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.785+0000 7f709b7fe700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7f707c0684f0 0x7f707c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.786+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== osd.5 v2:172.21.15.150:6808/88070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f707c06afd0 con 0x7f707c0684f0 2023-10-24T00:29:02.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.800+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 --> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f709c1564f0 con 0x7f707c0684f0 2023-10-24T00:29:02.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f70937fe700 1 -- 172.21.15.148:0/1928808769 <== osd.5 v2:172.21.15.150:6808/88070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f709c1564f0 con 0x7f707c0684f0 2023-10-24T00:29:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7f707c0684f0 msgr2=0x7f707c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7f707c0684f0 0x7f707c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f707c05f150 msgr2=0x7f707c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f707c05f150 0x7f707c061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f708c007fd0 tx=0x7f708c009040).stop 2023-10-24T00:29:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 msgr2=0x7f709c1538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 --2- 172.21.15.148:0/1928808769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f709c0c4090 0x7f709c1538c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7084012010 tx=0x7f7084019000).stop 2023-10-24T00:29:02.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709b7fe700 1 -- 172.21.15.148:0/1928808769 reap_dead start 2023-10-24T00:29:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 shutdown_connections 2023-10-24T00:29:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 >> 172.21.15.148:0/1928808769 conn(0x7f709c0c7ba0 msgr2=0x7f709c0bcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 shutdown_connections 2023-10-24T00:29:02.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.801+0000 7f709bfff700 1 -- 172.21.15.148:0/1928808769 wait complete. 2023-10-24T00:29:02.814 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:02.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-24T00:29:02.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.928+0000 7f0ff9347700 1 Processor -- start 2023-10-24T00:29:02.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.928+0000 7f0ff9347700 1 -- start start 2023-10-24T00:29:02.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.928+0000 7f0ff9347700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ff4154400 0x7f0ff40c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff9347700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0ff40a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff9347700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40c01c0 con 0x7f0ff40a82c0 2023-10-24T00:29:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff9347700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40aa960 con 0x7f0ff4154400 2023-10-24T00:29:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff9347700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c66f0 con 0x7f0ff41547e0 2023-10-24T00:29:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0ff40a82c0 0x7f0ff40c0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45762/0 (socket says 172.21.15.148:45762) 2023-10-24T00:29:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff37fe700 1 -- 172.21.15.148:0/3996851553 learned_addr learned my addr 172.21.15.148:0/3996851553 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0ff40a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/3996851553 >> v2:172.21.15.150:3300/0 conn(0x7f0ff4154400 0x7f0ff40c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507289083 0 0) 0x7f0ff40c01c0 con 0x7f0ff40a82c0 2023-10-24T00:29:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe00033f0 con 0x7f0ff40a82c0 2023-10-24T00:29:02.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623903813 0 0) 0x7f0fe00033f0 con 0x7f0ff40a82c0 2023-10-24T00:29:02.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 msgr2=0x7f0ff40a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0ff40a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 >> v2:172.21.15.150:3300/0 conn(0x7f0ff4154400 msgr2=0x7f0ff40c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 --2- 172.21.15.148:0/3996851553 >> v2:172.21.15.150:3300/0 conn(0x7f0ff4154400 0x7f0ff40c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40c6150 con 0x7f0ff40a82c0 2023-10-24T00:29:02.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f0fe4001470 con 0x7f0ff40a82c0 2023-10-24T00:29:02.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 >> v1:172.21.15.148:6789/0 conn(0x7f0ff40a82c0 legacy=0x7f0ff40c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0fe00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fe0003e10 0x7f0fe0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe0004b80 0x7f0fe0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40aa960 con 0x7f0fe0003e10 2023-10-24T00:29:02.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c66f0 con 0x7f0fe0004b80 2023-10-24T00:29:02.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe000b8e0 con 0x7f0ff41547e0 2023-10-24T00:29:02.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fe0003e10 0x7f0fe0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.929+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0fe00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff37fe700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe0004b80 0x7f0fe0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 -- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 msgr2=0x7f0fe00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ff41547e0 0x7f0fe00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 -- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe0004b80 msgr2=0x7f0fe0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe0004b80 0x7f0fe0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 -- 172.21.15.148:0/3996851553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00033f0 con 0x7f0fe0003e10 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fe0003e10 0x7f0fe0004690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0ff4085450 tx=0x7f0fdc009060).ready entity=mon.0 client_cookie=bae54edddda73312 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc009430 con 0x7f0fe0003e10 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc009e70 con 0x7f0fe0003e10 2023-10-24T00:29:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff1ffb700 1 -- 172.21.15.148:0/3996851553 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00e850 con 0x7f0fe0003e10 2023-10-24T00:29:02.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff9347700 1 -- 172.21.15.148:0/3996851553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fe0003e10 msgr2=0x7f0fe0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff9347700 1 --2- 172.21.15.148:0/3996851553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fe0003e10 0x7f0fe0004690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0ff4085450 tx=0x7f0fdc009060).stop 2023-10-24T00:29:02.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.930+0000 7f0ff37fe700 1 -- 172.21.15.148:0/3996851553 reap_dead start 2023-10-24T00:29:02.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.931+0000 7f0ff9347700 1 -- 172.21.15.148:0/3996851553 shutdown_connections 2023-10-24T00:29:02.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.931+0000 7f0ff9347700 1 -- 172.21.15.148:0/3996851553 >> 172.21.15.148:0/3996851553 conn(0x7f0ff40946a0 msgr2=0x7f0ff406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.931+0000 7f0ff9347700 1 -- 172.21.15.148:0/3996851553 shutdown_connections 2023-10-24T00:29:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.931+0000 7f0ff9347700 1 -- 172.21.15.148:0/3996851553 wait complete. 2023-10-24T00:29:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.932+0000 7f0ff9347700 1 Processor -- start 2023-10-24T00:29:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.932+0000 7f0ff9347700 1 -- start start 2023-10-24T00:29:02.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe0003e10 0x7f0ff40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 0x7f0ff413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff413e080 0x7f0ff40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c4eb0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c2b40 con 0x7f0ff413e080 2023-10-24T00:29:02.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40c2210 con 0x7f0fe0003e10 2023-10-24T00:29:02.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 0x7f0ff413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 0x7f0ff413db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59302/0 (socket says 172.21.15.148:59302) 2023-10-24T00:29:02.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 -- 172.21.15.148:0/1533458924 learned_addr learned my addr 172.21.15.148:0/1533458924 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe0003e10 0x7f0ff40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff37fe700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff413e080 0x7f0ff40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 -- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe0003e10 msgr2=0x7f0ff40b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe0003e10 0x7f0ff40b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 -- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff413e080 msgr2=0x7f0ff40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ff413e080 0x7f0ff40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40c24f0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe0003e10 0x7f0ff40b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff27fc700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 0x7f0ff413db90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0fdc00e4b0 tx=0x7f0fdc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc009430 con 0x7f0ff40c46c0 2023-10-24T00:29:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc01dd30 con 0x7f0ff40c46c0 2023-10-24T00:29:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40c27d0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc01dea0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.933+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff40afac0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.934+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ff406c6b0 con 0x7f0ff40c46c0 2023-10-24T00:29:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0fdc01b930 con 0x7f0ff40c46c0 2023-10-24T00:29:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0fd405f120 0x7f0fd40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0fdc07bf70 con 0x7f0ff40c46c0 2023-10-24T00:29:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7f0fd40684c0 0x7f0fd406a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd406afa0 con 0x7f0fd40684c0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fdc07e590 con 0x7f0ff40c46c0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0fd405f120 0x7f0fd40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.935+0000 7f0ff37fe700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7f0fd40684c0 0x7f0fd406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.936+0000 7f0ff2ffd700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0fd405f120 0x7f0fd40615e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0fec0094d0 tx=0x7f0fec00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.936+0000 7f0ff37fe700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7f0fd40684c0 0x7f0fd406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.936+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== osd.6 v2:172.21.15.150:6824/88100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0fd406afa0 con 0x7f0fd40684c0 2023-10-24T00:29:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.951+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 --> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ff40aa3a0 con 0x7f0fd40684c0 2023-10-24T00:29:02.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.951+0000 7f0feaffd700 1 -- 172.21.15.148:0/1533458924 <== osd.6 v2:172.21.15.150:6824/88100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ff40aa3a0 con 0x7f0fd40684c0 2023-10-24T00:29:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7f0fd40684c0 msgr2=0x7f0fd406a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7f0fd40684c0 0x7f0fd406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0fd405f120 msgr2=0x7f0fd40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0fd405f120 0x7f0fd40615e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0fec0094d0 tx=0x7f0fec00b040).stop 2023-10-24T00:29:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 msgr2=0x7f0ff413db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 --2- 172.21.15.148:0/1533458924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ff40c46c0 0x7f0ff413db90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f0fdc00e4b0 tx=0x7f0fdc019000).stop 2023-10-24T00:29:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff37fe700 1 -- 172.21.15.148:0/1533458924 reap_dead start 2023-10-24T00:29:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 shutdown_connections 2023-10-24T00:29:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 >> 172.21.15.148:0/1533458924 conn(0x7f0ff40946a0 msgr2=0x7f0ff40acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 shutdown_connections 2023-10-24T00:29:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:02.952+0000 7f0ff9347700 1 -- 172.21.15.148:0/1533458924 wait complete. 2023-10-24T00:29:02.964 INFO:teuthology.orchestra.run.smithi148.stdout:55834574854 2023-10-24T00:29:02.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-24T00:29:03.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.077+0000 7f27365f2700 1 Processor -- start 2023-10-24T00:29:03.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.077+0000 7f27365f2700 1 -- start start 2023-10-24T00:29:03.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f27365f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27300a7e50 0x7f27300c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f27365f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27300be9c0 0x7f27300bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f27365f2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300c3f10 con 0x7f2730152280 2023-10-24T00:29:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f27365f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300a82d0 con 0x7f27300a7e50 2023-10-24T00:29:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f27365f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300a87c0 con 0x7f27300be9c0 2023-10-24T00:29:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f272f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f27300a7e50 0x7f27300c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f272ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2730152280 0x7f27300c6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45776/0 (socket says 172.21.15.148:45776) 2023-10-24T00:29:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.078+0000 7f272ffff700 1 -- 172.21.15.148:0/761848309 learned_addr learned my addr 172.21.15.148:0/761848309 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f2734b8f700 1 --2- 172.21.15.148:0/761848309 >> v2:172.21.15.150:3300/0 conn(0x7f27300be9c0 0x7f27300bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272f7fe700 1 -- 172.21.15.148:0/761848309 >> v2:172.21.15.150:3300/0 conn(0x7f27300be9c0 msgr2=0x7f27300bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272f7fe700 1 --2- 172.21.15.148:0/761848309 >> v2:172.21.15.150:3300/0 conn(0x7f27300be9c0 0x7f27300bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272f7fe700 1 -- 172.21.15.148:0/761848309 >> v1:172.21.15.148:6789/0 conn(0x7f2730152280 legacy=0x7f27300c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272f7fe700 1 -- 172.21.15.148:0/761848309 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300a84e0 con 0x7f27300a7e50 2023-10-24T00:29:03.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272effd700 1 -- 172.21.15.148:0/761848309 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956270372 0 0) 0x7f27300c3f10 con 0x7f2730152280 2023-10-24T00:29:03.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272f7fe700 1 --2- 172.21.15.148:0/761848309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27300a7e50 0x7f27300c4c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f273006a5a0 tx=0x7f2724009060).ready entity=mon.0 client_cookie=ce3382387689f1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272effd700 1 -- 172.21.15.148:0/761848309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400b580 con 0x7f27300a7e50 2023-10-24T00:29:03.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272effd700 1 -- 172.21.15.148:0/761848309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400b6e0 con 0x7f27300a7e50 2023-10-24T00:29:03.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f272effd700 1 -- 172.21.15.148:0/761848309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400ba60 con 0x7f27300a7e50 2023-10-24T00:29:03.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 -- 172.21.15.148:0/761848309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27300a7e50 msgr2=0x7f27300c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 --2- 172.21.15.148:0/761848309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27300a7e50 0x7f27300c4c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f273006a5a0 tx=0x7f2724009060).stop 2023-10-24T00:29:03.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 -- 172.21.15.148:0/761848309 shutdown_connections 2023-10-24T00:29:03.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 --2- 172.21.15.148:0/761848309 >> v2:172.21.15.150:3300/0 conn(0x7f27300be9c0 0x7f27300bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 --2- 172.21.15.148:0/761848309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27300a7e50 0x7f27300c4c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 -- 172.21.15.148:0/761848309 >> 172.21.15.148:0/761848309 conn(0x7f2730082f60 msgr2=0x7f2730062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:03.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 -- 172.21.15.148:0/761848309 shutdown_connections 2023-10-24T00:29:03.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.079+0000 7f27365f2700 1 -- 172.21.15.148:0/761848309 wait complete. 2023-10-24T00:29:03.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.080+0000 7f27365f2700 1 Processor -- start 2023-10-24T00:29:03.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 -- start start 2023-10-24T00:29:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27300a7e50 0x7f2730152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300be9c0 0x7f27300c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 0x7f27300c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c29f0 con 0x7f2730152280 2023-10-24T00:29:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300aa470 con 0x7f27300be9c0 2023-10-24T00:29:03.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f27365f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300a98a0 con 0x7f27300a7e50 2023-10-24T00:29:03.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f2734b8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 0x7f27300c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f2734b8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 0x7f27300c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59318/0 (socket says 172.21.15.148:59318) 2023-10-24T00:29:03.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.081+0000 7f2734b8f700 1 -- 172.21.15.148:0/3166412221 learned_addr learned my addr 172.21.15.148:0/3166412221 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:03.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f272f7fe700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300be9c0 0x7f27300c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 -- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27300a7e50 msgr2=0x7f2730152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27300a7e50 0x7f2730152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:03.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 -- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300be9c0 msgr2=0x7f27300c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27300be9c0 0x7f27300c00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240092a0 con 0x7f2730152280 2023-10-24T00:29:03.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2734b8f700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 0x7f27300c1f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f272800ceb0 tx=0x7f2728007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800ae40 con 0x7f2730152280 2023-10-24T00:29:03.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728016400 con 0x7f2730152280 2023-10-24T00:29:03.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728016780 con 0x7f2730152280 2023-10-24T00:29:03.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27300a9ad0 con 0x7f2730152280 2023-10-24T00:29:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.082+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27300aa090 con 0x7f2730152280 2023-10-24T00:29:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.083+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2730154f90 con 0x7f2730152280 2023-10-24T00:29:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.083+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2728009030 con 0x7f2730152280 2023-10-24T00:29:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f2717fff700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f271c05f150 0x7f271c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f272807aa40 con 0x7f2730152280 2023-10-24T00:29:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f2717fff700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f271c0684f0 0x7f271c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f272ffff700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f271c05f150 0x7f271c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f271c06afd0 con 0x7f271c0684f0 2023-10-24T00:29:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272807f220 con 0x7f2730152280 2023-10-24T00:29:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f272f7fe700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f271c0684f0 0x7f271c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f272ffff700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f271c05f150 0x7f271c061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2720001560 tx=0x7f2720007690).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.084+0000 7f272f7fe700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f271c0684f0 0x7f271c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.085+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== osd.7 v2:172.21.15.150:6816/88101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f271c06afd0 con 0x7f271c0684f0 2023-10-24T00:29:03.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.099+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 --> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27300aa5b0 con 0x7f271c0684f0 2023-10-24T00:29:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f2717fff700 1 -- 172.21.15.148:0/3166412221 <== osd.7 v2:172.21.15.150:6816/88101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27300aa5b0 con 0x7f271c0684f0 2023-10-24T00:29:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f271c0684f0 msgr2=0x7f271c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f271c0684f0 0x7f271c06a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f271c05f150 msgr2=0x7f271c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f271c05f150 0x7f271c061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2720001560 tx=0x7f2720007690).stop 2023-10-24T00:29:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 msgr2=0x7f27300c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 --2- 172.21.15.148:0/3166412221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2730152280 0x7f27300c1f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f272800ceb0 tx=0x7f2728007870).stop 2023-10-24T00:29:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f2734b8f700 1 -- 172.21.15.148:0/3166412221 reap_dead start 2023-10-24T00:29:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 shutdown_connections 2023-10-24T00:29:03.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 >> 172.21.15.148:0/3166412221 conn(0x7f2730082f60 msgr2=0x7f273014ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:03.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 shutdown_connections 2023-10-24T00:29:03.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.100+0000 7f27365f2700 1 -- 172.21.15.148:0/3166412221 wait complete. 2023-10-24T00:29:03.113 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:03.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-24T00:29:03.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.226+0000 7fc555430700 1 Processor -- start 2023-10-24T00:29:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.226+0000 7fc555430700 1 -- start start 2023-10-24T00:29:03.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc555430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 0x7fc550154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc555430700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc550155090 0x7fc55015de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc555430700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500c21a0 con 0x7fc55014e8b0 2023-10-24T00:29:03.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc555430700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500c2d20 con 0x7fc550155090 2023-10-24T00:29:03.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc555430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500c31b0 con 0x7fc550062d60 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc550155090 0x7fc55015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc54ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc55014e8b0 0x7fc550062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45782/0 (socket says 172.21.15.148:45782) 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc54ffff700 1 -- 172.21.15.148:0/4162722611 learned_addr learned my addr 172.21.15.148:0/4162722611 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc54f7fe700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 0x7fc550154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 -- 172.21.15.148:0/4162722611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 msgr2=0x7fc550154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 0x7fc550154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 -- 172.21.15.148:0/4162722611 >> v1:172.21.15.148:6789/0 conn(0x7fc55014e8b0 legacy=0x7fc550062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc54effd700 1 -- 172.21.15.148:0/4162722611 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528170742 0 0) 0x7fc5500c21a0 con 0x7fc55014e8b0 2023-10-24T00:29:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 -- 172.21.15.148:0/4162722611 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500c23f0 con 0x7fc550155090 2023-10-24T00:29:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc54f7fe700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 0x7fc550154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.227+0000 7fc554c2f700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc55015de20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc548009e60 tx=0x7fc548009780).ready entity=mon.0 client_cookie=563bdceb0f5b7bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc54effd700 1 -- 172.21.15.148:0/4162722611 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800e070 con 0x7fc550155090 2023-10-24T00:29:03.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc54effd700 1 -- 172.21.15.148:0/4162722611 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800bc30 con 0x7fc550155090 2023-10-24T00:29:03.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc54effd700 1 -- 172.21.15.148:0/4162722611 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012410 con 0x7fc550155090 2023-10-24T00:29:03.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 -- 172.21.15.148:0/4162722611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 msgr2=0x7fc55015de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc55015de20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc548009e60 tx=0x7fc548009780).stop 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 -- 172.21.15.148:0/4162722611 shutdown_connections 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc55015de20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 --2- 172.21.15.148:0/4162722611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc550062d60 0x7fc550154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 -- 172.21.15.148:0/4162722611 >> 172.21.15.148:0/4162722611 conn(0x7fc5500c7ba0 msgr2=0x7fc5500c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 -- 172.21.15.148:0/4162722611 shutdown_connections 2023-10-24T00:29:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.228+0000 7fc555430700 1 -- 172.21.15.148:0/4162722611 wait complete. 2023-10-24T00:29:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.229+0000 7fc555430700 1 Processor -- start 2023-10-24T00:29:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.229+0000 7fc555430700 1 -- start start 2023-10-24T00:29:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc550062d60 0x7fc5500ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc55014e8b0 0x7fc5500aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500ab490 con 0x7fc550155090 2023-10-24T00:29:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500ab770 con 0x7fc550062d60 2023-10-24T00:29:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc555430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500aba50 con 0x7fc55014e8b0 2023-10-24T00:29:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc554c2f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc554c2f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59340/0 (socket says 172.21.15.148:59340) 2023-10-24T00:29:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc554c2f700 1 -- 172.21.15.148:0/2918699010 learned_addr learned my addr 172.21.15.148:0/2918699010 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc54f7fe700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc55014e8b0 0x7fc5500aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc54ffff700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc550062d60 0x7fc5500ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc554c2f700 1 -- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc55014e8b0 msgr2=0x7fc5500aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.230+0000 7fc554c2f700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc55014e8b0 0x7fc5500aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc554c2f700 1 -- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc550062d60 msgr2=0x7fc5500ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc554c2f700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc550062d60 0x7fc5500ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc554c2f700 1 -- 172.21.15.148:0/2918699010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009a20 con 0x7fc550155090 2023-10-24T00:29:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc554c2f700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc550068e80 tx=0x7fc548009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012410 con 0x7fc550155090 2023-10-24T00:29:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800b6f0 con 0x7fc550155090 2023-10-24T00:29:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5500abd30 con 0x7fc550155090 2023-10-24T00:29:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548011c80 con 0x7fc550155090 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.231+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55014db30 con 0x7fc550155090 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.232+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5500ac250 con 0x7fc550155090 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.232+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc548003040 con 0x7fc550155090 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.233+0000 7fc537fff700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 0x7fc53c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.233+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc54807c040 con 0x7fc550155090 2023-10-24T00:29:03.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.233+0000 7fc54ffff700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 0x7fc53c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.233+0000 7fc54ffff700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 0x7fc53c061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc540007fd0 tx=0x7fc540007db0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.237+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc5500ac250 con 0x7fc550155090 2023-10-24T00:29:03.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.401+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5500ac250 con 0x7fc550155090 2023-10-24T00:29:03.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.401+0000 7fc537fff700 1 -- 172.21.15.148:0/2918699010 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5500ac250 con 0x7fc550155090 2023-10-24T00:29:03.403 INFO:teuthology.orchestra.run.smithi148.stdout:55834574853 2023-10-24T00:29:03.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 msgr2=0x7fc53c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 0x7fc53c061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc540007fd0 tx=0x7fc540007db0).stop 2023-10-24T00:29:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 msgr2=0x7fc550066ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc550068e80 tx=0x7fc548009780).stop 2023-10-24T00:29:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 shutdown_connections 2023-10-24T00:29:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc53c05f150 0x7fc53c061610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc550155090 0x7fc550066ac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc550062d60 0x7fc5500ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 --2- 172.21.15.148:0/2918699010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc55014e8b0 0x7fc5500aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 >> 172.21.15.148:0/2918699010 conn(0x7fc5500c7ba0 msgr2=0x7fc5500bcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.403+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 shutdown_connections 2023-10-24T00:29:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:03.404+0000 7fc555430700 1 -- 172.21.15.148:0/2918699010 wait complete. 2023-10-24T00:29:03.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2023-10-24T00:29:04.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-24T00:29:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.533+0000 7ff9cbfff700 1 Processor -- start 2023-10-24T00:29:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.533+0000 7ff9cbfff700 1 -- start start 2023-10-24T00:29:04.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9cbfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9cc154a90 0x7ff9cc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9cbfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc06a860 con 0x7ff9cc0c0810 2023-10-24T00:29:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9cbfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0c9d90 con 0x7ff9cc154a90 2023-10-24T00:29:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9cbfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0c9180 con 0x7ff9cc154e70 2023-10-24T00:29:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9cc154a90 0x7ff9cc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9cc154a90 0x7ff9cc155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53148/0 (socket says 172.21.15.148:53148) 2023-10-24T00:29:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 -- 172.21.15.148:0/3678632276 learned_addr learned my addr 172.21.15.148:0/3678632276 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9c27fc700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 -- 172.21.15.148:0/3678632276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 msgr2=0x7ff9cc1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 -- 172.21.15.148:0/3678632276 >> v1:172.21.15.150:6789/0 conn(0x7ff9cc0c0810 legacy=0x7ff9cc0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 -- 172.21.15.148:0/3678632276 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0c9460 con 0x7ff9cc154a90 2023-10-24T00:29:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.534+0000 7ff9caffd700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc155a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff9bc006fd0 tx=0x7ff9bc0090f0).ready entity=mon.0 client_cookie=f1aa5b79881167a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9ca7fc700 1 -- 172.21.15.148:0/3678632276 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00b600 con 0x7ff9cc154a90 2023-10-24T00:29:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9ca7fc700 1 -- 172.21.15.148:0/3678632276 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc00b760 con 0x7ff9cc154a90 2023-10-24T00:29:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9ca7fc700 1 -- 172.21.15.148:0/3678632276 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00bae0 con 0x7ff9cc154a90 2023-10-24T00:29:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 -- 172.21.15.148:0/3678632276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 msgr2=0x7ff9cc155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc155a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff9bc006fd0 tx=0x7ff9bc0090f0).stop 2023-10-24T00:29:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 -- 172.21.15.148:0/3678632276 shutdown_connections 2023-10-24T00:29:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc155a90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/3678632276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 -- 172.21.15.148:0/3678632276 >> 172.21.15.148:0/3678632276 conn(0x7ff9cc084c20 msgr2=0x7ff9cc094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 -- 172.21.15.148:0/3678632276 shutdown_connections 2023-10-24T00:29:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.535+0000 7ff9cbfff700 1 -- 172.21.15.148:0/3678632276 wait complete. 2023-10-24T00:29:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.536+0000 7ff9cbfff700 1 Processor -- start 2023-10-24T00:29:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.536+0000 7ff9cbfff700 1 -- start start 2023-10-24T00:29:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9cc0c0810 0x7ff9cc150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0ade50 con 0x7ff9cc154a90 2023-10-24T00:29:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc165960 con 0x7ff9cc0c0810 2023-10-24T00:29:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cbfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc151170 con 0x7ff9cc154e70 2023-10-24T00:29:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53150/0 (socket says 172.21.15.148:53150) 2023-10-24T00:29:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 -- 172.21.15.148:0/2264184883 learned_addr learned my addr 172.21.15.148:0/2264184883 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9cb7fe700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9caffd700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9cc0c0810 0x7ff9cc150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 -- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 msgr2=0x7ff9cc155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 -- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9cc0c0810 msgr2=0x7ff9cc150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.537+0000 7ff9c27fc700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9cc0c0810 0x7ff9cc150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9c27fc700 1 -- 172.21.15.148:0/2264184883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009370 con 0x7ff9cc154a90 2023-10-24T00:29:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9c27fc700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff9b400d890 tx=0x7ff9b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40125f0 con 0x7ff9cc154a90 2023-10-24T00:29:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4012750 con 0x7ff9cc154a90 2023-10-24T00:29:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1652b0 con 0x7ff9cc154a90 2023-10-24T00:29:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4012ad0 con 0x7ff9cc154a90 2023-10-24T00:29:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.538+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc0ae060 con 0x7ff9cc154a90 2023-10-24T00:29:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.539+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc047480 con 0x7ff9cc154a90 2023-10-24T00:29:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.539+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff9b4013480 con 0x7ff9cc154a90 2023-10-24T00:29:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.539+0000 7ff9c37fe700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 0x7ff9ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.540+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff9b407a2e0 con 0x7ff9cc154a90 2023-10-24T00:29:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.540+0000 7ff9caffd700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 0x7ff9ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.540+0000 7ff9caffd700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 0x7ff9ac061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff9bc009130 tx=0x7ff9bc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.544+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff9b404b550 con 0x7ff9cc154a90 2023-10-24T00:29:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.708+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9cc0c9740 con 0x7ff9cc154a90 2023-10-24T00:29:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.709+0000 7ff9c37fe700 1 -- 172.21.15.148:0/2264184883 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9b404eb70 con 0x7ff9cc154a90 2023-10-24T00:29:04.711 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 msgr2=0x7ff9ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 0x7ff9ac061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff9bc009130 tx=0x7ff9bc017000).stop 2023-10-24T00:29:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 msgr2=0x7ff9cc0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff9b400d890 tx=0x7ff9b4008040).stop 2023-10-24T00:29:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 shutdown_connections 2023-10-24T00:29:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9cc154e70 0x7ff9cc155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9cc0c0810 0x7ff9cc150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff9ac05f150 0x7ff9ac061610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 --2- 172.21.15.148:0/2264184883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9cc154a90 0x7ff9cc0b04a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 >> 172.21.15.148:0/2264184883 conn(0x7ff9cc084c20 msgr2=0x7ff9cc0646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 shutdown_connections 2023-10-24T00:29:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.711+0000 7ff9cbfff700 1 -- 172.21.15.148:0/2264184883 wait complete. 2023-10-24T00:29:04.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-24T00:29:04.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-24T00:29:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.839+0000 7f15ad82f700 1 Processor -- start 2023-10-24T00:29:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.839+0000 7f15ad82f700 1 -- start start 2023-10-24T00:29:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15ad82f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15a8069540 0x7f15a80bce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15ad82f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15a80bd360 0x7f15a806a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15ad82f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80bd850 con 0x7f15a8151200 2023-10-24T00:29:04.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15ad82f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80bdb30 con 0x7f15a8069540 2023-10-24T00:29:04.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15ad82f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80bde10 con 0x7f15a80bd360 2023-10-24T00:29:04.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15a6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15a8069540 0x7f15a80bce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15a67fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f15a8151200 0x7f15a8069920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57482/0 (socket says 172.21.15.148:57482) 2023-10-24T00:29:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.840+0000 7f15a67fc700 1 -- 172.21.15.148:0/890745084 learned_addr learned my addr 172.21.15.148:0/890745084 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a77fe700 1 --2- 172.21.15.148:0/890745084 >> v2:172.21.15.150:3300/0 conn(0x7f15a80bd360 0x7f15a806a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a6ffd700 1 -- 172.21.15.148:0/890745084 >> v2:172.21.15.150:3300/0 conn(0x7f15a80bd360 msgr2=0x7f15a806a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a6ffd700 1 --2- 172.21.15.148:0/890745084 >> v2:172.21.15.150:3300/0 conn(0x7f15a80bd360 0x7f15a806a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a6ffd700 1 -- 172.21.15.148:0/890745084 >> v1:172.21.15.148:6789/0 conn(0x7f15a8151200 legacy=0x7f15a8069920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a5ffb700 1 -- 172.21.15.148:0/890745084 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972027771 0 0) 0x7f15a80bd850 con 0x7f15a8151200 2023-10-24T00:29:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a6ffd700 1 -- 172.21.15.148:0/890745084 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80be0f0 con 0x7f15a8069540 2023-10-24T00:29:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a6ffd700 1 --2- 172.21.15.148:0/890745084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a80bce70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f15a80c24d0 tx=0x7f159800b990).ready entity=mon.0 client_cookie=a8d3658a7a13f3e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a5ffb700 1 -- 172.21.15.148:0/890745084 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598010070 con 0x7f15a8069540 2023-10-24T00:29:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a5ffb700 1 -- 172.21.15.148:0/890745084 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159800ddc0 con 0x7f15a8069540 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15a5ffb700 1 -- 172.21.15.148:0/890745084 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159800b2e0 con 0x7f15a8069540 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 -- 172.21.15.148:0/890745084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 msgr2=0x7f15a80bce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 --2- 172.21.15.148:0/890745084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a80bce70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f15a80c24d0 tx=0x7f159800b990).stop 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 -- 172.21.15.148:0/890745084 shutdown_connections 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 --2- 172.21.15.148:0/890745084 >> v2:172.21.15.150:3300/0 conn(0x7f15a80bd360 0x7f15a806a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 --2- 172.21.15.148:0/890745084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a80bce70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.841+0000 7f15ad82f700 1 -- 172.21.15.148:0/890745084 >> 172.21.15.148:0/890745084 conn(0x7f15a80c7d00 msgr2=0x7f15a80c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:04.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.842+0000 7f15ad82f700 1 -- 172.21.15.148:0/890745084 shutdown_connections 2023-10-24T00:29:04.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.842+0000 7f15ad82f700 1 -- 172.21.15.148:0/890745084 wait complete. 2023-10-24T00:29:04.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 Processor -- start 2023-10-24T00:29:04.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 -- start start 2023-10-24T00:29:04.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a80bd360 0x7f15a8152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a8151200 0x7f15a814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80abe60 con 0x7f15a8069540 2023-10-24T00:29:04.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80abba0 con 0x7f15a8151200 2023-10-24T00:29:04.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.843+0000 7f15ad82f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81537c0 con 0x7f15a80bd360 2023-10-24T00:29:04.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53176/0 (socket says 172.21.15.148:53176) 2023-10-24T00:29:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 -- 172.21.15.148:0/3507718517 learned_addr learned my addr 172.21.15.148:0/3507718517 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a77fe700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a8151200 0x7f15a814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a67fc700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a80bd360 0x7f15a8152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 -- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a80bd360 msgr2=0x7f15a8152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a80bd360 0x7f15a8152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 -- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a8151200 msgr2=0x7f15a814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a8151200 0x7f15a814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 -- 172.21.15.148:0/3507718517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159800bc30 con 0x7f15a8069540 2023-10-24T00:29:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15a6ffd700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f159800d7f0 tx=0x7f159800b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159800b2a0 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598015420 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8153aa0 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980157c0 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.844+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8154060 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.845+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a806c6b0 con 0x7f15a8069540 2023-10-24T00:29:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.845+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1598015bb0 con 0x7f15a8069540 2023-10-24T00:29:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.846+0000 7f158effd700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.846+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f159807deb0 con 0x7f15a8069540 2023-10-24T00:29:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.846+0000 7f15a67fc700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.846+0000 7f15a67fc700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 0x7f1594061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f15a8150700 tx=0x7f159c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:04.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:04.850+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f159804f220 con 0x7f15a8069540 2023-10-24T00:29:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.013+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f15a80be3d0 con 0x7f15a8069540 2023-10-24T00:29:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.014+0000 7f158effd700 1 -- 172.21.15.148:0/3507718517 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1598015e60 con 0x7f15a8069540 2023-10-24T00:29:05.016 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 msgr2=0x7f1594061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 0x7f1594061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f15a8150700 tx=0x7f159c009040).stop 2023-10-24T00:29:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 msgr2=0x7f15a814d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f159800d7f0 tx=0x7f159800b990).stop 2023-10-24T00:29:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 shutdown_connections 2023-10-24T00:29:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a8151200 0x7f15a814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a8069540 0x7f15a814d230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 --2- 172.21.15.148:0/3507718517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a80bd360 0x7f15a8152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 >> 172.21.15.148:0/3507718517 conn(0x7f15a80c7d00 msgr2=0x7f15a80c7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 shutdown_connections 2023-10-24T00:29:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.015+0000 7f15ad82f700 1 -- 172.21.15.148:0/3507718517 wait complete. 2023-10-24T00:29:05.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-24T00:29:05.029 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-24T00:29:05.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.141+0000 7f89632c6700 1 Processor -- start 2023-10-24T00:29:05.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.141+0000 7f89632c6700 1 -- start start 2023-10-24T00:29:05.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f89632c6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f895c0a7e50 0x7f895c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f89632c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 0x7f895c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f89632c6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c0c3f10 con 0x7f895c152280 2023-10-24T00:29:05.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f89632c6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c0a82d0 con 0x7f895c0a7e50 2023-10-24T00:29:05.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f89632c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0a87c0 con 0x7f895c0be9c0 2023-10-24T00:29:05.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f8960861700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f895c0a7e50 0x7f895c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f8961062700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f895c152280 0x7f895c0c6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57486/0 (socket says 172.21.15.148:57486) 2023-10-24T00:29:05.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.142+0000 7f8961062700 1 -- 172.21.15.148:0/3435479346 learned_addr learned my addr 172.21.15.148:0/3435479346 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:05.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8961863700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 0x7f895c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8960861700 1 -- 172.21.15.148:0/3435479346 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 msgr2=0x7f895c0bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:05.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8960861700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 0x7f895c0bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8960861700 1 -- 172.21.15.148:0/3435479346 >> v1:172.21.15.148:6789/0 conn(0x7f895c152280 legacy=0x7f895c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8960861700 1 -- 172.21.15.148:0/3435479346 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0bf300 con 0x7f895c0a7e50 2023-10-24T00:29:05.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f895bfff700 1 -- 172.21.15.148:0/3435479346 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679473241 0 0) 0x7f895c0c3f10 con 0x7f895c152280 2023-10-24T00:29:05.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8961863700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 0x7f895c0bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:05.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f8960861700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0a7e50 0x7f895c0c4c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8950009760 tx=0x7f8950009060).ready entity=mon.0 client_cookie=af6849d591f05954 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f895bfff700 1 -- 172.21.15.148:0/3435479346 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000b580 con 0x7f895c0a7e50 2023-10-24T00:29:05.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f895bfff700 1 -- 172.21.15.148:0/3435479346 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000b6e0 con 0x7f895c0a7e50 2023-10-24T00:29:05.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f895bfff700 1 -- 172.21.15.148:0/3435479346 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ba60 con 0x7f895c0a7e50 2023-10-24T00:29:05.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f89632c6700 1 -- 172.21.15.148:0/3435479346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0a7e50 msgr2=0x7f895c0c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.143+0000 7f89632c6700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0a7e50 0x7f895c0c4c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8950009760 tx=0x7f8950009060).stop 2023-10-24T00:29:05.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 -- 172.21.15.148:0/3435479346 shutdown_connections 2023-10-24T00:29:05.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0be9c0 0x7f895c0bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 --2- 172.21.15.148:0/3435479346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0a7e50 0x7f895c0c4c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 -- 172.21.15.148:0/3435479346 >> 172.21.15.148:0/3435479346 conn(0x7f895c082f60 msgr2=0x7f895c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 -- 172.21.15.148:0/3435479346 shutdown_connections 2023-10-24T00:29:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.144+0000 7f89632c6700 1 -- 172.21.15.148:0/3435479346 wait complete. 2023-10-24T00:29:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.145+0000 7f89632c6700 1 Processor -- start 2023-10-24T00:29:05.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.145+0000 7f89632c6700 1 -- start start 2023-10-24T00:29:05.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 0x7f895c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 0x7f895c166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0a9be0 con 0x7f895c0be9c0 2023-10-24T00:29:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c166af0 con 0x7f895c152280 2023-10-24T00:29:05.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1541f0 con 0x7f895c0a7e50 2023-10-24T00:29:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53192/0 (socket says 172.21.15.148:53192) 2023-10-24T00:29:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 -- 172.21.15.148:0/2231293250 learned_addr learned my addr 172.21.15.148:0/2231293250 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:05.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8961062700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 0x7f895c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8961863700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 0x7f895c166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 -- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 msgr2=0x7f895c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 0x7f895c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 -- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 msgr2=0x7f895c166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 0x7f895c166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 -- 172.21.15.148:0/2231293250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500092a0 con 0x7f895c0be9c0 2023-10-24T00:29:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8961062700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 0x7f895c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8961863700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 0x7f895c166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f8960861700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8950009eb0 tx=0x7f8950017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ba60 con 0x7f895c0be9c0 2023-10-24T00:29:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950000c90 con 0x7f895c0be9c0 2023-10-24T00:29:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c0aa410 con 0x7f895c0be9c0 2023-10-24T00:29:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895001b660 con 0x7f895c0be9c0 2023-10-24T00:29:05.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.146+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c0ab720 con 0x7f895c0be9c0 2023-10-24T00:29:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.147+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c06c6b0 con 0x7f895c0be9c0 2023-10-24T00:29:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.148+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f895001b9d0 con 0x7f895c0be9c0 2023-10-24T00:29:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.148+0000 7f89597fa700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 0x7f89480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.148+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f895007bdf0 con 0x7f895c0be9c0 2023-10-24T00:29:05.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.148+0000 7f8961062700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 0x7f89480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.149+0000 7f8961062700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 0x7f89480615e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f894c007fd0 tx=0x7f894c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.152+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f895004d0c0 con 0x7f895c0be9c0 2023-10-24T00:29:05.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.314+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f895c0a84e0 con 0x7f895c0be9c0 2023-10-24T00:29:05.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.314+0000 7f89597fa700 1 -- 172.21.15.148:0/2231293250 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8950029020 con 0x7f895c0be9c0 2023-10-24T00:29:05.317 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 msgr2=0x7f89480615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 0x7f89480615e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f894c007fd0 tx=0x7f894c009040).stop 2023-10-24T00:29:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 msgr2=0x7f895c166110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f8950009eb0 tx=0x7f8950017000).stop 2023-10-24T00:29:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 shutdown_connections 2023-10-24T00:29:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f895c152280 0x7f895c166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f895c0a7e50 0x7f895c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f894805f120 0x7f89480615e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 --2- 172.21.15.148:0/2231293250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f895c0be9c0 0x7f895c166110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 >> 172.21.15.148:0/2231293250 conn(0x7f895c082f60 msgr2=0x7f895c0ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 shutdown_connections 2023-10-24T00:29:05.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.316+0000 7f89632c6700 1 -- 172.21.15.148:0/2231293250 wait complete. 2023-10-24T00:29:05.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-10-24T00:29:05.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-24T00:29:05.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.444+0000 7f987e83b700 1 Processor -- start 2023-10-24T00:29:05.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.444+0000 7f987e83b700 1 -- start start 2023-10-24T00:29:05.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e83b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9878062d60 0x7f9878154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e83b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9878155090 0x7f987815de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e83b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98780c21a0 con 0x7f987814e8b0 2023-10-24T00:29:05.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e83b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780c2d20 con 0x7f9878155090 2023-10-24T00:29:05.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e83b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98780c31b0 con 0x7f9878062d60 2023-10-24T00:29:05.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9878155090 0x7f987815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987d839700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f987814e8b0 0x7f9878062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57494/0 (socket says 172.21.15.148:57494) 2023-10-24T00:29:05.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9878155090 0x7f987815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53196/0 (socket says 172.21.15.148:53196) 2023-10-24T00:29:05.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987d839700 1 -- 172.21.15.148:0/3290713151 learned_addr learned my addr 172.21.15.148:0/3290713151 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987d038700 1 --2- 172.21.15.148:0/3290713151 >> v2:172.21.15.150:3300/0 conn(0x7f9878062d60 0x7f9878154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 -- 172.21.15.148:0/3290713151 >> v2:172.21.15.150:3300/0 conn(0x7f9878062d60 msgr2=0x7f9878154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 --2- 172.21.15.148:0/3290713151 >> v2:172.21.15.150:3300/0 conn(0x7f9878062d60 0x7f9878154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 -- 172.21.15.148:0/3290713151 >> v1:172.21.15.148:6789/0 conn(0x7f987814e8b0 legacy=0x7f9878062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987c837700 1 -- 172.21.15.148:0/3290713151 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193918568 0 0) 0x7f98780c21a0 con 0x7f987814e8b0 2023-10-24T00:29:05.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 -- 172.21.15.148:0/3290713151 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780c23f0 con 0x7f9878155090 2023-10-24T00:29:05.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.445+0000 7f987e03a700 1 --2- 172.21.15.148:0/3290713151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9878155090 0x7f987815de20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f9878157d50 tx=0x7f9870009780).ready entity=mon.0 client_cookie=32c92b239f3a5a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987c837700 1 -- 172.21.15.148:0/3290713151 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987000e070 con 0x7f9878155090 2023-10-24T00:29:05.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987c837700 1 -- 172.21.15.148:0/3290713151 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987000bc30 con 0x7f9878155090 2023-10-24T00:29:05.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987c837700 1 -- 172.21.15.148:0/3290713151 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870012410 con 0x7f9878155090 2023-10-24T00:29:05.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 -- 172.21.15.148:0/3290713151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9878155090 msgr2=0x7f987815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 --2- 172.21.15.148:0/3290713151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9878155090 0x7f987815de20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f9878157d50 tx=0x7f9870009780).stop 2023-10-24T00:29:05.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 -- 172.21.15.148:0/3290713151 shutdown_connections 2023-10-24T00:29:05.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 --2- 172.21.15.148:0/3290713151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9878155090 0x7f987815de20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 --2- 172.21.15.148:0/3290713151 >> v2:172.21.15.150:3300/0 conn(0x7f9878062d60 0x7f9878154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 -- 172.21.15.148:0/3290713151 >> 172.21.15.148:0/3290713151 conn(0x7f98780c7ba0 msgr2=0x7f98780c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 -- 172.21.15.148:0/3290713151 shutdown_connections 2023-10-24T00:29:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.446+0000 7f987e83b700 1 -- 172.21.15.148:0/3290713151 wait complete. 2023-10-24T00:29:05.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.447+0000 7f987e83b700 1 Processor -- start 2023-10-24T00:29:05.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.447+0000 7f987e83b700 1 -- start start 2023-10-24T00:29:05.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 0x7f98780a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 0x7f98780a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98781545d0 con 0x7f987814e8b0 2023-10-24T00:29:05.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780c0950 con 0x7f9878062d60 2023-10-24T00:29:05.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e83b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98780bfd40 con 0x7f9878155090 2023-10-24T00:29:05.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53198/0 (socket says 172.21.15.148:53198) 2023-10-24T00:29:05.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 -- 172.21.15.148:0/2960753309 learned_addr learned my addr 172.21.15.148:0/2960753309 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:05.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e03a700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 0x7f98780a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d839700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 0x7f98780a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 -- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 msgr2=0x7f98780a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 0x7f98780a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 -- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 msgr2=0x7f98780a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 0x7f98780a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d038700 1 -- 172.21.15.148:0/2960753309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870009a20 con 0x7f987814e8b0 2023-10-24T00:29:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987e03a700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 0x7f98780a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.448+0000 7f987d839700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 0x7f98780a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f987d038700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f986800d860 tx=0x7f9868008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98680125f0 con 0x7f987814e8b0 2023-10-24T00:29:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868012750 con 0x7f987814e8b0 2023-10-24T00:29:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780c0020 con 0x7f987814e8b0 2023-10-24T00:29:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868012ad0 con 0x7f987814e8b0 2023-10-24T00:29:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.449+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98780c05e0 con 0x7f987814e8b0 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.450+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878047480 con 0x7f987814e8b0 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.450+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9868013480 con 0x7f987814e8b0 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.450+0000 7f986dffb700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 0x7f985c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.451+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f986807a350 con 0x7f987814e8b0 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.451+0000 7f987d839700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 0x7f985c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.451+0000 7f987d839700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 0x7f985c061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9874001750 tx=0x7f9874009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.455+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f986804b500 con 0x7f987814e8b0 2023-10-24T00:29:05.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.616+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98780c26d0 con 0x7f987814e8b0 2023-10-24T00:29:05.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.617+0000 7f986dffb700 1 -- 172.21.15.148:0/2960753309 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f986804eb20 con 0x7f987814e8b0 2023-10-24T00:29:05.619 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:05.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 msgr2=0x7f985c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 0x7f985c061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9874001750 tx=0x7f9874009040).stop 2023-10-24T00:29:05.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 msgr2=0x7f98780a6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f986800d860 tx=0x7f9868008040).stop 2023-10-24T00:29:05.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 shutdown_connections 2023-10-24T00:29:05.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9878155090 0x7f98780a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9878062d60 0x7f98780a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f985c05f150 0x7f985c061610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 --2- 172.21.15.148:0/2960753309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f987814e8b0 0x7f98780a6940 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 >> 172.21.15.148:0/2960753309 conn(0x7f98780c7ba0 msgr2=0x7f987814d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 shutdown_connections 2023-10-24T00:29:05.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.619+0000 7f987e83b700 1 -- 172.21.15.148:0/2960753309 wait complete. 2023-10-24T00:29:05.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-24T00:29:05.632 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-24T00:29:05.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.745+0000 7fea0c231700 1 Processor -- start 2023-10-24T00:29:05.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.745+0000 7fea0c231700 1 -- start start 2023-10-24T00:29:05.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0c231700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 0x7fea040aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0c231700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea040c6a70 0x7fea040a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0c231700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040a8440 con 0x7fea040c1370 2023-10-24T00:29:05.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0c231700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea040c1870 con 0x7fea040c6a70 2023-10-24T00:29:05.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0c231700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea040c1b50 con 0x7fea041546d0 2023-10-24T00:29:05.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.746+0000 7fea0a7ce700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea040c6a70 0x7fea040a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea040c6a70 0x7fea040a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53200/0 (socket says 172.21.15.148:53200) 2023-10-24T00:29:05.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 -- 172.21.15.148:0/3542151393 learned_addr learned my addr 172.21.15.148:0/3542151393 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:05.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea09fcd700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 0x7fea040aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 -- 172.21.15.148:0/3542151393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 msgr2=0x7fea040aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:05.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 0x7fea040aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 -- 172.21.15.148:0/3542151393 >> v1:172.21.15.150:6789/0 conn(0x7fea040c1370 legacy=0x7fea040c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:05.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 -- 172.21.15.148:0/3542151393 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040a7df0 con 0x7fea040c6a70 2023-10-24T00:29:05.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea09fcd700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 0x7fea040aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:05.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea0a7ce700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea040a88d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe9fc009f20 tx=0x7fe9fc009840).ready entity=mon.0 client_cookie=47310502a9fc62 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea08fcb700 1 -- 172.21.15.148:0/3542151393 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc00e070 con 0x7fea040c6a70 2023-10-24T00:29:05.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea08fcb700 1 -- 172.21.15.148:0/3542151393 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc00ba40 con 0x7fea040c6a70 2023-10-24T00:29:05.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.747+0000 7fea08fcb700 1 -- 172.21.15.148:0/3542151393 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc00bdc0 con 0x7fea040c6a70 2023-10-24T00:29:05.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 -- 172.21.15.148:0/3542151393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 msgr2=0x7fea040a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea040a88d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe9fc009f20 tx=0x7fe9fc009840).stop 2023-10-24T00:29:05.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 -- 172.21.15.148:0/3542151393 shutdown_connections 2023-10-24T00:29:05.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea041546d0 0x7fea040aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 --2- 172.21.15.148:0/3542151393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea040a88d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 -- 172.21.15.148:0/3542151393 >> 172.21.15.148:0/3542151393 conn(0x7fea040946c0 msgr2=0x7fea0406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 -- 172.21.15.148:0/3542151393 shutdown_connections 2023-10-24T00:29:05.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.748+0000 7fea0c231700 1 -- 172.21.15.148:0/3542151393 wait complete. 2023-10-24T00:29:05.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.749+0000 7fea0c231700 1 Processor -- start 2023-10-24T00:29:05.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.749+0000 7fea0c231700 1 -- start start 2023-10-24T00:29:05.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea040c1370 0x7fea040afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea041546d0 0x7fea0414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040c2230 con 0x7fea040c6a70 2023-10-24T00:29:05.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040c2510 con 0x7fea041546d0 2023-10-24T00:29:05.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea040c27f0 con 0x7fea040c1370 2023-10-24T00:29:05.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53204/0 (socket says 172.21.15.148:53204) 2023-10-24T00:29:05.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 -- 172.21.15.148:0/3478925927 learned_addr learned my addr 172.21.15.148:0/3478925927 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea09fcd700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea040c1370 0x7fea040afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0a7ce700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea041546d0 0x7fea0414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 -- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea040c1370 msgr2=0x7fea040afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea040c1370 0x7fea040afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 -- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea041546d0 msgr2=0x7fea0414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea041546d0 0x7fea0414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 -- 172.21.15.148:0/3478925927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc009ae0 con 0x7fea040c6a70 2023-10-24T00:29:05.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea097cc700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe9f800c490 tx=0x7fe9f8007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007020 con 0x7fea040c6a70 2023-10-24T00:29:05.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8007180 con 0x7fea040c6a70 2023-10-24T00:29:05.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007520 con 0x7fea040c6a70 2023-10-24T00:29:05.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.750+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea040c2ad0 con 0x7fea040c6a70 2023-10-24T00:29:05.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.751+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea040affc0 con 0x7fea040c6a70 2023-10-24T00:29:05.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.751+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0406c6b0 con 0x7fea040c6a70 2023-10-24T00:29:05.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.752+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe9f80068b0 con 0x7fea040c6a70 2023-10-24T00:29:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.752+0000 7fea01ffb700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 0x7fe9f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.752+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe9f8079610 con 0x7fea040c6a70 2023-10-24T00:29:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.752+0000 7fea09fcd700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 0x7fe9f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.753+0000 7fea09fcd700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 0x7fe9f0061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea040add30 tx=0x7fe9f4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.756+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe9f8047af0 con 0x7fea040c6a70 2023-10-24T00:29:05.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.923+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fea040b1040 con 0x7fea040c6a70 2023-10-24T00:29:05.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.923+0000 7fea01ffb700 1 -- 172.21.15.148:0/3478925927 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9f804a8e0 con 0x7fea040c6a70 2023-10-24T00:29:05.925 INFO:teuthology.orchestra.run.smithi148.stdout:55834574855 2023-10-24T00:29:05.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 msgr2=0x7fe9f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 0x7fe9f0061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea040add30 tx=0x7fe9f4008040).stop 2023-10-24T00:29:05.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 msgr2=0x7fea04156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:05.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe9f800c490 tx=0x7fe9f8007d40).stop 2023-10-24T00:29:05.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 shutdown_connections 2023-10-24T00:29:05.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea041546d0 0x7fea0414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea040c1370 0x7fea040afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe9f005f150 0x7fe9f0061610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 --2- 172.21.15.148:0/3478925927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea040c6a70 0x7fea04156e20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:05.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 >> 172.21.15.148:0/3478925927 conn(0x7fea040946c0 msgr2=0x7fea04063d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:05.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 shutdown_connections 2023-10-24T00:29:05.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:05.925+0000 7fea0c231700 1 -- 172.21.15.148:0/3478925927 wait complete. 2023-10-24T00:29:05.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-10-24T00:29:05.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-24T00:29:06.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.052+0000 7f2c3b59e700 1 Processor -- start 2023-10-24T00:29:06.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.052+0000 7f2c3b59e700 1 -- start start 2023-10-24T00:29:06.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c3c154a90 0x7f2c3c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c06a860 con 0x7f2c3c154e70 2023-10-24T00:29:06.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0c9d90 con 0x7f2c3c0c0f20 2023-10-24T00:29:06.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c0c9180 con 0x7f2c3c154a90 2023-10-24T00:29:06.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c3c154a90 0x7f2c3c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c31d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2c3c154e70 0x7f2c3c0c0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57496/0 (socket says 172.21.15.148:57496) 2023-10-24T00:29:06.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c31d9b700 1 -- 172.21.15.148:0/578091095 learned_addr learned my addr 172.21.15.148:0/578091095 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:06.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3a59c700 1 -- 172.21.15.148:0/578091095 >> v1:172.21.15.150:6789/0 conn(0x7f2c3c0c0f20 legacy=0x7f2c3c0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3a59c700 1 -- 172.21.15.148:0/578091095 >> v1:172.21.15.148:6789/0 conn(0x7f2c3c154e70 legacy=0x7f2c3c0c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c39d9b700 1 -- 172.21.15.148:0/578091095 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570391014 0 0) 0x7f2c3c06a860 con 0x7f2c3c154e70 2023-10-24T00:29:06.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3a59c700 1 -- 172.21.15.148:0/578091095 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0c9460 con 0x7f2c3c154a90 2023-10-24T00:29:06.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.053+0000 7f2c3a59c700 1 --2- 172.21.15.148:0/578091095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154a90 0x7f2c3c155a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2c2c009790 tx=0x7f2c2c009060).ready entity=mon.0 client_cookie=6260eb7c08863300 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c39d9b700 1 -- 172.21.15.148:0/578091095 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00b580 con 0x7f2c3c154a90 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c39d9b700 1 -- 172.21.15.148:0/578091095 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00b6e0 con 0x7f2c3c154a90 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c39d9b700 1 -- 172.21.15.148:0/578091095 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00ba60 con 0x7f2c3c154a90 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 -- 172.21.15.148:0/578091095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154a90 msgr2=0x7f2c3c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/578091095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154a90 0x7f2c3c155a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2c2c009790 tx=0x7f2c2c009060).stop 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 -- 172.21.15.148:0/578091095 shutdown_connections 2023-10-24T00:29:06.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/578091095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154a90 0x7f2c3c155a90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 -- 172.21.15.148:0/578091095 >> 172.21.15.148:0/578091095 conn(0x7f2c3c084c20 msgr2=0x7f2c3c094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 -- 172.21.15.148:0/578091095 shutdown_connections 2023-10-24T00:29:06.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.054+0000 7f2c3b59e700 1 -- 172.21.15.148:0/578091095 wait complete. 2023-10-24T00:29:06.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.055+0000 7f2c3b59e700 1 Processor -- start 2023-10-24T00:29:06.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.055+0000 7f2c3b59e700 1 -- start start 2023-10-24T00:29:06.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 0x7f2c3c0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 0x7f2c3c064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c064d30 con 0x7f2c3c154e70 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c168660 con 0x7f2c3c154a90 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0c4d50 con 0x7f2c3c0c0f20 2023-10-24T00:29:06.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53224/0 (socket says 172.21.15.148:53224) 2023-10-24T00:29:06.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3ad9d700 1 -- 172.21.15.148:0/1158570318 learned_addr learned my addr 172.21.15.148:0/1158570318 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:06.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3a59c700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 0x7f2c3c0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c31d9b700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 0x7f2c3c064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3ad9d700 1 -- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 msgr2=0x7f2c3c0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.056+0000 7f2c3ad9d700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 0x7f2c3c0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3ad9d700 1 -- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 msgr2=0x7f2c3c064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3ad9d700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 0x7f2c3c064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3ad9d700 1 -- 172.21.15.148:0/1158570318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0092a0 con 0x7f2c3c154e70 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c31d9b700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 0x7f2c3c064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3a59c700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 0x7f2c3c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:06.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3ad9d700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2c3400c7c0 tx=0x7f2c34001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34010510 con 0x7f2c3c154e70 2023-10-24T00:29:06.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34010670 con 0x7f2c3c154e70 2023-10-24T00:29:06.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340109f0 con 0x7f2c3c154e70 2023-10-24T00:29:06.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c167d30 con 0x7f2c3c154e70 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.057+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c1682f0 con 0x7f2c3c154e70 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.058+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c047480 con 0x7f2c3c154e70 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.058+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2c3401b3b0 con 0x7f2c3c154e70 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.058+0000 7f2c32ffd700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 0x7f2c1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.058+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c34079a80 con 0x7f2c3c154e70 2023-10-24T00:29:06.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.059+0000 7f2c3a59c700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 0x7f2c1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.059+0000 7f2c3a59c700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 0x7f2c1c061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2c2c009760 tx=0x7f2c2c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.062+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c34048af0 con 0x7f2c3c154e70 2023-10-24T00:29:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.224+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2c3c0c9740 con 0x7f2c3c154e70 2023-10-24T00:29:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.225+0000 7f2c32ffd700 1 -- 172.21.15.148:0/1158570318 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c3404ada0 con 0x7f2c3c154e70 2023-10-24T00:29:06.227 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.226+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 msgr2=0x7f2c1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.226+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 0x7f2c1c061610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2c2c009760 tx=0x7f2c2c017000).stop 2023-10-24T00:29:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.226+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 msgr2=0x7f2c3c064840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.226+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2c3400c7c0 tx=0x7f2c34001530).stop 2023-10-24T00:29:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 shutdown_connections 2023-10-24T00:29:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c1c05f150 0x7f2c1c061610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c3c154e70 0x7f2c3c064840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c3c0c0f20 0x7f2c3c0c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 --2- 172.21.15.148:0/1158570318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c3c154a90 0x7f2c3c064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 >> 172.21.15.148:0/1158570318 conn(0x7f2c3c084c20 msgr2=0x7f2c3c0c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 shutdown_connections 2023-10-24T00:29:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.227+0000 7f2c3b59e700 1 -- 172.21.15.148:0/1158570318 wait complete. 2023-10-24T00:29:06.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-10-24T00:29:06.240 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-24T00:29:06.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.352+0000 7f94f55f8700 1 Processor -- start 2023-10-24T00:29:06.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.352+0000 7f94f55f8700 1 -- start start 2023-10-24T00:29:06.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94f55f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94f0154400 0x7f94f00c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94f55f8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f00c0b30 0x7f94f00c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94f55f8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f00c01c0 con 0x7f94f01547e0 2023-10-24T00:29:06.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94f55f8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00aa960 con 0x7f94f0154400 2023-10-24T00:29:06.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94f55f8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c66f0 con 0x7f94f00c0b30 2023-10-24T00:29:06.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94eeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94f0154400 0x7f94f00c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94ee7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f94f01547e0 0x7f94f00a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57508/0 (socket says 172.21.15.148:57508) 2023-10-24T00:29:06.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94eeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94f0154400 0x7f94f00c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53234/0 (socket says 172.21.15.148:53234) 2023-10-24T00:29:06.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.353+0000 7f94ee7fc700 1 -- 172.21.15.148:0/357935098 learned_addr learned my addr 172.21.15.148:0/357935098 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94ef7fe700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f00c0b30 0x7f94f00c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94eeffd700 1 -- 172.21.15.148:0/357935098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f00c0b30 msgr2=0x7f94f00c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94eeffd700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f00c0b30 0x7f94f00c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94eeffd700 1 -- 172.21.15.148:0/357935098 >> v1:172.21.15.148:6789/0 conn(0x7f94f01547e0 legacy=0x7f94f00a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94edffb700 1 -- 172.21.15.148:0/357935098 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936880106 0 0) 0x7f94f00c01c0 con 0x7f94f01547e0 2023-10-24T00:29:06.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94eeffd700 1 -- 172.21.15.148:0/357935098 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00c6150 con 0x7f94f0154400 2023-10-24T00:29:06.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94eeffd700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f00c8310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f94e0009e60 tx=0x7f94e0009780).ready entity=mon.0 client_cookie=f4e009c6edc775d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94edffb700 1 -- 172.21.15.148:0/357935098 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000e070 con 0x7f94f0154400 2023-10-24T00:29:06.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94edffb700 1 -- 172.21.15.148:0/357935098 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000bc30 con 0x7f94f0154400 2023-10-24T00:29:06.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94edffb700 1 -- 172.21.15.148:0/357935098 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0012410 con 0x7f94f0154400 2023-10-24T00:29:06.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 -- 172.21.15.148:0/357935098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 msgr2=0x7f94f00c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f00c8310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f94e0009e60 tx=0x7f94e0009780).stop 2023-10-24T00:29:06.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 -- 172.21.15.148:0/357935098 shutdown_connections 2023-10-24T00:29:06.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f00c0b30 0x7f94f00c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 --2- 172.21.15.148:0/357935098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f00c8310 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.354+0000 7f94f55f8700 1 -- 172.21.15.148:0/357935098 >> 172.21.15.148:0/357935098 conn(0x7f94f00946a0 msgr2=0x7f94f006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.355+0000 7f94f55f8700 1 -- 172.21.15.148:0/357935098 shutdown_connections 2023-10-24T00:29:06.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.355+0000 7f94f55f8700 1 -- 172.21.15.148:0/357935098 wait complete. 2023-10-24T00:29:06.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 Processor -- start 2023-10-24T00:29:06.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 -- start start 2023-10-24T00:29:06.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f00c0b30 0x7f94f0141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f01547e0 0x7f94f01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c4260 con 0x7f94f0154400 2023-10-24T00:29:06.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c4540 con 0x7f94f00c0b30 2023-10-24T00:29:06.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.356+0000 7f94f55f8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c4820 con 0x7f94f01547e0 2023-10-24T00:29:06.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53236/0 (socket says 172.21.15.148:53236) 2023-10-24T00:29:06.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 -- 172.21.15.148:0/2729825772 learned_addr learned my addr 172.21.15.148:0/2729825772 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:06.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94eeffd700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f00c0b30 0x7f94f0141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ef7fe700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f01547e0 0x7f94f01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 -- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f01547e0 msgr2=0x7f94f01560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f01547e0 0x7f94f01560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 -- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f00c0b30 msgr2=0x7f94f0141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f00c0b30 0x7f94f0141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 -- 172.21.15.148:0/2729825772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009a20 con 0x7f94f0154400 2023-10-24T00:29:06.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94ee7fc700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f94e400c490 tx=0x7f94e4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40070d0 con 0x7f94f0154400 2023-10-24T00:29:06.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4007230 con 0x7f94f0154400 2023-10-24T00:29:06.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f00c4b00 con 0x7f94f0154400 2023-10-24T00:29:06.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40075f0 con 0x7f94f0154400 2023-10-24T00:29:06.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.357+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f0142130 con 0x7f94f0154400 2023-10-24T00:29:06.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.358+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f00ae9e0 con 0x7f94f0154400 2023-10-24T00:29:06.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.358+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f94e4005bc0 con 0x7f94f0154400 2023-10-24T00:29:06.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.359+0000 7f94d6ffd700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 0x7f94dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.359+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94e40799b0 con 0x7f94f0154400 2023-10-24T00:29:06.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.359+0000 7f94eeffd700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 0x7f94dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.359+0000 7f94eeffd700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 0x7f94dc061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f94e0009870 tx=0x7f94e0009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.363+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f94f00ae9e0 con 0x7f94f0154400 2023-10-24T00:29:06.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.527+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f94f00ae9e0 con 0x7f94f0154400 2023-10-24T00:29:06.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.527+0000 7f94d6ffd700 1 -- 172.21.15.148:0/2729825772 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94f00ae9e0 con 0x7f94f0154400 2023-10-24T00:29:06.529 INFO:teuthology.orchestra.run.smithi148.stdout:55834574854 2023-10-24T00:29:06.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 msgr2=0x7f94dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 0x7f94dc061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f94e0009870 tx=0x7f94e0009780).stop 2023-10-24T00:29:06.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 msgr2=0x7f94f0157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f94e400c490 tx=0x7f94e4007de0).stop 2023-10-24T00:29:06.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 shutdown_connections 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94f01547e0 0x7f94f01560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94f00c0b30 0x7f94f0141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f94dc05f150 0x7f94dc061610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 --2- 172.21.15.148:0/2729825772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94f0154400 0x7f94f0157790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 >> 172.21.15.148:0/2729825772 conn(0x7f94f00946a0 msgr2=0x7f94f014dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 shutdown_connections 2023-10-24T00:29:06.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.529+0000 7f94f55f8700 1 -- 172.21.15.148:0/2729825772 wait complete. 2023-10-24T00:29:06.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-24T00:29:06.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-24T00:29:06.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.655+0000 7fc3bf4ad700 1 Processor -- start 2023-10-24T00:29:06.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.655+0000 7fc3bf4ad700 1 -- start start 2023-10-24T00:29:06.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bf4ad700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc3b8154400 0x7fc3b80c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bf4ad700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3b80c0b30 0x7fc3b80c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bf4ad700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b80c01c0 con 0x7fc3b81547e0 2023-10-24T00:29:06.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bf4ad700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b80aa960 con 0x7fc3b80c0b30 2023-10-24T00:29:06.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bf4ad700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b80c66f0 con 0x7fc3b8154400 2023-10-24T00:29:06.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bda4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3b80c0b30 0x7fc3b80c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bca48700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc3b81547e0 0x7fc3b80a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57520/0 (socket says 172.21.15.148:57520) 2023-10-24T00:29:06.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bca48700 1 -- 172.21.15.148:0/3287121001 learned_addr learned my addr 172.21.15.148:0/3287121001 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:06.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bd249700 1 --2- 172.21.15.148:0/3287121001 >> v2:172.21.15.150:3300/0 conn(0x7fc3b8154400 0x7fc3b80c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3affff700 1 -- 172.21.15.148:0/3287121001 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366450040 0 0) 0x7fc3b80c01c0 con 0x7fc3b81547e0 2023-10-24T00:29:06.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3affff700 1 -- 172.21.15.148:0/3287121001 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a40033f0 con 0x7fc3b81547e0 2023-10-24T00:29:06.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3287121001 >> v2:172.21.15.150:3300/0 conn(0x7fc3b8154400 msgr2=0x7fc3b80c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bda4a700 1 --2- 172.21.15.148:0/3287121001 >> v2:172.21.15.150:3300/0 conn(0x7fc3b8154400 0x7fc3b80c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3287121001 >> v1:172.21.15.148:6789/0 conn(0x7fc3b81547e0 legacy=0x7fc3b80a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.656+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3287121001 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80c6150 con 0x7fc3b80c0b30 2023-10-24T00:29:06.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bda4a700 1 --2- 172.21.15.148:0/3287121001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b80c0b30 0x7fc3b80c0f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc3b8084cf0 tx=0x7fc3b0009780).ready entity=mon.0 client_cookie=d0ae664390c1808e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3affff700 1 -- 172.21.15.148:0/3287121001 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000e070 con 0x7fc3b80c0b30 2023-10-24T00:29:06.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3affff700 1 -- 172.21.15.148:0/3287121001 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b000bab0 con 0x7fc3b80c0b30 2023-10-24T00:29:06.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3affff700 1 -- 172.21.15.148:0/3287121001 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000be30 con 0x7fc3b80c0b30 2023-10-24T00:29:06.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3287121001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b80c0b30 msgr2=0x7fc3b80c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3287121001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b80c0b30 0x7fc3b80c0f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc3b8084cf0 tx=0x7fc3b0009780).stop 2023-10-24T00:29:06.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3287121001 shutdown_connections 2023-10-24T00:29:06.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3287121001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b80c0b30 0x7fc3b80c0f60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3287121001 >> v2:172.21.15.150:3300/0 conn(0x7fc3b8154400 0x7fc3b80c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3287121001 >> 172.21.15.148:0/3287121001 conn(0x7fc3b80946a0 msgr2=0x7fc3b806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3287121001 shutdown_connections 2023-10-24T00:29:06.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.657+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3287121001 wait complete. 2023-10-24T00:29:06.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.658+0000 7fc3bf4ad700 1 Processor -- start 2023-10-24T00:29:06.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.658+0000 7fc3bf4ad700 1 -- start start 2023-10-24T00:29:06.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3b80c0b30 0x7fc3b8156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3b8154400 0x7fc3b8168080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b8168db0 con 0x7fc3b81547e0 2023-10-24T00:29:06.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80af610 con 0x7fc3b8154400 2023-10-24T00:29:06.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bf4ad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80c2540 con 0x7fc3b80c0b30 2023-10-24T00:29:06.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bda4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bda4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53248/0 (socket says 172.21.15.148:53248) 2023-10-24T00:29:06.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3839376877 learned_addr learned my addr 172.21.15.148:0/3839376877 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:06.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bd249700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3b80c0b30 0x7fc3b8156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.659+0000 7fc3bca48700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3b8154400 0x7fc3b8168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3b80c0b30 msgr2=0x7fc3b8156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3b80c0b30 0x7fc3b8156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3b8154400 msgr2=0x7fc3b8168080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3b8154400 0x7fc3b8168080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 -- 172.21.15.148:0/3839376877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009a20 con 0x7fc3b81547e0 2023-10-24T00:29:06.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bda4a700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc3b8084250 tx=0x7fc3b0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0013e60 con 0x7fc3b81547e0 2023-10-24T00:29:06.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b001d630 con 0x7fc3b81547e0 2023-10-24T00:29:06.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b80c27e0 con 0x7fc3b81547e0 2023-10-24T00:29:06.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b001d9d0 con 0x7fc3b81547e0 2023-10-24T00:29:06.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.660+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b80c2da0 con 0x7fc3b81547e0 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.661+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b80c2f90 con 0x7fc3b81547e0 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.661+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc3b0003040 con 0x7fc3b81547e0 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.662+0000 7fc3ad7fa700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 0x7fc39c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.662+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc3b007be00 con 0x7fc3b81547e0 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.662+0000 7fc3bd249700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 0x7fc39c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.662+0000 7fc3bd249700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 0x7fc39c061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc3b4009c10 tx=0x7fc3b4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.666+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc3b004d0d0 con 0x7fc3b81547e0 2023-10-24T00:29:06.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.829+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc3b80a84e0 con 0x7fc3b81547e0 2023-10-24T00:29:06.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.830+0000 7fc3ad7fa700 1 -- 172.21.15.148:0/3839376877 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3b00506f0 con 0x7fc3b81547e0 2023-10-24T00:29:06.832 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2023-10-24T00:29:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 msgr2=0x7fc39c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 0x7fc39c061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc3b4009c10 tx=0x7fc3b4009060).stop 2023-10-24T00:29:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 msgr2=0x7fc3b80aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fc3b8084250 tx=0x7fc3b0009780).stop 2023-10-24T00:29:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 shutdown_connections 2023-10-24T00:29:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc39c05f150 0x7fc39c061610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3b81547e0 0x7fc3b80aea00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3b80c0b30 0x7fc3b8156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 --2- 172.21.15.148:0/3839376877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3b8154400 0x7fc3b8168080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 >> 172.21.15.148:0/3839376877 conn(0x7fc3b80946a0 msgr2=0x7fc3b80a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 shutdown_connections 2023-10-24T00:29:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.832+0000 7fc3bf4ad700 1 -- 172.21.15.148:0/3839376877 wait complete. 2023-10-24T00:29:06.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-10-24T00:29:06.845 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-24T00:29:06.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.958+0000 7fe7ff8d5700 1 Processor -- start 2023-10-24T00:29:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.958+0000 7fe7ff8d5700 1 -- start start 2023-10-24T00:29:06.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7ff8d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7f8151060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7ff8d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe7f8063e70 0x7fe7f80c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7ff8d5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f80c32f0 con 0x7fe7f80c2810 2023-10-24T00:29:06.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7ff8d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f8064d10 con 0x7fe7f8063e70 2023-10-24T00:29:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7ff8d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80c35d0 con 0x7fe7f8150c80 2023-10-24T00:29:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7fce70700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe7f80c2810 0x7fe7f8063760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57524/0 (socket says 172.21.15.148:57524) 2023-10-24T00:29:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.959+0000 7fe7fce70700 1 -- 172.21.15.148:0/354769659 learned_addr learned my addr 172.21.15.148:0/354769659 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7f8151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606525547 0 0) 0x7fe7f80c32f0 con 0x7fe7f80c2810 2023-10-24T00:29:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fde72700 1 --2- 172.21.15.148:0/354769659 >> v2:172.21.15.150:3300/0 conn(0x7fe7f8063e70 0x7fe7f80c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e40033f0 con 0x7fe7f80c2810 2023-10-24T00:29:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454056292 0 0) 0x7fe7e40033f0 con 0x7fe7f80c2810 2023-10-24T00:29:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 msgr2=0x7fe7f8151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7f8151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 >> v2:172.21.15.150:3300/0 conn(0x7fe7f8063e70 msgr2=0x7fe7f80c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 --2- 172.21.15.148:0/354769659 >> v2:172.21.15.150:3300/0 conn(0x7fe7f8063e70 0x7fe7f80c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80c38b0 con 0x7fe7f80c2810 2023-10-24T00:29:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe7e8001470 con 0x7fe7f80c2810 2023-10-24T00:29:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 >> v1:172.21.15.148:6789/0 conn(0x7fe7f80c2810 legacy=0x7fe7f8063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e40038e0 0x7fe7e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e4004690 0x7fe7e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8064d10 con 0x7fe7e40038e0 2023-10-24T00:29:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80c35d0 con 0x7fe7e4004690 2023-10-24T00:29:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e400b8e0 con 0x7fe7f8150c80 2023-10-24T00:29:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e40038e0 0x7fe7e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fce70700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e4004690 0x7fe7e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fde72700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 -- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 msgr2=0x7fe7e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7f8150c80 0x7fe7e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 -- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e4004690 msgr2=0x7fe7e4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7e4004690 0x7fe7e4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.960+0000 7fe7fd671700 1 -- 172.21.15.148:0/354769659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e40033f0 con 0x7fe7e40038e0 2023-10-24T00:29:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7fd671700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e40038e0 0x7fe7e4003d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe7f400e210 tx=0x7fe7f400b040).ready entity=mon.0 client_cookie=e294a4408f0836b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4009ac0 con 0x7fe7e40038e0 2023-10-24T00:29:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400f040 con 0x7fe7e40038e0 2023-10-24T00:29:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7effff700 1 -- 172.21.15.148:0/354769659 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400ecd0 con 0x7fe7e40038e0 2023-10-24T00:29:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/354769659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e40038e0 msgr2=0x7fe7e4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/354769659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7e40038e0 0x7fe7e4003d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fe7f400e210 tx=0x7fe7f400b040).stop 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7fde72700 1 -- 172.21.15.148:0/354769659 reap_dead start 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/354769659 shutdown_connections 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/354769659 >> 172.21.15.148:0/354769659 conn(0x7fe7f80c7ee0 msgr2=0x7fe7f80c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/354769659 shutdown_connections 2023-10-24T00:29:06.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.961+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/354769659 wait complete. 2023-10-24T00:29:06.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.962+0000 7fe7ff8d5700 1 Processor -- start 2023-10-24T00:29:06.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.962+0000 7fe7ff8d5700 1 -- start start 2023-10-24T00:29:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7e40038e0 0x7fe7f814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 0x7fe7f8154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80bf470 con 0x7fe7f8154fc0 2023-10-24T00:29:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8155400 con 0x7fe7f814d360 2023-10-24T00:29:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7ff8d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81534a0 con 0x7fe7e40038e0 2023-10-24T00:29:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.963+0000 7fe7fde72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53270/0 (socket says 172.21.15.148:53270) 2023-10-24T00:29:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 -- 172.21.15.148:0/2613730773 learned_addr learned my addr 172.21.15.148:0/2613730773 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fce70700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 0x7fe7f8154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fd671700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7e40038e0 0x7fe7f814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 -- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7e40038e0 msgr2=0x7fe7f814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7e40038e0 0x7fe7f814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 -- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 msgr2=0x7fe7f8154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:06.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 0x7fe7f8154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 -- 172.21.15.148:0/2613730773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8153780 con 0x7fe7f8154fc0 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fce70700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 0x7fe7f8154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7fde72700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe7f8064270 tx=0x7fe7f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000f700 con 0x7fe7f8154fc0 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f000f860 con 0x7fe7f8154fc0 2023-10-24T00:29:06.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f8153a60 con 0x7fe7f8154fc0 2023-10-24T00:29:06.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000fc00 con 0x7fe7f8154fc0 2023-10-24T00:29:06.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.964+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f8152c10 con 0x7fe7f8154fc0 2023-10-24T00:29:06.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.965+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f80bf5e0 con 0x7fe7f8154fc0 2023-10-24T00:29:06.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.965+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe7f0014440 con 0x7fe7f8154fc0 2023-10-24T00:29:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.966+0000 7fe7ed7fa700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 0x7fe7dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.966+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe7f007a970 con 0x7fe7f8154fc0 2023-10-24T00:29:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.966+0000 7fe7fd671700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 0x7fe7dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.966+0000 7fe7fd671700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 0x7fe7dc061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe7f400afd0 tx=0x7fe7f401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:06.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:06.970+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe7f80bf5e0 con 0x7fe7f8154fc0 2023-10-24T00:29:07.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.128+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7f80bf5b0 con 0x7fe7dc05f150 2023-10-24T00:29:07.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.137+0000 7fe7ed7fa700 1 -- 172.21.15.148:0/2613730773 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336305 (secure 0 0 0) 0x7fe7f80bf5b0 con 0x7fe7dc05f150 2023-10-24T00:29:07.143 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 msgr2=0x7fe7dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 0x7fe7dc061610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe7f400afd0 tx=0x7fe7f401a000).stop 2023-10-24T00:29:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 msgr2=0x7fe7f8152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe7f8064270 tx=0x7fe7f0009060).stop 2023-10-24T00:29:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 shutdown_connections 2023-10-24T00:29:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7dc05f150 0x7fe7dc061610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7f8154fc0 0x7fe7f8152720 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7e40038e0 0x7fe7f814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 --2- 172.21.15.148:0/2613730773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7f814d360 0x7fe7f8154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 >> 172.21.15.148:0/2613730773 conn(0x7fe7f80c7ee0 msgr2=0x7fe7f814dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 shutdown_connections 2023-10-24T00:29:07.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.141+0000 7fe7ff8d5700 1 -- 172.21.15.148:0/2613730773 wait complete. 2023-10-24T00:29:07.148 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:07.154 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-24T00:29:06.771473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":686348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002693"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202675+0000","last_change":"2023-10-24T00:28:53.197457+0000","last_active":"2023-10-24T00:28:53.202675+0000","last_peered":"2023-10-24T00:28:53.202675+0000","last_clean":"2023-10-24T00:28:53.202675+0000","last_became_active":"2023-10-24T00:28:53.197181+0000","last_became_peered":"2023-10-24T00:28:53.197181+0000","last_unstale":"2023-10-24T00:28:53.202675+0000","last_undegraded":"2023-10-24T00:28:53.202675+0000","last_fullsized":"2023-10-24T00:28:53.202675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196253+0000","last_change":"2023-10-24T00:28:52.832585+0000","last_active":"2023-10-24T00:28:53.196253+0000","last_peered":"2023-10-24T00:28:53.196253+0000","last_clean":"2023-10-24T00:28:53.196253+0000","last_became_active":"2023-10-24T00:28:52.832304+0000","last_became_peered":"2023-10-24T00:28:52.832304+0000","last_unstale":"2023-10-24T00:28:53.196253+0000","last_undegraded":"2023-10-24T00:28:53.196253+0000","last_fullsized":"2023-10-24T00:28:53.196253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219117+0000","last_change":"2023-10-24T00:28:53.216919+0000","last_active":"2023-10-24T00:28:53.219117+0000","last_peered":"2023-10-24T00:28:53.219117+0000","last_clean":"2023-10-24T00:28:53.219117+0000","last_became_active":"2023-10-24T00:28:53.216644+0000","last_became_peered":"2023-10-24T00:28:53.216644+0000","last_unstale":"2023-10-24T00:28:53.219117+0000","last_undegraded":"2023-10-24T00:28:53.219117+0000","last_fullsized":"2023-10-24T00:28:53.219117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189038+0000","last_change":"2023-10-24T00:28:52.834106+0000","last_active":"2023-10-24T00:28:53.189038+0000","last_peered":"2023-10-24T00:28:53.189038+0000","last_clean":"2023-10-24T00:28:53.189038+0000","last_became_active":"2023-10-24T00:28:52.833861+0000","last_became_peered":"2023-10-24T00:28:52.833861+0000","last_unstale":"2023-10-24T00:28:53.189038+0000","last_undegraded":"2023-10-24T00:28:53.189038+0000","last_fullsized":"2023-10-24T00:28:53.189038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219445+0000","last_change":"2023-10-24T00:28:53.215329+0000","last_active":"2023-10-24T00:28:53.219445+0000","last_peered":"2023-10-24T00:28:53.219445+0000","last_clean":"2023-10-24T00:28:53.219445+0000","last_became_active":"2023-10-24T00:28:53.215054+0000","last_became_peered":"2023-10-24T00:28:53.215054+0000","last_unstale":"2023-10-24T00:28:53.219445+0000","last_undegraded":"2023-10-24T00:28:53.219445+0000","last_fullsized":"2023-10-24T00:28:53.219445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192190+0000","last_change":"2023-10-24T00:28:52.839855+0000","last_active":"2023-10-24T00:28:53.192190+0000","last_peered":"2023-10-24T00:28:53.192190+0000","last_clean":"2023-10-24T00:28:53.192190+0000","last_became_active":"2023-10-24T00:28:52.839642+0000","last_became_peered":"2023-10-24T00:28:52.839642+0000","last_unstale":"2023-10-24T00:28:53.192190+0000","last_undegraded":"2023-10-24T00:28:53.192190+0000","last_fullsized":"2023-10-24T00:28:53.192190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208075+0000","last_change":"2023-10-24T00:28:53.198164+0000","last_active":"2023-10-24T00:28:53.208075+0000","last_peered":"2023-10-24T00:28:53.208075+0000","last_clean":"2023-10-24T00:28:53.208075+0000","last_became_active":"2023-10-24T00:28:53.197880+0000","last_became_peered":"2023-10-24T00:28:53.197880+0000","last_unstale":"2023-10-24T00:28:53.208075+0000","last_undegraded":"2023-10-24T00:28:53.208075+0000","last_fullsized":"2023-10-24T00:28:53.208075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213801+0000","last_change":"2023-10-24T00:28:52.841842+0000","last_active":"2023-10-24T00:28:53.213801+0000","last_peered":"2023-10-24T00:28:53.213801+0000","last_clean":"2023-10-24T00:28:53.213801+0000","last_became_active":"2023-10-24T00:28:52.841497+0000","last_became_peered":"2023-10-24T00:28:52.841497+0000","last_unstale":"2023-10-24T00:28:53.213801+0000","last_undegraded":"2023-10-24T00:28:53.213801+0000","last_fullsized":"2023-10-24T00:28:53.213801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211799+0000","last_change":"2023-10-24T00:28:53.206480+0000","last_active":"2023-10-24T00:28:53.211799+0000","last_peered":"2023-10-24T00:28:53.211799+0000","last_clean":"2023-10-24T00:28:53.211799+0000","last_became_active":"2023-10-24T00:28:53.206200+0000","last_became_peered":"2023-10-24T00:28:53.206200+0000","last_unstale":"2023-10-24T00:28:53.211799+0000","last_undegraded":"2023-10-24T00:28:53.211799+0000","last_fullsized":"2023-10-24T00:28:53.211799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208301+0000","last_change":"2023-10-24T00:28:52.837935+0000","last_active":"2023-10-24T00:28:53.208301+0000","last_peered":"2023-10-24T00:28:53.208301+0000","last_clean":"2023-10-24T00:28:53.208301+0000","last_became_active":"2023-10-24T00:28:52.837653+0000","last_became_peered":"2023-10-24T00:28:52.837653+0000","last_unstale":"2023-10-24T00:28:53.208301+0000","last_undegraded":"2023-10-24T00:28:53.208301+0000","last_fullsized":"2023-10-24T00:28:53.208301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216889+0000","last_change":"2023-10-24T00:28:53.214654+0000","last_active":"2023-10-24T00:28:53.216889+0000","last_peered":"2023-10-24T00:28:53.216889+0000","last_clean":"2023-10-24T00:28:53.216889+0000","last_became_active":"2023-10-24T00:28:53.214391+0000","last_became_peered":"2023-10-24T00:28:53.214391+0000","last_unstale":"2023-10-24T00:28:53.216889+0000","last_undegraded":"2023-10-24T00:28:53.216889+0000","last_fullsized":"2023-10-24T00:28:53.216889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219715+0000","last_change":"2023-10-24T00:28:52.831368+0000","last_active":"2023-10-24T00:28:53.219715+0000","last_peered":"2023-10-24T00:28:53.219715+0000","last_clean":"2023-10-24T00:28:53.219715+0000","last_became_active":"2023-10-24T00:28:52.831054+0000","last_became_peered":"2023-10-24T00:28:52.831054+0000","last_unstale":"2023-10-24T00:28:53.219715+0000","last_undegraded":"2023-10-24T00:28:53.219715+0000","last_fullsized":"2023-10-24T00:28:53.219715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214442+0000","last_change":"2023-10-24T00:28:53.208856+0000","last_active":"2023-10-24T00:28:53.214442+0000","last_peered":"2023-10-24T00:28:53.214442+0000","last_clean":"2023-10-24T00:28:53.214442+0000","last_became_active":"2023-10-24T00:28:53.208588+0000","last_became_peered":"2023-10-24T00:28:53.208588+0000","last_unstale":"2023-10-24T00:28:53.214442+0000","last_undegraded":"2023-10-24T00:28:53.214442+0000","last_fullsized":"2023-10-24T00:28:53.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216976+0000","last_change":"2023-10-24T00:28:52.829502+0000","last_active":"2023-10-24T00:28:53.216976+0000","last_peered":"2023-10-24T00:28:53.216976+0000","last_clean":"2023-10-24T00:28:53.216976+0000","last_became_active":"2023-10-24T00:28:52.829097+0000","last_became_peered":"2023-10-24T00:28:52.829097+0000","last_unstale":"2023-10-24T00:28:53.216976+0000","last_undegraded":"2023-10-24T00:28:53.216976+0000","last_fullsized":"2023-10-24T00:28:53.216976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207273+0000","last_change":"2023-10-24T00:28:53.197597+0000","last_active":"2023-10-24T00:28:53.207273+0000","last_peered":"2023-10-24T00:28:53.207273+0000","last_clean":"2023-10-24T00:28:53.207273+0000","last_became_active":"2023-10-24T00:28:53.197328+0000","last_became_peered":"2023-10-24T00:28:53.197328+0000","last_unstale":"2023-10-24T00:28:53.207273+0000","last_undegraded":"2023-10-24T00:28:53.207273+0000","last_fullsized":"2023-10-24T00:28:53.207273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214747+0000","last_change":"2023-10-24T00:28:52.830223+0000","last_active":"2023-10-24T00:28:53.214747+0000","last_peered":"2023-10-24T00:28:53.214747+0000","last_clean":"2023-10-24T00:28:53.214747+0000","last_became_active":"2023-10-24T00:28:52.829963+0000","last_became_peered":"2023-10-24T00:28:52.829963+0000","last_unstale":"2023-10-24T00:28:53.214747+0000","last_undegraded":"2023-10-24T00:28:53.214747+0000","last_fullsized":"2023-10-24T00:28:53.214747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221048+0000","last_change":"2023-10-24T00:28:53.218099+0000","last_active":"2023-10-24T00:28:53.221048+0000","last_peered":"2023-10-24T00:28:53.221048+0000","last_clean":"2023-10-24T00:28:53.221048+0000","last_became_active":"2023-10-24T00:28:53.217842+0000","last_became_peered":"2023-10-24T00:28:53.217842+0000","last_unstale":"2023-10-24T00:28:53.221048+0000","last_undegraded":"2023-10-24T00:28:53.221048+0000","last_fullsized":"2023-10-24T00:28:53.221048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208421+0000","last_change":"2023-10-24T00:28:52.844225+0000","last_active":"2023-10-24T00:28:53.208421+0000","last_peered":"2023-10-24T00:28:53.208421+0000","last_clean":"2023-10-24T00:28:53.208421+0000","last_became_active":"2023-10-24T00:28:52.843751+0000","last_became_peered":"2023-10-24T00:28:52.843751+0000","last_unstale":"2023-10-24T00:28:53.208421+0000","last_undegraded":"2023-10-24T00:28:53.208421+0000","last_fullsized":"2023-10-24T00:28:53.208421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218875+0000","last_change":"2023-10-24T00:28:53.214994+0000","last_active":"2023-10-24T00:28:53.218875+0000","last_peered":"2023-10-24T00:28:53.218875+0000","last_clean":"2023-10-24T00:28:53.218875+0000","last_became_active":"2023-10-24T00:28:53.214737+0000","last_became_peered":"2023-10-24T00:28:53.214737+0000","last_unstale":"2023-10-24T00:28:53.218875+0000","last_undegraded":"2023-10-24T00:28:53.218875+0000","last_fullsized":"2023-10-24T00:28:53.218875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195147+0000","last_change":"2023-10-24T00:28:52.833269+0000","last_active":"2023-10-24T00:28:53.195147+0000","last_peered":"2023-10-24T00:28:53.195147+0000","last_clean":"2023-10-24T00:28:53.195147+0000","last_became_active":"2023-10-24T00:28:52.832982+0000","last_became_peered":"2023-10-24T00:28:52.832982+0000","last_unstale":"2023-10-24T00:28:53.195147+0000","last_undegraded":"2023-10-24T00:28:53.195147+0000","last_fullsized":"2023-10-24T00:28:53.195147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209960+0000","last_change":"2023-10-24T00:28:53.207217+0000","last_active":"2023-10-24T00:28:53.209960+0000","last_peered":"2023-10-24T00:28:53.209960+0000","last_clean":"2023-10-24T00:28:53.209960+0000","last_became_active":"2023-10-24T00:28:53.206965+0000","last_became_peered":"2023-10-24T00:28:53.206965+0000","last_unstale":"2023-10-24T00:28:53.209960+0000","last_undegraded":"2023-10-24T00:28:53.209960+0000","last_fullsized":"2023-10-24T00:28:53.209960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219384+0000","last_change":"2023-10-24T00:28:52.842202+0000","last_active":"2023-10-24T00:28:53.219384+0000","last_peered":"2023-10-24T00:28:53.219384+0000","last_clean":"2023-10-24T00:28:53.219384+0000","last_became_active":"2023-10-24T00:28:52.841831+0000","last_became_peered":"2023-10-24T00:28:52.841831+0000","last_unstale":"2023-10-24T00:28:53.219384+0000","last_undegraded":"2023-10-24T00:28:53.219384+0000","last_fullsized":"2023-10-24T00:28:53.219384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219913+0000","last_change":"2023-10-24T00:28:53.212670+0000","last_active":"2023-10-24T00:28:53.219913+0000","last_peered":"2023-10-24T00:28:53.219913+0000","last_clean":"2023-10-24T00:28:53.219913+0000","last_became_active":"2023-10-24T00:28:53.212381+0000","last_became_peered":"2023-10-24T00:28:53.212381+0000","last_unstale":"2023-10-24T00:28:53.219913+0000","last_undegraded":"2023-10-24T00:28:53.219913+0000","last_fullsized":"2023-10-24T00:28:53.219913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216783+0000","last_change":"2023-10-24T00:28:52.828196+0000","last_active":"2023-10-24T00:28:53.216783+0000","last_peered":"2023-10-24T00:28:53.216783+0000","last_clean":"2023-10-24T00:28:53.216783+0000","last_became_active":"2023-10-24T00:28:52.827920+0000","last_became_peered":"2023-10-24T00:28:52.827920+0000","last_unstale":"2023-10-24T00:28:53.216783+0000","last_undegraded":"2023-10-24T00:28:53.216783+0000","last_fullsized":"2023-10-24T00:28:53.216783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214085+0000","last_change":"2023-10-24T00:28:53.201055+0000","last_active":"2023-10-24T00:28:53.214085+0000","last_peered":"2023-10-24T00:28:53.214085+0000","last_clean":"2023-10-24T00:28:53.214085+0000","last_became_active":"2023-10-24T00:28:53.200779+0000","last_became_peered":"2023-10-24T00:28:53.200779+0000","last_unstale":"2023-10-24T00:28:53.214085+0000","last_undegraded":"2023-10-24T00:28:53.214085+0000","last_fullsized":"2023-10-24T00:28:53.214085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215927+0000","last_change":"2023-10-24T00:28:52.827714+0000","last_active":"2023-10-24T00:28:53.215927+0000","last_peered":"2023-10-24T00:28:53.215927+0000","last_clean":"2023-10-24T00:28:53.215927+0000","last_became_active":"2023-10-24T00:28:52.827404+0000","last_became_peered":"2023-10-24T00:28:52.827404+0000","last_unstale":"2023-10-24T00:28:53.215927+0000","last_undegraded":"2023-10-24T00:28:53.215927+0000","last_fullsized":"2023-10-24T00:28:53.215927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217556+0000","last_change":"2023-10-24T00:28:53.211199+0000","last_active":"2023-10-24T00:28:53.217556+0000","last_peered":"2023-10-24T00:28:53.217556+0000","last_clean":"2023-10-24T00:28:53.217556+0000","last_became_active":"2023-10-24T00:28:53.210886+0000","last_became_peered":"2023-10-24T00:28:53.210886+0000","last_unstale":"2023-10-24T00:28:53.217556+0000","last_undegraded":"2023-10-24T00:28:53.217556+0000","last_fullsized":"2023-10-24T00:28:53.217556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198976+0000","last_change":"2023-10-24T00:28:52.832499+0000","last_active":"2023-10-24T00:28:53.198976+0000","last_peered":"2023-10-24T00:28:53.198976+0000","last_clean":"2023-10-24T00:28:53.198976+0000","last_became_active":"2023-10-24T00:28:52.832220+0000","last_became_peered":"2023-10-24T00:28:52.832220+0000","last_unstale":"2023-10-24T00:28:53.198976+0000","last_undegraded":"2023-10-24T00:28:53.198976+0000","last_fullsized":"2023-10-24T00:28:53.198976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218827+0000","last_change":"2023-10-24T00:28:53.213828+0000","last_active":"2023-10-24T00:28:53.218827+0000","last_peered":"2023-10-24T00:28:53.218827+0000","last_clean":"2023-10-24T00:28:53.218827+0000","last_became_active":"2023-10-24T00:28:53.213506+0000","last_became_peered":"2023-10-24T00:28:53.213506+0000","last_unstale":"2023-10-24T00:28:53.218827+0000","last_undegraded":"2023-10-24T00:28:53.218827+0000","last_fullsized":"2023-10-24T00:28:53.218827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207923+0000","last_change":"2023-10-24T00:28:52.835199+0000","last_active":"2023-10-24T00:28:53.207923+0000","last_peered":"2023-10-24T00:28:53.207923+0000","last_clean":"2023-10-24T00:28:53.207923+0000","last_became_active":"2023-10-24T00:28:52.834770+0000","last_became_peered":"2023-10-24T00:28:52.834770+0000","last_unstale":"2023-10-24T00:28:53.207923+0000","last_undegraded":"2023-10-24T00:28:53.207923+0000","last_fullsized":"2023-10-24T00:28:53.207923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215542+0000","last_change":"2023-10-24T00:28:53.210526+0000","last_active":"2023-10-24T00:28:53.215542+0000","last_peered":"2023-10-24T00:28:53.215542+0000","last_clean":"2023-10-24T00:28:53.215542+0000","last_became_active":"2023-10-24T00:28:53.210295+0000","last_became_peered":"2023-10-24T00:28:53.210295+0000","last_unstale":"2023-10-24T00:28:53.215542+0000","last_undegraded":"2023-10-24T00:28:53.215542+0000","last_fullsized":"2023-10-24T00:28:53.215542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202449+0000","last_change":"2023-10-24T00:28:52.842949+0000","last_active":"2023-10-24T00:28:53.202449+0000","last_peered":"2023-10-24T00:28:53.202449+0000","last_clean":"2023-10-24T00:28:53.202449+0000","last_became_active":"2023-10-24T00:28:52.842488+0000","last_became_peered":"2023-10-24T00:28:52.842488+0000","last_unstale":"2023-10-24T00:28:53.202449+0000","last_undegraded":"2023-10-24T00:28:53.202449+0000","last_fullsized":"2023-10-24T00:28:53.202449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218240+0000","last_change":"2023-10-24T00:28:53.213761+0000","last_active":"2023-10-24T00:28:53.218240+0000","last_peered":"2023-10-24T00:28:53.218240+0000","last_clean":"2023-10-24T00:28:53.218240+0000","last_became_active":"2023-10-24T00:28:53.213457+0000","last_became_peered":"2023-10-24T00:28:53.213457+0000","last_unstale":"2023-10-24T00:28:53.218240+0000","last_undegraded":"2023-10-24T00:28:53.218240+0000","last_fullsized":"2023-10-24T00:28:53.218240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205989+0000","last_change":"2023-10-24T00:28:52.836396+0000","last_active":"2023-10-24T00:28:53.205989+0000","last_peered":"2023-10-24T00:28:53.205989+0000","last_clean":"2023-10-24T00:28:53.205989+0000","last_became_active":"2023-10-24T00:28:52.836110+0000","last_became_peered":"2023-10-24T00:28:52.836110+0000","last_unstale":"2023-10-24T00:28:53.205989+0000","last_undegraded":"2023-10-24T00:28:53.205989+0000","last_fullsized":"2023-10-24T00:28:53.205989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218040+0000","last_change":"2023-10-24T00:28:53.213383+0000","last_active":"2023-10-24T00:28:53.218040+0000","last_peered":"2023-10-24T00:28:53.218040+0000","last_clean":"2023-10-24T00:28:53.218040+0000","last_became_active":"2023-10-24T00:28:53.212809+0000","last_became_peered":"2023-10-24T00:28:53.212809+0000","last_unstale":"2023-10-24T00:28:53.218040+0000","last_undegraded":"2023-10-24T00:28:53.218040+0000","last_fullsized":"2023-10-24T00:28:53.218040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196651+0000","last_change":"2023-10-24T00:28:52.833221+0000","last_active":"2023-10-24T00:28:53.196651+0000","last_peered":"2023-10-24T00:28:53.196651+0000","last_clean":"2023-10-24T00:28:53.196651+0000","last_became_active":"2023-10-24T00:28:52.832941+0000","last_became_peered":"2023-10-24T00:28:52.832941+0000","last_unstale":"2023-10-24T00:28:53.196651+0000","last_undegraded":"2023-10-24T00:28:53.196651+0000","last_fullsized":"2023-10-24T00:28:53.196651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.201868+0000","last_change":"2023-10-24T00:28:53.197450+0000","last_active":"2023-10-24T00:28:53.201868+0000","last_peered":"2023-10-24T00:28:53.201868+0000","last_clean":"2023-10-24T00:28:53.201868+0000","last_became_active":"2023-10-24T00:28:53.197178+0000","last_became_peered":"2023-10-24T00:28:53.197178+0000","last_unstale":"2023-10-24T00:28:53.201868+0000","last_undegraded":"2023-10-24T00:28:53.201868+0000","last_fullsized":"2023-10-24T00:28:53.201868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.191976+0000","last_change":"2023-10-24T00:28:52.832101+0000","last_active":"2023-10-24T00:28:53.191976+0000","last_peered":"2023-10-24T00:28:53.191976+0000","last_clean":"2023-10-24T00:28:53.191976+0000","last_became_active":"2023-10-24T00:28:52.831799+0000","last_became_peered":"2023-10-24T00:28:52.831799+0000","last_unstale":"2023-10-24T00:28:53.191976+0000","last_undegraded":"2023-10-24T00:28:53.191976+0000","last_fullsized":"2023-10-24T00:28:53.191976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189164+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:53.189164+0000","last_peered":"2023-10-24T00:28:53.189164+0000","last_clean":"2023-10-24T00:28:53.189164+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:53.189164+0000","last_undegraded":"2023-10-24T00:28:53.189164+0000","last_fullsized":"2023-10-24T00:28:53.189164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208258+0000","last_change":"2023-10-24T00:28:52.837352+0000","last_active":"2023-10-24T00:28:53.208258+0000","last_peered":"2023-10-24T00:28:53.208258+0000","last_clean":"2023-10-24T00:28:53.208258+0000","last_became_active":"2023-10-24T00:28:52.836889+0000","last_became_peered":"2023-10-24T00:28:52.836889+0000","last_unstale":"2023-10-24T00:28:53.208258+0000","last_undegraded":"2023-10-24T00:28:53.208258+0000","last_fullsized":"2023-10-24T00:28:53.208258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215067+0000","last_change":"2023-10-24T00:28:53.212561+0000","last_active":"2023-10-24T00:28:53.215067+0000","last_peered":"2023-10-24T00:28:53.215067+0000","last_clean":"2023-10-24T00:28:53.215067+0000","last_became_active":"2023-10-24T00:28:53.212213+0000","last_became_peered":"2023-10-24T00:28:53.212213+0000","last_unstale":"2023-10-24T00:28:53.215067+0000","last_undegraded":"2023-10-24T00:28:53.215067+0000","last_fullsized":"2023-10-24T00:28:53.215067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208145+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:53.208145+0000","last_peered":"2023-10-24T00:28:53.208145+0000","last_clean":"2023-10-24T00:28:53.208145+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:53.208145+0000","last_undegraded":"2023-10-24T00:28:53.208145+0000","last_fullsized":"2023-10-24T00:28:53.208145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196733+0000","last_change":"2023-10-24T00:28:52.841779+0000","last_active":"2023-10-24T00:28:53.196733+0000","last_peered":"2023-10-24T00:28:53.196733+0000","last_clean":"2023-10-24T00:28:53.196733+0000","last_became_active":"2023-10-24T00:28:52.841486+0000","last_became_peered":"2023-10-24T00:28:52.841486+0000","last_unstale":"2023-10-24T00:28:53.196733+0000","last_undegraded":"2023-10-24T00:28:53.196733+0000","last_fullsized":"2023-10-24T00:28:53.196733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202018+0000","last_change":"2023-10-24T00:28:53.198838+0000","last_active":"2023-10-24T00:28:53.202018+0000","last_peered":"2023-10-24T00:28:53.202018+0000","last_clean":"2023-10-24T00:28:53.202018+0000","last_became_active":"2023-10-24T00:28:53.198572+0000","last_became_peered":"2023-10-24T00:28:53.198572+0000","last_unstale":"2023-10-24T00:28:53.202018+0000","last_undegraded":"2023-10-24T00:28:53.202018+0000","last_fullsized":"2023-10-24T00:28:53.202018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218830+0000","last_change":"2023-10-24T00:28:53.215991+0000","last_active":"2023-10-24T00:28:53.218830+0000","last_peered":"2023-10-24T00:28:53.218830+0000","last_clean":"2023-10-24T00:28:53.218830+0000","last_became_active":"2023-10-24T00:28:53.215724+0000","last_became_peered":"2023-10-24T00:28:53.215724+0000","last_unstale":"2023-10-24T00:28:53.218830+0000","last_undegraded":"2023-10-24T00:28:53.218830+0000","last_fullsized":"2023-10-24T00:28:53.218830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194747+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:53.194747+0000","last_peered":"2023-10-24T00:28:53.194747+0000","last_clean":"2023-10-24T00:28:53.194747+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:53.194747+0000","last_undegraded":"2023-10-24T00:28:53.194747+0000","last_fullsized":"2023-10-24T00:28:53.194747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189062+0000","last_change":"2023-10-24T00:28:52.836290+0000","last_active":"2023-10-24T00:28:53.189062+0000","last_peered":"2023-10-24T00:28:53.189062+0000","last_clean":"2023-10-24T00:28:53.189062+0000","last_became_active":"2023-10-24T00:28:52.836025+0000","last_became_peered":"2023-10-24T00:28:52.836025+0000","last_unstale":"2023-10-24T00:28:53.189062+0000","last_undegraded":"2023-10-24T00:28:53.189062+0000","last_fullsized":"2023-10-24T00:28:53.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219556+0000","last_change":"2023-10-24T00:28:53.216794+0000","last_active":"2023-10-24T00:28:53.219556+0000","last_peered":"2023-10-24T00:28:53.219556+0000","last_clean":"2023-10-24T00:28:53.219556+0000","last_became_active":"2023-10-24T00:28:53.216522+0000","last_became_peered":"2023-10-24T00:28:53.216522+0000","last_unstale":"2023-10-24T00:28:53.219556+0000","last_undegraded":"2023-10-24T00:28:53.219556+0000","last_fullsized":"2023-10-24T00:28:53.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207961+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:53.207961+0000","last_peered":"2023-10-24T00:28:53.207961+0000","last_clean":"2023-10-24T00:28:53.207961+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:53.207961+0000","last_undegraded":"2023-10-24T00:28:53.207961+0000","last_fullsized":"2023-10-24T00:28:53.207961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196499+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:53.196499+0000","last_peered":"2023-10-24T00:28:53.196499+0000","last_clean":"2023-10-24T00:28:53.196499+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:53.196499+0000","last_undegraded":"2023-10-24T00:28:53.196499+0000","last_fullsized":"2023-10-24T00:28:53.196499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192193+0000","last_change":"2023-10-24T00:28:52.835633+0000","last_active":"2023-10-24T00:28:53.192193+0000","last_peered":"2023-10-24T00:28:53.192193+0000","last_clean":"2023-10-24T00:28:53.192193+0000","last_became_active":"2023-10-24T00:28:52.833208+0000","last_became_peered":"2023-10-24T00:28:52.833208+0000","last_unstale":"2023-10-24T00:28:53.192193+0000","last_undegraded":"2023-10-24T00:28:53.192193+0000","last_fullsized":"2023-10-24T00:28:53.192193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218638+0000","last_change":"2023-10-24T00:28:53.213575+0000","last_active":"2023-10-24T00:28:53.218638+0000","last_peered":"2023-10-24T00:28:53.218638+0000","last_clean":"2023-10-24T00:28:53.218638+0000","last_became_active":"2023-10-24T00:28:53.209567+0000","last_became_peered":"2023-10-24T00:28:53.209567+0000","last_unstale":"2023-10-24T00:28:53.218638+0000","last_undegraded":"2023-10-24T00:28:53.218638+0000","last_fullsized":"2023-10-24T00:28:53.218638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196975+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:53.196975+0000","last_peered":"2023-10-24T00:28:53.196975+0000","last_clean":"2023-10-24T00:28:53.196975+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:53.196975+0000","last_undegraded":"2023-10-24T00:28:53.196975+0000","last_fullsized":"2023-10-24T00:28:53.196975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205869+0000","last_change":"2023-10-24T00:28:52.840006+0000","last_active":"2023-10-24T00:28:53.205869+0000","last_peered":"2023-10-24T00:28:53.205869+0000","last_clean":"2023-10-24T00:28:53.205869+0000","last_became_active":"2023-10-24T00:28:52.839452+0000","last_became_peered":"2023-10-24T00:28:52.839452+0000","last_unstale":"2023-10-24T00:28:53.205869+0000","last_undegraded":"2023-10-24T00:28:53.205869+0000","last_fullsized":"2023-10-24T00:28:53.205869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198874+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:53.198874+0000","last_peered":"2023-10-24T00:28:53.198874+0000","last_clean":"2023-10-24T00:28:53.198874+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:53.198874+0000","last_undegraded":"2023-10-24T00:28:53.198874+0000","last_fullsized":"2023-10-24T00:28:53.198874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189581+0000","last_change":"2023-10-24T00:28:52.832876+0000","last_active":"2023-10-24T00:28:53.189581+0000","last_peered":"2023-10-24T00:28:53.189581+0000","last_clean":"2023-10-24T00:28:53.189581+0000","last_became_active":"2023-10-24T00:28:52.832617+0000","last_became_peered":"2023-10-24T00:28:52.832617+0000","last_unstale":"2023-10-24T00:28:53.189581+0000","last_undegraded":"2023-10-24T00:28:53.189581+0000","last_fullsized":"2023-10-24T00:28:53.189581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219158+0000","last_change":"2023-10-24T00:28:53.217199+0000","last_active":"2023-10-24T00:28:53.219158+0000","last_peered":"2023-10-24T00:28:53.219158+0000","last_clean":"2023-10-24T00:28:53.219158+0000","last_became_active":"2023-10-24T00:28:53.216879+0000","last_became_peered":"2023-10-24T00:28:53.216879+0000","last_unstale":"2023-10-24T00:28:53.219158+0000","last_undegraded":"2023-10-24T00:28:53.219158+0000","last_fullsized":"2023-10-24T00:28:53.219158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207465+0000","last_change":"2023-10-24T00:28:52.831240+0000","last_active":"2023-10-24T00:28:53.207465+0000","last_peered":"2023-10-24T00:28:53.207465+0000","last_clean":"2023-10-24T00:28:53.207465+0000","last_became_active":"2023-10-24T00:28:52.830998+0000","last_became_peered":"2023-10-24T00:28:52.830998+0000","last_unstale":"2023-10-24T00:28:53.207465+0000","last_undegraded":"2023-10-24T00:28:53.207465+0000","last_fullsized":"2023-10-24T00:28:53.207465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189430+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:53.189430+0000","last_peered":"2023-10-24T00:28:53.189430+0000","last_clean":"2023-10-24T00:28:53.189430+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:53.189430+0000","last_undegraded":"2023-10-24T00:28:53.189430+0000","last_fullsized":"2023-10-24T00:28:53.189430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210569+0000","last_change":"2023-10-24T00:28:53.207984+0000","last_active":"2023-10-24T00:28:53.210569+0000","last_peered":"2023-10-24T00:28:53.210569+0000","last_clean":"2023-10-24T00:28:53.210569+0000","last_became_active":"2023-10-24T00:28:53.206306+0000","last_became_peered":"2023-10-24T00:28:53.206306+0000","last_unstale":"2023-10-24T00:28:53.210569+0000","last_undegraded":"2023-10-24T00:28:53.210569+0000","last_fullsized":"2023-10-24T00:28:53.210569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204049+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:53.204049+0000","last_peered":"2023-10-24T00:28:53.204049+0000","last_clean":"2023-10-24T00:28:53.204049+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:53.204049+0000","last_undegraded":"2023-10-24T00:28:53.204049+0000","last_fullsized":"2023-10-24T00:28:53.204049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213765+0000","last_change":"2023-10-24T00:28:52.845874+0000","last_active":"2023-10-24T00:28:53.213765+0000","last_peered":"2023-10-24T00:28:53.213765+0000","last_clean":"2023-10-24T00:28:53.213765+0000","last_became_active":"2023-10-24T00:28:52.845615+0000","last_became_peered":"2023-10-24T00:28:52.845615+0000","last_unstale":"2023-10-24T00:28:53.213765+0000","last_undegraded":"2023-10-24T00:28:53.213765+0000","last_fullsized":"2023-10-24T00:28:53.213765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217693+0000","last_change":"2023-10-24T00:28:53.212953+0000","last_active":"2023-10-24T00:28:53.217693+0000","last_peered":"2023-10-24T00:28:53.217693+0000","last_clean":"2023-10-24T00:28:53.217693+0000","last_became_active":"2023-10-24T00:28:53.212744+0000","last_became_peered":"2023-10-24T00:28:53.212744+0000","last_unstale":"2023-10-24T00:28:53.217693+0000","last_undegraded":"2023-10-24T00:28:53.217693+0000","last_fullsized":"2023-10-24T00:28:53.217693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209183+0000","last_change":"2023-10-24T00:28:53.200428+0000","last_active":"2023-10-24T00:28:53.209183+0000","last_peered":"2023-10-24T00:28:53.209183+0000","last_clean":"2023-10-24T00:28:53.209183+0000","last_became_active":"2023-10-24T00:28:53.200188+0000","last_became_peered":"2023-10-24T00:28:53.200188+0000","last_unstale":"2023-10-24T00:28:53.209183+0000","last_undegraded":"2023-10-24T00:28:53.209183+0000","last_fullsized":"2023-10-24T00:28:53.209183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209326+0000","last_change":"2023-10-24T00:28:52.841438+0000","last_active":"2023-10-24T00:28:53.209326+0000","last_peered":"2023-10-24T00:28:53.209326+0000","last_clean":"2023-10-24T00:28:53.209326+0000","last_became_active":"2023-10-24T00:28:52.840737+0000","last_became_peered":"2023-10-24T00:28:52.840737+0000","last_unstale":"2023-10-24T00:28:53.209326+0000","last_undegraded":"2023-10-24T00:28:53.209326+0000","last_fullsized":"2023-10-24T00:28:53.209326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221285+0000","last_change":"2023-10-24T00:28:53.214566+0000","last_active":"2023-10-24T00:28:53.221285+0000","last_peered":"2023-10-24T00:28:53.221285+0000","last_clean":"2023-10-24T00:28:53.221285+0000","last_became_active":"2023-10-24T00:28:53.213861+0000","last_became_peered":"2023-10-24T00:28:53.213861+0000","last_unstale":"2023-10-24T00:28:53.221285+0000","last_undegraded":"2023-10-24T00:28:53.221285+0000","last_fullsized":"2023-10-24T00:28:53.221285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207937+0000","last_change":"2023-10-24T00:28:52.837316+0000","last_active":"2023-10-24T00:28:53.207937+0000","last_peered":"2023-10-24T00:28:53.207937+0000","last_clean":"2023-10-24T00:28:53.207937+0000","last_became_active":"2023-10-24T00:28:52.836698+0000","last_became_peered":"2023-10-24T00:28:52.836698+0000","last_unstale":"2023-10-24T00:28:53.207937+0000","last_undegraded":"2023-10-24T00:28:53.207937+0000","last_fullsized":"2023-10-24T00:28:53.207937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214867+0000","last_change":"2023-10-24T00:28:53.202586+0000","last_active":"2023-10-24T00:28:53.214867+0000","last_peered":"2023-10-24T00:28:53.214867+0000","last_clean":"2023-10-24T00:28:53.214867+0000","last_became_active":"2023-10-24T00:28:53.202224+0000","last_became_peered":"2023-10-24T00:28:53.202224+0000","last_unstale":"2023-10-24T00:28:53.214867+0000","last_undegraded":"2023-10-24T00:28:53.214867+0000","last_fullsized":"2023-10-24T00:28:53.214867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218867+0000","last_change":"2023-10-24T00:28:52.836652+0000","last_active":"2023-10-24T00:28:53.218867+0000","last_peered":"2023-10-24T00:28:53.218867+0000","last_clean":"2023-10-24T00:28:53.218867+0000","last_became_active":"2023-10-24T00:28:52.833453+0000","last_became_peered":"2023-10-24T00:28:52.833453+0000","last_unstale":"2023-10-24T00:28:53.218867+0000","last_undegraded":"2023-10-24T00:28:53.218867+0000","last_fullsized":"2023-10-24T00:28:53.218867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211781+0000","last_change":"2023-10-24T00:28:53.198873+0000","last_active":"2023-10-24T00:28:53.211781+0000","last_peered":"2023-10-24T00:28:53.211781+0000","last_clean":"2023-10-24T00:28:53.211781+0000","last_became_active":"2023-10-24T00:28:53.198630+0000","last_became_peered":"2023-10-24T00:28:53.198630+0000","last_unstale":"2023-10-24T00:28:53.211781+0000","last_undegraded":"2023-10-24T00:28:53.211781+0000","last_fullsized":"2023-10-24T00:28:53.211781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203535+0000","last_change":"2023-10-24T00:28:52.830907+0000","last_active":"2023-10-24T00:28:53.203535+0000","last_peered":"2023-10-24T00:28:53.203535+0000","last_clean":"2023-10-24T00:28:53.203535+0000","last_became_active":"2023-10-24T00:28:52.830585+0000","last_became_peered":"2023-10-24T00:28:52.830585+0000","last_unstale":"2023-10-24T00:28:53.203535+0000","last_undegraded":"2023-10-24T00:28:53.203535+0000","last_fullsized":"2023-10-24T00:28:53.203535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214428+0000","last_change":"2023-10-24T00:28:53.207126+0000","last_active":"2023-10-24T00:28:53.214428+0000","last_peered":"2023-10-24T00:28:53.214428+0000","last_clean":"2023-10-24T00:28:53.214428+0000","last_became_active":"2023-10-24T00:28:53.206860+0000","last_became_peered":"2023-10-24T00:28:53.206860+0000","last_unstale":"2023-10-24T00:28:53.214428+0000","last_undegraded":"2023-10-24T00:28:53.214428+0000","last_fullsized":"2023-10-24T00:28:53.214428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219605+0000","last_change":"2023-10-24T00:28:52.839828+0000","last_active":"2023-10-24T00:28:53.219605+0000","last_peered":"2023-10-24T00:28:53.219605+0000","last_clean":"2023-10-24T00:28:53.219605+0000","last_became_active":"2023-10-24T00:28:52.839501+0000","last_became_peered":"2023-10-24T00:28:52.839501+0000","last_unstale":"2023-10-24T00:28:53.219605+0000","last_undegraded":"2023-10-24T00:28:53.219605+0000","last_fullsized":"2023-10-24T00:28:53.219605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208863+0000","last_change":"2023-10-24T00:28:53.207780+0000","last_active":"2023-10-24T00:28:53.208863+0000","last_peered":"2023-10-24T00:28:53.208863+0000","last_clean":"2023-10-24T00:28:53.208863+0000","last_became_active":"2023-10-24T00:28:53.207543+0000","last_became_peered":"2023-10-24T00:28:53.207543+0000","last_unstale":"2023-10-24T00:28:53.208863+0000","last_undegraded":"2023-10-24T00:28:53.208863+0000","last_fullsized":"2023-10-24T00:28:53.208863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202990+0000","last_change":"2023-10-24T00:28:52.841865+0000","last_active":"2023-10-24T00:28:53.202990+0000","last_peered":"2023-10-24T00:28:53.202990+0000","last_clean":"2023-10-24T00:28:53.202990+0000","last_became_active":"2023-10-24T00:28:52.841563+0000","last_became_peered":"2023-10-24T00:28:52.841563+0000","last_unstale":"2023-10-24T00:28:53.202990+0000","last_undegraded":"2023-10-24T00:28:53.202990+0000","last_fullsized":"2023-10-24T00:28:53.202990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210510+0000","last_change":"2023-10-24T00:28:53.209114+0000","last_active":"2023-10-24T00:28:53.210510+0000","last_peered":"2023-10-24T00:28:53.210510+0000","last_clean":"2023-10-24T00:28:53.210510+0000","last_became_active":"2023-10-24T00:28:53.208807+0000","last_became_peered":"2023-10-24T00:28:53.208807+0000","last_unstale":"2023-10-24T00:28:53.210510+0000","last_undegraded":"2023-10-24T00:28:53.210510+0000","last_fullsized":"2023-10-24T00:28:53.210510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194668+0000","last_change":"2023-10-24T00:28:52.844739+0000","last_active":"2023-10-24T00:28:53.194668+0000","last_peered":"2023-10-24T00:28:53.194668+0000","last_clean":"2023-10-24T00:28:53.194668+0000","last_became_active":"2023-10-24T00:28:52.844439+0000","last_became_peered":"2023-10-24T00:28:52.844439+0000","last_unstale":"2023-10-24T00:28:53.194668+0000","last_undegraded":"2023-10-24T00:28:53.194668+0000","last_fullsized":"2023-10-24T00:28:53.194668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221397+0000","last_change":"2023-10-24T00:28:53.218085+0000","last_active":"2023-10-24T00:28:53.221397+0000","last_peered":"2023-10-24T00:28:53.221397+0000","last_clean":"2023-10-24T00:28:53.221397+0000","last_became_active":"2023-10-24T00:28:53.217721+0000","last_became_peered":"2023-10-24T00:28:53.217721+0000","last_unstale":"2023-10-24T00:28:53.221397+0000","last_undegraded":"2023-10-24T00:28:53.221397+0000","last_fullsized":"2023-10-24T00:28:53.221397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208057+0000","last_change":"2023-10-24T00:28:52.835851+0000","last_active":"2023-10-24T00:28:53.208057+0000","last_peered":"2023-10-24T00:28:53.208057+0000","last_clean":"2023-10-24T00:28:53.208057+0000","last_became_active":"2023-10-24T00:28:52.835454+0000","last_became_peered":"2023-10-24T00:28:52.835454+0000","last_unstale":"2023-10-24T00:28:53.208057+0000","last_undegraded":"2023-10-24T00:28:53.208057+0000","last_fullsized":"2023-10-24T00:28:53.208057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214864+0000","last_change":"2023-10-24T00:28:53.211252+0000","last_active":"2023-10-24T00:28:53.214864+0000","last_peered":"2023-10-24T00:28:53.214864+0000","last_clean":"2023-10-24T00:28:53.214864+0000","last_became_active":"2023-10-24T00:28:53.210970+0000","last_became_peered":"2023-10-24T00:28:53.210970+0000","last_unstale":"2023-10-24T00:28:53.214864+0000","last_undegraded":"2023-10-24T00:28:53.214864+0000","last_fullsized":"2023-10-24T00:28:53.214864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206180+0000","last_change":"2023-10-24T00:28:52.841793+0000","last_active":"2023-10-24T00:28:53.206180+0000","last_peered":"2023-10-24T00:28:53.206180+0000","last_clean":"2023-10-24T00:28:53.206180+0000","last_became_active":"2023-10-24T00:28:52.841487+0000","last_became_peered":"2023-10-24T00:28:52.841487+0000","last_unstale":"2023-10-24T00:28:53.206180+0000","last_undegraded":"2023-10-24T00:28:53.206180+0000","last_fullsized":"2023-10-24T00:28:53.206180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210735+0000","last_change":"2023-10-24T00:28:53.208115+0000","last_active":"2023-10-24T00:28:53.210735+0000","last_peered":"2023-10-24T00:28:53.210735+0000","last_clean":"2023-10-24T00:28:53.210735+0000","last_became_active":"2023-10-24T00:28:53.207329+0000","last_became_peered":"2023-10-24T00:28:53.207329+0000","last_unstale":"2023-10-24T00:28:53.210735+0000","last_undegraded":"2023-10-24T00:28:53.210735+0000","last_fullsized":"2023-10-24T00:28:53.210735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195405+0000","last_change":"2023-10-24T00:28:52.833047+0000","last_active":"2023-10-24T00:28:53.195405+0000","last_peered":"2023-10-24T00:28:53.195405+0000","last_clean":"2023-10-24T00:28:53.195405+0000","last_became_active":"2023-10-24T00:28:52.832806+0000","last_became_peered":"2023-10-24T00:28:52.832806+0000","last_unstale":"2023-10-24T00:28:53.195405+0000","last_undegraded":"2023-10-24T00:28:53.195405+0000","last_fullsized":"2023-10-24T00:28:53.195405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221263+0000","last_change":"2023-10-24T00:28:53.214374+0000","last_active":"2023-10-24T00:28:53.221263+0000","last_peered":"2023-10-24T00:28:53.221263+0000","last_clean":"2023-10-24T00:28:53.221263+0000","last_became_active":"2023-10-24T00:28:53.214029+0000","last_became_peered":"2023-10-24T00:28:53.214029+0000","last_unstale":"2023-10-24T00:28:53.221263+0000","last_undegraded":"2023-10-24T00:28:53.221263+0000","last_fullsized":"2023-10-24T00:28:53.221263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189999+0000","last_change":"2023-10-24T00:28:52.831478+0000","last_active":"2023-10-24T00:28:53.189999+0000","last_peered":"2023-10-24T00:28:53.189999+0000","last_clean":"2023-10-24T00:28:53.189999+0000","last_became_active":"2023-10-24T00:28:52.831185+0000","last_became_peered":"2023-10-24T00:28:52.831185+0000","last_unstale":"2023-10-24T00:28:53.189999+0000","last_undegraded":"2023-10-24T00:28:53.189999+0000","last_fullsized":"2023-10-24T00:28:53.189999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203515+0000","last_change":"2023-10-24T00:28:53.197544+0000","last_active":"2023-10-24T00:28:53.203515+0000","last_peered":"2023-10-24T00:28:53.203515+0000","last_clean":"2023-10-24T00:28:53.203515+0000","last_became_active":"2023-10-24T00:28:53.197271+0000","last_became_peered":"2023-10-24T00:28:53.197271+0000","last_unstale":"2023-10-24T00:28:53.203515+0000","last_undegraded":"2023-10-24T00:28:53.203515+0000","last_fullsized":"2023-10-24T00:28:53.203515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-24T00:28:54.402689+0000","last_change":"2023-10-24T00:28:52.835770+0000","last_active":"2023-10-24T00:28:54.402689+0000","last_peered":"2023-10-24T00:28:54.402689+0000","last_clean":"2023-10-24T00:28:54.402689+0000","last_became_active":"2023-10-24T00:28:52.835495+0000","last_became_peered":"2023-10-24T00:28:52.835495+0000","last_unstale":"2023-10-24T00:28:54.402689+0000","last_undegraded":"2023-10-24T00:28:54.402689+0000","last_fullsized":"2023-10-24T00:28:54.402689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216732+0000","last_change":"2023-10-24T00:28:53.210440+0000","last_active":"2023-10-24T00:28:53.216732+0000","last_peered":"2023-10-24T00:28:53.216732+0000","last_clean":"2023-10-24T00:28:53.216732+0000","last_became_active":"2023-10-24T00:28:53.210153+0000","last_became_peered":"2023-10-24T00:28:53.210153+0000","last_unstale":"2023-10-24T00:28:53.216732+0000","last_undegraded":"2023-10-24T00:28:53.216732+0000","last_fullsized":"2023-10-24T00:28:53.216732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195686+0000","last_change":"2023-10-24T00:28:52.834627+0000","last_active":"2023-10-24T00:28:53.195686+0000","last_peered":"2023-10-24T00:28:53.195686+0000","last_clean":"2023-10-24T00:28:53.195686+0000","last_became_active":"2023-10-24T00:28:52.834319+0000","last_became_peered":"2023-10-24T00:28:52.834319+0000","last_unstale":"2023-10-24T00:28:53.195686+0000","last_undegraded":"2023-10-24T00:28:53.195686+0000","last_fullsized":"2023-10-24T00:28:53.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218902+0000","last_change":"2023-10-24T00:28:53.215043+0000","last_active":"2023-10-24T00:28:53.218902+0000","last_peered":"2023-10-24T00:28:53.218902+0000","last_clean":"2023-10-24T00:28:53.218902+0000","last_became_active":"2023-10-24T00:28:53.214443+0000","last_became_peered":"2023-10-24T00:28:53.214443+0000","last_unstale":"2023-10-24T00:28:53.218902+0000","last_undegraded":"2023-10-24T00:28:53.218902+0000","last_fullsized":"2023-10-24T00:28:53.218902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207692+0000","last_change":"2023-10-24T00:28:52.834431+0000","last_active":"2023-10-24T00:28:53.207692+0000","last_peered":"2023-10-24T00:28:53.207692+0000","last_clean":"2023-10-24T00:28:53.207692+0000","last_became_active":"2023-10-24T00:28:52.834148+0000","last_became_peered":"2023-10-24T00:28:52.834148+0000","last_unstale":"2023-10-24T00:28:53.207692+0000","last_undegraded":"2023-10-24T00:28:53.207692+0000","last_fullsized":"2023-10-24T00:28:53.207692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218060+0000","last_change":"2023-10-24T00:28:53.213561+0000","last_active":"2023-10-24T00:28:53.218060+0000","last_peered":"2023-10-24T00:28:53.218060+0000","last_clean":"2023-10-24T00:28:53.218060+0000","last_became_active":"2023-10-24T00:28:53.213113+0000","last_became_peered":"2023-10-24T00:28:53.213113+0000","last_unstale":"2023-10-24T00:28:53.218060+0000","last_undegraded":"2023-10-24T00:28:53.218060+0000","last_fullsized":"2023-10-24T00:28:53.218060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.193241+0000","last_change":"2023-10-24T00:28:52.836152+0000","last_active":"2023-10-24T00:28:53.193241+0000","last_peered":"2023-10-24T00:28:53.193241+0000","last_clean":"2023-10-24T00:28:53.193241+0000","last_became_active":"2023-10-24T00:28:52.835876+0000","last_became_peered":"2023-10-24T00:28:52.835876+0000","last_unstale":"2023-10-24T00:28:53.193241+0000","last_undegraded":"2023-10-24T00:28:53.193241+0000","last_fullsized":"2023-10-24T00:28:53.193241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218780+0000","last_change":"2023-10-24T00:28:53.215079+0000","last_active":"2023-10-24T00:28:53.218780+0000","last_peered":"2023-10-24T00:28:53.218780+0000","last_clean":"2023-10-24T00:28:53.218780+0000","last_became_active":"2023-10-24T00:28:53.214831+0000","last_became_peered":"2023-10-24T00:28:53.214831+0000","last_unstale":"2023-10-24T00:28:53.218780+0000","last_undegraded":"2023-10-24T00:28:53.218780+0000","last_fullsized":"2023-10-24T00:28:53.218780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208256+0000","last_change":"2023-10-24T00:28:52.836578+0000","last_active":"2023-10-24T00:28:53.208256+0000","last_peered":"2023-10-24T00:28:53.208256+0000","last_clean":"2023-10-24T00:28:53.208256+0000","last_became_active":"2023-10-24T00:28:52.836282+0000","last_became_peered":"2023-10-24T00:28:52.836282+0000","last_unstale":"2023-10-24T00:28:53.208256+0000","last_undegraded":"2023-10-24T00:28:53.208256+0000","last_fullsized":"2023-10-24T00:28:53.208256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221391+0000","last_change":"2023-10-24T00:28:53.215101+0000","last_active":"2023-10-24T00:28:53.221391+0000","last_peered":"2023-10-24T00:28:53.221391+0000","last_clean":"2023-10-24T00:28:53.221391+0000","last_became_active":"2023-10-24T00:28:53.214824+0000","last_became_peered":"2023-10-24T00:28:53.214824+0000","last_unstale":"2023-10-24T00:28:53.221391+0000","last_undegraded":"2023-10-24T00:28:53.221391+0000","last_fullsized":"2023-10-24T00:28:53.221391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.220171+0000","last_change":"2023-10-24T00:28:52.841688+0000","last_active":"2023-10-24T00:28:53.220171+0000","last_peered":"2023-10-24T00:28:53.220171+0000","last_clean":"2023-10-24T00:28:53.220171+0000","last_became_active":"2023-10-24T00:28:52.841119+0000","last_became_peered":"2023-10-24T00:28:52.841119+0000","last_unstale":"2023-10-24T00:28:53.220171+0000","last_undegraded":"2023-10-24T00:28:53.220171+0000","last_fullsized":"2023-10-24T00:28:53.220171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221472+0000","last_change":"2023-10-24T00:28:53.219544+0000","last_active":"2023-10-24T00:28:53.221472+0000","last_peered":"2023-10-24T00:28:53.221472+0000","last_clean":"2023-10-24T00:28:53.221472+0000","last_became_active":"2023-10-24T00:28:53.218846+0000","last_became_peered":"2023-10-24T00:28:53.218846+0000","last_unstale":"2023-10-24T00:28:53.221472+0000","last_undegraded":"2023-10-24T00:28:53.221472+0000","last_fullsized":"2023-10-24T00:28:53.221472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206514+0000","last_change":"2023-10-24T00:28:52.837080+0000","last_active":"2023-10-24T00:28:53.206514+0000","last_peered":"2023-10-24T00:28:53.206514+0000","last_clean":"2023-10-24T00:28:53.206514+0000","last_became_active":"2023-10-24T00:28:52.836776+0000","last_became_peered":"2023-10-24T00:28:52.836776+0000","last_unstale":"2023-10-24T00:28:53.206514+0000","last_undegraded":"2023-10-24T00:28:53.206514+0000","last_fullsized":"2023-10-24T00:28:53.206514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218929+0000","last_change":"2023-10-24T00:28:53.216046+0000","last_active":"2023-10-24T00:28:53.218929+0000","last_peered":"2023-10-24T00:28:53.218929+0000","last_clean":"2023-10-24T00:28:53.218929+0000","last_became_active":"2023-10-24T00:28:53.213450+0000","last_became_peered":"2023-10-24T00:28:53.213450+0000","last_unstale":"2023-10-24T00:28:53.218929+0000","last_undegraded":"2023-10-24T00:28:53.218929+0000","last_fullsized":"2023-10-24T00:28:53.218929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214964+0000","last_change":"2023-10-24T00:28:52.830778+0000","last_active":"2023-10-24T00:28:53.214964+0000","last_peered":"2023-10-24T00:28:53.214964+0000","last_clean":"2023-10-24T00:28:53.214964+0000","last_became_active":"2023-10-24T00:28:52.830521+0000","last_became_peered":"2023-10-24T00:28:52.830521+0000","last_unstale":"2023-10-24T00:28:53.214964+0000","last_undegraded":"2023-10-24T00:28:53.214964+0000","last_fullsized":"2023-10-24T00:28:53.214964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211818+0000","last_change":"2023-10-24T00:28:53.208010+0000","last_active":"2023-10-24T00:28:53.211818+0000","last_peered":"2023-10-24T00:28:53.211818+0000","last_clean":"2023-10-24T00:28:53.211818+0000","last_became_active":"2023-10-24T00:28:53.207747+0000","last_became_peered":"2023-10-24T00:28:53.207747+0000","last_unstale":"2023-10-24T00:28:53.211818+0000","last_undegraded":"2023-10-24T00:28:53.211818+0000","last_fullsized":"2023-10-24T00:28:53.211818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195211+0000","last_change":"2023-10-24T00:28:52.834362+0000","last_active":"2023-10-24T00:28:53.195211+0000","last_peered":"2023-10-24T00:28:53.195211+0000","last_clean":"2023-10-24T00:28:53.195211+0000","last_became_active":"2023-10-24T00:28:52.834075+0000","last_became_peered":"2023-10-24T00:28:52.834075+0000","last_unstale":"2023-10-24T00:28:53.195211+0000","last_undegraded":"2023-10-24T00:28:53.195211+0000","last_fullsized":"2023-10-24T00:28:53.195211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219214+0000","last_change":"2023-10-24T00:28:53.209612+0000","last_active":"2023-10-24T00:28:53.219214+0000","last_peered":"2023-10-24T00:28:53.219214+0000","last_clean":"2023-10-24T00:28:53.219214+0000","last_became_active":"2023-10-24T00:28:53.209308+0000","last_became_peered":"2023-10-24T00:28:53.209308+0000","last_unstale":"2023-10-24T00:28:53.219214+0000","last_undegraded":"2023-10-24T00:28:53.219214+0000","last_fullsized":"2023-10-24T00:28:53.219214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208307+0000","last_change":"2023-10-24T00:28:52.837004+0000","last_active":"2023-10-24T00:28:53.208307+0000","last_peered":"2023-10-24T00:28:53.208307+0000","last_clean":"2023-10-24T00:28:53.208307+0000","last_became_active":"2023-10-24T00:28:52.836745+0000","last_became_peered":"2023-10-24T00:28:52.836745+0000","last_unstale":"2023-10-24T00:28:53.208307+0000","last_undegraded":"2023-10-24T00:28:53.208307+0000","last_fullsized":"2023-10-24T00:28:53.208307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218923+0000","last_change":"2023-10-24T00:28:53.215218+0000","last_active":"2023-10-24T00:28:53.218923+0000","last_peered":"2023-10-24T00:28:53.218923+0000","last_clean":"2023-10-24T00:28:53.218923+0000","last_became_active":"2023-10-24T00:28:53.214775+0000","last_became_peered":"2023-10-24T00:28:53.214775+0000","last_unstale":"2023-10-24T00:28:53.218923+0000","last_undegraded":"2023-10-24T00:28:53.218923+0000","last_fullsized":"2023-10-24T00:28:53.218923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219822+0000","last_change":"2023-10-24T00:28:52.842419+0000","last_active":"2023-10-24T00:28:53.219822+0000","last_peered":"2023-10-24T00:28:53.219822+0000","last_clean":"2023-10-24T00:28:53.219822+0000","last_became_active":"2023-10-24T00:28:52.841163+0000","last_became_peered":"2023-10-24T00:28:52.841163+0000","last_unstale":"2023-10-24T00:28:53.219822+0000","last_undegraded":"2023-10-24T00:28:53.219822+0000","last_fullsized":"2023-10-24T00:28:53.219822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219805+0000","last_change":"2023-10-24T00:28:53.217175+0000","last_active":"2023-10-24T00:28:53.219805+0000","last_peered":"2023-10-24T00:28:53.219805+0000","last_clean":"2023-10-24T00:28:53.219805+0000","last_became_active":"2023-10-24T00:28:53.216835+0000","last_became_peered":"2023-10-24T00:28:53.216835+0000","last_unstale":"2023-10-24T00:28:53.219805+0000","last_undegraded":"2023-10-24T00:28:53.219805+0000","last_fullsized":"2023-10-24T00:28:53.219805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189036+0000","last_change":"2023-10-24T00:28:52.830798+0000","last_active":"2023-10-24T00:28:53.189036+0000","last_peered":"2023-10-24T00:28:53.189036+0000","last_clean":"2023-10-24T00:28:53.189036+0000","last_became_active":"2023-10-24T00:28:52.830499+0000","last_became_peered":"2023-10-24T00:28:52.830499+0000","last_unstale":"2023-10-24T00:28:53.189036+0000","last_undegraded":"2023-10-24T00:28:53.189036+0000","last_fullsized":"2023-10-24T00:28:53.189036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221123+0000","last_change":"2023-10-24T00:28:53.214273+0000","last_active":"2023-10-24T00:28:53.221123+0000","last_peered":"2023-10-24T00:28:53.221123+0000","last_clean":"2023-10-24T00:28:53.221123+0000","last_became_active":"2023-10-24T00:28:53.213976+0000","last_became_peered":"2023-10-24T00:28:53.213976+0000","last_unstale":"2023-10-24T00:28:53.221123+0000","last_undegraded":"2023-10-24T00:28:53.221123+0000","last_fullsized":"2023-10-24T00:28:53.221123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208529+0000","last_change":"2023-10-24T00:28:52.844073+0000","last_active":"2023-10-24T00:28:53.208529+0000","last_peered":"2023-10-24T00:28:53.208529+0000","last_clean":"2023-10-24T00:28:53.208529+0000","last_became_active":"2023-10-24T00:28:52.843728+0000","last_became_peered":"2023-10-24T00:28:52.843728+0000","last_unstale":"2023-10-24T00:28:53.208529+0000","last_undegraded":"2023-10-24T00:28:53.208529+0000","last_fullsized":"2023-10-24T00:28:53.208529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218774+0000","last_change":"2023-10-24T00:28:53.214608+0000","last_active":"2023-10-24T00:28:53.218774+0000","last_peered":"2023-10-24T00:28:53.218774+0000","last_clean":"2023-10-24T00:28:53.218774+0000","last_became_active":"2023-10-24T00:28:53.214109+0000","last_became_peered":"2023-10-24T00:28:53.214109+0000","last_unstale":"2023-10-24T00:28:53.218774+0000","last_undegraded":"2023-10-24T00:28:53.218774+0000","last_fullsized":"2023-10-24T00:28:53.218774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204197+0000","last_change":"2023-10-24T00:28:52.831728+0000","last_active":"2023-10-24T00:28:53.204197+0000","last_peered":"2023-10-24T00:28:53.204197+0000","last_clean":"2023-10-24T00:28:53.204197+0000","last_became_active":"2023-10-24T00:28:52.831431+0000","last_became_peered":"2023-10-24T00:28:52.831431+0000","last_unstale":"2023-10-24T00:28:53.204197+0000","last_undegraded":"2023-10-24T00:28:53.204197+0000","last_fullsized":"2023-10-24T00:28:53.204197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209657+0000","last_change":"2023-10-24T00:28:53.203483+0000","last_active":"2023-10-24T00:28:53.209657+0000","last_peered":"2023-10-24T00:28:53.209657+0000","last_clean":"2023-10-24T00:28:53.209657+0000","last_became_active":"2023-10-24T00:28:53.203186+0000","last_became_peered":"2023-10-24T00:28:53.203186+0000","last_unstale":"2023-10-24T00:28:53.209657+0000","last_undegraded":"2023-10-24T00:28:53.209657+0000","last_fullsized":"2023-10-24T00:28:53.209657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221459+0000","last_change":"2023-10-24T00:28:52.830036+0000","last_active":"2023-10-24T00:28:53.221459+0000","last_peered":"2023-10-24T00:28:53.221459+0000","last_clean":"2023-10-24T00:28:53.221459+0000","last_became_active":"2023-10-24T00:28:52.829705+0000","last_became_peered":"2023-10-24T00:28:52.829705+0000","last_unstale":"2023-10-24T00:28:53.221459+0000","last_undegraded":"2023-10-24T00:28:53.221459+0000","last_fullsized":"2023-10-24T00:28:53.221459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219887+0000","last_change":"2023-10-24T00:28:53.212603+0000","last_active":"2023-10-24T00:28:53.219887+0000","last_peered":"2023-10-24T00:28:53.219887+0000","last_clean":"2023-10-24T00:28:53.219887+0000","last_became_active":"2023-10-24T00:28:53.212009+0000","last_became_peered":"2023-10-24T00:28:53.212009+0000","last_unstale":"2023-10-24T00:28:53.219887+0000","last_undegraded":"2023-10-24T00:28:53.219887+0000","last_fullsized":"2023-10-24T00:28:53.219887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206210+0000","last_change":"2023-10-24T00:28:52.834788+0000","last_active":"2023-10-24T00:28:53.206210+0000","last_peered":"2023-10-24T00:28:53.206210+0000","last_clean":"2023-10-24T00:28:53.206210+0000","last_became_active":"2023-10-24T00:28:52.834521+0000","last_became_peered":"2023-10-24T00:28:52.834521+0000","last_unstale":"2023-10-24T00:28:53.206210+0000","last_undegraded":"2023-10-24T00:28:53.206210+0000","last_fullsized":"2023-10-24T00:28:53.206210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217102+0000","last_change":"2023-10-24T00:28:53.204703+0000","last_active":"2023-10-24T00:28:53.217102+0000","last_peered":"2023-10-24T00:28:53.217102+0000","last_clean":"2023-10-24T00:28:53.217102+0000","last_became_active":"2023-10-24T00:28:53.204271+0000","last_became_peered":"2023-10-24T00:28:53.204271+0000","last_unstale":"2023-10-24T00:28:53.217102+0000","last_undegraded":"2023-10-24T00:28:53.217102+0000","last_fullsized":"2023-10-24T00:28:53.217102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203299+0000","last_change":"2023-10-24T00:28:52.834186+0000","last_active":"2023-10-24T00:28:53.203299+0000","last_peered":"2023-10-24T00:28:53.203299+0000","last_clean":"2023-10-24T00:28:53.203299+0000","last_became_active":"2023-10-24T00:28:52.833901+0000","last_became_peered":"2023-10-24T00:28:52.833901+0000","last_unstale":"2023-10-24T00:28:53.203299+0000","last_undegraded":"2023-10-24T00:28:53.203299+0000","last_fullsized":"2023-10-24T00:28:53.203299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214448+0000","last_change":"2023-10-24T00:28:53.210483+0000","last_active":"2023-10-24T00:28:53.214448+0000","last_peered":"2023-10-24T00:28:53.214448+0000","last_clean":"2023-10-24T00:28:53.214448+0000","last_became_active":"2023-10-24T00:28:53.210273+0000","last_became_peered":"2023-10-24T00:28:53.210273+0000","last_unstale":"2023-10-24T00:28:53.214448+0000","last_undegraded":"2023-10-24T00:28:53.214448+0000","last_fullsized":"2023-10-24T00:28:53.214448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.199442+0000","last_change":"2023-10-24T00:28:52.832477+0000","last_active":"2023-10-24T00:28:53.199442+0000","last_peered":"2023-10-24T00:28:53.199442+0000","last_clean":"2023-10-24T00:28:53.199442+0000","last_became_active":"2023-10-24T00:28:52.832176+0000","last_became_peered":"2023-10-24T00:28:52.832176+0000","last_unstale":"2023-10-24T00:28:53.199442+0000","last_undegraded":"2023-10-24T00:28:53.199442+0000","last_fullsized":"2023-10-24T00:28:53.199442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209249+0000","last_change":"2023-10-24T00:28:53.202433+0000","last_active":"2023-10-24T00:28:53.209249+0000","last_peered":"2023-10-24T00:28:53.209249+0000","last_clean":"2023-10-24T00:28:53.209249+0000","last_became_active":"2023-10-24T00:28:53.202167+0000","last_became_peered":"2023-10-24T00:28:53.202167+0000","last_unstale":"2023-10-24T00:28:53.209249+0000","last_undegraded":"2023-10-24T00:28:53.209249+0000","last_fullsized":"2023-10-24T00:28:53.209249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192091+0000","last_change":"2023-10-24T00:28:52.834616+0000","last_active":"2023-10-24T00:28:53.192091+0000","last_peered":"2023-10-24T00:28:53.192091+0000","last_clean":"2023-10-24T00:28:53.192091+0000","last_became_active":"2023-10-24T00:28:52.834139+0000","last_became_peered":"2023-10-24T00:28:52.834139+0000","last_unstale":"2023-10-24T00:28:53.192091+0000","last_undegraded":"2023-10-24T00:28:53.192091+0000","last_fullsized":"2023-10-24T00:28:53.192091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218349+0000","last_change":"2023-10-24T00:28:53.212700+0000","last_active":"2023-10-24T00:28:53.218349+0000","last_peered":"2023-10-24T00:28:53.218349+0000","last_clean":"2023-10-24T00:28:53.218349+0000","last_became_active":"2023-10-24T00:28:53.212080+0000","last_became_peered":"2023-10-24T00:28:53.212080+0000","last_unstale":"2023-10-24T00:28:53.218349+0000","last_undegraded":"2023-10-24T00:28:53.218349+0000","last_fullsized":"2023-10-24T00:28:53.218349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195246+0000","last_change":"2023-10-24T00:28:52.840655+0000","last_active":"2023-10-24T00:28:53.195246+0000","last_peered":"2023-10-24T00:28:53.195246+0000","last_clean":"2023-10-24T00:28:53.195246+0000","last_became_active":"2023-10-24T00:28:52.840401+0000","last_became_peered":"2023-10-24T00:28:52.840401+0000","last_unstale":"2023-10-24T00:28:53.195246+0000","last_undegraded":"2023-10-24T00:28:53.195246+0000","last_fullsized":"2023-10-24T00:28:53.195246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221422+0000","last_change":"2023-10-24T00:28:53.215705+0000","last_active":"2023-10-24T00:28:53.221422+0000","last_peered":"2023-10-24T00:28:53.221422+0000","last_clean":"2023-10-24T00:28:53.221422+0000","last_became_active":"2023-10-24T00:28:53.214840+0000","last_became_peered":"2023-10-24T00:28:53.214840+0000","last_unstale":"2023-10-24T00:28:53.221422+0000","last_undegraded":"2023-10-24T00:28:53.221422+0000","last_fullsized":"2023-10-24T00:28:53.221422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219272+0000","last_change":"2023-10-24T00:28:52.844574+0000","last_active":"2023-10-24T00:28:53.219272+0000","last_peered":"2023-10-24T00:28:53.219272+0000","last_clean":"2023-10-24T00:28:53.219272+0000","last_became_active":"2023-10-24T00:28:52.844244+0000","last_became_peered":"2023-10-24T00:28:52.844244+0000","last_unstale":"2023-10-24T00:28:53.219272+0000","last_undegraded":"2023-10-24T00:28:53.219272+0000","last_fullsized":"2023-10-24T00:28:53.219272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221438+0000","last_change":"2023-10-24T00:28:53.219279+0000","last_active":"2023-10-24T00:28:53.221438+0000","last_peered":"2023-10-24T00:28:53.221438+0000","last_clean":"2023-10-24T00:28:53.221438+0000","last_became_active":"2023-10-24T00:28:53.218946+0000","last_became_peered":"2023-10-24T00:28:53.218946+0000","last_unstale":"2023-10-24T00:28:53.221438+0000","last_undegraded":"2023-10-24T00:28:53.221438+0000","last_fullsized":"2023-10-24T00:28:53.221438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210158+0000","last_change":"2023-10-24T00:28:52.835505+0000","last_active":"2023-10-24T00:28:53.210158+0000","last_peered":"2023-10-24T00:28:53.210158+0000","last_clean":"2023-10-24T00:28:53.210158+0000","last_became_active":"2023-10-24T00:28:52.835190+0000","last_became_peered":"2023-10-24T00:28:52.835190+0000","last_unstale":"2023-10-24T00:28:53.210158+0000","last_undegraded":"2023-10-24T00:28:53.210158+0000","last_fullsized":"2023-10-24T00:28:53.210158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219137+0000","last_change":"2023-10-24T00:28:53.217100+0000","last_active":"2023-10-24T00:28:53.219137+0000","last_peered":"2023-10-24T00:28:53.219137+0000","last_clean":"2023-10-24T00:28:53.219137+0000","last_became_active":"2023-10-24T00:28:53.216532+0000","last_became_peered":"2023-10-24T00:28:53.216532+0000","last_unstale":"2023-10-24T00:28:53.219137+0000","last_undegraded":"2023-10-24T00:28:53.219137+0000","last_fullsized":"2023-10-24T00:28:53.219137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217358+0000","last_change":"2023-10-24T00:28:52.835020+0000","last_active":"2023-10-24T00:28:53.217358+0000","last_peered":"2023-10-24T00:28:53.217358+0000","last_clean":"2023-10-24T00:28:53.217358+0000","last_became_active":"2023-10-24T00:28:52.834417+0000","last_became_peered":"2023-10-24T00:28:52.834417+0000","last_unstale":"2023-10-24T00:28:53.217358+0000","last_undegraded":"2023-10-24T00:28:53.217358+0000","last_fullsized":"2023-10-24T00:28:53.217358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.223749+0000","last_change":"2023-10-24T00:28:53.217865+0000","last_active":"2023-10-24T00:28:53.223749+0000","last_peered":"2023-10-24T00:28:53.223749+0000","last_clean":"2023-10-24T00:28:53.223749+0000","last_became_active":"2023-10-24T00:28:53.217135+0000","last_became_peered":"2023-10-24T00:28:53.217135+0000","last_unstale":"2023-10-24T00:28:53.223749+0000","last_undegraded":"2023-10-24T00:28:53.223749+0000","last_fullsized":"2023-10-24T00:28:53.223749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206256+0000","last_change":"2023-10-24T00:28:52.839792+0000","last_active":"2023-10-24T00:28:53.206256+0000","last_peered":"2023-10-24T00:28:53.206256+0000","last_clean":"2023-10-24T00:28:53.206256+0000","last_became_active":"2023-10-24T00:28:52.839474+0000","last_became_peered":"2023-10-24T00:28:52.839474+0000","last_unstale":"2023-10-24T00:28:53.206256+0000","last_undegraded":"2023-10-24T00:28:53.206256+0000","last_fullsized":"2023-10-24T00:28:53.206256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217081+0000","last_change":"2023-10-24T00:28:53.204551+0000","last_active":"2023-10-24T00:28:53.217081+0000","last_peered":"2023-10-24T00:28:53.217081+0000","last_clean":"2023-10-24T00:28:53.217081+0000","last_became_active":"2023-10-24T00:28:53.203979+0000","last_became_peered":"2023-10-24T00:28:53.203979+0000","last_unstale":"2023-10-24T00:28:53.217081+0000","last_undegraded":"2023-10-24T00:28:53.217081+0000","last_fullsized":"2023-10-24T00:28:53.217081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189600+0000","last_change":"2023-10-24T00:28:52.846124+0000","last_active":"2023-10-24T00:28:53.189600+0000","last_peered":"2023-10-24T00:28:53.189600+0000","last_clean":"2023-10-24T00:28:53.189600+0000","last_became_active":"2023-10-24T00:28:52.845781+0000","last_became_peered":"2023-10-24T00:28:52.845781+0000","last_unstale":"2023-10-24T00:28:53.189600+0000","last_undegraded":"2023-10-24T00:28:53.189600+0000","last_fullsized":"2023-10-24T00:28:53.189600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219930+0000","last_change":"2023-10-24T00:28:53.216003+0000","last_active":"2023-10-24T00:28:53.219930+0000","last_peered":"2023-10-24T00:28:53.219930+0000","last_clean":"2023-10-24T00:28:53.219930+0000","last_became_active":"2023-10-24T00:28:53.215711+0000","last_became_peered":"2023-10-24T00:28:53.215711+0000","last_unstale":"2023-10-24T00:28:53.219930+0000","last_undegraded":"2023-10-24T00:28:53.219930+0000","last_fullsized":"2023-10-24T00:28:53.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216700+0000","last_change":"2023-10-24T00:28:52.829842+0000","last_active":"2023-10-24T00:28:53.216700+0000","last_peered":"2023-10-24T00:28:53.216700+0000","last_clean":"2023-10-24T00:28:53.216700+0000","last_became_active":"2023-10-24T00:28:52.829018+0000","last_became_peered":"2023-10-24T00:28:52.829018+0000","last_unstale":"2023-10-24T00:28:53.216700+0000","last_undegraded":"2023-10-24T00:28:53.216700+0000","last_fullsized":"2023-10-24T00:28:53.216700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":86631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":86809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":86663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:07.161 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:07.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 Processor -- start 2023-10-24T00:29:07.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 -- start start 2023-10-24T00:29:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b64069380 0x7f1b640c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 0x7f1b6415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640bdfe0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b64151350 con 0x7f1b64069380 2023-10-24T00:29:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.307+0000 7f1b6af30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640bd3d0 con 0x7f1b64069e70 2023-10-24T00:29:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b63fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1b640bcbf0 0x7f1b64069760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57540/0 (socket says 172.21.15.148:57540) 2023-10-24T00:29:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b63fff700 1 -- 172.21.15.148:0/2577456138 learned_addr learned my addr 172.21.15.148:0/2577456138 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:07.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 --2- 172.21.15.148:0/2577456138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 0x7f1b6415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b68ccc700 1 --2- 172.21.15.148:0/2577456138 >> v2:172.21.15.150:3300/0 conn(0x7f1b64069380 0x7f1b640c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154286466 0 0) 0x7f1b640bdfe0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c0033f0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1136671139 0 0) 0x7f1b4c0033f0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 -- 172.21.15.148:0/2577456138 >> v2:172.21.15.150:3300/0 conn(0x7f1b64069380 msgr2=0x7f1b640c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 --2- 172.21.15.148:0/2577456138 >> v2:172.21.15.150:3300/0 conn(0x7f1b64069380 0x7f1b640c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 -- 172.21.15.148:0/2577456138 >> v1:172.21.15.148:6789/0 conn(0x7f1b640bcbf0 legacy=0x7f1b64069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 -- 172.21.15.148:0/2577456138 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640bd6b0 con 0x7f1b64069e70 2023-10-24T00:29:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b694cd700 1 --2- 172.21.15.148:0/2577456138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 0x7f1b6415ab10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1b5c009760 tx=0x7f1b5c009060).ready entity=mon.2 client_cookie=93d4f81036828974 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58001470 con 0x7f1b64069e70 2023-10-24T00:29:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c011400 con 0x7f1b64069e70 2023-10-24T00:29:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.308+0000 7f1b637fe700 1 -- 172.21.15.148:0/2577456138 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011780 con 0x7f1b64069e70 2023-10-24T00:29:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 -- 172.21.15.148:0/2577456138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 msgr2=0x7f1b6415ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 --2- 172.21.15.148:0/2577456138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 0x7f1b6415ab10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1b5c009760 tx=0x7f1b5c009060).stop 2023-10-24T00:29:07.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 -- 172.21.15.148:0/2577456138 shutdown_connections 2023-10-24T00:29:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 --2- 172.21.15.148:0/2577456138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069e70 0x7f1b6415ab10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 --2- 172.21.15.148:0/2577456138 >> v2:172.21.15.150:3300/0 conn(0x7f1b64069380 0x7f1b640c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 -- 172.21.15.148:0/2577456138 >> 172.21.15.148:0/2577456138 conn(0x7f1b640c5200 msgr2=0x7f1b640c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 -- 172.21.15.148:0/2577456138 shutdown_connections 2023-10-24T00:29:07.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.309+0000 7f1b6af30700 1 -- 172.21.15.148:0/2577456138 wait complete. 2023-10-24T00:29:07.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.310+0000 7f1b6af30700 1 Processor -- start 2023-10-24T00:29:07.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.310+0000 7f1b6af30700 1 -- start start 2023-10-24T00:29:07.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 0x7f1b640c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b64069e70 0x7f1b64167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640a85d0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640a88b0 con 0x7f1b64069e70 2023-10-24T00:29:07.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b6af30700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64167fe0 con 0x7f1b64069380 2023-10-24T00:29:07.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b694cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b694cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53272/0 (socket says 172.21.15.148:53272) 2023-10-24T00:29:07.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b694cd700 1 -- 172.21.15.148:0/3237054298 learned_addr learned my addr 172.21.15.148:0/3237054298 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:07.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b68ccc700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 0x7f1b640c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.311+0000 7f1b63fff700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b64069e70 0x7f1b64167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 -- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 msgr2=0x7f1b640c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 0x7f1b640c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 -- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b64069e70 msgr2=0x7f1b64167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b64069e70 0x7f1b64167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 -- 172.21.15.148:0/3237054298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0092a0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b68ccc700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 0x7f1b640c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b694cd700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1b5c009d50 tx=0x7f1b5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c010bb0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c010d10 con 0x7f1b640bcbf0 2023-10-24T00:29:07.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01d630 con 0x7f1b640bcbf0 2023-10-24T00:29:07.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b641682c0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.312+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64167cf0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.313+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b640a8a20 con 0x7f1b640bcbf0 2023-10-24T00:29:07.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.313+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b5c018030 con 0x7f1b640bcbf0 2023-10-24T00:29:07.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.313+0000 7f1b60ff9700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 0x7f1b50061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.313+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b5c07b5b0 con 0x7f1b640bcbf0 2023-10-24T00:29:07.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.314+0000 7f1b68ccc700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 0x7f1b50061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.314+0000 7f1b68ccc700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 0x7f1b50061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1b54007640 tx=0x7f1b5400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.317+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b5c04c880 con 0x7f1b640bcbf0 2023-10-24T00:29:07.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.477+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b640c2a10 con 0x7f1b5005f150 2023-10-24T00:29:07.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.486+0000 7f1b60ff9700 1 -- 172.21.15.148:0/3237054298 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336305 (secure 0 0 0) 0x7f1b640c2a10 con 0x7f1b5005f150 2023-10-24T00:29:07.492 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:07.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 msgr2=0x7f1b50061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 0x7f1b50061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1b54007640 tx=0x7f1b5400b040).stop 2023-10-24T00:29:07.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 msgr2=0x7f1b641436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1b5c009d50 tx=0x7f1b5c016000).stop 2023-10-24T00:29:07.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 shutdown_connections 2023-10-24T00:29:07.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5005f150 0x7f1b50061610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b640bcbf0 0x7f1b641436d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b64069380 0x7f1b640c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 --2- 172.21.15.148:0/3237054298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b64069e70 0x7f1b64167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 >> 172.21.15.148:0/3237054298 conn(0x7f1b640c5200 msgr2=0x7f1b640a4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:07.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 shutdown_connections 2023-10-24T00:29:07.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.490+0000 7f1b6af30700 1 -- 172.21.15.148:0/3237054298 wait complete. 2023-10-24T00:29:07.497 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:07.503 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-24T00:29:06.771473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":686348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002693"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202675+0000","last_change":"2023-10-24T00:28:53.197457+0000","last_active":"2023-10-24T00:28:53.202675+0000","last_peered":"2023-10-24T00:28:53.202675+0000","last_clean":"2023-10-24T00:28:53.202675+0000","last_became_active":"2023-10-24T00:28:53.197181+0000","last_became_peered":"2023-10-24T00:28:53.197181+0000","last_unstale":"2023-10-24T00:28:53.202675+0000","last_undegraded":"2023-10-24T00:28:53.202675+0000","last_fullsized":"2023-10-24T00:28:53.202675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196253+0000","last_change":"2023-10-24T00:28:52.832585+0000","last_active":"2023-10-24T00:28:53.196253+0000","last_peered":"2023-10-24T00:28:53.196253+0000","last_clean":"2023-10-24T00:28:53.196253+0000","last_became_active":"2023-10-24T00:28:52.832304+0000","last_became_peered":"2023-10-24T00:28:52.832304+0000","last_unstale":"2023-10-24T00:28:53.196253+0000","last_undegraded":"2023-10-24T00:28:53.196253+0000","last_fullsized":"2023-10-24T00:28:53.196253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219117+0000","last_change":"2023-10-24T00:28:53.216919+0000","last_active":"2023-10-24T00:28:53.219117+0000","last_peered":"2023-10-24T00:28:53.219117+0000","last_clean":"2023-10-24T00:28:53.219117+0000","last_became_active":"2023-10-24T00:28:53.216644+0000","last_became_peered":"2023-10-24T00:28:53.216644+0000","last_unstale":"2023-10-24T00:28:53.219117+0000","last_undegraded":"2023-10-24T00:28:53.219117+0000","last_fullsized":"2023-10-24T00:28:53.219117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189038+0000","last_change":"2023-10-24T00:28:52.834106+0000","last_active":"2023-10-24T00:28:53.189038+0000","last_peered":"2023-10-24T00:28:53.189038+0000","last_clean":"2023-10-24T00:28:53.189038+0000","last_became_active":"2023-10-24T00:28:52.833861+0000","last_became_peered":"2023-10-24T00:28:52.833861+0000","last_unstale":"2023-10-24T00:28:53.189038+0000","last_undegraded":"2023-10-24T00:28:53.189038+0000","last_fullsized":"2023-10-24T00:28:53.189038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219445+0000","last_change":"2023-10-24T00:28:53.215329+0000","last_active":"2023-10-24T00:28:53.219445+0000","last_peered":"2023-10-24T00:28:53.219445+0000","last_clean":"2023-10-24T00:28:53.219445+0000","last_became_active":"2023-10-24T00:28:53.215054+0000","last_became_peered":"2023-10-24T00:28:53.215054+0000","last_unstale":"2023-10-24T00:28:53.219445+0000","last_undegraded":"2023-10-24T00:28:53.219445+0000","last_fullsized":"2023-10-24T00:28:53.219445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192190+0000","last_change":"2023-10-24T00:28:52.839855+0000","last_active":"2023-10-24T00:28:53.192190+0000","last_peered":"2023-10-24T00:28:53.192190+0000","last_clean":"2023-10-24T00:28:53.192190+0000","last_became_active":"2023-10-24T00:28:52.839642+0000","last_became_peered":"2023-10-24T00:28:52.839642+0000","last_unstale":"2023-10-24T00:28:53.192190+0000","last_undegraded":"2023-10-24T00:28:53.192190+0000","last_fullsized":"2023-10-24T00:28:53.192190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208075+0000","last_change":"2023-10-24T00:28:53.198164+0000","last_active":"2023-10-24T00:28:53.208075+0000","last_peered":"2023-10-24T00:28:53.208075+0000","last_clean":"2023-10-24T00:28:53.208075+0000","last_became_active":"2023-10-24T00:28:53.197880+0000","last_became_peered":"2023-10-24T00:28:53.197880+0000","last_unstale":"2023-10-24T00:28:53.208075+0000","last_undegraded":"2023-10-24T00:28:53.208075+0000","last_fullsized":"2023-10-24T00:28:53.208075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213801+0000","last_change":"2023-10-24T00:28:52.841842+0000","last_active":"2023-10-24T00:28:53.213801+0000","last_peered":"2023-10-24T00:28:53.213801+0000","last_clean":"2023-10-24T00:28:53.213801+0000","last_became_active":"2023-10-24T00:28:52.841497+0000","last_became_peered":"2023-10-24T00:28:52.841497+0000","last_unstale":"2023-10-24T00:28:53.213801+0000","last_undegraded":"2023-10-24T00:28:53.213801+0000","last_fullsized":"2023-10-24T00:28:53.213801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211799+0000","last_change":"2023-10-24T00:28:53.206480+0000","last_active":"2023-10-24T00:28:53.211799+0000","last_peered":"2023-10-24T00:28:53.211799+0000","last_clean":"2023-10-24T00:28:53.211799+0000","last_became_active":"2023-10-24T00:28:53.206200+0000","last_became_peered":"2023-10-24T00:28:53.206200+0000","last_unstale":"2023-10-24T00:28:53.211799+0000","last_undegraded":"2023-10-24T00:28:53.211799+0000","last_fullsized":"2023-10-24T00:28:53.211799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208301+0000","last_change":"2023-10-24T00:28:52.837935+0000","last_active":"2023-10-24T00:28:53.208301+0000","last_peered":"2023-10-24T00:28:53.208301+0000","last_clean":"2023-10-24T00:28:53.208301+0000","last_became_active":"2023-10-24T00:28:52.837653+0000","last_became_peered":"2023-10-24T00:28:52.837653+0000","last_unstale":"2023-10-24T00:28:53.208301+0000","last_undegraded":"2023-10-24T00:28:53.208301+0000","last_fullsized":"2023-10-24T00:28:53.208301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216889+0000","last_change":"2023-10-24T00:28:53.214654+0000","last_active":"2023-10-24T00:28:53.216889+0000","last_peered":"2023-10-24T00:28:53.216889+0000","last_clean":"2023-10-24T00:28:53.216889+0000","last_became_active":"2023-10-24T00:28:53.214391+0000","last_became_peered":"2023-10-24T00:28:53.214391+0000","last_unstale":"2023-10-24T00:28:53.216889+0000","last_undegraded":"2023-10-24T00:28:53.216889+0000","last_fullsized":"2023-10-24T00:28:53.216889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219715+0000","last_change":"2023-10-24T00:28:52.831368+0000","last_active":"2023-10-24T00:28:53.219715+0000","last_peered":"2023-10-24T00:28:53.219715+0000","last_clean":"2023-10-24T00:28:53.219715+0000","last_became_active":"2023-10-24T00:28:52.831054+0000","last_became_peered":"2023-10-24T00:28:52.831054+0000","last_unstale":"2023-10-24T00:28:53.219715+0000","last_undegraded":"2023-10-24T00:28:53.219715+0000","last_fullsized":"2023-10-24T00:28:53.219715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214442+0000","last_change":"2023-10-24T00:28:53.208856+0000","last_active":"2023-10-24T00:28:53.214442+0000","last_peered":"2023-10-24T00:28:53.214442+0000","last_clean":"2023-10-24T00:28:53.214442+0000","last_became_active":"2023-10-24T00:28:53.208588+0000","last_became_peered":"2023-10-24T00:28:53.208588+0000","last_unstale":"2023-10-24T00:28:53.214442+0000","last_undegraded":"2023-10-24T00:28:53.214442+0000","last_fullsized":"2023-10-24T00:28:53.214442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216976+0000","last_change":"2023-10-24T00:28:52.829502+0000","last_active":"2023-10-24T00:28:53.216976+0000","last_peered":"2023-10-24T00:28:53.216976+0000","last_clean":"2023-10-24T00:28:53.216976+0000","last_became_active":"2023-10-24T00:28:52.829097+0000","last_became_peered":"2023-10-24T00:28:52.829097+0000","last_unstale":"2023-10-24T00:28:53.216976+0000","last_undegraded":"2023-10-24T00:28:53.216976+0000","last_fullsized":"2023-10-24T00:28:53.216976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207273+0000","last_change":"2023-10-24T00:28:53.197597+0000","last_active":"2023-10-24T00:28:53.207273+0000","last_peered":"2023-10-24T00:28:53.207273+0000","last_clean":"2023-10-24T00:28:53.207273+0000","last_became_active":"2023-10-24T00:28:53.197328+0000","last_became_peered":"2023-10-24T00:28:53.197328+0000","last_unstale":"2023-10-24T00:28:53.207273+0000","last_undegraded":"2023-10-24T00:28:53.207273+0000","last_fullsized":"2023-10-24T00:28:53.207273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214747+0000","last_change":"2023-10-24T00:28:52.830223+0000","last_active":"2023-10-24T00:28:53.214747+0000","last_peered":"2023-10-24T00:28:53.214747+0000","last_clean":"2023-10-24T00:28:53.214747+0000","last_became_active":"2023-10-24T00:28:52.829963+0000","last_became_peered":"2023-10-24T00:28:52.829963+0000","last_unstale":"2023-10-24T00:28:53.214747+0000","last_undegraded":"2023-10-24T00:28:53.214747+0000","last_fullsized":"2023-10-24T00:28:53.214747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221048+0000","last_change":"2023-10-24T00:28:53.218099+0000","last_active":"2023-10-24T00:28:53.221048+0000","last_peered":"2023-10-24T00:28:53.221048+0000","last_clean":"2023-10-24T00:28:53.221048+0000","last_became_active":"2023-10-24T00:28:53.217842+0000","last_became_peered":"2023-10-24T00:28:53.217842+0000","last_unstale":"2023-10-24T00:28:53.221048+0000","last_undegraded":"2023-10-24T00:28:53.221048+0000","last_fullsized":"2023-10-24T00:28:53.221048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208421+0000","last_change":"2023-10-24T00:28:52.844225+0000","last_active":"2023-10-24T00:28:53.208421+0000","last_peered":"2023-10-24T00:28:53.208421+0000","last_clean":"2023-10-24T00:28:53.208421+0000","last_became_active":"2023-10-24T00:28:52.843751+0000","last_became_peered":"2023-10-24T00:28:52.843751+0000","last_unstale":"2023-10-24T00:28:53.208421+0000","last_undegraded":"2023-10-24T00:28:53.208421+0000","last_fullsized":"2023-10-24T00:28:53.208421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218875+0000","last_change":"2023-10-24T00:28:53.214994+0000","last_active":"2023-10-24T00:28:53.218875+0000","last_peered":"2023-10-24T00:28:53.218875+0000","last_clean":"2023-10-24T00:28:53.218875+0000","last_became_active":"2023-10-24T00:28:53.214737+0000","last_became_peered":"2023-10-24T00:28:53.214737+0000","last_unstale":"2023-10-24T00:28:53.218875+0000","last_undegraded":"2023-10-24T00:28:53.218875+0000","last_fullsized":"2023-10-24T00:28:53.218875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195147+0000","last_change":"2023-10-24T00:28:52.833269+0000","last_active":"2023-10-24T00:28:53.195147+0000","last_peered":"2023-10-24T00:28:53.195147+0000","last_clean":"2023-10-24T00:28:53.195147+0000","last_became_active":"2023-10-24T00:28:52.832982+0000","last_became_peered":"2023-10-24T00:28:52.832982+0000","last_unstale":"2023-10-24T00:28:53.195147+0000","last_undegraded":"2023-10-24T00:28:53.195147+0000","last_fullsized":"2023-10-24T00:28:53.195147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209960+0000","last_change":"2023-10-24T00:28:53.207217+0000","last_active":"2023-10-24T00:28:53.209960+0000","last_peered":"2023-10-24T00:28:53.209960+0000","last_clean":"2023-10-24T00:28:53.209960+0000","last_became_active":"2023-10-24T00:28:53.206965+0000","last_became_peered":"2023-10-24T00:28:53.206965+0000","last_unstale":"2023-10-24T00:28:53.209960+0000","last_undegraded":"2023-10-24T00:28:53.209960+0000","last_fullsized":"2023-10-24T00:28:53.209960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219384+0000","last_change":"2023-10-24T00:28:52.842202+0000","last_active":"2023-10-24T00:28:53.219384+0000","last_peered":"2023-10-24T00:28:53.219384+0000","last_clean":"2023-10-24T00:28:53.219384+0000","last_became_active":"2023-10-24T00:28:52.841831+0000","last_became_peered":"2023-10-24T00:28:52.841831+0000","last_unstale":"2023-10-24T00:28:53.219384+0000","last_undegraded":"2023-10-24T00:28:53.219384+0000","last_fullsized":"2023-10-24T00:28:53.219384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219913+0000","last_change":"2023-10-24T00:28:53.212670+0000","last_active":"2023-10-24T00:28:53.219913+0000","last_peered":"2023-10-24T00:28:53.219913+0000","last_clean":"2023-10-24T00:28:53.219913+0000","last_became_active":"2023-10-24T00:28:53.212381+0000","last_became_peered":"2023-10-24T00:28:53.212381+0000","last_unstale":"2023-10-24T00:28:53.219913+0000","last_undegraded":"2023-10-24T00:28:53.219913+0000","last_fullsized":"2023-10-24T00:28:53.219913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216783+0000","last_change":"2023-10-24T00:28:52.828196+0000","last_active":"2023-10-24T00:28:53.216783+0000","last_peered":"2023-10-24T00:28:53.216783+0000","last_clean":"2023-10-24T00:28:53.216783+0000","last_became_active":"2023-10-24T00:28:52.827920+0000","last_became_peered":"2023-10-24T00:28:52.827920+0000","last_unstale":"2023-10-24T00:28:53.216783+0000","last_undegraded":"2023-10-24T00:28:53.216783+0000","last_fullsized":"2023-10-24T00:28:53.216783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214085+0000","last_change":"2023-10-24T00:28:53.201055+0000","last_active":"2023-10-24T00:28:53.214085+0000","last_peered":"2023-10-24T00:28:53.214085+0000","last_clean":"2023-10-24T00:28:53.214085+0000","last_became_active":"2023-10-24T00:28:53.200779+0000","last_became_peered":"2023-10-24T00:28:53.200779+0000","last_unstale":"2023-10-24T00:28:53.214085+0000","last_undegraded":"2023-10-24T00:28:53.214085+0000","last_fullsized":"2023-10-24T00:28:53.214085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215927+0000","last_change":"2023-10-24T00:28:52.827714+0000","last_active":"2023-10-24T00:28:53.215927+0000","last_peered":"2023-10-24T00:28:53.215927+0000","last_clean":"2023-10-24T00:28:53.215927+0000","last_became_active":"2023-10-24T00:28:52.827404+0000","last_became_peered":"2023-10-24T00:28:52.827404+0000","last_unstale":"2023-10-24T00:28:53.215927+0000","last_undegraded":"2023-10-24T00:28:53.215927+0000","last_fullsized":"2023-10-24T00:28:53.215927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217556+0000","last_change":"2023-10-24T00:28:53.211199+0000","last_active":"2023-10-24T00:28:53.217556+0000","last_peered":"2023-10-24T00:28:53.217556+0000","last_clean":"2023-10-24T00:28:53.217556+0000","last_became_active":"2023-10-24T00:28:53.210886+0000","last_became_peered":"2023-10-24T00:28:53.210886+0000","last_unstale":"2023-10-24T00:28:53.217556+0000","last_undegraded":"2023-10-24T00:28:53.217556+0000","last_fullsized":"2023-10-24T00:28:53.217556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198976+0000","last_change":"2023-10-24T00:28:52.832499+0000","last_active":"2023-10-24T00:28:53.198976+0000","last_peered":"2023-10-24T00:28:53.198976+0000","last_clean":"2023-10-24T00:28:53.198976+0000","last_became_active":"2023-10-24T00:28:52.832220+0000","last_became_peered":"2023-10-24T00:28:52.832220+0000","last_unstale":"2023-10-24T00:28:53.198976+0000","last_undegraded":"2023-10-24T00:28:53.198976+0000","last_fullsized":"2023-10-24T00:28:53.198976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218827+0000","last_change":"2023-10-24T00:28:53.213828+0000","last_active":"2023-10-24T00:28:53.218827+0000","last_peered":"2023-10-24T00:28:53.218827+0000","last_clean":"2023-10-24T00:28:53.218827+0000","last_became_active":"2023-10-24T00:28:53.213506+0000","last_became_peered":"2023-10-24T00:28:53.213506+0000","last_unstale":"2023-10-24T00:28:53.218827+0000","last_undegraded":"2023-10-24T00:28:53.218827+0000","last_fullsized":"2023-10-24T00:28:53.218827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207923+0000","last_change":"2023-10-24T00:28:52.835199+0000","last_active":"2023-10-24T00:28:53.207923+0000","last_peered":"2023-10-24T00:28:53.207923+0000","last_clean":"2023-10-24T00:28:53.207923+0000","last_became_active":"2023-10-24T00:28:52.834770+0000","last_became_peered":"2023-10-24T00:28:52.834770+0000","last_unstale":"2023-10-24T00:28:53.207923+0000","last_undegraded":"2023-10-24T00:28:53.207923+0000","last_fullsized":"2023-10-24T00:28:53.207923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215542+0000","last_change":"2023-10-24T00:28:53.210526+0000","last_active":"2023-10-24T00:28:53.215542+0000","last_peered":"2023-10-24T00:28:53.215542+0000","last_clean":"2023-10-24T00:28:53.215542+0000","last_became_active":"2023-10-24T00:28:53.210295+0000","last_became_peered":"2023-10-24T00:28:53.210295+0000","last_unstale":"2023-10-24T00:28:53.215542+0000","last_undegraded":"2023-10-24T00:28:53.215542+0000","last_fullsized":"2023-10-24T00:28:53.215542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202449+0000","last_change":"2023-10-24T00:28:52.842949+0000","last_active":"2023-10-24T00:28:53.202449+0000","last_peered":"2023-10-24T00:28:53.202449+0000","last_clean":"2023-10-24T00:28:53.202449+0000","last_became_active":"2023-10-24T00:28:52.842488+0000","last_became_peered":"2023-10-24T00:28:52.842488+0000","last_unstale":"2023-10-24T00:28:53.202449+0000","last_undegraded":"2023-10-24T00:28:53.202449+0000","last_fullsized":"2023-10-24T00:28:53.202449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218240+0000","last_change":"2023-10-24T00:28:53.213761+0000","last_active":"2023-10-24T00:28:53.218240+0000","last_peered":"2023-10-24T00:28:53.218240+0000","last_clean":"2023-10-24T00:28:53.218240+0000","last_became_active":"2023-10-24T00:28:53.213457+0000","last_became_peered":"2023-10-24T00:28:53.213457+0000","last_unstale":"2023-10-24T00:28:53.218240+0000","last_undegraded":"2023-10-24T00:28:53.218240+0000","last_fullsized":"2023-10-24T00:28:53.218240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205989+0000","last_change":"2023-10-24T00:28:52.836396+0000","last_active":"2023-10-24T00:28:53.205989+0000","last_peered":"2023-10-24T00:28:53.205989+0000","last_clean":"2023-10-24T00:28:53.205989+0000","last_became_active":"2023-10-24T00:28:52.836110+0000","last_became_peered":"2023-10-24T00:28:52.836110+0000","last_unstale":"2023-10-24T00:28:53.205989+0000","last_undegraded":"2023-10-24T00:28:53.205989+0000","last_fullsized":"2023-10-24T00:28:53.205989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218040+0000","last_change":"2023-10-24T00:28:53.213383+0000","last_active":"2023-10-24T00:28:53.218040+0000","last_peered":"2023-10-24T00:28:53.218040+0000","last_clean":"2023-10-24T00:28:53.218040+0000","last_became_active":"2023-10-24T00:28:53.212809+0000","last_became_peered":"2023-10-24T00:28:53.212809+0000","last_unstale":"2023-10-24T00:28:53.218040+0000","last_undegraded":"2023-10-24T00:28:53.218040+0000","last_fullsized":"2023-10-24T00:28:53.218040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196651+0000","last_change":"2023-10-24T00:28:52.833221+0000","last_active":"2023-10-24T00:28:53.196651+0000","last_peered":"2023-10-24T00:28:53.196651+0000","last_clean":"2023-10-24T00:28:53.196651+0000","last_became_active":"2023-10-24T00:28:52.832941+0000","last_became_peered":"2023-10-24T00:28:52.832941+0000","last_unstale":"2023-10-24T00:28:53.196651+0000","last_undegraded":"2023-10-24T00:28:53.196651+0000","last_fullsized":"2023-10-24T00:28:53.196651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.201868+0000","last_change":"2023-10-24T00:28:53.197450+0000","last_active":"2023-10-24T00:28:53.201868+0000","last_peered":"2023-10-24T00:28:53.201868+0000","last_clean":"2023-10-24T00:28:53.201868+0000","last_became_active":"2023-10-24T00:28:53.197178+0000","last_became_peered":"2023-10-24T00:28:53.197178+0000","last_unstale":"2023-10-24T00:28:53.201868+0000","last_undegraded":"2023-10-24T00:28:53.201868+0000","last_fullsized":"2023-10-24T00:28:53.201868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.191976+0000","last_change":"2023-10-24T00:28:52.832101+0000","last_active":"2023-10-24T00:28:53.191976+0000","last_peered":"2023-10-24T00:28:53.191976+0000","last_clean":"2023-10-24T00:28:53.191976+0000","last_became_active":"2023-10-24T00:28:52.831799+0000","last_became_peered":"2023-10-24T00:28:52.831799+0000","last_unstale":"2023-10-24T00:28:53.191976+0000","last_undegraded":"2023-10-24T00:28:53.191976+0000","last_fullsized":"2023-10-24T00:28:53.191976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189164+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:28:53.189164+0000","last_peered":"2023-10-24T00:28:53.189164+0000","last_clean":"2023-10-24T00:28:53.189164+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:28:53.189164+0000","last_undegraded":"2023-10-24T00:28:53.189164+0000","last_fullsized":"2023-10-24T00:28:53.189164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208258+0000","last_change":"2023-10-24T00:28:52.837352+0000","last_active":"2023-10-24T00:28:53.208258+0000","last_peered":"2023-10-24T00:28:53.208258+0000","last_clean":"2023-10-24T00:28:53.208258+0000","last_became_active":"2023-10-24T00:28:52.836889+0000","last_became_peered":"2023-10-24T00:28:52.836889+0000","last_unstale":"2023-10-24T00:28:53.208258+0000","last_undegraded":"2023-10-24T00:28:53.208258+0000","last_fullsized":"2023-10-24T00:28:53.208258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.215067+0000","last_change":"2023-10-24T00:28:53.212561+0000","last_active":"2023-10-24T00:28:53.215067+0000","last_peered":"2023-10-24T00:28:53.215067+0000","last_clean":"2023-10-24T00:28:53.215067+0000","last_became_active":"2023-10-24T00:28:53.212213+0000","last_became_peered":"2023-10-24T00:28:53.212213+0000","last_unstale":"2023-10-24T00:28:53.215067+0000","last_undegraded":"2023-10-24T00:28:53.215067+0000","last_fullsized":"2023-10-24T00:28:53.215067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208145+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:28:53.208145+0000","last_peered":"2023-10-24T00:28:53.208145+0000","last_clean":"2023-10-24T00:28:53.208145+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:28:53.208145+0000","last_undegraded":"2023-10-24T00:28:53.208145+0000","last_fullsized":"2023-10-24T00:28:53.208145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196733+0000","last_change":"2023-10-24T00:28:52.841779+0000","last_active":"2023-10-24T00:28:53.196733+0000","last_peered":"2023-10-24T00:28:53.196733+0000","last_clean":"2023-10-24T00:28:53.196733+0000","last_became_active":"2023-10-24T00:28:52.841486+0000","last_became_peered":"2023-10-24T00:28:52.841486+0000","last_unstale":"2023-10-24T00:28:53.196733+0000","last_undegraded":"2023-10-24T00:28:53.196733+0000","last_fullsized":"2023-10-24T00:28:53.196733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202018+0000","last_change":"2023-10-24T00:28:53.198838+0000","last_active":"2023-10-24T00:28:53.202018+0000","last_peered":"2023-10-24T00:28:53.202018+0000","last_clean":"2023-10-24T00:28:53.202018+0000","last_became_active":"2023-10-24T00:28:53.198572+0000","last_became_peered":"2023-10-24T00:28:53.198572+0000","last_unstale":"2023-10-24T00:28:53.202018+0000","last_undegraded":"2023-10-24T00:28:53.202018+0000","last_fullsized":"2023-10-24T00:28:53.202018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218830+0000","last_change":"2023-10-24T00:28:53.215991+0000","last_active":"2023-10-24T00:28:53.218830+0000","last_peered":"2023-10-24T00:28:53.218830+0000","last_clean":"2023-10-24T00:28:53.218830+0000","last_became_active":"2023-10-24T00:28:53.215724+0000","last_became_peered":"2023-10-24T00:28:53.215724+0000","last_unstale":"2023-10-24T00:28:53.218830+0000","last_undegraded":"2023-10-24T00:28:53.218830+0000","last_fullsized":"2023-10-24T00:28:53.218830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194747+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:28:53.194747+0000","last_peered":"2023-10-24T00:28:53.194747+0000","last_clean":"2023-10-24T00:28:53.194747+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:28:53.194747+0000","last_undegraded":"2023-10-24T00:28:53.194747+0000","last_fullsized":"2023-10-24T00:28:53.194747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189062+0000","last_change":"2023-10-24T00:28:52.836290+0000","last_active":"2023-10-24T00:28:53.189062+0000","last_peered":"2023-10-24T00:28:53.189062+0000","last_clean":"2023-10-24T00:28:53.189062+0000","last_became_active":"2023-10-24T00:28:52.836025+0000","last_became_peered":"2023-10-24T00:28:52.836025+0000","last_unstale":"2023-10-24T00:28:53.189062+0000","last_undegraded":"2023-10-24T00:28:53.189062+0000","last_fullsized":"2023-10-24T00:28:53.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219556+0000","last_change":"2023-10-24T00:28:53.216794+0000","last_active":"2023-10-24T00:28:53.219556+0000","last_peered":"2023-10-24T00:28:53.219556+0000","last_clean":"2023-10-24T00:28:53.219556+0000","last_became_active":"2023-10-24T00:28:53.216522+0000","last_became_peered":"2023-10-24T00:28:53.216522+0000","last_unstale":"2023-10-24T00:28:53.219556+0000","last_undegraded":"2023-10-24T00:28:53.219556+0000","last_fullsized":"2023-10-24T00:28:53.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207961+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:28:53.207961+0000","last_peered":"2023-10-24T00:28:53.207961+0000","last_clean":"2023-10-24T00:28:53.207961+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:28:53.207961+0000","last_undegraded":"2023-10-24T00:28:53.207961+0000","last_fullsized":"2023-10-24T00:28:53.207961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196499+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:28:53.196499+0000","last_peered":"2023-10-24T00:28:53.196499+0000","last_clean":"2023-10-24T00:28:53.196499+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:28:53.196499+0000","last_undegraded":"2023-10-24T00:28:53.196499+0000","last_fullsized":"2023-10-24T00:28:53.196499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192193+0000","last_change":"2023-10-24T00:28:52.835633+0000","last_active":"2023-10-24T00:28:53.192193+0000","last_peered":"2023-10-24T00:28:53.192193+0000","last_clean":"2023-10-24T00:28:53.192193+0000","last_became_active":"2023-10-24T00:28:52.833208+0000","last_became_peered":"2023-10-24T00:28:52.833208+0000","last_unstale":"2023-10-24T00:28:53.192193+0000","last_undegraded":"2023-10-24T00:28:53.192193+0000","last_fullsized":"2023-10-24T00:28:53.192193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218638+0000","last_change":"2023-10-24T00:28:53.213575+0000","last_active":"2023-10-24T00:28:53.218638+0000","last_peered":"2023-10-24T00:28:53.218638+0000","last_clean":"2023-10-24T00:28:53.218638+0000","last_became_active":"2023-10-24T00:28:53.209567+0000","last_became_peered":"2023-10-24T00:28:53.209567+0000","last_unstale":"2023-10-24T00:28:53.218638+0000","last_undegraded":"2023-10-24T00:28:53.218638+0000","last_fullsized":"2023-10-24T00:28:53.218638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.196975+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:28:53.196975+0000","last_peered":"2023-10-24T00:28:53.196975+0000","last_clean":"2023-10-24T00:28:53.196975+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:28:53.196975+0000","last_undegraded":"2023-10-24T00:28:53.196975+0000","last_fullsized":"2023-10-24T00:28:53.196975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.205869+0000","last_change":"2023-10-24T00:28:52.840006+0000","last_active":"2023-10-24T00:28:53.205869+0000","last_peered":"2023-10-24T00:28:53.205869+0000","last_clean":"2023-10-24T00:28:53.205869+0000","last_became_active":"2023-10-24T00:28:52.839452+0000","last_became_peered":"2023-10-24T00:28:52.839452+0000","last_unstale":"2023-10-24T00:28:53.205869+0000","last_undegraded":"2023-10-24T00:28:53.205869+0000","last_fullsized":"2023-10-24T00:28:53.205869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.198874+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:28:53.198874+0000","last_peered":"2023-10-24T00:28:53.198874+0000","last_clean":"2023-10-24T00:28:53.198874+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:28:53.198874+0000","last_undegraded":"2023-10-24T00:28:53.198874+0000","last_fullsized":"2023-10-24T00:28:53.198874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189581+0000","last_change":"2023-10-24T00:28:52.832876+0000","last_active":"2023-10-24T00:28:53.189581+0000","last_peered":"2023-10-24T00:28:53.189581+0000","last_clean":"2023-10-24T00:28:53.189581+0000","last_became_active":"2023-10-24T00:28:52.832617+0000","last_became_peered":"2023-10-24T00:28:52.832617+0000","last_unstale":"2023-10-24T00:28:53.189581+0000","last_undegraded":"2023-10-24T00:28:53.189581+0000","last_fullsized":"2023-10-24T00:28:53.189581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219158+0000","last_change":"2023-10-24T00:28:53.217199+0000","last_active":"2023-10-24T00:28:53.219158+0000","last_peered":"2023-10-24T00:28:53.219158+0000","last_clean":"2023-10-24T00:28:53.219158+0000","last_became_active":"2023-10-24T00:28:53.216879+0000","last_became_peered":"2023-10-24T00:28:53.216879+0000","last_unstale":"2023-10-24T00:28:53.219158+0000","last_undegraded":"2023-10-24T00:28:53.219158+0000","last_fullsized":"2023-10-24T00:28:53.219158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207465+0000","last_change":"2023-10-24T00:28:52.831240+0000","last_active":"2023-10-24T00:28:53.207465+0000","last_peered":"2023-10-24T00:28:53.207465+0000","last_clean":"2023-10-24T00:28:53.207465+0000","last_became_active":"2023-10-24T00:28:52.830998+0000","last_became_peered":"2023-10-24T00:28:52.830998+0000","last_unstale":"2023-10-24T00:28:53.207465+0000","last_undegraded":"2023-10-24T00:28:53.207465+0000","last_fullsized":"2023-10-24T00:28:53.207465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189430+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:28:53.189430+0000","last_peered":"2023-10-24T00:28:53.189430+0000","last_clean":"2023-10-24T00:28:53.189430+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:28:53.189430+0000","last_undegraded":"2023-10-24T00:28:53.189430+0000","last_fullsized":"2023-10-24T00:28:53.189430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210569+0000","last_change":"2023-10-24T00:28:53.207984+0000","last_active":"2023-10-24T00:28:53.210569+0000","last_peered":"2023-10-24T00:28:53.210569+0000","last_clean":"2023-10-24T00:28:53.210569+0000","last_became_active":"2023-10-24T00:28:53.206306+0000","last_became_peered":"2023-10-24T00:28:53.206306+0000","last_unstale":"2023-10-24T00:28:53.210569+0000","last_undegraded":"2023-10-24T00:28:53.210569+0000","last_fullsized":"2023-10-24T00:28:53.210569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204049+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:28:53.204049+0000","last_peered":"2023-10-24T00:28:53.204049+0000","last_clean":"2023-10-24T00:28:53.204049+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:28:53.204049+0000","last_undegraded":"2023-10-24T00:28:53.204049+0000","last_fullsized":"2023-10-24T00:28:53.204049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.213765+0000","last_change":"2023-10-24T00:28:52.845874+0000","last_active":"2023-10-24T00:28:53.213765+0000","last_peered":"2023-10-24T00:28:53.213765+0000","last_clean":"2023-10-24T00:28:53.213765+0000","last_became_active":"2023-10-24T00:28:52.845615+0000","last_became_peered":"2023-10-24T00:28:52.845615+0000","last_unstale":"2023-10-24T00:28:53.213765+0000","last_undegraded":"2023-10-24T00:28:53.213765+0000","last_fullsized":"2023-10-24T00:28:53.213765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217693+0000","last_change":"2023-10-24T00:28:53.212953+0000","last_active":"2023-10-24T00:28:53.217693+0000","last_peered":"2023-10-24T00:28:53.217693+0000","last_clean":"2023-10-24T00:28:53.217693+0000","last_became_active":"2023-10-24T00:28:53.212744+0000","last_became_peered":"2023-10-24T00:28:53.212744+0000","last_unstale":"2023-10-24T00:28:53.217693+0000","last_undegraded":"2023-10-24T00:28:53.217693+0000","last_fullsized":"2023-10-24T00:28:53.217693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209183+0000","last_change":"2023-10-24T00:28:53.200428+0000","last_active":"2023-10-24T00:28:53.209183+0000","last_peered":"2023-10-24T00:28:53.209183+0000","last_clean":"2023-10-24T00:28:53.209183+0000","last_became_active":"2023-10-24T00:28:53.200188+0000","last_became_peered":"2023-10-24T00:28:53.200188+0000","last_unstale":"2023-10-24T00:28:53.209183+0000","last_undegraded":"2023-10-24T00:28:53.209183+0000","last_fullsized":"2023-10-24T00:28:53.209183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209326+0000","last_change":"2023-10-24T00:28:52.841438+0000","last_active":"2023-10-24T00:28:53.209326+0000","last_peered":"2023-10-24T00:28:53.209326+0000","last_clean":"2023-10-24T00:28:53.209326+0000","last_became_active":"2023-10-24T00:28:52.840737+0000","last_became_peered":"2023-10-24T00:28:52.840737+0000","last_unstale":"2023-10-24T00:28:53.209326+0000","last_undegraded":"2023-10-24T00:28:53.209326+0000","last_fullsized":"2023-10-24T00:28:53.209326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221285+0000","last_change":"2023-10-24T00:28:53.214566+0000","last_active":"2023-10-24T00:28:53.221285+0000","last_peered":"2023-10-24T00:28:53.221285+0000","last_clean":"2023-10-24T00:28:53.221285+0000","last_became_active":"2023-10-24T00:28:53.213861+0000","last_became_peered":"2023-10-24T00:28:53.213861+0000","last_unstale":"2023-10-24T00:28:53.221285+0000","last_undegraded":"2023-10-24T00:28:53.221285+0000","last_fullsized":"2023-10-24T00:28:53.221285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207937+0000","last_change":"2023-10-24T00:28:52.837316+0000","last_active":"2023-10-24T00:28:53.207937+0000","last_peered":"2023-10-24T00:28:53.207937+0000","last_clean":"2023-10-24T00:28:53.207937+0000","last_became_active":"2023-10-24T00:28:52.836698+0000","last_became_peered":"2023-10-24T00:28:52.836698+0000","last_unstale":"2023-10-24T00:28:53.207937+0000","last_undegraded":"2023-10-24T00:28:53.207937+0000","last_fullsized":"2023-10-24T00:28:53.207937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214867+0000","last_change":"2023-10-24T00:28:53.202586+0000","last_active":"2023-10-24T00:28:53.214867+0000","last_peered":"2023-10-24T00:28:53.214867+0000","last_clean":"2023-10-24T00:28:53.214867+0000","last_became_active":"2023-10-24T00:28:53.202224+0000","last_became_peered":"2023-10-24T00:28:53.202224+0000","last_unstale":"2023-10-24T00:28:53.214867+0000","last_undegraded":"2023-10-24T00:28:53.214867+0000","last_fullsized":"2023-10-24T00:28:53.214867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218867+0000","last_change":"2023-10-24T00:28:52.836652+0000","last_active":"2023-10-24T00:28:53.218867+0000","last_peered":"2023-10-24T00:28:53.218867+0000","last_clean":"2023-10-24T00:28:53.218867+0000","last_became_active":"2023-10-24T00:28:52.833453+0000","last_became_peered":"2023-10-24T00:28:52.833453+0000","last_unstale":"2023-10-24T00:28:53.218867+0000","last_undegraded":"2023-10-24T00:28:53.218867+0000","last_fullsized":"2023-10-24T00:28:53.218867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211781+0000","last_change":"2023-10-24T00:28:53.198873+0000","last_active":"2023-10-24T00:28:53.211781+0000","last_peered":"2023-10-24T00:28:53.211781+0000","last_clean":"2023-10-24T00:28:53.211781+0000","last_became_active":"2023-10-24T00:28:53.198630+0000","last_became_peered":"2023-10-24T00:28:53.198630+0000","last_unstale":"2023-10-24T00:28:53.211781+0000","last_undegraded":"2023-10-24T00:28:53.211781+0000","last_fullsized":"2023-10-24T00:28:53.211781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203535+0000","last_change":"2023-10-24T00:28:52.830907+0000","last_active":"2023-10-24T00:28:53.203535+0000","last_peered":"2023-10-24T00:28:53.203535+0000","last_clean":"2023-10-24T00:28:53.203535+0000","last_became_active":"2023-10-24T00:28:52.830585+0000","last_became_peered":"2023-10-24T00:28:52.830585+0000","last_unstale":"2023-10-24T00:28:53.203535+0000","last_undegraded":"2023-10-24T00:28:53.203535+0000","last_fullsized":"2023-10-24T00:28:53.203535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214428+0000","last_change":"2023-10-24T00:28:53.207126+0000","last_active":"2023-10-24T00:28:53.214428+0000","last_peered":"2023-10-24T00:28:53.214428+0000","last_clean":"2023-10-24T00:28:53.214428+0000","last_became_active":"2023-10-24T00:28:53.206860+0000","last_became_peered":"2023-10-24T00:28:53.206860+0000","last_unstale":"2023-10-24T00:28:53.214428+0000","last_undegraded":"2023-10-24T00:28:53.214428+0000","last_fullsized":"2023-10-24T00:28:53.214428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219605+0000","last_change":"2023-10-24T00:28:52.839828+0000","last_active":"2023-10-24T00:28:53.219605+0000","last_peered":"2023-10-24T00:28:53.219605+0000","last_clean":"2023-10-24T00:28:53.219605+0000","last_became_active":"2023-10-24T00:28:52.839501+0000","last_became_peered":"2023-10-24T00:28:52.839501+0000","last_unstale":"2023-10-24T00:28:53.219605+0000","last_undegraded":"2023-10-24T00:28:53.219605+0000","last_fullsized":"2023-10-24T00:28:53.219605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208863+0000","last_change":"2023-10-24T00:28:53.207780+0000","last_active":"2023-10-24T00:28:53.208863+0000","last_peered":"2023-10-24T00:28:53.208863+0000","last_clean":"2023-10-24T00:28:53.208863+0000","last_became_active":"2023-10-24T00:28:53.207543+0000","last_became_peered":"2023-10-24T00:28:53.207543+0000","last_unstale":"2023-10-24T00:28:53.208863+0000","last_undegraded":"2023-10-24T00:28:53.208863+0000","last_fullsized":"2023-10-24T00:28:53.208863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.202990+0000","last_change":"2023-10-24T00:28:52.841865+0000","last_active":"2023-10-24T00:28:53.202990+0000","last_peered":"2023-10-24T00:28:53.202990+0000","last_clean":"2023-10-24T00:28:53.202990+0000","last_became_active":"2023-10-24T00:28:52.841563+0000","last_became_peered":"2023-10-24T00:28:52.841563+0000","last_unstale":"2023-10-24T00:28:53.202990+0000","last_undegraded":"2023-10-24T00:28:53.202990+0000","last_fullsized":"2023-10-24T00:28:53.202990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210510+0000","last_change":"2023-10-24T00:28:53.209114+0000","last_active":"2023-10-24T00:28:53.210510+0000","last_peered":"2023-10-24T00:28:53.210510+0000","last_clean":"2023-10-24T00:28:53.210510+0000","last_became_active":"2023-10-24T00:28:53.208807+0000","last_became_peered":"2023-10-24T00:28:53.208807+0000","last_unstale":"2023-10-24T00:28:53.210510+0000","last_undegraded":"2023-10-24T00:28:53.210510+0000","last_fullsized":"2023-10-24T00:28:53.210510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.194668+0000","last_change":"2023-10-24T00:28:52.844739+0000","last_active":"2023-10-24T00:28:53.194668+0000","last_peered":"2023-10-24T00:28:53.194668+0000","last_clean":"2023-10-24T00:28:53.194668+0000","last_became_active":"2023-10-24T00:28:52.844439+0000","last_became_peered":"2023-10-24T00:28:52.844439+0000","last_unstale":"2023-10-24T00:28:53.194668+0000","last_undegraded":"2023-10-24T00:28:53.194668+0000","last_fullsized":"2023-10-24T00:28:53.194668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221397+0000","last_change":"2023-10-24T00:28:53.218085+0000","last_active":"2023-10-24T00:28:53.221397+0000","last_peered":"2023-10-24T00:28:53.221397+0000","last_clean":"2023-10-24T00:28:53.221397+0000","last_became_active":"2023-10-24T00:28:53.217721+0000","last_became_peered":"2023-10-24T00:28:53.217721+0000","last_unstale":"2023-10-24T00:28:53.221397+0000","last_undegraded":"2023-10-24T00:28:53.221397+0000","last_fullsized":"2023-10-24T00:28:53.221397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208057+0000","last_change":"2023-10-24T00:28:52.835851+0000","last_active":"2023-10-24T00:28:53.208057+0000","last_peered":"2023-10-24T00:28:53.208057+0000","last_clean":"2023-10-24T00:28:53.208057+0000","last_became_active":"2023-10-24T00:28:52.835454+0000","last_became_peered":"2023-10-24T00:28:52.835454+0000","last_unstale":"2023-10-24T00:28:53.208057+0000","last_undegraded":"2023-10-24T00:28:53.208057+0000","last_fullsized":"2023-10-24T00:28:53.208057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214864+0000","last_change":"2023-10-24T00:28:53.211252+0000","last_active":"2023-10-24T00:28:53.214864+0000","last_peered":"2023-10-24T00:28:53.214864+0000","last_clean":"2023-10-24T00:28:53.214864+0000","last_became_active":"2023-10-24T00:28:53.210970+0000","last_became_peered":"2023-10-24T00:28:53.210970+0000","last_unstale":"2023-10-24T00:28:53.214864+0000","last_undegraded":"2023-10-24T00:28:53.214864+0000","last_fullsized":"2023-10-24T00:28:53.214864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206180+0000","last_change":"2023-10-24T00:28:52.841793+0000","last_active":"2023-10-24T00:28:53.206180+0000","last_peered":"2023-10-24T00:28:53.206180+0000","last_clean":"2023-10-24T00:28:53.206180+0000","last_became_active":"2023-10-24T00:28:52.841487+0000","last_became_peered":"2023-10-24T00:28:52.841487+0000","last_unstale":"2023-10-24T00:28:53.206180+0000","last_undegraded":"2023-10-24T00:28:53.206180+0000","last_fullsized":"2023-10-24T00:28:53.206180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210735+0000","last_change":"2023-10-24T00:28:53.208115+0000","last_active":"2023-10-24T00:28:53.210735+0000","last_peered":"2023-10-24T00:28:53.210735+0000","last_clean":"2023-10-24T00:28:53.210735+0000","last_became_active":"2023-10-24T00:28:53.207329+0000","last_became_peered":"2023-10-24T00:28:53.207329+0000","last_unstale":"2023-10-24T00:28:53.210735+0000","last_undegraded":"2023-10-24T00:28:53.210735+0000","last_fullsized":"2023-10-24T00:28:53.210735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195405+0000","last_change":"2023-10-24T00:28:52.833047+0000","last_active":"2023-10-24T00:28:53.195405+0000","last_peered":"2023-10-24T00:28:53.195405+0000","last_clean":"2023-10-24T00:28:53.195405+0000","last_became_active":"2023-10-24T00:28:52.832806+0000","last_became_peered":"2023-10-24T00:28:52.832806+0000","last_unstale":"2023-10-24T00:28:53.195405+0000","last_undegraded":"2023-10-24T00:28:53.195405+0000","last_fullsized":"2023-10-24T00:28:53.195405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221263+0000","last_change":"2023-10-24T00:28:53.214374+0000","last_active":"2023-10-24T00:28:53.221263+0000","last_peered":"2023-10-24T00:28:53.221263+0000","last_clean":"2023-10-24T00:28:53.221263+0000","last_became_active":"2023-10-24T00:28:53.214029+0000","last_became_peered":"2023-10-24T00:28:53.214029+0000","last_unstale":"2023-10-24T00:28:53.221263+0000","last_undegraded":"2023-10-24T00:28:53.221263+0000","last_fullsized":"2023-10-24T00:28:53.221263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189999+0000","last_change":"2023-10-24T00:28:52.831478+0000","last_active":"2023-10-24T00:28:53.189999+0000","last_peered":"2023-10-24T00:28:53.189999+0000","last_clean":"2023-10-24T00:28:53.189999+0000","last_became_active":"2023-10-24T00:28:52.831185+0000","last_became_peered":"2023-10-24T00:28:52.831185+0000","last_unstale":"2023-10-24T00:28:53.189999+0000","last_undegraded":"2023-10-24T00:28:53.189999+0000","last_fullsized":"2023-10-24T00:28:53.189999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203515+0000","last_change":"2023-10-24T00:28:53.197544+0000","last_active":"2023-10-24T00:28:53.203515+0000","last_peered":"2023-10-24T00:28:53.203515+0000","last_clean":"2023-10-24T00:28:53.203515+0000","last_became_active":"2023-10-24T00:28:53.197271+0000","last_became_peered":"2023-10-24T00:28:53.197271+0000","last_unstale":"2023-10-24T00:28:53.203515+0000","last_undegraded":"2023-10-24T00:28:53.203515+0000","last_fullsized":"2023-10-24T00:28:53.203515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-24T00:28:54.402689+0000","last_change":"2023-10-24T00:28:52.835770+0000","last_active":"2023-10-24T00:28:54.402689+0000","last_peered":"2023-10-24T00:28:54.402689+0000","last_clean":"2023-10-24T00:28:54.402689+0000","last_became_active":"2023-10-24T00:28:52.835495+0000","last_became_peered":"2023-10-24T00:28:52.835495+0000","last_unstale":"2023-10-24T00:28:54.402689+0000","last_undegraded":"2023-10-24T00:28:54.402689+0000","last_fullsized":"2023-10-24T00:28:54.402689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216732+0000","last_change":"2023-10-24T00:28:53.210440+0000","last_active":"2023-10-24T00:28:53.216732+0000","last_peered":"2023-10-24T00:28:53.216732+0000","last_clean":"2023-10-24T00:28:53.216732+0000","last_became_active":"2023-10-24T00:28:53.210153+0000","last_became_peered":"2023-10-24T00:28:53.210153+0000","last_unstale":"2023-10-24T00:28:53.216732+0000","last_undegraded":"2023-10-24T00:28:53.216732+0000","last_fullsized":"2023-10-24T00:28:53.216732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195686+0000","last_change":"2023-10-24T00:28:52.834627+0000","last_active":"2023-10-24T00:28:53.195686+0000","last_peered":"2023-10-24T00:28:53.195686+0000","last_clean":"2023-10-24T00:28:53.195686+0000","last_became_active":"2023-10-24T00:28:52.834319+0000","last_became_peered":"2023-10-24T00:28:52.834319+0000","last_unstale":"2023-10-24T00:28:53.195686+0000","last_undegraded":"2023-10-24T00:28:53.195686+0000","last_fullsized":"2023-10-24T00:28:53.195686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218902+0000","last_change":"2023-10-24T00:28:53.215043+0000","last_active":"2023-10-24T00:28:53.218902+0000","last_peered":"2023-10-24T00:28:53.218902+0000","last_clean":"2023-10-24T00:28:53.218902+0000","last_became_active":"2023-10-24T00:28:53.214443+0000","last_became_peered":"2023-10-24T00:28:53.214443+0000","last_unstale":"2023-10-24T00:28:53.218902+0000","last_undegraded":"2023-10-24T00:28:53.218902+0000","last_fullsized":"2023-10-24T00:28:53.218902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.207692+0000","last_change":"2023-10-24T00:28:52.834431+0000","last_active":"2023-10-24T00:28:53.207692+0000","last_peered":"2023-10-24T00:28:53.207692+0000","last_clean":"2023-10-24T00:28:53.207692+0000","last_became_active":"2023-10-24T00:28:52.834148+0000","last_became_peered":"2023-10-24T00:28:52.834148+0000","last_unstale":"2023-10-24T00:28:53.207692+0000","last_undegraded":"2023-10-24T00:28:53.207692+0000","last_fullsized":"2023-10-24T00:28:53.207692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218060+0000","last_change":"2023-10-24T00:28:53.213561+0000","last_active":"2023-10-24T00:28:53.218060+0000","last_peered":"2023-10-24T00:28:53.218060+0000","last_clean":"2023-10-24T00:28:53.218060+0000","last_became_active":"2023-10-24T00:28:53.213113+0000","last_became_peered":"2023-10-24T00:28:53.213113+0000","last_unstale":"2023-10-24T00:28:53.218060+0000","last_undegraded":"2023-10-24T00:28:53.218060+0000","last_fullsized":"2023-10-24T00:28:53.218060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.193241+0000","last_change":"2023-10-24T00:28:52.836152+0000","last_active":"2023-10-24T00:28:53.193241+0000","last_peered":"2023-10-24T00:28:53.193241+0000","last_clean":"2023-10-24T00:28:53.193241+0000","last_became_active":"2023-10-24T00:28:52.835876+0000","last_became_peered":"2023-10-24T00:28:52.835876+0000","last_unstale":"2023-10-24T00:28:53.193241+0000","last_undegraded":"2023-10-24T00:28:53.193241+0000","last_fullsized":"2023-10-24T00:28:53.193241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218780+0000","last_change":"2023-10-24T00:28:53.215079+0000","last_active":"2023-10-24T00:28:53.218780+0000","last_peered":"2023-10-24T00:28:53.218780+0000","last_clean":"2023-10-24T00:28:53.218780+0000","last_became_active":"2023-10-24T00:28:53.214831+0000","last_became_peered":"2023-10-24T00:28:53.214831+0000","last_unstale":"2023-10-24T00:28:53.218780+0000","last_undegraded":"2023-10-24T00:28:53.218780+0000","last_fullsized":"2023-10-24T00:28:53.218780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208256+0000","last_change":"2023-10-24T00:28:52.836578+0000","last_active":"2023-10-24T00:28:53.208256+0000","last_peered":"2023-10-24T00:28:53.208256+0000","last_clean":"2023-10-24T00:28:53.208256+0000","last_became_active":"2023-10-24T00:28:52.836282+0000","last_became_peered":"2023-10-24T00:28:52.836282+0000","last_unstale":"2023-10-24T00:28:53.208256+0000","last_undegraded":"2023-10-24T00:28:53.208256+0000","last_fullsized":"2023-10-24T00:28:53.208256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221391+0000","last_change":"2023-10-24T00:28:53.215101+0000","last_active":"2023-10-24T00:28:53.221391+0000","last_peered":"2023-10-24T00:28:53.221391+0000","last_clean":"2023-10-24T00:28:53.221391+0000","last_became_active":"2023-10-24T00:28:53.214824+0000","last_became_peered":"2023-10-24T00:28:53.214824+0000","last_unstale":"2023-10-24T00:28:53.221391+0000","last_undegraded":"2023-10-24T00:28:53.221391+0000","last_fullsized":"2023-10-24T00:28:53.221391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.220171+0000","last_change":"2023-10-24T00:28:52.841688+0000","last_active":"2023-10-24T00:28:53.220171+0000","last_peered":"2023-10-24T00:28:53.220171+0000","last_clean":"2023-10-24T00:28:53.220171+0000","last_became_active":"2023-10-24T00:28:52.841119+0000","last_became_peered":"2023-10-24T00:28:52.841119+0000","last_unstale":"2023-10-24T00:28:53.220171+0000","last_undegraded":"2023-10-24T00:28:53.220171+0000","last_fullsized":"2023-10-24T00:28:53.220171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221472+0000","last_change":"2023-10-24T00:28:53.219544+0000","last_active":"2023-10-24T00:28:53.221472+0000","last_peered":"2023-10-24T00:28:53.221472+0000","last_clean":"2023-10-24T00:28:53.221472+0000","last_became_active":"2023-10-24T00:28:53.218846+0000","last_became_peered":"2023-10-24T00:28:53.218846+0000","last_unstale":"2023-10-24T00:28:53.221472+0000","last_undegraded":"2023-10-24T00:28:53.221472+0000","last_fullsized":"2023-10-24T00:28:53.221472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206514+0000","last_change":"2023-10-24T00:28:52.837080+0000","last_active":"2023-10-24T00:28:53.206514+0000","last_peered":"2023-10-24T00:28:53.206514+0000","last_clean":"2023-10-24T00:28:53.206514+0000","last_became_active":"2023-10-24T00:28:52.836776+0000","last_became_peered":"2023-10-24T00:28:52.836776+0000","last_unstale":"2023-10-24T00:28:53.206514+0000","last_undegraded":"2023-10-24T00:28:53.206514+0000","last_fullsized":"2023-10-24T00:28:53.206514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218929+0000","last_change":"2023-10-24T00:28:53.216046+0000","last_active":"2023-10-24T00:28:53.218929+0000","last_peered":"2023-10-24T00:28:53.218929+0000","last_clean":"2023-10-24T00:28:53.218929+0000","last_became_active":"2023-10-24T00:28:53.213450+0000","last_became_peered":"2023-10-24T00:28:53.213450+0000","last_unstale":"2023-10-24T00:28:53.218929+0000","last_undegraded":"2023-10-24T00:28:53.218929+0000","last_fullsized":"2023-10-24T00:28:53.218929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214964+0000","last_change":"2023-10-24T00:28:52.830778+0000","last_active":"2023-10-24T00:28:53.214964+0000","last_peered":"2023-10-24T00:28:53.214964+0000","last_clean":"2023-10-24T00:28:53.214964+0000","last_became_active":"2023-10-24T00:28:52.830521+0000","last_became_peered":"2023-10-24T00:28:52.830521+0000","last_unstale":"2023-10-24T00:28:53.214964+0000","last_undegraded":"2023-10-24T00:28:53.214964+0000","last_fullsized":"2023-10-24T00:28:53.214964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.211818+0000","last_change":"2023-10-24T00:28:53.208010+0000","last_active":"2023-10-24T00:28:53.211818+0000","last_peered":"2023-10-24T00:28:53.211818+0000","last_clean":"2023-10-24T00:28:53.211818+0000","last_became_active":"2023-10-24T00:28:53.207747+0000","last_became_peered":"2023-10-24T00:28:53.207747+0000","last_unstale":"2023-10-24T00:28:53.211818+0000","last_undegraded":"2023-10-24T00:28:53.211818+0000","last_fullsized":"2023-10-24T00:28:53.211818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195211+0000","last_change":"2023-10-24T00:28:52.834362+0000","last_active":"2023-10-24T00:28:53.195211+0000","last_peered":"2023-10-24T00:28:53.195211+0000","last_clean":"2023-10-24T00:28:53.195211+0000","last_became_active":"2023-10-24T00:28:52.834075+0000","last_became_peered":"2023-10-24T00:28:52.834075+0000","last_unstale":"2023-10-24T00:28:53.195211+0000","last_undegraded":"2023-10-24T00:28:53.195211+0000","last_fullsized":"2023-10-24T00:28:53.195211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219214+0000","last_change":"2023-10-24T00:28:53.209612+0000","last_active":"2023-10-24T00:28:53.219214+0000","last_peered":"2023-10-24T00:28:53.219214+0000","last_clean":"2023-10-24T00:28:53.219214+0000","last_became_active":"2023-10-24T00:28:53.209308+0000","last_became_peered":"2023-10-24T00:28:53.209308+0000","last_unstale":"2023-10-24T00:28:53.219214+0000","last_undegraded":"2023-10-24T00:28:53.219214+0000","last_fullsized":"2023-10-24T00:28:53.219214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208307+0000","last_change":"2023-10-24T00:28:52.837004+0000","last_active":"2023-10-24T00:28:53.208307+0000","last_peered":"2023-10-24T00:28:53.208307+0000","last_clean":"2023-10-24T00:28:53.208307+0000","last_became_active":"2023-10-24T00:28:52.836745+0000","last_became_peered":"2023-10-24T00:28:52.836745+0000","last_unstale":"2023-10-24T00:28:53.208307+0000","last_undegraded":"2023-10-24T00:28:53.208307+0000","last_fullsized":"2023-10-24T00:28:53.208307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218923+0000","last_change":"2023-10-24T00:28:53.215218+0000","last_active":"2023-10-24T00:28:53.218923+0000","last_peered":"2023-10-24T00:28:53.218923+0000","last_clean":"2023-10-24T00:28:53.218923+0000","last_became_active":"2023-10-24T00:28:53.214775+0000","last_became_peered":"2023-10-24T00:28:53.214775+0000","last_unstale":"2023-10-24T00:28:53.218923+0000","last_undegraded":"2023-10-24T00:28:53.218923+0000","last_fullsized":"2023-10-24T00:28:53.218923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219822+0000","last_change":"2023-10-24T00:28:52.842419+0000","last_active":"2023-10-24T00:28:53.219822+0000","last_peered":"2023-10-24T00:28:53.219822+0000","last_clean":"2023-10-24T00:28:53.219822+0000","last_became_active":"2023-10-24T00:28:52.841163+0000","last_became_peered":"2023-10-24T00:28:52.841163+0000","last_unstale":"2023-10-24T00:28:53.219822+0000","last_undegraded":"2023-10-24T00:28:53.219822+0000","last_fullsized":"2023-10-24T00:28:53.219822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219805+0000","last_change":"2023-10-24T00:28:53.217175+0000","last_active":"2023-10-24T00:28:53.219805+0000","last_peered":"2023-10-24T00:28:53.219805+0000","last_clean":"2023-10-24T00:28:53.219805+0000","last_became_active":"2023-10-24T00:28:53.216835+0000","last_became_peered":"2023-10-24T00:28:53.216835+0000","last_unstale":"2023-10-24T00:28:53.219805+0000","last_undegraded":"2023-10-24T00:28:53.219805+0000","last_fullsized":"2023-10-24T00:28:53.219805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189036+0000","last_change":"2023-10-24T00:28:52.830798+0000","last_active":"2023-10-24T00:28:53.189036+0000","last_peered":"2023-10-24T00:28:53.189036+0000","last_clean":"2023-10-24T00:28:53.189036+0000","last_became_active":"2023-10-24T00:28:52.830499+0000","last_became_peered":"2023-10-24T00:28:52.830499+0000","last_unstale":"2023-10-24T00:28:53.189036+0000","last_undegraded":"2023-10-24T00:28:53.189036+0000","last_fullsized":"2023-10-24T00:28:53.189036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221123+0000","last_change":"2023-10-24T00:28:53.214273+0000","last_active":"2023-10-24T00:28:53.221123+0000","last_peered":"2023-10-24T00:28:53.221123+0000","last_clean":"2023-10-24T00:28:53.221123+0000","last_became_active":"2023-10-24T00:28:53.213976+0000","last_became_peered":"2023-10-24T00:28:53.213976+0000","last_unstale":"2023-10-24T00:28:53.221123+0000","last_undegraded":"2023-10-24T00:28:53.221123+0000","last_fullsized":"2023-10-24T00:28:53.221123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.208529+0000","last_change":"2023-10-24T00:28:52.844073+0000","last_active":"2023-10-24T00:28:53.208529+0000","last_peered":"2023-10-24T00:28:53.208529+0000","last_clean":"2023-10-24T00:28:53.208529+0000","last_became_active":"2023-10-24T00:28:52.843728+0000","last_became_peered":"2023-10-24T00:28:52.843728+0000","last_unstale":"2023-10-24T00:28:53.208529+0000","last_undegraded":"2023-10-24T00:28:53.208529+0000","last_fullsized":"2023-10-24T00:28:53.208529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218774+0000","last_change":"2023-10-24T00:28:53.214608+0000","last_active":"2023-10-24T00:28:53.218774+0000","last_peered":"2023-10-24T00:28:53.218774+0000","last_clean":"2023-10-24T00:28:53.218774+0000","last_became_active":"2023-10-24T00:28:53.214109+0000","last_became_peered":"2023-10-24T00:28:53.214109+0000","last_unstale":"2023-10-24T00:28:53.218774+0000","last_undegraded":"2023-10-24T00:28:53.218774+0000","last_fullsized":"2023-10-24T00:28:53.218774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.204197+0000","last_change":"2023-10-24T00:28:52.831728+0000","last_active":"2023-10-24T00:28:53.204197+0000","last_peered":"2023-10-24T00:28:53.204197+0000","last_clean":"2023-10-24T00:28:53.204197+0000","last_became_active":"2023-10-24T00:28:52.831431+0000","last_became_peered":"2023-10-24T00:28:52.831431+0000","last_unstale":"2023-10-24T00:28:53.204197+0000","last_undegraded":"2023-10-24T00:28:53.204197+0000","last_fullsized":"2023-10-24T00:28:53.204197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209657+0000","last_change":"2023-10-24T00:28:53.203483+0000","last_active":"2023-10-24T00:28:53.209657+0000","last_peered":"2023-10-24T00:28:53.209657+0000","last_clean":"2023-10-24T00:28:53.209657+0000","last_became_active":"2023-10-24T00:28:53.203186+0000","last_became_peered":"2023-10-24T00:28:53.203186+0000","last_unstale":"2023-10-24T00:28:53.209657+0000","last_undegraded":"2023-10-24T00:28:53.209657+0000","last_fullsized":"2023-10-24T00:28:53.209657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221459+0000","last_change":"2023-10-24T00:28:52.830036+0000","last_active":"2023-10-24T00:28:53.221459+0000","last_peered":"2023-10-24T00:28:53.221459+0000","last_clean":"2023-10-24T00:28:53.221459+0000","last_became_active":"2023-10-24T00:28:52.829705+0000","last_became_peered":"2023-10-24T00:28:52.829705+0000","last_unstale":"2023-10-24T00:28:53.221459+0000","last_undegraded":"2023-10-24T00:28:53.221459+0000","last_fullsized":"2023-10-24T00:28:53.221459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219887+0000","last_change":"2023-10-24T00:28:53.212603+0000","last_active":"2023-10-24T00:28:53.219887+0000","last_peered":"2023-10-24T00:28:53.219887+0000","last_clean":"2023-10-24T00:28:53.219887+0000","last_became_active":"2023-10-24T00:28:53.212009+0000","last_became_peered":"2023-10-24T00:28:53.212009+0000","last_unstale":"2023-10-24T00:28:53.219887+0000","last_undegraded":"2023-10-24T00:28:53.219887+0000","last_fullsized":"2023-10-24T00:28:53.219887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206210+0000","last_change":"2023-10-24T00:28:52.834788+0000","last_active":"2023-10-24T00:28:53.206210+0000","last_peered":"2023-10-24T00:28:53.206210+0000","last_clean":"2023-10-24T00:28:53.206210+0000","last_became_active":"2023-10-24T00:28:52.834521+0000","last_became_peered":"2023-10-24T00:28:52.834521+0000","last_unstale":"2023-10-24T00:28:53.206210+0000","last_undegraded":"2023-10-24T00:28:53.206210+0000","last_fullsized":"2023-10-24T00:28:53.206210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217102+0000","last_change":"2023-10-24T00:28:53.204703+0000","last_active":"2023-10-24T00:28:53.217102+0000","last_peered":"2023-10-24T00:28:53.217102+0000","last_clean":"2023-10-24T00:28:53.217102+0000","last_became_active":"2023-10-24T00:28:53.204271+0000","last_became_peered":"2023-10-24T00:28:53.204271+0000","last_unstale":"2023-10-24T00:28:53.217102+0000","last_undegraded":"2023-10-24T00:28:53.217102+0000","last_fullsized":"2023-10-24T00:28:53.217102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.203299+0000","last_change":"2023-10-24T00:28:52.834186+0000","last_active":"2023-10-24T00:28:53.203299+0000","last_peered":"2023-10-24T00:28:53.203299+0000","last_clean":"2023-10-24T00:28:53.203299+0000","last_became_active":"2023-10-24T00:28:52.833901+0000","last_became_peered":"2023-10-24T00:28:52.833901+0000","last_unstale":"2023-10-24T00:28:53.203299+0000","last_undegraded":"2023-10-24T00:28:53.203299+0000","last_fullsized":"2023-10-24T00:28:53.203299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.214448+0000","last_change":"2023-10-24T00:28:53.210483+0000","last_active":"2023-10-24T00:28:53.214448+0000","last_peered":"2023-10-24T00:28:53.214448+0000","last_clean":"2023-10-24T00:28:53.214448+0000","last_became_active":"2023-10-24T00:28:53.210273+0000","last_became_peered":"2023-10-24T00:28:53.210273+0000","last_unstale":"2023-10-24T00:28:53.214448+0000","last_undegraded":"2023-10-24T00:28:53.214448+0000","last_fullsized":"2023-10-24T00:28:53.214448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.199442+0000","last_change":"2023-10-24T00:28:52.832477+0000","last_active":"2023-10-24T00:28:53.199442+0000","last_peered":"2023-10-24T00:28:53.199442+0000","last_clean":"2023-10-24T00:28:53.199442+0000","last_became_active":"2023-10-24T00:28:52.832176+0000","last_became_peered":"2023-10-24T00:28:52.832176+0000","last_unstale":"2023-10-24T00:28:53.199442+0000","last_undegraded":"2023-10-24T00:28:53.199442+0000","last_fullsized":"2023-10-24T00:28:53.199442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.209249+0000","last_change":"2023-10-24T00:28:53.202433+0000","last_active":"2023-10-24T00:28:53.209249+0000","last_peered":"2023-10-24T00:28:53.209249+0000","last_clean":"2023-10-24T00:28:53.209249+0000","last_became_active":"2023-10-24T00:28:53.202167+0000","last_became_peered":"2023-10-24T00:28:53.202167+0000","last_unstale":"2023-10-24T00:28:53.209249+0000","last_undegraded":"2023-10-24T00:28:53.209249+0000","last_fullsized":"2023-10-24T00:28:53.209249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.192091+0000","last_change":"2023-10-24T00:28:52.834616+0000","last_active":"2023-10-24T00:28:53.192091+0000","last_peered":"2023-10-24T00:28:53.192091+0000","last_clean":"2023-10-24T00:28:53.192091+0000","last_became_active":"2023-10-24T00:28:52.834139+0000","last_became_peered":"2023-10-24T00:28:52.834139+0000","last_unstale":"2023-10-24T00:28:53.192091+0000","last_undegraded":"2023-10-24T00:28:53.192091+0000","last_fullsized":"2023-10-24T00:28:53.192091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.218349+0000","last_change":"2023-10-24T00:28:53.212700+0000","last_active":"2023-10-24T00:28:53.218349+0000","last_peered":"2023-10-24T00:28:53.218349+0000","last_clean":"2023-10-24T00:28:53.218349+0000","last_became_active":"2023-10-24T00:28:53.212080+0000","last_became_peered":"2023-10-24T00:28:53.212080+0000","last_unstale":"2023-10-24T00:28:53.218349+0000","last_undegraded":"2023-10-24T00:28:53.218349+0000","last_fullsized":"2023-10-24T00:28:53.218349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.195246+0000","last_change":"2023-10-24T00:28:52.840655+0000","last_active":"2023-10-24T00:28:53.195246+0000","last_peered":"2023-10-24T00:28:53.195246+0000","last_clean":"2023-10-24T00:28:53.195246+0000","last_became_active":"2023-10-24T00:28:52.840401+0000","last_became_peered":"2023-10-24T00:28:52.840401+0000","last_unstale":"2023-10-24T00:28:53.195246+0000","last_undegraded":"2023-10-24T00:28:53.195246+0000","last_fullsized":"2023-10-24T00:28:53.195246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221422+0000","last_change":"2023-10-24T00:28:53.215705+0000","last_active":"2023-10-24T00:28:53.221422+0000","last_peered":"2023-10-24T00:28:53.221422+0000","last_clean":"2023-10-24T00:28:53.221422+0000","last_became_active":"2023-10-24T00:28:53.214840+0000","last_became_peered":"2023-10-24T00:28:53.214840+0000","last_unstale":"2023-10-24T00:28:53.221422+0000","last_undegraded":"2023-10-24T00:28:53.221422+0000","last_fullsized":"2023-10-24T00:28:53.221422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219272+0000","last_change":"2023-10-24T00:28:52.844574+0000","last_active":"2023-10-24T00:28:53.219272+0000","last_peered":"2023-10-24T00:28:53.219272+0000","last_clean":"2023-10-24T00:28:53.219272+0000","last_became_active":"2023-10-24T00:28:52.844244+0000","last_became_peered":"2023-10-24T00:28:52.844244+0000","last_unstale":"2023-10-24T00:28:53.219272+0000","last_undegraded":"2023-10-24T00:28:53.219272+0000","last_fullsized":"2023-10-24T00:28:53.219272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.221438+0000","last_change":"2023-10-24T00:28:53.219279+0000","last_active":"2023-10-24T00:28:53.221438+0000","last_peered":"2023-10-24T00:28:53.221438+0000","last_clean":"2023-10-24T00:28:53.221438+0000","last_became_active":"2023-10-24T00:28:53.218946+0000","last_became_peered":"2023-10-24T00:28:53.218946+0000","last_unstale":"2023-10-24T00:28:53.221438+0000","last_undegraded":"2023-10-24T00:28:53.221438+0000","last_fullsized":"2023-10-24T00:28:53.221438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.210158+0000","last_change":"2023-10-24T00:28:52.835505+0000","last_active":"2023-10-24T00:28:53.210158+0000","last_peered":"2023-10-24T00:28:53.210158+0000","last_clean":"2023-10-24T00:28:53.210158+0000","last_became_active":"2023-10-24T00:28:52.835190+0000","last_became_peered":"2023-10-24T00:28:52.835190+0000","last_unstale":"2023-10-24T00:28:53.210158+0000","last_undegraded":"2023-10-24T00:28:53.210158+0000","last_fullsized":"2023-10-24T00:28:53.210158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219137+0000","last_change":"2023-10-24T00:28:53.217100+0000","last_active":"2023-10-24T00:28:53.219137+0000","last_peered":"2023-10-24T00:28:53.219137+0000","last_clean":"2023-10-24T00:28:53.219137+0000","last_became_active":"2023-10-24T00:28:53.216532+0000","last_became_peered":"2023-10-24T00:28:53.216532+0000","last_unstale":"2023-10-24T00:28:53.219137+0000","last_undegraded":"2023-10-24T00:28:53.219137+0000","last_fullsized":"2023-10-24T00:28:53.219137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217358+0000","last_change":"2023-10-24T00:28:52.835020+0000","last_active":"2023-10-24T00:28:53.217358+0000","last_peered":"2023-10-24T00:28:53.217358+0000","last_clean":"2023-10-24T00:28:53.217358+0000","last_became_active":"2023-10-24T00:28:52.834417+0000","last_became_peered":"2023-10-24T00:28:52.834417+0000","last_unstale":"2023-10-24T00:28:53.217358+0000","last_undegraded":"2023-10-24T00:28:53.217358+0000","last_fullsized":"2023-10-24T00:28:53.217358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.223749+0000","last_change":"2023-10-24T00:28:53.217865+0000","last_active":"2023-10-24T00:28:53.223749+0000","last_peered":"2023-10-24T00:28:53.223749+0000","last_clean":"2023-10-24T00:28:53.223749+0000","last_became_active":"2023-10-24T00:28:53.217135+0000","last_became_peered":"2023-10-24T00:28:53.217135+0000","last_unstale":"2023-10-24T00:28:53.223749+0000","last_undegraded":"2023-10-24T00:28:53.223749+0000","last_fullsized":"2023-10-24T00:28:53.223749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.206256+0000","last_change":"2023-10-24T00:28:52.839792+0000","last_active":"2023-10-24T00:28:53.206256+0000","last_peered":"2023-10-24T00:28:53.206256+0000","last_clean":"2023-10-24T00:28:53.206256+0000","last_became_active":"2023-10-24T00:28:52.839474+0000","last_became_peered":"2023-10-24T00:28:52.839474+0000","last_unstale":"2023-10-24T00:28:53.206256+0000","last_undegraded":"2023-10-24T00:28:53.206256+0000","last_fullsized":"2023-10-24T00:28:53.206256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.217081+0000","last_change":"2023-10-24T00:28:53.204551+0000","last_active":"2023-10-24T00:28:53.217081+0000","last_peered":"2023-10-24T00:28:53.217081+0000","last_clean":"2023-10-24T00:28:53.217081+0000","last_became_active":"2023-10-24T00:28:53.203979+0000","last_became_peered":"2023-10-24T00:28:53.203979+0000","last_unstale":"2023-10-24T00:28:53.217081+0000","last_undegraded":"2023-10-24T00:28:53.217081+0000","last_fullsized":"2023-10-24T00:28:53.217081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.189600+0000","last_change":"2023-10-24T00:28:52.846124+0000","last_active":"2023-10-24T00:28:53.189600+0000","last_peered":"2023-10-24T00:28:53.189600+0000","last_clean":"2023-10-24T00:28:53.189600+0000","last_became_active":"2023-10-24T00:28:52.845781+0000","last_became_peered":"2023-10-24T00:28:52.845781+0000","last_unstale":"2023-10-24T00:28:53.189600+0000","last_undegraded":"2023-10-24T00:28:53.189600+0000","last_fullsized":"2023-10-24T00:28:53.189600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.219930+0000","last_change":"2023-10-24T00:28:53.216003+0000","last_active":"2023-10-24T00:28:53.219930+0000","last_peered":"2023-10-24T00:28:53.219930+0000","last_clean":"2023-10-24T00:28:53.219930+0000","last_became_active":"2023-10-24T00:28:53.215711+0000","last_became_peered":"2023-10-24T00:28:53.215711+0000","last_unstale":"2023-10-24T00:28:53.219930+0000","last_undegraded":"2023-10-24T00:28:53.219930+0000","last_fullsized":"2023-10-24T00:28:53.219930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:52.808484+0000","last_clean_scrub_stamp":"2023-10-24T00:28:52.808484+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-24T00:28:53.216700+0000","last_change":"2023-10-24T00:28:52.829842+0000","last_active":"2023-10-24T00:28:53.216700+0000","last_peered":"2023-10-24T00:28:53.216700+0000","last_clean":"2023-10-24T00:28:53.216700+0000","last_became_active":"2023-10-24T00:28:52.829018+0000","last_became_peered":"2023-10-24T00:28:52.829018+0000","last_unstale":"2023-10-24T00:28:53.216700+0000","last_undegraded":"2023-10-24T00:28:53.216700+0000","last_fullsized":"2023-10-24T00:28:53.216700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:51.806735+0000","last_clean_scrub_stamp":"2023-10-24T00:28:51.806735+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":86631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":85217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":86809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":86663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:07.510 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-24T00:29:07.510 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-24T00:29:07.510 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-24T00:29:07.511 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-24T00:29:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.653+0000 7fc6e40a2700 1 Processor -- start 2023-10-24T00:29:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.654+0000 7fc6e40a2700 1 -- start start 2023-10-24T00:29:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e40a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 0x7fc6dc0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e40a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc6dc0a8260 0x7fc6dc0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e40a2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0bf2d0 con 0x7fc6dc154350 2023-10-24T00:29:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e40a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0a86f0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e40a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0bea30 con 0x7fc6dc154730 2023-10-24T00:29:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e1e3e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc6dc154350 0x7fc6dc064d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57548/0 (socket says 172.21.15.148:57548) 2023-10-24T00:29:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e1e3e700 1 -- 172.21.15.148:0/857083698 learned_addr learned my addr 172.21.15.148:0/857083698 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 --2- 172.21.15.148:0/857083698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 0x7fc6dc0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e263f700 1 --2- 172.21.15.148:0/857083698 >> v2:172.21.15.150:3300/0 conn(0x7fc6dc0a8260 0x7fc6dc0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317496157 0 0) 0x7fc6dc0bf2d0 con 0x7fc6dc154350 2023-10-24T00:29:07.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c40033f0 con 0x7fc6dc154350 2023-10-24T00:29:07.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 -- 172.21.15.148:0/857083698 >> v2:172.21.15.150:3300/0 conn(0x7fc6dc0a8260 msgr2=0x7fc6dc0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:07.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 --2- 172.21.15.148:0/857083698 >> v2:172.21.15.150:3300/0 conn(0x7fc6dc0a8260 0x7fc6dc0c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 -- 172.21.15.148:0/857083698 >> v1:172.21.15.148:6789/0 conn(0x7fc6dc154350 legacy=0x7fc6dc064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 788299401 0 0) 0x7fc6c40033f0 con 0x7fc6dc154350 2023-10-24T00:29:07.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 -- 172.21.15.148:0/857083698 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0bed10 con 0x7fc6dc154730 2023-10-24T00:29:07.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e163d700 1 --2- 172.21.15.148:0/857083698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 0x7fc6dc0a7d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc6d0009760 tx=0x7fc6d0009060).ready entity=mon.2 client_cookie=62a1d933d4efd0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.655+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0017f0 con 0x7fc6dc154730 2023-10-24T00:29:07.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0011400 con 0x7fc6dc154730 2023-10-24T00:29:07.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e0e3c700 1 -- 172.21.15.148:0/857083698 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0011780 con 0x7fc6dc154730 2023-10-24T00:29:07.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 -- 172.21.15.148:0/857083698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 msgr2=0x7fc6dc0a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/857083698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 0x7fc6dc0a7d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc6d0009760 tx=0x7fc6d0009060).stop 2023-10-24T00:29:07.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 -- 172.21.15.148:0/857083698 shutdown_connections 2023-10-24T00:29:07.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/857083698 >> v2:172.21.15.150:3300/0 conn(0x7fc6dc0a8260 0x7fc6dc0c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/857083698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154730 0x7fc6dc0a7d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 -- 172.21.15.148:0/857083698 >> 172.21.15.148:0/857083698 conn(0x7fc6dc082f60 msgr2=0x7fc6dc062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:07.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 -- 172.21.15.148:0/857083698 shutdown_connections 2023-10-24T00:29:07.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.656+0000 7fc6e40a2700 1 -- 172.21.15.148:0/857083698 wait complete. 2023-10-24T00:29:07.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.657+0000 7fc6e40a2700 1 Processor -- start 2023-10-24T00:29:07.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.657+0000 7fc6e40a2700 1 -- start start 2023-10-24T00:29:07.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154350 0x7fc6dc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 0x7fc6dc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0aa650 con 0x7fc6dc0a8260 2023-10-24T00:29:07.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0aa930 con 0x7fc6dc154730 2023-10-24T00:29:07.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e40a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0aac10 con 0x7fc6dc154350 2023-10-24T00:29:07.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53278/0 (socket says 172.21.15.148:53278) 2023-10-24T00:29:07.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 -- 172.21.15.148:0/2045545548 learned_addr learned my addr 172.21.15.148:0/2045545548 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:07.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e163d700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154350 0x7fc6dc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e263f700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 0x7fc6dc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 -- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154350 msgr2=0x7fc6dc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154350 0x7fc6dc14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 -- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 msgr2=0x7fc6dc1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 0x7fc6dc1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 -- 172.21.15.148:0/2045545548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00092a0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e263f700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 0x7fc6dc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:07.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.658+0000 7fc6e1e3e700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc6cc00cae0 tx=0x7fc6cc001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.659+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc001eb0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.659+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc004c40 con 0x7fc6dc0a8260 2023-10-24T00:29:07.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.659+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc0aaef0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.659+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc007170 con 0x7fc6dc0a8260 2023-10-24T00:29:07.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.659+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc0a97f0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.660+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc06c6b0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.660+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc6cc007520 con 0x7fc6dc0a8260 2023-10-24T00:29:07.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.660+0000 7fc6d9ffb700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 0x7fc6c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.661+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc6cc079fc0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.661+0000 7fc6e163d700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 0x7fc6c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.661+0000 7fc6e163d700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 0x7fc6c8061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc6dc159dd0 tx=0x7fc6d0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:07.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.664+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc6cc04b290 con 0x7fc6dc0a8260 2023-10-24T00:29:07.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.864+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc6dc0beff0 con 0x7fc6dc0a8260 2023-10-24T00:29:07.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.864+0000 7fc6d9ffb700 1 -- 172.21.15.148:0/2045545548 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fc6cc019070 con 0x7fc6dc0a8260 2023-10-24T00:29:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:07.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 msgr2=0x7fc6c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 0x7fc6c8061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc6dc159dd0 tx=0x7fc6d0016000).stop 2023-10-24T00:29:07.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 msgr2=0x7fc6dc0a9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:07.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc6cc00cae0 tx=0x7fc6cc001e20).stop 2023-10-24T00:29:07.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 shutdown_connections 2023-10-24T00:29:07.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc154730 0x7fc6dc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc6c805f150 0x7fc6c8061610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6dc0a8260 0x7fc6dc0a9300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 --2- 172.21.15.148:0/2045545548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6dc154350 0x7fc6dc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 >> 172.21.15.148:0/2045545548 conn(0x7fc6dc082f60 msgr2=0x7fc6dc151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:07.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 shutdown_connections 2023-10-24T00:29:07.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.866+0000 7fc6e40a2700 1 -- 172.21.15.148:0/2045545548 wait complete. 2023-10-24T00:29:07.879 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-24T00:29:07.880 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-24T00:29:07.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:07.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.992+0000 7f1b3a36a700 1 Processor -- start 2023-10-24T00:29:07.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.992+0000 7f1b3a36a700 1 -- start start 2023-10-24T00:29:07.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b3a36a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b340aa010 0x7f1b340c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b3a36a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 0x7f1b340aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:07.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b3a36a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b340c0960 con 0x7f1b34158770 2023-10-24T00:29:07.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b3a36a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b340aa8e0 con 0x7f1b340aa010 2023-10-24T00:29:07.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b3a36a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340c0c40 con 0x7f1b340c6710 2023-10-24T00:29:07.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b340aa010 0x7f1b340c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b340aa010 0x7f1b340c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53284/0 (socket says 172.21.15.148:53284) 2023-10-24T00:29:07.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 -- 172.21.15.148:0/1023850260 learned_addr learned my addr 172.21.15.148:0/1023850260 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:07.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 0x7f1b340aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:07.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 -- 172.21.15.148:0/1023850260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 msgr2=0x7f1b340aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:07.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 0x7f1b340aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:07.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 -- 172.21.15.148:0/1023850260 >> v1:172.21.15.150:6789/0 conn(0x7f1b34158770 legacy=0x7f1b34069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:07.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 -- 172.21.15.148:0/1023850260 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340c0f20 con 0x7f1b340aa010 2023-10-24T00:29:07.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 0x7f1b340aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:07.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.993+0000 7f1b33fff700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340c1a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f1b24006fd0 tx=0x7f1b240090f0).ready entity=mon.0 client_cookie=85f14b49b148b4ae server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b32ffd700 1 -- 172.21.15.148:0/1023850260 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400b600 con 0x7f1b340aa010 2023-10-24T00:29:08.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b32ffd700 1 -- 172.21.15.148:0/1023850260 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400b760 con 0x7f1b340aa010 2023-10-24T00:29:08.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b32ffd700 1 -- 172.21.15.148:0/1023850260 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400bae0 con 0x7f1b340aa010 2023-10-24T00:29:08.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1023850260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 msgr2=0x7f1b340c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340c1a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f1b24006fd0 tx=0x7f1b240090f0).stop 2023-10-24T00:29:08.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1023850260 shutdown_connections 2023-10-24T00:29:08.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340c1a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1023850260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b340c6710 0x7f1b340aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1023850260 >> 172.21.15.148:0/1023850260 conn(0x7f1b340caf40 msgr2=0x7f1b340cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1023850260 shutdown_connections 2023-10-24T00:29:08.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.994+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1023850260 wait complete. 2023-10-24T00:29:08.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.995+0000 7f1b3a36a700 1 Processor -- start 2023-10-24T00:29:08.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.995+0000 7f1b3a36a700 1 -- start start 2023-10-24T00:29:08.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 0x7f1b34152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 0x7f1b34156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340aded0 con 0x7f1b340aa010 2023-10-24T00:29:08.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340ae1b0 con 0x7f1b340c6710 2023-10-24T00:29:08.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b3a36a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b34155750 con 0x7f1b34158770 2023-10-24T00:29:08.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53296/0 (socket says 172.21.15.148:53296) 2023-10-24T00:29:08.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 -- 172.21.15.148:0/1889989618 learned_addr learned my addr 172.21.15.148:0/1889989618 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b38907700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 0x7f1b34156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 0x7f1b34152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 -- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 msgr2=0x7f1b34156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 0x7f1b34156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 -- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 msgr2=0x7f1b34152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 0x7f1b34152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b33fff700 1 -- 172.21.15.148:0/1889989618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009370 con 0x7f1b340aa010 2023-10-24T00:29:08.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.996+0000 7f1b38907700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 0x7f1b34156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:08.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 0x7f1b34152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:08.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b33fff700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1b24009f50 tx=0x7f1b24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400bae0 con 0x7f1b340aa010 2023-10-24T00:29:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24000c90 con 0x7f1b340aa010 2023-10-24T00:29:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b34155a30 con 0x7f1b340aa010 2023-10-24T00:29:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401c670 con 0x7f1b340aa010 2023-10-24T00:29:08.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.997+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b340b0690 con 0x7f1b340aa010 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.998+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3406c6b0 con 0x7f1b340aa010 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.998+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b2401ca20 con 0x7f1b340aa010 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.998+0000 7f1b2bfff700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 0x7f1b14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.999+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b2407baf0 con 0x7f1b340aa010 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.999+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 0x7f1b14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:07.999+0000 7f1b337fe700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 0x7f1b14061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b340a9cc0 tx=0x7f1b1c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.003+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b2404cdc0 con 0x7f1b340aa010 2023-10-24T00:29:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.165+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b340c1200 con 0x7f1b340aa010 2023-10-24T00:29:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.166+0000 7f1b2bfff700 1 -- 172.21.15.148:0/1889989618 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f1b24020070 con 0x7f1b340aa010 2023-10-24T00:29:08.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:08.168 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 msgr2=0x7f1b14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 0x7f1b14061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1b340a9cc0 tx=0x7f1b1c008040).stop 2023-10-24T00:29:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 msgr2=0x7f1b340b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1b24009f50 tx=0x7f1b24017000).stop 2023-10-24T00:29:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 shutdown_connections 2023-10-24T00:29:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b34158770 0x7f1b34156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b1405f150 0x7f1b14061610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b340aa010 0x7f1b340b01a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 --2- 172.21.15.148:0/1889989618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b340c6710 0x7f1b34152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 >> 172.21.15.148:0/1889989618 conn(0x7f1b340caf40 msgr2=0x7f1b340c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 shutdown_connections 2023-10-24T00:29:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.168+0000 7f1b3a36a700 1 -- 172.21.15.148:0/1889989618 wait complete. 2023-10-24T00:29:08.181 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:08.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:08.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.299+0000 7f9a89966700 1 Processor -- start 2023-10-24T00:29:08.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.299+0000 7f9a89966700 1 -- start start 2023-10-24T00:29:08.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a84154430 0x7f9a84154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a84098bd0 0x7f9a840c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a840bffd0 0x7f9a840c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840c0970 con 0x7f9a840bffd0 2023-10-24T00:29:08.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840c71d0 con 0x7f9a84154430 2023-10-24T00:29:08.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a89966700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840c9410 con 0x7f9a84098bd0 2023-10-24T00:29:08.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a840bffd0 0x7f9a840c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9a840bffd0 0x7f9a840c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53302/0 (socket says 172.21.15.148:53302) 2023-10-24T00:29:08.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 -- 172.21.15.148:0/2588370313 learned_addr learned my addr 172.21.15.148:0/2588370313 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a7bfff700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a84098bd0 0x7f9a840c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a82ffd700 1 --2- 172.21.15.148:0/2588370313 >> v2:172.21.15.150:3300/0 conn(0x7f9a84154430 0x7f9a84154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 -- 172.21.15.148:0/2588370313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a84098bd0 msgr2=0x7f9a840c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a84098bd0 0x7f9a840c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 -- 172.21.15.148:0/2588370313 >> v2:172.21.15.150:3300/0 conn(0x7f9a84154430 msgr2=0x7f9a84154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 --2- 172.21.15.148:0/2588370313 >> v2:172.21.15.150:3300/0 conn(0x7f9a84154430 0x7f9a84154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 -- 172.21.15.148:0/2588370313 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840c6c10 con 0x7f9a840bffd0 2023-10-24T00:29:08.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a837fe700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a840bffd0 0x7f9a840c0480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9a7c009f20 tx=0x7f9a7c009840).ready entity=mon.0 client_cookie=f1a81ba4e0c136b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a827fc700 1 -- 172.21.15.148:0/2588370313 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00e070 con 0x7f9a840bffd0 2023-10-24T00:29:08.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a827fc700 1 -- 172.21.15.148:0/2588370313 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c00b930 con 0x7f9a840bffd0 2023-10-24T00:29:08.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.300+0000 7f9a827fc700 1 -- 172.21.15.148:0/2588370313 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00bcb0 con 0x7f9a840bffd0 2023-10-24T00:29:08.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 -- 172.21.15.148:0/2588370313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a840bffd0 msgr2=0x7f9a840c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a840bffd0 0x7f9a840c0480 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9a7c009f20 tx=0x7f9a7c009840).stop 2023-10-24T00:29:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 -- 172.21.15.148:0/2588370313 shutdown_connections 2023-10-24T00:29:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a840bffd0 0x7f9a840c0480 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 --2- 172.21.15.148:0/2588370313 >> v2:172.21.15.150:3300/0 conn(0x7f9a84154430 0x7f9a84154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 --2- 172.21.15.148:0/2588370313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a84098bd0 0x7f9a840c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 -- 172.21.15.148:0/2588370313 >> 172.21.15.148:0/2588370313 conn(0x7f9a840cb070 msgr2=0x7f9a840cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 -- 172.21.15.148:0/2588370313 shutdown_connections 2023-10-24T00:29:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.301+0000 7f9a89966700 1 -- 172.21.15.148:0/2588370313 wait complete. 2023-10-24T00:29:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.302+0000 7f9a89966700 1 Processor -- start 2023-10-24T00:29:08.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.302+0000 7f9a89966700 1 -- start start 2023-10-24T00:29:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a840bffd0 0x7f9a840acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a84154430 0x7f9a84151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840aacb0 con 0x7f9a84098bd0 2023-10-24T00:29:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840ad2c0 con 0x7f9a84154430 2023-10-24T00:29:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a89966700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a841524b0 con 0x7f9a840bffd0 2023-10-24T00:29:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53306/0 (socket says 172.21.15.148:53306) 2023-10-24T00:29:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 -- 172.21.15.148:0/3131847309 learned_addr learned my addr 172.21.15.148:0/3131847309 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a837fe700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a84154430 0x7f9a84151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a7bfff700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a840bffd0 0x7f9a840acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 -- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a840bffd0 msgr2=0x7f9a840acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a840bffd0 0x7f9a840acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 -- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a84154430 msgr2=0x7f9a84151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a84154430 0x7f9a84151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 -- 172.21.15.148:0/3131847309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c009ae0 con 0x7f9a84098bd0 2023-10-24T00:29:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.303+0000 7f9a82ffd700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9a7400e900 tx=0x7f9a74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.304+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74012600 con 0x7f9a84098bd0 2023-10-24T00:29:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.304+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74012760 con 0x7f9a84098bd0 2023-10-24T00:29:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.304+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a84151c10 con 0x7f9a84098bd0 2023-10-24T00:29:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.304+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74012ae0 con 0x7f9a84098bd0 2023-10-24T00:29:08.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.304+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a841521d0 con 0x7f9a84098bd0 2023-10-24T00:29:08.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.305+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a840aaa80 con 0x7f9a84098bd0 2023-10-24T00:29:08.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.305+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9a7401b400 con 0x7f9a84098bd0 2023-10-24T00:29:08.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.305+0000 7f9a7affd700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 0x7f9a64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.305+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9a7407a4e0 con 0x7f9a84098bd0 2023-10-24T00:29:08.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.305+0000 7f9a7bfff700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 0x7f9a64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.306+0000 7f9a7bfff700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 0x7f9a64061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9a84150960 tx=0x7f9a6c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.310+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9a840aaa80 con 0x7f9a84098bd0 2023-10-24T00:29:08.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.472+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9a840aaa80 con 0x7f9a84098bd0 2023-10-24T00:29:08.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.472+0000 7f9a7affd700 1 -- 172.21.15.148:0/3131847309 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9a840aaa80 con 0x7f9a84098bd0 2023-10-24T00:29:08.474 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:08.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 msgr2=0x7f9a64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 0x7f9a64061610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9a84150960 tx=0x7f9a6c009060).stop 2023-10-24T00:29:08.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 msgr2=0x7f9a84153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9a7400e900 tx=0x7f9a74009060).stop 2023-10-24T00:29:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 shutdown_connections 2023-10-24T00:29:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a84154430 0x7f9a84151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9a6405f150 0x7f9a64061610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9a84098bd0 0x7f9a84153990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 --2- 172.21.15.148:0/3131847309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a840bffd0 0x7f9a840acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 >> 172.21.15.148:0/3131847309 conn(0x7f9a840cb070 msgr2=0x7f9a840ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 shutdown_connections 2023-10-24T00:29:08.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.474+0000 7f9a89966700 1 -- 172.21.15.148:0/3131847309 wait complete. 2023-10-24T00:29:08.488 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:08.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.603+0000 7f350f8f9700 1 Processor -- start 2023-10-24T00:29:08.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.603+0000 7f350f8f9700 1 -- start start 2023-10-24T00:29:08.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350f8f9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35080c06e0 0x7f3508154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350f8f9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080c71d0 con 0x7f3508154430 2023-10-24T00:29:08.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350f8f9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080c9410 con 0x7f3508098bd0 2023-10-24T00:29:08.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350f8f9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080c6a10 con 0x7f35080c06e0 2023-10-24T00:29:08.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350d695700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3508154430 0x7f35080c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57562/0 (socket says 172.21.15.148:57562) 2023-10-24T00:29:08.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.604+0000 7f350d695700 1 -- 172.21.15.148:0/1545501022 learned_addr learned my addr 172.21.15.148:0/1545501022 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:08.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 --2- 172.21.15.148:0/1545501022 >> v2:172.21.15.150:3300/0 conn(0x7f35080c06e0 0x7f3508154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394343676 0 0) 0x7f35080c71d0 con 0x7f3508154430 2023-10-24T00:29:08.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f00033f0 con 0x7f3508154430 2023-10-24T00:29:08.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4268995407 0 0) 0x7f34f00033f0 con 0x7f3508154430 2023-10-24T00:29:08.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 >> v2:172.21.15.150:3300/0 conn(0x7f35080c06e0 msgr2=0x7f3508154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 --2- 172.21.15.148:0/1545501022 >> v2:172.21.15.150:3300/0 conn(0x7f35080c06e0 0x7f3508154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 >> v1:172.21.15.150:6789/0 conn(0x7f3508098bd0 legacy=0x7f35080bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080ca8b0 con 0x7f3508154430 2023-10-24T00:29:08.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f34f8001470 con 0x7f3508154430 2023-10-24T00:29:08.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 >> v1:172.21.15.148:6789/0 conn(0x7f3508154430 legacy=0x7f35080c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34f00038e0 0x7f34f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34f0004690 0x7f34f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f34f000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080c6a10 con 0x7f34f0005000 2023-10-24T00:29:08.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f000bf60 con 0x7f34f0004690 2023-10-24T00:29:08.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f000c0f0 con 0x7f34f00038e0 2023-10-24T00:29:08.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f34f000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350d695700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34f00038e0 0x7f34f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350ce94700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34f0004690 0x7f34f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 -- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34f00038e0 msgr2=0x7f34f0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34f00038e0 0x7f34f0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 -- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34f0004690 msgr2=0x7f34f0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34f0004690 0x7f34f0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 -- 172.21.15.148:0/1545501022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00033f0 con 0x7f34f0005000 2023-10-24T00:29:08.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 -- 172.21.15.148:0/1545501022 reap_dead start 2023-10-24T00:29:08.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.605+0000 7f350de96700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f34f000b8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f35080c93c0 tx=0x7f350000b040).ready entity=mon.0 client_cookie=91afa043fbc980a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500009ac0 con 0x7f34f0005000 2023-10-24T00:29:08.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000f040 con 0x7f34f0005000 2023-10-24T00:29:08.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f3507fff700 1 -- 172.21.15.148:0/1545501022 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000ece0 con 0x7f34f0005000 2023-10-24T00:29:08.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 -- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 msgr2=0x7f34f000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f34f000b8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f35080c93c0 tx=0x7f350000b040).stop 2023-10-24T00:29:08.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 -- 172.21.15.148:0/1545501022 shutdown_connections 2023-10-24T00:29:08.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 --2- 172.21.15.148:0/1545501022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f34f000b8e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 -- 172.21.15.148:0/1545501022 >> 172.21.15.148:0/1545501022 conn(0x7f35080cb070 msgr2=0x7f35080cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 -- 172.21.15.148:0/1545501022 shutdown_connections 2023-10-24T00:29:08.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.606+0000 7f350f8f9700 1 -- 172.21.15.148:0/1545501022 wait complete. 2023-10-24T00:29:08.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.607+0000 7f350f8f9700 1 Processor -- start 2023-10-24T00:29:08.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.607+0000 7f350f8f9700 1 -- start start 2023-10-24T00:29:08.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 0x7f3508164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 0x7f350815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3508152fb0 con 0x7f34f0005000 2023-10-24T00:29:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350815abc0 con 0x7f350815a270 2023-10-24T00:29:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350f8f9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35081523e0 con 0x7f350814f150 2023-10-24T00:29:08.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350d695700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350d695700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53316/0 (socket says 172.21.15.148:53316) 2023-10-24T00:29:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350d695700 1 -- 172.21.15.148:0/364755458 learned_addr learned my addr 172.21.15.148:0/364755458 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350ce94700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 0x7f3508164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.608+0000 7f350de96700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 0x7f350815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 -- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 msgr2=0x7f3508164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 0x7f3508164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 -- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 msgr2=0x7f350815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 0x7f350815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 -- 172.21.15.148:0/364755458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508152680 con 0x7f34f0005000 2023-10-24T00:29:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350de96700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 0x7f350815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350ce94700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 0x7f3508164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:08.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350d695700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f34f8001c00 tx=0x7f35080caa40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8001470 con 0x7f34f0005000 2023-10-24T00:29:08.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8004e20 con 0x7f34f0005000 2023-10-24T00:29:08.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3508152960 con 0x7f34f0005000 2023-10-24T00:29:08.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f800fb70 con 0x7f34f0005000 2023-10-24T00:29:08.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.609+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350814f5d0 con 0x7f34f0005000 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.610+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3508152e00 con 0x7f34f0005000 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.610+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f34f801d3b0 con 0x7f34f0005000 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.610+0000 7f35057fa700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 0x7f34f4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.611+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f34f8079c00 con 0x7f34f0005000 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.611+0000 7f350ce94700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 0x7f34f4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.611+0000 7f350ce94700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 0x7f34f4061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f34fc007cc0 tx=0x7f34fc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.614+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f34f8080080 con 0x7f34f0005000 2023-10-24T00:29:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.780+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f350806c6b0 con 0x7f34f0005000 2023-10-24T00:29:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.781+0000 7f35057fa700 1 -- 172.21.15.148:0/364755458 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34f8019030 con 0x7f34f0005000 2023-10-24T00:29:08.783 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 msgr2=0x7f34f4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 0x7f34f4061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f34fc007cc0 tx=0x7f34fc009040).stop 2023-10-24T00:29:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 msgr2=0x7f3508153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f34f8001c00 tx=0x7f35080caa40).stop 2023-10-24T00:29:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 shutdown_connections 2023-10-24T00:29:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f350815a270 0x7f350815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34f405f150 0x7f34f4061610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.782+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34f0005000 0x7f3508153440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.783+0000 7f350f8f9700 1 --2- 172.21.15.148:0/364755458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f350814f150 0x7f3508164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.783+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 >> 172.21.15.148:0/364755458 conn(0x7f35080cb070 msgr2=0x7f35080a8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.783+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 shutdown_connections 2023-10-24T00:29:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.783+0000 7f350f8f9700 1 -- 172.21.15.148:0/364755458 wait complete. 2023-10-24T00:29:08.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:08.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.913+0000 7fe20773a700 1 Processor -- start 2023-10-24T00:29:08.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.913+0000 7fe20773a700 1 -- start start 2023-10-24T00:29:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe200154430 0x7fe200154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe200098bd0 0x7fe2000c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2000bffd0 0x7fe2000c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000c71d0 con 0x7fe200154430 2023-10-24T00:29:08.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000c9410 con 0x7fe200098bd0 2023-10-24T00:29:08.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe20773a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000c0950 con 0x7fe2000bffd0 2023-10-24T00:29:08.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe2054d6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe200154430 0x7fe200154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe2054d6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe200154430 0x7fe200154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53324/0 (socket says 172.21.15.148:53324) 2023-10-24T00:29:08.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe2054d6700 1 -- 172.21.15.148:0/3569185830 learned_addr learned my addr 172.21.15.148:0/3569185830 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe205cd7700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2000bffd0 0x7fe2000c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.914+0000 7fe204cd5700 1 --2- 172.21.15.148:0/3569185830 >> v2:172.21.15.150:3300/0 conn(0x7fe200098bd0 0x7fe2000c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 -- 172.21.15.148:0/3569185830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2000bffd0 msgr2=0x7fe2000c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2000bffd0 0x7fe2000c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 -- 172.21.15.148:0/3569185830 >> v2:172.21.15.150:3300/0 conn(0x7fe200098bd0 msgr2=0x7fe2000c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 --2- 172.21.15.148:0/3569185830 >> v2:172.21.15.150:3300/0 conn(0x7fe200098bd0 0x7fe2000c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 -- 172.21.15.148:0/3569185830 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000c6c10 con 0x7fe200154430 2023-10-24T00:29:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe2054d6700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe200154430 0x7fe200154810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fe2000c23b0 tx=0x7fe1f0009840).ready entity=mon.0 client_cookie=98e11970e1189606 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe1fffff700 1 -- 172.21.15.148:0/3569185830 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000e070 con 0x7fe200154430 2023-10-24T00:29:08.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe1fffff700 1 -- 172.21.15.148:0/3569185830 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000ba50 con 0x7fe200154430 2023-10-24T00:29:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe1fffff700 1 -- 172.21.15.148:0/3569185830 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000bdd0 con 0x7fe200154430 2023-10-24T00:29:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 -- 172.21.15.148:0/3569185830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe200154430 msgr2=0x7fe200154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe200154430 0x7fe200154810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fe2000c23b0 tx=0x7fe1f0009840).stop 2023-10-24T00:29:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 -- 172.21.15.148:0/3569185830 shutdown_connections 2023-10-24T00:29:08.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe200154430 0x7fe200154810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 --2- 172.21.15.148:0/3569185830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2000bffd0 0x7fe2000c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 --2- 172.21.15.148:0/3569185830 >> v2:172.21.15.150:3300/0 conn(0x7fe200098bd0 0x7fe2000c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 -- 172.21.15.148:0/3569185830 >> 172.21.15.148:0/3569185830 conn(0x7fe2000cb070 msgr2=0x7fe2000cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.915+0000 7fe20773a700 1 -- 172.21.15.148:0/3569185830 shutdown_connections 2023-10-24T00:29:08.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.916+0000 7fe20773a700 1 -- 172.21.15.148:0/3569185830 wait complete. 2023-10-24T00:29:08.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 Processor -- start 2023-10-24T00:29:08.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 -- start start 2023-10-24T00:29:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe200098bd0 0x7fe2001652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe200154430 0x7fe2000af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001517a0 con 0x7fe2000bffd0 2023-10-24T00:29:08.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000ac290 con 0x7fe200154430 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.917+0000 7fe20773a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200150c20 con 0x7fe200098bd0 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53328/0 (socket says 172.21.15.148:53328) 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 -- 172.21.15.148:0/2290406006 learned_addr learned my addr 172.21.15.148:0/2290406006 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe2054d6700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe200098bd0 0x7fe2001652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe205cd7700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe200154430 0x7fe2000af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 -- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe200098bd0 msgr2=0x7fe2001652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe200098bd0 0x7fe2001652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 -- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe200154430 msgr2=0x7fe2000af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe200154430 0x7fe2000af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 -- 172.21.15.148:0/2290406006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009ae0 con 0x7fe2000bffd0 2023-10-24T00:29:08.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe204cd5700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fe1f400d890 tx=0x7fe1f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4011590 con 0x7fe2000bffd0 2023-10-24T00:29:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f40116f0 con 0x7fe2000bffd0 2023-10-24T00:29:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4011a70 con 0x7fe2000bffd0 2023-10-24T00:29:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200150f00 con 0x7fe2000bffd0 2023-10-24T00:29:08.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.918+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe200151540 con 0x7fe2000bffd0 2023-10-24T00:29:08.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.919+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20006c6b0 con 0x7fe2000bffd0 2023-10-24T00:29:08.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.919+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe1f401c460 con 0x7fe2000bffd0 2023-10-24T00:29:08.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.920+0000 7fe1fd7fa700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 0x7fe1ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:08.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.920+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1f4079eb0 con 0x7fe2000bffd0 2023-10-24T00:29:08.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.920+0000 7fe2054d6700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 0x7fe1ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:08.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.920+0000 7fe2054d6700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 0x7fe1ec061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe2000c23b0 tx=0x7fe1f0009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:08.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:08.924+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe1f404b120 con 0x7fe2000bffd0 2023-10-24T00:29:09.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.087+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2000ac400 con 0x7fe2000bffd0 2023-10-24T00:29:09.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.087+0000 7fe1fd7fa700 1 -- 172.21.15.148:0/2290406006 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2000ac400 con 0x7fe2000bffd0 2023-10-24T00:29:09.090 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:09.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 msgr2=0x7fe1ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 0x7fe1ec061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe2000c23b0 tx=0x7fe1f0009840).stop 2023-10-24T00:29:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 msgr2=0x7fe20014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fe1f400d890 tx=0x7fe1f4008040).stop 2023-10-24T00:29:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 shutdown_connections 2023-10-24T00:29:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe200154430 0x7fe2000af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe200098bd0 0x7fe2001652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1ec05f150 0x7fe1ec061610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 --2- 172.21.15.148:0/2290406006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2000bffd0 0x7fe20014efb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 >> 172.21.15.148:0/2290406006 conn(0x7fe2000cb070 msgr2=0x7fe2000a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 shutdown_connections 2023-10-24T00:29:09.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.089+0000 7fe20773a700 1 -- 172.21.15.148:0/2290406006 wait complete. 2023-10-24T00:29:09.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:09.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.219+0000 7f9b6129c700 1 Processor -- start 2023-10-24T00:29:09.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.219+0000 7f9b6129c700 1 -- start start 2023-10-24T00:29:09.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b6129c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b5c154430 0x7f9b5c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b6129c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b5c0c3790 0x7f9b5c0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b6129c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0bec40 con 0x7f9b5c0c95d0 2023-10-24T00:29:09.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b6129c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0be650 con 0x7f9b5c154430 2023-10-24T00:29:09.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b6129c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0a82c0 con 0x7f9b5c0c3790 2023-10-24T00:29:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.220+0000 7f9b5affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b5c154430 0x7f9b5c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b5c154430 0x7f9b5c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53338/0 (socket says 172.21.15.148:53338) 2023-10-24T00:29:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 -- 172.21.15.148:0/2413912876 learned_addr learned my addr 172.21.15.148:0/2413912876 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5b7fe700 1 --2- 172.21.15.148:0/2413912876 >> v2:172.21.15.150:3300/0 conn(0x7f9b5c0c3790 0x7f9b5c0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 -- 172.21.15.148:0/2413912876 >> v2:172.21.15.150:3300/0 conn(0x7f9b5c0c3790 msgr2=0x7f9b5c0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 --2- 172.21.15.148:0/2413912876 >> v2:172.21.15.150:3300/0 conn(0x7f9b5c0c3790 0x7f9b5c0c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 -- 172.21.15.148:0/2413912876 >> v1:172.21.15.150:6789/0 conn(0x7f9b5c0c95d0 legacy=0x7f9b5c0a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 -- 172.21.15.148:0/2413912876 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0a85a0 con 0x7f9b5c154430 2023-10-24T00:29:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b5affd700 1 --2- 172.21.15.148:0/2413912876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c154810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9b5c0c5910 tx=0x7f9b540090f0).ready entity=mon.0 client_cookie=37593c8029c1fab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b59ffb700 1 -- 172.21.15.148:0/2413912876 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400b520 con 0x7f9b5c154430 2023-10-24T00:29:09.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b59ffb700 1 -- 172.21.15.148:0/2413912876 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400b680 con 0x7f9b5c154430 2023-10-24T00:29:09.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b59ffb700 1 -- 172.21.15.148:0/2413912876 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400ba00 con 0x7f9b5c154430 2023-10-24T00:29:09.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 -- 172.21.15.148:0/2413912876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 msgr2=0x7f9b5c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2413912876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c154810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9b5c0c5910 tx=0x7f9b540090f0).stop 2023-10-24T00:29:09.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 -- 172.21.15.148:0/2413912876 shutdown_connections 2023-10-24T00:29:09.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2413912876 >> v2:172.21.15.150:3300/0 conn(0x7f9b5c0c3790 0x7f9b5c0c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2413912876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c154810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.221+0000 7f9b6129c700 1 -- 172.21.15.148:0/2413912876 >> 172.21.15.148:0/2413912876 conn(0x7f9b5c0630d0 msgr2=0x7f9b5c0c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.222+0000 7f9b6129c700 1 -- 172.21.15.148:0/2413912876 shutdown_connections 2023-10-24T00:29:09.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.222+0000 7f9b6129c700 1 -- 172.21.15.148:0/2413912876 wait complete. 2023-10-24T00:29:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.223+0000 7f9b6129c700 1 Processor -- start 2023-10-24T00:29:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.223+0000 7f9b6129c700 1 -- start start 2023-10-24T00:29:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.223+0000 7f9b6129c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b5c0c3790 0x7f9b5c0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 0x7f9b5c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0adda0 con 0x7f9b5c154430 2023-10-24T00:29:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0ab9d0 con 0x7f9b5c0c95d0 2023-10-24T00:29:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c11b0 con 0x7f9b5c0c3790 2023-10-24T00:29:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53350/0 (socket says 172.21.15.148:53350) 2023-10-24T00:29:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 -- 172.21.15.148:0/2906523397 learned_addr learned my addr 172.21.15.148:0/2906523397 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5a7fc700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 0x7f9b5c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5affd700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b5c0c3790 0x7f9b5c0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 -- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b5c0c3790 msgr2=0x7f9b5c0ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b5c0c3790 0x7f9b5c0ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 -- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 msgr2=0x7f9b5c0ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 0x7f9b5c0ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 -- 172.21.15.148:0/2906523397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009370 con 0x7f9b5c154430 2023-10-24T00:29:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5a7fc700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 0x7f9b5c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b5b7fe700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b4c00e8d0 tx=0x7f9b4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00ee70 con 0x7f9b5c154430 2023-10-24T00:29:09.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00c7f0 con 0x7f9b5c154430 2023-10-24T00:29:09.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c0c1490 con 0x7f9b5c154430 2023-10-24T00:29:09.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00cb70 con 0x7f9b5c154430 2023-10-24T00:29:09.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.224+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c0ae270 con 0x7f9b5c154430 2023-10-24T00:29:09.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.225+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c06c6b0 con 0x7f9b5c154430 2023-10-24T00:29:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.225+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b4c01b400 con 0x7f9b5c154430 2023-10-24T00:29:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.226+0000 7f9b42ffd700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 0x7f9b48061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.226+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9b4c07a700 con 0x7f9b5c154430 2023-10-24T00:29:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.226+0000 7f9b5affd700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 0x7f9b48061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.226+0000 7f9b5affd700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 0x7f9b48061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9b54009130 tx=0x7f9b54017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.230+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b4c04b970 con 0x7f9b5c154430 2023-10-24T00:29:09.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.391+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b5c0c6ad0 con 0x7f9b5c154430 2023-10-24T00:29:09.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.391+0000 7f9b42ffd700 1 -- 172.21.15.148:0/2906523397 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b4c016020 con 0x7f9b5c154430 2023-10-24T00:29:09.393 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 msgr2=0x7f9b48061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 0x7f9b48061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9b54009130 tx=0x7f9b54017000).stop 2023-10-24T00:29:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 msgr2=0x7f9b5c14f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b4c00e8d0 tx=0x7f9b4c009060).stop 2023-10-24T00:29:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 shutdown_connections 2023-10-24T00:29:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4805f150 0x7f9b48061610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b5c154430 0x7f9b5c14f670 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b5c0c3790 0x7f9b5c0ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 --2- 172.21.15.148:0/2906523397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b5c0c95d0 0x7f9b5c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 >> 172.21.15.148:0/2906523397 conn(0x7f9b5c0630d0 msgr2=0x7f9b5c0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 shutdown_connections 2023-10-24T00:29:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.393+0000 7f9b6129c700 1 -- 172.21.15.148:0/2906523397 wait complete. 2023-10-24T00:29:09.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:09.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.520+0000 7ff2e9e45700 1 Processor -- start 2023-10-24T00:29:09.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.520+0000 7ff2e9e45700 1 -- start start 2023-10-24T00:29:09.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e9e45700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2e40c6710 0x7ff2e40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e9e45700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2e40aa3f0 0x7ff2e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e9e45700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e40aa820 con 0x7ff2e40aa010 2023-10-24T00:29:09.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e9e45700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e40c0960 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e9e45700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e40c0c40 con 0x7ff2e40c6710 2023-10-24T00:29:09.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2e40aa3f0 0x7ff2e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff2e40aa3f0 0x7ff2e4069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53352/0 (socket says 172.21.15.148:53352) 2023-10-24T00:29:09.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e3fff700 1 -- 172.21.15.148:0/1105205660 learned_addr learned my addr 172.21.15.148:0/1105205660 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.521+0000 7ff2e2ffd700 1 --2- 172.21.15.148:0/1105205660 >> v2:172.21.15.150:3300/0 conn(0x7ff2e40c6710 0x7ff2e40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e3fff700 1 -- 172.21.15.148:0/1105205660 >> v2:172.21.15.150:3300/0 conn(0x7ff2e40c6710 msgr2=0x7ff2e40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:09.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e3fff700 1 --2- 172.21.15.148:0/1105205660 >> v2:172.21.15.150:3300/0 conn(0x7ff2e40c6710 0x7ff2e40c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e27fc700 1 -- 172.21.15.148:0/1105205660 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779311648 0 0) 0x7ff2e40aa820 con 0x7ff2e40aa010 2023-10-24T00:29:09.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e3fff700 1 -- 172.21.15.148:0/1105205660 >> v1:172.21.15.150:6789/0 conn(0x7ff2e40aa010 legacy=0x7ff2e4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e3fff700 1 -- 172.21.15.148:0/1105205660 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40c0f20 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e3fff700 1 --2- 172.21.15.148:0/1105205660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff2e4157d00 tx=0x7ff2dc009840).ready entity=mon.0 client_cookie=4bba3473acab9829 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e27fc700 1 -- 172.21.15.148:0/1105205660 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e070 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e27fc700 1 -- 172.21.15.148:0/1105205660 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00ba20 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e27fc700 1 -- 172.21.15.148:0/1105205660 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00bda0 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 -- 172.21.15.148:0/1105205660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa3f0 msgr2=0x7ff2e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/1105205660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff2e4157d00 tx=0x7ff2dc009840).stop 2023-10-24T00:29:09.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 -- 172.21.15.148:0/1105205660 shutdown_connections 2023-10-24T00:29:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/1105205660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/1105205660 >> v2:172.21.15.150:3300/0 conn(0x7ff2e40c6710 0x7ff2e40c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 -- 172.21.15.148:0/1105205660 >> 172.21.15.148:0/1105205660 conn(0x7ff2e40caf40 msgr2=0x7ff2e40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 -- 172.21.15.148:0/1105205660 shutdown_connections 2023-10-24T00:29:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.522+0000 7ff2e9e45700 1 -- 172.21.15.148:0/1105205660 wait complete. 2023-10-24T00:29:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 Processor -- start 2023-10-24T00:29:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 -- start start 2023-10-24T00:29:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2e40c6710 0x7ff2e4140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4140f60 con 0x7ff2e40aa010 2023-10-24T00:29:09.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4142b70 con 0x7ff2e40aa3f0 2023-10-24T00:29:09.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.524+0000 7ff2e9e45700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4141f60 con 0x7ff2e40c6710 2023-10-24T00:29:09.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53368/0 (socket says 172.21.15.148:53368) 2023-10-24T00:29:09.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 -- 172.21.15.148:0/510241771 learned_addr learned my addr 172.21.15.148:0/510241771 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e2ffd700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e3fff700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2e40c6710 0x7ff2e4140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 -- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2e40c6710 msgr2=0x7ff2e4140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2e40c6710 0x7ff2e4140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 -- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 msgr2=0x7ff2e4140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 -- 172.21.15.148:0/510241771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009ae0 con 0x7ff2e40aa010 2023-10-24T00:29:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e2ffd700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e37fe700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff2d4001eb0 tx=0x7ff2d4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400f470 con 0x7ff2e40aa010 2023-10-24T00:29:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400f5f0 con 0x7ff2e40aa010 2023-10-24T00:29:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4142240 con 0x7ff2e40aa010 2023-10-24T00:29:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400f9b0 con 0x7ff2e40aa010 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.525+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e4142800 con 0x7ff2e40aa010 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.526+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e4144680 con 0x7ff2e40aa010 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.526+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff2d400fd20 con 0x7ff2e40aa010 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.527+0000 7ff2cb7fe700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 0x7ff2d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.527+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff2d4079710 con 0x7ff2e40aa010 2023-10-24T00:29:09.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.527+0000 7ff2e2ffd700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 0x7ff2d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.527+0000 7ff2e2ffd700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 0x7ff2d0061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff2e40c9250 tx=0x7ff2d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.531+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff2d4048af0 con 0x7ff2e40aa010 2023-10-24T00:29:09.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.732+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2e406c6b0 con 0x7ff2e40aa010 2023-10-24T00:29:09.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.732+0000 7ff2cb7fe700 1 -- 172.21.15.148:0/510241771 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7ff2d404aa90 con 0x7ff2e40aa010 2023-10-24T00:29:09.735 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:09.735 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:09.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 msgr2=0x7ff2d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 0x7ff2d0061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ff2e40c9250 tx=0x7ff2d8008040).stop 2023-10-24T00:29:09.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 msgr2=0x7ff2e4155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff2d4001eb0 tx=0x7ff2d4007c70).stop 2023-10-24T00:29:09.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 shutdown_connections 2023-10-24T00:29:09.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff2e40c6710 0x7ff2e4140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2d005f150 0x7ff2d0061610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2e40aa010 0x7ff2e4155a40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 --2- 172.21.15.148:0/510241771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2e40aa3f0 0x7ff2e4140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 >> 172.21.15.148:0/510241771 conn(0x7ff2e40caf40 msgr2=0x7ff2e41527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 shutdown_connections 2023-10-24T00:29:09.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.734+0000 7ff2e9e45700 1 -- 172.21.15.148:0/510241771 wait complete. 2023-10-24T00:29:09.739 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:09.748 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:09.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.860+0000 7f2ace463700 1 Processor -- start 2023-10-24T00:29:09.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 -- start start 2023-10-24T00:29:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ac80aa010 0x7f2ac80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 0x7f2ac80aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80c0960 con 0x7f2ac8158770 2023-10-24T00:29:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80aa8e0 con 0x7f2ac80aa010 2023-10-24T00:29:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.861+0000 7f2ace463700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80c0c40 con 0x7f2ac80c6710 2023-10-24T00:29:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ac80aa010 0x7f2ac80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ac80aa010 0x7f2ac80c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53384/0 (socket says 172.21.15.148:53384) 2023-10-24T00:29:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 -- 172.21.15.148:0/775938350 learned_addr learned my addr 172.21.15.148:0/775938350 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac77fe700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 0x7f2ac80aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 -- 172.21.15.148:0/775938350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 msgr2=0x7f2ac80aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 0x7f2ac80aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 -- 172.21.15.148:0/775938350 >> v1:172.21.15.150:6789/0 conn(0x7f2ac8158770 legacy=0x7f2ac8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 -- 172.21.15.148:0/775938350 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80c0f20 con 0x7f2ac80aa010 2023-10-24T00:29:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac77fe700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 0x7f2ac80aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac7fff700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80aa010 0x7f2ac80c1a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2ab8006fd0 tx=0x7f2ab80090f0).ready entity=mon.0 client_cookie=74d26c577245d7de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac6ffd700 1 -- 172.21.15.148:0/775938350 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800b600 con 0x7f2ac80aa010 2023-10-24T00:29:09.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac6ffd700 1 -- 172.21.15.148:0/775938350 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800b760 con 0x7f2ac80aa010 2023-10-24T00:29:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.862+0000 7f2ac6ffd700 1 -- 172.21.15.148:0/775938350 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bae0 con 0x7f2ac80aa010 2023-10-24T00:29:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 -- 172.21.15.148:0/775938350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80aa010 msgr2=0x7f2ac80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80aa010 0x7f2ac80c1a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f2ab8006fd0 tx=0x7f2ab80090f0).stop 2023-10-24T00:29:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 -- 172.21.15.148:0/775938350 shutdown_connections 2023-10-24T00:29:09.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80aa010 0x7f2ac80c1a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 --2- 172.21.15.148:0/775938350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80c6710 0x7f2ac80aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 -- 172.21.15.148:0/775938350 >> 172.21.15.148:0/775938350 conn(0x7f2ac80caf40 msgr2=0x7f2ac80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 -- 172.21.15.148:0/775938350 shutdown_connections 2023-10-24T00:29:09.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.863+0000 7f2ace463700 1 -- 172.21.15.148:0/775938350 wait complete. 2023-10-24T00:29:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.864+0000 7f2ace463700 1 Processor -- start 2023-10-24T00:29:09.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.864+0000 7f2ace463700 1 -- start start 2023-10-24T00:29:09.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80aa010 0x7f2ac81441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ac8158770 0x7f2ac8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8157430 con 0x7f2ac80c6710 2023-10-24T00:29:09.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81554f0 con 0x7f2ac8158770 2023-10-24T00:29:09.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81548e0 con 0x7f2ac80aa010 2023-10-24T00:29:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53392/0 (socket says 172.21.15.148:53392) 2023-10-24T00:29:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 -- 172.21.15.148:0/1792734379 learned_addr learned my addr 172.21.15.148:0/1792734379 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac7fff700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80aa010 0x7f2ac81441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2acca00700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ac8158770 0x7f2ac8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 -- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80aa010 msgr2=0x7f2ac81441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80aa010 0x7f2ac81441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 -- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ac8158770 msgr2=0x7f2ac8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ac8158770 0x7f2ac8156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 -- 172.21.15.148:0/1792734379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009370 con 0x7f2ac80c6710 2023-10-24T00:29:09.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ac77fe700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2abc00d860 tx=0x7f2abc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00f520 con 0x7f2ac80c6710 2023-10-24T00:29:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00f680 con 0x7f2ac80c6710 2023-10-24T00:29:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8154bc0 con 0x7f2ac80c6710 2023-10-24T00:29:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00fa00 con 0x7f2ac80c6710 2023-10-24T00:29:09.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.865+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8155180 con 0x7f2ac80c6710 2023-10-24T00:29:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.866+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac806c6b0 con 0x7f2ac80c6710 2023-10-24T00:29:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.867+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2abc0123e0 con 0x7f2ac80c6710 2023-10-24T00:29:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.867+0000 7f2aaffff700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 0x7f2ab4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:09.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.867+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2abc079da0 con 0x7f2ac80c6710 2023-10-24T00:29:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.867+0000 7f2ac7fff700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 0x7f2ab4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.868+0000 7f2ac7fff700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 0x7f2ab4061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2ab800b3c0 tx=0x7f2ab8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:09.871+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2abc04b010 con 0x7f2ac80c6710 2023-10-24T00:29:10.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.034+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ac80c1200 con 0x7f2ac80c6710 2023-10-24T00:29:10.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.035+0000 7f2aaffff700 1 -- 172.21.15.148:0/1792734379 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f2abc04e630 con 0x7f2ac80c6710 2023-10-24T00:29:10.037 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:10.038 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 msgr2=0x7f2ab4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 0x7f2ab4061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2ab800b3c0 tx=0x7f2ab8017000).stop 2023-10-24T00:29:10.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 msgr2=0x7f2ac8156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2abc00d860 tx=0x7f2abc008040).stop 2023-10-24T00:29:10.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 shutdown_connections 2023-10-24T00:29:10.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ac8158770 0x7f2ac8156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ac80aa010 0x7f2ac81441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2ab405f150 0x7f2ab4061610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 --2- 172.21.15.148:0/1792734379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac80c6710 0x7f2ac8156a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.037+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 >> 172.21.15.148:0/1792734379 conn(0x7f2ac80caf40 msgr2=0x7f2ac80c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.038+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 shutdown_connections 2023-10-24T00:29:10.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.038+0000 7f2ace463700 1 -- 172.21.15.148:0/1792734379 wait complete. 2023-10-24T00:29:10.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:10.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:10.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.166+0000 7fa633d77700 1 Processor -- start 2023-10-24T00:29:10.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.166+0000 7fa633d77700 1 -- start start 2023-10-24T00:29:10.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa633d77700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa62c098bd0 0x7fa62c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa633d77700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0c71d0 con 0x7fa62c154430 2023-10-24T00:29:10.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa633d77700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0c9410 con 0x7fa62c0bffd0 2023-10-24T00:29:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa633d77700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c0c6a10 con 0x7fa62c098bd0 2023-10-24T00:29:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631b13700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa62c154430 0x7fa62c0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57568/0 (socket says 172.21.15.148:57568) 2023-10-24T00:29:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631b13700 1 -- 172.21.15.148:0/1471430095 learned_addr learned my addr 172.21.15.148:0/1471430095 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631312700 1 --2- 172.21.15.148:0/1471430095 >> v2:172.21.15.148:3300/0 conn(0x7fa62c098bd0 0x7fa62c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631312700 1 -- 172.21.15.148:0/1471430095 >> v1:172.21.15.150:6789/0 conn(0x7fa62c0bffd0 legacy=0x7fa62c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631312700 1 -- 172.21.15.148:0/1471430095 >> v1:172.21.15.148:6789/0 conn(0x7fa62c154430 legacy=0x7fa62c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa630b11700 1 -- 172.21.15.148:0/1471430095 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060355432 0 0) 0x7fa62c0c71d0 con 0x7fa62c154430 2023-10-24T00:29:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.167+0000 7fa631312700 1 -- 172.21.15.148:0/1471430095 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0ca8b0 con 0x7fa62c098bd0 2023-10-24T00:29:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa631312700 1 --2- 172.21.15.148:0/1471430095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c098bd0 0x7fa62c154810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa61c009760 tx=0x7fa61c009060).ready entity=mon.0 client_cookie=6445213bdbfebccb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa630b11700 1 -- 172.21.15.148:0/1471430095 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00b520 con 0x7fa62c098bd0 2023-10-24T00:29:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa630b11700 1 -- 172.21.15.148:0/1471430095 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00b680 con 0x7fa62c098bd0 2023-10-24T00:29:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa630b11700 1 -- 172.21.15.148:0/1471430095 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00ba00 con 0x7fa62c098bd0 2023-10-24T00:29:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 -- 172.21.15.148:0/1471430095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c098bd0 msgr2=0x7fa62c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 --2- 172.21.15.148:0/1471430095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c098bd0 0x7fa62c154810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fa61c009760 tx=0x7fa61c009060).stop 2023-10-24T00:29:10.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 -- 172.21.15.148:0/1471430095 shutdown_connections 2023-10-24T00:29:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 --2- 172.21.15.148:0/1471430095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c098bd0 0x7fa62c154810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 -- 172.21.15.148:0/1471430095 >> 172.21.15.148:0/1471430095 conn(0x7fa62c0cb070 msgr2=0x7fa62c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 -- 172.21.15.148:0/1471430095 shutdown_connections 2023-10-24T00:29:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.168+0000 7fa633d77700 1 -- 172.21.15.148:0/1471430095 wait complete. 2023-10-24T00:29:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.169+0000 7fa633d77700 1 Processor -- start 2023-10-24T00:29:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.169+0000 7fa633d77700 1 -- start start 2023-10-24T00:29:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 0x7fa62c13c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa62c154430 0x7fa62c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c152400 con 0x7fa62c0bffd0 2023-10-24T00:29:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c13ca80 con 0x7fa62c154430 2023-10-24T00:29:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa633d77700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0c3320 con 0x7fa62c098bd0 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53406/0 (socket says 172.21.15.148:53406) 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 -- 172.21.15.148:0/3095530763 learned_addr learned my addr 172.21.15.148:0/3095530763 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa632314700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa62c154430 0x7fa62c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631b13700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 0x7fa62c13c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 -- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 msgr2=0x7fa62c13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 0x7fa62c13c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 -- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa62c154430 msgr2=0x7fa62c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa62c154430 0x7fa62c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631312700 1 -- 172.21.15.148:0/3095530763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0092a0 con 0x7fa62c0bffd0 2023-10-24T00:29:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.170+0000 7fa631b13700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 0x7fa62c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa631312700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa61c006dd0 tx=0x7fa61c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00b7f0 con 0x7fa62c0bffd0 2023-10-24T00:29:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00b950 con 0x7fa62c0bffd0 2023-10-24T00:29:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c01b660 con 0x7fa62c0bffd0 2023-10-24T00:29:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0ae9e0 con 0x7fa62c0bffd0 2023-10-24T00:29:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.171+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0c2cd0 con 0x7fa62c0bffd0 2023-10-24T00:29:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.172+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c0c2b30 con 0x7fa62c0bffd0 2023-10-24T00:29:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.172+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa61c01ba10 con 0x7fa62c0bffd0 2023-10-24T00:29:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.172+0000 7fa621ffb700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 0x7fa610061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.172+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa61c07bf00 con 0x7fa62c0bffd0 2023-10-24T00:29:10.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.173+0000 7fa631b13700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 0x7fa610061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.173+0000 7fa631b13700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 0x7fa610061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa6280016f0 tx=0x7fa628009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.176+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa62c0c2b30 con 0x7fa62c0bffd0 2023-10-24T00:29:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.339+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa62c0c2b30 con 0x7fa62c0bffd0 2023-10-24T00:29:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.339+0000 7fa621ffb700 1 -- 172.21.15.148:0/3095530763 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa61c028020 con 0x7fa62c0bffd0 2023-10-24T00:29:10.341 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 msgr2=0x7fa610061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 0x7fa610061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa6280016f0 tx=0x7fa628009040).stop 2023-10-24T00:29:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 msgr2=0x7fa62c0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa61c006dd0 tx=0x7fa61c017000).stop 2023-10-24T00:29:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 shutdown_connections 2023-10-24T00:29:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa62c154430 0x7fa62c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa62c098bd0 0x7fa62c13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61005f150 0x7fa610061610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 --2- 172.21.15.148:0/3095530763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa62c0bffd0 0x7fa62c0ae000 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 >> 172.21.15.148:0/3095530763 conn(0x7fa62c0cb070 msgr2=0x7fa62c0a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 shutdown_connections 2023-10-24T00:29:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.341+0000 7fa633d77700 1 -- 172.21.15.148:0/3095530763 wait complete. 2023-10-24T00:29:10.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:10.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.468+0000 7f4590fc3700 1 Processor -- start 2023-10-24T00:29:10.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.468+0000 7f4590fc3700 1 -- start start 2023-10-24T00:29:10.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.469+0000 7f4590fc3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f458c062d60 0x7f458c0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.469+0000 7f4590fc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 0x7f458c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.469+0000 7f4590fc3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c069f60 con 0x7f458c1541d0 2023-10-24T00:29:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.469+0000 7f4590fc3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0bd250 con 0x7f458c062d60 2023-10-24T00:29:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.469+0000 7f4590fc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c069420 con 0x7f458c0be640 2023-10-24T00:29:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f458c062d60 0x7f458c0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f458c062d60 0x7f458c0bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53410/0 (socket says 172.21.15.148:53410) 2023-10-24T00:29:10.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 -- 172.21.15.148:0/3658007055 learned_addr learned my addr 172.21.15.148:0/3658007055 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:10.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f458ad9d700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 0x7f458c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 -- 172.21.15.148:0/3658007055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 msgr2=0x7f458c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:10.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 0x7f458c0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 -- 172.21.15.148:0/3658007055 >> v1:172.21.15.150:6789/0 conn(0x7f458c1541d0 legacy=0x7f458c062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 -- 172.21.15.148:0/3658007055 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c069630 con 0x7f458c062d60 2023-10-24T00:29:10.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f458ad9d700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 0x7f458c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:10.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f4589d9b700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c062d60 0x7f458c0bcc70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4574006fd0 tx=0x7f45740090f0).ready entity=mon.0 client_cookie=15f876e27ea89d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f458959a700 1 -- 172.21.15.148:0/3658007055 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400b600 con 0x7f458c062d60 2023-10-24T00:29:10.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f458959a700 1 -- 172.21.15.148:0/3658007055 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400b760 con 0x7f458c062d60 2023-10-24T00:29:10.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.470+0000 7f458959a700 1 -- 172.21.15.148:0/3658007055 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400bae0 con 0x7f458c062d60 2023-10-24T00:29:10.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 -- 172.21.15.148:0/3658007055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c062d60 msgr2=0x7f458c0bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c062d60 0x7f458c0bcc70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f4574006fd0 tx=0x7f45740090f0).stop 2023-10-24T00:29:10.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 -- 172.21.15.148:0/3658007055 shutdown_connections 2023-10-24T00:29:10.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c0be640 0x7f458c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 --2- 172.21.15.148:0/3658007055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c062d60 0x7f458c0bcc70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 -- 172.21.15.148:0/3658007055 >> 172.21.15.148:0/3658007055 conn(0x7f458c0c7d10 msgr2=0x7f458c0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 -- 172.21.15.148:0/3658007055 shutdown_connections 2023-10-24T00:29:10.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.471+0000 7f4590fc3700 1 -- 172.21.15.148:0/3658007055 wait complete. 2023-10-24T00:29:10.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.472+0000 7f4590fc3700 1 Processor -- start 2023-10-24T00:29:10.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.472+0000 7f4590fc3700 1 -- start start 2023-10-24T00:29:10.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c062d60 0x7f458c1458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458c1541d0 0x7f458c0c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0bfdd0 con 0x7f458c0be640 2023-10-24T00:29:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0c0dd0 con 0x7f458c1541d0 2023-10-24T00:29:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0c1c20 con 0x7f458c062d60 2023-10-24T00:29:10.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53426/0 (socket says 172.21.15.148:53426) 2023-10-24T00:29:10.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 -- 172.21.15.148:0/2401238195 learned_addr learned my addr 172.21.15.148:0/2401238195 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:10.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f458a59c700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c062d60 0x7f458c1458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f458ad9d700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458c1541d0 0x7f458c0c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 -- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c062d60 msgr2=0x7f458c1458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c062d60 0x7f458c1458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 -- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458c1541d0 msgr2=0x7f458c0c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458c1541d0 0x7f458c0c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 -- 172.21.15.148:0/2401238195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574009370 con 0x7f458c0be640 2023-10-24T00:29:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4589d9b700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4574011000 tx=0x7f4574017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400bea0 con 0x7f458c0be640 2023-10-24T00:29:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400b8d0 con 0x7f458c0be640 2023-10-24T00:29:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c0c1010 con 0x7f458c0be640 2023-10-24T00:29:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457401b660 con 0x7f458c0be640 2023-10-24T00:29:10.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.473+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c0c15d0 con 0x7f458c0be640 2023-10-24T00:29:10.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.474+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c06c6b0 con 0x7f458c0be640 2023-10-24T00:29:10.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.475+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f457401b9d0 con 0x7f458c0be640 2023-10-24T00:29:10.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.475+0000 7f45827fc700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 0x7f456c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.475+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f457407b440 con 0x7f458c0be640 2023-10-24T00:29:10.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.475+0000 7f458a59c700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 0x7f456c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.476+0000 7f458a59c700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 0x7f456c0615e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f457c003840 tx=0x7f457c007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.479+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f457404c7b0 con 0x7f458c0be640 2023-10-24T00:29:10.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.642+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f458c152cf0 con 0x7f458c0be640 2023-10-24T00:29:10.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.642+0000 7f45827fc700 1 -- 172.21.15.148:0/2401238195 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f457401f020 con 0x7f458c0be640 2023-10-24T00:29:10.644 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 msgr2=0x7f456c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 0x7f456c0615e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f457c003840 tx=0x7f457c007d40).stop 2023-10-24T00:29:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 msgr2=0x7f458c0bf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4574011000 tx=0x7f4574017000).stop 2023-10-24T00:29:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 shutdown_connections 2023-10-24T00:29:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f458c1541d0 0x7f458c0c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f458c062d60 0x7f458c1458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f456c05f120 0x7f456c0615e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 --2- 172.21.15.148:0/2401238195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f458c0be640 0x7f458c0bf8e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 >> 172.21.15.148:0/2401238195 conn(0x7f458c0c7d10 msgr2=0x7f458c0c7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 shutdown_connections 2023-10-24T00:29:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.644+0000 7f4590fc3700 1 -- 172.21.15.148:0/2401238195 wait complete. 2023-10-24T00:29:10.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:10.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.772+0000 7fa413551700 1 Processor -- start 2023-10-24T00:29:10.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.772+0000 7fa413551700 1 -- start start 2023-10-24T00:29:10.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa413551700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa40c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa413551700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0c71d0 con 0x7fa40c154430 2023-10-24T00:29:10.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa413551700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0c9410 con 0x7fa40c098bd0 2023-10-24T00:29:10.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa413551700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c6a10 con 0x7fa40c0c06e0 2023-10-24T00:29:10.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa4112ed700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa40c154430 0x7fa40c0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57584/0 (socket says 172.21.15.148:57584) 2023-10-24T00:29:10.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.773+0000 7fa4112ed700 1 -- 172.21.15.148:0/1235634606 learned_addr learned my addr 172.21.15.148:0/1235634606 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:10.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa411aee700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa40c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075525846 0 0) 0x7fa40c0c71d0 con 0x7fa40c154430 2023-10-24T00:29:10.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f40033f0 con 0x7fa40c154430 2023-10-24T00:29:10.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443947802 0 0) 0x7fa3f40033f0 con 0x7fa40c154430 2023-10-24T00:29:10.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 msgr2=0x7fa40c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:10.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa40c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 >> v1:172.21.15.150:6789/0 conn(0x7fa40c098bd0 legacy=0x7fa40c0bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0ca8b0 con 0x7fa40c154430 2023-10-24T00:29:10.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fa3fc0017f0 con 0x7fa40c154430 2023-10-24T00:29:10.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 >> v1:172.21.15.148:6789/0 conn(0x7fa40c154430 legacy=0x7fa40c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4003910 0x7fa3f4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3f4004690 0x7fa3f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa3f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0c6a10 con 0x7fa3f4004690 2023-10-24T00:29:10.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f400b8e0 con 0x7fa3f4003910 2023-10-24T00:29:10.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f400ba50 con 0x7fa40c0c06e0 2023-10-24T00:29:10.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3f4004690 0x7fa3f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa4112ed700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4003910 0x7fa3f4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa411aee700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa3f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 -- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 msgr2=0x7fa3f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:10.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa3f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 -- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4003910 msgr2=0x7fa3f4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:10.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4003910 0x7fa3f4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 -- 172.21.15.148:0/1235634606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40033f0 con 0x7fa3f4004690 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa411aee700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c0c06e0 0x7fa3f4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa410aec700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3f4004690 0x7fa3f4004b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa400001820 tx=0x7fa400007b90).ready entity=mon.0 client_cookie=f3ec6107f7fef0a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.774+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400007ea0 con 0x7fa3f4004690 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400012400 con 0x7fa3f4004690 2023-10-24T00:29:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa40bfff700 1 -- 172.21.15.148:0/1235634606 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000127a0 con 0x7fa3f4004690 2023-10-24T00:29:10.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 -- 172.21.15.148:0/1235634606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3f4004690 msgr2=0x7fa3f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 --2- 172.21.15.148:0/1235634606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3f4004690 0x7fa3f4004b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa400001820 tx=0x7fa400007b90).stop 2023-10-24T00:29:10.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa411aee700 1 -- 172.21.15.148:0/1235634606 reap_dead start 2023-10-24T00:29:10.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 -- 172.21.15.148:0/1235634606 shutdown_connections 2023-10-24T00:29:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 -- 172.21.15.148:0/1235634606 >> 172.21.15.148:0/1235634606 conn(0x7fa40c0cb070 msgr2=0x7fa40c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 -- 172.21.15.148:0/1235634606 shutdown_connections 2023-10-24T00:29:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.775+0000 7fa413551700 1 -- 172.21.15.148:0/1235634606 wait complete. 2023-10-24T00:29:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.776+0000 7fa413551700 1 Processor -- start 2023-10-24T00:29:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.776+0000 7fa413551700 1 -- start start 2023-10-24T00:29:10.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4004690 0x7fa40c167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c149ec0 0x7fa40c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c14a340 con 0x7fa40c165a50 2023-10-24T00:29:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c14c8f0 con 0x7fa3f4004690 2023-10-24T00:29:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa413551700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c14cbd0 con 0x7fa40c149ec0 2023-10-24T00:29:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa410aec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa410aec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53434/0 (socket says 172.21.15.148:53434) 2023-10-24T00:29:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa410aec700 1 -- 172.21.15.148:0/1774589467 learned_addr learned my addr 172.21.15.148:0/1774589467 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa4112ed700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4004690 0x7fa40c167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.777+0000 7fa411aee700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c149ec0 0x7fa40c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 -- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c149ec0 msgr2=0x7fa40c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c149ec0 0x7fa40c14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 -- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4004690 msgr2=0x7fa40c167690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4004690 0x7fa40c167690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 -- 172.21.15.148:0/1774589467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0aefd0 con 0x7fa40c165a50 2023-10-24T00:29:10.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa410aec700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa400001e10 tx=0x7fa400016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400007ea0 con 0x7fa40c165a50 2023-10-24T00:29:10.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400011570 con 0x7fa40c165a50 2023-10-24T00:29:10.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0af2b0 con 0x7fa40c165a50 2023-10-24T00:29:10.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000118f0 con 0x7fa40c165a50 2023-10-24T00:29:10.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.778+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c167b80 con 0x7fa40c165a50 2023-10-24T00:29:10.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.779+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c14a2a0 con 0x7fa40c165a50 2023-10-24T00:29:10.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.779+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa400011ce0 con 0x7fa40c165a50 2023-10-24T00:29:10.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.780+0000 7fa4097fa700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 0x7fa3f8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:10.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.780+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa40007ac30 con 0x7fa40c165a50 2023-10-24T00:29:10.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.780+0000 7fa4112ed700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 0x7fa3f8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:10.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.780+0000 7fa4112ed700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 0x7fa3f8061640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3fc001920 tx=0x7fa40c0caa40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:10.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.784+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa40004bf00 con 0x7fa40c165a50 2023-10-24T00:29:10.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.947+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa40c06c6b0 con 0x7fa40c165a50 2023-10-24T00:29:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.947+0000 7fa4097fa700 1 -- 172.21.15.148:0/1774589467 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa40004f520 con 0x7fa40c165a50 2023-10-24T00:29:10.950 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:10.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.949+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 msgr2=0x7fa3f8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.949+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 0x7fa3f8061640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3fc001920 tx=0x7fa40c0caa40).stop 2023-10-24T00:29:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.949+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 msgr2=0x7fa40c1499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.949+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa400001e10 tx=0x7fa400016000).stop 2023-10-24T00:29:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 shutdown_connections 2023-10-24T00:29:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa40c149ec0 0x7fa40c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3f4004690 0x7fa40c167690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3f805f180 0x7fa3f8061640 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 --2- 172.21.15.148:0/1774589467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa40c165a50 0x7fa40c1499d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 >> 172.21.15.148:0/1774589467 conn(0x7fa40c0cb070 msgr2=0x7fa40c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 shutdown_connections 2023-10-24T00:29:10.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:10.950+0000 7fa413551700 1 -- 172.21.15.148:0/1774589467 wait complete. 2023-10-24T00:29:10.963 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:11.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.077+0000 7f3575353700 1 Processor -- start 2023-10-24T00:29:11.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.077+0000 7f3575353700 1 -- start start 2023-10-24T00:29:11.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f3575353700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3570157f80 0x7f35701583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f3575353700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3570062650 0x7f3570062ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f3575353700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700659b0 con 0x7f35700a6b10 2023-10-24T00:29:11.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f3575353700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3570065e40 con 0x7f3570157f80 2023-10-24T00:29:11.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f3575353700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35701588d0 con 0x7f3570062650 2023-10-24T00:29:11.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f356e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3570157f80 0x7f35701583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f356e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3570157f80 0x7f35701583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53444/0 (socket says 172.21.15.148:53444) 2023-10-24T00:29:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.078+0000 7f356e7fc700 1 -- 172.21.15.148:0/920993723 learned_addr learned my addr 172.21.15.148:0/920993723 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356f7fe700 1 --2- 172.21.15.148:0/920993723 >> v2:172.21.15.150:3300/0 conn(0x7f3570062650 0x7f3570062ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356e7fc700 1 -- 172.21.15.148:0/920993723 >> v2:172.21.15.150:3300/0 conn(0x7f3570062650 msgr2=0x7f3570062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356e7fc700 1 --2- 172.21.15.148:0/920993723 >> v2:172.21.15.150:3300/0 conn(0x7f3570062650 0x7f3570062ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356e7fc700 1 -- 172.21.15.148:0/920993723 >> v1:172.21.15.150:6789/0 conn(0x7f35700a6b10 legacy=0x7f35700a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:11.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356e7fc700 1 -- 172.21.15.148:0/920993723 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570064da0 con 0x7f3570157f80 2023-10-24T00:29:11.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356e7fc700 1 --2- 172.21.15.148:0/920993723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f35701583e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3570065920 tx=0x7f35640090f0).ready entity=mon.0 client_cookie=b664560d110c4f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356dffb700 1 -- 172.21.15.148:0/920993723 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400b5a0 con 0x7f3570157f80 2023-10-24T00:29:11.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356dffb700 1 -- 172.21.15.148:0/920993723 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400b700 con 0x7f3570157f80 2023-10-24T00:29:11.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f356dffb700 1 -- 172.21.15.148:0/920993723 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400ba80 con 0x7f3570157f80 2023-10-24T00:29:11.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 -- 172.21.15.148:0/920993723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 msgr2=0x7f35701583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 --2- 172.21.15.148:0/920993723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f35701583e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f3570065920 tx=0x7f35640090f0).stop 2023-10-24T00:29:11.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 -- 172.21.15.148:0/920993723 shutdown_connections 2023-10-24T00:29:11.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 --2- 172.21.15.148:0/920993723 >> v2:172.21.15.150:3300/0 conn(0x7f3570062650 0x7f3570062ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 --2- 172.21.15.148:0/920993723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f35701583e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 -- 172.21.15.148:0/920993723 >> 172.21.15.148:0/920993723 conn(0x7f35700c3f60 msgr2=0x7f35700c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 -- 172.21.15.148:0/920993723 shutdown_connections 2023-10-24T00:29:11.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.079+0000 7f3575353700 1 -- 172.21.15.148:0/920993723 wait complete. 2023-10-24T00:29:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 Processor -- start 2023-10-24T00:29:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 -- start start 2023-10-24T00:29:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3570062650 0x7f3570148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35700a6b10 0x7f3570150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3570151580 con 0x7f3570157f80 2023-10-24T00:29:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3570164990 con 0x7f35700a6b10 2023-10-24T00:29:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.081+0000 7f3575353700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35701657f0 con 0x7f3570062650 2023-10-24T00:29:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53454/0 (socket says 172.21.15.148:53454) 2023-10-24T00:29:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 -- 172.21.15.148:0/1111926079 learned_addr learned my addr 172.21.15.148:0/1111926079 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356effd700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3570062650 0x7f3570148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356e7fc700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35700a6b10 0x7f3570150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 -- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3570062650 msgr2=0x7f3570148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3570062650 0x7f3570148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 -- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35700a6b10 msgr2=0x7f3570150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35700a6b10 0x7f3570150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 -- 172.21.15.148:0/1111926079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564009370 con 0x7f3570157f80 2023-10-24T00:29:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f356f7fe700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f356800c680 tx=0x7f3568008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568010580 con 0x7f3570157f80 2023-10-24T00:29:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35680106e0 con 0x7f3570157f80 2023-10-24T00:29:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568010a60 con 0x7f3570157f80 2023-10-24T00:29:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3570164be0 con 0x7f3570157f80 2023-10-24T00:29:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.082+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35701651a0 con 0x7f3570157f80 2023-10-24T00:29:11.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.083+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357006c6b0 con 0x7f3570157f80 2023-10-24T00:29:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.083+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f356801b460 con 0x7f3570157f80 2023-10-24T00:29:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.084+0000 7f3556ffd700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 0x7f355c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.084+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3568079fe0 con 0x7f3570157f80 2023-10-24T00:29:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.084+0000 7f356effd700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 0x7f355c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.084+0000 7f356effd700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 0x7f355c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f3560003fb0 tx=0x7f3560002530).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.088+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f356804b250 con 0x7f3570157f80 2023-10-24T00:29:11.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.249+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3570065080 con 0x7f3570157f80 2023-10-24T00:29:11.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.250+0000 7f3556ffd700 1 -- 172.21.15.148:0/1111926079 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f356804e870 con 0x7f3570157f80 2023-10-24T00:29:11.252 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:11.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.251+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 msgr2=0x7f355c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.251+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 0x7f355c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f3560003fb0 tx=0x7f3560002530).stop 2023-10-24T00:29:11.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.251+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 msgr2=0x7f3570151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.251+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f356800c680 tx=0x7f3568008040).stop 2023-10-24T00:29:11.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 shutdown_connections 2023-10-24T00:29:11.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f355c05f150 0x7f355c061610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3570157f80 0x7f3570151090 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3570062650 0x7f3570148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 --2- 172.21.15.148:0/1111926079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35700a6b10 0x7f3570150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 >> 172.21.15.148:0/1111926079 conn(0x7f35700c3f60 msgr2=0x7f3570062ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 shutdown_connections 2023-10-24T00:29:11.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.252+0000 7f3575353700 1 -- 172.21.15.148:0/1111926079 wait complete. 2023-10-24T00:29:11.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.377+0000 7f5bf5d0f700 1 Processor -- start 2023-10-24T00:29:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.377+0000 7f5bf5d0f700 1 -- start start 2023-10-24T00:29:11.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5bf5d0f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5bf00aa010 0x7f5bf00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5bf5d0f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00aa820 con 0x7f5bf00c6710 2023-10-24T00:29:11.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5bf5d0f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00c0960 con 0x7f5bf00aa3f0 2023-10-24T00:29:11.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5bf5d0f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00c0c40 con 0x7f5bf00aa010 2023-10-24T00:29:11.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5beeffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5bf00c6710 0x7f5bf0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57592/0 (socket says 172.21.15.148:57592) 2023-10-24T00:29:11.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5beeffd700 1 -- 172.21.15.148:0/2432213283 learned_addr learned my addr 172.21.15.148:0/2432213283 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:11.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.378+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2432213283 >> v2:172.21.15.150:3300/0 conn(0x7f5bf00aa010 0x7f5bf00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645768998 0 0) 0x7f5bf00aa820 con 0x7f5bf00c6710 2023-10-24T00:29:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80033f0 con 0x7f5bf00c6710 2023-10-24T00:29:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bef7fe700 1 -- 172.21.15.148:0/2432213283 >> v1:172.21.15.150:6789/0 conn(0x7f5bf00aa3f0 legacy=0x7f5bf0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782790975 0 0) 0x7f5bf00c0960 con 0x7f5bf00aa3f0 2023-10-24T00:29:11.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bef7fe700 1 -- 172.21.15.148:0/2432213283 >> v1:172.21.15.148:6789/0 conn(0x7f5bf00c6710 legacy=0x7f5bf0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bef7fe700 1 -- 172.21.15.148:0/2432213283 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00c0f20 con 0x7f5bf00aa010 2023-10-24T00:29:11.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2432213283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00c1a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5be0009760 tx=0x7f5be0009060).ready entity=mon.1 client_cookie=10ff52ec113d0f4e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000f510 con 0x7f5bf00aa010 2023-10-24T00:29:11.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000f670 con 0x7f5bf00aa010 2023-10-24T00:29:11.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bee7fc700 1 -- 172.21.15.148:0/2432213283 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000f9f0 con 0x7f5bf00aa010 2023-10-24T00:29:11.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2432213283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 msgr2=0x7f5bf00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2432213283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00c1a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5be0009760 tx=0x7f5be0009060).stop 2023-10-24T00:29:11.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2432213283 shutdown_connections 2023-10-24T00:29:11.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2432213283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00c1a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2432213283 >> 172.21.15.148:0/2432213283 conn(0x7f5bf00caf40 msgr2=0x7f5bf00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2432213283 shutdown_connections 2023-10-24T00:29:11.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.379+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2432213283 wait complete. 2023-10-24T00:29:11.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 Processor -- start 2023-10-24T00:29:11.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 -- start start 2023-10-24T00:29:11.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 0x7f5bf014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0168e40 con 0x7f5bf00c6710 2023-10-24T00:29:11.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00b02a0 con 0x7f5bf00aa010 2023-10-24T00:29:11.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.381+0000 7f5bf5d0f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00b0c70 con 0x7f5bf00aa3f0 2023-10-24T00:29:11.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53470/0 (socket says 172.21.15.148:53470) 2023-10-24T00:29:11.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 -- 172.21.15.148:0/2847205220 learned_addr learned my addr 172.21.15.148:0/2847205220 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:11.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beeffd700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 0x7f5bf014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 -- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 msgr2=0x7f5bf014ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 0x7f5bf014ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 -- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 msgr2=0x7f5bf00b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 -- 172.21.15.148:0/2847205220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00092a0 con 0x7f5bf00c6710 2023-10-24T00:29:11.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:11.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beeffd700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 0x7f5bf014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:11.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5beffff700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5be8002230 tx=0x7f5be8007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800a580 con 0x7f5bf00c6710 2023-10-24T00:29:11.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800a6e0 con 0x7f5bf00c6710 2023-10-24T00:29:11.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf0168230 con 0x7f5bf00c6710 2023-10-24T00:29:11.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800aa80 con 0x7f5bf00c6710 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.382+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf01687f0 con 0x7f5bf00c6710 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.383+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf00c3200 con 0x7f5bf00c6710 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.383+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5be801b400 con 0x7f5bf00c6710 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.384+0000 7f5bd77fe700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 0x7f5bdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.384+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5be807a130 con 0x7f5bf00c6710 2023-10-24T00:29:11.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.384+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 0x7f5bdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.384+0000 7f5bef7fe700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 0x7f5bdc061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5be0009760 tx=0x7f5be0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.388+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5bf00c3200 con 0x7f5bf00c6710 2023-10-24T00:29:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.592+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bf00c3200 con 0x7f5bf00c6710 2023-10-24T00:29:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.593+0000 7f5bd77fe700 1 -- 172.21.15.148:0/2847205220 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f5bf00c3200 con 0x7f5bf00c6710 2023-10-24T00:29:11.595 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:11.595 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:11.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 msgr2=0x7f5bdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 0x7f5bdc061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f5be0009760 tx=0x7f5be0017000).stop 2023-10-24T00:29:11.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 msgr2=0x7f5bf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5be8002230 tx=0x7f5be8007f70).stop 2023-10-24T00:29:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 shutdown_connections 2023-10-24T00:29:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bdc05f150 0x7f5bdc061610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf00c6710 0x7f5bf0069d80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bf00aa010 0x7f5bf00b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 --2- 172.21.15.148:0/2847205220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bf00aa3f0 0x7f5bf014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 >> 172.21.15.148:0/2847205220 conn(0x7f5bf00caf40 msgr2=0x7f5bf00ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 shutdown_connections 2023-10-24T00:29:11.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.595+0000 7f5bf5d0f700 1 -- 172.21.15.148:0/2847205220 wait complete. 2023-10-24T00:29:11.600 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:11.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.721+0000 7f6194a08700 1 Processor -- start 2023-10-24T00:29:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.721+0000 7f6194a08700 1 -- start start 2023-10-24T00:29:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f6194a08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f61900c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f6194a08700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f61900ca110 0x7f61900c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f6194a08700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61900c6410 con 0x7f61900c0cd0 2023-10-24T00:29:11.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f6194a08700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61900c1160 con 0x7f61900ca110 2023-10-24T00:29:11.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f6194a08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61900ca6e0 con 0x7f61900aa140 2023-10-24T00:29:11.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f61900ca110 0x7f61900c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f61900ca110 0x7f61900c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53482/0 (socket says 172.21.15.148:53482) 2023-10-24T00:29:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 -- 172.21.15.148:0/1379361391 learned_addr learned my addr 172.21.15.148:0/1379361391 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618f7fe700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f61900c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 -- 172.21.15.148:0/1379361391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 msgr2=0x7f61900c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:11.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f61900c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 -- 172.21.15.148:0/1379361391 >> v1:172.21.15.150:6789/0 conn(0x7f61900c0cd0 legacy=0x7f6190157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618effd700 1 -- 172.21.15.148:0/1379361391 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61900ca9c0 con 0x7f61900ca110 2023-10-24T00:29:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.722+0000 7f618f7fe700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f61900c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f618effd700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f61900c07e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f6184006fd0 tx=0x7f61840090f0).ready entity=mon.0 client_cookie=3180ee98495db7a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f618e7fc700 1 -- 172.21.15.148:0/1379361391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400b600 con 0x7f61900ca110 2023-10-24T00:29:11.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f618e7fc700 1 -- 172.21.15.148:0/1379361391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400b760 con 0x7f61900ca110 2023-10-24T00:29:11.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f618e7fc700 1 -- 172.21.15.148:0/1379361391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618400bae0 con 0x7f61900ca110 2023-10-24T00:29:11.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 -- 172.21.15.148:0/1379361391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 msgr2=0x7f61900c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f61900c07e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f6184006fd0 tx=0x7f61840090f0).stop 2023-10-24T00:29:11.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 -- 172.21.15.148:0/1379361391 shutdown_connections 2023-10-24T00:29:11.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f61900c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 --2- 172.21.15.148:0/1379361391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f61900c07e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 -- 172.21.15.148:0/1379361391 >> 172.21.15.148:0/1379361391 conn(0x7f61900944a0 msgr2=0x7f619006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 -- 172.21.15.148:0/1379361391 shutdown_connections 2023-10-24T00:29:11.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.723+0000 7f6194a08700 1 -- 172.21.15.148:0/1379361391 wait complete. 2023-10-24T00:29:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.724+0000 7f6194a08700 1 Processor -- start 2023-10-24T00:29:11.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 -- start start 2023-10-24T00:29:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f619013fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 0x7f619014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900aee10 con 0x7f61900ca110 2023-10-24T00:29:11.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190150220 con 0x7f61900c0cd0 2023-10-24T00:29:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f6194a08700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6190150500 con 0x7f61900aa140 2023-10-24T00:29:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f618ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f618ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53488/0 (socket says 172.21.15.148:53488) 2023-10-24T00:29:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f618ffff700 1 -- 172.21.15.148:0/1311130039 learned_addr learned my addr 172.21.15.148:0/1311130039 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:11.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f618f7fe700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f619013fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.725+0000 7f618effd700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 0x7f619014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 -- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 msgr2=0x7f619013fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f619013fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 -- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 msgr2=0x7f619014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 0x7f619014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 -- 172.21.15.148:0/1311130039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184009370 con 0x7f61900ca110 2023-10-24T00:29:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618effd700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 0x7f619014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f618ffff700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f618800c440 tx=0x7f6188007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800cea0 con 0x7f61900ca110 2023-10-24T00:29:11.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188001e90 con 0x7f61900ca110 2023-10-24T00:29:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61901507e0 con 0x7f61900ca110 2023-10-24T00:29:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800f680 con 0x7f61900ca110 2023-10-24T00:29:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.726+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619013ffc0 con 0x7f61900ca110 2023-10-24T00:29:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.727+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61900aef80 con 0x7f61900ca110 2023-10-24T00:29:11.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.727+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f618800fa70 con 0x7f61900ca110 2023-10-24T00:29:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.727+0000 7f61777fe700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 0x7f617c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.727+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6188079590 con 0x7f61900ca110 2023-10-24T00:29:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.728+0000 7f618f7fe700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 0x7f617c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.728+0000 7f618f7fe700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 0x7f617c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f6180007740 tx=0x7f61800099d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:11.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.731+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6188047af0 con 0x7f61900ca110 2023-10-24T00:29:11.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.895+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6190047480 con 0x7f61900ca110 2023-10-24T00:29:11.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.895+0000 7f61777fe700 1 -- 172.21.15.148:0/1311130039 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f618804a860 con 0x7f61900ca110 2023-10-24T00:29:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:11.898 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:11.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 msgr2=0x7f617c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 0x7f617c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f6180007740 tx=0x7f61800099d0).stop 2023-10-24T00:29:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 msgr2=0x7f619014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f618800c440 tx=0x7f6188007d70).stop 2023-10-24T00:29:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 shutdown_connections 2023-10-24T00:29:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f617c05f150 0x7f617c061610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61900ca110 0x7f619014d890 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61900aa140 0x7f619013fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 --2- 172.21.15.148:0/1311130039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61900c0cd0 0x7f619014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 >> 172.21.15.148:0/1311130039 conn(0x7f61900944a0 msgr2=0x7f61900a7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 shutdown_connections 2023-10-24T00:29:11.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:11.897+0000 7f6194a08700 1 -- 172.21.15.148:0/1311130039 wait complete. 2023-10-24T00:29:11.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:12.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.022+0000 7f0bc9fe3700 1 Processor -- start 2023-10-24T00:29:12.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.022+0000 7f0bc9fe3700 1 -- start start 2023-10-24T00:29:12.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc9fe3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0bc40699d0 0x7f0bc413a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc9fe3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0bc413a7e0 0x7f0bc4065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc9fe3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc413ac70 con 0x7f0bc40695f0 2023-10-24T00:29:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc9fe3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc40c57b0 con 0x7f0bc413a7e0 2023-10-24T00:29:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc9fe3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc40c5a90 con 0x7f0bc40699d0 2023-10-24T00:29:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0bc413a7e0 0x7f0bc4065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0bc413a7e0 0x7f0bc4065fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53494/0 (socket says 172.21.15.148:53494) 2023-10-24T00:29:12.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc3fff700 1 -- 172.21.15.148:0/2323812213 learned_addr learned my addr 172.21.15.148:0/2323812213 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.023+0000 7f0bc2ffd700 1 --2- 172.21.15.148:0/2323812213 >> v2:172.21.15.150:3300/0 conn(0x7f0bc40699d0 0x7f0bc413a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc3fff700 1 -- 172.21.15.148:0/2323812213 >> v2:172.21.15.150:3300/0 conn(0x7f0bc40699d0 msgr2=0x7f0bc413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc3fff700 1 --2- 172.21.15.148:0/2323812213 >> v2:172.21.15.150:3300/0 conn(0x7f0bc40699d0 0x7f0bc413a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc3fff700 1 -- 172.21.15.148:0/2323812213 >> v1:172.21.15.150:6789/0 conn(0x7f0bc40695f0 legacy=0x7f0bc40aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc3fff700 1 -- 172.21.15.148:0/2323812213 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40c5d70 con 0x7f0bc413a7e0 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc3fff700 1 --2- 172.21.15.148:0/2323812213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc413a7e0 0x7f0bc4065fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f0bc406a020 tx=0x7f0bbc009840).ready entity=mon.0 client_cookie=c90dd6d732f37dde server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc27fc700 1 -- 172.21.15.148:0/2323812213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00e070 con 0x7f0bc413a7e0 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc27fc700 1 -- 172.21.15.148:0/2323812213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc00ba20 con 0x7f0bc413a7e0 2023-10-24T00:29:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc27fc700 1 -- 172.21.15.148:0/2323812213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00bda0 con 0x7f0bc413a7e0 2023-10-24T00:29:12.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/2323812213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc413a7e0 msgr2=0x7f0bc4065fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/2323812213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc413a7e0 0x7f0bc4065fb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f0bc406a020 tx=0x7f0bbc009840).stop 2023-10-24T00:29:12.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/2323812213 shutdown_connections 2023-10-24T00:29:12.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/2323812213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc413a7e0 0x7f0bc4065fb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.024+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/2323812213 >> v2:172.21.15.150:3300/0 conn(0x7f0bc40699d0 0x7f0bc413a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.025+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/2323812213 >> 172.21.15.148:0/2323812213 conn(0x7f0bc40641f0 msgr2=0x7f0bc40c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.025+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/2323812213 shutdown_connections 2023-10-24T00:29:12.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.025+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/2323812213 wait complete. 2023-10-24T00:29:12.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.026+0000 7f0bc9fe3700 1 Processor -- start 2023-10-24T00:29:12.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.026+0000 7f0bc9fe3700 1 -- start start 2023-10-24T00:29:12.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bc40699d0 0x7f0bc40a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bc413a7e0 0x7f0bc41389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40a50a0 con 0x7f0bc40695f0 2023-10-24T00:29:12.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40a5380 con 0x7f0bc40699d0 2023-10-24T00:29:12.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40a71a0 con 0x7f0bc413a7e0 2023-10-24T00:29:12.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53502/0 (socket says 172.21.15.148:53502) 2023-10-24T00:29:12.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 -- 172.21.15.148:0/887785939 learned_addr learned my addr 172.21.15.148:0/887785939 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc2ffd700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bc40699d0 0x7f0bc40a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc3fff700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bc413a7e0 0x7f0bc41389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 -- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bc413a7e0 msgr2=0x7f0bc41389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bc413a7e0 0x7f0bc41389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 -- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bc40699d0 msgr2=0x7f0bc40a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bc40699d0 0x7f0bc40a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 -- 172.21.15.148:0/887785939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc009ae0 con 0x7f0bc40695f0 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc37fe700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0bb400c470 tx=0x7f0bb4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4007020 con 0x7f0bc40695f0 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4007180 con 0x7f0bc40695f0 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4007520 con 0x7f0bc40695f0 2023-10-24T00:29:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc40a5810 con 0x7f0bc40695f0 2023-10-24T00:29:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.027+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc4155a30 con 0x7f0bc40695f0 2023-10-24T00:29:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.028+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc406c6b0 con 0x7f0bc40695f0 2023-10-24T00:29:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.029+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0bb40068b0 con 0x7f0bc40695f0 2023-10-24T00:29:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.029+0000 7f0bab7fe700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 0x7f0bb0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.029+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0bb4079480 con 0x7f0bc40695f0 2023-10-24T00:29:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.029+0000 7f0bc2ffd700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 0x7f0bb0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.030+0000 7f0bc2ffd700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 0x7f0bb0061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0bc40be140 tx=0x7f0bb8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.033+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0bb4047af0 con 0x7f0bc40695f0 2023-10-24T00:29:12.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.239+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc4061440 con 0x7f0bc40695f0 2023-10-24T00:29:12.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.239+0000 7f0bab7fe700 1 -- 172.21.15.148:0/887785939 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f0bb404a750 con 0x7f0bc40695f0 2023-10-24T00:29:12.241 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:12.241 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:12.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 msgr2=0x7f0bb0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 0x7f0bb0061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0bc40be140 tx=0x7f0bb8009060).stop 2023-10-24T00:29:12.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 msgr2=0x7f0bc4153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0bb400c470 tx=0x7f0bb4007e00).stop 2023-10-24T00:29:12.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 shutdown_connections 2023-10-24T00:29:12.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bc413a7e0 0x7f0bc41389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bb005f150 0x7f0bb0061610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bc40695f0 0x7f0bc4153f70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 --2- 172.21.15.148:0/887785939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bc40699d0 0x7f0bc40a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 >> 172.21.15.148:0/887785939 conn(0x7f0bc40641f0 msgr2=0x7f0bc413a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 shutdown_connections 2023-10-24T00:29:12.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.241+0000 7f0bc9fe3700 1 -- 172.21.15.148:0/887785939 wait complete. 2023-10-24T00:29:12.245 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:12.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:28:53.185947+0000', 'modified': '2023-10-24T00:28:55.191813+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6837/973806407', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6835', 'nonce': 973806407}, {'type': 'v1', 'addr': '172.21.15.150:6837', 'nonce': 973806407}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:29:12.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:29:12.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-24T00:29:12.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.772+0000 7f427edb7700 1 Processor -- start 2023-10-24T00:29:12.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.772+0000 7f427edb7700 1 -- start start 2023-10-24T00:29:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427edb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 0x7f42780c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427edb7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780c01c0 con 0x7f42780c0b30 2023-10-24T00:29:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427edb7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780c6150 con 0x7f42781547e0 2023-10-24T00:29:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427edb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780aa960 con 0x7f4278154400 2023-10-24T00:29:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427d354700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f42780c0b30 0x7f42780c0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57596/0 (socket says 172.21.15.148:57596) 2023-10-24T00:29:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427d354700 1 -- 172.21.15.148:0/2924102792 learned_addr learned my addr 172.21.15.148:0/2924102792 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427cb53700 1 --2- 172.21.15.148:0/2924102792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 0x7f42780c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689523058 0 0) 0x7f42780c6150 con 0x7f42781547e0 2023-10-24T00:29:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42640033f0 con 0x7f42781547e0 2023-10-24T00:29:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427cb53700 1 -- 172.21.15.148:0/2924102792 >> v1:172.21.15.150:6789/0 conn(0x7f42781547e0 legacy=0x7f42780a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795156263 0 0) 0x7f42780c01c0 con 0x7f42780c0b30 2023-10-24T00:29:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427cb53700 1 -- 172.21.15.148:0/2924102792 >> v1:172.21.15.148:6789/0 conn(0x7f42780c0b30 legacy=0x7f42780c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.773+0000 7f427cb53700 1 -- 172.21.15.148:0/2924102792 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780c66f0 con 0x7f4278154400 2023-10-24T00:29:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427cb53700 1 --2- 172.21.15.148:0/2924102792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 0x7f42780c8310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4270009790 tx=0x7f4270009060).ready entity=mon.2 client_cookie=a4622748be7c2a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000f510 con 0x7f4278154400 2023-10-24T00:29:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000f670 con 0x7f4278154400 2023-10-24T00:29:12.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f42777fe700 1 -- 172.21.15.148:0/2924102792 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000f9f0 con 0x7f4278154400 2023-10-24T00:29:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 -- 172.21.15.148:0/2924102792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 msgr2=0x7f42780c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 --2- 172.21.15.148:0/2924102792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 0x7f42780c8310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4270009790 tx=0x7f4270009060).stop 2023-10-24T00:29:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 -- 172.21.15.148:0/2924102792 shutdown_connections 2023-10-24T00:29:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 --2- 172.21.15.148:0/2924102792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4278154400 0x7f42780c8310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 -- 172.21.15.148:0/2924102792 >> 172.21.15.148:0/2924102792 conn(0x7f42780946a0 msgr2=0x7f427806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 -- 172.21.15.148:0/2924102792 shutdown_connections 2023-10-24T00:29:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.774+0000 7f427edb7700 1 -- 172.21.15.148:0/2924102792 wait complete. 2023-10-24T00:29:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.775+0000 7f427edb7700 1 Processor -- start 2023-10-24T00:29:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 -- start start 2023-10-24T00:29:12.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42780c0b30 0x7f4278168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 0x7f4278152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780b0500 con 0x7f42781547e0 2023-10-24T00:29:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780af100 con 0x7f4278154400 2023-10-24T00:29:12.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427edb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4278168ff0 con 0x7f42780c0b30 2023-10-24T00:29:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427d354700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427d354700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53504/0 (socket says 172.21.15.148:53504) 2023-10-24T00:29:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.776+0000 7f427d354700 1 -- 172.21.15.148:0/1132278199 learned_addr learned my addr 172.21.15.148:0/1132278199 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427cb53700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42780c0b30 0x7f4278168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f4277fff700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 0x7f4278152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 -- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42780c0b30 msgr2=0x7f4278168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42780c0b30 0x7f4278168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 -- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 msgr2=0x7f4278152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 0x7f4278152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 -- 172.21.15.148:0/1132278199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700092a0 con 0x7f42781547e0 2023-10-24T00:29:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f4277fff700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 0x7f4278152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427d354700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4260001eb0 tx=0x7f4260007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f4274ff9700 1 -- 172.21.15.148:0/1132278199 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600072e0 con 0x7f42781547e0 2023-10-24T00:29:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f4274ff9700 1 -- 172.21.15.148:0/1132278199 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260007440 con 0x7f42781547e0 2023-10-24T00:29:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780ae4f0 con 0x7f42781547e0 2023-10-24T00:29:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f4274ff9700 1 -- 172.21.15.148:0/1132278199 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600057a0 con 0x7f42781547e0 2023-10-24T00:29:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.777+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780aeab0 con 0x7f42781547e0 2023-10-24T00:29:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.778+0000 7f4274ff9700 1 -- 172.21.15.148:0/1132278199 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4260005b50 con 0x7f42781547e0 2023-10-24T00:29:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.778+0000 7f4274ff9700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 0x7f4258061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.779+0000 7f4274ff9700 1 -- 172.21.15.148:0/1132278199 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4260079a30 con 0x7f42781547e0 2023-10-24T00:29:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.779+0000 7f427cb53700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 0x7f4258061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.779+0000 7f427cb53700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 0x7f4258061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4270009150 tx=0x7f4270017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 Processor -- start 2023-10-24T00:29:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 -- start start 2023-10-24T00:29:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7dbef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dbae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7d361b0 con 0x5560c7de8190 2023-10-24T00:29:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.781+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7cfbcb0 con 0x5560c7dc1980 2023-10-24T00:29:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560c7d10c90 con 0x5560c7dbeb20 2023-10-24T00:29:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f427cb53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7dbef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53512/0 (socket says 172.21.15.148:53512) 2023-10-24T00:29:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 -- 172.21.15.148:0/3449647833 learned_addr learned my addr 172.21.15.148:0/3449647833 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f427d354700 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dbae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 -- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 msgr2=0x5560c7dbef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7dbef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 -- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 msgr2=0x5560c7dbae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dbae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 -- 172.21.15.148:0/3449647833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560c7d09e70 con 0x5560c7de8190 2023-10-24T00:29:12.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.782+0000 7f4277fff700 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f42780a9dc0 tx=0x7f4268009040).ready entity=mon.0 client_cookie=8ecec14b94afe05a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.783+0000 7f426dffb700 1 -- 172.21.15.148:0/3449647833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268002720 con 0x5560c7de8190 2023-10-24T00:29:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.783+0000 7f426dffb700 1 -- 172.21.15.148:0/3449647833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800f510 con 0x5560c7de8190 2023-10-24T00:29:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.783+0000 7f426dffb700 1 -- 172.21.15.148:0/3449647833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800f890 con 0x5560c7de8190 2023-10-24T00:29:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 -- 172.21.15.148:0/3449647833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 msgr2=0x5560c7dba9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f42780a9dc0 tx=0x7f4268009040).stop 2023-10-24T00:29:12.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 -- 172.21.15.148:0/3449647833 shutdown_connections 2023-10-24T00:29:12.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dbae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7dbef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 --2- 172.21.15.148:0/3449647833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba9a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 -- 172.21.15.148:0/3449647833 >> 172.21.15.148:0/3449647833 conn(0x5560c7b7be40 msgr2=0x5560c7e08ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 -- 172.21.15.148:0/3449647833 shutdown_connections 2023-10-24T00:29:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.784+0000 7f429074fb80 1 -- 172.21.15.148:0/3449647833 wait complete. 2023-10-24T00:29:12.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.785+0000 7f429074fb80 1 -- start start 2023-10-24T00:29:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.785+0000 7f429074fb80 1 Processor -- start 2023-10-24T00:29:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7de3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7de8190 0x5560c7dec290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7d10dd0 con 0x5560c7dc1980 2023-10-24T00:29:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7d11050 con 0x5560c7de8190 2023-10-24T00:29:12.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560c7cdc8d0 con 0x5560c7dbeb20 2023-10-24T00:29:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f429074fb80 10 client.0 ll_register_callbacks cb 0x5560c7d7f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:29:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53524/0 (socket says 172.21.15.148:53524) 2023-10-24T00:29:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 -- 172.21.15.148:0/2247443024 learned_addr learned my addr 172.21.15.148:0/2247443024 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f427cb53700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7de3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f427d354700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7de8190 0x5560c7dec290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 -- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 msgr2=0x5560c7de3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7de3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 -- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7de8190 msgr2=0x5560c7dec290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7de8190 0x5560c7dec290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 -- 172.21.15.148:0/2247443024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640033f0 con 0x5560c7dc1980 2023-10-24T00:29:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4277fff700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4268009010 tx=0x7f4268009040).ready entity=mon.0 client_cookie=6d432bc674d2f333 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.786+0000 7f4256ffd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:29:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.787+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268002250 con 0x5560c7dc1980 2023-10-24T00:29:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.787+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560c7db34e0 con 0x5560c7dc1980 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.787+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f42680023b0 con 0x5560c7dc1980 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4268001740 con 0x5560c7dc1980 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 10 client.4725 fetch_fsmap learned FSMap version 6 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5560c7d05480 con 0x5560c7dc1980 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5560c7db34e0 con 0x5560c7dc1980 2023-10-24T00:29:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f42680018a0 con 0x5560c7dc1980 2023-10-24T00:29:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 10 client.4725 fetch_fsmap finished waiting for FSMap version 6 2023-10-24T00:29:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 10 client.4725 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:29:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 20 client.4725 populate_metadata read hostname 'smithi148' 2023-10-24T00:29:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7dedea0 0x5560c7dee280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 4 client.4725 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:29:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 --> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560c7d894b0 con 0x5560c7dedea0 2023-10-24T00:29:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f427cb53700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7dedea0 0x5560c7dee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f4256ffd700 10 client.4725 ms_handle_connect on v2:172.21.15.150:6835/973806407 2023-10-24T00:29:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.788+0000 7f427cb53700 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7dedea0 0x5560c7dee280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8e361c56cc271391 server_cookie=e3f993139c6b3a1e in_seq=0 out_seq=0 2023-10-24T00:29:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f4256ffd700 1 -- 172.21.15.148:0/2247443024 <== mds.0 v2:172.21.15.150:6835/973806407 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5560c7d894b0 con 0x5560c7dedea0 2023-10-24T00:29:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f4256ffd700 10 client.4725 handle_command_reply: tid=0 2023-10-24T00:29:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 client.4725 shutdown 2023-10-24T00:29:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 msgr2=0x5560c7de7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4268009010 tx=0x7f4268009040).stop 2023-10-24T00:29:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 shutdown_connections 2023-10-24T00:29:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7dedea0 0x5560c7dee280 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7de8190 0x5560c7dec290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7de3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f4256ffd700 0 client.4725 ms_handle_reset on v2:172.21.15.150:6835/973806407 2023-10-24T00:29:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 --2- 172.21.15.148:0/2247443024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dc1980 0x5560c7de7440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 >> 172.21.15.148:0/2247443024 conn(0x5560c7b7be40 msgr2=0x5560c7e05300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 shutdown_connections 2023-10-24T00:29:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.789+0000 7f429074fb80 1 -- 172.21.15.148:0/2247443024 wait complete. 2023-10-24T00:29:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.790+0000 7f429074fb80 20 client.4725 trim_cache size 0 max 16384 2023-10-24T00:29:12.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.806+0000 7f429074fb80 1 Processor -- start 2023-10-24T00:29:12.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.806+0000 7f429074fb80 1 -- start start 2023-10-24T00:29:12.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dc0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7de8190 0x5560c7dbbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7de8630 con 0x5560c7dbeb20 2023-10-24T00:29:12.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7dbf4b0 con 0x5560c7dc1980 2023-10-24T00:29:12.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560c7e05f20 con 0x5560c7de8190 2023-10-24T00:29:12.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53534/0 (socket says 172.21.15.148:53534) 2023-10-24T00:29:12.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 -- 172.21.15.148:0/4241844004 learned_addr learned my addr 172.21.15.148:0/4241844004 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f4277fff700 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dc0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427d354700 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7de8190 0x5560c7dbbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 -- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7de8190 msgr2=0x5560c7dbbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7de8190 0x5560c7dbbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 -- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 msgr2=0x5560c7dc0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dc0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 -- 172.21.15.148:0/4241844004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560c7d051d0 con 0x5560c7dbeb20 2023-10-24T00:29:12.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f427cb53700 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4278084250 tx=0x7f427001d040).ready entity=mon.0 client_cookie=ddadab7cf2f7fd02 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f426e7fc700 1 -- 172.21.15.148:0/4241844004 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427002b040 con 0x5560c7dbeb20 2023-10-24T00:29:12.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f426e7fc700 1 -- 172.21.15.148:0/4241844004 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000f950 con 0x5560c7dbeb20 2023-10-24T00:29:12.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.807+0000 7f426e7fc700 1 -- 172.21.15.148:0/4241844004 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427002f280 con 0x5560c7dbeb20 2023-10-24T00:29:12.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 -- 172.21.15.148:0/4241844004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 msgr2=0x5560c7de5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f4278084250 tx=0x7f427001d040).stop 2023-10-24T00:29:12.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 -- 172.21.15.148:0/4241844004 shutdown_connections 2023-10-24T00:29:12.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7de8190 0x5560c7dbbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7dbeb20 0x5560c7de5bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 --2- 172.21.15.148:0/4241844004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7dc0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 -- 172.21.15.148:0/4241844004 >> 172.21.15.148:0/4241844004 conn(0x5560c7b7be40 msgr2=0x5560c7de79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 -- 172.21.15.148:0/4241844004 shutdown_connections 2023-10-24T00:29:12.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.808+0000 7f429074fb80 1 -- 172.21.15.148:0/4241844004 wait complete. 2023-10-24T00:29:12.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.809+0000 7f429074fb80 1 -- start start 2023-10-24T00:29:12.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.809+0000 7f429074fb80 1 Processor -- start 2023-10-24T00:29:12.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7e69650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7e69b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7de5d70 con 0x5560c7de8190 2023-10-24T00:29:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c7e170a0 con 0x5560c7dc1980 2023-10-24T00:29:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560c7e17380 con 0x5560c7dbeb20 2023-10-24T00:29:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 10 client.0 ll_register_callbacks cb 0x5560c7d7f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:29:12.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53538/0 (socket says 172.21.15.148:53538) 2023-10-24T00:29:12.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 -- 172.21.15.148:0/2836973063 learned_addr learned my addr 172.21.15.148:0/2836973063 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:12.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427cb53700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7e69650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4277fff700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7e69b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 -- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 msgr2=0x5560c7e69650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7e69650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 -- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 msgr2=0x5560c7e69b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:12.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7e69b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 -- 172.21.15.148:0/2836973063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780c66f0 con 0x5560c7de8190 2023-10-24T00:29:12.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4277fff700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7e69b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:12.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f427d354700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f426004e8b0 tx=0x7f426000f000).ready entity=mon.0 client_cookie=5b96053abe0c1899 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:12.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4256ffd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:29:12.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426005e070 con 0x5560c7de8190 2023-10-24T00:29:12.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f426004e080 con 0x5560c7de8190 2023-10-24T00:29:12.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f426800f510 con 0x5560c7de8190 2023-10-24T00:29:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426004a770 con 0x5560c7de8190 2023-10-24T00:29:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 10 client.4731 fetch_fsmap learned FSMap version 6 2023-10-24T00:29:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5560c7b7cf80 con 0x5560c7de8190 2023-10-24T00:29:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.810+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800f510 con 0x5560c7de8190 2023-10-24T00:29:12.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f426004a8d0 con 0x5560c7de8190 2023-10-24T00:29:12.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 10 client.4731 fetch_fsmap finished waiting for FSMap version 6 2023-10-24T00:29:12.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 10 client.4731 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:29:12.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 20 client.4731 populate_metadata read hostname 'smithi148' 2023-10-24T00:29:12.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7de3290 0x5560c7de3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:12.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 4 client.4731 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-10-24T00:29:12.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 --> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5560c7b77ca0 con 0x5560c7de3290 2023-10-24T00:29:12.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f427cb53700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7de3290 0x5560c7de3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:12.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f4256ffd700 10 client.4731 ms_handle_connect on v2:172.21.15.150:6835/973806407 2023-10-24T00:29:12.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f427cb53700 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7de3290 0x5560c7de3670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1508e1e9a02f351 server_cookie=6083cd2c58187df6 in_seq=0 out_seq=0 2023-10-24T00:29:12.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f4256ffd700 1 -- 172.21.15.148:0/2836973063 <== mds.0 v2:172.21.15.150:6835/973806407 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5560c7b77ca0 con 0x5560c7de3290 2023-10-24T00:29:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f4256ffd700 10 client.4731 handle_command_reply: tid=0 2023-10-24T00:29:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 client.4731 shutdown 2023-10-24T00:29:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 msgr2=0x5560c7dba1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f426004e8b0 tx=0x7f426000f000).stop 2023-10-24T00:29:12.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 shutdown_connections 2023-10-24T00:29:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:6835/973806407,v1:172.21.15.150:6837/973806407] conn(0x5560c7de3290 0x5560c7de3670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5560c7de8190 0x5560c7dba1f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5560c7dbeb20 0x5560c7e69650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 --2- 172.21.15.148:0/2836973063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560c7dc1980 0x5560c7e69b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f4256ffd700 0 client.4731 ms_handle_reset on v2:172.21.15.150:6835/973806407 2023-10-24T00:29:12.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.811+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 >> 172.21.15.148:0/2836973063 conn(0x5560c7b7be40 msgr2=0x5560c7dbbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 shutdown_connections 2023-10-24T00:29:12.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f429074fb80 1 -- 172.21.15.148:0/2836973063 wait complete. 2023-10-24T00:29:12.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f429074fb80 20 client.4731 trim_cache size 0 max 16384 2023-10-24T00:29:12.836 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:29:12.836 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:29:12.836 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:29:12.836 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 4278, 2023-10-24T00:29:12.836 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:29:12.837 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:29:12.837 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:29:12.837 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 19.624368543999999, 2023-10-24T00:29:12.837 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 6, 2023-10-24T00:29:12.837 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 22, 2023-10-24T00:29:12.838 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 22, 2023-10-24T00:29:12.838 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 23.900506349 2023-10-24T00:29:12.838 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:29:12.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 msgr2=0x7f4258061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 0x7f4258061610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4270009150 tx=0x7f4270017000).stop 2023-10-24T00:29:12.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 msgr2=0x7f42780af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:12.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4260001eb0 tx=0x7f4260007bb0).stop 2023-10-24T00:29:12.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 shutdown_connections 2023-10-24T00:29:12.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f425805f150 0x7f4258061610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42781547e0 0x7f42780af590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42780c0b30 0x7f4278168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 --2- 172.21.15.148:0/1132278199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4278154400 0x7f4278152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 >> 172.21.15.148:0/1132278199 conn(0x7f42780946a0 msgr2=0x7f42780c0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 shutdown_connections 2023-10-24T00:29:12.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:12.812+0000 7f427edb7700 1 -- 172.21.15.148:0/1132278199 wait complete. 2023-10-24T00:29:12.842 INFO:teuthology.run_tasks:Running task kclient... 2023-10-24T00:29:12.864 INFO:tasks.kclient:Mounting kernel clients... 2023-10-24T00:29:12.865 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-24T00:29:12.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:12.866 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:29:12.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:12.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-24T00:29:12.947 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-24T00:29:12.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:29:12.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:12.950 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:29:13.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-24T00:29:13.070 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-24T00:29:13.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:29:13.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.073 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T00:29:13.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.091 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-10-24T00:29:13.163 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-10-24T00:29:13.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:29:13.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.165 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T00:29:13.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-10-24T00:29:13.292 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-10-24T00:29:13.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T00:29:13.294 INFO:tasks.kclient:client.0 config is {} 2023-10-24T00:29:13.294 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:29:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.396+0000 7f00eea57700 1 Processor -- start 2023-10-24T00:29:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.396+0000 7f00eea57700 1 -- start start 2023-10-24T00:29:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00eea57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 0x7f00e80c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00eea57700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00e8150cb0 0x7f00e8151140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00eea57700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80c38a0 con 0x7f00e8068c60 2023-10-24T00:29:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00eea57700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e8151c80 con 0x7f00e8150cb0 2023-10-24T00:29:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00eea57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e814b150 con 0x7f00e814ad70 2023-10-24T00:29:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00ecff4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00e8150cb0 0x7f00e8151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00ecff4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00e8150cb0 0x7f00e8151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36516/0 (socket says 172.21.15.148:36516) 2023-10-24T00:29:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.397+0000 7f00ecff4700 1 -- 172.21.15.148:0/1522348104 learned_addr learned my addr 172.21.15.148:0/1522348104 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00e7fff700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 0x7f00e80c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00ecff4700 1 -- 172.21.15.148:0/1522348104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 msgr2=0x7f00e80c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00ecff4700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 0x7f00e80c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00ecff4700 1 -- 172.21.15.148:0/1522348104 >> v1:172.21.15.150:6789/0 conn(0x7f00e8068c60 legacy=0x7f00e80690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00ecff4700 1 -- 172.21.15.148:0/1522348104 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e81519a0 con 0x7f00e8150cb0 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00e7fff700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 0x7f00e80c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00ecff4700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e8150cb0 0x7f00e8151140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f00e0009f20 tx=0x7f00e0009840).ready entity=mon.0 client_cookie=cebb43f995edb72a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00e6ffd700 1 -- 172.21.15.148:0/1522348104 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000e070 con 0x7f00e8150cb0 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00e6ffd700 1 -- 172.21.15.148:0/1522348104 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000ba40 con 0x7f00e8150cb0 2023-10-24T00:29:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00e6ffd700 1 -- 172.21.15.148:0/1522348104 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000bdc0 con 0x7f00e8150cb0 2023-10-24T00:29:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.398+0000 7f00eea57700 1 -- 172.21.15.148:0/1522348104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e8150cb0 msgr2=0x7f00e8151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e8150cb0 0x7f00e8151140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f00e0009f20 tx=0x7f00e0009840).stop 2023-10-24T00:29:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 -- 172.21.15.148:0/1522348104 shutdown_connections 2023-10-24T00:29:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e814ad70 0x7f00e80c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 --2- 172.21.15.148:0/1522348104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e8150cb0 0x7f00e8151140 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 -- 172.21.15.148:0/1522348104 >> 172.21.15.148:0/1522348104 conn(0x7f00e80c6b70 msgr2=0x7f00e80c6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 -- 172.21.15.148:0/1522348104 shutdown_connections 2023-10-24T00:29:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.399+0000 7f00eea57700 1 -- 172.21.15.148:0/1522348104 wait complete. 2023-10-24T00:29:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.400+0000 7f00eea57700 1 Processor -- start 2023-10-24T00:29:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.400+0000 7f00eea57700 1 -- start start 2023-10-24T00:29:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e8068c60 0x7f00e8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00e8150cb0 0x7f00e81462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8148180 con 0x7f00e814ad70 2023-10-24T00:29:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e81483d0 con 0x7f00e8150cb0 2023-10-24T00:29:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e81486b0 con 0x7f00e8068c60 2023-10-24T00:29:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36520/0 (socket says 172.21.15.148:36520) 2023-10-24T00:29:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 -- 172.21.15.148:0/80409186 learned_addr learned my addr 172.21.15.148:0/80409186 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e7fff700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e8068c60 0x7f00e8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00ecff4700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00e8150cb0 0x7f00e81462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 -- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e8068c60 msgr2=0x7f00e8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e8068c60 0x7f00e8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 -- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00e8150cb0 msgr2=0x7f00e81462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00e8150cb0 0x7f00e81462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 -- 172.21.15.148:0/80409186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009ae0 con 0x7f00e814ad70 2023-10-24T00:29:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00e77fe700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f00dc00d9f0 tx=0x7f00dc00b270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00e920 con 0x7f00e814ad70 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc012070 con 0x7f00e814ad70 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8148990 con 0x7f00e814ad70 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00eae0 con 0x7f00e814ad70 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.401+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e8148f50 con 0x7f00e814ad70 2023-10-24T00:29:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.402+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e8047480 con 0x7f00e814ad70 2023-10-24T00:29:13.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.403+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f00dc016380 con 0x7f00e814ad70 2023-10-24T00:29:13.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.403+0000 7f00cffff700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 0x7f00d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:13.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.403+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f00dc07bb20 con 0x7f00e814ad70 2023-10-24T00:29:13.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.403+0000 7f00e7fff700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 0x7f00d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:13.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.404+0000 7f00e7fff700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 0x7f00d4061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f00d800ab40 tx=0x7f00d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:13.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.407+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f00dc04cd90 con 0x7f00e814ad70 2023-10-24T00:29:13.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.614+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f00e80c3250 con 0x7f00e814ad70 2023-10-24T00:29:13.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.615+0000 7f00cffff700 1 -- 172.21.15.148:0/80409186 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f00dc01c030 con 0x7f00e814ad70 2023-10-24T00:29:13.616 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:29:13.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 msgr2=0x7f00d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:13.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 0x7f00d4061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f00d800ab40 tx=0x7f00d8008040).stop 2023-10-24T00:29:13.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 msgr2=0x7f00e8149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:13.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f00dc00d9f0 tx=0x7f00dc00b270).stop 2023-10-24T00:29:13.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 shutdown_connections 2023-10-24T00:29:13.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00e8150cb0 0x7f00e81462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00e8068c60 0x7f00e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f00d405f150 0x7f00d4061610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 --2- 172.21.15.148:0/80409186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00e814ad70 0x7f00e8149470 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:13.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 >> 172.21.15.148:0/80409186 conn(0x7f00e80c6b70 msgr2=0x7f00e8065290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:13.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 shutdown_connections 2023-10-24T00:29:13.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:13.617+0000 7f00eea57700 1 -- 172.21.15.148:0/80409186 wait complete. 2023-10-24T00:29:13.629 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-24T00:29:13.629 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:29:13.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:29:13.630 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:29:13.630 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:13.630 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-24T00:29:13.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-24T00:29:13.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:29:13.631 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:29:13.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.631 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:29:13.646 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:13.646 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:13.647 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:13.647 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:13.647 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:13.647 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:13.647 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:13.648 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:13.648 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:29:13.648 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:13.648 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:13.648 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:29:13.649 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-10-24T00:29:13.650 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:29:13.650 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:13.650 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-24T00:29:13.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.651 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:13.651 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:13.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2023-10-24T00:29:13.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2023-10-24T00:29:13.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2023-10-24T00:29:13.653 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-24T00:29:13.653 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:13.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.809 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:29:13.850 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:29:13.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.852 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:29:13.926 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:29:13.926 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:29:13.927 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:29:13.927 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:29:13.927 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:29:13.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:13.928 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:13.928 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:13.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:29:13.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:29:13.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:29:13.929 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:14.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.178 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:29:14.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.194 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-10-24T00:29:14.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.249 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:14.249 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:14.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:29:14.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-24T00:29:14.250 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:14.339 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-24T00:29:14.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.340 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:14.340 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:14.340 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-24T00:29:14.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-24T00:29:14.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-24T00:29:14.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-24T00:29:14.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-24T00:29:14.342 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:14.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.533 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:14.533 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:14.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:29:14.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2023-10-24T00:29:14.534 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:14.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.627 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:14.642 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:29:14.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:14.733 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:14.733 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:14.825 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:14.826 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:14.828 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:29:14.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:14.828 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:14.853 INFO:tasks.kclient:client.2 config is {} 2023-10-24T00:29:14.854 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:29:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.993+0000 7f6e0a117700 1 Processor -- start 2023-10-24T00:29:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 -- start start 2023-10-24T00:29:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e041575e0 0x7f6e040ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 0x7f6e040aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e040ae6c0 con 0x7f6e041579c0 2023-10-24T00:29:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040cae10 con 0x7f6e041575e0 2023-10-24T00:29:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.994+0000 7f6e0a117700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040c94c0 con 0x7f6e040aaae0 2023-10-24T00:29:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e041575e0 0x7f6e040ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e03fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 0x7f6e040aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e041575e0 0x7f6e040ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51890/0 (socket says 172.21.15.148:51890) 2023-10-24T00:29:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e03fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 0x7f6e040aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:50450/0 (socket says 172.21.15.148:50450) 2023-10-24T00:29:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e02ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6e041579c0 0x7f6e040ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:47538/0 (socket says 172.21.15.148:47538) 2023-10-24T00:29:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 -- 172.21.15.148:0/3080196756 learned_addr learned my addr 172.21.15.148:0/3080196756 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 -- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 msgr2=0x7f6e040aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 --2- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 0x7f6e040aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 -- 172.21.15.148:0/3080196756 >> v1:172.21.15.150:6789/0 conn(0x7f6e041579c0 legacy=0x7f6e040ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 -- 172.21.15.148:0/3080196756 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040c8f40 con 0x7f6e041575e0 2023-10-24T00:29:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e027fc700 1 -- 172.21.15.148:0/3080196756 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810323863 0 0) 0x7f6e040ae6c0 con 0x7f6e041579c0 2023-10-24T00:29:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e037fe700 1 --2- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e040ca920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6df4009810 tx=0x7f6df4009060).ready entity=mon.1 client_cookie=df89b1b313bfae2c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e027fc700 1 -- 172.21.15.148:0/3080196756 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4005880 con 0x7f6e041575e0 2023-10-24T00:29:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e027fc700 1 -- 172.21.15.148:0/3080196756 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df40059e0 con 0x7f6e041575e0 2023-10-24T00:29:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.995+0000 7f6e027fc700 1 -- 172.21.15.148:0/3080196756 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4005d60 con 0x7f6e041575e0 2023-10-24T00:29:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 -- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 msgr2=0x7f6e040ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e040ca920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6df4009810 tx=0x7f6df4009060).stop 2023-10-24T00:29:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 -- 172.21.15.148:0/3080196756 shutdown_connections 2023-10-24T00:29:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e040aaae0 0x7f6e040aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3080196756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e040ca920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 -- 172.21.15.148:0/3080196756 >> 172.21.15.148:0/3080196756 conn(0x7f6e04094520 msgr2=0x7f6e0406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 -- 172.21.15.148:0/3080196756 shutdown_connections 2023-10-24T00:29:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.996+0000 7f6e0a117700 1 -- 172.21.15.148:0/3080196756 wait complete. 2023-10-24T00:29:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.997+0000 7f6e0a117700 1 Processor -- start 2023-10-24T00:29:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.997+0000 7f6e0a117700 1 -- start start 2023-10-24T00:29:15.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:15.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e04164c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:15.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e041579c0 0x7f6e04165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e041662c0 con 0x7f6e040aaae0 2023-10-24T00:29:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e041656b0 con 0x7f6e041575e0 2023-10-24T00:29:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e0a117700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04165990 con 0x7f6e041579c0 2023-10-24T00:29:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36536/0 (socket says 172.21.15.148:36536) 2023-10-24T00:29:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 -- 172.21.15.148:0/3667567534 learned_addr learned my addr 172.21.15.148:0/3667567534 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e02ffd700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e04164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e03fff700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e041579c0 0x7f6e04165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 -- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e041579c0 msgr2=0x7f6e04165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e041579c0 0x7f6e04165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 -- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 msgr2=0x7f6e04164c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e04164c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 -- 172.21.15.148:0/3667567534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4009300 con 0x7f6e040aaae0 2023-10-24T00:29:15.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e02ffd700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e04164c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:15.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.998+0000 7f6e037fe700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f6df4009eb0 tx=0x7f6df4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:15.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.999+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400b790 con 0x7f6e040aaae0 2023-10-24T00:29:15.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.999+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df400b8f0 con 0x7f6e040aaae0 2023-10-24T00:29:15.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.999+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e04165c70 con 0x7f6e040aaae0 2023-10-24T00:29:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.999+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400bc70 con 0x7f6e040aaae0 2023-10-24T00:29:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:14.999+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0415a120 con 0x7f6e040aaae0 2023-10-24T00:29:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.000+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e04047480 con 0x7f6e040aaae0 2023-10-24T00:29:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.000+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6df4018070 con 0x7f6e040aaae0 2023-10-24T00:29:15.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.000+0000 7f6deb7fe700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:15.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.000+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6df407b340 con 0x7f6e040aaae0 2023-10-24T00:29:15.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.000+0000 7f6e02ffd700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:15.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.001+0000 7f6e02ffd700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 0x7f6df0061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6df8007fd0 tx=0x7f6df8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:15.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.004+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6df404c610 con 0x7f6e040aaae0 2023-10-24T00:29:15.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.210+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6e0405f6b0 con 0x7f6e040aaae0 2023-10-24T00:29:15.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.210+0000 7f6deb7fe700 1 -- 172.21.15.148:0/3667567534 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6df404fc30 con 0x7f6e040aaae0 2023-10-24T00:29:15.212 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:29:15.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 msgr2=0x7f6df0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 0x7f6df0061610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6df8007fd0 tx=0x7f6df8009040).stop 2023-10-24T00:29:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 msgr2=0x7f6e04094e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f6df4009eb0 tx=0x7f6df4016000).stop 2023-10-24T00:29:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 shutdown_connections 2023-10-24T00:29:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e041579c0 0x7f6e04165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e040aaae0 0x7f6e04094e90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 --2- 172.21.15.148:0/3667567534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e041575e0 0x7f6e04164c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:15.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 >> 172.21.15.148:0/3667567534 conn(0x7f6e04094520 msgr2=0x7f6e04063140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:15.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 shutdown_connections 2023-10-24T00:29:15.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:15.212+0000 7f6e0a117700 1 -- 172.21.15.148:0/3667567534 wait complete. 2023-10-24T00:29:15.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-24T00:29:15.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:29:15.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:29:15.225 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-24T00:29:15.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-24T00:29:15.226 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-24T00:29:15.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-24T00:29:15.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:29:15.227 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-24T00:29:15.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.227 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:29:15.243 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:15.244 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:15.244 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:15.244 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.244 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:15.245 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.245 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:15.245 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:15.245 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:29:15.245 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:15.246 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:15.246 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:29:15.246 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:15.246 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:15.247 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:29:15.247 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:15.247 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:29:15.247 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:29:15.248 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.249 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link tentative 2023-10-24T00:29:15.249 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.249 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:29:15.249 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:29:15.250 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link tentative 2023-10-24T00:29:15.250 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.251 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:29:15.306 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:29:15.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.308 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:29:15.364 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:29:15.365 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:29:15.365 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:29:15.365 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:29:15.365 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:29:15.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.366 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:15.366 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:15.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:29:15.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:29:15.367 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:29:15.367 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:15.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.465 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:29:15.479 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:29:15.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.480 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2023-10-24T00:29:15.535 INFO:teuthology.orchestra.run.smithi148.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-24T00:29:15.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.536 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:15.536 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:15.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:29:15.537 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-24T00:29:15.538 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.624 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-24T00:29:15.658 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:15.658 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:15.659 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:15.659 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.659 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:15.659 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.659 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:29:15.660 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:48:21:d1:42:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-24T00:29:15.660 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-24T00:29:15.660 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.660 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::48:21ff:fed1:426c/64 scope link tentative 2023-10-24T00:29:15.660 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-24T00:29:15.748 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:15.748 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:15.748 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.749 INFO:teuthology.orchestra.run.smithi148.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:29:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 02:48:21:d1:42:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-24T00:29:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-24T00:29:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::48:21ff:fed1:426c/64 scope link tentative 2023-10-24T00:29:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:15.754 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-24T00:29:15.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.755 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:15.755 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:15.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-24T00:29:15.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-24T00:29:15.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-24T00:29:15.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-24T00:29:15.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-24T00:29:15.757 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:15.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:15.974 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:15.974 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:15.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.1 up 2023-10-24T00:29:15.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.1 master ceph-brx 2023-10-24T00:29:15.975 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:16.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.056 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-10-24T00:29:16.071 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:29:16.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:16.150 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:16.151 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:16.176 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:16.176 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:16.178 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:29:16.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-24T00:29:16.242 INFO:tasks.kclient:client.1 config is {} 2023-10-24T00:29:16.243 DEBUG:teuthology.orchestra.run.smithi150:> ceph fs ls 2023-10-24T00:29:16.356 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.355+0000 7f1b420b7700 1 Processor -- start 2023-10-24T00:29:16.357 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.355+0000 7f1b420b7700 1 -- start start 2023-10-24T00:29:16.359 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b420b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:16.359 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b420b7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0c7cb0 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b420b7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0c70a0 con 0x7f1b3c0be8d0 2023-10-24T00:29:16.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b420b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0c3f80 con 0x7f1b3c0a8330 2023-10-24T00:29:16.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:16.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1b3c0be8d0 0x7f1b3c0c33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:59528/0 (socket says 172.21.15.150:59528) 2023-10-24T00:29:16.360 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3affd700 1 -- 172.21.15.150:0/511496101 learned_addr learned my addr 172.21.15.150:0/511496101 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:29:16.361 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3a7fc700 1 -- 172.21.15.150:0/511496101 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233932723 0 0) 0x7f1b3c0c70a0 con 0x7f1b3c0be8d0 2023-10-24T00:29:16.361 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3a7fc700 1 -- 172.21.15.150:0/511496101 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b240033f0 con 0x7f1b3c0be8d0 2023-10-24T00:29:16.361 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3b7fe700 1 -- 172.21.15.150:0/511496101 >> v1:172.21.15.150:6789/0 conn(0x7f1b3c0be8d0 legacy=0x7f1b3c0c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.361 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3b7fe700 1 -- 172.21.15.150:0/511496101 >> v1:172.21.15.148:6789/0 conn(0x7f1b3c0c3ad0 legacy=0x7f1b3c0651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.361 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3b7fe700 1 -- 172.21.15.150:0/511496101 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0c7380 con 0x7f1b3c0a8330 2023-10-24T00:29:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3b7fe700 1 --2- 172.21.15.150:0/511496101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0c8140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1b30009790 tx=0x7f1b30009060).ready entity=mon.2 client_cookie=ac7ee9d04e5805e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3a7fc700 1 -- 172.21.15.150:0/511496101 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000f510 con 0x7f1b3c0a8330 2023-10-24T00:29:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3a7fc700 1 -- 172.21.15.150:0/511496101 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3000f670 con 0x7f1b3c0a8330 2023-10-24T00:29:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.356+0000 7f1b3a7fc700 1 -- 172.21.15.150:0/511496101 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000f9f0 con 0x7f1b3c0a8330 2023-10-24T00:29:16.362 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 -- 172.21.15.150:0/511496101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 msgr2=0x7f1b3c0c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 --2- 172.21.15.150:0/511496101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0c8140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1b30009790 tx=0x7f1b30009060).stop 2023-10-24T00:29:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 -- 172.21.15.150:0/511496101 shutdown_connections 2023-10-24T00:29:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 --2- 172.21.15.150:0/511496101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0c8140 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 -- 172.21.15.150:0/511496101 >> 172.21.15.150:0/511496101 conn(0x7f1b3c062e30 msgr2=0x7f1b3c0c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:16.363 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 -- 172.21.15.150:0/511496101 shutdown_connections 2023-10-24T00:29:16.364 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.357+0000 7f1b420b7700 1 -- 172.21.15.150:0/511496101 wait complete. 2023-10-24T00:29:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.358+0000 7f1b420b7700 1 Processor -- start 2023-10-24T00:29:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.358+0000 7f1b420b7700 1 -- start start 2023-10-24T00:29:16.367 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 0x7f1b3c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 0x7f1b3c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c1675e0 con 0x7f1b3c0be8d0 2023-10-24T00:29:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c164560 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.368 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b420b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c164840 con 0x7f1b3c0a8330 2023-10-24T00:29:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b3b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b3bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 0x7f1b3c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b3b7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:53558/0 (socket says 172.21.15.150:53558) 2023-10-24T00:29:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b3b7fe700 1 -- 172.21.15.150:0/852895378 learned_addr learned my addr 172.21.15.150:0/852895378 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:29:16.369 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.359+0000 7f1b3affd700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 0x7f1b3c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 -- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 msgr2=0x7f1b3c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 -- 172.21.15.150:0/852895378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 msgr2=0x7f1b3c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.370 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 0x7f1b3c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 -- 172.21.15.150:0/852895378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300092a0 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3b7fe700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3affd700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 0x7f1b3c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b3bfff700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 0x7f1b3c0acf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1b340013d0 tx=0x7f1b34001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:16.371 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34010510 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34010670 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c164b20 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340109f0 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.360+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c0ab220 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.372 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.361+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c047480 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.361+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b34012440 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.361+0000 7f1b237fe700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 0x7f1b28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.362+0000 7f1b3b7fe700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 0x7f1b28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:16.373 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.362+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b34079960 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.362+0000 7f1b3b7fe700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 0x7f1b28061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1b300096e0 tx=0x7f1b30017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:16.374 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.366+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b34048af0 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.569+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b3c0c8410 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.571 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.570+0000 7f1b237fe700 1 -- 172.21.15.150:0/852895378 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b3404ac80 con 0x7f1b3c0c3ad0 2023-10-24T00:29:16.572 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:29:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 msgr2=0x7f1b28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 0x7f1b28061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1b300096e0 tx=0x7f1b30017000).stop 2023-10-24T00:29:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 msgr2=0x7f1b3c0acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 0x7f1b3c0acf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1b340013d0 tx=0x7f1b34001530).stop 2023-10-24T00:29:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 shutdown_connections 2023-10-24T00:29:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c0c3ad0 0x7f1b3c0acf30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b3c0a8330 0x7f1b3c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b2805f150 0x7f1b28061610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 --2- 172.21.15.150:0/852895378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b3c0be8d0 0x7f1b3c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 >> 172.21.15.150:0/852895378 conn(0x7f1b3c062e30 msgr2=0x7f1b3c0a5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 shutdown_connections 2023-10-24T00:29:16.575 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:16.571+0000 7f1b420b7700 1 -- 172.21.15.150:0/852895378 wait complete. 2023-10-24T00:29:16.584 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-24T00:29:16.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:29:16.584 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-10-24T00:29:16.584 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-24T00:29:16.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-24T00:29:16.585 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-24T00:29:16.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-24T00:29:16.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:29:16.586 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-24T00:29:16.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.586 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-10-24T00:29:16.601 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:16.601 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:16.602 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:16.602 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:16.602 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:16.602 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:16.603 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:16.603 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:16.603 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-10-24T00:29:16.603 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:16.603 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:16.604 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-10-24T00:29:16.604 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:16.604 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:16.604 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:29:16.604 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:16.605 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:29:16.605 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-10-24T00:29:16.605 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-10-24T00:29:16.605 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:16.605 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-24T00:29:16.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.606 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:16.606 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:16.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-10-24T00:29:16.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-10-24T00:29:16.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-10-24T00:29:16.608 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-24T00:29:16.608 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:16.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.764 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:29:16.807 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-10-24T00:29:16.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.809 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-10-24T00:29:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-10-24T00:29:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:29:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:29:16.835 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:29:16.836 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:29:16.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:16.836 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:16.837 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:16.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:29:16.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:29:16.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:29:16.838 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:17.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.083 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T00:29:17.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.098 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-10-24T00:29:17.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.153 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:17.153 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:17.153 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-24T00:29:17.154 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-24T00:29:17.154 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:17.243 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-24T00:29:17.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.244 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:17.244 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:17.244 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-24T00:29:17.244 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-24T00:29:17.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-24T00:29:17.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-24T00:29:17.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-24T00:29:17.246 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:17.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.433 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:17.433 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:17.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-10-24T00:29:17.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-10-24T00:29:17.434 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:17.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.526 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-10-24T00:29:17.540 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:29:17.541 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:17.638 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:17.638 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:17.728 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:17.729 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:17.731 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:29:17.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:17.731 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-24T00:29:17.755 INFO:tasks.kclient:client.3 config is {} 2023-10-24T00:29:17.756 DEBUG:teuthology.orchestra.run.smithi150:> ceph fs ls 2023-10-24T00:29:17.896 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.894+0000 7fe79dc35700 1 Processor -- start 2023-10-24T00:29:17.897 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.894+0000 7fe79dc35700 1 -- start start 2023-10-24T00:29:17.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe79dc35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 0x7fe7980ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:17.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe79dc35700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7980ae6c0 con 0x7fe7981575e0 2023-10-24T00:29:17.899 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe79dc35700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7980c8f40 con 0x7fe7980aaae0 2023-10-24T00:29:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe79dc35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980cae10 con 0x7fe7981579c0 2023-10-24T00:29:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe796ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 0x7fe7980ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.895+0000 7fe797fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe7980aaae0 0x7fe7980aaf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:59536/0 (socket says 172.21.15.150:59536) 2023-10-24T00:29:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe797fff700 1 -- 172.21.15.150:0/3078687038 learned_addr learned my addr 172.21.15.150:0/3078687038 (peer_addr_for_me v1:172.21.15.150:0/0) 2023-10-24T00:29:17.900 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe7967fc700 1 -- 172.21.15.150:0/3078687038 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128876628 0 0) 0x7fe7980c8f40 con 0x7fe7980aaae0 2023-10-24T00:29:17.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe7967fc700 1 -- 172.21.15.150:0/3078687038 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7800033f0 con 0x7fe7980aaae0 2023-10-24T00:29:17.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe796ffd700 1 -- 172.21.15.150:0/3078687038 >> v1:172.21.15.150:6789/0 conn(0x7fe7980aaae0 legacy=0x7fe7980aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:17.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe796ffd700 1 -- 172.21.15.150:0/3078687038 >> v1:172.21.15.148:6789/0 conn(0x7fe7981575e0 legacy=0x7fe7980ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:17.901 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe796ffd700 1 -- 172.21.15.150:0/3078687038 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980c91e0 con 0x7fe7981579c0 2023-10-24T00:29:17.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe796ffd700 1 --2- 172.21.15.150:0/3078687038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 0x7fe7980ca920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe78c009790 tx=0x7fe78c009060).ready entity=mon.2 client_cookie=a4d8db4b1ee97af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:17.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe7967fc700 1 -- 172.21.15.150:0/3078687038 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00f510 con 0x7fe7981579c0 2023-10-24T00:29:17.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe7967fc700 1 -- 172.21.15.150:0/3078687038 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00f670 con 0x7fe7981579c0 2023-10-24T00:29:17.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.896+0000 7fe7967fc700 1 -- 172.21.15.150:0/3078687038 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00f9f0 con 0x7fe7981579c0 2023-10-24T00:29:17.902 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 -- 172.21.15.150:0/3078687038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 msgr2=0x7fe7980ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 --2- 172.21.15.150:0/3078687038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 0x7fe7980ca920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe78c009790 tx=0x7fe78c009060).stop 2023-10-24T00:29:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 -- 172.21.15.150:0/3078687038 shutdown_connections 2023-10-24T00:29:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 --2- 172.21.15.150:0/3078687038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981579c0 0x7fe7980ca920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 -- 172.21.15.150:0/3078687038 >> 172.21.15.150:0/3078687038 conn(0x7fe798094520 msgr2=0x7fe79806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:17.903 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 -- 172.21.15.150:0/3078687038 shutdown_connections 2023-10-24T00:29:17.904 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.897+0000 7fe79dc35700 1 -- 172.21.15.150:0/3078687038 wait complete. 2023-10-24T00:29:17.906 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.898+0000 7fe79dc35700 1 Processor -- start 2023-10-24T00:29:17.907 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.898+0000 7fe79dc35700 1 -- start start 2023-10-24T00:29:17.907 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:17.907 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:17.907 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7981579c0 0x7fe798096120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:17.907 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798164a40 con 0x7fe7981579c0 2023-10-24T00:29:17.908 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798096900 con 0x7fe7980aaae0 2023-10-24T00:29:17.908 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe79dc35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe798096be0 con 0x7fe7981575e0 2023-10-24T00:29:17.908 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe796ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:17.908 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:17.908 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe796ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:53576/0 (socket says 172.21.15.150:53576) 2023-10-24T00:29:17.909 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe796ffd700 1 -- 172.21.15.150:0/215619131 learned_addr learned my addr 172.21.15.150:0/215619131 (peer_addr_for_me v2:172.21.15.150:0/0) 2023-10-24T00:29:17.909 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54308/0 (socket says 172.21.15.150:54308) 2023-10-24T00:29:17.909 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 -- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 msgr2=0x7fe798164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:17.909 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:17.910 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 -- 172.21.15.150:0/215619131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7981579c0 msgr2=0x7fe798096120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:17.910 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7981579c0 0x7fe798096120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:17.910 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 -- 172.21.15.150:0/215619131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0092a0 con 0x7fe7980aaae0 2023-10-24T00:29:17.910 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe796ffd700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:17.910 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.899+0000 7fe7977fe700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe78800c490 tx=0x7fe788007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:17.911 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.900+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ce90 con 0x7fe7980aaae0 2023-10-24T00:29:17.911 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.900+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78800f470 con 0x7fe7980aaae0 2023-10-24T00:29:17.911 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.900+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7981646d0 con 0x7fe7980aaae0 2023-10-24T00:29:17.911 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.900+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800f810 con 0x7fe7980aaae0 2023-10-24T00:29:17.911 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.900+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7981643c0 con 0x7fe7980aaae0 2023-10-24T00:29:17.912 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.901+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798164d20 con 0x7fe7980aaae0 2023-10-24T00:29:17.912 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.901+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe78800fc00 con 0x7fe7980aaae0 2023-10-24T00:29:17.912 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.901+0000 7fe77f7fe700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 0x7fe7840615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:17.912 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.901+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe788079a20 con 0x7fe7980aaae0 2023-10-24T00:29:17.912 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.901+0000 7fe796ffd700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 0x7fe7840615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:17.913 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.902+0000 7fe796ffd700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 0x7fe7840615e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe7980b00e0 tx=0x7fe78c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:17.913 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:17.905+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe78804acf0 con 0x7fe7980aaae0 2023-10-24T00:29:18.112 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.110+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe798047480 con 0x7fe7980aaae0 2023-10-24T00:29:18.113 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.111+0000 7fe77f7fe700 1 -- 172.21.15.150:0/215619131 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe78804e310 con 0x7fe7980aaae0 2023-10-24T00:29:18.113 INFO:teuthology.orchestra.run.smithi150.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:29:18.114 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 msgr2=0x7fe7840615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:18.115 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 0x7fe7840615e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe7980b00e0 tx=0x7fe78c017000).stop 2023-10-24T00:29:18.115 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 msgr2=0x7fe7980986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:18.115 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe78800c490 tx=0x7fe788007d70).stop 2023-10-24T00:29:18.115 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 shutdown_connections 2023-10-24T00:29:18.116 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe78405f120 0x7fe7840615e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:18.116 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7981579c0 0x7fe798096120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:18.116 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7980aaae0 0x7fe7980986e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:18.116 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 --2- 172.21.15.150:0/215619131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7981575e0 0x7fe798164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:18.116 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 >> 172.21.15.150:0/215619131 conn(0x7fe798094520 msgr2=0x7fe798156420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:18.117 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 shutdown_connections 2023-10-24T00:29:18.117 INFO:teuthology.orchestra.run.smithi150.stderr:2023-10-24T00:29:18.113+0000 7fe79dc35700 1 -- 172.21.15.150:0/215619131 wait complete. 2023-10-24T00:29:18.125 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-24T00:29:18.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:29:18.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-10-24T00:29:18.126 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-24T00:29:18.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-24T00:29:18.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-24T00:29:18.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-24T00:29:18.127 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:29:18.127 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-24T00:29:18.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.128 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-10-24T00:29:18.143 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:18.143 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:18.143 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:18.144 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.144 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:18.144 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.144 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:18.145 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:18.145 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-10-24T00:29:18.145 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:18.145 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:18.145 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-10-24T00:29:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:18.146 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:18.146 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:29:18.146 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:18.146 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 96:e3:1e:34:4f:01 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:18.147 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:29:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::70f8:8bff:fe52:7cde/64 scope link tentative 2023-10-24T00:29:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.148 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:29:18.148 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 96:e3:1e:34:4f:01 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-24T00:29:18.149 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::94e3:1eff:fe34:4f01/64 scope link tentative 2023-10-24T00:29:18.149 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.150 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:29:18.206 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-10-24T00:29:18.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.208 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-10-24T00:29:18.264 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-10-24T00:29:18.264 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:29:18.265 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:29:18.265 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:29:18.265 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:29:18.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.266 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:18.266 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:18.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:29:18.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:29:18.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:29:18.268 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:18.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.365 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T00:29:18.379 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-24T00:29:18.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.380 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-10-24T00:29:18.433 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-24T00:29:18.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.434 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:18.435 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:18.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-24T00:29:18.435 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-24T00:29:18.435 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.522 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-24T00:29:18.558 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:18.558 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:18.558 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:18.558 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.559 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:18.559 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.559 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:29:18.559 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether aa:50:00:81:80:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-24T00:29:18.559 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-24T00:29:18.560 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.560 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::a850:ff:fe81:80c4/64 scope link tentative 2023-10-24T00:29:18.560 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-24T00:29:18.654 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:18.654 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:29:18.655 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether aa:50:00:81:80:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-24T00:29:18.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-24T00:29:18.656 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::a850:ff:fe81:80c4/64 scope link tentative 2023-10-24T00:29:18.656 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:18.666 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-24T00:29:18.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.666 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:18.667 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:18.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-24T00:29:18.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-24T00:29:18.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-24T00:29:18.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-24T00:29:18.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-24T00:29:18.669 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:18.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.877 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-10-24T00:29:18.878 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-10-24T00:29:18.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2023-10-24T00:29:18.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2023-10-24T00:29:18.878 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-10-24T00:29:18.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:18.959 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-10-24T00:29:18.973 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:29:18.973 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:19.052 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:19.052 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:19.076 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:19.077 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:19.078 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:29:19.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:19.079 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-24T00:29:19.143 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-24T00:29:19.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:19.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.287+0000 7f186fb34700 1 Processor -- start 2023-10-24T00:29:19.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.287+0000 7f186fb34700 1 -- start start 2023-10-24T00:29:19.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186fb34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186fb34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18680c6710 0x7f18680aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186fb34700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680c0960 con 0x7f1868158770 2023-10-24T00:29:19.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186fb34700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680aa8e0 con 0x7f18680c6710 2023-10-24T00:29:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186fb34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c0c40 con 0x7f18680aa010 2023-10-24T00:29:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186e0d1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1868158770 0x7f1868069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33218/0 (socket says 172.21.15.148:33218) 2023-10-24T00:29:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.288+0000 7f186e0d1700 1 -- 172.21.15.148:0/1949176884 learned_addr learned my addr 172.21.15.148:0/1949176884 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:19.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 --2- 172.21.15.148:0/1949176884 >> v2:172.21.15.150:3300/0 conn(0x7f18680c6710 0x7f18680aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d8d0700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610340094 0 0) 0x7f18680c0960 con 0x7f1868158770 2023-10-24T00:29:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18540033f0 con 0x7f1868158770 2023-10-24T00:29:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 -- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 msgr2=0x7f18680c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:19.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17374067 0 0) 0x7f18540033f0 con 0x7f1868158770 2023-10-24T00:29:19.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 -- 172.21.15.148:0/1949176884 >> v1:172.21.15.148:6789/0 conn(0x7f1868158770 legacy=0x7f1868069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 -- 172.21.15.148:0/1949176884 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680c0f20 con 0x7f18680c6710 2023-10-24T00:29:19.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d8d0700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:19.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186d0cf700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f18680aa3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1858009760 tx=0x7f1858009060).ready entity=mon.1 client_cookie=c874da20bd690d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18600017f0 con 0x7f18680c6710 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1858011400 con 0x7f18680c6710 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.289+0000 7f186c8ce700 1 -- 172.21.15.148:0/1949176884 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011780 con 0x7f18680c6710 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 -- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 msgr2=0x7f18680aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f18680aa3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1858009760 tx=0x7f1858009060).stop 2023-10-24T00:29:19.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 -- 172.21.15.148:0/1949176884 shutdown_connections 2023-10-24T00:29:19.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 --2- 172.21.15.148:0/1949176884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f18680aa3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 -- 172.21.15.148:0/1949176884 >> 172.21.15.148:0/1949176884 conn(0x7f18680caf40 msgr2=0x7f18680cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:19.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 -- 172.21.15.148:0/1949176884 shutdown_connections 2023-10-24T00:29:19.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.290+0000 7f186fb34700 1 -- 172.21.15.148:0/1949176884 wait complete. 2023-10-24T00:29:19.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.291+0000 7f186fb34700 1 Processor -- start 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.291+0000 7f186fb34700 1 -- start start 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f1868144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18681430e0 con 0x7f1868158770 2023-10-24T00:29:19.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868142460 con 0x7f18680c6710 2023-10-24T00:29:19.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1868142740 con 0x7f18680aa010 2023-10-24T00:29:19.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36540/0 (socket says 172.21.15.148:36540) 2023-10-24T00:29:19.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 -- 172.21.15.148:0/2015886417 learned_addr learned my addr 172.21.15.148:0/2015886417 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186d0cf700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f1868144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186d8d0700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 -- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 msgr2=0x7f18680c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 -- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 msgr2=0x7f1868144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f1868144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 -- 172.21.15.148:0/2015886417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18640092a0 con 0x7f1868158770 2023-10-24T00:29:19.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186e0d1700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f186000cb90 tx=0x7f1860001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000cea0 con 0x7f1868158770 2023-10-24T00:29:19.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860004c40 con 0x7f1868158770 2023-10-24T00:29:19.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18580092a0 con 0x7f1868158770 2023-10-24T00:29:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.292+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860007170 con 0x7f1868158770 2023-10-24T00:29:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.293+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1868142d00 con 0x7f1868158770 2023-10-24T00:29:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.294+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186806c6b0 con 0x7f1868158770 2023-10-24T00:29:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.294+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1860007520 con 0x7f1868158770 2023-10-24T00:29:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.294+0000 7f185dffb700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 0x7f184c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.294+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f186007a010 con 0x7f1868158770 2023-10-24T00:29:19.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.294+0000 7f186d8d0700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 0x7f184c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.295+0000 7f186d8d0700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 0x7f184c061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1864009dc0 tx=0x7f1864009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.298+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f186004b2e0 con 0x7f1868158770 2023-10-24T00:29:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.461+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18680c1200 con 0x7f1868158770 2023-10-24T00:29:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.462+0000 7f185dffb700 1 -- 172.21.15.148:0/2015886417 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f1860019030 con 0x7f1868158770 2023-10-24T00:29:19.464 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:19.464 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:19.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 msgr2=0x7f184c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 0x7f184c061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1864009dc0 tx=0x7f1864009060).stop 2023-10-24T00:29:19.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 msgr2=0x7f1868141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f186000cb90 tx=0x7f1860001d80).stop 2023-10-24T00:29:19.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 shutdown_connections 2023-10-24T00:29:19.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f184c05f150 0x7f184c061610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1868158770 0x7f1868141bd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18680aa010 0x7f18680c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 --2- 172.21.15.148:0/2015886417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18680c6710 0x7f1868144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 >> 172.21.15.148:0/2015886417 conn(0x7f18680caf40 msgr2=0x7f1868152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 shutdown_connections 2023-10-24T00:29:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.464+0000 7f186fb34700 1 -- 172.21.15.148:0/2015886417 wait complete. 2023-10-24T00:29:19.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:19.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:19.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.592+0000 7efd2cdb7700 1 Processor -- start 2023-10-24T00:29:19.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.592+0000 7efd2cdb7700 1 -- start start 2023-10-24T00:29:19.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 0x7efd28154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd28098bd0 0x7efd280c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 0x7efd280c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd280c0970 con 0x7efd28098bd0 2023-10-24T00:29:19.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd280c71d0 con 0x7efd280bffd0 2023-10-24T00:29:19.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2cdb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c9410 con 0x7efd28154430 2023-10-24T00:29:19.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd28098bd0 0x7efd280c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd28098bd0 0x7efd280c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36554/0 (socket says 172.21.15.148:36554) 2023-10-24T00:29:19.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 -- 172.21.15.148:0/3922740618 learned_addr learned my addr 172.21.15.148:0/3922740618 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:19.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd26d9d700 1 --2- 172.21.15.148:0/3922740618 >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 0x7efd280c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd2659c700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 0x7efd28154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 -- 172.21.15.148:0/3922740618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 msgr2=0x7efd28154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:19.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 0x7efd28154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 -- 172.21.15.148:0/3922740618 >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 msgr2=0x7efd280c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:19.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 --2- 172.21.15.148:0/3922740618 >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 0x7efd280c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.593+0000 7efd25d9b700 1 -- 172.21.15.148:0/3922740618 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280c6c10 con 0x7efd28098bd0 2023-10-24T00:29:19.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd26d9d700 1 --2- 172.21.15.148:0/3922740618 >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 0x7efd280c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:19.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2659c700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 0x7efd28154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:19.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd25d9b700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd280c6300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7efd10006fd0 tx=0x7efd100090f0).ready entity=mon.0 client_cookie=3c88531b41f1a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2559a700 1 -- 172.21.15.148:0/3922740618 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000b600 con 0x7efd28098bd0 2023-10-24T00:29:19.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2559a700 1 -- 172.21.15.148:0/3922740618 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000b760 con 0x7efd28098bd0 2023-10-24T00:29:19.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2559a700 1 -- 172.21.15.148:0/3922740618 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000bae0 con 0x7efd28098bd0 2023-10-24T00:29:19.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 -- 172.21.15.148:0/3922740618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 msgr2=0x7efd280c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd280c6300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7efd10006fd0 tx=0x7efd100090f0).stop 2023-10-24T00:29:19.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 -- 172.21.15.148:0/3922740618 shutdown_connections 2023-10-24T00:29:19.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/3922740618 >> v2:172.21.15.150:3300/0 conn(0x7efd280bffd0 0x7efd280c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd28154430 0x7efd28154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/3922740618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd280c6300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 -- 172.21.15.148:0/3922740618 >> 172.21.15.148:0/3922740618 conn(0x7efd280cb070 msgr2=0x7efd280cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:19.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 -- 172.21.15.148:0/3922740618 shutdown_connections 2023-10-24T00:29:19.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.594+0000 7efd2cdb7700 1 -- 172.21.15.148:0/3922740618 wait complete. 2023-10-24T00:29:19.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.595+0000 7efd2cdb7700 1 Processor -- start 2023-10-24T00:29:19.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.595+0000 7efd2cdb7700 1 -- start start 2023-10-24T00:29:19.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd280bffd0 0x7efd2814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd28154430 0x7efd28064470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c2110 con 0x7efd28098bd0 2023-10-24T00:29:19.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c23f0 con 0x7efd28154430 2023-10-24T00:29:19.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2cdb7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c26d0 con 0x7efd280bffd0 2023-10-24T00:29:19.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36558/0 (socket says 172.21.15.148:36558) 2023-10-24T00:29:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd2659c700 1 -- 172.21.15.148:0/38229138 learned_addr learned my addr 172.21.15.148:0/38229138 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd25d9b700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd280bffd0 0x7efd2814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.596+0000 7efd26d9d700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd28154430 0x7efd28064470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 -- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd280bffd0 msgr2=0x7efd2814e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd280bffd0 0x7efd2814e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 -- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd28154430 msgr2=0x7efd28064470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd28154430 0x7efd28064470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 -- 172.21.15.148:0/38229138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009370 con 0x7efd28098bd0 2023-10-24T00:29:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2659c700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7efd1800cfb0 tx=0x7efd18007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1800ad80 con 0x7efd28098bd0 2023-10-24T00:29:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd18016400 con 0x7efd28098bd0 2023-10-24T00:29:19.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18016780 con 0x7efd28098bd0 2023-10-24T00:29:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd280c29b0 con 0x7efd28098bd0 2023-10-24T00:29:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.597+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280c2f70 con 0x7efd28098bd0 2023-10-24T00:29:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.598+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2806c6b0 con 0x7efd28098bd0 2023-10-24T00:29:19.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.598+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efd180203f0 con 0x7efd28098bd0 2023-10-24T00:29:19.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.599+0000 7efd1e7fc700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 0x7efd08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.599+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd1807ac00 con 0x7efd28098bd0 2023-10-24T00:29:19.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.599+0000 7efd25d9b700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 0x7efd08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.599+0000 7efd25d9b700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 0x7efd08061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efd10006fd0 tx=0x7efd10017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.603+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efd18081080 con 0x7efd28098bd0 2023-10-24T00:29:19.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.764+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd280c6ef0 con 0x7efd28098bd0 2023-10-24T00:29:19.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.765+0000 7efd1e7fc700 1 -- 172.21.15.148:0/38229138 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd1804be70 con 0x7efd28098bd0 2023-10-24T00:29:19.768 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:19.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 msgr2=0x7efd08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 0x7efd08061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efd10006fd0 tx=0x7efd10017000).stop 2023-10-24T00:29:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 msgr2=0x7efd2814eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7efd1800cfb0 tx=0x7efd18007870).stop 2023-10-24T00:29:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 shutdown_connections 2023-10-24T00:29:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd28154430 0x7efd28064470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd0805f150 0x7efd08061610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd28098bd0 0x7efd2814eff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.766+0000 7efd2cdb7700 1 --2- 172.21.15.148:0/38229138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd280bffd0 0x7efd2814e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.767+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 >> 172.21.15.148:0/38229138 conn(0x7efd280cb070 msgr2=0x7efd280a85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.767+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 shutdown_connections 2023-10-24T00:29:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.767+0000 7efd2cdb7700 1 -- 172.21.15.148:0/38229138 wait complete. 2023-10-24T00:29:19.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:19.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.896+0000 7fe759a9c700 1 Processor -- start 2023-10-24T00:29:19.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.896+0000 7fe759a9c700 1 -- start start 2023-10-24T00:29:19.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe759a9c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe759a9c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7540a83d0 0x7fe75415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe759a9c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7540677f0 con 0x7fe754066f60 2023-10-24T00:29:19.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe759a9c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7540a6260 con 0x7fe7540a83d0 2023-10-24T00:29:19.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe759a9c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541536d0 con 0x7fe75414fcb0 2023-10-24T00:29:19.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7540a83d0 0x7fe75415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe753fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe754066f60 0x7fe7540a7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33232/0 (socket says 172.21.15.148:33232) 2023-10-24T00:29:19.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe753fff700 1 -- 172.21.15.148:0/2146712792 learned_addr learned my addr 172.21.15.148:0/2146712792 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:19.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe758a9a700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 -- 172.21.15.148:0/2146712792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 msgr2=0x7fe754066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:19.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 -- 172.21.15.148:0/2146712792 >> v1:172.21.15.148:6789/0 conn(0x7fe754066f60 legacy=0x7fe7540a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe7537fe700 1 -- 172.21.15.148:0/2146712792 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729070292 0 0) 0x7fe740001110 con 0x7fe754066f60 2023-10-24T00:29:19.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 -- 172.21.15.148:0/2146712792 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754067510 con 0x7fe7540a83d0 2023-10-24T00:29:19.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.897+0000 7fe75929b700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7540a83d0 0x7fe75415bdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe74c009e60 tx=0x7fe74c009780).ready entity=mon.0 client_cookie=6c6c4f81c3fff764 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe7537fe700 1 -- 172.21.15.148:0/2146712792 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00e070 con 0x7fe7540a83d0 2023-10-24T00:29:19.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe7537fe700 1 -- 172.21.15.148:0/2146712792 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00bb60 con 0x7fe7540a83d0 2023-10-24T00:29:19.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe7537fe700 1 -- 172.21.15.148:0/2146712792 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c012410 con 0x7fe7540a83d0 2023-10-24T00:29:19.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 -- 172.21.15.148:0/2146712792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7540a83d0 msgr2=0x7fe75415bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7540a83d0 0x7fe75415bdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe74c009e60 tx=0x7fe74c009780).stop 2023-10-24T00:29:19.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 -- 172.21.15.148:0/2146712792 shutdown_connections 2023-10-24T00:29:19.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7540a83d0 0x7fe75415bdd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 --2- 172.21.15.148:0/2146712792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 -- 172.21.15.148:0/2146712792 >> 172.21.15.148:0/2146712792 conn(0x7fe7540923d0 msgr2=0x7fe754062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:19.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 -- 172.21.15.148:0/2146712792 shutdown_connections 2023-10-24T00:29:19.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.898+0000 7fe759a9c700 1 -- 172.21.15.148:0/2146712792 wait complete. 2023-10-24T00:29:19.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.899+0000 7fe759a9c700 1 Processor -- start 2023-10-24T00:29:19.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.899+0000 7fe759a9c700 1 -- start start 2023-10-24T00:29:19.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7540a83d0 0x7fe754153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754154360 con 0x7fe754066f60 2023-10-24T00:29:19.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540ac880 con 0x7fe7540a83d0 2023-10-24T00:29:19.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe759a9c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540acb60 con 0x7fe75414fcb0 2023-10-24T00:29:19.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe758a9a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe758a9a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36582/0 (socket says 172.21.15.148:36582) 2023-10-24T00:29:19.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe758a9a700 1 -- 172.21.15.148:0/3323662181 learned_addr learned my addr 172.21.15.148:0/3323662181 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:19.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe753fff700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7540a83d0 0x7fe754153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.900+0000 7fe75929b700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 -- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 msgr2=0x7fe754153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 -- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7540a83d0 msgr2=0x7fe754153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:19.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7540a83d0 0x7fe754153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:19.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 -- 172.21.15.148:0/3323662181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009a20 con 0x7fe754066f60 2023-10-24T00:29:19.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe75929b700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:19.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe758a9a700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe74800e900 tx=0x7fe748006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012600 con 0x7fe754066f60 2023-10-24T00:29:19.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748012760 con 0x7fe754066f60 2023-10-24T00:29:19.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012ae0 con 0x7fe754066f60 2023-10-24T00:29:19.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7540ace40 con 0x7fe754066f60 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.901+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7540ad400 con 0x7fe754066f60 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.902+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe754047480 con 0x7fe754066f60 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.902+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe74801b400 con 0x7fe754066f60 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.902+0000 7fe750ff9700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 0x7fe738061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.903+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe74807a5a0 con 0x7fe754066f60 2023-10-24T00:29:19.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.903+0000 7fe753fff700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 0x7fe738061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:19.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.903+0000 7fe753fff700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 0x7fe738061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe7541545d0 tx=0x7fe740007a10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:19.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:19.907+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe74804b810 con 0x7fe754066f60 2023-10-24T00:29:20.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.067+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7540a5c10 con 0x7fe754066f60 2023-10-24T00:29:20.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.067+0000 7fe750ff9700 1 -- 172.21.15.148:0/3323662181 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe748016070 con 0x7fe754066f60 2023-10-24T00:29:20.070 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:20.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 msgr2=0x7fe738061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 0x7fe738061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe7541545d0 tx=0x7fe740007a10).stop 2023-10-24T00:29:20.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 msgr2=0x7fe75414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe74800e900 tx=0x7fe748006f40).stop 2023-10-24T00:29:20.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 shutdown_connections 2023-10-24T00:29:20.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe75414fcb0 0x7fe754153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe73805f150 0x7fe738061610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe754066f60 0x7fe75414e850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 --2- 172.21.15.148:0/3323662181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7540a83d0 0x7fe754153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 >> 172.21.15.148:0/3323662181 conn(0x7fe7540923d0 msgr2=0x7fe7541520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 shutdown_connections 2023-10-24T00:29:20.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.069+0000 7fe759a9c700 1 -- 172.21.15.148:0/3323662181 wait complete. 2023-10-24T00:29:20.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:20.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.198+0000 7fb5fe07c700 1 Processor -- start 2023-10-24T00:29:20.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.198+0000 7fb5fe07c700 1 -- start start 2023-10-24T00:29:20.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5fe07c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5fe07c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 0x7fb5f80c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5fe07c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80c71d0 con 0x7fb5f80bffd0 2023-10-24T00:29:20.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5fe07c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80c9410 con 0x7fb5f8098bd0 2023-10-24T00:29:20.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5fe07c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80c6c10 con 0x7fb5f8154430 2023-10-24T00:29:20.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f6ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 0x7fb5f80c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:50524/0 (socket says 172.21.15.148:50524) 2023-10-24T00:29:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 -- 172.21.15.148:0/380609430 learned_addr learned my addr 172.21.15.148:0/380609430 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f7fff700 1 --1- 172.21.15.148:0/380609430 >> v1:172.21.15.150:6789/0 conn(0x7fb5f80bffd0 0x7fb5f80c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:47550/0 (socket says 172.21.15.148:47550) 2023-10-24T00:29:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 -- 172.21.15.148:0/380609430 >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 msgr2=0x7fb5f80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 --2- 172.21.15.148:0/380609430 >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 0x7fb5f80c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 -- 172.21.15.148:0/380609430 >> v1:172.21.15.150:6789/0 conn(0x7fb5f80bffd0 legacy=0x7fb5f80c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f67fc700 1 -- 172.21.15.148:0/380609430 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215451593 0 0) 0x7fb5f80c71d0 con 0x7fb5f80bffd0 2023-10-24T00:29:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f77fe700 1 -- 172.21.15.148:0/380609430 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80c6ef0 con 0x7fb5f8154430 2023-10-24T00:29:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.199+0000 7fb5f6ffd700 1 --2- 172.21.15.148:0/380609430 >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 0x7fb5f80c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5f77fe700 1 --2- 172.21.15.148:0/380609430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb5e8009830 tx=0x7fb5e80090f0).ready entity=mon.2 client_cookie=a54561a24707dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5f67fc700 1 -- 172.21.15.148:0/380609430 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800b580 con 0x7fb5f8154430 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5f67fc700 1 -- 172.21.15.148:0/380609430 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e800b6e0 con 0x7fb5f8154430 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5f67fc700 1 -- 172.21.15.148:0/380609430 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e800ba60 con 0x7fb5f8154430 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 -- 172.21.15.148:0/380609430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 msgr2=0x7fb5f8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/380609430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb5e8009830 tx=0x7fb5e80090f0).stop 2023-10-24T00:29:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 -- 172.21.15.148:0/380609430 shutdown_connections 2023-10-24T00:29:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/380609430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f8154430 0x7fb5f8154810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/380609430 >> v2:172.21.15.150:3300/0 conn(0x7fb5f8098bd0 0x7fb5f80c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 -- 172.21.15.148:0/380609430 >> 172.21.15.148:0/380609430 conn(0x7fb5f80cb070 msgr2=0x7fb5f80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 -- 172.21.15.148:0/380609430 shutdown_connections 2023-10-24T00:29:20.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.200+0000 7fb5fe07c700 1 -- 172.21.15.148:0/380609430 wait complete. 2023-10-24T00:29:20.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 Processor -- start 2023-10-24T00:29:20.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 -- start start 2023-10-24T00:29:20.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f8098bd0 0x7fb5f814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f80bffd0 0x7fb5f80ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80c2e10 con 0x7fb5f8154430 2023-10-24T00:29:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80c3c70 con 0x7fb5f8098bd0 2023-10-24T00:29:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.202+0000 7fb5fe07c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80c3060 con 0x7fb5f80bffd0 2023-10-24T00:29:20.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36598/0 (socket says 172.21.15.148:36598) 2023-10-24T00:29:20.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 -- 172.21.15.148:0/970632573 learned_addr learned my addr 172.21.15.148:0/970632573 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:20.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f77fe700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f8098bd0 0x7fb5f814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f6ffd700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f80bffd0 0x7fb5f80ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 -- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f80bffd0 msgr2=0x7fb5f80ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f80bffd0 0x7fb5f80ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 -- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f8098bd0 msgr2=0x7fb5f814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f8098bd0 0x7fb5f814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 -- 172.21.15.148:0/970632573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0092a0 con 0x7fb5f8154430 2023-10-24T00:29:20.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5f7fff700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb5f000c7e0 tx=0x7fb5f0007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005c70 con 0x7fb5f8154430 2023-10-24T00:29:20.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0005dd0 con 0x7fb5f8154430 2023-10-24T00:29:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e8009370 con 0x7fb5f8154430 2023-10-24T00:29:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007320 con 0x7fb5f8154430 2023-10-24T00:29:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.203+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80c3620 con 0x7fb5f8154430 2023-10-24T00:29:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.204+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80c3de0 con 0x7fb5f8154430 2023-10-24T00:29:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.205+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5f0007710 con 0x7fb5f8154430 2023-10-24T00:29:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.205+0000 7fb5df7fe700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 0x7fb5e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.205+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5f007a0f0 con 0x7fb5f8154430 2023-10-24T00:29:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.205+0000 7fb5f77fe700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 0x7fb5e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.205+0000 7fb5f77fe700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 0x7fb5e4061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb5e8009130 tx=0x7fb5e8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.209+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5f004b360 con 0x7fb5f8154430 2023-10-24T00:29:20.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.373+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5f80c90a0 con 0x7fb5f8154430 2023-10-24T00:29:20.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.373+0000 7fb5df7fe700 1 -- 172.21.15.148:0/970632573 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5f004e980 con 0x7fb5f8154430 2023-10-24T00:29:20.376 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 msgr2=0x7fb5e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 0x7fb5e4061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fb5e8009130 tx=0x7fb5e8017000).stop 2023-10-24T00:29:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 msgr2=0x7fb5f80aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb5f000c7e0 tx=0x7fb5f0007f60).stop 2023-10-24T00:29:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 shutdown_connections 2023-10-24T00:29:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb5e405f150 0x7fb5e4061610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5f8154430 0x7fb5f80aeec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5f8098bd0 0x7fb5f814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 --2- 172.21.15.148:0/970632573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5f80bffd0 0x7fb5f80ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 >> 172.21.15.148:0/970632573 conn(0x7fb5f80cb070 msgr2=0x7fb5f80a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 shutdown_connections 2023-10-24T00:29:20.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.375+0000 7fb5fe07c700 1 -- 172.21.15.148:0/970632573 wait complete. 2023-10-24T00:29:20.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.503+0000 7fa97af2d700 1 Processor -- start 2023-10-24T00:29:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.503+0000 7fa97af2d700 1 -- start start 2023-10-24T00:29:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa97af2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa974154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa97af2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa974098bd0 0x7fa9740c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa97af2d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9740c71d0 con 0x7fa9740bffd0 2023-10-24T00:29:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa97af2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740c9410 con 0x7fa974098bd0 2023-10-24T00:29:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa97af2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740c6c10 con 0x7fa974154430 2023-10-24T00:29:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa9794ca700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9740bffd0 0x7fa9740c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33236/0 (socket says 172.21.15.148:33236) 2023-10-24T00:29:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa9794ca700 1 -- 172.21.15.148:0/923066866 learned_addr learned my addr 172.21.15.148:0/923066866 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa973fff700 1 --2- 172.21.15.148:0/923066866 >> v2:172.21.15.150:3300/0 conn(0x7fa974098bd0 0x7fa9740c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa978cc9700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa974154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105508843 0 0) 0x7fa9740c71d0 con 0x7fa9740bffd0 2023-10-24T00:29:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.504+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95c0033f0 con 0x7fa9740bffd0 2023-10-24T00:29:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918242963 0 0) 0x7fa95c0033f0 con 0x7fa9740bffd0 2023-10-24T00:29:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 msgr2=0x7fa974154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa974154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 >> v2:172.21.15.150:3300/0 conn(0x7fa974098bd0 msgr2=0x7fa9740c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 --2- 172.21.15.148:0/923066866 >> v2:172.21.15.150:3300/0 conn(0x7fa974098bd0 0x7fa9740c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740c6ef0 con 0x7fa9740bffd0 2023-10-24T00:29:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fa96c001470 con 0x7fa9740bffd0 2023-10-24T00:29:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 >> v1:172.21.15.148:6789/0 conn(0x7fa9740bffd0 legacy=0x7fa9740c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa95c0038e0 0x7fa95c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa95c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa95c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740c9410 con 0x7fa95c004b80 2023-10-24T00:29:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740c6c10 con 0x7fa95c0038e0 2023-10-24T00:29:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c00b8e0 con 0x7fa974154430 2023-10-24T00:29:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa973fff700 1 --2- 172.21.15.148:0/923066866 >> v2:172.21.15.150:3300/0 conn(0x7fa974098bd0 0x7fa9740c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa95c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa978cc9700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa95c0038e0 0x7fa95c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa973fff700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa95c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 -- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 msgr2=0x7fa95c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa95c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 -- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa95c0038e0 msgr2=0x7fa95c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa95c0038e0 0x7fa95c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 -- 172.21.15.148:0/923066866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0033f0 con 0x7fa95c004b80 2023-10-24T00:29:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa973fff700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa974154430 0x7fa95c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9794ca700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa95c005000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fa96c00c190 tx=0x7fa96c001e50).ready entity=mon.0 client_cookie=9723321232ce576c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c007a20 con 0x7fa95c004b80 2023-10-24T00:29:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c00cac0 con 0x7fa95c004b80 2023-10-24T00:29:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.505+0000 7fa9737fe700 1 -- 172.21.15.148:0/923066866 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00ce40 con 0x7fa95c004b80 2023-10-24T00:29:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 -- 172.21.15.148:0/923066866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 msgr2=0x7fa95c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 --2- 172.21.15.148:0/923066866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa95c005000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fa96c00c190 tx=0x7fa96c001e50).stop 2023-10-24T00:29:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa9794ca700 1 -- 172.21.15.148:0/923066866 reap_dead start 2023-10-24T00:29:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 -- 172.21.15.148:0/923066866 shutdown_connections 2023-10-24T00:29:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 -- 172.21.15.148:0/923066866 >> 172.21.15.148:0/923066866 conn(0x7fa9740cb070 msgr2=0x7fa9740cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 -- 172.21.15.148:0/923066866 shutdown_connections 2023-10-24T00:29:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.506+0000 7fa97af2d700 1 -- 172.21.15.148:0/923066866 wait complete. 2023-10-24T00:29:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.507+0000 7fa97af2d700 1 Processor -- start 2023-10-24T00:29:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.507+0000 7fa97af2d700 1 -- start start 2023-10-24T00:29:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9740abf40 0x7fa9740ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 0x7fa9740ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740ad650 con 0x7fa95c004b80 2023-10-24T00:29:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa974145490 con 0x7fa9740ae000 2023-10-24T00:29:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa97af2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740aca40 con 0x7fa9740abf40 2023-10-24T00:29:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36612/0 (socket says 172.21.15.148:36612) 2023-10-24T00:29:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 -- 172.21.15.148:0/3903817364 learned_addr learned my addr 172.21.15.148:0/3903817364 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa973fff700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9740abf40 0x7fa9740ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa9794ca700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 0x7fa9740ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 -- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9740abf40 msgr2=0x7fa9740ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9740abf40 0x7fa9740ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 -- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 msgr2=0x7fa9740ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 0x7fa9740ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa978cc9700 1 -- 172.21.15.148:0/3903817364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740acd20 con 0x7fa95c004b80 2023-10-24T00:29:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.508+0000 7fa9794ca700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 0x7fa9740ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa978cc9700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa964011f30 tx=0x7fa96400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400e040 con 0x7fa95c004b80 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96400f040 con 0x7fa95c004b80 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9740ad000 con 0x7fa95c004b80 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964015450 con 0x7fa95c004b80 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.509+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9740c4720 con 0x7fa95c004b80 2023-10-24T00:29:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.510+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97406c6b0 con 0x7fa95c004b80 2023-10-24T00:29:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.510+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa964015840 con 0x7fa95c004b80 2023-10-24T00:29:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.510+0000 7fa970ff9700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 0x7fa960061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.510+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa96407b1b0 con 0x7fa95c004b80 2023-10-24T00:29:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.511+0000 7fa973fff700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 0x7fa960061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.511+0000 7fa973fff700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 0x7fa960061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa968009270 tx=0x7fa968008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.514+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa96404c480 con 0x7fa95c004b80 2023-10-24T00:29:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.677+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9740c90a0 con 0x7fa95c004b80 2023-10-24T00:29:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.678+0000 7fa970ff9700 1 -- 172.21.15.148:0/3903817364 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9640190a0 con 0x7fa95c004b80 2023-10-24T00:29:20.681 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:20.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 msgr2=0x7fa960061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 0x7fa960061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa968009270 tx=0x7fa968008040).stop 2023-10-24T00:29:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 msgr2=0x7fa974144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa964011f30 tx=0x7fa96400b040).stop 2023-10-24T00:29:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 shutdown_connections 2023-10-24T00:29:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9740ae000 0x7fa9740ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96005f150 0x7fa960061610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa95c004b80 0x7fa974144fa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 --2- 172.21.15.148:0/3903817364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9740abf40 0x7fa9740ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.679+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 >> 172.21.15.148:0/3903817364 conn(0x7fa9740cb070 msgr2=0x7fa974063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.680+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 shutdown_connections 2023-10-24T00:29:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.680+0000 7fa97af2d700 1 -- 172.21.15.148:0/3903817364 wait complete. 2023-10-24T00:29:20.694 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:20.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.806+0000 7f2467f73700 1 Processor -- start 2023-10-24T00:29:20.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.806+0000 7f2467f73700 1 -- start start 2023-10-24T00:29:20.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2467f73700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 0x7f2460151060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2467f73700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f24600c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2467f73700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c32f0 con 0x7f24600c2810 2023-10-24T00:29:20.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2467f73700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2460064d10 con 0x7f2460150c80 2023-10-24T00:29:20.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2467f73700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600c35d0 con 0x7f2460063e70 2023-10-24T00:29:20.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f246550e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f24600c2810 0x7f2460063760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33246/0 (socket says 172.21.15.148:33246) 2023-10-24T00:29:20.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f246550e700 1 -- 172.21.15.148:0/3188982783 learned_addr learned my addr 172.21.15.148:0/3188982783 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:20.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2465d0f700 1 --2- 172.21.15.148:0/3188982783 >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 0x7f2460151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2466510700 1 --2- 172.21.15.148:0/3188982783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f24600c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143777358 0 0) 0x7f24600c32f0 con 0x7f24600c2810 2023-10-24T00:29:20.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c0033f0 con 0x7f24600c2810 2023-10-24T00:29:20.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2466510700 1 -- 172.21.15.148:0/3188982783 >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 msgr2=0x7f2460151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:20.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2466510700 1 --2- 172.21.15.148:0/3188982783 >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 0x7f2460151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2466510700 1 -- 172.21.15.148:0/3188982783 >> v1:172.21.15.148:6789/0 conn(0x7f24600c2810 legacy=0x7f2460063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.807+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2591526192 0 0) 0x7f244c0033f0 con 0x7f24600c2810 2023-10-24T00:29:20.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2466510700 1 -- 172.21.15.148:0/3188982783 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600c38b0 con 0x7f2460063e70 2023-10-24T00:29:20.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2465d0f700 1 --2- 172.21.15.148:0/3188982783 >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 0x7f2460151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:20.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2466510700 1 --2- 172.21.15.148:0/3188982783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f24600c2c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2458009e60 tx=0x7f2458009780).ready entity=mon.2 client_cookie=94bfc35c2068f0b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800e070 con 0x7f2460063e70 2023-10-24T00:29:20.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245800b7a0 con 0x7f2460063e70 2023-10-24T00:29:20.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2464d0d700 1 -- 172.21.15.148:0/3188982783 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450001470 con 0x7f2460063e70 2023-10-24T00:29:20.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 -- 172.21.15.148:0/3188982783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 msgr2=0x7f24600c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 --2- 172.21.15.148:0/3188982783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f24600c2c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2458009e60 tx=0x7f2458009780).stop 2023-10-24T00:29:20.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 -- 172.21.15.148:0/3188982783 shutdown_connections 2023-10-24T00:29:20.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 --2- 172.21.15.148:0/3188982783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f24600c2c90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 --2- 172.21.15.148:0/3188982783 >> v2:172.21.15.150:3300/0 conn(0x7f2460150c80 0x7f2460151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 -- 172.21.15.148:0/3188982783 >> 172.21.15.148:0/3188982783 conn(0x7f24600c7ee0 msgr2=0x7f24600c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.808+0000 7f2467f73700 1 -- 172.21.15.148:0/3188982783 shutdown_connections 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.809+0000 7f2467f73700 1 -- 172.21.15.148:0/3188982783 wait complete. 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 Processor -- start 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 -- start start 2023-10-24T00:29:20.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f246014b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2460150c80 0x7f2460063020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460063510 con 0x7f24600c2810 2023-10-24T00:29:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a6150 con 0x7f2460150c80 2023-10-24T00:29:20.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.810+0000 7f2467f73700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2460065ca0 con 0x7f2460063e70 2023-10-24T00:29:20.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36626/0 (socket says 172.21.15.148:36626) 2023-10-24T00:29:20.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 -- 172.21.15.148:0/992937521 learned_addr learned my addr 172.21.15.148:0/992937521 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:20.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2465d0f700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f246014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2466510700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2460150c80 0x7f2460063020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 -- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 msgr2=0x7f246014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f246014b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 -- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2460150c80 msgr2=0x7f2460063020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2460150c80 0x7f2460063020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 -- 172.21.15.148:0/992937521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0092a0 con 0x7f24600c2810 2023-10-24T00:29:20.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f246550e700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f245000c810 tx=0x7f2450001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450007170 con 0x7f24600c2810 2023-10-24T00:29:20.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500072d0 con 0x7f24600c2810 2023-10-24T00:29:20.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458009a20 con 0x7f24600c2810 2023-10-24T00:29:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500048c0 con 0x7f24600c2810 2023-10-24T00:29:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.811+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24600a6450 con 0x7f24600c2810 2023-10-24T00:29:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.813+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246006c6b0 con 0x7f24600c2810 2023-10-24T00:29:20.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.813+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2450004cb0 con 0x7f24600c2810 2023-10-24T00:29:20.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.813+0000 7f2455ffb700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 0x7f2444061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:20.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.813+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2450079bb0 con 0x7f24600c2810 2023-10-24T00:29:20.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.813+0000 7f2465d0f700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 0x7f2444061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:20.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.814+0000 7f2465d0f700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 0x7f2444061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f245c009d20 tx=0x7f245c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:20.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.817+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f245004ae80 con 0x7f24600c2810 2023-10-24T00:29:20.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.985+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24600663d0 con 0x7f24600c2810 2023-10-24T00:29:20.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.986+0000 7f2455ffb700 1 -- 172.21.15.148:0/992937521 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f245004e4a0 con 0x7f24600c2810 2023-10-24T00:29:20.989 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:20.989 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:20.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 msgr2=0x7f2444061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 0x7f2444061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f245c009d20 tx=0x7f245c009060).stop 2023-10-24T00:29:20.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 msgr2=0x7f24600666f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:20.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f245000c810 tx=0x7f2450001aa0).stop 2023-10-24T00:29:20.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 shutdown_connections 2023-10-24T00:29:20.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2460150c80 0x7f2460063020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2460063e70 0x7f246014b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f244405f150 0x7f2444061610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 --2- 172.21.15.148:0/992937521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24600c2810 0x7f24600666f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:20.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 >> 172.21.15.148:0/992937521 conn(0x7f24600c7ee0 msgr2=0x7f24600c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:20.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 shutdown_connections 2023-10-24T00:29:20.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:20.988+0000 7f2467f73700 1 -- 172.21.15.148:0/992937521 wait complete. 2023-10-24T00:29:21.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:21.003 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:21.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.118+0000 7f42d3fff700 1 Processor -- start 2023-10-24T00:29:21.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.118+0000 7f42d3fff700 1 -- start start 2023-10-24T00:29:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42d4154150 0x7f42d40a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f42d40aa390 0x7f42d40c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d3fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40a9830 con 0x7f42d40c0e30 2023-10-24T00:29:21.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d3fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40c1280 con 0x7f42d4154150 2023-10-24T00:29:21.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d3fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40a8c20 con 0x7f42d40aa390 2023-10-24T00:29:21.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42d4154150 0x7f42d40a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f42d40c0e30 0x7f42d40c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33248/0 (socket says 172.21.15.148:33248) 2023-10-24T00:29:21.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d37fe700 1 -- 172.21.15.148:0/2688716860 learned_addr learned my addr 172.21.15.148:0/2688716860 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:21.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d27fc700 1 --2- 172.21.15.148:0/2688716860 >> v2:172.21.15.150:3300/0 conn(0x7f42d40aa390 0x7f42d40c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 -- 172.21.15.148:0/2688716860 >> v2:172.21.15.150:3300/0 conn(0x7f42d40aa390 msgr2=0x7f42d40c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:21.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2688716860 >> v2:172.21.15.150:3300/0 conn(0x7f42d40aa390 0x7f42d40c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 -- 172.21.15.148:0/2688716860 >> v1:172.21.15.148:6789/0 conn(0x7f42d40c0e30 legacy=0x7f42d40c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d1ffb700 1 -- 172.21.15.148:0/2688716860 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893746132 0 0) 0x7f42d40a9830 con 0x7f42d40c0e30 2023-10-24T00:29:21.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 -- 172.21.15.148:0/2688716860 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40a8f00 con 0x7f42d4154150 2023-10-24T00:29:21.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.119+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2688716860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d4154150 0x7f42d40a8640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f42d4083af0 tx=0x7f42c4009780).ready entity=mon.0 client_cookie=8a62bb82868054b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d1ffb700 1 -- 172.21.15.148:0/2688716860 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400e070 con 0x7f42d4154150 2023-10-24T00:29:21.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d1ffb700 1 -- 172.21.15.148:0/2688716860 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c400bc30 con 0x7f42d4154150 2023-10-24T00:29:21.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d1ffb700 1 -- 172.21.15.148:0/2688716860 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4012410 con 0x7f42d4154150 2023-10-24T00:29:21.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 -- 172.21.15.148:0/2688716860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d4154150 msgr2=0x7f42d40a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2688716860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d4154150 0x7f42d40a8640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f42d4083af0 tx=0x7f42c4009780).stop 2023-10-24T00:29:21.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 -- 172.21.15.148:0/2688716860 shutdown_connections 2023-10-24T00:29:21.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2688716860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d4154150 0x7f42d40a8640 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2688716860 >> v2:172.21.15.150:3300/0 conn(0x7f42d40aa390 0x7f42d40c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 -- 172.21.15.148:0/2688716860 >> 172.21.15.148:0/2688716860 conn(0x7f42d4094500 msgr2=0x7f42d406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 -- 172.21.15.148:0/2688716860 shutdown_connections 2023-10-24T00:29:21.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.120+0000 7f42d3fff700 1 -- 172.21.15.148:0/2688716860 wait complete. 2023-10-24T00:29:21.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.121+0000 7f42d3fff700 1 Processor -- start 2023-10-24T00:29:21.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.121+0000 7f42d3fff700 1 -- start start 2023-10-24T00:29:21.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 0x7f42d40c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 0x7f42d40c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c4f20 con 0x7f42d40c0e30 2023-10-24T00:29:21.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c8680 con 0x7f42d40aa390 2023-10-24T00:29:21.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d3fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d413cdb0 con 0x7f42d4154150 2023-10-24T00:29:21.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36646/0 (socket says 172.21.15.148:36646) 2023-10-24T00:29:21.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d27fc700 1 -- 172.21.15.148:0/2200530969 learned_addr learned my addr 172.21.15.148:0/2200530969 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:21.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 0x7f42d40c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.122+0000 7f42d37fe700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 0x7f42d40c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 -- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 msgr2=0x7f42d40c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 0x7f42d40c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 -- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 msgr2=0x7f42d40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 0x7f42d40c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 -- 172.21.15.148:0/2200530969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4009a20 con 0x7f42d40c0e30 2023-10-24T00:29:21.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d37fe700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 0x7f42d40c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:21.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 0x7f42d40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:21.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d27fc700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f42c800d860 tx=0x7f42c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011590 con 0x7f42d40c0e30 2023-10-24T00:29:21.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c80116f0 con 0x7f42d40c0e30 2023-10-24T00:29:21.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d40c7a70 con 0x7f42d40c0e30 2023-10-24T00:29:21.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011a70 con 0x7f42d40c0e30 2023-10-24T00:29:21.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.123+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d40c8030 con 0x7f42d40c0e30 2023-10-24T00:29:21.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.124+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40c8830 con 0x7f42d40c0e30 2023-10-24T00:29:21.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.124+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f42c801c460 con 0x7f42d40c0e30 2023-10-24T00:29:21.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.125+0000 7f42baffd700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 0x7f42c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.125+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f42c8079fc0 con 0x7f42d40c0e30 2023-10-24T00:29:21.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.125+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 0x7f42c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.125+0000 7f42d2ffd700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 0x7f42c0061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f42c4009d80 tx=0x7f42c4009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.129+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f42c80a8af0 con 0x7f42d40c0e30 2023-10-24T00:29:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.290+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f42d4047480 con 0x7f42d40c0e30 2023-10-24T00:29:21.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.291+0000 7f42baffd700 1 -- 172.21.15.148:0/2200530969 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f42d40c8830 con 0x7f42d40c0e30 2023-10-24T00:29:21.294 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:21.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 msgr2=0x7f42c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 0x7f42c0061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f42c4009d80 tx=0x7f42c4009780).stop 2023-10-24T00:29:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 msgr2=0x7f42d40c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f42c800d860 tx=0x7f42c8008040).stop 2023-10-24T00:29:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 shutdown_connections 2023-10-24T00:29:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42d4154150 0x7f42d40c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40aa390 0x7f42d40c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f42c005f150 0x7f42c0061610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 --2- 172.21.15.148:0/2200530969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42d40c0e30 0x7f42d40c73e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 >> 172.21.15.148:0/2200530969 conn(0x7f42d4094500 msgr2=0x7f42d40644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 shutdown_connections 2023-10-24T00:29:21.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.293+0000 7f42d3fff700 1 -- 172.21.15.148:0/2200530969 wait complete. 2023-10-24T00:29:21.308 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.421+0000 7f5ed1198700 1 Processor -- start 2023-10-24T00:29:21.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.421+0000 7f5ed1198700 1 -- start start 2023-10-24T00:29:21.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ed1198700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ecc154430 0x7f5ecc154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ed1198700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ed1198700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0c71d0 con 0x7f5ecc098bd0 2023-10-24T00:29:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ed1198700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c6a10 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ed1198700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c9410 con 0x7f5ecc154430 2023-10-24T00:29:21.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ecb59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ecb59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36650/0 (socket says 172.21.15.148:36650) 2023-10-24T00:29:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ecb59e700 1 -- 172.21.15.148:0/2720420870 learned_addr learned my addr 172.21.15.148:0/2720420870 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.422+0000 7f5ecad9d700 1 --2- 172.21.15.148:0/2720420870 >> v2:172.21.15.150:3300/0 conn(0x7f5ecc154430 0x7f5ecc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ecb59e700 1 -- 172.21.15.148:0/2720420870 >> v2:172.21.15.150:3300/0 conn(0x7f5ecc154430 msgr2=0x7f5ecc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ecb59e700 1 --2- 172.21.15.148:0/2720420870 >> v2:172.21.15.150:3300/0 conn(0x7f5ecc154430 0x7f5ecc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ecb59e700 1 -- 172.21.15.148:0/2720420870 >> v1:172.21.15.150:6789/0 conn(0x7f5ecc098bd0 legacy=0x7f5ecc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ecb59e700 1 -- 172.21.15.148:0/2720420870 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0c0950 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ecb59e700 1 --2- 172.21.15.148:0/2720420870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f5ecc05ff70 tx=0x7f5ec4009840).ready entity=mon.0 client_cookie=7dc92d834e733bc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5eca59c700 1 -- 172.21.15.148:0/2720420870 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400e070 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5eca59c700 1 -- 172.21.15.148:0/2720420870 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec400ba20 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5eca59c700 1 -- 172.21.15.148:0/2720420870 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400bda0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 -- 172.21.15.148:0/2720420870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 msgr2=0x7f5ecc0c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 --2- 172.21.15.148:0/2720420870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f5ecc05ff70 tx=0x7f5ec4009840).stop 2023-10-24T00:29:21.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 -- 172.21.15.148:0/2720420870 shutdown_connections 2023-10-24T00:29:21.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 --2- 172.21.15.148:0/2720420870 >> v2:172.21.15.150:3300/0 conn(0x7f5ecc154430 0x7f5ecc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 --2- 172.21.15.148:0/2720420870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0c0460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 -- 172.21.15.148:0/2720420870 >> 172.21.15.148:0/2720420870 conn(0x7f5ecc0cb070 msgr2=0x7f5ecc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 -- 172.21.15.148:0/2720420870 shutdown_connections 2023-10-24T00:29:21.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.423+0000 7f5ed1198700 1 -- 172.21.15.148:0/2720420870 wait complete. 2023-10-24T00:29:21.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 Processor -- start 2023-10-24T00:29:21.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 -- start start 2023-10-24T00:29:21.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ecc098bd0 0x7f5ecc1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ecc154430 0x7f5ecc0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0af5d0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.425+0000 7f5ed1198700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0ae9c0 con 0x7f5ecc154430 2023-10-24T00:29:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ed1198700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0aeca0 con 0x7f5ecc098bd0 2023-10-24T00:29:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36654/0 (socket says 172.21.15.148:36654) 2023-10-24T00:29:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 -- 172.21.15.148:0/387916224 learned_addr learned my addr 172.21.15.148:0/387916224 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ecb59e700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ecc154430 0x7f5ecc0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ecad9d700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ecc098bd0 0x7f5ecc1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 -- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ecc098bd0 msgr2=0x7f5ecc1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ecc098bd0 0x7f5ecc1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 -- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ecc154430 msgr2=0x7f5ecc0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ecc154430 0x7f5ecc0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 -- 172.21.15.148:0/387916224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009ae0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec259c700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5eb400c4c0 tx=0x7f5eb4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400ce70 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4001e90 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc0aef80 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4007250 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.426+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc1517e0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.427+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc06c6b0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.427+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5eb40066a0 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.428+0000 7f5ec37fe700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 0x7f5eac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.428+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5eb4079a90 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.428+0000 7f5ecad9d700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 0x7f5eac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.428+0000 7f5ecad9d700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 0x7f5eac061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5ebc009b90 tx=0x7f5ebc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.432+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5eb404ad60 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.593+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ecc062c40 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.594+0000 7f5ec37fe700 1 -- 172.21.15.148:0/387916224 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5eb404e380 con 0x7f5ecc0bffd0 2023-10-24T00:29:21.597 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:21.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.595+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 msgr2=0x7f5eac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.595+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 0x7f5eac061610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5ebc009b90 tx=0x7f5ebc009060).stop 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 msgr2=0x7f5ecc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5eb400c4c0 tx=0x7f5eb4007e00).stop 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 shutdown_connections 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ecc154430 0x7f5ecc0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ecc098bd0 0x7f5ecc1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5eac05f150 0x7f5eac061610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 --2- 172.21.15.148:0/387916224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ecc0bffd0 0x7f5ecc0ae000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 >> 172.21.15.148:0/387916224 conn(0x7f5ecc0cb070 msgr2=0x7f5ecc154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 shutdown_connections 2023-10-24T00:29:21.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.596+0000 7f5ed1198700 1 -- 172.21.15.148:0/387916224 wait complete. 2023-10-24T00:29:21.610 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:21.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.725+0000 7f6930ecc700 1 Processor -- start 2023-10-24T00:29:21.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.725+0000 7f6930ecc700 1 -- start start 2023-10-24T00:29:21.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6930ecc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f692c152290 0x7f692c155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6930ecc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c155c00 con 0x7f692c0c6240 2023-10-24T00:29:21.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6930ecc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0c7b80 con 0x7f692c0c66c0 2023-10-24T00:29:21.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6930ecc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c0c8800 con 0x7f692c152290 2023-10-24T00:29:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6921d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f692c0c6240 0x7f692c0c0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33258/0 (socket says 172.21.15.148:33258) 2023-10-24T00:29:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6921d9b700 1 -- 172.21.15.148:0/461780312 learned_addr learned my addr 172.21.15.148:0/461780312 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f692a59c700 1 --2- 172.21.15.148:0/461780312 >> v2:172.21.15.150:3300/0 conn(0x7f692c152290 0x7f692c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239682146 0 0) 0x7f692c155c00 con 0x7f692c0c6240 2023-10-24T00:29:21.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.726+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69180033f0 con 0x7f692c0c6240 2023-10-24T00:29:21.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327925777 0 0) 0x7f692c0c7b80 con 0x7f692c0c66c0 2023-10-24T00:29:21.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f692c155c00 con 0x7f692c0c66c0 2023-10-24T00:29:21.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 318821435 0 0) 0x7f69180033f0 con 0x7f692c0c6240 2023-10-24T00:29:21.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f692a59c700 1 -- 172.21.15.148:0/461780312 >> v1:172.21.15.150:6789/0 conn(0x7f692c0c66c0 legacy=0x7f692c0c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f692a59c700 1 -- 172.21.15.148:0/461780312 >> v1:172.21.15.148:6789/0 conn(0x7f692c0c6240 legacy=0x7f692c0c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f692a59c700 1 -- 172.21.15.148:0/461780312 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0c7e60 con 0x7f692c152290 2023-10-24T00:29:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f692a59c700 1 --2- 172.21.15.148:0/461780312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c155710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f691c009760 tx=0x7f691c009060).ready entity=mon.1 client_cookie=cb1cfff18d5df124 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914001470 con 0x7f692c152290 2023-10-24T00:29:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0090d0 con 0x7f692c152290 2023-10-24T00:29:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6929d9b700 1 -- 172.21.15.148:0/461780312 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011610 con 0x7f692c152290 2023-10-24T00:29:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6930ecc700 1 -- 172.21.15.148:0/461780312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 msgr2=0x7f692c155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.727+0000 7f6930ecc700 1 --2- 172.21.15.148:0/461780312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c155710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f691c009760 tx=0x7f691c009060).stop 2023-10-24T00:29:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.728+0000 7f6930ecc700 1 -- 172.21.15.148:0/461780312 shutdown_connections 2023-10-24T00:29:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.728+0000 7f6930ecc700 1 --2- 172.21.15.148:0/461780312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c155710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.728+0000 7f6930ecc700 1 -- 172.21.15.148:0/461780312 >> 172.21.15.148:0/461780312 conn(0x7f692c0946c0 msgr2=0x7f692c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.728+0000 7f6930ecc700 1 -- 172.21.15.148:0/461780312 shutdown_connections 2023-10-24T00:29:21.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.728+0000 7f6930ecc700 1 -- 172.21.15.148:0/461780312 wait complete. 2023-10-24T00:29:21.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 Processor -- start 2023-10-24T00:29:21.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 -- start start 2023-10-24T00:29:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f692c0c6240 0x7f692c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.729+0000 7f6930ecc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c153530 con 0x7f692c0c66c0 2023-10-24T00:29:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6930ecc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1541d0 con 0x7f692c152290 2023-10-24T00:29:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6930ecc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0c2b40 con 0x7f692c0c6240 2023-10-24T00:29:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36656/0 (socket says 172.21.15.148:36656) 2023-10-24T00:29:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 -- 172.21.15.148:0/210460141 learned_addr learned my addr 172.21.15.148:0/210460141 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f692a59c700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f692c0c6240 0x7f692c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f692ad9d700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 -- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f692c0c6240 msgr2=0x7f692c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f692c0c6240 0x7f692c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 -- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 msgr2=0x7f692c1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c1591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 -- 172.21.15.148:0/210460141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0092a0 con 0x7f692c0c66c0 2023-10-24T00:29:21.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6921d9b700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f691400c830 tx=0x7f6914001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914007170 con 0x7f692c0c66c0 2023-10-24T00:29:21.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140072d0 con 0x7f692c0c66c0 2023-10-24T00:29:21.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140048c0 con 0x7f692c0c66c0 2023-10-24T00:29:21.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c14d330 con 0x7f692c0c66c0 2023-10-24T00:29:21.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.730+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c0b0760 con 0x7f692c0c66c0 2023-10-24T00:29:21.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.731+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c06c6b0 con 0x7f692c0c66c0 2023-10-24T00:29:21.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.732+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6914004c30 con 0x7f692c0c66c0 2023-10-24T00:29:21.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.732+0000 7f6922ffd700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 0x7f690c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:21.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.732+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6914079970 con 0x7f692c0c66c0 2023-10-24T00:29:21.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.732+0000 7f692a59c700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 0x7f690c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:21.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.733+0000 7f692a59c700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 0x7f690c061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f691c009760 tx=0x7f691c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:21.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.736+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f691404abe0 con 0x7f692c0c66c0 2023-10-24T00:29:21.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.901+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f692c14d330 con 0x7f692c0c66c0 2023-10-24T00:29:21.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.902+0000 7f6922ffd700 1 -- 172.21.15.148:0/210460141 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f692c14d330 con 0x7f692c0c66c0 2023-10-24T00:29:21.905 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:21.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.903+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 msgr2=0x7f690c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 0x7f690c061610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f691c009760 tx=0x7f691c016000).stop 2023-10-24T00:29:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 msgr2=0x7f692c153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f691400c830 tx=0x7f6914001ab0).stop 2023-10-24T00:29:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 shutdown_connections 2023-10-24T00:29:21.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f692c152290 0x7f692c1591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f692c0c6240 0x7f692c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f690c05f150 0x7f690c061610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 --2- 172.21.15.148:0/210460141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f692c0c66c0 0x7f692c153040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 >> 172.21.15.148:0/210460141 conn(0x7f692c0946c0 msgr2=0x7f692c0c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:21.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 shutdown_connections 2023-10-24T00:29:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:21.904+0000 7f6930ecc700 1 -- 172.21.15.148:0/210460141 wait complete. 2023-10-24T00:29:21.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.031+0000 7fda80455700 1 Processor -- start 2023-10-24T00:29:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.031+0000 7fda80455700 1 -- start start 2023-10-24T00:29:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda80455700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda78154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda80455700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda80455700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780c0970 con 0x7fda78154430 2023-10-24T00:29:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda80455700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780c6a10 con 0x7fda780bffd0 2023-10-24T00:29:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda80455700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c71d0 con 0x7fda78098bd0 2023-10-24T00:29:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda7e9f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda7e9f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36660/0 (socket says 172.21.15.148:36660) 2023-10-24T00:29:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda7e9f2700 1 -- 172.21.15.148:0/2249397414 learned_addr learned my addr 172.21.15.148:0/2249397414 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.032+0000 7fda7d9f0700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda78154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7e9f2700 1 -- 172.21.15.148:0/2249397414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 msgr2=0x7fda78154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7e9f2700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda78154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7d1ef700 1 -- 172.21.15.148:0/2249397414 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679868505 0 0) 0x7fda68001490 con 0x7fda78154430 2023-10-24T00:29:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7e9f2700 1 -- 172.21.15.148:0/2249397414 >> v1:172.21.15.150:6789/0 conn(0x7fda78154430 legacy=0x7fda780c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7e9f2700 1 -- 172.21.15.148:0/2249397414 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780c9410 con 0x7fda780bffd0 2023-10-24T00:29:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7e9f2700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fda70009830 tx=0x7fda700090f0).ready entity=mon.0 client_cookie=ecc59f291195c1db server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7d1ef700 1 -- 172.21.15.148:0/2249397414 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000b580 con 0x7fda780bffd0 2023-10-24T00:29:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7d1ef700 1 -- 172.21.15.148:0/2249397414 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000b6e0 con 0x7fda780bffd0 2023-10-24T00:29:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda7d1ef700 1 -- 172.21.15.148:0/2249397414 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000ba60 con 0x7fda780bffd0 2023-10-24T00:29:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda80455700 1 -- 172.21.15.148:0/2249397414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 msgr2=0x7fda780c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.033+0000 7fda80455700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fda70009830 tx=0x7fda700090f0).stop 2023-10-24T00:29:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 -- 172.21.15.148:0/2249397414 shutdown_connections 2023-10-24T00:29:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 --2- 172.21.15.148:0/2249397414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda78154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 -- 172.21.15.148:0/2249397414 >> 172.21.15.148:0/2249397414 conn(0x7fda780cb070 msgr2=0x7fda780cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 -- 172.21.15.148:0/2249397414 shutdown_connections 2023-10-24T00:29:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.034+0000 7fda80455700 1 -- 172.21.15.148:0/2249397414 wait complete. 2023-10-24T00:29:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.035+0000 7fda80455700 1 Processor -- start 2023-10-24T00:29:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.035+0000 7fda80455700 1 -- start start 2023-10-24T00:29:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.035+0000 7fda80455700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda7814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.035+0000 7fda80455700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.035+0000 7fda80455700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda780c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda80455700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c2ec0 con 0x7fda780bffd0 2023-10-24T00:29:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda80455700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c22b0 con 0x7fda78154430 2023-10-24T00:29:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda80455700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c2590 con 0x7fda78098bd0 2023-10-24T00:29:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36666/0 (socket says 172.21.15.148:36666) 2023-10-24T00:29:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 -- 172.21.15.148:0/368658596 learned_addr learned my addr 172.21.15.148:0/368658596 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7e9f2700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda780c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7e1f1700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda7814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 -- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 msgr2=0x7fda7814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda7814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 -- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 msgr2=0x7fda780c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda780c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 -- 172.21.15.148:0/368658596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70009370 con 0x7fda780bffd0 2023-10-24T00:29:22.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda7d9f0700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fda6c00e950 tx=0x7fda6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0094f0 con 0x7fda780bffd0 2023-10-24T00:29:22.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c012600 con 0x7fda780bffd0 2023-10-24T00:29:22.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780c2870 con 0x7fda780bffd0 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0129a0 con 0x7fda780bffd0 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.036+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7814d2e0 con 0x7fda780bffd0 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.037+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7806c6b0 con 0x7fda780bffd0 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.038+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda6c012d50 con 0x7fda780bffd0 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.038+0000 7fda767fc700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 0x7fda64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.038+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fda6c07a2f0 con 0x7fda780bffd0 2023-10-24T00:29:22.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.038+0000 7fda7e1f1700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 0x7fda64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.038+0000 7fda7e1f1700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 0x7fda64061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fda68002d80 tx=0x7fda680014b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.042+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fda6c04b5c0 con 0x7fda780bffd0 2023-10-24T00:29:22.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.205+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda780612f0 con 0x7fda780bffd0 2023-10-24T00:29:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.205+0000 7fda767fc700 1 -- 172.21.15.148:0/368658596 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda6c016020 con 0x7fda780bffd0 2023-10-24T00:29:22.208 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 msgr2=0x7fda64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 0x7fda64061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fda68002d80 tx=0x7fda680014b0).stop 2023-10-24T00:29:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 msgr2=0x7fda78152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fda6c00e950 tx=0x7fda6c009060).stop 2023-10-24T00:29:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 shutdown_connections 2023-10-24T00:29:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda780c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda7814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda6405f150 0x7fda64061610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 --2- 172.21.15.148:0/368658596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78152c30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 >> 172.21.15.148:0/368658596 conn(0x7fda780cb070 msgr2=0x7fda7814fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 shutdown_connections 2023-10-24T00:29:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.207+0000 7fda80455700 1 -- 172.21.15.148:0/368658596 wait complete. 2023-10-24T00:29:22.222 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:22.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.332+0000 7f8a9f081700 1 Processor -- start 2023-10-24T00:29:22.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.332+0000 7f8a9f081700 1 -- start start 2023-10-24T00:29:22.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9f081700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a98152400 0x7f8a980bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9f081700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a98065fc0 con 0x7f8a980c45c0 2023-10-24T00:29:22.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9f081700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a980be300 con 0x7f8a98152020 2023-10-24T00:29:22.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9f081700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a98066b60 con 0x7f8a98152400 2023-10-24T00:29:22.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a8ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a98152400 0x7f8a980bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9d61e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8a980c45c0 0x7f8a98063660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33274/0 (socket says 172.21.15.148:33274) 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.333+0000 7f8a9d61e700 1 -- 172.21.15.148:0/3812213433 learned_addr learned my addr 172.21.15.148:0/3812213433 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8ffff700 1 -- 172.21.15.148:0/3812213433 >> v1:172.21.15.150:6789/0 conn(0x7f8a98152020 legacy=0x7f8a98066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8ffff700 1 -- 172.21.15.148:0/3812213433 >> v1:172.21.15.148:6789/0 conn(0x7f8a980c45c0 legacy=0x7f8a98063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8ffff700 1 -- 172.21.15.148:0/3812213433 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a980bca00 con 0x7f8a98152400 2023-10-24T00:29:22.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8f7fe700 1 -- 172.21.15.148:0/3812213433 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537612179 0 0) 0x7f8a98065fc0 con 0x7f8a980c45c0 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8ffff700 1 --2- 172.21.15.148:0/3812213433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a980bc370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8a88009760 tx=0x7f8a88009060).ready entity=mon.0 client_cookie=e5d58633b368e346 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8f7fe700 1 -- 172.21.15.148:0/3812213433 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800b580 con 0x7f8a98152400 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8f7fe700 1 -- 172.21.15.148:0/3812213433 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8800b6e0 con 0x7f8a98152400 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a8f7fe700 1 -- 172.21.15.148:0/3812213433 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800ba60 con 0x7f8a98152400 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a9f081700 1 -- 172.21.15.148:0/3812213433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 msgr2=0x7f8a980bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.334+0000 7f8a9f081700 1 --2- 172.21.15.148:0/3812213433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a980bc370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8a88009760 tx=0x7f8a88009060).stop 2023-10-24T00:29:22.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.335+0000 7f8a9f081700 1 -- 172.21.15.148:0/3812213433 shutdown_connections 2023-10-24T00:29:22.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.335+0000 7f8a9f081700 1 --2- 172.21.15.148:0/3812213433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a980bc370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.335+0000 7f8a9f081700 1 -- 172.21.15.148:0/3812213433 >> 172.21.15.148:0/3812213433 conn(0x7f8a980c7ee0 msgr2=0x7f8a980c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.335+0000 7f8a9f081700 1 -- 172.21.15.148:0/3812213433 shutdown_connections 2023-10-24T00:29:22.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.335+0000 7f8a9f081700 1 -- 172.21.15.148:0/3812213433 wait complete. 2023-10-24T00:29:22.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.336+0000 7f8a9f081700 1 Processor -- start 2023-10-24T00:29:22.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.336+0000 7f8a9f081700 1 -- start start 2023-10-24T00:29:22.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a980c45c0 0x7f8a98165910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a98152020 0x7f8a98150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a98153660 con 0x7f8a98152400 2023-10-24T00:29:22.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a98153940 con 0x7f8a98152020 2023-10-24T00:29:22.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a98153c20 con 0x7f8a980c45c0 2023-10-24T00:29:22.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36676/0 (socket says 172.21.15.148:36676) 2023-10-24T00:29:22.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 -- 172.21.15.148:0/538878485 learned_addr learned my addr 172.21.15.148:0/538878485 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:22.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a8ffff700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a98152020 0x7f8a98150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9ce1d700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a980c45c0 0x7f8a98165910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 -- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a980c45c0 msgr2=0x7f8a98165910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a980c45c0 0x7f8a98165910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 -- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a98152020 msgr2=0x7f8a98150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a98152020 0x7f8a98150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 -- 172.21.15.148:0/538878485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a880092a0 con 0x7f8a98152400 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9d61e700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8a90001eb0 tx=0x7f8a90007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a900070d0 con 0x7f8a98152400 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90007230 con 0x7f8a98152400 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a980aba30 con 0x7f8a98152400 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a900075f0 con 0x7f8a98152400 2023-10-24T00:29:22.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.337+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a98150b20 con 0x7f8a98152400 2023-10-24T00:29:22.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.338+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a980abf50 con 0x7f8a98152400 2023-10-24T00:29:22.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.338+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8a900059b0 con 0x7f8a98152400 2023-10-24T00:29:22.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.339+0000 7f8a8cff9700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 0x7f8a84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.339+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a90079900 con 0x7f8a98152400 2023-10-24T00:29:22.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.339+0000 7f8a9ce1d700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 0x7f8a84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.339+0000 7f8a9ce1d700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 0x7f8a84061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8a94002d50 tx=0x7f8a940015c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.343+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8a980abf50 con 0x7f8a98152400 2023-10-24T00:29:22.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.504+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a980abf50 con 0x7f8a98152400 2023-10-24T00:29:22.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.505+0000 7f8a8cff9700 1 -- 172.21.15.148:0/538878485 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f8a980abf50 con 0x7f8a98152400 2023-10-24T00:29:22.508 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:22.508 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:22.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 msgr2=0x7f8a84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 0x7f8a84061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8a94002d50 tx=0x7f8a940015c0).stop 2023-10-24T00:29:22.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 msgr2=0x7f8a98150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8a90001eb0 tx=0x7f8a90007bb0).stop 2023-10-24T00:29:22.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 shutdown_connections 2023-10-24T00:29:22.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a8405f150 0x7f8a84061610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a98152400 0x7f8a98150630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a980c45c0 0x7f8a98165910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 --2- 172.21.15.148:0/538878485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a98152020 0x7f8a98150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 >> 172.21.15.148:0/538878485 conn(0x7f8a980c7ee0 msgr2=0x7f8a980c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 shutdown_connections 2023-10-24T00:29:22.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.507+0000 7f8a9f081700 1 -- 172.21.15.148:0/538878485 wait complete. 2023-10-24T00:29:22.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:22.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:22.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.636+0000 7fb845a35700 1 Processor -- start 2023-10-24T00:29:22.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.636+0000 7fb845a35700 1 -- start start 2023-10-24T00:29:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb845a35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb840154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb845a35700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400c71d0 con 0x7fb840098bd0 2023-10-24T00:29:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb845a35700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400c9410 con 0x7fb840154430 2023-10-24T00:29:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb845a35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6a10 con 0x7fb8400c06e0 2023-10-24T00:29:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83e7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb840098bd0 0x7fb8400bffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33278/0 (socket says 172.21.15.148:33278) 2023-10-24T00:29:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83e7fc700 1 -- 172.21.15.148:0/3402001147 learned_addr learned my addr 172.21.15.148:0/3402001147 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb840154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088465981 0 0) 0x7fb8400c71d0 con 0x7fb840098bd0 2023-10-24T00:29:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8280033f0 con 0x7fb840098bd0 2023-10-24T00:29:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825551250 0 0) 0x7fb8280033f0 con 0x7fb840098bd0 2023-10-24T00:29:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 msgr2=0x7fb840154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb840154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 >> v1:172.21.15.150:6789/0 conn(0x7fb840154430 legacy=0x7fb8400c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400ca8b0 con 0x7fb840098bd0 2023-10-24T00:29:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fb8340017f0 con 0x7fb840098bd0 2023-10-24T00:29:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 >> v1:172.21.15.148:6789/0 conn(0x7fb840098bd0 legacy=0x7fb8400bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.637+0000 7fb83dffb700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb828003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb828003e00 0x7fb828004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb828004b80 0x7fb828005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6a10 con 0x7fb828004b80 2023-10-24T00:29:22.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82800b8e0 con 0x7fb828003e00 2023-10-24T00:29:22.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82800baa0 con 0x7fb8400c06e0 2023-10-24T00:29:22.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb828004b80 0x7fb828005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83e7fc700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb828003e00 0x7fb828004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83effd700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb828003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 -- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 msgr2=0x7fb828003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:22.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8400c06e0 0x7fb828003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 -- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb828003e00 msgr2=0x7fb828004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:22.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb828003e00 0x7fb828004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 -- 172.21.15.148:0/3402001147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280033f0 con 0x7fb828004b80 2023-10-24T00:29:22.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb828004b80 0x7fb828005000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb830009a80 tx=0x7fb830009060).ready entity=mon.0 client_cookie=12ad8dc7b5b8a8a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830009430 con 0x7fb828004b80 2023-10-24T00:29:22.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000e640 con 0x7fb828004b80 2023-10-24T00:29:22.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.638+0000 7fb83dffb700 1 -- 172.21.15.148:0/3402001147 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000e9c0 con 0x7fb828004b80 2023-10-24T00:29:22.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 -- 172.21.15.148:0/3402001147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb828004b80 msgr2=0x7fb828005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 --2- 172.21.15.148:0/3402001147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb828004b80 0x7fb828005000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb830009a80 tx=0x7fb830009060).stop 2023-10-24T00:29:22.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb83f7fe700 1 -- 172.21.15.148:0/3402001147 reap_dead start 2023-10-24T00:29:22.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 -- 172.21.15.148:0/3402001147 shutdown_connections 2023-10-24T00:29:22.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 -- 172.21.15.148:0/3402001147 >> 172.21.15.148:0/3402001147 conn(0x7fb8400cb070 msgr2=0x7fb8400cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 -- 172.21.15.148:0/3402001147 shutdown_connections 2023-10-24T00:29:22.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.639+0000 7fb845a35700 1 -- 172.21.15.148:0/3402001147 wait complete. 2023-10-24T00:29:22.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.640+0000 7fb845a35700 1 Processor -- start 2023-10-24T00:29:22.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.640+0000 7fb845a35700 1 -- start start 2023-10-24T00:29:22.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8400ae000 0x7fb840152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb840142f60 0x7fb8401533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401538a0 con 0x7fb840142b80 2023-10-24T00:29:22.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb840164610 con 0x7fb8400ae000 2023-10-24T00:29:22.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb845a35700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400ae500 con 0x7fb840142f60 2023-10-24T00:29:22.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36690/0 (socket says 172.21.15.148:36690) 2023-10-24T00:29:22.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 -- 172.21.15.148:0/1593357747 learned_addr learned my addr 172.21.15.148:0/1593357747 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:22.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83e7fc700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8400ae000 0x7fb840152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83f7fe700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb840142f60 0x7fb8401533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 -- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb840142f60 msgr2=0x7fb8401533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb840142f60 0x7fb8401533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 -- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8400ae000 msgr2=0x7fb840152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8400ae000 0x7fb840152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 -- 172.21.15.148:0/1593357747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400ae7e0 con 0x7fb840142b80 2023-10-24T00:29:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.641+0000 7fb83effd700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb8380078e0 tx=0x7fb838007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.642+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800f610 con 0x7fb840142b80 2023-10-24T00:29:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.642+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800f770 con 0x7fb840142b80 2023-10-24T00:29:22.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.642+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400aeac0 con 0x7fb840142b80 2023-10-24T00:29:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.642+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800faf0 con 0x7fb840142b80 2023-10-24T00:29:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.642+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400c3d70 con 0x7fb840142b80 2023-10-24T00:29:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.643+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84006c6b0 con 0x7fb840142b80 2023-10-24T00:29:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.643+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb83801d3b0 con 0x7fb840142b80 2023-10-24T00:29:22.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.643+0000 7fb826ffd700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.643+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb83807a0b0 con 0x7fb840142b80 2023-10-24T00:29:22.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.644+0000 7fb83e7fc700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.644+0000 7fb83e7fc700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 0x7fb82c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb834007d50 tx=0x7fb834009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.647+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb83804b320 con 0x7fb840142b80 2023-10-24T00:29:22.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.808+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb8400c6c10 con 0x7fb840142b80 2023-10-24T00:29:22.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.811+0000 7fb826ffd700 1 -- 172.21.15.148:0/1593357747 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb8400c6c10 con 0x7fb840142b80 2023-10-24T00:29:22.813 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:22.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 msgr2=0x7fb82c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 0x7fb82c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb834007d50 tx=0x7fb834009040).stop 2023-10-24T00:29:22.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 msgr2=0x7fb8400c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb8380078e0 tx=0x7fb838007b90).stop 2023-10-24T00:29:22.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 shutdown_connections 2023-10-24T00:29:22.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb840142f60 0x7fb8401533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb840142b80 0x7fb8400c3880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 --2- 172.21.15.148:0/1593357747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8400ae000 0x7fb840152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 >> 172.21.15.148:0/1593357747 conn(0x7fb8400cb070 msgr2=0x7fb8400a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 shutdown_connections 2023-10-24T00:29:22.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.813+0000 7fb845a35700 1 -- 172.21.15.148:0/1593357747 wait complete. 2023-10-24T00:29:22.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.942+0000 7fcf51ee5700 1 Processor -- start 2023-10-24T00:29:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.942+0000 7fcf51ee5700 1 -- start start 2023-10-24T00:29:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf51ee5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf4c1378e0 0x7fcf4c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf51ee5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf51ee5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c06a6f0 con 0x7fcf4c137500 2023-10-24T00:29:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf51ee5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0bc5b0 con 0x7fcf4c1378e0 2023-10-24T00:29:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf51ee5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0bbc80 con 0x7fcf4c069e70 2023-10-24T00:29:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcf4c137500 0x7fcf4c0c11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33286/0 (socket says 172.21.15.148:33286) 2023-10-24T00:29:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4b7fe700 1 -- 172.21.15.148:0/2305885288 learned_addr learned my addr 172.21.15.148:0/2305885288 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4affd700 1 --2- 172.21.15.148:0/2305885288 >> v2:172.21.15.148:3300/0 conn(0x7fcf4c1378e0 0x7fcf4c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4bfff700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4a7fc700 1 -- 172.21.15.148:0/2305885288 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349322343 0 0) 0x7fcf4c06a6f0 con 0x7fcf4c137500 2023-10-24T00:29:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4a7fc700 1 -- 172.21.15.148:0/2305885288 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf340033f0 con 0x7fcf4c137500 2023-10-24T00:29:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4affd700 1 -- 172.21.15.148:0/2305885288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 msgr2=0x7fcf4c1515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4affd700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c1515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4affd700 1 -- 172.21.15.148:0/2305885288 >> v1:172.21.15.148:6789/0 conn(0x7fcf4c137500 legacy=0x7fcf4c0c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.943+0000 7fcf4affd700 1 -- 172.21.15.148:0/2305885288 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0bbf60 con 0x7fcf4c1378e0 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf4affd700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c1521e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fcf40009760 tx=0x7fcf40009060).ready entity=mon.0 client_cookie=7a4c3cb9dd1e8175 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf4a7fc700 1 -- 172.21.15.148:0/2305885288 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400090d0 con 0x7fcf4c1378e0 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf4a7fc700 1 -- 172.21.15.148:0/2305885288 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000d4a0 con 0x7fcf4c1378e0 2023-10-24T00:29:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf4a7fc700 1 -- 172.21.15.148:0/2305885288 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000d820 con 0x7fcf4c1378e0 2023-10-24T00:29:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 -- 172.21.15.148:0/2305885288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c1378e0 msgr2=0x7fcf4c1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c1521e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fcf40009760 tx=0x7fcf40009060).stop 2023-10-24T00:29:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 -- 172.21.15.148:0/2305885288 shutdown_connections 2023-10-24T00:29:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c1515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/2305885288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c1521e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 -- 172.21.15.148:0/2305885288 >> 172.21.15.148:0/2305885288 conn(0x7fcf4c0c6bf0 msgr2=0x7fcf4c0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 -- 172.21.15.148:0/2305885288 shutdown_connections 2023-10-24T00:29:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.944+0000 7fcf51ee5700 1 -- 172.21.15.148:0/2305885288 wait complete. 2023-10-24T00:29:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 Processor -- start 2023-10-24T00:29:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 -- start start 2023-10-24T00:29:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c154450 con 0x7fcf4c137500 2023-10-24T00:29:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c152c40 con 0x7fcf4c1378e0 2023-10-24T00:29:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf51ee5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c152ec0 con 0x7fcf4c069e70 2023-10-24T00:29:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.946+0000 7fcf4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36704/0 (socket says 172.21.15.148:36704) 2023-10-24T00:29:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 -- 172.21.15.148:0/1920584470 learned_addr learned my addr 172.21.15.148:0/1920584470 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4b7fe700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4bfff700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 -- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 msgr2=0x7fcf4c153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 -- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf4c1378e0 msgr2=0x7fcf4c14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 -- 172.21.15.148:0/1920584470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400092a0 con 0x7fcf4c137500 2023-10-24T00:29:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf4affd700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fcf40010000 tx=0x7fcf40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40006910 con 0x7fcf4c137500 2023-10-24T00:29:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40012770 con 0x7fcf4c137500 2023-10-24T00:29:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c1531a0 con 0x7fcf4c137500 2023-10-24T00:29:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40012b10 con 0x7fcf4c137500 2023-10-24T00:29:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.947+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c153760 con 0x7fcf4c137500 2023-10-24T00:29:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.948+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0acd10 con 0x7fcf4c137500 2023-10-24T00:29:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.948+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcf40026460 con 0x7fcf4c137500 2023-10-24T00:29:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.949+0000 7fcf337fe700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 0x7fcf38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.949+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcf4007b420 con 0x7fcf4c137500 2023-10-24T00:29:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.949+0000 7fcf4b7fe700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 0x7fcf38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.949+0000 7fcf4b7fe700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 0x7fcf38061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fcf3c005750 tx=0x7fcf3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:22.953+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf4004c690 con 0x7fcf4c137500 2023-10-24T00:29:23.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.117+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf4c06c6b0 con 0x7fcf4c137500 2023-10-24T00:29:23.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.117+0000 7fcf337fe700 1 -- 172.21.15.148:0/1920584470 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf4004fcb0 con 0x7fcf4c137500 2023-10-24T00:29:23.120 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:23.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 msgr2=0x7fcf38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 0x7fcf38061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fcf3c005750 tx=0x7fcf3c009040).stop 2023-10-24T00:29:23.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 msgr2=0x7fcf4c152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fcf40010000 tx=0x7fcf40016000).stop 2023-10-24T00:29:23.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 shutdown_connections 2023-10-24T00:29:23.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf4c1378e0 0x7fcf4c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf4c069e70 0x7fcf4c153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf3805f150 0x7fcf38061610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 --2- 172.21.15.148:0/1920584470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf4c137500 0x7fcf4c152750 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 >> 172.21.15.148:0/1920584470 conn(0x7fcf4c0c6bf0 msgr2=0x7fcf4c0c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 shutdown_connections 2023-10-24T00:29:23.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.119+0000 7fcf51ee5700 1 -- 172.21.15.148:0/1920584470 wait complete. 2023-10-24T00:29:23.134 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:23.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.247+0000 7fab1b34f700 1 Processor -- start 2023-10-24T00:29:23.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.247+0000 7fab1b34f700 1 -- start start 2023-10-24T00:29:23.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab1b34f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fab14154430 0x7fab14154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab1b34f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fab140bffd0 0x7fab140c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab1b34f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab140c71d0 con 0x7fab14098bd0 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab1b34f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab140c6a10 con 0x7fab140bffd0 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab1b34f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab140c9410 con 0x7fab14154430 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab198ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fab140bffd0 0x7fab140c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab188ea700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fab14098bd0 0x7fab140c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:33288/0 (socket says 172.21.15.148:33288) 2023-10-24T00:29:23.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab188ea700 1 -- 172.21.15.148:0/3331348805 learned_addr learned my addr 172.21.15.148:0/3331348805 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:23.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab190eb700 1 --2- 172.21.15.148:0/3331348805 >> v2:172.21.15.150:3300/0 conn(0x7fab14154430 0x7fab14154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab198ec700 1 -- 172.21.15.148:0/3331348805 >> v2:172.21.15.150:3300/0 conn(0x7fab14154430 msgr2=0x7fab14154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:23.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab198ec700 1 --2- 172.21.15.148:0/3331348805 >> v2:172.21.15.150:3300/0 conn(0x7fab14154430 0x7fab14154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab198ec700 1 -- 172.21.15.148:0/3331348805 >> v1:172.21.15.148:6789/0 conn(0x7fab14098bd0 legacy=0x7fab140c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab198ec700 1 -- 172.21.15.148:0/3331348805 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140c0950 con 0x7fab140bffd0 2023-10-24T00:29:23.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.248+0000 7fab0bfff700 1 -- 172.21.15.148:0/3331348805 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878339106 0 0) 0x7fab140c71d0 con 0x7fab14098bd0 2023-10-24T00:29:23.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab198ec700 1 --2- 172.21.15.148:0/3331348805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab140bffd0 0x7fab140c0460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fab1405ff70 tx=0x7fab0c009060).ready entity=mon.0 client_cookie=2bd5eb34a3328af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab0bfff700 1 -- 172.21.15.148:0/3331348805 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00b580 con 0x7fab140bffd0 2023-10-24T00:29:23.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab0bfff700 1 -- 172.21.15.148:0/3331348805 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c00b6e0 con 0x7fab140bffd0 2023-10-24T00:29:23.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab0bfff700 1 -- 172.21.15.148:0/3331348805 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00ba60 con 0x7fab140bffd0 2023-10-24T00:29:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 -- 172.21.15.148:0/3331348805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab140bffd0 msgr2=0x7fab140c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 --2- 172.21.15.148:0/3331348805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab140bffd0 0x7fab140c0460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fab1405ff70 tx=0x7fab0c009060).stop 2023-10-24T00:29:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 -- 172.21.15.148:0/3331348805 shutdown_connections 2023-10-24T00:29:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 --2- 172.21.15.148:0/3331348805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab140bffd0 0x7fab140c0460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 --2- 172.21.15.148:0/3331348805 >> v2:172.21.15.150:3300/0 conn(0x7fab14154430 0x7fab14154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 -- 172.21.15.148:0/3331348805 >> 172.21.15.148:0/3331348805 conn(0x7fab140cb070 msgr2=0x7fab140cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 -- 172.21.15.148:0/3331348805 shutdown_connections 2023-10-24T00:29:23.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.249+0000 7fab1b34f700 1 -- 172.21.15.148:0/3331348805 wait complete. 2023-10-24T00:29:23.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.250+0000 7fab1b34f700 1 Processor -- start 2023-10-24T00:29:23.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.250+0000 7fab1b34f700 1 -- start start 2023-10-24T00:29:23.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab140bffd0 0x7fab140ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 0x7fab140aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab140c5340 con 0x7fab14098bd0 2023-10-24T00:29:23.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1414ef80 con 0x7fab140bffd0 2023-10-24T00:29:23.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab1b34f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab14159cd0 con 0x7fab14154430 2023-10-24T00:29:23.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab190eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab190eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36722/0 (socket says 172.21.15.148:36722) 2023-10-24T00:29:23.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.251+0000 7fab190eb700 1 -- 172.21.15.148:0/4035654248 learned_addr learned my addr 172.21.15.148:0/4035654248 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:23.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab188ea700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab140bffd0 0x7fab140ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab198ec700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 0x7fab140aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 -- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 msgr2=0x7fab140aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 0x7fab140aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 -- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab140bffd0 msgr2=0x7fab140ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab140bffd0 0x7fab140ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 -- 172.21.15.148:0/4035654248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0092a0 con 0x7fab14098bd0 2023-10-24T00:29:23.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab198ec700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 0x7fab140aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab190eb700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fab10009fa0 tx=0x7fab10009880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000ed20 con 0x7fab14098bd0 2023-10-24T00:29:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000ee80 con 0x7fab14098bd0 2023-10-24T00:29:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1414e400 con 0x7fab14098bd0 2023-10-24T00:29:23.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10014610 con 0x7fab14098bd0 2023-10-24T00:29:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.252+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1414e9c0 con 0x7fab14098bd0 2023-10-24T00:29:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.253+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1406c6b0 con 0x7fab14098bd0 2023-10-24T00:29:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.253+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fab10014a00 con 0x7fab14098bd0 2023-10-24T00:29:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.254+0000 7fab097fa700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 0x7faaf8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.254+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fab1007a1b0 con 0x7fab14098bd0 2023-10-24T00:29:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.254+0000 7fab188ea700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 0x7faaf8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.254+0000 7fab188ea700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 0x7faaf8061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fab040011e0 tx=0x7fab04009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.258+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fab1004aaf0 con 0x7fab14098bd0 2023-10-24T00:29:23.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.420+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab140612f0 con 0x7fab14098bd0 2023-10-24T00:29:23.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.421+0000 7fab097fa700 1 -- 172.21.15.148:0/4035654248 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab1004b4d0 con 0x7fab14098bd0 2023-10-24T00:29:23.424 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:23.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 msgr2=0x7faaf8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 0x7faaf8061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fab040011e0 tx=0x7fab04009040).stop 2023-10-24T00:29:23.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 msgr2=0x7fab140ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fab10009fa0 tx=0x7fab10009880).stop 2023-10-24T00:29:23.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 shutdown_connections 2023-10-24T00:29:23.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab14154430 0x7fab140aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faaf805f150 0x7faaf8061610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab14098bd0 0x7fab140ad2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 --2- 172.21.15.148:0/4035654248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab140bffd0 0x7fab140ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 >> 172.21.15.148:0/4035654248 conn(0x7fab140cb070 msgr2=0x7fab14064b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 shutdown_connections 2023-10-24T00:29:23.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.422+0000 7fab1b34f700 1 -- 172.21.15.148:0/4035654248 wait complete. 2023-10-24T00:29:23.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.550+0000 7f7950340700 1 Processor -- start 2023-10-24T00:29:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.550+0000 7f7950340700 1 -- start start 2023-10-24T00:29:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7948098bd0 0x7f79480c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79480bffd0 0x7f79480c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79480c0970 con 0x7f7948098bd0 2023-10-24T00:29:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79480c71d0 con 0x7f79480bffd0 2023-10-24T00:29:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f7950340700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79480c9410 con 0x7f7948154430 2023-10-24T00:29:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794d8db700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7948098bd0 0x7f79480c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794d8db700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7948098bd0 0x7f79480c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56040/0 (socket says 172.21.15.148:56040) 2023-10-24T00:29:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794d8db700 1 -- 172.21.15.148:0/3071201141 learned_addr learned my addr 172.21.15.148:0/3071201141 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794e0dc700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794e8dd700 1 --2- 172.21.15.148:0/3071201141 >> v2:172.21.15.150:3300/0 conn(0x7f79480bffd0 0x7f79480c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.551+0000 7f794d8db700 1 -- 172.21.15.148:0/3071201141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 msgr2=0x7f7948154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d8db700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d8db700 1 -- 172.21.15.148:0/3071201141 >> v2:172.21.15.150:3300/0 conn(0x7f79480bffd0 msgr2=0x7f79480c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d8db700 1 --2- 172.21.15.148:0/3071201141 >> v2:172.21.15.150:3300/0 conn(0x7f79480bffd0 0x7f79480c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d8db700 1 -- 172.21.15.148:0/3071201141 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480c6c10 con 0x7f7948098bd0 2023-10-24T00:29:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d8db700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7948098bd0 0x7f79480c6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f7938006fd0 tx=0x7f79380090f0).ready entity=mon.0 client_cookie=7e8da3928fa74b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d0da700 1 -- 172.21.15.148:0/3071201141 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800f510 con 0x7f7948098bd0 2023-10-24T00:29:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d0da700 1 -- 172.21.15.148:0/3071201141 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800f670 con 0x7f7948098bd0 2023-10-24T00:29:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f794d0da700 1 -- 172.21.15.148:0/3071201141 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800f9f0 con 0x7f7948098bd0 2023-10-24T00:29:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 -- 172.21.15.148:0/3071201141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7948098bd0 msgr2=0x7f79480c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7948098bd0 0x7f79480c6300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f7938006fd0 tx=0x7f79380090f0).stop 2023-10-24T00:29:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 -- 172.21.15.148:0/3071201141 shutdown_connections 2023-10-24T00:29:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 --2- 172.21.15.148:0/3071201141 >> v2:172.21.15.150:3300/0 conn(0x7f79480bffd0 0x7f79480c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 --2- 172.21.15.148:0/3071201141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7948098bd0 0x7f79480c6300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 -- 172.21.15.148:0/3071201141 >> 172.21.15.148:0/3071201141 conn(0x7f79480cb070 msgr2=0x7f79480cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 -- 172.21.15.148:0/3071201141 shutdown_connections 2023-10-24T00:29:23.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.552+0000 7f7950340700 1 -- 172.21.15.148:0/3071201141 wait complete. 2023-10-24T00:29:23.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.553+0000 7f7950340700 1 Processor -- start 2023-10-24T00:29:23.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.553+0000 7f7950340700 1 -- start start 2023-10-24T00:29:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7948098bd0 0x7f794814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948155d20 con 0x7f79480bffd0 2023-10-24T00:29:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481503b0 con 0x7f7948098bd0 2023-10-24T00:29:23.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f7950340700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79480b0ed0 con 0x7f7948154430 2023-10-24T00:29:23.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f794d8db700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f794d8db700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56046/0 (socket says 172.21.15.148:56046) 2023-10-24T00:29:23.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f794d8db700 1 -- 172.21.15.148:0/868104604 learned_addr learned my addr 172.21.15.148:0/868104604 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:23.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f794e0dc700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7948098bd0 0x7f794814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.554+0000 7f794e8dd700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 -- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 msgr2=0x7f7948155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 -- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7948098bd0 msgr2=0x7f794814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7948098bd0 0x7f794814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 -- 172.21.15.148:0/868104604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938009370 con 0x7f79480bffd0 2023-10-24T00:29:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f794d8db700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f7938011000 tx=0x7f7938017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938006a40 con 0x7f79480bffd0 2023-10-24T00:29:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793800fe80 con 0x7f79480bffd0 2023-10-24T00:29:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7948164400 con 0x7f79480bffd0 2023-10-24T00:29:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793801c420 con 0x7f79480bffd0 2023-10-24T00:29:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.555+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79481649c0 con 0x7f79480bffd0 2023-10-24T00:29:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.556+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794806c6b0 con 0x7f79480bffd0 2023-10-24T00:29:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.556+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f793801c7d0 con 0x7f79480bffd0 2023-10-24T00:29:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.556+0000 7f793e7fc700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 0x7f792c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.557+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f793807bda0 con 0x7f79480bffd0 2023-10-24T00:29:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.557+0000 7f794e0dc700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 0x7f792c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.557+0000 7f794e0dc700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 0x7f792c061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7944009fd0 tx=0x7f794400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.561+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f793804d070 con 0x7f79480bffd0 2023-10-24T00:29:23.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.726+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7948062c40 con 0x7f79480bffd0 2023-10-24T00:29:23.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.727+0000 7f793e7fc700 1 -- 172.21.15.148:0/868104604 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7938020070 con 0x7f79480bffd0 2023-10-24T00:29:23.730 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:23.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 msgr2=0x7f792c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 0x7f792c061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7944009fd0 tx=0x7f794400b040).stop 2023-10-24T00:29:23.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 msgr2=0x7f7948155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f7938011000 tx=0x7f7938017000).stop 2023-10-24T00:29:23.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 shutdown_connections 2023-10-24T00:29:23.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7948154430 0x7f7948155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7948098bd0 0x7f794814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f792c05f150 0x7f792c061610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 --2- 172.21.15.148:0/868104604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79480bffd0 0x7f7948155340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 >> 172.21.15.148:0/868104604 conn(0x7f79480cb070 msgr2=0x7f7948063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 shutdown_connections 2023-10-24T00:29:23.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.729+0000 7f7950340700 1 -- 172.21.15.148:0/868104604 wait complete. 2023-10-24T00:29:23.743 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:23.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.856+0000 7fc7aa890700 1 Processor -- start 2023-10-24T00:29:23.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.856+0000 7fc7aa890700 1 -- start start 2023-10-24T00:29:23.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7a40aa010 0x7fc7a40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7a40c6710 0x7fc7a40aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a4158770 0x7fc7a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40aa8e0 con 0x7fc7a40c6710 2023-10-24T00:29:23.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40c0960 con 0x7fc7a40aa010 2023-10-24T00:29:23.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7aa890700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40c0c40 con 0x7fc7a4158770 2023-10-24T00:29:23.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7a40c6710 0x7fc7a40aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7a40c6710 0x7fc7a40aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56060/0 (socket says 172.21.15.148:56060) 2023-10-24T00:29:23.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 -- 172.21.15.148:0/2038034391 learned_addr learned my addr 172.21.15.148:0/2038034391 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:23.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a8e2d700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a4158770 0x7fc7a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a3fff700 1 --2- 172.21.15.148:0/2038034391 >> v2:172.21.15.150:3300/0 conn(0x7fc7a40aa010 0x7fc7a40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 -- 172.21.15.148:0/2038034391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a4158770 msgr2=0x7fc7a4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:23.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a4158770 0x7fc7a4069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 -- 172.21.15.148:0/2038034391 >> v2:172.21.15.150:3300/0 conn(0x7fc7a40aa010 msgr2=0x7fc7a40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:23.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 --2- 172.21.15.148:0/2038034391 >> v2:172.21.15.150:3300/0 conn(0x7fc7a40aa010 0x7fc7a40c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.857+0000 7fc7a37fe700 1 -- 172.21.15.148:0/2038034391 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40c0f20 con 0x7fc7a40c6710 2023-10-24T00:29:23.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7a37fe700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a40c6710 0x7fc7a40aa3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fc7a4083e30 tx=0x7fc7980090f0).ready entity=mon.0 client_cookie=15cbac440606efaa server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7a2ffd700 1 -- 172.21.15.148:0/2038034391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79800b600 con 0x7fc7a40c6710 2023-10-24T00:29:23.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7a2ffd700 1 -- 172.21.15.148:0/2038034391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79800b760 con 0x7fc7a40c6710 2023-10-24T00:29:23.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7a2ffd700 1 -- 172.21.15.148:0/2038034391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79800bae0 con 0x7fc7a40c6710 2023-10-24T00:29:23.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 -- 172.21.15.148:0/2038034391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a40c6710 msgr2=0x7fc7a40aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a40c6710 0x7fc7a40aa3f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fc7a4083e30 tx=0x7fc7980090f0).stop 2023-10-24T00:29:23.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 -- 172.21.15.148:0/2038034391 shutdown_connections 2023-10-24T00:29:23.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a4158770 0x7fc7a4069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 --2- 172.21.15.148:0/2038034391 >> v2:172.21.15.150:3300/0 conn(0x7fc7a40aa010 0x7fc7a40c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 --2- 172.21.15.148:0/2038034391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a40c6710 0x7fc7a40aa3f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 -- 172.21.15.148:0/2038034391 >> 172.21.15.148:0/2038034391 conn(0x7fc7a40caf40 msgr2=0x7fc7a40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:23.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 -- 172.21.15.148:0/2038034391 shutdown_connections 2023-10-24T00:29:23.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.858+0000 7fc7aa890700 1 -- 172.21.15.148:0/2038034391 wait complete. 2023-10-24T00:29:23.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.859+0000 7fc7aa890700 1 Processor -- start 2023-10-24T00:29:23.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 -- start start 2023-10-24T00:29:23.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a40aa010 0x7fc7a4152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a40c6710 0x7fc7a4169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a41554f0 con 0x7fc7a4158770 2023-10-24T00:29:23.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4152930 con 0x7fc7a40aa010 2023-10-24T00:29:23.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7aa890700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a41548e0 con 0x7fc7a40c6710 2023-10-24T00:29:23.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7a8e2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7a8e2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56070/0 (socket says 172.21.15.148:56070) 2023-10-24T00:29:23.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.860+0000 7fc7a8e2d700 1 -- 172.21.15.148:0/214877452 learned_addr learned my addr 172.21.15.148:0/214877452 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:23.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a37fe700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a40c6710 0x7fc7a4169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 -- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a40c6710 msgr2=0x7fc7a4169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a40c6710 0x7fc7a4169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a3fff700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a40aa010 0x7fc7a4152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 -- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a40aa010 msgr2=0x7fc7a4152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:23.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a40aa010 0x7fc7a4152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:23.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 -- 172.21.15.148:0/214877452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798009370 con 0x7fc7a4158770 2023-10-24T00:29:23.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7a8e2d700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc79c007f20 tx=0x7fc79c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00eca0 con 0x7fc7a4158770 2023-10-24T00:29:23.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c00ee00 con 0x7fc7a4158770 2023-10-24T00:29:23.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4154bc0 con 0x7fc7a4158770 2023-10-24T00:29:23.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c014610 con 0x7fc7a4158770 2023-10-24T00:29:23.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.861+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a4155180 con 0x7fc7a4158770 2023-10-24T00:29:23.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.862+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a4155660 con 0x7fc7a4158770 2023-10-24T00:29:23.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.862+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc79c014980 con 0x7fc7a4158770 2023-10-24T00:29:23.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.863+0000 7fc78bfff700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 0x7fc7900615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:23.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.863+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc79c07a770 con 0x7fc7a4158770 2023-10-24T00:29:23.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.863+0000 7fc7a3fff700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 0x7fc7900615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:23.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.863+0000 7fc7a3fff700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 0x7fc7900615e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc794006fd0 tx=0x7fc794008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:23.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:23.867+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc79c04ba40 con 0x7fc7a4158770 2023-10-24T00:29:24.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.031+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7a406c6b0 con 0x7fc7a4158770 2023-10-24T00:29:24.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.032+0000 7fc78bfff700 1 -- 172.21.15.148:0/214877452 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc79c04f060 con 0x7fc7a4158770 2023-10-24T00:29:24.035 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:24.035 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:24.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 msgr2=0x7fc7900615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 0x7fc7900615e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fc794006fd0 tx=0x7fc794008040).stop 2023-10-24T00:29:24.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 msgr2=0x7fc7a4157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc79c007f20 tx=0x7fc79c009860).stop 2023-10-24T00:29:24.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 shutdown_connections 2023-10-24T00:29:24.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc79005f120 0x7fc7900615e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7a4158770 0x7fc7a4157000 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7a40aa010 0x7fc7a4152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 --2- 172.21.15.148:0/214877452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7a40c6710 0x7fc7a4169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 >> 172.21.15.148:0/214877452 conn(0x7fc7a40caf40 msgr2=0x7fc7a4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 shutdown_connections 2023-10-24T00:29:24.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.034+0000 7fc7aa890700 1 -- 172.21.15.148:0/214877452 wait complete. 2023-10-24T00:29:24.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:24.050 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:24.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.163+0000 7f75c759e700 1 Processor -- start 2023-10-24T00:29:24.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.163+0000 7f75c759e700 1 -- start start 2023-10-24T00:29:24.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.164+0000 7f75c759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f75c8152170 0x7f75c8062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.164+0000 7f75c759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f75c80c52a0 0x7f75c8062b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.164+0000 7f75c759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c8065f40 con 0x7f75c8067b50 2023-10-24T00:29:24.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.164+0000 7f75c759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c8063030 con 0x7f75c80c52a0 2023-10-24T00:29:24.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.164+0000 7f75c759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c8065d30 con 0x7f75c8152170 2023-10-24T00:29:24.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f75c80c52a0 0x7f75c8062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c6d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f75c8067b50 0x7f75c80bcb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46152/0 (socket says 172.21.15.148:46152) 2023-10-24T00:29:24.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c6d9d700 1 -- 172.21.15.148:0/2800140570 learned_addr learned my addr 172.21.15.148:0/2800140570 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:24.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c659c700 1 --2- 172.21.15.148:0/2800140570 >> v2:172.21.15.150:3300/0 conn(0x7f75c8152170 0x7f75c8062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 -- 172.21.15.148:0/2800140570 >> v2:172.21.15.150:3300/0 conn(0x7f75c8152170 msgr2=0x7f75c8062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:24.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 --2- 172.21.15.148:0/2800140570 >> v2:172.21.15.150:3300/0 conn(0x7f75c8152170 0x7f75c8062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 -- 172.21.15.148:0/2800140570 >> v1:172.21.15.148:6789/0 conn(0x7f75c8067b50 legacy=0x7f75c80bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 -- 172.21.15.148:0/2800140570 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8066220 con 0x7f75c80c52a0 2023-10-24T00:29:24.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c559a700 1 -- 172.21.15.148:0/2800140570 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729564454 0 0) 0x7f75c8065f40 con 0x7f75c8067b50 2023-10-24T00:29:24.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c5d9b700 1 --2- 172.21.15.148:0/2800140570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80c52a0 0x7f75c8062b40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f75c805f570 tx=0x7f75bc009060).ready entity=mon.0 client_cookie=59d2ecd4e62ad74e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c559a700 1 -- 172.21.15.148:0/2800140570 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00f510 con 0x7f75c80c52a0 2023-10-24T00:29:24.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c559a700 1 -- 172.21.15.148:0/2800140570 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00f670 con 0x7f75c80c52a0 2023-10-24T00:29:24.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.165+0000 7f75c559a700 1 -- 172.21.15.148:0/2800140570 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00f9f0 con 0x7f75c80c52a0 2023-10-24T00:29:24.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 -- 172.21.15.148:0/2800140570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80c52a0 msgr2=0x7f75c8062b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 --2- 172.21.15.148:0/2800140570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80c52a0 0x7f75c8062b40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f75c805f570 tx=0x7f75bc009060).stop 2023-10-24T00:29:24.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 -- 172.21.15.148:0/2800140570 shutdown_connections 2023-10-24T00:29:24.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 --2- 172.21.15.148:0/2800140570 >> v2:172.21.15.150:3300/0 conn(0x7f75c8152170 0x7f75c8062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 --2- 172.21.15.148:0/2800140570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80c52a0 0x7f75c8062b40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 -- 172.21.15.148:0/2800140570 >> 172.21.15.148:0/2800140570 conn(0x7f75c80c86e0 msgr2=0x7f75c80c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 -- 172.21.15.148:0/2800140570 shutdown_connections 2023-10-24T00:29:24.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.166+0000 7f75c759e700 1 -- 172.21.15.148:0/2800140570 wait complete. 2023-10-24T00:29:24.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.167+0000 7f75c759e700 1 Processor -- start 2023-10-24T00:29:24.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.167+0000 7f75c759e700 1 -- start start 2023-10-24T00:29:24.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c8067b50 0x7f75c814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 0x7f75c80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a4c50 con 0x7f75c80a6760 2023-10-24T00:29:24.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c814c410 con 0x7f75c8152170 2023-10-24T00:29:24.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a6c50 con 0x7f75c8067b50 2023-10-24T00:29:24.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56096/0 (socket says 172.21.15.148:56096) 2023-10-24T00:29:24.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 -- 172.21.15.148:0/3310112858 learned_addr learned my addr 172.21.15.148:0/3310112858 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:24.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c5d9b700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 0x7f75c80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c659c700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c8067b50 0x7f75c814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 -- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c8067b50 msgr2=0x7f75c814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c8067b50 0x7f75c814bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 -- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 msgr2=0x7f75c80a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 0x7f75c80a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 -- 172.21.15.148:0/3310112858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0092a0 con 0x7f75c80a6760 2023-10-24T00:29:24.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c5d9b700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 0x7f75c80a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:24.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75c6d9d700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f75b800c450 tx=0x7f75b8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80072e0 con 0x7f75c80a6760 2023-10-24T00:29:24.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.168+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b8007440 con 0x7f75c80a6760 2023-10-24T00:29:24.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.169+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c80a6f30 con 0x7f75c80a6760 2023-10-24T00:29:24.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.169+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80057a0 con 0x7f75c80a6760 2023-10-24T00:29:24.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.169+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c80a48e0 con 0x7f75c80a6760 2023-10-24T00:29:24.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.169+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c814f540 con 0x7f75c80a6760 2023-10-24T00:29:24.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.170+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f75b8005b90 con 0x7f75c80a6760 2023-10-24T00:29:24.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.170+0000 7f75b67fc700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 0x7f75a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.170+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75b8079ac0 con 0x7f75c80a6760 2023-10-24T00:29:24.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.170+0000 7f75c659c700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 0x7f75a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.171+0000 7f75c659c700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 0x7f75a8061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f75c0007600 tx=0x7f75c000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.174+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75b804ad90 con 0x7f75c80a6760 2023-10-24T00:29:24.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.335+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f75c8047480 con 0x7f75c80a6760 2023-10-24T00:29:24.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.336+0000 7f75b67fc700 1 -- 172.21.15.148:0/3310112858 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f75b8079e60 con 0x7f75c80a6760 2023-10-24T00:29:24.339 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:24.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 msgr2=0x7f75a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 0x7f75a8061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f75c0007600 tx=0x7f75c000b040).stop 2023-10-24T00:29:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 msgr2=0x7f75c80bf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f75b800c450 tx=0x7f75b8007bb0).stop 2023-10-24T00:29:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 shutdown_connections 2023-10-24T00:29:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75a805f150 0x7f75a8061610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75c80a6760 0x7f75c80bf920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75c8067b50 0x7f75c814bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 --2- 172.21.15.148:0/3310112858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75c8152170 0x7f75c80a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 >> 172.21.15.148:0/3310112858 conn(0x7f75c80c86e0 msgr2=0x7f75c80bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 shutdown_connections 2023-10-24T00:29:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.338+0000 7f75c759e700 1 -- 172.21.15.148:0/3310112858 wait complete. 2023-10-24T00:29:24.352 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:24.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.466+0000 7fd15d136700 1 Processor -- start 2023-10-24T00:29:24.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.466+0000 7fd15d136700 1 -- start start 2023-10-24T00:29:24.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15d136700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15d136700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd158098bd0 0x7fd1580c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15d136700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1580c71d0 con 0x7fd1580bffd0 2023-10-24T00:29:24.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15d136700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580c9410 con 0x7fd158098bd0 2023-10-24T00:29:24.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15d136700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580c6c10 con 0x7fd158154430 2023-10-24T00:29:24.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd158098bd0 0x7fd1580c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15759e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd1580bffd0 0x7fd1580c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46166/0 (socket says 172.21.15.148:46166) 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15759e700 1 -- 172.21.15.148:0/2967419864 learned_addr learned my addr 172.21.15.148:0/2967419864 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd156d9d700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 -- 172.21.15.148:0/2967419864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 msgr2=0x7fd158154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 -- 172.21.15.148:0/2967419864 >> v1:172.21.15.148:6789/0 conn(0x7fd1580bffd0 legacy=0x7fd1580c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd15659c700 1 -- 172.21.15.148:0/2967419864 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225990675 0 0) 0x7fd1580c71d0 con 0x7fd1580bffd0 2023-10-24T00:29:24.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 -- 172.21.15.148:0/2967419864 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580c6ef0 con 0x7fd158098bd0 2023-10-24T00:29:24.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd156d9d700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:24.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.467+0000 7fd14e59c700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580c6300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fd140009790 tx=0x7fd140009060).ready entity=mon.0 client_cookie=1e66307894584ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15659c700 1 -- 172.21.15.148:0/2967419864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000b580 con 0x7fd158098bd0 2023-10-24T00:29:24.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15659c700 1 -- 172.21.15.148:0/2967419864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000b6e0 con 0x7fd158098bd0 2023-10-24T00:29:24.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15659c700 1 -- 172.21.15.148:0/2967419864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000ba60 con 0x7fd158098bd0 2023-10-24T00:29:24.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 -- 172.21.15.148:0/2967419864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 msgr2=0x7fd1580c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580c6300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fd140009790 tx=0x7fd140009060).stop 2023-10-24T00:29:24.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 -- 172.21.15.148:0/2967419864 shutdown_connections 2023-10-24T00:29:24.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 --2- 172.21.15.148:0/2967419864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580c6300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 -- 172.21.15.148:0/2967419864 >> 172.21.15.148:0/2967419864 conn(0x7fd1580cb070 msgr2=0x7fd1580cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 -- 172.21.15.148:0/2967419864 shutdown_connections 2023-10-24T00:29:24.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.468+0000 7fd15d136700 1 -- 172.21.15.148:0/2967419864 wait complete. 2023-10-24T00:29:24.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.469+0000 7fd15d136700 1 Processor -- start 2023-10-24T00:29:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.469+0000 7fd15d136700 1 -- start start 2023-10-24T00:29:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580bffd0 0x7fd1581529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580acc40 con 0x7fd158098bd0 2023-10-24T00:29:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ace20 con 0x7fd1580bffd0 2023-10-24T00:29:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15d136700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ad100 con 0x7fd158154430 2023-10-24T00:29:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56114/0 (socket says 172.21.15.148:56114) 2023-10-24T00:29:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 -- 172.21.15.148:0/341118579 learned_addr learned my addr 172.21.15.148:0/341118579 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd14e59c700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580bffd0 0x7fd1581529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd15759e700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 -- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 msgr2=0x7fd158167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158167ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 -- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580bffd0 msgr2=0x7fd1581529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580bffd0 0x7fd1581529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.470+0000 7fd156d9d700 1 -- 172.21.15.148:0/341118579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400092a0 con 0x7fd158098bd0 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd156d9d700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fd14800d890 tx=0x7fd148008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1480125f0 con 0x7fd158098bd0 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148012750 con 0x7fd158098bd0 2023-10-24T00:29:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1580ad3e0 con 0x7fd158098bd0 2023-10-24T00:29:24.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148012ad0 con 0x7fd158098bd0 2023-10-24T00:29:24.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.471+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1580ad9a0 con 0x7fd158098bd0 2023-10-24T00:29:24.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.472+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1580c3770 con 0x7fd158098bd0 2023-10-24T00:29:24.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.472+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd148013480 con 0x7fd158098bd0 2023-10-24T00:29:24.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.472+0000 7fd14f7fe700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 0x7fd138061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.472+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd14807a040 con 0x7fd158098bd0 2023-10-24T00:29:24.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.473+0000 7fd14e59c700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 0x7fd138061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.473+0000 7fd14e59c700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 0x7fd138061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd140009790 tx=0x7fd140017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.476+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd1480a8af0 con 0x7fd158098bd0 2023-10-24T00:29:24.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.642+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd15806c6b0 con 0x7fd158098bd0 2023-10-24T00:29:24.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.642+0000 7fd14f7fe700 1 -- 172.21.15.148:0/341118579 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd15806c6b0 con 0x7fd158098bd0 2023-10-24T00:29:24.645 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:24.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 msgr2=0x7fd138061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 0x7fd138061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd140009790 tx=0x7fd140017000).stop 2023-10-24T00:29:24.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 msgr2=0x7fd1580aa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fd14800d890 tx=0x7fd148008040).stop 2023-10-24T00:29:24.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 shutdown_connections 2023-10-24T00:29:24.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158154430 0x7fd158167ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd13805f150 0x7fd138061610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd158098bd0 0x7fd1580aa5b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 --2- 172.21.15.148:0/341118579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1580bffd0 0x7fd1581529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 >> 172.21.15.148:0/341118579 conn(0x7fd1580cb070 msgr2=0x7fd1580a8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 shutdown_connections 2023-10-24T00:29:24.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.644+0000 7fd15d136700 1 -- 172.21.15.148:0/341118579 wait complete. 2023-10-24T00:29:24.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.773+0000 7f7361bcf700 1 Processor -- start 2023-10-24T00:29:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.773+0000 7f7361bcf700 1 -- start start 2023-10-24T00:29:24.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f7361bcf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f735c154430 0x7f735c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f7361bcf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c0c71d0 con 0x7f735c0bffd0 2023-10-24T00:29:24.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f7361bcf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c0c9410 con 0x7f735c098bd0 2023-10-24T00:29:24.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f7361bcf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c0c6a10 con 0x7f735c154430 2023-10-24T00:29:24.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f735c154430 0x7f735c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f735c0bffd0 0x7f735c15e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46176/0 (socket says 172.21.15.148:46176) 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735bfff700 1 -- 172.21.15.148:0/914038560 learned_addr learned my addr 172.21.15.148:0/914038560 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735b7fe700 1 -- 172.21.15.148:0/914038560 >> v1:172.21.15.150:6789/0 conn(0x7f735c098bd0 legacy=0x7f735c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735b7fe700 1 -- 172.21.15.148:0/914038560 >> v1:172.21.15.148:6789/0 conn(0x7f735c0bffd0 legacy=0x7f735c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735a7fc700 1 -- 172.21.15.148:0/914038560 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061375965 0 0) 0x7f735c0c71d0 con 0x7f735c0bffd0 2023-10-24T00:29:24.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.774+0000 7f735b7fe700 1 -- 172.21.15.148:0/914038560 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0ca8b0 con 0x7f735c154430 2023-10-24T00:29:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.775+0000 7f735b7fe700 1 --2- 172.21.15.148:0/914038560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c154810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f734c009e60 tx=0x7f734c009780).ready entity=mon.0 client_cookie=78d818e503362565 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.775+0000 7f735a7fc700 1 -- 172.21.15.148:0/914038560 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00e070 con 0x7f735c154430 2023-10-24T00:29:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.775+0000 7f735a7fc700 1 -- 172.21.15.148:0/914038560 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c00bc30 con 0x7f735c154430 2023-10-24T00:29:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.775+0000 7f735a7fc700 1 -- 172.21.15.148:0/914038560 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c012410 con 0x7f735c154430 2023-10-24T00:29:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 -- 172.21.15.148:0/914038560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 msgr2=0x7f735c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 --2- 172.21.15.148:0/914038560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c154810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f734c009e60 tx=0x7f734c009780).stop 2023-10-24T00:29:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 -- 172.21.15.148:0/914038560 shutdown_connections 2023-10-24T00:29:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 --2- 172.21.15.148:0/914038560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c154810 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 -- 172.21.15.148:0/914038560 >> 172.21.15.148:0/914038560 conn(0x7f735c0cb070 msgr2=0x7f735c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 -- 172.21.15.148:0/914038560 shutdown_connections 2023-10-24T00:29:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.776+0000 7f7361bcf700 1 -- 172.21.15.148:0/914038560 wait complete. 2023-10-24T00:29:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.777+0000 7f7361bcf700 1 Processor -- start 2023-10-24T00:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.777+0000 7f7361bcf700 1 -- start start 2023-10-24T00:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f735c098bd0 0x7f735c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f735c0bffd0 0x7f735c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0aea80 con 0x7f735c154430 2023-10-24T00:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0af8e0 con 0x7f735c098bd0 2023-10-24T00:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0aecd0 con 0x7f735c0bffd0 2023-10-24T00:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56130/0 (socket says 172.21.15.148:56130) 2023-10-24T00:29:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 -- 172.21.15.148:0/2397179243 learned_addr learned my addr 172.21.15.148:0/2397179243 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:24.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735b7fe700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f735c098bd0 0x7f735c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735affd700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f735c0bffd0 0x7f735c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 -- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f735c0bffd0 msgr2=0x7f735c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f735c0bffd0 0x7f735c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 -- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f735c098bd0 msgr2=0x7f735c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f735c098bd0 0x7f735c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 -- 172.21.15.148:0/2397179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c009a20 con 0x7f735c154430 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f735bfff700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f735400c440 tx=0x7f7354007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540072e0 con 0x7f735c154430 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354007440 con 0x7f735c154430 2023-10-24T00:29:24.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c0aefb0 con 0x7f735c154430 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540057a0 con 0x7f735c154430 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.778+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c0af570 con 0x7f735c154430 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.779+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c06c6b0 con 0x7f735c154430 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.780+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7354005b50 con 0x7f735c154430 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.780+0000 7f73437fe700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 0x7f73480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:24.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.780+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7354079950 con 0x7f735c154430 2023-10-24T00:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.780+0000 7f735b7fe700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 0x7f73480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.781+0000 7f735b7fe700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 0x7f73480615e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f734c0099f0 tx=0x7f734c009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:24.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.784+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f735404ac20 con 0x7f735c154430 2023-10-24T00:29:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.951+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f735c0c6c10 con 0x7f735c154430 2023-10-24T00:29:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.951+0000 7f73437fe700 1 -- 172.21.15.148:0/2397179243 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7354007cf0 con 0x7f735c154430 2023-10-24T00:29:24.954 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 msgr2=0x7f73480615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 0x7f73480615e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f734c0099f0 tx=0x7f734c009780).stop 2023-10-24T00:29:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 msgr2=0x7f735c14d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:24.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f735400c440 tx=0x7f7354007bb0).stop 2023-10-24T00:29:24.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 shutdown_connections 2023-10-24T00:29:24.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f734805f120 0x7f73480615e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f735c154430 0x7f735c14d610 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f735c098bd0 0x7f735c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 --2- 172.21.15.148:0/2397179243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f735c0bffd0 0x7f735c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:24.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 >> 172.21.15.148:0/2397179243 conn(0x7f735c0cb070 msgr2=0x7f735c0a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:24.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 shutdown_connections 2023-10-24T00:29:24.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:24.953+0000 7f7361bcf700 1 -- 172.21.15.148:0/2397179243 wait complete. 2023-10-24T00:29:24.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.081+0000 7f418c64d700 1 Processor -- start 2023-10-24T00:29:25.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.081+0000 7f418c64d700 1 -- start start 2023-10-24T00:29:25.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418c64d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4184154430 0x7f4184154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418c64d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f41840bffd0 0x7f41840c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418c64d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840c71d0 con 0x7f4184098bd0 2023-10-24T00:29:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418c64d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840c6a10 con 0x7f4184154430 2023-10-24T00:29:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418c64d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41840c9410 con 0x7f41840bffd0 2023-10-24T00:29:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f418a3e9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4184154430 0x7f4184154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f4189be8700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4184098bd0 0x7f41840c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46178/0 (socket says 172.21.15.148:46178) 2023-10-24T00:29:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.082+0000 7f4189be8700 1 -- 172.21.15.148:0/1495838207 learned_addr learned my addr 172.21.15.148:0/1495838207 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418abea700 1 --2- 172.21.15.148:0/1495838207 >> v2:172.21.15.150:3300/0 conn(0x7f41840bffd0 0x7f41840c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418a3e9700 1 -- 172.21.15.148:0/1495838207 >> v2:172.21.15.150:3300/0 conn(0x7f41840bffd0 msgr2=0x7f41840c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418a3e9700 1 --2- 172.21.15.148:0/1495838207 >> v2:172.21.15.150:3300/0 conn(0x7f41840bffd0 0x7f41840c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418a3e9700 1 -- 172.21.15.148:0/1495838207 >> v1:172.21.15.148:6789/0 conn(0x7f4184098bd0 legacy=0x7f41840c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418a3e9700 1 -- 172.21.15.148:0/1495838207 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840c0950 con 0x7f4184154430 2023-10-24T00:29:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418a3e9700 1 --2- 172.21.15.148:0/1495838207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184154430 0x7f4184154810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f41840aab20 tx=0x7f4180009060).ready entity=mon.0 client_cookie=a21ac5f30f0b44b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f41893e7700 1 -- 172.21.15.148:0/1495838207 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000b580 con 0x7f4184154430 2023-10-24T00:29:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f41893e7700 1 -- 172.21.15.148:0/1495838207 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000b6e0 con 0x7f4184154430 2023-10-24T00:29:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f41893e7700 1 -- 172.21.15.148:0/1495838207 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000ba60 con 0x7f4184154430 2023-10-24T00:29:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418c64d700 1 -- 172.21.15.148:0/1495838207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184154430 msgr2=0x7f4184154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.083+0000 7f418c64d700 1 --2- 172.21.15.148:0/1495838207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184154430 0x7f4184154810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f41840aab20 tx=0x7f4180009060).stop 2023-10-24T00:29:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 -- 172.21.15.148:0/1495838207 shutdown_connections 2023-10-24T00:29:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 --2- 172.21.15.148:0/1495838207 >> v2:172.21.15.150:3300/0 conn(0x7f41840bffd0 0x7f41840c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 --2- 172.21.15.148:0/1495838207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184154430 0x7f4184154810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 -- 172.21.15.148:0/1495838207 >> 172.21.15.148:0/1495838207 conn(0x7f41840cb070 msgr2=0x7f41840cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 -- 172.21.15.148:0/1495838207 shutdown_connections 2023-10-24T00:29:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.084+0000 7f418c64d700 1 -- 172.21.15.148:0/1495838207 wait complete. 2023-10-24T00:29:25.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 Processor -- start 2023-10-24T00:29:25.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 -- start start 2023-10-24T00:29:25.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 0x7f4184149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4184154430 0x7f41840c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840c4fc0 con 0x7f4184098bd0 2023-10-24T00:29:25.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840aea80 con 0x7f41840bffd0 2023-10-24T00:29:25.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.085+0000 7f418c64d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840aed60 con 0x7f4184154430 2023-10-24T00:29:25.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56152/0 (socket says 172.21.15.148:56152) 2023-10-24T00:29:25.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 -- 172.21.15.148:0/4174447312 learned_addr learned my addr 172.21.15.148:0/4174447312 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:25.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f4189be8700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 0x7f4184149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418abea700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4184154430 0x7f41840c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 -- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4184154430 msgr2=0x7f41840c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4184154430 0x7f41840c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 -- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 msgr2=0x7f4184149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 0x7f4184149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 -- 172.21.15.148:0/4174447312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800092a0 con 0x7f4184098bd0 2023-10-24T00:29:25.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f4189be8700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 0x7f4184149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:25.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418a3e9700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f4180009fd0 tx=0x7f4180017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000b850 con 0x7f4184098bd0 2023-10-24T00:29:25.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000b9b0 con 0x7f4184098bd0 2023-10-24T00:29:25.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840af040 con 0x7f4184098bd0 2023-10-24T00:29:25.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418001b620 con 0x7f4184098bd0 2023-10-24T00:29:25.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.086+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840af600 con 0x7f4184098bd0 2023-10-24T00:29:25.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.087+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840ae820 con 0x7f4184098bd0 2023-10-24T00:29:25.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.087+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f418001ba50 con 0x7f4184098bd0 2023-10-24T00:29:25.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.088+0000 7f417a7fc700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 0x7f4168061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.088+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f418007ba40 con 0x7f4184098bd0 2023-10-24T00:29:25.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.088+0000 7f4189be8700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 0x7f4168061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.088+0000 7f4189be8700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 0x7f4168061640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4184167f00 tx=0x7f4174009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.092+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f418007de60 con 0x7f4184098bd0 2023-10-24T00:29:25.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.256+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f418406c6b0 con 0x7f4184098bd0 2023-10-24T00:29:25.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.256+0000 7f417a7fc700 1 -- 172.21.15.148:0/4174447312 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f418004cd10 con 0x7f4184098bd0 2023-10-24T00:29:25.259 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 msgr2=0x7f4168061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 0x7f4168061640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4184167f00 tx=0x7f4174009040).stop 2023-10-24T00:29:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 msgr2=0x7f41840c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f4180009fd0 tx=0x7f4180017000).stop 2023-10-24T00:29:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 shutdown_connections 2023-10-24T00:29:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4184154430 0x7f41840c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f416805f180 0x7f4168061640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4184098bd0 0x7f41840c23e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 --2- 172.21.15.148:0/4174447312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41840bffd0 0x7f4184149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 >> 172.21.15.148:0/4174447312 conn(0x7f41840cb070 msgr2=0x7f41840a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 shutdown_connections 2023-10-24T00:29:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.258+0000 7f418c64d700 1 -- 172.21.15.148:0/4174447312 wait complete. 2023-10-24T00:29:25.281 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-10-24T00:29:25.282 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:29:25.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-24T00:29:25.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.393+0000 7f7baff91700 1 Processor -- start 2023-10-24T00:29:25.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.394+0000 7f7baff91700 1 -- start start 2023-10-24T00:29:25.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.394+0000 7f7baff91700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ba8154650 0x7f7ba80a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.394+0000 7f7baff91700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 0x7f7ba8062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7baff91700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba8154cc0 con 0x7f7ba8154270 2023-10-24T00:29:25.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7baff91700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba81558d0 con 0x7f7ba8154650 2023-10-24T00:29:25.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7baff91700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba8154fa0 con 0x7f7ba80a7350 2023-10-24T00:29:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ba8154650 0x7f7ba80a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ba8154650 0x7f7ba80a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56168/0 (socket says 172.21.15.148:56168) 2023-10-24T00:29:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 -- 172.21.15.148:0/2358417615 learned_addr learned my addr 172.21.15.148:0/2358417615 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bae52e700 1 --2- 172.21.15.148:0/2358417615 >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 0x7f7ba8062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 -- 172.21.15.148:0/2358417615 >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 msgr2=0x7f7ba8062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 --2- 172.21.15.148:0/2358417615 >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 0x7f7ba8062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 -- 172.21.15.148:0/2358417615 >> v1:172.21.15.150:6789/0 conn(0x7f7ba8154270 legacy=0x7f7ba8065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 -- 172.21.15.148:0/2358417615 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8155280 con 0x7f7ba8154650 2023-10-24T00:29:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bae52e700 1 --2- 172.21.15.148:0/2358417615 >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 0x7f7ba8062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bad52c700 1 --2- 172.21.15.148:0/2358417615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8154650 0x7f7ba80a6e60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7ba805fcf0 tx=0x7f7b980090f0).ready entity=mon.0 client_cookie=c3c8c10252cf29e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bacd2b700 1 -- 172.21.15.148:0/2358417615 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800b600 con 0x7f7ba8154650 2023-10-24T00:29:25.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bacd2b700 1 -- 172.21.15.148:0/2358417615 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800b760 con 0x7f7ba8154650 2023-10-24T00:29:25.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.395+0000 7f7bacd2b700 1 -- 172.21.15.148:0/2358417615 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800bb00 con 0x7f7ba8154650 2023-10-24T00:29:25.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 -- 172.21.15.148:0/2358417615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8154650 msgr2=0x7f7ba80a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 --2- 172.21.15.148:0/2358417615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8154650 0x7f7ba80a6e60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f7ba805fcf0 tx=0x7f7b980090f0).stop 2023-10-24T00:29:25.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 -- 172.21.15.148:0/2358417615 shutdown_connections 2023-10-24T00:29:25.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 --2- 172.21.15.148:0/2358417615 >> v2:172.21.15.150:3300/0 conn(0x7f7ba80a7350 0x7f7ba8062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 --2- 172.21.15.148:0/2358417615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba8154650 0x7f7ba80a6e60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 -- 172.21.15.148:0/2358417615 >> 172.21.15.148:0/2358417615 conn(0x7f7ba8064230 msgr2=0x7f7ba80c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:25.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 -- 172.21.15.148:0/2358417615 shutdown_connections 2023-10-24T00:29:25.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.396+0000 7f7baff91700 1 -- 172.21.15.148:0/2358417615 wait complete. 2023-10-24T00:29:25.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.397+0000 7f7baff91700 1 Processor -- start 2023-10-24T00:29:25.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.397+0000 7f7baff91700 1 -- start start 2023-10-24T00:29:25.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ba8154270 0x7f7ba8168790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba8154650 0x7f7ba80a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80a84d0 con 0x7f7ba80a7350 2023-10-24T00:29:25.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80a7900 con 0x7f7ba8154650 2023-10-24T00:29:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80a7ba0 con 0x7f7ba8154270 2023-10-24T00:29:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56176/0 (socket says 172.21.15.148:56176) 2023-10-24T00:29:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 -- 172.21.15.148:0/3260818621 learned_addr learned my addr 172.21.15.148:0/3260818621 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:25.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7bae52e700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba8154650 0x7f7ba80a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7bad52c700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ba8154270 0x7f7ba8168790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 -- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ba8154270 msgr2=0x7f7ba8168790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ba8154270 0x7f7ba8168790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 -- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba8154650 msgr2=0x7f7ba80a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba8154650 0x7f7ba80a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 -- 172.21.15.148:0/3260818621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009370 con 0x7f7ba80a7350 2023-10-24T00:29:25.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7badd2d700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7ba400c440 tx=0x7f7ba4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4012400 con 0x7f7ba80a7350 2023-10-24T00:29:25.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4012580 con 0x7f7ba80a7350 2023-10-24T00:29:25.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4012940 con 0x7f7ba80a7350 2023-10-24T00:29:25.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.398+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba80a7e80 con 0x7f7ba80a7350 2023-10-24T00:29:25.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.399+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba80aa450 con 0x7f7ba80a7350 2023-10-24T00:29:25.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.400+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba80a87b0 con 0x7f7ba80a7350 2023-10-24T00:29:25.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.400+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7ba401b3b0 con 0x7f7ba80a7350 2023-10-24T00:29:25.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.400+0000 7f7b9dffb700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 0x7f7b8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.400+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ba4079400 con 0x7f7ba80a7350 2023-10-24T00:29:25.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.400+0000 7f7bad52c700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 0x7f7b8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.401+0000 7f7bad52c700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 0x7f7b8c061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7b9800b3c0 tx=0x7f7b98017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.404+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ba4048af0 con 0x7f7ba80a7350 2023-10-24T00:29:25.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.629+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f7ba806c6b0 con 0x7f7ba80a7350 2023-10-24T00:29:25.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.822+0000 7f7b9dffb700 1 -- 172.21.15.148:0/3260818621 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7ba4017070 con 0x7f7ba80a7350 2023-10-24T00:29:25.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 msgr2=0x7f7b8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 0x7f7b8c061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7b9800b3c0 tx=0x7f7b98017000).stop 2023-10-24T00:29:25.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 msgr2=0x7f7ba81682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7ba400c440 tx=0x7f7ba4007dc0).stop 2023-10-24T00:29:25.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 shutdown_connections 2023-10-24T00:29:25.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ba8154650 0x7f7ba80a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7b8c05f150 0x7f7b8c061610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ba80a7350 0x7f7ba81682a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 --2- 172.21.15.148:0/3260818621 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ba8154270 0x7f7ba8168790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 >> 172.21.15.148:0/3260818621 conn(0x7f7ba8064230 msgr2=0x7f7ba80a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:25.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 shutdown_connections 2023-10-24T00:29:25.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.824+0000 7f7baff91700 1 -- 172.21.15.148:0/3260818621 wait complete. 2023-10-24T00:29:25.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:29:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.953+0000 7f1e29e91700 1 Processor -- start 2023-10-24T00:29:25.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.953+0000 7f1e29e91700 1 -- start start 2023-10-24T00:29:25.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29e91700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e24154150 0x7f1e240a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29e91700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e240c1050 0x7f1e2415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29e91700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240a9830 con 0x7f1e240aa390 2023-10-24T00:29:25.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29e91700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240a8c20 con 0x7f1e24154150 2023-10-24T00:29:25.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29e91700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240a8f00 con 0x7f1e240c1050 2023-10-24T00:29:25.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e24154150 0x7f1e240a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e24154150 0x7f1e240a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56192/0 (socket says 172.21.15.148:56192) 2023-10-24T00:29:25.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 -- 172.21.15.148:0/475130280 learned_addr learned my addr 172.21.15.148:0/475130280 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:25.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e29690700 1 --2- 172.21.15.148:0/475130280 >> v2:172.21.15.150:3300/0 conn(0x7f1e240c1050 0x7f1e2415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 -- 172.21.15.148:0/475130280 >> v2:172.21.15.150:3300/0 conn(0x7f1e240c1050 msgr2=0x7f1e2415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:25.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 --2- 172.21.15.148:0/475130280 >> v2:172.21.15.150:3300/0 conn(0x7f1e240c1050 0x7f1e2415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 -- 172.21.15.148:0/475130280 >> v1:172.21.15.150:6789/0 conn(0x7f1e240aa390 legacy=0x7f1e240c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 -- 172.21.15.148:0/475130280 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240a91e0 con 0x7f1e24154150 2023-10-24T00:29:25.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e28e8f700 1 --2- 172.21.15.148:0/475130280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e24154150 0x7f1e240a8640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1e24085860 tx=0x7f1e18009060).ready entity=mon.0 client_cookie=dcfb06fa5525a712 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e237fe700 1 -- 172.21.15.148:0/475130280 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18005880 con 0x7f1e24154150 2023-10-24T00:29:25.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e237fe700 1 -- 172.21.15.148:0/475130280 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180059e0 con 0x7f1e24154150 2023-10-24T00:29:25.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.954+0000 7f1e237fe700 1 -- 172.21.15.148:0/475130280 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18005d60 con 0x7f1e24154150 2023-10-24T00:29:25.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 -- 172.21.15.148:0/475130280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e24154150 msgr2=0x7f1e240a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 --2- 172.21.15.148:0/475130280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e24154150 0x7f1e240a8640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f1e24085860 tx=0x7f1e18009060).stop 2023-10-24T00:29:25.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 -- 172.21.15.148:0/475130280 shutdown_connections 2023-10-24T00:29:25.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 --2- 172.21.15.148:0/475130280 >> v2:172.21.15.150:3300/0 conn(0x7f1e240c1050 0x7f1e2415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 --2- 172.21.15.148:0/475130280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e24154150 0x7f1e240a8640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 -- 172.21.15.148:0/475130280 >> 172.21.15.148:0/475130280 conn(0x7f1e24094500 msgr2=0x7f1e2406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:25.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 -- 172.21.15.148:0/475130280 shutdown_connections 2023-10-24T00:29:25.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.955+0000 7f1e29e91700 1 -- 172.21.15.148:0/475130280 wait complete. 2023-10-24T00:29:25.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.956+0000 7f1e29e91700 1 Processor -- start 2023-10-24T00:29:25.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.956+0000 7f1e29e91700 1 -- start start 2023-10-24T00:29:25.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e240c1050 0x7f1e240c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e24154150 0x7f1e240ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240ab410 con 0x7f1e240aa390 2023-10-24T00:29:25.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24147730 con 0x7f1e240c1050 2023-10-24T00:29:25.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29e91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240aaae0 con 0x7f1e24154150 2023-10-24T00:29:25.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56200/0 (socket says 172.21.15.148:56200) 2023-10-24T00:29:25.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 -- 172.21.15.148:0/1051981413 learned_addr learned my addr 172.21.15.148:0/1051981413 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:25.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e23fff700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e240c1050 0x7f1e240c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e29690700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e24154150 0x7f1e240ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 -- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e24154150 msgr2=0x7f1e240ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e24154150 0x7f1e240ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 -- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e240c1050 msgr2=0x7f1e240c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:25.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e240c1050 0x7f1e240c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:25.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 -- 172.21.15.148:0/1051981413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18009300 con 0x7f1e240aa390 2023-10-24T00:29:25.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.957+0000 7f1e28e8f700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f1e18009fd0 tx=0x7f1e18016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.958+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18005880 con 0x7f1e240aa390 2023-10-24T00:29:25.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.958+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e180069e0 con 0x7f1e240aa390 2023-10-24T00:29:25.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.958+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240aadc0 con 0x7f1e240aa390 2023-10-24T00:29:25.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.958+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800b9a0 con 0x7f1e240aa390 2023-10-24T00:29:25.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.958+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e24147ad0 con 0x7f1e240aa390 2023-10-24T00:29:25.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.959+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e24147cc0 con 0x7f1e240aa390 2023-10-24T00:29:25.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.959+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e18018070 con 0x7f1e240aa390 2023-10-24T00:29:25.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.959+0000 7f1e20ff9700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:25.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.959+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e1807b130 con 0x7f1e240aa390 2023-10-24T00:29:25.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.960+0000 7f1e23fff700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:25.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.960+0000 7f1e23fff700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1e241507d0 tx=0x7f1e10007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:25.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:25.964+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e1804c400 con 0x7f1e240aa390 2023-10-24T00:29:26.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.128+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1e24047480 con 0x7f1e240aa390 2023-10-24T00:29:26.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.131+0000 7f1e20ff9700 1 -- 172.21.15.148:0/1051981413 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1e1804fa20 con 0x7f1e240aa390 2023-10-24T00:29:26.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 msgr2=0x7f1e08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1e241507d0 tx=0x7f1e10007d40).stop 2023-10-24T00:29:26.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 msgr2=0x7f1e24147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f1e18009fd0 tx=0x7f1e18016000).stop 2023-10-24T00:29:26.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 shutdown_connections 2023-10-24T00:29:26.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e24154150 0x7f1e240ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240aa390 0x7f1e24147240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 --2- 172.21.15.148:0/1051981413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e240c1050 0x7f1e240c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 >> 172.21.15.148:0/1051981413 conn(0x7f1e24094500 msgr2=0x7f1e2406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:26.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 shutdown_connections 2023-10-24T00:29:26.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.133+0000 7f1e29e91700 1 -- 172.21.15.148:0/1051981413 wait complete. 2023-10-24T00:29:26.148 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:29:26.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:29:26.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:29:26.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:29:26.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:29:26.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:26.229 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-24T00:29:26.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:29:26.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:26.269 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:29:26.323 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-24T00:29:26.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:26.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-24T00:29:26.361 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:29:26.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:26.362 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-24T00:29:26.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-24T00:29:26.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:26.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-24T00:29:26.454 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:29:26.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:26.455 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-24T00:29:26.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-24T00:29:26.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:26.510 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-24T00:29:26.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T00:29:26.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:26.557 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-24T00:29:26.573 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:29:26.574 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:26.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.684+0000 7f15e8970700 1 Processor -- start 2023-10-24T00:29:26.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.684+0000 7f15e8970700 1 -- start start 2023-10-24T00:29:26.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e8970700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 0x7f15e40a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e8970700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15e40a6d50 0x7f15e4151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e8970700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e406a160 con 0x7f15e4062810 2023-10-24T00:29:26.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e8970700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40650f0 con 0x7f15e40a6d50 2023-10-24T00:29:26.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e8970700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4069550 con 0x7f15e4062bf0 2023-10-24T00:29:26.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f15e4062810 0x7f15e41554c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46190/0 (socket says 172.21.15.148:46190) 2023-10-24T00:29:26.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e37fe700 1 -- 172.21.15.148:0/2027840464 learned_addr learned my addr 172.21.15.148:0/2027840464 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:26.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e3fff700 1 --2- 172.21.15.148:0/2027840464 >> v2:172.21.15.150:3300/0 conn(0x7f15e40a6d50 0x7f15e4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e2ffd700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 0x7f15e40a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383712946 0 0) 0x7f15e406a160 con 0x7f15e4062810 2023-10-24T00:29:26.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.685+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0033f0 con 0x7f15e4062810 2023-10-24T00:29:26.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134998426 0 0) 0x7f15cc0033f0 con 0x7f15e4062810 2023-10-24T00:29:26.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e3fff700 1 -- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 msgr2=0x7f15e40a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:26.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e3fff700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 0x7f15e40a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e3fff700 1 -- 172.21.15.148:0/2027840464 >> v1:172.21.15.148:6789/0 conn(0x7f15e4062810 legacy=0x7f15e41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e3fff700 1 -- 172.21.15.148:0/2027840464 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4069830 con 0x7f15e40a6d50 2023-10-24T00:29:26.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e2ffd700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 0x7f15e40a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:26.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e3fff700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e40a6d50 0x7f15e4151770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f15dc009760 tx=0x7f15dc009060).ready entity=mon.1 client_cookie=2b8afb6bb4d55f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:26.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40017f0 con 0x7f15e40a6d50 2023-10-24T00:29:26.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc011400 con 0x7f15e40a6d50 2023-10-24T00:29:26.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e27fc700 1 -- 172.21.15.148:0/2027840464 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc011780 con 0x7f15e40a6d50 2023-10-24T00:29:26.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 -- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e40a6d50 msgr2=0x7f15e4151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e40a6d50 0x7f15e4151770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f15dc009760 tx=0x7f15dc009060).stop 2023-10-24T00:29:26.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 -- 172.21.15.148:0/2027840464 shutdown_connections 2023-10-24T00:29:26.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e40a6d50 0x7f15e4151770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 --2- 172.21.15.148:0/2027840464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e4062bf0 0x7f15e40a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.686+0000 7f15e8970700 1 -- 172.21.15.148:0/2027840464 >> 172.21.15.148:0/2027840464 conn(0x7f15e40c7ad0 msgr2=0x7f15e40c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:26.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.687+0000 7f15e8970700 1 -- 172.21.15.148:0/2027840464 shutdown_connections 2023-10-24T00:29:26.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.687+0000 7f15e8970700 1 -- 172.21.15.148:0/2027840464 wait complete. 2023-10-24T00:29:26.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.688+0000 7f15e8970700 1 Processor -- start 2023-10-24T00:29:26.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.688+0000 7f15e8970700 1 -- start start 2023-10-24T00:29:26.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e4062bf0 0x7f15e40a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e40a6d50 0x7f15e40c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4168350 con 0x7f15e4062810 2023-10-24T00:29:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4168630 con 0x7f15e4062bf0 2023-10-24T00:29:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4168910 con 0x7f15e40a6d50 2023-10-24T00:29:26.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56204/0 (socket says 172.21.15.148:56204) 2023-10-24T00:29:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 -- 172.21.15.148:0/1871764840 learned_addr learned my addr 172.21.15.148:0/1871764840 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e3fff700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e40a6d50 0x7f15e40c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e2ffd700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e4062bf0 0x7f15e40a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 -- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e40a6d50 msgr2=0x7f15e40c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e40a6d50 0x7f15e40c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 -- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e4062bf0 msgr2=0x7f15e40a7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e4062bf0 0x7f15e40a7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 -- 172.21.15.148:0/1871764840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80092a0 con 0x7f15e4062810 2023-10-24T00:29:26.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e37fe700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f15d400cb10 tx=0x7f15d4001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4004c40 con 0x7f15e4062810 2023-10-24T00:29:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4004da0 con 0x7f15e4062810 2023-10-24T00:29:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc0092a0 con 0x7f15e4062810 2023-10-24T00:29:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40073a0 con 0x7f15e4062810 2023-10-24T00:29:26.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.689+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e4167f00 con 0x7f15e4062810 2023-10-24T00:29:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.690+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e4047480 con 0x7f15e4062810 2023-10-24T00:29:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.691+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f15d4007710 con 0x7f15e4062810 2023-10-24T00:29:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.691+0000 7f15cb7fe700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 0x7f15d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.691+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f15d407a080 con 0x7f15e4062810 2023-10-24T00:29:26.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.691+0000 7f15e2ffd700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 0x7f15d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:26.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.692+0000 7f15e2ffd700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 0x7f15d0061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f15e4157f70 tx=0x7f15d8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:26.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.695+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f15d404b290 con 0x7f15e4062810 2023-10-24T00:29:26.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.902+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15e40abe50 con 0x7f15e4062810 2023-10-24T00:29:26.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.903+0000 7f15cb7fe700 1 -- 172.21.15.148:0/1871764840 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f15d404e8b0 con 0x7f15e4062810 2023-10-24T00:29:26.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:26.906 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 msgr2=0x7f15d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 0x7f15d0061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f15e4157f70 tx=0x7f15d8009060).stop 2023-10-24T00:29:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 msgr2=0x7f15e40c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f15d400cb10 tx=0x7f15d4001e30).stop 2023-10-24T00:29:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 shutdown_connections 2023-10-24T00:29:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15e40a6d50 0x7f15e40c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15d005f150 0x7f15d0061610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15e4062810 0x7f15e40c42b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 --2- 172.21.15.148:0/1871764840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15e4062bf0 0x7f15e40a7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 >> 172.21.15.148:0/1871764840 conn(0x7f15e40c7ad0 msgr2=0x7f15e4153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.904+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 shutdown_connections 2023-10-24T00:29:26.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:26.905+0000 7f15e8970700 1 -- 172.21.15.148:0/1871764840 wait complete. 2023-10-24T00:29:26.910 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:26.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:27.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.030+0000 7fb74881b700 1 Processor -- start 2023-10-24T00:29:27.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.030+0000 7fb74881b700 1 -- start start 2023-10-24T00:29:27.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74881b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb7440c0c90 0x7fb7440c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74881b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440c6410 con 0x7fb7440aa140 2023-10-24T00:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74881b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440ca6e0 con 0x7fb7440c07e0 2023-10-24T00:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74881b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440ca9c0 con 0x7fb7440c0c90 2023-10-24T00:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb742d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb7440aa140 0x7fb7440c9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46204/0 (socket says 172.21.15.148:46204) 2023-10-24T00:29:27.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb742d9d700 1 -- 172.21.15.148:0/2441628548 learned_addr learned my addr 172.21.15.148:0/2441628548 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74359e700 1 --2- 172.21.15.148:0/2441628548 >> v2:172.21.15.150:3300/0 conn(0x7fb7440c0c90 0x7fb7440c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319778253 0 0) 0x7fb7440c6410 con 0x7fb7440aa140 2023-10-24T00:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72c0033f0 con 0x7fb7440aa140 2023-10-24T00:29:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3407678697 0 0) 0x7fb72c0033f0 con 0x7fb7440aa140 2023-10-24T00:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 >> v2:172.21.15.150:3300/0 conn(0x7fb7440c0c90 msgr2=0x7fb7440c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 --2- 172.21.15.148:0/2441628548 >> v2:172.21.15.150:3300/0 conn(0x7fb7440c0c90 0x7fb7440c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 >> v1:172.21.15.150:6789/0 conn(0x7fb7440c07e0 legacy=0x7fb7440c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440c60a0 con 0x7fb7440aa140 2023-10-24T00:29:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fb73c0017f0 con 0x7fb7440aa140 2023-10-24T00:29:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 >> v1:172.21.15.148:6789/0 conn(0x7fb7440aa140 legacy=0x7fb7440c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c0038e0 0x7fb72c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb72c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c005050 0x7fb72c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440ca9c0 con 0x7fb72c004690 2023-10-24T00:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c00bfe0 con 0x7fb72c0038e0 2023-10-24T00:29:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c00c1a0 con 0x7fb72c005050 2023-10-24T00:29:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.031+0000 7fb74259c700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb72c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb742d9d700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c0038e0 0x7fb72c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74359e700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c005050 0x7fb72c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 -- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c005050 msgr2=0x7fb72c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb72c005050 0x7fb72c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 -- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c0038e0 msgr2=0x7fb72c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb72c0038e0 0x7fb72c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74359e700 1 -- 172.21.15.148:0/2441628548 reap_dead start 2023-10-24T00:29:27.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 -- 172.21.15.148:0/2441628548 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0033f0 con 0x7fb72c004690 2023-10-24T00:29:27.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74259c700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb72c004b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fb738001700 tx=0x7fb738007bb0).ready entity=mon.0 client_cookie=f40d8b9a7a5e36a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738007020 con 0x7fb72c004690 2023-10-24T00:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738007180 con 0x7fb72c004690 2023-10-24T00:29:27.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb741d9b700 1 -- 172.21.15.148:0/2441628548 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738007540 con 0x7fb72c004690 2023-10-24T00:29:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74881b700 1 -- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 msgr2=0x7fb72c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74881b700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb72c004b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fb738001700 tx=0x7fb738007bb0).stop 2023-10-24T00:29:27.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74881b700 1 -- 172.21.15.148:0/2441628548 shutdown_connections 2023-10-24T00:29:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74881b700 1 --2- 172.21.15.148:0/2441628548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb72c004b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.032+0000 7fb74881b700 1 -- 172.21.15.148:0/2441628548 >> 172.21.15.148:0/2441628548 conn(0x7fb7440944a0 msgr2=0x7fb74406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.033+0000 7fb74881b700 1 -- 172.21.15.148:0/2441628548 shutdown_connections 2023-10-24T00:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.033+0000 7fb74881b700 1 -- 172.21.15.148:0/2441628548 wait complete. 2023-10-24T00:29:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.034+0000 7fb74881b700 1 Processor -- start 2023-10-24T00:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.034+0000 7fb74881b700 1 -- start start 2023-10-24T00:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.034+0000 7fb74881b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.034+0000 7fb74881b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7441525b0 0x7fb744152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7440acc20 0x7fb7440ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74413f860 con 0x7fb72c004690 2023-10-24T00:29:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb744152f20 con 0x7fb7441525b0 2023-10-24T00:29:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440ae320 con 0x7fb7440acc20 2023-10-24T00:29:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56230/0 (socket says 172.21.15.148:56230) 2023-10-24T00:29:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 -- 172.21.15.148:0/817058708 learned_addr learned my addr 172.21.15.148:0/817058708 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74259c700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7441525b0 0x7fb744152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74359e700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7440acc20 0x7fb7440ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 -- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7440acc20 msgr2=0x7fb7440ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7440acc20 0x7fb7440ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 -- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7441525b0 msgr2=0x7fb744152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7441525b0 0x7fb744152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 -- 172.21.15.148:0/817058708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440ae600 con 0x7fb72c004690 2023-10-24T00:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb742d9d700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb73c007720 tx=0x7fb73c002100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f6c0 con 0x7fb72c004690 2023-10-24T00:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f820 con 0x7fb72c004690 2023-10-24T00:29:27.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440ae8e0 con 0x7fb72c004690 2023-10-24T00:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00fba0 con 0x7fb72c004690 2023-10-24T00:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.035+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7440aeea0 con 0x7fb72c004690 2023-10-24T00:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.036+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744047480 con 0x7fb72c004690 2023-10-24T00:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.036+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb73c01d3b0 con 0x7fb72c004690 2023-10-24T00:29:27.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.037+0000 7fb72affd700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 0x7fb730061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.037+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb73c079ce0 con 0x7fb72c004690 2023-10-24T00:29:27.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.037+0000 7fb74259c700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 0x7fb730061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.037+0000 7fb74259c700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 0x7fb730061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb738001010 tx=0x7fb738016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.041+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb73c04b000 con 0x7fb72c004690 2023-10-24T00:29:27.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.203+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7440c10c0 con 0x7fb72c004690 2023-10-24T00:29:27.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.204+0000 7fb72affd700 1 -- 172.21.15.148:0/817058708 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb73c019020 con 0x7fb72c004690 2023-10-24T00:29:27.208 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:27.209 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:27.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 msgr2=0x7fb730061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 0x7fb730061610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb738001010 tx=0x7fb738016000).stop 2023-10-24T00:29:27.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 msgr2=0x7fb74413f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb73c007720 tx=0x7fb73c002100).stop 2023-10-24T00:29:27.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 shutdown_connections 2023-10-24T00:29:27.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7440acc20 0x7fb7440ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb73005f150 0x7fb730061610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb72c004690 0x7fb74413f370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 --2- 172.21.15.148:0/817058708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7441525b0 0x7fb744152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 >> 172.21.15.148:0/817058708 conn(0x7fb7440944a0 msgr2=0x7fb7440a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 shutdown_connections 2023-10-24T00:29:27.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.206+0000 7fb74881b700 1 -- 172.21.15.148:0/817058708 wait complete. 2023-10-24T00:29:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:28:51.624309+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:28:52.145190+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:29:27.222 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:27.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.336+0000 7f755c356700 1 Processor -- start 2023-10-24T00:29:27.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.336+0000 7f755c356700 1 -- start start 2023-10-24T00:29:27.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755c356700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f755414b3b0 0x7f7554065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755c356700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 0x7f75540c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755c356700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540bbb50 con 0x7f7554069e60 2023-10-24T00:29:27.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755c356700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540c16e0 con 0x7f755414b3b0 2023-10-24T00:29:27.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755c356700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755406a310 con 0x7f755414b790 2023-10-24T00:29:27.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.337+0000 7f755a0f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f755414b3b0 0x7f7554065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f755414b3b0 0x7f7554065bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56234/0 (socket says 172.21.15.148:56234) 2023-10-24T00:29:27.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 -- 172.21.15.148:0/605371700 learned_addr learned my addr 172.21.15.148:0/605371700 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:27.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f75598f1700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 0x7f75540c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 -- 172.21.15.148:0/605371700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 msgr2=0x7f75540c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 0x7f75540c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 -- 172.21.15.148:0/605371700 >> v1:172.21.15.150:6789/0 conn(0x7f7554069e60 legacy=0x7f7554154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 -- 172.21.15.148:0/605371700 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755406a5d0 con 0x7f755414b3b0 2023-10-24T00:29:27.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f75598f1700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 0x7f75540c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:27.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755a0f2700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b3b0 0x7f7554065bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7550006fd0 tx=0x7f75500090f0).ready entity=mon.0 client_cookie=846fbfe4f781fa96 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f75590f0700 1 -- 172.21.15.148:0/605371700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000b600 con 0x7f755414b3b0 2023-10-24T00:29:27.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f75590f0700 1 -- 172.21.15.148:0/605371700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755000b760 con 0x7f755414b3b0 2023-10-24T00:29:27.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f75590f0700 1 -- 172.21.15.148:0/605371700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755000bae0 con 0x7f755414b3b0 2023-10-24T00:29:27.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755c356700 1 -- 172.21.15.148:0/605371700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b3b0 msgr2=0x7f7554065bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.338+0000 7f755c356700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b3b0 0x7f7554065bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f7550006fd0 tx=0x7f75500090f0).stop 2023-10-24T00:29:27.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 -- 172.21.15.148:0/605371700 shutdown_connections 2023-10-24T00:29:27.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b3b0 0x7f7554065bd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 --2- 172.21.15.148:0/605371700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b790 0x7f75540c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 -- 172.21.15.148:0/605371700 >> 172.21.15.148:0/605371700 conn(0x7f75540c6bf0 msgr2=0x7f75540c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 -- 172.21.15.148:0/605371700 shutdown_connections 2023-10-24T00:29:27.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.339+0000 7f755c356700 1 -- 172.21.15.148:0/605371700 wait complete. 2023-10-24T00:29:27.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 Processor -- start 2023-10-24T00:29:27.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 -- start start 2023-10-24T00:29:27.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554069e60 0x7f75540a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b3b0 0x7f7554139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75541372d0 con 0x7f755414b790 2023-10-24T00:29:27.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554166bc0 con 0x7f7554069e60 2023-10-24T00:29:27.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.340+0000 7f755c356700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755414c4a0 con 0x7f755414b3b0 2023-10-24T00:29:27.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56238/0 (socket says 172.21.15.148:56238) 2023-10-24T00:29:27.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 -- 172.21.15.148:0/4112526437 learned_addr learned my addr 172.21.15.148:0/4112526437 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:27.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f75598f1700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b3b0 0x7f7554139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a0f2700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554069e60 0x7f75540a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 -- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b3b0 msgr2=0x7f7554139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b3b0 0x7f7554139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 -- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554069e60 msgr2=0x7f75540a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554069e60 0x7f75540a90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 -- 172.21.15.148:0/4112526437 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550009370 con 0x7f755414b790 2023-10-24T00:29:27.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755a8f3700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f754c00b810 tx=0x7f754c009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00d4a0 con 0x7f755414b790 2023-10-24T00:29:27.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00d600 con 0x7f755414b790 2023-10-24T00:29:27.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7554165fb0 con 0x7f755414b790 2023-10-24T00:29:27.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00d9c0 con 0x7f755414b790 2023-10-24T00:29:27.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.341+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7554166570 con 0x7f755414b790 2023-10-24T00:29:27.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.342+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554166d50 con 0x7f755414b790 2023-10-24T00:29:27.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.342+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f754c011400 con 0x7f755414b790 2023-10-24T00:29:27.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.343+0000 7f754a7fc700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 0x7f7538061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.343+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f754c079960 con 0x7f755414b790 2023-10-24T00:29:27.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.343+0000 7f755a0f2700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 0x7f7538061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.343+0000 7f755a0f2700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 0x7f7538061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7550009130 tx=0x7f7550017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.347+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f754c047af0 con 0x7f755414b790 2023-10-24T00:29:27.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.508+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f755406c6b0 con 0x7f755414b790 2023-10-24T00:29:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.509+0000 7f754a7fc700 1 -- 172.21.15.148:0/4112526437 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f754c04ac80 con 0x7f755414b790 2023-10-24T00:29:27.513 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:27.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 msgr2=0x7f7538061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 0x7f7538061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7550009130 tx=0x7f7550017000).stop 2023-10-24T00:29:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 msgr2=0x7f75540c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f754c00b810 tx=0x7f754c009290).stop 2023-10-24T00:29:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 shutdown_connections 2023-10-24T00:29:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f753805f150 0x7f7538061610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f755414b790 0x7f75540c3570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554069e60 0x7f75540a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 --2- 172.21.15.148:0/4112526437 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f755414b3b0 0x7f7554139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.510+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 >> 172.21.15.148:0/4112526437 conn(0x7f75540c6bf0 msgr2=0x7f75540c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.511+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 shutdown_connections 2023-10-24T00:29:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.511+0000 7f755c356700 1 -- 172.21.15.148:0/4112526437 wait complete. 2023-10-24T00:29:27.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.638+0000 7fd849102700 1 Processor -- start 2023-10-24T00:29:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.638+0000 7fd849102700 1 -- start start 2023-10-24T00:29:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd849102700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 0x7fd844154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd849102700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440c71d0 con 0x7fd844154430 2023-10-24T00:29:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd849102700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440c9410 con 0x7fd844098bd0 2023-10-24T00:29:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd849102700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c6a10 con 0x7fd8440c06e0 2023-10-24T00:29:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd842d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd844154430 0x7fd8440c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46206/0 (socket says 172.21.15.148:46206) 2023-10-24T00:29:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd842d9d700 1 -- 172.21.15.148:0/2394698300 learned_addr learned my addr 172.21.15.148:0/2394698300 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.639+0000 7fd84359e700 1 --2- 172.21.15.148:0/2394698300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 0x7fd844154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831623113 0 0) 0x7fd8440c71d0 con 0x7fd844154430 2023-10-24T00:29:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8300033f0 con 0x7fd844154430 2023-10-24T00:29:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399347192 0 0) 0x7fd8440c9410 con 0x7fd844098bd0 2023-10-24T00:29:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8440c71d0 con 0x7fd844098bd0 2023-10-24T00:29:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84359e700 1 -- 172.21.15.148:0/2394698300 >> v1:172.21.15.150:6789/0 conn(0x7fd844098bd0 legacy=0x7fd8440bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84359e700 1 -- 172.21.15.148:0/2394698300 >> v1:172.21.15.148:6789/0 conn(0x7fd844154430 legacy=0x7fd8440c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84359e700 1 -- 172.21.15.148:0/2394698300 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440ca8b0 con 0x7fd8440c06e0 2023-10-24T00:29:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84359e700 1 --2- 172.21.15.148:0/2394698300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 0x7fd844154810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd83c009e90 tx=0x7fd83c009780).ready entity=mon.2 client_cookie=68c79349ea11251d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00e070 con 0x7fd8440c06e0 2023-10-24T00:29:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00bab0 con 0x7fd8440c06e0 2023-10-24T00:29:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.640+0000 7fd84259c700 1 -- 172.21.15.148:0/2394698300 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00be30 con 0x7fd8440c06e0 2023-10-24T00:29:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 -- 172.21.15.148:0/2394698300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 msgr2=0x7fd844154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 --2- 172.21.15.148:0/2394698300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 0x7fd844154810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd83c009e90 tx=0x7fd83c009780).stop 2023-10-24T00:29:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 -- 172.21.15.148:0/2394698300 shutdown_connections 2023-10-24T00:29:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 --2- 172.21.15.148:0/2394698300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8440c06e0 0x7fd844154810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 -- 172.21.15.148:0/2394698300 >> 172.21.15.148:0/2394698300 conn(0x7fd8440cb070 msgr2=0x7fd8440cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 -- 172.21.15.148:0/2394698300 shutdown_connections 2023-10-24T00:29:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.641+0000 7fd849102700 1 -- 172.21.15.148:0/2394698300 wait complete. 2023-10-24T00:29:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.642+0000 7fd849102700 1 Processor -- start 2023-10-24T00:29:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.642+0000 7fd849102700 1 -- start start 2023-10-24T00:29:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd844098bd0 0x7fd8440ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd844154430 0x7fd8440ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84414dcc0 con 0x7fd8440c06e0 2023-10-24T00:29:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84414dfa0 con 0x7fd844154430 2023-10-24T00:29:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84414e280 con 0x7fd844098bd0 2023-10-24T00:29:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56248/0 (socket says 172.21.15.148:56248) 2023-10-24T00:29:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 -- 172.21.15.148:0/2571221924 learned_addr learned my addr 172.21.15.148:0/2571221924 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd84359e700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd844154430 0x7fd8440ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd842d9d700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd844098bd0 0x7fd8440ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 -- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd844098bd0 msgr2=0x7fd8440ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd844098bd0 0x7fd8440ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 -- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd844154430 msgr2=0x7fd8440ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd844154430 0x7fd8440ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 -- 172.21.15.148:0/2571221924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c009a20 con 0x7fd8440c06e0 2023-10-24T00:29:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83a59c700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd82c00c490 tx=0x7fd82c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00ce40 con 0x7fd8440c06e0 2023-10-24T00:29:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00f470 con 0x7fd8440c06e0 2023-10-24T00:29:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00f830 con 0x7fd8440c06e0 2023-10-24T00:29:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84414e560 con 0x7fd8440c06e0 2023-10-24T00:29:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.643+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440abdc0 con 0x7fd8440c06e0 2023-10-24T00:29:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.644+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440c54b0 con 0x7fd8440c06e0 2023-10-24T00:29:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.645+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd82c00fc20 con 0x7fd8440c06e0 2023-10-24T00:29:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.645+0000 7fd83b7fe700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 0x7fd824061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.645+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd82c079610 con 0x7fd8440c06e0 2023-10-24T00:29:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.645+0000 7fd842d9d700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 0x7fd824061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.646+0000 7fd842d9d700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 0x7fd824061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd834007fd0 tx=0x7fd834009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.649+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd82c048af0 con 0x7fd8440c06e0 2023-10-24T00:29:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.811+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd84414ea80 con 0x7fd8440c06e0 2023-10-24T00:29:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.811+0000 7fd83b7fe700 1 -- 172.21.15.148:0/2571221924 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd84414ea80 con 0x7fd8440c06e0 2023-10-24T00:29:27.814 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 msgr2=0x7fd824061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 0x7fd824061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd834007fd0 tx=0x7fd834009040).stop 2023-10-24T00:29:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 msgr2=0x7fd84414ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd82c00c490 tx=0x7fd82c007c40).stop 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 shutdown_connections 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd844154430 0x7fd8440ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd844098bd0 0x7fd8440ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd82405f150 0x7fd824061610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 --2- 172.21.15.148:0/2571221924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8440c06e0 0x7fd84414ed60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 >> 172.21.15.148:0/2571221924 conn(0x7fd8440cb070 msgr2=0x7fd8440c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 shutdown_connections 2023-10-24T00:29:27.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.813+0000 7fd849102700 1 -- 172.21.15.148:0/2571221924 wait complete. 2023-10-24T00:29:27.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:29:27.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.941+0000 7fa58dc2d700 1 Processor -- start 2023-10-24T00:29:27.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.941+0000 7fa58dc2d700 1 -- start start 2023-10-24T00:29:27.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58dc2d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa588157780 0x7fa5880c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58dc2d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880c6770 con 0x7fa5880a9e60 2023-10-24T00:29:27.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58dc2d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880c1120 con 0x7fa5880c0960 2023-10-24T00:29:27.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58dc2d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880c1400 con 0x7fa588157780 2023-10-24T00:29:27.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58d42c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa5880a9e60 0x7fa5880aa270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46208/0 (socket says 172.21.15.148:46208) 2023-10-24T00:29:27.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58d42c700 1 -- 172.21.15.148:0/2533545077 learned_addr learned my addr 172.21.15.148:0/2533545077 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:27.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/2533545077 >> v2:172.21.15.150:3300/0 conn(0x7fa588157780 0x7fa5880c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014339074 0 0) 0x7fa5880c6770 con 0x7fa5880a9e60 2023-10-24T00:29:27.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.942+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5700033f0 con 0x7fa5880a9e60 2023-10-24T00:29:27.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2474511357 0 0) 0x7fa5700033f0 con 0x7fa5880a9e60 2023-10-24T00:29:27.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 >> v2:172.21.15.150:3300/0 conn(0x7fa588157780 msgr2=0x7fa5880c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 --2- 172.21.15.148:0/2533545077 >> v2:172.21.15.150:3300/0 conn(0x7fa588157780 0x7fa5880c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 >> v1:172.21.15.150:6789/0 conn(0x7fa5880c0960 legacy=0x7fa5880a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880c6120 con 0x7fa5880a9e60 2023-10-24T00:29:27.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fa580001470 con 0x7fa5880a9e60 2023-10-24T00:29:27.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 >> v1:172.21.15.148:6789/0 conn(0x7fa5880a9e60 legacy=0x7fa5880aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 0x7fa570003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa570004690 0x7fa570004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa570005050 0x7fa57000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c1400 con 0x7fa5700038e0 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57000bfe0 con 0x7fa570005050 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57000c1a0 con 0x7fa570004690 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 0x7fa570003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa587fff700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa570004690 0x7fa570004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58d42c700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa570005050 0x7fa57000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 -- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa570004690 msgr2=0x7fa570004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa570004690 0x7fa570004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 -- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa570005050 msgr2=0x7fa57000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:27.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa570005050 0x7fa57000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58d42c700 1 -- 172.21.15.148:0/2533545077 reap_dead start 2023-10-24T00:29:27.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 -- 172.21.15.148:0/2533545077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700033f0 con 0x7fa5700038e0 2023-10-24T00:29:27.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 0x7fa570003d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fa5780094d0 tx=0x7fa57800b040).ready entity=mon.0 client_cookie=4ff8295b9ae71f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.943+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578009b10 con 0x7fa5700038e0 2023-10-24T00:29:27.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800f040 con 0x7fa5700038e0 2023-10-24T00:29:27.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa5877fe700 1 -- 172.21.15.148:0/2533545077 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57800ecb0 con 0x7fa5700038e0 2023-10-24T00:29:27.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 -- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 msgr2=0x7fa570003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 0x7fa570003d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fa5780094d0 tx=0x7fa57800b040).stop 2023-10-24T00:29:27.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 -- 172.21.15.148:0/2533545077 shutdown_connections 2023-10-24T00:29:27.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/2533545077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5700038e0 0x7fa570003d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 -- 172.21.15.148:0/2533545077 >> 172.21.15.148:0/2533545077 conn(0x7fa588094570 msgr2=0x7fa58806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:27.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 -- 172.21.15.148:0/2533545077 shutdown_connections 2023-10-24T00:29:27.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.944+0000 7fa58dc2d700 1 -- 172.21.15.148:0/2533545077 wait complete. 2023-10-24T00:29:27.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.945+0000 7fa58dc2d700 1 Processor -- start 2023-10-24T00:29:27.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.945+0000 7fa58dc2d700 1 -- start start 2023-10-24T00:29:27.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 0x7fa5880aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 0x7fa5880a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880a9630 con 0x7fa5880a85e0 2023-10-24T00:29:27.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588150790 con 0x7fa5880aae90 2023-10-24T00:29:27.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58dc2d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880ae3a0 con 0x7fa5700038e0 2023-10-24T00:29:27.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58d42c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58d42c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56252/0 (socket says 172.21.15.148:56252) 2023-10-24T00:29:27.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58d42c700 1 -- 172.21.15.148:0/3583276909 learned_addr learned my addr 172.21.15.148:0/3583276909 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:27.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 0x7fa5880aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.946+0000 7fa587fff700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 0x7fa5880a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 -- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 msgr2=0x7fa5880aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 0x7fa5880aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 -- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 msgr2=0x7fa5880a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:27.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 0x7fa5880a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:27.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 -- 172.21.15.148:0/3583276909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880ab310 con 0x7fa5880a85e0 2023-10-24T00:29:27.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 0x7fa5880aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:27.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa587fff700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 0x7fa5880a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:27.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58d42c700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fa5800049e0 tx=0x7fa580001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000f660 con 0x7fa5880a85e0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000f7c0 con 0x7fa5880a85e0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000fb40 con 0x7fa5880a85e0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5880a9070 con 0x7fa5880a85e0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.947+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5880ae030 con 0x7fa5880a85e0 2023-10-24T00:29:27.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.948+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5880ade90 con 0x7fa5880a85e0 2023-10-24T00:29:27.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.948+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa580015410 con 0x7fa5880a85e0 2023-10-24T00:29:27.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.948+0000 7fa584ff9700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 0x7fa574061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:27.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.948+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa580079860 con 0x7fa5880a85e0 2023-10-24T00:29:27.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.949+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 0x7fa574061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:27.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.949+0000 7fa58cc2b700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 0x7fa574061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa57800afd0 tx=0x7fa57801a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:27.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:27.952+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa5880ade90 con 0x7fa5880a85e0 2023-10-24T00:29:28.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.116+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5880ade90 con 0x7fa5880a85e0 2023-10-24T00:29:28.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.116+0000 7fa584ff9700 1 -- 172.21.15.148:0/3583276909 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5880ade90 con 0x7fa5880a85e0 2023-10-24T00:29:28.119 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:28.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 msgr2=0x7fa574061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 0x7fa574061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa57800afd0 tx=0x7fa57801a000).stop 2023-10-24T00:29:28.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 msgr2=0x7fa5880a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fa5800049e0 tx=0x7fa580001e50).stop 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 shutdown_connections 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa57405f150 0x7fa574061610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5880a85e0 0x7fa5880a8a60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5700038e0 0x7fa5880aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 --2- 172.21.15.148:0/3583276909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5880aae90 0x7fa5880a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 >> 172.21.15.148:0/3583276909 conn(0x7fa588094570 msgr2=0x7fa5880c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 shutdown_connections 2023-10-24T00:29:28.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.118+0000 7fa58dc2d700 1 -- 172.21.15.148:0/3583276909 wait complete. 2023-10-24T00:29:28.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:29:28.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.246+0000 7f36cc3d7700 1 Processor -- start 2023-10-24T00:29:28.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.246+0000 7f36cc3d7700 1 -- start start 2023-10-24T00:29:28.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36cc3d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36cc3d7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40bec40 con 0x7f36c40c95d0 2023-10-24T00:29:28.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36cc3d7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40be650 con 0x7f36c4154430 2023-10-24T00:29:28.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36cc3d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40a82c0 con 0x7f36c40c4940 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36c9972700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f36c40c95d0 0x7f36c40c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46212/0 (socket says 172.21.15.148:46212) 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.247+0000 7f36c9972700 1 -- 172.21.15.148:0/1836559206 learned_addr learned my addr 172.21.15.148:0/1836559206 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36ca974700 1 --2- 172.21.15.148:0/1836559206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387501074 0 0) 0x7f36c40bec40 con 0x7f36c40c95d0 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b00033f0 con 0x7f36c40c95d0 2023-10-24T00:29:28.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884081481 0 0) 0x7f36c40be650 con 0x7f36c4154430 2023-10-24T00:29:28.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c40bec40 con 0x7f36c4154430 2023-10-24T00:29:28.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36ca974700 1 -- 172.21.15.148:0/1836559206 >> v1:172.21.15.150:6789/0 conn(0x7f36c4154430 legacy=0x7f36c40a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082204844 0 0) 0x7f36b00033f0 con 0x7f36c40c95d0 2023-10-24T00:29:28.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36ca974700 1 -- 172.21.15.148:0/1836559206 >> v1:172.21.15.148:6789/0 conn(0x7f36c40c95d0 legacy=0x7f36c40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36ca974700 1 -- 172.21.15.148:0/1836559206 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40a85a0 con 0x7f36c40c4940 2023-10-24T00:29:28.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36ca974700 1 --2- 172.21.15.148:0/1836559206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c4154810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f36bc009e90 tx=0x7f36bc009780).ready entity=mon.2 client_cookie=bd2f8b42840417f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00e070 con 0x7f36c40c4940 2023-10-24T00:29:28.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc00b7a0 con 0x7f36c40c4940 2023-10-24T00:29:28.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.248+0000 7f36c9171700 1 -- 172.21.15.148:0/1836559206 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4001470 con 0x7f36c40c4940 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 -- 172.21.15.148:0/1836559206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 msgr2=0x7f36c4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/1836559206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c4154810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f36bc009e90 tx=0x7f36bc009780).stop 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 -- 172.21.15.148:0/1836559206 shutdown_connections 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/1836559206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c4154810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 -- 172.21.15.148:0/1836559206 >> 172.21.15.148:0/1836559206 conn(0x7f36c40630d0 msgr2=0x7f36c40c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 -- 172.21.15.148:0/1836559206 shutdown_connections 2023-10-24T00:29:28.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.249+0000 7f36cc3d7700 1 -- 172.21.15.148:0/1836559206 wait complete. 2023-10-24T00:29:28.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.250+0000 7f36cc3d7700 1 Processor -- start 2023-10-24T00:29:28.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.250+0000 7f36cc3d7700 1 -- start start 2023-10-24T00:29:28.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c40c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c40c95d0 0x7f36c40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40aeda0 con 0x7f36c4154430 2023-10-24T00:29:28.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40c1650 con 0x7f36c40c95d0 2023-10-24T00:29:28.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40c08b0 con 0x7f36c40c4940 2023-10-24T00:29:28.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56254/0 (socket says 172.21.15.148:56254) 2023-10-24T00:29:28.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 -- 172.21.15.148:0/2675344951 learned_addr learned my addr 172.21.15.148:0/2675344951 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:28.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36c9972700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c40c95d0 0x7f36c40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca173700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c40c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 -- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 msgr2=0x7f36c40c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c40c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 -- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c40c95d0 msgr2=0x7f36c40ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c40c95d0 0x7f36c40ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 -- 172.21.15.148:0/2675344951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc009a20 con 0x7f36c4154430 2023-10-24T00:29:28.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ca974700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f36c40662b0 tx=0x7f36bc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00be50 con 0x7f36c4154430 2023-10-24T00:29:28.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc01d650 con 0x7f36c4154430 2023-10-24T00:29:28.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c414c960 con 0x7f36c4154430 2023-10-24T00:29:28.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc01d9f0 con 0x7f36c4154430 2023-10-24T00:29:28.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.251+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c40c1000 con 0x7f36c4154430 2023-10-24T00:29:28.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.252+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c406c6b0 con 0x7f36c4154430 2023-10-24T00:29:28.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.253+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f36bc027460 con 0x7f36c4154430 2023-10-24T00:29:28.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.253+0000 7f36ba7fc700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 0x7f36a80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.253+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f36bc07c210 con 0x7f36c4154430 2023-10-24T00:29:28.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.253+0000 7f36ca173700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 0x7f36a80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.254+0000 7f36ca173700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 0x7f36a80615e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f36c0003700 tx=0x7f36c0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.257+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36bc04d480 con 0x7f36c4154430 2023-10-24T00:29:28.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.420+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36c4065f60 con 0x7f36c4154430 2023-10-24T00:29:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.420+0000 7f36ba7fc700 1 -- 172.21.15.148:0/2675344951 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36bc050aa0 con 0x7f36c4154430 2023-10-24T00:29:28.423 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:29:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 msgr2=0x7f36a80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 0x7f36a80615e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f36c0003700 tx=0x7f36c0009040).stop 2023-10-24T00:29:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 msgr2=0x7f36c40adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f36c40662b0 tx=0x7f36bc009780).stop 2023-10-24T00:29:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 shutdown_connections 2023-10-24T00:29:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36a805f120 0x7f36a80615e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36c4154430 0x7f36c40adf20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36c40c4940 0x7f36c40c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 --2- 172.21.15.148:0/2675344951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36c40c95d0 0x7f36c40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 >> 172.21.15.148:0/2675344951 conn(0x7f36c40630d0 msgr2=0x7f36c40bf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 shutdown_connections 2023-10-24T00:29:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.422+0000 7f36cc3d7700 1 -- 172.21.15.148:0/2675344951 wait complete. 2023-10-24T00:29:28.436 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:28.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.547+0000 7f4174420700 1 Processor -- start 2023-10-24T00:29:28.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.547+0000 7f4174420700 1 -- start start 2023-10-24T00:29:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f4174420700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f416c0c86c0 0x7f416c0bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f4174420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f416c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f4174420700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c0a6a50 con 0x7f416c0a6550 2023-10-24T00:29:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f4174420700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c0a6d30 con 0x7f416c0c86c0 2023-10-24T00:29:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f4174420700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0a7010 con 0x7f416c0a8480 2023-10-24T00:29:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f41719bb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f416c0a6550 0x7f416c0a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46222/0 (socket says 172.21.15.148:46222) 2023-10-24T00:29:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.548+0000 7f41719bb700 1 -- 172.21.15.148:0/1752033543 learned_addr learned my addr 172.21.15.148:0/1752033543 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> v2:172.21.15.150:3300/0 conn(0x7f416c0c86c0 0x7f416c0bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41729bd700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f416c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884595615 0 0) 0x7f416c0a6a50 con 0x7f416c0a6550 2023-10-24T00:29:28.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41580033f0 con 0x7f416c0a6550 2023-10-24T00:29:28.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477848273 0 0) 0x7f41580033f0 con 0x7f416c0a6550 2023-10-24T00:29:28.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 msgr2=0x7f416c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:28.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f416c15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 >> v2:172.21.15.150:3300/0 conn(0x7f416c0c86c0 msgr2=0x7f416c0bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:28.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 --2- 172.21.15.148:0/1752033543 >> v2:172.21.15.150:3300/0 conn(0x7f416c0c86c0 0x7f416c0bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0a72f0 con 0x7f416c0a6550 2023-10-24T00:29:28.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f415c001470 con 0x7f416c0a6550 2023-10-24T00:29:28.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> v2:172.21.15.150:3300/0 conn(0x7f416c0c86c0 0x7f416c0bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:28.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 >> v1:172.21.15.148:6789/0 conn(0x7f416c0a6550 legacy=0x7f416c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41580038e0 0x7f4158003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4158004690 0x7f4158004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f4158005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0a6d30 con 0x7f41580038e0 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0a7010 con 0x7f4158004690 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415800b8e0 con 0x7f416c0a8480 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41580038e0 0x7f4158003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41719bb700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4158004690 0x7f4158004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.549+0000 7f41729bd700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f4158005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 -- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 msgr2=0x7f4158005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:28.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f416c0a8480 0x7f4158005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 -- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4158004690 msgr2=0x7f4158004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:28.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4158004690 0x7f4158004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 -- 172.21.15.148:0/1752033543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580033f0 con 0x7f41580038e0 2023-10-24T00:29:28.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41721bc700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41580038e0 0x7f4158003d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4168009d00 tx=0x7f4168006f40).ready entity=mon.0 client_cookie=ebc18ce73110b3bc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168009e60 con 0x7f41580038e0 2023-10-24T00:29:28.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168009670 con 0x7f41580038e0 2023-10-24T00:29:28.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41711ba700 1 -- 172.21.15.148:0/1752033543 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416800eb30 con 0x7f41580038e0 2023-10-24T00:29:28.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 -- 172.21.15.148:0/1752033543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41580038e0 msgr2=0x7f4158003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 --2- 172.21.15.148:0/1752033543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41580038e0 0x7f4158003d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f4168009d00 tx=0x7f4168006f40).stop 2023-10-24T00:29:28.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f41729bd700 1 -- 172.21.15.148:0/1752033543 reap_dead start 2023-10-24T00:29:28.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 -- 172.21.15.148:0/1752033543 shutdown_connections 2023-10-24T00:29:28.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 -- 172.21.15.148:0/1752033543 >> 172.21.15.148:0/1752033543 conn(0x7f416c092480 msgr2=0x7f416c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 -- 172.21.15.148:0/1752033543 shutdown_connections 2023-10-24T00:29:28.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.550+0000 7f4174420700 1 -- 172.21.15.148:0/1752033543 wait complete. 2023-10-24T00:29:28.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.551+0000 7f4174420700 1 Processor -- start 2023-10-24T00:29:28.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 -- start start 2023-10-24T00:29:28.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41580038e0 0x7f416c13e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f416c0a9e90 0x7f416c0aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c153070 con 0x7f416c0abdc0 2023-10-24T00:29:28.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c153bf0 con 0x7f416c0a9e90 2023-10-24T00:29:28.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f4174420700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0ac730 con 0x7f41580038e0 2023-10-24T00:29:28.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f41719bb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f41719bb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56272/0 (socket says 172.21.15.148:56272) 2023-10-24T00:29:28.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f41719bb700 1 -- 172.21.15.148:0/379129857 learned_addr learned my addr 172.21.15.148:0/379129857 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:28.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f41729bd700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f416c0a9e90 0x7f416c0aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.552+0000 7f41721bc700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41580038e0 0x7f416c13e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 -- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41580038e0 msgr2=0x7f416c13e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41580038e0 0x7f416c13e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 -- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f416c0a9e90 msgr2=0x7f416c0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f416c0a9e90 0x7f416c0aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 -- 172.21.15.148:0/379129857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c1532c0 con 0x7f416c0abdc0 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41719bb700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f415c004960 tx=0x7f416c0a7af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c011590 con 0x7f416c0abdc0 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0116f0 con 0x7f416c0abdc0 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c011a70 con 0x7f416c0abdc0 2023-10-24T00:29:28.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c1535a0 con 0x7f416c0abdc0 2023-10-24T00:29:28.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.553+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c13ea90 con 0x7f416c0abdc0 2023-10-24T00:29:28.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.554+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c06c6b0 con 0x7f416c0abdc0 2023-10-24T00:29:28.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.554+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f415c015410 con 0x7f416c0abdc0 2023-10-24T00:29:28.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.555+0000 7f41627fc700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 0x7f4150061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.555+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f415c07a270 con 0x7f416c0abdc0 2023-10-24T00:29:28.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.555+0000 7f41721bc700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 0x7f4150061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.555+0000 7f41721bc700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 0x7f4150061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4168009820 tx=0x7f4168019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.559+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f415c04b4e0 con 0x7f416c0abdc0 2023-10-24T00:29:28.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.762+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f416c0a75d0 con 0x7f416c0abdc0 2023-10-24T00:29:28.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.762+0000 7f41627fc700 1 -- 172.21.15.148:0/379129857 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f415c04eb00 con 0x7f416c0abdc0 2023-10-24T00:29:28.765 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:28.766 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:28.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 msgr2=0x7f4150061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 0x7f4150061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f4168009820 tx=0x7f4168019000).stop 2023-10-24T00:29:28.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 msgr2=0x7f416c0ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f415c004960 tx=0x7f416c0a7af0).stop 2023-10-24T00:29:28.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 shutdown_connections 2023-10-24T00:29:28.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f416c0a9e90 0x7f416c0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.764+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41580038e0 0x7f416c13e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.765+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f415005f150 0x7f4150061610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.765+0000 7f4174420700 1 --2- 172.21.15.148:0/379129857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f416c0abdc0 0x7f416c0ac240 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.765+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 >> 172.21.15.148:0/379129857 conn(0x7f416c092480 msgr2=0x7f416c1518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.765+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 shutdown_connections 2023-10-24T00:29:28.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.765+0000 7f4174420700 1 -- 172.21.15.148:0/379129857 wait complete. 2023-10-24T00:29:28.771 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:28.779 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:28.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.890+0000 7fafc6ad3700 1 Processor -- start 2023-10-24T00:29:28.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.890+0000 7fafc6ad3700 1 -- start start 2023-10-24T00:29:28.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc6ad3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafc00695f0 0x7fafc00699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc6ad3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fafc00aacd0 0x7fafc013a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc6ad3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc013ac70 con 0x7fafc013a7e0 2023-10-24T00:29:28.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc6ad3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc00c57b0 con 0x7fafc00695f0 2023-10-24T00:29:28.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc6ad3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc00c5a90 con 0x7fafc00aacd0 2023-10-24T00:29:28.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc486f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafc00695f0 0x7fafc00699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc486f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafc00695f0 0x7fafc00699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56282/0 (socket says 172.21.15.148:56282) 2023-10-24T00:29:28.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafc486f700 1 -- 172.21.15.148:0/3975932606 learned_addr learned my addr 172.21.15.148:0/3975932606 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:28.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.891+0000 7fafbffff700 1 --2- 172.21.15.148:0/3975932606 >> v2:172.21.15.150:3300/0 conn(0x7fafc00aacd0 0x7fafc013a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc486f700 1 -- 172.21.15.148:0/3975932606 >> v2:172.21.15.150:3300/0 conn(0x7fafc00aacd0 msgr2=0x7fafc013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:28.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc486f700 1 --2- 172.21.15.148:0/3975932606 >> v2:172.21.15.150:3300/0 conn(0x7fafc00aacd0 0x7fafc013a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc486f700 1 -- 172.21.15.148:0/3975932606 >> v1:172.21.15.150:6789/0 conn(0x7fafc013a7e0 legacy=0x7fafc0065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc486f700 1 -- 172.21.15.148:0/3975932606 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00c5d70 con 0x7fafc00695f0 2023-10-24T00:29:28.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc486f700 1 --2- 172.21.15.148:0/3975932606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00695f0 0x7fafc00699d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fafc006a020 tx=0x7fafb40090f0).ready entity=mon.0 client_cookie=7257a58be70e3c00 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafbf7fe700 1 -- 172.21.15.148:0/3975932606 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400b520 con 0x7fafc00695f0 2023-10-24T00:29:28.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafbf7fe700 1 -- 172.21.15.148:0/3975932606 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400b680 con 0x7fafc00695f0 2023-10-24T00:29:28.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafbf7fe700 1 -- 172.21.15.148:0/3975932606 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400ba00 con 0x7fafc00695f0 2023-10-24T00:29:28.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 -- 172.21.15.148:0/3975932606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00695f0 msgr2=0x7fafc00699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/3975932606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00695f0 0x7fafc00699d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fafc006a020 tx=0x7fafb40090f0).stop 2023-10-24T00:29:28.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 -- 172.21.15.148:0/3975932606 shutdown_connections 2023-10-24T00:29:28.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/3975932606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00695f0 0x7fafc00699d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/3975932606 >> v2:172.21.15.150:3300/0 conn(0x7fafc00aacd0 0x7fafc013a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.892+0000 7fafc6ad3700 1 -- 172.21.15.148:0/3975932606 >> 172.21.15.148:0/3975932606 conn(0x7fafc00641f0 msgr2=0x7fafc00c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:28.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.893+0000 7fafc6ad3700 1 -- 172.21.15.148:0/3975932606 shutdown_connections 2023-10-24T00:29:28.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.893+0000 7fafc6ad3700 1 -- 172.21.15.148:0/3975932606 wait complete. 2023-10-24T00:29:28.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.894+0000 7fafc6ad3700 1 Processor -- start 2023-10-24T00:29:28.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.894+0000 7fafc6ad3700 1 -- start start 2023-10-24T00:29:28.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.894+0000 7fafc6ad3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc00695f0 0x7fafc01503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc013a7e0 0x7fafc00c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01536e0 con 0x7fafc00aacd0 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0152ad0 con 0x7fafc013a7e0 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0152db0 con 0x7fafc00695f0 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56286/0 (socket says 172.21.15.148:56286) 2023-10-24T00:29:28.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 -- 172.21.15.148:0/1535674656 learned_addr learned my addr 172.21.15.148:0/1535674656 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:28.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc486f700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc00695f0 0x7fafc01503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc5070700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc013a7e0 0x7fafc00c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 -- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc00695f0 msgr2=0x7fafc01503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc00695f0 0x7fafc01503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 -- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc013a7e0 msgr2=0x7fafc00c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc013a7e0 0x7fafc00c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 -- 172.21.15.148:0/1535674656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009370 con 0x7fafc00aacd0 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbffff700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fafac00e930 tx=0x7fafac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac012600 con 0x7fafc00aacd0 2023-10-24T00:29:28.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac012760 con 0x7fafc00aacd0 2023-10-24T00:29:28.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac012ae0 con 0x7fafc00aacd0 2023-10-24T00:29:28.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0153090 con 0x7fafc00aacd0 2023-10-24T00:29:28.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.895+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01508c0 con 0x7fafc00aacd0 2023-10-24T00:29:28.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.896+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc006c6b0 con 0x7fafc00aacd0 2023-10-24T00:29:28.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.897+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fafac01b400 con 0x7fafc00aacd0 2023-10-24T00:29:28.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.897+0000 7fafbcff9700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:28.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.897+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fafac07a5d0 con 0x7fafc00aacd0 2023-10-24T00:29:28.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.897+0000 7fafc486f700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:28.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.898+0000 7fafc486f700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 0x7fafa4061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fafb4009130 tx=0x7fafb4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:28.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:28.901+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fafac04b840 con 0x7fafc00aacd0 2023-10-24T00:29:29.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.069+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafc0061440 con 0x7fafc00aacd0 2023-10-24T00:29:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.070+0000 7fafbcff9700 1 -- 172.21.15.148:0/1535674656 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fafac04ee60 con 0x7fafc00aacd0 2023-10-24T00:29:29.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:29.074 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:29.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 msgr2=0x7fafa4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 0x7fafa4061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fafb4009130 tx=0x7fafb4017000).stop 2023-10-24T00:29:29.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 msgr2=0x7fafc0153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fafac00e930 tx=0x7fafac009060).stop 2023-10-24T00:29:29.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 shutdown_connections 2023-10-24T00:29:29.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc013a7e0 0x7fafc00c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc00695f0 0x7fafc01503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 --2- 172.21.15.148:0/1535674656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc00aacd0 0x7fafc0153b70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 >> 172.21.15.148:0/1535674656 conn(0x7fafc00641f0 msgr2=0x7fafc00c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 shutdown_connections 2023-10-24T00:29:29.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.072+0000 7fafc6ad3700 1 -- 172.21.15.148:0/1535674656 wait complete. 2023-10-24T00:29:29.087 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:29:29.088 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:29.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.198+0000 7f0584a81700 1 Processor -- start 2023-10-24T00:29:29.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.198+0000 7f0584a81700 1 -- start start 2023-10-24T00:29:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f0584a81700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0580153d40 0x7f0580154120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f0584a81700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800c7510 con 0x7f0580064cb0 2023-10-24T00:29:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f0584a81700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800a8470 con 0x7f05800beb90 2023-10-24T00:29:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f0584a81700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0580065820 con 0x7f0580153d40 2023-10-24T00:29:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f057f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0580153d40 0x7f0580154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f057effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0580064cb0 0x7f05800be480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46226/0 (socket says 172.21.15.148:46226) 2023-10-24T00:29:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.199+0000 7f057effd700 1 -- 172.21.15.148:0/2227202246 learned_addr learned my addr 172.21.15.148:0/2227202246 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057f7fe700 1 -- 172.21.15.148:0/2227202246 >> v1:172.21.15.150:6789/0 conn(0x7f05800beb90 legacy=0x7f05800c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057f7fe700 1 -- 172.21.15.148:0/2227202246 >> v1:172.21.15.148:6789/0 conn(0x7f0580064cb0 legacy=0x7f05800be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057f7fe700 1 -- 172.21.15.148:0/2227202246 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800c6be0 con 0x7f0580153d40 2023-10-24T00:29:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057e7fc700 1 -- 172.21.15.148:0/2227202246 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482296600 0 0) 0x7f05800c7510 con 0x7f0580064cb0 2023-10-24T00:29:29.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057f7fe700 1 --2- 172.21.15.148:0/2227202246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580153d40 0x7f0580154120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0570009e60 tx=0x7f0570009780).ready entity=mon.0 client_cookie=7f2e9de69e48a47a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057e7fc700 1 -- 172.21.15.148:0/2227202246 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000e070 con 0x7f0580153d40 2023-10-24T00:29:29.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057e7fc700 1 -- 172.21.15.148:0/2227202246 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000bc30 con 0x7f0580153d40 2023-10-24T00:29:29.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f057e7fc700 1 -- 172.21.15.148:0/2227202246 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570012410 con 0x7f0580153d40 2023-10-24T00:29:29.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 -- 172.21.15.148:0/2227202246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580153d40 msgr2=0x7f0580154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 --2- 172.21.15.148:0/2227202246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580153d40 0x7f0580154120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0570009e60 tx=0x7f0570009780).stop 2023-10-24T00:29:29.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 -- 172.21.15.148:0/2227202246 shutdown_connections 2023-10-24T00:29:29.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 --2- 172.21.15.148:0/2227202246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580153d40 0x7f0580154120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 -- 172.21.15.148:0/2227202246 >> 172.21.15.148:0/2227202246 conn(0x7f05800922e0 msgr2=0x7f0580062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 -- 172.21.15.148:0/2227202246 shutdown_connections 2023-10-24T00:29:29.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.200+0000 7f0584a81700 1 -- 172.21.15.148:0/2227202246 wait complete. 2023-10-24T00:29:29.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 Processor -- start 2023-10-24T00:29:29.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 -- start start 2023-10-24T00:29:29.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 0x7f05800a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 0x7f0580151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580095f40 con 0x7f0580064cb0 2023-10-24T00:29:29.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800ac3d0 con 0x7f05800beb90 2023-10-24T00:29:29.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f0584a81700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800956a0 con 0x7f0580153d40 2023-10-24T00:29:29.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f057f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.202+0000 7f057f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56302/0 (socket says 172.21.15.148:56302) 2023-10-24T00:29:29.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 -- 172.21.15.148:0/2793569553 learned_addr learned my addr 172.21.15.148:0/2793569553 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:29.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057effd700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 0x7f05800a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 -- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 msgr2=0x7f0580151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057ffff700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 0x7f0580151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 0x7f0580151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 -- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 msgr2=0x7f05800a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 0x7f05800a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 -- 172.21.15.148:0/2793569553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009a20 con 0x7f0580064cb0 2023-10-24T00:29:29.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057effd700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 0x7f05800a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:29.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057ffff700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 0x7f0580151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:29.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f057f7fe700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f057000b6c0 tx=0x7f0570009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057001d630 con 0x7f0580064cb0 2023-10-24T00:29:29.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057001d790 con 0x7f0580064cb0 2023-10-24T00:29:29.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580095980 con 0x7f0580064cb0 2023-10-24T00:29:29.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057001db50 con 0x7f0580064cb0 2023-10-24T00:29:29.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.203+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580150270 con 0x7f0580064cb0 2023-10-24T00:29:29.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.204+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05800ac230 con 0x7f0580064cb0 2023-10-24T00:29:29.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.204+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0570026410 con 0x7f0580064cb0 2023-10-24T00:29:29.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.205+0000 7f05677fe700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 0x7f056c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.205+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f057007c170 con 0x7f0580064cb0 2023-10-24T00:29:29.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.205+0000 7f057effd700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 0x7f056c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.205+0000 7f057effd700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 0x7f056c061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0574001750 tx=0x7f0574009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.209+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f05800ac230 con 0x7f0580064cb0 2023-10-24T00:29:29.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.411+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05800ac230 con 0x7f0580064cb0 2023-10-24T00:29:29.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.411+0000 7f05677fe700 1 -- 172.21.15.148:0/2793569553 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f05800ac230 con 0x7f0580064cb0 2023-10-24T00:29:29.414 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:29.414 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 msgr2=0x7f056c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 0x7f056c061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0574001750 tx=0x7f0574009040).stop 2023-10-24T00:29:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 msgr2=0x7f058014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f057000b6c0 tx=0x7f0570009780).stop 2023-10-24T00:29:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 shutdown_connections 2023-10-24T00:29:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0580153d40 0x7f0580151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f056c05f150 0x7f056c061610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0580064cb0 0x7f058014fd80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 --2- 172.21.15.148:0/2793569553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05800beb90 0x7f05800a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 >> 172.21.15.148:0/2793569553 conn(0x7f05800922e0 msgr2=0x7f05800a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 shutdown_connections 2023-10-24T00:29:29.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.413+0000 7f0584a81700 1 -- 172.21.15.148:0/2793569553 wait complete. 2023-10-24T00:29:29.419 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:29.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:29.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 Processor -- start 2023-10-24T00:29:29.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 -- start start 2023-10-24T00:29:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f70154540 0x7f3f700640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 0x7f3f700a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f700be650 0x7f3f700a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f700a8750 con 0x7f3f70154540 2023-10-24T00:29:29.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f700a5bd0 con 0x7f3f700645a0 2023-10-24T00:29:29.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.539+0000 7f3f75ea9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f70064ab0 con 0x7f3f700be650 2023-10-24T00:29:29.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f70154540 0x7f3f700640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f70154540 0x7f3f700640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56318/0 (socket says 172.21.15.148:56318) 2023-10-24T00:29:29.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/2475533564 learned_addr learned my addr 172.21.15.148:0/2475533564 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:29.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6ffff700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f700be650 0x7f3f700a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6effd700 1 --2- 172.21.15.148:0/2475533564 >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 0x7f3f700a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/2475533564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f700be650 msgr2=0x7f3f700a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:29.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f700be650 0x7f3f700a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/2475533564 >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 msgr2=0x7f3f700a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:29.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/2475533564 >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 0x7f3f700a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/2475533564 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70064d90 con 0x7f3f70154540 2023-10-24T00:29:29.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6effd700 1 --2- 172.21.15.148:0/2475533564 >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 0x7f3f700a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:29.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f70154540 0x7f3f700640b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3f7006c330 tx=0x7f3f60009840).ready entity=mon.0 client_cookie=b866d65c6d6e1694 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6e7fc700 1 -- 172.21.15.148:0/2475533564 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000e070 con 0x7f3f70154540 2023-10-24T00:29:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6e7fc700 1 -- 172.21.15.148:0/2475533564 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6000ba20 con 0x7f3f70154540 2023-10-24T00:29:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.540+0000 7f3f6e7fc700 1 -- 172.21.15.148:0/2475533564 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000bda0 con 0x7f3f70154540 2023-10-24T00:29:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 -- 172.21.15.148:0/2475533564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f70154540 msgr2=0x7f3f700640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f70154540 0x7f3f700640b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3f7006c330 tx=0x7f3f60009840).stop 2023-10-24T00:29:29.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 -- 172.21.15.148:0/2475533564 shutdown_connections 2023-10-24T00:29:29.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f70154540 0x7f3f700640b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/2475533564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f700be650 0x7f3f700a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/2475533564 >> v2:172.21.15.150:3300/0 conn(0x7f3f700645a0 0x7f3f700a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 -- 172.21.15.148:0/2475533564 >> 172.21.15.148:0/2475533564 conn(0x7f3f70092480 msgr2=0x7f3f70062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 -- 172.21.15.148:0/2475533564 shutdown_connections 2023-10-24T00:29:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.541+0000 7f3f75ea9700 1 -- 172.21.15.148:0/2475533564 wait complete. 2023-10-24T00:29:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.542+0000 7f3f75ea9700 1 Processor -- start 2023-10-24T00:29:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.542+0000 7f3f75ea9700 1 -- start start 2023-10-24T00:29:29.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f700be650 0x7f3f700ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 0x7f3f700a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7014d580 con 0x7f3f700645a0 2023-10-24T00:29:29.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700a9d50 con 0x7f3f700be650 2023-10-24T00:29:29.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f75ea9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700aa020 con 0x7f3f70154540 2023-10-24T00:29:29.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56334/0 (socket says 172.21.15.148:56334) 2023-10-24T00:29:29.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/1545389935 learned_addr learned my addr 172.21.15.148:0/1545389935 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:29.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6ffff700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 0x7f3f700a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6effd700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f700be650 0x7f3f700ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 msgr2=0x7f3f700a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 0x7f3f700a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f700be650 msgr2=0x7f3f700ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f700be650 0x7f3f700ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 -- 172.21.15.148:0/1545389935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60009ae0 con 0x7f3f700645a0 2023-10-24T00:29:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6ffff700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 0x7f3f700a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f6f7fe700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f3f7005f5d0 tx=0x7f3f60009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.543+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600032f0 con 0x7f3f700645a0 2023-10-24T00:29:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.544+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6000bb90 con 0x7f3f700645a0 2023-10-24T00:29:29.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.544+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f700aa300 con 0x7f3f700645a0 2023-10-24T00:29:29.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.544+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6001e470 con 0x7f3f700645a0 2023-10-24T00:29:29.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.544+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7014d1a0 con 0x7f3f700645a0 2023-10-24T00:29:29.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.544+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7014d6c0 con 0x7f3f700645a0 2023-10-24T00:29:29.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.545+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3f60003040 con 0x7f3f700645a0 2023-10-24T00:29:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.545+0000 7f3f577fe700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 0x7f3f5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.545+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f6007b560 con 0x7f3f700645a0 2023-10-24T00:29:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.545+0000 7f3f6effd700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 0x7f3f5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.546+0000 7f3f6effd700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 0x7f3f5c061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3f64006d80 tx=0x7f3f64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.549+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3f7014d6c0 con 0x7f3f700645a0 2023-10-24T00:29:29.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.751+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f7006c6b0 con 0x7f3f700645a0 2023-10-24T00:29:29.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.752+0000 7f3f577fe700 1 -- 172.21.15.148:0/1545389935 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f3f60023020 con 0x7f3f700645a0 2023-10-24T00:29:29.755 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:29.755 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3030659884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3030659884},{"type":"v1","addr":"172.21.15.148:6835","nonce":3030659884}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1039880166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1039880166},{"type":"v1","addr":"172.21.15.150:6836","nonce":1039880166}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/136122479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":136122479},{"type":"v1","addr":"172.21.15.148:6833","nonce":136122479}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:28:53.185947+0000","modified":"2023-10-24T00:28:55.191813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/973806407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":973806407},{"type":"v1","addr":"172.21.15.150:6837","nonce":973806407}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-24T00:29:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 msgr2=0x7f3f5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 0x7f3f5c061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3f64006d80 tx=0x7f3f64008040).stop 2023-10-24T00:29:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 msgr2=0x7f3f700abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f3f7005f5d0 tx=0x7f3f60009840).stop 2023-10-24T00:29:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 shutdown_connections 2023-10-24T00:29:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f70154540 0x7f3f700a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f5c05f150 0x7f3f5c061610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f700645a0 0x7f3f700abdc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 --2- 172.21.15.148:0/1545389935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f700be650 0x7f3f700ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 >> 172.21.15.148:0/1545389935 conn(0x7f3f70092480 msgr2=0x7f3f70066660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 shutdown_connections 2023-10-24T00:29:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.754+0000 7f3f75ea9700 1 -- 172.21.15.148:0/1545389935 wait complete. 2023-10-24T00:29:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 6 2023-10-24T00:29:29.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:29.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.880+0000 7f92bf9df700 1 Processor -- start 2023-10-24T00:29:29.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.880+0000 7f92bf9df700 1 -- start start 2023-10-24T00:29:29.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bf9df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 0x7f92b80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bf9df700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92b80c6710 0x7f92b80aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bf9df700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80c0960 con 0x7f92b8158770 2023-10-24T00:29:29.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bf9df700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80aa8e0 con 0x7f92b80c6710 2023-10-24T00:29:29.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bf9df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80c0c40 con 0x7f92b80aa010 2023-10-24T00:29:29.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92b80c6710 0x7f92b80aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bdf7c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f92b8158770 0x7f92b8069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46232/0 (socket says 172.21.15.148:46232) 2023-10-24T00:29:29.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92b80c6710 0x7f92b80aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56346/0 (socket says 172.21.15.148:56346) 2023-10-24T00:29:29.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bdf7c700 1 -- 172.21.15.148:0/1626833853 learned_addr learned my addr 172.21.15.148:0/1626833853 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:29.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bd77b700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 0x7f92b80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 -- 172.21.15.148:0/1626833853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 msgr2=0x7f92b80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:29.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 0x7f92b80c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 -- 172.21.15.148:0/1626833853 >> v1:172.21.15.148:6789/0 conn(0x7f92b8158770 legacy=0x7f92b8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 -- 172.21.15.148:0/1626833853 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80c0f20 con 0x7f92b80c6710 2023-10-24T00:29:29.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bd77b700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 0x7f92b80c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:29.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.881+0000 7f92bcf7a700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b80c6710 0x7f92b80aa3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f92a8009760 tx=0x7f92a8009060).ready entity=mon.0 client_cookie=385bca60c318e026 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92affff700 1 -- 172.21.15.148:0/1626833853 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80090d0 con 0x7f92b80c6710 2023-10-24T00:29:29.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92affff700 1 -- 172.21.15.148:0/1626833853 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800f510 con 0x7f92b80c6710 2023-10-24T00:29:29.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92affff700 1 -- 172.21.15.148:0/1626833853 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800f890 con 0x7f92b80c6710 2023-10-24T00:29:29.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 -- 172.21.15.148:0/1626833853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b80c6710 msgr2=0x7f92b80aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b80c6710 0x7f92b80aa3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f92a8009760 tx=0x7f92a8009060).stop 2023-10-24T00:29:29.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 -- 172.21.15.148:0/1626833853 shutdown_connections 2023-10-24T00:29:29.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80aa010 0x7f92b80c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 --2- 172.21.15.148:0/1626833853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b80c6710 0x7f92b80aa3f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 -- 172.21.15.148:0/1626833853 >> 172.21.15.148:0/1626833853 conn(0x7f92b80caf40 msgr2=0x7f92b80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:29.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 -- 172.21.15.148:0/1626833853 shutdown_connections 2023-10-24T00:29:29.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.882+0000 7f92bf9df700 1 -- 172.21.15.148:0/1626833853 wait complete. 2023-10-24T00:29:29.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.883+0000 7f92bf9df700 1 Processor -- start 2023-10-24T00:29:29.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.883+0000 7f92bf9df700 1 -- start start 2023-10-24T00:29:29.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 0x7f92b8152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80c6710 0x7f92b8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8156730 con 0x7f92b8158770 2023-10-24T00:29:29.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8155b20 con 0x7f92b80aa010 2023-10-24T00:29:29.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bf9df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8155e00 con 0x7f92b80c6710 2023-10-24T00:29:29.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bdf7c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bdf7c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56352/0 (socket says 172.21.15.148:56352) 2023-10-24T00:29:29.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bdf7c700 1 -- 172.21.15.148:0/783004900 learned_addr learned my addr 172.21.15.148:0/783004900 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:29.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bcf7a700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80c6710 0x7f92b8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.884+0000 7f92bd77b700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 0x7f92b8152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 -- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80c6710 msgr2=0x7f92b8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80c6710 0x7f92b8156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 -- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 msgr2=0x7f92b8152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 0x7f92b8152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:29.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 -- 172.21.15.148:0/783004900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80092a0 con 0x7f92b8158770 2023-10-24T00:29:29.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bd77b700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 0x7f92b8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:29.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bdf7c700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f92b000c890 tx=0x7f92b0001610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0005d30 con 0x7f92b8158770 2023-10-24T00:29:29.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0005e90 con 0x7f92b8158770 2023-10-24T00:29:29.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b81560e0 con 0x7f92b8158770 2023-10-24T00:29:29.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0007320 con 0x7f92b8158770 2023-10-24T00:29:29.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.885+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b8155810 con 0x7f92b8158770 2023-10-24T00:29:29.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.886+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b806c6b0 con 0x7f92b8158770 2023-10-24T00:29:29.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.886+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f92b0007710 con 0x7f92b8158770 2023-10-24T00:29:29.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.887+0000 7f92ad7fa700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 0x7f929c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:29.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.887+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f92b007a400 con 0x7f92b8158770 2023-10-24T00:29:29.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.887+0000 7f92bd77b700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 0x7f929c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:29.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.887+0000 7f92bd77b700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 0x7f929c061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f92b4006fd0 tx=0x7f92b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:29.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:29.891+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f92b004b5b0 con 0x7f92b8158770 2023-10-24T00:29:30.054 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:29:30.057 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:29:30.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.055+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92b80c1200 con 0x7f92b8158770 2023-10-24T00:29:30.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.055+0000 7f92ad7fa700 1 -- 172.21.15.148:0/783004900 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f92b004ebd0 con 0x7f92b8158770 2023-10-24T00:29:30.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:30.060 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:28:54.187640+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:28:51.624309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-24T00:28:52.145190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 msgr2=0x7f929c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 0x7f929c061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f92b4006fd0 tx=0x7f92b4008040).stop 2023-10-24T00:29:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 msgr2=0x7f92b80c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f92b000c890 tx=0x7f92b0001610).stop 2023-10-24T00:29:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 shutdown_connections 2023-10-24T00:29:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f929c05f150 0x7f929c061610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92b8158770 0x7f92b80c4630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92b80aa010 0x7f92b8152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.057+0000 7f92bf9df700 1 --2- 172.21.15.148:0/783004900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92b80c6710 0x7f92b8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.058+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 >> 172.21.15.148:0/783004900 conn(0x7f92b80caf40 msgr2=0x7f92b8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:30.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.058+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 shutdown_connections 2023-10-24T00:29:30.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.058+0000 7f92bf9df700 1 -- 172.21.15.148:0/783004900 wait complete. 2023-10-24T00:29:30.074 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:29:30.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.264+0000 7feb02cf7700 1 Processor -- start 2023-10-24T00:29:30.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.264+0000 7feb02cf7700 1 -- start start 2023-10-24T00:29:30.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb02cf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feafc068a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb02cf7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc065ad0 con 0x7feafc153950 2023-10-24T00:29:30.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb02cf7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc069000 con 0x7feafc153d30 2023-10-24T00:29:30.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb02cf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c31b0 con 0x7feafc06a060 2023-10-24T00:29:30.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb00a93700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feafc153950 0x7feafc0c21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46248/0 (socket says 172.21.15.148:46248) 2023-10-24T00:29:30.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.265+0000 7feb00a93700 1 -- 172.21.15.148:0/1970904725 learned_addr learned my addr 172.21.15.148:0/1970904725 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:30.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf3fff700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feafc068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985756024 0 0) 0x7feafc065ad0 con 0x7feafc153950 2023-10-24T00:29:30.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae40033f0 con 0x7feafc153950 2023-10-24T00:29:30.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366853104 0 0) 0x7feae40033f0 con 0x7feafc153950 2023-10-24T00:29:30.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 msgr2=0x7feafc068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:30.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feafc068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 >> v1:172.21.15.150:6789/0 conn(0x7feafc153d30 legacy=0x7feafc064970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0692a0 con 0x7feafc153950 2023-10-24T00:29:30.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7feaf80017f0 con 0x7feafc153950 2023-10-24T00:29:30.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 >> v1:172.21.15.148:6789/0 conn(0x7feafc153950 legacy=0x7feafc0c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feae4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4004690 0x7feae4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feae4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0c31b0 con 0x7feae4003910 2023-10-24T00:29:30.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae400c9f0 con 0x7feae4004690 2023-10-24T00:29:30.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae40058e0 con 0x7feafc06a060 2023-10-24T00:29:30.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feae4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feaf3fff700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4004690 0x7feae4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb01294700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feae4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 -- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 msgr2=0x7feae4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:30.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc06a060 0x7feae4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 -- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4004690 msgr2=0x7feae4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:30.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feae4004690 0x7feae4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 -- 172.21.15.148:0/1970904725 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40033f0 con 0x7feae4003910 2023-10-24T00:29:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.266+0000 7feb00a93700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feae4003cf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7feaf800c5f0 tx=0x7feaf8001d10).ready entity=mon.0 client_cookie=51f8bd81fae1a842 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8001f40 con 0x7feae4003910 2023-10-24T00:29:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800cd90 con 0x7feae4003910 2023-10-24T00:29:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feaf37fe700 1 -- 172.21.15.148:0/1970904725 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8005d30 con 0x7feae4003910 2023-10-24T00:29:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 -- 172.21.15.148:0/1970904725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 msgr2=0x7feae4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 --2- 172.21.15.148:0/1970904725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feae4003cf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7feaf800c5f0 tx=0x7feaf8001d10).stop 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb01294700 1 -- 172.21.15.148:0/1970904725 reap_dead start 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 -- 172.21.15.148:0/1970904725 shutdown_connections 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 -- 172.21.15.148:0/1970904725 >> 172.21.15.148:0/1970904725 conn(0x7feafc0c6bf0 msgr2=0x7feafc0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 -- 172.21.15.148:0/1970904725 shutdown_connections 2023-10-24T00:29:30.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.267+0000 7feb02cf7700 1 -- 172.21.15.148:0/1970904725 wait complete. 2023-10-24T00:29:30.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.268+0000 7feb02cf7700 1 Processor -- start 2023-10-24T00:29:30.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.268+0000 7feb02cf7700 1 -- start start 2023-10-24T00:29:30.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc0a74c0 0x7feafc1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feafc0a7940 0x7feafc164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0aab50 con 0x7feae4003910 2023-10-24T00:29:30.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc14ddf0 con 0x7feafc0a7940 2023-10-24T00:29:30.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb02cf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0aada0 con 0x7feafc0a74c0 2023-10-24T00:29:30.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56370/0 (socket says 172.21.15.148:56370) 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 -- 172.21.15.148:0/2610709684 learned_addr learned my addr 172.21.15.148:0/2610709684 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 -- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc0a74c0 msgr2=0x7feafc1646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc0a74c0 0x7feafc1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 -- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feafc0a7940 msgr2=0x7feafc164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.269+0000 7feb00a93700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feafc0a7940 0x7feafc164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:30.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feb00a93700 1 -- 172.21.15.148:0/2610709684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0ab080 con 0x7feae4003910 2023-10-24T00:29:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feb00a93700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feae40045b0 tx=0x7feaf8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80017c0 con 0x7feae4003910 2023-10-24T00:29:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80074f0 con 0x7feae4003910 2023-10-24T00:29:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80078b0 con 0x7feae4003910 2023-10-24T00:29:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc0ab360 con 0x7feae4003910 2023-10-24T00:29:30.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.270+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc152b00 con 0x7feae4003910 2023-10-24T00:29:30.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.271+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc0ab800 con 0x7feae4003910 2023-10-24T00:29:30.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.271+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feaf8013660 con 0x7feae4003910 2023-10-24T00:29:30.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.271+0000 7feaf0ff9700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 0x7feae8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.272+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feaf807b2d0 con 0x7feae4003910 2023-10-24T00:29:30.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.272+0000 7feaf3fff700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 0x7feae8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.272+0000 7feaf3fff700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 0x7feae8061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7feafc0c28a0 tx=0x7feaec009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.276+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feaf804c5a0 con 0x7feae4003910 2023-10-24T00:29:30.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.478+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feafc0ab9b0 con 0x7feae4003910 2023-10-24T00:29:30.831 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:29:30.829+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:29:30.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.836+0000 7feaf0ff9700 1 -- 172.21.15.148:0/2610709684 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7feaf801a020 con 0x7feae4003910 2023-10-24T00:29:30.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 msgr2=0x7feae8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 0x7feae8061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7feafc0c28a0 tx=0x7feaec009060).stop 2023-10-24T00:29:30.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 msgr2=0x7feafc14d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feae40045b0 tx=0x7feaf8015000).stop 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 shutdown_connections 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feafc0a7940 0x7feafc164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feae805f150 0x7feae8061610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae4003910 0x7feafc14d900 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 --2- 172.21.15.148:0/2610709684 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feafc0a74c0 0x7feafc1646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:30.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 >> 172.21.15.148:0/2610709684 conn(0x7feafc0c6bf0 msgr2=0x7feafc064b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:30.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 shutdown_connections 2023-10-24T00:29:30.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.838+0000 7feb02cf7700 1 -- 172.21.15.148:0/2610709684 wait complete. 2023-10-24T00:29:30.843 INFO:tasks.ceph.mds.d.smithi150.stderr: -1822> 2023-10-24T00:28:54.906+0000 7f311db36700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:29:30.844 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:29:30.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:29:30.864 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:29:30.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.966+0000 7f16c226c700 1 Processor -- start 2023-10-24T00:29:30.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.966+0000 7f16c226c700 1 -- start start 2023-10-24T00:29:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16bc157780 0x7f16bc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0c0960 0x7f16bc0a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16bc0a8120 0x7f16bc0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16bc0c6770 con 0x7f16bc157780 2023-10-24T00:29:30.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16bc0c1120 con 0x7f16bc0a8120 2023-10-24T00:29:30.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c226c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0c1400 con 0x7f16bc0c0960 2023-10-24T00:29:30.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16bc157780 0x7f16bc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16bc157780 0x7f16bc0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56378/0 (socket says 172.21.15.148:56378) 2023-10-24T00:29:30.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 -- 172.21.15.148:0/1313876465 learned_addr learned my addr 172.21.15.148:0/1313876465 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:30.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c1a6b700 1 --2- 172.21.15.148:0/1313876465 >> v2:172.21.15.150:3300/0 conn(0x7f16bc0a8120 0x7f16bc0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c0a69700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0c0960 0x7f16bc0a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 -- 172.21.15.148:0/1313876465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0c0960 msgr2=0x7f16bc0a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:30.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0c0960 0x7f16bc0a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 -- 172.21.15.148:0/1313876465 >> v2:172.21.15.150:3300/0 conn(0x7f16bc0a8120 msgr2=0x7f16bc0a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:30.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 --2- 172.21.15.148:0/1313876465 >> v2:172.21.15.150:3300/0 conn(0x7f16bc0a8120 0x7f16bc0a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 -- 172.21.15.148:0/1313876465 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0c6120 con 0x7f16bc157780 2023-10-24T00:29:30.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.967+0000 7f16c126a700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc0c8530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f16bc0bfef0 tx=0x7f16b4009060).ready entity=mon.0 client_cookie=7ee978b228420586 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16bbfff700 1 -- 172.21.15.148:0/1313876465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4005880 con 0x7f16bc157780 2023-10-24T00:29:30.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16bbfff700 1 -- 172.21.15.148:0/1313876465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b40059e0 con 0x7f16bc157780 2023-10-24T00:29:30.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16bbfff700 1 -- 172.21.15.148:0/1313876465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b4005d60 con 0x7f16bc157780 2023-10-24T00:29:30.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 -- 172.21.15.148:0/1313876465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 msgr2=0x7f16bc0c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc0c8530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f16bc0bfef0 tx=0x7f16b4009060).stop 2023-10-24T00:29:30.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 -- 172.21.15.148:0/1313876465 shutdown_connections 2023-10-24T00:29:30.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc0c8530 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 --2- 172.21.15.148:0/1313876465 >> v2:172.21.15.150:3300/0 conn(0x7f16bc0a8120 0x7f16bc0a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 --2- 172.21.15.148:0/1313876465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0c0960 0x7f16bc0a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 -- 172.21.15.148:0/1313876465 >> 172.21.15.148:0/1313876465 conn(0x7f16bc094570 msgr2=0x7f16bc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:30.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 -- 172.21.15.148:0/1313876465 shutdown_connections 2023-10-24T00:29:30.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.968+0000 7f16c226c700 1 -- 172.21.15.148:0/1313876465 wait complete. 2023-10-24T00:29:30.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.969+0000 7f16c226c700 1 Processor -- start 2023-10-24T00:29:30.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.969+0000 7f16c226c700 1 -- start start 2023-10-24T00:29:30.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0a8120 0x7f16bc168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16bc0c0960 0x7f16bc168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc168b00 con 0x7f16bc157780 2023-10-24T00:29:30.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc0cb5e0 con 0x7f16bc0c0960 2023-10-24T00:29:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c226c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc165d20 con 0x7f16bc0a8120 2023-10-24T00:29:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c1a6b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c1a6b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56388/0 (socket says 172.21.15.148:56388) 2023-10-24T00:29:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c1a6b700 1 -- 172.21.15.148:0/2468716404 learned_addr learned my addr 172.21.15.148:0/2468716404 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:30.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c126a700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0a8120 0x7f16bc168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.970+0000 7f16c0a69700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16bc0c0960 0x7f16bc168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 -- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0a8120 msgr2=0x7f16bc168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0a8120 0x7f16bc168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 -- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16bc0c0960 msgr2=0x7f16bc168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16bc0c0960 0x7f16bc168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 -- 172.21.15.148:0/2468716404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009300 con 0x7f16bc157780 2023-10-24T00:29:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c1a6b700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f16ac009ef0 tx=0x7f16ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00cc50 con 0x7f16bc157780 2023-10-24T00:29:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00f040 con 0x7f16bc157780 2023-10-24T00:29:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc166000 con 0x7f16bc157780 2023-10-24T00:29:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac013400 con 0x7f16bc157780 2023-10-24T00:29:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.971+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc1665c0 con 0x7f16bc157780 2023-10-24T00:29:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.972+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16bc1667e0 con 0x7f16bc157780 2023-10-24T00:29:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.972+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f16ac013770 con 0x7f16bc157780 2023-10-24T00:29:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.972+0000 7f16b97fa700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 0x7f16a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.972+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f16ac07ab70 con 0x7f16bc157780 2023-10-24T00:29:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.973+0000 7f16c126a700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 0x7f16a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.973+0000 7f16c126a700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 0x7f16a8061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f16b4009150 tx=0x7f16b4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:30.977+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f16ac04bdf0 con 0x7f16bc157780 2023-10-24T00:29:31.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.180+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f16bc047480 con 0x7f16bc157780 2023-10-24T00:29:31.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.838+0000 7f16b97fa700 1 -- 172.21.15.148:0/2468716404 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16ac04f410 con 0x7f16bc157780 2023-10-24T00:29:31.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 msgr2=0x7f16a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 0x7f16a8061610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f16b4009150 tx=0x7f16b4016000).stop 2023-10-24T00:29:31.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 msgr2=0x7f16bc164b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f16ac009ef0 tx=0x7f16ac00b040).stop 2023-10-24T00:29:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 shutdown_connections 2023-10-24T00:29:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16a805f150 0x7f16a8061610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16bc157780 0x7f16bc164b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16bc0a8120 0x7f16bc168120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 --2- 172.21.15.148:0/2468716404 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16bc0c0960 0x7f16bc168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 >> 172.21.15.148:0/2468716404 conn(0x7f16bc094570 msgr2=0x7f16bc14ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:31.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 shutdown_connections 2023-10-24T00:29:31.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.840+0000 7f16c226c700 1 -- 172.21.15.148:0/2468716404 wait complete. 2023-10-24T00:29:31.855 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:29:31.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.971+0000 7f52c759e700 1 Processor -- start 2023-10-24T00:29:31.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.971+0000 7f52c759e700 1 -- start start 2023-10-24T00:29:31.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52c8155350 0x7f52c80aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 0x7f52c8153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c80c7770 con 0x7f52c80a9f40 2023-10-24T00:29:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80c1070 con 0x7f52c8155350 2023-10-24T00:29:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80c79e0 con 0x7f52c80c81e0 2023-10-24T00:29:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52c8155350 0x7f52c80aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f52c80a9f40 0x7f52c80c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46262/0 (socket says 172.21.15.148:46262) 2023-10-24T00:29:31.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c659c700 1 -- 172.21.15.148:0/1744362850 learned_addr learned my addr 172.21.15.148:0/1744362850 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:31.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c6d9d700 1 --2- 172.21.15.148:0/1744362850 >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 0x7f52c8153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 -- 172.21.15.148:0/1744362850 >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 msgr2=0x7f52c8153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:31.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 --2- 172.21.15.148:0/1744362850 >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 0x7f52c8153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 -- 172.21.15.148:0/1744362850 >> v1:172.21.15.148:6789/0 conn(0x7f52c80a9f40 legacy=0x7f52c80c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c5d9b700 1 -- 172.21.15.148:0/1744362850 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933585905 0 0) 0x7f52c80c7770 con 0x7f52c80a9f40 2023-10-24T00:29:31.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 -- 172.21.15.148:0/1744362850 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80c7cc0 con 0x7f52c8155350 2023-10-24T00:29:31.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c6d9d700 1 --2- 172.21.15.148:0/1744362850 >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 0x7f52c8153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:31.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52bdd9b700 1 --2- 172.21.15.148:0/1744362850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c8155350 0x7f52c80aa320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f52c80c7460 tx=0x7f52b0009060).ready entity=mon.0 client_cookie=58e070160a3d0a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:31.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c5d9b700 1 -- 172.21.15.148:0/1744362850 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000b580 con 0x7f52c8155350 2023-10-24T00:29:31.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c5d9b700 1 -- 172.21.15.148:0/1744362850 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000b6e0 con 0x7f52c8155350 2023-10-24T00:29:31.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.972+0000 7f52c5d9b700 1 -- 172.21.15.148:0/1744362850 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000ba60 con 0x7f52c8155350 2023-10-24T00:29:31.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 -- 172.21.15.148:0/1744362850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c8155350 msgr2=0x7f52c80aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 --2- 172.21.15.148:0/1744362850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c8155350 0x7f52c80aa320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f52c80c7460 tx=0x7f52b0009060).stop 2023-10-24T00:29:31.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 -- 172.21.15.148:0/1744362850 shutdown_connections 2023-10-24T00:29:31.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 --2- 172.21.15.148:0/1744362850 >> v2:172.21.15.150:3300/0 conn(0x7f52c80c81e0 0x7f52c8153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 --2- 172.21.15.148:0/1744362850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c8155350 0x7f52c80aa320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 -- 172.21.15.148:0/1744362850 >> 172.21.15.148:0/1744362850 conn(0x7f52c8094420 msgr2=0x7f52c806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:31.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 -- 172.21.15.148:0/1744362850 shutdown_connections 2023-10-24T00:29:31.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.973+0000 7f52c759e700 1 -- 172.21.15.148:0/1744362850 wait complete. 2023-10-24T00:29:31.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.974+0000 7f52c759e700 1 Processor -- start 2023-10-24T00:29:31.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.974+0000 7f52c759e700 1 -- start start 2023-10-24T00:29:31.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52c80c81e0 0x7f52c8146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52c8155350 0x7f52c81472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80c1e80 con 0x7f52c80a9f40 2023-10-24T00:29:31.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80c2690 con 0x7f52c80c81e0 2023-10-24T00:29:31.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c814ec50 con 0x7f52c8155350 2023-10-24T00:29:31.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56394/0 (socket says 172.21.15.148:56394) 2023-10-24T00:29:31.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 -- 172.21.15.148:0/1596102608 learned_addr learned my addr 172.21.15.148:0/1596102608 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:31.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52bdd9b700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52c80c81e0 0x7f52c8146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c6d9d700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52c8155350 0x7f52c81472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 -- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52c8155350 msgr2=0x7f52c81472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52c8155350 0x7f52c81472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 -- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52c80c81e0 msgr2=0x7f52c8146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:31.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52c80c81e0 0x7f52c8146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:31.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 -- 172.21.15.148:0/1596102608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00092a0 con 0x7f52c80a9f40 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52c659c700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f52b800c490 tx=0x7f52b8007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800ce00 con 0x7f52c80a9f40 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.975+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b80072e0 con 0x7f52c80a9f40 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.976+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8005670 con 0x7f52c80a9f40 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.976+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c80c20d0 con 0x7f52c80a9f40 2023-10-24T00:29:31.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.976+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c814e8e0 con 0x7f52c80a9f40 2023-10-24T00:29:31.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.977+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c814ef30 con 0x7f52c80a9f40 2023-10-24T00:29:31.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.977+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f52b8005a60 con 0x7f52c80a9f40 2023-10-24T00:29:31.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.977+0000 7f52beffd700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 0x7f52a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:31.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.977+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f52b80798a0 con 0x7f52c80a9f40 2023-10-24T00:29:31.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.978+0000 7f52bdd9b700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 0x7f52a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:31.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.978+0000 7f52bdd9b700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 0x7f52a8061610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f52c8158c50 tx=0x7f52b0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:31.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:31.981+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f52b804ab20 con 0x7f52c80a9f40 2023-10-24T00:29:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.147+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52c8047480 con 0x7f52c80a9f40 2023-10-24T00:29:32.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.850+0000 7f52beffd700 1 -- 172.21.15.148:0/1596102608 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f52b804e140 con 0x7f52c80a9f40 2023-10-24T00:29:32.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 msgr2=0x7f52a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 0x7f52a8061610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f52c8158c50 tx=0x7f52b0017000).stop 2023-10-24T00:29:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 msgr2=0x7f52c814f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f52b800c490 tx=0x7f52b8007b00).stop 2023-10-24T00:29:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 shutdown_connections 2023-10-24T00:29:32.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52c8155350 0x7f52c81472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f52a805f150 0x7f52a8061610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52c80a9f40 0x7f52c814f0e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 --2- 172.21.15.148:0/1596102608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52c80c81e0 0x7f52c8146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 >> 172.21.15.148:0/1596102608 conn(0x7f52c8094420 msgr2=0x7f52c80630d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:32.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 shutdown_connections 2023-10-24T00:29:32.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.854+0000 7f52c759e700 1 -- 172.21.15.148:0/1596102608 wait complete. 2023-10-24T00:29:32.859 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:29:32.869 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:29:32.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.985+0000 7fa8d7530700 1 Processor -- start 2023-10-24T00:29:32.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.985+0000 7fa8d7530700 1 -- start start 2023-10-24T00:29:32.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d7530700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8d01544b0 0x7fa8d00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:32.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d7530700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 0x7fa8d00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:32.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d7530700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00c6270 con 0x7fa8d00c8290 2023-10-24T00:29:32.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d7530700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00c60e0 con 0x7fa8d01544b0 2023-10-24T00:29:32.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d7530700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00c0c80 con 0x7fa8d00aa640 2023-10-24T00:29:32.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d52cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8d01544b0 0x7fa8d00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:32.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d5acd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 0x7fa8d00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:32.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d4acb700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa8d00c8290 0x7fa8d00a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:36550/0 (socket says 172.21.15.148:36550) 2023-10-24T00:29:32.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.986+0000 7fa8d4acb700 1 -- 172.21.15.148:0/1227587234 learned_addr learned my addr 172.21.15.148:0/1227587234 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:32.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8c7fff700 1 -- 172.21.15.148:0/1227587234 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053970382 0 0) 0x7fa8d00c6270 con 0x7fa8d00c8290 2023-10-24T00:29:32.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8c7fff700 1 -- 172.21.15.148:0/1227587234 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc0033f0 con 0x7fa8d00c8290 2023-10-24T00:29:32.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d52cc700 1 -- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 msgr2=0x7fa8d00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:32.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d52cc700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 0x7fa8d00c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d52cc700 1 -- 172.21.15.148:0/1227587234 >> v1:172.21.15.150:6789/0 conn(0x7fa8d00c8290 legacy=0x7fa8d00a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:32.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d52cc700 1 -- 172.21.15.148:0/1227587234 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00c0f40 con 0x7fa8d01544b0 2023-10-24T00:29:32.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d5acd700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 0x7fa8d00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:32.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d52cc700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a7d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa8cc009760 tx=0x7fa8cc009060).ready entity=mon.1 client_cookie=4909d03f2267c0ba server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:32.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8c7fff700 1 -- 172.21.15.148:0/1227587234 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00d4a0 con 0x7fa8d01544b0 2023-10-24T00:29:32.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8c7fff700 1 -- 172.21.15.148:0/1227587234 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00d600 con 0x7fa8d01544b0 2023-10-24T00:29:32.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8c7fff700 1 -- 172.21.15.148:0/1227587234 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc00d980 con 0x7fa8d01544b0 2023-10-24T00:29:32.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.987+0000 7fa8d7530700 1 -- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 msgr2=0x7fa8d00a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:32.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a7d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fa8cc009760 tx=0x7fa8cc009060).stop 2023-10-24T00:29:32.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 -- 172.21.15.148:0/1227587234 shutdown_connections 2023-10-24T00:29:32.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00aa640 0x7fa8d00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 --2- 172.21.15.148:0/1227587234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a7d00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:32.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 -- 172.21.15.148:0/1227587234 >> 172.21.15.148:0/1227587234 conn(0x7fa8d00945d0 msgr2=0x7fa8d006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:32.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 -- 172.21.15.148:0/1227587234 shutdown_connections 2023-10-24T00:29:32.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.988+0000 7fa8d7530700 1 -- 172.21.15.148:0/1227587234 wait complete. 2023-10-24T00:29:32.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.989+0000 7fa8d7530700 1 Processor -- start 2023-10-24T00:29:32.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.989+0000 7fa8d7530700 1 -- start start 2023-10-24T00:29:33.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:33.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00c8290 0x7fa8d00a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:33.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:33.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a8c60 con 0x7fa8d00aa640 2023-10-24T00:29:33.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0164950 con 0x7fa8d01544b0 2023-10-24T00:29:33.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00b0fe0 con 0x7fa8d00c8290 2023-10-24T00:29:33.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:33.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56398/0 (socket says 172.21.15.148:56398) 2023-10-24T00:29:33.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 -- 172.21.15.148:0/2533692260 learned_addr learned my addr 172.21.15.148:0/2533692260 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:33.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d5acd700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:33.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d4acb700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00c8290 0x7fa8d00a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:33.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 -- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00c8290 msgr2=0x7fa8d00a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:33.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00c8290 0x7fa8d00a8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 -- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 msgr2=0x7fa8d00a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:33.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 -- 172.21.15.148:0/2533692260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009a20 con 0x7fa8d00aa640 2023-10-24T00:29:33.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d5acd700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:33.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d52cc700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fa8cc009d50 tx=0x7fa8cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:33.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc000c90 con 0x7fa8d00aa640 2023-10-24T00:29:33.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc00d770 con 0x7fa8d00aa640 2023-10-24T00:29:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0092a0 con 0x7fa8d00aa640 2023-10-24T00:29:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc01d640 con 0x7fa8d00aa640 2023-10-24T00:29:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.990+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d0165600 con 0x7fa8d00aa640 2023-10-24T00:29:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.991+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d006c6b0 con 0x7fa8d00aa640 2023-10-24T00:29:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.992+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa8cc01da70 con 0x7fa8d00aa640 2023-10-24T00:29:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.992+0000 7fa8c57fa700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 0x7fa8b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.992+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7fa8cc07b8b0 con 0x7fa8d00aa640 2023-10-24T00:29:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.992+0000 7fa8d4acb700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 0x7fa8b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.993+0000 7fa8d4acb700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 0x7fa8b4061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa8c0005750 tx=0x7fa8c0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:32.996+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa8cc04cce0 con 0x7fa8d00aa640 2023-10-24T00:29:33.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.170+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8d00c1220 con 0x7fa8d00aa640 2023-10-24T00:29:33.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.852+0000 7fa8c57fa700 1 -- 172.21.15.148:0/2533692260 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8cc050300 con 0x7fa8d00aa640 2023-10-24T00:29:33.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.855+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 msgr2=0x7fa8b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:33.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.855+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 0x7fa8b4061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fa8c0005750 tx=0x7fa8c0009040).stop 2023-10-24T00:29:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.855+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 msgr2=0x7fa8d0165110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.855+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fa8cc009d50 tx=0x7fa8cc016000).stop 2023-10-24T00:29:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 shutdown_connections 2023-10-24T00:29:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d01544b0 0x7fa8d00a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa8b405f150 0x7fa8b4061610 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8d00aa640 0x7fa8d0165110 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 --2- 172.21.15.148:0/2533692260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d00c8290 0x7fa8d00a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:33.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 >> 172.21.15.148:0/2533692260 conn(0x7fa8d00945d0 msgr2=0x7fa8d014f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:33.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 shutdown_connections 2023-10-24T00:29:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:33.856+0000 7fa8d7530700 1 -- 172.21.15.148:0/2533692260 wait complete. 2023-10-24T00:29:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:29:33.871 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:29:33.872 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:29:33.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:29:33.872 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:29:33.873 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:29:33.873 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:29:33.873 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:29:33.873 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:29:33.874 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:29:33.874 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:29:33.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:29:33.875 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:29:33.875 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:29:33.875 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:29:33.875 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:29:33.876 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:29:33.880 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:29:33.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:29:33.882 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:29:33.882 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:29:33.884 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:29:33.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:29:33.885 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:29:33.886 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:29:33.924 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:29:33.925 DEBUG:teuthology.parallel:result is None 2023-10-24T00:29:33.926 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:29:33.926 DEBUG:teuthology.parallel:result is None 2023-10-24T00:29:33.927 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:29:33.927 DEBUG:teuthology.parallel:result is None 2023-10-24T00:29:33.928 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:29:33.929 DEBUG:teuthology.parallel:result is None 2023-10-24T00:29:33.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:29:33.997 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:29:34.004 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:29:34.005 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:29:34.005 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:29:34.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.064+0000 7f72c72a1700 1 Processor -- start 2023-10-24T00:29:34.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.064+0000 7f72c72a1700 1 -- start start 2023-10-24T00:29:34.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c72a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72c01546d0 0x7f72c00aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c72a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c72a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00c6d00 con 0x7f72c00c6850 2023-10-24T00:29:34.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c72a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00a8440 con 0x7f72c01546d0 2023-10-24T00:29:34.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c72a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c1870 con 0x7f72c00c1370 2023-10-24T00:29:34.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c503d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72c01546d0 0x7f72c00aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c483c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c503d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72c01546d0 0x7f72c00aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:47162/0 (socket says 172.21.15.148:47162) 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c503d700 1 -- 172.21.15.148:0/2650539619 learned_addr learned my addr 172.21.15.148:0/2650539619 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.065+0000 7f72c583e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f72c00c6850 0x7f72c00c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:46540/0 (socket says 172.21.15.148:46540) 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c503d700 1 -- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 msgr2=0x7f72c00c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:34.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c503d700 1 --2- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:34.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c503d700 1 -- 172.21.15.148:0/2650539619 >> v1:172.21.15.150:6789/0 conn(0x7f72c00c6850 legacy=0x7f72c00c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:34.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c503d700 1 -- 172.21.15.148:0/2650539619 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00c1b50 con 0x7f72c01546d0 2023-10-24T00:29:34.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72b7fff700 1 -- 172.21.15.148:0/2650539619 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631192732 0 0) 0x7f72b8001490 con 0x7f72c00c6850 2023-10-24T00:29:34.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c503d700 1 --2- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aa2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f72bc009810 tx=0x7f72bc009060).ready entity=mon.1 client_cookie=332f28ceed8470a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:34.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72b7fff700 1 -- 172.21.15.148:0/2650539619 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc005880 con 0x7f72c01546d0 2023-10-24T00:29:34.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72b7fff700 1 -- 172.21.15.148:0/2650539619 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0059e0 con 0x7f72c01546d0 2023-10-24T00:29:34.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72b7fff700 1 -- 172.21.15.148:0/2650539619 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc005d60 con 0x7f72c01546d0 2023-10-24T00:29:34.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 -- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 msgr2=0x7f72c00aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:34.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 --2- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aa2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f72bc009810 tx=0x7f72bc009060).stop 2023-10-24T00:29:34.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 -- 172.21.15.148:0/2650539619 shutdown_connections 2023-10-24T00:29:34.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 --2- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aa2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:34.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 --2- 172.21.15.148:0/2650539619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:34.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 -- 172.21.15.148:0/2650539619 >> 172.21.15.148:0/2650539619 conn(0x7f72c00946c0 msgr2=0x7f72c006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:34.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.066+0000 7f72c72a1700 1 -- 172.21.15.148:0/2650539619 shutdown_connections 2023-10-24T00:29:34.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.067+0000 7f72c72a1700 1 -- 172.21.15.148:0/2650539619 wait complete. 2023-10-24T00:29:34.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.068+0000 7f72c72a1700 1 Processor -- start 2023-10-24T00:29:34.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.068+0000 7f72c72a1700 1 -- start start 2023-10-24T00:29:34.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.068+0000 7f72c72a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c4680 con 0x7f72c00c6850 2023-10-24T00:29:34.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00adb40 con 0x7f72c01546d0 2023-10-24T00:29:34.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c21a0 con 0x7f72c00c1370 2023-10-24T00:29:34.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38346/0 (socket says 172.21.15.148:38346) 2023-10-24T00:29:34.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 -- 172.21.15.148:0/1059862800 learned_addr learned my addr 172.21.15.148:0/1059862800 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:34.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c583e700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c503d700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 -- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 msgr2=0x7f72c00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:34.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:34.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 -- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 msgr2=0x7f72c00aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:34.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:34.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 -- 172.21.15.148:0/1059862800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009300 con 0x7f72c00c6850 2023-10-24T00:29:34.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c483c700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f72b000e930 tx=0x7f72b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:34.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0012600 con 0x7f72c00c6850 2023-10-24T00:29:34.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0012760 con 0x7f72c00c6850 2023-10-24T00:29:34.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00c2480 con 0x7f72c00c6850 2023-10-24T00:29:34.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0012ae0 con 0x7f72c00c6850 2023-10-24T00:29:34.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.069+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00ab120 con 0x7f72c00c6850 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.070+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c00c4a20 con 0x7f72c00c6850 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.071+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f72b001b400 con 0x7f72c00c6850 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.071+0000 7f72b57fa700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 0x7f72a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.071+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f72b007a2d0 con 0x7f72c00c6850 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.071+0000 7f72c503d700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 0x7f72a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:34.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.072+0000 7f72c503d700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 0x7f72a4061610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f72bc00b340 tx=0x7f72bc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:34.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.075+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f72b004b840 con 0x7f72c00c6850 2023-10-24T00:29:34.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:34.252+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f72c00c2670 con 0x7f72c00c6850 2023-10-24T00:29:35.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.040+0000 7f72b57fa700 1 -- 172.21.15.148:0/1059862800 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f72b004ee60 con 0x7f72c00c6850 2023-10-24T00:29:35.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 msgr2=0x7f72a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 0x7f72a4061610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f72bc00b340 tx=0x7f72bc016000).stop 2023-10-24T00:29:35.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 msgr2=0x7f72c01641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f72b000e930 tx=0x7f72b0009060).stop 2023-10-24T00:29:35.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 shutdown_connections 2023-10-24T00:29:35.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.042+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72c01546d0 0x7f72c00aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72c00c1370 0x7f72c00c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f72a405f150 0x7f72a4061610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 --2- 172.21.15.148:0/1059862800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72c00c6850 0x7f72c01641c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 >> 172.21.15.148:0/1059862800 conn(0x7f72c00946c0 msgr2=0x7f72c0153880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 shutdown_connections 2023-10-24T00:29:35.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.043+0000 7f72c72a1700 1 -- 172.21.15.148:0/1059862800 wait complete. 2023-10-24T00:29:35.048 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:29:35.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:29:35.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.170+0000 7fdfad953700 1 Processor -- start 2023-10-24T00:29:35.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.170+0000 7fdfad953700 1 -- start start 2023-10-24T00:29:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfa8098700 0x7fdfa8098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa80c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 0x7fdfa80cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa8154860 con 0x7fdfa8098700 2023-10-24T00:29:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa80c5910 con 0x7fdfa80ca640 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfad953700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80c6490 con 0x7fdfa80c1b40 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfa6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfa8098700 0x7fdfa8098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfa6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfa8098700 0x7fdfa8098ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38350/0 (socket says 172.21.15.148:38350) 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.171+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/1901528632 learned_addr learned my addr 172.21.15.148:0/1901528632 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdf9e7fc700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa80c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa77fe700 1 --2- 172.21.15.148:0/1901528632 >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 0x7fdfa80cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/1901528632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 msgr2=0x7fdfa80c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa80c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/1901528632 >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 msgr2=0x7fdfa80cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/1901528632 >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 0x7fdfa80cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/1901528632 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80c5b60 con 0x7fdfa8098700 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa77fe700 1 --2- 172.21.15.148:0/1901528632 >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 0x7fdfa80cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8098ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdfa80adca0 tx=0x7fdf980090f0).ready entity=mon.0 client_cookie=a1563bf6439ee9ca server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa67fc700 1 -- 172.21.15.148:0/1901528632 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800b520 con 0x7fdfa8098700 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa67fc700 1 -- 172.21.15.148:0/1901528632 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800b680 con 0x7fdfa8098700 2023-10-24T00:29:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfa67fc700 1 -- 172.21.15.148:0/1901528632 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800ba00 con 0x7fdfa8098700 2023-10-24T00:29:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfad953700 1 -- 172.21.15.148:0/1901528632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 msgr2=0x7fdfa8098ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.172+0000 7fdfad953700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8098ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdfa80adca0 tx=0x7fdf980090f0).stop 2023-10-24T00:29:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 -- 172.21.15.148:0/1901528632 shutdown_connections 2023-10-24T00:29:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8098ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 --2- 172.21.15.148:0/1901528632 >> v2:172.21.15.150:3300/0 conn(0x7fdfa80ca640 0x7fdfa80cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 --2- 172.21.15.148:0/1901528632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa80c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 -- 172.21.15.148:0/1901528632 >> 172.21.15.148:0/1901528632 conn(0x7fdfa806b380 msgr2=0x7fdfa806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 -- 172.21.15.148:0/1901528632 shutdown_connections 2023-10-24T00:29:35.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.173+0000 7fdfad953700 1 -- 172.21.15.148:0/1901528632 wait complete. 2023-10-24T00:29:35.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.174+0000 7fdfad953700 1 Processor -- start 2023-10-24T00:29:35.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.174+0000 7fdfad953700 1 -- start start 2023-10-24T00:29:35.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa8151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 0x7fdfa80950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81553f0 con 0x7fdfa8098700 2023-10-24T00:29:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81555d0 con 0x7fdfa80ca640 2023-10-24T00:29:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81558b0 con 0x7fdfa80c1b40 2023-10-24T00:29:35.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38358/0 (socket says 172.21.15.148:38358) 2023-10-24T00:29:35.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/288257005 learned_addr learned my addr 172.21.15.148:0/288257005 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa77fe700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 0x7fdfa80950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdf9e7fc700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa8151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 msgr2=0x7fdfa8151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa8151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 msgr2=0x7fdfa80950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 0x7fdfa80950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 -- 172.21.15.148:0/288257005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009370 con 0x7fdfa8098700 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa77fe700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 0x7fdfa80950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfa6ffd700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fdfa80c8ce0 tx=0x7fdf98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98000bc0 con 0x7fdfa8098700 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800b7f0 con 0x7fdfa8098700 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98000d20 con 0x7fdfa8098700 2023-10-24T00:29:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa8155b90 con 0x7fdfa8098700 2023-10-24T00:29:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.175+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa8156150 con 0x7fdfa8098700 2023-10-24T00:29:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.176+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa806c6b0 con 0x7fdfa8098700 2023-10-24T00:29:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.177+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdf9801b8b0 con 0x7fdfa8098700 2023-10-24T00:29:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.177+0000 7fdf9f7fe700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 0x7fdf88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.177+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf9807b760 con 0x7fdfa8098700 2023-10-24T00:29:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.177+0000 7fdf9e7fc700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 0x7fdf88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.178+0000 7fdf9e7fc700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 0x7fdf88061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdf90009270 tx=0x7fdf90008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.181+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf9804cd80 con 0x7fdfa8098700 2023-10-24T00:29:35.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.409+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdfa80c5e40 con 0x7fdfa8098700 2023-10-24T00:29:35.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.409+0000 7fdf9f7fe700 1 -- 172.21.15.148:0/288257005 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fdf98029070 con 0x7fdfa8098700 2023-10-24T00:29:35.412 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:35.413 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:29:35.413 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:29:35.413 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.413 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:29:35.413 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:29:35.414 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.414 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.414 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:29:35.414 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:29:35.414 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.415 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.415 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.415 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.415 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:29:35.415 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:29:35.416 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:29:35.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:29:35.416 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:29:35.417 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.418 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.418 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:29:35.418 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:29:35.418 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.418 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.419 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.419 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.419 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:29:35.419 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:29:35.419 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.420 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.421 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.421 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:29:35.421 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:29:35.421 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.421 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.422 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.422 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.422 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.422 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.422 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.423 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.424 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.424 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.424 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.424 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:29:35.424 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:29:35.425 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.425 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.425 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.425 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.426 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.426 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.426 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.426 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:29:35.426 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.427 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.428 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.428 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:29:35.428 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:29:35.428 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.428 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.429 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:29:35.430 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:29:35.430 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.430 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.430 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.430 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.431 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.431 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.431 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.431 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:29:35.431 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:29:35.432 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.432 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.432 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.432 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.432 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.433 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:29:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:29:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.435 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:29:35.435 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:29:35.435 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.435 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.435 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:29:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:29:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:29:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.436 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:29:35.437 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:29:35.438 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:29:35.438 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.438 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.438 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:29:35.439 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:29:35.440 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.440 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.440 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.440 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:29:35.440 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:29:35.441 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.441 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:29:35.441 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:29:35.441 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:29:35.441 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:29:35.442 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.442 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.442 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.442 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:29:35.442 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:29:35.443 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:29:35.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:29:35.443 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:29:35.443 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-mds", 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdljTPlNRAAFwAQ/Bxg8Z+FFW5oY3rJEg==", 2023-10-24T00:29:35.444 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.445 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-mds" 2023-10-24T00:29:35.445 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.445 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.445 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.445 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-mgr", 2023-10-24T00:29:35.446 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdl2j7lNRAAmfhhDobvSWrqPBAVlmQLyQ==", 2023-10-24T00:29:35.446 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.446 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-24T00:29:35.446 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.446 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-osd", 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdlBEblNRAAKZUK2NHkX3BrKE6WYoKJmw==", 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-osd" 2023-10-24T00:29:35.447 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.448 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.448 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.448 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-rbd", 2023-10-24T00:29:35.448 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdlw0zlNRAArhzkk7Dc/k2I6WuefoCD7A==", 2023-10-24T00:29:35.448 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.449 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-24T00:29:35.449 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.449 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.449 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.449 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-24T00:29:35.450 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdlyFPlNRAA5X/ZYyloemb7GyLYbG+PjA==", 2023-10-24T00:29:35.450 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.450 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-24T00:29:35.450 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.450 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.451 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.451 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.bootstrap-rgw", 2023-10-24T00:29:35.451 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCzDzdl2VrlNRAAz5HA/s8CrdRksa9VdGRD4g==", 2023-10-24T00:29:35.451 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.451 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:29:35.452 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.453 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:29:35.453 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:29:35.453 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.453 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.453 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:35.454 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:35.454 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:29:35.454 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:29:35.454 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:29:35.454 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:29:35.455 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:29:35.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.411+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 msgr2=0x7fdf88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.411+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 0x7fdf88061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdf90009270 tx=0x7fdf90008040).stop 2023-10-24T00:29:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.411+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 msgr2=0x7fdfa8157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.411+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fdfa80c8ce0 tx=0x7fdf98017000).stop 2023-10-24T00:29:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 shutdown_connections 2023-10-24T00:29:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfa80ca640 0x7fdfa80950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8805f150 0x7fdf88061610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfa8098700 0x7fdfa8157390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 --2- 172.21.15.148:0/288257005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfa80c1b40 0x7fdfa8151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 >> 172.21.15.148:0/288257005 conn(0x7fdfa806b380 msgr2=0x7fdfa80ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 shutdown_connections 2023-10-24T00:29:35.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.412+0000 7fdfad953700 1 -- 172.21.15.148:0/288257005 wait complete. 2023-10-24T00:29:35.460 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-24T00:29:35.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.572+0000 7fdd6330a700 1 Processor -- start 2023-10-24T00:29:35.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.572+0000 7fdd6330a700 1 -- start start 2023-10-24T00:29:35.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd6330a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd5c154a90 0x7fdd5c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd6330a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd5c0c0f20 0x7fdd5c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd6330a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c06a860 con 0x7fdd5c154e70 2023-10-24T00:29:35.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd6330a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c9d90 con 0x7fdd5c154a90 2023-10-24T00:29:35.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd6330a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c9180 con 0x7fdd5c0c0f20 2023-10-24T00:29:35.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd5c154a90 0x7fdd5c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd5c154a90 0x7fdd5c155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38372/0 (socket says 172.21.15.148:38372) 2023-10-24T00:29:35.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 -- 172.21.15.148:0/113006754 learned_addr learned my addr 172.21.15.148:0/113006754 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62b09700 1 --2- 172.21.15.148:0/113006754 >> v2:172.21.15.150:3300/0 conn(0x7fdd5c0c0f20 0x7fdd5c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 -- 172.21.15.148:0/113006754 >> v2:172.21.15.150:3300/0 conn(0x7fdd5c0c0f20 msgr2=0x7fdd5c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:35.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 --2- 172.21.15.148:0/113006754 >> v2:172.21.15.150:3300/0 conn(0x7fdd5c0c0f20 0x7fdd5c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 -- 172.21.15.148:0/113006754 >> v1:172.21.15.150:6789/0 conn(0x7fdd5c154e70 legacy=0x7fdd5c0c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:35.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 -- 172.21.15.148:0/113006754 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0c9460 con 0x7fdd5c154a90 2023-10-24T00:29:35.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.573+0000 7fdd62308700 1 --2- 172.21.15.148:0/113006754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154a90 0x7fdd5c155a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fdd54009f20 tx=0x7fdd54009840).ready entity=mon.0 client_cookie=d419330db46c5619 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd61306700 1 -- 172.21.15.148:0/113006754 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400e070 con 0x7fdd5c154a90 2023-10-24T00:29:35.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd61306700 1 -- 172.21.15.148:0/113006754 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400ba00 con 0x7fdd5c154a90 2023-10-24T00:29:35.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd61306700 1 -- 172.21.15.148:0/113006754 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400bd80 con 0x7fdd5c154a90 2023-10-24T00:29:35.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 -- 172.21.15.148:0/113006754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154a90 msgr2=0x7fdd5c155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 --2- 172.21.15.148:0/113006754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154a90 0x7fdd5c155a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fdd54009f20 tx=0x7fdd54009840).stop 2023-10-24T00:29:35.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 -- 172.21.15.148:0/113006754 shutdown_connections 2023-10-24T00:29:35.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 --2- 172.21.15.148:0/113006754 >> v2:172.21.15.150:3300/0 conn(0x7fdd5c0c0f20 0x7fdd5c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 --2- 172.21.15.148:0/113006754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154a90 0x7fdd5c155a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 -- 172.21.15.148:0/113006754 >> 172.21.15.148:0/113006754 conn(0x7fdd5c084c20 msgr2=0x7fdd5c094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 -- 172.21.15.148:0/113006754 shutdown_connections 2023-10-24T00:29:35.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.574+0000 7fdd6330a700 1 -- 172.21.15.148:0/113006754 wait complete. 2023-10-24T00:29:35.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.575+0000 7fdd6330a700 1 Processor -- start 2023-10-24T00:29:35.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.575+0000 7fdd6330a700 1 -- start start 2023-10-24T00:29:35.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd5c0c0f20 0x7fdd5c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 0x7fdd5c0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0b07b0 con 0x7fdd5c154e70 2023-10-24T00:29:35.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c4950 con 0x7fdd5c0c0f20 2023-10-24T00:29:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd6330a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c151ff0 con 0x7fdd5c154a90 2023-10-24T00:29:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38384/0 (socket says 172.21.15.148:38384) 2023-10-24T00:29:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 -- 172.21.15.148:0/2601724808 learned_addr learned my addr 172.21.15.148:0/2601724808 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62308700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd5c0c0f20 0x7fdd5c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd61b07700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 0x7fdd5c0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 -- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 msgr2=0x7fdd5c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 0x7fdd5c0c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 -- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd5c0c0f20 msgr2=0x7fdd5c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd5c0c0f20 0x7fdd5c151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd62b09700 1 -- 172.21.15.148:0/2601724808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54009ae0 con 0x7fdd5c154e70 2023-10-24T00:29:35.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.576+0000 7fdd61b07700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 0x7fdd5c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:35.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd62b09700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdd4c00c680 tx=0x7fdd4c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00a210 con 0x7fdd5c154e70 2023-10-24T00:29:35.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c010580 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c010920 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c0afc30 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.577+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c0b01f0 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.578+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c0c1f20 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.578+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd4c010cd0 con 0x7fdd5c154e70 2023-10-24T00:29:35.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.578+0000 7fdd5a7fc700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 0x7fdd48061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.578+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdd4c079bb0 con 0x7fdd5c154e70 2023-10-24T00:29:35.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.579+0000 7fdd62308700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 0x7fdd48061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.579+0000 7fdd62308700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 0x7fdd48061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fdd54009880 tx=0x7fdd5c0c18d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.582+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd5c0c1f20 con 0x7fdd5c154e70 2023-10-24T00:29:35.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.811+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fdd5c0c1f20 con 0x7fdd5c154e70 2023-10-24T00:29:35.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.817+0000 7fdd5a7fc700 1 -- 172.21.15.148:0/2601724808 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd5c0c1f20 con 0x7fdd5c154e70 2023-10-24T00:29:35.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 msgr2=0x7fdd48061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 0x7fdd48061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fdd54009880 tx=0x7fdd5c0c18d0).stop 2023-10-24T00:29:35.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 msgr2=0x7fdd5c0c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fdd4c00c680 tx=0x7fdd4c008040).stop 2023-10-24T00:29:35.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 shutdown_connections 2023-10-24T00:29:35.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd4805f150 0x7fdd48061610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd5c154e70 0x7fdd5c0c4460 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd5c0c0f20 0x7fdd5c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 --2- 172.21.15.148:0/2601724808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd5c154a90 0x7fdd5c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 >> 172.21.15.148:0/2601724808 conn(0x7fdd5c084c20 msgr2=0x7fdd5c152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 shutdown_connections 2023-10-24T00:29:35.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.819+0000 7fdd6330a700 1 -- 172.21.15.148:0/2601724808 wait complete. 2023-10-24T00:29:35.824 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:35.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-24T00:29:35.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.947+0000 7f3c295c5700 1 Processor -- start 2023-10-24T00:29:35.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.947+0000 7f3c295c5700 1 -- start start 2023-10-24T00:29:35.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c295c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240be600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c295c5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c240c48a0 0x7f3c2415e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c295c5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240bfcf0 con 0x7f3c240beaf0 2023-10-24T00:29:35.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c295c5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240c6800 con 0x7f3c240c48a0 2023-10-24T00:29:35.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c295c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240bf0e0 con 0x7f3c240c6420 2023-10-24T00:29:35.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c237fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c240c48a0 0x7f3c2415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c237fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3c240c48a0 0x7f3c2415e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38388/0 (socket says 172.21.15.148:38388) 2023-10-24T00:29:35.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c1a7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3c240beaf0 0x7f3c240c4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50850/0 (socket says 172.21.15.148:50850) 2023-10-24T00:29:35.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c237fe700 1 -- 172.21.15.148:0/1394868769 learned_addr learned my addr 172.21.15.148:0/1394868769 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c22ffd700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c237fe700 1 -- 172.21.15.148:0/1394868769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 msgr2=0x7f3c240be600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:35.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.948+0000 7f3c237fe700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240be600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c237fe700 1 -- 172.21.15.148:0/1394868769 >> v1:172.21.15.148:6789/0 conn(0x7f3c240beaf0 legacy=0x7f3c240c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c237fe700 1 -- 172.21.15.148:0/1394868769 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240bf3c0 con 0x7f3c240c48a0 2023-10-24T00:29:35.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c227fc700 1 -- 172.21.15.148:0/1394868769 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372614037 0 0) 0x7f3c240bfcf0 con 0x7f3c240beaf0 2023-10-24T00:29:35.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c22ffd700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240be600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:35.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c237fe700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240c48a0 0x7f3c2415e210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f3c1c009f20 tx=0x7f3c1c009840).ready entity=mon.0 client_cookie=8aaf248db6575333 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c227fc700 1 -- 172.21.15.148:0/1394868769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c00e070 con 0x7f3c240c48a0 2023-10-24T00:29:35.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c227fc700 1 -- 172.21.15.148:0/1394868769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c00ba80 con 0x7f3c240c48a0 2023-10-24T00:29:35.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c227fc700 1 -- 172.21.15.148:0/1394868769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c00be00 con 0x7f3c240c48a0 2023-10-24T00:29:35.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 -- 172.21.15.148:0/1394868769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240c48a0 msgr2=0x7f3c2415e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240c48a0 0x7f3c2415e210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f3c1c009f20 tx=0x7f3c1c009840).stop 2023-10-24T00:29:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 -- 172.21.15.148:0/1394868769 shutdown_connections 2023-10-24T00:29:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240c48a0 0x7f3c2415e210 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 --2- 172.21.15.148:0/1394868769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240be600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 -- 172.21.15.148:0/1394868769 >> 172.21.15.148:0/1394868769 conn(0x7f3c24092510 msgr2=0x7f3c24062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:35.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 -- 172.21.15.148:0/1394868769 shutdown_connections 2023-10-24T00:29:35.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.949+0000 7f3c295c5700 1 -- 172.21.15.148:0/1394868769 wait complete. 2023-10-24T00:29:35.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 Processor -- start 2023-10-24T00:29:35.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 -- start start 2023-10-24T00:29:35.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240c48a0 0x7f3c241530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240bff50 con 0x7f3c240beaf0 2023-10-24T00:29:35.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c0160 con 0x7f3c240c48a0 2023-10-24T00:29:35.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c295c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c0440 con 0x7f3c240c6420 2023-10-24T00:29:35.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c22ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c22ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38400/0 (socket says 172.21.15.148:38400) 2023-10-24T00:29:35.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.951+0000 7f3c22ffd700 1 -- 172.21.15.148:0/89249140 learned_addr learned my addr 172.21.15.148:0/89249140 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:35.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c237fe700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c1a7fc700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240c48a0 0x7f3c241530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 -- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 msgr2=0x7f3c240ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 -- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240c48a0 msgr2=0x7f3c241530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:35.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240c48a0 0x7f3c241530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:35.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 -- 172.21.15.148:0/89249140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009ae0 con 0x7f3c240beaf0 2023-10-24T00:29:35.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c22ffd700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3c1400c880 tx=0x7f3c14008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14010580 con 0x7f3c240beaf0 2023-10-24T00:29:35.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c140106e0 con 0x7f3c240beaf0 2023-10-24T00:29:35.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c240c0720 con 0x7f3c240beaf0 2023-10-24T00:29:35.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14010a60 con 0x7f3c240beaf0 2023-10-24T00:29:35.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.952+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24168470 con 0x7f3c240beaf0 2023-10-24T00:29:35.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.953+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240c0d70 con 0x7f3c240beaf0 2023-10-24T00:29:35.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.953+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3c1401a410 con 0x7f3c240beaf0 2023-10-24T00:29:35.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.954+0000 7f3c1b7fe700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 0x7f3c040615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:35.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.954+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3c14079930 con 0x7f3c240beaf0 2023-10-24T00:29:35.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.954+0000 7f3c1a7fc700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 0x7f3c040615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:35.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.954+0000 7f3c1a7fc700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 0x7f3c040615e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3c24066d60 tx=0x7f3c0c007c90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:35.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:35.958+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3c1404aef0 con 0x7f3c240beaf0 2023-10-24T00:29:36.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.180+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3c24092a50 con 0x7f3c240beaf0 2023-10-24T00:29:36.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.186+0000 7f3c1b7fe700 1 -- 172.21.15.148:0/89249140 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3c1404e510 con 0x7f3c240beaf0 2023-10-24T00:29:36.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 msgr2=0x7f3c040615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 0x7f3c040615e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3c24066d60 tx=0x7f3c0c007c90).stop 2023-10-24T00:29:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 msgr2=0x7f3c24167f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3c1400c880 tx=0x7f3c14008040).stop 2023-10-24T00:29:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 shutdown_connections 2023-10-24T00:29:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c240c6420 0x7f3c240ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c0405f120 0x7f3c040615e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c240beaf0 0x7f3c24167f80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 --2- 172.21.15.148:0/89249140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c240c48a0 0x7f3c241530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 >> 172.21.15.148:0/89249140 conn(0x7f3c24092510 msgr2=0x7f3c24153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 shutdown_connections 2023-10-24T00:29:36.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.188+0000 7f3c295c5700 1 -- 172.21.15.148:0/89249140 wait complete. 2023-10-24T00:29:36.194 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:36.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-24T00:29:36.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.315+0000 7f340cb9b700 1 Processor -- start 2023-10-24T00:29:36.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.315+0000 7f340cb9b700 1 -- start start 2023-10-24T00:29:36.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340cb9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34080aa150 0x7f34081580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340cb9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34081579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340cb9b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3408157ea0 con 0x7f34080aa530 2023-10-24T00:29:36.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340cb9b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080c0450 con 0x7f34080aa150 2023-10-24T00:29:36.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340cb9b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408158680 con 0x7f3408157520 2023-10-24T00:29:36.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f340659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34080aa150 0x7f34081580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f3405d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f34080aa530 0x7f34080c63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50854/0 (socket says 172.21.15.148:50854) 2023-10-24T00:29:36.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.316+0000 7f3405d9b700 1 -- 172.21.15.148:0/3805226199 learned_addr learned my addr 172.21.15.148:0/3805226199 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:36.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f3406d9d700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34081579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340659c700 1 -- 172.21.15.148:0/3805226199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 msgr2=0x7f34081579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:36.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340659c700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34081579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340659c700 1 -- 172.21.15.148:0/3805226199 >> v1:172.21.15.148:6789/0 conn(0x7f34080aa530 legacy=0x7f34080c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340659c700 1 -- 172.21.15.148:0/3805226199 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408158960 con 0x7f34080aa150 2023-10-24T00:29:36.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340559a700 1 -- 172.21.15.148:0/3805226199 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349279922 0 0) 0x7f3408157ea0 con 0x7f34080aa530 2023-10-24T00:29:36.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340659c700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34081580e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f33f8009e60 tx=0x7f33f8009780).ready entity=mon.0 client_cookie=62e15c95e786f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340559a700 1 -- 172.21.15.148:0/3805226199 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800e070 con 0x7f34080aa150 2023-10-24T00:29:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340559a700 1 -- 172.21.15.148:0/3805226199 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800bb60 con 0x7f34080aa150 2023-10-24T00:29:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340559a700 1 -- 172.21.15.148:0/3805226199 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8012410 con 0x7f34080aa150 2023-10-24T00:29:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340cb9b700 1 -- 172.21.15.148:0/3805226199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 msgr2=0x7f34081580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.317+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34081580e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f33f8009e60 tx=0x7f33f8009780).stop 2023-10-24T00:29:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 -- 172.21.15.148:0/3805226199 shutdown_connections 2023-10-24T00:29:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34081579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3805226199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34081580e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 -- 172.21.15.148:0/3805226199 >> 172.21.15.148:0/3805226199 conn(0x7f34080cb020 msgr2=0x7f34080cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 -- 172.21.15.148:0/3805226199 shutdown_connections 2023-10-24T00:29:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.318+0000 7f340cb9b700 1 -- 172.21.15.148:0/3805226199 wait complete. 2023-10-24T00:29:36.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.319+0000 7f340cb9b700 1 Processor -- start 2023-10-24T00:29:36.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.319+0000 7f340cb9b700 1 -- start start 2023-10-24T00:29:36.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.319+0000 7f340cb9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.319+0000 7f340cb9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34080aa530 0x7f3408147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34080c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408149170 con 0x7f34080aa150 2023-10-24T00:29:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080c2d90 con 0x7f34080aa530 2023-10-24T00:29:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408148840 con 0x7f3408157520 2023-10-24T00:29:36.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38416/0 (socket says 172.21.15.148:38416) 2023-10-24T00:29:36.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 -- 172.21.15.148:0/3980491216 learned_addr learned my addr 172.21.15.148:0/3980491216 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:36.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f3406d9d700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34080c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f3405d9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34080aa530 0x7f3408147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 -- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 msgr2=0x7f34080c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34080c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 -- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34080aa530 msgr2=0x7f3408147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34080aa530 0x7f3408147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 -- 172.21.15.148:0/3980491216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009a20 con 0x7f34080aa150 2023-10-24T00:29:36.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340659c700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f33f800b6c0 tx=0x7f33f8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f801d420 con 0x7f34080aa150 2023-10-24T00:29:36.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f801d580 con 0x7f34080aa150 2023-10-24T00:29:36.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f801d980 con 0x7f34080aa150 2023-10-24T00:29:36.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3408148b20 con 0x7f34080aa150 2023-10-24T00:29:36.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.320+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34080ae4a0 con 0x7f34080aa150 2023-10-24T00:29:36.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.321+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340806c6b0 con 0x7f34080aa150 2023-10-24T00:29:36.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.321+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f33f8003040 con 0x7f34080aa150 2023-10-24T00:29:36.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.322+0000 7f33f67fc700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 0x7f33e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.322+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f33f807ba60 con 0x7f34080aa150 2023-10-24T00:29:36.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.322+0000 7f3405d9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 0x7f33e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.322+0000 7f3405d9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 0x7f33e8061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f340814ac30 tx=0x7f33fc007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.326+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f33f804d080 con 0x7f34080aa150 2023-10-24T00:29:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.553+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f34080c6700 con 0x7f34080aa150 2023-10-24T00:29:36.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.558+0000 7f33f67fc700 1 -- 172.21.15.148:0/3980491216 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33f80506a0 con 0x7f34080aa150 2023-10-24T00:29:36.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 msgr2=0x7f33e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 0x7f33e8061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f340814ac30 tx=0x7f33fc007b90).stop 2023-10-24T00:29:36.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 msgr2=0x7f34080adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f33f800b6c0 tx=0x7f33f8009780).stop 2023-10-24T00:29:36.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 shutdown_connections 2023-10-24T00:29:36.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3408157520 0x7f34080c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33e805f150 0x7f33e8061610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34080aa150 0x7f34080adfb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 --2- 172.21.15.148:0/3980491216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34080aa530 0x7f3408147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 >> 172.21.15.148:0/3980491216 conn(0x7f34080cb020 msgr2=0x7f340814b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:36.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 shutdown_connections 2023-10-24T00:29:36.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.560+0000 7f340cb9b700 1 -- 172.21.15.148:0/3980491216 wait complete. 2023-10-24T00:29:36.566 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:36.575 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-24T00:29:36.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.686+0000 7f0f447e1700 1 Processor -- start 2023-10-24T00:29:36.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.686+0000 7f0f447e1700 1 -- start start 2023-10-24T00:29:36.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f447e1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f3c154400 0x7f0f3c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f447e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f447e1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0c01c0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f447e1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0aa960 con 0x7f0f3c1547e0 2023-10-24T00:29:36.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f447e1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0c66f0 con 0x7f0f3c154400 2023-10-24T00:29:36.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f41d7c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f41d7c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38428/0 (socket says 172.21.15.148:38428) 2023-10-24T00:29:36.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f41d7c700 1 -- 172.21.15.148:0/892421726 learned_addr learned my addr 172.21.15.148:0/892421726 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:36.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.687+0000 7f0f4257d700 1 --2- 172.21.15.148:0/892421726 >> v2:172.21.15.150:3300/0 conn(0x7f0f3c154400 0x7f0f3c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f41d7c700 1 -- 172.21.15.148:0/892421726 >> v2:172.21.15.150:3300/0 conn(0x7f0f3c154400 msgr2=0x7f0f3c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:36.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f41d7c700 1 --2- 172.21.15.148:0/892421726 >> v2:172.21.15.150:3300/0 conn(0x7f0f3c154400 0x7f0f3c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f41d7c700 1 -- 172.21.15.148:0/892421726 >> v1:172.21.15.150:6789/0 conn(0x7f0f3c0a82c0 legacy=0x7f0f3c0c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f41d7c700 1 -- 172.21.15.148:0/892421726 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0c6150 con 0x7f0f3c1547e0 2023-10-24T00:29:36.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f41d7c700 1 --2- 172.21.15.148:0/892421726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0f3c084cf0 tx=0x7f0f2c0090f0).ready entity=mon.0 client_cookie=7888859233d257bb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f4157b700 1 -- 172.21.15.148:0/892421726 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00b520 con 0x7f0f3c1547e0 2023-10-24T00:29:36.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f4157b700 1 -- 172.21.15.148:0/892421726 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00b680 con 0x7f0f3c1547e0 2023-10-24T00:29:36.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f4157b700 1 -- 172.21.15.148:0/892421726 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00ba20 con 0x7f0f3c1547e0 2023-10-24T00:29:36.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 -- 172.21.15.148:0/892421726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c1547e0 msgr2=0x7f0f3c0a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 --2- 172.21.15.148:0/892421726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0f3c084cf0 tx=0x7f0f2c0090f0).stop 2023-10-24T00:29:36.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 -- 172.21.15.148:0/892421726 shutdown_connections 2023-10-24T00:29:36.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 --2- 172.21.15.148:0/892421726 >> v2:172.21.15.150:3300/0 conn(0x7f0f3c154400 0x7f0f3c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 --2- 172.21.15.148:0/892421726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c1547e0 0x7f0f3c0a7dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 -- 172.21.15.148:0/892421726 >> 172.21.15.148:0/892421726 conn(0x7f0f3c0946a0 msgr2=0x7f0f3c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:36.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 -- 172.21.15.148:0/892421726 shutdown_connections 2023-10-24T00:29:36.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.688+0000 7f0f447e1700 1 -- 172.21.15.148:0/892421726 wait complete. 2023-10-24T00:29:36.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 Processor -- start 2023-10-24T00:29:36.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 -- start start 2023-10-24T00:29:36.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f3c154400 0x7f0f3c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 0x7f0f3c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b1120 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c154be0 con 0x7f0f3c154400 2023-10-24T00:29:36.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f447e1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c155440 con 0x7f0f3c1547e0 2023-10-24T00:29:36.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f4257d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f4257d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38436/0 (socket says 172.21.15.148:38436) 2023-10-24T00:29:36.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.690+0000 7f0f4257d700 1 -- 172.21.15.148:0/3213535599 learned_addr learned my addr 172.21.15.148:0/3213535599 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:36.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f41d7c700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f3c154400 0x7f0f3c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f42d7e700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 0x7f0f3c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 -- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 msgr2=0x7f0f3c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 0x7f0f3c0b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 -- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f3c154400 msgr2=0x7f0f3c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f3c154400 0x7f0f3c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 -- 172.21.15.148:0/3213535599 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009370 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f42d7e700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 0x7f0f3c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:36.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f4257d700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0f3800e950 tx=0x7f0f38009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800c6a0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3800c800 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800cb80 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0b0e40 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.691+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c1550d0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.692+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c06c6b0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.692+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0f3801b400 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.693+0000 7f0f327fc700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 0x7f0f200615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:36.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.693+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0f3807a3f0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.693+0000 7f0f41d7c700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 0x7f0f200615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:36.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.693+0000 7f0f41d7c700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 0x7f0f200615e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0f3c084cf0 tx=0x7f0f2c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:36.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.697+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f3804ba60 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.923+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0f3c0aa3a0 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.929+0000 7f0f327fc700 1 -- 172.21.15.148:0/3213535599 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0f38016020 con 0x7f0f3c0a82c0 2023-10-24T00:29:36.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.930+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 msgr2=0x7f0f200615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.930+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 0x7f0f200615e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0f3c084cf0 tx=0x7f0f2c017000).stop 2023-10-24T00:29:36.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.930+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 msgr2=0x7f0f3c151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:36.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.930+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0f3800e950 tx=0x7f0f38009060).stop 2023-10-24T00:29:36.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 shutdown_connections 2023-10-24T00:29:36.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f3c1547e0 0x7f0f3c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f2005f120 0x7f0f200615e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f3c0a82c0 0x7f0f3c151140 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 --2- 172.21.15.148:0/3213535599 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f3c154400 0x7f0f3c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:36.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 >> 172.21.15.148:0/3213535599 conn(0x7f0f3c0946a0 msgr2=0x7f0f3c0c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:36.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 shutdown_connections 2023-10-24T00:29:36.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:36.931+0000 7f0f447e1700 1 -- 172.21.15.148:0/3213535599 wait complete. 2023-10-24T00:29:36.936 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:36.945 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-24T00:29:37.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.057+0000 7fa3ed274700 1 Processor -- start 2023-10-24T00:29:37.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.057+0000 7fa3ed274700 1 -- start start 2023-10-24T00:29:37.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3ed274700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3ed274700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3e80a6750 0x7fa3e80a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3ed274700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e8063fc0 con 0x7fa3e80a4840 2023-10-24T00:29:37.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3ed274700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80633b0 con 0x7fa3e8154290 2023-10-24T00:29:37.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3ed274700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e8063690 con 0x7fa3e80a6750 2023-10-24T00:29:37.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38438/0 (socket says 172.21.15.148:38438) 2023-10-24T00:29:37.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 -- 172.21.15.148:0/3993493195 learned_addr learned my addr 172.21.15.148:0/3993493195 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:37.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3de7fc700 1 --2- 172.21.15.148:0/3993493195 >> v2:172.21.15.150:3300/0 conn(0x7fa3e80a6750 0x7fa3e80a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 -- 172.21.15.148:0/3993493195 >> v2:172.21.15.150:3300/0 conn(0x7fa3e80a6750 msgr2=0x7fa3e80a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 --2- 172.21.15.148:0/3993493195 >> v2:172.21.15.150:3300/0 conn(0x7fa3e80a6750 0x7fa3e80a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 -- 172.21.15.148:0/3993493195 >> v1:172.21.15.150:6789/0 conn(0x7fa3e80a4840 legacy=0x7fa3e8064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.058+0000 7fa3e6ffd700 1 -- 172.21.15.148:0/3993493195 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8063970 con 0x7fa3e8154290 2023-10-24T00:29:37.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3e6ffd700 1 --2- 172.21.15.148:0/3993493195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa3e80643d0 tx=0x7fa3d80090f0).ready entity=mon.0 client_cookie=a7267c9082e0abea server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3e67fc700 1 -- 172.21.15.148:0/3993493195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800b5a0 con 0x7fa3e8154290 2023-10-24T00:29:37.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3e67fc700 1 -- 172.21.15.148:0/3993493195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800b700 con 0x7fa3e8154290 2023-10-24T00:29:37.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3e67fc700 1 -- 172.21.15.148:0/3993493195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800ba80 con 0x7fa3e8154290 2023-10-24T00:29:37.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 -- 172.21.15.148:0/3993493195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e8154290 msgr2=0x7fa3e8154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3993493195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa3e80643d0 tx=0x7fa3d80090f0).stop 2023-10-24T00:29:37.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 -- 172.21.15.148:0/3993493195 shutdown_connections 2023-10-24T00:29:37.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3993493195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3993493195 >> v2:172.21.15.150:3300/0 conn(0x7fa3e80a6750 0x7fa3e80a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 -- 172.21.15.148:0/3993493195 >> 172.21.15.148:0/3993493195 conn(0x7fa3e80c3f60 msgr2=0x7fa3e80c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 -- 172.21.15.148:0/3993493195 shutdown_connections 2023-10-24T00:29:37.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.059+0000 7fa3ed274700 1 -- 172.21.15.148:0/3993493195 wait complete. 2023-10-24T00:29:37.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 Processor -- start 2023-10-24T00:29:37.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 -- start start 2023-10-24T00:29:37.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3e80a4840 0x7fa3e81401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81530c0 con 0x7fa3e80a6750 2023-10-24T00:29:37.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80aafa0 con 0x7fa3e8154290 2023-10-24T00:29:37.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3ed274700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e81406e0 con 0x7fa3e80a4840 2023-10-24T00:29:37.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3de7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3de7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38446/0 (socket says 172.21.15.148:38446) 2023-10-24T00:29:37.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.061+0000 7fa3de7fc700 1 -- 172.21.15.148:0/3436341907 learned_addr learned my addr 172.21.15.148:0/3436341907 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:37.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3e6ffd700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3e80a4840 0x7fa3e81401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3e77fe700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 -- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3e80a4840 msgr2=0x7fa3e81401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3e80a4840 0x7fa3e81401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 -- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3e8154290 msgr2=0x7fa3e8154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 -- 172.21.15.148:0/3436341907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009370 con 0x7fa3e80a6750 2023-10-24T00:29:37.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3de7fc700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa3d000d8c0 tx=0x7fa3d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0011590 con 0x7fa3e80a6750 2023-10-24T00:29:37.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d00116f0 con 0x7fa3e80a6750 2023-10-24T00:29:37.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0011a70 con 0x7fa3e80a6750 2023-10-24T00:29:37.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8152b00 con 0x7fa3e80a6750 2023-10-24T00:29:37.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.062+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e80aac30 con 0x7fa3e80a6750 2023-10-24T00:29:37.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.063+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80ab150 con 0x7fa3e80a6750 2023-10-24T00:29:37.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.063+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa3d001c460 con 0x7fa3e80a6750 2023-10-24T00:29:37.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.064+0000 7fa3df7fe700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 0x7fa3c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.064+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa3d0079bb0 con 0x7fa3e80a6750 2023-10-24T00:29:37.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.064+0000 7fa3e6ffd700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 0x7fa3c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.064+0000 7fa3e6ffd700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 0x7fa3c8061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa3d8009130 tx=0x7fa3d8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.068+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa3e80ab150 con 0x7fa3e80a6750 2023-10-24T00:29:37.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.295+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa3e80ab150 con 0x7fa3e80a6750 2023-10-24T00:29:37.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.301+0000 7fa3df7fe700 1 -- 172.21.15.148:0/3436341907 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa3e80ab150 con 0x7fa3e80a6750 2023-10-24T00:29:37.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 msgr2=0x7fa3c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 0x7fa3c8061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa3d8009130 tx=0x7fa3d8015000).stop 2023-10-24T00:29:37.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 msgr2=0x7fa3e8152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fa3d000d8c0 tx=0x7fa3d0008040).stop 2023-10-24T00:29:37.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 shutdown_connections 2023-10-24T00:29:37.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3e8154290 0x7fa3e8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3e80a4840 0x7fa3e81401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa3c805f150 0x7fa3c8061610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 --2- 172.21.15.148:0/3436341907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3e80a6750 0x7fa3e8152120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 >> 172.21.15.148:0/3436341907 conn(0x7fa3e80c3f60 msgr2=0x7fa3e80a7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 shutdown_connections 2023-10-24T00:29:37.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.303+0000 7fa3ed274700 1 -- 172.21.15.148:0/3436341907 wait complete. 2023-10-24T00:29:37.309 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:37.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-24T00:29:37.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.430+0000 7f1e217b8700 1 Processor -- start 2023-10-24T00:29:37.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.430+0000 7f1e217b8700 1 -- start start 2023-10-24T00:29:37.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e217b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e1c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e217b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e1c154e70 0x7f1e1c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e217b8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c06a860 con 0x7f1e1c0c0810 2023-10-24T00:29:37.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e217b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9d90 con 0x7f1e1c154e70 2023-10-24T00:29:37.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e217b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9180 con 0x7f1e1c154a90 2023-10-24T00:29:37.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e20fb7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1e1c0c0810 0x7f1e1c0ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50868/0 (socket says 172.21.15.148:50868) 2023-10-24T00:29:37.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e20fb7700 1 -- 172.21.15.148:0/323095419 learned_addr learned my addr 172.21.15.148:0/323095419 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:37.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/323095419 >> v2:172.21.15.150:3300/0 conn(0x7f1e1c154e70 0x7f1e1c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664329620 0 0) 0x7f1e1c06a860 con 0x7f1e1c0c0810 2023-10-24T00:29:37.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e040033f0 con 0x7f1e1c0c0810 2023-10-24T00:29:37.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1bfff700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e1c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125936302 0 0) 0x7f1e040033f0 con 0x7f1e1c0c0810 2023-10-24T00:29:37.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 msgr2=0x7f1e1c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e1c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 >> v2:172.21.15.150:3300/0 conn(0x7f1e1c154e70 msgr2=0x7f1e1c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 --2- 172.21.15.148:0/323095419 >> v2:172.21.15.150:3300/0 conn(0x7f1e1c154e70 0x7f1e1c1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0c9460 con 0x7f1e1c0c0810 2023-10-24T00:29:37.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f1e140017f0 con 0x7f1e1c0c0810 2023-10-24T00:29:37.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.431+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 >> v1:172.21.15.148:6789/0 conn(0x7f1e1c0c0810 legacy=0x7f1e1c0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e040038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e04003e10 0x7f1e04004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e04004b80 0x7f1e04005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9d90 con 0x7f1e04003e10 2023-10-24T00:29:37.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c9180 con 0x7f1e04004b80 2023-10-24T00:29:37.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0400b8e0 con 0x7f1e1c154a90 2023-10-24T00:29:37.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e04003e10 0x7f1e04004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1bfff700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e040038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e20fb7700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e04004b80 0x7f1e04005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 msgr2=0x7f1e040038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e1c154a90 0x7f1e040038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e04004b80 msgr2=0x7f1e04005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e04004b80 0x7f1e04005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/323095419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040033f0 con 0x7f1e04003e10 2023-10-24T00:29:37.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e04003e10 0x7f1e04004690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f1e10009a80 tx=0x7f1e10009060).ready entity=mon.0 client_cookie=60fa4024172aa220 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10009430 con 0x7f1e04003e10 2023-10-24T00:29:37.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1000e640 con 0x7f1e04003e10 2023-10-24T00:29:37.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.432+0000 7f1e1affd700 1 -- 172.21.15.148:0/323095419 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000e9c0 con 0x7f1e04003e10 2023-10-24T00:29:37.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 -- 172.21.15.148:0/323095419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e04003e10 msgr2=0x7f1e04004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 --2- 172.21.15.148:0/323095419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e04003e10 0x7f1e04004690 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f1e10009a80 tx=0x7f1e10009060).stop 2023-10-24T00:29:37.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e20fb7700 1 -- 172.21.15.148:0/323095419 reap_dead start 2023-10-24T00:29:37.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 -- 172.21.15.148:0/323095419 shutdown_connections 2023-10-24T00:29:37.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 -- 172.21.15.148:0/323095419 >> 172.21.15.148:0/323095419 conn(0x7f1e1c084c20 msgr2=0x7f1e1c094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 -- 172.21.15.148:0/323095419 shutdown_connections 2023-10-24T00:29:37.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.433+0000 7f1e217b8700 1 -- 172.21.15.148:0/323095419 wait complete. 2023-10-24T00:29:37.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.434+0000 7f1e217b8700 1 Processor -- start 2023-10-24T00:29:37.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.434+0000 7f1e217b8700 1 -- start start 2023-10-24T00:29:37.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e04003e10 0x7f1e1c150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e1c0c38f0 0x7f1e1c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c4240 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0ade50 con 0x7f1e1c0c38f0 2023-10-24T00:29:37.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e217b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c27c0 con 0x7f1e04003e10 2023-10-24T00:29:37.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38462/0 (socket says 172.21.15.148:38462) 2023-10-24T00:29:37.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/3472869845 learned_addr learned my addr 172.21.15.148:0/3472869845 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:37.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1bfff700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e04003e10 0x7f1e1c150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e20fb7700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e1c0c38f0 0x7f1e1c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e04003e10 msgr2=0x7f1e1c150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e04003e10 0x7f1e1c150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e1c0c38f0 msgr2=0x7f1e1c0c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e1c0c38f0 0x7f1e1c0c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 -- 172.21.15.148:0/3472869845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0c2aa0 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e1b7fe700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f1e040045a0 tx=0x7f1e1001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10009ec0 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1000ed30 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.435+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000eea0 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.436+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c0c2d80 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.436+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c151240 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.437+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c0c5120 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.437+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e1001b660 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.437+0000 7f1e03fff700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.437+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1e1007b780 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.437+0000 7f1e1bfff700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.438+0000 7f1e1bfff700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1e0c006d80 tx=0x7f1e0c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.441+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e1004ce50 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.666+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1e1c0ae010 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.671+0000 7f1e03fff700 1 -- 172.21.15.148:0/3472869845 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e1002b070 con 0x7f1e1c0b0bd0 2023-10-24T00:29:37.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.673+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 msgr2=0x7f1e08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.673+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f1e0c006d80 tx=0x7f1e0c009060).stop 2023-10-24T00:29:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.673+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 msgr2=0x7f1e1c0c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.673+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f1e040045a0 tx=0x7f1e1001a000).stop 2023-10-24T00:29:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 shutdown_connections 2023-10-24T00:29:37.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e1c0c38f0 0x7f1e1c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e04003e10 0x7f1e1c150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0805f150 0x7f1e08061610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 --2- 172.21.15.148:0/3472869845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e1c0b0bd0 0x7f1e1c0c1ec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 >> 172.21.15.148:0/3472869845 conn(0x7f1e1c084c20 msgr2=0x7f1e1c0cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 shutdown_connections 2023-10-24T00:29:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.674+0000 7f1e217b8700 1 -- 172.21.15.148:0/3472869845 wait complete. 2023-10-24T00:29:37.679 INFO:teuthology.orchestra.run.smithi148.stderr:updated 2023-10-24T00:29:37.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:37.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.799+0000 7fa197704700 1 Processor -- start 2023-10-24T00:29:37.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.799+0000 7fa197704700 1 -- start start 2023-10-24T00:29:37.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa1900c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 0x7fa1900aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa190158770 0x7fa190069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900aa8e0 con 0x7fa190158770 2023-10-24T00:29:37.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900c0960 con 0x7fa1900c6710 2023-10-24T00:29:37.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa197704700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c0c40 con 0x7fa1900aa010 2023-10-24T00:29:37.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa190158770 0x7fa190069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa190158770 0x7fa190069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38476/0 (socket says 172.21.15.148:38476) 2023-10-24T00:29:37.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 -- 172.21.15.148:0/1229660775 learned_addr learned my addr 172.21.15.148:0/1229660775 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:37.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa194c9f700 1 --2- 172.21.15.148:0/1229660775 >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 0x7fa1900aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 -- 172.21.15.148:0/1229660775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 msgr2=0x7fa1900c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa1900c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa1900c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 -- 172.21.15.148:0/1229660775 >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 msgr2=0x7fa1900aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:37.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1229660775 >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 0x7fa1900aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 -- 172.21.15.148:0/1229660775 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900c0f20 con 0x7fa190158770 2023-10-24T00:29:37.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa194c9f700 1 --2- 172.21.15.148:0/1229660775 >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 0x7fa1900aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:37.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa1900c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:37.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa190069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa19006c320 tx=0x7fa1800090f0).ready entity=mon.0 client_cookie=526f651b54f1a79b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.800+0000 7fa18ffff700 1 -- 172.21.15.148:0/1229660775 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000b600 con 0x7fa190158770 2023-10-24T00:29:37.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa18ffff700 1 -- 172.21.15.148:0/1229660775 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18000b760 con 0x7fa190158770 2023-10-24T00:29:37.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa18ffff700 1 -- 172.21.15.148:0/1229660775 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000bae0 con 0x7fa190158770 2023-10-24T00:29:37.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 -- 172.21.15.148:0/1229660775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 msgr2=0x7fa190069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa190069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fa19006c320 tx=0x7fa1800090f0).stop 2023-10-24T00:29:37.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 -- 172.21.15.148:0/1229660775 shutdown_connections 2023-10-24T00:29:37.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa190069d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 --2- 172.21.15.148:0/1229660775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa1900c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 --2- 172.21.15.148:0/1229660775 >> v2:172.21.15.150:3300/0 conn(0x7fa1900c6710 0x7fa1900aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 -- 172.21.15.148:0/1229660775 >> 172.21.15.148:0/1229660775 conn(0x7fa1900caf40 msgr2=0x7fa1900cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 -- 172.21.15.148:0/1229660775 shutdown_connections 2023-10-24T00:29:37.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.801+0000 7fa197704700 1 -- 172.21.15.148:0/1229660775 wait complete. 2023-10-24T00:29:37.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.802+0000 7fa197704700 1 Processor -- start 2023-10-24T00:29:37.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.802+0000 7fa197704700 1 -- start start 2023-10-24T00:29:37.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa190144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 0x7fa1900c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190145060 con 0x7fa190158770 2023-10-24T00:29:37.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ae7d0 con 0x7fa1900c6710 2023-10-24T00:29:37.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa197704700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ae1f0 con 0x7fa1900aa010 2023-10-24T00:29:37.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa195ca1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa195ca1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38486/0 (socket says 172.21.15.148:38486) 2023-10-24T00:29:37.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa195ca1700 1 -- 172.21.15.148:0/1231063511 learned_addr learned my addr 172.21.15.148:0/1231063511 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:37.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa194c9f700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 0x7fa1900c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.803+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa190144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 -- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 msgr2=0x7fa190144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa190144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 -- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 msgr2=0x7fa1900c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 0x7fa1900c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 -- 172.21.15.148:0/1231063511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009370 con 0x7fa190158770 2023-10-24T00:29:37.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa194c9f700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 0x7fa1900c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:37.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa190144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:37.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa195ca1700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fa190084230 tx=0x7fa180017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000bae0 con 0x7fa190158770 2023-10-24T00:29:37.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18001c420 con 0x7fa190158770 2023-10-24T00:29:37.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900c3b90 con 0x7fa190158770 2023-10-24T00:29:37.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18001c7e0 con 0x7fa190158770 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.804+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1900c3e70 con 0x7fa190158770 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.805+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900ae980 con 0x7fa190158770 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.805+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa18001cb50 con 0x7fa190158770 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.805+0000 7fa18d7fa700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 0x7fa17c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.805+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa18007b9a0 con 0x7fa190158770 2023-10-24T00:29:37.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.806+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 0x7fa17c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:37.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.806+0000 7fa1954a0700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 0x7fa17c061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa188008990 tx=0x7fa188008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:37.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.809+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa1900ae980 con 0x7fa190158770 2023-10-24T00:29:37.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.973+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1900ae980 con 0x7fa190158770 2023-10-24T00:29:37.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.974+0000 7fa18d7fa700 1 -- 172.21.15.148:0/1231063511 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fa1900ae980 con 0x7fa190158770 2023-10-24T00:29:37.977 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:37.977 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":30,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:29:35.033733+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:37.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 msgr2=0x7fa17c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 0x7fa17c061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa188008990 tx=0x7fa188008040).stop 2023-10-24T00:29:37.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 msgr2=0x7fa1900c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:37.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fa190084230 tx=0x7fa180017000).stop 2023-10-24T00:29:37.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 shutdown_connections 2023-10-24T00:29:37.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa17c05f150 0x7fa17c061610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa190158770 0x7fa1900c4690 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1900aa010 0x7fa190144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 --2- 172.21.15.148:0/1231063511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1900c6710 0x7fa1900c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:37.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 >> 172.21.15.148:0/1231063511 conn(0x7fa1900caf40 msgr2=0x7fa1900c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:37.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 shutdown_connections 2023-10-24T00:29:37.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:37.976+0000 7fa197704700 1 -- 172.21.15.148:0/1231063511 wait complete. 2023-10-24T00:29:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:29:37.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:29:38.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.105+0000 7f993ad94700 1 Processor -- start 2023-10-24T00:29:38.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.105+0000 7f993ad94700 1 -- start start 2023-10-24T00:29:38.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 0x7f9934154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9934098bd0 0x7f99340c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340c71d0 con 0x7f9934098bd0 2023-10-24T00:29:38.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340c9410 con 0x7f9934154430 2023-10-24T00:29:38.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f993ad94700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340c0950 con 0x7f99340bffd0 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f992bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9934098bd0 0x7f99340c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f992bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9934098bd0 0x7f99340c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38490/0 (socket says 172.21.15.148:38490) 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f992bfff700 1 -- 172.21.15.148:0/2098490580 learned_addr learned my addr 172.21.15.148:0/2098490580 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f9939331700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.106+0000 7f9938b30700 1 --2- 172.21.15.148:0/2098490580 >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 0x7f9934154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 -- 172.21.15.148:0/2098490580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 msgr2=0x7f99340c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:38.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 -- 172.21.15.148:0/2098490580 >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 msgr2=0x7f9934154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:38.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 --2- 172.21.15.148:0/2098490580 >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 0x7f9934154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 -- 172.21.15.148:0/2098490580 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340c6c10 con 0x7f9934098bd0 2023-10-24T00:29:38.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f9938b30700 1 --2- 172.21.15.148:0/2098490580 >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 0x7f9934154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:38.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992bfff700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934098bd0 0x7f99340c6300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f993405ff70 tx=0x7f99240090f0).ready entity=mon.0 client_cookie=91fa8cd1687e4a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992b7fe700 1 -- 172.21.15.148:0/2098490580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400b520 con 0x7f9934098bd0 2023-10-24T00:29:38.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992b7fe700 1 -- 172.21.15.148:0/2098490580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400b680 con 0x7f9934098bd0 2023-10-24T00:29:38.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f992b7fe700 1 -- 172.21.15.148:0/2098490580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400ba00 con 0x7f9934098bd0 2023-10-24T00:29:38.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 -- 172.21.15.148:0/2098490580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934098bd0 msgr2=0x7f99340c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934098bd0 0x7f99340c6300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f993405ff70 tx=0x7f99240090f0).stop 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 -- 172.21.15.148:0/2098490580 shutdown_connections 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 --2- 172.21.15.148:0/2098490580 >> v2:172.21.15.150:3300/0 conn(0x7f9934154430 0x7f9934154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 --2- 172.21.15.148:0/2098490580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934098bd0 0x7f99340c6300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 -- 172.21.15.148:0/2098490580 >> 172.21.15.148:0/2098490580 conn(0x7f99340cb070 msgr2=0x7f99340cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 -- 172.21.15.148:0/2098490580 shutdown_connections 2023-10-24T00:29:38.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.107+0000 7f993ad94700 1 -- 172.21.15.148:0/2098490580 wait complete. 2023-10-24T00:29:38.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.108+0000 7f993ad94700 1 Processor -- start 2023-10-24T00:29:38.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 -- start start 2023-10-24T00:29:38.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9934098bd0 0x7f993414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993414f470 con 0x7f9934154430 2023-10-24T00:29:38.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340af070 con 0x7f9934098bd0 2023-10-24T00:29:38.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f993ad94700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340af350 con 0x7f99340bffd0 2023-10-24T00:29:38.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f9939331700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f9939331700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38498/0 (socket says 172.21.15.148:38498) 2023-10-24T00:29:38.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.109+0000 7f9939331700 1 -- 172.21.15.148:0/4244557722 learned_addr learned my addr 172.21.15.148:0/4244557722 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9938b30700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9934098bd0 0x7f993414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f992bfff700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 -- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 msgr2=0x7f99340ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 -- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9934098bd0 msgr2=0x7f993414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9934098bd0 0x7f993414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 -- 172.21.15.148:0/4244557722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009370 con 0x7f9934154430 2023-10-24T00:29:38.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9939331700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f992c009e90 tx=0x7f992c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00caa0 con 0x7f9934154430 2023-10-24T00:29:38.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00f040 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340af630 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00ce10 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.110+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340afbf0 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.111+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99340afde0 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.111+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f992c013610 con 0x7f9934154430 2023-10-24T00:29:38.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.112+0000 7f9928ff9700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 0x7f9920061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.112+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f992c07a690 con 0x7f9934154430 2023-10-24T00:29:38.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.112+0000 7f9938b30700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 0x7f9920061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.112+0000 7f9938b30700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 0x7f9920061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9930006fd0 tx=0x7f9930008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.116+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f992c04bcb0 con 0x7f9934154430 2023-10-24T00:29:38.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.276+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f993406c6b0 con 0x7f9934154430 2023-10-24T00:29:38.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.276+0000 7f9928ff9700 1 -- 172.21.15.148:0/4244557722 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f992c04f2d0 con 0x7f9934154430 2023-10-24T00:29:38.280 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:29:38.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 msgr2=0x7f9920061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 0x7f9920061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9930006fd0 tx=0x7f9930008040).stop 2023-10-24T00:29:38.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 msgr2=0x7f99340abe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f992c009e90 tx=0x7f992c00b040).stop 2023-10-24T00:29:38.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 shutdown_connections 2023-10-24T00:29:38.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f992005f150 0x7f9920061610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9934154430 0x7f99340abe10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9934098bd0 0x7f993414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 --2- 172.21.15.148:0/4244557722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99340bffd0 0x7f99340ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 >> 172.21.15.148:0/4244557722 conn(0x7f99340cb070 msgr2=0x7f99340c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 shutdown_connections 2023-10-24T00:29:38.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.278+0000 7f993ad94700 1 -- 172.21.15.148:0/4244557722 wait complete. 2023-10-24T00:29:38.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:29:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.406+0000 7f165bb5f700 1 Processor -- start 2023-10-24T00:29:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.406+0000 7f165bb5f700 1 -- start start 2023-10-24T00:29:38.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 0x7f1654154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1654098bd0 0x7f16540c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16540bffd0 0x7f16540c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540c71d0 con 0x7f1654098bd0 2023-10-24T00:29:38.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540c9410 con 0x7f1654154430 2023-10-24T00:29:38.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165bb5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16540c0950 con 0x7f16540bffd0 2023-10-24T00:29:38.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f16590fa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1654098bd0 0x7f16540c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f16590fa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1654098bd0 0x7f16540c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38504/0 (socket says 172.21.15.148:38504) 2023-10-24T00:29:38.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f16590fa700 1 -- 172.21.15.148:0/717834372 learned_addr learned my addr 172.21.15.148:0/717834372 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f16598fb700 1 --2- 172.21.15.148:0/717834372 >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 0x7f1654154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.407+0000 7f165a0fc700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16540bffd0 0x7f16540c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 -- 172.21.15.148:0/717834372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16540bffd0 msgr2=0x7f16540c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:38.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16540bffd0 0x7f16540c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 -- 172.21.15.148:0/717834372 >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 msgr2=0x7f1654154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 --2- 172.21.15.148:0/717834372 >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 0x7f1654154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 -- 172.21.15.148:0/717834372 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540c6c10 con 0x7f1654098bd0 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16598fb700 1 --2- 172.21.15.148:0/717834372 >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 0x7f1654154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16590fa700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1654098bd0 0x7f16540c6300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f165405ff70 tx=0x7f16440090f0).ready entity=mon.0 client_cookie=ac75d8d72809713d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16588f9700 1 -- 172.21.15.148:0/717834372 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400b520 con 0x7f1654098bd0 2023-10-24T00:29:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16588f9700 1 -- 172.21.15.148:0/717834372 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400b680 con 0x7f1654098bd0 2023-10-24T00:29:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f16588f9700 1 -- 172.21.15.148:0/717834372 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400ba00 con 0x7f1654098bd0 2023-10-24T00:29:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 -- 172.21.15.148:0/717834372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1654098bd0 msgr2=0x7f16540c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1654098bd0 0x7f16540c6300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f165405ff70 tx=0x7f16440090f0).stop 2023-10-24T00:29:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 -- 172.21.15.148:0/717834372 shutdown_connections 2023-10-24T00:29:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16540bffd0 0x7f16540c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 --2- 172.21.15.148:0/717834372 >> v2:172.21.15.150:3300/0 conn(0x7f1654154430 0x7f1654154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 --2- 172.21.15.148:0/717834372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1654098bd0 0x7f16540c6300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.408+0000 7f165bb5f700 1 -- 172.21.15.148:0/717834372 >> 172.21.15.148:0/717834372 conn(0x7f16540cb070 msgr2=0x7f16540cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.409+0000 7f165bb5f700 1 -- 172.21.15.148:0/717834372 shutdown_connections 2023-10-24T00:29:38.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.409+0000 7f165bb5f700 1 -- 172.21.15.148:0/717834372 wait complete. 2023-10-24T00:29:38.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 Processor -- start 2023-10-24T00:29:38.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 -- start start 2023-10-24T00:29:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1654098bd0 0x7f16541524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1654154430 0x7f16540aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654142900 con 0x7f16540bffd0 2023-10-24T00:29:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541646e0 con 0x7f1654154430 2023-10-24T00:29:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f165bb5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654153000 con 0x7f1654098bd0 2023-10-24T00:29:38.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.410+0000 7f16590fa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38518/0 (socket says 172.21.15.148:38518) 2023-10-24T00:29:38.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 -- 172.21.15.148:0/3540109792 learned_addr learned my addr 172.21.15.148:0/3540109792 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16598fb700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1654098bd0 0x7f16541524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f165a0fc700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1654154430 0x7f16540aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 -- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1654098bd0 msgr2=0x7f16541524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1654098bd0 0x7f16541524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 -- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1654154430 msgr2=0x7f16540aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1654154430 0x7f16540aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 -- 172.21.15.148:0/3540109792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009370 con 0x7f16540bffd0 2023-10-24T00:29:38.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f16590fa700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f16540c5910 tx=0x7f1644017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400be90 con 0x7f16540bffd0 2023-10-24T00:29:38.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400b7f0 con 0x7f16540bffd0 2023-10-24T00:29:38.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541532e0 con 0x7f16540bffd0 2023-10-24T00:29:38.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164401c630 con 0x7f16540bffd0 2023-10-24T00:29:38.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.411+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16540b0210 con 0x7f16540bffd0 2023-10-24T00:29:38.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.412+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165406c6b0 con 0x7f16540bffd0 2023-10-24T00:29:38.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.413+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f164401ca20 con 0x7f16540bffd0 2023-10-24T00:29:38.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.414+0000 7f1649ffb700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 0x7f1638061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.414+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f164407c170 con 0x7f16540bffd0 2023-10-24T00:29:38.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.414+0000 7f16598fb700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 0x7f1638061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.414+0000 7f16598fb700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 0x7f1638061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1650006fd0 tx=0x7f1650008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.417+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f164404d750 con 0x7f16540bffd0 2023-10-24T00:29:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.578+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16540c6ef0 con 0x7f16540bffd0 2023-10-24T00:29:38.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.579+0000 7f1649ffb700 1 -- 172.21.15.148:0/3540109792 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1644050d70 con 0x7f16540bffd0 2023-10-24T00:29:38.582 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:29:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 msgr2=0x7f1638061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 0x7f1638061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1650006fd0 tx=0x7f1650008040).stop 2023-10-24T00:29:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 msgr2=0x7f16541529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f16540c5910 tx=0x7f1644017000).stop 2023-10-24T00:29:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 shutdown_connections 2023-10-24T00:29:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1654154430 0x7f16540aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1654098bd0 0x7f16541524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f163805f150 0x7f1638061610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 --2- 172.21.15.148:0/3540109792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16540bffd0 0x7f16541529b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.580+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 >> 172.21.15.148:0/3540109792 conn(0x7f16540cb070 msgr2=0x7f16540c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.581+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 shutdown_connections 2023-10-24T00:29:38.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.581+0000 7f165bb5f700 1 -- 172.21.15.148:0/3540109792 wait complete. 2023-10-24T00:29:38.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:29:38.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.705+0000 7f1575dde700 1 Processor -- start 2023-10-24T00:29:38.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.705+0000 7f1575dde700 1 -- start start 2023-10-24T00:29:38.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1575dde700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15700aa140 0x7f15700c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1575dde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700c0ef0 0x7f15700c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1575dde700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15700c6410 con 0x7f15700ca110 2023-10-24T00:29:38.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1575dde700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15700ca6e0 con 0x7f15700aa140 2023-10-24T00:29:38.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1575dde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700ca9c0 con 0x7f15700c0ef0 2023-10-24T00:29:38.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15700aa140 0x7f15700c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15700aa140 0x7f15700c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38526/0 (socket says 172.21.15.148:38526) 2023-10-24T00:29:38.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 -- 172.21.15.148:0/1332285066 learned_addr learned my addr 172.21.15.148:0/1332285066 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f15755dd700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700c0ef0 0x7f15700c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 -- 172.21.15.148:0/1332285066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700c0ef0 msgr2=0x7f15700c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:38.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700c0ef0 0x7f15700c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 -- 172.21.15.148:0/1332285066 >> v1:172.21.15.150:6789/0 conn(0x7f15700ca110 legacy=0x7f15700c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.706+0000 7f1574ddc700 1 -- 172.21.15.148:0/1332285066 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700c60a0 con 0x7f15700aa140 2023-10-24T00:29:38.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1574ddc700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700aa140 0x7f15700c9c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1564006fd0 tx=0x7f15640090f0).ready entity=mon.0 client_cookie=27e677a1f7d7270e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f156f7fe700 1 -- 172.21.15.148:0/1332285066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400b600 con 0x7f15700aa140 2023-10-24T00:29:38.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f156f7fe700 1 -- 172.21.15.148:0/1332285066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156400b760 con 0x7f15700aa140 2023-10-24T00:29:38.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f156f7fe700 1 -- 172.21.15.148:0/1332285066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400bae0 con 0x7f15700aa140 2023-10-24T00:29:38.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 -- 172.21.15.148:0/1332285066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700aa140 msgr2=0x7f15700c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700aa140 0x7f15700c9c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1564006fd0 tx=0x7f15640090f0).stop 2023-10-24T00:29:38.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 -- 172.21.15.148:0/1332285066 shutdown_connections 2023-10-24T00:29:38.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700c0ef0 0x7f15700c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 --2- 172.21.15.148:0/1332285066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700aa140 0x7f15700c9c20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 -- 172.21.15.148:0/1332285066 >> 172.21.15.148:0/1332285066 conn(0x7f15700944a0 msgr2=0x7f157006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 -- 172.21.15.148:0/1332285066 shutdown_connections 2023-10-24T00:29:38.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.707+0000 7f1575dde700 1 -- 172.21.15.148:0/1332285066 wait complete. 2023-10-24T00:29:38.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.708+0000 7f1575dde700 1 Processor -- start 2023-10-24T00:29:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 -- start start 2023-10-24T00:29:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700aa140 0x7f1570151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15700ca110 0x7f15700abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700ab3d0 con 0x7f15700c0ef0 2023-10-24T00:29:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700aa520 con 0x7f15700ca110 2023-10-24T00:29:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f1575dde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700aa7c0 con 0x7f15700aa140 2023-10-24T00:29:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f156ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f156ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38540/0 (socket says 172.21.15.148:38540) 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.709+0000 7f156ffff700 1 -- 172.21.15.148:0/2612373651 learned_addr learned my addr 172.21.15.148:0/2612373651 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f15755dd700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15700ca110 0x7f15700abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f1574ddc700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700aa140 0x7f1570151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 -- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700aa140 msgr2=0x7f1570151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700aa140 0x7f1570151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 -- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15700ca110 msgr2=0x7f15700abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15700ca110 0x7f15700abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 -- 172.21.15.148:0/2612373651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009370 con 0x7f15700c0ef0 2023-10-24T00:29:38.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156ffff700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f155c00c440 tx=0x7f155c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c007020 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c007180 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15700aaaa0 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c007540 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.710+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15700ab060 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.711+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15700ab6b0 con 0x7f15700c0ef0 2023-10-24T00:29:38.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.711+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f155c0068b0 con 0x7f15700c0ef0 2023-10-24T00:29:38.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.712+0000 7f156cff9700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 0x7f15540615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:38.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.712+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f155c079090 con 0x7f15700c0ef0 2023-10-24T00:29:38.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.712+0000 7f1574ddc700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 0x7f15540615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:38.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.712+0000 7f1574ddc700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 0x7f15540615e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1564009130 tx=0x7f1564017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:38.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.716+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f155c047af0 con 0x7f15700c0ef0 2023-10-24T00:29:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.881+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1570047480 con 0x7f15700c0ef0 2023-10-24T00:29:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.882+0000 7f156cff9700 1 -- 172.21.15.148:0/2612373651 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7f155c04a6b0 con 0x7f15700c0ef0 2023-10-24T00:29:38.885 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:38.885 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:29:38.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:38.885 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:29:38.886 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:29:38.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:29:38.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:38.886 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:29:38.886 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:29:38.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:38.887 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:29:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.883+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 msgr2=0x7f15540615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.883+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 0x7f15540615e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f1564009130 tx=0x7f1564017000).stop 2023-10-24T00:29:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 msgr2=0x7f15700b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f155c00c440 tx=0x7f155c007e00).stop 2023-10-24T00:29:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 shutdown_connections 2023-10-24T00:29:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15700ca110 0x7f15700abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15700aa140 0x7f1570151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f155405f120 0x7f15540615e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 --2- 172.21.15.148:0/2612373651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15700c0ef0 0x7f15700b0120 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 >> 172.21.15.148:0/2612373651 conn(0x7f15700944a0 msgr2=0x7f1570152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 shutdown_connections 2023-10-24T00:29:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:38.884+0000 7f1575dde700 1 -- 172.21.15.148:0/2612373651 wait complete. 2023-10-24T00:29:38.898 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:29:38.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:29:39.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.015+0000 7f0760ef8700 1 Processor -- start 2023-10-24T00:29:39.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.015+0000 7f0760ef8700 1 -- start start 2023-10-24T00:29:39.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0760ef8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f075c1522c0 0x7f075c063080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0760ef8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f075c1526a0 0x7f075c153340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0760ef8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c152eb0 con 0x7f075c0c56d0 2023-10-24T00:29:39.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0760ef8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0c5eb0 con 0x7f075c1526a0 2023-10-24T00:29:39.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0760ef8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0c6190 con 0x7f075c1522c0 2023-10-24T00:29:39.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0759d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f075c1526a0 0x7f075c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f075ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f075c0c56d0 0x7f075c0a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50870/0 (socket says 172.21.15.148:50870) 2023-10-24T00:29:39.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f075ad9d700 1 -- 172.21.15.148:0/1185817481 learned_addr learned my addr 172.21.15.148:0/1185817481 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:39.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f075a59c700 1 --2- 172.21.15.148:0/1185817481 >> v2:172.21.15.150:3300/0 conn(0x7f075c1522c0 0x7f075c063080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0759d9b700 1 -- 172.21.15.148:0/1185817481 >> v2:172.21.15.150:3300/0 conn(0x7f075c1522c0 msgr2=0x7f075c063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:39.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0759d9b700 1 --2- 172.21.15.148:0/1185817481 >> v2:172.21.15.150:3300/0 conn(0x7f075c1522c0 0x7f075c063080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0759d9b700 1 -- 172.21.15.148:0/1185817481 >> v1:172.21.15.148:6789/0 conn(0x7f075c0c56d0 legacy=0x7f075c0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f0759d9b700 1 -- 172.21.15.148:0/1185817481 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c152b40 con 0x7f075c1526a0 2023-10-24T00:29:39.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.016+0000 7f075959a700 1 -- 172.21.15.148:0/1185817481 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084176712 0 0) 0x7f075c152eb0 con 0x7f075c0c56d0 2023-10-24T00:29:39.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0759d9b700 1 --2- 172.21.15.148:0/1185817481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c153340 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f075c069fe0 tx=0x7f0750009060).ready entity=mon.0 client_cookie=fc73effccd55ab39 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:39.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f075959a700 1 -- 172.21.15.148:0/1185817481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000f510 con 0x7f075c1526a0 2023-10-24T00:29:39.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f075959a700 1 -- 172.21.15.148:0/1185817481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000f670 con 0x7f075c1526a0 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f075959a700 1 -- 172.21.15.148:0/1185817481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000f9f0 con 0x7f075c1526a0 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 -- 172.21.15.148:0/1185817481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 msgr2=0x7f075c153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 --2- 172.21.15.148:0/1185817481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c153340 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f075c069fe0 tx=0x7f0750009060).stop 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 -- 172.21.15.148:0/1185817481 shutdown_connections 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 --2- 172.21.15.148:0/1185817481 >> v2:172.21.15.150:3300/0 conn(0x7f075c1522c0 0x7f075c063080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 --2- 172.21.15.148:0/1185817481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c153340 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 -- 172.21.15.148:0/1185817481 >> 172.21.15.148:0/1185817481 conn(0x7f075c082f60 msgr2=0x7f075c092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:39.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 -- 172.21.15.148:0/1185817481 shutdown_connections 2023-10-24T00:29:39.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.017+0000 7f0760ef8700 1 -- 172.21.15.148:0/1185817481 wait complete. 2023-10-24T00:29:39.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.018+0000 7f0760ef8700 1 Processor -- start 2023-10-24T00:29:39.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.018+0000 7f0760ef8700 1 -- start start 2023-10-24T00:29:39.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f075c0c56d0 0x7f075c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f075c1522c0 0x7f075c063760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0647e0 con 0x7f075c1526a0 2023-10-24T00:29:39.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c14e9e0 con 0x7f075c1522c0 2023-10-24T00:29:39.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0760ef8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c063f40 con 0x7f075c0c56d0 2023-10-24T00:29:39.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f075ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f075ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38552/0 (socket says 172.21.15.148:38552) 2023-10-24T00:29:39.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f075ad9d700 1 -- 172.21.15.148:0/3186541783 learned_addr learned my addr 172.21.15.148:0/3186541783 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:39.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f0759d9b700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f075c1522c0 0x7f075c063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.019+0000 7f075a59c700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f075c0c56d0 0x7f075c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 -- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f075c0c56d0 msgr2=0x7f075c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f075c0c56d0 0x7f075c150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 -- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f075c1522c0 msgr2=0x7f075c063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f075c1522c0 0x7f075c063760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 -- 172.21.15.148:0/3186541783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500092a0 con 0x7f075c1526a0 2023-10-24T00:29:39.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f075ad9d700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f075400c7e0 tx=0x7f0754007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:39.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754005d30 con 0x7f075c1526a0 2023-10-24T00:29:39.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754005e90 con 0x7f075c1526a0 2023-10-24T00:29:39.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c064220 con 0x7f075c1526a0 2023-10-24T00:29:39.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754007320 con 0x7f075c1526a0 2023-10-24T00:29:39.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.020+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c063c50 con 0x7f075c1526a0 2023-10-24T00:29:39.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.021+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c14e7b0 con 0x7f075c1526a0 2023-10-24T00:29:39.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.021+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0754007710 con 0x7f075c1526a0 2023-10-24T00:29:39.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.022+0000 7f074a7fc700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 0x7f073c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:39.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.022+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0754079da0 con 0x7f075c1526a0 2023-10-24T00:29:39.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.022+0000 7f075a59c700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 0x7f073c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:39.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.022+0000 7f075a59c700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 0x7f073c061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f074c009c30 tx=0x7f074c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:39.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.026+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f075c14e7b0 con 0x7f075c1526a0 2023-10-24T00:29:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.189+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f075c14e7b0 con 0x7f075c1526a0 2023-10-24T00:29:39.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.878+0000 7f074a7fc700 1 -- 172.21.15.148:0/3186541783 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f075c14e7b0 con 0x7f075c1526a0 2023-10-24T00:29:39.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 msgr2=0x7f073c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 0x7f073c061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f074c009c30 tx=0x7f074c009060).stop 2023-10-24T00:29:39.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 msgr2=0x7f075c0c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:39.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f075400c7e0 tx=0x7f0754007f90).stop 2023-10-24T00:29:39.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 shutdown_connections 2023-10-24T00:29:39.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f073c05f150 0x7f073c061610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f075c1526a0 0x7f075c0c1e80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f075c0c56d0 0x7f075c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 --2- 172.21.15.148:0/3186541783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f075c1522c0 0x7f075c063760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:39.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 >> 172.21.15.148:0/3186541783 conn(0x7f075c082f60 msgr2=0x7f075c0adc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:39.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 shutdown_connections 2023-10-24T00:29:39.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:39.881+0000 7f0760ef8700 1 -- 172.21.15.148:0/3186541783 wait complete. 2023-10-24T00:29:39.887 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:29:39.901 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:29:40.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.019+0000 7fc97359e700 1 Processor -- start 2023-10-24T00:29:40.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.019+0000 7fc97359e700 1 -- start start 2023-10-24T00:29:40.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc974154150 0x7fc9740a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc9740c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9740a9830 con 0x7fc9740c0e30 2023-10-24T00:29:40.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740c12c0 con 0x7fc974154150 2023-10-24T00:29:40.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740a8c20 con 0x7fc9740aa390 2023-10-24T00:29:40.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc972d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc9740c0e30 0x7fc9740c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50880/0 (socket says 172.21.15.148:50880) 2023-10-24T00:29:40.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc972d9d700 1 -- 172.21.15.148:0/3234935417 learned_addr learned my addr 172.21.15.148:0/3234935417 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:40.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc97259c700 1 --2- 172.21.15.148:0/3234935417 >> v2:172.21.15.150:3300/0 conn(0x7fc974154150 0x7fc9740a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc96bfff700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc9740c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690836741 0 0) 0x7fc9740a9830 con 0x7fc9740c0e30 2023-10-24T00:29:40.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9600033f0 con 0x7fc9740c0e30 2023-10-24T00:29:40.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650851012 0 0) 0x7fc9600033f0 con 0x7fc9740c0e30 2023-10-24T00:29:40.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 msgr2=0x7fc9740c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:40.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc9740c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 >> v2:172.21.15.150:3300/0 conn(0x7fc974154150 msgr2=0x7fc9740a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:40.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 --2- 172.21.15.148:0/3234935417 >> v2:172.21.15.150:3300/0 conn(0x7fc974154150 0x7fc9740a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9740a8f00 con 0x7fc9740c0e30 2023-10-24T00:29:40.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fc96c0017f0 con 0x7fc9740c0e30 2023-10-24T00:29:40.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 >> v1:172.21.15.148:6789/0 conn(0x7fc9740c0e30 legacy=0x7fc9740c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600038e0 0x7fc960003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc960004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc960004b80 0x7fc960005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c12c0 con 0x7fc960004b80 2023-10-24T00:29:40.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740a8c20 con 0x7fc9600038e0 2023-10-24T00:29:40.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.020+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000b8e0 con 0x7fc9740aa390 2023-10-24T00:29:40.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc960004b80 0x7fc960005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc96bfff700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc960004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc97259c700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600038e0 0x7fc960003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 -- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 msgr2=0x7fc960004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:40.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740aa390 0x7fc960004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 -- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600038e0 msgr2=0x7fc960003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:40.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9600038e0 0x7fc960003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 -- 172.21.15.148:0/3234935417 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600033f0 con 0x7fc960004b80 2023-10-24T00:29:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc960004b80 0x7fc960005000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fc96c00c530 tx=0x7fc96c001d90).ready entity=mon.0 client_cookie=3942dab8434060de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00ce60 con 0x7fc960004b80 2023-10-24T00:29:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c005b20 con 0x7fc960004b80 2023-10-24T00:29:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc971d9b700 1 -- 172.21.15.148:0/3234935417 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0070d0 con 0x7fc960004b80 2023-10-24T00:29:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc97359e700 1 -- 172.21.15.148:0/3234935417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc960004b80 msgr2=0x7fc960005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc97359e700 1 --2- 172.21.15.148:0/3234935417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc960004b80 0x7fc960005000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fc96c00c530 tx=0x7fc96c001d90).stop 2023-10-24T00:29:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.021+0000 7fc972d9d700 1 -- 172.21.15.148:0/3234935417 reap_dead start 2023-10-24T00:29:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.022+0000 7fc97359e700 1 -- 172.21.15.148:0/3234935417 shutdown_connections 2023-10-24T00:29:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.022+0000 7fc97359e700 1 -- 172.21.15.148:0/3234935417 >> 172.21.15.148:0/3234935417 conn(0x7fc974094500 msgr2=0x7fc97406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:40.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.022+0000 7fc97359e700 1 -- 172.21.15.148:0/3234935417 shutdown_connections 2023-10-24T00:29:40.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.022+0000 7fc97359e700 1 -- 172.21.15.148:0/3234935417 wait complete. 2023-10-24T00:29:40.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 Processor -- start 2023-10-24T00:29:40.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 -- start start 2023-10-24T00:29:40.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 0x7fc974164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9741651c0 0x7fc974164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974157580 con 0x7fc974158d30 2023-10-24T00:29:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc974163b00 con 0x7fc9741651c0 2023-10-24T00:29:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974159110 con 0x7fc9740c8af0 2023-10-24T00:29:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.023+0000 7fc97259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38572/0 (socket says 172.21.15.148:38572) 2023-10-24T00:29:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 -- 172.21.15.148:0/1617424380 learned_addr learned my addr 172.21.15.148:0/1617424380 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc972d9d700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9741651c0 0x7fc974164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc96bfff700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 0x7fc974164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 -- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 msgr2=0x7fc974164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 0x7fc974164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 -- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9741651c0 msgr2=0x7fc974164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9741651c0 0x7fc974164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 -- 172.21.15.148:0/1617424380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974156ce0 con 0x7fc974158d30 2023-10-24T00:29:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc96bfff700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 0x7fc974164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97259c700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc9640119c0 tx=0x7fc964006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964011e50 con 0x7fc974158d30 2023-10-24T00:29:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400f940 con 0x7fc974158d30 2023-10-24T00:29:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400fcc0 con 0x7fc974158d30 2023-10-24T00:29:40.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc974156fc0 con 0x7fc974158d30 2023-10-24T00:29:40.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.024+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc974163d10 con 0x7fc974158d30 2023-10-24T00:29:40.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.025+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc974047480 con 0x7fc974158d30 2023-10-24T00:29:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.026+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc964014650 con 0x7fc974158d30 2023-10-24T00:29:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.026+0000 7fc96a7fc700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 0x7fc954061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.026+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fc96407a810 con 0x7fc974158d30 2023-10-24T00:29:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.026+0000 7fc96bfff700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 0x7fc954061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.027+0000 7fc96bfff700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 0x7fc954061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc974157c30 tx=0x7fc95c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.031+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc96404bcc0 con 0x7fc974158d30 2023-10-24T00:29:40.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.194+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc9740a91e0 con 0x7fc974158d30 2023-10-24T00:29:40.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.885+0000 7fc96a7fc700 1 -- 172.21.15.148:0/1617424380 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc964022030 con 0x7fc974158d30 2023-10-24T00:29:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.890+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 msgr2=0x7fc954061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.890+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 0x7fc954061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc974157c30 tx=0x7fc95c008040).stop 2023-10-24T00:29:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.890+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 msgr2=0x7fc974156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:40.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.890+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc9640119c0 tx=0x7fc964006f40).stop 2023-10-24T00:29:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 shutdown_connections 2023-10-24T00:29:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9741651c0 0x7fc974164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc95405f150 0x7fc954061610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc974158d30 0x7fc974156690 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 --2- 172.21.15.148:0/1617424380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9740c8af0 0x7fc974164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.891+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 >> 172.21.15.148:0/1617424380 conn(0x7fc974094500 msgr2=0x7fc9740c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:40.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.892+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 shutdown_connections 2023-10-24T00:29:40.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:40.894+0000 7fc97359e700 1 -- 172.21.15.148:0/1617424380 wait complete. 2023-10-24T00:29:40.900 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:29:40.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:29:41.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.034+0000 7f9b0813c700 1 Processor -- start 2023-10-24T00:29:41.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.034+0000 7f9b0813c700 1 -- start start 2023-10-24T00:29:41.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b0813c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b00151190 0x7f9b00064da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b0813c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b0006b380 0x7f9b00065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b0813c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000ad3d0 con 0x7f9b00151570 2023-10-24T00:29:41.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b0813c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b000c3800 con 0x7f9b00151190 2023-10-24T00:29:41.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b0813c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c3ae0 con 0x7f9b0006b380 2023-10-24T00:29:41.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b066d9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9b00151570 0x7f9b00154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50882/0 (socket says 172.21.15.148:50882) 2023-10-24T00:29:41.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.035+0000 7f9b066d9700 1 -- 172.21.15.148:0/1505826666 learned_addr learned my addr 172.21.15.148:0/1505826666 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:41.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b0006b380 0x7f9b00065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> v2:172.21.15.150:3300/0 conn(0x7f9b00151190 0x7f9b00064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540842931 0 0) 0x7f9b000ad3d0 con 0x7f9b00151570 2023-10-24T00:29:41.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aec0033f0 con 0x7f9b00151570 2023-10-24T00:29:41.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1971867860 0 0) 0x7f9aec0033f0 con 0x7f9b00151570 2023-10-24T00:29:41.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b0006b380 msgr2=0x7f9b00065290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b0006b380 0x7f9b00065290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 >> v2:172.21.15.150:3300/0 conn(0x7f9b00151190 msgr2=0x7f9b00064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 --2- 172.21.15.148:0/1505826666 >> v2:172.21.15.150:3300/0 conn(0x7f9b00151190 0x7f9b00064da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000ad060 con 0x7f9b00151570 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f9af8001470 con 0x7f9b00151570 2023-10-24T00:29:41.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 >> v1:172.21.15.148:6789/0 conn(0x7f9b00151570 legacy=0x7f9b00154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9aec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aec004690 0x7f9aec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aec005000 0x7f9aec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c3800 con 0x7f9aec0038e0 2023-10-24T00:29:41.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c3ae0 con 0x7f9aec004690 2023-10-24T00:29:41.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec00bdd0 con 0x7f9aec005000 2023-10-24T00:29:41.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> v2:172.21.15.150:3300/0 conn(0x7f9b00151190 0x7f9b00064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:41.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b0006b380 0x7f9b00065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:41.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b066d9700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aec005000 0x7f9aec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9aec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.036+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aec004690 0x7f9aec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aec005000 msgr2=0x7f9aec00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aec005000 0x7f9aec00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aec004690 msgr2=0x7f9aec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aec004690 0x7f9aec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1505826666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec0033f0 con 0x7f9aec0038e0 2023-10-24T00:29:41.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9aec003d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f9afc00e3f0 tx=0x7f9afc00b040).ready entity=mon.0 client_cookie=bb1a9edab4fec96b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc017070 con 0x7f9aec0038e0 2023-10-24T00:29:41.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc00f040 con 0x7f9aec0038e0 2023-10-24T00:29:41.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b04ed6700 1 -- 172.21.15.148:0/1505826666 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00eeb0 con 0x7f9aec0038e0 2023-10-24T00:29:41.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 -- 172.21.15.148:0/1505826666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 msgr2=0x7f9aec003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1505826666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9aec003d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f9afc00e3f0 tx=0x7f9afc00b040).stop 2023-10-24T00:29:41.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b066d9700 1 -- 172.21.15.148:0/1505826666 reap_dead start 2023-10-24T00:29:41.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 -- 172.21.15.148:0/1505826666 shutdown_connections 2023-10-24T00:29:41.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 -- 172.21.15.148:0/1505826666 >> 172.21.15.148:0/1505826666 conn(0x7f9b000c3f60 msgr2=0x7f9b000c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 -- 172.21.15.148:0/1505826666 shutdown_connections 2023-10-24T00:29:41.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.037+0000 7f9b0813c700 1 -- 172.21.15.148:0/1505826666 wait complete. 2023-10-24T00:29:41.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.038+0000 7f9b0813c700 1 Processor -- start 2023-10-24T00:29:41.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 -- start start 2023-10-24T00:29:41.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b00151a30 0x7f9b001540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b001545c0 0x7f9b00147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00154c10 con 0x7f9aec0038e0 2023-10-24T00:29:41.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b001448f0 con 0x7f9b001545c0 2023-10-24T00:29:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b0813c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00143d50 con 0x7f9b00151a30 2023-10-24T00:29:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b05ed8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b05ed8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38590/0 (socket says 172.21.15.148:38590) 2023-10-24T00:29:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.039+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1715244268 learned_addr learned my addr 172.21.15.148:0/1715244268 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:41.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b066d9700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b001545c0 0x7f9b00147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b00151a30 0x7f9b001540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b00151a30 msgr2=0x7f9b001540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b00151a30 0x7f9b001540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b001545c0 msgr2=0x7f9b00147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b001545c0 0x7f9b00147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 -- 172.21.15.148:0/1715244268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00143fc0 con 0x7f9aec0038e0 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b05ed8700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9afc013ce0 tx=0x7f9afc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01e640 con 0x7f9aec0038e0 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc01e7a0 con 0x7f9aec0038e0 2023-10-24T00:29:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b001442a0 con 0x7f9aec0038e0 2023-10-24T00:29:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01eb40 con 0x7f9aec0038e0 2023-10-24T00:29:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.040+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00152930 con 0x7f9aec0038e0 2023-10-24T00:29:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.041+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0006c6b0 con 0x7f9aec0038e0 2023-10-24T00:29:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.041+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9afc003020 con 0x7f9aec0038e0 2023-10-24T00:29:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.042+0000 7f9af5ffb700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 0x7f9ae4061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.042+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9afc07b9f0 con 0x7f9aec0038e0 2023-10-24T00:29:41.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.042+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 0x7f9ae4061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.042+0000 7f9b056d7700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 0x7f9ae4061640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9b000a9c60 tx=0x7f9af0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.046+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9afc04cd20 con 0x7f9aec0038e0 2023-10-24T00:29:41.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.251+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9b00069f30 con 0x7f9aec0038e0 2023-10-24T00:29:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.261+0000 7f9af5ffb700 1 -- 172.21.15.148:0/1715244268 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9afc025070 con 0x7f9aec0038e0 2023-10-24T00:29:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 msgr2=0x7f9ae4061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 0x7f9ae4061640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9b000a9c60 tx=0x7f9af0008040).stop 2023-10-24T00:29:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 msgr2=0x7f9b00152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9afc013ce0 tx=0x7f9afc019000).stop 2023-10-24T00:29:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 shutdown_connections 2023-10-24T00:29:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b001545c0 0x7f9b00147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ae405f180 0x7f9ae4061640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aec0038e0 0x7f9b00152440 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 --2- 172.21.15.148:0/1715244268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b00151a30 0x7f9b001540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 >> 172.21.15.148:0/1715244268 conn(0x7f9b000c3f60 msgr2=0x7f9b00154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 shutdown_connections 2023-10-24T00:29:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.268+0000 7f9b0813c700 1 -- 172.21.15.148:0/1715244268 wait complete. 2023-10-24T00:29:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 5 and data pool 6 2023-10-24T00:29:41.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:41.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.402+0000 7ff82d86f700 1 Processor -- start 2023-10-24T00:29:41.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.402+0000 7ff82d86f700 1 -- start start 2023-10-24T00:29:41.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.402+0000 7ff82d86f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8280c6710 0x7ff8280c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.402+0000 7ff82d86f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8280aa3f0 0x7ff828069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff82d86f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280aa820 con 0x7ff8280aa010 2023-10-24T00:29:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff82d86f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280c0960 con 0x7ff8280c6710 2023-10-24T00:29:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff82d86f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280c0c40 con 0x7ff8280aa3f0 2023-10-24T00:29:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8280c6710 0x7ff8280c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff8280c6710 0x7ff8280c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38594/0 (socket says 172.21.15.148:38594) 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 -- 172.21.15.148:0/4183031300 learned_addr learned my addr 172.21.15.148:0/4183031300 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 -- 172.21.15.148:0/4183031300 >> v2:172.21.15.150:3300/0 conn(0x7ff8280aa3f0 msgr2=0x7ff828069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 --2- 172.21.15.148:0/4183031300 >> v2:172.21.15.150:3300/0 conn(0x7ff8280aa3f0 0x7ff828069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 -- 172.21.15.148:0/4183031300 >> v1:172.21.15.150:6789/0 conn(0x7ff8280aa010 legacy=0x7ff828158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 -- 172.21.15.148:0/4183031300 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280c0f20 con 0x7ff8280c6710 2023-10-24T00:29:41.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff8267fc700 1 --2- 172.21.15.148:0/4183031300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280c6710 0x7ff8280c1a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7ff828158e80 tx=0x7ff81c0090f0).ready entity=mon.0 client_cookie=a130a0f87a702237 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff825ffb700 1 -- 172.21.15.148:0/4183031300 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00b5a0 con 0x7ff8280c6710 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff825ffb700 1 -- 172.21.15.148:0/4183031300 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c00b700 con 0x7ff8280c6710 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.403+0000 7ff825ffb700 1 -- 172.21.15.148:0/4183031300 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00ba80 con 0x7ff8280c6710 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 -- 172.21.15.148:0/4183031300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280c6710 msgr2=0x7ff8280c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 --2- 172.21.15.148:0/4183031300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280c6710 0x7ff8280c1a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7ff828158e80 tx=0x7ff81c0090f0).stop 2023-10-24T00:29:41.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 -- 172.21.15.148:0/4183031300 shutdown_connections 2023-10-24T00:29:41.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 --2- 172.21.15.148:0/4183031300 >> v2:172.21.15.150:3300/0 conn(0x7ff8280aa3f0 0x7ff828069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 --2- 172.21.15.148:0/4183031300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280c6710 0x7ff8280c1a00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 -- 172.21.15.148:0/4183031300 >> 172.21.15.148:0/4183031300 conn(0x7ff8280caf40 msgr2=0x7ff8280cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 -- 172.21.15.148:0/4183031300 shutdown_connections 2023-10-24T00:29:41.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.404+0000 7ff82d86f700 1 -- 172.21.15.148:0/4183031300 wait complete. 2023-10-24T00:29:41.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.405+0000 7ff82d86f700 1 Processor -- start 2023-10-24T00:29:41.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.405+0000 7ff82d86f700 1 -- start start 2023-10-24T00:29:41.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8280aa010 0x7ff828144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8280c6710 0x7ff828069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280af3e0 con 0x7ff8280aa3f0 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280ae7d0 con 0x7ff8280c6710 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280aeab0 con 0x7ff8280aa010 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38604/0 (socket says 172.21.15.148:38604) 2023-10-24T00:29:41.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 -- 172.21.15.148:0/239086103 learned_addr learned my addr 172.21.15.148:0/239086103 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:41.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff826ffd700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8280aa010 0x7ff828144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8277fe700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8280c6710 0x7ff828069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 -- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8280aa010 msgr2=0x7ff828144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8280aa010 0x7ff828144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 -- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8280c6710 msgr2=0x7ff828069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8280c6710 0x7ff828069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 -- 172.21.15.148:0/239086103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c009370 con 0x7ff8280aa3f0 2023-10-24T00:29:41.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff8267fc700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff81c009130 tx=0x7ff81c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00b870 con 0x7ff8280aa3f0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c00b9d0 con 0x7ff8280aa3f0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c01c670 con 0x7ff8280aa3f0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.406+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8280aed90 con 0x7ff8280aa3f0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.407+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff828145060 con 0x7ff8280aa3f0 2023-10-24T00:29:41.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.407+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82806c6b0 con 0x7ff8280aa3f0 2023-10-24T00:29:41.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.408+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff81c01ca20 con 0x7ff8280aa3f0 2023-10-24T00:29:41.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.408+0000 7ff80effd700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 0x7ff814061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.408+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff81c07c040 con 0x7ff8280aa3f0 2023-10-24T00:29:41.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.408+0000 7ff826ffd700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 0x7ff814061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.409+0000 7ff826ffd700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 0x7ff814061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff81800a7a0 tx=0x7ff818008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.412+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff81c04d310 con 0x7ff8280aa3f0 2023-10-24T00:29:41.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.575+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8280af520 con 0x7ff8280aa3f0 2023-10-24T00:29:41.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.576+0000 7ff80effd700 1 -- 172.21.15.148:0/239086103 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7ff81c020070 con 0x7ff8280aa3f0 2023-10-24T00:29:41.578 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:41.579 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:29:41.252267+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:41.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.578+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 msgr2=0x7ff814061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.578+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 0x7ff814061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff81800a7a0 tx=0x7ff818008040).stop 2023-10-24T00:29:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.578+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 msgr2=0x7ff8280adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.578+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff81c009130 tx=0x7ff81c015000).stop 2023-10-24T00:29:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 shutdown_connections 2023-10-24T00:29:41.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8280c6710 0x7ff828069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8280aa010 0x7ff828144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff81405f150 0x7ff814061610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 --2- 172.21.15.148:0/239086103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8280aa3f0 0x7ff8280adef0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 >> 172.21.15.148:0/239086103 conn(0x7ff8280caf40 msgr2=0x7ff8280ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 shutdown_connections 2023-10-24T00:29:41.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.579+0000 7ff82d86f700 1 -- 172.21.15.148:0/239086103 wait complete. 2023-10-24T00:29:41.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:41.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.704+0000 7f1cd0161700 1 Processor -- start 2023-10-24T00:29:41.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.704+0000 7f1cd0161700 1 -- start start 2023-10-24T00:29:41.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cd0161700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc806a490 0x7f1cc80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cd0161700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc80c0960 con 0x7f1cc80aa010 2023-10-24T00:29:41.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cd0161700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc80c0c40 con 0x7f1cc80c6710 2023-10-24T00:29:41.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cd0161700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc80c0f20 con 0x7f1cc806a490 2023-10-24T00:29:41.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cce6fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc806a490 0x7f1cc80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1ccdefd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1cc80aa010 0x7f1cc8158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50884/0 (socket says 172.21.15.148:50884) 2023-10-24T00:29:41.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1ccdefd700 1 -- 172.21.15.148:0/1527016261 learned_addr learned my addr 172.21.15.148:0/1527016261 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:41.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.705+0000 7f1cce6fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cc806a490 0x7f1cc80c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38606/0 (socket says 172.21.15.148:38606) 2023-10-24T00:29:41.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cce6fe700 1 -- 172.21.15.148:0/1527016261 >> v1:172.21.15.150:6789/0 conn(0x7f1cc80c6710 legacy=0x7f1cc8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:41.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cce6fe700 1 -- 172.21.15.148:0/1527016261 >> v1:172.21.15.148:6789/0 conn(0x7f1cc80aa010 legacy=0x7f1cc8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cccefb700 1 -- 172.21.15.148:0/1527016261 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047424314 0 0) 0x7f1cc80c0960 con 0x7f1cc80aa010 2023-10-24T00:29:41.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cce6fe700 1 -- 172.21.15.148:0/1527016261 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80c1200 con 0x7f1cc806a490 2023-10-24T00:29:41.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cce6fe700 1 --2- 172.21.15.148:0/1527016261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc80c1a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f1cc0009760 tx=0x7f1cc0009060).ready entity=mon.0 client_cookie=6c26913f7f7b3209 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cccefb700 1 -- 172.21.15.148:0/1527016261 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000b580 con 0x7f1cc806a490 2023-10-24T00:29:41.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cccefb700 1 -- 172.21.15.148:0/1527016261 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc000b6e0 con 0x7f1cc806a490 2023-10-24T00:29:41.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cccefb700 1 -- 172.21.15.148:0/1527016261 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc000ba60 con 0x7f1cc806a490 2023-10-24T00:29:41.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cd0161700 1 -- 172.21.15.148:0/1527016261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 msgr2=0x7f1cc80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cd0161700 1 --2- 172.21.15.148:0/1527016261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc80c1a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f1cc0009760 tx=0x7f1cc0009060).stop 2023-10-24T00:29:41.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cd0161700 1 -- 172.21.15.148:0/1527016261 shutdown_connections 2023-10-24T00:29:41.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cd0161700 1 --2- 172.21.15.148:0/1527016261 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc80c1a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.706+0000 7f1cd0161700 1 -- 172.21.15.148:0/1527016261 >> 172.21.15.148:0/1527016261 conn(0x7f1cc80caf40 msgr2=0x7f1cc80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.707+0000 7f1cd0161700 1 -- 172.21.15.148:0/1527016261 shutdown_connections 2023-10-24T00:29:41.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.707+0000 7f1cd0161700 1 -- 172.21.15.148:0/1527016261 wait complete. 2023-10-24T00:29:41.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 Processor -- start 2023-10-24T00:29:41.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 -- start start 2023-10-24T00:29:41.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80aa010 0x7f1cc8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80c6710 0x7f1cc80c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80c2c90 con 0x7f1cc806a490 2023-10-24T00:29:41.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80c3120 con 0x7f1cc80c6710 2023-10-24T00:29:41.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.708+0000 7f1cd0161700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80c2080 con 0x7f1cc80aa010 2023-10-24T00:29:41.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38618/0 (socket says 172.21.15.148:38618) 2023-10-24T00:29:41.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 -- 172.21.15.148:0/2138872998 learned_addr learned my addr 172.21.15.148:0/2138872998 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:41.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 -- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80aa010 msgr2=0x7f1cc8152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80aa010 0x7f1cc8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 -- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80c6710 msgr2=0x7f1cc80c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80c6710 0x7f1cc80c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 -- 172.21.15.148:0/2138872998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00092a0 con 0x7f1cc806a490 2023-10-24T00:29:41.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1ccdefd700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1cc400c810 tx=0x7f1cc4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4005d30 con 0x7f1cc806a490 2023-10-24T00:29:41.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4005e90 con 0x7f1cc806a490 2023-10-24T00:29:41.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80c2360 con 0x7f1cc806a490 2023-10-24T00:29:41.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4007340 con 0x7f1cc806a490 2023-10-24T00:29:41.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.709+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc80c2920 con 0x7f1cc806a490 2023-10-24T00:29:41.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.710+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc806c6b0 con 0x7f1cc806a490 2023-10-24T00:29:41.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.710+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1cc4007770 con 0x7f1cc806a490 2023-10-24T00:29:41.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.711+0000 7f1cbdffb700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 0x7f1cac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:41.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.711+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1cc407a2b0 con 0x7f1cc806a490 2023-10-24T00:29:41.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.711+0000 7f1ccd6fc700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 0x7f1cac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:41.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.711+0000 7f1ccd6fc700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 0x7f1cac061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1cc80b1110 tx=0x7f1cb80079c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:41.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.715+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1cc404b580 con 0x7f1cc806a490 2023-10-24T00:29:41.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.877+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc80c14e0 con 0x7f1cc806a490 2023-10-24T00:29:41.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.878+0000 7f1cbdffb700 1 -- 172.21.15.148:0/2138872998 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f1cc404eba0 con 0x7f1cc806a490 2023-10-24T00:29:41.880 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:41.880 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:29:41.252267+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:41.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 msgr2=0x7f1cac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 0x7f1cac061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1cc80b1110 tx=0x7f1cb80079c0).stop 2023-10-24T00:29:41.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 msgr2=0x7f1cc8152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:41.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1cc400c810 tx=0x7f1cc4007f90).stop 2023-10-24T00:29:41.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 shutdown_connections 2023-10-24T00:29:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cc80c6710 0x7f1cc80c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1cac05f150 0x7f1cac061610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cc806a490 0x7f1cc8152270 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 --2- 172.21.15.148:0/2138872998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cc80aa010 0x7f1cc8152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 >> 172.21.15.148:0/2138872998 conn(0x7f1cc80caf40 msgr2=0x7f1cc8157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 shutdown_connections 2023-10-24T00:29:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:41.880+0000 7f1cd0161700 1 -- 172.21.15.148:0/2138872998 wait complete. 2023-10-24T00:29:41.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:29:42.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.009+0000 7f24e52f7700 1 Processor -- start 2023-10-24T00:29:42.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.009+0000 7f24e52f7700 1 -- start start 2023-10-24T00:29:42.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24e52f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f24e0154430 0x7f24e0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24e52f7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24e00bffd0 0x7f24e00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24e52f7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e00c71d0 con 0x7f24e0098bd0 2023-10-24T00:29:42.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24e52f7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e00c6a10 con 0x7f24e00bffd0 2023-10-24T00:29:42.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24e52f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e00c9410 con 0x7f24e0154430 2023-10-24T00:29:42.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24df7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24e00bffd0 0x7f24e00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24d67fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f24e0098bd0 0x7f24e00c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50894/0 (socket says 172.21.15.148:50894) 2023-10-24T00:29:42.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24d67fc700 1 -- 172.21.15.148:0/2825906795 learned_addr learned my addr 172.21.15.148:0/2825906795 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:42.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24deffd700 1 --2- 172.21.15.148:0/2825906795 >> v2:172.21.15.150:3300/0 conn(0x7f24e0154430 0x7f24e0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24df7fe700 1 -- 172.21.15.148:0/2825906795 >> v2:172.21.15.150:3300/0 conn(0x7f24e0154430 msgr2=0x7f24e0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:42.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24df7fe700 1 --2- 172.21.15.148:0/2825906795 >> v2:172.21.15.150:3300/0 conn(0x7f24e0154430 0x7f24e0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24df7fe700 1 -- 172.21.15.148:0/2825906795 >> v1:172.21.15.148:6789/0 conn(0x7f24e0098bd0 legacy=0x7f24e00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.010+0000 7f24df7fe700 1 -- 172.21.15.148:0/2825906795 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00c0950 con 0x7f24e00bffd0 2023-10-24T00:29:42.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24df7fe700 1 --2- 172.21.15.148:0/2825906795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e00bffd0 0x7f24e00c0460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f24e005ff70 tx=0x7f24d8009780).ready entity=mon.0 client_cookie=4548dd4dd04fee91 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24de7fc700 1 -- 172.21.15.148:0/2825906795 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800e070 con 0x7f24e00bffd0 2023-10-24T00:29:42.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24de7fc700 1 -- 172.21.15.148:0/2825906795 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800bb30 con 0x7f24e00bffd0 2023-10-24T00:29:42.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24de7fc700 1 -- 172.21.15.148:0/2825906795 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800beb0 con 0x7f24e00bffd0 2023-10-24T00:29:42.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 -- 172.21.15.148:0/2825906795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e00bffd0 msgr2=0x7f24e00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 --2- 172.21.15.148:0/2825906795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e00bffd0 0x7f24e00c0460 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f24e005ff70 tx=0x7f24d8009780).stop 2023-10-24T00:29:42.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 -- 172.21.15.148:0/2825906795 shutdown_connections 2023-10-24T00:29:42.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 --2- 172.21.15.148:0/2825906795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e00bffd0 0x7f24e00c0460 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 --2- 172.21.15.148:0/2825906795 >> v2:172.21.15.150:3300/0 conn(0x7f24e0154430 0x7f24e0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 -- 172.21.15.148:0/2825906795 >> 172.21.15.148:0/2825906795 conn(0x7f24e00cb070 msgr2=0x7f24e00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:42.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 -- 172.21.15.148:0/2825906795 shutdown_connections 2023-10-24T00:29:42.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.011+0000 7f24e52f7700 1 -- 172.21.15.148:0/2825906795 wait complete. 2023-10-24T00:29:42.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.012+0000 7f24e52f7700 1 Processor -- start 2023-10-24T00:29:42.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.012+0000 7f24e52f7700 1 -- start start 2023-10-24T00:29:42.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 0x7f24e00c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 0x7f24e00ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00c4000 con 0x7f24e0098bd0 2023-10-24T00:29:42.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00c48a0 con 0x7f24e0154430 2023-10-24T00:29:42.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24e52f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00ac150 con 0x7f24e00bffd0 2023-10-24T00:29:42.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38626/0 (socket says 172.21.15.148:38626) 2023-10-24T00:29:42.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.013+0000 7f24deffd700 1 -- 172.21.15.148:0/1611974687 learned_addr learned my addr 172.21.15.148:0/1611974687 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:42.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24df7fe700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 0x7f24e00ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24d67fc700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 0x7f24e00c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 -- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 msgr2=0x7f24e00c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 0x7f24e00c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 -- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 msgr2=0x7f24e00ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 0x7f24e00ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 -- 172.21.15.148:0/1611974687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009a20 con 0x7f24e0098bd0 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24d67fc700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 0x7f24e00c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24df7fe700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 0x7f24e00ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24deffd700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f24d000d890 tx=0x7f24d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d00125f0 con 0x7f24e0098bd0 2023-10-24T00:29:42.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0012750 con 0x7f24e0098bd0 2023-10-24T00:29:42.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e00c4250 con 0x7f24e0098bd0 2023-10-24T00:29:42.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0012ad0 con 0x7f24e0098bd0 2023-10-24T00:29:42.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.014+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e0149700 con 0x7f24e0098bd0 2023-10-24T00:29:42.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.015+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e00c4b80 con 0x7f24e0098bd0 2023-10-24T00:29:42.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.015+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f24d0013480 con 0x7f24e0098bd0 2023-10-24T00:29:42.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.015+0000 7f24d77fe700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 0x7f24c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.016+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f24d007a320 con 0x7f24e0098bd0 2023-10-24T00:29:42.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.016+0000 7f24d67fc700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 0x7f24c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.016+0000 7f24d67fc700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 0x7f24c0061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f24c8005750 tx=0x7f24c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.019+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f24d004b590 con 0x7f24e0098bd0 2023-10-24T00:29:42.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.224+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f24e006c6b0 con 0x7f24e0098bd0 2023-10-24T00:29:42.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.258+0000 7f24d77fe700 1 -- 172.21.15.148:0/1611974687 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f24d004ebb0 con 0x7f24e0098bd0 2023-10-24T00:29:42.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 msgr2=0x7f24c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 0x7f24c0061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f24c8005750 tx=0x7f24c8009040).stop 2023-10-24T00:29:42.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 msgr2=0x7f24e0149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f24d000d890 tx=0x7f24d0008040).stop 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 shutdown_connections 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24e0154430 0x7f24e00ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24c005f150 0x7f24c0061610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24e0098bd0 0x7f24e0149210 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 --2- 172.21.15.148:0/1611974687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24e00bffd0 0x7f24e00c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 >> 172.21.15.148:0/1611974687 conn(0x7f24e00cb070 msgr2=0x7f24e0063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:42.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 shutdown_connections 2023-10-24T00:29:42.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.260+0000 7f24e52f7700 1 -- 172.21.15.148:0/1611974687 wait complete. 2023-10-24T00:29:42.275 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:29:42.276 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:29:42.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.390+0000 7fd656de8700 1 Processor -- start 2023-10-24T00:29:42.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.390+0000 7fd656de8700 1 -- start start 2023-10-24T00:29:42.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd656de8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd650098bd0 0x7fd650154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd656de8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6500bffd0 0x7fd6500c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd656de8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500c71d0 con 0x7fd650154430 2023-10-24T00:29:42.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd656de8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500c6a10 con 0x7fd650098bd0 2023-10-24T00:29:42.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd656de8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500c9410 con 0x7fd6500bffd0 2023-10-24T00:29:42.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd650098bd0 0x7fd650154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd650098bd0 0x7fd650154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38634/0 (socket says 172.21.15.148:38634) 2023-10-24T00:29:42.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 -- 172.21.15.148:0/2659787096 learned_addr learned my addr 172.21.15.148:0/2659787096 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:42.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd655385700 1 --2- 172.21.15.148:0/2659787096 >> v2:172.21.15.150:3300/0 conn(0x7fd6500bffd0 0x7fd6500c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 -- 172.21.15.148:0/2659787096 >> v2:172.21.15.150:3300/0 conn(0x7fd6500bffd0 msgr2=0x7fd6500c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 --2- 172.21.15.148:0/2659787096 >> v2:172.21.15.150:3300/0 conn(0x7fd6500bffd0 0x7fd6500c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 -- 172.21.15.148:0/2659787096 >> v1:172.21.15.150:6789/0 conn(0x7fd650154430 legacy=0x7fd6500c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.391+0000 7fd647fff700 1 -- 172.21.15.148:0/2659787096 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500c0950 con 0x7fd650098bd0 2023-10-24T00:29:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd647fff700 1 --2- 172.21.15.148:0/2659787096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd650098bd0 0x7fd650154810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fd6500aab20 tx=0x7fd6400090f0).ready entity=mon.0 client_cookie=d27b68bf7e49ae3f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd6477fe700 1 -- 172.21.15.148:0/2659787096 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000b5a0 con 0x7fd650098bd0 2023-10-24T00:29:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd6477fe700 1 -- 172.21.15.148:0/2659787096 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64000b700 con 0x7fd650098bd0 2023-10-24T00:29:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd6477fe700 1 -- 172.21.15.148:0/2659787096 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000ba80 con 0x7fd650098bd0 2023-10-24T00:29:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 -- 172.21.15.148:0/2659787096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd650098bd0 msgr2=0x7fd650154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 --2- 172.21.15.148:0/2659787096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd650098bd0 0x7fd650154810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fd6500aab20 tx=0x7fd6400090f0).stop 2023-10-24T00:29:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 -- 172.21.15.148:0/2659787096 shutdown_connections 2023-10-24T00:29:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 --2- 172.21.15.148:0/2659787096 >> v2:172.21.15.150:3300/0 conn(0x7fd6500bffd0 0x7fd6500c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 --2- 172.21.15.148:0/2659787096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd650098bd0 0x7fd650154810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 -- 172.21.15.148:0/2659787096 >> 172.21.15.148:0/2659787096 conn(0x7fd6500cb070 msgr2=0x7fd6500cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 -- 172.21.15.148:0/2659787096 shutdown_connections 2023-10-24T00:29:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.392+0000 7fd656de8700 1 -- 172.21.15.148:0/2659787096 wait complete. 2023-10-24T00:29:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.393+0000 7fd656de8700 1 Processor -- start 2023-10-24T00:29:42.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 -- start start 2023-10-24T00:29:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 0x7fd6500c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 0x7fd65014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500aab50 con 0x7fd6500bffd0 2023-10-24T00:29:42.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c4be0 con 0x7fd650154430 2023-10-24T00:29:42.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd656de8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500c4ec0 con 0x7fd650098bd0 2023-10-24T00:29:42.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd647fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd647fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38640/0 (socket says 172.21.15.148:38640) 2023-10-24T00:29:42.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.394+0000 7fd647fff700 1 -- 172.21.15.148:0/2955916350 learned_addr learned my addr 172.21.15.148:0/2955916350 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd655385700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 0x7fd65014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd654b84700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 0x7fd6500c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 -- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 msgr2=0x7fd6500c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 0x7fd6500c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 -- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 msgr2=0x7fd65014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:42.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 0x7fd65014eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 -- 172.21.15.148:0/2955916350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009370 con 0x7fd6500bffd0 2023-10-24T00:29:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd655385700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 0x7fd65014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd654b84700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 0x7fd6500c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd647fff700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fd640009130 tx=0x7fd640015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000b870 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64000b9d0 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6500c51a0 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64001c670 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.395+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6500afea0 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.396+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65006c6b0 con 0x7fd6500bffd0 2023-10-24T00:29:42.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.396+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd64001c9e0 con 0x7fd6500bffd0 2023-10-24T00:29:42.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.397+0000 7fd644ff9700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 0x7fd63c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:42.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.397+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd64007bed0 con 0x7fd6500bffd0 2023-10-24T00:29:42.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.397+0000 7fd654b84700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 0x7fd63c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:42.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.397+0000 7fd654b84700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 0x7fd63c061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd64c007b00 tx=0x7fd64c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:42.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.401+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd64004d1a0 con 0x7fd6500bffd0 2023-10-24T00:29:42.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:42.606+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd650062c40 con 0x7fd6500bffd0 2023-10-24T00:29:43.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.274+0000 7fd644ff9700 1 -- 172.21.15.148:0/2955916350 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd640020020 con 0x7fd6500bffd0 2023-10-24T00:29:43.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 msgr2=0x7fd63c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 0x7fd63c061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd64c007b00 tx=0x7fd64c008040).stop 2023-10-24T00:29:43.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 msgr2=0x7fd6500af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fd640009130 tx=0x7fd640015000).stop 2023-10-24T00:29:43.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 shutdown_connections 2023-10-24T00:29:43.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd650154430 0x7fd65014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd650098bd0 0x7fd6500c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd63c05f150 0x7fd63c061610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 --2- 172.21.15.148:0/2955916350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6500bffd0 0x7fd6500af9b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 >> 172.21.15.148:0/2955916350 conn(0x7fd6500cb070 msgr2=0x7fd65014fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:43.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 shutdown_connections 2023-10-24T00:29:43.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.277+0000 7fd656de8700 1 -- 172.21.15.148:0/2955916350 wait complete. 2023-10-24T00:29:43.291 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:29:43.292 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:43.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.406+0000 7fbb8e334700 1 Processor -- start 2023-10-24T00:29:43.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.406+0000 7fbb8e334700 1 -- start start 2023-10-24T00:29:43.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8e334700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb880ca450 0x7fbb880ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8e334700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880c93b0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8e334700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880c9690 con 0x7fbb880c8e80 2023-10-24T00:29:43.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8e334700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880cadb0 con 0x7fbb880ca450 2023-10-24T00:29:43.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8c8d1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb880ca450 0x7fbb880ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8c8d1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbb880ca450 0x7fbb880ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46018/0 (socket says 172.21.15.148:46018) 2023-10-24T00:29:43.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8c8d1700 1 -- 172.21.15.148:0/1652070126 learned_addr learned my addr 172.21.15.148:0/1652070126 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:43.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb87fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbb880aa5a0 0x7fbb881552b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53484/0 (socket says 172.21.15.148:53484) 2023-10-24T00:29:43.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8c8d1700 1 -- 172.21.15.148:0/1652070126 >> v1:172.21.15.150:6789/0 conn(0x7fbb880c8e80 legacy=0x7fbb88155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:43.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.407+0000 7fbb8c8d1700 1 -- 172.21.15.148:0/1652070126 >> v1:172.21.15.148:6789/0 conn(0x7fbb880aa5a0 legacy=0x7fbb881552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb86ffd700 1 -- 172.21.15.148:0/1652070126 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774289119 0 0) 0x7fbb880c93b0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8c8d1700 1 -- 172.21.15.148:0/1652070126 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880c9970 con 0x7fbb880ca450 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8c8d1700 1 --2- 172.21.15.148:0/1652070126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880ca450 0x7fbb880ca8c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fbb80009f20 tx=0x7fbb80009840).ready entity=mon.0 client_cookie=aba6027d9145ae09 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb86ffd700 1 -- 172.21.15.148:0/1652070126 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000e070 con 0x7fbb880ca450 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb86ffd700 1 -- 172.21.15.148:0/1652070126 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000ba40 con 0x7fbb880ca450 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb86ffd700 1 -- 172.21.15.148:0/1652070126 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000bdc0 con 0x7fbb880ca450 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 -- 172.21.15.148:0/1652070126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880ca450 msgr2=0x7fbb880ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 --2- 172.21.15.148:0/1652070126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880ca450 0x7fbb880ca8c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fbb80009f20 tx=0x7fbb80009840).stop 2023-10-24T00:29:43.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 -- 172.21.15.148:0/1652070126 shutdown_connections 2023-10-24T00:29:43.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 --2- 172.21.15.148:0/1652070126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880ca450 0x7fbb880ca8c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 -- 172.21.15.148:0/1652070126 >> 172.21.15.148:0/1652070126 conn(0x7fbb88084ce0 msgr2=0x7fbb88094600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:43.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 -- 172.21.15.148:0/1652070126 shutdown_connections 2023-10-24T00:29:43.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.408+0000 7fbb8e334700 1 -- 172.21.15.148:0/1652070126 wait complete. 2023-10-24T00:29:43.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.409+0000 7fbb8e334700 1 Processor -- start 2023-10-24T00:29:43.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 -- start start 2023-10-24T00:29:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb880c8e80 0x7fbb880c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb880ca450 0x7fbb880c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880c34f0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880c37d0 con 0x7fbb880c8e80 2023-10-24T00:29:43.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb8e334700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880c3ab0 con 0x7fbb880ca450 2023-10-24T00:29:43.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.410+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46020/0 (socket says 172.21.15.148:46020) 2023-10-24T00:29:43.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 -- 172.21.15.148:0/2719883895 learned_addr learned my addr 172.21.15.148:0/2719883895 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb877fe700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb880c8e80 0x7fbb880c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb8c8d1700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb880ca450 0x7fbb880c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 -- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb880ca450 msgr2=0x7fbb880c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb880ca450 0x7fbb880c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 -- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb880c8e80 msgr2=0x7fbb880c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb880c8e80 0x7fbb880c29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 -- 172.21.15.148:0/2719883895 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009ae0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb87fff700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbb7800c560 tx=0x7fbb78007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780072e0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78007440 con 0x7fbb880aa5a0 2023-10-24T00:29:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb880c3d90 con 0x7fbb880aa5a0 2023-10-24T00:29:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780058f0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.411+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb880ad960 con 0x7fbb880aa5a0 2023-10-24T00:29:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.412+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8806c6b0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.412+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbb78005ce0 con 0x7fbb880aa5a0 2023-10-24T00:29:43.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.413+0000 7fbb6ffff700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 0x7fbb74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.413+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb78079b50 con 0x7fbb880aa5a0 2023-10-24T00:29:43.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.413+0000 7fbb877fe700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 0x7fbb74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.413+0000 7fbb877fe700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 0x7fbb74061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fbb880c92e0 tx=0x7fbb7c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.417+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbb7804ae20 con 0x7fbb880aa5a0 2023-10-24T00:29:43.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.620+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb880c8710 con 0x7fbb880aa5a0 2023-10-24T00:29:43.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.621+0000 7fbb6ffff700 1 -- 172.21.15.148:0/2719883895 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fbb78018030 con 0x7fbb880aa5a0 2023-10-24T00:29:43.623 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:43.623 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:29:43.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 msgr2=0x7fbb74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 0x7fbb74061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fbb880c92e0 tx=0x7fbb7c008040).stop 2023-10-24T00:29:43.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 msgr2=0x7fbb88153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fbb7800c560 tx=0x7fbb78007c90).stop 2023-10-24T00:29:43.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 shutdown_connections 2023-10-24T00:29:43.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb880ca450 0x7fbb880c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbb7405f150 0x7fbb74061610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb880aa5a0 0x7fbb88153060 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 --2- 172.21.15.148:0/2719883895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb880c8e80 0x7fbb880c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 >> 172.21.15.148:0/2719883895 conn(0x7fbb88084ce0 msgr2=0x7fbb880c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:43.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 shutdown_connections 2023-10-24T00:29:43.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.623+0000 7fbb8e334700 1 -- 172.21.15.148:0/2719883895 wait complete. 2023-10-24T00:29:43.627 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:29:43.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:29:43.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.748+0000 7f3a26e16700 1 Processor -- start 2023-10-24T00:29:43.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.748+0000 7f3a26e16700 1 -- start start 2023-10-24T00:29:43.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a26e16700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3a200c8470 0x7f3a200c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a26e16700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a20155550 con 0x7f3a20152170 2023-10-24T00:29:43.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a26e16700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a200a7480 con 0x7f3a20151d90 2023-10-24T00:29:43.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a26e16700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a20154960 con 0x7f3a200c8470 2023-10-24T00:29:43.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a253b3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3a20152170 0x7f3a20157f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53498/0 (socket says 172.21.15.148:53498) 2023-10-24T00:29:43.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a253b3700 1 -- 172.21.15.148:0/4266284654 learned_addr learned my addr 172.21.15.148:0/4266284654 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:43.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.749+0000 7f3a17fff700 1 --2- 172.21.15.148:0/4266284654 >> v2:172.21.15.150:3300/0 conn(0x7f3a200c8470 0x7f3a200c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191225768 0 0) 0x7f3a20155550 con 0x7f3a20152170 2023-10-24T00:29:43.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a080033f0 con 0x7f3a20152170 2023-10-24T00:29:43.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456028758 0 0) 0x7f3a080033f0 con 0x7f3a20152170 2023-10-24T00:29:43.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 >> v2:172.21.15.150:3300/0 conn(0x7f3a200c8470 msgr2=0x7f3a200c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:43.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 --2- 172.21.15.148:0/4266284654 >> v2:172.21.15.150:3300/0 conn(0x7f3a200c8470 0x7f3a200c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 >> v1:172.21.15.150:6789/0 conn(0x7f3a20151d90 legacy=0x7f3a200a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20154c20 con 0x7f3a20152170 2023-10-24T00:29:43.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f3a180017f0 con 0x7f3a20152170 2023-10-24T00:29:43.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 >> v1:172.21.15.148:6789/0 conn(0x7f3a20152170 legacy=0x7f3a20157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a080038e0 0x7f3a08003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08004690 0x7f3a08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 0x7f3a0800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20154960 con 0x7f3a08005000 2023-10-24T00:29:43.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0800beb0 con 0x7f3a08004690 2023-10-24T00:29:43.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0800c070 con 0x7f3a080038e0 2023-10-24T00:29:43.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 0x7f3a0800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a24bb2700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a080038e0 0x7f3a08003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a17fff700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08004690 0x7f3a08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 -- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a080038e0 msgr2=0x7f3a08003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:43.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a080038e0 0x7f3a08003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 -- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08004690 msgr2=0x7f3a08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:43.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08004690 0x7f3a08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 -- 172.21.15.148:0/4266284654 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080033f0 con 0x7f3a08005000 2023-10-24T00:29:43.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.750+0000 7f3a253b3700 1 -- 172.21.15.148:0/4266284654 reap_dead start 2023-10-24T00:29:43.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a253b3700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 0x7f3a0800b8e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3a1800c5f0 tx=0x7f3a201554c0).ready entity=mon.0 client_cookie=524dea9ba994be78 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800cdf0 con 0x7f3a08005000 2023-10-24T00:29:43.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18005b20 con 0x7f3a08005000 2023-10-24T00:29:43.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a177fe700 1 -- 172.21.15.148:0/4266284654 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18005ea0 con 0x7f3a08005000 2023-10-24T00:29:43.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 -- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 msgr2=0x7f3a0800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 0x7f3a0800b8e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3a1800c5f0 tx=0x7f3a201554c0).stop 2023-10-24T00:29:43.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 -- 172.21.15.148:0/4266284654 shutdown_connections 2023-10-24T00:29:43.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 --2- 172.21.15.148:0/4266284654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a08005000 0x7f3a0800b8e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 -- 172.21.15.148:0/4266284654 >> 172.21.15.148:0/4266284654 conn(0x7f3a200641b0 msgr2=0x7f3a200c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:43.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 -- 172.21.15.148:0/4266284654 shutdown_connections 2023-10-24T00:29:43.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.751+0000 7f3a26e16700 1 -- 172.21.15.148:0/4266284654 wait complete. 2023-10-24T00:29:43.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.752+0000 7f3a26e16700 1 Processor -- start 2023-10-24T00:29:43.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 -- start start 2023-10-24T00:29:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 0x7f3a200be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2014b330 0x7f3a200be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20157850 con 0x7f3a20069ab0 2023-10-24T00:29:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2006a420 con 0x7f3a08005000 2023-10-24T00:29:43.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a26e16700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20156c40 con 0x7f3a2014b330 2023-10-24T00:29:43.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a253b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a253b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46032/0 (socket says 172.21.15.148:46032) 2023-10-24T00:29:43.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.753+0000 7f3a253b3700 1 -- 172.21.15.148:0/3438629042 learned_addr learned my addr 172.21.15.148:0/3438629042 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:43.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a17fff700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2014b330 0x7f3a200be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a24bb2700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 0x7f3a200be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 -- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2014b330 msgr2=0x7f3a200be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2014b330 0x7f3a200be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 -- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 msgr2=0x7f3a200be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 0x7f3a200be1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 -- 172.21.15.148:0/3438629042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20156f20 con 0x7f3a20069ab0 2023-10-24T00:29:43.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a24bb2700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 0x7f3a200be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:43.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a253b3700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f3a18006000 tx=0x7f3a18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180017f0 con 0x7f3a20069ab0 2023-10-24T00:29:43.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18020480 con 0x7f3a20069ab0 2023-10-24T00:29:43.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a20157200 con 0x7f3a20069ab0 2023-10-24T00:29:43.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18005ea0 con 0x7f3a20069ab0 2023-10-24T00:29:43.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.754+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a200aac30 con 0x7f3a20069ab0 2023-10-24T00:29:43.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.755+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2006c6b0 con 0x7f3a20069ab0 2023-10-24T00:29:43.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.755+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3a18020af0 con 0x7f3a20069ab0 2023-10-24T00:29:43.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.756+0000 7f3a14ff9700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 0x7f3a0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:43.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.756+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a1807b0b0 con 0x7f3a20069ab0 2023-10-24T00:29:43.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.756+0000 7f3a24bb2700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 0x7f3a0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:43.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.756+0000 7f3a24bb2700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 0x7f3a0c061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3a1c007a40 tx=0x7f3a1c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:43.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.760+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3a1804c420 con 0x7f3a20069ab0 2023-10-24T00:29:43.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.922+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a20067100 con 0x7f3a20069ab0 2023-10-24T00:29:43.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.923+0000 7f3a14ff9700 1 -- 172.21.15.148:0/3438629042 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f3a1804fa40 con 0x7f3a20069ab0 2023-10-24T00:29:43.924 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:43.925 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":34,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:29:42.254244+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:29:43.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 msgr2=0x7f3a0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 0x7f3a0c061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3a1c007a40 tx=0x7f3a1c009040).stop 2023-10-24T00:29:43.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 msgr2=0x7f3a20069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:43.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f3a18006000 tx=0x7f3a18015000).stop 2023-10-24T00:29:43.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 shutdown_connections 2023-10-24T00:29:43.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3a0c05f150 0x7f3a0c061610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3a20069ab0 0x7f3a20069f30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a08005000 0x7f3a200be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 --2- 172.21.15.148:0/3438629042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2014b330 0x7f3a200be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 >> 172.21.15.148:0/3438629042 conn(0x7f3a200641b0 msgr2=0x7f3a20065760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 shutdown_connections 2023-10-24T00:29:43.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:43.925+0000 7f3a26e16700 1 -- 172.21.15.148:0/3438629042 wait complete. 2023-10-24T00:29:43.940 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:29:43.941 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:44.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.054+0000 7f82cdb7d700 1 Processor -- start 2023-10-24T00:29:44.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.054+0000 7f82cdb7d700 1 -- start start 2023-10-24T00:29:44.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82cdb7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82c80aa010 0x7f82c80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82cdb7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 0x7f82c80aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82cdb7d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80c0960 con 0x7f82c8158770 2023-10-24T00:29:44.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82cdb7d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80aa8e0 con 0x7f82c80aa010 2023-10-24T00:29:44.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82cdb7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80c0c40 con 0x7f82c80c6710 2023-10-24T00:29:44.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82c77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82c80aa010 0x7f82c80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82c77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82c80aa010 0x7f82c80c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46048/0 (socket says 172.21.15.148:46048) 2023-10-24T00:29:44.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.055+0000 7f82c77fe700 1 -- 172.21.15.148:0/1732418999 learned_addr learned my addr 172.21.15.148:0/1732418999 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:44.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c6ffd700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 0x7f82c80aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c77fe700 1 -- 172.21.15.148:0/1732418999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 msgr2=0x7f82c80aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c77fe700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 0x7f82c80aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c77fe700 1 -- 172.21.15.148:0/1732418999 >> v1:172.21.15.150:6789/0 conn(0x7f82c8158770 legacy=0x7f82c8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c77fe700 1 -- 172.21.15.148:0/1732418999 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80c0f20 con 0x7f82c80aa010 2023-10-24T00:29:44.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c6ffd700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 0x7f82c80aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:44.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c77fe700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80aa010 0x7f82c80c1a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f82b8006fd0 tx=0x7f82b80090f0).ready entity=mon.0 client_cookie=e6a1579b3a7b6282 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c67fc700 1 -- 172.21.15.148:0/1732418999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800b600 con 0x7f82c80aa010 2023-10-24T00:29:44.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c67fc700 1 -- 172.21.15.148:0/1732418999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800b760 con 0x7f82c80aa010 2023-10-24T00:29:44.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82c67fc700 1 -- 172.21.15.148:0/1732418999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b800bae0 con 0x7f82c80aa010 2023-10-24T00:29:44.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 -- 172.21.15.148:0/1732418999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80aa010 msgr2=0x7f82c80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80aa010 0x7f82c80c1a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f82b8006fd0 tx=0x7f82b80090f0).stop 2023-10-24T00:29:44.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 -- 172.21.15.148:0/1732418999 shutdown_connections 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80aa010 0x7f82c80c1a00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/1732418999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80c6710 0x7f82c80aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 -- 172.21.15.148:0/1732418999 >> 172.21.15.148:0/1732418999 conn(0x7f82c80caf40 msgr2=0x7f82c80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 -- 172.21.15.148:0/1732418999 shutdown_connections 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.056+0000 7f82cdb7d700 1 -- 172.21.15.148:0/1732418999 wait complete. 2023-10-24T00:29:44.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 Processor -- start 2023-10-24T00:29:44.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 -- start start 2023-10-24T00:29:44.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80aa010 0x7f82c80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c8158770 0x7f82c8156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80aded0 con 0x7f82c80c6710 2023-10-24T00:29:44.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80ae1b0 con 0x7f82c8158770 2023-10-24T00:29:44.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.058+0000 7f82cdb7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8155750 con 0x7f82c80aa010 2023-10-24T00:29:44.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46058/0 (socket says 172.21.15.148:46058) 2023-10-24T00:29:44.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 -- 172.21.15.148:0/3943961081 learned_addr learned my addr 172.21.15.148:0/3943961081 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:44.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c77fe700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80aa010 0x7f82c80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c7fff700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c8158770 0x7f82c8156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 -- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80aa010 msgr2=0x7f82c80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80aa010 0x7f82c80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 -- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c8158770 msgr2=0x7f82c8156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c8158770 0x7f82c8156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 -- 172.21.15.148:0/3943961081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009370 con 0x7f82c80c6710 2023-10-24T00:29:44.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82c6ffd700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f82bc00c8b0 tx=0x7f82bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc010580 con 0x7f82c80c6710 2023-10-24T00:29:44.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc0106e0 con 0x7f82c80c6710 2023-10-24T00:29:44.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8155a30 con 0x7f82c80c6710 2023-10-24T00:29:44.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc010a60 con 0x7f82c80c6710 2023-10-24T00:29:44.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.059+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80b0690 con 0x7f82c80c6710 2023-10-24T00:29:44.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.060+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c806c6b0 con 0x7f82c80c6710 2023-10-24T00:29:44.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.060+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f82bc01b460 con 0x7f82c80c6710 2023-10-24T00:29:44.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.061+0000 7f82af7fe700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 0x7f82b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.061+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f82bc07a110 con 0x7f82c80c6710 2023-10-24T00:29:44.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.061+0000 7f82c77fe700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 0x7f82b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.061+0000 7f82c77fe700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 0x7f82b4061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f82b8009130 tx=0x7f82b8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.065+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f82bc04b380 con 0x7f82c80c6710 2023-10-24T00:29:44.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.224+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82c80c1200 con 0x7f82b405f150 2023-10-24T00:29:44.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.234+0000 7f82af7fe700 1 -- 172.21.15.148:0/3943961081 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+331577 (secure 0 0 0) 0x7f82c80c1200 con 0x7f82b405f150 2023-10-24T00:29:44.240 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:44.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 msgr2=0x7f82b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 0x7f82b4061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f82b8009130 tx=0x7f82b8017000).stop 2023-10-24T00:29:44.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 msgr2=0x7f82c8152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f82bc00c8b0 tx=0x7f82bc008040).stop 2023-10-24T00:29:44.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 shutdown_connections 2023-10-24T00:29:44.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82c8158770 0x7f82c8156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82c80aa010 0x7f82c80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82b405f150 0x7f82b4061610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 --2- 172.21.15.148:0/3943961081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82c80c6710 0x7f82c8152040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 >> 172.21.15.148:0/3943961081 conn(0x7f82c80caf40 msgr2=0x7f82c80c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 shutdown_connections 2023-10-24T00:29:44.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.237+0000 7f82cdb7d700 1 -- 172.21.15.148:0/3943961081 wait complete. 2023-10-24T00:29:44.245 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:44.250 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-24T00:29:42.780340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":200,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379520,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595200,"statfs":{"total":773094113280,"available":770657484800,"internally_reserved":0,"allocated":2818048,"data_stored":1133418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.586051"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282508+0000","last_change":"2023-10-24T00:29:41.282508+0000","last_active":"2023-10-24T00:29:41.282508+0000","last_peered":"2023-10-24T00:29:41.282508+0000","last_clean":"2023-10-24T00:29:41.282508+0000","last_became_active":"2023-10-24T00:29:41.282208+0000","last_became_peered":"2023-10-24T00:29:41.282208+0000","last_unstale":"2023-10-24T00:29:41.282508+0000","last_undegraded":"2023-10-24T00:29:41.282508+0000","last_fullsized":"2023-10-24T00:29:41.282508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890350+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885444+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913085+0000","last_change":"2023-10-24T00:29:40.911353+0000","last_active":"2023-10-24T00:29:40.913085+0000","last_peered":"2023-10-24T00:29:40.913085+0000","last_clean":"2023-10-24T00:29:40.913085+0000","last_became_active":"2023-10-24T00:29:40.911057+0000","last_became_peered":"2023-10-24T00:29:40.911057+0000","last_unstale":"2023-10-24T00:29:40.913085+0000","last_undegraded":"2023-10-24T00:29:40.913085+0000","last_fullsized":"2023-10-24T00:29:40.913085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.883087+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260670+0000","last_change":"2023-10-24T00:29:40.896011+0000","last_active":"2023-10-24T00:29:41.260670+0000","last_peered":"2023-10-24T00:29:41.260670+0000","last_clean":"2023-10-24T00:29:41.260670+0000","last_became_active":"2023-10-24T00:29:40.895711+0000","last_became_peered":"2023-10-24T00:29:40.895711+0000","last_unstale":"2023-10-24T00:29:41.260670+0000","last_undegraded":"2023-10-24T00:29:41.260670+0000","last_fullsized":"2023-10-24T00:29:41.260670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281385+0000","last_change":"2023-10-24T00:29:41.281385+0000","last_active":"2023-10-24T00:29:41.281385+0000","last_peered":"2023-10-24T00:29:41.281385+0000","last_clean":"2023-10-24T00:29:41.281385+0000","last_became_active":"2023-10-24T00:29:41.281043+0000","last_became_peered":"2023-10-24T00:29:41.281043+0000","last_unstale":"2023-10-24T00:29:41.281385+0000","last_undegraded":"2023-10-24T00:29:41.281385+0000","last_fullsized":"2023-10-24T00:29:41.281385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885197+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915110+0000","last_change":"2023-10-24T00:29:40.909172+0000","last_active":"2023-10-24T00:29:40.915110+0000","last_peered":"2023-10-24T00:29:40.915110+0000","last_clean":"2023-10-24T00:29:40.915110+0000","last_became_active":"2023-10-24T00:29:40.908746+0000","last_became_peered":"2023-10-24T00:29:40.908746+0000","last_unstale":"2023-10-24T00:29:40.915110+0000","last_undegraded":"2023-10-24T00:29:40.915110+0000","last_fullsized":"2023-10-24T00:29:40.915110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282681+0000","last_change":"2023-10-24T00:29:41.282681+0000","last_active":"2023-10-24T00:29:41.282681+0000","last_peered":"2023-10-24T00:29:41.282681+0000","last_clean":"2023-10-24T00:29:41.282681+0000","last_became_active":"2023-10-24T00:29:41.282332+0000","last_became_peered":"2023-10-24T00:29:41.282332+0000","last_unstale":"2023-10-24T00:29:41.282681+0000","last_undegraded":"2023-10-24T00:29:41.282681+0000","last_fullsized":"2023-10-24T00:29:41.282681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908108+0000","last_change":"2023-10-24T00:29:40.904330+0000","last_active":"2023-10-24T00:29:40.908108+0000","last_peered":"2023-10-24T00:29:40.908108+0000","last_clean":"2023-10-24T00:29:40.908108+0000","last_became_active":"2023-10-24T00:29:40.903980+0000","last_became_peered":"2023-10-24T00:29:40.903980+0000","last_unstale":"2023-10-24T00:29:40.908108+0000","last_undegraded":"2023-10-24T00:29:40.908108+0000","last_fullsized":"2023-10-24T00:29:40.908108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884858+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284715+0000","last_change":"2023-10-24T00:29:41.284715+0000","last_active":"2023-10-24T00:29:41.284715+0000","last_peered":"2023-10-24T00:29:41.284715+0000","last_clean":"2023-10-24T00:29:41.284715+0000","last_became_active":"2023-10-24T00:29:41.284417+0000","last_became_peered":"2023-10-24T00:29:41.284417+0000","last_unstale":"2023-10-24T00:29:41.284715+0000","last_undegraded":"2023-10-24T00:29:41.284715+0000","last_fullsized":"2023-10-24T00:29:41.284715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882965+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279331+0000","last_change":"2023-10-24T00:29:41.279331+0000","last_active":"2023-10-24T00:29:41.279331+0000","last_peered":"2023-10-24T00:29:41.279331+0000","last_clean":"2023-10-24T00:29:41.279331+0000","last_became_active":"2023-10-24T00:29:41.279005+0000","last_became_peered":"2023-10-24T00:29:41.279005+0000","last_unstale":"2023-10-24T00:29:41.279331+0000","last_undegraded":"2023-10-24T00:29:41.279331+0000","last_fullsized":"2023-10-24T00:29:41.279331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.910647+0000","last_change":"2023-10-24T00:29:40.908076+0000","last_active":"2023-10-24T00:29:40.910647+0000","last_peered":"2023-10-24T00:29:40.910647+0000","last_clean":"2023-10-24T00:29:40.910647+0000","last_became_active":"2023-10-24T00:29:40.907720+0000","last_became_peered":"2023-10-24T00:29:40.907720+0000","last_unstale":"2023-10-24T00:29:40.910647+0000","last_undegraded":"2023-10-24T00:29:40.910647+0000","last_fullsized":"2023-10-24T00:29:40.910647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284689+0000","last_change":"2023-10-24T00:29:40.909485+0000","last_active":"2023-10-24T00:29:41.284689+0000","last_peered":"2023-10-24T00:29:41.284689+0000","last_clean":"2023-10-24T00:29:41.284689+0000","last_became_active":"2023-10-24T00:29:40.909207+0000","last_became_peered":"2023-10-24T00:29:40.909207+0000","last_unstale":"2023-10-24T00:29:41.284689+0000","last_undegraded":"2023-10-24T00:29:41.284689+0000","last_fullsized":"2023-10-24T00:29:41.284689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278399+0000","last_change":"2023-10-24T00:29:41.278399+0000","last_active":"2023-10-24T00:29:41.278399+0000","last_peered":"2023-10-24T00:29:41.278399+0000","last_clean":"2023-10-24T00:29:41.278399+0000","last_became_active":"2023-10-24T00:29:41.277871+0000","last_became_peered":"2023-10-24T00:29:41.277871+0000","last_unstale":"2023-10-24T00:29:41.278399+0000","last_undegraded":"2023-10-24T00:29:41.278399+0000","last_fullsized":"2023-10-24T00:29:41.278399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260648+0000","last_change":"2023-10-24T00:29:40.901458+0000","last_active":"2023-10-24T00:29:41.260648+0000","last_peered":"2023-10-24T00:29:41.260648+0000","last_clean":"2023-10-24T00:29:41.260648+0000","last_became_active":"2023-10-24T00:29:40.901103+0000","last_became_peered":"2023-10-24T00:29:40.901103+0000","last_unstale":"2023-10-24T00:29:41.260648+0000","last_undegraded":"2023-10-24T00:29:41.260648+0000","last_fullsized":"2023-10-24T00:29:41.260648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276984+0000","last_change":"2023-10-24T00:29:41.276984+0000","last_active":"2023-10-24T00:29:41.276984+0000","last_peered":"2023-10-24T00:29:41.276984+0000","last_clean":"2023-10-24T00:29:41.276984+0000","last_became_active":"2023-10-24T00:29:41.276711+0000","last_became_peered":"2023-10-24T00:29:41.276711+0000","last_unstale":"2023-10-24T00:29:41.276984+0000","last_undegraded":"2023-10-24T00:29:41.276984+0000","last_fullsized":"2023-10-24T00:29:41.276984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884557+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.911924+0000","last_change":"2023-10-24T00:29:40.907877+0000","last_active":"2023-10-24T00:29:40.911924+0000","last_peered":"2023-10-24T00:29:40.911924+0000","last_clean":"2023-10-24T00:29:40.911924+0000","last_became_active":"2023-10-24T00:29:40.907520+0000","last_became_peered":"2023-10-24T00:29:40.907520+0000","last_unstale":"2023-10-24T00:29:40.911924+0000","last_undegraded":"2023-10-24T00:29:40.911924+0000","last_fullsized":"2023-10-24T00:29:40.911924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279222+0000","last_change":"2023-10-24T00:29:41.279222+0000","last_active":"2023-10-24T00:29:41.279222+0000","last_peered":"2023-10-24T00:29:41.279222+0000","last_clean":"2023-10-24T00:29:41.279222+0000","last_became_active":"2023-10-24T00:29:41.278945+0000","last_became_peered":"2023-10-24T00:29:41.278945+0000","last_unstale":"2023-10-24T00:29:41.279222+0000","last_undegraded":"2023-10-24T00:29:41.279222+0000","last_fullsized":"2023-10-24T00:29:41.279222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272957+0000","last_change":"2023-10-24T00:29:40.907495+0000","last_active":"2023-10-24T00:29:41.272957+0000","last_peered":"2023-10-24T00:29:41.272957+0000","last_clean":"2023-10-24T00:29:41.272957+0000","last_became_active":"2023-10-24T00:29:40.907255+0000","last_became_peered":"2023-10-24T00:29:40.907255+0000","last_unstale":"2023-10-24T00:29:41.272957+0000","last_undegraded":"2023-10-24T00:29:41.272957+0000","last_fullsized":"2023-10-24T00:29:41.272957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915149+0000","last_change":"2023-10-24T00:29:40.909325+0000","last_active":"2023-10-24T00:29:40.915149+0000","last_peered":"2023-10-24T00:29:40.915149+0000","last_clean":"2023-10-24T00:29:40.915149+0000","last_became_active":"2023-10-24T00:29:40.909009+0000","last_became_peered":"2023-10-24T00:29:40.909009+0000","last_unstale":"2023-10-24T00:29:40.915149+0000","last_undegraded":"2023-10-24T00:29:40.915149+0000","last_fullsized":"2023-10-24T00:29:40.915149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275585+0000","last_change":"2023-10-24T00:29:41.275585+0000","last_active":"2023-10-24T00:29:41.275585+0000","last_peered":"2023-10-24T00:29:41.275585+0000","last_clean":"2023-10-24T00:29:41.275585+0000","last_became_active":"2023-10-24T00:29:41.275266+0000","last_became_peered":"2023-10-24T00:29:41.275266+0000","last_unstale":"2023-10-24T00:29:41.275585+0000","last_undegraded":"2023-10-24T00:29:41.275585+0000","last_fullsized":"2023-10-24T00:29:41.275585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884631+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884803+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280428+0000","last_change":"2023-10-24T00:29:41.280428+0000","last_active":"2023-10-24T00:29:41.280428+0000","last_peered":"2023-10-24T00:29:41.280428+0000","last_clean":"2023-10-24T00:29:41.280428+0000","last_became_active":"2023-10-24T00:29:41.279677+0000","last_became_peered":"2023-10-24T00:29:41.279677+0000","last_unstale":"2023-10-24T00:29:41.280428+0000","last_undegraded":"2023-10-24T00:29:41.280428+0000","last_fullsized":"2023-10-24T00:29:41.280428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915620+0000","last_change":"2023-10-24T00:29:40.911768+0000","last_active":"2023-10-24T00:29:40.915620+0000","last_peered":"2023-10-24T00:29:40.915620+0000","last_clean":"2023-10-24T00:29:40.915620+0000","last_became_active":"2023-10-24T00:29:40.911432+0000","last_became_peered":"2023-10-24T00:29:40.911432+0000","last_unstale":"2023-10-24T00:29:40.915620+0000","last_undegraded":"2023-10-24T00:29:40.915620+0000","last_fullsized":"2023-10-24T00:29:40.915620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273672+0000","last_change":"2023-10-24T00:29:41.273672+0000","last_active":"2023-10-24T00:29:41.273672+0000","last_peered":"2023-10-24T00:29:41.273672+0000","last_clean":"2023-10-24T00:29:41.273672+0000","last_became_active":"2023-10-24T00:29:41.273229+0000","last_became_peered":"2023-10-24T00:29:41.273229+0000","last_unstale":"2023-10-24T00:29:41.273672+0000","last_undegraded":"2023-10-24T00:29:41.273672+0000","last_fullsized":"2023-10-24T00:29:41.273672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885009+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273562+0000","last_change":"2023-10-24T00:29:41.273562+0000","last_active":"2023-10-24T00:29:41.273562+0000","last_peered":"2023-10-24T00:29:41.273562+0000","last_clean":"2023-10-24T00:29:41.273562+0000","last_became_active":"2023-10-24T00:29:41.273232+0000","last_became_peered":"2023-10-24T00:29:41.273232+0000","last_unstale":"2023-10-24T00:29:41.273562+0000","last_undegraded":"2023-10-24T00:29:41.273562+0000","last_fullsized":"2023-10-24T00:29:41.273562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884690+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887721+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279922+0000","last_change":"2023-10-24T00:29:41.279922+0000","last_active":"2023-10-24T00:29:41.279922+0000","last_peered":"2023-10-24T00:29:41.279922+0000","last_clean":"2023-10-24T00:29:41.279922+0000","last_became_active":"2023-10-24T00:29:41.279200+0000","last_became_peered":"2023-10-24T00:29:41.279200+0000","last_unstale":"2023-10-24T00:29:41.279922+0000","last_undegraded":"2023-10-24T00:29:41.279922+0000","last_fullsized":"2023-10-24T00:29:41.279922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912648+0000","last_change":"2023-10-24T00:29:40.909194+0000","last_active":"2023-10-24T00:29:40.912648+0000","last_peered":"2023-10-24T00:29:40.912648+0000","last_clean":"2023-10-24T00:29:40.912648+0000","last_became_active":"2023-10-24T00:29:40.908896+0000","last_became_peered":"2023-10-24T00:29:40.908896+0000","last_unstale":"2023-10-24T00:29:40.912648+0000","last_undegraded":"2023-10-24T00:29:40.912648+0000","last_fullsized":"2023-10-24T00:29:40.912648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281694+0000","last_change":"2023-10-24T00:29:41.281694+0000","last_active":"2023-10-24T00:29:41.281694+0000","last_peered":"2023-10-24T00:29:41.281694+0000","last_clean":"2023-10-24T00:29:41.281694+0000","last_became_active":"2023-10-24T00:29:41.281285+0000","last_became_peered":"2023-10-24T00:29:41.281285+0000","last_unstale":"2023-10-24T00:29:41.281694+0000","last_undegraded":"2023-10-24T00:29:41.281694+0000","last_fullsized":"2023-10-24T00:29:41.281694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882942+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885041+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882933+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913026+0000","last_change":"2023-10-24T00:29:40.910828+0000","last_active":"2023-10-24T00:29:40.913026+0000","last_peered":"2023-10-24T00:29:40.913026+0000","last_clean":"2023-10-24T00:29:40.913026+0000","last_became_active":"2023-10-24T00:29:40.910440+0000","last_became_peered":"2023-10-24T00:29:40.910440+0000","last_unstale":"2023-10-24T00:29:40.913026+0000","last_undegraded":"2023-10-24T00:29:40.913026+0000","last_fullsized":"2023-10-24T00:29:40.913026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884505+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275537+0000","last_change":"2023-10-24T00:29:41.275537+0000","last_active":"2023-10-24T00:29:41.275537+0000","last_peered":"2023-10-24T00:29:41.275537+0000","last_clean":"2023-10-24T00:29:41.275537+0000","last_became_active":"2023-10-24T00:29:41.275261+0000","last_became_peered":"2023-10-24T00:29:41.275261+0000","last_unstale":"2023-10-24T00:29:41.275537+0000","last_undegraded":"2023-10-24T00:29:41.275537+0000","last_fullsized":"2023-10-24T00:29:41.275537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915163+0000","last_change":"2023-10-24T00:29:40.909407+0000","last_active":"2023-10-24T00:29:40.915163+0000","last_peered":"2023-10-24T00:29:40.915163+0000","last_clean":"2023-10-24T00:29:40.915163+0000","last_became_active":"2023-10-24T00:29:40.908984+0000","last_became_peered":"2023-10-24T00:29:40.908984+0000","last_unstale":"2023-10-24T00:29:40.915163+0000","last_undegraded":"2023-10-24T00:29:40.915163+0000","last_fullsized":"2023-10-24T00:29:40.915163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.900536+0000","last_change":"2023-10-24T00:29:40.899421+0000","last_active":"2023-10-24T00:29:40.900536+0000","last_peered":"2023-10-24T00:29:40.900536+0000","last_clean":"2023-10-24T00:29:40.900536+0000","last_became_active":"2023-10-24T00:29:40.898728+0000","last_became_peered":"2023-10-24T00:29:40.898728+0000","last_unstale":"2023-10-24T00:29:40.900536+0000","last_undegraded":"2023-10-24T00:29:40.900536+0000","last_fullsized":"2023-10-24T00:29:40.900536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274440+0000","last_change":"2023-10-24T00:29:41.274440+0000","last_active":"2023-10-24T00:29:41.274440+0000","last_peered":"2023-10-24T00:29:41.274440+0000","last_clean":"2023-10-24T00:29:41.274440+0000","last_became_active":"2023-10-24T00:29:41.274130+0000","last_became_peered":"2023-10-24T00:29:41.274130+0000","last_unstale":"2023-10-24T00:29:41.274440+0000","last_undegraded":"2023-10-24T00:29:41.274440+0000","last_fullsized":"2023-10-24T00:29:41.274440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.888182+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882489+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887336+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912713+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:40.912713+0000","last_peered":"2023-10-24T00:29:40.912713+0000","last_clean":"2023-10-24T00:29:40.912713+0000","last_became_active":"2023-10-24T00:29:40.908574+0000","last_became_peered":"2023-10-24T00:29:40.908574+0000","last_unstale":"2023-10-24T00:29:40.912713+0000","last_undegraded":"2023-10-24T00:29:40.912713+0000","last_fullsized":"2023-10-24T00:29:40.912713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280110+0000","last_change":"2023-10-24T00:29:41.280110+0000","last_active":"2023-10-24T00:29:41.280110+0000","last_peered":"2023-10-24T00:29:41.280110+0000","last_clean":"2023-10-24T00:29:41.280110+0000","last_became_active":"2023-10-24T00:29:41.279056+0000","last_became_peered":"2023-10-24T00:29:41.279056+0000","last_unstale":"2023-10-24T00:29:41.280110+0000","last_undegraded":"2023-10-24T00:29:41.280110+0000","last_fullsized":"2023-10-24T00:29:41.280110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.904760+0000","last_change":"2023-10-24T00:29:40.900962+0000","last_active":"2023-10-24T00:29:40.904760+0000","last_peered":"2023-10-24T00:29:40.904760+0000","last_clean":"2023-10-24T00:29:40.904760+0000","last_became_active":"2023-10-24T00:29:40.900707+0000","last_became_peered":"2023-10-24T00:29:40.900707+0000","last_unstale":"2023-10-24T00:29:40.904760+0000","last_undegraded":"2023-10-24T00:29:40.904760+0000","last_fullsized":"2023-10-24T00:29:40.904760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882492+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884525+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282531+0000","last_change":"2023-10-24T00:29:41.282531+0000","last_active":"2023-10-24T00:29:41.282531+0000","last_peered":"2023-10-24T00:29:41.282531+0000","last_clean":"2023-10-24T00:29:41.282531+0000","last_became_active":"2023-10-24T00:29:41.282183+0000","last_became_peered":"2023-10-24T00:29:41.282183+0000","last_unstale":"2023-10-24T00:29:41.282531+0000","last_undegraded":"2023-10-24T00:29:41.282531+0000","last_fullsized":"2023-10-24T00:29:41.282531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885545+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277528+0000","last_change":"2023-10-24T00:29:41.277528+0000","last_active":"2023-10-24T00:29:41.277528+0000","last_peered":"2023-10-24T00:29:41.277528+0000","last_clean":"2023-10-24T00:29:41.277528+0000","last_became_active":"2023-10-24T00:29:41.277225+0000","last_became_peered":"2023-10-24T00:29:41.277225+0000","last_unstale":"2023-10-24T00:29:41.277528+0000","last_undegraded":"2023-10-24T00:29:41.277528+0000","last_fullsized":"2023-10-24T00:29:41.277528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912990+0000","last_change":"2023-10-24T00:29:40.910398+0000","last_active":"2023-10-24T00:29:40.912990+0000","last_peered":"2023-10-24T00:29:40.912990+0000","last_clean":"2023-10-24T00:29:40.912990+0000","last_became_active":"2023-10-24T00:29:40.910084+0000","last_became_peered":"2023-10-24T00:29:40.910084+0000","last_unstale":"2023-10-24T00:29:40.912990+0000","last_undegraded":"2023-10-24T00:29:40.912990+0000","last_fullsized":"2023-10-24T00:29:40.912990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280101+0000","last_change":"2023-10-24T00:29:40.911169+0000","last_active":"2023-10-24T00:29:41.280101+0000","last_peered":"2023-10-24T00:29:41.280101+0000","last_clean":"2023-10-24T00:29:41.280101+0000","last_became_active":"2023-10-24T00:29:40.910890+0000","last_became_peered":"2023-10-24T00:29:40.910890+0000","last_unstale":"2023-10-24T00:29:41.280101+0000","last_undegraded":"2023-10-24T00:29:41.280101+0000","last_fullsized":"2023-10-24T00:29:41.280101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884549+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884530+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882493+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276786+0000","last_change":"2023-10-24T00:29:41.276786+0000","last_active":"2023-10-24T00:29:41.276786+0000","last_peered":"2023-10-24T00:29:41.276786+0000","last_clean":"2023-10-24T00:29:41.276786+0000","last_became_active":"2023-10-24T00:29:41.276496+0000","last_became_peered":"2023-10-24T00:29:41.276496+0000","last_unstale":"2023-10-24T00:29:41.276786+0000","last_undegraded":"2023-10-24T00:29:41.276786+0000","last_fullsized":"2023-10-24T00:29:41.276786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890250+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272860+0000","last_change":"2023-10-24T00:29:40.899606+0000","last_active":"2023-10-24T00:29:41.272860+0000","last_peered":"2023-10-24T00:29:41.272860+0000","last_clean":"2023-10-24T00:29:41.272860+0000","last_became_active":"2023-10-24T00:29:40.899105+0000","last_became_peered":"2023-10-24T00:29:40.899105+0000","last_unstale":"2023-10-24T00:29:41.272860+0000","last_undegraded":"2023-10-24T00:29:41.272860+0000","last_fullsized":"2023-10-24T00:29:41.272860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271459+0000","last_change":"2023-10-24T00:29:40.910529+0000","last_active":"2023-10-24T00:29:41.271459+0000","last_peered":"2023-10-24T00:29:41.271459+0000","last_clean":"2023-10-24T00:29:41.271459+0000","last_became_active":"2023-10-24T00:29:40.910236+0000","last_became_peered":"2023-10-24T00:29:40.910236+0000","last_unstale":"2023-10-24T00:29:41.271459+0000","last_undegraded":"2023-10-24T00:29:41.271459+0000","last_fullsized":"2023-10-24T00:29:41.271459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284279+0000","last_change":"2023-10-24T00:29:41.284279+0000","last_active":"2023-10-24T00:29:41.284279+0000","last_peered":"2023-10-24T00:29:41.284279+0000","last_clean":"2023-10-24T00:29:41.284279+0000","last_became_active":"2023-10-24T00:29:41.279681+0000","last_became_peered":"2023-10-24T00:29:41.279681+0000","last_unstale":"2023-10-24T00:29:41.284279+0000","last_undegraded":"2023-10-24T00:29:41.284279+0000","last_fullsized":"2023-10-24T00:29:41.284279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885096+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.907850+0000","last_change":"2023-10-24T00:29:40.904046+0000","last_active":"2023-10-24T00:29:40.907850+0000","last_peered":"2023-10-24T00:29:40.907850+0000","last_clean":"2023-10-24T00:29:40.907850+0000","last_became_active":"2023-10-24T00:29:40.903723+0000","last_became_peered":"2023-10-24T00:29:40.903723+0000","last_unstale":"2023-10-24T00:29:40.907850+0000","last_undegraded":"2023-10-24T00:29:40.907850+0000","last_fullsized":"2023-10-24T00:29:40.907850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272804+0000","last_change":"2023-10-24T00:29:41.272804+0000","last_active":"2023-10-24T00:29:41.272804+0000","last_peered":"2023-10-24T00:29:41.272804+0000","last_clean":"2023-10-24T00:29:41.272804+0000","last_became_active":"2023-10-24T00:29:41.272528+0000","last_became_peered":"2023-10-24T00:29:41.272528+0000","last_unstale":"2023-10-24T00:29:41.272804+0000","last_undegraded":"2023-10-24T00:29:41.272804+0000","last_fullsized":"2023-10-24T00:29:41.272804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.880635+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278176+0000","last_change":"2023-10-24T00:29:41.278176+0000","last_active":"2023-10-24T00:29:41.278176+0000","last_peered":"2023-10-24T00:29:41.278176+0000","last_clean":"2023-10-24T00:29:41.278176+0000","last_became_active":"2023-10-24T00:29:41.276898+0000","last_became_peered":"2023-10-24T00:29:41.276898+0000","last_unstale":"2023-10-24T00:29:41.278176+0000","last_undegraded":"2023-10-24T00:29:41.278176+0000","last_fullsized":"2023-10-24T00:29:41.278176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260764+0000","last_change":"2023-10-24T00:29:40.904817+0000","last_active":"2023-10-24T00:29:41.260764+0000","last_peered":"2023-10-24T00:29:41.260764+0000","last_clean":"2023-10-24T00:29:41.260764+0000","last_became_active":"2023-10-24T00:29:40.904554+0000","last_became_peered":"2023-10-24T00:29:40.904554+0000","last_unstale":"2023-10-24T00:29:41.260764+0000","last_undegraded":"2023-10-24T00:29:41.260764+0000","last_fullsized":"2023-10-24T00:29:41.260764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.903731+0000","last_change":"2023-10-24T00:29:40.899587+0000","last_active":"2023-10-24T00:29:40.903731+0000","last_peered":"2023-10-24T00:29:40.903731+0000","last_clean":"2023-10-24T00:29:40.903731+0000","last_became_active":"2023-10-24T00:29:40.899281+0000","last_became_peered":"2023-10-24T00:29:40.899281+0000","last_unstale":"2023-10-24T00:29:40.903731+0000","last_undegraded":"2023-10-24T00:29:40.903731+0000","last_fullsized":"2023-10-24T00:29:40.903731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274908+0000","last_change":"2023-10-24T00:29:41.274908+0000","last_active":"2023-10-24T00:29:41.274908+0000","last_peered":"2023-10-24T00:29:41.274908+0000","last_clean":"2023-10-24T00:29:41.274908+0000","last_became_active":"2023-10-24T00:29:41.274570+0000","last_became_peered":"2023-10-24T00:29:41.274570+0000","last_unstale":"2023-10-24T00:29:41.274908+0000","last_undegraded":"2023-10-24T00:29:41.274908+0000","last_fullsized":"2023-10-24T00:29:41.274908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908183+0000","last_change":"2023-10-24T00:29:40.903507+0000","last_active":"2023-10-24T00:29:40.908183+0000","last_peered":"2023-10-24T00:29:40.908183+0000","last_clean":"2023-10-24T00:29:40.908183+0000","last_became_active":"2023-10-24T00:29:40.903175+0000","last_became_peered":"2023-10-24T00:29:40.903175+0000","last_unstale":"2023-10-24T00:29:40.908183+0000","last_undegraded":"2023-10-24T00:29:40.908183+0000","last_fullsized":"2023-10-24T00:29:40.908183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.899874+0000","last_change":"2023-10-24T00:29:40.897887+0000","last_active":"2023-10-24T00:29:40.899874+0000","last_peered":"2023-10-24T00:29:40.899874+0000","last_clean":"2023-10-24T00:29:40.899874+0000","last_became_active":"2023-10-24T00:29:40.897165+0000","last_became_peered":"2023-10-24T00:29:40.897165+0000","last_unstale":"2023-10-24T00:29:40.899874+0000","last_undegraded":"2023-10-24T00:29:40.899874+0000","last_fullsized":"2023-10-24T00:29:40.899874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887726+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887760+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.898546+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:29:40.898546+0000","last_peered":"2023-10-24T00:29:40.898546+0000","last_clean":"2023-10-24T00:29:40.898546+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:29:40.898546+0000","last_undegraded":"2023-10-24T00:29:40.898546+0000","last_fullsized":"2023-10-24T00:29:40.898546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275099+0000","last_change":"2023-10-24T00:29:41.275099+0000","last_active":"2023-10-24T00:29:41.275099+0000","last_peered":"2023-10-24T00:29:41.275099+0000","last_clean":"2023-10-24T00:29:41.275099+0000","last_became_active":"2023-10-24T00:29:41.273851+0000","last_became_peered":"2023-10-24T00:29:41.273851+0000","last_unstale":"2023-10-24T00:29:41.275099+0000","last_undegraded":"2023-10-24T00:29:41.275099+0000","last_fullsized":"2023-10-24T00:29:41.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915220+0000","last_change":"2023-10-24T00:29:40.908757+0000","last_active":"2023-10-24T00:29:40.915220+0000","last_peered":"2023-10-24T00:29:40.915220+0000","last_clean":"2023-10-24T00:29:40.915220+0000","last_became_active":"2023-10-24T00:29:40.908448+0000","last_became_peered":"2023-10-24T00:29:40.908448+0000","last_unstale":"2023-10-24T00:29:40.915220+0000","last_undegraded":"2023-10-24T00:29:40.915220+0000","last_fullsized":"2023-10-24T00:29:40.915220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.887884+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:29:40.887884+0000","last_peered":"2023-10-24T00:29:40.887884+0000","last_clean":"2023-10-24T00:29:40.887884+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:29:40.887884+0000","last_undegraded":"2023-10-24T00:29:40.887884+0000","last_fullsized":"2023-10-24T00:29:40.887884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284246+0000","last_change":"2023-10-24T00:29:41.284246+0000","last_active":"2023-10-24T00:29:41.284246+0000","last_peered":"2023-10-24T00:29:41.284246+0000","last_clean":"2023-10-24T00:29:41.284246+0000","last_became_active":"2023-10-24T00:29:41.280875+0000","last_became_peered":"2023-10-24T00:29:41.280875+0000","last_unstale":"2023-10-24T00:29:41.284246+0000","last_undegraded":"2023-10-24T00:29:41.284246+0000","last_fullsized":"2023-10-24T00:29:41.284246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908095+0000","last_change":"2023-10-24T00:29:40.904270+0000","last_active":"2023-10-24T00:29:40.908095+0000","last_peered":"2023-10-24T00:29:40.908095+0000","last_clean":"2023-10-24T00:29:40.908095+0000","last_became_active":"2023-10-24T00:29:40.903932+0000","last_became_peered":"2023-10-24T00:29:40.903932+0000","last_unstale":"2023-10-24T00:29:40.908095+0000","last_undegraded":"2023-10-24T00:29:40.908095+0000","last_fullsized":"2023-10-24T00:29:40.908095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.895909+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:29:40.895909+0000","last_peered":"2023-10-24T00:29:40.895909+0000","last_clean":"2023-10-24T00:29:40.895909+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:29:40.895909+0000","last_undegraded":"2023-10-24T00:29:40.895909+0000","last_fullsized":"2023-10-24T00:29:40.895909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890293+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:29:40.890293+0000","last_peered":"2023-10-24T00:29:40.890293+0000","last_clean":"2023-10-24T00:29:40.890293+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:29:40.890293+0000","last_undegraded":"2023-10-24T00:29:40.890293+0000","last_fullsized":"2023-10-24T00:29:40.890293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284475+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.284475+0000","last_peered":"2023-10-24T00:29:41.284475+0000","last_clean":"2023-10-24T00:29:41.284475+0000","last_became_active":"2023-10-24T00:29:40.908367+0000","last_became_peered":"2023-10-24T00:29:40.908367+0000","last_unstale":"2023-10-24T00:29:41.284475+0000","last_undegraded":"2023-10-24T00:29:41.284475+0000","last_fullsized":"2023-10-24T00:29:41.284475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890706+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:29:40.890706+0000","last_peered":"2023-10-24T00:29:40.890706+0000","last_clean":"2023-10-24T00:29:40.890706+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:29:40.890706+0000","last_undegraded":"2023-10-24T00:29:40.890706+0000","last_fullsized":"2023-10-24T00:29:40.890706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889739+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.894423+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:29:40.894423+0000","last_peered":"2023-10-24T00:29:40.894423+0000","last_clean":"2023-10-24T00:29:40.894423+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:29:40.894423+0000","last_undegraded":"2023-10-24T00:29:40.894423+0000","last_fullsized":"2023-10-24T00:29:40.894423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884655+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273553+0000","last_change":"2023-10-24T00:29:41.273553+0000","last_active":"2023-10-24T00:29:41.273553+0000","last_peered":"2023-10-24T00:29:41.273553+0000","last_clean":"2023-10-24T00:29:41.273553+0000","last_became_active":"2023-10-24T00:29:41.273266+0000","last_became_peered":"2023-10-24T00:29:41.273266+0000","last_unstale":"2023-10-24T00:29:41.273553+0000","last_undegraded":"2023-10-24T00:29:41.273553+0000","last_fullsized":"2023-10-24T00:29:41.273553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884527+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.301374+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:29:35.301374+0000","last_peered":"2023-10-24T00:29:35.301374+0000","last_clean":"2023-10-24T00:29:35.301374+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:29:35.301374+0000","last_undegraded":"2023-10-24T00:29:35.301374+0000","last_fullsized":"2023-10-24T00:29:35.301374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":153434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2959999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2610000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":151876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:44.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.401+0000 7fde6e5a0700 1 Processor -- start 2023-10-24T00:29:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.401+0000 7fde6e5a0700 1 -- start start 2023-10-24T00:29:44.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde6e5a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde68095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde6e5a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde68154780 0x7fde680962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde6e5a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680bf5c0 con 0x7fde681543a0 2023-10-24T00:29:44.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde6e5a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680967c0 con 0x7fde68154780 2023-10-24T00:29:44.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde6e5a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680a86d0 con 0x7fde680bfa50 2023-10-24T00:29:44.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde67fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fde681543a0 0x7fde680a7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53514/0 (socket says 172.21.15.148:53514) 2023-10-24T00:29:44.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.402+0000 7fde67fff700 1 -- 172.21.15.148:0/1538903120 learned_addr learned my addr 172.21.15.148:0/1538903120 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:44.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> v2:172.21.15.150:3300/0 conn(0x7fde68154780 0x7fde680962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde677fe700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde68095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961899670 0 0) 0x7fde680bf5c0 con 0x7fde681543a0 2023-10-24T00:29:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde500033f0 con 0x7fde681543a0 2023-10-24T00:29:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570634214 0 0) 0x7fde500033f0 con 0x7fde681543a0 2023-10-24T00:29:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 msgr2=0x7fde68095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde68095de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 >> v2:172.21.15.150:3300/0 conn(0x7fde68154780 msgr2=0x7fde680962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 --2- 172.21.15.148:0/1538903120 >> v2:172.21.15.150:3300/0 conn(0x7fde68154780 0x7fde680962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680be9b0 con 0x7fde681543a0 2023-10-24T00:29:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fde58001470 con 0x7fde681543a0 2023-10-24T00:29:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> v2:172.21.15.150:3300/0 conn(0x7fde68154780 0x7fde680962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 >> v1:172.21.15.148:6789/0 conn(0x7fde681543a0 legacy=0x7fde680a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde500038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003e10 0x7fde50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde50004b80 0x7fde50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680967c0 con 0x7fde50004b80 2023-10-24T00:29:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680a86d0 con 0x7fde50003e10 2023-10-24T00:29:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000b910 con 0x7fde680bfa50 2023-10-24T00:29:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde50004b80 0x7fde50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde677fe700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003e10 0x7fde50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde67fff700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde500038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 -- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 msgr2=0x7fde500038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680bfa50 0x7fde500038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 -- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003e10 msgr2=0x7fde50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde50003e10 0x7fde50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.403+0000 7fde6cb3d700 1 -- 172.21.15.148:0/1538903120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500033f0 con 0x7fde50004b80 2023-10-24T00:29:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde50004b80 0x7fde50005000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fde60007580 tx=0x7fde600097d0).ready entity=mon.0 client_cookie=863a790538d6dfac server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60009ae0 con 0x7fde50004b80 2023-10-24T00:29:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60007d70 con 0x7fde50004b80 2023-10-24T00:29:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde66ffd700 1 -- 172.21.15.148:0/1538903120 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60015620 con 0x7fde50004b80 2023-10-24T00:29:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1538903120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde50004b80 msgr2=0x7fde50005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1538903120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde50004b80 0x7fde50005000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fde60007580 tx=0x7fde600097d0).stop 2023-10-24T00:29:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6cb3d700 1 -- 172.21.15.148:0/1538903120 reap_dead start 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1538903120 shutdown_connections 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1538903120 >> 172.21.15.148:0/1538903120 conn(0x7fde680630f0 msgr2=0x7fde680c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1538903120 shutdown_connections 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.404+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1538903120 wait complete. 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.405+0000 7fde6e5a0700 1 Processor -- start 2023-10-24T00:29:44.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 -- start start 2023-10-24T00:29:44.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680a8b00 0x7fde68164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 0x7fde68164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680aebf0 con 0x7fde6814f2e0 2023-10-24T00:29:44.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680aad70 con 0x7fde6814f6c0 2023-10-24T00:29:44.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde6e5a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680c0f60 con 0x7fde680a8b00 2023-10-24T00:29:44.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde67fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde67fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46078/0 (socket says 172.21.15.148:46078) 2023-10-24T00:29:44.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.406+0000 7fde67fff700 1 -- 172.21.15.148:0/1483405509 learned_addr learned my addr 172.21.15.148:0/1483405509 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:44.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 0x7fde68164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 -- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680a8b00 msgr2=0x7fde68164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde677fe700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680a8b00 0x7fde68164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680a8b00 0x7fde68164770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 -- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 msgr2=0x7fde68164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 0x7fde68164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 -- 172.21.15.148:0/1483405509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680adb50 con 0x7fde6814f2e0 2023-10-24T00:29:44.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde6cb3d700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 0x7fde68164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:44.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde67fff700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fde58000fd0 tx=0x7fde58001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58000c40 con 0x7fde6814f2e0 2023-10-24T00:29:44.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800f840 con 0x7fde6814f2e0 2023-10-24T00:29:44.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde68165150 con 0x7fde6814f2e0 2023-10-24T00:29:44.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5800fbc0 con 0x7fde6814f2e0 2023-10-24T00:29:44.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.407+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde680ab580 con 0x7fde6814f2e0 2023-10-24T00:29:44.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.408+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6806c6b0 con 0x7fde6814f2e0 2023-10-24T00:29:44.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.408+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fde5801d3b0 con 0x7fde6814f2e0 2023-10-24T00:29:44.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.408+0000 7fde4ffff700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 0x7fde54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.409+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fde58079bc0 con 0x7fde6814f2e0 2023-10-24T00:29:44.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.409+0000 7fde677fe700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 0x7fde54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.409+0000 7fde677fe700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 0x7fde54061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fde68167ce0 tx=0x7fde5c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.412+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde5804ae30 con 0x7fde6814f2e0 2023-10-24T00:29:44.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.571+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde680bec90 con 0x7fde5405f150 2023-10-24T00:29:44.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.580+0000 7fde4ffff700 1 -- 172.21.15.148:0/1483405509 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+331577 (secure 0 0 0) 0x7fde680bec90 con 0x7fde5405f150 2023-10-24T00:29:44.586 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:44.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 msgr2=0x7fde54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 0x7fde54061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fde68167ce0 tx=0x7fde5c008040).stop 2023-10-24T00:29:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 msgr2=0x7fde680ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fde58000fd0 tx=0x7fde58001e90).stop 2023-10-24T00:29:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 shutdown_connections 2023-10-24T00:29:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde6814f6c0 0x7fde68164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde5405f150 0x7fde54061610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde6814f2e0 0x7fde680ae700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 --2- 172.21.15.148:0/1483405509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde680a8b00 0x7fde68164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 >> 172.21.15.148:0/1483405509 conn(0x7fde680630f0 msgr2=0x7fde680a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 shutdown_connections 2023-10-24T00:29:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.583+0000 7fde6e5a0700 1 -- 172.21.15.148:0/1483405509 wait complete. 2023-10-24T00:29:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:44.597 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-24T00:29:42.780340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":200,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379520,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595200,"statfs":{"total":773094113280,"available":770657484800,"internally_reserved":0,"allocated":2818048,"data_stored":1133418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.586051"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282508+0000","last_change":"2023-10-24T00:29:41.282508+0000","last_active":"2023-10-24T00:29:41.282508+0000","last_peered":"2023-10-24T00:29:41.282508+0000","last_clean":"2023-10-24T00:29:41.282508+0000","last_became_active":"2023-10-24T00:29:41.282208+0000","last_became_peered":"2023-10-24T00:29:41.282208+0000","last_unstale":"2023-10-24T00:29:41.282508+0000","last_undegraded":"2023-10-24T00:29:41.282508+0000","last_fullsized":"2023-10-24T00:29:41.282508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890350+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885444+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913085+0000","last_change":"2023-10-24T00:29:40.911353+0000","last_active":"2023-10-24T00:29:40.913085+0000","last_peered":"2023-10-24T00:29:40.913085+0000","last_clean":"2023-10-24T00:29:40.913085+0000","last_became_active":"2023-10-24T00:29:40.911057+0000","last_became_peered":"2023-10-24T00:29:40.911057+0000","last_unstale":"2023-10-24T00:29:40.913085+0000","last_undegraded":"2023-10-24T00:29:40.913085+0000","last_fullsized":"2023-10-24T00:29:40.913085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.883087+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260670+0000","last_change":"2023-10-24T00:29:40.896011+0000","last_active":"2023-10-24T00:29:41.260670+0000","last_peered":"2023-10-24T00:29:41.260670+0000","last_clean":"2023-10-24T00:29:41.260670+0000","last_became_active":"2023-10-24T00:29:40.895711+0000","last_became_peered":"2023-10-24T00:29:40.895711+0000","last_unstale":"2023-10-24T00:29:41.260670+0000","last_undegraded":"2023-10-24T00:29:41.260670+0000","last_fullsized":"2023-10-24T00:29:41.260670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281385+0000","last_change":"2023-10-24T00:29:41.281385+0000","last_active":"2023-10-24T00:29:41.281385+0000","last_peered":"2023-10-24T00:29:41.281385+0000","last_clean":"2023-10-24T00:29:41.281385+0000","last_became_active":"2023-10-24T00:29:41.281043+0000","last_became_peered":"2023-10-24T00:29:41.281043+0000","last_unstale":"2023-10-24T00:29:41.281385+0000","last_undegraded":"2023-10-24T00:29:41.281385+0000","last_fullsized":"2023-10-24T00:29:41.281385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885197+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915110+0000","last_change":"2023-10-24T00:29:40.909172+0000","last_active":"2023-10-24T00:29:40.915110+0000","last_peered":"2023-10-24T00:29:40.915110+0000","last_clean":"2023-10-24T00:29:40.915110+0000","last_became_active":"2023-10-24T00:29:40.908746+0000","last_became_peered":"2023-10-24T00:29:40.908746+0000","last_unstale":"2023-10-24T00:29:40.915110+0000","last_undegraded":"2023-10-24T00:29:40.915110+0000","last_fullsized":"2023-10-24T00:29:40.915110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282681+0000","last_change":"2023-10-24T00:29:41.282681+0000","last_active":"2023-10-24T00:29:41.282681+0000","last_peered":"2023-10-24T00:29:41.282681+0000","last_clean":"2023-10-24T00:29:41.282681+0000","last_became_active":"2023-10-24T00:29:41.282332+0000","last_became_peered":"2023-10-24T00:29:41.282332+0000","last_unstale":"2023-10-24T00:29:41.282681+0000","last_undegraded":"2023-10-24T00:29:41.282681+0000","last_fullsized":"2023-10-24T00:29:41.282681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908108+0000","last_change":"2023-10-24T00:29:40.904330+0000","last_active":"2023-10-24T00:29:40.908108+0000","last_peered":"2023-10-24T00:29:40.908108+0000","last_clean":"2023-10-24T00:29:40.908108+0000","last_became_active":"2023-10-24T00:29:40.903980+0000","last_became_peered":"2023-10-24T00:29:40.903980+0000","last_unstale":"2023-10-24T00:29:40.908108+0000","last_undegraded":"2023-10-24T00:29:40.908108+0000","last_fullsized":"2023-10-24T00:29:40.908108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884858+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284715+0000","last_change":"2023-10-24T00:29:41.284715+0000","last_active":"2023-10-24T00:29:41.284715+0000","last_peered":"2023-10-24T00:29:41.284715+0000","last_clean":"2023-10-24T00:29:41.284715+0000","last_became_active":"2023-10-24T00:29:41.284417+0000","last_became_peered":"2023-10-24T00:29:41.284417+0000","last_unstale":"2023-10-24T00:29:41.284715+0000","last_undegraded":"2023-10-24T00:29:41.284715+0000","last_fullsized":"2023-10-24T00:29:41.284715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882965+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279331+0000","last_change":"2023-10-24T00:29:41.279331+0000","last_active":"2023-10-24T00:29:41.279331+0000","last_peered":"2023-10-24T00:29:41.279331+0000","last_clean":"2023-10-24T00:29:41.279331+0000","last_became_active":"2023-10-24T00:29:41.279005+0000","last_became_peered":"2023-10-24T00:29:41.279005+0000","last_unstale":"2023-10-24T00:29:41.279331+0000","last_undegraded":"2023-10-24T00:29:41.279331+0000","last_fullsized":"2023-10-24T00:29:41.279331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.910647+0000","last_change":"2023-10-24T00:29:40.908076+0000","last_active":"2023-10-24T00:29:40.910647+0000","last_peered":"2023-10-24T00:29:40.910647+0000","last_clean":"2023-10-24T00:29:40.910647+0000","last_became_active":"2023-10-24T00:29:40.907720+0000","last_became_peered":"2023-10-24T00:29:40.907720+0000","last_unstale":"2023-10-24T00:29:40.910647+0000","last_undegraded":"2023-10-24T00:29:40.910647+0000","last_fullsized":"2023-10-24T00:29:40.910647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284689+0000","last_change":"2023-10-24T00:29:40.909485+0000","last_active":"2023-10-24T00:29:41.284689+0000","last_peered":"2023-10-24T00:29:41.284689+0000","last_clean":"2023-10-24T00:29:41.284689+0000","last_became_active":"2023-10-24T00:29:40.909207+0000","last_became_peered":"2023-10-24T00:29:40.909207+0000","last_unstale":"2023-10-24T00:29:41.284689+0000","last_undegraded":"2023-10-24T00:29:41.284689+0000","last_fullsized":"2023-10-24T00:29:41.284689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278399+0000","last_change":"2023-10-24T00:29:41.278399+0000","last_active":"2023-10-24T00:29:41.278399+0000","last_peered":"2023-10-24T00:29:41.278399+0000","last_clean":"2023-10-24T00:29:41.278399+0000","last_became_active":"2023-10-24T00:29:41.277871+0000","last_became_peered":"2023-10-24T00:29:41.277871+0000","last_unstale":"2023-10-24T00:29:41.278399+0000","last_undegraded":"2023-10-24T00:29:41.278399+0000","last_fullsized":"2023-10-24T00:29:41.278399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260648+0000","last_change":"2023-10-24T00:29:40.901458+0000","last_active":"2023-10-24T00:29:41.260648+0000","last_peered":"2023-10-24T00:29:41.260648+0000","last_clean":"2023-10-24T00:29:41.260648+0000","last_became_active":"2023-10-24T00:29:40.901103+0000","last_became_peered":"2023-10-24T00:29:40.901103+0000","last_unstale":"2023-10-24T00:29:41.260648+0000","last_undegraded":"2023-10-24T00:29:41.260648+0000","last_fullsized":"2023-10-24T00:29:41.260648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276984+0000","last_change":"2023-10-24T00:29:41.276984+0000","last_active":"2023-10-24T00:29:41.276984+0000","last_peered":"2023-10-24T00:29:41.276984+0000","last_clean":"2023-10-24T00:29:41.276984+0000","last_became_active":"2023-10-24T00:29:41.276711+0000","last_became_peered":"2023-10-24T00:29:41.276711+0000","last_unstale":"2023-10-24T00:29:41.276984+0000","last_undegraded":"2023-10-24T00:29:41.276984+0000","last_fullsized":"2023-10-24T00:29:41.276984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884557+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.911924+0000","last_change":"2023-10-24T00:29:40.907877+0000","last_active":"2023-10-24T00:29:40.911924+0000","last_peered":"2023-10-24T00:29:40.911924+0000","last_clean":"2023-10-24T00:29:40.911924+0000","last_became_active":"2023-10-24T00:29:40.907520+0000","last_became_peered":"2023-10-24T00:29:40.907520+0000","last_unstale":"2023-10-24T00:29:40.911924+0000","last_undegraded":"2023-10-24T00:29:40.911924+0000","last_fullsized":"2023-10-24T00:29:40.911924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279222+0000","last_change":"2023-10-24T00:29:41.279222+0000","last_active":"2023-10-24T00:29:41.279222+0000","last_peered":"2023-10-24T00:29:41.279222+0000","last_clean":"2023-10-24T00:29:41.279222+0000","last_became_active":"2023-10-24T00:29:41.278945+0000","last_became_peered":"2023-10-24T00:29:41.278945+0000","last_unstale":"2023-10-24T00:29:41.279222+0000","last_undegraded":"2023-10-24T00:29:41.279222+0000","last_fullsized":"2023-10-24T00:29:41.279222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272957+0000","last_change":"2023-10-24T00:29:40.907495+0000","last_active":"2023-10-24T00:29:41.272957+0000","last_peered":"2023-10-24T00:29:41.272957+0000","last_clean":"2023-10-24T00:29:41.272957+0000","last_became_active":"2023-10-24T00:29:40.907255+0000","last_became_peered":"2023-10-24T00:29:40.907255+0000","last_unstale":"2023-10-24T00:29:41.272957+0000","last_undegraded":"2023-10-24T00:29:41.272957+0000","last_fullsized":"2023-10-24T00:29:41.272957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915149+0000","last_change":"2023-10-24T00:29:40.909325+0000","last_active":"2023-10-24T00:29:40.915149+0000","last_peered":"2023-10-24T00:29:40.915149+0000","last_clean":"2023-10-24T00:29:40.915149+0000","last_became_active":"2023-10-24T00:29:40.909009+0000","last_became_peered":"2023-10-24T00:29:40.909009+0000","last_unstale":"2023-10-24T00:29:40.915149+0000","last_undegraded":"2023-10-24T00:29:40.915149+0000","last_fullsized":"2023-10-24T00:29:40.915149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275585+0000","last_change":"2023-10-24T00:29:41.275585+0000","last_active":"2023-10-24T00:29:41.275585+0000","last_peered":"2023-10-24T00:29:41.275585+0000","last_clean":"2023-10-24T00:29:41.275585+0000","last_became_active":"2023-10-24T00:29:41.275266+0000","last_became_peered":"2023-10-24T00:29:41.275266+0000","last_unstale":"2023-10-24T00:29:41.275585+0000","last_undegraded":"2023-10-24T00:29:41.275585+0000","last_fullsized":"2023-10-24T00:29:41.275585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884631+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884803+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280428+0000","last_change":"2023-10-24T00:29:41.280428+0000","last_active":"2023-10-24T00:29:41.280428+0000","last_peered":"2023-10-24T00:29:41.280428+0000","last_clean":"2023-10-24T00:29:41.280428+0000","last_became_active":"2023-10-24T00:29:41.279677+0000","last_became_peered":"2023-10-24T00:29:41.279677+0000","last_unstale":"2023-10-24T00:29:41.280428+0000","last_undegraded":"2023-10-24T00:29:41.280428+0000","last_fullsized":"2023-10-24T00:29:41.280428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915620+0000","last_change":"2023-10-24T00:29:40.911768+0000","last_active":"2023-10-24T00:29:40.915620+0000","last_peered":"2023-10-24T00:29:40.915620+0000","last_clean":"2023-10-24T00:29:40.915620+0000","last_became_active":"2023-10-24T00:29:40.911432+0000","last_became_peered":"2023-10-24T00:29:40.911432+0000","last_unstale":"2023-10-24T00:29:40.915620+0000","last_undegraded":"2023-10-24T00:29:40.915620+0000","last_fullsized":"2023-10-24T00:29:40.915620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273672+0000","last_change":"2023-10-24T00:29:41.273672+0000","last_active":"2023-10-24T00:29:41.273672+0000","last_peered":"2023-10-24T00:29:41.273672+0000","last_clean":"2023-10-24T00:29:41.273672+0000","last_became_active":"2023-10-24T00:29:41.273229+0000","last_became_peered":"2023-10-24T00:29:41.273229+0000","last_unstale":"2023-10-24T00:29:41.273672+0000","last_undegraded":"2023-10-24T00:29:41.273672+0000","last_fullsized":"2023-10-24T00:29:41.273672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885009+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273562+0000","last_change":"2023-10-24T00:29:41.273562+0000","last_active":"2023-10-24T00:29:41.273562+0000","last_peered":"2023-10-24T00:29:41.273562+0000","last_clean":"2023-10-24T00:29:41.273562+0000","last_became_active":"2023-10-24T00:29:41.273232+0000","last_became_peered":"2023-10-24T00:29:41.273232+0000","last_unstale":"2023-10-24T00:29:41.273562+0000","last_undegraded":"2023-10-24T00:29:41.273562+0000","last_fullsized":"2023-10-24T00:29:41.273562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884690+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887721+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279922+0000","last_change":"2023-10-24T00:29:41.279922+0000","last_active":"2023-10-24T00:29:41.279922+0000","last_peered":"2023-10-24T00:29:41.279922+0000","last_clean":"2023-10-24T00:29:41.279922+0000","last_became_active":"2023-10-24T00:29:41.279200+0000","last_became_peered":"2023-10-24T00:29:41.279200+0000","last_unstale":"2023-10-24T00:29:41.279922+0000","last_undegraded":"2023-10-24T00:29:41.279922+0000","last_fullsized":"2023-10-24T00:29:41.279922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912648+0000","last_change":"2023-10-24T00:29:40.909194+0000","last_active":"2023-10-24T00:29:40.912648+0000","last_peered":"2023-10-24T00:29:40.912648+0000","last_clean":"2023-10-24T00:29:40.912648+0000","last_became_active":"2023-10-24T00:29:40.908896+0000","last_became_peered":"2023-10-24T00:29:40.908896+0000","last_unstale":"2023-10-24T00:29:40.912648+0000","last_undegraded":"2023-10-24T00:29:40.912648+0000","last_fullsized":"2023-10-24T00:29:40.912648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281694+0000","last_change":"2023-10-24T00:29:41.281694+0000","last_active":"2023-10-24T00:29:41.281694+0000","last_peered":"2023-10-24T00:29:41.281694+0000","last_clean":"2023-10-24T00:29:41.281694+0000","last_became_active":"2023-10-24T00:29:41.281285+0000","last_became_peered":"2023-10-24T00:29:41.281285+0000","last_unstale":"2023-10-24T00:29:41.281694+0000","last_undegraded":"2023-10-24T00:29:41.281694+0000","last_fullsized":"2023-10-24T00:29:41.281694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882942+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885041+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882933+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913026+0000","last_change":"2023-10-24T00:29:40.910828+0000","last_active":"2023-10-24T00:29:40.913026+0000","last_peered":"2023-10-24T00:29:40.913026+0000","last_clean":"2023-10-24T00:29:40.913026+0000","last_became_active":"2023-10-24T00:29:40.910440+0000","last_became_peered":"2023-10-24T00:29:40.910440+0000","last_unstale":"2023-10-24T00:29:40.913026+0000","last_undegraded":"2023-10-24T00:29:40.913026+0000","last_fullsized":"2023-10-24T00:29:40.913026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884505+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275537+0000","last_change":"2023-10-24T00:29:41.275537+0000","last_active":"2023-10-24T00:29:41.275537+0000","last_peered":"2023-10-24T00:29:41.275537+0000","last_clean":"2023-10-24T00:29:41.275537+0000","last_became_active":"2023-10-24T00:29:41.275261+0000","last_became_peered":"2023-10-24T00:29:41.275261+0000","last_unstale":"2023-10-24T00:29:41.275537+0000","last_undegraded":"2023-10-24T00:29:41.275537+0000","last_fullsized":"2023-10-24T00:29:41.275537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915163+0000","last_change":"2023-10-24T00:29:40.909407+0000","last_active":"2023-10-24T00:29:40.915163+0000","last_peered":"2023-10-24T00:29:40.915163+0000","last_clean":"2023-10-24T00:29:40.915163+0000","last_became_active":"2023-10-24T00:29:40.908984+0000","last_became_peered":"2023-10-24T00:29:40.908984+0000","last_unstale":"2023-10-24T00:29:40.915163+0000","last_undegraded":"2023-10-24T00:29:40.915163+0000","last_fullsized":"2023-10-24T00:29:40.915163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.900536+0000","last_change":"2023-10-24T00:29:40.899421+0000","last_active":"2023-10-24T00:29:40.900536+0000","last_peered":"2023-10-24T00:29:40.900536+0000","last_clean":"2023-10-24T00:29:40.900536+0000","last_became_active":"2023-10-24T00:29:40.898728+0000","last_became_peered":"2023-10-24T00:29:40.898728+0000","last_unstale":"2023-10-24T00:29:40.900536+0000","last_undegraded":"2023-10-24T00:29:40.900536+0000","last_fullsized":"2023-10-24T00:29:40.900536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274440+0000","last_change":"2023-10-24T00:29:41.274440+0000","last_active":"2023-10-24T00:29:41.274440+0000","last_peered":"2023-10-24T00:29:41.274440+0000","last_clean":"2023-10-24T00:29:41.274440+0000","last_became_active":"2023-10-24T00:29:41.274130+0000","last_became_peered":"2023-10-24T00:29:41.274130+0000","last_unstale":"2023-10-24T00:29:41.274440+0000","last_undegraded":"2023-10-24T00:29:41.274440+0000","last_fullsized":"2023-10-24T00:29:41.274440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.888182+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882489+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887336+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912713+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:40.912713+0000","last_peered":"2023-10-24T00:29:40.912713+0000","last_clean":"2023-10-24T00:29:40.912713+0000","last_became_active":"2023-10-24T00:29:40.908574+0000","last_became_peered":"2023-10-24T00:29:40.908574+0000","last_unstale":"2023-10-24T00:29:40.912713+0000","last_undegraded":"2023-10-24T00:29:40.912713+0000","last_fullsized":"2023-10-24T00:29:40.912713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280110+0000","last_change":"2023-10-24T00:29:41.280110+0000","last_active":"2023-10-24T00:29:41.280110+0000","last_peered":"2023-10-24T00:29:41.280110+0000","last_clean":"2023-10-24T00:29:41.280110+0000","last_became_active":"2023-10-24T00:29:41.279056+0000","last_became_peered":"2023-10-24T00:29:41.279056+0000","last_unstale":"2023-10-24T00:29:41.280110+0000","last_undegraded":"2023-10-24T00:29:41.280110+0000","last_fullsized":"2023-10-24T00:29:41.280110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.904760+0000","last_change":"2023-10-24T00:29:40.900962+0000","last_active":"2023-10-24T00:29:40.904760+0000","last_peered":"2023-10-24T00:29:40.904760+0000","last_clean":"2023-10-24T00:29:40.904760+0000","last_became_active":"2023-10-24T00:29:40.900707+0000","last_became_peered":"2023-10-24T00:29:40.900707+0000","last_unstale":"2023-10-24T00:29:40.904760+0000","last_undegraded":"2023-10-24T00:29:40.904760+0000","last_fullsized":"2023-10-24T00:29:40.904760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882492+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884525+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282531+0000","last_change":"2023-10-24T00:29:41.282531+0000","last_active":"2023-10-24T00:29:41.282531+0000","last_peered":"2023-10-24T00:29:41.282531+0000","last_clean":"2023-10-24T00:29:41.282531+0000","last_became_active":"2023-10-24T00:29:41.282183+0000","last_became_peered":"2023-10-24T00:29:41.282183+0000","last_unstale":"2023-10-24T00:29:41.282531+0000","last_undegraded":"2023-10-24T00:29:41.282531+0000","last_fullsized":"2023-10-24T00:29:41.282531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885545+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277528+0000","last_change":"2023-10-24T00:29:41.277528+0000","last_active":"2023-10-24T00:29:41.277528+0000","last_peered":"2023-10-24T00:29:41.277528+0000","last_clean":"2023-10-24T00:29:41.277528+0000","last_became_active":"2023-10-24T00:29:41.277225+0000","last_became_peered":"2023-10-24T00:29:41.277225+0000","last_unstale":"2023-10-24T00:29:41.277528+0000","last_undegraded":"2023-10-24T00:29:41.277528+0000","last_fullsized":"2023-10-24T00:29:41.277528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912990+0000","last_change":"2023-10-24T00:29:40.910398+0000","last_active":"2023-10-24T00:29:40.912990+0000","last_peered":"2023-10-24T00:29:40.912990+0000","last_clean":"2023-10-24T00:29:40.912990+0000","last_became_active":"2023-10-24T00:29:40.910084+0000","last_became_peered":"2023-10-24T00:29:40.910084+0000","last_unstale":"2023-10-24T00:29:40.912990+0000","last_undegraded":"2023-10-24T00:29:40.912990+0000","last_fullsized":"2023-10-24T00:29:40.912990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280101+0000","last_change":"2023-10-24T00:29:40.911169+0000","last_active":"2023-10-24T00:29:41.280101+0000","last_peered":"2023-10-24T00:29:41.280101+0000","last_clean":"2023-10-24T00:29:41.280101+0000","last_became_active":"2023-10-24T00:29:40.910890+0000","last_became_peered":"2023-10-24T00:29:40.910890+0000","last_unstale":"2023-10-24T00:29:41.280101+0000","last_undegraded":"2023-10-24T00:29:41.280101+0000","last_fullsized":"2023-10-24T00:29:41.280101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884549+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884530+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882493+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276786+0000","last_change":"2023-10-24T00:29:41.276786+0000","last_active":"2023-10-24T00:29:41.276786+0000","last_peered":"2023-10-24T00:29:41.276786+0000","last_clean":"2023-10-24T00:29:41.276786+0000","last_became_active":"2023-10-24T00:29:41.276496+0000","last_became_peered":"2023-10-24T00:29:41.276496+0000","last_unstale":"2023-10-24T00:29:41.276786+0000","last_undegraded":"2023-10-24T00:29:41.276786+0000","last_fullsized":"2023-10-24T00:29:41.276786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890250+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272860+0000","last_change":"2023-10-24T00:29:40.899606+0000","last_active":"2023-10-24T00:29:41.272860+0000","last_peered":"2023-10-24T00:29:41.272860+0000","last_clean":"2023-10-24T00:29:41.272860+0000","last_became_active":"2023-10-24T00:29:40.899105+0000","last_became_peered":"2023-10-24T00:29:40.899105+0000","last_unstale":"2023-10-24T00:29:41.272860+0000","last_undegraded":"2023-10-24T00:29:41.272860+0000","last_fullsized":"2023-10-24T00:29:41.272860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271459+0000","last_change":"2023-10-24T00:29:40.910529+0000","last_active":"2023-10-24T00:29:41.271459+0000","last_peered":"2023-10-24T00:29:41.271459+0000","last_clean":"2023-10-24T00:29:41.271459+0000","last_became_active":"2023-10-24T00:29:40.910236+0000","last_became_peered":"2023-10-24T00:29:40.910236+0000","last_unstale":"2023-10-24T00:29:41.271459+0000","last_undegraded":"2023-10-24T00:29:41.271459+0000","last_fullsized":"2023-10-24T00:29:41.271459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284279+0000","last_change":"2023-10-24T00:29:41.284279+0000","last_active":"2023-10-24T00:29:41.284279+0000","last_peered":"2023-10-24T00:29:41.284279+0000","last_clean":"2023-10-24T00:29:41.284279+0000","last_became_active":"2023-10-24T00:29:41.279681+0000","last_became_peered":"2023-10-24T00:29:41.279681+0000","last_unstale":"2023-10-24T00:29:41.284279+0000","last_undegraded":"2023-10-24T00:29:41.284279+0000","last_fullsized":"2023-10-24T00:29:41.284279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885096+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.907850+0000","last_change":"2023-10-24T00:29:40.904046+0000","last_active":"2023-10-24T00:29:40.907850+0000","last_peered":"2023-10-24T00:29:40.907850+0000","last_clean":"2023-10-24T00:29:40.907850+0000","last_became_active":"2023-10-24T00:29:40.903723+0000","last_became_peered":"2023-10-24T00:29:40.903723+0000","last_unstale":"2023-10-24T00:29:40.907850+0000","last_undegraded":"2023-10-24T00:29:40.907850+0000","last_fullsized":"2023-10-24T00:29:40.907850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272804+0000","last_change":"2023-10-24T00:29:41.272804+0000","last_active":"2023-10-24T00:29:41.272804+0000","last_peered":"2023-10-24T00:29:41.272804+0000","last_clean":"2023-10-24T00:29:41.272804+0000","last_became_active":"2023-10-24T00:29:41.272528+0000","last_became_peered":"2023-10-24T00:29:41.272528+0000","last_unstale":"2023-10-24T00:29:41.272804+0000","last_undegraded":"2023-10-24T00:29:41.272804+0000","last_fullsized":"2023-10-24T00:29:41.272804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.880635+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278176+0000","last_change":"2023-10-24T00:29:41.278176+0000","last_active":"2023-10-24T00:29:41.278176+0000","last_peered":"2023-10-24T00:29:41.278176+0000","last_clean":"2023-10-24T00:29:41.278176+0000","last_became_active":"2023-10-24T00:29:41.276898+0000","last_became_peered":"2023-10-24T00:29:41.276898+0000","last_unstale":"2023-10-24T00:29:41.278176+0000","last_undegraded":"2023-10-24T00:29:41.278176+0000","last_fullsized":"2023-10-24T00:29:41.278176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260764+0000","last_change":"2023-10-24T00:29:40.904817+0000","last_active":"2023-10-24T00:29:41.260764+0000","last_peered":"2023-10-24T00:29:41.260764+0000","last_clean":"2023-10-24T00:29:41.260764+0000","last_became_active":"2023-10-24T00:29:40.904554+0000","last_became_peered":"2023-10-24T00:29:40.904554+0000","last_unstale":"2023-10-24T00:29:41.260764+0000","last_undegraded":"2023-10-24T00:29:41.260764+0000","last_fullsized":"2023-10-24T00:29:41.260764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.903731+0000","last_change":"2023-10-24T00:29:40.899587+0000","last_active":"2023-10-24T00:29:40.903731+0000","last_peered":"2023-10-24T00:29:40.903731+0000","last_clean":"2023-10-24T00:29:40.903731+0000","last_became_active":"2023-10-24T00:29:40.899281+0000","last_became_peered":"2023-10-24T00:29:40.899281+0000","last_unstale":"2023-10-24T00:29:40.903731+0000","last_undegraded":"2023-10-24T00:29:40.903731+0000","last_fullsized":"2023-10-24T00:29:40.903731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274908+0000","last_change":"2023-10-24T00:29:41.274908+0000","last_active":"2023-10-24T00:29:41.274908+0000","last_peered":"2023-10-24T00:29:41.274908+0000","last_clean":"2023-10-24T00:29:41.274908+0000","last_became_active":"2023-10-24T00:29:41.274570+0000","last_became_peered":"2023-10-24T00:29:41.274570+0000","last_unstale":"2023-10-24T00:29:41.274908+0000","last_undegraded":"2023-10-24T00:29:41.274908+0000","last_fullsized":"2023-10-24T00:29:41.274908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908183+0000","last_change":"2023-10-24T00:29:40.903507+0000","last_active":"2023-10-24T00:29:40.908183+0000","last_peered":"2023-10-24T00:29:40.908183+0000","last_clean":"2023-10-24T00:29:40.908183+0000","last_became_active":"2023-10-24T00:29:40.903175+0000","last_became_peered":"2023-10-24T00:29:40.903175+0000","last_unstale":"2023-10-24T00:29:40.908183+0000","last_undegraded":"2023-10-24T00:29:40.908183+0000","last_fullsized":"2023-10-24T00:29:40.908183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.899874+0000","last_change":"2023-10-24T00:29:40.897887+0000","last_active":"2023-10-24T00:29:40.899874+0000","last_peered":"2023-10-24T00:29:40.899874+0000","last_clean":"2023-10-24T00:29:40.899874+0000","last_became_active":"2023-10-24T00:29:40.897165+0000","last_became_peered":"2023-10-24T00:29:40.897165+0000","last_unstale":"2023-10-24T00:29:40.899874+0000","last_undegraded":"2023-10-24T00:29:40.899874+0000","last_fullsized":"2023-10-24T00:29:40.899874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887726+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887760+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.898546+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:29:40.898546+0000","last_peered":"2023-10-24T00:29:40.898546+0000","last_clean":"2023-10-24T00:29:40.898546+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:29:40.898546+0000","last_undegraded":"2023-10-24T00:29:40.898546+0000","last_fullsized":"2023-10-24T00:29:40.898546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275099+0000","last_change":"2023-10-24T00:29:41.275099+0000","last_active":"2023-10-24T00:29:41.275099+0000","last_peered":"2023-10-24T00:29:41.275099+0000","last_clean":"2023-10-24T00:29:41.275099+0000","last_became_active":"2023-10-24T00:29:41.273851+0000","last_became_peered":"2023-10-24T00:29:41.273851+0000","last_unstale":"2023-10-24T00:29:41.275099+0000","last_undegraded":"2023-10-24T00:29:41.275099+0000","last_fullsized":"2023-10-24T00:29:41.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915220+0000","last_change":"2023-10-24T00:29:40.908757+0000","last_active":"2023-10-24T00:29:40.915220+0000","last_peered":"2023-10-24T00:29:40.915220+0000","last_clean":"2023-10-24T00:29:40.915220+0000","last_became_active":"2023-10-24T00:29:40.908448+0000","last_became_peered":"2023-10-24T00:29:40.908448+0000","last_unstale":"2023-10-24T00:29:40.915220+0000","last_undegraded":"2023-10-24T00:29:40.915220+0000","last_fullsized":"2023-10-24T00:29:40.915220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.887884+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:29:40.887884+0000","last_peered":"2023-10-24T00:29:40.887884+0000","last_clean":"2023-10-24T00:29:40.887884+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:29:40.887884+0000","last_undegraded":"2023-10-24T00:29:40.887884+0000","last_fullsized":"2023-10-24T00:29:40.887884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284246+0000","last_change":"2023-10-24T00:29:41.284246+0000","last_active":"2023-10-24T00:29:41.284246+0000","last_peered":"2023-10-24T00:29:41.284246+0000","last_clean":"2023-10-24T00:29:41.284246+0000","last_became_active":"2023-10-24T00:29:41.280875+0000","last_became_peered":"2023-10-24T00:29:41.280875+0000","last_unstale":"2023-10-24T00:29:41.284246+0000","last_undegraded":"2023-10-24T00:29:41.284246+0000","last_fullsized":"2023-10-24T00:29:41.284246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908095+0000","last_change":"2023-10-24T00:29:40.904270+0000","last_active":"2023-10-24T00:29:40.908095+0000","last_peered":"2023-10-24T00:29:40.908095+0000","last_clean":"2023-10-24T00:29:40.908095+0000","last_became_active":"2023-10-24T00:29:40.903932+0000","last_became_peered":"2023-10-24T00:29:40.903932+0000","last_unstale":"2023-10-24T00:29:40.908095+0000","last_undegraded":"2023-10-24T00:29:40.908095+0000","last_fullsized":"2023-10-24T00:29:40.908095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.895909+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:29:40.895909+0000","last_peered":"2023-10-24T00:29:40.895909+0000","last_clean":"2023-10-24T00:29:40.895909+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:29:40.895909+0000","last_undegraded":"2023-10-24T00:29:40.895909+0000","last_fullsized":"2023-10-24T00:29:40.895909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890293+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:29:40.890293+0000","last_peered":"2023-10-24T00:29:40.890293+0000","last_clean":"2023-10-24T00:29:40.890293+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:29:40.890293+0000","last_undegraded":"2023-10-24T00:29:40.890293+0000","last_fullsized":"2023-10-24T00:29:40.890293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284475+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.284475+0000","last_peered":"2023-10-24T00:29:41.284475+0000","last_clean":"2023-10-24T00:29:41.284475+0000","last_became_active":"2023-10-24T00:29:40.908367+0000","last_became_peered":"2023-10-24T00:29:40.908367+0000","last_unstale":"2023-10-24T00:29:41.284475+0000","last_undegraded":"2023-10-24T00:29:41.284475+0000","last_fullsized":"2023-10-24T00:29:41.284475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890706+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:29:40.890706+0000","last_peered":"2023-10-24T00:29:40.890706+0000","last_clean":"2023-10-24T00:29:40.890706+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:29:40.890706+0000","last_undegraded":"2023-10-24T00:29:40.890706+0000","last_fullsized":"2023-10-24T00:29:40.890706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889739+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.894423+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:29:40.894423+0000","last_peered":"2023-10-24T00:29:40.894423+0000","last_clean":"2023-10-24T00:29:40.894423+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:29:40.894423+0000","last_undegraded":"2023-10-24T00:29:40.894423+0000","last_fullsized":"2023-10-24T00:29:40.894423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884655+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273553+0000","last_change":"2023-10-24T00:29:41.273553+0000","last_active":"2023-10-24T00:29:41.273553+0000","last_peered":"2023-10-24T00:29:41.273553+0000","last_clean":"2023-10-24T00:29:41.273553+0000","last_became_active":"2023-10-24T00:29:41.273266+0000","last_became_peered":"2023-10-24T00:29:41.273266+0000","last_unstale":"2023-10-24T00:29:41.273553+0000","last_undegraded":"2023-10-24T00:29:41.273553+0000","last_fullsized":"2023-10-24T00:29:41.273553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884527+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.301374+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:29:35.301374+0000","last_peered":"2023-10-24T00:29:35.301374+0000","last_clean":"2023-10-24T00:29:35.301374+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:29:35.301374+0000","last_undegraded":"2023-10-24T00:29:35.301374+0000","last_fullsized":"2023-10-24T00:29:35.301374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":153434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2959999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2610000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":151876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:44.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.748+0000 7fee9e5eb700 1 Processor -- start 2023-10-24T00:29:44.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.748+0000 7fee9e5eb700 1 -- start start 2023-10-24T00:29:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9e5eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee980c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9e5eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980c0960 con 0x7fee980aa3f0 2023-10-24T00:29:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9e5eb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980c0c40 con 0x7fee980c6710 2023-10-24T00:29:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9e5eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980aa8a0 con 0x7fee980aa010 2023-10-24T00:29:44.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9cb88700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fee980aa3f0 0x7fee98069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53530/0 (socket says 172.21.15.148:53530) 2023-10-24T00:29:44.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.749+0000 7fee9cb88700 1 -- 172.21.15.148:0/3454156708 learned_addr learned my addr 172.21.15.148:0/3454156708 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:44.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee97fff700 1 --2- 172.21.15.148:0/3454156708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee980c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775757507 0 0) 0x7fee980c0960 con 0x7fee980aa3f0 2023-10-24T00:29:44.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee800033f0 con 0x7fee980aa3f0 2023-10-24T00:29:44.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55288196 0 0) 0x7fee980c0c40 con 0x7fee980c6710 2023-10-24T00:29:44.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee980c0960 con 0x7fee980c6710 2023-10-24T00:29:44.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee97fff700 1 -- 172.21.15.148:0/3454156708 >> v1:172.21.15.150:6789/0 conn(0x7fee980c6710 legacy=0x7fee98158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459358955 0 0) 0x7fee800033f0 con 0x7fee980aa3f0 2023-10-24T00:29:44.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee97fff700 1 -- 172.21.15.148:0/3454156708 >> v1:172.21.15.148:6789/0 conn(0x7fee980aa3f0 legacy=0x7fee98069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee97fff700 1 -- 172.21.15.148:0/3454156708 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980c0f20 con 0x7fee980aa010 2023-10-24T00:29:44.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee97fff700 1 --2- 172.21.15.148:0/3454156708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee980c1a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fee88009790 tx=0x7fee88009060).ready entity=mon.2 client_cookie=c7e04a408cd7d5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900017f0 con 0x7fee980aa010 2023-10-24T00:29:44.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88011400 con 0x7fee980aa010 2023-10-24T00:29:44.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.750+0000 7fee96ffd700 1 -- 172.21.15.148:0/3454156708 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011780 con 0x7fee980aa010 2023-10-24T00:29:44.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 -- 172.21.15.148:0/3454156708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 msgr2=0x7fee980c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/3454156708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee980c1a00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fee88009790 tx=0x7fee88009060).stop 2023-10-24T00:29:44.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 -- 172.21.15.148:0/3454156708 shutdown_connections 2023-10-24T00:29:44.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/3454156708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee980c1a00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 -- 172.21.15.148:0/3454156708 >> 172.21.15.148:0/3454156708 conn(0x7fee980caf40 msgr2=0x7fee980cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 -- 172.21.15.148:0/3454156708 shutdown_connections 2023-10-24T00:29:44.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.751+0000 7fee9e5eb700 1 -- 172.21.15.148:0/3454156708 wait complete. 2023-10-24T00:29:44.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.752+0000 7fee9e5eb700 1 Processor -- start 2023-10-24T00:29:44.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.752+0000 7fee9e5eb700 1 -- start start 2023-10-24T00:29:44.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee98168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee980c6710 0x7fee980aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98164a50 con 0x7fee980aa3f0 2023-10-24T00:29:44.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98164cf0 con 0x7fee980c6710 2023-10-24T00:29:44.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9e5eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee98153ff0 con 0x7fee980aa010 2023-10-24T00:29:44.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee97fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee98168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46094/0 (socket says 172.21.15.148:46094) 2023-10-24T00:29:44.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 -- 172.21.15.148:0/463067767 learned_addr learned my addr 172.21.15.148:0/463067767 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:44.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee9cb88700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee980c6710 0x7fee980aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 -- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 msgr2=0x7fee98168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee98168020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 -- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee980c6710 msgr2=0x7fee980aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee980c6710 0x7fee980aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 -- 172.21.15.148:0/463067767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880092a0 con 0x7fee980aa3f0 2023-10-24T00:29:44.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.753+0000 7fee977fe700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fee8c00c450 tx=0x7fee8c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.754+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c012400 con 0x7fee980aa3f0 2023-10-24T00:29:44.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.754+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c012560 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.754+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee98168510 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.754+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c012920 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.754+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98168a70 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.755+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9806c6b0 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.755+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fee8c01b3b0 con 0x7fee980aa3f0 2023-10-24T00:29:44.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.755+0000 7fee7ffff700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 0x7fee84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:44.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.755+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee8c079980 con 0x7fee980aa3f0 2023-10-24T00:29:44.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.755+0000 7fee97fff700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 0x7fee84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:44.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.756+0000 7fee97fff700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 0x7fee84061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fee980af490 tx=0x7fee88016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:44.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.759+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fee8c04abf0 con 0x7fee980aa3f0 2023-10-24T00:29:44.862 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:29:44.860+0000 7f410a100700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:29:44.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.921+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee980c1200 con 0x7fee8405f150 2023-10-24T00:29:44.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.930+0000 7fee7ffff700 1 -- 172.21.15.148:0/463067767 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+331577 (secure 0 0 0) 0x7fee980c1200 con 0x7fee8405f150 2023-10-24T00:29:44.936 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:44.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 msgr2=0x7fee84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 0x7fee84061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fee980af490 tx=0x7fee88016000).stop 2023-10-24T00:29:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 msgr2=0x7fee980afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fee8c00c450 tx=0x7fee8c007c60).stop 2023-10-24T00:29:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 shutdown_connections 2023-10-24T00:29:44.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee980c6710 0x7fee980aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee980aa010 0x7fee98168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fee8405f150 0x7fee84061610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 --2- 172.21.15.148:0/463067767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee980aa3f0 0x7fee980afa90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:44.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 >> 172.21.15.148:0/463067767 conn(0x7fee980caf40 msgr2=0x7fee980ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 shutdown_connections 2023-10-24T00:29:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:44.934+0000 7fee9e5eb700 1 -- 172.21.15.148:0/463067767 wait complete. 2023-10-24T00:29:44.942 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:44.947 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-24T00:29:44.780767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":200,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379520,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595200,"statfs":{"total":773094113280,"available":770657484800,"internally_reserved":0,"allocated":2818048,"data_stored":1133418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.585878"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282508+0000","last_change":"2023-10-24T00:29:41.282508+0000","last_active":"2023-10-24T00:29:41.282508+0000","last_peered":"2023-10-24T00:29:41.282508+0000","last_clean":"2023-10-24T00:29:41.282508+0000","last_became_active":"2023-10-24T00:29:41.282208+0000","last_became_peered":"2023-10-24T00:29:41.282208+0000","last_unstale":"2023-10-24T00:29:41.282508+0000","last_undegraded":"2023-10-24T00:29:41.282508+0000","last_fullsized":"2023-10-24T00:29:41.282508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890350+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885444+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913085+0000","last_change":"2023-10-24T00:29:40.911353+0000","last_active":"2023-10-24T00:29:40.913085+0000","last_peered":"2023-10-24T00:29:40.913085+0000","last_clean":"2023-10-24T00:29:40.913085+0000","last_became_active":"2023-10-24T00:29:40.911057+0000","last_became_peered":"2023-10-24T00:29:40.911057+0000","last_unstale":"2023-10-24T00:29:40.913085+0000","last_undegraded":"2023-10-24T00:29:40.913085+0000","last_fullsized":"2023-10-24T00:29:40.913085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.883087+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260670+0000","last_change":"2023-10-24T00:29:40.896011+0000","last_active":"2023-10-24T00:29:41.260670+0000","last_peered":"2023-10-24T00:29:41.260670+0000","last_clean":"2023-10-24T00:29:41.260670+0000","last_became_active":"2023-10-24T00:29:40.895711+0000","last_became_peered":"2023-10-24T00:29:40.895711+0000","last_unstale":"2023-10-24T00:29:41.260670+0000","last_undegraded":"2023-10-24T00:29:41.260670+0000","last_fullsized":"2023-10-24T00:29:41.260670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281385+0000","last_change":"2023-10-24T00:29:41.281385+0000","last_active":"2023-10-24T00:29:41.281385+0000","last_peered":"2023-10-24T00:29:41.281385+0000","last_clean":"2023-10-24T00:29:41.281385+0000","last_became_active":"2023-10-24T00:29:41.281043+0000","last_became_peered":"2023-10-24T00:29:41.281043+0000","last_unstale":"2023-10-24T00:29:41.281385+0000","last_undegraded":"2023-10-24T00:29:41.281385+0000","last_fullsized":"2023-10-24T00:29:41.281385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885197+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915110+0000","last_change":"2023-10-24T00:29:40.909172+0000","last_active":"2023-10-24T00:29:40.915110+0000","last_peered":"2023-10-24T00:29:40.915110+0000","last_clean":"2023-10-24T00:29:40.915110+0000","last_became_active":"2023-10-24T00:29:40.908746+0000","last_became_peered":"2023-10-24T00:29:40.908746+0000","last_unstale":"2023-10-24T00:29:40.915110+0000","last_undegraded":"2023-10-24T00:29:40.915110+0000","last_fullsized":"2023-10-24T00:29:40.915110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282681+0000","last_change":"2023-10-24T00:29:41.282681+0000","last_active":"2023-10-24T00:29:41.282681+0000","last_peered":"2023-10-24T00:29:41.282681+0000","last_clean":"2023-10-24T00:29:41.282681+0000","last_became_active":"2023-10-24T00:29:41.282332+0000","last_became_peered":"2023-10-24T00:29:41.282332+0000","last_unstale":"2023-10-24T00:29:41.282681+0000","last_undegraded":"2023-10-24T00:29:41.282681+0000","last_fullsized":"2023-10-24T00:29:41.282681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908108+0000","last_change":"2023-10-24T00:29:40.904330+0000","last_active":"2023-10-24T00:29:40.908108+0000","last_peered":"2023-10-24T00:29:40.908108+0000","last_clean":"2023-10-24T00:29:40.908108+0000","last_became_active":"2023-10-24T00:29:40.903980+0000","last_became_peered":"2023-10-24T00:29:40.903980+0000","last_unstale":"2023-10-24T00:29:40.908108+0000","last_undegraded":"2023-10-24T00:29:40.908108+0000","last_fullsized":"2023-10-24T00:29:40.908108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884858+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284715+0000","last_change":"2023-10-24T00:29:41.284715+0000","last_active":"2023-10-24T00:29:41.284715+0000","last_peered":"2023-10-24T00:29:41.284715+0000","last_clean":"2023-10-24T00:29:41.284715+0000","last_became_active":"2023-10-24T00:29:41.284417+0000","last_became_peered":"2023-10-24T00:29:41.284417+0000","last_unstale":"2023-10-24T00:29:41.284715+0000","last_undegraded":"2023-10-24T00:29:41.284715+0000","last_fullsized":"2023-10-24T00:29:41.284715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882965+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279331+0000","last_change":"2023-10-24T00:29:41.279331+0000","last_active":"2023-10-24T00:29:41.279331+0000","last_peered":"2023-10-24T00:29:41.279331+0000","last_clean":"2023-10-24T00:29:41.279331+0000","last_became_active":"2023-10-24T00:29:41.279005+0000","last_became_peered":"2023-10-24T00:29:41.279005+0000","last_unstale":"2023-10-24T00:29:41.279331+0000","last_undegraded":"2023-10-24T00:29:41.279331+0000","last_fullsized":"2023-10-24T00:29:41.279331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.910647+0000","last_change":"2023-10-24T00:29:40.908076+0000","last_active":"2023-10-24T00:29:40.910647+0000","last_peered":"2023-10-24T00:29:40.910647+0000","last_clean":"2023-10-24T00:29:40.910647+0000","last_became_active":"2023-10-24T00:29:40.907720+0000","last_became_peered":"2023-10-24T00:29:40.907720+0000","last_unstale":"2023-10-24T00:29:40.910647+0000","last_undegraded":"2023-10-24T00:29:40.910647+0000","last_fullsized":"2023-10-24T00:29:40.910647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284689+0000","last_change":"2023-10-24T00:29:40.909485+0000","last_active":"2023-10-24T00:29:41.284689+0000","last_peered":"2023-10-24T00:29:41.284689+0000","last_clean":"2023-10-24T00:29:41.284689+0000","last_became_active":"2023-10-24T00:29:40.909207+0000","last_became_peered":"2023-10-24T00:29:40.909207+0000","last_unstale":"2023-10-24T00:29:41.284689+0000","last_undegraded":"2023-10-24T00:29:41.284689+0000","last_fullsized":"2023-10-24T00:29:41.284689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278399+0000","last_change":"2023-10-24T00:29:41.278399+0000","last_active":"2023-10-24T00:29:41.278399+0000","last_peered":"2023-10-24T00:29:41.278399+0000","last_clean":"2023-10-24T00:29:41.278399+0000","last_became_active":"2023-10-24T00:29:41.277871+0000","last_became_peered":"2023-10-24T00:29:41.277871+0000","last_unstale":"2023-10-24T00:29:41.278399+0000","last_undegraded":"2023-10-24T00:29:41.278399+0000","last_fullsized":"2023-10-24T00:29:41.278399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260648+0000","last_change":"2023-10-24T00:29:40.901458+0000","last_active":"2023-10-24T00:29:41.260648+0000","last_peered":"2023-10-24T00:29:41.260648+0000","last_clean":"2023-10-24T00:29:41.260648+0000","last_became_active":"2023-10-24T00:29:40.901103+0000","last_became_peered":"2023-10-24T00:29:40.901103+0000","last_unstale":"2023-10-24T00:29:41.260648+0000","last_undegraded":"2023-10-24T00:29:41.260648+0000","last_fullsized":"2023-10-24T00:29:41.260648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276984+0000","last_change":"2023-10-24T00:29:41.276984+0000","last_active":"2023-10-24T00:29:41.276984+0000","last_peered":"2023-10-24T00:29:41.276984+0000","last_clean":"2023-10-24T00:29:41.276984+0000","last_became_active":"2023-10-24T00:29:41.276711+0000","last_became_peered":"2023-10-24T00:29:41.276711+0000","last_unstale":"2023-10-24T00:29:41.276984+0000","last_undegraded":"2023-10-24T00:29:41.276984+0000","last_fullsized":"2023-10-24T00:29:41.276984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884557+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.911924+0000","last_change":"2023-10-24T00:29:40.907877+0000","last_active":"2023-10-24T00:29:40.911924+0000","last_peered":"2023-10-24T00:29:40.911924+0000","last_clean":"2023-10-24T00:29:40.911924+0000","last_became_active":"2023-10-24T00:29:40.907520+0000","last_became_peered":"2023-10-24T00:29:40.907520+0000","last_unstale":"2023-10-24T00:29:40.911924+0000","last_undegraded":"2023-10-24T00:29:40.911924+0000","last_fullsized":"2023-10-24T00:29:40.911924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279222+0000","last_change":"2023-10-24T00:29:41.279222+0000","last_active":"2023-10-24T00:29:41.279222+0000","last_peered":"2023-10-24T00:29:41.279222+0000","last_clean":"2023-10-24T00:29:41.279222+0000","last_became_active":"2023-10-24T00:29:41.278945+0000","last_became_peered":"2023-10-24T00:29:41.278945+0000","last_unstale":"2023-10-24T00:29:41.279222+0000","last_undegraded":"2023-10-24T00:29:41.279222+0000","last_fullsized":"2023-10-24T00:29:41.279222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272957+0000","last_change":"2023-10-24T00:29:40.907495+0000","last_active":"2023-10-24T00:29:41.272957+0000","last_peered":"2023-10-24T00:29:41.272957+0000","last_clean":"2023-10-24T00:29:41.272957+0000","last_became_active":"2023-10-24T00:29:40.907255+0000","last_became_peered":"2023-10-24T00:29:40.907255+0000","last_unstale":"2023-10-24T00:29:41.272957+0000","last_undegraded":"2023-10-24T00:29:41.272957+0000","last_fullsized":"2023-10-24T00:29:41.272957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915149+0000","last_change":"2023-10-24T00:29:40.909325+0000","last_active":"2023-10-24T00:29:40.915149+0000","last_peered":"2023-10-24T00:29:40.915149+0000","last_clean":"2023-10-24T00:29:40.915149+0000","last_became_active":"2023-10-24T00:29:40.909009+0000","last_became_peered":"2023-10-24T00:29:40.909009+0000","last_unstale":"2023-10-24T00:29:40.915149+0000","last_undegraded":"2023-10-24T00:29:40.915149+0000","last_fullsized":"2023-10-24T00:29:40.915149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275585+0000","last_change":"2023-10-24T00:29:41.275585+0000","last_active":"2023-10-24T00:29:41.275585+0000","last_peered":"2023-10-24T00:29:41.275585+0000","last_clean":"2023-10-24T00:29:41.275585+0000","last_became_active":"2023-10-24T00:29:41.275266+0000","last_became_peered":"2023-10-24T00:29:41.275266+0000","last_unstale":"2023-10-24T00:29:41.275585+0000","last_undegraded":"2023-10-24T00:29:41.275585+0000","last_fullsized":"2023-10-24T00:29:41.275585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884631+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884803+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280428+0000","last_change":"2023-10-24T00:29:41.280428+0000","last_active":"2023-10-24T00:29:41.280428+0000","last_peered":"2023-10-24T00:29:41.280428+0000","last_clean":"2023-10-24T00:29:41.280428+0000","last_became_active":"2023-10-24T00:29:41.279677+0000","last_became_peered":"2023-10-24T00:29:41.279677+0000","last_unstale":"2023-10-24T00:29:41.280428+0000","last_undegraded":"2023-10-24T00:29:41.280428+0000","last_fullsized":"2023-10-24T00:29:41.280428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915620+0000","last_change":"2023-10-24T00:29:40.911768+0000","last_active":"2023-10-24T00:29:40.915620+0000","last_peered":"2023-10-24T00:29:40.915620+0000","last_clean":"2023-10-24T00:29:40.915620+0000","last_became_active":"2023-10-24T00:29:40.911432+0000","last_became_peered":"2023-10-24T00:29:40.911432+0000","last_unstale":"2023-10-24T00:29:40.915620+0000","last_undegraded":"2023-10-24T00:29:40.915620+0000","last_fullsized":"2023-10-24T00:29:40.915620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273672+0000","last_change":"2023-10-24T00:29:41.273672+0000","last_active":"2023-10-24T00:29:41.273672+0000","last_peered":"2023-10-24T00:29:41.273672+0000","last_clean":"2023-10-24T00:29:41.273672+0000","last_became_active":"2023-10-24T00:29:41.273229+0000","last_became_peered":"2023-10-24T00:29:41.273229+0000","last_unstale":"2023-10-24T00:29:41.273672+0000","last_undegraded":"2023-10-24T00:29:41.273672+0000","last_fullsized":"2023-10-24T00:29:41.273672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885009+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273562+0000","last_change":"2023-10-24T00:29:41.273562+0000","last_active":"2023-10-24T00:29:41.273562+0000","last_peered":"2023-10-24T00:29:41.273562+0000","last_clean":"2023-10-24T00:29:41.273562+0000","last_became_active":"2023-10-24T00:29:41.273232+0000","last_became_peered":"2023-10-24T00:29:41.273232+0000","last_unstale":"2023-10-24T00:29:41.273562+0000","last_undegraded":"2023-10-24T00:29:41.273562+0000","last_fullsized":"2023-10-24T00:29:41.273562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884690+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887721+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279922+0000","last_change":"2023-10-24T00:29:41.279922+0000","last_active":"2023-10-24T00:29:41.279922+0000","last_peered":"2023-10-24T00:29:41.279922+0000","last_clean":"2023-10-24T00:29:41.279922+0000","last_became_active":"2023-10-24T00:29:41.279200+0000","last_became_peered":"2023-10-24T00:29:41.279200+0000","last_unstale":"2023-10-24T00:29:41.279922+0000","last_undegraded":"2023-10-24T00:29:41.279922+0000","last_fullsized":"2023-10-24T00:29:41.279922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912648+0000","last_change":"2023-10-24T00:29:40.909194+0000","last_active":"2023-10-24T00:29:40.912648+0000","last_peered":"2023-10-24T00:29:40.912648+0000","last_clean":"2023-10-24T00:29:40.912648+0000","last_became_active":"2023-10-24T00:29:40.908896+0000","last_became_peered":"2023-10-24T00:29:40.908896+0000","last_unstale":"2023-10-24T00:29:40.912648+0000","last_undegraded":"2023-10-24T00:29:40.912648+0000","last_fullsized":"2023-10-24T00:29:40.912648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281694+0000","last_change":"2023-10-24T00:29:41.281694+0000","last_active":"2023-10-24T00:29:41.281694+0000","last_peered":"2023-10-24T00:29:41.281694+0000","last_clean":"2023-10-24T00:29:41.281694+0000","last_became_active":"2023-10-24T00:29:41.281285+0000","last_became_peered":"2023-10-24T00:29:41.281285+0000","last_unstale":"2023-10-24T00:29:41.281694+0000","last_undegraded":"2023-10-24T00:29:41.281694+0000","last_fullsized":"2023-10-24T00:29:41.281694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882942+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885041+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882933+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913026+0000","last_change":"2023-10-24T00:29:40.910828+0000","last_active":"2023-10-24T00:29:40.913026+0000","last_peered":"2023-10-24T00:29:40.913026+0000","last_clean":"2023-10-24T00:29:40.913026+0000","last_became_active":"2023-10-24T00:29:40.910440+0000","last_became_peered":"2023-10-24T00:29:40.910440+0000","last_unstale":"2023-10-24T00:29:40.913026+0000","last_undegraded":"2023-10-24T00:29:40.913026+0000","last_fullsized":"2023-10-24T00:29:40.913026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884505+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275537+0000","last_change":"2023-10-24T00:29:41.275537+0000","last_active":"2023-10-24T00:29:41.275537+0000","last_peered":"2023-10-24T00:29:41.275537+0000","last_clean":"2023-10-24T00:29:41.275537+0000","last_became_active":"2023-10-24T00:29:41.275261+0000","last_became_peered":"2023-10-24T00:29:41.275261+0000","last_unstale":"2023-10-24T00:29:41.275537+0000","last_undegraded":"2023-10-24T00:29:41.275537+0000","last_fullsized":"2023-10-24T00:29:41.275537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915163+0000","last_change":"2023-10-24T00:29:40.909407+0000","last_active":"2023-10-24T00:29:40.915163+0000","last_peered":"2023-10-24T00:29:40.915163+0000","last_clean":"2023-10-24T00:29:40.915163+0000","last_became_active":"2023-10-24T00:29:40.908984+0000","last_became_peered":"2023-10-24T00:29:40.908984+0000","last_unstale":"2023-10-24T00:29:40.915163+0000","last_undegraded":"2023-10-24T00:29:40.915163+0000","last_fullsized":"2023-10-24T00:29:40.915163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.900536+0000","last_change":"2023-10-24T00:29:40.899421+0000","last_active":"2023-10-24T00:29:40.900536+0000","last_peered":"2023-10-24T00:29:40.900536+0000","last_clean":"2023-10-24T00:29:40.900536+0000","last_became_active":"2023-10-24T00:29:40.898728+0000","last_became_peered":"2023-10-24T00:29:40.898728+0000","last_unstale":"2023-10-24T00:29:40.900536+0000","last_undegraded":"2023-10-24T00:29:40.900536+0000","last_fullsized":"2023-10-24T00:29:40.900536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274440+0000","last_change":"2023-10-24T00:29:41.274440+0000","last_active":"2023-10-24T00:29:41.274440+0000","last_peered":"2023-10-24T00:29:41.274440+0000","last_clean":"2023-10-24T00:29:41.274440+0000","last_became_active":"2023-10-24T00:29:41.274130+0000","last_became_peered":"2023-10-24T00:29:41.274130+0000","last_unstale":"2023-10-24T00:29:41.274440+0000","last_undegraded":"2023-10-24T00:29:41.274440+0000","last_fullsized":"2023-10-24T00:29:41.274440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.888182+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882489+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887336+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912713+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:40.912713+0000","last_peered":"2023-10-24T00:29:40.912713+0000","last_clean":"2023-10-24T00:29:40.912713+0000","last_became_active":"2023-10-24T00:29:40.908574+0000","last_became_peered":"2023-10-24T00:29:40.908574+0000","last_unstale":"2023-10-24T00:29:40.912713+0000","last_undegraded":"2023-10-24T00:29:40.912713+0000","last_fullsized":"2023-10-24T00:29:40.912713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280110+0000","last_change":"2023-10-24T00:29:41.280110+0000","last_active":"2023-10-24T00:29:41.280110+0000","last_peered":"2023-10-24T00:29:41.280110+0000","last_clean":"2023-10-24T00:29:41.280110+0000","last_became_active":"2023-10-24T00:29:41.279056+0000","last_became_peered":"2023-10-24T00:29:41.279056+0000","last_unstale":"2023-10-24T00:29:41.280110+0000","last_undegraded":"2023-10-24T00:29:41.280110+0000","last_fullsized":"2023-10-24T00:29:41.280110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.904760+0000","last_change":"2023-10-24T00:29:40.900962+0000","last_active":"2023-10-24T00:29:40.904760+0000","last_peered":"2023-10-24T00:29:40.904760+0000","last_clean":"2023-10-24T00:29:40.904760+0000","last_became_active":"2023-10-24T00:29:40.900707+0000","last_became_peered":"2023-10-24T00:29:40.900707+0000","last_unstale":"2023-10-24T00:29:40.904760+0000","last_undegraded":"2023-10-24T00:29:40.904760+0000","last_fullsized":"2023-10-24T00:29:40.904760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882492+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884525+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282531+0000","last_change":"2023-10-24T00:29:41.282531+0000","last_active":"2023-10-24T00:29:41.282531+0000","last_peered":"2023-10-24T00:29:41.282531+0000","last_clean":"2023-10-24T00:29:41.282531+0000","last_became_active":"2023-10-24T00:29:41.282183+0000","last_became_peered":"2023-10-24T00:29:41.282183+0000","last_unstale":"2023-10-24T00:29:41.282531+0000","last_undegraded":"2023-10-24T00:29:41.282531+0000","last_fullsized":"2023-10-24T00:29:41.282531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885545+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277528+0000","last_change":"2023-10-24T00:29:41.277528+0000","last_active":"2023-10-24T00:29:41.277528+0000","last_peered":"2023-10-24T00:29:41.277528+0000","last_clean":"2023-10-24T00:29:41.277528+0000","last_became_active":"2023-10-24T00:29:41.277225+0000","last_became_peered":"2023-10-24T00:29:41.277225+0000","last_unstale":"2023-10-24T00:29:41.277528+0000","last_undegraded":"2023-10-24T00:29:41.277528+0000","last_fullsized":"2023-10-24T00:29:41.277528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912990+0000","last_change":"2023-10-24T00:29:40.910398+0000","last_active":"2023-10-24T00:29:40.912990+0000","last_peered":"2023-10-24T00:29:40.912990+0000","last_clean":"2023-10-24T00:29:40.912990+0000","last_became_active":"2023-10-24T00:29:40.910084+0000","last_became_peered":"2023-10-24T00:29:40.910084+0000","last_unstale":"2023-10-24T00:29:40.912990+0000","last_undegraded":"2023-10-24T00:29:40.912990+0000","last_fullsized":"2023-10-24T00:29:40.912990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280101+0000","last_change":"2023-10-24T00:29:40.911169+0000","last_active":"2023-10-24T00:29:41.280101+0000","last_peered":"2023-10-24T00:29:41.280101+0000","last_clean":"2023-10-24T00:29:41.280101+0000","last_became_active":"2023-10-24T00:29:40.910890+0000","last_became_peered":"2023-10-24T00:29:40.910890+0000","last_unstale":"2023-10-24T00:29:41.280101+0000","last_undegraded":"2023-10-24T00:29:41.280101+0000","last_fullsized":"2023-10-24T00:29:41.280101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884549+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884530+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882493+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276786+0000","last_change":"2023-10-24T00:29:41.276786+0000","last_active":"2023-10-24T00:29:41.276786+0000","last_peered":"2023-10-24T00:29:41.276786+0000","last_clean":"2023-10-24T00:29:41.276786+0000","last_became_active":"2023-10-24T00:29:41.276496+0000","last_became_peered":"2023-10-24T00:29:41.276496+0000","last_unstale":"2023-10-24T00:29:41.276786+0000","last_undegraded":"2023-10-24T00:29:41.276786+0000","last_fullsized":"2023-10-24T00:29:41.276786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890250+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272860+0000","last_change":"2023-10-24T00:29:40.899606+0000","last_active":"2023-10-24T00:29:41.272860+0000","last_peered":"2023-10-24T00:29:41.272860+0000","last_clean":"2023-10-24T00:29:41.272860+0000","last_became_active":"2023-10-24T00:29:40.899105+0000","last_became_peered":"2023-10-24T00:29:40.899105+0000","last_unstale":"2023-10-24T00:29:41.272860+0000","last_undegraded":"2023-10-24T00:29:41.272860+0000","last_fullsized":"2023-10-24T00:29:41.272860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271459+0000","last_change":"2023-10-24T00:29:40.910529+0000","last_active":"2023-10-24T00:29:41.271459+0000","last_peered":"2023-10-24T00:29:41.271459+0000","last_clean":"2023-10-24T00:29:41.271459+0000","last_became_active":"2023-10-24T00:29:40.910236+0000","last_became_peered":"2023-10-24T00:29:40.910236+0000","last_unstale":"2023-10-24T00:29:41.271459+0000","last_undegraded":"2023-10-24T00:29:41.271459+0000","last_fullsized":"2023-10-24T00:29:41.271459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284279+0000","last_change":"2023-10-24T00:29:41.284279+0000","last_active":"2023-10-24T00:29:41.284279+0000","last_peered":"2023-10-24T00:29:41.284279+0000","last_clean":"2023-10-24T00:29:41.284279+0000","last_became_active":"2023-10-24T00:29:41.279681+0000","last_became_peered":"2023-10-24T00:29:41.279681+0000","last_unstale":"2023-10-24T00:29:41.284279+0000","last_undegraded":"2023-10-24T00:29:41.284279+0000","last_fullsized":"2023-10-24T00:29:41.284279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885096+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.907850+0000","last_change":"2023-10-24T00:29:40.904046+0000","last_active":"2023-10-24T00:29:40.907850+0000","last_peered":"2023-10-24T00:29:40.907850+0000","last_clean":"2023-10-24T00:29:40.907850+0000","last_became_active":"2023-10-24T00:29:40.903723+0000","last_became_peered":"2023-10-24T00:29:40.903723+0000","last_unstale":"2023-10-24T00:29:40.907850+0000","last_undegraded":"2023-10-24T00:29:40.907850+0000","last_fullsized":"2023-10-24T00:29:40.907850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272804+0000","last_change":"2023-10-24T00:29:41.272804+0000","last_active":"2023-10-24T00:29:41.272804+0000","last_peered":"2023-10-24T00:29:41.272804+0000","last_clean":"2023-10-24T00:29:41.272804+0000","last_became_active":"2023-10-24T00:29:41.272528+0000","last_became_peered":"2023-10-24T00:29:41.272528+0000","last_unstale":"2023-10-24T00:29:41.272804+0000","last_undegraded":"2023-10-24T00:29:41.272804+0000","last_fullsized":"2023-10-24T00:29:41.272804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.880635+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278176+0000","last_change":"2023-10-24T00:29:41.278176+0000","last_active":"2023-10-24T00:29:41.278176+0000","last_peered":"2023-10-24T00:29:41.278176+0000","last_clean":"2023-10-24T00:29:41.278176+0000","last_became_active":"2023-10-24T00:29:41.276898+0000","last_became_peered":"2023-10-24T00:29:41.276898+0000","last_unstale":"2023-10-24T00:29:41.278176+0000","last_undegraded":"2023-10-24T00:29:41.278176+0000","last_fullsized":"2023-10-24T00:29:41.278176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260764+0000","last_change":"2023-10-24T00:29:40.904817+0000","last_active":"2023-10-24T00:29:41.260764+0000","last_peered":"2023-10-24T00:29:41.260764+0000","last_clean":"2023-10-24T00:29:41.260764+0000","last_became_active":"2023-10-24T00:29:40.904554+0000","last_became_peered":"2023-10-24T00:29:40.904554+0000","last_unstale":"2023-10-24T00:29:41.260764+0000","last_undegraded":"2023-10-24T00:29:41.260764+0000","last_fullsized":"2023-10-24T00:29:41.260764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.903731+0000","last_change":"2023-10-24T00:29:40.899587+0000","last_active":"2023-10-24T00:29:40.903731+0000","last_peered":"2023-10-24T00:29:40.903731+0000","last_clean":"2023-10-24T00:29:40.903731+0000","last_became_active":"2023-10-24T00:29:40.899281+0000","last_became_peered":"2023-10-24T00:29:40.899281+0000","last_unstale":"2023-10-24T00:29:40.903731+0000","last_undegraded":"2023-10-24T00:29:40.903731+0000","last_fullsized":"2023-10-24T00:29:40.903731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274908+0000","last_change":"2023-10-24T00:29:41.274908+0000","last_active":"2023-10-24T00:29:41.274908+0000","last_peered":"2023-10-24T00:29:41.274908+0000","last_clean":"2023-10-24T00:29:41.274908+0000","last_became_active":"2023-10-24T00:29:41.274570+0000","last_became_peered":"2023-10-24T00:29:41.274570+0000","last_unstale":"2023-10-24T00:29:41.274908+0000","last_undegraded":"2023-10-24T00:29:41.274908+0000","last_fullsized":"2023-10-24T00:29:41.274908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908183+0000","last_change":"2023-10-24T00:29:40.903507+0000","last_active":"2023-10-24T00:29:40.908183+0000","last_peered":"2023-10-24T00:29:40.908183+0000","last_clean":"2023-10-24T00:29:40.908183+0000","last_became_active":"2023-10-24T00:29:40.903175+0000","last_became_peered":"2023-10-24T00:29:40.903175+0000","last_unstale":"2023-10-24T00:29:40.908183+0000","last_undegraded":"2023-10-24T00:29:40.908183+0000","last_fullsized":"2023-10-24T00:29:40.908183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.899874+0000","last_change":"2023-10-24T00:29:40.897887+0000","last_active":"2023-10-24T00:29:40.899874+0000","last_peered":"2023-10-24T00:29:40.899874+0000","last_clean":"2023-10-24T00:29:40.899874+0000","last_became_active":"2023-10-24T00:29:40.897165+0000","last_became_peered":"2023-10-24T00:29:40.897165+0000","last_unstale":"2023-10-24T00:29:40.899874+0000","last_undegraded":"2023-10-24T00:29:40.899874+0000","last_fullsized":"2023-10-24T00:29:40.899874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887726+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887760+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.898546+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:29:40.898546+0000","last_peered":"2023-10-24T00:29:40.898546+0000","last_clean":"2023-10-24T00:29:40.898546+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:29:40.898546+0000","last_undegraded":"2023-10-24T00:29:40.898546+0000","last_fullsized":"2023-10-24T00:29:40.898546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275099+0000","last_change":"2023-10-24T00:29:41.275099+0000","last_active":"2023-10-24T00:29:41.275099+0000","last_peered":"2023-10-24T00:29:41.275099+0000","last_clean":"2023-10-24T00:29:41.275099+0000","last_became_active":"2023-10-24T00:29:41.273851+0000","last_became_peered":"2023-10-24T00:29:41.273851+0000","last_unstale":"2023-10-24T00:29:41.275099+0000","last_undegraded":"2023-10-24T00:29:41.275099+0000","last_fullsized":"2023-10-24T00:29:41.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915220+0000","last_change":"2023-10-24T00:29:40.908757+0000","last_active":"2023-10-24T00:29:40.915220+0000","last_peered":"2023-10-24T00:29:40.915220+0000","last_clean":"2023-10-24T00:29:40.915220+0000","last_became_active":"2023-10-24T00:29:40.908448+0000","last_became_peered":"2023-10-24T00:29:40.908448+0000","last_unstale":"2023-10-24T00:29:40.915220+0000","last_undegraded":"2023-10-24T00:29:40.915220+0000","last_fullsized":"2023-10-24T00:29:40.915220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.887884+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:29:40.887884+0000","last_peered":"2023-10-24T00:29:40.887884+0000","last_clean":"2023-10-24T00:29:40.887884+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:29:40.887884+0000","last_undegraded":"2023-10-24T00:29:40.887884+0000","last_fullsized":"2023-10-24T00:29:40.887884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284246+0000","last_change":"2023-10-24T00:29:41.284246+0000","last_active":"2023-10-24T00:29:41.284246+0000","last_peered":"2023-10-24T00:29:41.284246+0000","last_clean":"2023-10-24T00:29:41.284246+0000","last_became_active":"2023-10-24T00:29:41.280875+0000","last_became_peered":"2023-10-24T00:29:41.280875+0000","last_unstale":"2023-10-24T00:29:41.284246+0000","last_undegraded":"2023-10-24T00:29:41.284246+0000","last_fullsized":"2023-10-24T00:29:41.284246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908095+0000","last_change":"2023-10-24T00:29:40.904270+0000","last_active":"2023-10-24T00:29:40.908095+0000","last_peered":"2023-10-24T00:29:40.908095+0000","last_clean":"2023-10-24T00:29:40.908095+0000","last_became_active":"2023-10-24T00:29:40.903932+0000","last_became_peered":"2023-10-24T00:29:40.903932+0000","last_unstale":"2023-10-24T00:29:40.908095+0000","last_undegraded":"2023-10-24T00:29:40.908095+0000","last_fullsized":"2023-10-24T00:29:40.908095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.895909+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:29:40.895909+0000","last_peered":"2023-10-24T00:29:40.895909+0000","last_clean":"2023-10-24T00:29:40.895909+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:29:40.895909+0000","last_undegraded":"2023-10-24T00:29:40.895909+0000","last_fullsized":"2023-10-24T00:29:40.895909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890293+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:29:40.890293+0000","last_peered":"2023-10-24T00:29:40.890293+0000","last_clean":"2023-10-24T00:29:40.890293+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:29:40.890293+0000","last_undegraded":"2023-10-24T00:29:40.890293+0000","last_fullsized":"2023-10-24T00:29:40.890293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284475+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.284475+0000","last_peered":"2023-10-24T00:29:41.284475+0000","last_clean":"2023-10-24T00:29:41.284475+0000","last_became_active":"2023-10-24T00:29:40.908367+0000","last_became_peered":"2023-10-24T00:29:40.908367+0000","last_unstale":"2023-10-24T00:29:41.284475+0000","last_undegraded":"2023-10-24T00:29:41.284475+0000","last_fullsized":"2023-10-24T00:29:41.284475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890706+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:29:40.890706+0000","last_peered":"2023-10-24T00:29:40.890706+0000","last_clean":"2023-10-24T00:29:40.890706+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:29:40.890706+0000","last_undegraded":"2023-10-24T00:29:40.890706+0000","last_fullsized":"2023-10-24T00:29:40.890706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889739+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.894423+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:29:40.894423+0000","last_peered":"2023-10-24T00:29:40.894423+0000","last_clean":"2023-10-24T00:29:40.894423+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:29:40.894423+0000","last_undegraded":"2023-10-24T00:29:40.894423+0000","last_fullsized":"2023-10-24T00:29:40.894423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884655+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273553+0000","last_change":"2023-10-24T00:29:41.273553+0000","last_active":"2023-10-24T00:29:41.273553+0000","last_peered":"2023-10-24T00:29:41.273553+0000","last_clean":"2023-10-24T00:29:41.273553+0000","last_became_active":"2023-10-24T00:29:41.273266+0000","last_became_peered":"2023-10-24T00:29:41.273266+0000","last_unstale":"2023-10-24T00:29:41.273553+0000","last_undegraded":"2023-10-24T00:29:41.273553+0000","last_fullsized":"2023-10-24T00:29:41.273553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884527+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.301374+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:29:35.301374+0000","last_peered":"2023-10-24T00:29:35.301374+0000","last_clean":"2023-10-24T00:29:35.301374+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:29:35.301374+0000","last_undegraded":"2023-10-24T00:29:35.301374+0000","last_fullsized":"2023-10-24T00:29:35.301374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":153434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2959999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2610000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":151876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:44.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-10-24T00:29:44.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.890350+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:29:44.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-10-24T00:29:44.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-24T00:29:44.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885444+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-24T00:29:44.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-24T00:29:44.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-10-24T00:29:44.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.883087+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-24T00:29:44.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-24T00:29:44.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885197+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-10-24T00:29:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-10-24T00:29:44.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-10-24T00:29:44.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884858+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-10-24T00:29:44.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882965+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-10-24T00:29:44.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-24T00:29:44.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884557+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-10-24T00:29:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-10-24T00:29:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-24T00:29:44.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884631+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-10-24T00:29:44.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-24T00:29:44.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884803+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-10-24T00:29:44.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885009+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-10-24T00:29:44.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884690+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-10-24T00:29:44.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-10-24T00:29:44.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.887721+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:29:44.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-10-24T00:29:44.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882942+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-10-24T00:29:44.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-24T00:29:44.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885041+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-10-24T00:29:44.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-10-24T00:29:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882933+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-10-24T00:29:44.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-10-24T00:29:44.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-10-24T00:29:44.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884505+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-10-24T00:29:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-10-24T00:29:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.889779+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:29:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-10-24T00:29:44.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-24T00:29:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.889779+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:29:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-24T00:29:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-24T00:29:44.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.888182+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:29:44.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-24T00:29:44.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-24T00:29:44.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882489+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-24T00:29:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-24T00:29:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.887336+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-24T00:29:44.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-24T00:29:44.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-24T00:29:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882492+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-24T00:29:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-24T00:29:44.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884525+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-24T00:29:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885545+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-24T00:29:44.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-24T00:29:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-24T00:29:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884549+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-24T00:29:44.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-24T00:29:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884530+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-24T00:29:44.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:44.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-24T00:29:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.882493+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-24T00:29:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.890250+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:29:45.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-24T00:29:45.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-24T00:29:45.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-24T00:29:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.885096+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-24T00:29:45.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-24T00:29:45.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.880635+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:29:45.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-24T00:29:45.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-24T00:29:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-24T00:29:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-24T00:29:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.887726+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:29:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-24T00:29:45.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-24T00:29:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.887760+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:29:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-24T00:29:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-24T00:29:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-24T00:29:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.889739+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:29:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-24T00:29:45.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:29:40.878302+0000', 'last_change': '2023-10-24T00:29:40.878302+0000', 'last_active': '2023-10-24T00:29:40.878302+0000', 'last_peered': '2023-10-24T00:29:40.878302+0000', 'last_clean': '2023-10-24T00:29:40.878302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:40.878302+0000', 'last_undegraded': '2023-10-24T00:29:40.878302+0000', 'last_fullsized': '2023-10-24T00:29:40.878302+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:40.878302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:29:45.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-24T00:29:45.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884655+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:29:45.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-24T00:29:45.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:29:39.873877+0000', 'last_change': '2023-10-24T00:29:39.884527+0000', 'last_active': '2023-10-24T00:29:39.873877+0000', 'last_peered': '2023-10-24T00:29:39.873877+0000', 'last_clean': '2023-10-24T00:29:39.873877+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:29:39.873877+0000', 'last_undegraded': '2023-10-24T00:29:39.873877+0000', 'last_fullsized': '2023-10-24T00:29:39.873877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'last_clean_scrub_stamp': '2023-10-24T00:29:39.873877+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:29:45.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:29:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.125+0000 7f2441283700 1 Processor -- start 2023-10-24T00:29:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 -- start start 2023-10-24T00:29:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0c45f0 con 0x7f243c0a7d70 2023-10-24T00:29:45.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c0bef90 con 0x7f243c0be740 2023-10-24T00:29:45.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.126+0000 7f2441283700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0bf270 con 0x7f243c152240 2023-10-24T00:29:45.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f24327fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54238/0 (socket says 172.21.15.148:54238) 2023-10-24T00:29:45.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f24327fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:49502/0 (socket says 172.21.15.148:49502) 2023-10-24T00:29:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 -- 172.21.15.148:0/2513284687 learned_addr learned my addr 172.21.15.148:0/2513284687 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 -- 172.21.15.148:0/2513284687 >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 msgr2=0x7f243c0c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:45.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 --2- 172.21.15.148:0/2513284687 >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 -- 172.21.15.148:0/2513284687 >> v1:172.21.15.150:6789/0 conn(0x7f243c0a7d70 legacy=0x7f243c0a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 -- 172.21.15.148:0/2513284687 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0c3fa0 con 0x7f243c152240 2023-10-24T00:29:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243a7fc700 1 -- 172.21.15.148:0/2513284687 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655333465 0 0) 0x7f243c0c45f0 con 0x7f243c0a7d70 2023-10-24T00:29:45.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f24327fc700 1 --2- 172.21.15.148:0/2513284687 >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243affd700 1 --2- 172.21.15.148:0/2513284687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f242c006fd0 tx=0x7f242c0090f0).ready entity=mon.2 client_cookie=e4378e1065c4fcda server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243a7fc700 1 -- 172.21.15.148:0/2513284687 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00b580 con 0x7f243c152240 2023-10-24T00:29:45.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243a7fc700 1 -- 172.21.15.148:0/2513284687 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00b6e0 con 0x7f243c152240 2023-10-24T00:29:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.127+0000 7f243a7fc700 1 -- 172.21.15.148:0/2513284687 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00ba60 con 0x7f243c152240 2023-10-24T00:29:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 -- 172.21.15.148:0/2513284687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 msgr2=0x7f243c0c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 --2- 172.21.15.148:0/2513284687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f242c006fd0 tx=0x7f242c0090f0).stop 2023-10-24T00:29:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 -- 172.21.15.148:0/2513284687 shutdown_connections 2023-10-24T00:29:45.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 --2- 172.21.15.148:0/2513284687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c6480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 --2- 172.21.15.148:0/2513284687 >> v2:172.21.15.150:3300/0 conn(0x7f243c0be740 0x7f243c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 -- 172.21.15.148:0/2513284687 >> 172.21.15.148:0/2513284687 conn(0x7f243c082f60 msgr2=0x7f243c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:45.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 -- 172.21.15.148:0/2513284687 shutdown_connections 2023-10-24T00:29:45.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.128+0000 7f2441283700 1 -- 172.21.15.148:0/2513284687 wait complete. 2023-10-24T00:29:45.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.129+0000 7f2441283700 1 Processor -- start 2023-10-24T00:29:45.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.129+0000 7f2441283700 1 -- start start 2023-10-24T00:29:45.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 0x7f243c0c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0bffd0 con 0x7f243c0a7d70 2023-10-24T00:29:45.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0c02b0 con 0x7f243c0be740 2023-10-24T00:29:45.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f2441283700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c0c0590 con 0x7f243c152240 2023-10-24T00:29:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46108/0 (socket says 172.21.15.148:46108) 2023-10-24T00:29:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 -- 172.21.15.148:0/761064783 learned_addr learned my addr 172.21.15.148:0/761064783 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243b7fe700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f24327fc700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 0x7f243c0c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 -- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 msgr2=0x7f243c0c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 -- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 msgr2=0x7f243c0c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 0x7f243c0c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f243affd700 1 -- 172.21.15.148:0/761064783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240092a0 con 0x7f243c0a7d70 2023-10-24T00:29:45.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.130+0000 7f24327fc700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 0x7f243c0c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f243affd700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f243c05f0f0 tx=0x7f242c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c006a40 con 0x7f243c0a7d70 2023-10-24T00:29:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00b850 con 0x7f243c0a7d70 2023-10-24T00:29:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c009370 con 0x7f243c0a7d70 2023-10-24T00:29:45.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c01c670 con 0x7f243c0a7d70 2023-10-24T00:29:45.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.131+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c0c0b50 con 0x7f243c0a7d70 2023-10-24T00:29:45.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.132+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c06c6b0 con 0x7f243c0a7d70 2023-10-24T00:29:45.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.132+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f242c01caa0 con 0x7f243c0a7d70 2023-10-24T00:29:45.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.133+0000 7f24337fe700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 0x7f241c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.133+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f242c07be30 con 0x7f243c0a7d70 2023-10-24T00:29:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.133+0000 7f24327fc700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 0x7f241c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.133+0000 7f24327fc700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 0x7f241c061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2424009270 tx=0x7f2424008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.137+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f242c04d100 con 0x7f243c0a7d70 2023-10-24T00:29:45.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.365+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f243c0c0ec0 con 0x7f243c0a7d70 2023-10-24T00:29:45.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.366+0000 7f24337fe700 1 -- 172.21.15.148:0/761064783 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2725 (secure 0 0 0) 0x7f242c050720 con 0x7f243c0a7d70 2023-10-24T00:29:45.369 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:45.369 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":69,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":65},{"state_name":"unknown","count":37},{"state_name":"creating+peering","count":35}],"num_pgs":137,"num_pools":4,"num_objects":12,"data_bytes":1004,"bytes_used":2436628480,"bytes_avail":770657484800,"bytes_total":773094113280,"unknown_pgs_ratio":0.27007299661636353,"inactive_pgs_ratio":0.25547444820404053},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5022}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-10-24T00:29:42.780401+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-24T00:29:45.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 msgr2=0x7f241c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 0x7f241c061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2424009270 tx=0x7f2424008040).stop 2023-10-24T00:29:45.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 msgr2=0x7f243c14d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f243c05f0f0 tx=0x7f242c017000).stop 2023-10-24T00:29:45.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 shutdown_connections 2023-10-24T00:29:45.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f243c152240 0x7f243c0c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f241c05f150 0x7f241c061610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f243c0a7d70 0x7f243c14d070 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 --2- 172.21.15.148:0/761064783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f243c0be740 0x7f243c0c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 >> 172.21.15.148:0/761064783 conn(0x7f243c082f60 msgr2=0x7f243c0abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:45.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 shutdown_connections 2023-10-24T00:29:45.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.368+0000 7f2441283700 1 -- 172.21.15.148:0/761064783 wait complete. 2023-10-24T00:29:45.381 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:29:45.382 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:45.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.493+0000 7fbc7e224700 1 Processor -- start 2023-10-24T00:29:45.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.493+0000 7fbc7e224700 1 -- start start 2023-10-24T00:29:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc7e224700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc780c6710 0x7fbc780c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc7e224700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc780aa820 con 0x7fbc780aa010 2023-10-24T00:29:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc7e224700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc780c0960 con 0x7fbc780aa3f0 2023-10-24T00:29:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc7e224700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780c0c40 con 0x7fbc780c6710 2023-10-24T00:29:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc777fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbc780aa010 0x7fbc78158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53534/0 (socket says 172.21.15.148:53534) 2023-10-24T00:29:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc777fe700 1 -- 172.21.15.148:0/1386228396 learned_addr learned my addr 172.21.15.148:0/1386228396 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc76ffd700 1 --2- 172.21.15.148:0/1386228396 >> v2:172.21.15.148:3300/0 conn(0x7fbc780c6710 0x7fbc780c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.494+0000 7fbc767fc700 1 -- 172.21.15.148:0/1386228396 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412883791 0 0) 0x7fbc780aa820 con 0x7fbc780aa010 2023-10-24T00:29:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc767fc700 1 -- 172.21.15.148:0/1386228396 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc600033f0 con 0x7fbc780aa010 2023-10-24T00:29:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc76ffd700 1 -- 172.21.15.148:0/1386228396 >> v1:172.21.15.150:6789/0 conn(0x7fbc780aa3f0 legacy=0x7fbc78069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc76ffd700 1 -- 172.21.15.148:0/1386228396 >> v1:172.21.15.148:6789/0 conn(0x7fbc780aa010 legacy=0x7fbc78158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc76ffd700 1 -- 172.21.15.148:0/1386228396 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780c0f20 con 0x7fbc780c6710 2023-10-24T00:29:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc76ffd700 1 --2- 172.21.15.148:0/1386228396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780c6710 0x7fbc780c1a00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbc6c009760 tx=0x7fbc6c009060).ready entity=mon.0 client_cookie=debe837de05ef164 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc767fc700 1 -- 172.21.15.148:0/1386228396 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f510 con 0x7fbc780c6710 2023-10-24T00:29:45.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc767fc700 1 -- 172.21.15.148:0/1386228396 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00f670 con 0x7fbc780c6710 2023-10-24T00:29:45.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc767fc700 1 -- 172.21.15.148:0/1386228396 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00f9f0 con 0x7fbc780c6710 2023-10-24T00:29:45.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 -- 172.21.15.148:0/1386228396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780c6710 msgr2=0x7fbc780c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 --2- 172.21.15.148:0/1386228396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780c6710 0x7fbc780c1a00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbc6c009760 tx=0x7fbc6c009060).stop 2023-10-24T00:29:45.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 -- 172.21.15.148:0/1386228396 shutdown_connections 2023-10-24T00:29:45.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 --2- 172.21.15.148:0/1386228396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780c6710 0x7fbc780c1a00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 -- 172.21.15.148:0/1386228396 >> 172.21.15.148:0/1386228396 conn(0x7fbc780caf40 msgr2=0x7fbc780cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:45.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 -- 172.21.15.148:0/1386228396 shutdown_connections 2023-10-24T00:29:45.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.495+0000 7fbc7e224700 1 -- 172.21.15.148:0/1386228396 wait complete. 2023-10-24T00:29:45.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 Processor -- start 2023-10-24T00:29:45.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 -- start start 2023-10-24T00:29:45.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc780aa3f0 0x7fbc781591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc780c6710 0x7fbc780ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781555f0 con 0x7fbc780aa010 2023-10-24T00:29:45.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781549e0 con 0x7fbc780aa3f0 2023-10-24T00:29:45.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc7e224700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78154cc0 con 0x7fbc780c6710 2023-10-24T00:29:45.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46122/0 (socket says 172.21.15.148:46122) 2023-10-24T00:29:45.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.497+0000 7fbc777fe700 1 -- 172.21.15.148:0/2661657565 learned_addr learned my addr 172.21.15.148:0/2661657565 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:45.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc76ffd700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc780aa3f0 0x7fbc781591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc77fff700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc780c6710 0x7fbc780ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 -- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc780c6710 msgr2=0x7fbc780ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc780c6710 0x7fbc780ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 -- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc780aa3f0 msgr2=0x7fbc781591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc780aa3f0 0x7fbc781591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 -- 172.21.15.148:0/2661657565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0092a0 con 0x7fbc780aa010 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc777fe700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fbc6800c7c0 tx=0x7fbc680015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68005d30 con 0x7fbc780aa010 2023-10-24T00:29:45.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68005e90 con 0x7fbc780aa010 2023-10-24T00:29:45.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc78154fa0 con 0x7fbc780aa010 2023-10-24T00:29:45.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68007340 con 0x7fbc780aa010 2023-10-24T00:29:45.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.498+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc781571e0 con 0x7fbc780aa010 2023-10-24T00:29:45.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.499+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7806c6b0 con 0x7fbc780aa010 2023-10-24T00:29:45.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.499+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbc68007770 con 0x7fbc780aa010 2023-10-24T00:29:45.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.500+0000 7fbc5f7fe700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 0x7fbc64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:45.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.500+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbc6807a250 con 0x7fbc780aa010 2023-10-24T00:29:45.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.500+0000 7fbc76ffd700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 0x7fbc64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:45.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.500+0000 7fbc76ffd700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 0x7fbc64061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fbc780b1110 tx=0x7fbc6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:45.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.504+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbc6804b4c0 con 0x7fbc780aa010 2023-10-24T00:29:45.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.663+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc78155730 con 0x7fbc6405f150 2023-10-24T00:29:45.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.673+0000 7fbc5f7fe700 1 -- 172.21.15.148:0/2661657565 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+331577 (secure 0 0 0) 0x7fbc6c00fdb0 con 0x7fbc6405f150 2023-10-24T00:29:45.678 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:45.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 msgr2=0x7fbc64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 0x7fbc64061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fbc780b1110 tx=0x7fbc6c017000).stop 2023-10-24T00:29:45.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 msgr2=0x7fbc7814fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:45.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fbc6800c7c0 tx=0x7fbc680015b0).stop 2023-10-24T00:29:45.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 shutdown_connections 2023-10-24T00:29:45.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc780c6710 0x7fbc780ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbc6405f150 0x7fbc64061610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc780aa010 0x7fbc7814fa20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 --2- 172.21.15.148:0/2661657565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc780aa3f0 0x7fbc781591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:45.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 >> 172.21.15.148:0/2661657565 conn(0x7fbc780caf40 msgr2=0x7fbc780aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:45.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 shutdown_connections 2023-10-24T00:29:45.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:45.676+0000 7fbc7e224700 1 -- 172.21.15.148:0/2661657565 wait complete. 2023-10-24T00:29:45.684 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:45.689 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-24T00:29:44.780767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":200,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379520,"kb_used_data":2752,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595200,"statfs":{"total":773094113280,"available":770657484800,"internally_reserved":0,"allocated":2818048,"data_stored":1133418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4305,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.585878"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282508+0000","last_change":"2023-10-24T00:29:41.282508+0000","last_active":"2023-10-24T00:29:41.282508+0000","last_peered":"2023-10-24T00:29:41.282508+0000","last_clean":"2023-10-24T00:29:41.282508+0000","last_became_active":"2023-10-24T00:29:41.282208+0000","last_became_peered":"2023-10-24T00:29:41.282208+0000","last_unstale":"2023-10-24T00:29:41.282508+0000","last_undegraded":"2023-10-24T00:29:41.282508+0000","last_fullsized":"2023-10-24T00:29:41.282508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890350+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885444+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913085+0000","last_change":"2023-10-24T00:29:40.911353+0000","last_active":"2023-10-24T00:29:40.913085+0000","last_peered":"2023-10-24T00:29:40.913085+0000","last_clean":"2023-10-24T00:29:40.913085+0000","last_became_active":"2023-10-24T00:29:40.911057+0000","last_became_peered":"2023-10-24T00:29:40.911057+0000","last_unstale":"2023-10-24T00:29:40.913085+0000","last_undegraded":"2023-10-24T00:29:40.913085+0000","last_fullsized":"2023-10-24T00:29:40.913085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.883087+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260670+0000","last_change":"2023-10-24T00:29:40.896011+0000","last_active":"2023-10-24T00:29:41.260670+0000","last_peered":"2023-10-24T00:29:41.260670+0000","last_clean":"2023-10-24T00:29:41.260670+0000","last_became_active":"2023-10-24T00:29:40.895711+0000","last_became_peered":"2023-10-24T00:29:40.895711+0000","last_unstale":"2023-10-24T00:29:41.260670+0000","last_undegraded":"2023-10-24T00:29:41.260670+0000","last_fullsized":"2023-10-24T00:29:41.260670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281385+0000","last_change":"2023-10-24T00:29:41.281385+0000","last_active":"2023-10-24T00:29:41.281385+0000","last_peered":"2023-10-24T00:29:41.281385+0000","last_clean":"2023-10-24T00:29:41.281385+0000","last_became_active":"2023-10-24T00:29:41.281043+0000","last_became_peered":"2023-10-24T00:29:41.281043+0000","last_unstale":"2023-10-24T00:29:41.281385+0000","last_undegraded":"2023-10-24T00:29:41.281385+0000","last_fullsized":"2023-10-24T00:29:41.281385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885197+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915110+0000","last_change":"2023-10-24T00:29:40.909172+0000","last_active":"2023-10-24T00:29:40.915110+0000","last_peered":"2023-10-24T00:29:40.915110+0000","last_clean":"2023-10-24T00:29:40.915110+0000","last_became_active":"2023-10-24T00:29:40.908746+0000","last_became_peered":"2023-10-24T00:29:40.908746+0000","last_unstale":"2023-10-24T00:29:40.915110+0000","last_undegraded":"2023-10-24T00:29:40.915110+0000","last_fullsized":"2023-10-24T00:29:40.915110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282681+0000","last_change":"2023-10-24T00:29:41.282681+0000","last_active":"2023-10-24T00:29:41.282681+0000","last_peered":"2023-10-24T00:29:41.282681+0000","last_clean":"2023-10-24T00:29:41.282681+0000","last_became_active":"2023-10-24T00:29:41.282332+0000","last_became_peered":"2023-10-24T00:29:41.282332+0000","last_unstale":"2023-10-24T00:29:41.282681+0000","last_undegraded":"2023-10-24T00:29:41.282681+0000","last_fullsized":"2023-10-24T00:29:41.282681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908108+0000","last_change":"2023-10-24T00:29:40.904330+0000","last_active":"2023-10-24T00:29:40.908108+0000","last_peered":"2023-10-24T00:29:40.908108+0000","last_clean":"2023-10-24T00:29:40.908108+0000","last_became_active":"2023-10-24T00:29:40.903980+0000","last_became_peered":"2023-10-24T00:29:40.903980+0000","last_unstale":"2023-10-24T00:29:40.908108+0000","last_undegraded":"2023-10-24T00:29:40.908108+0000","last_fullsized":"2023-10-24T00:29:40.908108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884858+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284715+0000","last_change":"2023-10-24T00:29:41.284715+0000","last_active":"2023-10-24T00:29:41.284715+0000","last_peered":"2023-10-24T00:29:41.284715+0000","last_clean":"2023-10-24T00:29:41.284715+0000","last_became_active":"2023-10-24T00:29:41.284417+0000","last_became_peered":"2023-10-24T00:29:41.284417+0000","last_unstale":"2023-10-24T00:29:41.284715+0000","last_undegraded":"2023-10-24T00:29:41.284715+0000","last_fullsized":"2023-10-24T00:29:41.284715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882965+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279331+0000","last_change":"2023-10-24T00:29:41.279331+0000","last_active":"2023-10-24T00:29:41.279331+0000","last_peered":"2023-10-24T00:29:41.279331+0000","last_clean":"2023-10-24T00:29:41.279331+0000","last_became_active":"2023-10-24T00:29:41.279005+0000","last_became_peered":"2023-10-24T00:29:41.279005+0000","last_unstale":"2023-10-24T00:29:41.279331+0000","last_undegraded":"2023-10-24T00:29:41.279331+0000","last_fullsized":"2023-10-24T00:29:41.279331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.910647+0000","last_change":"2023-10-24T00:29:40.908076+0000","last_active":"2023-10-24T00:29:40.910647+0000","last_peered":"2023-10-24T00:29:40.910647+0000","last_clean":"2023-10-24T00:29:40.910647+0000","last_became_active":"2023-10-24T00:29:40.907720+0000","last_became_peered":"2023-10-24T00:29:40.907720+0000","last_unstale":"2023-10-24T00:29:40.910647+0000","last_undegraded":"2023-10-24T00:29:40.910647+0000","last_fullsized":"2023-10-24T00:29:40.910647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284689+0000","last_change":"2023-10-24T00:29:40.909485+0000","last_active":"2023-10-24T00:29:41.284689+0000","last_peered":"2023-10-24T00:29:41.284689+0000","last_clean":"2023-10-24T00:29:41.284689+0000","last_became_active":"2023-10-24T00:29:40.909207+0000","last_became_peered":"2023-10-24T00:29:40.909207+0000","last_unstale":"2023-10-24T00:29:41.284689+0000","last_undegraded":"2023-10-24T00:29:41.284689+0000","last_fullsized":"2023-10-24T00:29:41.284689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278399+0000","last_change":"2023-10-24T00:29:41.278399+0000","last_active":"2023-10-24T00:29:41.278399+0000","last_peered":"2023-10-24T00:29:41.278399+0000","last_clean":"2023-10-24T00:29:41.278399+0000","last_became_active":"2023-10-24T00:29:41.277871+0000","last_became_peered":"2023-10-24T00:29:41.277871+0000","last_unstale":"2023-10-24T00:29:41.278399+0000","last_undegraded":"2023-10-24T00:29:41.278399+0000","last_fullsized":"2023-10-24T00:29:41.278399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260648+0000","last_change":"2023-10-24T00:29:40.901458+0000","last_active":"2023-10-24T00:29:41.260648+0000","last_peered":"2023-10-24T00:29:41.260648+0000","last_clean":"2023-10-24T00:29:41.260648+0000","last_became_active":"2023-10-24T00:29:40.901103+0000","last_became_peered":"2023-10-24T00:29:40.901103+0000","last_unstale":"2023-10-24T00:29:41.260648+0000","last_undegraded":"2023-10-24T00:29:41.260648+0000","last_fullsized":"2023-10-24T00:29:41.260648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276984+0000","last_change":"2023-10-24T00:29:41.276984+0000","last_active":"2023-10-24T00:29:41.276984+0000","last_peered":"2023-10-24T00:29:41.276984+0000","last_clean":"2023-10-24T00:29:41.276984+0000","last_became_active":"2023-10-24T00:29:41.276711+0000","last_became_peered":"2023-10-24T00:29:41.276711+0000","last_unstale":"2023-10-24T00:29:41.276984+0000","last_undegraded":"2023-10-24T00:29:41.276984+0000","last_fullsized":"2023-10-24T00:29:41.276984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884557+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.911924+0000","last_change":"2023-10-24T00:29:40.907877+0000","last_active":"2023-10-24T00:29:40.911924+0000","last_peered":"2023-10-24T00:29:40.911924+0000","last_clean":"2023-10-24T00:29:40.911924+0000","last_became_active":"2023-10-24T00:29:40.907520+0000","last_became_peered":"2023-10-24T00:29:40.907520+0000","last_unstale":"2023-10-24T00:29:40.911924+0000","last_undegraded":"2023-10-24T00:29:40.911924+0000","last_fullsized":"2023-10-24T00:29:40.911924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279222+0000","last_change":"2023-10-24T00:29:41.279222+0000","last_active":"2023-10-24T00:29:41.279222+0000","last_peered":"2023-10-24T00:29:41.279222+0000","last_clean":"2023-10-24T00:29:41.279222+0000","last_became_active":"2023-10-24T00:29:41.278945+0000","last_became_peered":"2023-10-24T00:29:41.278945+0000","last_unstale":"2023-10-24T00:29:41.279222+0000","last_undegraded":"2023-10-24T00:29:41.279222+0000","last_fullsized":"2023-10-24T00:29:41.279222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272957+0000","last_change":"2023-10-24T00:29:40.907495+0000","last_active":"2023-10-24T00:29:41.272957+0000","last_peered":"2023-10-24T00:29:41.272957+0000","last_clean":"2023-10-24T00:29:41.272957+0000","last_became_active":"2023-10-24T00:29:40.907255+0000","last_became_peered":"2023-10-24T00:29:40.907255+0000","last_unstale":"2023-10-24T00:29:41.272957+0000","last_undegraded":"2023-10-24T00:29:41.272957+0000","last_fullsized":"2023-10-24T00:29:41.272957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915149+0000","last_change":"2023-10-24T00:29:40.909325+0000","last_active":"2023-10-24T00:29:40.915149+0000","last_peered":"2023-10-24T00:29:40.915149+0000","last_clean":"2023-10-24T00:29:40.915149+0000","last_became_active":"2023-10-24T00:29:40.909009+0000","last_became_peered":"2023-10-24T00:29:40.909009+0000","last_unstale":"2023-10-24T00:29:40.915149+0000","last_undegraded":"2023-10-24T00:29:40.915149+0000","last_fullsized":"2023-10-24T00:29:40.915149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275585+0000","last_change":"2023-10-24T00:29:41.275585+0000","last_active":"2023-10-24T00:29:41.275585+0000","last_peered":"2023-10-24T00:29:41.275585+0000","last_clean":"2023-10-24T00:29:41.275585+0000","last_became_active":"2023-10-24T00:29:41.275266+0000","last_became_peered":"2023-10-24T00:29:41.275266+0000","last_unstale":"2023-10-24T00:29:41.275585+0000","last_undegraded":"2023-10-24T00:29:41.275585+0000","last_fullsized":"2023-10-24T00:29:41.275585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884631+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884803+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280428+0000","last_change":"2023-10-24T00:29:41.280428+0000","last_active":"2023-10-24T00:29:41.280428+0000","last_peered":"2023-10-24T00:29:41.280428+0000","last_clean":"2023-10-24T00:29:41.280428+0000","last_became_active":"2023-10-24T00:29:41.279677+0000","last_became_peered":"2023-10-24T00:29:41.279677+0000","last_unstale":"2023-10-24T00:29:41.280428+0000","last_undegraded":"2023-10-24T00:29:41.280428+0000","last_fullsized":"2023-10-24T00:29:41.280428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915620+0000","last_change":"2023-10-24T00:29:40.911768+0000","last_active":"2023-10-24T00:29:40.915620+0000","last_peered":"2023-10-24T00:29:40.915620+0000","last_clean":"2023-10-24T00:29:40.915620+0000","last_became_active":"2023-10-24T00:29:40.911432+0000","last_became_peered":"2023-10-24T00:29:40.911432+0000","last_unstale":"2023-10-24T00:29:40.915620+0000","last_undegraded":"2023-10-24T00:29:40.915620+0000","last_fullsized":"2023-10-24T00:29:40.915620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273672+0000","last_change":"2023-10-24T00:29:41.273672+0000","last_active":"2023-10-24T00:29:41.273672+0000","last_peered":"2023-10-24T00:29:41.273672+0000","last_clean":"2023-10-24T00:29:41.273672+0000","last_became_active":"2023-10-24T00:29:41.273229+0000","last_became_peered":"2023-10-24T00:29:41.273229+0000","last_unstale":"2023-10-24T00:29:41.273672+0000","last_undegraded":"2023-10-24T00:29:41.273672+0000","last_fullsized":"2023-10-24T00:29:41.273672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885009+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273562+0000","last_change":"2023-10-24T00:29:41.273562+0000","last_active":"2023-10-24T00:29:41.273562+0000","last_peered":"2023-10-24T00:29:41.273562+0000","last_clean":"2023-10-24T00:29:41.273562+0000","last_became_active":"2023-10-24T00:29:41.273232+0000","last_became_peered":"2023-10-24T00:29:41.273232+0000","last_unstale":"2023-10-24T00:29:41.273562+0000","last_undegraded":"2023-10-24T00:29:41.273562+0000","last_fullsized":"2023-10-24T00:29:41.273562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884690+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887721+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279922+0000","last_change":"2023-10-24T00:29:41.279922+0000","last_active":"2023-10-24T00:29:41.279922+0000","last_peered":"2023-10-24T00:29:41.279922+0000","last_clean":"2023-10-24T00:29:41.279922+0000","last_became_active":"2023-10-24T00:29:41.279200+0000","last_became_peered":"2023-10-24T00:29:41.279200+0000","last_unstale":"2023-10-24T00:29:41.279922+0000","last_undegraded":"2023-10-24T00:29:41.279922+0000","last_fullsized":"2023-10-24T00:29:41.279922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912648+0000","last_change":"2023-10-24T00:29:40.909194+0000","last_active":"2023-10-24T00:29:40.912648+0000","last_peered":"2023-10-24T00:29:40.912648+0000","last_clean":"2023-10-24T00:29:40.912648+0000","last_became_active":"2023-10-24T00:29:40.908896+0000","last_became_peered":"2023-10-24T00:29:40.908896+0000","last_unstale":"2023-10-24T00:29:40.912648+0000","last_undegraded":"2023-10-24T00:29:40.912648+0000","last_fullsized":"2023-10-24T00:29:40.912648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281694+0000","last_change":"2023-10-24T00:29:41.281694+0000","last_active":"2023-10-24T00:29:41.281694+0000","last_peered":"2023-10-24T00:29:41.281694+0000","last_clean":"2023-10-24T00:29:41.281694+0000","last_became_active":"2023-10-24T00:29:41.281285+0000","last_became_peered":"2023-10-24T00:29:41.281285+0000","last_unstale":"2023-10-24T00:29:41.281694+0000","last_undegraded":"2023-10-24T00:29:41.281694+0000","last_fullsized":"2023-10-24T00:29:41.281694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882942+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885041+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882933+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.913026+0000","last_change":"2023-10-24T00:29:40.910828+0000","last_active":"2023-10-24T00:29:40.913026+0000","last_peered":"2023-10-24T00:29:40.913026+0000","last_clean":"2023-10-24T00:29:40.913026+0000","last_became_active":"2023-10-24T00:29:40.910440+0000","last_became_peered":"2023-10-24T00:29:40.910440+0000","last_unstale":"2023-10-24T00:29:40.913026+0000","last_undegraded":"2023-10-24T00:29:40.913026+0000","last_fullsized":"2023-10-24T00:29:40.913026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884505+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275537+0000","last_change":"2023-10-24T00:29:41.275537+0000","last_active":"2023-10-24T00:29:41.275537+0000","last_peered":"2023-10-24T00:29:41.275537+0000","last_clean":"2023-10-24T00:29:41.275537+0000","last_became_active":"2023-10-24T00:29:41.275261+0000","last_became_peered":"2023-10-24T00:29:41.275261+0000","last_unstale":"2023-10-24T00:29:41.275537+0000","last_undegraded":"2023-10-24T00:29:41.275537+0000","last_fullsized":"2023-10-24T00:29:41.275537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915163+0000","last_change":"2023-10-24T00:29:40.909407+0000","last_active":"2023-10-24T00:29:40.915163+0000","last_peered":"2023-10-24T00:29:40.915163+0000","last_clean":"2023-10-24T00:29:40.915163+0000","last_became_active":"2023-10-24T00:29:40.908984+0000","last_became_peered":"2023-10-24T00:29:40.908984+0000","last_unstale":"2023-10-24T00:29:40.915163+0000","last_undegraded":"2023-10-24T00:29:40.915163+0000","last_fullsized":"2023-10-24T00:29:40.915163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.900536+0000","last_change":"2023-10-24T00:29:40.899421+0000","last_active":"2023-10-24T00:29:40.900536+0000","last_peered":"2023-10-24T00:29:40.900536+0000","last_clean":"2023-10-24T00:29:40.900536+0000","last_became_active":"2023-10-24T00:29:40.898728+0000","last_became_peered":"2023-10-24T00:29:40.898728+0000","last_unstale":"2023-10-24T00:29:40.900536+0000","last_undegraded":"2023-10-24T00:29:40.900536+0000","last_fullsized":"2023-10-24T00:29:40.900536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274440+0000","last_change":"2023-10-24T00:29:41.274440+0000","last_active":"2023-10-24T00:29:41.274440+0000","last_peered":"2023-10-24T00:29:41.274440+0000","last_clean":"2023-10-24T00:29:41.274440+0000","last_became_active":"2023-10-24T00:29:41.274130+0000","last_became_peered":"2023-10-24T00:29:41.274130+0000","last_unstale":"2023-10-24T00:29:41.274440+0000","last_undegraded":"2023-10-24T00:29:41.274440+0000","last_fullsized":"2023-10-24T00:29:41.274440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889779+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.888182+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882489+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887336+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912713+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:40.912713+0000","last_peered":"2023-10-24T00:29:40.912713+0000","last_clean":"2023-10-24T00:29:40.912713+0000","last_became_active":"2023-10-24T00:29:40.908574+0000","last_became_peered":"2023-10-24T00:29:40.908574+0000","last_unstale":"2023-10-24T00:29:40.912713+0000","last_undegraded":"2023-10-24T00:29:40.912713+0000","last_fullsized":"2023-10-24T00:29:40.912713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280110+0000","last_change":"2023-10-24T00:29:41.280110+0000","last_active":"2023-10-24T00:29:41.280110+0000","last_peered":"2023-10-24T00:29:41.280110+0000","last_clean":"2023-10-24T00:29:41.280110+0000","last_became_active":"2023-10-24T00:29:41.279056+0000","last_became_peered":"2023-10-24T00:29:41.279056+0000","last_unstale":"2023-10-24T00:29:41.280110+0000","last_undegraded":"2023-10-24T00:29:41.280110+0000","last_fullsized":"2023-10-24T00:29:41.280110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.904760+0000","last_change":"2023-10-24T00:29:40.900962+0000","last_active":"2023-10-24T00:29:40.904760+0000","last_peered":"2023-10-24T00:29:40.904760+0000","last_clean":"2023-10-24T00:29:40.904760+0000","last_became_active":"2023-10-24T00:29:40.900707+0000","last_became_peered":"2023-10-24T00:29:40.900707+0000","last_unstale":"2023-10-24T00:29:40.904760+0000","last_undegraded":"2023-10-24T00:29:40.904760+0000","last_fullsized":"2023-10-24T00:29:40.904760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882492+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884525+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282531+0000","last_change":"2023-10-24T00:29:41.282531+0000","last_active":"2023-10-24T00:29:41.282531+0000","last_peered":"2023-10-24T00:29:41.282531+0000","last_clean":"2023-10-24T00:29:41.282531+0000","last_became_active":"2023-10-24T00:29:41.282183+0000","last_became_peered":"2023-10-24T00:29:41.282183+0000","last_unstale":"2023-10-24T00:29:41.282531+0000","last_undegraded":"2023-10-24T00:29:41.282531+0000","last_fullsized":"2023-10-24T00:29:41.282531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885545+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277528+0000","last_change":"2023-10-24T00:29:41.277528+0000","last_active":"2023-10-24T00:29:41.277528+0000","last_peered":"2023-10-24T00:29:41.277528+0000","last_clean":"2023-10-24T00:29:41.277528+0000","last_became_active":"2023-10-24T00:29:41.277225+0000","last_became_peered":"2023-10-24T00:29:41.277225+0000","last_unstale":"2023-10-24T00:29:41.277528+0000","last_undegraded":"2023-10-24T00:29:41.277528+0000","last_fullsized":"2023-10-24T00:29:41.277528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.912990+0000","last_change":"2023-10-24T00:29:40.910398+0000","last_active":"2023-10-24T00:29:40.912990+0000","last_peered":"2023-10-24T00:29:40.912990+0000","last_clean":"2023-10-24T00:29:40.912990+0000","last_became_active":"2023-10-24T00:29:40.910084+0000","last_became_peered":"2023-10-24T00:29:40.910084+0000","last_unstale":"2023-10-24T00:29:40.912990+0000","last_undegraded":"2023-10-24T00:29:40.912990+0000","last_fullsized":"2023-10-24T00:29:40.912990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280101+0000","last_change":"2023-10-24T00:29:40.911169+0000","last_active":"2023-10-24T00:29:41.280101+0000","last_peered":"2023-10-24T00:29:41.280101+0000","last_clean":"2023-10-24T00:29:41.280101+0000","last_became_active":"2023-10-24T00:29:40.910890+0000","last_became_peered":"2023-10-24T00:29:40.910890+0000","last_unstale":"2023-10-24T00:29:41.280101+0000","last_undegraded":"2023-10-24T00:29:41.280101+0000","last_fullsized":"2023-10-24T00:29:41.280101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884549+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884530+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.882493+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.276786+0000","last_change":"2023-10-24T00:29:41.276786+0000","last_active":"2023-10-24T00:29:41.276786+0000","last_peered":"2023-10-24T00:29:41.276786+0000","last_clean":"2023-10-24T00:29:41.276786+0000","last_became_active":"2023-10-24T00:29:41.276496+0000","last_became_peered":"2023-10-24T00:29:41.276496+0000","last_unstale":"2023-10-24T00:29:41.276786+0000","last_undegraded":"2023-10-24T00:29:41.276786+0000","last_fullsized":"2023-10-24T00:29:41.276786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.890250+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272860+0000","last_change":"2023-10-24T00:29:40.899606+0000","last_active":"2023-10-24T00:29:41.272860+0000","last_peered":"2023-10-24T00:29:41.272860+0000","last_clean":"2023-10-24T00:29:41.272860+0000","last_became_active":"2023-10-24T00:29:40.899105+0000","last_became_peered":"2023-10-24T00:29:40.899105+0000","last_unstale":"2023-10-24T00:29:41.272860+0000","last_undegraded":"2023-10-24T00:29:41.272860+0000","last_fullsized":"2023-10-24T00:29:41.272860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271459+0000","last_change":"2023-10-24T00:29:40.910529+0000","last_active":"2023-10-24T00:29:41.271459+0000","last_peered":"2023-10-24T00:29:41.271459+0000","last_clean":"2023-10-24T00:29:41.271459+0000","last_became_active":"2023-10-24T00:29:40.910236+0000","last_became_peered":"2023-10-24T00:29:40.910236+0000","last_unstale":"2023-10-24T00:29:41.271459+0000","last_undegraded":"2023-10-24T00:29:41.271459+0000","last_fullsized":"2023-10-24T00:29:41.271459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284279+0000","last_change":"2023-10-24T00:29:41.284279+0000","last_active":"2023-10-24T00:29:41.284279+0000","last_peered":"2023-10-24T00:29:41.284279+0000","last_clean":"2023-10-24T00:29:41.284279+0000","last_became_active":"2023-10-24T00:29:41.279681+0000","last_became_peered":"2023-10-24T00:29:41.279681+0000","last_unstale":"2023-10-24T00:29:41.284279+0000","last_undegraded":"2023-10-24T00:29:41.284279+0000","last_fullsized":"2023-10-24T00:29:41.284279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.885096+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.907850+0000","last_change":"2023-10-24T00:29:40.904046+0000","last_active":"2023-10-24T00:29:40.907850+0000","last_peered":"2023-10-24T00:29:40.907850+0000","last_clean":"2023-10-24T00:29:40.907850+0000","last_became_active":"2023-10-24T00:29:40.903723+0000","last_became_peered":"2023-10-24T00:29:40.903723+0000","last_unstale":"2023-10-24T00:29:40.907850+0000","last_undegraded":"2023-10-24T00:29:40.907850+0000","last_fullsized":"2023-10-24T00:29:40.907850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.272804+0000","last_change":"2023-10-24T00:29:41.272804+0000","last_active":"2023-10-24T00:29:41.272804+0000","last_peered":"2023-10-24T00:29:41.272804+0000","last_clean":"2023-10-24T00:29:41.272804+0000","last_became_active":"2023-10-24T00:29:41.272528+0000","last_became_peered":"2023-10-24T00:29:41.272528+0000","last_unstale":"2023-10-24T00:29:41.272804+0000","last_undegraded":"2023-10-24T00:29:41.272804+0000","last_fullsized":"2023-10-24T00:29:41.272804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.880635+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278176+0000","last_change":"2023-10-24T00:29:41.278176+0000","last_active":"2023-10-24T00:29:41.278176+0000","last_peered":"2023-10-24T00:29:41.278176+0000","last_clean":"2023-10-24T00:29:41.278176+0000","last_became_active":"2023-10-24T00:29:41.276898+0000","last_became_peered":"2023-10-24T00:29:41.276898+0000","last_unstale":"2023-10-24T00:29:41.278176+0000","last_undegraded":"2023-10-24T00:29:41.278176+0000","last_fullsized":"2023-10-24T00:29:41.278176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260764+0000","last_change":"2023-10-24T00:29:40.904817+0000","last_active":"2023-10-24T00:29:41.260764+0000","last_peered":"2023-10-24T00:29:41.260764+0000","last_clean":"2023-10-24T00:29:41.260764+0000","last_became_active":"2023-10-24T00:29:40.904554+0000","last_became_peered":"2023-10-24T00:29:40.904554+0000","last_unstale":"2023-10-24T00:29:41.260764+0000","last_undegraded":"2023-10-24T00:29:41.260764+0000","last_fullsized":"2023-10-24T00:29:41.260764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.903731+0000","last_change":"2023-10-24T00:29:40.899587+0000","last_active":"2023-10-24T00:29:40.903731+0000","last_peered":"2023-10-24T00:29:40.903731+0000","last_clean":"2023-10-24T00:29:40.903731+0000","last_became_active":"2023-10-24T00:29:40.899281+0000","last_became_peered":"2023-10-24T00:29:40.899281+0000","last_unstale":"2023-10-24T00:29:40.903731+0000","last_undegraded":"2023-10-24T00:29:40.903731+0000","last_fullsized":"2023-10-24T00:29:40.903731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274908+0000","last_change":"2023-10-24T00:29:41.274908+0000","last_active":"2023-10-24T00:29:41.274908+0000","last_peered":"2023-10-24T00:29:41.274908+0000","last_clean":"2023-10-24T00:29:41.274908+0000","last_became_active":"2023-10-24T00:29:41.274570+0000","last_became_peered":"2023-10-24T00:29:41.274570+0000","last_unstale":"2023-10-24T00:29:41.274908+0000","last_undegraded":"2023-10-24T00:29:41.274908+0000","last_fullsized":"2023-10-24T00:29:41.274908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908183+0000","last_change":"2023-10-24T00:29:40.903507+0000","last_active":"2023-10-24T00:29:40.908183+0000","last_peered":"2023-10-24T00:29:40.908183+0000","last_clean":"2023-10-24T00:29:40.908183+0000","last_became_active":"2023-10-24T00:29:40.903175+0000","last_became_peered":"2023-10-24T00:29:40.903175+0000","last_unstale":"2023-10-24T00:29:40.908183+0000","last_undegraded":"2023-10-24T00:29:40.908183+0000","last_fullsized":"2023-10-24T00:29:40.908183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.899874+0000","last_change":"2023-10-24T00:29:40.897887+0000","last_active":"2023-10-24T00:29:40.899874+0000","last_peered":"2023-10-24T00:29:40.899874+0000","last_clean":"2023-10-24T00:29:40.899874+0000","last_became_active":"2023-10-24T00:29:40.897165+0000","last_became_peered":"2023-10-24T00:29:40.897165+0000","last_unstale":"2023-10-24T00:29:40.899874+0000","last_undegraded":"2023-10-24T00:29:40.899874+0000","last_fullsized":"2023-10-24T00:29:40.899874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887726+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.887760+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.898546+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:29:40.898546+0000","last_peered":"2023-10-24T00:29:40.898546+0000","last_clean":"2023-10-24T00:29:40.898546+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:29:40.898546+0000","last_undegraded":"2023-10-24T00:29:40.898546+0000","last_fullsized":"2023-10-24T00:29:40.898546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275099+0000","last_change":"2023-10-24T00:29:41.275099+0000","last_active":"2023-10-24T00:29:41.275099+0000","last_peered":"2023-10-24T00:29:41.275099+0000","last_clean":"2023-10-24T00:29:41.275099+0000","last_became_active":"2023-10-24T00:29:41.273851+0000","last_became_peered":"2023-10-24T00:29:41.273851+0000","last_unstale":"2023-10-24T00:29:41.275099+0000","last_undegraded":"2023-10-24T00:29:41.275099+0000","last_fullsized":"2023-10-24T00:29:41.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.915220+0000","last_change":"2023-10-24T00:29:40.908757+0000","last_active":"2023-10-24T00:29:40.915220+0000","last_peered":"2023-10-24T00:29:40.915220+0000","last_clean":"2023-10-24T00:29:40.915220+0000","last_became_active":"2023-10-24T00:29:40.908448+0000","last_became_peered":"2023-10-24T00:29:40.908448+0000","last_unstale":"2023-10-24T00:29:40.915220+0000","last_undegraded":"2023-10-24T00:29:40.915220+0000","last_fullsized":"2023-10-24T00:29:40.915220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.887884+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:29:40.887884+0000","last_peered":"2023-10-24T00:29:40.887884+0000","last_clean":"2023-10-24T00:29:40.887884+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:29:40.887884+0000","last_undegraded":"2023-10-24T00:29:40.887884+0000","last_fullsized":"2023-10-24T00:29:40.887884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284246+0000","last_change":"2023-10-24T00:29:41.284246+0000","last_active":"2023-10-24T00:29:41.284246+0000","last_peered":"2023-10-24T00:29:41.284246+0000","last_clean":"2023-10-24T00:29:41.284246+0000","last_became_active":"2023-10-24T00:29:41.280875+0000","last_became_peered":"2023-10-24T00:29:41.280875+0000","last_unstale":"2023-10-24T00:29:41.284246+0000","last_undegraded":"2023-10-24T00:29:41.284246+0000","last_fullsized":"2023-10-24T00:29:41.284246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.908095+0000","last_change":"2023-10-24T00:29:40.904270+0000","last_active":"2023-10-24T00:29:40.908095+0000","last_peered":"2023-10-24T00:29:40.908095+0000","last_clean":"2023-10-24T00:29:40.908095+0000","last_became_active":"2023-10-24T00:29:40.903932+0000","last_became_peered":"2023-10-24T00:29:40.903932+0000","last_unstale":"2023-10-24T00:29:40.908095+0000","last_undegraded":"2023-10-24T00:29:40.908095+0000","last_fullsized":"2023-10-24T00:29:40.908095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.895909+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:29:40.895909+0000","last_peered":"2023-10-24T00:29:40.895909+0000","last_clean":"2023-10-24T00:29:40.895909+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:29:40.895909+0000","last_undegraded":"2023-10-24T00:29:40.895909+0000","last_fullsized":"2023-10-24T00:29:40.895909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890293+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:29:40.890293+0000","last_peered":"2023-10-24T00:29:40.890293+0000","last_clean":"2023-10-24T00:29:40.890293+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:29:40.890293+0000","last_undegraded":"2023-10-24T00:29:40.890293+0000","last_fullsized":"2023-10-24T00:29:40.890293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284475+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.284475+0000","last_peered":"2023-10-24T00:29:41.284475+0000","last_clean":"2023-10-24T00:29:41.284475+0000","last_became_active":"2023-10-24T00:29:40.908367+0000","last_became_peered":"2023-10-24T00:29:40.908367+0000","last_unstale":"2023-10-24T00:29:41.284475+0000","last_undegraded":"2023-10-24T00:29:41.284475+0000","last_fullsized":"2023-10-24T00:29:41.284475+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.890706+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:29:40.890706+0000","last_peered":"2023-10-24T00:29:40.890706+0000","last_clean":"2023-10-24T00:29:40.890706+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:29:40.890706+0000","last_undegraded":"2023-10-24T00:29:40.890706+0000","last_fullsized":"2023-10-24T00:29:40.890706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.889739+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-24T00:29:40.894423+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:29:40.894423+0000","last_peered":"2023-10-24T00:29:40.894423+0000","last_clean":"2023-10-24T00:29:40.894423+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:29:40.894423+0000","last_undegraded":"2023-10-24T00:29:40.894423+0000","last_fullsized":"2023-10-24T00:29:40.894423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:29:40.878302+0000","last_change":"2023-10-24T00:29:40.878302+0000","last_active":"2023-10-24T00:29:40.878302+0000","last_peered":"2023-10-24T00:29:40.878302+0000","last_clean":"2023-10-24T00:29:40.878302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:40.878302+0000","last_undegraded":"2023-10-24T00:29:40.878302+0000","last_fullsized":"2023-10-24T00:29:40.878302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884655+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.042111+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:29:35.042111+0000","last_peered":"2023-10-24T00:29:35.042111+0000","last_clean":"2023-10-24T00:29:35.042111+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:29:35.042111+0000","last_undegraded":"2023-10-24T00:29:35.042111+0000","last_fullsized":"2023-10-24T00:29:35.042111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273553+0000","last_change":"2023-10-24T00:29:41.273553+0000","last_active":"2023-10-24T00:29:41.273553+0000","last_peered":"2023-10-24T00:29:41.273553+0000","last_clean":"2023-10-24T00:29:41.273553+0000","last_became_active":"2023-10-24T00:29:41.273266+0000","last_became_peered":"2023-10-24T00:29:41.273266+0000","last_unstale":"2023-10-24T00:29:41.273553+0000","last_undegraded":"2023-10-24T00:29:41.273553+0000","last_fullsized":"2023-10-24T00:29:41.273553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:29:39.873877+0000","last_change":"2023-10-24T00:29:39.884527+0000","last_active":"2023-10-24T00:29:39.873877+0000","last_peered":"2023-10-24T00:29:39.873877+0000","last_clean":"2023-10-24T00:29:39.873877+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:29:39.873877+0000","last_undegraded":"2023-10-24T00:29:39.873877+0000","last_fullsized":"2023-10-24T00:29:39.873877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-24T00:29:35.301374+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:29:35.301374+0000","last_peered":"2023-10-24T00:29:35.301374+0000","last_clean":"2023-10-24T00:29:35.301374+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:29:35.301374+0000","last_undegraded":"2023-10-24T00:29:35.301374+0000","last_fullsized":"2023-10-24T00:29:35.301374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":1004,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":153434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297432,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074408,"statfs":{"total":96636764160,"available":96332193792,"internally_reserved":0,"allocated":344064,"data_stored":138018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2959999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8340000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2610000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":151876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:48.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:29:48.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.821+0000 7f1c0d03c700 1 Processor -- start 2023-10-24T00:29:48.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.821+0000 7f1c0d03c700 1 -- start start 2023-10-24T00:29:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0d03c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c080aa140 0x7f1c080c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0d03c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0d03c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c080c6410 con 0x7f1c080c0cd0 2023-10-24T00:29:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0d03c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c080c1140 con 0x7f1c080aa140 2023-10-24T00:29:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0d03c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080ca6e0 con 0x7f1c080ca110 2023-10-24T00:29:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1c080aa140 0x7f1c080c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0c83b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1c080c0cd0 0x7f1c08157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53540/0 (socket says 172.21.15.148:53540) 2023-10-24T00:29:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c0c83b700 1 -- 172.21.15.148:0/1573449240 learned_addr learned my addr 172.21.15.148:0/1573449240 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c077fe700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 -- 172.21.15.148:0/1573449240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 msgr2=0x7f1c080c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 -- 172.21.15.148:0/1573449240 >> v1:172.21.15.148:6789/0 conn(0x7f1c080c0cd0 legacy=0x7f1c08157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c06ffd700 1 -- 172.21.15.148:0/1573449240 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757061402 0 0) 0x7f1c080c6410 con 0x7f1c080c0cd0 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 -- 172.21.15.148:0/1573449240 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c080ca9c0 con 0x7f1c080aa140 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c077fe700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.822+0000 7f1c07fff700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080aa140 0x7f1c080c9c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f1bf8009760 tx=0x7f1bf8009060).ready entity=mon.0 client_cookie=2c3858a59da7c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c06ffd700 1 -- 172.21.15.148:0/1573449240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800b580 con 0x7f1c080aa140 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c06ffd700 1 -- 172.21.15.148:0/1573449240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800b6e0 con 0x7f1c080aa140 2023-10-24T00:29:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c06ffd700 1 -- 172.21.15.148:0/1573449240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800ba60 con 0x7f1c080aa140 2023-10-24T00:29:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 -- 172.21.15.148:0/1573449240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080aa140 msgr2=0x7f1c080c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080aa140 0x7f1c080c9c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f1bf8009760 tx=0x7f1bf8009060).stop 2023-10-24T00:29:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 -- 172.21.15.148:0/1573449240 shutdown_connections 2023-10-24T00:29:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080aa140 0x7f1c080c9c20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/1573449240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 -- 172.21.15.148:0/1573449240 >> 172.21.15.148:0/1573449240 conn(0x7f1c080944a0 msgr2=0x7f1c0806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 -- 172.21.15.148:0/1573449240 shutdown_connections 2023-10-24T00:29:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.823+0000 7f1c0d03c700 1 -- 172.21.15.148:0/1573449240 wait complete. 2023-10-24T00:29:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.824+0000 7f1c0d03c700 1 Processor -- start 2023-10-24T00:29:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 -- start start 2023-10-24T00:29:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c080aa140 0x7f1c080ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080abb30 con 0x7f1c080c0cd0 2023-10-24T00:29:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080ac390 con 0x7f1c080aa140 2023-10-24T00:29:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c0d03c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080c2b40 con 0x7f1c080ca110 2023-10-24T00:29:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46140/0 (socket says 172.21.15.148:46140) 2023-10-24T00:29:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.825+0000 7f1c077fe700 1 -- 172.21.15.148:0/2727969939 learned_addr learned my addr 172.21.15.148:0/2727969939 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c07fff700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c080aa140 0x7f1c080ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c0c83b700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 -- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 msgr2=0x7f1c080c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 -- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c080aa140 msgr2=0x7f1c080ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c080aa140 0x7f1c080ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 -- 172.21.15.148:0/2727969939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf80092a0 con 0x7f1c080c0cd0 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c0c83b700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c077fe700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1bfc00d890 tx=0x7f1bfc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc011590 con 0x7f1c080c0cd0 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0116f0 con 0x7f1c080c0cd0 2023-10-24T00:29:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c080abd40 con 0x7f1c080c0cd0 2023-10-24T00:29:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc011a70 con 0x7f1c080c0cd0 2023-10-24T00:29:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.826+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c080a85f0 con 0x7f1c080c0cd0 2023-10-24T00:29:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.827+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c080a8870 con 0x7f1c080c0cd0 2023-10-24T00:29:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.827+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1bfc01c460 con 0x7f1c080c0cd0 2023-10-24T00:29:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.828+0000 7f1beffff700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 0x7f1bf4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.828+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1bfc079f40 con 0x7f1c080c0cd0 2023-10-24T00:29:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.828+0000 7f1c07fff700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 0x7f1bf4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.828+0000 7f1c07fff700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 0x7f1bf4061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1bf8009760 tx=0x7f1bf8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.832+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1bfc04b1b0 con 0x7f1c080c0cd0 2023-10-24T00:29:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:48.994+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c08047480 con 0x7f1bf405f150 2023-10-24T00:29:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.004+0000 7f1beffff700 1 -- 172.21.15.148:0/2727969939 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343041 (secure 0 0 0) 0x7f1c08047480 con 0x7f1bf405f150 2023-10-24T00:29:49.009 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:49.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 msgr2=0x7f1bf4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 0x7f1bf4061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1bf8009760 tx=0x7f1bf8017000).stop 2023-10-24T00:29:49.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 msgr2=0x7f1c080a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f1bfc00d890 tx=0x7f1bfc008040).stop 2023-10-24T00:29:49.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 shutdown_connections 2023-10-24T00:29:49.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c080ca110 0x7f1c080c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c080aa140 0x7f1c080ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1bf405f150 0x7f1bf4061610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 --2- 172.21.15.148:0/2727969939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1c080c0cd0 0x7f1c080a8100 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.007+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 >> 172.21.15.148:0/2727969939 conn(0x7f1c080944a0 msgr2=0x7f1c080c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:49.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.008+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 shutdown_connections 2023-10-24T00:29:49.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.008+0000 7f1c0d03c700 1 -- 172.21.15.148:0/2727969939 wait complete. 2023-10-24T00:29:49.015 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:29:49.021 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-24T00:29:48.781857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":267,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379808,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594912,"statfs":{"total":773094113280,"available":770657189888,"internally_reserved":0,"allocated":3112960,"data_stored":1273252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3003,"num_objects":-12,"num_object_clones":0,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.586473"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.288597+0000","last_change":"2023-10-24T00:29:41.282508+0000","last_active":"2023-10-24T00:29:41.288597+0000","last_peered":"2023-10-24T00:29:41.288597+0000","last_clean":"2023-10-24T00:29:41.288597+0000","last_became_active":"2023-10-24T00:29:41.282208+0000","last_became_peered":"2023-10-24T00:29:41.282208+0000","last_unstale":"2023-10-24T00:29:41.288597+0000","last_undegraded":"2023-10-24T00:29:41.288597+0000","last_fullsized":"2023-10-24T00:29:41.288597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.285686+0000","last_change":"2023-10-24T00:29:40.911969+0000","last_active":"2023-10-24T00:29:41.285686+0000","last_peered":"2023-10-24T00:29:41.285686+0000","last_clean":"2023-10-24T00:29:41.285686+0000","last_became_active":"2023-10-24T00:29:40.911659+0000","last_became_peered":"2023-10-24T00:29:40.911659+0000","last_unstale":"2023-10-24T00:29:41.285686+0000","last_undegraded":"2023-10-24T00:29:41.285686+0000","last_fullsized":"2023-10-24T00:29:41.285686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277046+0000","last_change":"2023-10-24T00:29:41.275624+0000","last_active":"2023-10-24T00:29:41.277046+0000","last_peered":"2023-10-24T00:29:41.277046+0000","last_clean":"2023-10-24T00:29:41.277046+0000","last_became_active":"2023-10-24T00:29:41.275350+0000","last_became_peered":"2023-10-24T00:29:41.275350+0000","last_unstale":"2023-10-24T00:29:41.277046+0000","last_undegraded":"2023-10-24T00:29:41.277046+0000","last_fullsized":"2023-10-24T00:29:41.277046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.265478+0000","last_change":"2023-10-24T00:29:40.903597+0000","last_active":"2023-10-24T00:29:41.265478+0000","last_peered":"2023-10-24T00:29:41.265478+0000","last_clean":"2023-10-24T00:29:41.265478+0000","last_became_active":"2023-10-24T00:29:40.903332+0000","last_became_peered":"2023-10-24T00:29:40.903332+0000","last_unstale":"2023-10-24T00:29:41.265478+0000","last_undegraded":"2023-10-24T00:29:41.265478+0000","last_fullsized":"2023-10-24T00:29:41.265478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.283611+0000","last_change":"2023-10-24T00:29:41.276733+0000","last_active":"2023-10-24T00:29:41.283611+0000","last_peered":"2023-10-24T00:29:41.283611+0000","last_clean":"2023-10-24T00:29:41.283611+0000","last_became_active":"2023-10-24T00:29:41.276418+0000","last_became_peered":"2023-10-24T00:29:41.276418+0000","last_unstale":"2023-10-24T00:29:41.283611+0000","last_undegraded":"2023-10-24T00:29:41.283611+0000","last_fullsized":"2023-10-24T00:29:41.283611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270520+0000","last_change":"2023-10-24T00:29:40.911353+0000","last_active":"2023-10-24T00:29:41.270520+0000","last_peered":"2023-10-24T00:29:41.270520+0000","last_clean":"2023-10-24T00:29:41.270520+0000","last_became_active":"2023-10-24T00:29:40.911057+0000","last_became_peered":"2023-10-24T00:29:40.911057+0000","last_unstale":"2023-10-24T00:29:41.270520+0000","last_undegraded":"2023-10-24T00:29:41.270520+0000","last_fullsized":"2023-10-24T00:29:41.270520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286016+0000","last_change":"2023-10-24T00:29:41.279019+0000","last_active":"2023-10-24T00:29:41.286016+0000","last_peered":"2023-10-24T00:29:41.286016+0000","last_clean":"2023-10-24T00:29:41.286016+0000","last_became_active":"2023-10-24T00:29:41.278766+0000","last_became_peered":"2023-10-24T00:29:41.278766+0000","last_unstale":"2023-10-24T00:29:41.286016+0000","last_undegraded":"2023-10-24T00:29:41.286016+0000","last_fullsized":"2023-10-24T00:29:41.286016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280428+0000","last_change":"2023-10-24T00:29:40.900712+0000","last_active":"2023-10-24T00:29:41.280428+0000","last_peered":"2023-10-24T00:29:41.280428+0000","last_clean":"2023-10-24T00:29:41.280428+0000","last_became_active":"2023-10-24T00:29:40.900213+0000","last_became_peered":"2023-10-24T00:29:40.900213+0000","last_unstale":"2023-10-24T00:29:41.280428+0000","last_undegraded":"2023-10-24T00:29:41.280428+0000","last_fullsized":"2023-10-24T00:29:41.280428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286030+0000","last_change":"2023-10-24T00:29:41.279238+0000","last_active":"2023-10-24T00:29:41.286030+0000","last_peered":"2023-10-24T00:29:41.286030+0000","last_clean":"2023-10-24T00:29:41.286030+0000","last_became_active":"2023-10-24T00:29:41.277903+0000","last_became_peered":"2023-10-24T00:29:41.277903+0000","last_unstale":"2023-10-24T00:29:41.286030+0000","last_undegraded":"2023-10-24T00:29:41.286030+0000","last_fullsized":"2023-10-24T00:29:41.286030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274802+0000","last_change":"2023-10-24T00:29:40.896011+0000","last_active":"2023-10-24T00:29:41.274802+0000","last_peered":"2023-10-24T00:29:41.274802+0000","last_clean":"2023-10-24T00:29:41.274802+0000","last_became_active":"2023-10-24T00:29:40.895711+0000","last_became_peered":"2023-10-24T00:29:40.895711+0000","last_unstale":"2023-10-24T00:29:41.274802+0000","last_undegraded":"2023-10-24T00:29:41.274802+0000","last_fullsized":"2023-10-24T00:29:41.274802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286915+0000","last_change":"2023-10-24T00:29:41.281385+0000","last_active":"2023-10-24T00:29:41.286915+0000","last_peered":"2023-10-24T00:29:41.286915+0000","last_clean":"2023-10-24T00:29:41.286915+0000","last_became_active":"2023-10-24T00:29:41.281043+0000","last_became_peered":"2023-10-24T00:29:41.281043+0000","last_unstale":"2023-10-24T00:29:41.286915+0000","last_undegraded":"2023-10-24T00:29:41.286915+0000","last_fullsized":"2023-10-24T00:29:41.286915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278139+0000","last_change":"2023-10-24T00:29:40.905130+0000","last_active":"2023-10-24T00:29:41.278139+0000","last_peered":"2023-10-24T00:29:41.278139+0000","last_clean":"2023-10-24T00:29:41.278139+0000","last_became_active":"2023-10-24T00:29:40.904824+0000","last_became_peered":"2023-10-24T00:29:40.904824+0000","last_unstale":"2023-10-24T00:29:41.278139+0000","last_undegraded":"2023-10-24T00:29:41.278139+0000","last_fullsized":"2023-10-24T00:29:41.278139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274905+0000","last_change":"2023-10-24T00:29:41.266077+0000","last_active":"2023-10-24T00:29:41.274905+0000","last_peered":"2023-10-24T00:29:41.274905+0000","last_clean":"2023-10-24T00:29:41.274905+0000","last_became_active":"2023-10-24T00:29:41.265817+0000","last_became_peered":"2023-10-24T00:29:41.265817+0000","last_unstale":"2023-10-24T00:29:41.274905+0000","last_undegraded":"2023-10-24T00:29:41.274905+0000","last_fullsized":"2023-10-24T00:29:41.274905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258831+0000","last_change":"2023-10-24T00:29:40.909172+0000","last_active":"2023-10-24T00:29:41.258831+0000","last_peered":"2023-10-24T00:29:41.258831+0000","last_clean":"2023-10-24T00:29:41.258831+0000","last_became_active":"2023-10-24T00:29:40.908746+0000","last_became_peered":"2023-10-24T00:29:40.908746+0000","last_unstale":"2023-10-24T00:29:41.258831+0000","last_undegraded":"2023-10-24T00:29:41.258831+0000","last_fullsized":"2023-10-24T00:29:41.258831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.288626+0000","last_change":"2023-10-24T00:29:41.282681+0000","last_active":"2023-10-24T00:29:41.288626+0000","last_peered":"2023-10-24T00:29:41.288626+0000","last_clean":"2023-10-24T00:29:41.288626+0000","last_became_active":"2023-10-24T00:29:41.282332+0000","last_became_peered":"2023-10-24T00:29:41.282332+0000","last_unstale":"2023-10-24T00:29:41.288626+0000","last_undegraded":"2023-10-24T00:29:41.288626+0000","last_fullsized":"2023-10-24T00:29:41.288626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.259447+0000","last_change":"2023-10-24T00:29:40.904330+0000","last_active":"2023-10-24T00:29:41.259447+0000","last_peered":"2023-10-24T00:29:41.259447+0000","last_clean":"2023-10-24T00:29:41.259447+0000","last_became_active":"2023-10-24T00:29:40.903980+0000","last_became_peered":"2023-10-24T00:29:40.903980+0000","last_unstale":"2023-10-24T00:29:41.259447+0000","last_undegraded":"2023-10-24T00:29:41.259447+0000","last_fullsized":"2023-10-24T00:29:41.259447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280526+0000","last_change":"2023-10-24T00:29:41.278270+0000","last_active":"2023-10-24T00:29:41.280526+0000","last_peered":"2023-10-24T00:29:41.280526+0000","last_clean":"2023-10-24T00:29:41.280526+0000","last_became_active":"2023-10-24T00:29:41.277903+0000","last_became_peered":"2023-10-24T00:29:41.277903+0000","last_unstale":"2023-10-24T00:29:41.280526+0000","last_undegraded":"2023-10-24T00:29:41.280526+0000","last_fullsized":"2023-10-24T00:29:41.280526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.261363+0000","last_change":"2023-10-24T00:29:40.905278+0000","last_active":"2023-10-24T00:29:41.261363+0000","last_peered":"2023-10-24T00:29:41.261363+0000","last_clean":"2023-10-24T00:29:41.261363+0000","last_became_active":"2023-10-24T00:29:40.905047+0000","last_became_peered":"2023-10-24T00:29:40.905047+0000","last_unstale":"2023-10-24T00:29:41.261363+0000","last_undegraded":"2023-10-24T00:29:41.261363+0000","last_fullsized":"2023-10-24T00:29:41.261363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.287052+0000","last_change":"2023-10-24T00:29:41.284715+0000","last_active":"2023-10-24T00:29:41.287052+0000","last_peered":"2023-10-24T00:29:41.287052+0000","last_clean":"2023-10-24T00:29:41.287052+0000","last_became_active":"2023-10-24T00:29:41.284417+0000","last_became_peered":"2023-10-24T00:29:41.284417+0000","last_unstale":"2023-10-24T00:29:41.287052+0000","last_undegraded":"2023-10-24T00:29:41.287052+0000","last_fullsized":"2023-10-24T00:29:41.287052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.256888+0000","last_change":"2023-10-24T00:29:40.901547+0000","last_active":"2023-10-24T00:29:41.256888+0000","last_peered":"2023-10-24T00:29:41.256888+0000","last_clean":"2023-10-24T00:29:41.256888+0000","last_became_active":"2023-10-24T00:29:40.901214+0000","last_became_peered":"2023-10-24T00:29:40.901214+0000","last_unstale":"2023-10-24T00:29:41.256888+0000","last_undegraded":"2023-10-24T00:29:41.256888+0000","last_fullsized":"2023-10-24T00:29:41.256888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286405+0000","last_change":"2023-10-24T00:29:41.279331+0000","last_active":"2023-10-24T00:29:41.286405+0000","last_peered":"2023-10-24T00:29:41.286405+0000","last_clean":"2023-10-24T00:29:41.286405+0000","last_became_active":"2023-10-24T00:29:41.279005+0000","last_became_peered":"2023-10-24T00:29:41.279005+0000","last_unstale":"2023-10-24T00:29:41.286405+0000","last_undegraded":"2023-10-24T00:29:41.286405+0000","last_fullsized":"2023-10-24T00:29:41.286405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258817+0000","last_change":"2023-10-24T00:29:40.908076+0000","last_active":"2023-10-24T00:29:41.258817+0000","last_peered":"2023-10-24T00:29:41.258817+0000","last_clean":"2023-10-24T00:29:41.258817+0000","last_became_active":"2023-10-24T00:29:40.907720+0000","last_became_peered":"2023-10-24T00:29:40.907720+0000","last_unstale":"2023-10-24T00:29:41.258817+0000","last_undegraded":"2023-10-24T00:29:41.258817+0000","last_fullsized":"2023-10-24T00:29:41.258817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282209+0000","last_change":"2023-10-24T00:29:41.279648+0000","last_active":"2023-10-24T00:29:41.282209+0000","last_peered":"2023-10-24T00:29:41.282209+0000","last_clean":"2023-10-24T00:29:41.282209+0000","last_became_active":"2023-10-24T00:29:41.279277+0000","last_became_peered":"2023-10-24T00:29:41.279277+0000","last_unstale":"2023-10-24T00:29:41.282209+0000","last_undegraded":"2023-10-24T00:29:41.282209+0000","last_fullsized":"2023-10-24T00:29:41.282209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.291755+0000","last_change":"2023-10-24T00:29:40.909485+0000","last_active":"2023-10-24T00:29:41.291755+0000","last_peered":"2023-10-24T00:29:41.291755+0000","last_clean":"2023-10-24T00:29:41.291755+0000","last_became_active":"2023-10-24T00:29:40.909207+0000","last_became_peered":"2023-10-24T00:29:40.909207+0000","last_unstale":"2023-10-24T00:29:41.291755+0000","last_undegraded":"2023-10-24T00:29:41.291755+0000","last_fullsized":"2023-10-24T00:29:41.291755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280788+0000","last_change":"2023-10-24T00:29:41.278399+0000","last_active":"2023-10-24T00:29:41.280788+0000","last_peered":"2023-10-24T00:29:41.280788+0000","last_clean":"2023-10-24T00:29:41.280788+0000","last_became_active":"2023-10-24T00:29:41.277871+0000","last_became_peered":"2023-10-24T00:29:41.277871+0000","last_unstale":"2023-10-24T00:29:41.280788+0000","last_undegraded":"2023-10-24T00:29:41.280788+0000","last_fullsized":"2023-10-24T00:29:41.280788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274755+0000","last_change":"2023-10-24T00:29:40.901458+0000","last_active":"2023-10-24T00:29:41.274755+0000","last_peered":"2023-10-24T00:29:41.274755+0000","last_clean":"2023-10-24T00:29:41.274755+0000","last_became_active":"2023-10-24T00:29:40.901103+0000","last_became_peered":"2023-10-24T00:29:40.901103+0000","last_unstale":"2023-10-24T00:29:41.274755+0000","last_undegraded":"2023-10-24T00:29:41.274755+0000","last_fullsized":"2023-10-24T00:29:41.274755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281256+0000","last_change":"2023-10-24T00:29:41.276984+0000","last_active":"2023-10-24T00:29:41.281256+0000","last_peered":"2023-10-24T00:29:41.281256+0000","last_clean":"2023-10-24T00:29:41.281256+0000","last_became_active":"2023-10-24T00:29:41.276711+0000","last_became_peered":"2023-10-24T00:29:41.276711+0000","last_unstale":"2023-10-24T00:29:41.281256+0000","last_undegraded":"2023-10-24T00:29:41.281256+0000","last_fullsized":"2023-10-24T00:29:41.281256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.263582+0000","last_change":"2023-10-24T00:29:40.898024+0000","last_active":"2023-10-24T00:29:41.263582+0000","last_peered":"2023-10-24T00:29:41.263582+0000","last_clean":"2023-10-24T00:29:41.263582+0000","last_became_active":"2023-10-24T00:29:40.897771+0000","last_became_peered":"2023-10-24T00:29:40.897771+0000","last_unstale":"2023-10-24T00:29:41.263582+0000","last_undegraded":"2023-10-24T00:29:41.263582+0000","last_fullsized":"2023-10-24T00:29:41.263582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281603+0000","last_change":"2023-10-24T00:29:41.274783+0000","last_active":"2023-10-24T00:29:41.281603+0000","last_peered":"2023-10-24T00:29:41.281603+0000","last_clean":"2023-10-24T00:29:41.281603+0000","last_became_active":"2023-10-24T00:29:41.274494+0000","last_became_peered":"2023-10-24T00:29:41.274494+0000","last_unstale":"2023-10-24T00:29:41.281603+0000","last_undegraded":"2023-10-24T00:29:41.281603+0000","last_fullsized":"2023-10-24T00:29:41.281603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270304+0000","last_change":"2023-10-24T00:29:40.907877+0000","last_active":"2023-10-24T00:29:41.270304+0000","last_peered":"2023-10-24T00:29:41.270304+0000","last_clean":"2023-10-24T00:29:41.270304+0000","last_became_active":"2023-10-24T00:29:40.907520+0000","last_became_peered":"2023-10-24T00:29:40.907520+0000","last_unstale":"2023-10-24T00:29:41.270304+0000","last_undegraded":"2023-10-24T00:29:41.270304+0000","last_fullsized":"2023-10-24T00:29:41.270304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286357+0000","last_change":"2023-10-24T00:29:41.279222+0000","last_active":"2023-10-24T00:29:41.286357+0000","last_peered":"2023-10-24T00:29:41.286357+0000","last_clean":"2023-10-24T00:29:41.286357+0000","last_became_active":"2023-10-24T00:29:41.278945+0000","last_became_peered":"2023-10-24T00:29:41.278945+0000","last_unstale":"2023-10-24T00:29:41.286357+0000","last_undegraded":"2023-10-24T00:29:41.286357+0000","last_fullsized":"2023-10-24T00:29:41.286357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.274917+0000","last_change":"2023-10-24T00:29:40.907495+0000","last_active":"2023-10-24T00:29:41.274917+0000","last_peered":"2023-10-24T00:29:41.274917+0000","last_clean":"2023-10-24T00:29:41.274917+0000","last_became_active":"2023-10-24T00:29:40.907255+0000","last_became_peered":"2023-10-24T00:29:40.907255+0000","last_unstale":"2023-10-24T00:29:41.274917+0000","last_undegraded":"2023-10-24T00:29:41.274917+0000","last_fullsized":"2023-10-24T00:29:41.274917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.283656+0000","last_change":"2023-10-24T00:29:41.282555+0000","last_active":"2023-10-24T00:29:41.283656+0000","last_peered":"2023-10-24T00:29:41.283656+0000","last_clean":"2023-10-24T00:29:41.283656+0000","last_became_active":"2023-10-24T00:29:41.282275+0000","last_became_peered":"2023-10-24T00:29:41.282275+0000","last_unstale":"2023-10-24T00:29:41.283656+0000","last_undegraded":"2023-10-24T00:29:41.283656+0000","last_fullsized":"2023-10-24T00:29:41.283656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258724+0000","last_change":"2023-10-24T00:29:40.909325+0000","last_active":"2023-10-24T00:29:41.258724+0000","last_peered":"2023-10-24T00:29:41.258724+0000","last_clean":"2023-10-24T00:29:41.258724+0000","last_became_active":"2023-10-24T00:29:40.909009+0000","last_became_peered":"2023-10-24T00:29:40.909009+0000","last_unstale":"2023-10-24T00:29:41.258724+0000","last_undegraded":"2023-10-24T00:29:41.258724+0000","last_fullsized":"2023-10-24T00:29:41.258724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281211+0000","last_change":"2023-10-24T00:29:41.275585+0000","last_active":"2023-10-24T00:29:41.281211+0000","last_peered":"2023-10-24T00:29:41.281211+0000","last_clean":"2023-10-24T00:29:41.281211+0000","last_became_active":"2023-10-24T00:29:41.275266+0000","last_became_peered":"2023-10-24T00:29:41.275266+0000","last_unstale":"2023-10-24T00:29:41.281211+0000","last_undegraded":"2023-10-24T00:29:41.281211+0000","last_fullsized":"2023-10-24T00:29:41.281211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.262460+0000","last_change":"2023-10-24T00:29:40.902165+0000","last_active":"2023-10-24T00:29:41.262460+0000","last_peered":"2023-10-24T00:29:41.262460+0000","last_clean":"2023-10-24T00:29:41.262460+0000","last_became_active":"2023-10-24T00:29:40.901924+0000","last_became_peered":"2023-10-24T00:29:40.901924+0000","last_unstale":"2023-10-24T00:29:41.262460+0000","last_undegraded":"2023-10-24T00:29:41.262460+0000","last_fullsized":"2023-10-24T00:29:41.262460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.285280+0000","last_change":"2023-10-24T00:29:41.283015+0000","last_active":"2023-10-24T00:29:41.285280+0000","last_peered":"2023-10-24T00:29:41.285280+0000","last_clean":"2023-10-24T00:29:41.285280+0000","last_became_active":"2023-10-24T00:29:41.282714+0000","last_became_peered":"2023-10-24T00:29:41.282714+0000","last_unstale":"2023-10-24T00:29:41.285280+0000","last_undegraded":"2023-10-24T00:29:41.285280+0000","last_fullsized":"2023-10-24T00:29:41.285280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275117+0000","last_change":"2023-10-24T00:29:40.905255+0000","last_active":"2023-10-24T00:29:41.275117+0000","last_peered":"2023-10-24T00:29:41.275117+0000","last_clean":"2023-10-24T00:29:41.275117+0000","last_became_active":"2023-10-24T00:29:40.904962+0000","last_became_peered":"2023-10-24T00:29:40.904962+0000","last_unstale":"2023-10-24T00:29:41.275117+0000","last_undegraded":"2023-10-24T00:29:41.275117+0000","last_fullsized":"2023-10-24T00:29:41.275117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282417+0000","last_change":"2023-10-24T00:29:41.280428+0000","last_active":"2023-10-24T00:29:41.282417+0000","last_peered":"2023-10-24T00:29:41.282417+0000","last_clean":"2023-10-24T00:29:41.282417+0000","last_became_active":"2023-10-24T00:29:41.279677+0000","last_became_peered":"2023-10-24T00:29:41.279677+0000","last_unstale":"2023-10-24T00:29:41.282417+0000","last_undegraded":"2023-10-24T00:29:41.282417+0000","last_fullsized":"2023-10-24T00:29:41.282417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260926+0000","last_change":"2023-10-24T00:29:40.911768+0000","last_active":"2023-10-24T00:29:41.260926+0000","last_peered":"2023-10-24T00:29:41.260926+0000","last_clean":"2023-10-24T00:29:41.260926+0000","last_became_active":"2023-10-24T00:29:40.911432+0000","last_became_peered":"2023-10-24T00:29:40.911432+0000","last_unstale":"2023-10-24T00:29:41.260926+0000","last_undegraded":"2023-10-24T00:29:41.260926+0000","last_fullsized":"2023-10-24T00:29:41.260926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275593+0000","last_change":"2023-10-24T00:29:41.273672+0000","last_active":"2023-10-24T00:29:41.275593+0000","last_peered":"2023-10-24T00:29:41.275593+0000","last_clean":"2023-10-24T00:29:41.275593+0000","last_became_active":"2023-10-24T00:29:41.273229+0000","last_became_peered":"2023-10-24T00:29:41.273229+0000","last_unstale":"2023-10-24T00:29:41.275593+0000","last_undegraded":"2023-10-24T00:29:41.275593+0000","last_fullsized":"2023-10-24T00:29:41.275593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279971+0000","last_change":"2023-10-24T00:29:40.905213+0000","last_active":"2023-10-24T00:29:41.279971+0000","last_peered":"2023-10-24T00:29:41.279971+0000","last_clean":"2023-10-24T00:29:41.279971+0000","last_became_active":"2023-10-24T00:29:40.904922+0000","last_became_peered":"2023-10-24T00:29:40.904922+0000","last_unstale":"2023-10-24T00:29:41.279971+0000","last_undegraded":"2023-10-24T00:29:41.279971+0000","last_fullsized":"2023-10-24T00:29:41.279971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278082+0000","last_change":"2023-10-24T00:29:41.273562+0000","last_active":"2023-10-24T00:29:41.278082+0000","last_peered":"2023-10-24T00:29:41.278082+0000","last_clean":"2023-10-24T00:29:41.278082+0000","last_became_active":"2023-10-24T00:29:41.273232+0000","last_became_peered":"2023-10-24T00:29:41.273232+0000","last_unstale":"2023-10-24T00:29:41.278082+0000","last_undegraded":"2023-10-24T00:29:41.278082+0000","last_fullsized":"2023-10-24T00:29:41.278082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.262371+0000","last_change":"2023-10-24T00:29:40.898960+0000","last_active":"2023-10-24T00:29:41.262371+0000","last_peered":"2023-10-24T00:29:41.262371+0000","last_clean":"2023-10-24T00:29:41.262371+0000","last_became_active":"2023-10-24T00:29:40.898635+0000","last_became_peered":"2023-10-24T00:29:40.898635+0000","last_unstale":"2023-10-24T00:29:41.262371+0000","last_undegraded":"2023-10-24T00:29:41.262371+0000","last_fullsized":"2023-10-24T00:29:41.262371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281786+0000","last_change":"2023-10-24T00:29:41.275964+0000","last_active":"2023-10-24T00:29:41.281786+0000","last_peered":"2023-10-24T00:29:41.281786+0000","last_clean":"2023-10-24T00:29:41.281786+0000","last_became_active":"2023-10-24T00:29:41.275661+0000","last_became_peered":"2023-10-24T00:29:41.275661+0000","last_unstale":"2023-10-24T00:29:41.281786+0000","last_undegraded":"2023-10-24T00:29:41.281786+0000","last_fullsized":"2023-10-24T00:29:41.281786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.259334+0000","last_change":"2023-10-24T00:29:40.902527+0000","last_active":"2023-10-24T00:29:41.259334+0000","last_peered":"2023-10-24T00:29:41.259334+0000","last_clean":"2023-10-24T00:29:41.259334+0000","last_became_active":"2023-10-24T00:29:40.901937+0000","last_became_peered":"2023-10-24T00:29:40.901937+0000","last_unstale":"2023-10-24T00:29:41.259334+0000","last_undegraded":"2023-10-24T00:29:41.259334+0000","last_fullsized":"2023-10-24T00:29:41.259334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286482+0000","last_change":"2023-10-24T00:29:41.279922+0000","last_active":"2023-10-24T00:29:41.286482+0000","last_peered":"2023-10-24T00:29:41.286482+0000","last_clean":"2023-10-24T00:29:41.286482+0000","last_became_active":"2023-10-24T00:29:41.279200+0000","last_became_peered":"2023-10-24T00:29:41.279200+0000","last_unstale":"2023-10-24T00:29:41.286482+0000","last_undegraded":"2023-10-24T00:29:41.286482+0000","last_fullsized":"2023-10-24T00:29:41.286482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270580+0000","last_change":"2023-10-24T00:29:40.909194+0000","last_active":"2023-10-24T00:29:41.270580+0000","last_peered":"2023-10-24T00:29:41.270580+0000","last_clean":"2023-10-24T00:29:41.270580+0000","last_became_active":"2023-10-24T00:29:40.908896+0000","last_became_peered":"2023-10-24T00:29:40.908896+0000","last_unstale":"2023-10-24T00:29:41.270580+0000","last_undegraded":"2023-10-24T00:29:41.270580+0000","last_fullsized":"2023-10-24T00:29:41.270580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286965+0000","last_change":"2023-10-24T00:29:41.281694+0000","last_active":"2023-10-24T00:29:41.286965+0000","last_peered":"2023-10-24T00:29:41.286965+0000","last_clean":"2023-10-24T00:29:41.286965+0000","last_became_active":"2023-10-24T00:29:41.281285+0000","last_became_peered":"2023-10-24T00:29:41.281285+0000","last_unstale":"2023-10-24T00:29:41.286965+0000","last_undegraded":"2023-10-24T00:29:41.286965+0000","last_fullsized":"2023-10-24T00:29:41.286965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258387+0000","last_change":"2023-10-24T00:29:40.900816+0000","last_active":"2023-10-24T00:29:41.258387+0000","last_peered":"2023-10-24T00:29:41.258387+0000","last_clean":"2023-10-24T00:29:41.258387+0000","last_became_active":"2023-10-24T00:29:40.899963+0000","last_became_peered":"2023-10-24T00:29:40.899963+0000","last_unstale":"2023-10-24T00:29:41.258387+0000","last_undegraded":"2023-10-24T00:29:41.258387+0000","last_fullsized":"2023-10-24T00:29:41.258387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281414+0000","last_change":"2023-10-24T00:29:41.276849+0000","last_active":"2023-10-24T00:29:41.281414+0000","last_peered":"2023-10-24T00:29:41.281414+0000","last_clean":"2023-10-24T00:29:41.281414+0000","last_became_active":"2023-10-24T00:29:41.276533+0000","last_became_peered":"2023-10-24T00:29:41.276533+0000","last_unstale":"2023-10-24T00:29:41.281414+0000","last_undegraded":"2023-10-24T00:29:41.281414+0000","last_fullsized":"2023-10-24T00:29:41.281414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-24T00:29:42.269949+0000","last_change":"2023-10-24T00:29:40.897950+0000","last_active":"2023-10-24T00:29:42.269949+0000","last_peered":"2023-10-24T00:29:42.269949+0000","last_clean":"2023-10-24T00:29:42.269949+0000","last_became_active":"2023-10-24T00:29:40.897653+0000","last_became_peered":"2023-10-24T00:29:40.897653+0000","last_unstale":"2023-10-24T00:29:42.269949+0000","last_undegraded":"2023-10-24T00:29:42.269949+0000","last_fullsized":"2023-10-24T00:29:42.269949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280908+0000","last_change":"2023-10-24T00:29:41.276420+0000","last_active":"2023-10-24T00:29:41.280908+0000","last_peered":"2023-10-24T00:29:41.280908+0000","last_clean":"2023-10-24T00:29:41.280908+0000","last_became_active":"2023-10-24T00:29:41.276090+0000","last_became_peered":"2023-10-24T00:29:41.276090+0000","last_unstale":"2023-10-24T00:29:41.280908+0000","last_undegraded":"2023-10-24T00:29:41.280908+0000","last_fullsized":"2023-10-24T00:29:41.280908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.257956+0000","last_change":"2023-10-24T00:29:40.903388+0000","last_active":"2023-10-24T00:29:41.257956+0000","last_peered":"2023-10-24T00:29:41.257956+0000","last_clean":"2023-10-24T00:29:41.257956+0000","last_became_active":"2023-10-24T00:29:40.902166+0000","last_became_peered":"2023-10-24T00:29:40.902166+0000","last_unstale":"2023-10-24T00:29:41.257956+0000","last_undegraded":"2023-10-24T00:29:41.257956+0000","last_fullsized":"2023-10-24T00:29:41.257956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281799+0000","last_change":"2023-10-24T00:29:41.278411+0000","last_active":"2023-10-24T00:29:41.281799+0000","last_peered":"2023-10-24T00:29:41.281799+0000","last_clean":"2023-10-24T00:29:41.281799+0000","last_became_active":"2023-10-24T00:29:41.278100+0000","last_became_peered":"2023-10-24T00:29:41.278100+0000","last_unstale":"2023-10-24T00:29:41.281799+0000","last_undegraded":"2023-10-24T00:29:41.281799+0000","last_fullsized":"2023-10-24T00:29:41.281799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270292+0000","last_change":"2023-10-24T00:29:40.910828+0000","last_active":"2023-10-24T00:29:41.270292+0000","last_peered":"2023-10-24T00:29:41.270292+0000","last_clean":"2023-10-24T00:29:41.270292+0000","last_became_active":"2023-10-24T00:29:40.910440+0000","last_became_peered":"2023-10-24T00:29:40.910440+0000","last_unstale":"2023-10-24T00:29:41.270292+0000","last_undegraded":"2023-10-24T00:29:41.270292+0000","last_fullsized":"2023-10-24T00:29:41.270292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278402+0000","last_change":"2023-10-24T00:29:41.273005+0000","last_active":"2023-10-24T00:29:41.278402+0000","last_peered":"2023-10-24T00:29:41.278402+0000","last_clean":"2023-10-24T00:29:41.278402+0000","last_became_active":"2023-10-24T00:29:41.272752+0000","last_became_peered":"2023-10-24T00:29:41.272752+0000","last_unstale":"2023-10-24T00:29:41.278402+0000","last_undegraded":"2023-10-24T00:29:41.278402+0000","last_fullsized":"2023-10-24T00:29:41.278402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.261125+0000","last_change":"2023-10-24T00:29:40.898693+0000","last_active":"2023-10-24T00:29:41.261125+0000","last_peered":"2023-10-24T00:29:41.261125+0000","last_clean":"2023-10-24T00:29:41.261125+0000","last_became_active":"2023-10-24T00:29:40.898183+0000","last_became_peered":"2023-10-24T00:29:40.898183+0000","last_unstale":"2023-10-24T00:29:41.261125+0000","last_undegraded":"2023-10-24T00:29:41.261125+0000","last_fullsized":"2023-10-24T00:29:41.261125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279562+0000","last_change":"2023-10-24T00:29:41.275537+0000","last_active":"2023-10-24T00:29:41.279562+0000","last_peered":"2023-10-24T00:29:41.279562+0000","last_clean":"2023-10-24T00:29:41.279562+0000","last_became_active":"2023-10-24T00:29:41.275261+0000","last_became_peered":"2023-10-24T00:29:41.275261+0000","last_unstale":"2023-10-24T00:29:41.279562+0000","last_undegraded":"2023-10-24T00:29:41.279562+0000","last_fullsized":"2023-10-24T00:29:41.279562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258470+0000","last_change":"2023-10-24T00:29:40.909407+0000","last_active":"2023-10-24T00:29:41.258470+0000","last_peered":"2023-10-24T00:29:41.258470+0000","last_clean":"2023-10-24T00:29:41.258470+0000","last_became_active":"2023-10-24T00:29:40.908984+0000","last_became_peered":"2023-10-24T00:29:40.908984+0000","last_unstale":"2023-10-24T00:29:41.258470+0000","last_undegraded":"2023-10-24T00:29:41.258470+0000","last_fullsized":"2023-10-24T00:29:41.258470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281960+0000","last_change":"2023-10-24T00:29:41.278520+0000","last_active":"2023-10-24T00:29:41.281960+0000","last_peered":"2023-10-24T00:29:41.281960+0000","last_clean":"2023-10-24T00:29:41.281960+0000","last_became_active":"2023-10-24T00:29:41.278233+0000","last_became_peered":"2023-10-24T00:29:41.278233+0000","last_unstale":"2023-10-24T00:29:41.281960+0000","last_undegraded":"2023-10-24T00:29:41.281960+0000","last_fullsized":"2023-10-24T00:29:41.281960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.265700+0000","last_change":"2023-10-24T00:29:40.902707+0000","last_active":"2023-10-24T00:29:41.265700+0000","last_peered":"2023-10-24T00:29:41.265700+0000","last_clean":"2023-10-24T00:29:41.265700+0000","last_became_active":"2023-10-24T00:29:40.901594+0000","last_became_peered":"2023-10-24T00:29:40.901594+0000","last_unstale":"2023-10-24T00:29:41.265700+0000","last_undegraded":"2023-10-24T00:29:41.265700+0000","last_fullsized":"2023-10-24T00:29:41.265700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282660+0000","last_change":"2023-10-24T00:29:41.279660+0000","last_active":"2023-10-24T00:29:41.282660+0000","last_peered":"2023-10-24T00:29:41.282660+0000","last_clean":"2023-10-24T00:29:41.282660+0000","last_became_active":"2023-10-24T00:29:41.279378+0000","last_became_peered":"2023-10-24T00:29:41.279378+0000","last_unstale":"2023-10-24T00:29:41.282660+0000","last_undegraded":"2023-10-24T00:29:41.282660+0000","last_fullsized":"2023-10-24T00:29:41.282660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258129+0000","last_change":"2023-10-24T00:29:40.899421+0000","last_active":"2023-10-24T00:29:41.258129+0000","last_peered":"2023-10-24T00:29:41.258129+0000","last_clean":"2023-10-24T00:29:41.258129+0000","last_became_active":"2023-10-24T00:29:40.898728+0000","last_became_peered":"2023-10-24T00:29:40.898728+0000","last_unstale":"2023-10-24T00:29:41.258129+0000","last_undegraded":"2023-10-24T00:29:41.258129+0000","last_fullsized":"2023-10-24T00:29:41.258129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277642+0000","last_change":"2023-10-24T00:29:41.274440+0000","last_active":"2023-10-24T00:29:41.277642+0000","last_peered":"2023-10-24T00:29:41.277642+0000","last_clean":"2023-10-24T00:29:41.277642+0000","last_became_active":"2023-10-24T00:29:41.274130+0000","last_became_peered":"2023-10-24T00:29:41.274130+0000","last_unstale":"2023-10-24T00:29:41.277642+0000","last_undegraded":"2023-10-24T00:29:41.277642+0000","last_fullsized":"2023-10-24T00:29:41.277642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.282087+0000","last_change":"2023-10-24T00:29:40.906739+0000","last_active":"2023-10-24T00:29:41.282087+0000","last_peered":"2023-10-24T00:29:41.282087+0000","last_clean":"2023-10-24T00:29:41.282087+0000","last_became_active":"2023-10-24T00:29:40.906422+0000","last_became_peered":"2023-10-24T00:29:40.906422+0000","last_unstale":"2023-10-24T00:29:41.282087+0000","last_undegraded":"2023-10-24T00:29:41.282087+0000","last_fullsized":"2023-10-24T00:29:41.282087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280986+0000","last_change":"2023-10-24T00:29:41.276038+0000","last_active":"2023-10-24T00:29:41.280986+0000","last_peered":"2023-10-24T00:29:41.280986+0000","last_clean":"2023-10-24T00:29:41.280986+0000","last_became_active":"2023-10-24T00:29:41.275776+0000","last_became_peered":"2023-10-24T00:29:41.275776+0000","last_unstale":"2023-10-24T00:29:41.280986+0000","last_undegraded":"2023-10-24T00:29:41.280986+0000","last_fullsized":"2023-10-24T00:29:41.280986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278446+0000","last_change":"2023-10-24T00:29:40.902110+0000","last_active":"2023-10-24T00:29:41.278446+0000","last_peered":"2023-10-24T00:29:41.278446+0000","last_clean":"2023-10-24T00:29:41.278446+0000","last_became_active":"2023-10-24T00:29:40.901833+0000","last_became_peered":"2023-10-24T00:29:40.901833+0000","last_unstale":"2023-10-24T00:29:41.278446+0000","last_undegraded":"2023-10-24T00:29:41.278446+0000","last_fullsized":"2023-10-24T00:29:41.278446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281703+0000","last_change":"2023-10-24T00:29:41.272332+0000","last_active":"2023-10-24T00:29:41.281703+0000","last_peered":"2023-10-24T00:29:41.281703+0000","last_clean":"2023-10-24T00:29:41.281703+0000","last_became_active":"2023-10-24T00:29:41.271678+0000","last_became_peered":"2023-10-24T00:29:41.271678+0000","last_unstale":"2023-10-24T00:29:41.281703+0000","last_undegraded":"2023-10-24T00:29:41.281703+0000","last_fullsized":"2023-10-24T00:29:41.281703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280931+0000","last_change":"2023-10-24T00:29:40.903470+0000","last_active":"2023-10-24T00:29:41.280931+0000","last_peered":"2023-10-24T00:29:41.280931+0000","last_clean":"2023-10-24T00:29:41.280931+0000","last_became_active":"2023-10-24T00:29:40.903108+0000","last_became_peered":"2023-10-24T00:29:40.903108+0000","last_unstale":"2023-10-24T00:29:41.280931+0000","last_undegraded":"2023-10-24T00:29:41.280931+0000","last_fullsized":"2023-10-24T00:29:41.280931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279179+0000","last_change":"2023-10-24T00:29:41.274048+0000","last_active":"2023-10-24T00:29:41.279179+0000","last_peered":"2023-10-24T00:29:41.279179+0000","last_clean":"2023-10-24T00:29:41.279179+0000","last_became_active":"2023-10-24T00:29:41.273751+0000","last_became_peered":"2023-10-24T00:29:41.273751+0000","last_unstale":"2023-10-24T00:29:41.279179+0000","last_undegraded":"2023-10-24T00:29:41.279179+0000","last_fullsized":"2023-10-24T00:29:41.279179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.261714+0000","last_change":"2023-10-24T00:29:40.895757+0000","last_active":"2023-10-24T00:29:41.261714+0000","last_peered":"2023-10-24T00:29:41.261714+0000","last_clean":"2023-10-24T00:29:41.261714+0000","last_became_active":"2023-10-24T00:29:40.895258+0000","last_became_peered":"2023-10-24T00:29:40.895258+0000","last_unstale":"2023-10-24T00:29:41.261714+0000","last_undegraded":"2023-10-24T00:29:41.261714+0000","last_fullsized":"2023-10-24T00:29:41.261714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.273376+0000","last_change":"2023-10-24T00:29:41.263508+0000","last_active":"2023-10-24T00:29:41.273376+0000","last_peered":"2023-10-24T00:29:41.273376+0000","last_clean":"2023-10-24T00:29:41.273376+0000","last_became_active":"2023-10-24T00:29:41.263243+0000","last_became_peered":"2023-10-24T00:29:41.263243+0000","last_unstale":"2023-10-24T00:29:41.273376+0000","last_undegraded":"2023-10-24T00:29:41.273376+0000","last_fullsized":"2023-10-24T00:29:41.273376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271183+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.271183+0000","last_peered":"2023-10-24T00:29:41.271183+0000","last_clean":"2023-10-24T00:29:41.271183+0000","last_became_active":"2023-10-24T00:29:40.908574+0000","last_became_peered":"2023-10-24T00:29:40.908574+0000","last_unstale":"2023-10-24T00:29:41.271183+0000","last_undegraded":"2023-10-24T00:29:41.271183+0000","last_fullsized":"2023-10-24T00:29:41.271183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286526+0000","last_change":"2023-10-24T00:29:41.280110+0000","last_active":"2023-10-24T00:29:41.286526+0000","last_peered":"2023-10-24T00:29:41.286526+0000","last_clean":"2023-10-24T00:29:41.286526+0000","last_became_active":"2023-10-24T00:29:41.279056+0000","last_became_peered":"2023-10-24T00:29:41.279056+0000","last_unstale":"2023-10-24T00:29:41.286526+0000","last_undegraded":"2023-10-24T00:29:41.286526+0000","last_fullsized":"2023-10-24T00:29:41.286526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258256+0000","last_change":"2023-10-24T00:29:40.900962+0000","last_active":"2023-10-24T00:29:41.258256+0000","last_peered":"2023-10-24T00:29:41.258256+0000","last_clean":"2023-10-24T00:29:41.258256+0000","last_became_active":"2023-10-24T00:29:40.900707+0000","last_became_peered":"2023-10-24T00:29:40.900707+0000","last_unstale":"2023-10-24T00:29:41.258256+0000","last_undegraded":"2023-10-24T00:29:41.258256+0000","last_fullsized":"2023-10-24T00:29:41.258256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281804+0000","last_change":"2023-10-24T00:29:41.279338+0000","last_active":"2023-10-24T00:29:41.281804+0000","last_peered":"2023-10-24T00:29:41.281804+0000","last_clean":"2023-10-24T00:29:41.281804+0000","last_became_active":"2023-10-24T00:29:41.277874+0000","last_became_peered":"2023-10-24T00:29:41.277874+0000","last_unstale":"2023-10-24T00:29:41.281804+0000","last_undegraded":"2023-10-24T00:29:41.281804+0000","last_fullsized":"2023-10-24T00:29:41.281804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.257319+0000","last_change":"2023-10-24T00:29:40.902739+0000","last_active":"2023-10-24T00:29:41.257319+0000","last_peered":"2023-10-24T00:29:41.257319+0000","last_clean":"2023-10-24T00:29:41.257319+0000","last_became_active":"2023-10-24T00:29:40.902480+0000","last_became_peered":"2023-10-24T00:29:40.902480+0000","last_unstale":"2023-10-24T00:29:41.257319+0000","last_undegraded":"2023-10-24T00:29:41.257319+0000","last_fullsized":"2023-10-24T00:29:41.257319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.283541+0000","last_change":"2023-10-24T00:29:41.274502+0000","last_active":"2023-10-24T00:29:41.283541+0000","last_peered":"2023-10-24T00:29:41.283541+0000","last_clean":"2023-10-24T00:29:41.283541+0000","last_became_active":"2023-10-24T00:29:41.274244+0000","last_became_peered":"2023-10-24T00:29:41.274244+0000","last_unstale":"2023-10-24T00:29:41.283541+0000","last_undegraded":"2023-10-24T00:29:41.283541+0000","last_fullsized":"2023-10-24T00:29:41.283541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.261012+0000","last_change":"2023-10-24T00:29:40.897704+0000","last_active":"2023-10-24T00:29:41.261012+0000","last_peered":"2023-10-24T00:29:41.261012+0000","last_clean":"2023-10-24T00:29:41.261012+0000","last_became_active":"2023-10-24T00:29:40.897390+0000","last_became_peered":"2023-10-24T00:29:40.897390+0000","last_unstale":"2023-10-24T00:29:41.261012+0000","last_undegraded":"2023-10-24T00:29:41.261012+0000","last_fullsized":"2023-10-24T00:29:41.261012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.288621+0000","last_change":"2023-10-24T00:29:41.282531+0000","last_active":"2023-10-24T00:29:41.288621+0000","last_peered":"2023-10-24T00:29:41.288621+0000","last_clean":"2023-10-24T00:29:41.288621+0000","last_became_active":"2023-10-24T00:29:41.282183+0000","last_became_peered":"2023-10-24T00:29:41.282183+0000","last_unstale":"2023-10-24T00:29:41.288621+0000","last_undegraded":"2023-10-24T00:29:41.288621+0000","last_fullsized":"2023-10-24T00:29:41.288621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.263953+0000","last_change":"2023-10-24T00:29:40.905342+0000","last_active":"2023-10-24T00:29:41.263953+0000","last_peered":"2023-10-24T00:29:41.263953+0000","last_clean":"2023-10-24T00:29:41.263953+0000","last_became_active":"2023-10-24T00:29:40.904840+0000","last_became_peered":"2023-10-24T00:29:40.904840+0000","last_unstale":"2023-10-24T00:29:41.263953+0000","last_undegraded":"2023-10-24T00:29:41.263953+0000","last_fullsized":"2023-10-24T00:29:41.263953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280653+0000","last_change":"2023-10-24T00:29:41.277528+0000","last_active":"2023-10-24T00:29:41.280653+0000","last_peered":"2023-10-24T00:29:41.280653+0000","last_clean":"2023-10-24T00:29:41.280653+0000","last_became_active":"2023-10-24T00:29:41.277225+0000","last_became_peered":"2023-10-24T00:29:41.277225+0000","last_unstale":"2023-10-24T00:29:41.280653+0000","last_undegraded":"2023-10-24T00:29:41.280653+0000","last_fullsized":"2023-10-24T00:29:41.280653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270711+0000","last_change":"2023-10-24T00:29:40.910398+0000","last_active":"2023-10-24T00:29:41.270711+0000","last_peered":"2023-10-24T00:29:41.270711+0000","last_clean":"2023-10-24T00:29:41.270711+0000","last_became_active":"2023-10-24T00:29:40.910084+0000","last_became_peered":"2023-10-24T00:29:40.910084+0000","last_unstale":"2023-10-24T00:29:41.270711+0000","last_undegraded":"2023-10-24T00:29:41.270711+0000","last_fullsized":"2023-10-24T00:29:41.270711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275356+0000","last_change":"2023-10-24T00:29:41.268378+0000","last_active":"2023-10-24T00:29:41.275356+0000","last_peered":"2023-10-24T00:29:41.275356+0000","last_clean":"2023-10-24T00:29:41.275356+0000","last_became_active":"2023-10-24T00:29:41.268116+0000","last_became_peered":"2023-10-24T00:29:41.268116+0000","last_unstale":"2023-10-24T00:29:41.275356+0000","last_undegraded":"2023-10-24T00:29:41.275356+0000","last_fullsized":"2023-10-24T00:29:41.275356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284657+0000","last_change":"2023-10-24T00:29:40.911169+0000","last_active":"2023-10-24T00:29:41.284657+0000","last_peered":"2023-10-24T00:29:41.284657+0000","last_clean":"2023-10-24T00:29:41.284657+0000","last_became_active":"2023-10-24T00:29:40.910890+0000","last_became_peered":"2023-10-24T00:29:40.910890+0000","last_unstale":"2023-10-24T00:29:41.284657+0000","last_undegraded":"2023-10-24T00:29:41.284657+0000","last_fullsized":"2023-10-24T00:29:41.284657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281659+0000","last_change":"2023-10-24T00:29:41.275940+0000","last_active":"2023-10-24T00:29:41.281659+0000","last_peered":"2023-10-24T00:29:41.281659+0000","last_clean":"2023-10-24T00:29:41.281659+0000","last_became_active":"2023-10-24T00:29:41.275626+0000","last_became_peered":"2023-10-24T00:29:41.275626+0000","last_unstale":"2023-10-24T00:29:41.281659+0000","last_undegraded":"2023-10-24T00:29:41.281659+0000","last_fullsized":"2023-10-24T00:29:41.281659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275445+0000","last_change":"2023-10-24T00:29:40.899331+0000","last_active":"2023-10-24T00:29:41.275445+0000","last_peered":"2023-10-24T00:29:41.275445+0000","last_clean":"2023-10-24T00:29:41.275445+0000","last_became_active":"2023-10-24T00:29:40.899079+0000","last_became_peered":"2023-10-24T00:29:40.899079+0000","last_unstale":"2023-10-24T00:29:41.275445+0000","last_undegraded":"2023-10-24T00:29:41.275445+0000","last_fullsized":"2023-10-24T00:29:41.275445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280510+0000","last_change":"2023-10-24T00:29:41.278062+0000","last_active":"2023-10-24T00:29:41.280510+0000","last_peered":"2023-10-24T00:29:41.280510+0000","last_clean":"2023-10-24T00:29:41.280510+0000","last_became_active":"2023-10-24T00:29:41.277767+0000","last_became_peered":"2023-10-24T00:29:41.277767+0000","last_unstale":"2023-10-24T00:29:41.280510+0000","last_undegraded":"2023-10-24T00:29:41.280510+0000","last_fullsized":"2023-10-24T00:29:41.280510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279687+0000","last_change":"2023-10-24T00:29:40.901197+0000","last_active":"2023-10-24T00:29:41.279687+0000","last_peered":"2023-10-24T00:29:41.279687+0000","last_clean":"2023-10-24T00:29:41.279687+0000","last_became_active":"2023-10-24T00:29:40.900897+0000","last_became_peered":"2023-10-24T00:29:40.900897+0000","last_unstale":"2023-10-24T00:29:41.279687+0000","last_undegraded":"2023-10-24T00:29:41.279687+0000","last_fullsized":"2023-10-24T00:29:41.279687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.286060+0000","last_change":"2023-10-24T00:29:41.280010+0000","last_active":"2023-10-24T00:29:41.286060+0000","last_peered":"2023-10-24T00:29:41.286060+0000","last_clean":"2023-10-24T00:29:41.286060+0000","last_became_active":"2023-10-24T00:29:41.279742+0000","last_became_peered":"2023-10-24T00:29:41.279742+0000","last_unstale":"2023-10-24T00:29:41.286060+0000","last_undegraded":"2023-10-24T00:29:41.286060+0000","last_fullsized":"2023-10-24T00:29:41.286060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.257678+0000","last_change":"2023-10-24T00:29:40.903275+0000","last_active":"2023-10-24T00:29:41.257678+0000","last_peered":"2023-10-24T00:29:41.257678+0000","last_clean":"2023-10-24T00:29:41.257678+0000","last_became_active":"2023-10-24T00:29:40.903013+0000","last_became_peered":"2023-10-24T00:29:40.903013+0000","last_unstale":"2023-10-24T00:29:41.257678+0000","last_undegraded":"2023-10-24T00:29:41.257678+0000","last_fullsized":"2023-10-24T00:29:41.257678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280720+0000","last_change":"2023-10-24T00:29:41.276786+0000","last_active":"2023-10-24T00:29:41.280720+0000","last_peered":"2023-10-24T00:29:41.280720+0000","last_clean":"2023-10-24T00:29:41.280720+0000","last_became_active":"2023-10-24T00:29:41.276496+0000","last_became_peered":"2023-10-24T00:29:41.276496+0000","last_unstale":"2023-10-24T00:29:41.280720+0000","last_undegraded":"2023-10-24T00:29:41.280720+0000","last_fullsized":"2023-10-24T00:29:41.280720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.265577+0000","last_change":"2023-10-24T00:29:40.902830+0000","last_active":"2023-10-24T00:29:41.265577+0000","last_peered":"2023-10-24T00:29:41.265577+0000","last_clean":"2023-10-24T00:29:41.265577+0000","last_became_active":"2023-10-24T00:29:40.901977+0000","last_became_peered":"2023-10-24T00:29:40.901977+0000","last_unstale":"2023-10-24T00:29:41.265577+0000","last_undegraded":"2023-10-24T00:29:41.265577+0000","last_fullsized":"2023-10-24T00:29:41.265577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.285952+0000","last_change":"2023-10-24T00:29:41.278415+0000","last_active":"2023-10-24T00:29:41.285952+0000","last_peered":"2023-10-24T00:29:41.285952+0000","last_clean":"2023-10-24T00:29:41.285952+0000","last_became_active":"2023-10-24T00:29:41.278132+0000","last_became_peered":"2023-10-24T00:29:41.278132+0000","last_unstale":"2023-10-24T00:29:41.285952+0000","last_undegraded":"2023-10-24T00:29:41.285952+0000","last_fullsized":"2023-10-24T00:29:41.285952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280318+0000","last_change":"2023-10-24T00:29:40.899606+0000","last_active":"2023-10-24T00:29:41.280318+0000","last_peered":"2023-10-24T00:29:41.280318+0000","last_clean":"2023-10-24T00:29:41.280318+0000","last_became_active":"2023-10-24T00:29:40.899105+0000","last_became_peered":"2023-10-24T00:29:40.899105+0000","last_unstale":"2023-10-24T00:29:41.280318+0000","last_undegraded":"2023-10-24T00:29:41.280318+0000","last_fullsized":"2023-10-24T00:29:41.280318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278626+0000","last_change":"2023-10-24T00:29:41.270487+0000","last_active":"2023-10-24T00:29:41.278626+0000","last_peered":"2023-10-24T00:29:41.278626+0000","last_clean":"2023-10-24T00:29:41.278626+0000","last_became_active":"2023-10-24T00:29:41.270217+0000","last_became_peered":"2023-10-24T00:29:41.270217+0000","last_unstale":"2023-10-24T00:29:41.278626+0000","last_undegraded":"2023-10-24T00:29:41.278626+0000","last_fullsized":"2023-10-24T00:29:41.278626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284580+0000","last_change":"2023-10-24T00:29:40.910529+0000","last_active":"2023-10-24T00:29:41.284580+0000","last_peered":"2023-10-24T00:29:41.284580+0000","last_clean":"2023-10-24T00:29:41.284580+0000","last_became_active":"2023-10-24T00:29:40.910236+0000","last_became_peered":"2023-10-24T00:29:40.910236+0000","last_unstale":"2023-10-24T00:29:41.284580+0000","last_undegraded":"2023-10-24T00:29:41.284580+0000","last_fullsized":"2023-10-24T00:29:41.284580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.287024+0000","last_change":"2023-10-24T00:29:41.284279+0000","last_active":"2023-10-24T00:29:41.287024+0000","last_peered":"2023-10-24T00:29:41.287024+0000","last_clean":"2023-10-24T00:29:41.287024+0000","last_became_active":"2023-10-24T00:29:41.279681+0000","last_became_peered":"2023-10-24T00:29:41.279681+0000","last_unstale":"2023-10-24T00:29:41.287024+0000","last_undegraded":"2023-10-24T00:29:41.287024+0000","last_fullsized":"2023-10-24T00:29:41.287024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280344+0000","last_change":"2023-10-24T00:29:40.907996+0000","last_active":"2023-10-24T00:29:41.280344+0000","last_peered":"2023-10-24T00:29:41.280344+0000","last_clean":"2023-10-24T00:29:41.280344+0000","last_became_active":"2023-10-24T00:29:40.907716+0000","last_became_peered":"2023-10-24T00:29:40.907716+0000","last_unstale":"2023-10-24T00:29:41.280344+0000","last_undegraded":"2023-10-24T00:29:41.280344+0000","last_fullsized":"2023-10-24T00:29:41.280344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281724+0000","last_change":"2023-10-24T00:29:41.272530+0000","last_active":"2023-10-24T00:29:41.281724+0000","last_peered":"2023-10-24T00:29:41.281724+0000","last_clean":"2023-10-24T00:29:41.281724+0000","last_became_active":"2023-10-24T00:29:41.271987+0000","last_became_peered":"2023-10-24T00:29:41.271987+0000","last_unstale":"2023-10-24T00:29:41.281724+0000","last_undegraded":"2023-10-24T00:29:41.281724+0000","last_fullsized":"2023-10-24T00:29:41.281724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.262252+0000","last_change":"2023-10-24T00:29:40.904046+0000","last_active":"2023-10-24T00:29:41.262252+0000","last_peered":"2023-10-24T00:29:41.262252+0000","last_clean":"2023-10-24T00:29:41.262252+0000","last_became_active":"2023-10-24T00:29:40.903723+0000","last_became_peered":"2023-10-24T00:29:40.903723+0000","last_unstale":"2023-10-24T00:29:41.262252+0000","last_undegraded":"2023-10-24T00:29:41.262252+0000","last_fullsized":"2023-10-24T00:29:41.262252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275703+0000","last_change":"2023-10-24T00:29:41.272804+0000","last_active":"2023-10-24T00:29:41.275703+0000","last_peered":"2023-10-24T00:29:41.275703+0000","last_clean":"2023-10-24T00:29:41.275703+0000","last_became_active":"2023-10-24T00:29:41.272528+0000","last_became_peered":"2023-10-24T00:29:41.272528+0000","last_unstale":"2023-10-24T00:29:41.275703+0000","last_undegraded":"2023-10-24T00:29:41.275703+0000","last_fullsized":"2023-10-24T00:29:41.275703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258871+0000","last_change":"2023-10-24T00:29:40.899780+0000","last_active":"2023-10-24T00:29:41.258871+0000","last_peered":"2023-10-24T00:29:41.258871+0000","last_clean":"2023-10-24T00:29:41.258871+0000","last_became_active":"2023-10-24T00:29:40.897495+0000","last_became_peered":"2023-10-24T00:29:40.897495+0000","last_unstale":"2023-10-24T00:29:41.258871+0000","last_undegraded":"2023-10-24T00:29:41.258871+0000","last_fullsized":"2023-10-24T00:29:41.258871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.280768+0000","last_change":"2023-10-24T00:29:41.278176+0000","last_active":"2023-10-24T00:29:41.280768+0000","last_peered":"2023-10-24T00:29:41.280768+0000","last_clean":"2023-10-24T00:29:41.280768+0000","last_became_active":"2023-10-24T00:29:41.276898+0000","last_became_peered":"2023-10-24T00:29:41.276898+0000","last_unstale":"2023-10-24T00:29:41.280768+0000","last_undegraded":"2023-10-24T00:29:41.280768+0000","last_fullsized":"2023-10-24T00:29:41.280768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279014+0000","last_change":"2023-10-24T00:29:40.904817+0000","last_active":"2023-10-24T00:29:41.279014+0000","last_peered":"2023-10-24T00:29:41.279014+0000","last_clean":"2023-10-24T00:29:41.279014+0000","last_became_active":"2023-10-24T00:29:40.904554+0000","last_became_peered":"2023-10-24T00:29:40.904554+0000","last_unstale":"2023-10-24T00:29:41.279014+0000","last_undegraded":"2023-10-24T00:29:41.279014+0000","last_fullsized":"2023-10-24T00:29:41.279014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.275497+0000","last_change":"2023-10-24T00:29:41.268371+0000","last_active":"2023-10-24T00:29:41.275497+0000","last_peered":"2023-10-24T00:29:41.275497+0000","last_clean":"2023-10-24T00:29:41.275497+0000","last_became_active":"2023-10-24T00:29:41.268090+0000","last_became_peered":"2023-10-24T00:29:41.268090+0000","last_unstale":"2023-10-24T00:29:41.275497+0000","last_undegraded":"2023-10-24T00:29:41.275497+0000","last_fullsized":"2023-10-24T00:29:41.275497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.261040+0000","last_change":"2023-10-24T00:29:40.899587+0000","last_active":"2023-10-24T00:29:41.261040+0000","last_peered":"2023-10-24T00:29:41.261040+0000","last_clean":"2023-10-24T00:29:41.261040+0000","last_became_active":"2023-10-24T00:29:40.899281+0000","last_became_peered":"2023-10-24T00:29:40.899281+0000","last_unstale":"2023-10-24T00:29:41.261040+0000","last_undegraded":"2023-10-24T00:29:41.261040+0000","last_fullsized":"2023-10-24T00:29:41.261040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279597+0000","last_change":"2023-10-24T00:29:41.274908+0000","last_active":"2023-10-24T00:29:41.279597+0000","last_peered":"2023-10-24T00:29:41.279597+0000","last_clean":"2023-10-24T00:29:41.279597+0000","last_became_active":"2023-10-24T00:29:41.274570+0000","last_became_peered":"2023-10-24T00:29:41.274570+0000","last_unstale":"2023-10-24T00:29:41.279597+0000","last_undegraded":"2023-10-24T00:29:41.279597+0000","last_fullsized":"2023-10-24T00:29:41.279597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.257682+0000","last_change":"2023-10-24T00:29:40.903507+0000","last_active":"2023-10-24T00:29:41.257682+0000","last_peered":"2023-10-24T00:29:41.257682+0000","last_clean":"2023-10-24T00:29:41.257682+0000","last_became_active":"2023-10-24T00:29:40.903175+0000","last_became_peered":"2023-10-24T00:29:40.903175+0000","last_unstale":"2023-10-24T00:29:41.257682+0000","last_undegraded":"2023-10-24T00:29:41.257682+0000","last_fullsized":"2023-10-24T00:29:41.257682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.283565+0000","last_change":"2023-10-24T00:29:41.274542+0000","last_active":"2023-10-24T00:29:41.283565+0000","last_peered":"2023-10-24T00:29:41.283565+0000","last_clean":"2023-10-24T00:29:41.283565+0000","last_became_active":"2023-10-24T00:29:41.274257+0000","last_became_peered":"2023-10-24T00:29:41.274257+0000","last_unstale":"2023-10-24T00:29:41.283565+0000","last_undegraded":"2023-10-24T00:29:41.283565+0000","last_fullsized":"2023-10-24T00:29:41.283565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260606+0000","last_change":"2023-10-24T00:29:40.897887+0000","last_active":"2023-10-24T00:29:41.260606+0000","last_peered":"2023-10-24T00:29:41.260606+0000","last_clean":"2023-10-24T00:29:41.260606+0000","last_became_active":"2023-10-24T00:29:40.897165+0000","last_became_peered":"2023-10-24T00:29:40.897165+0000","last_unstale":"2023-10-24T00:29:41.260606+0000","last_undegraded":"2023-10-24T00:29:41.260606+0000","last_fullsized":"2023-10-24T00:29:41.260606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278171+0000","last_change":"2023-10-24T00:29:41.270162+0000","last_active":"2023-10-24T00:29:41.278171+0000","last_peered":"2023-10-24T00:29:41.278171+0000","last_clean":"2023-10-24T00:29:41.278171+0000","last_became_active":"2023-10-24T00:29:41.269888+0000","last_became_peered":"2023-10-24T00:29:41.269888+0000","last_unstale":"2023-10-24T00:29:41.278171+0000","last_undegraded":"2023-10-24T00:29:41.278171+0000","last_fullsized":"2023-10-24T00:29:41.278171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260187+0000","last_change":"2023-10-24T00:29:40.903533+0000","last_active":"2023-10-24T00:29:41.260187+0000","last_peered":"2023-10-24T00:29:41.260187+0000","last_clean":"2023-10-24T00:29:41.260187+0000","last_became_active":"2023-10-24T00:29:40.903269+0000","last_became_peered":"2023-10-24T00:29:40.903269+0000","last_unstale":"2023-10-24T00:29:41.260187+0000","last_undegraded":"2023-10-24T00:29:41.260187+0000","last_fullsized":"2023-10-24T00:29:41.260187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258946+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:29:41.258946+0000","last_peered":"2023-10-24T00:29:41.258946+0000","last_clean":"2023-10-24T00:29:41.258946+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:29:41.258946+0000","last_undegraded":"2023-10-24T00:29:41.258946+0000","last_fullsized":"2023-10-24T00:29:41.258946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279472+0000","last_change":"2023-10-24T00:29:41.273001+0000","last_active":"2023-10-24T00:29:41.279472+0000","last_peered":"2023-10-24T00:29:41.279472+0000","last_clean":"2023-10-24T00:29:41.279472+0000","last_became_active":"2023-10-24T00:29:41.272725+0000","last_became_peered":"2023-10-24T00:29:41.272725+0000","last_unstale":"2023-10-24T00:29:41.279472+0000","last_undegraded":"2023-10-24T00:29:41.279472+0000","last_fullsized":"2023-10-24T00:29:41.279472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.259783+0000","last_change":"2023-10-24T00:29:40.908517+0000","last_active":"2023-10-24T00:29:41.259783+0000","last_peered":"2023-10-24T00:29:41.259783+0000","last_clean":"2023-10-24T00:29:41.259783+0000","last_became_active":"2023-10-24T00:29:40.908183+0000","last_became_peered":"2023-10-24T00:29:40.908183+0000","last_unstale":"2023-10-24T00:29:41.259783+0000","last_undegraded":"2023-10-24T00:29:41.259783+0000","last_fullsized":"2023-10-24T00:29:41.259783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.271086+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:29:41.271086+0000","last_peered":"2023-10-24T00:29:41.271086+0000","last_clean":"2023-10-24T00:29:41.271086+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:29:41.271086+0000","last_undegraded":"2023-10-24T00:29:41.271086+0000","last_fullsized":"2023-10-24T00:29:41.271086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.279636+0000","last_change":"2023-10-24T00:29:41.275099+0000","last_active":"2023-10-24T00:29:41.279636+0000","last_peered":"2023-10-24T00:29:41.279636+0000","last_clean":"2023-10-24T00:29:41.279636+0000","last_became_active":"2023-10-24T00:29:41.273851+0000","last_became_peered":"2023-10-24T00:29:41.273851+0000","last_unstale":"2023-10-24T00:29:41.279636+0000","last_undegraded":"2023-10-24T00:29:41.279636+0000","last_fullsized":"2023-10-24T00:29:41.279636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260936+0000","last_change":"2023-10-24T00:29:40.908757+0000","last_active":"2023-10-24T00:29:41.260936+0000","last_peered":"2023-10-24T00:29:41.260936+0000","last_clean":"2023-10-24T00:29:41.260936+0000","last_became_active":"2023-10-24T00:29:40.908448+0000","last_became_peered":"2023-10-24T00:29:40.908448+0000","last_unstale":"2023-10-24T00:29:41.260936+0000","last_undegraded":"2023-10-24T00:29:41.260936+0000","last_fullsized":"2023-10-24T00:29:41.260936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260802+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:29:41.260802+0000","last_peered":"2023-10-24T00:29:41.260802+0000","last_clean":"2023-10-24T00:29:41.260802+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:29:41.260802+0000","last_undegraded":"2023-10-24T00:29:41.260802+0000","last_fullsized":"2023-10-24T00:29:41.260802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.287017+0000","last_change":"2023-10-24T00:29:41.284246+0000","last_active":"2023-10-24T00:29:41.287017+0000","last_peered":"2023-10-24T00:29:41.287017+0000","last_clean":"2023-10-24T00:29:41.287017+0000","last_became_active":"2023-10-24T00:29:41.280875+0000","last_became_peered":"2023-10-24T00:29:41.280875+0000","last_unstale":"2023-10-24T00:29:41.287017+0000","last_undegraded":"2023-10-24T00:29:41.287017+0000","last_fullsized":"2023-10-24T00:29:41.287017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258834+0000","last_change":"2023-10-24T00:29:40.904270+0000","last_active":"2023-10-24T00:29:41.258834+0000","last_peered":"2023-10-24T00:29:41.258834+0000","last_clean":"2023-10-24T00:29:41.258834+0000","last_became_active":"2023-10-24T00:29:40.903932+0000","last_became_peered":"2023-10-24T00:29:40.903932+0000","last_unstale":"2023-10-24T00:29:41.258834+0000","last_undegraded":"2023-10-24T00:29:41.258834+0000","last_fullsized":"2023-10-24T00:29:41.258834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.270711+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:29:41.270711+0000","last_peered":"2023-10-24T00:29:41.270711+0000","last_clean":"2023-10-24T00:29:41.270711+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:29:41.270711+0000","last_undegraded":"2023-10-24T00:29:41.270711+0000","last_fullsized":"2023-10-24T00:29:41.270711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.259025+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:29:41.259025+0000","last_peered":"2023-10-24T00:29:41.259025+0000","last_clean":"2023-10-24T00:29:41.259025+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:29:41.259025+0000","last_undegraded":"2023-10-24T00:29:41.259025+0000","last_fullsized":"2023-10-24T00:29:41.259025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281051+0000","last_change":"2023-10-24T00:29:41.276534+0000","last_active":"2023-10-24T00:29:41.281051+0000","last_peered":"2023-10-24T00:29:41.281051+0000","last_clean":"2023-10-24T00:29:41.281051+0000","last_became_active":"2023-10-24T00:29:41.276250+0000","last_became_peered":"2023-10-24T00:29:41.276250+0000","last_unstale":"2023-10-24T00:29:41.281051+0000","last_undegraded":"2023-10-24T00:29:41.281051+0000","last_fullsized":"2023-10-24T00:29:41.281051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.284690+0000","last_change":"2023-10-24T00:29:40.909655+0000","last_active":"2023-10-24T00:29:41.284690+0000","last_peered":"2023-10-24T00:29:41.284690+0000","last_clean":"2023-10-24T00:29:41.284690+0000","last_became_active":"2023-10-24T00:29:40.908367+0000","last_became_peered":"2023-10-24T00:29:40.908367+0000","last_unstale":"2023-10-24T00:29:41.284690+0000","last_undegraded":"2023-10-24T00:29:41.284690+0000","last_fullsized":"2023-10-24T00:29:41.284690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.259222+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:29:41.259222+0000","last_peered":"2023-10-24T00:29:41.259222+0000","last_clean":"2023-10-24T00:29:41.259222+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:29:41.259222+0000","last_undegraded":"2023-10-24T00:29:41.259222+0000","last_fullsized":"2023-10-24T00:29:41.259222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.278291+0000","last_change":"2023-10-24T00:29:41.272020+0000","last_active":"2023-10-24T00:29:41.278291+0000","last_peered":"2023-10-24T00:29:41.278291+0000","last_clean":"2023-10-24T00:29:41.278291+0000","last_became_active":"2023-10-24T00:29:41.271800+0000","last_became_peered":"2023-10-24T00:29:41.271800+0000","last_unstale":"2023-10-24T00:29:41.278291+0000","last_undegraded":"2023-10-24T00:29:41.278291+0000","last_fullsized":"2023-10-24T00:29:41.278291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.267944+0000","last_change":"2023-10-24T00:29:40.896811+0000","last_active":"2023-10-24T00:29:41.267944+0000","last_peered":"2023-10-24T00:29:41.267944+0000","last_clean":"2023-10-24T00:29:41.267944+0000","last_became_active":"2023-10-24T00:29:40.896518+0000","last_became_peered":"2023-10-24T00:29:40.896518+0000","last_unstale":"2023-10-24T00:29:41.267944+0000","last_undegraded":"2023-10-24T00:29:41.267944+0000","last_fullsized":"2023-10-24T00:29:41.267944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.258676+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:29:41.258676+0000","last_peered":"2023-10-24T00:29:41.258676+0000","last_clean":"2023-10-24T00:29:41.258676+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:29:41.258676+0000","last_undegraded":"2023-10-24T00:29:41.258676+0000","last_fullsized":"2023-10-24T00:29:41.258676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.281111+0000","last_change":"2023-10-24T00:29:41.271268+0000","last_active":"2023-10-24T00:29:41.281111+0000","last_peered":"2023-10-24T00:29:41.281111+0000","last_clean":"2023-10-24T00:29:41.281111+0000","last_became_active":"2023-10-24T00:29:41.270938+0000","last_became_peered":"2023-10-24T00:29:41.270938+0000","last_unstale":"2023-10-24T00:29:41.281111+0000","last_undegraded":"2023-10-24T00:29:41.281111+0000","last_fullsized":"2023-10-24T00:29:41.281111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.260844+0000","last_change":"2023-10-24T00:29:40.897246+0000","last_active":"2023-10-24T00:29:41.260844+0000","last_peered":"2023-10-24T00:29:41.260844+0000","last_clean":"2023-10-24T00:29:41.260844+0000","last_became_active":"2023-10-24T00:29:40.896978+0000","last_became_peered":"2023-10-24T00:29:40.896978+0000","last_unstale":"2023-10-24T00:29:41.260844+0000","last_undegraded":"2023-10-24T00:29:41.260844+0000","last_fullsized":"2023-10-24T00:29:41.260844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.257270+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:29:41.257270+0000","last_peered":"2023-10-24T00:29:41.257270+0000","last_clean":"2023-10-24T00:29:41.257270+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:29:41.257270+0000","last_undegraded":"2023-10-24T00:29:41.257270+0000","last_fullsized":"2023-10-24T00:29:41.257270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.277587+0000","last_change":"2023-10-24T00:29:41.273553+0000","last_active":"2023-10-24T00:29:41.277587+0000","last_peered":"2023-10-24T00:29:41.277587+0000","last_clean":"2023-10-24T00:29:41.277587+0000","last_became_active":"2023-10-24T00:29:41.273266+0000","last_became_peered":"2023-10-24T00:29:41.273266+0000","last_unstale":"2023-10-24T00:29:41.277587+0000","last_undegraded":"2023-10-24T00:29:41.277587+0000","last_fullsized":"2023-10-24T00:29:41.277587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:40.878302+0000","last_clean_scrub_stamp":"2023-10-24T00:29:40.878302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.266722+0000","last_change":"2023-10-24T00:29:40.901452+0000","last_active":"2023-10-24T00:29:41.266722+0000","last_peered":"2023-10-24T00:29:41.266722+0000","last_clean":"2023-10-24T00:29:41.266722+0000","last_became_active":"2023-10-24T00:29:40.901174+0000","last_became_peered":"2023-10-24T00:29:40.901174+0000","last_unstale":"2023-10-24T00:29:41.266722+0000","last_undegraded":"2023-10-24T00:29:41.266722+0000","last_fullsized":"2023-10-24T00:29:41.266722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:29:39.873877+0000","last_clean_scrub_stamp":"2023-10-24T00:29:39.873877+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-24T00:29:41.269459+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:29:41.269459+0000","last_peered":"2023-10-24T00:29:41.269459+0000","last_clean":"2023-10-24T00:29:41.269459+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:29:41.269459+0000","last_undegraded":"2023-10-24T00:29:41.269459+0000","last_fullsized":"2023-10-24T00:29:41.269459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":159224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":397312,"data_stored":160138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":158740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":160220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.28000000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":159134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.437},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621}]},{"osd":4,"last update":"Tue Oct 24 00:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":158580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"last":0.22},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.29199999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26900000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51700000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.50900000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:29:49.033 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:29:49.034 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:29:49.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.180+0000 7f02539c5700 1 Processor -- start 2023-10-24T00:29:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.180+0000 7f02539c5700 1 -- start start 2023-10-24T00:29:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f02539c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f02539c5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f024c098bd0 0x7f024c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f02539c5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c0c71d0 con 0x7f024c0bffd0 2023-10-24T00:29:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f02539c5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024c0c9410 con 0x7f024c098bd0 2023-10-24T00:29:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f02539c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0c6c10 con 0x7f024c154430 2023-10-24T00:29:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f024c098bd0 0x7f024c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0251f62700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f024c0bffd0 0x7f024c0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53550/0 (socket says 172.21.15.148:53550) 2023-10-24T00:29:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0251f62700 1 -- 172.21.15.148:0/2107187966 learned_addr learned my addr 172.21.15.148:0/2107187966 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 -- 172.21.15.148:0/2107187966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 msgr2=0x7f024c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 --2- 172.21.15.148:0/2107187966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 -- 172.21.15.148:0/2107187966 >> v1:172.21.15.148:6789/0 conn(0x7f024c0bffd0 legacy=0x7f024c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 -- 172.21.15.148:0/2107187966 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0c6ef0 con 0x7f024c098bd0 2023-10-24T00:29:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0243fff700 1 -- 172.21.15.148:0/2107187966 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752258756 0 0) 0x7f024c0c71d0 con 0x7f024c0bffd0 2023-10-24T00:29:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0250f60700 1 --2- 172.21.15.148:0/2107187966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c0c6300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f023c009790 tx=0x7f023c009060).ready entity=mon.0 client_cookie=48ccad7447edd0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.181+0000 7f0243fff700 1 -- 172.21.15.148:0/2107187966 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00b580 con 0x7f024c098bd0 2023-10-24T00:29:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f0243fff700 1 -- 172.21.15.148:0/2107187966 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c00b6e0 con 0x7f024c098bd0 2023-10-24T00:29:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f0243fff700 1 -- 172.21.15.148:0/2107187966 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c00ba60 con 0x7f024c098bd0 2023-10-24T00:29:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 -- 172.21.15.148:0/2107187966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 msgr2=0x7f024c0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 --2- 172.21.15.148:0/2107187966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c0c6300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f023c009790 tx=0x7f023c009060).stop 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 -- 172.21.15.148:0/2107187966 shutdown_connections 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 --2- 172.21.15.148:0/2107187966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 --2- 172.21.15.148:0/2107187966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c0c6300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 -- 172.21.15.148:0/2107187966 >> 172.21.15.148:0/2107187966 conn(0x7f024c0cb070 msgr2=0x7f024c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 -- 172.21.15.148:0/2107187966 shutdown_connections 2023-10-24T00:29:49.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.182+0000 7f02539c5700 1 -- 172.21.15.148:0/2107187966 wait complete. 2023-10-24T00:29:49.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.183+0000 7f02539c5700 1 Processor -- start 2023-10-24T00:29:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.183+0000 7f02539c5700 1 -- start start 2023-10-24T00:29:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 0x7f024c152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0c3290 con 0x7f024c098bd0 2023-10-24T00:29:49.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0c3810 con 0x7f024c0bffd0 2023-10-24T00:29:49.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f02539c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c1538a0 con 0x7f024c154430 2023-10-24T00:29:49.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f0251761700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f0251761700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46158/0 (socket says 172.21.15.148:46158) 2023-10-24T00:29:49.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f0251761700 1 -- 172.21.15.148:0/3095157004 learned_addr learned my addr 172.21.15.148:0/3095157004 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:49.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.184+0000 7f0251f62700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0250f60700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 0x7f024c152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 -- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 msgr2=0x7f024c150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 -- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 msgr2=0x7f024c152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 0x7f024c152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 -- 172.21.15.148:0/3095157004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0092a0 con 0x7f024c098bd0 2023-10-24T00:29:49.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0250f60700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 0x7f024c152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:49.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f0251761700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f024800b490 tx=0x7f0248009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248002320 con 0x7f024c098bd0 2023-10-24T00:29:49.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248002480 con 0x7f024c098bd0 2023-10-24T00:29:49.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248002840 con 0x7f024c098bd0 2023-10-24T00:29:49.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c153b80 con 0x7f024c098bd0 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.185+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c0ae830 con 0x7f024c098bd0 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.186+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c06c6b0 con 0x7f024c098bd0 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.186+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0248002bf0 con 0x7f024c098bd0 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.186+0000 7f02417fa700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 0x7f0230061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.187+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0248079f90 con 0x7f024c098bd0 2023-10-24T00:29:49.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.187+0000 7f0250f60700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 0x7f0230061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.187+0000 7f0250f60700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 0x7f0230061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f023c009790 tx=0x7f023c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.191+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f024804b260 con 0x7f024c098bd0 2023-10-24T00:29:49.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.420+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f024c0c90a0 con 0x7f024c098bd0 2023-10-24T00:29:49.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.424+0000 7f02417fa700 1 -- 172.21.15.148:0/3095157004 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f024804e880 con 0x7f024c098bd0 2023-10-24T00:29:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 msgr2=0x7f0230061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 0x7f0230061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f023c009790 tx=0x7f023c017000).stop 2023-10-24T00:29:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 msgr2=0x7f024c142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f024800b490 tx=0x7f0248009060).stop 2023-10-24T00:29:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 shutdown_connections 2023-10-24T00:29:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f024c154430 0x7f024c150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f023005f150 0x7f0230061610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f024c098bd0 0x7f024c142200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 --2- 172.21.15.148:0/3095157004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f024c0bffd0 0x7f024c152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 >> 172.21.15.148:0/3095157004 conn(0x7f024c0cb070 msgr2=0x7f024c0a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:49.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 shutdown_connections 2023-10-24T00:29:49.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.426+0000 7f02539c5700 1 -- 172.21.15.148:0/3095157004 wait complete. 2023-10-24T00:29:49.431 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:29:49.439 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:29:49.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.552+0000 7f5350719700 1 Processor -- start 2023-10-24T00:29:49.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.552+0000 7f5350719700 1 -- start start 2023-10-24T00:29:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f5350719700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f5350719700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480aa820 con 0x7f53480aa010 2023-10-24T00:29:49.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f5350719700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480c0960 con 0x7f53480aa3f0 2023-10-24T00:29:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f5350719700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480c0c40 con 0x7f53480c6710 2023-10-24T00:29:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f534e4b5700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f53480aa010 0x7f5348158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53562/0 (socket says 172.21.15.148:53562) 2023-10-24T00:29:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.553+0000 7f534e4b5700 1 -- 172.21.15.148:0/3774710213 learned_addr learned my addr 172.21.15.148:0/3774710213 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:49.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534dcb4700 1 --2- 172.21.15.148:0/3774710213 >> v2:172.21.15.150:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016234276 0 0) 0x7f53480aa820 con 0x7f53480aa010 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53340033f0 con 0x7f53480aa010 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649340171 0 0) 0x7f53340033f0 con 0x7f53480aa010 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 >> v2:172.21.15.150:3300/0 conn(0x7f53480c6710 msgr2=0x7f53480c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 --2- 172.21.15.148:0/3774710213 >> v2:172.21.15.150:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 >> v1:172.21.15.150:6789/0 conn(0x7f53480aa3f0 legacy=0x7f5348069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c0f20 con 0x7f53480aa010 2023-10-24T00:29:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f53440017f0 con 0x7f53480aa010 2023-10-24T00:29:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 >> v1:172.21.15.148:6789/0 conn(0x7f53480aa010 legacy=0x7f5348158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53340038e0 0x7f5334003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334004690 0x7f5334004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 0x7f533400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c0c40 con 0x7f5334005000 2023-10-24T00:29:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533400bf60 con 0x7f5334004690 2023-10-24T00:29:49.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533400c0f0 con 0x7f53340038e0 2023-10-24T00:29:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 0x7f533400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534dcb4700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334004690 0x7f5334004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534e4b5700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53340038e0 0x7f5334003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 -- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53340038e0 msgr2=0x7f5334003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53340038e0 0x7f5334003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 -- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334004690 msgr2=0x7f5334004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334004690 0x7f5334004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.554+0000 7f534ecb6700 1 -- 172.21.15.148:0/3774710213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340033f0 con 0x7f5334005000 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f534ecb6700 1 -- 172.21.15.148:0/3774710213 reap_dead start 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 0x7f533400b8e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f5340001730 tx=0x7f5340007bb0).ready entity=mon.0 client_cookie=b2f9e3e19bdb0875 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340007020 con 0x7f5334005000 2023-10-24T00:29:49.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340007180 con 0x7f5334005000 2023-10-24T00:29:49.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f534d4b3700 1 -- 172.21.15.148:0/3774710213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340007520 con 0x7f5334005000 2023-10-24T00:29:49.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 -- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 msgr2=0x7f533400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 0x7f533400b8e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f5340001730 tx=0x7f5340007bb0).stop 2023-10-24T00:29:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 -- 172.21.15.148:0/3774710213 shutdown_connections 2023-10-24T00:29:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 --2- 172.21.15.148:0/3774710213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5334005000 0x7f533400b8e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 -- 172.21.15.148:0/3774710213 >> 172.21.15.148:0/3774710213 conn(0x7f53480caf40 msgr2=0x7f53480cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 -- 172.21.15.148:0/3774710213 shutdown_connections 2023-10-24T00:29:49.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.555+0000 7f5350719700 1 -- 172.21.15.148:0/3774710213 wait complete. 2023-10-24T00:29:49.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.556+0000 7f5350719700 1 Processor -- start 2023-10-24T00:29:49.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.556+0000 7f5350719700 1 -- start start 2023-10-24T00:29:49.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334005000 0x7f5348150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480c2560 0x7f5348168530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348150cf0 con 0x7f53480ac1f0 2023-10-24T00:29:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348155830 con 0x7f5334005000 2023-10-24T00:29:49.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f5350719700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480acb60 con 0x7f53480c2560 2023-10-24T00:29:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f534ecb6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f534ecb6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46168/0 (socket says 172.21.15.148:46168) 2023-10-24T00:29:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f534ecb6700 1 -- 172.21.15.148:0/3525963983 learned_addr learned my addr 172.21.15.148:0/3525963983 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f534e4b5700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334005000 0x7f5348150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.557+0000 7f534dcb4700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480c2560 0x7f5348168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 -- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480c2560 msgr2=0x7f5348168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480c2560 0x7f5348168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 -- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334005000 msgr2=0x7f5348150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334005000 0x7f5348150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 -- 172.21.15.148:0/3525963983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c29e0 con 0x7f53480ac1f0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f534ecb6700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5340001d20 tx=0x7f5340015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340013670 con 0x7f53480ac1f0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400137d0 con 0x7f53480ac1f0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348154c20 con 0x7f53480ac1f0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340013b70 con 0x7f53480ac1f0 2023-10-24T00:29:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.558+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53481551e0 con 0x7f53480ac1f0 2023-10-24T00:29:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.559+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534806c6b0 con 0x7f53480ac1f0 2023-10-24T00:29:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.559+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f534001f3e0 con 0x7f53480ac1f0 2023-10-24T00:29:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.559+0000 7f533e7fc700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 0x7f532c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.559+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f534007abc0 con 0x7f53480ac1f0 2023-10-24T00:29:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.560+0000 7f534e4b5700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 0x7f532c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.560+0000 7f534e4b5700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 0x7f532c061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5344001330 tx=0x7f5344000f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.563+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f534004be30 con 0x7f53480ac1f0 2023-10-24T00:29:49.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.765+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5348155970 con 0x7f53480ac1f0 2023-10-24T00:29:49.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.765+0000 7f533e7fc700 1 -- 172.21.15.148:0/3525963983 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f5340007e60 con 0x7f53480ac1f0 2023-10-24T00:29:49.767 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:29:49.767 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:29:49.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 msgr2=0x7f532c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 0x7f532c061610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f5344001330 tx=0x7f5344000f40).stop 2023-10-24T00:29:49.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 msgr2=0x7f53480ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:49.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5340001d20 tx=0x7f5340015000).stop 2023-10-24T00:29:49.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 shutdown_connections 2023-10-24T00:29:49.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f532c05f150 0x7f532c061610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480ac1f0 0x7f53480ac670 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5334005000 0x7f5348150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 --2- 172.21.15.148:0/3525963983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480c2560 0x7f5348168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 >> 172.21.15.148:0/3525963983 conn(0x7f53480caf40 msgr2=0x7f5348153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 shutdown_connections 2023-10-24T00:29:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:49.767+0000 7f5350719700 1 -- 172.21.15.148:0/3525963983 wait complete. 2023-10-24T00:29:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:29:50.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:29:41.252610+0000', 'modified': '2023-10-24T00:29:43.265396+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5022}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5022': {'gid': 5022, 'name': 'c', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/115636737', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 115636737}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 115636737}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:29:50.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:29:50.184 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-24T00:29:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.299+0000 7f4f878fa700 1 Processor -- start 2023-10-24T00:29:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.299+0000 7f4f878fa700 1 -- start start 2023-10-24T00:29:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f878fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f800c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f878fa700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800c01c0 con 0x7f4f801547e0 2023-10-24T00:29:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f878fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800c6150 con 0x7f4f800c0b30 2023-10-24T00:29:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f878fa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800aa960 con 0x7f4f80154400 2023-10-24T00:29:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f84e95700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4f801547e0 0x7f4f800a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53578/0 (socket says 172.21.15.148:53578) 2023-10-24T00:29:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f84e95700 1 -- 172.21.15.148:0/3726827343 learned_addr learned my addr 172.21.15.148:0/3726827343 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f85696700 1 --2- 172.21.15.148:0/3726827343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f800c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510258013 0 0) 0x7f4f800c01c0 con 0x7f4f801547e0 2023-10-24T00:29:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c0033f0 con 0x7f4f801547e0 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787538972 0 0) 0x7f4f800c6150 con 0x7f4f800c0b30 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f800c01c0 con 0x7f4f800c0b30 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f85696700 1 -- 172.21.15.148:0/3726827343 >> v1:172.21.15.150:6789/0 conn(0x7f4f800c0b30 legacy=0x7f4f800c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f85696700 1 -- 172.21.15.148:0/3726827343 >> v1:172.21.15.148:6789/0 conn(0x7f4f801547e0 legacy=0x7f4f800a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.300+0000 7f4f85696700 1 -- 172.21.15.148:0/3726827343 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800c66f0 con 0x7f4f80154400 2023-10-24T00:29:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f85696700 1 --2- 172.21.15.148:0/3726827343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f800c8310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4f7c009790 tx=0x7f4f7c009060).ready entity=mon.2 client_cookie=9cf4aa0211bad8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c0090d0 con 0x7f4f80154400 2023-10-24T00:29:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00f510 con 0x7f4f80154400 2023-10-24T00:29:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f77fff700 1 -- 172.21.15.148:0/3726827343 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00f890 con 0x7f4f80154400 2023-10-24T00:29:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 -- 172.21.15.148:0/3726827343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 msgr2=0x7f4f800c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 --2- 172.21.15.148:0/3726827343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f800c8310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f4f7c009790 tx=0x7f4f7c009060).stop 2023-10-24T00:29:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 -- 172.21.15.148:0/3726827343 shutdown_connections 2023-10-24T00:29:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 --2- 172.21.15.148:0/3726827343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f800c8310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 -- 172.21.15.148:0/3726827343 >> 172.21.15.148:0/3726827343 conn(0x7f4f800946a0 msgr2=0x7f4f8006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 -- 172.21.15.148:0/3726827343 shutdown_connections 2023-10-24T00:29:50.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.301+0000 7f4f878fa700 1 -- 172.21.15.148:0/3726827343 wait complete. 2023-10-24T00:29:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.302+0000 7f4f878fa700 1 Processor -- start 2023-10-24T00:29:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.302+0000 7f4f878fa700 1 -- start start 2023-10-24T00:29:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 0x7f4f800c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f80165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c4780 con 0x7f4f801547e0 2023-10-24T00:29:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c3b70 con 0x7f4f800c0b30 2023-10-24T00:29:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.303+0000 7f4f878fa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c3e50 con 0x7f4f80154400 2023-10-24T00:29:50.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46178/0 (socket says 172.21.15.148:46178) 2023-10-24T00:29:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 -- 172.21.15.148:0/1245770120 learned_addr learned my addr 172.21.15.148:0/1245770120 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f84e95700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f80165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85696700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 0x7f4f800c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 -- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 msgr2=0x7f4f80165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f80165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 -- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 msgr2=0x7f4f800c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 0x7f4f800c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 -- 172.21.15.148:0/1245770120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0092a0 con 0x7f4f801547e0 2023-10-24T00:29:50.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85696700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 0x7f4f800c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:50.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f85e97700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f4f7800c710 tx=0x7f4f7800cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f757fa700 1 -- 172.21.15.148:0/1245770120 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78010510 con 0x7f4f801547e0 2023-10-24T00:29:50.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f757fa700 1 -- 172.21.15.148:0/1245770120 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78010670 con 0x7f4f801547e0 2023-10-24T00:29:50.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f757fa700 1 -- 172.21.15.148:0/1245770120 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780109f0 con 0x7f4f801547e0 2023-10-24T00:29:50.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f800c4130 con 0x7f4f801547e0 2023-10-24T00:29:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.304+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80164fd0 con 0x7f4f801547e0 2023-10-24T00:29:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.306+0000 7f4f757fa700 1 -- 172.21.15.148:0/1245770120 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4f7801b400 con 0x7f4f801547e0 2023-10-24T00:29:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.306+0000 7f4f757fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 0x7f4f640615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.306+0000 7f4f757fa700 1 -- 172.21.15.148:0/1245770120 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f7807a000 con 0x7f4f801547e0 2023-10-24T00:29:50.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.306+0000 7f4f85696700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 0x7f4f640615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.307+0000 7f4f85696700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 0x7f4f640615e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4f7c0096e0 tx=0x7f4f7c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.308+0000 7f4f99292b80 1 Processor -- start 2023-10-24T00:29:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.308+0000 7f4f99292b80 1 -- start start 2023-10-24T00:29:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea8caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea8c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea8421b0 con 0x5614ea8f4190 2023-10-24T00:29:50.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea807cb0 con 0x5614ea8cd980 2023-10-24T00:29:50.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ea81cc90 con 0x5614ea8cab20 2023-10-24T00:29:50.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46180/0 (socket says 172.21.15.148:46180) 2023-10-24T00:29:50.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 -- 172.21.15.148:0/1310171596 learned_addr learned my addr 172.21.15.148:0/1310171596 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f85696700 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea8caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f85e97700 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea8c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 -- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 msgr2=0x5614ea8caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea8caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 -- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 msgr2=0x5614ea8c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea8c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 -- 172.21.15.148:0/1310171596 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614ea815e70 con 0x5614ea8f4190 2023-10-24T00:29:50.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f84e95700 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f4f80084530 tx=0x7f4f70009040).ready entity=mon.0 client_cookie=788e030b849e8e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f6a7fc700 1 -- 172.21.15.148:0/1310171596 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700070d0 con 0x5614ea8f4190 2023-10-24T00:29:50.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.309+0000 7f4f6a7fc700 1 -- 172.21.15.148:0/1310171596 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70007230 con 0x5614ea8f4190 2023-10-24T00:29:50.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f6a7fc700 1 -- 172.21.15.148:0/1310171596 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700075b0 con 0x5614ea8f4190 2023-10-24T00:29:50.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 -- 172.21.15.148:0/1310171596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 msgr2=0x5614ea8c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f4f80084530 tx=0x7f4f70009040).stop 2023-10-24T00:29:50.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 -- 172.21.15.148:0/1310171596 shutdown_connections 2023-10-24T00:29:50.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea8c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea8caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 --2- 172.21.15.148:0/1310171596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8c69a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 -- 172.21.15.148:0/1310171596 >> 172.21.15.148:0/1310171596 conn(0x5614ea687e40 msgr2=0x5614ea914ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 -- 172.21.15.148:0/1310171596 shutdown_connections 2023-10-24T00:29:50.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.310+0000 7f4f99292b80 1 -- 172.21.15.148:0/1310171596 wait complete. 2023-10-24T00:29:50.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.311+0000 7f4f99292b80 1 -- start start 2023-10-24T00:29:50.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.311+0000 7f4f99292b80 1 Processor -- start 2023-10-24T00:29:50.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea918d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cd980 0x5614ea919220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea81cdd0 con 0x5614ea8f4190 2023-10-24T00:29:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea81d050 con 0x5614ea8cab20 2023-10-24T00:29:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ea7e88d0 con 0x5614ea8cd980 2023-10-24T00:29:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 10 client.0 ll_register_callbacks cb 0x5614ea88b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:29:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46184/0 (socket says 172.21.15.148:46184) 2023-10-24T00:29:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 -- 172.21.15.148:0/843379049 learned_addr learned my addr 172.21.15.148:0/843379049 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85696700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea918d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f84e95700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cd980 0x5614ea919220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 -- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cd980 msgr2=0x5614ea919220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cd980 0x5614ea919220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 -- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 msgr2=0x5614ea918d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea918d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 -- 172.21.15.148:0/843379049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7000f040 con 0x5614ea8f4190 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f85e97700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4f7800c6e0 tx=0x7f4f78002840).ready entity=mon.0 client_cookie=1e43d43b75362c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800ada0 con 0x5614ea8f4190 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f7804d2d0 con 0x5614ea8f4190 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614ea8bf4e0 con 0x5614ea8f4190 2023-10-24T00:29:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f780542d0 con 0x5614ea8f4190 2023-10-24T00:29:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 10 client.5235 fetch_fsmap learned FSMap version 12 2023-10-24T00:29:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.312+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5614ea811480 con 0x5614ea8f4190 2023-10-24T00:29:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614ea8bf4e0 con 0x5614ea8f4190 2023-10-24T00:29:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f7805a020 con 0x5614ea8f4190 2023-10-24T00:29:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 10 client.5235 fetch_fsmap finished waiting for FSMap version 12 2023-10-24T00:29:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 10 client.5235 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:29:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 20 client.5235 populate_metadata read hostname 'smithi148' 2023-10-24T00:29:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8efd60 0x5614ea8f0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 4 client.5235 mds_command: new command op to 5022 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:29:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 --> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614ea8954b0 con 0x5614ea8efd60 2023-10-24T00:29:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f85696700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8efd60 0x5614ea8f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f5f7fe700 10 client.5235 ms_handle_connect on v2:172.21.15.148:6834/115636737 2023-10-24T00:29:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.313+0000 7f4f85696700 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8efd60 0x5614ea8f0140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=91902e38db56e855 server_cookie=1c6650251096ba20 in_seq=0 out_seq=0 2023-10-24T00:29:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/843379049 <== mds.0 v2:172.21.15.148:6834/115636737 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5614ea8954b0 con 0x5614ea8efd60 2023-10-24T00:29:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f5f7fe700 10 client.5235 handle_command_reply: tid=0 2023-10-24T00:29:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 client.5235 shutdown 2023-10-24T00:29:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 msgr2=0x5614ea8f29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f4f7800c6e0 tx=0x7f4f78002840).stop 2023-10-24T00:29:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 shutdown_connections 2023-10-24T00:29:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f29c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea918d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8efd60 0x5614ea8f0140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 --2- 172.21.15.148:0/843379049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cd980 0x5614ea919220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f5f7fe700 0 client.5235 ms_handle_reset on v2:172.21.15.148:6834/115636737 2023-10-24T00:29:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 >> 172.21.15.148:0/843379049 conn(0x5614ea687e40 msgr2=0x5614ea911300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 shutdown_connections 2023-10-24T00:29:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 1 -- 172.21.15.148:0/843379049 wait complete. 2023-10-24T00:29:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.314+0000 7f4f99292b80 20 client.5235 trim_cache size 0 max 16384 2023-10-24T00:29:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.330+0000 7f4f99292b80 1 Processor -- start 2023-10-24T00:29:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.330+0000 7f4f99292b80 1 -- start start 2023-10-24T00:29:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea8faa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8f4190 0x5614ea914c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea8c5400 con 0x5614ea8cd980 2023-10-24T00:29:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea90f840 con 0x5614ea8cab20 2023-10-24T00:29:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ea8f23d0 con 0x5614ea8f4190 2023-10-24T00:29:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46198/0 (socket says 172.21.15.148:46198) 2023-10-24T00:29:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 -- 172.21.15.148:0/2784385203 learned_addr learned my addr 172.21.15.148:0/2784385203 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f85696700 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea8faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f85e97700 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8f4190 0x5614ea914c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 -- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8f4190 msgr2=0x5614ea914c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8f4190 0x5614ea914c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 -- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 msgr2=0x5614ea8faa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea8faa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 -- 172.21.15.148:0/2784385203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614ea8111d0 con 0x5614ea8cd980 2023-10-24T00:29:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.331+0000 7f4f84e95700 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f4f800a9dc0 tx=0x7f4f70009040).ready entity=mon.0 client_cookie=639cf3129bc26945 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f6affd700 1 -- 172.21.15.148:0/2784385203 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700079d0 con 0x5614ea8cd980 2023-10-24T00:29:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f6affd700 1 -- 172.21.15.148:0/2784385203 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f700075b0 con 0x5614ea8cd980 2023-10-24T00:29:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f6affd700 1 -- 172.21.15.148:0/2784385203 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70005bc0 con 0x5614ea8cd980 2023-10-24T00:29:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 -- 172.21.15.148:0/2784385203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 msgr2=0x5614ea8c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f4f800a9dc0 tx=0x7f4f70009040).stop 2023-10-24T00:29:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 -- 172.21.15.148:0/2784385203 shutdown_connections 2023-10-24T00:29:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8f4190 0x5614ea914c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cab20 0x5614ea8faa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2784385203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8cd980 0x5614ea8c7b60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 -- 172.21.15.148:0/2784385203 >> 172.21.15.148:0/2784385203 conn(0x5614ea687e40 msgr2=0x5614ea8c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 -- 172.21.15.148:0/2784385203 shutdown_connections 2023-10-24T00:29:50.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.332+0000 7f4f99292b80 1 -- 172.21.15.148:0/2784385203 wait complete. 2023-10-24T00:29:50.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.333+0000 7f4f99292b80 1 -- start start 2023-10-24T00:29:50.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.333+0000 7f4f99292b80 1 Processor -- start 2023-10-24T00:29:50.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea976040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea9180a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea92a420 con 0x5614ea8f4190 2023-10-24T00:29:50.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ea8f1aa0 con 0x5614ea8cd980 2023-10-24T00:29:50.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ea92a590 con 0x5614ea8cab20 2023-10-24T00:29:50.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 10 client.0 ll_register_callbacks cb 0x5614ea88b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:29:50.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46200/0 (socket says 172.21.15.148:46200) 2023-10-24T00:29:50.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 -- 172.21.15.148:0/2397105979 learned_addr learned my addr 172.21.15.148:0/2397105979 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85696700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea976040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f84e95700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea9180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 -- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 msgr2=0x5614ea976040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea976040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 -- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 msgr2=0x5614ea9180a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea9180a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 -- 172.21.15.148:0/2397105979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614ea815e70 con 0x5614ea8f4190 2023-10-24T00:29:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f85e97700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f4f7804ec30 tx=0x7f4f78062000).ready entity=mon.0 client_cookie=60719d450453701e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:29:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800ada0 con 0x5614ea8f4190 2023-10-24T00:29:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f7804eed0 con 0x5614ea8f4190 2023-10-24T00:29:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f70007230 con 0x5614ea8f4190 2023-10-24T00:29:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f7804e420 con 0x5614ea8f4190 2023-10-24T00:29:50.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 10 client.5241 fetch_fsmap learned FSMap version 12 2023-10-24T00:29:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.334+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5614ea688f80 con 0x5614ea8f4190 2023-10-24T00:29:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70007230 con 0x5614ea8f4190 2023-10-24T00:29:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f78019020 con 0x5614ea8f4190 2023-10-24T00:29:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 10 client.5241 fetch_fsmap finished waiting for FSMap version 12 2023-10-24T00:29:50.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 10 client.5241 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 20 client.5241 populate_metadata read hostname 'smithi148' 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8f0bf0 0x5614ea8f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 4 client.5241 mds_command: new command op to 5022 tid=0[{"prefix": "status"}] 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 --> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5614ea683ca0 con 0x5614ea8f0bf0 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f85696700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8f0bf0 0x5614ea8f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f5f7fe700 10 client.5241 ms_handle_connect on v2:172.21.15.148:6834/115636737 2023-10-24T00:29:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f85696700 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8f0bf0 0x5614ea8f0fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=909dd6e39298e825 server_cookie=7132f4ef4c131817 in_seq=0 out_seq=0 2023-10-24T00:29:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f5f7fe700 1 -- 172.21.15.148:0/2397105979 <== mds.0 v2:172.21.15.148:6834/115636737 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5614ea683ca0 con 0x5614ea8f0bf0 2023-10-24T00:29:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f5f7fe700 10 client.5241 handle_command_reply: tid=0 2023-10-24T00:29:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 1 client.5241 shutdown 2023-10-24T00:29:50.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 msgr2=0x5614ea8f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.335+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f4f7804ec30 tx=0x7f4f78062000).stop 2023-10-24T00:29:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 shutdown_connections 2023-10-24T00:29:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614ea8f4190 0x5614ea8f4750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.148:6834/115636737,v1:172.21.15.148:6835/115636737] conn(0x5614ea8f0bf0 0x5614ea8f0fd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5614ea8cab20 0x5614ea976040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f5f7fe700 0 client.5241 ms_handle_reset on v2:172.21.15.148:6834/115636737 2023-10-24T00:29:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 --2- 172.21.15.148:0/2397105979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614ea8cd980 0x5614ea9180a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 >> 172.21.15.148:0/2397105979 conn(0x5614ea687e40 msgr2=0x5614ea914c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 shutdown_connections 2023-10-24T00:29:50.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 1 -- 172.21.15.148:0/2397105979 wait complete. 2023-10-24T00:29:50.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f99292b80 20 client.5241 trim_cache size 0 max 16384 2023-10-24T00:29:50.365 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:29:50.365 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:29:50.366 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:29:50.366 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 5022, 2023-10-24T00:29:50.366 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:29:50.366 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:29:50.366 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:29:50.367 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.0819022129999993, 2023-10-24T00:29:50.367 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 12, 2023-10-24T00:29:50.367 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 34, 2023-10-24T00:29:50.367 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 34, 2023-10-24T00:29:50.367 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 16.331328307 2023-10-24T00:29:50.368 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:29:50.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 msgr2=0x7f4f640615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 0x7f4f640615e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f4f7c0096e0 tx=0x7f4f7c017000).stop 2023-10-24T00:29:50.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 msgr2=0x7f4f800c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f4f7800c710 tx=0x7f4f7800cad0).stop 2023-10-24T00:29:50.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 shutdown_connections 2023-10-24T00:29:50.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f6405f120 0x7f4f640615e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f801547e0 0x7f4f800c30b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f800c0b30 0x7f4f800c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 --2- 172.21.15.148:0/1245770120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f80154400 0x7f4f80165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 >> 172.21.15.148:0/1245770120 conn(0x7f4f800946a0 msgr2=0x7f4f800a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 shutdown_connections 2023-10-24T00:29:50.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.336+0000 7f4f878fa700 1 -- 172.21.15.148:0/1245770120 wait complete. 2023-10-24T00:29:50.372 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:29:50.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.471+0000 7f7916325700 1 Processor -- start 2023-10-24T00:29:50.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.471+0000 7f7916325700 1 -- start start 2023-10-24T00:29:50.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.472+0000 7f7916325700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.472+0000 7f7916325700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7910154f10 0x7f79100a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.472+0000 7f7916325700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100a8d50 con 0x7f79100c4310 2023-10-24T00:29:50.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.472+0000 7f7916325700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79100c46f0 con 0x7f7910154f10 2023-10-24T00:29:50.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.472+0000 7f7916325700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79101553a0 con 0x7f7910063760 2023-10-24T00:29:50.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7910154f10 0x7f79100a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7910154f10 0x7f79100a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:49602/0 (socket says 172.21.15.148:49602) 2023-10-24T00:29:50.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f79100c4310 0x7f79100a7930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:38970/0 (socket says 172.21.15.148:38970) 2023-10-24T00:29:50.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54380/0 (socket says 172.21.15.148:54380) 2023-10-24T00:29:50.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 -- 172.21.15.148:0/914735900 learned_addr learned my addr 172.21.15.148:0/914735900 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 -- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 msgr2=0x7f7910154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:50.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 -- 172.21.15.148:0/914735900 >> v1:172.21.15.150:6789/0 conn(0x7f79100c4310 legacy=0x7f79100a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790effd700 1 -- 172.21.15.148:0/914735900 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834036904 0 0) 0x7f79100a8d50 con 0x7f79100c4310 2023-10-24T00:29:50.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 -- 172.21.15.148:0/914735900 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100a8140 con 0x7f7910154f10 2023-10-24T00:29:50.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790f7fe700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:50.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f79148c2700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7910154f10 0x7f79100a91e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7908009f20 tx=0x7f7908009840).ready entity=mon.1 client_cookie=f25372d33fe53657 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790effd700 1 -- 172.21.15.148:0/914735900 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f7910154f10 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790effd700 1 -- 172.21.15.148:0/914735900 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800b9d0 con 0x7f7910154f10 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.473+0000 7f790effd700 1 -- 172.21.15.148:0/914735900 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800bd50 con 0x7f7910154f10 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 -- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7910154f10 msgr2=0x7f79100a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7910154f10 0x7f79100a91e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7908009f20 tx=0x7f7908009840).stop 2023-10-24T00:29:50.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 -- 172.21.15.148:0/914735900 shutdown_connections 2023-10-24T00:29:50.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7910154f10 0x7f79100a91e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 --2- 172.21.15.148:0/914735900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910063760 0x7f7910154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 -- 172.21.15.148:0/914735900 >> 172.21.15.148:0/914735900 conn(0x7f79100c7ea0 msgr2=0x7f79100aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 -- 172.21.15.148:0/914735900 shutdown_connections 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.474+0000 7f7916325700 1 -- 172.21.15.148:0/914735900 wait complete. 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.475+0000 7f7916325700 1 Processor -- start 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.475+0000 7f7916325700 1 -- start start 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79100c4310 0x7f79100a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910154f10 0x7f79100a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100a6540 con 0x7f7910063760 2023-10-24T00:29:50.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100bd800 con 0x7f79100c4310 2023-10-24T00:29:50.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f7916325700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100bdae0 con 0x7f7910154f10 2023-10-24T00:29:50.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46210/0 (socket says 172.21.15.148:46210) 2023-10-24T00:29:50.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 -- 172.21.15.148:0/3457081773 learned_addr learned my addr 172.21.15.148:0/3457081773 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:50.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790f7fe700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79100c4310 0x7f79100a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f79148c2700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910154f10 0x7f79100a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 -- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910154f10 msgr2=0x7f79100a6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910154f10 0x7f79100a6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 -- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79100c4310 msgr2=0x7f79100a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79100c4310 0x7f79100a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 -- 172.21.15.148:0/3457081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040092a0 con 0x7f7910063760 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f790ffff700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f790000c560 tx=0x7f7900007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000072e0 con 0x7f7910063760 2023-10-24T00:29:50.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.476+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900007440 con 0x7f7910063760 2023-10-24T00:29:50.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.477+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7908009ae0 con 0x7f7910063760 2023-10-24T00:29:50.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.477+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000058f0 con 0x7f7910063760 2023-10-24T00:29:50.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.477+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79100be380 con 0x7f7910063760 2023-10-24T00:29:50.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.478+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79100bded0 con 0x7f7910063760 2023-10-24T00:29:50.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.478+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7900005ce0 con 0x7f7910063760 2023-10-24T00:29:50.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.478+0000 7f78f7fff700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 0x7f78fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:50.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.478+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7900079b50 con 0x7f7910063760 2023-10-24T00:29:50.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.478+0000 7f790f7fe700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 0x7f78fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:50.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.479+0000 7f790f7fe700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 0x7f78fc061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f7904009270 tx=0x7f7904008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:50.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.482+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f790004ae20 con 0x7f7910063760 2023-10-24T00:29:50.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.687+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79100bdca0 con 0x7f7910063760 2023-10-24T00:29:50.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.687+0000 7f78f7fff700 1 -- 172.21.15.148:0/3457081773 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7900018030 con 0x7f7910063760 2023-10-24T00:29:50.689 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:29:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 msgr2=0x7f78fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 0x7f78fc061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f7904009270 tx=0x7f7904008040).stop 2023-10-24T00:29:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 msgr2=0x7f7910161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f790000c560 tx=0x7f7900007c90).stop 2023-10-24T00:29:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 shutdown_connections 2023-10-24T00:29:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7910154f10 0x7f79100a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f78fc05f150 0x7f78fc061610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7910063760 0x7f7910161b60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 --2- 172.21.15.148:0/3457081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79100c4310 0x7f79100a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:50.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.689+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 >> 172.21.15.148:0/3457081773 conn(0x7f79100c7ea0 msgr2=0x7f7910153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:50.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.690+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 shutdown_connections 2023-10-24T00:29:50.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:50.690+0000 7f7916325700 1 -- 172.21.15.148:0/3457081773 wait complete. 2023-10-24T00:29:50.702 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:29:50.702 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:29:50.702 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:29:50.703 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:29:50.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:50.703 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:29:50.704 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:29:50.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:29:50.704 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:29:50.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.705 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:29:50.721 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:29:50.721 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:29:50.721 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:29:50.722 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.722 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:29:50.722 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.722 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:50.722 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:50.723 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:29:50.723 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:50.723 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:50.723 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:29:50.723 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:29:50.724 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:50.724 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:29:50.724 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:50.724 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:29:50.724 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 42338sec preferred_lft 42338sec 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:29:50.725 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.726 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:29:50.726 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.726 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:29:50.726 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:29:50.726 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:29:50.727 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.727 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:29:50.727 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:29:50.727 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:29:50.727 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:29:50.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.728 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:29:50.784 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:29:50.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.786 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:29:50.842 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:29:50.843 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:29:50.843 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:29:50.843 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:29:50.843 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:29:50.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.844 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:29:50.845 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:29:50.845 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:29:50.845 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:29:50.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:29:50.846 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:29:50.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.943 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:29:50.957 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:29:50.958 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:29:50.958 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:29:50.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:50.959 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:29:51.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:51.024 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:51.077 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:29:51.078 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:51.156 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:51.156 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:51.182 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:29:51.183 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:29:51.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:29:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:29:51.186 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:29:51.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:29:51.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.403+0000 7f3c39d06700 1 Processor -- start 2023-10-24T00:29:51.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.403+0000 7f3c39d06700 1 -- start start 2023-10-24T00:29:51.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c39d06700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3c340c0f20 0x7f3c341552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c39d06700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3406a860 con 0x7f3c34154a90 2023-10-24T00:29:51.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c39d06700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c340c9d90 con 0x7f3c34154e70 2023-10-24T00:29:51.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c39d06700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c341561a0 con 0x7f3c340c0f20 2023-10-24T00:29:51.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c38d04700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3c34154a90 0x7f3c34155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53580/0 (socket says 172.21.15.148:53580) 2023-10-24T00:29:51.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c38d04700 1 -- 172.21.15.148:0/4284741171 learned_addr learned my addr 172.21.15.148:0/4284741171 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:51.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c39505700 1 --2- 172.21.15.148:0/4284741171 >> v2:172.21.15.150:3300/0 conn(0x7f3c340c0f20 0x7f3c341552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201173953 0 0) 0x7f3c3406a860 con 0x7f3c34154a90 2023-10-24T00:29:51.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c240033f0 con 0x7f3c34154a90 2023-10-24T00:29:51.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124645094 0 0) 0x7f3c240033f0 con 0x7f3c34154a90 2023-10-24T00:29:51.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 >> v2:172.21.15.150:3300/0 conn(0x7f3c340c0f20 msgr2=0x7f3c341552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:51.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 --2- 172.21.15.148:0/4284741171 >> v2:172.21.15.150:3300/0 conn(0x7f3c340c0f20 0x7f3c341552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 >> v1:172.21.15.150:6789/0 conn(0x7f3c34154e70 legacy=0x7f3c340c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340c9180 con 0x7f3c34154a90 2023-10-24T00:29:51.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.404+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f3c28001470 con 0x7f3c34154a90 2023-10-24T00:29:51.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 >> v1:172.21.15.148:6789/0 conn(0x7f3c34154a90 legacy=0x7f3c34155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c24003910 0x7f3c24003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24004690 0x7f3c24004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 0x7f3c2400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c341561a0 con 0x7f3c24005000 2023-10-24T00:29:51.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2400bf60 con 0x7f3c24004690 2023-10-24T00:29:51.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2400c120 con 0x7f3c24003910 2023-10-24T00:29:51.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 0x7f3c2400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c38d04700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c24003910 0x7f3c24003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c33fff700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24004690 0x7f3c24004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 -- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c24003910 msgr2=0x7f3c24003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:51.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c24003910 0x7f3c24003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 -- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24004690 msgr2=0x7f3c24004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:51.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24004690 0x7f3c24004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 -- 172.21.15.148:0/4284741171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240033f0 con 0x7f3c24005000 2023-10-24T00:29:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c38d04700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c24003910 0x7f3c24003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 -- 172.21.15.148:0/4284741171 reap_dead start 2023-10-24T00:29:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c39505700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 0x7f3c2400b8e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3c34098f40 tx=0x7f3c2c00b040).ready entity=mon.0 client_cookie=4a2a58a39b9a9c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c009ac0 con 0x7f3c24005000 2023-10-24T00:29:51.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00f040 con 0x7f3c24005000 2023-10-24T00:29:51.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.405+0000 7f3c337fe700 1 -- 172.21.15.148:0/4284741171 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00ec60 con 0x7f3c24005000 2023-10-24T00:29:51.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 -- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 msgr2=0x7f3c2400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 0x7f3c2400b8e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3c34098f40 tx=0x7f3c2c00b040).stop 2023-10-24T00:29:51.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 -- 172.21.15.148:0/4284741171 shutdown_connections 2023-10-24T00:29:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 --2- 172.21.15.148:0/4284741171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c24005000 0x7f3c2400b8e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 -- 172.21.15.148:0/4284741171 >> 172.21.15.148:0/4284741171 conn(0x7f3c34084c20 msgr2=0x7f3c34094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 -- 172.21.15.148:0/4284741171 shutdown_connections 2023-10-24T00:29:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.406+0000 7f3c39d06700 1 -- 172.21.15.148:0/4284741171 wait complete. 2023-10-24T00:29:51.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.407+0000 7f3c39d06700 1 Processor -- start 2023-10-24T00:29:51.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.407+0000 7f3c39d06700 1 -- start start 2023-10-24T00:29:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 0x7f3c34165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c340b0860 0x7f3c34153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34095e90 con 0x7f3c34096e40 2023-10-24T00:29:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34097790 con 0x7f3c24005000 2023-10-24T00:29:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39d06700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34095280 con 0x7f3c340b0860 2023-10-24T00:29:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46236/0 (socket says 172.21.15.148:46236) 2023-10-24T00:29:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 -- 172.21.15.148:0/2176169038 learned_addr learned my addr 172.21.15.148:0/2176169038 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c33fff700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c340b0860 0x7f3c34153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c38d04700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 0x7f3c34165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 -- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c340b0860 msgr2=0x7f3c34153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c340b0860 0x7f3c34153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 -- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 msgr2=0x7f3c34165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 0x7f3c34165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 -- 172.21.15.148:0/2176169038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34095560 con 0x7f3c34096e40 2023-10-24T00:29:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c38d04700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 0x7f3c34165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.408+0000 7f3c39505700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f3c340c9d00 tx=0x7f3c2c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.409+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c009ac0 con 0x7f3c34096e40 2023-10-24T00:29:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.409+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00eb50 con 0x7f3c34096e40 2023-10-24T00:29:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.409+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c34095840 con 0x7f3c34096e40 2023-10-24T00:29:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.409+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c027420 con 0x7f3c34096e40 2023-10-24T00:29:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.409+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c34165850 con 0x7f3c34096e40 2023-10-24T00:29:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.410+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c34096040 con 0x7f3c34096e40 2023-10-24T00:29:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.410+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3c2c024020 con 0x7f3c34096e40 2023-10-24T00:29:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.410+0000 7f3c30ff9700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 0x7f3c18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.410+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3c2c07c090 con 0x7f3c34096e40 2023-10-24T00:29:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.410+0000 7f3c38d04700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 0x7f3c18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.411+0000 7f3c38d04700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 0x7f3c18061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3c340cbd20 tx=0x7f3c28009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.414+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3c34096040 con 0x7f3c34096e40 2023-10-24T00:29:51.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.601+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c34047480 con 0x7f3c1805f150 2023-10-24T00:29:51.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.603+0000 7f3c30ff9700 1 -- 172.21.15.148:0/2176169038 <== mgr.4105 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3c34047480 con 0x7f3c1805f150 2023-10-24T00:29:51.605 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:29:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:29:51.605 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:29:51.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:29:51.606 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:29:51.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 msgr2=0x7f3c18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 0x7f3c18061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3c340cbd20 tx=0x7f3c28009040).stop 2023-10-24T00:29:51.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 msgr2=0x7f3c340972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f3c340c9d00 tx=0x7f3c2c01a000).stop 2023-10-24T00:29:51.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 shutdown_connections 2023-10-24T00:29:51.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3c1805f150 0x7f3c18061610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.604+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c34096e40 0x7f3c340972a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.605+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3c24005000 0x7f3c34165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.605+0000 7f3c39d06700 1 --2- 172.21.15.148:0/2176169038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3c340b0860 0x7f3c34153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.605+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 >> 172.21.15.148:0/2176169038 conn(0x7f3c34084c20 msgr2=0x7f3c34157450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:51.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.605+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 shutdown_connections 2023-10-24T00:29:51.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.605+0000 7f3c39d06700 1 -- 172.21.15.148:0/2176169038 wait complete. 2023-10-24T00:29:51.618 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:29:51.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.733+0000 7f992759e700 1 Processor -- start 2023-10-24T00:29:51.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.733+0000 7f992759e700 1 -- start start 2023-10-24T00:29:51.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f992814fcb0 0x7f9928066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9928066f60 0x7f99280a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280677f0 con 0x7f99280a81b0 2023-10-24T00:29:51.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280a8660 con 0x7f9928066f60 2023-10-24T00:29:51.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99280a6260 con 0x7f992814fcb0 2023-10-24T00:29:51.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f991dd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9928066f60 0x7f99280a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f9926d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f99280a81b0 0x7f99280a66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:53594/0 (socket says 172.21.15.148:53594) 2023-10-24T00:29:51.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f9926d9d700 1 -- 172.21.15.148:0/3908311046 learned_addr learned my addr 172.21.15.148:0/3908311046 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:51.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f992659c700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f992814fcb0 0x7f9928066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f991dd9b700 1 -- 172.21.15.148:0/3908311046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f992814fcb0 msgr2=0x7f9928066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:51.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f991dd9b700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f992814fcb0 0x7f9928066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f991dd9b700 1 -- 172.21.15.148:0/3908311046 >> v1:172.21.15.148:6789/0 conn(0x7f99280a81b0 legacy=0x7f99280a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f9925d9b700 1 -- 172.21.15.148:0/3908311046 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510765531 0 0) 0x7f9920001490 con 0x7f99280a81b0 2023-10-24T00:29:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.734+0000 7f991dd9b700 1 -- 172.21.15.148:0/3908311046 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99281536d0 con 0x7f9928066f60 2023-10-24T00:29:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f991dd9b700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9928066f60 0x7f99280a7cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9910009760 tx=0x7f9910009060).ready entity=mon.0 client_cookie=6cdfcd817edc63db server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f9925d9b700 1 -- 172.21.15.148:0/3908311046 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100090d0 con 0x7f9928066f60 2023-10-24T00:29:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f9925d9b700 1 -- 172.21.15.148:0/3908311046 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000b580 con 0x7f9928066f60 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f9925d9b700 1 -- 172.21.15.148:0/3908311046 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000b900 con 0x7f9928066f60 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 -- 172.21.15.148:0/3908311046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9928066f60 msgr2=0x7f99280a7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9928066f60 0x7f99280a7cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f9910009760 tx=0x7f9910009060).stop 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 -- 172.21.15.148:0/3908311046 shutdown_connections 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f992814fcb0 0x7f9928066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 --2- 172.21.15.148:0/3908311046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9928066f60 0x7f99280a7cc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 -- 172.21.15.148:0/3908311046 >> 172.21.15.148:0/3908311046 conn(0x7f99280923d0 msgr2=0x7f9928062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:51.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 -- 172.21.15.148:0/3908311046 shutdown_connections 2023-10-24T00:29:51.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.735+0000 7f992759e700 1 -- 172.21.15.148:0/3908311046 wait complete. 2023-10-24T00:29:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.736+0000 7f992759e700 1 Processor -- start 2023-10-24T00:29:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.736+0000 7f992759e700 1 -- start start 2023-10-24T00:29:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928066f60 0x7f9928154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99280a81b0 0x7f9928154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928155860 con 0x7f992814fcb0 2023-10-24T00:29:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99280c4400 con 0x7f99280a81b0 2023-10-24T00:29:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f992759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9928155580 con 0x7f9928066f60 2023-10-24T00:29:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f9926d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f9926d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46254/0 (socket says 172.21.15.148:46254) 2023-10-24T00:29:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.737+0000 7f9926d9d700 1 -- 172.21.15.148:0/1899280425 learned_addr learned my addr 172.21.15.148:0/1899280425 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f991dd9b700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99280a81b0 0x7f9928154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f992659c700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928066f60 0x7f9928154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 -- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928066f60 msgr2=0x7f9928154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928066f60 0x7f9928154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 -- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99280a81b0 msgr2=0x7f9928154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99280a81b0 0x7f9928154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 -- 172.21.15.148:0/1899280425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100092a0 con 0x7f992814fcb0 2023-10-24T00:29:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f9926d9d700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f992000c7e0 tx=0x7f9920007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920005d30 con 0x7f992814fcb0 2023-10-24T00:29:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9920005e90 con 0x7f992814fcb0 2023-10-24T00:29:51.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99280c3db0 con 0x7f992814fcb0 2023-10-24T00:29:51.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920007320 con 0x7f992814fcb0 2023-10-24T00:29:51.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.738+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9928155230 con 0x7f992814fcb0 2023-10-24T00:29:51.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.739+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992806bf30 con 0x7f992814fcb0 2023-10-24T00:29:51.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.739+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f99200076d0 con 0x7f992814fcb0 2023-10-24T00:29:51.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.740+0000 7f991effd700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 0x7f9908061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:51.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.740+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f992007a100 con 0x7f992814fcb0 2023-10-24T00:29:51.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.740+0000 7f992659c700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 0x7f9908061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:51.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.740+0000 7f992659c700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 0x7f9908061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9918006920 tx=0x7f9918008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:51.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.744+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f992004b3d0 con 0x7f992814fcb0 2023-10-24T00:29:51.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:51.951+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f9928151ec0 con 0x7f992814fcb0 2023-10-24T00:29:52.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.913+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f9920077ed0 con 0x7f992814fcb0 2023-10-24T00:29:52.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.915+0000 7f991effd700 1 -- 172.21.15.148:0/1899280425 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f9920072af0 con 0x7f992814fcb0 2023-10-24T00:29:52.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 msgr2=0x7f9908061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:52.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 0x7f9908061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9918006920 tx=0x7f9918008040).stop 2023-10-24T00:29:52.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 msgr2=0x7f9928151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:52.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f992000c7e0 tx=0x7f9920007dd0).stop 2023-10-24T00:29:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 shutdown_connections 2023-10-24T00:29:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f990805f150 0x7f9908061610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f992814fcb0 0x7f9928151200 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928066f60 0x7f9928154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 --2- 172.21.15.148:0/1899280425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99280a81b0 0x7f9928154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:52.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 >> 172.21.15.148:0/1899280425 conn(0x7f99280923d0 msgr2=0x7f99280c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:52.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 shutdown_connections 2023-10-24T00:29:52.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:52.917+0000 7f992759e700 1 -- 172.21.15.148:0/1899280425 wait complete. 2023-10-24T00:29:52.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:29:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.054+0000 7fe61a7d5700 1 Processor -- start 2023-10-24T00:29:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.054+0000 7fe61a7d5700 1 -- start start 2023-10-24T00:29:53.056 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:53.054+0000 7fa26a311680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:29:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6141574f0 0x7fe6140c8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6140a9e60 0x7fe6140c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe6140c6fb0 0x7fe6140a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140c5700 con 0x7fe6140a9e60 2023-10-24T00:29:53.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140aa3e0 con 0x7fe6140c6fb0 2023-10-24T00:29:53.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe61a7d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140aa680 con 0x7fe6141574f0 2023-10-24T00:29:53.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6140a9e60 0x7fe6140c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6140a9e60 0x7fe6140c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46296/0 (socket says 172.21.15.148:46296) 2023-10-24T00:29:53.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 -- 172.21.15.148:0/60955534 learned_addr learned my addr 172.21.15.148:0/60955534 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:53.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe619fd4700 1 --2- 172.21.15.148:0/60955534 >> v2:172.21.15.150:3300/0 conn(0x7fe6140c6fb0 0x7fe6140a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe6197d3700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6141574f0 0x7fe6140c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 -- 172.21.15.148:0/60955534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6141574f0 msgr2=0x7fe6140c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:53.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6141574f0 0x7fe6140c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 -- 172.21.15.148:0/60955534 >> v2:172.21.15.150:3300/0 conn(0x7fe6140c6fb0 msgr2=0x7fe6140a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:53.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 --2- 172.21.15.148:0/60955534 >> v2:172.21.15.150:3300/0 conn(0x7fe6140c6fb0 0x7fe6140a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 -- 172.21.15.148:0/60955534 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140c62c0 con 0x7fe6140a9e60 2023-10-24T00:29:53.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.055+0000 7fe618fd2700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe6140c6ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fe6140b1030 tx=0x7fe6040090f0).ready entity=mon.0 client_cookie=c816fbcc9981cc58 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:53.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe60bfff700 1 -- 172.21.15.148:0/60955534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400f510 con 0x7fe6140a9e60 2023-10-24T00:29:53.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe60bfff700 1 -- 172.21.15.148:0/60955534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400f670 con 0x7fe6140a9e60 2023-10-24T00:29:53.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe60bfff700 1 -- 172.21.15.148:0/60955534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400fa10 con 0x7fe6140a9e60 2023-10-24T00:29:53.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 -- 172.21.15.148:0/60955534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 msgr2=0x7fe6140c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe6140c6ac0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fe6140b1030 tx=0x7fe6040090f0).stop 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 -- 172.21.15.148:0/60955534 shutdown_connections 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/60955534 >> v2:172.21.15.150:3300/0 conn(0x7fe6140c6fb0 0x7fe6140a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6141574f0 0x7fe6140c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/60955534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe6140c6ac0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 -- 172.21.15.148:0/60955534 >> 172.21.15.148:0/60955534 conn(0x7fe614094500 msgr2=0x7fe61406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:53.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 -- 172.21.15.148:0/60955534 shutdown_connections 2023-10-24T00:29:53.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.056+0000 7fe61a7d5700 1 -- 172.21.15.148:0/60955534 wait complete. 2023-10-24T00:29:53.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.057+0000 7fe61a7d5700 1 Processor -- start 2023-10-24T00:29:53.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.057+0000 7fe61a7d5700 1 -- start start 2023-10-24T00:29:53.066 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:53.055+0000 7fc4c5e49680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:29:53.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6140c6fb0 0x7fe6141539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6141574f0 0x7fe6140631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614155080 con 0x7fe6140a9e60 2023-10-24T00:29:53.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141541b0 con 0x7fe6141574f0 2023-10-24T00:29:53.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe61a7d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614148120 con 0x7fe6140c6fb0 2023-10-24T00:29:53.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.058+0000 7fe6197d3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46312/0 (socket says 172.21.15.148:46312) 2023-10-24T00:29:53.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 -- 172.21.15.148:0/2902511157 learned_addr learned my addr 172.21.15.148:0/2902511157 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:53.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe618fd2700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6140c6fb0 0x7fe6141539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe619fd4700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6141574f0 0x7fe6140631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 -- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6140c6fb0 msgr2=0x7fe6141539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6140c6fb0 0x7fe6141539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 -- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6141574f0 msgr2=0x7fe6140631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6141574f0 0x7fe6140631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 -- 172.21.15.148:0/2902511157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604009370 con 0x7fe6140a9e60 2023-10-24T00:29:53.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6197d3700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fe61000e930 tx=0x7fe610009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:53.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610012600 con 0x7fe6140a9e60 2023-10-24T00:29:53.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe610012760 con 0x7fe6140a9e60 2023-10-24T00:29:53.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe614154400 con 0x7fe6140a9e60 2023-10-24T00:29:53.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610012ae0 con 0x7fe6140a9e60 2023-10-24T00:29:53.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.059+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6141549c0 con 0x7fe6140a9e60 2023-10-24T00:29:53.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.060+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614047480 con 0x7fe6140a9e60 2023-10-24T00:29:53.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.061+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fe61001b400 con 0x7fe6140a9e60 2023-10-24T00:29:53.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.061+0000 7fe6097fa700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 0x7fe5f8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.061+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe61007a5f0 con 0x7fe6140a9e60 2023-10-24T00:29:53.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.061+0000 7fe618fd2700 1 -- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 msgr2=0x7fe5f8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:53.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.061+0000 7fe618fd2700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 0x7fe5f8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:29:53.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.069+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe61004b8c0 con 0x7fe6140a9e60 2023-10-24T00:29:53.121 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:53.119+0000 7fc4c5e49680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:29:53.124 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:53.122+0000 7fa26a311680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:29:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.241+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe6140c65a0 con 0x7fe6140a9e60 2023-10-24T00:29:53.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.247+0000 7fe6097fa700 1 -- 172.21.15.148:0/2902511157 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe6100160d0 con 0x7fe6140a9e60 2023-10-24T00:29:53.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 msgr2=0x7fe5f8061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:29:53.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 0x7fe5f8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:53.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 msgr2=0x7fe614147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fe61000e930 tx=0x7fe610009060).stop 2023-10-24T00:29:53.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 shutdown_connections 2023-10-24T00:29:53.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6141574f0 0x7fe6140631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe5f805f1a0 0x7fe5f8061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:53.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6140a9e60 0x7fe614147c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 --2- 172.21.15.148:0/2902511157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6140c6fb0 0x7fe6141539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 >> 172.21.15.148:0/2902511157 conn(0x7fe614094500 msgr2=0x7fe6141521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:53.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 shutdown_connections 2023-10-24T00:29:53.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.249+0000 7fe61a7d5700 1 -- 172.21.15.148:0/2902511157 wait complete. 2023-10-24T00:29:53.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:53.264 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T00:29:53.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:53.284 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-10-24T00:29:53.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-10-24T00:29:53.395 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:53.393+0000 7fc4c5e49680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:29:53.410 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:53.409+0000 7fa26a311680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:29:53.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.503+0000 7f88633de700 1 Processor -- start 2023-10-24T00:29:53.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.503+0000 7f88633de700 1 -- start start 2023-10-24T00:29:53.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f88633de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f885c069250 0x7f885c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f88633de700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f885c0659c0 0x7f885c065e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f88633de700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c065530 con 0x7f885c062810 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f88633de700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c0bd340 con 0x7f885c0659c0 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f88633de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c069830 con 0x7f885c069250 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f886197b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f885c0659c0 0x7f885c065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f886117a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f885c062810 0x7f885c0bcc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57470/0 (socket says 172.21.15.148:57470) 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f886117a700 1 -- 172.21.15.148:0/494407960 learned_addr learned my addr 172.21.15.148:0/494407960 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:53.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.504+0000 7f8860979700 1 --2- 172.21.15.148:0/494407960 >> v2:172.21.15.150:3300/0 conn(0x7f885c069250 0x7f885c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f886197b700 1 -- 172.21.15.148:0/494407960 >> v2:172.21.15.150:3300/0 conn(0x7f885c069250 msgr2=0x7f885c062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f886197b700 1 --2- 172.21.15.148:0/494407960 >> v2:172.21.15.150:3300/0 conn(0x7f885c069250 0x7f885c062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f886197b700 1 -- 172.21.15.148:0/494407960 >> v1:172.21.15.148:6789/0 conn(0x7f885c062810 legacy=0x7f885c0bcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f8853fff700 1 -- 172.21.15.148:0/494407960 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264434636 0 0) 0x7f885c065530 con 0x7f885c062810 2023-10-24T00:29:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f886197b700 1 -- 172.21.15.148:0/494407960 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c069b10 con 0x7f885c0659c0 2023-10-24T00:29:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f886197b700 1 --2- 172.21.15.148:0/494407960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c065e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f885c0be570 tx=0x7f8854009780).ready entity=mon.0 client_cookie=bb6bd45ddada4a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f8853fff700 1 -- 172.21.15.148:0/494407960 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400e070 con 0x7f885c0659c0 2023-10-24T00:29:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f8853fff700 1 -- 172.21.15.148:0/494407960 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885400bb60 con 0x7f885c0659c0 2023-10-24T00:29:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f8853fff700 1 -- 172.21.15.148:0/494407960 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854012410 con 0x7f885c0659c0 2023-10-24T00:29:53.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f88633de700 1 -- 172.21.15.148:0/494407960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 msgr2=0x7f885c065e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.505+0000 7f88633de700 1 --2- 172.21.15.148:0/494407960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c065e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f885c0be570 tx=0x7f8854009780).stop 2023-10-24T00:29:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 -- 172.21.15.148:0/494407960 shutdown_connections 2023-10-24T00:29:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 --2- 172.21.15.148:0/494407960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c065e10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 --2- 172.21.15.148:0/494407960 >> v2:172.21.15.150:3300/0 conn(0x7f885c069250 0x7f885c062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 -- 172.21.15.148:0/494407960 >> 172.21.15.148:0/494407960 conn(0x7f885c0c7cd0 msgr2=0x7f885c0c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 -- 172.21.15.148:0/494407960 shutdown_connections 2023-10-24T00:29:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.506+0000 7f88633de700 1 -- 172.21.15.148:0/494407960 wait complete. 2023-10-24T00:29:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.507+0000 7f88633de700 1 Processor -- start 2023-10-24T00:29:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.507+0000 7f88633de700 1 -- start start 2023-10-24T00:29:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f885c062810 0x7f885c14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 0x7f885c1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c39e0 con 0x7f885c0659c0 2023-10-24T00:29:53.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c14ef70 con 0x7f885c069250 2023-10-24T00:29:53.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88633de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c2dd0 con 0x7f885c062810 2023-10-24T00:29:53.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57432/0 (socket says 172.21.15.148:57432) 2023-10-24T00:29:53.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 -- 172.21.15.148:0/2596052453 learned_addr learned my addr 172.21.15.148:0/2596052453 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:53.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f886197b700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 0x7f885c1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f885c062810 0x7f885c14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f885c062810 msgr2=0x7f885c14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f885c062810 0x7f885c14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 msgr2=0x7f885c1528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 0x7f885c1528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:53.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009a20 con 0x7f885c0659c0 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f886197b700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 0x7f885c1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f8860979700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f884c00e900 tx=0x7f884c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c012600 con 0x7f885c0659c0 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.508+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c012760 con 0x7f885c0659c0 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.509+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0c30b0 con 0x7f885c0659c0 2023-10-24T00:29:53.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.509+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c012ae0 con 0x7f885c0659c0 2023-10-24T00:29:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.509+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0c3670 con 0x7f885c0659c0 2023-10-24T00:29:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c061270 con 0x7f885c0659c0 2023-10-24T00:29:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f884c01b400 con 0x7f885c0659c0 2023-10-24T00:29:53.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f88517fa700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f886117a700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f884c07a570 con 0x7f885c0659c0 2023-10-24T00:29:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.510+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:29:53.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.518+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f884c04b7e0 con 0x7f885c0659c0 2023-10-24T00:29:53.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.711+0000 7f886117a700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:53.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.711+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:29:53.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:53.714+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f885c06c6b0 con 0x7f884005f1a0 2023-10-24T00:29:54.008 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.005+0000 7fc4c5e49680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:29:54.037 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.036+0000 7fa26a311680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:29:54.080 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.077+0000 7fc4c5e49680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:29:54.109 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.108+0000 7fa26a311680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:29:54.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:54.112+0000 7f886117a700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:54.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:54.112+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:29:54.265 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.262+0000 7fc4c5e49680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:29:54.295 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.293+0000 7fa26a311680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:29:54.683 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.681+0000 7fc4c5e49680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:29:54.710 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.709+0000 7fa26a311680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:29:54.786 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.783+0000 7fc4c5e49680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:29:54.813 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.812+0000 7fa26a311680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:29:54.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:54.913+0000 7f886117a700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:54.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:54.913+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:29:54.938 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:54.935+0000 7fc4c5e49680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:29:54.965 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:54.964+0000 7fa26a311680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:29:55.012 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:55.010+0000 7fc4c5e49680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:29:55.038 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:55.037+0000 7fa26a311680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:29:55.078 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:55.076+0000 7fc4c5e49680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:29:55.105 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:55.103+0000 7fa26a311680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:29:55.334 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:55.331+0000 7fc4c5e49680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:29:55.360 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:55.358+0000 7fa26a311680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:29:55.521 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:55.518+0000 7fc4c5e49680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:29:55.542 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:55.541+0000 7fa26a311680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:29:56.169 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.166+0000 7fc4c5e49680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:29:56.189 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.188+0000 7fa26a311680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:29:56.236 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.233+0000 7fc4c5e49680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:29:56.257 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.256+0000 7fa26a311680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:29:56.310 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.307+0000 7fc4c5e49680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:29:56.331 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.330+0000 7fa26a311680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:29:56.454 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.452+0000 7fc4c5e49680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:29:56.476 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.475+0000 7fa26a311680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:29:56.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:56.515+0000 7f886117a700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:29:56.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:56.515+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:29:56.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.520+0000 7fc4c5e49680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:29:56.546 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.545+0000 7fa26a311680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:29:56.636 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.634+0000 7fc4c5e49680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:29:56.658 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.657+0000 7fa26a311680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:29:56.744 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:56.741+0000 7fc4c5e49680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:29:56.765 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:56.764+0000 7fa26a311680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:29:57.033 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.031+0000 7fc4c5e49680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:29:57.057 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:57.056+0000 7fa26a311680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:29:57.104 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.101+0000 7fc4c5e49680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:29:57.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:57.122+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 6) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f884c078340 con 0x7f885c0659c0 2023-10-24T00:29:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:57.122+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f8840061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:29:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:57.122+0000 7f88517fa700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f8840061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:57.129 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:29:57.128+0000 7fa26a311680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:29:57.192 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43a5d0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.193 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43a5d0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.193 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43a5d0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.193 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43a5d0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.193 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43a5d0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43d5d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43d5d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43d5d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43d5d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:57.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:29:57.190+0000 7fc43d5d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:29:58.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.124+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f884c0786c0 con 0x7f885c0659c0 2023-10-24T00:29:58.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.124+0000 7f88517fa700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f88400615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.124+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f885c06c6b0 con 0x7f884005f1a0 2023-10-24T00:29:58.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.125+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f88400615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.125+0000 7f886117a700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f88400615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f88580011e0 tx=0x7f8858007bb0).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.146+0000 7f88517fa700 1 -- 172.21.15.148:0/2596052453 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f885c06c6b0 con 0x7f884005f1a0 2023-10-24T00:29:58.147 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir0 2023-10-24T00:29:58.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 msgr2=0x7f88400615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f88400615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f88580011e0 tx=0x7f8858007bb0).stop 2023-10-24T00:29:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 msgr2=0x7f885c0c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f884c00e900 tx=0x7f884c009060).stop 2023-10-24T00:29:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 shutdown_connections 2023-10-24T00:29:58.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f885c069250 0x7f885c1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f885c062810 0x7f885c14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f884005f1a0 0x7f88400615e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 --2- 172.21.15.148:0/2596052453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f885c0659c0 0x7f885c0c23f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 >> 172.21.15.148:0/2596052453 conn(0x7f885c0c7cd0 msgr2=0x7f885c1539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:58.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 shutdown_connections 2023-10-24T00:29:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.148+0000 7f88633de700 1 -- 172.21.15.148:0/2596052453 wait complete. 2023-10-24T00:29:58.162 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-10-24T00:29:58.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:58.163 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-10-24T00:29:58.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-10-24T00:29:58.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.377+0000 7fe81548c700 1 Processor -- start 2023-10-24T00:29:58.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.377+0000 7fe81548c700 1 -- start start 2023-10-24T00:29:58.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe81548c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 0x7fe810154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe81548c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe8100c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe81548c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8100ca270 con 0x7fe8101588c0 2023-10-24T00:29:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe81548c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100cae10 con 0x7fe810154040 2023-10-24T00:29:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe81548c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100c9660 con 0x7fe8100c7840 2023-10-24T00:29:58.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80e7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe8101588c0 0x7fe8100ca700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57474/0 (socket says 172.21.15.148:57474) 2023-10-24T00:29:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80e7fc700 1 -- 172.21.15.148:0/2483174030 learned_addr learned my addr 172.21.15.148:0/2483174030 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80effd700 1 --2- 172.21.15.148:0/2483174030 >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 0x7fe810154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 --2- 172.21.15.148:0/2483174030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe8100c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060808539 0 0) 0x7fe8100ca270 con 0x7fe8101588c0 2023-10-24T00:29:58.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc0033f0 con 0x7fe8101588c0 2023-10-24T00:29:58.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 -- 172.21.15.148:0/2483174030 >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 msgr2=0x7fe810154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:58.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 --2- 172.21.15.148:0/2483174030 >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 0x7fe810154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 -- 172.21.15.148:0/2483174030 >> v1:172.21.15.148:6789/0 conn(0x7fe8101588c0 legacy=0x7fe8100ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273810830 0 0) 0x7fe7fc0033f0 con 0x7fe8101588c0 2023-10-24T00:29:58.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 -- 172.21.15.148:0/2483174030 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100c9940 con 0x7fe8100c7840 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80effd700 1 --2- 172.21.15.148:0/2483174030 >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 0x7fe810154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.378+0000 7fe80f7fe700 1 --2- 172.21.15.148:0/2483174030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe8100c7cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe800009760 tx=0x7fe800009060).ready entity=mon.2 client_cookie=f3c801f0d0d2aedc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000d4a0 con 0x7fe8100c7840 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000d600 con 0x7fe8100c7840 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe80dffb700 1 -- 172.21.15.148:0/2483174030 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000d980 con 0x7fe8100c7840 2023-10-24T00:29:58.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 -- 172.21.15.148:0/2483174030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 msgr2=0x7fe8100c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 --2- 172.21.15.148:0/2483174030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe8100c7cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe800009760 tx=0x7fe800009060).stop 2023-10-24T00:29:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 -- 172.21.15.148:0/2483174030 shutdown_connections 2023-10-24T00:29:58.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 --2- 172.21.15.148:0/2483174030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe8100c7cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 --2- 172.21.15.148:0/2483174030 >> v2:172.21.15.150:3300/0 conn(0x7fe810154040 0x7fe810154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 -- 172.21.15.148:0/2483174030 >> 172.21.15.148:0/2483174030 conn(0x7fe810069d80 msgr2=0x7fe81006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:58.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 -- 172.21.15.148:0/2483174030 shutdown_connections 2023-10-24T00:29:58.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.379+0000 7fe81548c700 1 -- 172.21.15.148:0/2483174030 wait complete. 2023-10-24T00:29:58.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.380+0000 7fe81548c700 1 Processor -- start 2023-10-24T00:29:58.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 -- start start 2023-10-24T00:29:58.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe810156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 0x7fe8100af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810155140 con 0x7fe810154040 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81014e750 con 0x7fe8101588c0 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe81548c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101655c0 con 0x7fe8100c7840 2023-10-24T00:29:58.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe80e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe80e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57438/0 (socket says 172.21.15.148:57438) 2023-10-24T00:29:58.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.381+0000 7fe80e7fc700 1 -- 172.21.15.148:0/3683475303 learned_addr learned my addr 172.21.15.148:0/3683475303 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:58.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80f7fe700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 0x7fe8100af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80effd700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe810156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 -- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 msgr2=0x7fe810156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe810156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 -- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 msgr2=0x7fe8100af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 0x7fe8100af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 -- 172.21.15.148:0/3683475303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009a20 con 0x7fe810154040 2023-10-24T00:29:58.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80f7fe700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 0x7fe8100af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:29:58.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe80e7fc700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe7f800c3f0 tx=0x7fe7f8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8007170 con 0x7fe810154040 2023-10-24T00:29:58.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f80072d0 con 0x7fe810154040 2023-10-24T00:29:58.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80048c0 con 0x7fe810154040 2023-10-24T00:29:58.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8000092a0 con 0x7fe810154040 2023-10-24T00:29:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.382+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe810154af0 con 0x7fe810154040 2023-10-24T00:29:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.383+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8101552b0 con 0x7fe810154040 2023-10-24T00:29:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.383+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe7f8004cf0 con 0x7fe810154040 2023-10-24T00:29:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.384+0000 7fe806ffd700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 0x7fe7f0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.384+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe7f8079990 con 0x7fe810154040 2023-10-24T00:29:58.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.384+0000 7fe80effd700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 0x7fe7f0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.384+0000 7fe80effd700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 0x7fe7f0061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe8080099f0 tx=0x7fe80800b040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.388+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe7f804ad80 con 0x7fe810154040 2023-10-24T00:29:58.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.574+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8101558f0 con 0x7fe7f005f080 2023-10-24T00:29:58.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.579+0000 7fe806ffd700 1 -- 172.21.15.148:0/3683475303 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe8101558f0 con 0x7fe7f005f080 2023-10-24T00:29:58.581 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir1 2023-10-24T00:29:58.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 msgr2=0x7fe7f0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 0x7fe7f0061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe8080099f0 tx=0x7fe80800b040).stop 2023-10-24T00:29:58.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 msgr2=0x7fe8101650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe7f800c3f0 tx=0x7fe7f8007c20).stop 2023-10-24T00:29:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 shutdown_connections 2023-10-24T00:29:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8101588c0 0x7fe8100af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8100c7840 0x7fe810156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe7f005f080 0x7fe7f0061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 --2- 172.21.15.148:0/3683475303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe810154040 0x7fe8101650d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 >> 172.21.15.148:0/3683475303 conn(0x7fe810069d80 msgr2=0x7fe8100c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:58.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 shutdown_connections 2023-10-24T00:29:58.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.581+0000 7fe81548c700 1 -- 172.21.15.148:0/3683475303 wait complete. 2023-10-24T00:29:58.594 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-10-24T00:29:58.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:58.595 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-10-24T00:29:58.611 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-10-24T00:29:58.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.767+0000 7fa8431d5700 1 Processor -- start 2023-10-24T00:29:58.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.767+0000 7fa8431d5700 1 -- start start 2023-10-24T00:29:58.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa8431d5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa83c1544b0 0x7fa83c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa8431d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa83c0c8290 0x7fa83c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa8431d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c0c6270 con 0x7fa83c0aa420 2023-10-24T00:29:58.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa8431d5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0c60e0 con 0x7fa83c1544b0 2023-10-24T00:29:58.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa8431d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0c0c80 con 0x7fa83c0c8290 2023-10-24T00:29:58.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa83c1544b0 0x7fa83c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa83c1544b0 0x7fa83c0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57448/0 (socket says 172.21.15.148:57448) 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 -- 172.21.15.148:0/289513663 learned_addr learned my addr 172.21.15.148:0/289513663 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa833fff700 1 --2- 172.21.15.148:0/289513663 >> v2:172.21.15.150:3300/0 conn(0x7fa83c0c8290 0x7fa83c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 -- 172.21.15.148:0/289513663 >> v2:172.21.15.150:3300/0 conn(0x7fa83c0c8290 msgr2=0x7fa83c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 --2- 172.21.15.148:0/289513663 >> v2:172.21.15.150:3300/0 conn(0x7fa83c0c8290 0x7fa83c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 -- 172.21.15.148:0/289513663 >> v1:172.21.15.150:6789/0 conn(0x7fa83c0aa420 legacy=0x7fa83c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.768+0000 7fa840f71700 1 -- 172.21.15.148:0/289513663 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0c0f40 con 0x7fa83c1544b0 2023-10-24T00:29:58.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa840f71700 1 --2- 172.21.15.148:0/289513663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c0a7d00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa83c0a9cf0 tx=0x7fa8380090f0).ready entity=mon.0 client_cookie=f2b4cd1bad3c278a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8337fe700 1 -- 172.21.15.148:0/289513663 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800b520 con 0x7fa83c1544b0 2023-10-24T00:29:58.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8337fe700 1 -- 172.21.15.148:0/289513663 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800b680 con 0x7fa83c1544b0 2023-10-24T00:29:58.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8337fe700 1 -- 172.21.15.148:0/289513663 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800ba00 con 0x7fa83c1544b0 2023-10-24T00:29:58.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 -- 172.21.15.148:0/289513663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 msgr2=0x7fa83c0a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 --2- 172.21.15.148:0/289513663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c0a7d00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa83c0a9cf0 tx=0x7fa8380090f0).stop 2023-10-24T00:29:58.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 -- 172.21.15.148:0/289513663 shutdown_connections 2023-10-24T00:29:58.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 --2- 172.21.15.148:0/289513663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c0a7d00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 --2- 172.21.15.148:0/289513663 >> v2:172.21.15.150:3300/0 conn(0x7fa83c0c8290 0x7fa83c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 -- 172.21.15.148:0/289513663 >> 172.21.15.148:0/289513663 conn(0x7fa83c0945d0 msgr2=0x7fa83c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:58.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 -- 172.21.15.148:0/289513663 shutdown_connections 2023-10-24T00:29:58.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.769+0000 7fa8431d5700 1 -- 172.21.15.148:0/289513663 wait complete. 2023-10-24T00:29:58.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.770+0000 7fa8431d5700 1 Processor -- start 2023-10-24T00:29:58.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 -- start start 2023-10-24T00:29:58.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83c0aa420 0x7fa83c14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83c0c8290 0x7fa83c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0ae120 con 0x7fa83c1544b0 2023-10-24T00:29:58.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0ae400 con 0x7fa83c0aa420 2023-10-24T00:29:58.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.771+0000 7fa8431d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0ae6e0 con 0x7fa83c0c8290 2023-10-24T00:29:58.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57454/0 (socket says 172.21.15.148:57454) 2023-10-24T00:29:58.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa840f71700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83c0aa420 0x7fa83c14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 -- 172.21.15.148:0/1222236335 learned_addr learned my addr 172.21.15.148:0/1222236335 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:58.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa833fff700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83c0c8290 0x7fa83c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 -- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83c0c8290 msgr2=0x7fa83c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83c0c8290 0x7fa83c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 -- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83c0aa420 msgr2=0x7fa83c14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83c0aa420 0x7fa83c14f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 -- 172.21.15.148:0/1222236335 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009370 con 0x7fa83c1544b0 2023-10-24T00:29:58.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa841772700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa834002230 tx=0x7fa8340015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400e4a0 con 0x7fa83c1544b0 2023-10-24T00:29:58.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400e600 con 0x7fa83c1544b0 2023-10-24T00:29:58.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400e980 con 0x7fa83c1544b0 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c0ae9c0 con 0x7fa83c1544b0 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.772+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c14f560 con 0x7fa83c1544b0 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.773+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c06c6b0 con 0x7fa83c1544b0 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.773+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fa83401b3b0 con 0x7fa83c1544b0 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.774+0000 7fa830ff9700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 0x7fa828061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.774+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa8340796a0 con 0x7fa83c1544b0 2023-10-24T00:29:58.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.774+0000 7fa840f71700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 0x7fa828061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:58.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.774+0000 7fa840f71700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 0x7fa828061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa838009130 tx=0x7fa838017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:58.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.778+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa834048af0 con 0x7fa83c1544b0 2023-10-24T00:29:58.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.965+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa83c0c1220 con 0x7fa82805f080 2023-10-24T00:29:58.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.970+0000 7fa830ff9700 1 -- 172.21.15.148:0/1222236335 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa83c0c1220 con 0x7fa82805f080 2023-10-24T00:29:58.972 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir2 2023-10-24T00:29:58.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 msgr2=0x7fa828061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 0x7fa828061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa838009130 tx=0x7fa838017000).stop 2023-10-24T00:29:58.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 msgr2=0x7fa83c156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:58.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa834002230 tx=0x7fa8340015e0).stop 2023-10-24T00:29:58.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 shutdown_connections 2023-10-24T00:29:58.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa82805f080 0x7fa828061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa83c1544b0 0x7fa83c156e70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa83c0aa420 0x7fa83c14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 --2- 172.21.15.148:0/1222236335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa83c0c8290 0x7fa83c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:58.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 >> 172.21.15.148:0/1222236335 conn(0x7fa83c0945d0 msgr2=0x7fa83c063cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:58.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 shutdown_connections 2023-10-24T00:29:58.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:58.972+0000 7fa8431d5700 1 -- 172.21.15.148:0/1222236335 wait complete. 2023-10-24T00:29:58.985 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-10-24T00:29:58.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:58.986 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-10-24T00:29:59.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-10-24T00:29:59.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.160+0000 7f1507fff700 1 Processor -- start 2023-10-24T00:29:59.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.160+0000 7f1507fff700 1 -- start start 2023-10-24T00:29:59.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1507fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f1508155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1507fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15080c81e0 0x7f1508153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1507fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15080c7770 con 0x7f15080aa320 2023-10-24T00:29:59.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1507fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080c8690 con 0x7f15080c81e0 2023-10-24T00:29:59.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1507fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c1070 con 0x7f15080a9f40 2023-10-24T00:29:59.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f15067fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f15080aa320 0x7f15080c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57476/0 (socket says 172.21.15.148:57476) 2023-10-24T00:29:59.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f15067fc700 1 -- 172.21.15.148:0/3075222331 learned_addr learned my addr 172.21.15.148:0/3075222331 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:59.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1506ffd700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f1508155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f15077fe700 1 --2- 172.21.15.148:0/3075222331 >> v2:172.21.15.150:3300/0 conn(0x7f15080c81e0 0x7f1508153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386632177 0 0) 0x7f15080c7770 con 0x7f15080aa320 2023-10-24T00:29:59.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f00033f0 con 0x7f15080aa320 2023-10-24T00:29:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 755883597 0 0) 0x7f14f00033f0 con 0x7f15080aa320 2023-10-24T00:29:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 msgr2=0x7f1508155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f1508155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 >> v2:172.21.15.150:3300/0 conn(0x7f15080c81e0 msgr2=0x7f1508153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 --2- 172.21.15.148:0/3075222331 >> v2:172.21.15.150:3300/0 conn(0x7f15080c81e0 0x7f1508153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080c79e0 con 0x7f15080aa320 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f14fc001470 con 0x7f15080aa320 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f15077fe700 1 --2- 172.21.15.148:0/3075222331 >> v2:172.21.15.150:3300/0 conn(0x7f15080c81e0 0x7f1508153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1506ffd700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f1508155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 >> v1:172.21.15.148:6789/0 conn(0x7f15080aa320 legacy=0x7f15080c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f00038e0 0x7f14f0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f0004690 0x7f14f0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.161+0000 7f1505ffb700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f14f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c8690 con 0x7f14f0004690 2023-10-24T00:29:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080c1070 con 0x7f14f00038e0 2023-10-24T00:29:59.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f000b910 con 0x7f15080a9f40 2023-10-24T00:29:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f0004690 0x7f14f0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1506ffd700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f00038e0 0x7f14f0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15077fe700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f14f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 -- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 msgr2=0x7f14f0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f14f0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 -- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f00038e0 msgr2=0x7f14f0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14f00038e0 0x7f14f0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 -- 172.21.15.148:0/3075222331 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f00033f0 con 0x7f14f0004690 2023-10-24T00:29:59.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15077fe700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15080a9f40 0x7f14f0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:59.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f15067fc700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f0004690 0x7f14f0004b10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f14fc00c1e0 tx=0x7f14fc001e90).ready entity=mon.0 client_cookie=e434cef3fd2e6ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc007a60 con 0x7f14f0004690 2023-10-24T00:29:59.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc00cab0 con 0x7f14f0004690 2023-10-24T00:29:59.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.162+0000 7f1505ffb700 1 -- 172.21.15.148:0/3075222331 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00ce50 con 0x7f14f0004690 2023-10-24T00:29:59.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 -- 172.21.15.148:0/3075222331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f0004690 msgr2=0x7f14f0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 --2- 172.21.15.148:0/3075222331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14f0004690 0x7f14f0004b10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f14fc00c1e0 tx=0x7f14fc001e90).stop 2023-10-24T00:29:59.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f15077fe700 1 -- 172.21.15.148:0/3075222331 reap_dead start 2023-10-24T00:29:59.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 -- 172.21.15.148:0/3075222331 shutdown_connections 2023-10-24T00:29:59.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 -- 172.21.15.148:0/3075222331 >> 172.21.15.148:0/3075222331 conn(0x7f1508094420 msgr2=0x7f150806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:59.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 -- 172.21.15.148:0/3075222331 shutdown_connections 2023-10-24T00:29:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.163+0000 7f1507fff700 1 -- 172.21.15.148:0/3075222331 wait complete. 2023-10-24T00:29:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.164+0000 7f1507fff700 1 Processor -- start 2023-10-24T00:29:59.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.164+0000 7f1507fff700 1 -- start start 2023-10-24T00:29:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14f0004690 0x7f150814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f150814fa70 0x7f15080c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080ab390 con 0x7f15080c95b0 2023-10-24T00:29:59.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080aaa60 con 0x7f150814fa70 2023-10-24T00:29:59.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15080aad40 con 0x7f14f0004690 2023-10-24T00:29:59.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57480/0 (socket says 172.21.15.148:57480) 2023-10-24T00:29:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 -- 172.21.15.148:0/1938181915 learned_addr learned my addr 172.21.15.148:0/1938181915 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15067fc700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f150814fa70 0x7f15080c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1506ffd700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14f0004690 0x7f150814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 -- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14f0004690 msgr2=0x7f150814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14f0004690 0x7f150814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 -- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f150814fa70 msgr2=0x7f15080c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f150814fa70 0x7f15080c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 -- 172.21.15.148:0/1938181915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080ab020 con 0x7f15080c95b0 2023-10-24T00:29:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f15077fe700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f15080c7460 tx=0x7f15000098d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500002bd0 con 0x7f15080c95b0 2023-10-24T00:29:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150000f030 con 0x7f15080c95b0 2023-10-24T00:29:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15080acb30 con 0x7f15080c95b0 2023-10-24T00:29:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500015420 con 0x7f15080c95b0 2023-10-24T00:29:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.165+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15080ab820 con 0x7f15080c95b0 2023-10-24T00:29:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.166+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15080ab1b0 con 0x7f15080c95b0 2023-10-24T00:29:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.167+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f1500003040 con 0x7f15080c95b0 2023-10-24T00:29:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.167+0000 7f14eeffd700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 0x7f14f4061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.167+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f150007a560 con 0x7f15080c95b0 2023-10-24T00:29:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.167+0000 7f1506ffd700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 0x7f14f4061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.168+0000 7f1506ffd700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 0x7f14f4061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14f8005f70 tx=0x7f14f8008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.171+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f15080ab1b0 con 0x7f15080c95b0 2023-10-24T00:29:59.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.358+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f15080aabd0 con 0x7f14f405f080 2023-10-24T00:29:59.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.363+0000 7f14eeffd700 1 -- 172.21.15.148:0/1938181915 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f15080aabd0 con 0x7f14f405f080 2023-10-24T00:29:59.365 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir3 2023-10-24T00:29:59.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 msgr2=0x7f14f4061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 0x7f14f4061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f14f8005f70 tx=0x7f14f8008040).stop 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 msgr2=0x7f15080ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f15080c7460 tx=0x7f15000098d0).stop 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 shutdown_connections 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f14f405f080 0x7f14f4061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15080c95b0 0x7f15080ac640 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14f0004690 0x7f150814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 --2- 172.21.15.148:0/1938181915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f150814fa70 0x7f15080c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.365+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 >> 172.21.15.148:0/1938181915 conn(0x7f1508094420 msgr2=0x7f15080635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:59.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.366+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 shutdown_connections 2023-10-24T00:29:59.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.366+0000 7f1507fff700 1 -- 172.21.15.148:0/1938181915 wait complete. 2023-10-24T00:29:59.379 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-10-24T00:29:59.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:59.380 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-10-24T00:29:59.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-10-24T00:29:59.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.553+0000 7f8493fb5700 1 Processor -- start 2023-10-24T00:29:59.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.553+0000 7f8493fb5700 1 -- start start 2023-10-24T00:29:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8493fb5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f848c0a7d00 0x7f848c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8493fb5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c0c6270 con 0x7f848c1544b0 2023-10-24T00:29:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8493fb5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c0c0c80 con 0x7f848c0aa420 2023-10-24T00:29:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8493fb5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0c60e0 con 0x7f848c0a7d00 2023-10-24T00:29:59.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491550700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f848c0a7d00 0x7f848c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491d51700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f848c1544b0 0x7f848c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57488/0 (socket says 172.21.15.148:57488) 2023-10-24T00:29:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491d51700 1 -- 172.21.15.148:0/4223368824 learned_addr learned my addr 172.21.15.148:0/4223368824 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:29:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491550700 1 -- 172.21.15.148:0/4223368824 >> v1:172.21.15.150:6789/0 conn(0x7f848c0aa420 legacy=0x7f848c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491550700 1 -- 172.21.15.148:0/4223368824 >> v1:172.21.15.148:6789/0 conn(0x7f848c1544b0 legacy=0x7f848c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8490d4f700 1 -- 172.21.15.148:0/4223368824 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805597834 0 0) 0x7f848c0c6270 con 0x7f848c1544b0 2023-10-24T00:29:59.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491550700 1 -- 172.21.15.148:0/4223368824 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0c0f40 con 0x7f848c0a7d00 2023-10-24T00:29:59.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.554+0000 7f8491550700 1 --2- 172.21.15.148:0/4223368824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c0a9f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f847c009760 tx=0x7f847c009060).ready entity=mon.0 client_cookie=1261531d9daa7388 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8490d4f700 1 -- 172.21.15.148:0/4223368824 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00b520 con 0x7f848c0a7d00 2023-10-24T00:29:59.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8490d4f700 1 -- 172.21.15.148:0/4223368824 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c00b680 con 0x7f848c0a7d00 2023-10-24T00:29:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8490d4f700 1 -- 172.21.15.148:0/4223368824 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00ba00 con 0x7f848c0a7d00 2023-10-24T00:29:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 -- 172.21.15.148:0/4223368824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 msgr2=0x7f848c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4223368824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c0a9f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f847c009760 tx=0x7f847c009060).stop 2023-10-24T00:29:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 -- 172.21.15.148:0/4223368824 shutdown_connections 2023-10-24T00:29:59.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4223368824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c0a9f30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 -- 172.21.15.148:0/4223368824 >> 172.21.15.148:0/4223368824 conn(0x7f848c0945d0 msgr2=0x7f848c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 -- 172.21.15.148:0/4223368824 shutdown_connections 2023-10-24T00:29:59.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.555+0000 7f8493fb5700 1 -- 172.21.15.148:0/4223368824 wait complete. 2023-10-24T00:29:59.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.556+0000 7f8493fb5700 1 Processor -- start 2023-10-24T00:29:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.556+0000 7f8493fb5700 1 -- start start 2023-10-24T00:29:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f848c0aa420 0x7f848c0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f848c1544b0 0x7f848c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1659a0 con 0x7f848c0a7d00 2023-10-24T00:29:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0afae0 con 0x7f848c0aa420 2023-10-24T00:29:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8493fb5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1656c0 con 0x7f848c1544b0 2023-10-24T00:29:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57490/0 (socket says 172.21.15.148:57490) 2023-10-24T00:29:59.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 -- 172.21.15.148:0/4117356287 learned_addr learned my addr 172.21.15.148:0/4117356287 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 -- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f848c1544b0 msgr2=0x7f848c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f848c1544b0 0x7f848c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 -- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f848c0aa420 msgr2=0x7f848c0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f848c0aa420 0x7f848c0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:59.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 -- 172.21.15.148:0/4117356287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0092a0 con 0x7f848c0a7d00 2023-10-24T00:29:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.557+0000 7f8491d51700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f848800c460 tx=0x7f8488007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.558+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880072e0 con 0x7f848c0a7d00 2023-10-24T00:29:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.558+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488007440 con 0x7f848c0a7d00 2023-10-24T00:29:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.558+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880057a0 con 0x7f848c0a7d00 2023-10-24T00:29:59.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.558+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c0af490 con 0x7f848c0a7d00 2023-10-24T00:29:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.558+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c14ee60 con 0x7f848c0a7d00 2023-10-24T00:29:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.559+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8488005b90 con 0x7f848c0a7d00 2023-10-24T00:29:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.559+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c06c6b0 con 0x7f848c0a7d00 2023-10-24T00:29:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.559+0000 7f8481ffb700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 0x7f8470061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.559+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f84880798a0 con 0x7f848c0a7d00 2023-10-24T00:29:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.560+0000 7f8491550700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 0x7f8470061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.560+0000 7f8491550700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 0x7f8470061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f848c0c7d50 tx=0x7f847c017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.563+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f848804ac90 con 0x7f848c0a7d00 2023-10-24T00:29:59.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.752+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f848c0af930 con 0x7f847005f080 2023-10-24T00:29:59.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.756+0000 7f8481ffb700 1 -- 172.21.15.148:0/4117356287 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f848c0af930 con 0x7f847005f080 2023-10-24T00:29:59.758 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir4 2023-10-24T00:29:59.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 msgr2=0x7f8470061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 0x7f8470061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f848c0c7d50 tx=0x7f847c017000).stop 2023-10-24T00:29:59.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 msgr2=0x7f848c14e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f848800c460 tx=0x7f8488007e90).stop 2023-10-24T00:29:59.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 shutdown_connections 2023-10-24T00:29:59.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f848c1544b0 0x7f848c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:59.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f847005f080 0x7f8470061540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f848c0a7d00 0x7f848c14e970 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 --2- 172.21.15.148:0/4117356287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f848c0aa420 0x7f848c0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:29:59.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 >> 172.21.15.148:0/4117356287 conn(0x7f848c0945d0 msgr2=0x7f848c063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:59.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 shutdown_connections 2023-10-24T00:29:59.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.758+0000 7f8493fb5700 1 -- 172.21.15.148:0/4117356287 wait complete. 2023-10-24T00:29:59.772 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-10-24T00:29:59.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:29:59.772 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-10-24T00:29:59.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-10-24T00:29:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.946+0000 7f544f4f1700 1 Processor -- start 2023-10-24T00:29:59.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.946+0000 7f544f4f1700 1 -- start start 2023-10-24T00:29:59.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544f4f1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a7d00 0x7f54480a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544f4f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480aa420 0x7f54480c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544f4f1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480c6270 con 0x7f54481544b0 2023-10-24T00:29:59.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544f4f1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480c60e0 con 0x7f54480a7d00 2023-10-24T00:29:59.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544f4f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480aa870 con 0x7f54480aa420 2023-10-24T00:29:59.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a7d00 0x7f54480a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a7d00 0x7f54480a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57494/0 (socket says 172.21.15.148:57494) 2023-10-24T00:29:59.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 -- 172.21.15.148:0/2609454044 learned_addr learned my addr 172.21.15.148:0/2609454044 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:59.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544da8e700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480aa420 0x7f54480c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 -- 172.21.15.148:0/2609454044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480aa420 msgr2=0x7f54480c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:29:59.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480aa420 0x7f54480c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 -- 172.21.15.148:0/2609454044 >> v1:172.21.15.150:6789/0 conn(0x7f54481544b0 legacy=0x7f54480c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 -- 172.21.15.148:0/2609454044 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480c0c80 con 0x7f54480a7d00 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f544ca8c700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a7d00 0x7f54480a9f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5438006fd0 tx=0x7f54380090f0).ready entity=mon.0 client_cookie=fc960ae04af3db9f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.947+0000 7f543ffff700 1 -- 172.21.15.148:0/2609454044 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800b580 con 0x7f54480a7d00 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f543ffff700 1 -- 172.21.15.148:0/2609454044 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800b6e0 con 0x7f54480a7d00 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f543ffff700 1 -- 172.21.15.148:0/2609454044 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800ba60 con 0x7f54480a7d00 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 -- 172.21.15.148:0/2609454044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a7d00 msgr2=0x7f54480a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a7d00 0x7f54480a9f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5438006fd0 tx=0x7f54380090f0).stop 2023-10-24T00:29:59.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 -- 172.21.15.148:0/2609454044 shutdown_connections 2023-10-24T00:29:59.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480aa420 0x7f54480c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2609454044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a7d00 0x7f54480a9f30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 -- 172.21.15.148:0/2609454044 >> 172.21.15.148:0/2609454044 conn(0x7f54480945d0 msgr2=0x7f544806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:29:59.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 -- 172.21.15.148:0/2609454044 shutdown_connections 2023-10-24T00:29:59.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.948+0000 7f544f4f1700 1 -- 172.21.15.148:0/2609454044 wait complete. 2023-10-24T00:29:59.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.949+0000 7f544f4f1700 1 Processor -- start 2023-10-24T00:29:59.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.949+0000 7f544f4f1700 1 -- start start 2023-10-24T00:29:59.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a7d00 0x7f5448157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 0x7f5448154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448169010 con 0x7f54481544b0 2023-10-24T00:29:59.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154d80 con 0x7f54480aa420 2023-10-24T00:29:59.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544f4f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448168cc0 con 0x7f54480a7d00 2023-10-24T00:29:59.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544da8e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544da8e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57508/0 (socket says 172.21.15.148:57508) 2023-10-24T00:29:59.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544da8e700 1 -- 172.21.15.148:0/2487949510 learned_addr learned my addr 172.21.15.148:0/2487949510 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:29:59.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544d28d700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a7d00 0x7f5448157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544ca8c700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 0x7f5448154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544da8e700 1 -- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a7d00 msgr2=0x7f5448157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.950+0000 7f544da8e700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a7d00 0x7f5448157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544da8e700 1 -- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 msgr2=0x7f5448154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:29:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544da8e700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 0x7f5448154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:29:59.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544da8e700 1 -- 172.21.15.148:0/2487949510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009370 con 0x7f54481544b0 2023-10-24T00:29:59.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544ca8c700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 0x7f5448154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:29:59.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544da8e700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5440009ec0 tx=0x7f544000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000cc20 con 0x7f54481544b0 2023-10-24T00:29:59.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000f040 con 0x7f54481544b0 2023-10-24T00:29:59.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448155000 con 0x7f54481544b0 2023-10-24T00:29:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440013400 con 0x7f54481544b0 2023-10-24T00:29:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.951+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54481555c0 con 0x7f54481544b0 2023-10-24T00:29:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.952+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544814f3e0 con 0x7f54481544b0 2023-10-24T00:29:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.952+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f54400137b0 con 0x7f54481544b0 2023-10-24T00:29:59.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.953+0000 7f543d7fa700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 0x7f542c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:29:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.953+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f544007a990 con 0x7f54481544b0 2023-10-24T00:29:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.953+0000 7f544d28d700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 0x7f542c061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:29:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.953+0000 7f544d28d700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 0x7f542c061510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f54440035a0 tx=0x7f5444009040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:29:59.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:29:59.957+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f544004bd80 con 0x7f54481544b0 2023-10-24T00:30:00.123 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:30:00.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:30:00.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.132+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f5440078880 con 0x7f54481544b0 2023-10-24T00:30:00.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.150+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f544806c6b0 con 0x7f542c05f050 2023-10-24T00:30:00.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:30:00.151+0000 7fc42cdb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:30:00.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:30:00.151+0000 7fc42cdb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:30:00.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:30:00.151+0000 7fc42cdb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:30:00.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:30:00.151+0000 7fc42cdb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:30:00.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:30:00.151+0000 7fc42cdb5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:30:00.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.175+0000 7f543d7fa700 1 -- 172.21.15.148:0/2487949510 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f544806c6b0 con 0x7f542c05f050 2023-10-24T00:30:00.177 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir5 2023-10-24T00:30:00.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 msgr2=0x7f542c061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 0x7f542c061510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f54440035a0 tx=0x7f5444009040).stop 2023-10-24T00:30:00.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 msgr2=0x7f5448153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f5440009ec0 tx=0x7f544000b040).stop 2023-10-24T00:30:00.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 shutdown_connections 2023-10-24T00:30:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f542c05f050 0x7f542c061510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54481544b0 0x7f5448153770 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a7d00 0x7f5448157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 --2- 172.21.15.148:0/2487949510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480aa420 0x7f5448154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 >> 172.21.15.148:0/2487949510 conn(0x7f54480945d0 msgr2=0x7f54480c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:00.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 shutdown_connections 2023-10-24T00:30:00.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.177+0000 7f544f4f1700 1 -- 172.21.15.148:0/2487949510 wait complete. 2023-10-24T00:30:00.191 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-10-24T00:30:00.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:30:00.193 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-10-24T00:30:00.248 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-10-24T00:30:00.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.406+0000 7f6ea3713700 1 Processor -- start 2023-10-24T00:30:00.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.407+0000 7f6ea3713700 1 -- start start 2023-10-24T00:30:00.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea3713700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 0x7f6e9c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea3713700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea3713700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c0c6270 con 0x7f6e9c0aa420 2023-10-24T00:30:00.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea3713700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c60e0 con 0x7f6e9c1544b0 2023-10-24T00:30:00.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea3713700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0aa890 con 0x7f6e9c0c8290 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea1cb0700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6e9c0aa420 0x7f6e9c0c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:33398/0 (socket says 172.21.15.148:33398) 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea14af700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 0x7f6e9c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea1cb0700 1 -- 172.21.15.148:0/2306224732 learned_addr learned my addr 172.21.15.148:0/2306224732 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 -- 172.21.15.148:0/2306224732 >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 msgr2=0x7f6e9c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:00.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 --2- 172.21.15.148:0/2306224732 >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 0x7f6e9c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 -- 172.21.15.148:0/2306224732 >> v1:172.21.15.150:6789/0 conn(0x7f6e9c0aa420 legacy=0x7f6e9c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 -- 172.21.15.148:0/2306224732 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0c0c80 con 0x7f6e9c0c8290 2023-10-24T00:30:00.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea14af700 1 --2- 172.21.15.148:0/2306224732 >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 0x7f6e9c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:30:00.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.408+0000 7f6ea0cae700 1 --2- 172.21.15.148:0/2306224732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c0a9f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6e90009760 tx=0x7f6e90009060).ready entity=mon.2 client_cookie=4023d2675f06cf29 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6e9bfff700 1 -- 172.21.15.148:0/2306224732 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000f510 con 0x7f6e9c0c8290 2023-10-24T00:30:00.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6e9bfff700 1 -- 172.21.15.148:0/2306224732 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000f670 con 0x7f6e9c0c8290 2023-10-24T00:30:00.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6e9bfff700 1 -- 172.21.15.148:0/2306224732 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000f9f0 con 0x7f6e9c0c8290 2023-10-24T00:30:00.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 -- 172.21.15.148:0/2306224732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 msgr2=0x7f6e9c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 --2- 172.21.15.148:0/2306224732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c0a9f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6e90009760 tx=0x7f6e90009060).stop 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 -- 172.21.15.148:0/2306224732 shutdown_connections 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 --2- 172.21.15.148:0/2306224732 >> v2:172.21.15.150:3300/0 conn(0x7f6e9c1544b0 0x7f6e9c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 --2- 172.21.15.148:0/2306224732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c0a9f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 -- 172.21.15.148:0/2306224732 >> 172.21.15.148:0/2306224732 conn(0x7f6e9c0945d0 msgr2=0x7f6e9c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 -- 172.21.15.148:0/2306224732 shutdown_connections 2023-10-24T00:30:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.409+0000 7f6ea3713700 1 -- 172.21.15.148:0/2306224732 wait complete. 2023-10-24T00:30:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.410+0000 7f6ea3713700 1 Processor -- start 2023-10-24T00:30:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.410+0000 7f6ea3713700 1 -- start start 2023-10-24T00:30:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e9c1544b0 0x7f6e9c0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0ac1f0 con 0x7f6e9c0aa420 2023-10-24T00:30:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c165e80 con 0x7f6e9c1544b0 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea3713700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0abba0 con 0x7f6e9c0c8290 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea14af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea14af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57520/0 (socket says 172.21.15.148:57520) 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea14af700 1 -- 172.21.15.148:0/784595205 learned_addr learned my addr 172.21.15.148:0/784595205 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea1cb0700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e9c1544b0 0x7f6e9c0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.411+0000 7f6ea0cae700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 -- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 msgr2=0x7f6e9c156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 -- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e9c1544b0 msgr2=0x7f6e9c0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e9c1544b0 0x7f6e9c0c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 -- 172.21.15.148:0/784595205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94009a20 con 0x7f6e9c0aa420 2023-10-24T00:30:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea14af700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f6e9400c0c0 tx=0x7f6e9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400cc00 con 0x7f6e9c0aa420 2023-10-24T00:30:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9400f040 con 0x7f6e9c0aa420 2023-10-24T00:30:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e900092a0 con 0x7f6e9c0aa420 2023-10-24T00:30:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94013400 con 0x7f6e9c0aa420 2023-10-24T00:30:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.412+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0acb70 con 0x7f6e9c0aa420 2023-10-24T00:30:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.413+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c0aba00 con 0x7f6e9c0aa420 2023-10-24T00:30:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.413+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f6e940137b0 con 0x7f6e9c0aa420 2023-10-24T00:30:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.414+0000 7f6e997fa700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 0x7f6e88061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.414+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6e9407aee0 con 0x7f6e9c0aa420 2023-10-24T00:30:00.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.414+0000 7f6ea0cae700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 0x7f6e88061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.414+0000 7f6ea0cae700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 0x7f6e88061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6e90009fd0 tx=0x7f6e90017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.418+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6e9c0aba00 con 0x7f6e9c0aa420 2023-10-24T00:30:00.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.606+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e9c0ac330 con 0x7f6e8805f350 2023-10-24T00:30:00.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.610+0000 7f6e997fa700 1 -- 172.21.15.148:0/784595205 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6e9000f7e0 con 0x7f6e8805f350 2023-10-24T00:30:00.611 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir6 2023-10-24T00:30:00.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 msgr2=0x7f6e88061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 0x7f6e88061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6e90009fd0 tx=0x7f6e90017000).stop 2023-10-24T00:30:00.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 msgr2=0x7f6e9c0ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f6e9400c0c0 tx=0x7f6e9400b040).stop 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 shutdown_connections 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e9c1544b0 0x7f6e9c0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6e8805f350 0x7f6e88061810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e9c0aa420 0x7f6e9c0ac680 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 --2- 172.21.15.148:0/784595205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e9c0c8290 0x7f6e9c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 >> 172.21.15.148:0/784595205 conn(0x7f6e9c0945d0 msgr2=0x7f6e9c0646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:00.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 shutdown_connections 2023-10-24T00:30:00.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.612+0000 7f6ea3713700 1 -- 172.21.15.148:0/784595205 wait complete. 2023-10-24T00:30:00.625 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-10-24T00:30:00.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:30:00.626 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-10-24T00:30:00.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-10-24T00:30:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.804+0000 7f5e7c531700 1 Processor -- start 2023-10-24T00:30:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.804+0000 7f5e7c531700 1 -- start start 2023-10-24T00:30:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7c531700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e74063760 0x7f5e74063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7c531700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e740be080 0x7f5e740be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7c531700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740640d0 con 0x7f5e74137570 2023-10-24T00:30:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7c531700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74137950 con 0x7f5e740be080 2023-10-24T00:30:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7c531700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74157fd0 con 0x7f5e74063760 2023-10-24T00:30:00.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7aace700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e740be080 0x7f5e740be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.805+0000 7f5e7aace700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e740be080 0x7f5e740be4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57528/0 (socket says 172.21.15.148:57528) 2023-10-24T00:30:00.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 -- 172.21.15.148:0/2357024355 learned_addr learned my addr 172.21.15.148:0/2357024355 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:00.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e79acc700 1 --2- 172.21.15.148:0/2357024355 >> v2:172.21.15.150:3300/0 conn(0x7f5e74063760 0x7f5e74063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 -- 172.21.15.148:0/2357024355 >> v2:172.21.15.150:3300/0 conn(0x7f5e74063760 msgr2=0x7f5e74063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 --2- 172.21.15.148:0/2357024355 >> v2:172.21.15.150:3300/0 conn(0x7f5e74063760 0x7f5e74063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 -- 172.21.15.148:0/2357024355 >> v1:172.21.15.150:6789/0 conn(0x7f5e74137570 legacy=0x7f5e740665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 -- 172.21.15.148:0/2357024355 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74158270 con 0x7f5e740be080 2023-10-24T00:30:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7aace700 1 --2- 172.21.15.148:0/2357024355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e740be080 0x7f5e740be4c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f5e740a88f0 tx=0x7f5e6c0090f0).ready entity=mon.0 client_cookie=2c81e48b558023c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e792cb700 1 -- 172.21.15.148:0/2357024355 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00b600 con 0x7f5e740be080 2023-10-24T00:30:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e792cb700 1 -- 172.21.15.148:0/2357024355 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00b760 con 0x7f5e740be080 2023-10-24T00:30:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e792cb700 1 -- 172.21.15.148:0/2357024355 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00bae0 con 0x7f5e740be080 2023-10-24T00:30:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7c531700 1 -- 172.21.15.148:0/2357024355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e740be080 msgr2=0x7f5e740be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.806+0000 7f5e7c531700 1 --2- 172.21.15.148:0/2357024355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e740be080 0x7f5e740be4c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f5e740a88f0 tx=0x7f5e6c0090f0).stop 2023-10-24T00:30:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 -- 172.21.15.148:0/2357024355 shutdown_connections 2023-10-24T00:30:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 --2- 172.21.15.148:0/2357024355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e740be080 0x7f5e740be4c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 --2- 172.21.15.148:0/2357024355 >> v2:172.21.15.150:3300/0 conn(0x7f5e74063760 0x7f5e74063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 -- 172.21.15.148:0/2357024355 >> 172.21.15.148:0/2357024355 conn(0x7f5e74063120 msgr2=0x7f5e740c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 -- 172.21.15.148:0/2357024355 shutdown_connections 2023-10-24T00:30:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.807+0000 7f5e7c531700 1 -- 172.21.15.148:0/2357024355 wait complete. 2023-10-24T00:30:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.808+0000 7f5e7c531700 1 Processor -- start 2023-10-24T00:30:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.808+0000 7f5e7c531700 1 -- start start 2023-10-24T00:30:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e74063760 0x7f5e74164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e740be080 0x7f5e7414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74151140 con 0x7f5e74137570 2023-10-24T00:30:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74151420 con 0x7f5e740be080 2023-10-24T00:30:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74151700 con 0x7f5e74063760 2023-10-24T00:30:00.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57544/0 (socket says 172.21.15.148:57544) 2023-10-24T00:30:00.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 -- 172.21.15.148:0/3586522611 learned_addr learned my addr 172.21.15.148:0/3586522611 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:00.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e79acc700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e740be080 0x7f5e7414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7a2cd700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e74063760 0x7f5e74164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 -- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e74063760 msgr2=0x7f5e74164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e74063760 0x7f5e74164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 -- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e740be080 msgr2=0x7f5e7414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e740be080 0x7f5e7414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 -- 172.21.15.148:0/3586522611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009370 con 0x7f5e74137570 2023-10-24T00:30:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7aace700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f5e6c009130 tx=0x7f5e6c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00bae0 con 0x7f5e74137570 2023-10-24T00:30:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00bea0 con 0x7f5e74137570 2023-10-24T00:30:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e741519e0 con 0x7f5e74137570 2023-10-24T00:30:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c01c670 con 0x7f5e74137570 2023-10-24T00:30:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.809+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e74164580 con 0x7f5e74137570 2023-10-24T00:30:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.810+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74164770 con 0x7f5e74137570 2023-10-24T00:30:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.811+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f5e6c01ca20 con 0x7f5e74137570 2023-10-24T00:30:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.811+0000 7f5e6a7fc700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 0x7f5e58061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.811+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5e6c07be90 con 0x7f5e74137570 2023-10-24T00:30:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.811+0000 7f5e7a2cd700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 0x7f5e58061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.811+0000 7f5e7a2cd700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 0x7f5e58061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5e70007fd0 tx=0x7f5e70001530).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:00.815+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e6c04ceb0 con 0x7f5e74137570 2023-10-24T00:30:01.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.006+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e7406c6b0 con 0x7f5e5805f350 2023-10-24T00:30:01.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.010+0000 7f5e6a7fc700 1 -- 172.21.15.148:0/3586522611 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5e7406c6b0 con 0x7f5e5805f350 2023-10-24T00:30:01.012 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir7 2023-10-24T00:30:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 msgr2=0x7f5e58061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 0x7f5e58061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5e70007fd0 tx=0x7f5e70001530).stop 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 msgr2=0x7f5e740ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f5e6c009130 tx=0x7f5e6c017000).stop 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 shutdown_connections 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e5805f350 0x7f5e58061810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e74137570 0x7f5e740ac6d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e74063760 0x7f5e74164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 --2- 172.21.15.148:0/3586522611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e740be080 0x7f5e7414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 >> 172.21.15.148:0/3586522611 conn(0x7f5e74063120 msgr2=0x7f5e740c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 shutdown_connections 2023-10-24T00:30:01.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.012+0000 7f5e7c531700 1 -- 172.21.15.148:0/3586522611 wait complete. 2023-10-24T00:30:01.025 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-10-24T00:30:01.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:30:01.026 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-10-24T00:30:01.044 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-10-24T00:30:01.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.201+0000 7fc6516b6700 1 Processor -- start 2023-10-24T00:30:01.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.201+0000 7fc6516b6700 1 -- start start 2023-10-24T00:30:01.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc6516b6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc64c0aa640 0x7fc64c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc6516b6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0c6270 con 0x7fc64c1544b0 2023-10-24T00:30:01.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc6516b6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0c0c80 con 0x7fc64c0a7d00 2023-10-24T00:30:01.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc6516b6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0c60e0 con 0x7fc64c0aa640 2023-10-24T00:30:01.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc64affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc64c1544b0 0x7fc64c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57502/0 (socket says 172.21.15.148:57502) 2023-10-24T00:30:01.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc64affd700 1 -- 172.21.15.148:0/1390806027 learned_addr learned my addr 172.21.15.148:0/1390806027 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:01.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc64b7fe700 1 --2- 172.21.15.148:0/1390806027 >> v2:172.21.15.150:3300/0 conn(0x7fc64c0aa640 0x7fc64c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200103751 0 0) 0x7fc64c0c6270 con 0x7fc64c1544b0 2023-10-24T00:30:01.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6340033f0 con 0x7fc64c1544b0 2023-10-24T00:30:01.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3258447087 0 0) 0x7fc6340033f0 con 0x7fc64c1544b0 2023-10-24T00:30:01.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 >> v2:172.21.15.150:3300/0 conn(0x7fc64c0aa640 msgr2=0x7fc64c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 --2- 172.21.15.148:0/1390806027 >> v2:172.21.15.150:3300/0 conn(0x7fc64c0aa640 0x7fc64c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 >> v1:172.21.15.150:6789/0 conn(0x7fc64c0a7d00 legacy=0x7fc64c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0c0f40 con 0x7fc64c1544b0 2023-10-24T00:30:01.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fc63c001470 con 0x7fc64c1544b0 2023-10-24T00:30:01.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 >> v1:172.21.15.148:6789/0 conn(0x7fc64c1544b0 legacy=0x7fc64c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6340038e0 0x7fc634003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 0x7fc634004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634005000 0x7fc63400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0c60e0 con 0x7fc634004690 2023-10-24T00:30:01.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63400beb0 con 0x7fc6340038e0 2023-10-24T00:30:01.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.202+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63400c070 con 0x7fc634005000 2023-10-24T00:30:01.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 0x7fc634004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64affd700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6340038e0 0x7fc634003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64b7fe700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634005000 0x7fc63400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 -- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634005000 msgr2=0x7fc63400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634005000 0x7fc63400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 -- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6340038e0 msgr2=0x7fc634003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6340038e0 0x7fc634003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 -- 172.21.15.148:0/1390806027 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340033f0 con 0x7fc634004690 2023-10-24T00:30:01.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64b7fe700 1 -- 172.21.15.148:0/1390806027 reap_dead start 2023-10-24T00:30:01.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64affd700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6340038e0 0x7fc634003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:01.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc64a7fc700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 0x7fc634004b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc640001730 tx=0x7fc640007bb0).ready entity=mon.0 client_cookie=659d4c215d6e9503 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640007020 con 0x7fc634004690 2023-10-24T00:30:01.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640007180 con 0x7fc634004690 2023-10-24T00:30:01.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc649ffb700 1 -- 172.21.15.148:0/1390806027 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640007520 con 0x7fc634004690 2023-10-24T00:30:01.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc6516b6700 1 -- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 msgr2=0x7fc634004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 0x7fc634004b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc640001730 tx=0x7fc640007bb0).stop 2023-10-24T00:30:01.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.203+0000 7fc6516b6700 1 -- 172.21.15.148:0/1390806027 shutdown_connections 2023-10-24T00:30:01.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.204+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1390806027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc634004690 0x7fc634004b10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.204+0000 7fc6516b6700 1 -- 172.21.15.148:0/1390806027 >> 172.21.15.148:0/1390806027 conn(0x7fc64c0945d0 msgr2=0x7fc64c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.204+0000 7fc6516b6700 1 -- 172.21.15.148:0/1390806027 shutdown_connections 2023-10-24T00:30:01.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.204+0000 7fc6516b6700 1 -- 172.21.15.148:0/1390806027 wait complete. 2023-10-24T00:30:01.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.205+0000 7fc6516b6700 1 Processor -- start 2023-10-24T00:30:01.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.205+0000 7fc6516b6700 1 -- start start 2023-10-24T00:30:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.205+0000 7fc6516b6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634004690 0x7fc64c14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc64c154890 0x7fc64c1649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c14f390 con 0x7fc64c164ee0 2023-10-24T00:30:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0ae470 con 0x7fc64c154890 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c154d10 con 0x7fc634004690 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57564/0 (socket says 172.21.15.148:57564) 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 -- 172.21.15.148:0/1210438987 learned_addr learned my addr 172.21.15.148:0/1210438987 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64a7fc700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc64c154890 0x7fc64c1649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64affd700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634004690 0x7fc64c14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 -- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634004690 msgr2=0x7fc64c14eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634004690 0x7fc64c14eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 -- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc64c154890 msgr2=0x7fc64c1649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc64c154890 0x7fc64c1649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 -- 172.21.15.148:0/1210438987 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c165520 con 0x7fc64c164ee0 2023-10-24T00:30:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc64b7fe700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc64c0adcd0 tx=0x7fc64400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400e070 con 0x7fc64c164ee0 2023-10-24T00:30:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644011c30 con 0x7fc64c164ee0 2023-10-24T00:30:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c165800 con 0x7fc64c164ee0 2023-10-24T00:30:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644016450 con 0x7fc64c164ee0 2023-10-24T00:30:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.206+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c1538a0 con 0x7fc64c164ee0 2023-10-24T00:30:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.207+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c165a40 con 0x7fc64c164ee0 2023-10-24T00:30:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.208+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fc644016840 con 0x7fc64c164ee0 2023-10-24T00:30:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.208+0000 7fc632ffd700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 0x7fc638061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.208+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc64407ab80 con 0x7fc64c164ee0 2023-10-24T00:30:01.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.208+0000 7fc64affd700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 0x7fc638061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.208+0000 7fc64affd700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 0x7fc638061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc63c000e10 tx=0x7fc63c007040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.212+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc64c165a40 con 0x7fc64c164ee0 2023-10-24T00:30:01.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.397+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc64c0adf80 con 0x7fc63805f350 2023-10-24T00:30:01.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.401+0000 7fc632ffd700 1 -- 172.21.15.148:0/1210438987 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc63c0057e0 con 0x7fc63805f350 2023-10-24T00:30:01.403 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir8 2023-10-24T00:30:01.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 msgr2=0x7fc638061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 0x7fc638061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc63c000e10 tx=0x7fc63c007040).stop 2023-10-24T00:30:01.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 msgr2=0x7fc64c156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc64c0adcd0 tx=0x7fc64400b040).stop 2023-10-24T00:30:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 shutdown_connections 2023-10-24T00:30:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc63805f350 0x7fc638061810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc64c164ee0 0x7fc64c156ce0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc634004690 0x7fc64c14eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 --2- 172.21.15.148:0/1210438987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc64c154890 0x7fc64c1649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.403+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 >> 172.21.15.148:0/1210438987 conn(0x7fc64c0945d0 msgr2=0x7fc64c0a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.404+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 shutdown_connections 2023-10-24T00:30:01.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.404+0000 7fc6516b6700 1 -- 172.21.15.148:0/1210438987 wait complete. 2023-10-24T00:30:01.417 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-10-24T00:30:01.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:30:01.418 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-10-24T00:30:01.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-10-24T00:30:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.592+0000 7ff455d40700 1 Processor -- start 2023-10-24T00:30:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.592+0000 7ff455d40700 1 -- start start 2023-10-24T00:30:01.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4501544b0 0x7ff4500a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 0x7ff4500a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4500aa420 0x7ff4500c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500c60e0 con 0x7ff4501544b0 2023-10-24T00:30:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500c6270 con 0x7ff4500aa420 2023-10-24T00:30:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff455d40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500aa890 con 0x7ff4500c8290 2023-10-24T00:30:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4501544b0 0x7ff4500a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4501544b0 0x7ff4500a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57580/0 (socket says 172.21.15.148:57580) 2023-10-24T00:30:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 -- 172.21.15.148:0/690677229 learned_addr learned my addr 172.21.15.148:0/690677229 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44effd700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 0x7ff4500a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44ffff700 1 --2- 172.21.15.148:0/690677229 >> v2:172.21.15.150:3300/0 conn(0x7ff4500aa420 0x7ff4500c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 -- 172.21.15.148:0/690677229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 msgr2=0x7ff4500a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 0x7ff4500a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 -- 172.21.15.148:0/690677229 >> v2:172.21.15.150:3300/0 conn(0x7ff4500aa420 msgr2=0x7ff4500c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/690677229 >> v2:172.21.15.150:3300/0 conn(0x7ff4500aa420 0x7ff4500c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44f7fe700 1 -- 172.21.15.148:0/690677229 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500c0c80 con 0x7ff4501544b0 2023-10-24T00:30:01.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.593+0000 7ff44effd700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 0x7ff4500a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:30:01.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4501544b0 0x7ff4500a7d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ff450084520 tx=0x7ff440009840).ready entity=mon.0 client_cookie=6c3a04e0794601a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff44e7fc700 1 -- 172.21.15.148:0/690677229 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000e070 con 0x7ff4501544b0 2023-10-24T00:30:01.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff44e7fc700 1 -- 172.21.15.148:0/690677229 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000ba50 con 0x7ff4501544b0 2023-10-24T00:30:01.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff44e7fc700 1 -- 172.21.15.148:0/690677229 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000bdd0 con 0x7ff4501544b0 2023-10-24T00:30:01.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 -- 172.21.15.148:0/690677229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4501544b0 msgr2=0x7ff4500a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4501544b0 0x7ff4500a7d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ff450084520 tx=0x7ff440009840).stop 2023-10-24T00:30:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 -- 172.21.15.148:0/690677229 shutdown_connections 2023-10-24T00:30:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4501544b0 0x7ff4500a7d00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 --2- 172.21.15.148:0/690677229 >> v2:172.21.15.150:3300/0 conn(0x7ff4500aa420 0x7ff4500c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 --2- 172.21.15.148:0/690677229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4500c8290 0x7ff4500a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 -- 172.21.15.148:0/690677229 >> 172.21.15.148:0/690677229 conn(0x7ff4500945d0 msgr2=0x7ff45006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 -- 172.21.15.148:0/690677229 shutdown_connections 2023-10-24T00:30:01.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.594+0000 7ff455d40700 1 -- 172.21.15.148:0/690677229 wait complete. 2023-10-24T00:30:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.595+0000 7ff455d40700 1 Processor -- start 2023-10-24T00:30:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 -- start start 2023-10-24T00:30:01.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 0x7ff4500ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 0x7ff4500ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500ab120 con 0x7ff4500aa420 2023-10-24T00:30:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500ca040 con 0x7ff4500c8290 2023-10-24T00:30:01.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff455d40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500c9d60 con 0x7ff4501544b0 2023-10-24T00:30:01.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff44f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff44f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57590/0 (socket says 172.21.15.148:57590) 2023-10-24T00:30:01.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.596+0000 7ff44f7fe700 1 -- 172.21.15.148:0/1755005066 learned_addr learned my addr 172.21.15.148:0/1755005066 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:01.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44ffff700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 0x7ff4500ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44effd700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 0x7ff4500ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 -- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 msgr2=0x7ff4500ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 0x7ff4500ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 -- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 msgr2=0x7ff4500ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 0x7ff4500ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 -- 172.21.15.148:0/1755005066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009ae0 con 0x7ff4500aa420 2023-10-24T00:30:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44ffff700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 0x7ff4500ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:30:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44effd700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 0x7ff4500ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:30:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff44f7fe700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ff440009fd0 tx=0x7ff440009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440009500 con 0x7ff4500aa420 2023-10-24T00:30:01.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000bbc0 con 0x7ff4500aa420 2023-10-24T00:30:01.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4500aaad0 con 0x7ff4500aa420 2023-10-24T00:30:01.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44001d460 con 0x7ff4500aa420 2023-10-24T00:30:01.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.597+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4500ad700 con 0x7ff4500aa420 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.598+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500aaf70 con 0x7ff4500aa420 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.598+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7ff440003040 con 0x7ff4500aa420 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.599+0000 7ff4377fe700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 0x7ff43c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.599+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff44007b820 con 0x7ff4500aa420 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.599+0000 7ff44effd700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 0x7ff43c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.599+0000 7ff44effd700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 0x7ff43c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff4500cbf60 tx=0x7ff444008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.603+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff440050210 con 0x7ff4500aa420 2023-10-24T00:30:01.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.673+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ff440079230 con 0x7ff4500aa420 2023-10-24T00:30:01.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.793+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff45006c6b0 con 0x7ff43c05f350 2023-10-24T00:30:01.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.797+0000 7ff4377fe700 1 -- 172.21.15.148:0/1755005066 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff45006c6b0 con 0x7ff43c05f350 2023-10-24T00:30:01.799 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/dir9 2023-10-24T00:30:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 msgr2=0x7ff43c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 0x7ff43c061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff4500cbf60 tx=0x7ff444008040).stop 2023-10-24T00:30:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 msgr2=0x7ff45014ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ff440009fd0 tx=0x7ff440009840).stop 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 shutdown_connections 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4501544b0 0x7ff4500ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43c05f350 0x7ff43c061810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4500aa420 0x7ff45014ec10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 --2- 172.21.15.148:0/1755005066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4500c8290 0x7ff4500ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 >> 172.21.15.148:0/1755005066 conn(0x7ff4500945d0 msgr2=0x7ff4500a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 shutdown_connections 2023-10-24T00:30:01.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.799+0000 7ff455d40700 1 -- 172.21.15.148:0/1755005066 wait complete. 2023-10-24T00:30:01.812 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-10-24T00:30:01.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-24T00:30:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.930+0000 7f8883f6f700 1 Processor -- start 2023-10-24T00:30:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.930+0000 7f8883f6f700 1 -- start start 2023-10-24T00:30:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8883f6f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8883f6f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f887c0c8290 0x7f887c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8883f6f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0c6270 con 0x7f887c0aa420 2023-10-24T00:30:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8883f6f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c0c60e0 con 0x7f887c0c8290 2023-10-24T00:30:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8883f6f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0aa8b0 con 0x7f887c1544b0 2023-10-24T00:30:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f888150a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f887c0c8290 0x7f887c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f888150a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f887c0c8290 0x7f887c0a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57592/0 (socket says 172.21.15.148:57592) 2023-10-24T00:30:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f888150a700 1 -- 172.21.15.148:0/4181689388 learned_addr learned my addr 172.21.15.148:0/4181689388 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.931+0000 7f8881d0b700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f888150a700 1 -- 172.21.15.148:0/4181689388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 msgr2=0x7f887c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:01.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f888150a700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f888150a700 1 -- 172.21.15.148:0/4181689388 >> v1:172.21.15.150:6789/0 conn(0x7f887c0aa420 legacy=0x7f887c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f888150a700 1 -- 172.21.15.148:0/4181689388 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0c0c80 con 0x7f887c0c8290 2023-10-24T00:30:01.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f888150a700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c0a9f30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f886c006fd0 tx=0x7f886c0090f0).ready entity=mon.0 client_cookie=4dc257c8ed1d220 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8880d09700 1 -- 172.21.15.148:0/4181689388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00b580 con 0x7f887c0c8290 2023-10-24T00:30:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8880d09700 1 -- 172.21.15.148:0/4181689388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c00b6e0 con 0x7f887c0c8290 2023-10-24T00:30:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8880d09700 1 -- 172.21.15.148:0/4181689388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00ba60 con 0x7f887c0c8290 2023-10-24T00:30:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 -- 172.21.15.148:0/4181689388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 msgr2=0x7f887c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c0a9f30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f886c006fd0 tx=0x7f886c0090f0).stop 2023-10-24T00:30:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 -- 172.21.15.148:0/4181689388 shutdown_connections 2023-10-24T00:30:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 --2- 172.21.15.148:0/4181689388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c0a9f30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 -- 172.21.15.148:0/4181689388 >> 172.21.15.148:0/4181689388 conn(0x7f887c0945d0 msgr2=0x7f887c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 -- 172.21.15.148:0/4181689388 shutdown_connections 2023-10-24T00:30:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.932+0000 7f8883f6f700 1 -- 172.21.15.148:0/4181689388 wait complete. 2023-10-24T00:30:01.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.933+0000 7f8883f6f700 1 Processor -- start 2023-10-24T00:30:01.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 -- start start 2023-10-24T00:30:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887c0aa420 0x7f887c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0adf80 con 0x7f887c0c8290 2023-10-24T00:30:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c151750 con 0x7f887c0aa420 2023-10-24T00:30:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8883f6f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0c9cf0 con 0x7f887c1544b0 2023-10-24T00:30:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f888150a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f888150a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57600/0 (socket says 172.21.15.148:57600) 2023-10-24T00:30:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f888150a700 1 -- 172.21.15.148:0/2303123270 learned_addr learned my addr 172.21.15.148:0/2303123270 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f8881d0b700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887c0aa420 0x7f887c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.934+0000 7f888250c700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 -- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 msgr2=0x7f887c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 -- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887c0aa420 msgr2=0x7f887c151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887c0aa420 0x7f887c151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 -- 172.21.15.148:0/2303123270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009370 con 0x7f887c0c8290 2023-10-24T00:30:01.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f888150a700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f886c009130 tx=0x7f886c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c000bc0 con 0x7f887c0c8290 2023-10-24T00:30:01.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c00b850 con 0x7f887c0c8290 2023-10-24T00:30:01.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c0ae1d0 con 0x7f887c0c8290 2023-10-24T00:30:01.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c000d20 con 0x7f887c0c8290 2023-10-24T00:30:01.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.935+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c0ae790 con 0x7f887c0c8290 2023-10-24T00:30:01.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.936+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c164600 con 0x7f887c0c8290 2023-10-24T00:30:01.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.936+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f886c01c900 con 0x7f887c0c8290 2023-10-24T00:30:01.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.937+0000 7f8871ffb700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 0x7f8860061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:01.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.937+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f886c07c350 con 0x7f887c0c8290 2023-10-24T00:30:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.937+0000 7f8881d0b700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 0x7f8860061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.937+0000 7f8881d0b700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 0x7f8860061870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8878009fd0 tx=0x7f887800b040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:01.941+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f886c04d210 con 0x7f887c0c8290 2023-10-24T00:30:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.131+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f887c0ae980 con 0x7f886005f3b0 2023-10-24T00:30:02.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.135+0000 7f8871ffb700 1 -- 172.21.15.148:0/2303123270 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f887c0ae980 con 0x7f886005f3b0 2023-10-24T00:30:02.137 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-10-24T00:30:02.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 msgr2=0x7f8860061870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 0x7f8860061870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8878009fd0 tx=0x7f887800b040).stop 2023-10-24T00:30:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 msgr2=0x7f887c141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f886c009130 tx=0x7f886c017000).stop 2023-10-24T00:30:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 shutdown_connections 2023-10-24T00:30:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887c1544b0 0x7f887c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887c0aa420 0x7f887c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f886005f3b0 0x7f8860061870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 --2- 172.21.15.148:0/2303123270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f887c0c8290 0x7f887c141380 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.137+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 >> 172.21.15.148:0/2303123270 conn(0x7f887c0945d0 msgr2=0x7f887c0c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.138+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 shutdown_connections 2023-10-24T00:30:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.138+0000 7f8883f6f700 1 -- 172.21.15.148:0/2303123270 wait complete. 2023-10-24T00:30:02.151 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-10-24T00:30:02.152 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-24T00:30:02.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.267+0000 7f2f4d0e5700 1 Processor -- start 2023-10-24T00:30:02.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.267+0000 7f2f4d0e5700 1 -- start start 2023-10-24T00:30:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4d0e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f480c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4d0e5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480c6270 con 0x7f2f481544b0 2023-10-24T00:30:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4d0e5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480c0c80 con 0x7f2f480a7d00 2023-10-24T00:30:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4d0e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480c60e0 con 0x7f2f480aa640 2023-10-24T00:30:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f46d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2f481544b0 0x7f2f480c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57514/0 (socket says 172.21.15.148:57514) 2023-10-24T00:30:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f46d9d700 1 -- 172.21.15.148:0/891927844 learned_addr learned my addr 172.21.15.148:0/891927844 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013688474 0 0) 0x7f2f480c6270 con 0x7f2f481544b0 2023-10-24T00:30:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f340033f0 con 0x7f2f481544b0 2023-10-24T00:30:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.268+0000 7f2f4759e700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f480c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134934019 0 0) 0x7f2f340033f0 con 0x7f2f481544b0 2023-10-24T00:30:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 msgr2=0x7f2f480c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f480c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 >> v1:172.21.15.150:6789/0 conn(0x7f2f480a7d00 legacy=0x7f2f480a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480c0f40 con 0x7f2f481544b0 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f2f38001470 con 0x7f2f481544b0 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 >> v1:172.21.15.148:6789/0 conn(0x7f2f481544b0 legacy=0x7f2f480c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f34003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f34004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f34004b80 0x7f2f34005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480c60e0 con 0x7f2f34003910 2023-10-24T00:30:02.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3400b910 con 0x7f2f34004b80 2023-10-24T00:30:02.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3400bad0 con 0x7f2f480aa640 2023-10-24T00:30:02.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f34003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4759e700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f34004b80 0x7f2f34005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f3ffff700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f34004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 -- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 msgr2=0x7f2f34004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480aa640 0x7f2f34004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 -- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f34004b80 msgr2=0x7f2f34005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f34004b80 0x7f2f34005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 -- 172.21.15.148:0/891927844 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340033f0 con 0x7f2f34003910 2023-10-24T00:30:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f34003d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2f3800c190 tx=0x7f2f38001e50).ready entity=mon.0 client_cookie=7080cc776dddfcb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38007a20 con 0x7f2f34003910 2023-10-24T00:30:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800cac0 con 0x7f2f34003910 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.269+0000 7f2f4659c700 1 -- 172.21.15.148:0/891927844 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800ce60 con 0x7f2f34003910 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/891927844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 msgr2=0x7f2f34003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/891927844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f34003d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2f3800c190 tx=0x7f2f38001e50).stop 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4759e700 1 -- 172.21.15.148:0/891927844 reap_dead start 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/891927844 shutdown_connections 2023-10-24T00:30:02.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/891927844 >> 172.21.15.148:0/891927844 conn(0x7f2f480945d0 msgr2=0x7f2f4806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/891927844 shutdown_connections 2023-10-24T00:30:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.270+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/891927844 wait complete. 2023-10-24T00:30:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.271+0000 7f2f4d0e5700 1 Processor -- start 2023-10-24T00:30:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.271+0000 7f2f4d0e5700 1 -- start start 2023-10-24T00:30:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 0x7f2f480b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480c9c80 0x7f2f480ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48155310 con 0x7f2f34003910 2023-10-24T00:30:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48157780 con 0x7f2f480b0420 2023-10-24T00:30:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480ca5f0 con 0x7f2f480c9c80 2023-10-24T00:30:02.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57626/0 (socket says 172.21.15.148:57626) 2023-10-24T00:30:02.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 -- 172.21.15.148:0/873401788 learned_addr learned my addr 172.21.15.148:0/873401788 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:02.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f3ffff700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 0x7f2f480b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4759e700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480c9c80 0x7f2f480ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 -- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480c9c80 msgr2=0x7f2f480ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480c9c80 0x7f2f480ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 -- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 msgr2=0x7f2f480b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 0x7f2f480b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 -- 172.21.15.148:0/873401788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480b0eb0 con 0x7f2f34003910 2023-10-24T00:30:02.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f3ffff700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 0x7f2f480b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:30:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f46d9d700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f2f38001900 tx=0x7f2f38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380075f0 con 0x7f2f34003910 2023-10-24T00:30:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f380046b0 con 0x7f2f34003910 2023-10-24T00:30:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f481549e0 con 0x7f2f34003910 2023-10-24T00:30:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38004a50 con 0x7f2f34003910 2023-10-24T00:30:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.272+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48154fa0 con 0x7f2f34003910 2023-10-24T00:30:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.274+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f481555f0 con 0x7f2f34003910 2023-10-24T00:30:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.274+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f2f38013450 con 0x7f2f34003910 2023-10-24T00:30:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.274+0000 7f2f3effd700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 0x7f2f280618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.274+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2f3807b570 con 0x7f2f34003910 2023-10-24T00:30:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.274+0000 7f2f3ffff700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 0x7f2f280618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.275+0000 7f2f3ffff700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 0x7f2f280618a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f30000c00 tx=0x7f2f30009040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.278+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2f3804c430 con 0x7f2f34003910 2023-10-24T00:30:02.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.467+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f48155450 con 0x7f2f2805f3e0 2023-10-24T00:30:02.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.472+0000 7f2f3effd700 1 -- 172.21.15.148:0/873401788 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2f30003740 con 0x7f2f2805f3e0 2023-10-24T00:30:02.475 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-10-24T00:30:02.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 msgr2=0x7f2f280618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 0x7f2f280618a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f30000c00 tx=0x7f2f30009040).stop 2023-10-24T00:30:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 msgr2=0x7f2f48157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f2f38001900 tx=0x7f2f38015000).stop 2023-10-24T00:30:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 shutdown_connections 2023-10-24T00:30:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f480c9c80 0x7f2f480ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2f2805f3e0 0x7f2f280618a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f34003910 0x7f2f48157290 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 --2- 172.21.15.148:0/873401788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f480b0420 0x7f2f480b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 >> 172.21.15.148:0/873401788 conn(0x7f2f480945d0 msgr2=0x7f2f480c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 shutdown_connections 2023-10-24T00:30:02.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.474+0000 7f2f4d0e5700 1 -- 172.21.15.148:0/873401788 wait complete. 2023-10-24T00:30:02.488 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-10-24T00:30:02.489 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-24T00:30:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 Processor -- start 2023-10-24T00:30:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 -- start start 2023-10-24T00:30:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f040a6a00 0x7f6f041549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f04067070 con 0x7f6f04150bd0 2023-10-24T00:30:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f04066460 con 0x7f6f04063d70 2023-10-24T00:30:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.608+0000 7f6f0b124700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f04066740 con 0x7f6f040a6a00 2023-10-24T00:30:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f096c1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6f040a6a00 0x7f6f041549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f08ec0700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6f04150bd0 0x7f6f04063660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57516/0 (socket says 172.21.15.148:57516) 2023-10-24T00:30:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f08ec0700 1 -- 172.21.15.148:0/3738797891 learned_addr learned my addr 172.21.15.148:0/3738797891 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f096c1700 1 -- 172.21.15.148:0/3738797891 >> v1:172.21.15.150:6789/0 conn(0x7f6f04063d70 legacy=0x7f6f040c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f096c1700 1 -- 172.21.15.148:0/3738797891 >> v1:172.21.15.148:6789/0 conn(0x7f6f04150bd0 legacy=0x7f6f04063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f096c1700 1 -- 172.21.15.148:0/3738797891 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04066a20 con 0x7f6f040a6a00 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f037fe700 1 -- 172.21.15.148:0/3738797891 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157939531 0 0) 0x7f6f04067070 con 0x7f6f04150bd0 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f096c1700 1 --2- 172.21.15.148:0/3738797891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f040a6a00 0x7f6f041549d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f6eec009760 tx=0x7f6eec009060).ready entity=mon.0 client_cookie=8cd05e3a54758865 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f037fe700 1 -- 172.21.15.148:0/3738797891 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00b520 con 0x7f6f040a6a00 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f037fe700 1 -- 172.21.15.148:0/3738797891 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00b680 con 0x7f6f040a6a00 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f037fe700 1 -- 172.21.15.148:0/3738797891 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00ba00 con 0x7f6f040a6a00 2023-10-24T00:30:02.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.609+0000 7f6f0b124700 1 -- 172.21.15.148:0/3738797891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f040a6a00 msgr2=0x7f6f041549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 --2- 172.21.15.148:0/3738797891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f040a6a00 0x7f6f041549d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f6eec009760 tx=0x7f6eec009060).stop 2023-10-24T00:30:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 -- 172.21.15.148:0/3738797891 shutdown_connections 2023-10-24T00:30:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 --2- 172.21.15.148:0/3738797891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f040a6a00 0x7f6f041549d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 -- 172.21.15.148:0/3738797891 >> 172.21.15.148:0/3738797891 conn(0x7f6f040c49e0 msgr2=0x7f6f04068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 -- 172.21.15.148:0/3738797891 shutdown_connections 2023-10-24T00:30:02.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.610+0000 7f6f0b124700 1 -- 172.21.15.148:0/3738797891 wait complete. 2023-10-24T00:30:02.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.611+0000 7f6f0b124700 1 Processor -- start 2023-10-24T00:30:02.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.611+0000 7f6f0b124700 1 -- start start 2023-10-24T00:30:02.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f040a6a00 0x7f6f040be590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f04150bd0 0x7f6f04154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040bede0 con 0x7f6f04063d70 2023-10-24T00:30:02.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040a89f0 con 0x7f6f040a6a00 2023-10-24T00:30:02.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040a80c0 con 0x7f6f04150bd0 2023-10-24T00:30:02.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57640/0 (socket says 172.21.15.148:57640) 2023-10-24T00:30:02.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 -- 172.21.15.148:0/1539930231 learned_addr learned my addr 172.21.15.148:0/1539930231 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:02.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f03fff700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f040a6a00 0x7f6f040be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f096c1700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f04150bd0 0x7f6f04154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 -- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f04150bd0 msgr2=0x7f6f04154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f04150bd0 0x7f6f04154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 -- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f040a6a00 msgr2=0x7f6f040be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f040a6a00 0x7f6f040be590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 -- 172.21.15.148:0/1539930231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0092a0 con 0x7f6f04063d70 2023-10-24T00:30:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f08ec0700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f6efc00c810 tx=0x7f6efc001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc005d30 con 0x7f6f04063d70 2023-10-24T00:30:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc005e90 con 0x7f6f04063d70 2023-10-24T00:30:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc007320 con 0x7f6f04063d70 2023-10-24T00:30:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f040a83a0 con 0x7f6f04063d70 2023-10-24T00:30:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.612+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f04162e60 con 0x7f6f04063d70 2023-10-24T00:30:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.614+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0406c6b0 con 0x7f6f04063d70 2023-10-24T00:30:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.614+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f6efc007750 con 0x7f6f04063d70 2023-10-24T00:30:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.614+0000 7f6f00ff9700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 0x7f6ee40618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.614+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f6efc07a5b0 con 0x7f6f04063d70 2023-10-24T00:30:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.614+0000 7f6f03fff700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 0x7f6ee40618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.615+0000 7f6f03fff700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 0x7f6ee40618a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6f04162dc0 tx=0x7f6ef4007d20).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.618+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6efc04b4d0 con 0x7f6f04063d70 2023-10-24T00:30:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.807+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f0406b990 con 0x7f6ee405f3e0 2023-10-24T00:30:02.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.812+0000 7f6f00ff9700 1 -- 172.21.15.148:0/1539930231 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6f0406b990 con 0x7f6ee405f3e0 2023-10-24T00:30:02.815 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-10-24T00:30:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 msgr2=0x7f6ee40618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 0x7f6ee40618a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6f04162dc0 tx=0x7f6ef4007d20).stop 2023-10-24T00:30:02.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 msgr2=0x7f6f041628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f6efc00c810 tx=0x7f6efc001570).stop 2023-10-24T00:30:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 shutdown_connections 2023-10-24T00:30:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f04150bd0 0x7f6f04154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6ee405f3e0 0x7f6ee40618a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f04063d70 0x7f6f041628d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 --2- 172.21.15.148:0/1539930231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f040a6a00 0x7f6f040be590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 >> 172.21.15.148:0/1539930231 conn(0x7f6f040c49e0 msgr2=0x7f6f040acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 shutdown_connections 2023-10-24T00:30:02.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.814+0000 7f6f0b124700 1 -- 172.21.15.148:0/1539930231 wait complete. 2023-10-24T00:30:02.828 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-10-24T00:30:02.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-24T00:30:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.945+0000 7f7d7d610700 1 Processor -- start 2023-10-24T00:30:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.945+0000 7f7d7d610700 1 -- start start 2023-10-24T00:30:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7d610700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d78069710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7d610700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7d780c20d0 0x7f7d7814e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7d610700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d781559f0 con 0x7f7d78069330 2023-10-24T00:30:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7d610700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d78155240 con 0x7f7d780c20d0 2023-10-24T00:30:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7d610700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78066560 con 0x7f7d78152170 2023-10-24T00:30:02.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d77fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7d78069330 0x7f7d78154b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57530/0 (socket says 172.21.15.148:57530) 2023-10-24T00:30:02.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d77fff700 1 -- 172.21.15.148:0/3294093067 learned_addr learned my addr 172.21.15.148:0/3294093067 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:02.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008112270 0 0) 0x7f7d781559f0 con 0x7f7d78069330 2023-10-24T00:30:02.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d600033f0 con 0x7f7d78069330 2023-10-24T00:30:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d7ce0f700 1 --2- 172.21.15.148:0/3294093067 >> v2:172.21.15.150:3300/0 conn(0x7f7d780c20d0 0x7f7d7814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d777fe700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d78069710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1956794656 0 0) 0x7f7d600033f0 con 0x7f7d78069330 2023-10-24T00:30:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 msgr2=0x7f7d78069710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d78069710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 >> v2:172.21.15.150:3300/0 conn(0x7f7d780c20d0 msgr2=0x7f7d7814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 --2- 172.21.15.148:0/3294093067 >> v2:172.21.15.150:3300/0 conn(0x7f7d780c20d0 0x7f7d7814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78066ae0 con 0x7f7d78069330 2023-10-24T00:30:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f7d68001470 con 0x7f7d78069330 2023-10-24T00:30:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 >> v1:172.21.15.148:6789/0 conn(0x7f7d78069330 legacy=0x7f7d78154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d60004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d60004b80 0x7f7d60005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78066560 con 0x7f7d600038e0 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000b8e0 con 0x7f7d60004b80 2023-10-24T00:30:02.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.946+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000ba20 con 0x7f7d78152170 2023-10-24T00:30:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d777fe700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d60004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d7ce0f700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d60004b80 0x7f7d60005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 -- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 msgr2=0x7f7d60004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d78152170 0x7f7d60004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 -- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d60004b80 msgr2=0x7f7d60005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:02.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d60004b80 0x7f7d60005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 -- 172.21.15.148:0/3294093067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600033f0 con 0x7f7d600038e0 2023-10-24T00:30:02.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d77fff700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d60003d00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7d6800c1c0 tx=0x7f7d68001e50).ready entity=mon.0 client_cookie=a7f3ff6be83ed2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68007a20 con 0x7f7d600038e0 2023-10-24T00:30:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800cab0 con 0x7f7d600038e0 2023-10-24T00:30:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.947+0000 7f7d76ffd700 1 -- 172.21.15.148:0/3294093067 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800ce30 con 0x7f7d600038e0 2023-10-24T00:30:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 -- 172.21.15.148:0/3294093067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 msgr2=0x7f7d60003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 --2- 172.21.15.148:0/3294093067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d60003d00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f7d6800c1c0 tx=0x7f7d68001e50).stop 2023-10-24T00:30:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7ce0f700 1 -- 172.21.15.148:0/3294093067 reap_dead start 2023-10-24T00:30:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 -- 172.21.15.148:0/3294093067 shutdown_connections 2023-10-24T00:30:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 -- 172.21.15.148:0/3294093067 >> 172.21.15.148:0/3294093067 conn(0x7f7d780c4570 msgr2=0x7f7d780c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 -- 172.21.15.148:0/3294093067 shutdown_connections 2023-10-24T00:30:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.948+0000 7f7d7d610700 1 -- 172.21.15.148:0/3294093067 wait complete. 2023-10-24T00:30:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.949+0000 7f7d7d610700 1 Processor -- start 2023-10-24T00:30:02.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.949+0000 7f7d7d610700 1 -- start start 2023-10-24T00:30:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 0x7f7d780c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d780c6380 0x7f7d78062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781634e0 con 0x7f7d600038e0 2023-10-24T00:30:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7814d6c0 con 0x7f7d780ad460 2023-10-24T00:30:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7d610700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c67e0 con 0x7f7d780c6380 2023-10-24T00:30:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57660/0 (socket says 172.21.15.148:57660) 2023-10-24T00:30:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 -- 172.21.15.148:0/2022334582 learned_addr learned my addr 172.21.15.148:0/2022334582 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d7ce0f700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d780c6380 0x7f7d78062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d777fe700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 0x7f7d780c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 -- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d780c6380 msgr2=0x7f7d78062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d780c6380 0x7f7d78062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 -- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 msgr2=0x7f7d780c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 0x7f7d780c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 -- 172.21.15.148:0/2022334582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d781628d0 con 0x7f7d600038e0 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d777fe700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 0x7f7d780c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.950+0000 7f7d77fff700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7d6800c7b0 tx=0x7f7d68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.951+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680076c0 con 0x7f7d600038e0 2023-10-24T00:30:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.951+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680046b0 con 0x7f7d600038e0 2023-10-24T00:30:02.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.951+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d78162bb0 con 0x7f7d600038e0 2023-10-24T00:30:02.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.951+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68004a50 con 0x7f7d600038e0 2023-10-24T00:30:02.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.951+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d78163170 con 0x7f7d600038e0 2023-10-24T00:30:02.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.952+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78047480 con 0x7f7d600038e0 2023-10-24T00:30:02.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.952+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f7d68020480 con 0x7f7d600038e0 2023-10-24T00:30:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.952+0000 7f7d5ffff700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 0x7f7d640618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.952+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7d6807b4f0 con 0x7f7d600038e0 2023-10-24T00:30:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.953+0000 7f7d777fe700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 0x7f7d640618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.953+0000 7f7d777fe700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 0x7f7d640618a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7d780ab1b0 tx=0x7f7d6c008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:02.956+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d6804c3b0 con 0x7f7d600038e0 2023-10-24T00:30:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.144+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d78155430 con 0x7f7d6405f3e0 2023-10-24T00:30:03.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.149+0000 7f7d5ffff700 1 -- 172.21.15.148:0/2022334582 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7d78155430 con 0x7f7d6405f3e0 2023-10-24T00:30:03.151 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-10-24T00:30:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 msgr2=0x7f7d640618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 0x7f7d640618a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7d780ab1b0 tx=0x7f7d6c008040).stop 2023-10-24T00:30:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 msgr2=0x7f7d7814d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f7d6800c7b0 tx=0x7f7d68015000).stop 2023-10-24T00:30:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 shutdown_connections 2023-10-24T00:30:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7d780c6380 0x7f7d78062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7d6405f3e0 0x7f7d640618a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d600038e0 0x7f7d7814d1d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 --2- 172.21.15.148:0/2022334582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d780ad460 0x7f7d780c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 >> 172.21.15.148:0/2022334582 conn(0x7f7d780c4570 msgr2=0x7f7d780c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 shutdown_connections 2023-10-24T00:30:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.151+0000 7f7d7d610700 1 -- 172.21.15.148:0/2022334582 wait complete. 2023-10-24T00:30:03.165 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-10-24T00:30:03.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-24T00:30:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.282+0000 7ff8b1aa6700 1 Processor -- start 2023-10-24T00:30:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.282+0000 7ff8b1aa6700 1 -- start start 2023-10-24T00:30:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8b1aa6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8b1aa6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8ac0aa640 0x7ff8ac0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8b1aa6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0c6270 con 0x7ff8ac0c8290 2023-10-24T00:30:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8b1aa6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c60e0 con 0x7ff8ac0aa640 2023-10-24T00:30:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8b1aa6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c0c80 con 0x7ff8ac1544b0 2023-10-24T00:30:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8abfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8ac0aa640 0x7ff8ac0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8ab7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8ab7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:49622/0 (socket says 172.21.15.148:49622) 2023-10-24T00:30:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8aaffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff8ac0c8290 0x7ff8ac0a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:33436/0 (socket says 172.21.15.148:33436) 2023-10-24T00:30:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8abfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8ac0aa640 0x7ff8ac0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:53532/0 (socket says 172.21.15.148:53532) 2023-10-24T00:30:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8ab7fe700 1 -- 172.21.15.148:0/1571506548 learned_addr learned my addr 172.21.15.148:0/1571506548 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8abfff700 1 -- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 msgr2=0x7ff8ac0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.283+0000 7ff8abfff700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8abfff700 1 -- 172.21.15.148:0/1571506548 >> v1:172.21.15.150:6789/0 conn(0x7ff8ac0c8290 legacy=0x7ff8ac0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8aa7fc700 1 -- 172.21.15.148:0/1571506548 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600073693 0 0) 0x7ff8ac0c6270 con 0x7ff8ac0c8290 2023-10-24T00:30:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8abfff700 1 -- 172.21.15.148:0/1571506548 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0c0f40 con 0x7ff8ac0aa640 2023-10-24T00:30:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8ab7fe700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:30:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8abfff700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c6700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff8a4009e60 tx=0x7ff8a4009780).ready entity=mon.1 client_cookie=f2e31ef86e84ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8aa7fc700 1 -- 172.21.15.148:0/1571506548 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400e070 con 0x7ff8ac0aa640 2023-10-24T00:30:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8aa7fc700 1 -- 172.21.15.148:0/1571506548 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400bb60 con 0x7ff8ac0aa640 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8aa7fc700 1 -- 172.21.15.148:0/1571506548 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4012410 con 0x7ff8ac0aa640 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 msgr2=0x7ff8ac0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c6700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff8a4009e60 tx=0x7ff8a4009780).stop 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/1571506548 shutdown_connections 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c6700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/1571506548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/1571506548 >> 172.21.15.148:0/1571506548 conn(0x7ff8ac0945d0 msgr2=0x7ff8ac06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/1571506548 shutdown_connections 2023-10-24T00:30:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.284+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/1571506548 wait complete. 2023-10-24T00:30:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 Processor -- start 2023-10-24T00:30:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 -- start start 2023-10-24T00:30:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac14d1e0 con 0x7ff8ac0c8290 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c4d50 con 0x7ff8ac0aa640 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.286+0000 7ff8b1aa6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c4140 con 0x7ff8ac1544b0 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57666/0 (socket says 172.21.15.148:57666) 2023-10-24T00:30:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 -- 172.21.15.148:0/2194586145 learned_addr learned my addr 172.21.15.148:0/2194586145 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8abfff700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8ab7fe700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 -- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 msgr2=0x7ff8ac14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 -- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 msgr2=0x7ff8ac0c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 -- 172.21.15.148:0/2194586145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c009370 con 0x7ff8ac0c8290 2023-10-24T00:30:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8ab7fe700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8aaffd700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff8a000c4e0 tx=0x7ff8a0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00072e0 con 0x7ff8ac0c8290 2023-10-24T00:30:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0007440 con 0x7ff8ac0c8290 2023-10-24T00:30:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00058f0 con 0x7ff8ac0c8290 2023-10-24T00:30:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a4009a20 con 0x7ff8ac0c8290 2023-10-24T00:30:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.287+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac0c4700 con 0x7ff8ac0c8290 2023-10-24T00:30:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.288+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac0c4ee0 con 0x7ff8ac0c8290 2023-10-24T00:30:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.289+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ff8a0005ce0 con 0x7ff8ac0c8290 2023-10-24T00:30:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.289+0000 7ff8937fe700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 0x7ff8980618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.289+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff8a0079f30 con 0x7ff8ac0c8290 2023-10-24T00:30:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.289+0000 7ff8ab7fe700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 0x7ff8980618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.289+0000 7ff8ab7fe700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 0x7ff8980618a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff89c006fd0 tx=0x7ff89c008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.293+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff8a004ae50 con 0x7ff8ac0c8290 2023-10-24T00:30:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.483+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8ac06c6b0 con 0x7ff89805f3e0 2023-10-24T00:30:03.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.488+0000 7ff8937fe700 1 -- 172.21.15.148:0/2194586145 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff8ac06c6b0 con 0x7ff89805f3e0 2023-10-24T00:30:03.491 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-10-24T00:30:03.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 msgr2=0x7ff8980618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 0x7ff8980618a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff89c006fd0 tx=0x7ff89c008040).stop 2023-10-24T00:30:03.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 msgr2=0x7ff8ac14c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff8a000c4e0 tx=0x7ff8a0007c60).stop 2023-10-24T00:30:03.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 shutdown_connections 2023-10-24T00:30:03.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8ac1544b0 0x7ff8ac14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8ac0aa640 0x7ff8ac0c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff89805f3e0 0x7ff8980618a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 --2- 172.21.15.148:0/2194586145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ac0c8290 0x7ff8ac14c800 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 >> 172.21.15.148:0/2194586145 conn(0x7ff8ac0945d0 msgr2=0x7ff8ac0a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 shutdown_connections 2023-10-24T00:30:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.490+0000 7ff8b1aa6700 1 -- 172.21.15.148:0/2194586145 wait complete. 2023-10-24T00:30:03.504 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-10-24T00:30:03.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-24T00:30:03.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.621+0000 7fdf96427700 1 Processor -- start 2023-10-24T00:30:03.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.621+0000 7fdf96427700 1 -- start start 2023-10-24T00:30:03.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf96427700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf90064c80 0x7fdf90065060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf96427700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90063380 0x7fdf90157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf96427700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf90062650 con 0x7fdf901581b0 2023-10-24T00:30:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf96427700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf90158a30 con 0x7fdf90064c80 2023-10-24T00:30:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf96427700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900628a0 con 0x7fdf90063380 2023-10-24T00:30:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf90064c80 0x7fdf90065060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95c26700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdf901581b0 0x7fdf90153a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55626/0 (socket says 172.21.15.148:55626) 2023-10-24T00:30:03.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf90064c80 0x7fdf90065060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47106/0 (socket says 172.21.15.148:47106) 2023-10-24T00:30:03.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95c26700 1 -- 172.21.15.148:0/1969423228 learned_addr learned my addr 172.21.15.148:0/1969423228 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:03.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf94c24700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90063380 0x7fdf90157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 -- 172.21.15.148:0/1969423228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90063380 msgr2=0x7fdf90157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:03.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90063380 0x7fdf90157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 -- 172.21.15.148:0/1969423228 >> v1:172.21.15.148:6789/0 conn(0x7fdf901581b0 legacy=0x7fdf90153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf87fff700 1 -- 172.21.15.148:0/1969423228 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343573386 0 0) 0x7fdf90062650 con 0x7fdf901581b0 2023-10-24T00:30:03.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.622+0000 7fdf95425700 1 -- 172.21.15.148:0/1969423228 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90062b80 con 0x7fdf90064c80 2023-10-24T00:30:03.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf95425700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf90064c80 0x7fdf90065060 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fdf8c009760 tx=0x7fdf8c009060).ready entity=mon.0 client_cookie=63d7b69c3ece4bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf87fff700 1 -- 172.21.15.148:0/1969423228 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00b580 con 0x7fdf90064c80 2023-10-24T00:30:03.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf87fff700 1 -- 172.21.15.148:0/1969423228 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00b6e0 con 0x7fdf90064c80 2023-10-24T00:30:03.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf87fff700 1 -- 172.21.15.148:0/1969423228 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00ba60 con 0x7fdf90064c80 2023-10-24T00:30:03.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 -- 172.21.15.148:0/1969423228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf90064c80 msgr2=0x7fdf90065060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf90064c80 0x7fdf90065060 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fdf8c009760 tx=0x7fdf8c009060).stop 2023-10-24T00:30:03.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 -- 172.21.15.148:0/1969423228 shutdown_connections 2023-10-24T00:30:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf90064c80 0x7fdf90065060 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 --2- 172.21.15.148:0/1969423228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90063380 0x7fdf90157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 -- 172.21.15.148:0/1969423228 >> 172.21.15.148:0/1969423228 conn(0x7fdf900c7250 msgr2=0x7fdf900c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 -- 172.21.15.148:0/1969423228 shutdown_connections 2023-10-24T00:30:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.623+0000 7fdf96427700 1 -- 172.21.15.148:0/1969423228 wait complete. 2023-10-24T00:30:03.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.624+0000 7fdf96427700 1 Processor -- start 2023-10-24T00:30:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.624+0000 7fdf96427700 1 -- start start 2023-10-24T00:30:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 0x7fdf900a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 0x7fdf90168880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90168d70 con 0x7fdf901581b0 2023-10-24T00:30:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900a5220 con 0x7fdf90063380 2023-10-24T00:30:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf96427700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900a5500 con 0x7fdf90064c80 2023-10-24T00:30:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.625+0000 7fdf95c26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47108/0 (socket says 172.21.15.148:47108) 2023-10-24T00:30:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 -- 172.21.15.148:0/472686362 learned_addr learned my addr 172.21.15.148:0/472686362 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf94c24700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 0x7fdf90168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95425700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 0x7fdf900a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 -- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 msgr2=0x7fdf90168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 0x7fdf90168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 -- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 msgr2=0x7fdf900a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 0x7fdf900a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 -- 172.21.15.148:0/472686362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0092a0 con 0x7fdf901581b0 2023-10-24T00:30:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95425700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 0x7fdf900a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf94c24700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 0x7fdf90168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf95c26700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fdf8800c730 tx=0x7fdf88001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88005d30 con 0x7fdf901581b0 2023-10-24T00:30:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88005e90 con 0x7fdf901581b0 2023-10-24T00:30:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900a57e0 con 0x7fdf901581b0 2023-10-24T00:30:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88007340 con 0x7fdf901581b0 2023-10-24T00:30:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.626+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf900a5da0 con 0x7fdf901581b0 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.627+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf900a5fc0 con 0x7fdf901581b0 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.627+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7fdf880076f0 con 0x7fdf901581b0 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.628+0000 7fdf857fa700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 0x7fdf740618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.628+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fdf8807a670 con 0x7fdf901581b0 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.628+0000 7fdf95425700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 0x7fdf740618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.629+0000 7fdf95425700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 0x7fdf740618a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdf8c00b340 tx=0x7fdf8c017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.632+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf8804b590 con 0x7fdf901581b0 2023-10-24T00:30:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.822+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf90047480 con 0x7fdf7405f3e0 2023-10-24T00:30:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.827+0000 7fdf857fa700 1 -- 172.21.15.148:0/472686362 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fdf90047480 con 0x7fdf7405f3e0 2023-10-24T00:30:03.829 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-10-24T00:30:03.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.828+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 msgr2=0x7fdf740618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.828+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 0x7fdf740618a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdf8c00b340 tx=0x7fdf8c017000).stop 2023-10-24T00:30:03.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.828+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 msgr2=0x7fdf90156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.828+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fdf8800c730 tx=0x7fdf88001520).stop 2023-10-24T00:30:03.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 shutdown_connections 2023-10-24T00:30:03.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf7405f3e0 0x7fdf740618a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf901581b0 0x7fdf90156ed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf90063380 0x7fdf900a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 --2- 172.21.15.148:0/472686362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf90064c80 0x7fdf90168880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 >> 172.21.15.148:0/472686362 conn(0x7fdf900c7250 msgr2=0x7fdf90151030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 shutdown_connections 2023-10-24T00:30:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.829+0000 7fdf96427700 1 -- 172.21.15.148:0/472686362 wait complete. 2023-10-24T00:30:03.843 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-10-24T00:30:03.843 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-24T00:30:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.959+0000 7efc04446700 1 Processor -- start 2023-10-24T00:30:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.959+0000 7efc04446700 1 -- start start 2023-10-24T00:30:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc04446700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efbfc0a7d00 0x7efbfc0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc04446700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc04446700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0c6270 con 0x7efbfc1544b0 2023-10-24T00:30:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc04446700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0c60e0 con 0x7efbfc0a7d00 2023-10-24T00:30:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc04446700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0aa870 con 0x7efbfc0aa420 2023-10-24T00:30:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc021e2700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efbfc1544b0 0x7efbfc0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55640/0 (socket says 172.21.15.148:55640) 2023-10-24T00:30:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc019e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efbfc0a7d00 0x7efbfc0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc021e2700 1 -- 172.21.15.148:0/914153014 learned_addr learned my addr 172.21.15.148:0/914153014 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.960+0000 7efc029e3700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc019e1700 1 -- 172.21.15.148:0/914153014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 msgr2=0x7efbfc0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc019e1700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc019e1700 1 -- 172.21.15.148:0/914153014 >> v1:172.21.15.148:6789/0 conn(0x7efbfc1544b0 legacy=0x7efbfc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc011e0700 1 -- 172.21.15.148:0/914153014 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455807892 0 0) 0x7efbfc0c6270 con 0x7efbfc1544b0 2023-10-24T00:30:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc019e1700 1 -- 172.21.15.148:0/914153014 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0c0c80 con 0x7efbfc0a7d00 2023-10-24T00:30:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc019e1700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc0a7d00 0x7efbfc0a9f30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7efbec009760 tx=0x7efbec009060).ready entity=mon.0 client_cookie=be88f737aa1beed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc011e0700 1 -- 172.21.15.148:0/914153014 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec00b580 con 0x7efbfc0a7d00 2023-10-24T00:30:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc011e0700 1 -- 172.21.15.148:0/914153014 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec00b6e0 con 0x7efbfc0a7d00 2023-10-24T00:30:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc011e0700 1 -- 172.21.15.148:0/914153014 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec00ba60 con 0x7efbfc0a7d00 2023-10-24T00:30:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 -- 172.21.15.148:0/914153014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc0a7d00 msgr2=0x7efbfc0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc0a7d00 0x7efbfc0a9f30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7efbec009760 tx=0x7efbec009060).stop 2023-10-24T00:30:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 -- 172.21.15.148:0/914153014 shutdown_connections 2023-10-24T00:30:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 --2- 172.21.15.148:0/914153014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc0a7d00 0x7efbfc0a9f30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 -- 172.21.15.148:0/914153014 >> 172.21.15.148:0/914153014 conn(0x7efbfc0945d0 msgr2=0x7efbfc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 -- 172.21.15.148:0/914153014 shutdown_connections 2023-10-24T00:30:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.961+0000 7efc04446700 1 -- 172.21.15.148:0/914153014 wait complete. 2023-10-24T00:30:03.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 Processor -- start 2023-10-24T00:30:03.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 -- start start 2023-10-24T00:30:03.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbfc0a7d00 0x7efbfc158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc15a0f0 con 0x7efbfc1544b0 2023-10-24T00:30:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0c27f0 con 0x7efbfc0a7d00 2023-10-24T00:30:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc04446700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc158e80 con 0x7efbfc0aa420 2023-10-24T00:30:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc029e3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc029e3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47120/0 (socket says 172.21.15.148:47120) 2023-10-24T00:30:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.963+0000 7efc029e3700 1 -- 172.21.15.148:0/740776405 learned_addr learned my addr 172.21.15.148:0/740776405 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc019e1700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc021e2700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbfc0a7d00 0x7efbfc158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 -- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 msgr2=0x7efbfc147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 -- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbfc0a7d00 msgr2=0x7efbfc158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbfc0a7d00 0x7efbfc158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 -- 172.21.15.148:0/740776405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec0092a0 con 0x7efbfc1544b0 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc019e1700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc029e3700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7efbf400d890 tx=0x7efbf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf40125f0 con 0x7efbfc1544b0 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4012750 con 0x7efbfc1544b0 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc159e10 con 0x7efbfc1544b0 2023-10-24T00:30:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4012ad0 con 0x7efbfc1544b0 2023-10-24T00:30:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.964+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc0c2480 con 0x7efbfc1544b0 2023-10-24T00:30:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.965+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc06c6b0 con 0x7efbfc1544b0 2023-10-24T00:30:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.965+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7efbf4013480 con 0x7efbfc1544b0 2023-10-24T00:30:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.966+0000 7efbf27fc700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 0x7efbe0061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.966+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7efbf407a870 con 0x7efbfc1544b0 2023-10-24T00:30:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.966+0000 7efc021e2700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 0x7efbe0061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.966+0000 7efc021e2700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 0x7efbe0061870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efbf8007fd0 tx=0x7efbf8009040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:03.970+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efbf404b730 con 0x7efbfc1544b0 2023-10-24T00:30:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.157+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efbfc0c0f40 con 0x7efbe005f3b0 2023-10-24T00:30:04.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.162+0000 7efbf27fc700 1 -- 172.21.15.148:0/740776405 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7efbfc0c0f40 con 0x7efbe005f3b0 2023-10-24T00:30:04.164 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-10-24T00:30:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 msgr2=0x7efbe0061870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 0x7efbe0061870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7efbf8007fd0 tx=0x7efbf8009040).stop 2023-10-24T00:30:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 msgr2=0x7efbfc0c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7efbf400d890 tx=0x7efbf4008040).stop 2023-10-24T00:30:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 shutdown_connections 2023-10-24T00:30:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efbe005f3b0 0x7efbe0061870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efbfc1544b0 0x7efbfc0c2c80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efbfc0a7d00 0x7efbfc158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 --2- 172.21.15.148:0/740776405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efbfc0aa420 0x7efbfc147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 >> 172.21.15.148:0/740776405 conn(0x7efbfc0945d0 msgr2=0x7efbfc0c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 shutdown_connections 2023-10-24T00:30:04.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.164+0000 7efc04446700 1 -- 172.21.15.148:0/740776405 wait complete. 2023-10-24T00:30:04.178 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-10-24T00:30:04.179 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-24T00:30:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.294+0000 7ffa39c54700 1 Processor -- start 2023-10-24T00:30:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.294+0000 7ffa39c54700 1 -- start start 2023-10-24T00:30:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa39c54700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffa341544b0 0x7ffa340a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa39c54700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 0x7ffa340a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa39c54700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340c6270 con 0x7ffa340aa420 2023-10-24T00:30:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa39c54700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340c60e0 con 0x7ffa341544b0 2023-10-24T00:30:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa39c54700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340c0c80 con 0x7ffa340c8290 2023-10-24T00:30:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffa341544b0 0x7ffa340a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa33fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ffa340aa420 0x7ffa340c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55656/0 (socket says 172.21.15.148:55656) 2023-10-24T00:30:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa33fff700 1 -- 172.21.15.148:0/3431836313 learned_addr learned my addr 172.21.15.148:0/3431836313 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.295+0000 7ffa337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ffa341544b0 0x7ffa340a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47136/0 (socket says 172.21.15.148:47136) 2023-10-24T00:30:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa32ffd700 1 --2- 172.21.15.148:0/3431836313 >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 0x7ffa340a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa337fe700 1 -- 172.21.15.148:0/3431836313 >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 msgr2=0x7ffa340a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa337fe700 1 --2- 172.21.15.148:0/3431836313 >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 0x7ffa340a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa337fe700 1 -- 172.21.15.148:0/3431836313 >> v1:172.21.15.148:6789/0 conn(0x7ffa340aa420 legacy=0x7ffa340c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa327fc700 1 -- 172.21.15.148:0/3431836313 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356799308 0 0) 0x7ffa340c6270 con 0x7ffa340aa420 2023-10-24T00:30:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa337fe700 1 -- 172.21.15.148:0/3431836313 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340c0f40 con 0x7ffa341544b0 2023-10-24T00:30:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa32ffd700 1 --2- 172.21.15.148:0/3431836313 >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 0x7ffa340a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa337fe700 1 --2- 172.21.15.148:0/3431836313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340a7d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa340a9cf0 tx=0x7ffa24009780).ready entity=mon.0 client_cookie=b5e5931f8ea86d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa327fc700 1 -- 172.21.15.148:0/3431836313 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400e070 con 0x7ffa341544b0 2023-10-24T00:30:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa327fc700 1 -- 172.21.15.148:0/3431836313 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400bc30 con 0x7ffa341544b0 2023-10-24T00:30:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa327fc700 1 -- 172.21.15.148:0/3431836313 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24012410 con 0x7ffa341544b0 2023-10-24T00:30:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 -- 172.21.15.148:0/3431836313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 msgr2=0x7ffa340a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 --2- 172.21.15.148:0/3431836313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340a7d00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa340a9cf0 tx=0x7ffa24009780).stop 2023-10-24T00:30:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 -- 172.21.15.148:0/3431836313 shutdown_connections 2023-10-24T00:30:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 --2- 172.21.15.148:0/3431836313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340a7d00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 --2- 172.21.15.148:0/3431836313 >> v2:172.21.15.150:3300/0 conn(0x7ffa340c8290 0x7ffa340a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.296+0000 7ffa39c54700 1 -- 172.21.15.148:0/3431836313 >> 172.21.15.148:0/3431836313 conn(0x7ffa340945d0 msgr2=0x7ffa3406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.297+0000 7ffa39c54700 1 -- 172.21.15.148:0/3431836313 shutdown_connections 2023-10-24T00:30:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.297+0000 7ffa39c54700 1 -- 172.21.15.148:0/3431836313 wait complete. 2023-10-24T00:30:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.298+0000 7ffa39c54700 1 Processor -- start 2023-10-24T00:30:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.298+0000 7ffa39c54700 1 -- start start 2023-10-24T00:30:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 0x7ffa3414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa340c8290 0x7ffa340aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340af510 con 0x7ffa341544b0 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341569d0 con 0x7ffa340c8290 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34155320 con 0x7ffa340aa420 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47146/0 (socket says 172.21.15.148:47146) 2023-10-24T00:30:04.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 -- 172.21.15.148:0/4209362855 learned_addr learned my addr 172.21.15.148:0/4209362855 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa337fe700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 0x7ffa3414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa32ffd700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa340c8290 0x7ffa340aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 -- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 msgr2=0x7ffa3414eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 0x7ffa3414eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 -- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa340c8290 msgr2=0x7ffa340aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa340c8290 0x7ffa340aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 -- 172.21.15.148:0/4209362855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009a20 con 0x7ffa341544b0 2023-10-24T00:30:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa337fe700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 0x7ffa3414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa33fff700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ffa2c001eb0 tx=0x7ffa2c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00ce70 con 0x7ffa341544b0 2023-10-24T00:30:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c0072e0 con 0x7ffa341544b0 2023-10-24T00:30:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0057a0 con 0x7ffa341544b0 2023-10-24T00:30:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34154a30 con 0x7ffa341544b0 2023-10-24T00:30:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.299+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa34155030 con 0x7ffa341544b0 2023-10-24T00:30:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.301+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34155490 con 0x7ffa341544b0 2023-10-24T00:30:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.301+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ffa2c005b10 con 0x7ffa341544b0 2023-10-24T00:30:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.301+0000 7ffa1b7fe700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 0x7ffa200618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.301+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ffa2c079d30 con 0x7ffa341544b0 2023-10-24T00:30:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.301+0000 7ffa337fe700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 0x7ffa200618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.302+0000 7ffa337fe700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 0x7ffa200618d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ffa24009fd0 tx=0x7ffa24009780).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.305+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffa2c04ac50 con 0x7ffa341544b0 2023-10-24T00:30:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.494+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa3406c6b0 con 0x7ffa2005f410 2023-10-24T00:30:04.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.499+0000 7ffa1b7fe700 1 -- 172.21.15.148:0/4209362855 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ffa3406c6b0 con 0x7ffa2005f410 2023-10-24T00:30:04.501 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-10-24T00:30:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 msgr2=0x7ffa200618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 0x7ffa200618d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ffa24009fd0 tx=0x7ffa24009780).stop 2023-10-24T00:30:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 msgr2=0x7ffa340ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7ffa2c001eb0 tx=0x7ffa2c007bb0).stop 2023-10-24T00:30:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 shutdown_connections 2023-10-24T00:30:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ffa2005f410 0x7ffa200618d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa341544b0 0x7ffa340ae930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa340aa420 0x7ffa3414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 --2- 172.21.15.148:0/4209362855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa340c8290 0x7ffa340aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.500+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 >> 172.21.15.148:0/4209362855 conn(0x7ffa340945d0 msgr2=0x7ffa3414fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.501+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 shutdown_connections 2023-10-24T00:30:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.501+0000 7ffa39c54700 1 -- 172.21.15.148:0/4209362855 wait complete. 2023-10-24T00:30:04.515 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-10-24T00:30:04.515 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-24T00:30:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.631+0000 7ff7c3eae700 1 Processor -- start 2023-10-24T00:30:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.631+0000 7ff7c3eae700 1 -- start start 2023-10-24T00:30:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c3eae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7bc0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c3eae700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff7bc0aa420 0x7ff7bc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c3eae700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0c6270 con 0x7ff7bc1544b0 2023-10-24T00:30:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c3eae700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c60e0 con 0x7ff7bc0aa420 2023-10-24T00:30:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c3eae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0aa890 con 0x7ff7bc0a7d00 2023-10-24T00:30:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c1c4a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff7bc1544b0 0x7ff7bc0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:55662/0 (socket says 172.21.15.148:55662) 2023-10-24T00:30:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c1c4a700 1 -- 172.21.15.148:0/1682193353 learned_addr learned my addr 172.21.15.148:0/1682193353 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:30:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c244b700 1 --2- 172.21.15.148:0/1682193353 >> v2:172.21.15.150:3300/0 conn(0x7ff7bc0aa420 0x7ff7bc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c1449700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7bc0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640818809 0 0) 0x7ff7bc0c6270 con 0x7ff7bc1544b0 2023-10-24T00:30:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a80033f0 con 0x7ff7bc1544b0 2023-10-24T00:30:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4027234871 0 0) 0x7ff7a80033f0 con 0x7ff7bc1544b0 2023-10-24T00:30:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 msgr2=0x7ff7bc0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7bc0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 >> v2:172.21.15.150:3300/0 conn(0x7ff7bc0aa420 msgr2=0x7ff7bc0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 --2- 172.21.15.148:0/1682193353 >> v2:172.21.15.150:3300/0 conn(0x7ff7bc0aa420 0x7ff7bc0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0c0c80 con 0x7ff7bc1544b0 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.632+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7ff7b8001470 con 0x7ff7bc1544b0 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 >> v1:172.21.15.148:6789/0 conn(0x7ff7bc1544b0 legacy=0x7ff7bc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7a80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7a8003e10 0x7ff7a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c60e0 con 0x7ff7a8004b80 2023-10-24T00:30:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0aa890 con 0x7ff7a8003e10 2023-10-24T00:30:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800b8e0 con 0x7ff7bc0a7d00 2023-10-24T00:30:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c1449700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7a8003e10 0x7ff7a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c1c4a700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7a80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 -- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 msgr2=0x7ff7a80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7a80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 -- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7a8003e10 msgr2=0x7ff7a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7a8003e10 0x7ff7a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 -- 172.21.15.148:0/1682193353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80033f0 con 0x7ff7a8004b80 2023-10-24T00:30:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c1c4a700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc0a7d00 0x7ff7a80038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:30:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c244b700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7a8005000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7ff7b400e240 tx=0x7ff7b400b040).ready entity=mon.0 client_cookie=bd77f975a9584da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4009ac0 con 0x7ff7a8004b80 2023-10-24T00:30:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400f040 con 0x7ff7a8004b80 2023-10-24T00:30:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.633+0000 7ff7c0c48700 1 -- 172.21.15.148:0/1682193353 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400ed00 con 0x7ff7a8004b80 2023-10-24T00:30:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 -- 172.21.15.148:0/1682193353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 msgr2=0x7ff7a8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/1682193353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7a8005000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7ff7b400e240 tx=0x7ff7b400b040).stop 2023-10-24T00:30:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c244b700 1 -- 172.21.15.148:0/1682193353 reap_dead start 2023-10-24T00:30:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 -- 172.21.15.148:0/1682193353 shutdown_connections 2023-10-24T00:30:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 -- 172.21.15.148:0/1682193353 >> 172.21.15.148:0/1682193353 conn(0x7ff7bc0945d0 msgr2=0x7ff7bc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 -- 172.21.15.148:0/1682193353 shutdown_connections 2023-10-24T00:30:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.634+0000 7ff7c3eae700 1 -- 172.21.15.148:0/1682193353 wait complete. 2023-10-24T00:30:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.635+0000 7ff7c3eae700 1 Processor -- start 2023-10-24T00:30:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.635+0000 7ff7c3eae700 1 -- start start 2023-10-24T00:30:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc1495c0 0x7ff7bc14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7bc14e840 0x7ff7bc0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc149a40 con 0x7ff7a8004b80 2023-10-24T00:30:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1653e0 con 0x7ff7bc14e840 2023-10-24T00:30:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc14ecc0 con 0x7ff7bc1495c0 2023-10-24T00:30:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47152/0 (socket says 172.21.15.148:47152) 2023-10-24T00:30:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 -- 172.21.15.148:0/378493406 learned_addr learned my addr 172.21.15.148:0/378493406 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c244b700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7bc14e840 0x7ff7bc0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1449700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc1495c0 0x7ff7bc14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 -- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc1495c0 msgr2=0x7ff7bc14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc1495c0 0x7ff7bc14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 -- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7bc14e840 msgr2=0x7ff7bc0ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7bc14e840 0x7ff7bc0ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 -- 172.21.15.148:0/378493406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc164ab0 con 0x7ff7a8004b80 2023-10-24T00:30:04.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c1c4a700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7ff7b8005fd0 tx=0x7ff7b80014f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8010490 con 0x7ff7a8004b80 2023-10-24T00:30:04.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8010040 con 0x7ff7a8004b80 2023-10-24T00:30:04.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc164d90 con 0x7ff7a8004b80 2023-10-24T00:30:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.636+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8010840 con 0x7ff7a8004b80 2023-10-24T00:30:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.637+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc164720 con 0x7ff7a8004b80 2023-10-24T00:30:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.638+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc06c6b0 con 0x7ff7a8004b80 2023-10-24T00:30:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.638+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ff7b8010bb0 con 0x7ff7a8004b80 2023-10-24T00:30:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.638+0000 7ff7b1ffb700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 0x7ff7a00618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.638+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff7b8079ad0 con 0x7ff7a8004b80 2023-10-24T00:30:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.638+0000 7ff7c1449700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 0x7ff7a00618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.639+0000 7ff7c1449700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 0x7ff7a00618a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff7bc0cc060 tx=0x7ff7ac008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.642+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff7b804a8e0 con 0x7ff7a8004b80 2023-10-24T00:30:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.832+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7bc0c0f40 con 0x7ff7a005f3e0 2023-10-24T00:30:04.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.837+0000 7ff7b1ffb700 1 -- 172.21.15.148:0/378493406 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff7bc0c0f40 con 0x7ff7a005f3e0 2023-10-24T00:30:04.839 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-10-24T00:30:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 msgr2=0x7ff7a00618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 0x7ff7a00618a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff7bc0cc060 tx=0x7ff7ac008040).stop 2023-10-24T00:30:04.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 msgr2=0x7ff7bc155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7ff7b8005fd0 tx=0x7ff7b80014f0).stop 2023-10-24T00:30:04.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 shutdown_connections 2023-10-24T00:30:04.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7bc14e840 0x7ff7bc0ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff7a005f3e0 0x7ff7a00618a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7a8004b80 0x7ff7bc155710 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 --2- 172.21.15.148:0/378493406 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7bc1495c0 0x7ff7bc14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 >> 172.21.15.148:0/378493406 conn(0x7ff7bc0945d0 msgr2=0x7ff7bc14fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 shutdown_connections 2023-10-24T00:30:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.839+0000 7ff7c3eae700 1 -- 172.21.15.148:0/378493406 wait complete. 2023-10-24T00:30:04.853 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-10-24T00:30:04.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-24T00:30:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.972+0000 7f9b5d961700 1 Processor -- start 2023-10-24T00:30:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.972+0000 7f9b5d961700 1 -- start start 2023-10-24T00:30:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b581544b0 0x7f9b580a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580c8290 0x7f9b580a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b580aa420 0x7f9b580c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b580c60e0 con 0x7f9b581544b0 2023-10-24T00:30:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b580c6270 con 0x7f9b580aa420 2023-10-24T00:30:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b5d961700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580aa890 con 0x7f9b580c8290 2023-10-24T00:30:04.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b581544b0 0x7f9b580a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9b581544b0 0x7f9b580a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47162/0 (socket says 172.21.15.148:47162) 2023-10-24T00:30:04.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 -- 172.21.15.148:0/106247176 learned_addr learned my addr 172.21.15.148:0/106247176 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:04.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b577fe700 1 --2- 172.21.15.148:0/106247176 >> v2:172.21.15.150:3300/0 conn(0x7f9b580aa420 0x7f9b580c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b567fc700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580c8290 0x7f9b580a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 -- 172.21.15.148:0/106247176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580c8290 msgr2=0x7f9b580a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580c8290 0x7f9b580a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 -- 172.21.15.148:0/106247176 >> v2:172.21.15.150:3300/0 conn(0x7f9b580aa420 msgr2=0x7f9b580c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:30:04.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 --2- 172.21.15.148:0/106247176 >> v2:172.21.15.150:3300/0 conn(0x7f9b580aa420 0x7f9b580c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 -- 172.21.15.148:0/106247176 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580c0c80 con 0x7f9b581544b0 2023-10-24T00:30:04.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b56ffd700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b581544b0 0x7f9b580a7d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f9b58084520 tx=0x7f9b50009840).ready entity=mon.0 client_cookie=f7367c3057518de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b55ffb700 1 -- 172.21.15.148:0/106247176 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000e070 con 0x7f9b581544b0 2023-10-24T00:30:04.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b55ffb700 1 -- 172.21.15.148:0/106247176 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000ba50 con 0x7f9b581544b0 2023-10-24T00:30:04.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.973+0000 7f9b55ffb700 1 -- 172.21.15.148:0/106247176 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000bdd0 con 0x7f9b581544b0 2023-10-24T00:30:04.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 -- 172.21.15.148:0/106247176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b581544b0 msgr2=0x7f9b580a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b581544b0 0x7f9b580a7d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f9b58084520 tx=0x7f9b50009840).stop 2023-10-24T00:30:04.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 -- 172.21.15.148:0/106247176 shutdown_connections 2023-10-24T00:30:04.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b581544b0 0x7f9b580a7d00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 --2- 172.21.15.148:0/106247176 >> v2:172.21.15.150:3300/0 conn(0x7f9b580aa420 0x7f9b580c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 --2- 172.21.15.148:0/106247176 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580c8290 0x7f9b580a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:04.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 -- 172.21.15.148:0/106247176 >> 172.21.15.148:0/106247176 conn(0x7f9b580945d0 msgr2=0x7f9b5806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:04.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 -- 172.21.15.148:0/106247176 shutdown_connections 2023-10-24T00:30:04.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.974+0000 7f9b5d961700 1 -- 172.21.15.148:0/106247176 wait complete. 2023-10-24T00:30:04.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.975+0000 7f9b5d961700 1 Processor -- start 2023-10-24T00:30:04.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.975+0000 7f9b5d961700 1 -- start start 2023-10-24T00:30:04.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580aa420 0x7f9b5814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b581544b0 0x7f9b58151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b58152170 con 0x7f9b580c8290 2023-10-24T00:30:04.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580c9310 con 0x7f9b581544b0 2023-10-24T00:30:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b5d961700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581510b0 con 0x7f9b580aa420 2023-10-24T00:30:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47178/0 (socket says 172.21.15.148:47178) 2023-10-24T00:30:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 -- 172.21.15.148:0/161743941 learned_addr learned my addr 172.21.15.148:0/161743941 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:30:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 -- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580aa420 msgr2=0x7f9b5814ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580aa420 0x7f9b5814ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:30:04.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 -- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b581544b0 msgr2=0x7f9b58151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:04.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b581544b0 0x7f9b58151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:30:04.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 -- 172.21.15.148:0/161743941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50009ae0 con 0x7f9b580c8290 2023-10-24T00:30:04.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.976+0000 7f9b567fc700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9b4000d890 tx=0x7f9b40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.977+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400125f0 con 0x7f9b580c8290 2023-10-24T00:30:04.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.977+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40012750 con 0x7f9b580c8290 2023-10-24T00:30:04.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.977+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b58151390 con 0x7f9b580c8290 2023-10-24T00:30:04.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.977+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40012ad0 con 0x7f9b580c8290 2023-10-24T00:30:04.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.977+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b580ae310 con 0x7f9b580c8290 2023-10-24T00:30:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.978+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b580ae530 con 0x7f9b580c8290 2023-10-24T00:30:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.978+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f9b40013480 con 0x7f9b580c8290 2023-10-24T00:30:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.978+0000 7f9b4effd700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 0x7f9b380618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:30:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.978+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9b4007a4b0 con 0x7f9b580c8290 2023-10-24T00:30:04.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.979+0000 7f9b56ffd700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 0x7f9b380618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:30:04.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.979+0000 7f9b56ffd700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 0x7f9b380618a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9b58084520 tx=0x7f9b50009840).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:30:04.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:04.982+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b580ae530 con 0x7f9b580c8290 2023-10-24T00:30:05.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.172+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b580c9480 con 0x7f9b3805f3e0 2023-10-24T00:30:05.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.176+0000 7f9b4effd700 1 -- 172.21.15.148:0/161743941 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9b580c9480 con 0x7f9b3805f3e0 2023-10-24T00:30:05.179 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-10-24T00:30:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 msgr2=0x7f9b380618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 0x7f9b380618a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9b58084520 tx=0x7f9b50009840).stop 2023-10-24T00:30:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 msgr2=0x7f9b58151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:30:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9b4000d890 tx=0x7f9b40008040).stop 2023-10-24T00:30:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 shutdown_connections 2023-10-24T00:30:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b581544b0 0x7f9b58151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:30:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b580aa420 0x7f9b5814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:30:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b3805f3e0 0x7f9b380618a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 --2- 172.21.15.148:0/161743941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b580c8290 0x7f9b58151790 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:30:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 >> 172.21.15.148:0/161743941 conn(0x7f9b580945d0 msgr2=0x7f9b580c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:30:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 shutdown_connections 2023-10-24T00:30:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:30:05.178+0000 7f9b5d961700 1 -- 172.21.15.148:0/161743941 wait complete. 2023-10-24T00:30:05.193 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-10-24T00:30:30.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:30:30.200 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:31:00.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:31:00.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:31:30.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:31:30.348 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:32:00.408 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:32:00.412 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:32:30.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:32:30.481 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:33:00.566 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:33:00.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:33:30.647 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:33:30.651 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:34:00.729 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:34:00.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:34:30.818 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:34:30.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:35:00.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:35:00.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:35:30.946 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:35:30.949 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:36:01.010 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:36:01.013 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:36:31.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:36:31.075 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:37:01.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:37:01.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:37:31.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:37:31.206 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:38:01.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:38:01.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:38:31.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:38:31.368 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:39:01.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:39:01.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:39:31.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:39:31.496 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:40:01.549 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:40:01.553 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:40:31.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:40:31.616 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:41:01.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:41:01.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:41:19.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-24T00:41:19.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.323+0000 7f1f20a61700 1 Processor -- start 2023-10-24T00:41:19.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.323+0000 7f1f20a61700 1 -- start start 2023-10-24T00:41:19.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 0x7f1f1c0be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c3dd0 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c45c0 con 0x7f1f1c151da0 2023-10-24T00:41:19.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f20a61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0beba0 con 0x7f1f1c0bda50 2023-10-24T00:41:19.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35756/0 (socket says 172.21.15.148:35756) 2023-10-24T00:41:19.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 -- 172.21.15.148:0/3559064532 learned_addr learned my addr 172.21.15.148:0/3559064532 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:19.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 -- 172.21.15.148:0/3559064532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 msgr2=0x7f1f1c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:19.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/3559064532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:19.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 -- 172.21.15.148:0/3559064532 >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 msgr2=0x7f1f1c0be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:19.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f1a59c700 1 --2- 172.21.15.148:0/3559064532 >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 0x7f1f1c0be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/3559064532 >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 0x7f1f1c0be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f19d9b700 1 -- 172.21.15.148:0/3559064532 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0c4000 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.324+0000 7f1f1a59c700 1 --2- 172.21.15.148:0/3559064532 >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 0x7f1f1c0be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:19.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/3559064532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1f1c064da0 tx=0x7f1f100090f0).ready entity=mon.0 client_cookie=6112f18fc117edcc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f1959a700 1 -- 172.21.15.148:0/3559064532 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000b600 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f1959a700 1 -- 172.21.15.148:0/3559064532 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1000b760 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f1959a700 1 -- 172.21.15.148:0/3559064532 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000bae0 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 -- 172.21.15.148:0/3559064532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 msgr2=0x7f1f1c0bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 --2- 172.21.15.148:0/3559064532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f1f1c064da0 tx=0x7f1f100090f0).stop 2023-10-24T00:41:19.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 -- 172.21.15.148:0/3559064532 shutdown_connections 2023-10-24T00:41:19.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 --2- 172.21.15.148:0/3559064532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:19.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 --2- 172.21.15.148:0/3559064532 >> v2:172.21.15.150:3300/0 conn(0x7f1f1c151da0 0x7f1f1c0be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 --2- 172.21.15.148:0/3559064532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c0bd560 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 -- 172.21.15.148:0/3559064532 >> 172.21.15.148:0/3559064532 conn(0x7f1f1c0c4790 msgr2=0x7f1f1c0c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 -- 172.21.15.148:0/3559064532 shutdown_connections 2023-10-24T00:41:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.325+0000 7f1f20a61700 1 -- 172.21.15.148:0/3559064532 wait complete. 2023-10-24T00:41:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 Processor -- start 2023-10-24T00:41:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 -- start start 2023-10-24T00:41:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 0x7f1f1c0ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0aa650 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0a91e0 con 0x7f1f1c151da0 2023-10-24T00:41:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f20a61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0aa020 con 0x7f1f1c0bda50 2023-10-24T00:41:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.327+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35760/0 (socket says 172.21.15.148:35760) 2023-10-24T00:41:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 -- 172.21.15.148:0/2845609096 learned_addr learned my addr 172.21.15.148:0/2845609096 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f1a59c700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f1ad9d700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 0x7f1f1c0ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 -- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 msgr2=0x7f1f1c0a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 -- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 msgr2=0x7f1f1c0ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 0x7f1f1c0ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 -- 172.21.15.148:0/2845609096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10009370 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f1ad9d700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 0x7f1f1c0ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f19d9b700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f1f1c068eb0 tx=0x7f1f10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000bae0 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10000c90 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1001b660 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c0c1920 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.328+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c0a96f0 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.329+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c0aa160 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.329+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1f1001ba90 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.330+0000 7f1f0a7fc700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 0x7f1efc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.330+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1f1007c380 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.330+0000 7f1f1a59c700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 0x7f1efc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.330+0000 7f1f1a59c700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 0x7f1efc061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1f0c00ab40 tx=0x7f1f0c008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.334+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1f1c0aa160 con 0x7f1f1c0c52b0 2023-10-24T00:41:19.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.524+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f1c0aa160 con 0x7f1efc05f2c0 2023-10-24T00:41:19.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.528+0000 7f1f0a7fc700 1 -- 172.21.15.148:0/2845609096 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1f1c0aa160 con 0x7f1efc05f2c0 2023-10-24T00:41:19.531 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-10-24T00:41:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.530+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 msgr2=0x7f1efc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.530+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 0x7f1efc061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1f0c00ab40 tx=0x7f1f0c008040).stop 2023-10-24T00:41:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.530+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 msgr2=0x7f1f1c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.530+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f1f1c068eb0 tx=0x7f1f10017000).stop 2023-10-24T00:41:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 shutdown_connections 2023-10-24T00:41:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f1c151da0 0x7f1f1c0ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f1c0bda50 0x7f1f1c0a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1efc05f2c0 0x7f1efc061780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 --2- 172.21.15.148:0/2845609096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f1c0c52b0 0x7f1f1c14df90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 >> 172.21.15.148:0/2845609096 conn(0x7f1f1c0c4790 msgr2=0x7f1f1c14fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 shutdown_connections 2023-10-24T00:41:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.531+0000 7f1f20a61700 1 -- 172.21.15.148:0/2845609096 wait complete. 2023-10-24T00:41:19.545 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-10-24T00:41:19.545 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-24T00:41:19.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.661+0000 7f4aca6a3700 1 Processor -- start 2023-10-24T00:41:19.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.661+0000 7f4aca6a3700 1 -- start start 2023-10-24T00:41:19.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4aca6a3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ac41544b0 0x7f4ac40a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4aca6a3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ac40c8290 0x7f4ac40a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4aca6a3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40c6270 con 0x7f4ac40aa420 2023-10-24T00:41:19.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4aca6a3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40c60e0 con 0x7f4ac41544b0 2023-10-24T00:41:19.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4aca6a3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac40c0c80 con 0x7f4ac40c8290 2023-10-24T00:41:19.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4ac41544b0 0x7f4ac40a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac8c40700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4ac40aa420 0x7f4ac40c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39214/0 (socket says 172.21.15.148:39214) 2023-10-24T00:41:19.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac8c40700 1 -- 172.21.15.148:0/3888842924 learned_addr learned my addr 172.21.15.148:0/3888842924 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:19.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac37fe700 1 --2- 172.21.15.148:0/3888842924 >> v2:172.21.15.150:3300/0 conn(0x7f4ac40c8290 0x7f4ac40a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 -- 172.21.15.148:0/3888842924 >> v2:172.21.15.150:3300/0 conn(0x7f4ac40c8290 msgr2=0x7f4ac40a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:19.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 --2- 172.21.15.148:0/3888842924 >> v2:172.21.15.150:3300/0 conn(0x7f4ac40c8290 0x7f4ac40a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac2ffd700 1 -- 172.21.15.148:0/3888842924 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485132311 0 0) 0x7f4ac40c6270 con 0x7f4ac40aa420 2023-10-24T00:41:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 -- 172.21.15.148:0/3888842924 >> v1:172.21.15.148:6789/0 conn(0x7f4ac40aa420 legacy=0x7f4ac40c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 -- 172.21.15.148:0/3888842924 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40c0f40 con 0x7f4ac41544b0 2023-10-24T00:41:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac3fff700 1 --2- 172.21.15.148:0/3888842924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac41544b0 0x7f4ac40a7d00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4ac40a9cf0 tx=0x7f4ab4009060).ready entity=mon.0 client_cookie=b3c5622e784ef288 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac2ffd700 1 -- 172.21.15.148:0/3888842924 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400b580 con 0x7f4ac41544b0 2023-10-24T00:41:19.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac2ffd700 1 -- 172.21.15.148:0/3888842924 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab400b6e0 con 0x7f4ac41544b0 2023-10-24T00:41:19.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.662+0000 7f4ac2ffd700 1 -- 172.21.15.148:0/3888842924 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400ba60 con 0x7f4ac41544b0 2023-10-24T00:41:19.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 -- 172.21.15.148:0/3888842924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac41544b0 msgr2=0x7f4ac40a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/3888842924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac41544b0 0x7f4ac40a7d00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4ac40a9cf0 tx=0x7f4ab4009060).stop 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 -- 172.21.15.148:0/3888842924 shutdown_connections 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/3888842924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac41544b0 0x7f4ac40a7d00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/3888842924 >> v2:172.21.15.150:3300/0 conn(0x7f4ac40c8290 0x7f4ac40a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 -- 172.21.15.148:0/3888842924 >> 172.21.15.148:0/3888842924 conn(0x7f4ac40945d0 msgr2=0x7f4ac406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 -- 172.21.15.148:0/3888842924 shutdown_connections 2023-10-24T00:41:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.663+0000 7f4aca6a3700 1 -- 172.21.15.148:0/3888842924 wait complete. 2023-10-24T00:41:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.664+0000 7f4aca6a3700 1 Processor -- start 2023-10-24T00:41:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.664+0000 7f4aca6a3700 1 -- start start 2023-10-24T00:41:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ac40aa420 0x7f4ac414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 0x7f4ac40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40aab70 con 0x7f4ac40c8290 2023-10-24T00:41:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4155540 con 0x7f4ac41544b0 2023-10-24T00:41:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4aca6a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4154930 con 0x7f4ac40aa420 2023-10-24T00:41:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35776/0 (socket says 172.21.15.148:35776) 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 -- 172.21.15.148:0/2669830204 learned_addr learned my addr 172.21.15.148:0/2669830204 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac3fff700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ac40aa420 0x7f4ac414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac8c40700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 0x7f4ac40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 -- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ac40aa420 msgr2=0x7f4ac414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ac40aa420 0x7f4ac414efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 -- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 msgr2=0x7f4ac40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 0x7f4ac40ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac37fe700 1 -- 172.21.15.148:0/2669830204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40092a0 con 0x7f4ac40c8290 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.665+0000 7f4ac8c40700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 0x7f4ac40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4ac37fe700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4ab800c850 tx=0x7f4ab8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8010580 con 0x7f4ac40c8290 2023-10-24T00:41:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80106e0 con 0x7f4ac40c8290 2023-10-24T00:41:19.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8010a60 con 0x7f4ac40c8290 2023-10-24T00:41:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4154c10 con 0x7f4ac40c8290 2023-10-24T00:41:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.666+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41551d0 con 0x7f4ac40c8290 2023-10-24T00:41:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.667+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac406c6b0 con 0x7f4ac40c8290 2023-10-24T00:41:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.667+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f4ab801b460 con 0x7f4ac40c8290 2023-10-24T00:41:19.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.667+0000 7f4aabfff700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 0x7f4ab0061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:19.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.668+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4ab807a4a0 con 0x7f4ac40c8290 2023-10-24T00:41:19.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.668+0000 7f4ac3fff700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 0x7f4ab0061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:19.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.668+0000 7f4ac3fff700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 0x7f4ab0061750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ab400b340 tx=0x7f4ab4017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:19.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.672+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ab804b4c0 con 0x7f4ac40c8290 2023-10-24T00:41:19.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.858+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ac40c1220 con 0x7f4ab005f290 2023-10-24T00:41:19.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.862+0000 7f4aabfff700 1 -- 172.21.15.148:0/2669830204 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4ac40c1220 con 0x7f4ab005f290 2023-10-24T00:41:19.865 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-10-24T00:41:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 msgr2=0x7f4ab0061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 0x7f4ab0061750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ab400b340 tx=0x7f4ab4017000).stop 2023-10-24T00:41:19.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 msgr2=0x7f4ac4157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4ab800c850 tx=0x7f4ab8008040).stop 2023-10-24T00:41:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 shutdown_connections 2023-10-24T00:41:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac41544b0 0x7f4ac40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ac40aa420 0x7f4ac414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ab005f290 0x7f4ab0061750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 --2- 172.21.15.148:0/2669830204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac40c8290 0x7f4ac4157060 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 >> 172.21.15.148:0/2669830204 conn(0x7f4ac40945d0 msgr2=0x7f4ac40a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 shutdown_connections 2023-10-24T00:41:19.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.864+0000 7f4aca6a3700 1 -- 172.21.15.148:0/2669830204 wait complete. 2023-10-24T00:41:19.878 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-10-24T00:41:19.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-24T00:41:19.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.995+0000 7fe77b283700 1 Processor -- start 2023-10-24T00:41:19.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.995+0000 7fe77b283700 1 -- start start 2023-10-24T00:41:20.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7741544b0 0x7fe7740a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 0x7fe7740a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7740aa420 0x7fe7740c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740c60e0 con 0x7fe7740aa420 2023-10-24T00:41:20.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740c6270 con 0x7fe7740c8290 2023-10-24T00:41:20.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe77b283700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740aa8b0 con 0x7fe7741544b0 2023-10-24T00:41:20.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe779820700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7740aa420 0x7fe7740c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe779820700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7740aa420 0x7fe7740c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35778/0 (socket says 172.21.15.148:35778) 2023-10-24T00:41:20.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.996+0000 7fe779820700 1 -- 172.21.15.148:0/1503098987 learned_addr learned my addr 172.21.15.148:0/1503098987 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:20.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77901f700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7741544b0 0x7fe7740a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77881e700 1 --2- 172.21.15.148:0/1503098987 >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 0x7fe7740a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 -- 172.21.15.148:0/1503098987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7741544b0 msgr2=0x7fe7740a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:20.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7741544b0 0x7fe7740a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 -- 172.21.15.148:0/1503098987 >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 msgr2=0x7fe7740a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:20.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 --2- 172.21.15.148:0/1503098987 >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 0x7fe7740a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 -- 172.21.15.148:0/1503098987 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740c0c80 con 0x7fe7740aa420 2023-10-24T00:41:20.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77881e700 1 --2- 172.21.15.148:0/1503098987 >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 0x7fe7740a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:20.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe779820700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7740aa420 0x7fe7740c6700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe774084220 tx=0x7fe76c009840).ready entity=mon.0 client_cookie=b18361890ae60fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe76bfff700 1 -- 172.21.15.148:0/1503098987 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00e070 con 0x7fe7740aa420 2023-10-24T00:41:20.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe76bfff700 1 -- 172.21.15.148:0/1503098987 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00ba20 con 0x7fe7740aa420 2023-10-24T00:41:20.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe76bfff700 1 -- 172.21.15.148:0/1503098987 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00bda0 con 0x7fe7740aa420 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 -- 172.21.15.148:0/1503098987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7740aa420 msgr2=0x7fe7740c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7740aa420 0x7fe7740c6700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe774084220 tx=0x7fe76c009840).stop 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 -- 172.21.15.148:0/1503098987 shutdown_connections 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7740aa420 0x7fe7740c6700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 --2- 172.21.15.148:0/1503098987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7741544b0 0x7fe7740a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 --2- 172.21.15.148:0/1503098987 >> v2:172.21.15.150:3300/0 conn(0x7fe7740c8290 0x7fe7740a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.997+0000 7fe77b283700 1 -- 172.21.15.148:0/1503098987 >> 172.21.15.148:0/1503098987 conn(0x7fe7740945d0 msgr2=0x7fe77406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.998+0000 7fe77b283700 1 -- 172.21.15.148:0/1503098987 shutdown_connections 2023-10-24T00:41:20.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.998+0000 7fe77b283700 1 -- 172.21.15.148:0/1503098987 wait complete. 2023-10-24T00:41:20.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.999+0000 7fe77b283700 1 Processor -- start 2023-10-24T00:41:20.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:19.999+0000 7fe77b283700 1 -- start start 2023-10-24T00:41:20.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7740aa420 0x7fe7741686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7740c8290 0x7fe7740ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740adf60 con 0x7fe7741544b0 2023-10-24T00:41:20.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe774150c90 con 0x7fe7740aa420 2023-10-24T00:41:20.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740ae1b0 con 0x7fe7740c8290 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35782/0 (socket says 172.21.15.148:35782) 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 -- 172.21.15.148:0/1867261720 learned_addr learned my addr 172.21.15.148:0/1867261720 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77881e700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7740c8290 0x7fe7740ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77901f700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7740aa420 0x7fe7741686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 -- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7740c8290 msgr2=0x7fe7740ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7740c8290 0x7fe7740ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 -- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7740aa420 msgr2=0x7fe7741686b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7740aa420 0x7fe7741686b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 -- 172.21.15.148:0/1867261720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009ae0 con 0x7fe7741544b0 2023-10-24T00:41:20.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe779820700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe76c00b6c0 tx=0x7fe76c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0032f0 con 0x7fe7741544b0 2023-10-24T00:41:20.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0092e0 con 0x7fe7741544b0 2023-10-24T00:41:20.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740ae490 con 0x7fe7741544b0 2023-10-24T00:41:20.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c01e6a0 con 0x7fe7741544b0 2023-10-24T00:41:20.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.000+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7740aea50 con 0x7fe7741544b0 2023-10-24T00:41:20.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.001+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77406c6b0 con 0x7fe7741544b0 2023-10-24T00:41:20.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.001+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe76c003040 con 0x7fe7741544b0 2023-10-24T00:41:20.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.002+0000 7fe7697fa700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 0x7fe758061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.002+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe76c07b870 con 0x7fe7741544b0 2023-10-24T00:41:20.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.002+0000 7fe77901f700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 0x7fe758061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.002+0000 7fe77901f700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 0x7fe758061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe770009b90 tx=0x7fe770009060).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.006+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe76c04c9a0 con 0x7fe7741544b0 2023-10-24T00:41:20.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.196+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7740c0f40 con 0x7fe75805f2c0 2023-10-24T00:41:20.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.200+0000 7fe7697fa700 1 -- 172.21.15.148:0/1867261720 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe7740c0f40 con 0x7fe75805f2c0 2023-10-24T00:41:20.203 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-10-24T00:41:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 msgr2=0x7fe758061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 0x7fe758061780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe770009b90 tx=0x7fe770009060).stop 2023-10-24T00:41:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 msgr2=0x7fe77414ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe76c00b6c0 tx=0x7fe76c009840).stop 2023-10-24T00:41:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 shutdown_connections 2023-10-24T00:41:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe75805f2c0 0x7fe758061780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7741544b0 0x7fe77414ef30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7740aa420 0x7fe7741686b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 --2- 172.21.15.148:0/1867261720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7740c8290 0x7fe7740ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 >> 172.21.15.148:0/1867261720 conn(0x7fe7740945d0 msgr2=0x7fe774063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 shutdown_connections 2023-10-24T00:41:20.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.202+0000 7fe77b283700 1 -- 172.21.15.148:0/1867261720 wait complete. 2023-10-24T00:41:20.216 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-10-24T00:41:20.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-24T00:41:20.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.332+0000 7f5a86a49700 1 Processor -- start 2023-10-24T00:41:20.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.332+0000 7f5a86a49700 1 -- start start 2023-10-24T00:41:20.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a86a49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a800a7d00 0x7f5a800a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a86a49700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a800aa420 0x7f5a800c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a86a49700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a800c6270 con 0x7f5a801544b0 2023-10-24T00:41:20.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a86a49700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a800c60e0 con 0x7f5a800aa420 2023-10-24T00:41:20.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a86a49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800aa890 con 0x7f5a800a7d00 2023-10-24T00:41:20.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a7ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5a801544b0 0x7f5a800c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39218/0 (socket says 172.21.15.148:39218) 2023-10-24T00:41:20.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5a800aa420 0x7f5a800c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a7ffff700 1 -- 172.21.15.148:0/3454984662 learned_addr learned my addr 172.21.15.148:0/3454984662 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:20.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a7f7fe700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a800a7d00 0x7f5a800a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a7effd700 1 -- 172.21.15.148:0/3454984662 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926400605 0 0) 0x7f5a800c6270 con 0x7f5a801544b0 2023-10-24T00:41:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a7effd700 1 -- 172.21.15.148:0/3454984662 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a680033f0 con 0x7f5a801544b0 2023-10-24T00:41:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 -- 172.21.15.148:0/3454984662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a800a7d00 msgr2=0x7f5a800a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a800a7d00 0x7f5a800a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 -- 172.21.15.148:0/3454984662 >> v1:172.21.15.148:6789/0 conn(0x7f5a801544b0 legacy=0x7f5a800c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 -- 172.21.15.148:0/3454984662 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800c0c80 con 0x7f5a800aa420 2023-10-24T00:41:20.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.333+0000 7f5a84fe6700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800aa420 0x7f5a800c6700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5a78009e60 tx=0x7f5a78009780).ready entity=mon.0 client_cookie=dac5d52d7949588c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a7effd700 1 -- 172.21.15.148:0/3454984662 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800e070 con 0x7f5a800aa420 2023-10-24T00:41:20.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a7effd700 1 -- 172.21.15.148:0/3454984662 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800bab0 con 0x7f5a800aa420 2023-10-24T00:41:20.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a7effd700 1 -- 172.21.15.148:0/3454984662 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800be30 con 0x7f5a800aa420 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 -- 172.21.15.148:0/3454984662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800aa420 msgr2=0x7f5a800c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800aa420 0x7f5a800c6700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5a78009e60 tx=0x7f5a78009780).stop 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 -- 172.21.15.148:0/3454984662 shutdown_connections 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800aa420 0x7f5a800c6700 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3454984662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a800a7d00 0x7f5a800a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 -- 172.21.15.148:0/3454984662 >> 172.21.15.148:0/3454984662 conn(0x7f5a800945d0 msgr2=0x7f5a8006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 -- 172.21.15.148:0/3454984662 shutdown_connections 2023-10-24T00:41:20.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.334+0000 7f5a86a49700 1 -- 172.21.15.148:0/3454984662 wait complete. 2023-10-24T00:41:20.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.335+0000 7f5a86a49700 1 Processor -- start 2023-10-24T00:41:20.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.335+0000 7f5a86a49700 1 -- start start 2023-10-24T00:41:20.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 0x7f5a8014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a801544b0 0x7f5a800aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800c4880 con 0x7f5a800a7d00 2023-10-24T00:41:20.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a80155d60 con 0x7f5a800aa420 2023-10-24T00:41:20.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a86a49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a80156040 con 0x7f5a801544b0 2023-10-24T00:41:20.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a7ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a7ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35802/0 (socket says 172.21.15.148:35802) 2023-10-24T00:41:20.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a7ffff700 1 -- 172.21.15.148:0/3897076423 learned_addr learned my addr 172.21.15.148:0/3897076423 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:20.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a7ffff700 1 -- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a801544b0 msgr2=0x7f5a800aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.336+0000 7f5a7ffff700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a801544b0 0x7f5a800aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:20.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7ffff700 1 -- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 msgr2=0x7f5a8014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7f7fe700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 0x7f5a8014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7ffff700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 0x7f5a8014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7ffff700 1 -- 172.21.15.148:0/3897076423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a78009a20 con 0x7f5a800a7d00 2023-10-24T00:41:20.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7f7fe700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 0x7f5a8014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:20.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a7ffff700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5a7000c420 tx=0x7f5a70007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a700072e0 con 0x7f5a800a7d00 2023-10-24T00:41:20.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70007440 con 0x7f5a800a7d00 2023-10-24T00:41:20.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a700057a0 con 0x7f5a800a7d00 2023-10-24T00:41:20.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a80156320 con 0x7f5a800a7d00 2023-10-24T00:41:20.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.337+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a80155970 con 0x7f5a800a7d00 2023-10-24T00:41:20.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.338+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8006c6b0 con 0x7f5a800a7d00 2023-10-24T00:41:20.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.339+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f5a70005bd0 con 0x7f5a800a7d00 2023-10-24T00:41:20.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.339+0000 7f5a67fff700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 0x7f5a6c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.339+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5a70079e40 con 0x7f5a800a7d00 2023-10-24T00:41:20.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.339+0000 7f5a7f7fe700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 0x7f5a6c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.339+0000 7f5a7f7fe700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 0x7f5a6c061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a74006d80 tx=0x7f5a74008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.342+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5a70049af0 con 0x7f5a800a7d00 2023-10-24T00:41:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.533+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a800c0fb0 con 0x7f5a6c05f2c0 2023-10-24T00:41:20.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.538+0000 7f5a67fff700 1 -- 172.21.15.148:0/3897076423 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5a800c0fb0 con 0x7f5a6c05f2c0 2023-10-24T00:41:20.540 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-10-24T00:41:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 msgr2=0x7f5a6c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 0x7f5a6c061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a74006d80 tx=0x7f5a74008040).stop 2023-10-24T00:41:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 msgr2=0x7f5a80155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f5a7000c420 tx=0x7f5a70007c80).stop 2023-10-24T00:41:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 shutdown_connections 2023-10-24T00:41:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a801544b0 0x7f5a800aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5a6c05f2c0 0x7f5a6c061780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a800a7d00 0x7f5a80155480 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 --2- 172.21.15.148:0/3897076423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a800aa420 0x7f5a8014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 >> 172.21.15.148:0/3897076423 conn(0x7f5a800945d0 msgr2=0x7f5a800bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 shutdown_connections 2023-10-24T00:41:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.540+0000 7f5a86a49700 1 -- 172.21.15.148:0/3897076423 wait complete. 2023-10-24T00:41:20.554 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-10-24T00:41:20.554 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-24T00:41:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.670+0000 7fc5ae83b700 1 Processor -- start 2023-10-24T00:41:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.670+0000 7fc5ae83b700 1 -- start start 2023-10-24T00:41:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5ae83b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc5a81544b0 0x7fc5a80a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5ae83b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 0x7fc5a80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5ae83b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80c6270 con 0x7fc5a80c8290 2023-10-24T00:41:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5ae83b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80c60e0 con 0x7fc5a81544b0 2023-10-24T00:41:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5ae83b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80c0c80 con 0x7fc5a80aa640 2023-10-24T00:41:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5a7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc5a81544b0 0x7fc5a80a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5a7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc5a81544b0 0x7fc5a80a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35816/0 (socket says 172.21.15.148:35816) 2023-10-24T00:41:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5a7fff700 1 -- 172.21.15.148:0/60274780 learned_addr learned my addr 172.21.15.148:0/60274780 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.671+0000 7fc5acdd8700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 0x7fc5a80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a7fff700 1 -- 172.21.15.148:0/60274780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 msgr2=0x7fc5a80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a7fff700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 0x7fc5a80c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a7fff700 1 -- 172.21.15.148:0/60274780 >> v1:172.21.15.150:6789/0 conn(0x7fc5a80c8290 legacy=0x7fc5a80a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a7fff700 1 -- 172.21.15.148:0/60274780 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80c0f40 con 0x7fc5a81544b0 2023-10-24T00:41:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5acdd8700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 0x7fc5a80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a7fff700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80a7d00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc598006fd0 tx=0x7fc5980090f0).ready entity=mon.0 client_cookie=60cb75fd98327f4f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a6ffd700 1 -- 172.21.15.148:0/60274780 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800b600 con 0x7fc5a81544b0 2023-10-24T00:41:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a6ffd700 1 -- 172.21.15.148:0/60274780 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59800b760 con 0x7fc5a81544b0 2023-10-24T00:41:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5a6ffd700 1 -- 172.21.15.148:0/60274780 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59800bae0 con 0x7fc5a81544b0 2023-10-24T00:41:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 -- 172.21.15.148:0/60274780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 msgr2=0x7fc5a80a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80a7d00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fc598006fd0 tx=0x7fc5980090f0).stop 2023-10-24T00:41:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 -- 172.21.15.148:0/60274780 shutdown_connections 2023-10-24T00:41:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80aa640 0x7fc5a80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/60274780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80a7d00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 -- 172.21.15.148:0/60274780 >> 172.21.15.148:0/60274780 conn(0x7fc5a80945d0 msgr2=0x7fc5a806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 -- 172.21.15.148:0/60274780 shutdown_connections 2023-10-24T00:41:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.672+0000 7fc5ae83b700 1 -- 172.21.15.148:0/60274780 wait complete. 2023-10-24T00:41:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.673+0000 7fc5ae83b700 1 Processor -- start 2023-10-24T00:41:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 -- start start 2023-10-24T00:41:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5a80aa640 0x7fc5a814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80c8290 0x7fc5a80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a814e640 con 0x7fc5a81544b0 2023-10-24T00:41:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80acbe0 con 0x7fc5a80aa640 2023-10-24T00:41:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.674+0000 7fc5ae83b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80c7a60 con 0x7fc5a80c8290 2023-10-24T00:41:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35820/0 (socket says 172.21.15.148:35820) 2023-10-24T00:41:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 -- 172.21.15.148:0/109358687 learned_addr learned my addr 172.21.15.148:0/109358687 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5a77fe700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80c8290 0x7fc5a80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5a7fff700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5a80aa640 0x7fc5a814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 -- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80c8290 msgr2=0x7fc5a80c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80c8290 0x7fc5a80c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 -- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5a80aa640 msgr2=0x7fc5a814e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5a80aa640 0x7fc5a814e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 -- 172.21.15.148:0/109358687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598009370 con 0x7fc5a81544b0 2023-10-24T00:41:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5acdd8700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc5a000d180 tx=0x7fc5a0009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000dc60 con 0x7fc5a81544b0 2023-10-24T00:41:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000f040 con 0x7fc5a81544b0 2023-10-24T00:41:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a80c7d40 con 0x7fc5a81544b0 2023-10-24T00:41:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00133f0 con 0x7fc5a81544b0 2023-10-24T00:41:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.675+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a8155db0 con 0x7fc5a81544b0 2023-10-24T00:41:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.676+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a80c8080 con 0x7fc5a81544b0 2023-10-24T00:41:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.677+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc5a00137e0 con 0x7fc5a81544b0 2023-10-24T00:41:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.677+0000 7fc58ffff700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 0x7fc594061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.677+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc5a007ab30 con 0x7fc5a81544b0 2023-10-24T00:41:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.677+0000 7fc5a7fff700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 0x7fc594061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.678+0000 7fc5a7fff700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 0x7fc594061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc598009130 tx=0x7fc598017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.681+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc5a004bbb0 con 0x7fc5a81544b0 2023-10-24T00:41:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.874+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5a806c6b0 con 0x7fc59405f2c0 2023-10-24T00:41:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.879+0000 7fc58ffff700 1 -- 172.21.15.148:0/109358687 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc5a806c6b0 con 0x7fc59405f2c0 2023-10-24T00:41:20.881 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-10-24T00:41:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 msgr2=0x7fc594061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 0x7fc594061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc598009130 tx=0x7fc598017000).stop 2023-10-24T00:41:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 msgr2=0x7fc5a80ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fc5a000d180 tx=0x7fc5a0009a50).stop 2023-10-24T00:41:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 shutdown_connections 2023-10-24T00:41:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc59405f2c0 0x7fc594061780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5a81544b0 0x7fc5a80ab430 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5a80aa640 0x7fc5a814e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 --2- 172.21.15.148:0/109358687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5a80c8290 0x7fc5a80c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:20.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 >> 172.21.15.148:0/109358687 conn(0x7fc5a80945d0 msgr2=0x7fc5a80a9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:20.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 shutdown_connections 2023-10-24T00:41:20.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:20.881+0000 7fc5ae83b700 1 -- 172.21.15.148:0/109358687 wait complete. 2023-10-24T00:41:20.895 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-10-24T00:41:20.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-24T00:41:21.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.012+0000 7fde925d7700 1 Processor -- start 2023-10-24T00:41:21.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.012+0000 7fde925d7700 1 -- start start 2023-10-24T00:41:21.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde925d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 0x7fde8c155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde925d7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde8c0aa320 0x7fde8c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde925d7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c0c7770 con 0x7fde8c0c0820 2023-10-24T00:41:21.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde925d7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0c86d0 con 0x7fde8c0aa320 2023-10-24T00:41:21.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde925d7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0c1070 con 0x7fde8c0a9f40 2023-10-24T00:41:21.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde90dd4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde8c0aa320 0x7fde8c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde90dd4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde8c0aa320 0x7fde8c0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35834/0 (socket says 172.21.15.148:35834) 2023-10-24T00:41:21.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde90dd4700 1 -- 172.21.15.148:0/2481406547 learned_addr learned my addr 172.21.15.148:0/2481406547 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:21.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.013+0000 7fde915d5700 1 --2- 172.21.15.148:0/2481406547 >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 0x7fde8c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde90dd4700 1 -- 172.21.15.148:0/2481406547 >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 msgr2=0x7fde8c155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde90dd4700 1 --2- 172.21.15.148:0/2481406547 >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 0x7fde8c155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde90dd4700 1 -- 172.21.15.148:0/2481406547 >> v1:172.21.15.150:6789/0 conn(0x7fde8c0c0820 legacy=0x7fde8c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde90dd4700 1 -- 172.21.15.148:0/2481406547 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0c79e0 con 0x7fde8c0aa320 2023-10-24T00:41:21.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde915d5700 1 --2- 172.21.15.148:0/2481406547 >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 0x7fde8c155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:21.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde90dd4700 1 --2- 172.21.15.148:0/2481406547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c81e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fde8c083a10 tx=0x7fde7c0090f0).ready entity=mon.0 client_cookie=38000c6cb6601b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde83fff700 1 -- 172.21.15.148:0/2481406547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00b5a0 con 0x7fde8c0aa320 2023-10-24T00:41:21.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde83fff700 1 -- 172.21.15.148:0/2481406547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00b700 con 0x7fde8c0aa320 2023-10-24T00:41:21.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde83fff700 1 -- 172.21.15.148:0/2481406547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00ba80 con 0x7fde8c0aa320 2023-10-24T00:41:21.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 -- 172.21.15.148:0/2481406547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0aa320 msgr2=0x7fde8c0c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 --2- 172.21.15.148:0/2481406547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c81e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fde8c083a10 tx=0x7fde7c0090f0).stop 2023-10-24T00:41:21.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 -- 172.21.15.148:0/2481406547 shutdown_connections 2023-10-24T00:41:21.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 --2- 172.21.15.148:0/2481406547 >> v2:172.21.15.150:3300/0 conn(0x7fde8c0a9f40 0x7fde8c155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 --2- 172.21.15.148:0/2481406547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c81e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.014+0000 7fde925d7700 1 -- 172.21.15.148:0/2481406547 >> 172.21.15.148:0/2481406547 conn(0x7fde8c094420 msgr2=0x7fde8c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.015+0000 7fde925d7700 1 -- 172.21.15.148:0/2481406547 shutdown_connections 2023-10-24T00:41:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.015+0000 7fde925d7700 1 -- 172.21.15.148:0/2481406547 wait complete. 2023-10-24T00:41:21.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.016+0000 7fde925d7700 1 Processor -- start 2023-10-24T00:41:21.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.016+0000 7fde925d7700 1 -- start start 2023-10-24T00:41:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde8c0c0820 0x7fde8c0641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c151480 con 0x7fde8c0a9f40 2023-10-24T00:41:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c151760 con 0x7fde8c0aa320 2023-10-24T00:41:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c151a40 con 0x7fde8c0c0820 2023-10-24T00:41:21.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35840/0 (socket says 172.21.15.148:35840) 2023-10-24T00:41:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 -- 172.21.15.148:0/377922537 learned_addr learned my addr 172.21.15.148:0/377922537 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde90dd4700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 -- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde8c0c0820 msgr2=0x7fde8c0641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde91dd6700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde8c0c0820 0x7fde8c0641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde8c0c0820 0x7fde8c0641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 -- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde8c0aa320 msgr2=0x7fde8c0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 -- 172.21.15.148:0/377922537 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c009370 con 0x7fde8c0a9f40 2023-10-24T00:41:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde915d5700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fde8800d860 tx=0x7fde88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88017070 con 0x7fde8c0a9f40 2023-10-24T00:41:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88005880 con 0x7fde8c0a9f40 2023-10-24T00:41:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c151d20 con 0x7fde8c0a9f40 2023-10-24T00:41:21.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88005c00 con 0x7fde8c0a9f40 2023-10-24T00:41:21.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.017+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c14f2c0 con 0x7fde8c0a9f40 2023-10-24T00:41:21.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.018+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c047480 con 0x7fde8c0a9f40 2023-10-24T00:41:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.019+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fde88006020 con 0x7fde8c0a9f40 2023-10-24T00:41:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.019+0000 7fde817fa700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 0x7fde70061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.019+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fde8807a480 con 0x7fde8c0a9f40 2023-10-24T00:41:21.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.019+0000 7fde90dd4700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 0x7fde70061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.020+0000 7fde90dd4700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 0x7fde70061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fde7c009130 tx=0x7fde7c015000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.023+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde8804b500 con 0x7fde8c0a9f40 2023-10-24T00:41:21.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.211+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde8c0c0cb0 con 0x7fde7005f2c0 2023-10-24T00:41:21.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.216+0000 7fde817fa700 1 -- 172.21.15.148:0/377922537 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fde8c0c0cb0 con 0x7fde7005f2c0 2023-10-24T00:41:21.218 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-10-24T00:41:21.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 msgr2=0x7fde70061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 0x7fde70061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fde7c009130 tx=0x7fde7c015000).stop 2023-10-24T00:41:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 msgr2=0x7fde8c14edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fde8800d860 tx=0x7fde88008040).stop 2023-10-24T00:41:21.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 shutdown_connections 2023-10-24T00:41:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde8c0c0820 0x7fde8c0641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde7005f2c0 0x7fde70061780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde8c0a9f40 0x7fde8c14edd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 --2- 172.21.15.148:0/377922537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde8c0aa320 0x7fde8c0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 >> 172.21.15.148:0/377922537 conn(0x7fde8c094420 msgr2=0x7fde8c0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 shutdown_connections 2023-10-24T00:41:21.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.218+0000 7fde925d7700 1 -- 172.21.15.148:0/377922537 wait complete. 2023-10-24T00:41:21.232 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-10-24T00:41:21.233 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-24T00:41:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.349+0000 7f3655e2c700 1 Processor -- start 2023-10-24T00:41:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.349+0000 7f3655e2c700 1 -- start start 2023-10-24T00:41:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f3655e2c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3650063be0 0x7f36500be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f3655e2c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650137950 con 0x7f3650063760 2023-10-24T00:41:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f3655e2c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650157fd0 con 0x7f3650137570 2023-10-24T00:41:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f3655e2c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3650158270 con 0x7f3650063be0 2023-10-24T00:41:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f364effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3650063760 0x7f36500be080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39222/0 (socket says 172.21.15.148:39222) 2023-10-24T00:41:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.350+0000 7f364effd700 1 -- 172.21.15.148:0/2995517104 learned_addr learned my addr 172.21.15.148:0/2995517104 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364ffff700 1 --2- 172.21.15.148:0/2995517104 >> v2:172.21.15.150:3300/0 conn(0x7f3650063be0 0x7f36500be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012432070 0 0) 0x7f3650137950 con 0x7f3650063760 2023-10-24T00:41:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36380033f0 con 0x7f3650063760 2023-10-24T00:41:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716373699 0 0) 0x7f36380033f0 con 0x7f3650063760 2023-10-24T00:41:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 >> v2:172.21.15.150:3300/0 conn(0x7f3650063be0 msgr2=0x7f36500be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 --2- 172.21.15.148:0/2995517104 >> v2:172.21.15.150:3300/0 conn(0x7f3650063be0 0x7f36500be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 >> v1:172.21.15.150:6789/0 conn(0x7f3650137570 legacy=0x7f36500665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650158550 con 0x7f3650063760 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f3644001470 con 0x7f3650063760 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 >> v1:172.21.15.148:6789/0 conn(0x7f3650063760 legacy=0x7f36500be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36380038e0 0x7f3638003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 0x7f3638004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3638005000 0x7f363800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3650158270 con 0x7f3638004690 2023-10-24T00:41:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363800bf60 con 0x7f3638005000 2023-10-24T00:41:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363800c0f0 con 0x7f36380038e0 2023-10-24T00:41:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 0x7f3638004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364f7fe700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36380038e0 0x7f3638003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364ffff700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3638005000 0x7f363800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 -- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36380038e0 msgr2=0x7f3638003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36380038e0 0x7f3638003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 -- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3638005000 msgr2=0x7f363800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3638005000 0x7f363800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364ffff700 1 -- 172.21.15.148:0/2995517104 reap_dead start 2023-10-24T00:41:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.351+0000 7f364effd700 1 -- 172.21.15.148:0/2995517104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36380033f0 con 0x7f3638004690 2023-10-24T00:41:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f364effd700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 0x7f3638004b10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f364400c190 tx=0x7f3644001e50).ready entity=mon.0 client_cookie=ac5d05146c7fb36b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644007a20 con 0x7f3638004690 2023-10-24T00:41:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400ca40 con 0x7f3638004690 2023-10-24T00:41:21.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f364e7fc700 1 -- 172.21.15.148:0/2995517104 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400cdc0 con 0x7f3638004690 2023-10-24T00:41:21.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 -- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 msgr2=0x7f3638004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 0x7f3638004b10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f364400c190 tx=0x7f3644001e50).stop 2023-10-24T00:41:21.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 -- 172.21.15.148:0/2995517104 shutdown_connections 2023-10-24T00:41:21.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 --2- 172.21.15.148:0/2995517104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3638004690 0x7f3638004b10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 -- 172.21.15.148:0/2995517104 >> 172.21.15.148:0/2995517104 conn(0x7f3650063120 msgr2=0x7f36500c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 -- 172.21.15.148:0/2995517104 shutdown_connections 2023-10-24T00:41:21.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.352+0000 7f3655e2c700 1 -- 172.21.15.148:0/2995517104 wait complete. 2023-10-24T00:41:21.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.353+0000 7f3655e2c700 1 Processor -- start 2023-10-24T00:41:21.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.353+0000 7f3655e2c700 1 -- start start 2023-10-24T00:41:21.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3638004690 0x7f365014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3650136760 0x7f3650136be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500ac740 con 0x7f36500abdd0 2023-10-24T00:41:21.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36501356c0 con 0x7f3650136760 2023-10-24T00:41:21.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f3655e2c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36501359a0 con 0x7f3638004690 2023-10-24T00:41:21.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f364ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f364ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35854/0 (socket says 172.21.15.148:35854) 2023-10-24T00:41:21.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f364ffff700 1 -- 172.21.15.148:0/1044174349 learned_addr learned my addr 172.21.15.148:0/1044174349 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:21.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f364f7fe700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3638004690 0x7f365014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.354+0000 7f364effd700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3650136760 0x7f3650136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 -- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3638004690 msgr2=0x7f365014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3638004690 0x7f365014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 -- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3650136760 msgr2=0x7f3650136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3650136760 0x7f3650136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 -- 172.21.15.148:0/1044174349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650135c80 con 0x7f36500abdd0 2023-10-24T00:41:21.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f364ffff700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3650047650 tx=0x7f3648009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648013680 con 0x7f36500abdd0 2023-10-24T00:41:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36480137e0 con 0x7f36500abdd0 2023-10-24T00:41:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650135f60 con 0x7f36500abdd0 2023-10-24T00:41:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648013b80 con 0x7f36500abdd0 2023-10-24T00:41:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.355+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365014e040 con 0x7f36500abdd0 2023-10-24T00:41:21.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.356+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365014e260 con 0x7f36500abdd0 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.356+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f364801f460 con 0x7f36500abdd0 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.357+0000 7f36377fe700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 0x7f363c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.357+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f364807a960 con 0x7f36500abdd0 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.357+0000 7f364f7fe700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 0x7f363c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.357+0000 7f364f7fe700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 0x7f363c061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f36400042e0 tx=0x7f3640004100).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.361+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f364804b980 con 0x7f36500abdd0 2023-10-24T00:41:21.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.550+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3650135b10 con 0x7f363c05f2c0 2023-10-24T00:41:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.554+0000 7f36377fe700 1 -- 172.21.15.148:0/1044174349 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3650135b10 con 0x7f363c05f2c0 2023-10-24T00:41:21.556 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-10-24T00:41:21.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 msgr2=0x7f363c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 0x7f363c061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f36400042e0 tx=0x7f3640004100).stop 2023-10-24T00:41:21.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 msgr2=0x7f36500ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3650047650 tx=0x7f3648009060).stop 2023-10-24T00:41:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 shutdown_connections 2023-10-24T00:41:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363c05f2c0 0x7f363c061780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36500abdd0 0x7f36500ac250 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3638004690 0x7f365014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 --2- 172.21.15.148:0/1044174349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3650136760 0x7f3650136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 >> 172.21.15.148:0/1044174349 conn(0x7f3650063120 msgr2=0x7f36500c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 shutdown_connections 2023-10-24T00:41:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.556+0000 7f3655e2c700 1 -- 172.21.15.148:0/1044174349 wait complete. 2023-10-24T00:41:21.570 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-10-24T00:41:21.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-24T00:41:21.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.686+0000 7f8121337700 1 Processor -- start 2023-10-24T00:41:21.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.686+0000 7f8121337700 1 -- start start 2023-10-24T00:41:21.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f8121337700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f811c1544b0 0x7f811c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f8121337700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f811c0aa640 0x7f811c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f8121337700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0c6270 con 0x7f811c0c8290 2023-10-24T00:41:21.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f8121337700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0c60e0 con 0x7f811c0aa640 2023-10-24T00:41:21.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f8121337700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0c0c80 con 0x7f811c1544b0 2023-10-24T00:41:21.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f811c0aa640 0x7f811c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f811c0aa640 0x7f811c0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35858/0 (socket says 172.21.15.148:35858) 2023-10-24T00:41:21.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 -- 172.21.15.148:0/1143492491 learned_addr learned my addr 172.21.15.148:0/1143492491 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:21.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811affd700 1 --2- 172.21.15.148:0/1143492491 >> v2:172.21.15.150:3300/0 conn(0x7f811c1544b0 0x7f811c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 -- 172.21.15.148:0/1143492491 >> v2:172.21.15.150:3300/0 conn(0x7f811c1544b0 msgr2=0x7f811c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:21.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 --2- 172.21.15.148:0/1143492491 >> v2:172.21.15.150:3300/0 conn(0x7f811c1544b0 0x7f811c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.687+0000 7f811b7fe700 1 -- 172.21.15.148:0/1143492491 >> v1:172.21.15.150:6789/0 conn(0x7f811c0c8290 legacy=0x7f811c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f811b7fe700 1 -- 172.21.15.148:0/1143492491 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0c0f40 con 0x7f811c0aa640 2023-10-24T00:41:21.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f811b7fe700 1 --2- 172.21.15.148:0/1143492491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c0aa640 0x7f811c0c6700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f811c084570 tx=0x7f8114009840).ready entity=mon.0 client_cookie=d88e0b78c8f1aa99 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f811a7fc700 1 -- 172.21.15.148:0/1143492491 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400e070 con 0x7f811c0aa640 2023-10-24T00:41:21.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f811a7fc700 1 -- 172.21.15.148:0/1143492491 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400ba20 con 0x7f811c0aa640 2023-10-24T00:41:21.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f811a7fc700 1 -- 172.21.15.148:0/1143492491 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400bda0 con 0x7f811c0aa640 2023-10-24T00:41:21.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 -- 172.21.15.148:0/1143492491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c0aa640 msgr2=0x7f811c0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 --2- 172.21.15.148:0/1143492491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c0aa640 0x7f811c0c6700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f811c084570 tx=0x7f8114009840).stop 2023-10-24T00:41:21.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 -- 172.21.15.148:0/1143492491 shutdown_connections 2023-10-24T00:41:21.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 --2- 172.21.15.148:0/1143492491 >> v2:172.21.15.150:3300/0 conn(0x7f811c1544b0 0x7f811c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 --2- 172.21.15.148:0/1143492491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c0aa640 0x7f811c0c6700 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 -- 172.21.15.148:0/1143492491 >> 172.21.15.148:0/1143492491 conn(0x7f811c0945d0 msgr2=0x7f811c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 -- 172.21.15.148:0/1143492491 shutdown_connections 2023-10-24T00:41:21.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.688+0000 7f8121337700 1 -- 172.21.15.148:0/1143492491 wait complete. 2023-10-24T00:41:21.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 Processor -- start 2023-10-24T00:41:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 -- start start 2023-10-24T00:41:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 0x7f811c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f811c0c8290 0x7f811c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 0x7f811c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0c7fb0 con 0x7f811c1544b0 2023-10-24T00:41:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c14b4b0 con 0x7f811c0aa640 2023-10-24T00:41:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.690+0000 7f8121337700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c168430 con 0x7f811c0c8290 2023-10-24T00:41:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 0x7f811c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 0x7f811c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 0x7f811c14afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:43680/0 (socket says 172.21.15.148:43680) 2023-10-24T00:41:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811affd700 1 -- 172.21.15.148:0/572920614 learned_addr learned my addr 172.21.15.148:0/572920614 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f81127fc700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f811c0c8290 0x7f811c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 -- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f811c0c8290 msgr2=0x7f811c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f811c0c8290 0x7f811c0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 -- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 msgr2=0x7f811c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 0x7f811c14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 -- 172.21.15.148:0/572920614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009ae0 con 0x7f811c1544b0 2023-10-24T00:41:21.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f811b7fe700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 0x7f811c0c7ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f8114013000 tx=0x7f8114009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114007170 con 0x7f811c1544b0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140092e0 con 0x7f811c1544b0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c168710 con 0x7f811c1544b0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811401e6a0 con 0x7f811c1544b0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.691+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c168cd0 con 0x7f811c1544b0 2023-10-24T00:41:21.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.692+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c06c6b0 con 0x7f811c1544b0 2023-10-24T00:41:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.693+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f8114003040 con 0x7f811c1544b0 2023-10-24T00:41:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.693+0000 7f81137fe700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 0x7f80fc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.693+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f811407b9c0 con 0x7f811c1544b0 2023-10-24T00:41:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.693+0000 7f811affd700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 0x7f80fc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.693+0000 7f811affd700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 0x7f80fc061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f811c14b730 tx=0x7f810c009060).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.697+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f811404ca40 con 0x7f811c1544b0 2023-10-24T00:41:21.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.890+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f811c164c90 con 0x7f80fc05f2c0 2023-10-24T00:41:21.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.894+0000 7f81137fe700 1 -- 172.21.15.148:0/572920614 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f810c009e60 con 0x7f80fc05f2c0 2023-10-24T00:41:21.897 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-10-24T00:41:21.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 msgr2=0x7f80fc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 0x7f80fc061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f811c14b730 tx=0x7f810c009060).stop 2023-10-24T00:41:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 msgr2=0x7f811c0c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 0x7f811c0c7ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f8114013000 tx=0x7f8114009840).stop 2023-10-24T00:41:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 shutdown_connections 2023-10-24T00:41:21.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f80fc05f2c0 0x7f80fc061780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f811c1544b0 0x7f811c0c7ac0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f811c0aa640 0x7f811c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 --2- 172.21.15.148:0/572920614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f811c0c8290 0x7f811c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:21.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 >> 172.21.15.148:0/572920614 conn(0x7f811c0945d0 msgr2=0x7f811c063f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 shutdown_connections 2023-10-24T00:41:21.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:21.896+0000 7f8121337700 1 -- 172.21.15.148:0/572920614 wait complete. 2023-10-24T00:41:21.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-10-24T00:41:21.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-24T00:41:22.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.028+0000 7fdfb1c29700 1 Processor -- start 2023-10-24T00:41:22.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.028+0000 7fdfb1c29700 1 -- start start 2023-10-24T00:41:22.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfb1c29700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfac0aa640 0x7fdfac0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfb1c29700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0c6270 con 0x7fdfac1544b0 2023-10-24T00:41:22.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfb1c29700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0c0c80 con 0x7fdfac0a7d00 2023-10-24T00:41:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfb1c29700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0c60e0 con 0x7fdfac0aa640 2023-10-24T00:41:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfac0aa640 0x7fdfac0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdfac0aa640 0x7fdfac0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35884/0 (socket says 172.21.15.148:35884) 2023-10-24T00:41:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfab7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdfac1544b0 0x7fdfac0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39226/0 (socket says 172.21.15.148:39226) 2023-10-24T00:41:22.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 -- 172.21.15.148:0/3774358775 learned_addr learned my addr 172.21.15.148:0/3774358775 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 -- 172.21.15.148:0/3774358775 >> v1:172.21.15.150:6789/0 conn(0x7fdfac0a7d00 legacy=0x7fdfac0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:22.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 -- 172.21.15.148:0/3774358775 >> v1:172.21.15.148:6789/0 conn(0x7fdfac1544b0 legacy=0x7fdfac0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfaaffd700 1 -- 172.21.15.148:0/3774358775 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614500370 0 0) 0x7fdfac0c6270 con 0x7fdfac1544b0 2023-10-24T00:41:22.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 -- 172.21.15.148:0/3774358775 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0c0f40 con 0x7fdfac0aa640 2023-10-24T00:41:22.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.029+0000 7fdfabfff700 1 --2- 172.21.15.148:0/3774358775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0aa640 0x7fdfac0c6700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdfa4009f20 tx=0x7fdfa4009840).ready entity=mon.0 client_cookie=d5575a31de6b13c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfaaffd700 1 -- 172.21.15.148:0/3774358775 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400e070 con 0x7fdfac0aa640 2023-10-24T00:41:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfaaffd700 1 -- 172.21.15.148:0/3774358775 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400ba40 con 0x7fdfac0aa640 2023-10-24T00:41:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfaaffd700 1 -- 172.21.15.148:0/3774358775 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400bdc0 con 0x7fdfac0aa640 2023-10-24T00:41:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 -- 172.21.15.148:0/3774358775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0aa640 msgr2=0x7fdfac0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/3774358775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0aa640 0x7fdfac0c6700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fdfa4009f20 tx=0x7fdfa4009840).stop 2023-10-24T00:41:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 -- 172.21.15.148:0/3774358775 shutdown_connections 2023-10-24T00:41:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/3774358775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0aa640 0x7fdfac0c6700 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 -- 172.21.15.148:0/3774358775 >> 172.21.15.148:0/3774358775 conn(0x7fdfac0945d0 msgr2=0x7fdfac06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 -- 172.21.15.148:0/3774358775 shutdown_connections 2023-10-24T00:41:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.030+0000 7fdfb1c29700 1 -- 172.21.15.148:0/3774358775 wait complete. 2023-10-24T00:41:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.031+0000 7fdfb1c29700 1 Processor -- start 2023-10-24T00:41:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.031+0000 7fdfb1c29700 1 -- start start 2023-10-24T00:41:22.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfac0aa640 0x7fdfac156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfac1544b0 0x7fdfac0643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0ab540 con 0x7fdfac0a7d00 2023-10-24T00:41:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0aac50 con 0x7fdfac1544b0 2023-10-24T00:41:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfb1c29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac14d3e0 con 0x7fdfac0aa640 2023-10-24T00:41:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35888/0 (socket says 172.21.15.148:35888) 2023-10-24T00:41:22.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 -- 172.21.15.148:0/2568953214 learned_addr learned my addr 172.21.15.148:0/2568953214 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 -- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfac0aa640 msgr2=0x7fdfac156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfac0aa640 0x7fdfac156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 -- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfac1544b0 msgr2=0x7fdfac0643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfac1544b0 0x7fdfac0643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 -- 172.21.15.148:0/2568953214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4009ae0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.032+0000 7fdfab7fe700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdf9c00c440 tx=0x7fdf9c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.033+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0072e0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.033+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c007440 con 0x7fdfac0a7d00 2023-10-24T00:41:22.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.033+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac0aaef0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.033+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c005910 con 0x7fdfac0a7d00 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.033+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac1577e0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.034+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac06c6b0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.034+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fdf9c005d00 con 0x7fdfac0a7d00 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.034+0000 7fdfa37fe700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 0x7fdf8c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.034+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fdf9c079bf0 con 0x7fdfac0a7d00 2023-10-24T00:41:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.035+0000 7fdfa3fff700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 0x7fdf8c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.035+0000 7fdfa3fff700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 0x7fdf8c061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfac0ad0f0 tx=0x7fdf94006b60).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.038+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf9c080080 con 0x7fdfac0a7d00 2023-10-24T00:41:22.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.229+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfac0ab680 con 0x7fdf8c05f2c0 2023-10-24T00:41:22.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.234+0000 7fdfa37fe700 1 -- 172.21.15.148:0/2568953214 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdf94006e40 con 0x7fdf8c05f2c0 2023-10-24T00:41:22.236 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-10-24T00:41:22.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.235+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 msgr2=0x7fdf8c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.235+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 0x7fdf8c061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfac0ad0f0 tx=0x7fdf94006b60).stop 2023-10-24T00:41:22.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.235+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 msgr2=0x7fdfac14cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fdf9c00c440 tx=0x7fdf9c007e30).stop 2023-10-24T00:41:22.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 shutdown_connections 2023-10-24T00:41:22.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfac1544b0 0x7fdfac0643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf8c05f2c0 0x7fdf8c061780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfac0a7d00 0x7fdfac14cef0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 --2- 172.21.15.148:0/2568953214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfac0aa640 0x7fdfac156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 >> 172.21.15.148:0/2568953214 conn(0x7fdfac0945d0 msgr2=0x7fdfac14f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 shutdown_connections 2023-10-24T00:41:22.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.236+0000 7fdfb1c29700 1 -- 172.21.15.148:0/2568953214 wait complete. 2023-10-24T00:41:22.249 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-10-24T00:41:22.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-24T00:41:22.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.367+0000 7f8a46717700 1 Processor -- start 2023-10-24T00:41:22.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.367+0000 7f8a46717700 1 -- start start 2023-10-24T00:41:22.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a401544b0 0x7f8a400a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a400c8290 0x7f8a400a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400aa420 0x7f8a400c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a400c60e0 con 0x7f8a401544b0 2023-10-24T00:41:22.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a400c6270 con 0x7f8a400c8290 2023-10-24T00:41:22.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a46717700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400aa870 con 0x7f8a400aa420 2023-10-24T00:41:22.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a3ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a401544b0 0x7f8a400a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a3ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8a401544b0 0x7f8a400a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35896/0 (socket says 172.21.15.148:35896) 2023-10-24T00:41:22.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.368+0000 7f8a3ffff700 1 -- 172.21.15.148:0/501104832 learned_addr learned my addr 172.21.15.148:0/501104832 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3f7fe700 1 --2- 172.21.15.148:0/501104832 >> v2:172.21.15.150:3300/0 conn(0x7f8a400c8290 0x7f8a400a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 -- 172.21.15.148:0/501104832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400aa420 msgr2=0x7f8a400c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:22.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/501104832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400aa420 0x7f8a400c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 -- 172.21.15.148:0/501104832 >> v2:172.21.15.150:3300/0 conn(0x7f8a400c8290 msgr2=0x7f8a400a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:22.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/501104832 >> v2:172.21.15.150:3300/0 conn(0x7f8a400c8290 0x7f8a400a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 -- 172.21.15.148:0/501104832 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400c0c80 con 0x7f8a401544b0 2023-10-24T00:41:22.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/501104832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400a7d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f8a400a9cf0 tx=0x7f8a300090f0).ready entity=mon.0 client_cookie=fce17166f636524d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3effd700 1 -- 172.21.15.148:0/501104832 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000b600 con 0x7f8a401544b0 2023-10-24T00:41:22.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3effd700 1 -- 172.21.15.148:0/501104832 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000b760 con 0x7f8a401544b0 2023-10-24T00:41:22.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a3effd700 1 -- 172.21.15.148:0/501104832 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000bae0 con 0x7f8a401544b0 2023-10-24T00:41:22.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a46717700 1 -- 172.21.15.148:0/501104832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 msgr2=0x7f8a400a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.369+0000 7f8a46717700 1 --2- 172.21.15.148:0/501104832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400a7d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f8a400a9cf0 tx=0x7f8a300090f0).stop 2023-10-24T00:41:22.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 -- 172.21.15.148:0/501104832 shutdown_connections 2023-10-24T00:41:22.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 --2- 172.21.15.148:0/501104832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400a7d00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 --2- 172.21.15.148:0/501104832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400aa420 0x7f8a400c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:22.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 --2- 172.21.15.148:0/501104832 >> v2:172.21.15.150:3300/0 conn(0x7f8a400c8290 0x7f8a400a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 -- 172.21.15.148:0/501104832 >> 172.21.15.148:0/501104832 conn(0x7f8a400945d0 msgr2=0x7f8a4006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 -- 172.21.15.148:0/501104832 shutdown_connections 2023-10-24T00:41:22.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.370+0000 7f8a46717700 1 -- 172.21.15.148:0/501104832 wait complete. 2023-10-24T00:41:22.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.371+0000 7f8a46717700 1 Processor -- start 2023-10-24T00:41:22.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.371+0000 7f8a46717700 1 -- start start 2023-10-24T00:41:22.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400aa420 0x7f8a4014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400c8290 0x7f8a400b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40155540 con 0x7f8a401544b0 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401559d0 con 0x7f8a400aa420 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40154930 con 0x7f8a400c8290 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35898/0 (socket says 172.21.15.148:35898) 2023-10-24T00:41:22.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 -- 172.21.15.148:0/2655149003 learned_addr learned my addr 172.21.15.148:0/2655149003 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a3f7fe700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400c8290 0x7f8a400b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400aa420 0x7f8a4014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 -- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400c8290 msgr2=0x7f8a400b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400c8290 0x7f8a400b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 -- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400aa420 msgr2=0x7f8a4014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400aa420 0x7f8a4014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 -- 172.21.15.148:0/2655149003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009370 con 0x7f8a401544b0 2023-10-24T00:41:22.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a44cb4700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f8a3800b790 tx=0x7f8a38009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800d500 con 0x7f8a401544b0 2023-10-24T00:41:22.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3800d680 con 0x7f8a401544b0 2023-10-24T00:41:22.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a40154c10 con 0x7f8a401544b0 2023-10-24T00:41:22.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800da40 con 0x7f8a401544b0 2023-10-24T00:41:22.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.372+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401551d0 con 0x7f8a401544b0 2023-10-24T00:41:22.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.373+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a401556b0 con 0x7f8a401544b0 2023-10-24T00:41:22.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.374+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f8a38011460 con 0x7f8a401544b0 2023-10-24T00:41:22.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.374+0000 7f8a27fff700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 0x7f8a2c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.374+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8a38079f00 con 0x7f8a401544b0 2023-10-24T00:41:22.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.374+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 0x7f8a2c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.374+0000 7f8a3ffff700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 0x7f8a2c061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8a30009130 tx=0x7f8a30017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.378+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8a38047af0 con 0x7f8a401544b0 2023-10-24T00:41:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.566+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4006c6b0 con 0x7f8a2c05f2c0 2023-10-24T00:41:22.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.570+0000 7f8a27fff700 1 -- 172.21.15.148:0/2655149003 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8a4006c6b0 con 0x7f8a2c05f2c0 2023-10-24T00:41:22.573 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-10-24T00:41:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 msgr2=0x7f8a2c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 0x7f8a2c061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8a30009130 tx=0x7f8a30017000).stop 2023-10-24T00:41:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 msgr2=0x7f8a400c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f8a3800b790 tx=0x7f8a38009330).stop 2023-10-24T00:41:22.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 shutdown_connections 2023-10-24T00:41:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a2c05f2c0 0x7f8a2c061780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a401544b0 0x7f8a400c9f80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a400aa420 0x7f8a4014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 --2- 172.21.15.148:0/2655149003 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a400c8290 0x7f8a400b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 >> 172.21.15.148:0/2655149003 conn(0x7f8a400945d0 msgr2=0x7f8a40063f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 shutdown_connections 2023-10-24T00:41:22.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.572+0000 7f8a46717700 1 -- 172.21.15.148:0/2655149003 wait complete. 2023-10-24T00:41:22.586 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-10-24T00:41:22.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:22.587 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-24T00:41:22.604 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:22.605 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:22.606 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:22.607 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:22.607 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_30_00_UTC', 'scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:22.607 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-10-24T00:41:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.760+0000 7f544dfc1700 1 Processor -- start 2023-10-24T00:41:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.760+0000 7f544dfc1700 1 -- start start 2023-10-24T00:41:22.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544dfc1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a5970 0x7f54480a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544dfc1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54480a8090 0x7f54480c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544dfc1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480a5df0 con 0x7f5448151fc0 2023-10-24T00:41:22.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544dfc1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480bdd60 con 0x7f54480a5970 2023-10-24T00:41:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544dfc1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480c3d30 con 0x7f54480a8090 2023-10-24T00:41:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a5970 0x7f54480a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54480a5970 0x7f54480a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35914/0 (socket says 172.21.15.148:35914) 2023-10-24T00:41:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 -- 172.21.15.148:0/3294760069 learned_addr learned my addr 172.21.15.148:0/3294760069 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f544d7c0700 1 --2- 172.21.15.148:0/3294760069 >> v2:172.21.15.150:3300/0 conn(0x7f54480a8090 0x7f54480c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 -- 172.21.15.148:0/3294760069 >> v2:172.21.15.150:3300/0 conn(0x7f54480a8090 msgr2=0x7f54480c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 --2- 172.21.15.148:0/3294760069 >> v2:172.21.15.150:3300/0 conn(0x7f54480a8090 0x7f54480c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 -- 172.21.15.148:0/3294760069 >> v1:172.21.15.150:6789/0 conn(0x7f5448151fc0 legacy=0x7f54480c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 -- 172.21.15.148:0/3294760069 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480c3fd0 con 0x7f54480a5970 2023-10-24T00:41:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543ffff700 1 --2- 172.21.15.148:0/3294760069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a5970 0x7f54480a7ba0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f54480be0f0 tx=0x7f54380090f0).ready entity=mon.0 client_cookie=17bfc1397d4ea122 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543f7fe700 1 -- 172.21.15.148:0/3294760069 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800b520 con 0x7f54480a5970 2023-10-24T00:41:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543f7fe700 1 -- 172.21.15.148:0/3294760069 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800b680 con 0x7f54480a5970 2023-10-24T00:41:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.761+0000 7f543f7fe700 1 -- 172.21.15.148:0/3294760069 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800ba00 con 0x7f54480a5970 2023-10-24T00:41:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 -- 172.21.15.148:0/3294760069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a5970 msgr2=0x7f54480a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 --2- 172.21.15.148:0/3294760069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a5970 0x7f54480a7ba0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f54480be0f0 tx=0x7f54380090f0).stop 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 -- 172.21.15.148:0/3294760069 shutdown_connections 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 --2- 172.21.15.148:0/3294760069 >> v2:172.21.15.150:3300/0 conn(0x7f54480a8090 0x7f54480c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 --2- 172.21.15.148:0/3294760069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54480a5970 0x7f54480a7ba0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 -- 172.21.15.148:0/3294760069 >> 172.21.15.148:0/3294760069 conn(0x7f5448092240 msgr2=0x7f5448062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 -- 172.21.15.148:0/3294760069 shutdown_connections 2023-10-24T00:41:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.762+0000 7f544dfc1700 1 -- 172.21.15.148:0/3294760069 wait complete. 2023-10-24T00:41:22.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.763+0000 7f544dfc1700 1 Processor -- start 2023-10-24T00:41:22.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.763+0000 7f544dfc1700 1 -- start start 2023-10-24T00:41:22.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a5970 0x7f5448152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480a8090 0x7f5448143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448153260 con 0x7f5448151fc0 2023-10-24T00:41:22.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448144270 con 0x7f54480a8090 2023-10-24T00:41:22.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544dfc1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154050 con 0x7f54480a5970 2023-10-24T00:41:22.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35918/0 (socket says 172.21.15.148:35918) 2023-10-24T00:41:22.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 -- 172.21.15.148:0/387441191 learned_addr learned my addr 172.21.15.148:0/387441191 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:22.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f543ffff700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480a8090 0x7f5448143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544cfbf700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a5970 0x7f5448152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 -- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a5970 msgr2=0x7f5448152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a5970 0x7f5448152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 -- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480a8090 msgr2=0x7f5448143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480a8090 0x7f5448143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.764+0000 7f544d7c0700 1 -- 172.21.15.148:0/387441191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009370 con 0x7f5448151fc0 2023-10-24T00:41:22.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f544d7c0700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f544000e8d0 tx=0x7f5440009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440009530 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440012600 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544814d0e0 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400129a0 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.765+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5448153720 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.766+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5448047480 con 0x7f5448151fc0 2023-10-24T00:41:22.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.766+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f5440012d50 con 0x7f5448151fc0 2023-10-24T00:41:22.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.767+0000 7f543cff9700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 0x7f5434061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:22.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.767+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f544007a840 con 0x7f5448151fc0 2023-10-24T00:41:22.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.767+0000 7f544cfbf700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 0x7f5434061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:22.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.767+0000 7f544cfbf700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 0x7f5434061750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5444000f80 tx=0x7f5444009040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:22.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.771+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f544004b8c0 con 0x7f5448151fc0 2023-10-24T00:41:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.960+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54480a84c0 con 0x7f543405f290 2023-10-24T00:41:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.961+0000 7f543cff9700 1 -- 172.21.15.148:0/387441191 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f54480a84c0 con 0x7f543405f290 2023-10-24T00:41:22.964 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:22.964 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:22.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 msgr2=0x7f5434061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 0x7f5434061750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5444000f80 tx=0x7f5444009040).stop 2023-10-24T00:41:22.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 msgr2=0x7f544814cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:22.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f544000e8d0 tx=0x7f5440009060).stop 2023-10-24T00:41:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 shutdown_connections 2023-10-24T00:41:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f543405f290 0x7f5434061750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5448151fc0 0x7f544814cbf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54480a5970 0x7f5448152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 --2- 172.21.15.148:0/387441191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54480a8090 0x7f5448143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:22.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 >> 172.21.15.148:0/387441191 conn(0x7f5448092240 msgr2=0x7f54480a6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:22.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 shutdown_connections 2023-10-24T00:41:22.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:22.963+0000 7f544dfc1700 1 -- 172.21.15.148:0/387441191 wait complete. 2023-10-24T00:41:22.977 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:22.978 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:29:58', 'first': '2023-10-24T00:30:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:22.978 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 12 2023-10-24T00:41:22.978 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 12 2023-10-24T00:41:22.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:22.979 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-24T00:41:22.995 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:22.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:22.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:22.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:22.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:22.997 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:22.997 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:22.997 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:22.997 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:22.997 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:22.998 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:22.998 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:22.998 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_30_00_UTC', 'scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:22.999 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-10-24T00:41:23.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.150+0000 7fa546eda700 1 Processor -- start 2023-10-24T00:41:23.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.150+0000 7fa546eda700 1 -- start start 2023-10-24T00:41:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa546eda700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5401544b0 0x7fa5400a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa546eda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5400aa640 0x7fa5400c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa546eda700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400c6270 con 0x7fa5400c8290 2023-10-24T00:41:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa546eda700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400c60e0 con 0x7fa5401544b0 2023-10-24T00:41:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa546eda700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c0c80 con 0x7fa5400aa640 2023-10-24T00:41:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa537fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa5400c8290 0x7fa5400a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39242/0 (socket says 172.21.15.148:39242) 2023-10-24T00:41:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa537fff700 1 -- 172.21.15.148:0/742620302 learned_addr learned my addr 172.21.15.148:0/742620302 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.151+0000 7fa544c76700 1 --2- 172.21.15.148:0/742620302 >> v2:172.21.15.150:3300/0 conn(0x7fa5401544b0 0x7fa5400a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa5377fe700 1 -- 172.21.15.148:0/742620302 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242642628 0 0) 0x7fa5400c6270 con 0x7fa5400c8290 2023-10-24T00:41:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa5377fe700 1 -- 172.21.15.148:0/742620302 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5280033f0 con 0x7fa5400c8290 2023-10-24T00:41:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa545477700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5400aa640 0x7fa5400c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa544c76700 1 -- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5400aa640 msgr2=0x7fa5400c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa544c76700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5400aa640 0x7fa5400c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa544c76700 1 -- 172.21.15.148:0/742620302 >> v1:172.21.15.148:6789/0 conn(0x7fa5400c8290 legacy=0x7fa5400a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa544c76700 1 -- 172.21.15.148:0/742620302 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400c0f40 con 0x7fa5401544b0 2023-10-24T00:41:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa544c76700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5401544b0 0x7fa5400a7d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa53c009760 tx=0x7fa53c009060).ready entity=mon.1 client_cookie=704790651395695 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa5377fe700 1 -- 172.21.15.148:0/742620302 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00f510 con 0x7fa5401544b0 2023-10-24T00:41:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa5377fe700 1 -- 172.21.15.148:0/742620302 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00f670 con 0x7fa5401544b0 2023-10-24T00:41:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.152+0000 7fa5377fe700 1 -- 172.21.15.148:0/742620302 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00f9f0 con 0x7fa5401544b0 2023-10-24T00:41:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 -- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5401544b0 msgr2=0x7fa5400a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5401544b0 0x7fa5400a7d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa53c009760 tx=0x7fa53c009060).stop 2023-10-24T00:41:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 -- 172.21.15.148:0/742620302 shutdown_connections 2023-10-24T00:41:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5400aa640 0x7fa5400c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 --2- 172.21.15.148:0/742620302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5401544b0 0x7fa5400a7d00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 -- 172.21.15.148:0/742620302 >> 172.21.15.148:0/742620302 conn(0x7fa5400945d0 msgr2=0x7fa54006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 -- 172.21.15.148:0/742620302 shutdown_connections 2023-10-24T00:41:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.153+0000 7fa546eda700 1 -- 172.21.15.148:0/742620302 wait complete. 2023-10-24T00:41:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.154+0000 7fa546eda700 1 Processor -- start 2023-10-24T00:41:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.154+0000 7fa546eda700 1 -- start start 2023-10-24T00:41:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 0x7fa540155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5401544b0 0x7fa5400b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54014a5b0 con 0x7fa5400c8290 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540155910 con 0x7fa5400aa640 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa540156ad0 con 0x7fa5401544b0 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35920/0 (socket says 172.21.15.148:35920) 2023-10-24T00:41:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 -- 172.21.15.148:0/2110564899 learned_addr learned my addr 172.21.15.148:0/2110564899 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa544c76700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 0x7fa540155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 -- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5401544b0 msgr2=0x7fa5400b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5401544b0 0x7fa5400b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 -- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 msgr2=0x7fa540155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 0x7fa540155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 -- 172.21.15.148:0/2110564899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0092a0 con 0x7fa5400c8290 2023-10-24T00:41:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa544c76700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 0x7fa540155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa537fff700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa53000c490 tx=0x7fa530007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300072e0 con 0x7fa5400c8290 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530007440 con 0x7fa5400c8290 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300057a0 con 0x7fa5400c8290 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.155+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540156f60 con 0x7fa5400c8290 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.156+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540156480 con 0x7fa5400c8290 2023-10-24T00:41:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.157+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54006c6b0 con 0x7fa5400c8290 2023-10-24T00:41:23.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.157+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fa530005b50 con 0x7fa5400c8290 2023-10-24T00:41:23.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.157+0000 7fa534ff9700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 0x7fa52c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.157+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa530079c60 con 0x7fa5400c8290 2023-10-24T00:41:23.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.157+0000 7fa544c76700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 0x7fa52c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.158+0000 7fa544c76700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 0x7fa52c061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa53c009fd0 tx=0x7fa53c017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.161+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa53004ace0 con 0x7fa5400c8290 2023-10-24T00:41:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.352+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5400c8970 con 0x7fa52c05f2c0 2023-10-24T00:41:23.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.354+0000 7fa534ff9700 1 -- 172.21.15.148:0/2110564899 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa53c000c50 con 0x7fa52c05f2c0 2023-10-24T00:41:23.356 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:23.356 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 msgr2=0x7fa52c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 0x7fa52c061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa53c009fd0 tx=0x7fa53c017000).stop 2023-10-24T00:41:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 msgr2=0x7fa5400ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa53000c490 tx=0x7fa530007c70).stop 2023-10-24T00:41:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 shutdown_connections 2023-10-24T00:41:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5401544b0 0x7fa5400b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5400aa640 0x7fa540155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa52c05f2c0 0x7fa52c061780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 --2- 172.21.15.148:0/2110564899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5400c8290 0x7fa5400ae990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.355+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 >> 172.21.15.148:0/2110564899 conn(0x7fa5400945d0 msgr2=0x7fa5400a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.356+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 shutdown_connections 2023-10-24T00:41:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.356+0000 7fa546eda700 1 -- 172.21.15.148:0/2110564899 wait complete. 2023-10-24T00:41:23.369 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:23.370 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:29:58', 'first': '2023-10-24T00:30:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:23.370 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 12 2023-10-24T00:41:23.370 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 12 2023-10-24T00:41:23.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:23.371 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-24T00:41:23.387 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:23.387 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:23.387 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:23.387 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:23.388 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:23.388 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:23.388 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:23.388 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:23.388 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:23.389 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:23.389 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:23.389 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:23.390 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_30_00_UTC', 'scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:23.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-10-24T00:41:23.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.545+0000 7fb32e9ff700 1 Processor -- start 2023-10-24T00:41:23.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.545+0000 7fb32e9ff700 1 -- start start 2023-10-24T00:41:23.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e9ff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb328154250 0x7fb3280c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e9ff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 0x7fb3280a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e9ff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3280644a0 con 0x7fb3280c3220 2023-10-24T00:41:23.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e9ff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328154630 con 0x7fb328154250 2023-10-24T00:41:23.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e9ff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280be930 con 0x7fb3280c6310 2023-10-24T00:41:23.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e1fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb3280c3220 0x7fb328064930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46552/0 (socket says 172.21.15.148:46552) 2023-10-24T00:41:23.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32e1fe700 1 -- 172.21.15.148:0/1975173544 learned_addr learned my addr 172.21.15.148:0/1975173544 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:23.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32d1fc700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 0x7fb3280a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1975173544 >> v2:172.21.15.150:3300/0 conn(0x7fb328154250 0x7fb3280c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32c9fb700 1 -- 172.21.15.148:0/1975173544 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889575641 0 0) 0x7fb3280644a0 con 0x7fb3280c3220 2023-10-24T00:41:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.546+0000 7fb32c9fb700 1 -- 172.21.15.148:0/1975173544 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3140033f0 con 0x7fb3280c3220 2023-10-24T00:41:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d9fd700 1 -- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 msgr2=0x7fb3280a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 0x7fb3280a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d9fd700 1 -- 172.21.15.148:0/1975173544 >> v1:172.21.15.148:6789/0 conn(0x7fb3280c3220 legacy=0x7fb328064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d9fd700 1 -- 172.21.15.148:0/1975173544 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280bec10 con 0x7fb328154250 2023-10-24T00:41:23.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d1fc700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 0x7fb3280a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:23.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb328154250 0x7fb3280c5e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb324006fd0 tx=0x7fb324006f40).ready entity=mon.1 client_cookie=ab857b89e2d01105 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32c9fb700 1 -- 172.21.15.148:0/1975173544 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324005880 con 0x7fb328154250 2023-10-24T00:41:23.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32c9fb700 1 -- 172.21.15.148:0/1975173544 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240059e0 con 0x7fb328154250 2023-10-24T00:41:23.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32c9fb700 1 -- 172.21.15.148:0/1975173544 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324005d60 con 0x7fb328154250 2023-10-24T00:41:23.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb328154250 msgr2=0x7fb3280c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb328154250 0x7fb3280c5e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb324006fd0 tx=0x7fb324006f40).stop 2023-10-24T00:41:23.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1975173544 shutdown_connections 2023-10-24T00:41:23.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb328154250 0x7fb3280c5e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1975173544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3280c6310 0x7fb3280a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1975173544 >> 172.21.15.148:0/1975173544 conn(0x7fb328092240 msgr2=0x7fb328062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:23.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1975173544 shutdown_connections 2023-10-24T00:41:23.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.547+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1975173544 wait complete. 2023-10-24T00:41:23.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 Processor -- start 2023-10-24T00:41:23.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 -- start start 2023-10-24T00:41:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280c3220 0x7fb3280ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 0x7fb3281675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32815a480 con 0x7fb3280c6310 2023-10-24T00:41:23.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328154d40 con 0x7fb3280c3220 2023-10-24T00:41:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32e9ff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280acd40 con 0x7fb328154250 2023-10-24T00:41:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32d1fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32d1fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60242/0 (socket says 172.21.15.148:60242) 2023-10-24T00:41:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.549+0000 7fb32d1fc700 1 -- 172.21.15.148:0/1275637487 learned_addr learned my addr 172.21.15.148:0/1275637487 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:23.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280c3220 0x7fb3280ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32e1fe700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 0x7fb3281675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 -- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 msgr2=0x7fb3281675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 0x7fb3281675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 -- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280c3220 msgr2=0x7fb3280ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280c3220 0x7fb3280ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 -- 172.21.15.148:0/1275637487 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180092a0 con 0x7fb3280c6310 2023-10-24T00:41:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32e1fe700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 0x7fb3281675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:23.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32d1fc700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fb31800e980 tx=0x7fb318009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800ee70 con 0x7fb3280c6310 2023-10-24T00:41:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31800c7f0 con 0x7fb3280c6310 2023-10-24T00:41:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb324009250 con 0x7fb3280c6310 2023-10-24T00:41:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800cb70 con 0x7fb3280c6310 2023-10-24T00:41:23.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.550+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280ad300 con 0x7fb3280c6310 2023-10-24T00:41:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.551+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb328154eb0 con 0x7fb3280c6310 2023-10-24T00:41:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.551+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fb31801b400 con 0x7fb3280c6310 2023-10-24T00:41:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.552+0000 7fb31dffb700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 0x7fb30c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.552+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fb31807aa10 con 0x7fb3280c6310 2023-10-24T00:41:23.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.552+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 0x7fb30c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.552+0000 7fb32d9fd700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 0x7fb30c061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb324006f80 tx=0x7fb324015000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.556+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb31804bae0 con 0x7fb3280c6310 2023-10-24T00:41:23.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.748+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb32806c160 con 0x7fb30c05f2c0 2023-10-24T00:41:23.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.750+0000 7fb31dffb700 1 -- 172.21.15.148:0/1275637487 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb32806c160 con 0x7fb30c05f2c0 2023-10-24T00:41:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:23.753 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:23.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.751+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 msgr2=0x7fb30c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 0x7fb30c061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb324006f80 tx=0x7fb324015000).stop 2023-10-24T00:41:23.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 msgr2=0x7fb32814fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fb31800e980 tx=0x7fb318009060).stop 2023-10-24T00:41:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 shutdown_connections 2023-10-24T00:41:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328154250 0x7fb3281675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280c3220 0x7fb3280ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb30c05f2c0 0x7fb30c061780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 --2- 172.21.15.148:0/1275637487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280c6310 0x7fb32814fae0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 >> 172.21.15.148:0/1275637487 conn(0x7fb328092240 msgr2=0x7fb3280c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 shutdown_connections 2023-10-24T00:41:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.752+0000 7fb32e9ff700 1 -- 172.21.15.148:0/1275637487 wait complete. 2023-10-24T00:41:23.766 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:58", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:23.766 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:29:58', 'first': '2023-10-24T00:30:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:23.767 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 12 2023-10-24T00:41:23.767 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 12 2023-10-24T00:41:23.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:23.768 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-24T00:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:23.784 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:23.785 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:23.786 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:23.787 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_30_00_UTC', 'scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:23.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-10-24T00:41:23.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.938+0000 7f91da066700 1 Processor -- start 2023-10-24T00:41:23.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.938+0000 7f91da066700 1 -- start start 2023-10-24T00:41:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91da066700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 0x7f91d4063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91da066700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91d40be080 0x7f91d40be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91da066700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d40640d0 con 0x7f91d4137570 2023-10-24T00:41:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91da066700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d4137950 con 0x7f91d40be080 2023-10-24T00:41:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91da066700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d4157fd0 con 0x7f91d4063760 2023-10-24T00:41:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91d3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91d40be080 0x7f91d40be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91d3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f91d40be080 0x7f91d40be4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60250/0 (socket says 172.21.15.148:60250) 2023-10-24T00:41:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.939+0000 7f91d3fff700 1 -- 172.21.15.148:0/675027369 learned_addr learned my addr 172.21.15.148:0/675027369 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d2ffd700 1 --2- 172.21.15.148:0/675027369 >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 0x7f91d4063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d3fff700 1 -- 172.21.15.148:0/675027369 >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 msgr2=0x7f91d4063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d3fff700 1 --2- 172.21.15.148:0/675027369 >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 0x7f91d4063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d3fff700 1 -- 172.21.15.148:0/675027369 >> v1:172.21.15.150:6789/0 conn(0x7f91d4137570 legacy=0x7f91d40665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d3fff700 1 -- 172.21.15.148:0/675027369 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4158270 con 0x7f91d40be080 2023-10-24T00:41:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d2ffd700 1 --2- 172.21.15.148:0/675027369 >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 0x7f91d4063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d3fff700 1 --2- 172.21.15.148:0/675027369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d40be080 0x7f91d40be4c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f91d40a88f0 tx=0x7f91cc0090f0).ready entity=mon.0 client_cookie=97e818e7addaa15 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d27fc700 1 -- 172.21.15.148:0/675027369 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00b600 con 0x7f91d40be080 2023-10-24T00:41:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d27fc700 1 -- 172.21.15.148:0/675027369 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc00b760 con 0x7f91d40be080 2023-10-24T00:41:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91d27fc700 1 -- 172.21.15.148:0/675027369 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00bae0 con 0x7f91d40be080 2023-10-24T00:41:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 -- 172.21.15.148:0/675027369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d40be080 msgr2=0x7f91d40be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 --2- 172.21.15.148:0/675027369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d40be080 0x7f91d40be4c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f91d40a88f0 tx=0x7f91cc0090f0).stop 2023-10-24T00:41:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 -- 172.21.15.148:0/675027369 shutdown_connections 2023-10-24T00:41:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 --2- 172.21.15.148:0/675027369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d40be080 0x7f91d40be4c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 --2- 172.21.15.148:0/675027369 >> v2:172.21.15.150:3300/0 conn(0x7f91d4063760 0x7f91d4063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 -- 172.21.15.148:0/675027369 >> 172.21.15.148:0/675027369 conn(0x7f91d4063120 msgr2=0x7f91d40c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.940+0000 7f91da066700 1 -- 172.21.15.148:0/675027369 shutdown_connections 2023-10-24T00:41:23.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.941+0000 7f91da066700 1 -- 172.21.15.148:0/675027369 wait complete. 2023-10-24T00:41:23.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 Processor -- start 2023-10-24T00:41:23.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 -- start start 2023-10-24T00:41:23.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91d4063760 0x7f91d40ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d40be080 0x7f91d40a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40aaec0 con 0x7f91d4137570 2023-10-24T00:41:23.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.942+0000 7f91da066700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40aa5e0 con 0x7f91d40be080 2023-10-24T00:41:23.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91da066700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40acb10 con 0x7f91d4063760 2023-10-24T00:41:23.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60266/0 (socket says 172.21.15.148:60266) 2023-10-24T00:41:23.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 -- 172.21.15.148:0/1810892831 learned_addr learned my addr 172.21.15.148:0/1810892831 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:23.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d2ffd700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d40be080 0x7f91d40a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d37fe700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91d4063760 0x7f91d40ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 -- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91d4063760 msgr2=0x7f91d40ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91d4063760 0x7f91d40ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 -- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d40be080 msgr2=0x7f91d40a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:23.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d40be080 0x7f91d40a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:23.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 -- 172.21.15.148:0/1810892831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc009370 con 0x7f91d4137570 2023-10-24T00:41:23.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91d3fff700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f91d414f040 tx=0x7f91cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc006d90 con 0x7f91d4137570 2023-10-24T00:41:23.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc00bea0 con 0x7f91d4137570 2023-10-24T00:41:23.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40aa870 con 0x7f91d4137570 2023-10-24T00:41:23.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc00bae0 con 0x7f91d4137570 2023-10-24T00:41:23.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.943+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d40a9930 con 0x7f91d4137570 2023-10-24T00:41:23.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.944+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d406c6b0 con 0x7f91d4137570 2023-10-24T00:41:23.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.945+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f91cc01b870 con 0x7f91d4137570 2023-10-24T00:41:23.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.945+0000 7f91bb7fe700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 0x7f91c0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:23.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.945+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f91cc07bc60 con 0x7f91d4137570 2023-10-24T00:41:23.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.945+0000 7f91d37fe700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 0x7f91c0061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:23.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.945+0000 7f91d37fe700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 0x7f91c0061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f91c4007fd0 tx=0x7f91c4001530).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:23.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:23.949+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f91cc04cda0 con 0x7f91d4137570 2023-10-24T00:41:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.136+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91d4158550 con 0x7f91c005f2c0 2023-10-24T00:41:24.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.138+0000 7f91bb7fe700 1 -- 172.21.15.148:0/1810892831 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f91d4158550 con 0x7f91c005f2c0 2023-10-24T00:41:24.140 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:24.140 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:59", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 msgr2=0x7f91c0061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 0x7f91c0061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f91c4007fd0 tx=0x7f91c4001530).stop 2023-10-24T00:41:24.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 msgr2=0x7f91d414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f91d414f040 tx=0x7f91cc017000).stop 2023-10-24T00:41:24.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 shutdown_connections 2023-10-24T00:41:24.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91c005f2c0 0x7f91c0061780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91d4137570 0x7f91d414e490 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91d4063760 0x7f91d40ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 --2- 172.21.15.148:0/1810892831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91d40be080 0x7f91d40a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 >> 172.21.15.148:0/1810892831 conn(0x7f91d4063120 msgr2=0x7f91d4136a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:24.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 shutdown_connections 2023-10-24T00:41:24.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.140+0000 7f91da066700 1 -- 172.21.15.148:0/1810892831 wait complete. 2023-10-24T00:41:24.154 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:59", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.154 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:29:59', 'first': '2023-10-24T00:30:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:24.154 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 12 2023-10-24T00:41:24.155 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 12 2023-10-24T00:41:24.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:24.156 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-24T00:41:24.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:24.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:24.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:24.174 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:24.174 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:24.174 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:24.174 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:24.174 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_30_00_UTC', 'scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:24.175 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-10-24T00:41:24.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.327+0000 7f1b6ffff700 1 Processor -- start 2023-10-24T00:41:24.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.327+0000 7f1b6ffff700 1 -- start start 2023-10-24T00:41:24.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b700c81e0 0x7f1b70153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6ffff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b700c7770 con 0x7f1b700a9f40 2023-10-24T00:41:24.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6ffff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b700c8670 con 0x7f1b700c81e0 2023-10-24T00:41:24.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700c1070 con 0x7f1b70155350 2023-10-24T00:41:24.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b700c81e0 0x7f1b70153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b700c81e0 0x7f1b70153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:58556/0 (socket says 172.21.15.148:58556) 2023-10-24T00:41:24.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:38888/0 (socket says 172.21.15.148:38888) 2023-10-24T00:41:24.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1b700a9f40 0x7f1b700c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:40932/0 (socket says 172.21.15.148:40932) 2023-10-24T00:41:24.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/1493190725 learned_addr learned my addr 172.21.15.148:0/1493190725 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:24.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 msgr2=0x7f1b700aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:24.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/1493190725 >> v1:172.21.15.150:6789/0 conn(0x7f1b700a9f40 legacy=0x7f1b700c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/1493190725 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700c79e0 con 0x7f1b700c81e0 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6dffb700 1 -- 172.21.15.148:0/1493190725 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283135594 0 0) 0x7f1b700c7770 con 0x7f1b700a9f40 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.328+0000 7f1b6e7fc700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6f7fe700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700c81e0 0x7f1b70153b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1b68009f20 tx=0x7f1b68009840).ready entity=mon.1 client_cookie=b0d927d83e2c10ad server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6dffb700 1 -- 172.21.15.148:0/1493190725 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800e070 con 0x7f1b700c81e0 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6dffb700 1 -- 172.21.15.148:0/1493190725 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800b9d0 con 0x7f1b700c81e0 2023-10-24T00:41:24.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6dffb700 1 -- 172.21.15.148:0/1493190725 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800bd50 con 0x7f1b700c81e0 2023-10-24T00:41:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 -- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700c81e0 msgr2=0x7f1b70153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700c81e0 0x7f1b70153b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f1b68009f20 tx=0x7f1b68009840).stop 2023-10-24T00:41:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 -- 172.21.15.148:0/1493190725 shutdown_connections 2023-10-24T00:41:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700c81e0 0x7f1b70153b60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/1493190725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b70155350 0x7f1b700aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 -- 172.21.15.148:0/1493190725 >> 172.21.15.148:0/1493190725 conn(0x7f1b70094420 msgr2=0x7f1b7006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:24.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 -- 172.21.15.148:0/1493190725 shutdown_connections 2023-10-24T00:41:24.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.329+0000 7f1b6ffff700 1 -- 172.21.15.148:0/1493190725 wait complete. 2023-10-24T00:41:24.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.330+0000 7f1b6ffff700 1 Processor -- start 2023-10-24T00:41:24.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 -- start start 2023-10-24T00:41:24.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700a9f40 0x7f1b700aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b700c81e0 0x7f1b7014e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700abce0 con 0x7f1b70155350 2023-10-24T00:41:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700ab0d0 con 0x7f1b700a9f40 2023-10-24T00:41:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700ab3b0 con 0x7f1b700c81e0 2023-10-24T00:41:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60270/0 (socket says 172.21.15.148:60270) 2023-10-24T00:41:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/2280224686 learned_addr learned my addr 172.21.15.148:0/2280224686 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6effd700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700a9f40 0x7f1b700aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.331+0000 7f1b6e7fc700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b700c81e0 0x7f1b7014e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b700c81e0 msgr2=0x7f1b7014e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b700c81e0 0x7f1b7014e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700a9f40 msgr2=0x7f1b700aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700a9f40 0x7f1b700aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 -- 172.21.15.148:0/2280224686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640092a0 con 0x7f1b70155350 2023-10-24T00:41:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6f7fe700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f1b6800b610 tx=0x7f1b68009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680092e0 con 0x7f1b70155350 2023-10-24T00:41:24.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6801e470 con 0x7f1b70155350 2023-10-24T00:41:24.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b68009ae0 con 0x7f1b70155350 2023-10-24T00:41:24.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6801e830 con 0x7f1b70155350 2023-10-24T00:41:24.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.332+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b700ab970 con 0x7f1b70155350 2023-10-24T00:41:24.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.333+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b70154a70 con 0x7f1b70155350 2023-10-24T00:41:24.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.333+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1b68003040 con 0x7f1b70155350 2023-10-24T00:41:24.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.334+0000 7f1b56ffd700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 0x7f1b5c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.334+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1b6807be20 con 0x7f1b70155350 2023-10-24T00:41:24.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.334+0000 7f1b6effd700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 0x7f1b5c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.335+0000 7f1b6effd700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 0x7f1b5c061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1b60004820 tx=0x7f1b60007dc0).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.338+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b6804cea0 con 0x7f1b70155350 2023-10-24T00:41:24.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.525+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b700c7cc0 con 0x7f1b5c05f2c0 2023-10-24T00:41:24.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.528+0000 7f1b56ffd700 1 -- 172.21.15.148:0/2280224686 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1b700c7cc0 con 0x7f1b5c05f2c0 2023-10-24T00:41:24.529 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:24.530 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:59", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 msgr2=0x7f1b5c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 0x7f1b5c061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1b60004820 tx=0x7f1b60007dc0).stop 2023-10-24T00:41:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 msgr2=0x7f1b700a8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f1b6800b610 tx=0x7f1b68009840).stop 2023-10-24T00:41:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 shutdown_connections 2023-10-24T00:41:24.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b5c05f2c0 0x7f1b5c061780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b70155350 0x7f1b700a8570 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b700a9f40 0x7f1b700aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 --2- 172.21.15.148:0/2280224686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b700c81e0 0x7f1b7014e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 >> 172.21.15.148:0/2280224686 conn(0x7f1b70094420 msgr2=0x7f1b70155860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 shutdown_connections 2023-10-24T00:41:24.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.529+0000 7f1b6ffff700 1 -- 172.21.15.148:0/2280224686 wait complete. 2023-10-24T00:41:24.543 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:29:59", "first": "2023-10-24T00:30:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.544 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:29:59', 'first': '2023-10-24T00:30:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:24.544 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 12 2023-10-24T00:41:24.544 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 12 2023-10-24T00:41:24.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:24.545 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-24T00:41:24.561 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:24.562 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:24.562 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:24.562 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:24.562 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:24.563 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:24.563 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:24.563 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:24.563 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:24.564 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:24.564 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:24.564 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:24.565 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-10-24T00:41:24.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.717+0000 7f4f2c450700 1 Processor -- start 2023-10-24T00:41:24.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.717+0000 7f4f2c450700 1 -- start start 2023-10-24T00:41:24.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f2414e8e0 0x7f4f240a6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4f24063660 0x7f4f24063ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f24157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f240c6590 con 0x7f4f2414e8e0 2023-10-24T00:41:24.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f24063fd0 con 0x7f4f24063660 2023-10-24T00:41:24.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2c450700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240a4e00 con 0x7f4f241570b0 2023-10-24T00:41:24.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2a1ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f2414e8e0 0x7f4f240a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2a1ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4f2414e8e0 0x7f4f240a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60282/0 (socket says 172.21.15.148:60282) 2023-10-24T00:41:24.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/2596468038 learned_addr learned my addr 172.21.15.148:0/2596468038 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:24.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f299eb700 1 --2- 172.21.15.148:0/2596468038 >> v2:172.21.15.150:3300/0 conn(0x7f4f24063660 0x7f4f24063ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.718+0000 7f4f2a9ed700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f24157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/2596468038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 msgr2=0x7f4f24157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:24.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f24157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/2596468038 >> v2:172.21.15.150:3300/0 conn(0x7f4f24063660 msgr2=0x7f4f24063ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:24.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/2596468038 >> v2:172.21.15.150:3300/0 conn(0x7f4f24063660 0x7f4f24063ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/2596468038 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24154d70 con 0x7f4f2414e8e0 2023-10-24T00:41:24.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2414e8e0 0x7f4f240a6900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4f24069de0 tx=0x7f4f20009840).ready entity=mon.0 client_cookie=40e22ef97f6c89c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f291ea700 1 -- 172.21.15.148:0/2596468038 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000e070 con 0x7f4f2414e8e0 2023-10-24T00:41:24.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f291ea700 1 -- 172.21.15.148:0/2596468038 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000b970 con 0x7f4f2414e8e0 2023-10-24T00:41:24.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f291ea700 1 -- 172.21.15.148:0/2596468038 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000bcf0 con 0x7f4f2414e8e0 2023-10-24T00:41:24.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2c450700 1 -- 172.21.15.148:0/2596468038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2414e8e0 msgr2=0x7f4f240a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.719+0000 7f4f2c450700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2414e8e0 0x7f4f240a6900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4f24069de0 tx=0x7f4f20009840).stop 2023-10-24T00:41:24.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 -- 172.21.15.148:0/2596468038 shutdown_connections 2023-10-24T00:41:24.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f2414e8e0 0x7f4f240a6900 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 --2- 172.21.15.148:0/2596468038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f24157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 --2- 172.21.15.148:0/2596468038 >> v2:172.21.15.150:3300/0 conn(0x7f4f24063660 0x7f4f24063ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 -- 172.21.15.148:0/2596468038 >> 172.21.15.148:0/2596468038 conn(0x7f4f240c49d0 msgr2=0x7f4f24068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:24.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 -- 172.21.15.148:0/2596468038 shutdown_connections 2023-10-24T00:41:24.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.720+0000 7f4f2c450700 1 -- 172.21.15.148:0/2596468038 wait complete. 2023-10-24T00:41:24.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 Processor -- start 2023-10-24T00:41:24.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 -- start start 2023-10-24T00:41:24.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 0x7f4f240be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f240c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240bff10 con 0x7f4f24063660 2023-10-24T00:41:24.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240bf300 con 0x7f4f2414e8e0 2023-10-24T00:41:24.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.721+0000 7f4f2c450700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240bf5e0 con 0x7f4f241570b0 2023-10-24T00:41:24.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60294/0 (socket says 172.21.15.148:60294) 2023-10-24T00:41:24.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/4103594580 learned_addr learned my addr 172.21.15.148:0/4103594580 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:24.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a9ed700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f240c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f299eb700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 0x7f4f240be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 msgr2=0x7f4f240c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f240c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 msgr2=0x7f4f240be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 0x7f4f240be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 -- 172.21.15.148:0/4103594580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009ae0 con 0x7f4f24063660 2023-10-24T00:41:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f299eb700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 0x7f4f240be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2a1ec700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4f2000b610 tx=0x7f4f20009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200092e0 con 0x7f4f24063660 2023-10-24T00:41:24.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20009500 con 0x7f4f24063660 2023-10-24T00:41:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f240bf8c0 con 0x7f4f24063660 2023-10-24T00:41:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000bcf0 con 0x7f4f24063660 2023-10-24T00:41:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.722+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2414e3c0 con 0x7f4f24063660 2023-10-24T00:41:24.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.723+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2406c6b0 con 0x7f4f24063660 2023-10-24T00:41:24.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.723+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f4f20003040 con 0x7f4f24063660 2023-10-24T00:41:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.724+0000 7f4f1a7fc700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 0x7f4f080617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.724+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4f2007b740 con 0x7f4f24063660 2023-10-24T00:41:24.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.724+0000 7f4f299eb700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 0x7f4f080617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.724+0000 7f4f299eb700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 0x7f4f080617b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4f2406ad50 tx=0x7f4f14008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:24.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.728+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4f200502a0 con 0x7f4f24063660 2023-10-24T00:41:24.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.913+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f240c0050 con 0x7f4f0805f2f0 2023-10-24T00:41:24.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.916+0000 7f4f1a7fc700 1 -- 172.21.15.148:0/4103594580 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f4f140097a0 con 0x7f4f0805f2f0 2023-10-24T00:41:24.920 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:24.920 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:00", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 msgr2=0x7f4f080617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 0x7f4f080617b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4f2406ad50 tx=0x7f4f14008040).stop 2023-10-24T00:41:24.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 msgr2=0x7f4f2414ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:24.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4f2000b610 tx=0x7f4f20009840).stop 2023-10-24T00:41:24.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 shutdown_connections 2023-10-24T00:41:24.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4f241570b0 0x7f4f240c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4f0805f2f0 0x7f4f080617b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f24063660 0x7f4f2414ded0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 --2- 172.21.15.148:0/4103594580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f2414e8e0 0x7f4f240be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:24.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 >> 172.21.15.148:0/4103594580 conn(0x7f4f240c49d0 msgr2=0x7f4f240bd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:24.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 shutdown_connections 2023-10-24T00:41:24.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:24.917+0000 7f4f2c450700 1 -- 172.21.15.148:0/4103594580 wait complete. 2023-10-24T00:41:24.932 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:00", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:24.932 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:30:00', 'first': '2023-10-24T00:31:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:24.933 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T00:41:24.933 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T00:41:24.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:24.934 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-24T00:41:24.950 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:24.950 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:24.950 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:24.951 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:24.952 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:24.952 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:24.952 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:24.952 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:24.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-10-24T00:41:25.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.105+0000 7f15cfd96700 1 Processor -- start 2023-10-24T00:41:25.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.105+0000 7f15cfd96700 1 -- start start 2023-10-24T00:41:25.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cfd96700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15c80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cfd96700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80c6270 con 0x7f15c81544b0 2023-10-24T00:41:25.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cfd96700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80c0c80 con 0x7f15c80a7d00 2023-10-24T00:41:25.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cfd96700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80c60e0 con 0x7f15c80aa640 2023-10-24T00:41:25.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cdb32700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f15c81544b0 0x7f15c80c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46554/0 (socket says 172.21.15.148:46554) 2023-10-24T00:41:25.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15cdb32700 1 -- 172.21.15.148:0/1215336748 learned_addr learned my addr 172.21.15.148:0/1215336748 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:25.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860340139 0 0) 0x7f15c80c6270 con 0x7f15c81544b0 2023-10-24T00:41:25.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15ce333700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15c80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.106+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b40033f0 con 0x7f15c81544b0 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647827176 0 0) 0x7f15b40033f0 con 0x7f15c81544b0 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 msgr2=0x7f15c80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15c80c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 >> v1:172.21.15.150:6789/0 conn(0x7f15c80a7d00 legacy=0x7f15c80a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80c0f40 con 0x7f15c81544b0 2023-10-24T00:41:25.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f15c4001470 con 0x7f15c81544b0 2023-10-24T00:41:25.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 >> v1:172.21.15.148:6789/0 conn(0x7f15c81544b0 legacy=0x7f15c80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15b4003910 0x7f15b4003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b4004b80 0x7f15b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80c60e0 con 0x7f15b4003910 2023-10-24T00:41:25.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b400b910 con 0x7f15b4004b80 2023-10-24T00:41:25.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b400bad0 con 0x7f15c80aa640 2023-10-24T00:41:25.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15b4003910 0x7f15b4003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ce333700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b4004b80 0x7f15b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cd331700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 -- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 msgr2=0x7f15b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15c80aa640 0x7f15b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 -- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b4004b80 msgr2=0x7f15b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15b4004b80 0x7f15b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 -- 172.21.15.148:0/1215336748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40033f0 con 0x7f15b4003910 2023-10-24T00:41:25.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15cdb32700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15b4003910 0x7f15b4003d30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f15c400c190 tx=0x7f15c4001e50).ready entity=mon.0 client_cookie=a2196e7edee75f87 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.107+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4007a20 con 0x7f15b4003910 2023-10-24T00:41:25.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c400cac0 con 0x7f15b4003910 2023-10-24T00:41:25.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15ccb30700 1 -- 172.21.15.148:0/1215336748 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400ce40 con 0x7f15b4003910 2023-10-24T00:41:25.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 -- 172.21.15.148:0/1215336748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15b4003910 msgr2=0x7f15b4003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 --2- 172.21.15.148:0/1215336748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15b4003910 0x7f15b4003d30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f15c400c190 tx=0x7f15c4001e50).stop 2023-10-24T00:41:25.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15ce333700 1 -- 172.21.15.148:0/1215336748 reap_dead start 2023-10-24T00:41:25.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 -- 172.21.15.148:0/1215336748 shutdown_connections 2023-10-24T00:41:25.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 -- 172.21.15.148:0/1215336748 >> 172.21.15.148:0/1215336748 conn(0x7f15c80945d0 msgr2=0x7f15c806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:25.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 -- 172.21.15.148:0/1215336748 shutdown_connections 2023-10-24T00:41:25.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.108+0000 7f15cfd96700 1 -- 172.21.15.148:0/1215336748 wait complete. 2023-10-24T00:41:25.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.109+0000 7f15cfd96700 1 Processor -- start 2023-10-24T00:41:25.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.109+0000 7f15cfd96700 1 -- start start 2023-10-24T00:41:25.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4003910 0x7f15c8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c80c9c80 0x7f15c80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8155310 con 0x7f15c80b0420 2023-10-24T00:41:25.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8157780 con 0x7f15c80c9c80 2023-10-24T00:41:25.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cfd96700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80ca5f0 con 0x7f15b4003910 2023-10-24T00:41:25.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60320/0 (socket says 172.21.15.148:60320) 2023-10-24T00:41:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 -- 172.21.15.148:0/3203939707 learned_addr learned my addr 172.21.15.148:0/3203939707 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cdb32700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4003910 0x7f15c8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 -- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4003910 msgr2=0x7f15c8157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4003910 0x7f15c8157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 -- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c80c9c80 msgr2=0x7f15c80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15ce333700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c80c9c80 0x7f15c80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c80c9c80 0x7f15c80ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 -- 172.21.15.148:0/3203939707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80b0eb0 con 0x7f15c80b0420 2023-10-24T00:41:25.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.110+0000 7f15cd331700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f15b8002920 tx=0x7f15b8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.111+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800f640 con 0x7f15c80b0420 2023-10-24T00:41:25.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.111+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800f7a0 con 0x7f15c80b0420 2023-10-24T00:41:25.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.111+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c81549e0 con 0x7f15c80b0420 2023-10-24T00:41:25.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.111+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b800fb20 con 0x7f15c80b0420 2023-10-24T00:41:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.111+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c8154fa0 con 0x7f15c80b0420 2023-10-24T00:41:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.112+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c806c6b0 con 0x7f15c80b0420 2023-10-24T00:41:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.112+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f15b8014450 con 0x7f15c80b0420 2023-10-24T00:41:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.112+0000 7f15bdffb700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 0x7f15ac061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.112+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f15b807a1e0 con 0x7f15c80b0420 2023-10-24T00:41:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.113+0000 7f15cdb32700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 0x7f15ac061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.113+0000 7f15cdb32700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 0x7f15ac061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f15c8099050 tx=0x7f15c4015000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.116+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f15b804aaf0 con 0x7f15c80b0420 2023-10-24T00:41:25.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.307+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15c80c1220 con 0x7f15ac05f2c0 2023-10-24T00:41:25.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.309+0000 7f15bdffb700 1 -- 172.21.15.148:0/3203939707 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f15c80c1220 con 0x7f15ac05f2c0 2023-10-24T00:41:25.312 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:25.312 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:00", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:25.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 msgr2=0x7f15ac061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 0x7f15ac061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f15c8099050 tx=0x7f15c4015000).stop 2023-10-24T00:41:25.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 msgr2=0x7f15c80b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f15b8002920 tx=0x7f15b8007bb0).stop 2023-10-24T00:41:25.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 shutdown_connections 2023-10-24T00:41:25.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15c80c9c80 0x7f15c80ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15b4003910 0x7f15c8157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f15ac05f2c0 0x7f15ac061780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 --2- 172.21.15.148:0/3203939707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15c80b0420 0x7f15c80b08a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 >> 172.21.15.148:0/3203939707 conn(0x7f15c80945d0 msgr2=0x7f15c80c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:25.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 shutdown_connections 2023-10-24T00:41:25.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.311+0000 7f15cfd96700 1 -- 172.21.15.148:0/3203939707 wait complete. 2023-10-24T00:41:25.325 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:00", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:25.326 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:30:00', 'first': '2023-10-24T00:31:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:25.327 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T00:41:25.327 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T00:41:25.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:25.329 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-24T00:41:25.346 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:25.346 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:25.346 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:25.347 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:25.347 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:25.347 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:25.348 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:25.348 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:25.349 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:25.349 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:25.349 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:25.350 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:25.350 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-10-24T00:41:25.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.499+0000 7fe2f18a0700 1 Processor -- start 2023-10-24T00:41:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 -- start start 2023-10-24T00:41:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2ec154040 0x7fe2ec154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0ca270 con 0x7fe2ec1588c0 2023-10-24T00:41:25.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec0cae10 con 0x7fe2ec154040 2023-10-24T00:41:25.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.500+0000 7fe2f18a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0c9660 con 0x7fe2ec0c7840 2023-10-24T00:41:25.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2e3fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe2ec1588c0 0x7fe2ec0ca700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46560/0 (socket says 172.21.15.148:46560) 2023-10-24T00:41:25.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2e3fff700 1 -- 172.21.15.148:0/2105393765 learned_addr learned my addr 172.21.15.148:0/2105393765 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:25.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 --2- 172.21.15.148:0/2105393765 >> v2:172.21.15.150:3300/0 conn(0x7fe2ec154040 0x7fe2ec154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eb7fe700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274626026 0 0) 0x7fe2ec0ca270 con 0x7fe2ec1588c0 2023-10-24T00:41:25.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d80033f0 con 0x7fe2ec1588c0 2023-10-24T00:41:25.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803260736 0 0) 0x7fe2d80033f0 con 0x7fe2ec1588c0 2023-10-24T00:41:25.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 -- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 msgr2=0x7fe2ec0c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec0c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 -- 172.21.15.148:0/2105393765 >> v1:172.21.15.148:6789/0 conn(0x7fe2ec1588c0 legacy=0x7fe2ec0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 -- 172.21.15.148:0/2105393765 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0c9940 con 0x7fe2ec154040 2023-10-24T00:41:25.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2eaffd700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec154040 0x7fe2ec154420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe2dc009760 tx=0x7fe2dc009060).ready entity=mon.1 client_cookie=f801976880f40e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4001470 con 0x7fe2ec154040 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc011400 con 0x7fe2ec154040 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.501+0000 7fe2ea7fc700 1 -- 172.21.15.148:0/2105393765 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc011780 con 0x7fe2ec154040 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 -- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec154040 msgr2=0x7fe2ec154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec154040 0x7fe2ec154420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe2dc009760 tx=0x7fe2dc009060).stop 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 -- 172.21.15.148:0/2105393765 shutdown_connections 2023-10-24T00:41:25.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec0c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/2105393765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec154040 0x7fe2ec154420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 -- 172.21.15.148:0/2105393765 >> 172.21.15.148:0/2105393765 conn(0x7fe2ec069d80 msgr2=0x7fe2ec06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:25.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 -- 172.21.15.148:0/2105393765 shutdown_connections 2023-10-24T00:41:25.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.502+0000 7fe2f18a0700 1 -- 172.21.15.148:0/2105393765 wait complete. 2023-10-24T00:41:25.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.503+0000 7fe2f18a0700 1 Processor -- start 2023-10-24T00:41:25.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.503+0000 7fe2f18a0700 1 -- start start 2023-10-24T00:41:25.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec1588c0 0x7fe2ec14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec156180 con 0x7fe2ec154040 2023-10-24T00:41:25.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec155bc0 con 0x7fe2ec1588c0 2023-10-24T00:41:25.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2f18a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec155ea0 con 0x7fe2ec0c7840 2023-10-24T00:41:25.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60328/0 (socket says 172.21.15.148:60328) 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 -- 172.21.15.148:0/1897136683 learned_addr learned my addr 172.21.15.148:0/1897136683 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2eb7fe700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec1588c0 0x7fe2ec14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 -- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 msgr2=0x7fe2ec155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:25.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 -- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec1588c0 msgr2=0x7fe2ec14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec1588c0 0x7fe2ec14adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 -- 172.21.15.148:0/1897136683 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0092a0 con 0x7fe2ec154040 2023-10-24T00:41:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.504+0000 7fe2e3fff700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe2d400c810 tx=0x7fe2d4001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.505+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4007170 con 0x7fe2ec154040 2023-10-24T00:41:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.505+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d40072f0 con 0x7fe2ec154040 2023-10-24T00:41:25.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.505+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec0c2180 con 0x7fe2ec154040 2023-10-24T00:41:25.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.505+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40048c0 con 0x7fe2ec154040 2023-10-24T00:41:25.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.505+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec0c3890 con 0x7fe2ec154040 2023-10-24T00:41:25.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.506+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0c26a0 con 0x7fe2ec154040 2023-10-24T00:41:25.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.506+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe2d4004c70 con 0x7fe2ec154040 2023-10-24T00:41:25.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.506+0000 7fe2e2ffd700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 0x7fe2cc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.506+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe2d407a0c0 con 0x7fe2ec154040 2023-10-24T00:41:25.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.506+0000 7fe2eaffd700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 0x7fe2cc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.507+0000 7fe2eaffd700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 0x7fe2cc061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe2dc009760 tx=0x7fe2dc016000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.510+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2ec0c26a0 con 0x7fe2ec154040 2023-10-24T00:41:25.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.698+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2ec0c26a0 con 0x7fe2cc05f2c0 2023-10-24T00:41:25.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.700+0000 7fe2e2ffd700 1 -- 172.21.15.148:0/1897136683 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe2ec0c26a0 con 0x7fe2cc05f2c0 2023-10-24T00:41:25.702 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:25.702 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 msgr2=0x7fe2cc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 0x7fe2cc061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe2dc009760 tx=0x7fe2dc016000).stop 2023-10-24T00:41:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 msgr2=0x7fe2ec0c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe2d400c810 tx=0x7fe2d4001ab0).stop 2023-10-24T00:41:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 shutdown_connections 2023-10-24T00:41:25.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2ec1588c0 0x7fe2ec14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2ec0c7840 0x7fe2ec155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2cc05f2c0 0x7fe2cc061780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 --2- 172.21.15.148:0/1897136683 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2ec154040 0x7fe2ec0c33a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 >> 172.21.15.148:0/1897136683 conn(0x7fe2ec069d80 msgr2=0x7fe2ec0c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:25.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 shutdown_connections 2023-10-24T00:41:25.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.701+0000 7fe2f18a0700 1 -- 172.21.15.148:0/1897136683 wait complete. 2023-10-24T00:41:25.715 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:25.716 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:30:01', 'first': '2023-10-24T00:31:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:25.716 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T00:41:25.717 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T00:41:25.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:25.717 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-24T00:41:25.734 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:25.734 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:25.735 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:25.735 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:25.735 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:25.735 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:25.735 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:25.736 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:25.736 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:25.736 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:25.736 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:25.736 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:25.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-10-24T00:41:25.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.889+0000 7f763d5eb700 1 Processor -- start 2023-10-24T00:41:25.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.889+0000 7f763d5eb700 1 -- start start 2023-10-24T00:41:25.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763d5eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76380a9f40 0x7f7638155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763d5eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76380c7770 con 0x7f76380c81e0 2023-10-24T00:41:25.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763d5eb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76380c1070 con 0x7f76380aa320 2023-10-24T00:41:25.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763d5eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76380c79e0 con 0x7f76380a9f40 2023-10-24T00:41:25.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763cdea700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f76380c81e0 0x7f7638153b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46570/0 (socket says 172.21.15.148:46570) 2023-10-24T00:41:25.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f763cdea700 1 -- 172.21.15.148:0/913303862 learned_addr learned my addr 172.21.15.148:0/913303862 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:25.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7637fff700 1 --2- 172.21.15.148:0/913303862 >> v2:172.21.15.150:3300/0 conn(0x7f76380a9f40 0x7f7638155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328630824 0 0) 0x7f76380c7770 con 0x7f76380c81e0 2023-10-24T00:41:25.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76200033f0 con 0x7f76380c81e0 2023-10-24T00:41:25.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960840925 0 0) 0x7f76200033f0 con 0x7f76380c81e0 2023-10-24T00:41:25.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 >> v2:172.21.15.150:3300/0 conn(0x7f76380a9f40 msgr2=0x7f7638155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 --2- 172.21.15.148:0/913303862 >> v2:172.21.15.150:3300/0 conn(0x7f76380a9f40 0x7f7638155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 >> v1:172.21.15.150:6789/0 conn(0x7f76380aa320 legacy=0x7f76380c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380c7cc0 con 0x7f76380c81e0 2023-10-24T00:41:25.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f76300017f0 con 0x7f76380c81e0 2023-10-24T00:41:25.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 >> v1:172.21.15.148:6789/0 conn(0x7f76380c81e0 legacy=0x7f7638153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76200038e0 0x7f7620003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620004690 0x7f7620004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.890+0000 7f7636ffd700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 0x7f762000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76380c79e0 con 0x7f7620005000 2023-10-24T00:41:25.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762000beb0 con 0x7f7620004690 2023-10-24T00:41:25.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762000c070 con 0x7f76200038e0 2023-10-24T00:41:25.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 0x7f762000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7637fff700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76200038e0 0x7f7620003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f76377fe700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620004690 0x7f7620004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 -- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76200038e0 msgr2=0x7f7620003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76200038e0 0x7f7620003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 -- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620004690 msgr2=0x7f7620004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:25.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620004690 0x7f7620004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 -- 172.21.15.148:0/913303862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200033f0 con 0x7f7620005000 2023-10-24T00:41:25.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 -- 172.21.15.148:0/913303862 reap_dead start 2023-10-24T00:41:25.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f763cdea700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 0x7f762000b8e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f763000c480 tx=0x7f763000c790).ready entity=mon.0 client_cookie=83569f3aca8748ac server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630002030 con 0x7f7620005000 2023-10-24T00:41:25.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763000ce20 con 0x7f7620005000 2023-10-24T00:41:25.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.891+0000 7f7636ffd700 1 -- 172.21.15.148:0/913303862 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630005d30 con 0x7f7620005000 2023-10-24T00:41:25.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 -- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 msgr2=0x7f762000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 0x7f762000b8e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f763000c480 tx=0x7f763000c790).stop 2023-10-24T00:41:25.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 -- 172.21.15.148:0/913303862 shutdown_connections 2023-10-24T00:41:25.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 --2- 172.21.15.148:0/913303862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7620005000 0x7f762000b8e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 -- 172.21.15.148:0/913303862 >> 172.21.15.148:0/913303862 conn(0x7f7638094420 msgr2=0x7f763806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:25.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 -- 172.21.15.148:0/913303862 shutdown_connections 2023-10-24T00:41:25.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.892+0000 7f763d5eb700 1 -- 172.21.15.148:0/913303862 wait complete. 2023-10-24T00:41:25.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.893+0000 7f763d5eb700 1 Processor -- start 2023-10-24T00:41:25.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.893+0000 7f763d5eb700 1 -- start start 2023-10-24T00:41:25.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620005000 0x7f7638167620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76380c9330 0x7f76380caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638150230 con 0x7f76380c97b0 2023-10-24T00:41:25.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638167b10 con 0x7f7620005000 2023-10-24T00:41:25.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76380ad0e0 con 0x7f76380c9330 2023-10-24T00:41:25.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60356/0 (socket says 172.21.15.148:60356) 2023-10-24T00:41:25.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 -- 172.21.15.148:0/708677457 learned_addr learned my addr 172.21.15.148:0/708677457 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:25.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f7637fff700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620005000 0x7f7638167620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f76377fe700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76380c9330 0x7f76380caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 -- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76380c9330 msgr2=0x7f76380caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76380c9330 0x7f76380caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 -- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620005000 msgr2=0x7f7638167620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:25.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620005000 0x7f7638167620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:25.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 -- 172.21.15.148:0/708677457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380c8e10 con 0x7f76380c97b0 2023-10-24T00:41:25.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763cdea700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f763805f860 tx=0x7f7630015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630002030 con 0x7f76380c97b0 2023-10-24T00:41:25.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76300017b0 con 0x7f76380c97b0 2023-10-24T00:41:25.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76380ab6f0 con 0x7f76380c97b0 2023-10-24T00:41:25.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.894+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300138b0 con 0x7f76380c97b0 2023-10-24T00:41:25.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.895+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76380abcb0 con 0x7f76380c97b0 2023-10-24T00:41:25.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.896+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76380abea0 con 0x7f76380c97b0 2023-10-24T00:41:25.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.896+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7630013c20 con 0x7f76380c97b0 2023-10-24T00:41:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.896+0000 7f761ffff700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 0x7f7624061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.896+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f763007b5d0 con 0x7f76380c97b0 2023-10-24T00:41:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.896+0000 7f7637fff700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 0x7f7624061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.897+0000 7f7637fff700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 0x7f7624061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7628006f10 tx=0x7f7628006f40).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:25.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:25.900+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f763004c650 con 0x7f76380c97b0 2023-10-24T00:41:26.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.088+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76380c0280 con 0x7f762405f2c0 2023-10-24T00:41:26.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.091+0000 7f761ffff700 1 -- 172.21.15.148:0/708677457 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f76380c0280 con 0x7f762405f2c0 2023-10-24T00:41:26.093 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:26.093 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:26.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 msgr2=0x7f7624061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 0x7f7624061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7628006f10 tx=0x7f7628006f40).stop 2023-10-24T00:41:26.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 msgr2=0x7f76380cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f763805f860 tx=0x7f7630015000).stop 2023-10-24T00:41:26.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 shutdown_connections 2023-10-24T00:41:26.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f762405f2c0 0x7f7624061780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76380c97b0 0x7f76380cb3e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7620005000 0x7f7638167620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 --2- 172.21.15.148:0/708677457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76380c9330 0x7f76380caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 >> 172.21.15.148:0/708677457 conn(0x7f7638094420 msgr2=0x7f7638154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:26.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 shutdown_connections 2023-10-24T00:41:26.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.093+0000 7f763d5eb700 1 -- 172.21.15.148:0/708677457 wait complete. 2023-10-24T00:41:26.107 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:26.107 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:30:01', 'first': '2023-10-24T00:31:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:26.108 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T00:41:26.108 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T00:41:26.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:26.109 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-24T00:41:26.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:26.126 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:26.126 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:26.126 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:26.127 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:26.127 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:26.127 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:26.127 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:26.127 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:26.128 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:26.128 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:26.128 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_31_00_UTC', 'scheduled-2023-10-24-00_32_00_UTC', 'scheduled-2023-10-24-00_33_00_UTC', 'scheduled-2023-10-24-00_34_00_UTC', 'scheduled-2023-10-24-00_35_00_UTC', 'scheduled-2023-10-24-00_36_00_UTC', 'scheduled-2023-10-24-00_37_00_UTC', 'scheduled-2023-10-24-00_38_00_UTC', 'scheduled-2023-10-24-00_39_00_UTC', 'scheduled-2023-10-24-00_40_00_UTC', 'scheduled-2023-10-24-00_41_00_UTC'] 2023-10-24T00:41:26.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-10-24T00:41:26.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.279+0000 7f5c54765700 1 Processor -- start 2023-10-24T00:41:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.279+0000 7f5c54765700 1 -- start start 2023-10-24T00:41:26.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c54765700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c4c1544b0 0x7f5c4c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c54765700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c4c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c54765700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0c6270 con 0x7f5c4c0aa420 2023-10-24T00:41:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c54765700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c60e0 con 0x7f5c4c1544b0 2023-10-24T00:41:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c54765700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0aa890 con 0x7f5c4c0c8290 2023-10-24T00:41:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c52d02700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5c4c0aa420 0x7f5c4c0c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46576/0 (socket says 172.21.15.148:46576) 2023-10-24T00:41:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c52d02700 1 -- 172.21.15.148:0/187007210 learned_addr learned my addr 172.21.15.148:0/187007210 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c51d00700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c4c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c52501700 1 --2- 172.21.15.148:0/187007210 >> v2:172.21.15.150:3300/0 conn(0x7f5c4c1544b0 0x7f5c4c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622217626 0 0) 0x7f5c4c0c6270 con 0x7f5c4c0aa420 2023-10-24T00:41:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.280+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c380033f0 con 0x7f5c4c0aa420 2023-10-24T00:41:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629234755 0 0) 0x7f5c380033f0 con 0x7f5c4c0aa420 2023-10-24T00:41:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 msgr2=0x7f5c4c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c4c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 >> v2:172.21.15.150:3300/0 conn(0x7f5c4c1544b0 msgr2=0x7f5c4c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 --2- 172.21.15.148:0/187007210 >> v2:172.21.15.150:3300/0 conn(0x7f5c4c1544b0 0x7f5c4c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0c0c80 con 0x7f5c4c0aa420 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f5c44001470 con 0x7f5c4c0aa420 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 >> v1:172.21.15.148:6789/0 conn(0x7f5c4c0aa420 legacy=0x7f5c4c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c380038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38003e10 0x7f5c38004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c60e0 con 0x7f5c38004b80 2023-10-24T00:41:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0aa890 con 0x7f5c38003e10 2023-10-24T00:41:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3800b8e0 con 0x7f5c4c0c8290 2023-10-24T00:41:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52501700 1 --2- 172.21.15.148:0/187007210 >> v2:172.21.15.150:3300/0 conn(0x7f5c4c1544b0 0x7f5c4c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:26.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c51d00700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38003e10 0x7f5c38004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52501700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c380038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 -- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 msgr2=0x7f5c380038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c8290 0x7f5c380038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 -- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38003e10 msgr2=0x7f5c38004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38003e10 0x7f5c38004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 -- 172.21.15.148:0/187007210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380033f0 con 0x7f5c38004b80 2023-10-24T00:41:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c52d02700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5c4400c240 tx=0x7f5c44001e90).ready entity=mon.0 client_cookie=f1aecc84cf32f77d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44007a60 con 0x7f5c38004b80 2023-10-24T00:41:26.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400cad0 con 0x7f5c38004b80 2023-10-24T00:41:26.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.281+0000 7f5c514ff700 1 -- 172.21.15.148:0/187007210 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400ce50 con 0x7f5c38004b80 2023-10-24T00:41:26.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 -- 172.21.15.148:0/187007210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c38004b80 msgr2=0x7f5c38005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 --2- 172.21.15.148:0/187007210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c38004b80 0x7f5c38005000 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5c4400c240 tx=0x7f5c44001e90).stop 2023-10-24T00:41:26.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c52d02700 1 -- 172.21.15.148:0/187007210 reap_dead start 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 -- 172.21.15.148:0/187007210 shutdown_connections 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 -- 172.21.15.148:0/187007210 >> 172.21.15.148:0/187007210 conn(0x7f5c4c0945d0 msgr2=0x7f5c4c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 -- 172.21.15.148:0/187007210 shutdown_connections 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.282+0000 7f5c54765700 1 -- 172.21.15.148:0/187007210 wait complete. 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.283+0000 7f5c54765700 1 Processor -- start 2023-10-24T00:41:26.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.283+0000 7f5c54765700 1 -- start start 2023-10-24T00:41:26.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c4c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c9dd0 0x7f5c4c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c37f0 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c4090 con 0x7f5c38004b80 2023-10-24T00:41:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c54765700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ca740 con 0x7f5c4c0c9dd0 2023-10-24T00:41:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60374/0 (socket says 172.21.15.148:60374) 2023-10-24T00:41:26.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 -- 172.21.15.148:0/3979184657 learned_addr learned my addr 172.21.15.148:0/3979184657 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:26.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c52d02700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c9dd0 0x7f5c4c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 -- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c9dd0 msgr2=0x7f5c4c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c9dd0 0x7f5c4c0ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c52501700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c4c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 -- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 msgr2=0x7f5c4c14cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c4c14cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 -- 172.21.15.148:0/3979184657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0c2e50 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.284+0000 7f5c51d00700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5c3c0119c0 tx=0x7f5c3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.285+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00f940 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.285+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00faa0 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.285+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0c3a40 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.285+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00fe20 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.285+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c14d260 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.286+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c06c6b0 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.286+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f5c3c014650 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.286+0000 7f5c427fc700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 0x7f5c30061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.286+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5c3c07b0e0 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.287+0000 7f5c52501700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 0x7f5c30061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.287+0000 7f5c52501700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 0x7f5c30061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5c48007230 tx=0x7f5c4800b040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.290+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5c3c04c160 con 0x7f5c4c0aaa70 2023-10-24T00:41:26.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.476+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c4c0c0f40 con 0x7f5c3005f2c0 2023-10-24T00:41:26.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.478+0000 7f5c427fc700 1 -- 172.21.15.148:0/3979184657 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f5c4c0c0f40 con 0x7f5c3005f2c0 2023-10-24T00:41:26.480 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:26.480 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 msgr2=0x7f5c30061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 0x7f5c30061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5c48007230 tx=0x7f5c4800b040).stop 2023-10-24T00:41:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 msgr2=0x7f5c4c0aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5c3c0119c0 tx=0x7f5c3c009060).stop 2023-10-24T00:41:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 shutdown_connections 2023-10-24T00:41:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c4c0c9dd0 0x7f5c4c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c38004b80 0x7f5c4c14cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c3005f2c0 0x7f5c30061780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 --2- 172.21.15.148:0/3979184657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c4c0aaa70 0x7f5c4c0aaef0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.479+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 >> 172.21.15.148:0/3979184657 conn(0x7f5c4c0945d0 msgr2=0x7f5c4c0638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.480+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 shutdown_connections 2023-10-24T00:41:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.480+0000 7f5c54765700 1 -- 172.21.15.148:0/3979184657 wait complete. 2023-10-24T00:41:26.493 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:30:01", "first": "2023-10-24T00:31:00", "last": "2023-10-24T00:41:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-24T00:41:26.494 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:30:01', 'first': '2023-10-24T00:31:00', 'last': '2023-10-24T00:41:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-24T00:41:26.494 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T00:41:26.495 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T00:41:26.495 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-10-24T00:41:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.611+0000 7f4af8f41700 1 Processor -- start 2023-10-24T00:41:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.611+0000 7f4af8f41700 1 -- start start 2023-10-24T00:41:26.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4af41544b0 0x7f4af40a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af40a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4af40aa420 0x7f4af40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40c60e0 con 0x7f4af40aa420 2023-10-24T00:41:26.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40c6270 con 0x7f4af41544b0 2023-10-24T00:41:26.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af8f41700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40aa890 con 0x7f4af40c8290 2023-10-24T00:41:26.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4af40aa420 0x7f4af40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4af40aa420 0x7f4af40c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60384/0 (socket says 172.21.15.148:60384) 2023-10-24T00:41:26.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 -- 172.21.15.148:0/44286996 learned_addr learned my addr 172.21.15.148:0/44286996 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:26.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af259c700 1 --2- 172.21.15.148:0/44286996 >> v2:172.21.15.150:3300/0 conn(0x7f4af41544b0 0x7f4af40a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4ae9d9b700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af40a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 -- 172.21.15.148:0/44286996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 msgr2=0x7f4af40a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af40a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 -- 172.21.15.148:0/44286996 >> v2:172.21.15.150:3300/0 conn(0x7f4af41544b0 msgr2=0x7f4af40a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:26.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 --2- 172.21.15.148:0/44286996 >> v2:172.21.15.150:3300/0 conn(0x7f4af41544b0 0x7f4af40a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 -- 172.21.15.148:0/44286996 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40c0c80 con 0x7f4af40aa420 2023-10-24T00:41:26.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af2d9d700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af40c6700 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f4af4084570 tx=0x7f4aec009840).ready entity=mon.0 client_cookie=3f89602629ea431a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af1d9b700 1 -- 172.21.15.148:0/44286996 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00e070 con 0x7f4af40aa420 2023-10-24T00:41:26.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af1d9b700 1 -- 172.21.15.148:0/44286996 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec00ba50 con 0x7f4af40aa420 2023-10-24T00:41:26.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.612+0000 7f4af1d9b700 1 -- 172.21.15.148:0/44286996 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00bdd0 con 0x7f4af40aa420 2023-10-24T00:41:26.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 -- 172.21.15.148:0/44286996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 msgr2=0x7f4af40c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af40c6700 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f4af4084570 tx=0x7f4aec009840).stop 2023-10-24T00:41:26.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 -- 172.21.15.148:0/44286996 shutdown_connections 2023-10-24T00:41:26.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af40c6700 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 --2- 172.21.15.148:0/44286996 >> v2:172.21.15.150:3300/0 conn(0x7f4af41544b0 0x7f4af40a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 --2- 172.21.15.148:0/44286996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af40a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 -- 172.21.15.148:0/44286996 >> 172.21.15.148:0/44286996 conn(0x7f4af40945d0 msgr2=0x7f4af406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:26.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 -- 172.21.15.148:0/44286996 shutdown_connections 2023-10-24T00:41:26.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.613+0000 7f4af8f41700 1 -- 172.21.15.148:0/44286996 wait complete. 2023-10-24T00:41:26.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.614+0000 7f4af8f41700 1 Processor -- start 2023-10-24T00:41:26.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.614+0000 7f4af8f41700 1 -- start start 2023-10-24T00:41:26.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af4155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af41544b0 0x7f4af4155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af4155a50 con 0x7f4af40aa420 2023-10-24T00:41:26.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c4770 con 0x7f4af41544b0 2023-10-24T00:41:26.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af8f41700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c3b60 con 0x7f4af40c8290 2023-10-24T00:41:26.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60386/0 (socket says 172.21.15.148:60386) 2023-10-24T00:41:26.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 -- 172.21.15.148:0/3687870783 learned_addr learned my addr 172.21.15.148:0/3687870783 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:26.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4ae9d9b700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af4155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af2d9d700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af41544b0 0x7f4af4155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 -- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 msgr2=0x7f4af4155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af4155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 -- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af41544b0 msgr2=0x7f4af4155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af41544b0 0x7f4af4155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 -- 172.21.15.148:0/3687870783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec009ae0 con 0x7f4af40aa420 2023-10-24T00:41:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4ae9d9b700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af4155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.615+0000 7f4af259c700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f4ae400d8c0 tx=0x7f4ae4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.616+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4009640 con 0x7f4af40aa420 2023-10-24T00:41:26.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.616+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40097a0 con 0x7f4af40aa420 2023-10-24T00:41:26.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.616+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af40c3e40 con 0x7f4af40aa420 2023-10-24T00:41:26.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.616+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4009b20 con 0x7f4af40aa420 2023-10-24T00:41:26.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.616+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40c4400 con 0x7f4af40aa420 2023-10-24T00:41:26.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.617+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af40c8070 con 0x7f4af40aa420 2023-10-24T00:41:26.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.617+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f4ae4013480 con 0x7f4af40aa420 2023-10-24T00:41:26.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.617+0000 7f4aeaffd700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 0x7f4ad4061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:26.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.617+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f4ae407a300 con 0x7f4af40aa420 2023-10-24T00:41:26.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.617+0000 7f4ae9d9b700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 0x7f4ad4061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:26.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.618+0000 7f4ae9d9b700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 0x7f4ad4061750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4af414f4d0 tx=0x7f4adc008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:26.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.621+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ae404b320 con 0x7f4af40aa420 2023-10-24T00:41:26.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.810+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af406c6b0 con 0x7f4ad405f290 2023-10-24T00:41:26.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.814+0000 7f4aeaffd700 1 -- 172.21.15.148:0/3687870783 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f4af406c6b0 con 0x7f4ad405f290 2023-10-24T00:41:26.816 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-10-24T00:41:26.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 msgr2=0x7f4ad4061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 0x7f4ad4061750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4af414f4d0 tx=0x7f4adc008040).stop 2023-10-24T00:41:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 msgr2=0x7f4af414cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f4ae400d8c0 tx=0x7f4ae4008040).stop 2023-10-24T00:41:26.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 shutdown_connections 2023-10-24T00:41:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af41544b0 0x7f4af4155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4ad405f290 0x7f4ad4061750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4af40aa420 0x7f4af414cd70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 --2- 172.21.15.148:0/3687870783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40c8290 0x7f4af4155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:26.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 >> 172.21.15.148:0/3687870783 conn(0x7f4af40945d0 msgr2=0x7f4af40c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:26.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 shutdown_connections 2023-10-24T00:41:26.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:26.816+0000 7f4af8f41700 1 -- 172.21.15.148:0/3687870783 wait complete. 2023-10-24T00:41:26.830 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-10-24T00:41:26.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:26.831 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-24T00:41:26.847 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:26.847 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:26.848 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:26.848 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:26.848 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:26.848 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:26.848 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:26.849 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:26.849 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:26.849 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:26.849 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:26.849 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:26.850 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:26.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:26.851 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_30_00_UTC) 2023-10-24T00:41:26.911 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:26.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:26.912 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:26.972 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:26.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:26.973 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:27.032 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:27.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.033 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:27.095 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:27.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.096 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:27.157 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:27.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.158 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:27.219 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:27.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.220 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:27.281 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:27.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.282 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:27.342 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:27.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.343 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:27.404 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:27.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.405 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:27.468 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:27.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.469 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:27.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:27.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.529 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:27.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:27.591 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-10-24T00:41:27.651 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-10-24T00:41:27.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.807+0000 7fc80e773700 1 Processor -- start 2023-10-24T00:41:27.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.807+0000 7fc80e773700 1 -- start start 2023-10-24T00:41:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc80e773700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8081544b0 0x7fc8080a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc80e773700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc8080c8290 0x7fc8080a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc80e773700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8080c6270 con 0x7fc8080aa420 2023-10-24T00:41:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc80e773700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080c60e0 con 0x7fc8081544b0 2023-10-24T00:41:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc80e773700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080c0c80 con 0x7fc8080c8290 2023-10-24T00:41:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8081544b0 0x7fc8080a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8081544b0 0x7fc8080a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60392/0 (socket says 172.21.15.148:60392) 2023-10-24T00:41:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 -- 172.21.15.148:0/3036515896 learned_addr learned my addr 172.21.15.148:0/3036515896 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc8077fe700 1 --2- 172.21.15.148:0/3036515896 >> v2:172.21.15.150:3300/0 conn(0x7fc8080c8290 0x7fc8080a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 -- 172.21.15.148:0/3036515896 >> v2:172.21.15.150:3300/0 conn(0x7fc8080c8290 msgr2=0x7fc8080a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 --2- 172.21.15.148:0/3036515896 >> v2:172.21.15.150:3300/0 conn(0x7fc8080c8290 0x7fc8080a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 -- 172.21.15.148:0/3036515896 >> v1:172.21.15.150:6789/0 conn(0x7fc8080aa420 legacy=0x7fc8080c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.808+0000 7fc807fff700 1 -- 172.21.15.148:0/3036515896 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080c0f40 con 0x7fc8081544b0 2023-10-24T00:41:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc807fff700 1 --2- 172.21.15.148:0/3036515896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8081544b0 0x7fc8080a7d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc8080a9cf0 tx=0x7fc7f80090f0).ready entity=mon.0 client_cookie=f95d8390ef5f0cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc806ffd700 1 -- 172.21.15.148:0/3036515896 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800b5a0 con 0x7fc8081544b0 2023-10-24T00:41:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc806ffd700 1 -- 172.21.15.148:0/3036515896 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f800b700 con 0x7fc8081544b0 2023-10-24T00:41:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc806ffd700 1 -- 172.21.15.148:0/3036515896 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800ba80 con 0x7fc8081544b0 2023-10-24T00:41:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 -- 172.21.15.148:0/3036515896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8081544b0 msgr2=0x7fc8080a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 --2- 172.21.15.148:0/3036515896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8081544b0 0x7fc8080a7d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc8080a9cf0 tx=0x7fc7f80090f0).stop 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 -- 172.21.15.148:0/3036515896 shutdown_connections 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 --2- 172.21.15.148:0/3036515896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8081544b0 0x7fc8080a7d00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 --2- 172.21.15.148:0/3036515896 >> v2:172.21.15.150:3300/0 conn(0x7fc8080c8290 0x7fc8080a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 -- 172.21.15.148:0/3036515896 >> 172.21.15.148:0/3036515896 conn(0x7fc8080945d0 msgr2=0x7fc80806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 -- 172.21.15.148:0/3036515896 shutdown_connections 2023-10-24T00:41:27.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.809+0000 7fc80e773700 1 -- 172.21.15.148:0/3036515896 wait complete. 2023-10-24T00:41:27.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.810+0000 7fc80e773700 1 Processor -- start 2023-10-24T00:41:27.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 -- start start 2023-10-24T00:41:27.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8080c8290 0x7fc808156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8081544b0 0x7fc80814f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ae960 con 0x7fc8080aa420 2023-10-24T00:41:27.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ac360 con 0x7fc8081544b0 2023-10-24T00:41:27.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80e773700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ac640 con 0x7fc8080c8290 2023-10-24T00:41:27.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc807fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc807fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60396/0 (socket says 172.21.15.148:60396) 2023-10-24T00:41:27.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc807fff700 1 -- 172.21.15.148:0/1161116677 learned_addr learned my addr 172.21.15.148:0/1161116677 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:27.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.811+0000 7fc80cd10700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8081544b0 0x7fc80814f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc8077fe700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8080c8290 0x7fc808156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 -- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8080c8290 msgr2=0x7fc808156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:27.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8080c8290 0x7fc808156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:27.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 -- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8081544b0 msgr2=0x7fc80814f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:27.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8081544b0 0x7fc80814f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:27.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 -- 172.21.15.148:0/1161116677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009370 con 0x7fc8080aa420 2023-10-24T00:41:27.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc807fff700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc7f8006df0 tx=0x7fc7f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:27.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800b870 con 0x7fc8080aa420 2023-10-24T00:41:27.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f800b9d0 con 0x7fc8080aa420 2023-10-24T00:41:27.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8080ac920 con 0x7fc8080aa420 2023-10-24T00:41:27.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f801b660 con 0x7fc8080aa420 2023-10-24T00:41:27.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.812+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080accb0 con 0x7fc8080aa420 2023-10-24T00:41:27.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.813+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80806c6b0 con 0x7fc8080aa420 2023-10-24T00:41:27.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.813+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc7f801b9d0 con 0x7fc8080aa420 2023-10-24T00:41:27.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.814+0000 7fc7effff700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 0x7fc7f4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:27.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.814+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc7f807be70 con 0x7fc8080aa420 2023-10-24T00:41:27.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.814+0000 7fc8077fe700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 0x7fc7f4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:27.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.814+0000 7fc8077fe700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 0x7fc7f4061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc808157890 tx=0x7fc7fc008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:27.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:27.818+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc7f804cef0 con 0x7fc8080aa420 2023-10-24T00:41:28.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.006+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8080acab0 con 0x7fc7f405f2c0 2023-10-24T00:41:28.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.010+0000 7fc7effff700 1 -- 172.21.15.148:0/1161116677 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc8080acab0 con 0x7fc7f405f2c0 2023-10-24T00:41:28.012 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-10-24T00:41:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 msgr2=0x7fc7f4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 0x7fc7f4061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc808157890 tx=0x7fc7fc008040).stop 2023-10-24T00:41:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 msgr2=0x7fc8080ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc7f8006df0 tx=0x7fc7f8015000).stop 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 shutdown_connections 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8081544b0 0x7fc80814f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7f405f2c0 0x7fc7f4061780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8080aa420 0x7fc8080ca5a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 --2- 172.21.15.148:0/1161116677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8080c8290 0x7fc808156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 >> 172.21.15.148:0/1161116677 conn(0x7fc8080945d0 msgr2=0x7fc808063a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 shutdown_connections 2023-10-24T00:41:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.012+0000 7fc80e773700 1 -- 172.21.15.148:0/1161116677 wait complete. 2023-10-24T00:41:28.026 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-10-24T00:41:28.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.027 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-24T00:41:28.042 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:28.044 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:28.045 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:28.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.045 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_30_00_UTC) 2023-10-24T00:41:28.106 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:28.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.107 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:28.167 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:28.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.168 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:28.228 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:28.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.229 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:28.289 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:28.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.290 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:28.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:28.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.353 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:28.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:28.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.413 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:28.473 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:28.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.474 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:28.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:28.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.536 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:28.595 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:28.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.596 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:28.656 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:28.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.658 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:28.717 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:28.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.718 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:28.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:28.780 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-10-24T00:41:28.838 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-10-24T00:41:28.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.994+0000 7f16b1376700 1 Processor -- start 2023-10-24T00:41:28.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 -- start start 2023-10-24T00:41:29.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f16ac0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16ac069e40 0x7f16ac0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0699b0 con 0x7f16ac151640 2023-10-24T00:41:29.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac152180 con 0x7f16ac069e40 2023-10-24T00:41:29.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.995+0000 7f16b1376700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac152650 con 0x7f16ac0bdf80 2023-10-24T00:41:29.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16b0b75700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f16ac151640 0x7f16ac151a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46582/0 (socket says 172.21.15.148:46582) 2023-10-24T00:41:29.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16b0b75700 1 -- 172.21.15.148:0/641290666 learned_addr learned my addr 172.21.15.148:0/641290666 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:29.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/641290666 >> v2:172.21.15.150:3300/0 conn(0x7f16ac069e40 0x7f16ac0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16abfff700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f16ac0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51301860 0 0) 0x7f16ac0699b0 con 0x7f16ac151640 2023-10-24T00:41:29.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16940033f0 con 0x7f16ac151640 2023-10-24T00:41:29.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417353233 0 0) 0x7f16940033f0 con 0x7f16ac151640 2023-10-24T00:41:29.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 msgr2=0x7f16ac0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:29.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f16ac0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 >> v2:172.21.15.150:3300/0 conn(0x7f16ac069e40 msgr2=0x7f16ac0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:29.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 --2- 172.21.15.148:0/641290666 >> v2:172.21.15.150:3300/0 conn(0x7f16ac069e40 0x7f16ac0c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac152370 con 0x7f16ac151640 2023-10-24T00:41:29.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f16a40017f0 con 0x7f16ac151640 2023-10-24T00:41:29.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/641290666 >> v2:172.21.15.150:3300/0 conn(0x7f16ac069e40 0x7f16ac0c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:29.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 >> v1:172.21.15.148:6789/0 conn(0x7f16ac151640 legacy=0x7f16ac151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f1694003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1694004690 0x7f1694004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f1694005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac152650 con 0x7f16940038e0 2023-10-24T00:41:29.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940044b0 con 0x7f1694004690 2023-10-24T00:41:29.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169400b910 con 0x7f16ac0bdf80 2023-10-24T00:41:29.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16abfff700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f1694003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1694004690 0x7f1694004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.996+0000 7f16b0b75700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f1694005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 -- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 msgr2=0x7f1694005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:29.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0bdf80 0x7f1694005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 -- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1694004690 msgr2=0x7f1694004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:29.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1694004690 0x7f1694004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 -- 172.21.15.148:0/641290666 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940033f0 con 0x7f16940038e0 2023-10-24T00:41:29.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16abfff700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f1694003d00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f169c009a80 tx=0x7f169c009060).ready entity=mon.0 client_cookie=58b86e2985b07619 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:29.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c009430 con 0x7f16940038e0 2023-10-24T00:41:29.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00e640 con 0x7f16940038e0 2023-10-24T00:41:29.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16aaffd700 1 -- 172.21.15.148:0/641290666 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00e9c0 con 0x7f16940038e0 2023-10-24T00:41:29.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16b1376700 1 -- 172.21.15.148:0/641290666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 msgr2=0x7f1694003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16b1376700 1 --2- 172.21.15.148:0/641290666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f1694003d00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f169c009a80 tx=0x7f169c009060).stop 2023-10-24T00:41:29.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16b0b75700 1 -- 172.21.15.148:0/641290666 reap_dead start 2023-10-24T00:41:29.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16b1376700 1 -- 172.21.15.148:0/641290666 shutdown_connections 2023-10-24T00:41:29.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.997+0000 7f16b1376700 1 -- 172.21.15.148:0/641290666 >> 172.21.15.148:0/641290666 conn(0x7f16ac063760 msgr2=0x7f16ac063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:29.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.998+0000 7f16b1376700 1 -- 172.21.15.148:0/641290666 shutdown_connections 2023-10-24T00:41:29.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.998+0000 7f16b1376700 1 -- 172.21.15.148:0/641290666 wait complete. 2023-10-24T00:41:29.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.999+0000 7f16b1376700 1 Processor -- start 2023-10-24T00:41:29.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:28.999+0000 7f16b1376700 1 -- start start 2023-10-24T00:41:29.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16ac0aa280 0x7f16ac13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0c6e30 0x7f16ac0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0c77a0 con 0x7f16940038e0 2023-10-24T00:41:29.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac13cd90 con 0x7f16ac0aa280 2023-10-24T00:41:29.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0c0590 con 0x7f16ac0c6e30 2023-10-24T00:41:29.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60414/0 (socket says 172.21.15.148:60414) 2023-10-24T00:41:29.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 -- 172.21.15.148:0/1605338999 learned_addr learned my addr 172.21.15.148:0/1605338999 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:29.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16ac0aa280 0x7f16ac13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b0b75700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0c6e30 0x7f16ac0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 -- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0c6e30 msgr2=0x7f16ac0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0c6e30 0x7f16ac0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 -- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16ac0aa280 msgr2=0x7f16ac13c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16ac0aa280 0x7f16ac13c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 -- 172.21.15.148:0/1605338999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0c0870 con 0x7f16940038e0 2023-10-24T00:41:29.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16abfff700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f1694004480 tx=0x7f169c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:29.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c009ec0 con 0x7f16940038e0 2023-10-24T00:41:29.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00ed30 con 0x7f16940038e0 2023-10-24T00:41:29.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac0c0b50 con 0x7f16940038e0 2023-10-24T00:41:29.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00eea0 con 0x7f16940038e0 2023-10-24T00:41:29.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.000+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac0c1110 con 0x7f16940038e0 2023-10-24T00:41:29.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.001+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac047480 con 0x7f16940038e0 2023-10-24T00:41:29.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.002+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f169c02f440 con 0x7f16940038e0 2023-10-24T00:41:29.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.002+0000 7f1693fff700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 0x7f1698061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:29.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.002+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f169c07c1b0 con 0x7f16940038e0 2023-10-24T00:41:29.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.002+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 0x7f1698061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:29.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.002+0000 7f16ab7fe700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 0x7f1698061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f16ac14a3d0 tx=0x7f16a0009060).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:29.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.006+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f169c04d1d0 con 0x7f16940038e0 2023-10-24T00:41:29.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.194+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f16ac0a74a0 con 0x7f169805f2c0 2023-10-24T00:41:29.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.198+0000 7f1693fff700 1 -- 172.21.15.148:0/1605338999 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f16ac0a74a0 con 0x7f169805f2c0 2023-10-24T00:41:29.201 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-10-24T00:41:29.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 msgr2=0x7f1698061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 0x7f1698061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f16ac14a3d0 tx=0x7f16a0009060).stop 2023-10-24T00:41:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 msgr2=0x7f16ac0c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f1694004480 tx=0x7f169c01a000).stop 2023-10-24T00:41:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 shutdown_connections 2023-10-24T00:41:29.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16ac0c6e30 0x7f16ac0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169805f2c0 0x7f1698061780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16940038e0 0x7f16ac0c1630 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 --2- 172.21.15.148:0/1605338999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16ac0aa280 0x7f16ac13c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 >> 172.21.15.148:0/1605338999 conn(0x7f16ac063760 msgr2=0x7f16ac063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:29.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 shutdown_connections 2023-10-24T00:41:29.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:29.200+0000 7f16b1376700 1 -- 172.21.15.148:0/1605338999 wait complete. 2023-10-24T00:41:29.214 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-10-24T00:41:29.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.215 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-24T00:41:29.231 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:29.232 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:29.232 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:29.232 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:29.232 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:29.232 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:29.233 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:29.233 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:29.234 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:29.235 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:29.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.236 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_30_00_UTC) 2023-10-24T00:41:29.293 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:29.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.294 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:29.355 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:29.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.356 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:29.417 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:29.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.418 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:29.478 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:29.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.479 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:29.540 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:29.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.541 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:29.602 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:29.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.603 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:29.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:29.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.663 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:29.722 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:29.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.723 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:29.782 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:29.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.783 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:29.844 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:29.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.845 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:29.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:29.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.906 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:29.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:29.967 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-10-24T00:41:30.029 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-10-24T00:41:30.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.188+0000 7f94b50e4700 1 Processor -- start 2023-10-24T00:41:30.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.188+0000 7f94b50e4700 1 -- start start 2023-10-24T00:41:30.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 0x7f94b00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94b00c8290 0x7f94b00a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b00c6270 con 0x7f94b00aa420 2023-10-24T00:41:30.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00c60e0 con 0x7f94b00c8290 2023-10-24T00:41:30.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00c0c80 con 0x7f94b01544b0 2023-10-24T00:41:30.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94b00c8290 0x7f94b00a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f94b00c8290 0x7f94b00a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60416/0 (socket says 172.21.15.148:60416) 2023-10-24T00:41:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 -- 172.21.15.148:0/3700428700 learned_addr learned my addr 172.21.15.148:0/3700428700 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94aed9d700 1 --2- 172.21.15.148:0/3700428700 >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 0x7f94b00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 -- 172.21.15.148:0/3700428700 >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 msgr2=0x7f94b00a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 --2- 172.21.15.148:0/3700428700 >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 0x7f94b00a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 -- 172.21.15.148:0/3700428700 >> v1:172.21.15.150:6789/0 conn(0x7f94b00aa420 legacy=0x7f94b00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 -- 172.21.15.148:0/3700428700 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b00c0f40 con 0x7f94b00c8290 2023-10-24T00:41:30.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94aed9d700 1 --2- 172.21.15.148:0/3700428700 >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 0x7f94b00a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:30.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94ae59c700 1 --2- 172.21.15.148:0/3700428700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00c8290 0x7f94b00a9f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f94b0084570 tx=0x7f94a40090f0).ready entity=mon.0 client_cookie=fd226eafca9be4aa server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:30.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94add9b700 1 -- 172.21.15.148:0/3700428700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a400b600 con 0x7f94b00c8290 2023-10-24T00:41:30.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94add9b700 1 -- 172.21.15.148:0/3700428700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a400b760 con 0x7f94b00c8290 2023-10-24T00:41:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94add9b700 1 -- 172.21.15.148:0/3700428700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a400bae0 con 0x7f94b00c8290 2023-10-24T00:41:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- 172.21.15.148:0/3700428700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00c8290 msgr2=0x7f94b00a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3700428700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00c8290 0x7f94b00a9f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f94b0084570 tx=0x7f94a40090f0).stop 2023-10-24T00:41:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- 172.21.15.148:0/3700428700 shutdown_connections 2023-10-24T00:41:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3700428700 >> v2:172.21.15.150:3300/0 conn(0x7f94b01544b0 0x7f94b00a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3700428700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00c8290 0x7f94b00a9f30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- 172.21.15.148:0/3700428700 >> 172.21.15.148:0/3700428700 conn(0x7f94b00945d0 msgr2=0x7f94b006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:30.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- 172.21.15.148:0/3700428700 shutdown_connections 2023-10-24T00:41:30.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.189+0000 7f94b50e4700 1 -- 172.21.15.148:0/3700428700 wait complete. 2023-10-24T00:41:30.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.190+0000 7f94b50e4700 1 Processor -- start 2023-10-24T00:41:30.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.190+0000 7f94b50e4700 1 -- start start 2023-10-24T00:41:30.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b00c8290 0x7f94b00ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94b01544b0 0x7f94b0164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b0155500 con 0x7f94b00aa420 2023-10-24T00:41:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01551d0 con 0x7f94b00c8290 2023-10-24T00:41:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94b50e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b0165600 con 0x7f94b01544b0 2023-10-24T00:41:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60422/0 (socket says 172.21.15.148:60422) 2023-10-24T00:41:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 -- 172.21.15.148:0/3986657332 learned_addr learned my addr 172.21.15.148:0/3986657332 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94ae59c700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b00c8290 0x7f94b00ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94af59e700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94b01544b0 0x7f94b0164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 -- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94b01544b0 msgr2=0x7f94b0164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94b01544b0 0x7f94b0164d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 -- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b00c8290 msgr2=0x7f94b00ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b00c8290 0x7f94b00ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.191+0000 7f94aed9d700 1 -- 172.21.15.148:0/3986657332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009370 con 0x7f94b00aa420 2023-10-24T00:41:30.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f94aed9d700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f94a000d890 tx=0x7f94a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:30.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011590 con 0x7f94b00aa420 2023-10-24T00:41:30.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a00116f0 con 0x7f94b00aa420 2023-10-24T00:41:30.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b01658e0 con 0x7f94b00aa420 2023-10-24T00:41:30.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011a70 con 0x7f94b00aa420 2023-10-24T00:41:30.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.192+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b00aec80 con 0x7f94b00aa420 2023-10-24T00:41:30.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.193+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b006c6b0 con 0x7f94b00aa420 2023-10-24T00:41:30.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.193+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f94a0012420 con 0x7f94b00aa420 2023-10-24T00:41:30.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.193+0000 7f9496ffd700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 0x7f949c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:30.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.193+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7114+0+0 (secure 0 0 0) 0x7f94a007a180 con 0x7f94b00aa420 2023-10-24T00:41:30.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.193+0000 7f94ae59c700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 0x7f949c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:30.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.194+0000 7f94ae59c700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 0x7f949c061780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f94a400b3c0 tx=0x7f94a4017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:30.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.198+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f94a004ae90 con 0x7f94b00aa420 2023-10-24T00:41:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.388+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f94b0165d80 con 0x7f949c05f2c0 2023-10-24T00:41:30.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.393+0000 7f9496ffd700 1 -- 172.21.15.148:0/3986657332 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f94a400bea0 con 0x7f949c05f2c0 2023-10-24T00:41:30.395 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-10-24T00:41:30.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 msgr2=0x7f949c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 0x7f949c061780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f94a400b3c0 tx=0x7f94a4017000).stop 2023-10-24T00:41:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 msgr2=0x7f94b0157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f94a000d890 tx=0x7f94a0008040).stop 2023-10-24T00:41:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 shutdown_connections 2023-10-24T00:41:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94b01544b0 0x7f94b0164d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f949c05f2c0 0x7f949c061780 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94b00aa420 0x7f94b0157260 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 --2- 172.21.15.148:0/3986657332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b00c8290 0x7f94b00ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 >> 172.21.15.148:0/3986657332 conn(0x7f94b00945d0 msgr2=0x7f94b00c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 shutdown_connections 2023-10-24T00:41:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:30.395+0000 7f94b50e4700 1 -- 172.21.15.148:0/3986657332 wait complete. 2023-10-24T00:41:30.411 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-10-24T00:41:30.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.412 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-24T00:41:30.431 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:30.431 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:30.432 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:30.432 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:30.432 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:30.433 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:30.433 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:30.433 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:30.434 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:30.434 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:30.434 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:30.435 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:30.435 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:30.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.436 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_30_00_UTC) 2023-10-24T00:41:30.495 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:30.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.568 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:30.591 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:30.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.592 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:30.676 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:30.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.677 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:30.737 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:30.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.738 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:30.798 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:30.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.799 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:30.858 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:30.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.859 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:30.919 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:30.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.921 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:30.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:30.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:30.981 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:31.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:31.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.066 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:31.092 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:31.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.093 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:31.155 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:31.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.156 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:31.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.219 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-10-24T00:41:31.278 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-10-24T00:41:31.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.434+0000 7fda91c34700 1 Processor -- start 2023-10-24T00:41:31.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.434+0000 7fda91c34700 1 -- start start 2023-10-24T00:41:31.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda91c34700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda8c0a5ba0 0x7fda8c0be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda91c34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 0x7fda8c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda91c34700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0c7a20 con 0x7fda8c0c5f50 2023-10-24T00:41:31.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda91c34700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0c6330 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda91c34700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0bf0a0 con 0x7fda8c0bec70 2023-10-24T00:41:31.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda8affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda8c0a5ba0 0x7fda8c0be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda8affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda8c0a5ba0 0x7fda8c0be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60436/0 (socket says 172.21.15.148:60436) 2023-10-24T00:41:31.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.435+0000 7fda8b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fda8c0c5f50 0x7fda8c064c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46594/0 (socket says 172.21.15.148:46594) 2023-10-24T00:41:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 -- 172.21.15.148:0/220802958 learned_addr learned my addr 172.21.15.148:0/220802958 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8bfff700 1 --2- 172.21.15.148:0/220802958 >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 0x7fda8c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 -- 172.21.15.148:0/220802958 >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 msgr2=0x7fda8c0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 --2- 172.21.15.148:0/220802958 >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 0x7fda8c0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 -- 172.21.15.148:0/220802958 >> v1:172.21.15.148:6789/0 conn(0x7fda8c0c5f50 legacy=0x7fda8c064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 -- 172.21.15.148:0/220802958 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0633f0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8a7fc700 1 -- 172.21.15.148:0/220802958 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275014703 0 0) 0x7fda8c0c7a20 con 0x7fda8c0c5f50 2023-10-24T00:41:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8bfff700 1 --2- 172.21.15.148:0/220802958 >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 0x7fda8c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8affd700 1 --2- 172.21.15.148:0/220802958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c0be780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fda8c0bdf50 tx=0x7fda800090f0).ready entity=mon.0 client_cookie=f0c0c7783dd1221 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8a7fc700 1 -- 172.21.15.148:0/220802958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000b600 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8a7fc700 1 -- 172.21.15.148:0/220802958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000b760 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda8a7fc700 1 -- 172.21.15.148:0/220802958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000bae0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda91c34700 1 -- 172.21.15.148:0/220802958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 msgr2=0x7fda8c0be780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.436+0000 7fda91c34700 1 --2- 172.21.15.148:0/220802958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c0be780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fda8c0bdf50 tx=0x7fda800090f0).stop 2023-10-24T00:41:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 -- 172.21.15.148:0/220802958 shutdown_connections 2023-10-24T00:41:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 --2- 172.21.15.148:0/220802958 >> v2:172.21.15.150:3300/0 conn(0x7fda8c0bec70 0x7fda8c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 --2- 172.21.15.148:0/220802958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c0be780 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 -- 172.21.15.148:0/220802958 >> 172.21.15.148:0/220802958 conn(0x7fda8c082f60 msgr2=0x7fda8c092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 -- 172.21.15.148:0/220802958 shutdown_connections 2023-10-24T00:41:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.437+0000 7fda91c34700 1 -- 172.21.15.148:0/220802958 wait complete. 2023-10-24T00:41:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.438+0000 7fda91c34700 1 Processor -- start 2023-10-24T00:41:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.438+0000 7fda91c34700 1 -- start start 2023-10-24T00:41:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda8c0bec70 0x7fda8c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda8c0c5f50 0x7fda8c0c0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0a8540 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0c03a0 con 0x7fda8c0bec70 2023-10-24T00:41:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0a73d0 con 0x7fda8c0c5f50 2023-10-24T00:41:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60440/0 (socket says 172.21.15.148:60440) 2023-10-24T00:41:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 -- 172.21.15.148:0/3475536618 learned_addr learned my addr 172.21.15.148:0/3475536618 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8affd700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda8c0bec70 0x7fda8c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8bfff700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda8c0c5f50 0x7fda8c0c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 -- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda8c0c5f50 msgr2=0x7fda8c0c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda8c0c5f50 0x7fda8c0c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 -- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda8c0bec70 msgr2=0x7fda8c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda8c0bec70 0x7fda8c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 -- 172.21.15.148:0/3475536618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80009370 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda8b7fe700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fda7c00c440 tx=0x7fda7c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0070d0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c007230 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0056e0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c0a76b0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.439+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c0c0030 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.440+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c06c6b0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.441+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fda7c005ad0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.441+0000 7fda737fe700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 0x7fda78061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.441+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7114+0+0 (secure 0 0 0) 0x7fda7c079dc0 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.441+0000 7fda8affd700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 0x7fda78061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.442+0000 7fda8affd700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 0x7fda78061750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fda80009fd0 tx=0x7fda80017000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.445+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fda7c04ab30 con 0x7fda8c0a5ba0 2023-10-24T00:41:31.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.630+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fda8c0c6e10 con 0x7fda7805f290 2023-10-24T00:41:31.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.635+0000 7fda737fe700 1 -- 172.21.15.148:0/3475536618 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fda8c0c6e10 con 0x7fda7805f290 2023-10-24T00:41:31.636 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-10-24T00:41:31.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 msgr2=0x7fda78061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 0x7fda78061750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fda80009fd0 tx=0x7fda80017000).stop 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 msgr2=0x7fda8c14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fda7c00c440 tx=0x7fda7c007e30).stop 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 shutdown_connections 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda8c0c5f50 0x7fda8c0c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda7805f290 0x7fda78061750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda8c0a5ba0 0x7fda8c14c880 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 --2- 172.21.15.148:0/3475536618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda8c0bec70 0x7fda8c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:31.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 >> 172.21.15.148:0/3475536618 conn(0x7fda8c082f60 msgr2=0x7fda8c0c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:31.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 shutdown_connections 2023-10-24T00:41:31.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:31.637+0000 7fda91c34700 1 -- 172.21.15.148:0/3475536618 wait complete. 2023-10-24T00:41:31.650 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-10-24T00:41:31.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.651 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-24T00:41:31.667 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:31.667 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:31.667 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:31.667 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:31.667 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:31.668 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:31.668 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:31.668 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:31.668 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:31.668 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:31.669 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:31.669 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:31.669 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_30_00_UTC 2023-10-24T00:41:31.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.670 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_30_00_UTC) 2023-10-24T00:41:31.729 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:31.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.730 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:31.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:41:31.772 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:41:31.791 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:31.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.792 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:31.892 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:31.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.893 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:31.954 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:31.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:31.955 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:32.024 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:32.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.025 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:32.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:32.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.089 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:32.149 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:32.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.150 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:32.210 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:32.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.211 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:32.279 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:32.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.280 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:32.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:32.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.352 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:32.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:32.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.413 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:32.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.474 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-10-24T00:41:32.532 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-10-24T00:41:32.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.689+0000 7fc8e0234700 1 Processor -- start 2023-10-24T00:41:32.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.689+0000 7fc8e0234700 1 -- start start 2023-10-24T00:41:32.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8e0234700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8d8065310 0x7fc8d80c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:32.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8e0234700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d814ecd0 con 0x7fc8d80c0d90 2023-10-24T00:41:32.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8e0234700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80c11d0 con 0x7fc8d814e8f0 2023-10-24T00:41:32.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8e0234700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d8065810 con 0x7fc8d8065310 2023-10-24T00:41:32.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8d8065310 0x7fc8d80c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:32.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc8d8065310 0x7fc8d80c08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60452/0 (socket says 172.21.15.148:60452) 2023-10-24T00:41:32.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8de7d1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc8d80c0d90 0x7fc8d80c2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46596/0 (socket says 172.21.15.148:46596) 2023-10-24T00:41:32.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/984359704 learned_addr learned my addr 172.21.15.148:0/984359704 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:32.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/984359704 >> v1:172.21.15.150:6789/0 conn(0x7fc8d814e8f0 legacy=0x7fc8d8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/984359704 >> v1:172.21.15.148:6789/0 conn(0x7fc8d80c0d90 legacy=0x7fc8d80c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dcfce700 1 -- 172.21.15.148:0/984359704 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519407080 0 0) 0x7fc8d814ecd0 con 0x7fc8d80c0d90 2023-10-24T00:41:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/984359704 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8065af0 con 0x7fc8d8065310 2023-10-24T00:41:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dd7cf700 1 --2- 172.21.15.148:0/984359704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d8065310 0x7fc8d80c08a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fc8c8006fd0 tx=0x7fc8c80090f0).ready entity=mon.0 client_cookie=a2d0561eac4d3483 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.690+0000 7fc8dcfce700 1 -- 172.21.15.148:0/984359704 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800b600 con 0x7fc8d8065310 2023-10-24T00:41:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8dcfce700 1 -- 172.21.15.148:0/984359704 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800b760 con 0x7fc8d8065310 2023-10-24T00:41:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8dcfce700 1 -- 172.21.15.148:0/984359704 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800bae0 con 0x7fc8d8065310 2023-10-24T00:41:32.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 -- 172.21.15.148:0/984359704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d8065310 msgr2=0x7fc8d80c08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 --2- 172.21.15.148:0/984359704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d8065310 0x7fc8d80c08a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fc8c8006fd0 tx=0x7fc8c80090f0).stop 2023-10-24T00:41:32.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 -- 172.21.15.148:0/984359704 shutdown_connections 2023-10-24T00:41:32.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 --2- 172.21.15.148:0/984359704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d8065310 0x7fc8d80c08a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 -- 172.21.15.148:0/984359704 >> 172.21.15.148:0/984359704 conn(0x7fc8d80c7f40 msgr2=0x7fc8d80c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:32.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 -- 172.21.15.148:0/984359704 shutdown_connections 2023-10-24T00:41:32.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.691+0000 7fc8e0234700 1 -- 172.21.15.148:0/984359704 wait complete. 2023-10-24T00:41:32.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.692+0000 7fc8e0234700 1 Processor -- start 2023-10-24T00:41:32.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.692+0000 7fc8e0234700 1 -- start start 2023-10-24T00:41:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8d8065310 0x7fc8d8145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d814e8f0 0x7fc8d8156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8147c90 con 0x7fc8d80c0d90 2023-10-24T00:41:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d814ae50 con 0x7fc8d814e8f0 2023-10-24T00:41:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8e0234700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8145c60 con 0x7fc8d8065310 2023-10-24T00:41:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8dd7cf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8dd7cf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60460/0 (socket says 172.21.15.148:60460) 2023-10-24T00:41:32.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/979476821 learned_addr learned my addr 172.21.15.148:0/979476821 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:32.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8ddfd0700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8d8065310 0x7fc8d8145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:32.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8de7d1700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d814e8f0 0x7fc8d8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:32.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.693+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8d8065310 msgr2=0x7fc8d8145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8dd7cf700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8d8065310 0x7fc8d8145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d814e8f0 msgr2=0x7fc8d8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8dd7cf700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d814e8f0 0x7fc8d8156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8dd7cf700 1 -- 172.21.15.148:0/979476821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8009370 con 0x7fc8d80c0d90 2023-10-24T00:41:32.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8dd7cf700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fc8c8009f50 tx=0x7fc8c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:32.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800b8d0 con 0x7fc8d80c0d90 2023-10-24T00:41:32.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800ba30 con 0x7fc8d80c0d90 2023-10-24T00:41:32.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d8147a10 con 0x7fc8d80c0d90 2023-10-24T00:41:32.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c801b660 con 0x7fc8d80c0d90 2023-10-24T00:41:32.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.694+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d814b060 con 0x7fc8d80c0d90 2023-10-24T00:41:32.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.695+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d806c6b0 con 0x7fc8d80c0d90 2023-10-24T00:41:32.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.695+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc8c801ba10 con 0x7fc8d80c0d90 2023-10-24T00:41:32.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.696+0000 7fc8cdffb700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 0x7fc8bc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:32.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.696+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7050+0+0 (secure 0 0 0) 0x7fc8c807c200 con 0x7fc8d80c0d90 2023-10-24T00:41:32.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.696+0000 7fc8ddfd0700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 0x7fc8bc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:32.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.696+0000 7fc8ddfd0700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 0x7fc8bc061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc8d4003900 tx=0x7fc8d4007d40).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:32.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.700+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc8c804cfb0 con 0x7fc8d80c0d90 2023-10-24T00:41:32.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.885+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8d81588e0 con 0x7fc8bc05f2c0 2023-10-24T00:41:32.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.889+0000 7fc8cdffb700 1 -- 172.21.15.148:0/979476821 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc8d81588e0 con 0x7fc8bc05f2c0 2023-10-24T00:41:32.890 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-10-24T00:41:32.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 msgr2=0x7fc8bc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 0x7fc8bc061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc8d4003900 tx=0x7fc8d4007d40).stop 2023-10-24T00:41:32.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 msgr2=0x7fc8d8147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:32.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fc8c8009f50 tx=0x7fc8c8017000).stop 2023-10-24T00:41:32.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 shutdown_connections 2023-10-24T00:41:32.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d814e8f0 0x7fc8d8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc8d8065310 0x7fc8d8145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc8bc05f2c0 0x7fc8bc061780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 --2- 172.21.15.148:0/979476821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d80c0d90 0x7fc8d8147520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:32.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 >> 172.21.15.148:0/979476821 conn(0x7fc8d80c7f40 msgr2=0x7fc8d80c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:32.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 shutdown_connections 2023-10-24T00:41:32.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:32.891+0000 7fc8e0234700 1 -- 172.21.15.148:0/979476821 wait complete. 2023-10-24T00:41:32.904 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-10-24T00:41:32.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.905 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-24T00:41:32.920 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:32.920 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:32.921 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:32.921 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:32.921 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:32.921 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:32.921 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:32.922 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:32.922 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:32.922 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:32.922 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:32.923 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:32.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.924 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:32.987 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:32.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:32.988 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:33.069 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:33.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.070 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:33.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:33.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.131 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:33.192 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:33.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.193 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:33.253 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:33.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.254 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:33.314 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:33.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.315 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:33.392 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:33.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.393 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:33.455 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:33.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.456 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:33.516 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:33.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.517 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:33.578 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:33.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.579 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:33.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:33.641 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-10-24T00:41:33.701 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-10-24T00:41:33.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.857+0000 7fea7ed23700 1 Processor -- start 2023-10-24T00:41:33.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.857+0000 7fea7ed23700 1 -- start start 2023-10-24T00:41:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7ed23700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea78135390 0x7fea780c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7ed23700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea78066ba0 0x7fea780c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7ed23700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea780be9e0 con 0x7fea781539a0 2023-10-24T00:41:33.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7ed23700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780c3e20 con 0x7fea78135390 2023-10-24T00:41:33.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7ed23700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780bde40 con 0x7fea78066ba0 2023-10-24T00:41:33.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea78135390 0x7fea780c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea78135390 0x7fea780c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54556/0 (socket says 172.21.15.148:54556) 2023-10-24T00:41:33.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 -- 172.21.15.148:0/2225834988 learned_addr learned my addr 172.21.15.148:0/2225834988 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:33.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7d2c0700 1 --2- 172.21.15.148:0/2225834988 >> v2:172.21.15.150:3300/0 conn(0x7fea78066ba0 0x7fea780c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 -- 172.21.15.148:0/2225834988 >> v2:172.21.15.150:3300/0 conn(0x7fea78066ba0 msgr2=0x7fea780c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:33.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 --2- 172.21.15.148:0/2225834988 >> v2:172.21.15.150:3300/0 conn(0x7fea78066ba0 0x7fea780c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:33.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 -- 172.21.15.148:0/2225834988 >> v1:172.21.15.150:6789/0 conn(0x7fea781539a0 legacy=0x7fea78066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:33.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 -- 172.21.15.148:0/2225834988 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78135770 con 0x7fea78135390 2023-10-24T00:41:33.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.858+0000 7fea7cabf700 1 --2- 172.21.15.148:0/2225834988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c3440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fea78067580 tx=0x7fea6c009060).ready entity=mon.0 client_cookie=b7cdc1536b6a665d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:33.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea777fe700 1 -- 172.21.15.148:0/2225834988 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c005880 con 0x7fea78135390 2023-10-24T00:41:33.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea777fe700 1 -- 172.21.15.148:0/2225834988 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0059e0 con 0x7fea78135390 2023-10-24T00:41:33.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea777fe700 1 -- 172.21.15.148:0/2225834988 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c005d60 con 0x7fea78135390 2023-10-24T00:41:33.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 -- 172.21.15.148:0/2225834988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 msgr2=0x7fea780c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:33.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 --2- 172.21.15.148:0/2225834988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c3440 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fea78067580 tx=0x7fea6c009060).stop 2023-10-24T00:41:33.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 -- 172.21.15.148:0/2225834988 shutdown_connections 2023-10-24T00:41:33.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 --2- 172.21.15.148:0/2225834988 >> v2:172.21.15.150:3300/0 conn(0x7fea78066ba0 0x7fea780c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:33.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 --2- 172.21.15.148:0/2225834988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c3440 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:33.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 -- 172.21.15.148:0/2225834988 >> 172.21.15.148:0/2225834988 conn(0x7fea78063120 msgr2=0x7fea780c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:33.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 -- 172.21.15.148:0/2225834988 shutdown_connections 2023-10-24T00:41:33.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.859+0000 7fea7ed23700 1 -- 172.21.15.148:0/2225834988 wait complete. 2023-10-24T00:41:33.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.860+0000 7fea7ed23700 1 Processor -- start 2023-10-24T00:41:33.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.860+0000 7fea7ed23700 1 -- start start 2023-10-24T00:41:33.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea78066ba0 0x7fea78163240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea781539a0 0x7fea780c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78162c50 con 0x7fea78135390 2023-10-24T00:41:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780c2df0 con 0x7fea78066ba0 2023-10-24T00:41:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7ed23700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea78136590 con 0x7fea781539a0 2023-10-24T00:41:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54568/0 (socket says 172.21.15.148:54568) 2023-10-24T00:41:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea77fff700 1 -- 172.21.15.148:0/4281871847 learned_addr learned my addr 172.21.15.148:0/4281871847 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7cabf700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea78066ba0 0x7fea78163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.861+0000 7fea7d2c0700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea781539a0 0x7fea780c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 -- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea781539a0 msgr2=0x7fea780c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea781539a0 0x7fea780c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 -- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea78066ba0 msgr2=0x7fea78163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea78066ba0 0x7fea78163240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 -- 172.21.15.148:0/4281871847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009300 con 0x7fea78135390 2023-10-24T00:41:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea77fff700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fea6400c4c0 tx=0x7fea64007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400ce70 con 0x7fea78135390 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64001e90 con 0x7fea78135390 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea78136870 con 0x7fea78135390 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64007250 con 0x7fea78135390 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.862+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea78136e30 con 0x7fea78135390 2023-10-24T00:41:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.863+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7806c6b0 con 0x7fea78135390 2023-10-24T00:41:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.863+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fea640066a0 con 0x7fea78135390 2023-10-24T00:41:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.864+0000 7fea74ff9700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 0x7fea5c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.864+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7034+0+0 (secure 0 0 0) 0x7fea6407a020 con 0x7fea78135390 2023-10-24T00:41:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.864+0000 7fea7cabf700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 0x7fea5c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.864+0000 7fea7cabf700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 0x7fea5c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fea6c009fd0 tx=0x7fea6c016000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:33.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:33.868+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea6404ade0 con 0x7fea78135390 2023-10-24T00:41:34.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.088+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fea780be0b0 con 0x7fea5c05f2c0 2023-10-24T00:41:34.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.092+0000 7fea74ff9700 1 -- 172.21.15.148:0/4281871847 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fea780be0b0 con 0x7fea5c05f2c0 2023-10-24T00:41:34.093 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-10-24T00:41:34.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 msgr2=0x7fea5c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:34.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 0x7fea5c061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fea6c009fd0 tx=0x7fea6c016000).stop 2023-10-24T00:41:34.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 msgr2=0x7fea780c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:34.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fea6400c4c0 tx=0x7fea64007e00).stop 2023-10-24T00:41:34.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 shutdown_connections 2023-10-24T00:41:34.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea781539a0 0x7fea780c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:34.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea78066ba0 0x7fea78163240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:34.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea5c05f2c0 0x7fea5c061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:34.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 --2- 172.21.15.148:0/4281871847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea78135390 0x7fea780c2410 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:34.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 >> 172.21.15.148:0/4281871847 conn(0x7fea78063120 msgr2=0x7fea780ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:34.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 shutdown_connections 2023-10-24T00:41:34.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:34.094+0000 7fea7ed23700 1 -- 172.21.15.148:0/4281871847 wait complete. 2023-10-24T00:41:34.107 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-10-24T00:41:34.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.108 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-24T00:41:34.124 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:34.124 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:34.124 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:34.124 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:34.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:34.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:34.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:34.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:34.125 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:34.126 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:34.126 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:34.126 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:34.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.127 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:34.185 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:34.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.186 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:34.246 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:34.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.247 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:34.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:34.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.308 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:34.368 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:34.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.369 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:34.430 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:34.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.431 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:34.491 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:34.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.492 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:34.553 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:34.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.555 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:34.616 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:34.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.617 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:34.677 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:34.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.678 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:34.739 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:34.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.740 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:34.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:34.801 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-10-24T00:41:34.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-10-24T00:41:35.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.020+0000 7fce33a51700 1 Processor -- start 2023-10-24T00:41:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.021+0000 7fce33a51700 1 -- start start 2023-10-24T00:41:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.022+0000 7fce33a51700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce2c063820 0x7fce2c0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.022+0000 7fce33a51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce2c0a69a0 0x7fce2c063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.022+0000 7fce33a51700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2c0c2040 con 0x7fce2c065190 2023-10-24T00:41:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.022+0000 7fce33a51700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0c2320 con 0x7fce2c0a69a0 2023-10-24T00:41:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.022+0000 7fce33a51700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0c2600 con 0x7fce2c063820 2023-10-24T00:41:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce31fee700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fce2c065190 0x7fce2c158210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:46522/0 (socket says 172.21.15.148:46522) 2023-10-24T00:41:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce31fee700 1 -- 172.21.15.148:0/557252328 learned_addr learned my addr 172.21.15.148:0/557252328 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce317ed700 1 --2- 172.21.15.148:0/557252328 >> v2:172.21.15.150:3300/0 conn(0x7fce2c063820 0x7fce2c0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce30fec700 1 --2- 172.21.15.148:0/557252328 >> v2:172.21.15.148:3300/0 conn(0x7fce2c0a69a0 0x7fce2c063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce23fff700 1 -- 172.21.15.148:0/557252328 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398780421 0 0) 0x7fce2c0c2040 con 0x7fce2c065190 2023-10-24T00:41:35.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.023+0000 7fce23fff700 1 -- 172.21.15.148:0/557252328 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce180033f0 con 0x7fce2c065190 2023-10-24T00:41:35.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce30fec700 1 -- 172.21.15.148:0/557252328 >> v2:172.21.15.150:3300/0 conn(0x7fce2c063820 msgr2=0x7fce2c0c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:35.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce30fec700 1 --2- 172.21.15.148:0/557252328 >> v2:172.21.15.150:3300/0 conn(0x7fce2c063820 0x7fce2c0c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce30fec700 1 -- 172.21.15.148:0/557252328 >> v1:172.21.15.150:6789/0 conn(0x7fce2c065190 legacy=0x7fce2c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce30fec700 1 -- 172.21.15.148:0/557252328 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0c28e0 con 0x7fce2c0a69a0 2023-10-24T00:41:35.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce30fec700 1 --2- 172.21.15.148:0/557252328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c063c00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fce2c0be3d0 tx=0x7fce1c009060).ready entity=mon.0 client_cookie=29525e9b98399922 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:35.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce23fff700 1 -- 172.21.15.148:0/557252328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00d4a0 con 0x7fce2c0a69a0 2023-10-24T00:41:35.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce23fff700 1 -- 172.21.15.148:0/557252328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c00d600 con 0x7fce2c0a69a0 2023-10-24T00:41:35.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.024+0000 7fce23fff700 1 -- 172.21.15.148:0/557252328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c00d980 con 0x7fce2c0a69a0 2023-10-24T00:41:35.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.025+0000 7fce33a51700 1 -- 172.21.15.148:0/557252328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 msgr2=0x7fce2c063c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.025+0000 7fce33a51700 1 --2- 172.21.15.148:0/557252328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c063c00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fce2c0be3d0 tx=0x7fce1c009060).stop 2023-10-24T00:41:35.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.026+0000 7fce33a51700 1 -- 172.21.15.148:0/557252328 shutdown_connections 2023-10-24T00:41:35.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.026+0000 7fce33a51700 1 --2- 172.21.15.148:0/557252328 >> v2:172.21.15.150:3300/0 conn(0x7fce2c063820 0x7fce2c0c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.026+0000 7fce33a51700 1 --2- 172.21.15.148:0/557252328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c063c00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.026+0000 7fce33a51700 1 -- 172.21.15.148:0/557252328 >> 172.21.15.148:0/557252328 conn(0x7fce2c0c49d0 msgr2=0x7fce2c068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.027+0000 7fce33a51700 1 -- 172.21.15.148:0/557252328 shutdown_connections 2023-10-24T00:41:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.027+0000 7fce33a51700 1 -- 172.21.15.148:0/557252328 wait complete. 2023-10-24T00:41:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.029+0000 7fce33a51700 1 Processor -- start 2023-10-24T00:41:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.029+0000 7fce33a51700 1 -- start start 2023-10-24T00:41:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 0x7fce2c147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2c065190 0x7fce2c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c14a1b0 con 0x7fce2c0a69a0 2023-10-24T00:41:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c14a490 con 0x7fce2c065190 2023-10-24T00:41:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce33a51700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0bf800 con 0x7fce2c063820 2023-10-24T00:41:35.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce31fee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce31fee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54576/0 (socket says 172.21.15.148:54576) 2023-10-24T00:41:35.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce31fee700 1 -- 172.21.15.148:0/2762349268 learned_addr learned my addr 172.21.15.148:0/2762349268 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:35.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce317ed700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 0x7fce2c147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.031+0000 7fce30fec700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2c065190 0x7fce2c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 -- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2c065190 msgr2=0x7fce2c149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2c065190 0x7fce2c149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 -- 172.21.15.148:0/2762349268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 msgr2=0x7fce2c149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 -- 172.21.15.148:0/2762349268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0092a0 con 0x7fce2c063820 2023-10-24T00:41:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.032+0000 7fce317ed700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 0x7fce2c147410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce24009ef0 tx=0x7fce2400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.033+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2400cc20 con 0x7fce2c063820 2023-10-24T00:41:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.033+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400f040 con 0x7fce2c063820 2023-10-24T00:41:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.033+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24013400 con 0x7fce2c063820 2023-10-24T00:41:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.033+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c0bfae0 con 0x7fce2c063820 2023-10-24T00:41:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.033+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c149e40 con 0x7fce2c063820 2023-10-24T00:41:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.034+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c14a6b0 con 0x7fce2c063820 2023-10-24T00:41:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.035+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fce240137b0 con 0x7fce2c063820 2023-10-24T00:41:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.036+0000 7fce217fa700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 0x7fce100617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.036+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7066+0+0 (secure 0 0 0) 0x7fce2407afd0 con 0x7fce2c063820 2023-10-24T00:41:35.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.036+0000 7fce30fec700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 0x7fce100617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:35.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.037+0000 7fce30fec700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 0x7fce100617d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fce2c0be3d0 tx=0x7fce1c016000).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:35.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.043+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fce2404be30 con 0x7fce2c063820 2023-10-24T00:41:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.267+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fce2c06c6b0 con 0x7fce1005f310 2023-10-24T00:41:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.271+0000 7fce217fa700 1 -- 172.21.15.148:0/2762349268 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fce2c06c6b0 con 0x7fce1005f310 2023-10-24T00:41:35.272 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-10-24T00:41:35.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 msgr2=0x7fce100617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 0x7fce100617d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fce2c0be3d0 tx=0x7fce1c016000).stop 2023-10-24T00:41:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 msgr2=0x7fce2c147410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 0x7fce2c147410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce24009ef0 tx=0x7fce2400b040).stop 2023-10-24T00:41:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 shutdown_connections 2023-10-24T00:41:35.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce1005f310 0x7fce100617d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce2c0a69a0 0x7fce2c149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce2c063820 0x7fce2c147410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 --2- 172.21.15.148:0/2762349268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce2c065190 0x7fce2c149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 >> 172.21.15.148:0/2762349268 conn(0x7fce2c0c49d0 msgr2=0x7fce2c0c2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:35.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 shutdown_connections 2023-10-24T00:41:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:35.273+0000 7fce33a51700 1 -- 172.21.15.148:0/2762349268 wait complete. 2023-10-24T00:41:35.286 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-10-24T00:41:35.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.287 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-24T00:41:35.302 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:35.303 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:35.303 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:35.303 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:35.304 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:35.304 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:35.304 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:35.304 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:35.304 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:35.305 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:35.305 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:35.305 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:35.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.306 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:35.366 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:35.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.367 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:35.428 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:35.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.429 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:35.491 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:35.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.491 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:35.554 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:35.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.555 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:35.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:35.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.619 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:35.684 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:35.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.685 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:35.746 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:35.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.747 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:35.837 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:35.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.838 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:35.862 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:35.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.863 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:35.926 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:35.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.927 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:35.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:35.991 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-10-24T00:41:36.063 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-10-24T00:41:36.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.220+0000 7fe884a59700 1 Processor -- start 2023-10-24T00:41:36.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.220+0000 7fe884a59700 1 -- start start 2023-10-24T00:41:36.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 0x7fe880154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8801588c0 0x7fe8800ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8800c7840 0x7fe8800c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800ca270 con 0x7fe8800c7840 2023-10-24T00:41:36.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800c9660 con 0x7fe8801588c0 2023-10-24T00:41:36.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe884a59700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c9940 con 0x7fe880154040 2023-10-24T00:41:36.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8800c7840 0x7fe8800c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8800c7840 0x7fe8800c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54592/0 (socket says 172.21.15.148:54592) 2023-10-24T00:41:36.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 -- 172.21.15.148:0/3422614580 learned_addr learned my addr 172.21.15.148:0/3422614580 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:36.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87e59c700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 0x7fe880154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87dd9b700 1 --2- 172.21.15.148:0/3422614580 >> v2:172.21.15.150:3300/0 conn(0x7fe8801588c0 0x7fe8800ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 -- 172.21.15.148:0/3422614580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 msgr2=0x7fe880154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:36.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 0x7fe880154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 -- 172.21.15.148:0/3422614580 >> v2:172.21.15.150:3300/0 conn(0x7fe8801588c0 msgr2=0x7fe8800ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:36.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 --2- 172.21.15.148:0/3422614580 >> v2:172.21.15.150:3300/0 conn(0x7fe8801588c0 0x7fe8800ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87ed9d700 1 -- 172.21.15.148:0/3422614580 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800c9c20 con 0x7fe8800c7840 2023-10-24T00:41:36.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.221+0000 7fe87e59c700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 0x7fe880154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:36.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe87ed9d700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8800c7840 0x7fe8800c7cf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe8800b1260 tx=0x7fe878009840).ready entity=mon.0 client_cookie=1cd99a6db0ed4d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:36.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe87d59a700 1 -- 172.21.15.148:0/3422614580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800e070 con 0x7fe8800c7840 2023-10-24T00:41:36.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe87d59a700 1 -- 172.21.15.148:0/3422614580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800ba50 con 0x7fe8800c7840 2023-10-24T00:41:36.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe87d59a700 1 -- 172.21.15.148:0/3422614580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800bdd0 con 0x7fe8800c7840 2023-10-24T00:41:36.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 -- 172.21.15.148:0/3422614580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8800c7840 msgr2=0x7fe8800c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:36.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8800c7840 0x7fe8800c7cf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe8800b1260 tx=0x7fe878009840).stop 2023-10-24T00:41:36.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 -- 172.21.15.148:0/3422614580 shutdown_connections 2023-10-24T00:41:36.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8800c7840 0x7fe8800c7cf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 --2- 172.21.15.148:0/3422614580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe880154040 0x7fe880154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 --2- 172.21.15.148:0/3422614580 >> v2:172.21.15.150:3300/0 conn(0x7fe8801588c0 0x7fe8800ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 -- 172.21.15.148:0/3422614580 >> 172.21.15.148:0/3422614580 conn(0x7fe880069d80 msgr2=0x7fe88006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:36.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 -- 172.21.15.148:0/3422614580 shutdown_connections 2023-10-24T00:41:36.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.222+0000 7fe884a59700 1 -- 172.21.15.148:0/3422614580 wait complete. 2023-10-24T00:41:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.223+0000 7fe884a59700 1 Processor -- start 2023-10-24T00:41:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.223+0000 7fe884a59700 1 -- start start 2023-10-24T00:41:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8800c7840 0x7fe880144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 0x7fe8800cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c4f40 con 0x7fe880154040 2023-10-24T00:41:36.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800cbcf0 con 0x7fe8800c7840 2023-10-24T00:41:36.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe884a59700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe880154e80 con 0x7fe8801588c0 2023-10-24T00:41:36.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe87dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe87dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54594/0 (socket says 172.21.15.148:54594) 2023-10-24T00:41:36.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe87dd9b700 1 -- 172.21.15.148:0/4207151714 learned_addr learned my addr 172.21.15.148:0/4207151714 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:36.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe87e59c700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8800c7840 0x7fe880144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.224+0000 7fe87ed9d700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 0x7fe8800cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 -- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 msgr2=0x7fe8800cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:36.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 0x7fe8800cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 -- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8800c7840 msgr2=0x7fe880144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:36.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8800c7840 0x7fe880144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 -- 172.21.15.148:0/4207151714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009ae0 con 0x7fe880154040 2023-10-24T00:41:36.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87ed9d700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 0x7fe8800cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:36.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe87dd9b700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fe87400d890 tx=0x7fe874008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:36.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87400f520 con 0x7fe880154040 2023-10-24T00:41:36.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87400f680 con 0x7fe880154040 2023-10-24T00:41:36.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe880145250 con 0x7fe880154040 2023-10-24T00:41:36.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87400fa00 con 0x7fe880154040 2023-10-24T00:41:36.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.225+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800c4c60 con 0x7fe880154040 2023-10-24T00:41:36.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.226+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88006c6b0 con 0x7fe880154040 2023-10-24T00:41:36.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.226+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe874013480 con 0x7fe880154040 2023-10-24T00:41:36.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.226+0000 7fe86e7fc700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 0x7fe860061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:36.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.226+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7670+0+0 (secure 0 0 0) 0x7fe87407a580 con 0x7fe880154040 2023-10-24T00:41:36.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.227+0000 7fe87e59c700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 0x7fe860061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:36.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.227+0000 7fe87e59c700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 0x7fe860061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe870006d80 tx=0x7fe870008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:36.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.230+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe87404b060 con 0x7fe880154040 2023-10-24T00:41:36.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.417+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8800c9f00 con 0x7fe86005f2c0 2023-10-24T00:41:36.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.421+0000 7fe86e7fc700 1 -- 172.21.15.148:0/4207151714 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe8800c9f00 con 0x7fe86005f2c0 2023-10-24T00:41:36.422 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-10-24T00:41:36.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 msgr2=0x7fe860061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:36.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 0x7fe860061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe870006d80 tx=0x7fe870008040).stop 2023-10-24T00:41:36.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 msgr2=0x7fe8800cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:36.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fe87400d890 tx=0x7fe874008040).stop 2023-10-24T00:41:36.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 shutdown_connections 2023-10-24T00:41:36.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8801588c0 0x7fe8800cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8800c7840 0x7fe880144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe86005f2c0 0x7fe860061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 --2- 172.21.15.148:0/4207151714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe880154040 0x7fe8800cb310 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:36.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 >> 172.21.15.148:0/4207151714 conn(0x7fe880069d80 msgr2=0x7fe8800aa160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:36.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 shutdown_connections 2023-10-24T00:41:36.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:36.423+0000 7fe884a59700 1 -- 172.21.15.148:0/4207151714 wait complete. 2023-10-24T00:41:36.435 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-10-24T00:41:36.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.436 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-24T00:41:36.452 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:36.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:36.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:36.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:36.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:36.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:36.455 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:36.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.456 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:36.516 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:36.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.517 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:36.577 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:36.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.578 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:36.639 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:36.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.640 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:36.700 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:36.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.701 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:36.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:36.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.764 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:36.849 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:36.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.850 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:36.874 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:36.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.875 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:36.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:36.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.936 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:36.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:36.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:36.999 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:37.060 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:37.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.061 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:37.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.125 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-10-24T00:41:37.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-10-24T00:41:37.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.340+0000 7faa384a2700 1 Processor -- start 2023-10-24T00:41:37.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.340+0000 7faa384a2700 1 -- start start 2023-10-24T00:41:37.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa384a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 0x7faa300a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa384a2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa300aa420 0x7faa300c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa384a2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa300c6270 con 0x7faa301544b0 2023-10-24T00:41:37.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa384a2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300c60e0 con 0x7faa300aa420 2023-10-24T00:41:37.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa384a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300aa890 con 0x7faa300a7d00 2023-10-24T00:41:37.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa300aa420 0x7faa300c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa300aa420 0x7faa300c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54598/0 (socket says 172.21.15.148:54598) 2023-10-24T00:41:37.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 -- 172.21.15.148:0/942428579 learned_addr learned my addr 172.21.15.148:0/942428579 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:37.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa3623e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faa301544b0 0x7faa300c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54658/0 (socket says 172.21.15.148:54658) 2023-10-24T00:41:37.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa35a3d700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 0x7faa300a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 -- 172.21.15.148:0/942428579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 msgr2=0x7faa300a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:37.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 0x7faa300a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 -- 172.21.15.148:0/942428579 >> v1:172.21.15.148:6789/0 conn(0x7faa301544b0 legacy=0x7faa300c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 -- 172.21.15.148:0/942428579 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300c0c80 con 0x7faa300aa420 2023-10-24T00:41:37.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa3523c700 1 -- 172.21.15.148:0/942428579 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081071003 0 0) 0x7faa300c6270 con 0x7faa301544b0 2023-10-24T00:41:37.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa35a3d700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 0x7faa300a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:37.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa36a3f700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa300c6700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7faa28009f20 tx=0x7faa28009840).ready entity=mon.0 client_cookie=1d0291aa3348ba32 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:37.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.341+0000 7faa3523c700 1 -- 172.21.15.148:0/942428579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800e070 con 0x7faa300aa420 2023-10-24T00:41:37.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa3523c700 1 -- 172.21.15.148:0/942428579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800ba80 con 0x7faa300aa420 2023-10-24T00:41:37.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa3523c700 1 -- 172.21.15.148:0/942428579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800be00 con 0x7faa300aa420 2023-10-24T00:41:37.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 -- 172.21.15.148:0/942428579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 msgr2=0x7faa300c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa300c6700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7faa28009f20 tx=0x7faa28009840).stop 2023-10-24T00:41:37.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 -- 172.21.15.148:0/942428579 shutdown_connections 2023-10-24T00:41:37.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa300c6700 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 --2- 172.21.15.148:0/942428579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa300a7d00 0x7faa300a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 -- 172.21.15.148:0/942428579 >> 172.21.15.148:0/942428579 conn(0x7faa300945d0 msgr2=0x7faa3006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:37.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 -- 172.21.15.148:0/942428579 shutdown_connections 2023-10-24T00:41:37.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.342+0000 7faa384a2700 1 -- 172.21.15.148:0/942428579 wait complete. 2023-10-24T00:41:37.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.343+0000 7faa384a2700 1 Processor -- start 2023-10-24T00:41:37.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.343+0000 7faa384a2700 1 -- start start 2023-10-24T00:41:37.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 0x7faa30142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 0x7faa30143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa301589f0 con 0x7faa300aa420 2023-10-24T00:41:37.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30158cd0 con 0x7faa300a7d00 2023-10-24T00:41:37.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa384a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30158fb0 con 0x7faa301544b0 2023-10-24T00:41:37.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54608/0 (socket says 172.21.15.148:54608) 2023-10-24T00:41:37.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 -- 172.21.15.148:0/1079385018 learned_addr learned my addr 172.21.15.148:0/1079385018 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:37.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa36a3f700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 0x7faa30143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa3623e700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 0x7faa30142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 -- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 msgr2=0x7faa30143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 0x7faa30143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 -- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 msgr2=0x7faa30142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 0x7faa30142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa35a3d700 1 -- 172.21.15.148:0/1079385018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009ae0 con 0x7faa300aa420 2023-10-24T00:41:37.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa36a3f700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 0x7faa30143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:37.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.344+0000 7faa3623e700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 0x7faa30142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:37.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa35a3d700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7faa2000d860 tx=0x7faa20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:37.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20011590 con 0x7faa300aa420 2023-10-24T00:41:37.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200116f0 con 0x7faa300aa420 2023-10-24T00:41:37.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa30159290 con 0x7faa300aa420 2023-10-24T00:41:37.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20011a70 con 0x7faa300aa420 2023-10-24T00:41:37.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.345+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa30143130 con 0x7faa300aa420 2023-10-24T00:41:37.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.346+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa301598e0 con 0x7faa300aa420 2023-10-24T00:41:37.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.346+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7faa20012420 con 0x7faa300aa420 2023-10-24T00:41:37.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.346+0000 7faa267fc700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 0x7faa14061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:37.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.346+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7034+0+0 (secure 0 0 0) 0x7faa2007a330 con 0x7faa300aa420 2023-10-24T00:41:37.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.346+0000 7faa3623e700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 0x7faa14061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:37.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.347+0000 7faa3623e700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 0x7faa14061750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7faa2c007fd0 tx=0x7faa2c009040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:37.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.350+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faa2004b090 con 0x7faa300aa420 2023-10-24T00:41:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.536+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faa3006c6b0 con 0x7faa1405f290 2023-10-24T00:41:37.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.539+0000 7faa267fc700 1 -- 172.21.15.148:0/1079385018 <== mgr.4811 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7faa3006c6b0 con 0x7faa1405f290 2023-10-24T00:41:37.541 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-10-24T00:41:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.541+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 msgr2=0x7faa14061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.541+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 0x7faa14061750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7faa2c007fd0 tx=0x7faa2c009040).stop 2023-10-24T00:41:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.541+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 msgr2=0x7faa30157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.541+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7faa2000d860 tx=0x7faa20008040).stop 2023-10-24T00:41:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 shutdown_connections 2023-10-24T00:41:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa301544b0 0x7faa30143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa300a7d00 0x7faa30142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa1405f290 0x7faa14061750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 --2- 172.21.15.148:0/1079385018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa300aa420 0x7faa30157fa0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 >> 172.21.15.148:0/1079385018 conn(0x7faa300945d0 msgr2=0x7faa30145a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 shutdown_connections 2023-10-24T00:41:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:37.542+0000 7faa384a2700 1 -- 172.21.15.148:0/1079385018 wait complete. 2023-10-24T00:41:37.554 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-10-24T00:41:37.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.555 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-24T00:41:37.571 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:37.571 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:37.572 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:37.572 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:37.572 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:37.572 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:37.572 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:37.573 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:37.573 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:37.573 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:37.573 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:37.573 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_31_00_UTC 2023-10-24T00:41:37.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.574 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_31_00_UTC) 2023-10-24T00:41:37.635 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_32_00_UTC 2023-10-24T00:41:37.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.636 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_32_00_UTC) 2023-10-24T00:41:37.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_33_00_UTC 2023-10-24T00:41:37.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.698 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_33_00_UTC) 2023-10-24T00:41:37.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_34_00_UTC 2023-10-24T00:41:37.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.759 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_34_00_UTC) 2023-10-24T00:41:37.844 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_35_00_UTC 2023-10-24T00:41:37.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.845 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_35_00_UTC) 2023-10-24T00:41:37.866 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_36_00_UTC 2023-10-24T00:41:37.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.867 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_36_00_UTC) 2023-10-24T00:41:37.927 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_37_00_UTC 2023-10-24T00:41:37.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.928 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_37_00_UTC) 2023-10-24T00:41:37.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_38_00_UTC 2023-10-24T00:41:37.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:37.990 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_38_00_UTC) 2023-10-24T00:41:38.050 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_39_00_UTC 2023-10-24T00:41:38.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:38.051 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_39_00_UTC) 2023-10-24T00:41:38.111 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_40_00_UTC 2023-10-24T00:41:38.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:38.112 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_40_00_UTC) 2023-10-24T00:41:38.183 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_41_00_UTC 2023-10-24T00:41:38.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:38.184 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-24-00_41_00_UTC) 2023-10-24T00:41:38.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:38.248 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-10-24T00:41:38.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:41:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.473+0000 7f842a7a0700 1 Processor -- start 2023-10-24T00:41:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.474+0000 7f842a7a0700 1 -- start start 2023-10-24T00:41:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.474+0000 7f842a7a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f8424154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.474+0000 7f842a7a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240c71d0 con 0x7f8424154430 2023-10-24T00:41:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.474+0000 7f842a7a0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240c9410 con 0x7f84240bffd0 2023-10-24T00:41:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.474+0000 7f842a7a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84240c6a10 con 0x7f8424098bd0 2023-10-24T00:41:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8423fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8424154430 0x7f84240c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54668/0 (socket says 172.21.15.148:54668) 2023-10-24T00:41:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8423fff700 1 -- 172.21.15.148:0/3928526355 learned_addr learned my addr 172.21.15.148:0/3928526355 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085938836 0 0) 0x7f84240c71d0 con 0x7f8424154430 2023-10-24T00:41:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840c0033f0 con 0x7f8424154430 2023-10-24T00:41:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f84237fe700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f8424154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750809856 0 0) 0x7f840c0033f0 con 0x7f8424154430 2023-10-24T00:41:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 msgr2=0x7f8424154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f8424154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 >> v1:172.21.15.150:6789/0 conn(0x7f84240bffd0 legacy=0x7f842415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240ca8b0 con 0x7f8424154430 2023-10-24T00:41:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f8414001470 con 0x7f8424154430 2023-10-24T00:41:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 >> v1:172.21.15.148:6789/0 conn(0x7f8424154430 legacy=0x7f84240c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f840c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f840c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840c004b80 0x7f840c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240c6a10 con 0x7f840c003ef0 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c00ba90 con 0x7f840c004b80 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c00bc50 con 0x7f8424098bd0 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f84237fe700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f840c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8423fff700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f840c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.475+0000 7f8428d3d700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840c004b80 0x7f840c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 -- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 msgr2=0x7f840c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424098bd0 0x7f840c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 -- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840c004b80 msgr2=0x7f840c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f840c004b80 0x7f840c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 -- 172.21.15.148:0/3928526355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0033f0 con 0x7f840c003ef0 2023-10-24T00:41:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f84237fe700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f840c004690 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f841800b9b0 tx=0x7f8418008040).ready entity=mon.0 client_cookie=11e662a11111398d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418013430 con 0x7f840c003ef0 2023-10-24T00:41:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418013590 con 0x7f840c003ef0 2023-10-24T00:41:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f8422ffd700 1 -- 172.21.15.148:0/3928526355 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418013910 con 0x7f840c003ef0 2023-10-24T00:41:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 -- 172.21.15.148:0/3928526355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 msgr2=0x7f840c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3928526355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f840c004690 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f841800b9b0 tx=0x7f8418008040).stop 2023-10-24T00:41:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f8428d3d700 1 -- 172.21.15.148:0/3928526355 reap_dead start 2023-10-24T00:41:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 -- 172.21.15.148:0/3928526355 shutdown_connections 2023-10-24T00:41:38.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 -- 172.21.15.148:0/3928526355 >> 172.21.15.148:0/3928526355 conn(0x7f84240cb070 msgr2=0x7f84240cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:38.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 -- 172.21.15.148:0/3928526355 shutdown_connections 2023-10-24T00:41:38.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.476+0000 7f842a7a0700 1 -- 172.21.15.148:0/3928526355 wait complete. 2023-10-24T00:41:38.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 Processor -- start 2023-10-24T00:41:38.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 -- start start 2023-10-24T00:41:38.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424151490 0x7f8424159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8424159a00 0x7f84240c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8424157d00 con 0x7f840c003ef0 2023-10-24T00:41:38.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8424157780 con 0x7f8424159a00 2023-10-24T00:41:38.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.478+0000 7f842a7a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8424157a20 con 0x7f8424151490 2023-10-24T00:41:38.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54622/0 (socket says 172.21.15.148:54622) 2023-10-24T00:41:38.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 -- 172.21.15.148:0/3996557131 learned_addr learned my addr 172.21.15.148:0/3996557131 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:38.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8428d3d700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8424159a00 0x7f84240c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f84237fe700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424151490 0x7f8424159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 -- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424151490 msgr2=0x7f8424159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:38.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424151490 0x7f8424159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:38.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 -- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8424159a00 msgr2=0x7f84240c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:38.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8424159a00 0x7f84240c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:38.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 -- 172.21.15.148:0/3996557131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240afd40 con 0x7f840c003ef0 2023-10-24T00:41:38.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f8423fff700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f84140049e0 tx=0x7f84240caa40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:38.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414001470 con 0x7f840c003ef0 2023-10-24T00:41:38.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400f660 con 0x7f840c003ef0 2023-10-24T00:41:38.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84240b0020 con 0x7f840c003ef0 2023-10-24T00:41:38.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400f9e0 con 0x7f840c003ef0 2023-10-24T00:41:38.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.479+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8424151910 con 0x7f840c003ef0 2023-10-24T00:41:38.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.480+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84240b04c0 con 0x7f840c003ef0 2023-10-24T00:41:38.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.480+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f841400fd90 con 0x7f840c003ef0 2023-10-24T00:41:38.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.481+0000 7f840bfff700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 0x7f8410061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:38.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.481+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f841407a210 con 0x7f840c003ef0 2023-10-24T00:41:38.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.481+0000 7f84237fe700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 0x7f8410061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:38.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.481+0000 7f84237fe700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 0x7f8410061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8418008010 tx=0x7f8418008040).ready entity=mgr.4811 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:38.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.485+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f841404afb0 con 0x7f840c003ef0 2023-10-24T00:41:38.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:38.707+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f84240b0670 con 0x7f840c003ef0 2023-10-24T00:41:39.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.035+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f8414077ab0 con 0x7f840c003ef0 2023-10-24T00:41:39.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.037+0000 7f840bfff700 1 -- 172.21.15.148:0/3996557131 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8414071a70 con 0x7f840c003ef0 2023-10-24T00:41:39.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 msgr2=0x7f8410061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 0x7f8410061780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8418008010 tx=0x7f8418008040).stop 2023-10-24T00:41:39.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 msgr2=0x7f84240b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f84140049e0 tx=0x7f84240caa40).stop 2023-10-24T00:41:39.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 shutdown_connections 2023-10-24T00:41:39.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8424159a00 0x7f84240c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f841005f2c0 0x7f8410061780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f840c003ef0 0x7f84240b0820 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 --2- 172.21.15.148:0/3996557131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8424151490 0x7f8424159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 >> 172.21.15.148:0/3996557131 conn(0x7f84240cb070 msgr2=0x7f84240a8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 shutdown_connections 2023-10-24T00:41:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.039+0000 7f842a7a0700 1 -- 172.21.15.148:0/3996557131 wait complete. 2023-10-24T00:41:39.055 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:41:39.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:41:39.097 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:41:39.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:41:39.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:41:39.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:41:39.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:41:39.182 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:41:39.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:41:39.183 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:41:39.184 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:39.180+0000 7f4aaf6e1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:41:39.184 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:39.181+0000 7f760ff2c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:41:39.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:39.253 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:39.251+0000 7f4aaf6e1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:41:39.261 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:39.260+0000 7f760ff2c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:41:39.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.369+0000 7f25e41ea700 1 Processor -- start 2023-10-24T00:41:39.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.369+0000 7f25e41ea700 1 -- start start 2023-10-24T00:41:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 0x7f25dc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25dc0653d0 0x7f25dc065850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc1382f0 0x7f25dc138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc065d40 con 0x7f25dc0653d0 2023-10-24T00:41:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0c1b60 con 0x7f25dc0684c0 2023-10-24T00:41:39.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e41ea700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc064770 con 0x7f25dc1382f0 2023-10-24T00:41:39.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e1785700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25dc0653d0 0x7f25dc065850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e1785700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25dc0653d0 0x7f25dc065850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54646/0 (socket says 172.21.15.148:54646) 2023-10-24T00:41:39.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e1785700 1 -- 172.21.15.148:0/227925233 learned_addr learned my addr 172.21.15.148:0/227925233 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:39.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e1f86700 1 --2- 172.21.15.148:0/227925233 >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 0x7f25dc0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.370+0000 7f25e2787700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc1382f0 0x7f25dc138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 -- 172.21.15.148:0/227925233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc1382f0 msgr2=0x7f25dc138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:39.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc1382f0 0x7f25dc138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 -- 172.21.15.148:0/227925233 >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 msgr2=0x7f25dc0688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:39.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 --2- 172.21.15.148:0/227925233 >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 0x7f25dc0688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 -- 172.21.15.148:0/227925233 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc065f40 con 0x7f25dc0653d0 2023-10-24T00:41:39.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1f86700 1 --2- 172.21.15.148:0/227925233 >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 0x7f25dc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:39.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e1785700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0653d0 0x7f25dc065850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f25dc0bdb00 tx=0x7f25d80090f0).ready entity=mon.0 client_cookie=b90c60fb53378634 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:39.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e0f84700 1 -- 172.21.15.148:0/227925233 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800b600 con 0x7f25dc0653d0 2023-10-24T00:41:39.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e0f84700 1 -- 172.21.15.148:0/227925233 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d800b760 con 0x7f25dc0653d0 2023-10-24T00:41:39.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e0f84700 1 -- 172.21.15.148:0/227925233 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800bae0 con 0x7f25dc0653d0 2023-10-24T00:41:39.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 -- 172.21.15.148:0/227925233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0653d0 msgr2=0x7f25dc065850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0653d0 0x7f25dc065850 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f25dc0bdb00 tx=0x7f25d80090f0).stop 2023-10-24T00:41:39.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 -- 172.21.15.148:0/227925233 shutdown_connections 2023-10-24T00:41:39.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc1382f0 0x7f25dc138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 --2- 172.21.15.148:0/227925233 >> v2:172.21.15.150:3300/0 conn(0x7f25dc0684c0 0x7f25dc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 --2- 172.21.15.148:0/227925233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0653d0 0x7f25dc065850 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 -- 172.21.15.148:0/227925233 >> 172.21.15.148:0/227925233 conn(0x7f25dc063120 msgr2=0x7f25dc0c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:39.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 -- 172.21.15.148:0/227925233 shutdown_connections 2023-10-24T00:41:39.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.371+0000 7f25e41ea700 1 -- 172.21.15.148:0/227925233 wait complete. 2023-10-24T00:41:39.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 Processor -- start 2023-10-24T00:41:39.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 -- start start 2023-10-24T00:41:39.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc0653d0 0x7f25dc0bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25dc1382f0 0x7f25dc0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0c54a0 con 0x7f25dc0684c0 2023-10-24T00:41:39.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0c4e90 con 0x7f25dc1382f0 2023-10-24T00:41:39.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e41ea700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc152a40 con 0x7f25dc0653d0 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e1785700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.373+0000 7f25e1785700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54654/0 (socket says 172.21.15.148:54654) 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 -- 172.21.15.148:0/728676444 learned_addr learned my addr 172.21.15.148:0/728676444 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1f86700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc0653d0 0x7f25dc0bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e2787700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25dc1382f0 0x7f25dc0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc0653d0 msgr2=0x7f25dc0bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc0653d0 0x7f25dc0bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25dc1382f0 msgr2=0x7f25dc0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25dc1382f0 0x7f25dc0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 -- 172.21.15.148:0/728676444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8009370 con 0x7f25dc0684c0 2023-10-24T00:41:39.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e1785700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f25d8006fd0 tx=0x7f25d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:39.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800bea0 con 0x7f25dc0684c0 2023-10-24T00:41:39.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d800b8d0 con 0x7f25dc0684c0 2023-10-24T00:41:39.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc0aa870 con 0x7f25dc0684c0 2023-10-24T00:41:39.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d801b660 con 0x7f25dc0684c0 2023-10-24T00:41:39.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.374+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc0c5130 con 0x7f25dc0684c0 2023-10-24T00:41:39.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.375+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc0c5650 con 0x7f25dc0684c0 2023-10-24T00:41:39.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.376+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f25d801b9d0 con 0x7f25dc0684c0 2023-10-24T00:41:39.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.376+0000 7f25d1ffb700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 0x7f25c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.376+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f25d807ba50 con 0x7f25dc0684c0 2023-10-24T00:41:39.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.376+0000 7f25e1f86700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 msgr2=0x7f25c0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:39.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.376+0000 7f25e1f86700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 0x7f25c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:39.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.384+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f25dc0c5650 con 0x7f25dc0684c0 2023-10-24T00:41:39.544 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:39.543+0000 7f760ff2c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:41:39.561 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:39.560+0000 7f4aaf6e1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:41:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.577+0000 7f25e1f86700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 msgr2=0x7f25c0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.577+0000 7f25e1f86700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 0x7f25c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:39.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.614+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25dc06c6b0 con 0x7f25dc0684c0 2023-10-24T00:41:39.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.614+0000 7f25d1ffb700 1 -- 172.21.15.148:0/728676444 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f25d801f090 con 0x7f25dc0684c0 2023-10-24T00:41:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:39.616 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:41:39.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 msgr2=0x7f25c0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:39.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 0x7f25c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:39.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 msgr2=0x7f25dc152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f25d8006fd0 tx=0x7f25d8017000).stop 2023-10-24T00:41:39.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 shutdown_connections 2023-10-24T00:41:39.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25dc1382f0 0x7f25dc0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25dc0653d0 0x7f25dc0bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25c005f270 0x7f25c0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:39.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 --2- 172.21.15.148:0/728676444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25dc0684c0 0x7f25dc152550 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.616+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 >> 172.21.15.148:0/728676444 conn(0x7f25dc063120 msgr2=0x7f25dc0a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:39.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.617+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 shutdown_connections 2023-10-24T00:41:39.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.617+0000 7f25e41ea700 1 -- 172.21.15.148:0/728676444 wait complete. 2023-10-24T00:41:39.621 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:41:39.631 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.746+0000 7f6c40717700 1 Processor -- start 2023-10-24T00:41:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.746+0000 7f6c40717700 1 -- start start 2023-10-24T00:41:39.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.747+0000 7f6c40717700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38062650 0x7f6c38062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.747+0000 7f6c40717700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c380bc370 0x7f6c380bc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.747+0000 7f6c40717700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c38063d00 con 0x7f6c38157df0 2023-10-24T00:41:39.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.747+0000 7f6c40717700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c38137790 con 0x7f6c380bc370 2023-10-24T00:41:39.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.747+0000 7f6c40717700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380630f0 con 0x7f6c38062650 2023-10-24T00:41:39.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c380bc370 0x7f6c380bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6c380bc370 0x7f6c380bc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54656/0 (socket says 172.21.15.148:54656) 2023-10-24T00:41:39.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3e4b3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6c38157df0 0x7f6c381581d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54682/0 (socket says 172.21.15.148:54682) 2023-10-24T00:41:39.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 -- 172.21.15.148:0/3800633631 learned_addr learned my addr 172.21.15.148:0/3800633631 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:39.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3dcb2700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38062650 0x7f6c38062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3d4b1700 1 -- 172.21.15.148:0/3800633631 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455828474 0 0) 0x7f6c38063d00 con 0x7f6c38157df0 2023-10-24T00:41:39.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3d4b1700 1 -- 172.21.15.148:0/3800633631 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c240033f0 con 0x7f6c38157df0 2023-10-24T00:41:39.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 -- 172.21.15.148:0/3800633631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38062650 msgr2=0x7f6c38062ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:39.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38062650 0x7f6c38062ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 -- 172.21.15.148:0/3800633631 >> v1:172.21.15.148:6789/0 conn(0x7f6c38157df0 legacy=0x7f6c381581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 -- 172.21.15.148:0/3800633631 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380633d0 con 0x7f6c380bc370 2023-10-24T00:41:39.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3ecb4700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c380bc370 0x7f6c380bc800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6c30009f20 tx=0x7f6c30009840).ready entity=mon.0 client_cookie=4627b65b19cc95dd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:39.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3d4b1700 1 -- 172.21.15.148:0/3800633631 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000e070 con 0x7f6c380bc370 2023-10-24T00:41:39.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3d4b1700 1 -- 172.21.15.148:0/3800633631 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3000b970 con 0x7f6c380bc370 2023-10-24T00:41:39.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.748+0000 7f6c3d4b1700 1 -- 172.21.15.148:0/3800633631 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000bcf0 con 0x7f6c380bc370 2023-10-24T00:41:39.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 -- 172.21.15.148:0/3800633631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c380bc370 msgr2=0x7f6c380bc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c380bc370 0x7f6c380bc800 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6c30009f20 tx=0x7f6c30009840).stop 2023-10-24T00:41:39.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 -- 172.21.15.148:0/3800633631 shutdown_connections 2023-10-24T00:41:39.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c380bc370 0x7f6c380bc800 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 --2- 172.21.15.148:0/3800633631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38062650 0x7f6c38062ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 -- 172.21.15.148:0/3800633631 >> 172.21.15.148:0/3800633631 conn(0x7f6c380c7ee0 msgr2=0x7f6c380c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:39.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 -- 172.21.15.148:0/3800633631 shutdown_connections 2023-10-24T00:41:39.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.749+0000 7f6c40717700 1 -- 172.21.15.148:0/3800633631 wait complete. 2023-10-24T00:41:39.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.750+0000 7f6c40717700 1 Processor -- start 2023-10-24T00:41:39.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.750+0000 7f6c40717700 1 -- start start 2023-10-24T00:41:39.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380bc370 0x7f6c380a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38157df0 0x7f6c380a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380a7850 con 0x7f6c38062650 2023-10-24T00:41:39.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380ad380 con 0x7f6c380bc370 2023-10-24T00:41:39.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c40717700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380a8640 con 0x7f6c38157df0 2023-10-24T00:41:39.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54660/0 (socket says 172.21.15.148:54660) 2023-10-24T00:41:39.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 -- 172.21.15.148:0/2640911315 learned_addr learned my addr 172.21.15.148:0/2640911315 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:39.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3dcb2700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380bc370 0x7f6c380a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3ecb4700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38157df0 0x7f6c380a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:39.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38157df0 msgr2=0x7f6c380a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38157df0 0x7f6c380a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380bc370 msgr2=0x7f6c380a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380bc370 0x7f6c380a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 -- 172.21.15.148:0/2640911315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30009ae0 con 0x7f6c38062650 2023-10-24T00:41:39.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.751+0000 7f6c3e4b3700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f6c2800c420 tx=0x7f6c28007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:39.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.752+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280070d0 con 0x7f6c38062650 2023-10-24T00:41:39.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.752+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28007230 con 0x7f6c38062650 2023-10-24T00:41:39.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.752+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c380a7a30 con 0x7f6c38062650 2023-10-24T00:41:39.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.752+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280056e0 con 0x7f6c38062650 2023-10-24T00:41:39.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.752+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c380a7ff0 con 0x7f6c38062650 2023-10-24T00:41:39.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c380a8920 con 0x7f6c38062650 2023-10-24T00:41:39.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f6c28005a50 con 0x7f6c38062650 2023-10-24T00:41:39.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c2e7fc700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 0x7f6c1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:39.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f6c28079c20 con 0x7f6c38062650 2023-10-24T00:41:39.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c3dcb2700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 msgr2=0x7f6c1c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:39.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.753+0000 7f6c3dcb2700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 0x7f6c1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:39.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.757+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6c2804a9c0 con 0x7f6c38062650 2023-10-24T00:41:39.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.954+0000 7f6c3dcb2700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 msgr2=0x7f6c1c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:39.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.954+0000 7f6c3dcb2700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 0x7f6c1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:39.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.967+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c3806c6b0 con 0x7f6c38062650 2023-10-24T00:41:39.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.969+0000 7f6c2e7fc700 1 -- 172.21.15.148:0/2640911315 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f6c28007d80 con 0x7f6c38062650 2023-10-24T00:41:39.972 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:39.972 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":48,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:39.802711+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":230,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6832/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:6833/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/2026137738":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/3960475136":"2023-10-25T00:29:57.116241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":15,"length":2},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":25,"length":2},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":35,"length":2},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":45,"length":2},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":55,"length":2},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":65,"length":2},{"begin":68,"length":3},{"begin":72,"length":2},{"begin":75,"length":2},{"begin":78,"length":3},{"begin":82,"length":2},{"begin":85,"length":2},{"begin":88,"length":3},{"begin":92,"length":2},{"begin":95,"length":2},{"begin":98,"length":3},{"begin":102,"length":2},{"begin":105,"length":2},{"begin":108,"length":2},{"begin":112,"length":2},{"begin":115,"length":2},{"begin":160,"length":71}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":30,"length":1},{"begin":40,"length":1},{"begin":50,"length":1},{"begin":60,"length":1},{"begin":70,"length":1},{"begin":80,"length":1},{"begin":90,"length":1},{"begin":100,"length":1},{"begin":223,"length":8}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.972+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 msgr2=0x7f6c1c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.972+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 0x7f6c1c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:39.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.972+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 msgr2=0x7f6c38163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:39.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.972+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f6c2800c420 tx=0x7f6c28007c40).stop 2023-10-24T00:41:39.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 shutdown_connections 2023-10-24T00:41:39.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c38157df0 0x7f6c380a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6c1c05f270 0x7f6c1c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c38062650 0x7f6c38163e60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 --2- 172.21.15.148:0/2640911315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380bc370 0x7f6c380a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 >> 172.21.15.148:0/2640911315 conn(0x7f6c380c7ee0 msgr2=0x7f6c38136030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 shutdown_connections 2023-10-24T00:41:39.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:39.976+0000 7f6c40717700 1 -- 172.21.15.148:0/2640911315 wait complete. 2023-10-24T00:41:39.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:29:39.212730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:29:40.218279+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 230, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:41:39.991 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:41:40.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.112+0000 7f76f6f74700 1 Processor -- start 2023-10-24T00:41:40.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.112+0000 7f76f6f74700 1 -- start start 2023-10-24T00:41:40.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f6f74700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76f00c65f0 0x7f76f00be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f6f74700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f0063760 con 0x7f76f00c6210 2023-10-24T00:41:40.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f6f74700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f00bf2f0 con 0x7f76f00c4910 2023-10-24T00:41:40.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f6f74700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f0154b50 con 0x7f76f00c65f0 2023-10-24T00:41:40.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76effff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76f00c65f0 0x7f76f00be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f4d10700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f76f00c6210 0x7f76f00c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54698/0 (socket says 172.21.15.148:54698) 2023-10-24T00:41:40.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76f4d10700 1 -- 172.21.15.148:0/289473022 learned_addr learned my addr 172.21.15.148:0/289473022 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:40.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76effff700 1 -- 172.21.15.148:0/289473022 >> v1:172.21.15.150:6789/0 conn(0x7f76f00c4910 legacy=0x7f76f00bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76effff700 1 -- 172.21.15.148:0/289473022 >> v1:172.21.15.148:6789/0 conn(0x7f76f00c6210 legacy=0x7f76f00c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76effff700 1 -- 172.21.15.148:0/289473022 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00bf5d0 con 0x7f76f00c65f0 2023-10-24T00:41:40.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76ef7fe700 1 -- 172.21.15.148:0/289473022 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403753342 0 0) 0x7f76f0063760 con 0x7f76f00c6210 2023-10-24T00:41:40.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76effff700 1 --2- 172.21.15.148:0/289473022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c65f0 0x7f76f00be570 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f76dc009760 tx=0x7f76dc009060).ready entity=mon.0 client_cookie=8e169796a21c324b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76ef7fe700 1 -- 172.21.15.148:0/289473022 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00b580 con 0x7f76f00c65f0 2023-10-24T00:41:40.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76ef7fe700 1 -- 172.21.15.148:0/289473022 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00b6e0 con 0x7f76f00c65f0 2023-10-24T00:41:40.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.113+0000 7f76ef7fe700 1 -- 172.21.15.148:0/289473022 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00ba60 con 0x7f76f00c65f0 2023-10-24T00:41:40.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 -- 172.21.15.148:0/289473022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c65f0 msgr2=0x7f76f00be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 --2- 172.21.15.148:0/289473022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c65f0 0x7f76f00be570 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f76dc009760 tx=0x7f76dc009060).stop 2023-10-24T00:41:40.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 -- 172.21.15.148:0/289473022 shutdown_connections 2023-10-24T00:41:40.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 --2- 172.21.15.148:0/289473022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c65f0 0x7f76f00be570 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 -- 172.21.15.148:0/289473022 >> 172.21.15.148:0/289473022 conn(0x7f76f0092510 msgr2=0x7f76f0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 -- 172.21.15.148:0/289473022 shutdown_connections 2023-10-24T00:41:40.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.114+0000 7f76f6f74700 1 -- 172.21.15.148:0/289473022 wait complete. 2023-10-24T00:41:40.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.115+0000 7f76f6f74700 1 Processor -- start 2023-10-24T00:41:40.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.115+0000 7f76f6f74700 1 -- start start 2023-10-24T00:41:40.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f00c6210 0x7f76f0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 0x7f76f00be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0155f40 con 0x7f76f00c4910 2023-10-24T00:41:40.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0155ab0 con 0x7f76f00c6210 2023-10-24T00:41:40.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f6f74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f01553f0 con 0x7f76f00c65f0 2023-10-24T00:41:40.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f4d10700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f4d10700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54678/0 (socket says 172.21.15.148:54678) 2023-10-24T00:41:40.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f4d10700 1 -- 172.21.15.148:0/643116858 learned_addr learned my addr 172.21.15.148:0/643116858 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:40.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76effff700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f00c6210 0x7f76f0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.116+0000 7f76f5511700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 0x7f76f00be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 msgr2=0x7f76f00be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 0x7f76f00be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f00c6210 msgr2=0x7f76f0157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f00c6210 0x7f76f0157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 -- 172.21.15.148:0/643116858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0092a0 con 0x7f76f00c4910 2023-10-24T00:41:40.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f5511700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 0x7f76f00be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:40.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f4d10700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f76e400c4c0 tx=0x7f76e4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40072e0 con 0x7f76f00c4910 2023-10-24T00:41:40.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4007440 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0154e30 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40057a0 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.117+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f0155740 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.118+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0155d90 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.118+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f76e4005b90 con 0x7f76f00c4910 2023-10-24T00:41:40.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.118+0000 7f76ecff9700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 0x7f76d4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.119+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f76e4079e90 con 0x7f76f00c4910 2023-10-24T00:41:40.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.119+0000 7f76effff700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 msgr2=0x7f76d4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:40.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.119+0000 7f76effff700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 0x7f76d4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:40.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.123+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76e404ac40 con 0x7f76f00c4910 2023-10-24T00:41:40.199 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:40.198+0000 7f760ff2c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:41:40.240 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:40.238+0000 7f4aaf6e1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:41:40.271 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:40.270+0000 7f760ff2c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:41:40.312 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:40.311+0000 7f4aaf6e1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:41:40.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.320+0000 7f76effff700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 msgr2=0x7f76d4061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:40.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.320+0000 7f76effff700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 0x7f76d4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:40.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.325+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f76f006c6b0 con 0x7f76f00c4910 2023-10-24T00:41:40.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.325+0000 7f76ecff9700 1 -- 172.21.15.148:0/643116858 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v48) v1 ==== 110+0+10 (secure 0 0 0) 0x7f76e404e260 con 0x7f76f00c4910 2023-10-24T00:41:40.327 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:41:40.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 msgr2=0x7f76d4061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:40.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 0x7f76d4061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 msgr2=0x7f76f00abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f76e400c4c0 tx=0x7f76e4007c10).stop 2023-10-24T00:41:40.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 shutdown_connections 2023-10-24T00:41:40.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76f00c65f0 0x7f76f00be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76d405f240 0x7f76d4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76f00c4910 0x7f76f00abe40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 --2- 172.21.15.148:0/643116858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76f00c6210 0x7f76f0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 >> 172.21.15.148:0/643116858 conn(0x7f76f0092510 msgr2=0x7f76f0067110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 shutdown_connections 2023-10-24T00:41:40.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.327+0000 7f76f6f74700 1 -- 172.21.15.148:0/643116858 wait complete. 2023-10-24T00:41:40.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:41:40.457 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:40.455+0000 7f760ff2c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:41:40.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 Processor -- start 2023-10-24T00:41:40.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 -- start start 2023-10-24T00:41:40.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb40062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb400a9fa0 0x7feb400a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb40063bd0 con 0x7feb40062b40 2023-10-24T00:41:40.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb40064060 con 0x7feb400a9fa0 2023-10-24T00:41:40.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.463+0000 7feb46a2a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40062fc0 con 0x7feb400acc60 2023-10-24T00:41:40.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7feb400a9fa0 0x7feb400a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feb40062b40 0x7feb40154430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54714/0 (socket says 172.21.15.148:54714) 2023-10-24T00:41:40.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3f7fe700 1 -- 172.21.15.148:0/3428054438 learned_addr learned my addr 172.21.15.148:0/3428054438 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:40.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 --2- 172.21.15.148:0/3428054438 >> v2:172.21.15.148:3300/0 conn(0x7feb400a9fa0 0x7feb400a6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54688/0 (socket says 172.21.15.148:54688) 2023-10-24T00:41:40.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3ffff700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb40062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3effd700 1 -- 172.21.15.148:0/3428054438 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461040432 0 0) 0x7feb40063bd0 con 0x7feb40062b40 2023-10-24T00:41:40.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3effd700 1 -- 172.21.15.148:0/3428054438 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb280033f0 con 0x7feb40062b40 2023-10-24T00:41:40.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 -- 172.21.15.148:0/3428054438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 msgr2=0x7feb40062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:40.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb40062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 -- 172.21.15.148:0/3428054438 >> v1:172.21.15.148:6789/0 conn(0x7feb40062b40 legacy=0x7feb40154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 -- 172.21.15.148:0/3428054438 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400632a0 con 0x7feb400a9fa0 2023-10-24T00:41:40.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb44fc7700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb400a9fa0 0x7feb400a6490 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feb38009e60 tx=0x7feb38009780).ready entity=mon.0 client_cookie=7c81d0bfeb5a5f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3effd700 1 -- 172.21.15.148:0/3428054438 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800e070 con 0x7feb400a9fa0 2023-10-24T00:41:40.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3effd700 1 -- 172.21.15.148:0/3428054438 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3800bab0 con 0x7feb400a9fa0 2023-10-24T00:41:40.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.464+0000 7feb3effd700 1 -- 172.21.15.148:0/3428054438 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800be30 con 0x7feb400a9fa0 2023-10-24T00:41:40.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 -- 172.21.15.148:0/3428054438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb400a9fa0 msgr2=0x7feb400a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb400a9fa0 0x7feb400a6490 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7feb38009e60 tx=0x7feb38009780).stop 2023-10-24T00:41:40.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 -- 172.21.15.148:0/3428054438 shutdown_connections 2023-10-24T00:41:40.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb400a9fa0 0x7feb400a6490 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 --2- 172.21.15.148:0/3428054438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb40062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 -- 172.21.15.148:0/3428054438 >> 172.21.15.148:0/3428054438 conn(0x7feb400c3f60 msgr2=0x7feb400c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 -- 172.21.15.148:0/3428054438 shutdown_connections 2023-10-24T00:41:40.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.465+0000 7feb46a2a700 1 -- 172.21.15.148:0/3428054438 wait complete. 2023-10-24T00:41:40.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.466+0000 7feb46a2a700 1 Processor -- start 2023-10-24T00:41:40.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.466+0000 7feb46a2a700 1 -- start start 2023-10-24T00:41:40.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb400a9fa0 0x7feb400a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb400a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb400a1540 con 0x7feb40062b40 2023-10-24T00:41:40.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40150050 con 0x7feb400a9fa0 2023-10-24T00:41:40.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb46a2a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40150330 con 0x7feb400acc60 2023-10-24T00:41:40.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54694/0 (socket says 172.21.15.148:54694) 2023-10-24T00:41:40.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 -- 172.21.15.148:0/1226321268 learned_addr learned my addr 172.21.15.148:0/1226321268 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:40.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb44fc7700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb400a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3f7fe700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb400a9fa0 0x7feb400a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 -- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 msgr2=0x7feb400a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb400a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 -- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb400a9fa0 msgr2=0x7feb400a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb400a9fa0 0x7feb400a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 -- 172.21.15.148:0/1226321268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38009a20 con 0x7feb40062b40 2023-10-24T00:41:40.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.467+0000 7feb3ffff700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7feb3000e900 tx=0x7feb30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.468+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30012600 con 0x7feb40062b40 2023-10-24T00:41:40.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.468+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30012760 con 0x7feb40062b40 2023-10-24T00:41:40.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.468+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40150610 con 0x7feb40062b40 2023-10-24T00:41:40.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.468+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30012ae0 con 0x7feb40062b40 2023-10-24T00:41:40.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.468+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb40150bd0 con 0x7feb40062b40 2023-10-24T00:41:40.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4006c6b0 con 0x7feb40062b40 2023-10-24T00:41:40.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7feb3001b400 con 0x7feb40062b40 2023-10-24T00:41:40.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb27fff700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 0x7feb2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7050+0+0 (secure 0 0 0) 0x7feb3007a9e0 con 0x7feb40062b40 2023-10-24T00:41:40.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb3f7fe700 1 -- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 msgr2=0x7feb2c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:40.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.469+0000 7feb3f7fe700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 0x7feb2c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:40.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.473+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feb3004b730 con 0x7feb40062b40 2023-10-24T00:41:40.512 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:40.510+0000 7f4aaf6e1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:41:40.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.644+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb40063580 con 0x7feb40062b40 2023-10-24T00:41:40.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.644+0000 7feb27fff700 1 -- 172.21.15.148:0/1226321268 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb3004ed50 con 0x7feb40062b40 2023-10-24T00:41:40.646 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:41:40.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 msgr2=0x7feb2c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:40.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 0x7feb2c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 msgr2=0x7feb401513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7feb3000e900 tx=0x7feb30009060).stop 2023-10-24T00:41:40.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 shutdown_connections 2023-10-24T00:41:40.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feb400acc60 0x7feb400a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7feb2c05f270 0x7feb2c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb40062b40 0x7feb401513d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 --2- 172.21.15.148:0/1226321268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb400a9fa0 0x7feb400a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 >> 172.21.15.148:0/1226321268 conn(0x7feb400c3f60 msgr2=0x7feb400c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 shutdown_connections 2023-10-24T00:41:40.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.646+0000 7feb46a2a700 1 -- 172.21.15.148:0/1226321268 wait complete. 2023-10-24T00:41:40.659 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:41:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.781+0000 7f9d0846c700 1 Processor -- start 2023-10-24T00:41:40.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.782+0000 7f9d0846c700 1 -- start start 2023-10-24T00:41:40.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.782+0000 7f9d0846c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d00150ec0 0x7f9d0006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.782+0000 7f9d0846c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d00069b30 0x7f9d00065a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d0846c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d00065590 con 0x7f9d000bd860 2023-10-24T00:41:40.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d0846c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d00065290 con 0x7f9d00150ec0 2023-10-24T00:41:40.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d0846c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000bdd50 con 0x7f9d00069b30 2023-10-24T00:41:40.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d00150ec0 0x7f9d0006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05a07700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9d000bd860 0x7f9d00069420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54730/0 (socket says 172.21.15.148:54730) 2023-10-24T00:41:40.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05a07700 1 -- 172.21.15.148:0/3602581248 learned_addr learned my addr 172.21.15.148:0/3602581248 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:40.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06a09700 1 --2- 172.21.15.148:0/3602581248 >> v2:172.21.15.150:3300/0 conn(0x7f9d00069b30 0x7f9d00065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 -- 172.21.15.148:0/3602581248 >> v2:172.21.15.150:3300/0 conn(0x7f9d00069b30 msgr2=0x7f9d00065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:40.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 --2- 172.21.15.148:0/3602581248 >> v2:172.21.15.150:3300/0 conn(0x7f9d00069b30 0x7f9d00065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 -- 172.21.15.148:0/3602581248 >> v1:172.21.15.148:6789/0 conn(0x7f9d000bd860 legacy=0x7f9d00069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05206700 1 -- 172.21.15.148:0/3602581248 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917561522 0 0) 0x7f9d00065590 con 0x7f9d000bd860 2023-10-24T00:41:40.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 -- 172.21.15.148:0/3602581248 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000be030 con 0x7f9d00150ec0 2023-10-24T00:41:40.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d06208700 1 --2- 172.21.15.148:0/3602581248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00150ec0 0x7f9d0006a160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f9d000aa980 tx=0x7f9cf0009060).ready entity=mon.0 client_cookie=6c7fb92c38aec241 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05206700 1 -- 172.21.15.148:0/3602581248 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000f510 con 0x7f9d00150ec0 2023-10-24T00:41:40.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05206700 1 -- 172.21.15.148:0/3602581248 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000f670 con 0x7f9d00150ec0 2023-10-24T00:41:40.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.783+0000 7f9d05206700 1 -- 172.21.15.148:0/3602581248 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000f9f0 con 0x7f9d00150ec0 2023-10-24T00:41:40.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 -- 172.21.15.148:0/3602581248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00150ec0 msgr2=0x7f9d0006a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3602581248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00150ec0 0x7f9d0006a160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f9d000aa980 tx=0x7f9cf0009060).stop 2023-10-24T00:41:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 -- 172.21.15.148:0/3602581248 shutdown_connections 2023-10-24T00:41:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3602581248 >> v2:172.21.15.150:3300/0 conn(0x7f9d00069b30 0x7f9d00065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3602581248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00150ec0 0x7f9d0006a160 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 -- 172.21.15.148:0/3602581248 >> 172.21.15.148:0/3602581248 conn(0x7f9d000c7d10 msgr2=0x7f9d000c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 -- 172.21.15.148:0/3602581248 shutdown_connections 2023-10-24T00:41:40.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.784+0000 7f9d0846c700 1 -- 172.21.15.148:0/3602581248 wait complete. 2023-10-24T00:41:40.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.785+0000 7f9d0846c700 1 Processor -- start 2023-10-24T00:41:40.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.785+0000 7f9d0846c700 1 -- start start 2023-10-24T00:41:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 0x7f9d000aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 0x7f9d000a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000a9970 con 0x7f9d00069b30 2023-10-24T00:41:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c1900 con 0x7f9d000bd860 2023-10-24T00:41:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d0846c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c1be0 con 0x7f9d00150ec0 2023-10-24T00:41:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54712/0 (socket says 172.21.15.148:54712) 2023-10-24T00:41:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 -- 172.21.15.148:0/3449725496 learned_addr learned my addr 172.21.15.148:0/3449725496 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d05a07700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 0x7f9d000aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06a09700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 0x7f9d000a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 -- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 msgr2=0x7f9d000a9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 0x7f9d000a9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 -- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 msgr2=0x7f9d000aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 0x7f9d000aaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 -- 172.21.15.148:0/3449725496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00092a0 con 0x7f9d00069b30 2023-10-24T00:41:40.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d05a07700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 0x7f9d000aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:40.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06a09700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 0x7f9d000a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:40.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.786+0000 7f9d06208700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9cf0009dd0 tx=0x7f9cf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:40.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.787+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000f9f0 con 0x7f9d00069b30 2023-10-24T00:41:40.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.787+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0000cc0 con 0x7f9d00069b30 2023-10-24T00:41:40.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.787+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000a9320 con 0x7f9d00069b30 2023-10-24T00:41:40.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.787+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf001c670 con 0x7f9d00069b30 2023-10-24T00:41:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.787+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d000c1590 con 0x7f9d00069b30 2023-10-24T00:41:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000a9c50 con 0x7f9d00069b30 2023-10-24T00:41:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9cf001ca60 con 0x7f9d00069b30 2023-10-24T00:41:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9cf67fc700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 0x7f9ce4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f9cf007c590 con 0x7f9d00069b30 2023-10-24T00:41:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9d05a07700 1 -- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 msgr2=0x7f9ce4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.788+0000 7f9d05a07700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 0x7f9ce4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.792+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9cf004d3f0 con 0x7f9d00069b30 2023-10-24T00:41:40.883 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:40.882+0000 7f760ff2c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:41:40.960 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:40.959+0000 7f4aaf6e1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:41:40.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.973+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d0006c6b0 con 0x7f9d00069b30 2023-10-24T00:41:40.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.973+0000 7f9cf67fc700 1 -- 172.21.15.148:0/3449725496 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cf0050a10 con 0x7f9d00069b30 2023-10-24T00:41:40.975 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:41:40.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 msgr2=0x7f9ce4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:40.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 0x7f9ce4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 msgr2=0x7f9d00139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:40.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9cf0009dd0 tx=0x7f9cf0017000).stop 2023-10-24T00:41:40.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 shutdown_connections 2023-10-24T00:41:40.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d00150ec0 0x7f9d000a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ce405f270 0x7f9ce4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:40.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d00069b30 0x7f9d00139c90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 --2- 172.21.15.148:0/3449725496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d000bd860 0x7f9d000aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:40.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 >> 172.21.15.148:0/3449725496 conn(0x7f9d000c7d10 msgr2=0x7f9d000a5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:40.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 shutdown_connections 2023-10-24T00:41:40.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:40.975+0000 7f9d0846c700 1 -- 172.21.15.148:0/3449725496 wait complete. 2023-10-24T00:41:40.988 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:41:40.989 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:40.988+0000 7f760ff2c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:41:41.073 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.072+0000 7f4aaf6e1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:41:41.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.108+0000 7f0f83db5700 1 Processor -- start 2023-10-24T00:41:41.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 -- start start 2023-10-24T00:41:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c154430 0x7f0f7c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f7c0c95d0 0x7f0f7c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c0a60e0 0x7f0f7c0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0bec40 con 0x7f0f7c154430 2023-10-24T00:41:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0be650 con 0x7f0f7c0c95d0 2023-10-24T00:41:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.109+0000 7f0f83db5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0a82c0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c154430 0x7f0f7c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f7c154430 0x7f0f7c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54718/0 (socket says 172.21.15.148:54718) 2023-10-24T00:41:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 -- 172.21.15.148:0/954896666 learned_addr learned my addr 172.21.15.148:0/954896666 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81350700 1 --2- 172.21.15.148:0/954896666 >> v2:172.21.15.150:3300/0 conn(0x7f0f7c0c95d0 0x7f0f7c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f82352700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c0a60e0 0x7f0f7c0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 -- 172.21.15.148:0/954896666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c0a60e0 msgr2=0x7f0f7c0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c0a60e0 0x7f0f7c0c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 -- 172.21.15.148:0/954896666 >> v2:172.21.15.150:3300/0 conn(0x7f0f7c0c95d0 msgr2=0x7f0f7c0a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 --2- 172.21.15.148:0/954896666 >> v2:172.21.15.150:3300/0 conn(0x7f0f7c0c95d0 0x7f0f7c0a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 -- 172.21.15.148:0/954896666 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0a85a0 con 0x7f0f7c154430 2023-10-24T00:41:41.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f81b51700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c154430 0x7f0f7c154810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f0f7c0c3d80 tx=0x7f0f700090f0).ready entity=mon.0 client_cookie=f13a23377ad75e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f80b4f700 1 -- 172.21.15.148:0/954896666 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000f510 con 0x7f0f7c154430 2023-10-24T00:41:41.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f80b4f700 1 -- 172.21.15.148:0/954896666 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000f670 con 0x7f0f7c154430 2023-10-24T00:41:41.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.110+0000 7f0f80b4f700 1 -- 172.21.15.148:0/954896666 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000fa10 con 0x7f0f7c154430 2023-10-24T00:41:41.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 -- 172.21.15.148:0/954896666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c154430 msgr2=0x7f0f7c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c154430 0x7f0f7c154810 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f0f7c0c3d80 tx=0x7f0f700090f0).stop 2023-10-24T00:41:41.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 -- 172.21.15.148:0/954896666 shutdown_connections 2023-10-24T00:41:41.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c154430 0x7f0f7c154810 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 --2- 172.21.15.148:0/954896666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c0a60e0 0x7f0f7c0c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 --2- 172.21.15.148:0/954896666 >> v2:172.21.15.150:3300/0 conn(0x7f0f7c0c95d0 0x7f0f7c0a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 -- 172.21.15.148:0/954896666 >> 172.21.15.148:0/954896666 conn(0x7f0f7c0630d0 msgr2=0x7f0f7c0c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 -- 172.21.15.148:0/954896666 shutdown_connections 2023-10-24T00:41:41.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.111+0000 7f0f83db5700 1 -- 172.21.15.148:0/954896666 wait complete. 2023-10-24T00:41:41.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.112+0000 7f0f83db5700 1 Processor -- start 2023-10-24T00:41:41.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.112+0000 7f0f83db5700 1 -- start start 2023-10-24T00:41:41.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 0x7f0f7c0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 0x7f0f7c167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0abf60 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c165ab0 con 0x7f0f7c0c95d0 2023-10-24T00:41:41.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f83db5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1657b0 con 0x7f0f7c168160 2023-10-24T00:41:41.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f82352700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81350700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 0x7f0f7c167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 0x7f0f7c0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f82352700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:57896/0 (socket says 172.21.15.148:57896) 2023-10-24T00:41:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81350700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 0x7f0f7c167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:53958/0 (socket says 172.21.15.148:53958) 2023-10-24T00:41:41.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f82352700 1 -- 172.21.15.148:0/2070186522 learned_addr learned my addr 172.21.15.148:0/2070186522 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:41.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 -- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 msgr2=0x7f0f7c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 -- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 msgr2=0x7f0f7c167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 0x7f0f7c167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 -- 172.21.15.148:0/2070186522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70009370 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f82352700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:41.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.113+0000 7f0f81b51700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 0x7f0f7c0ae650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f0f70014000 tx=0x7f0f70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.114+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70006d90 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.114+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70000bc0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.114+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c1685c0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.114+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70024470 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.114+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c152240 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.115+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c06c6b0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.115+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0f70021070 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.115+0000 7f0f6dffb700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 0x7f0f60061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.116+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f0f7007bec0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.116+0000 7f0f81350700 1 -- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 msgr2=0x7f0f60061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.116+0000 7f0f81350700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 0x7f0f60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:41.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.120+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f7004cce0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.146 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:41.145+0000 7f760ff2c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:41:41.224 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:41.223+0000 7f760ff2c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:41:41.236 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.235+0000 7f4aaf6e1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:41:41.291 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:41.290+0000 7f760ff2c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:41:41.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.293+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f7c1525e0 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.293+0000 7f0f6dffb700 1 -- 172.21.15.148:0/2070186522 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f70050300 con 0x7f0f7c0a60e0 2023-10-24T00:41:41.295 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:41:41.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 msgr2=0x7f0f60061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:41.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 0x7f0f60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:41.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 msgr2=0x7f0f7c0ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 0x7f0f7c0ae650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f0f70014000 tx=0x7f0f70017000).stop 2023-10-24T00:41:41.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 shutdown_connections 2023-10-24T00:41:41.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f7c168160 0x7f0f7c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f6005f270 0x7f0f60061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:41.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f7c0a60e0 0x7f0f7c0ae650 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 --2- 172.21.15.148:0/2070186522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f7c0c95d0 0x7f0f7c167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 >> 172.21.15.148:0/2070186522 conn(0x7f0f7c0630d0 msgr2=0x7f0f7c066690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:41.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 shutdown_connections 2023-10-24T00:41:41.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.295+0000 7f0f83db5700 1 -- 172.21.15.148:0/2070186522 wait complete. 2023-10-24T00:41:41.308 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:41.315 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.314+0000 7f4aaf6e1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:41:41.394 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.387+0000 7f4aaf6e1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:41:41.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.425+0000 7f9d22ddd700 1 Processor -- start 2023-10-24T00:41:41.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.425+0000 7f9d22ddd700 1 -- start start 2023-10-24T00:41:41.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d22ddd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d1c068c60 0x7f9d1c069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d22ddd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c063020 0x7f9d1c0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d22ddd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0697f0 con 0x7f9d1c0634a0 2023-10-24T00:41:41.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d22ddd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c06a000 con 0x7f9d1c068c60 2023-10-24T00:41:41.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d22ddd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c069a40 con 0x7f9d1c063020 2023-10-24T00:41:41.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d1c068c60 0x7f9d1c069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d225dc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9d1c0634a0 0x7f9d1c150c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54742/0 (socket says 172.21.15.148:54742) 2023-10-24T00:41:41.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d225dc700 1 -- 172.21.15.148:0/469998790 learned_addr learned my addr 172.21.15.148:0/469998790 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:41.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d215da700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c063020 0x7f9d1c0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 -- 172.21.15.148:0/469998790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c063020 msgr2=0x7f9d1c0aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:41.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c063020 0x7f9d1c0aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 -- 172.21.15.148:0/469998790 >> v1:172.21.15.148:6789/0 conn(0x7f9d1c0634a0 legacy=0x7f9d1c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d20dd9700 1 -- 172.21.15.148:0/469998790 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438119837 0 0) 0x7f9d1c0697f0 con 0x7f9d1c0634a0 2023-10-24T00:41:41.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 -- 172.21.15.148:0/469998790 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c069d20 con 0x7f9d1c068c60 2023-10-24T00:41:41.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d21ddb700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c069040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9d18009760 tx=0x7f9d18009060).ready entity=mon.0 client_cookie=99d4db2be3b1480e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.426+0000 7f9d20dd9700 1 -- 172.21.15.148:0/469998790 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800f510 con 0x7f9d1c068c60 2023-10-24T00:41:41.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d20dd9700 1 -- 172.21.15.148:0/469998790 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800f670 con 0x7f9d1c068c60 2023-10-24T00:41:41.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d20dd9700 1 -- 172.21.15.148:0/469998790 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800f9f0 con 0x7f9d1c068c60 2023-10-24T00:41:41.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 -- 172.21.15.148:0/469998790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 msgr2=0x7f9d1c069040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c069040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9d18009760 tx=0x7f9d18009060).stop 2023-10-24T00:41:41.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 -- 172.21.15.148:0/469998790 shutdown_connections 2023-10-24T00:41:41.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c069040 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/469998790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c063020 0x7f9d1c0aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 -- 172.21.15.148:0/469998790 >> 172.21.15.148:0/469998790 conn(0x7f9d1c0c72d0 msgr2=0x7f9d1c0c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:41.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 -- 172.21.15.148:0/469998790 shutdown_connections 2023-10-24T00:41:41.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.427+0000 7f9d22ddd700 1 -- 172.21.15.148:0/469998790 wait complete. 2023-10-24T00:41:41.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.428+0000 7f9d22ddd700 1 Processor -- start 2023-10-24T00:41:41.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.428+0000 7f9d22ddd700 1 -- start start 2023-10-24T00:41:41.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c063020 0x7f9d1c14b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0634a0 0x7f9d1c0abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0ac950 con 0x7f9d1c068c60 2023-10-24T00:41:41.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c163190 con 0x7f9d1c063020 2023-10-24T00:41:41.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d22ddd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c1625b0 con 0x7f9d1c0634a0 2023-10-24T00:41:41.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d225dc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d225dc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54738/0 (socket says 172.21.15.148:54738) 2023-10-24T00:41:41.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d225dc700 1 -- 172.21.15.148:0/3373162626 learned_addr learned my addr 172.21.15.148:0/3373162626 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:41.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d215da700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0634a0 0x7f9d1c0abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.429+0000 7f9d21ddb700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c063020 0x7f9d1c14b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0634a0 msgr2=0x7f9d1c0abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0634a0 0x7f9d1c0abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c063020 msgr2=0x7f9d1c14b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c063020 0x7f9d1c14b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 -- 172.21.15.148:0/3373162626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180092a0 con 0x7f9d1c068c60 2023-10-24T00:41:41.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d225dc700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f9d1400c7e0 tx=0x7f9d14007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14005d30 con 0x7f9d1c068c60 2023-10-24T00:41:41.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14005e90 con 0x7f9d1c068c60 2023-10-24T00:41:41.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c162860 con 0x7f9d1c068c60 2023-10-24T00:41:41.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14007320 con 0x7f9d1c068c60 2023-10-24T00:41:41.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.430+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c162e20 con 0x7f9d1c068c60 2023-10-24T00:41:41.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.431+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9d14007710 con 0x7f9d1c068c60 2023-10-24T00:41:41.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.431+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c06bad0 con 0x7f9d1c068c60 2023-10-24T00:41:41.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.432+0000 7f9d11ffb700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 0x7f9d00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.432+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f9d1407a610 con 0x7f9d1c068c60 2023-10-24T00:41:41.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.432+0000 7f9d21ddb700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 msgr2=0x7f9d00061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:41.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.432+0000 7f9d21ddb700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 0x7f9d00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:41.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.436+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d1404b3d0 con 0x7f9d1c068c60 2023-10-24T00:41:41.552 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:41.550+0000 7f760ff2c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:41:41.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.633+0000 7f9d21ddb700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 msgr2=0x7f9d00061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:41.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.633+0000 7f9d21ddb700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 0x7f9d00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:41.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.646+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d1c047480 con 0x7f9d1c068c60 2023-10-24T00:41:41.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.646+0000 7f9d11ffb700 1 -- 172.21.15.148:0/3373162626 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f9d1404e9f0 con 0x7f9d1c068c60 2023-10-24T00:41:41.648 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:41.648 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:41:41.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 msgr2=0x7f9d00061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:41.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 0x7f9d00061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:41.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 msgr2=0x7f9d1c0ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f9d1400c7e0 tx=0x7f9d14007f90).stop 2023-10-24T00:41:41.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 shutdown_connections 2023-10-24T00:41:41.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9d0005f270 0x7f9d00061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:41.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d1c068c60 0x7f9d1c0ac460 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d1c063020 0x7f9d1c14b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 --2- 172.21.15.148:0/3373162626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d1c0634a0 0x7f9d1c0abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 >> 172.21.15.148:0/3373162626 conn(0x7f9d1c0c72d0 msgr2=0x7f9d1c14d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:41.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 shutdown_connections 2023-10-24T00:41:41.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.648+0000 7f9d22ddd700 1 -- 172.21.15.148:0/3373162626 wait complete. 2023-10-24T00:41:41.652 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:41:41.657 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.656+0000 7f4aaf6e1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:41:41.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:41.735 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:41.734+0000 7f760ff2c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:41:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.822+0000 7ff8d2f4d700 1 Processor -- start 2023-10-24T00:41:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.822+0000 7ff8d2f4d700 1 -- start start 2023-10-24T00:41:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d2f4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 0x7ff8cc15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d2f4d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0bf5c0 con 0x7ff8cc1543a0 2023-10-24T00:41:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d2f4d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0a86d0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d2f4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0be9b0 con 0x7ff8cc0964f0 2023-10-24T00:41:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d0ce9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff8cc1543a0 0x7ff8cc0a7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54754/0 (socket says 172.21.15.148:54754) 2023-10-24T00:41:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d0ce9700 1 -- 172.21.15.148:0/4153051743 learned_addr learned my addr 172.21.15.148:0/4153051743 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d14ea700 1 --2- 172.21.15.148:0/4153051743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 0x7ff8cc15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759900807 0 0) 0x7ff8cc0bf5c0 con 0x7ff8cc1543a0 2023-10-24T00:41:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc0033f0 con 0x7ff8cc1543a0 2023-10-24T00:41:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672786597 0 0) 0x7ff8cc0a86d0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8cc0bf5c0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886209707 0 0) 0x7ff8bc0033f0 con 0x7ff8cc1543a0 2023-10-24T00:41:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d14ea700 1 -- 172.21.15.148:0/4153051743 >> v1:172.21.15.150:6789/0 conn(0x7ff8cc0bfa50 legacy=0x7ff8cc095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d14ea700 1 -- 172.21.15.148:0/4153051743 >> v1:172.21.15.148:6789/0 conn(0x7ff8cc1543a0 legacy=0x7ff8cc0a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.823+0000 7ff8d14ea700 1 -- 172.21.15.148:0/4153051743 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0bec90 con 0x7ff8cc0964f0 2023-10-24T00:41:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d14ea700 1 --2- 172.21.15.148:0/4153051743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 0x7ff8cc15f4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8c4009e90 tx=0x7ff8c4009780).ready entity=mon.2 client_cookie=9eff438a955cdad server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400e070 con 0x7ff8cc0964f0 2023-10-24T00:41:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400b830 con 0x7ff8cc0964f0 2023-10-24T00:41:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8cb7fe700 1 -- 172.21.15.148:0/4153051743 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0001470 con 0x7ff8cc0964f0 2023-10-24T00:41:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/4153051743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 msgr2=0x7ff8cc15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/4153051743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 0x7ff8cc15f4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8c4009e90 tx=0x7ff8c4009780).stop 2023-10-24T00:41:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/4153051743 shutdown_connections 2023-10-24T00:41:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/4153051743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc0964f0 0x7ff8cc15f4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/4153051743 >> 172.21.15.148:0/4153051743 conn(0x7ff8cc0630f0 msgr2=0x7ff8cc0c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/4153051743 shutdown_connections 2023-10-24T00:41:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.824+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/4153051743 wait complete. 2023-10-24T00:41:41.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.825+0000 7ff8d2f4d700 1 Processor -- start 2023-10-24T00:41:41.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 -- start start 2023-10-24T00:41:41.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0964f0 0x7ff8cc0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc1543a0 0x7ff8cc148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc150e70 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0ad550 con 0x7ff8cc0964f0 2023-10-24T00:41:41.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.826+0000 7ff8d2f4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0ac450 con 0x7ff8cc1543a0 2023-10-24T00:41:41.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54750/0 (socket says 172.21.15.148:54750) 2023-10-24T00:41:41.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 -- 172.21.15.148:0/2352231973 learned_addr learned my addr 172.21.15.148:0/2352231973 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:41.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8d0ce9700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0964f0 0x7ff8cc0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8d14ea700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc1543a0 0x7ff8cc148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:41.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 -- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc1543a0 msgr2=0x7ff8cc148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc1543a0 0x7ff8cc148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 -- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0964f0 msgr2=0x7ff8cc0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:41.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0964f0 0x7ff8cc0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:41.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 -- 172.21.15.148:0/2352231973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009a20 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8cbfff700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7ff8b800c490 tx=0x7ff8b8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:41.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800ce40 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b800f470 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc0ac730 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800f830 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.827+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc0accf0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.828+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff8b800fba0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.828+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc0ad6c0 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.829+0000 7ff8c8ff9700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 0x7ff8b0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:41.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.829+0000 7ff8d0ce9700 1 -- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 msgr2=0x7ff8b0061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:41.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.829+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7ff8b8079c20 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.829+0000 7ff8d0ce9700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 0x7ff8b0061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:41.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:41.833+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff8b804aa40 con 0x7ff8cc0bfa50 2023-10-24T00:41:41.852 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:41.851+0000 7f4aaf6e1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:41:42.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.004+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8cc06c6b0 con 0x7ff8cc0bfa50 2023-10-24T00:41:42.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.005+0000 7ff8c8ff9700 1 -- 172.21.15.148:0/2352231973 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18231 (secure 0 0 0) 0x7ff8b8007d80 con 0x7ff8cc0bfa50 2023-10-24T00:41:42.007 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:42.007 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:40.803987+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":231,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6832/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:6833/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/2026137738":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/3960475136":"2023-10-25T00:29:57.116241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":15,"length":2},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":25,"length":2},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":35,"length":2},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":45,"length":2},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":55,"length":2},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":65,"length":2},{"begin":68,"length":3},{"begin":72,"length":2},{"begin":75,"length":2},{"begin":78,"length":3},{"begin":82,"length":2},{"begin":85,"length":2},{"begin":88,"length":3},{"begin":92,"length":2},{"begin":95,"length":2},{"begin":98,"length":3},{"begin":102,"length":2},{"begin":105,"length":2},{"begin":108,"length":3},{"begin":112,"length":2},{"begin":115,"length":2},{"begin":160,"length":72}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":110,"length":1},{"begin":231,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:42.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 msgr2=0x7ff8b0061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:42.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 0x7ff8b0061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 msgr2=0x7ff8cc150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7ff8b800c490 tx=0x7ff8b8007c60).stop 2023-10-24T00:41:42.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 shutdown_connections 2023-10-24T00:41:42.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8cc1543a0 0x7ff8cc148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8cc0964f0 0x7ff8cc0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff8b005f240 0x7ff8b0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 --2- 172.21.15.148:0/2352231973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8cc0bfa50 0x7ff8cc150980 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 >> 172.21.15.148:0/2352231973 conn(0x7ff8cc0630f0 msgr2=0x7ff8cc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 shutdown_connections 2023-10-24T00:41:42.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.007+0000 7ff8d2f4d700 1 -- 172.21.15.148:0/2352231973 wait complete. 2023-10-24T00:41:42.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:41:42.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:42.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.138+0000 7fd1b312b700 1 Processor -- start 2023-10-24T00:41:42.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 -- start start 2023-10-24T00:41:42.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1ac150910 0x7fd1ac0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 0x7fd1ac0bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0c30f0 con 0x7fd1ac150530 2023-10-24T00:41:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c3c90 con 0x7fd1ac150910 2023-10-24T00:41:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.139+0000 7fd1b312b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c24e0 con 0x7fd1ac0638c0 2023-10-24T00:41:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1ac150910 0x7fd1ac0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1b0ec7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd1ac150530 0x7fd1ac0c3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54768/0 (socket says 172.21.15.148:54768) 2023-10-24T00:41:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1b0ec7700 1 -- 172.21.15.148:0/2590277635 learned_addr learned my addr 172.21.15.148:0/2590277635 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1b16c8700 1 --2- 172.21.15.148:0/2590277635 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 0x7fd1ac0bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 -- 172.21.15.148:0/2590277635 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 msgr2=0x7fd1ac0bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 --2- 172.21.15.148:0/2590277635 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 0x7fd1ac0bcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 -- 172.21.15.148:0/2590277635 >> v1:172.21.15.148:6789/0 conn(0x7fd1ac150530 legacy=0x7fd1ac0c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1ab7fe700 1 -- 172.21.15.148:0/2590277635 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209980480 0 0) 0x7fd1ac0c30f0 con 0x7fd1ac150530 2023-10-24T00:41:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 -- 172.21.15.148:0/2590277635 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0c27c0 con 0x7fd1ac150910 2023-10-24T00:41:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1b16c8700 1 --2- 172.21.15.148:0/2590277635 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 0x7fd1ac0bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1abfff700 1 --2- 172.21.15.148:0/2590277635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0c1f50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd1ac064630 tx=0x7fd198009060).ready entity=mon.0 client_cookie=fe170b23bd607b2d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1ab7fe700 1 -- 172.21.15.148:0/2590277635 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800b580 con 0x7fd1ac150910 2023-10-24T00:41:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1ab7fe700 1 -- 172.21.15.148:0/2590277635 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19800b6e0 con 0x7fd1ac150910 2023-10-24T00:41:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.140+0000 7fd1ab7fe700 1 -- 172.21.15.148:0/2590277635 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800ba60 con 0x7fd1ac150910 2023-10-24T00:41:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 -- 172.21.15.148:0/2590277635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 msgr2=0x7fd1ac0c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 --2- 172.21.15.148:0/2590277635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0c1f50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fd1ac064630 tx=0x7fd198009060).stop 2023-10-24T00:41:42.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 -- 172.21.15.148:0/2590277635 shutdown_connections 2023-10-24T00:41:42.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 --2- 172.21.15.148:0/2590277635 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0638c0 0x7fd1ac0bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 --2- 172.21.15.148:0/2590277635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0c1f50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 -- 172.21.15.148:0/2590277635 >> 172.21.15.148:0/2590277635 conn(0x7fd1ac0c7ee0 msgr2=0x7fd1ac0c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 -- 172.21.15.148:0/2590277635 shutdown_connections 2023-10-24T00:41:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.141+0000 7fd1b312b700 1 -- 172.21.15.148:0/2590277635 wait complete. 2023-10-24T00:41:42.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.143+0000 7fd1b312b700 1 Processor -- start 2023-10-24T00:41:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.143+0000 7fd1b312b700 1 -- start start 2023-10-24T00:41:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0638c0 0x7fd1ac14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac150530 0x7fd1ac0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c10b0 con 0x7fd1ac150910 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac14e330 con 0x7fd1ac0638c0 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b312b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c12c0 con 0x7fd1ac150530 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b16c8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b16c8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54764/0 (socket says 172.21.15.148:54764) 2023-10-24T00:41:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b16c8700 1 -- 172.21.15.148:0/3732259265 learned_addr learned my addr 172.21.15.148:0/3732259265 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1b0ec7700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0638c0 0x7fd1ac14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.144+0000 7fd1abfff700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac150530 0x7fd1ac0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac150530 msgr2=0x7fd1ac0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac150530 0x7fd1ac0c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0638c0 msgr2=0x7fd1ac14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0638c0 0x7fd1ac14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 -- 172.21.15.148:0/3732259265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980092a0 con 0x7fd1ac150910 2023-10-24T00:41:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b16c8700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fd1a400d180 tx=0x7fd1a4009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400dcc0 con 0x7fd1ac150910 2023-10-24T00:41:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400f040 con 0x7fd1ac150910 2023-10-24T00:41:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4013600 con 0x7fd1ac150910 2023-10-24T00:41:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac14da00 con 0x7fd1ac150910 2023-10-24T00:41:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.145+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac14dfc0 con 0x7fd1ac150910 2023-10-24T00:41:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.146+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd1a40139f0 con 0x7fd1ac150910 2023-10-24T00:41:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.146+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac14e4a0 con 0x7fd1ac150910 2023-10-24T00:41:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.147+0000 7fd1a8ff9700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 0x7fd190061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.147+0000 7fd1b0ec7700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 msgr2=0x7fd190061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.147+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7fd1a407ad20 con 0x7fd1ac150910 2023-10-24T00:41:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.147+0000 7fd1b0ec7700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 0x7fd190061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:42.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.151+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd1a404bae0 con 0x7fd1ac150910 2023-10-24T00:41:42.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.348+0000 7fd1b0ec7700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 msgr2=0x7fd190061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:42.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.348+0000 7fd1b0ec7700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 0x7fd190061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:42.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.364+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1ac0c2aa0 con 0x7fd1ac150910 2023-10-24T00:41:42.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.364+0000 7fd1a8ff9700 1 -- 172.21.15.148:0/3732259265 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fd1a404f100 con 0x7fd1ac150910 2023-10-24T00:41:42.366 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:42.366 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:41:42.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 msgr2=0x7fd190061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:42.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 0x7fd190061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 msgr2=0x7fd1ac0ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fd1a400d180 tx=0x7fd1a4009a50).stop 2023-10-24T00:41:42.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 shutdown_connections 2023-10-24T00:41:42.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19005f240 0x7fd190061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac150910 0x7fd1ac0ac530 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0638c0 0x7fd1ac14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 --2- 172.21.15.148:0/3732259265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac150530 0x7fd1ac0c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 >> 172.21.15.148:0/3732259265 conn(0x7fd1ac0c7ee0 msgr2=0x7fd1ac068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 shutdown_connections 2023-10-24T00:41:42.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.366+0000 7fd1b312b700 1 -- 172.21.15.148:0/3732259265 wait complete. 2023-10-24T00:41:42.371 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:41:42.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:42.390 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.389+0000 7f760ff2c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:41:42.458 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.457+0000 7f760ff2c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:41:42.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.501+0000 7f46c5c82700 1 Processor -- start 2023-10-24T00:41:42.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.501+0000 7f46c5c82700 1 -- start start 2023-10-24T00:41:42.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5c82700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152080 0x7f46c00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5c82700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46c00ac6c0 0x7f46c0065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5c82700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c006b9e0 con 0x7f46c0152460 2023-10-24T00:41:42.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5c82700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00699a0 con 0x7f46c00ac6c0 2023-10-24T00:41:42.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5c82700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c006b420 con 0x7f46c0152080 2023-10-24T00:41:42.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46bffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46c00ac6c0 0x7f46c0065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5481700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f46c0152460 0x7f46c0062c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54778/0 (socket says 172.21.15.148:54778) 2023-10-24T00:41:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c5481700 1 -- 172.21.15.148:0/2800554715 learned_addr learned my addr 172.21.15.148:0/2800554715 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46c4c80700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152080 0x7f46c00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46bffff700 1 -- 172.21.15.148:0/2800554715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152080 msgr2=0x7f46c00694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46bffff700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152080 0x7f46c00694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46bffff700 1 -- 172.21.15.148:0/2800554715 >> v1:172.21.15.148:6789/0 conn(0x7f46c0152460 legacy=0x7f46c0062c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.502+0000 7f46bf7fe700 1 -- 172.21.15.148:0/2800554715 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888988153 0 0) 0x7f46c006b9e0 con 0x7f46c0152460 2023-10-24T00:41:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46bffff700 1 -- 172.21.15.148:0/2800554715 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c006b700 con 0x7f46c00ac6c0 2023-10-24T00:41:42.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46bffff700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00ac6c0 0x7f46c0065470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f46ac009760 tx=0x7f46ac009060).ready entity=mon.0 client_cookie=7108f90b440a9c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46bf7fe700 1 -- 172.21.15.148:0/2800554715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0090d0 con 0x7f46c00ac6c0 2023-10-24T00:41:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46bf7fe700 1 -- 172.21.15.148:0/2800554715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00f510 con 0x7f46c00ac6c0 2023-10-24T00:41:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46bf7fe700 1 -- 172.21.15.148:0/2800554715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00f890 con 0x7f46c00ac6c0 2023-10-24T00:41:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 -- 172.21.15.148:0/2800554715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00ac6c0 msgr2=0x7f46c0065470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00ac6c0 0x7f46c0065470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f46ac009760 tx=0x7f46ac009060).stop 2023-10-24T00:41:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 -- 172.21.15.148:0/2800554715 shutdown_connections 2023-10-24T00:41:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152080 0x7f46c00694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2800554715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00ac6c0 0x7f46c0065470 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.503+0000 7f46c5c82700 1 -- 172.21.15.148:0/2800554715 >> 172.21.15.148:0/2800554715 conn(0x7f46c00c72d0 msgr2=0x7f46c00c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.504+0000 7f46c5c82700 1 -- 172.21.15.148:0/2800554715 shutdown_connections 2023-10-24T00:41:42.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.504+0000 7f46c5c82700 1 -- 172.21.15.148:0/2800554715 wait complete. 2023-10-24T00:41:42.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.505+0000 7f46c5c82700 1 Processor -- start 2023-10-24T00:41:42.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.505+0000 7f46c5c82700 1 -- start start 2023-10-24T00:41:42.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.505+0000 7f46c5c82700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c00ac6c0 0x7f46c0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 0x7f46c0154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014c870 con 0x7f46c0152080 2023-10-24T00:41:42.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014b9d0 con 0x7f46c00ac6c0 2023-10-24T00:41:42.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014bc60 con 0x7f46c0152460 2023-10-24T00:41:42.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54796/0 (socket says 172.21.15.148:54796) 2023-10-24T00:41:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 -- 172.21.15.148:0/2569123243 learned_addr learned my addr 172.21.15.148:0/2569123243 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5481700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 0x7f46c0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c4c80700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c00ac6c0 0x7f46c0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 msgr2=0x7f46c0154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 0x7f46c0154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c00ac6c0 msgr2=0x7f46c0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c00ac6c0 0x7f46c0152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 -- 172.21.15.148:0/2569123243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0092a0 con 0x7f46c0152080 2023-10-24T00:41:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5481700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 0x7f46c0154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:42.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bffff700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f46c00684b0 tx=0x7f46ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac006950 con 0x7f46c0152080 2023-10-24T00:41:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c014bf40 con 0x7f46c0152080 2023-10-24T00:41:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00f680 con 0x7f46c0152080 2023-10-24T00:41:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00fe80 con 0x7f46c0152080 2023-10-24T00:41:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.506+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c014c500 con 0x7f46c0152080 2023-10-24T00:41:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.507+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c00640f0 con 0x7f46c0152080 2023-10-24T00:41:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.508+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f46ac01b620 con 0x7f46c0152080 2023-10-24T00:41:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.509+0000 7f46bcff9700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 0x7f46a40616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.509+0000 7f46c4c80700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 msgr2=0x7f46a40616d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.509+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f46ac07bef0 con 0x7f46c0152080 2023-10-24T00:41:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.509+0000 7f46c4c80700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 0x7f46a40616d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:42.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.513+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f46ac04cd10 con 0x7f46c0152080 2023-10-24T00:41:42.534 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.532+0000 7f760ff2c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:41:42.544 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:42.543+0000 7f4aaf6e1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:41:42.615 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:42.614+0000 7f4aaf6e1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:41:42.681 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.680+0000 7f760ff2c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:41:42.693 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:42.691+0000 7f4aaf6e1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:41:42.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.710+0000 7f46c4c80700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 msgr2=0x7f46a40616d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:42.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.710+0000 7f46c4c80700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 0x7f46a40616d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:41:42.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.727+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46c014c690 con 0x7f46c0152080 2023-10-24T00:41:42.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.728+0000 7f46bcff9700 1 -- 172.21.15.148:0/2569123243 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f46ac028070 con 0x7f46c0152080 2023-10-24T00:41:42.730 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:42.730 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:29:41.252610+0000","modified":"2023-10-24T00:29:43.265396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5022":{"gid":5022,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/115636737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":115636737},{"type":"v1","addr":"172.21.15.148:6835","nonce":115636737}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-24T00:41:42.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 msgr2=0x7f46a40616d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:42.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 0x7f46a40616d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 msgr2=0x7f46c0162590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f46c00684b0 tx=0x7f46ac017000).stop 2023-10-24T00:41:42.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 shutdown_connections 2023-10-24T00:41:42.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c0152460 0x7f46c0154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c00ac6c0 0x7f46c0152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46a405f210 0x7f46a40616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:42.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 --2- 172.21.15.148:0/2569123243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0152080 0x7f46c0162590 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 >> 172.21.15.148:0/2569123243 conn(0x7f46c00c72d0 msgr2=0x7f46c014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 shutdown_connections 2023-10-24T00:41:42.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.730+0000 7f46c5c82700 1 -- 172.21.15.148:0/2569123243 wait complete. 2023-10-24T00:41:42.734 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 12 2023-10-24T00:41:42.744 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:42.750 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.749+0000 7f760ff2c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:41:42.850 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:42.849+0000 7f4aaf6e1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:41:42.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.861+0000 7f51ff59e700 1 Processor -- start 2023-10-24T00:41:42.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.861+0000 7f51ff59e700 1 -- start start 2023-10-24T00:41:42.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.862+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.862+0000 7f51ff59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52000c0ef0 0x7f52000c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.862+0000 7f51ff59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000c6410 con 0x7f52000ca110 2023-10-24T00:41:42.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.862+0000 7f51ff59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000ca6e0 con 0x7f52000c0ef0 2023-10-24T00:41:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.862+0000 7f51ff59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000ca9c0 con 0x7f52000aa140 2023-10-24T00:41:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52000c0ef0 0x7f52000c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52000c0ef0 0x7f52000c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54810/0 (socket says 172.21.15.148:54810) 2023-10-24T00:41:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 -- 172.21.15.148:0/4144461275 learned_addr learned my addr 172.21.15.148:0/4144461275 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:42.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fe59c700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 -- 172.21.15.148:0/4144461275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 msgr2=0x7f52000c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:42.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 -- 172.21.15.148:0/4144461275 >> v1:172.21.15.150:6789/0 conn(0x7f52000ca110 legacy=0x7f52000c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fd59a700 1 -- 172.21.15.148:0/4144461275 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592687894 0 0) 0x7f52000c6410 con 0x7f52000ca110 2023-10-24T00:41:42.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 -- 172.21.15.148:0/4144461275 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000c60a0 con 0x7f52000c0ef0 2023-10-24T00:41:42.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fed9d700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000c0ef0 0x7f52000c68a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f51f8009f20 tx=0x7f51f8009840).ready entity=mon.0 client_cookie=b9567bab544b4d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fd59a700 1 -- 172.21.15.148:0/4144461275 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800e070 con 0x7f52000c0ef0 2023-10-24T00:41:42.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fd59a700 1 -- 172.21.15.148:0/4144461275 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f800b9d0 con 0x7f52000c0ef0 2023-10-24T00:41:42.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.863+0000 7f51fd59a700 1 -- 172.21.15.148:0/4144461275 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800bd50 con 0x7f52000c0ef0 2023-10-24T00:41:42.869 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.865+0000 7f760ff2c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:41:42.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 -- 172.21.15.148:0/4144461275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000c0ef0 msgr2=0x7f52000c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000c0ef0 0x7f52000c68a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f51f8009f20 tx=0x7f51f8009840).stop 2023-10-24T00:41:42.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 -- 172.21.15.148:0/4144461275 shutdown_connections 2023-10-24T00:41:42.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 --2- 172.21.15.148:0/4144461275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000c0ef0 0x7f52000c68a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 -- 172.21.15.148:0/4144461275 >> 172.21.15.148:0/4144461275 conn(0x7f52000944a0 msgr2=0x7f520006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:42.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 -- 172.21.15.148:0/4144461275 shutdown_connections 2023-10-24T00:41:42.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.864+0000 7f51ff59e700 1 -- 172.21.15.148:0/4144461275 wait complete. 2023-10-24T00:41:42.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.866+0000 7f51ff59e700 1 Processor -- start 2023-10-24T00:41:42.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.866+0000 7f51ff59e700 1 -- start start 2023-10-24T00:41:42.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52000c0ef0 0x7f5200167990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200164580 con 0x7f52000ca110 2023-10-24T00:41:42.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b0310 con 0x7f52000c0ef0 2023-10-24T00:41:42.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.867+0000 7f51ff59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b05f0 con 0x7f52000aa140 2023-10-24T00:41:42.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fe59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54820/0 (socket says 172.21.15.148:54820) 2023-10-24T00:41:42.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 -- 172.21.15.148:0/3623091339 learned_addr learned my addr 172.21.15.148:0/3623091339 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:42.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fdd9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52000c0ef0 0x7f5200167990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:42.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 -- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 msgr2=0x7f52000982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 -- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52000c0ef0 msgr2=0x7f5200167990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:42.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52000c0ef0 0x7f5200167990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:42.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 -- 172.21.15.148:0/3623091339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009ae0 con 0x7f52000ca110 2023-10-24T00:41:42.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51fed9d700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f51f8010000 tx=0x7f51f8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:42.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80092e0 con 0x7f52000ca110 2023-10-24T00:41:42.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8007080 con 0x7f52000ca110 2023-10-24T00:41:42.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f801e680 con 0x7f52000ca110 2023-10-24T00:41:42.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52000b08d0 con 0x7f52000ca110 2023-10-24T00:41:42.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.868+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52000aff70 con 0x7f52000ca110 2023-10-24T00:41:42.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.869+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200047480 con 0x7f52000ca110 2023-10-24T00:41:42.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.870+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f51f8003040 con 0x7f52000ca110 2023-10-24T00:41:42.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.870+0000 7f51ee7fc700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 0x7f51e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:42.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.870+0000 7f51fe59c700 1 -- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 msgr2=0x7f51e0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:42.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.870+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f51f807b9b0 con 0x7f52000ca110 2023-10-24T00:41:42.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.870+0000 7f51fe59c700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 0x7f51e0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:42.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:42.874+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51f804c880 con 0x7f52000ca110 2023-10-24T00:41:42.927 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:42.926+0000 7f4aaf6e1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:41:42.977 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:42.975+0000 7f760ff2c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:41:43.046 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:43.045+0000 7f4aaf6e1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:41:43.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.046+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52000c5d50 con 0x7f52000ca110 2023-10-24T00:41:43.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.047+0000 7f51ee7fc700 1 -- 172.21.15.148:0/3623091339 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f51f8023070 con 0x7f52000ca110 2023-10-24T00:41:43.049 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:43.049 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:40.803987+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:29:39.212730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-24T00:29:40.218279+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":231,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6832/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:6833/87479":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/2026137738":"2023-10-25T00:29:57.116241+0000","172.21.15.150:0/3960475136":"2023-10-25T00:29:57.116241+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":9,"length":2},{"begin":12,"length":2},{"begin":15,"length":2},{"begin":19,"length":2},{"begin":22,"length":2},{"begin":25,"length":2},{"begin":29,"length":2},{"begin":32,"length":2},{"begin":35,"length":2},{"begin":39,"length":2},{"begin":42,"length":2},{"begin":45,"length":2},{"begin":49,"length":2},{"begin":52,"length":2},{"begin":55,"length":2},{"begin":59,"length":2},{"begin":62,"length":2},{"begin":65,"length":2},{"begin":68,"length":3},{"begin":72,"length":2},{"begin":75,"length":2},{"begin":78,"length":3},{"begin":82,"length":2},{"begin":85,"length":2},{"begin":88,"length":3},{"begin":92,"length":2},{"begin":95,"length":2},{"begin":98,"length":3},{"begin":102,"length":2},{"begin":105,"length":2},{"begin":108,"length":3},{"begin":112,"length":2},{"begin":115,"length":2},{"begin":160,"length":72}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":110,"length":1},{"begin":231,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:43.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 msgr2=0x7f51e0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:43.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 0x7f51e0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:43.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 msgr2=0x7f52000c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:43.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f51f8010000 tx=0x7f51f8009840).stop 2023-10-24T00:41:43.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 shutdown_connections 2023-10-24T00:41:43.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51e005f270 0x7f51e0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:43.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52000ca110 0x7f52000c8d30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52000aa140 0x7f52000982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.049+0000 7f51ff59e700 1 --2- 172.21.15.148:0/3623091339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52000c0ef0 0x7f5200167990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.050+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 >> 172.21.15.148:0/3623091339 conn(0x7f52000944a0 msgr2=0x7f5200152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:43.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.050+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 shutdown_connections 2023-10-24T00:41:43.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.050+0000 7f51ff59e700 1 -- 172.21.15.148:0/3623091339 wait complete. 2023-10-24T00:41:43.064 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:41:43.162 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:43.161+0000 7f4aaf6e1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:41:43.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.181+0000 7f305ec69700 1 Processor -- start 2023-10-24T00:41:43.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.181+0000 7f305ec69700 1 -- start start 2023-10-24T00:41:43.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ec69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 0x7f30580a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ec69700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3058062a30 0x7f3058062ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ec69700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580a9db0 con 0x7f3058062650 2023-10-24T00:41:43.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ec69700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3058150da0 con 0x7f3058062a30 2023-10-24T00:41:43.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ec69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3058064da0 con 0x7f30580a7c80 2023-10-24T00:41:43.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3058062a30 0x7f3058062ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:43.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ca05700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3058062650 0x7f30580aa610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:54780/0 (socket says 172.21.15.148:54780) 2023-10-24T00:41:43.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305ca05700 1 -- 172.21.15.148:0/2350894757 learned_addr learned my addr 172.21.15.148:0/2350894757 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:43.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f3057fff700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 0x7f30580a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:43.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 -- 172.21.15.148:0/2350894757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 msgr2=0x7f30580a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:43.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 0x7f30580a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 -- 172.21.15.148:0/2350894757 >> v1:172.21.15.148:6789/0 conn(0x7f3058062650 legacy=0x7f30580aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:43.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 -- 172.21.15.148:0/2350894757 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058065c00 con 0x7f3058062a30 2023-10-24T00:41:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f30577fe700 1 -- 172.21.15.148:0/2350894757 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157427258 0 0) 0x7f304c001110 con 0x7f3058062650 2023-10-24T00:41:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f3057fff700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 0x7f30580a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f305d206700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062a30 0x7f3058062ea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3050009e60 tx=0x7f3050009780).ready entity=mon.0 client_cookie=9c3d5a900f168b14 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f30577fe700 1 -- 172.21.15.148:0/2350894757 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000e070 con 0x7f3058062a30 2023-10-24T00:41:43.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f30577fe700 1 -- 172.21.15.148:0/2350894757 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000bc30 con 0x7f3058062a30 2023-10-24T00:41:43.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.182+0000 7f30577fe700 1 -- 172.21.15.148:0/2350894757 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050012410 con 0x7f3058062a30 2023-10-24T00:41:43.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 -- 172.21.15.148:0/2350894757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062a30 msgr2=0x7f3058062ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:43.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062a30 0x7f3058062ea0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f3050009e60 tx=0x7f3050009780).stop 2023-10-24T00:41:43.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 -- 172.21.15.148:0/2350894757 shutdown_connections 2023-10-24T00:41:43.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062a30 0x7f3058062ea0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 --2- 172.21.15.148:0/2350894757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30580a7c80 0x7f30580a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 -- 172.21.15.148:0/2350894757 >> 172.21.15.148:0/2350894757 conn(0x7f30580c3f60 msgr2=0x7f30580c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:43.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 -- 172.21.15.148:0/2350894757 shutdown_connections 2023-10-24T00:41:43.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.183+0000 7f305ec69700 1 -- 172.21.15.148:0/2350894757 wait complete. 2023-10-24T00:41:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.184+0000 7f305ec69700 1 Processor -- start 2023-10-24T00:41:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.184+0000 7f305ec69700 1 -- start start 2023-10-24T00:41:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 0x7f305814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 0x7f30580be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30580a7c80 0x7f30580be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580bebe0 con 0x7f3058062650 2023-10-24T00:41:43.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580a0b20 con 0x7f30580a7c80 2023-10-24T00:41:43.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ec69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580bd5e0 con 0x7f3058062a30 2023-10-24T00:41:43.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ca05700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 0x7f305814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:43.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ca05700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 0x7f305814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54840/0 (socket says 172.21.15.148:54840) 2023-10-24T00:41:43.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305ca05700 1 -- 172.21.15.148:0/3765711632 learned_addr learned my addr 172.21.15.148:0/3765711632 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:43.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f3057fff700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 0x7f30580be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:43.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.185+0000 7f305d206700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30580a7c80 0x7f30580be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:43.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30580a7c80 msgr2=0x7f30580be6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:43.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30580a7c80 0x7f30580be6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 msgr2=0x7f305814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:43.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 0x7f305814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:43.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 -- 172.21.15.148:0/3765711632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050009a20 con 0x7f3058062a30 2023-10-24T00:41:43.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3057fff700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 0x7f30580be200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f304400d860 tx=0x7f3044008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:43.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044011590 con 0x7f3058062a30 2023-10-24T00:41:43.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30440116f0 con 0x7f3058062a30 2023-10-24T00:41:43.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30580bd300 con 0x7f3058062a30 2023-10-24T00:41:43.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044011a70 con 0x7f3058062a30 2023-10-24T00:41:43.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.186+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30580a07b0 con 0x7f3058062a30 2023-10-24T00:41:43.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.187+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580a0cb0 con 0x7f3058062a30 2023-10-24T00:41:43.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.187+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3044012420 con 0x7f3058062a30 2023-10-24T00:41:43.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.188+0000 7f3054ff9700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:43.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.188+0000 7f305ca05700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 msgr2=0x7f303c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:41:43.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.188+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f304407a050 con 0x7f3058062a30 2023-10-24T00:41:43.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.188+0000 7f305ca05700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:41:43.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.192+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f304404ae10 con 0x7f3058062a30 2023-10-24T00:41:43.270 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.269+0000 7f760ff2c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:41:43.341 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.339+0000 7f760ff2c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:41:43.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.365+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mgrmap(e 12) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f3044077970 con 0x7f3058062a30 2023-10-24T00:41:43.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.365+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 msgr2=0x7f303c061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:41:43.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.365+0000 7f3054ff9700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:43.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:43.408+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f30580a9200 con 0x7f3058062a30 2023-10-24T00:41:43.421 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758d6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758d6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758d6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758a6bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758d6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758a6bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758d6c5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758a6bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758a6bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:41:43.420+0000 7f758a6bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:41:43.426 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.426 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.426 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.427 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.427 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-10-24T00:41:43.427 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:41:43.425+0000 7f41068f9700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:41:43.451 INFO:tasks.ceph.mds.c.smithi148.stderr: -7> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.451 INFO:tasks.ceph.mds.c.smithi148.stderr: -6> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.452 INFO:tasks.ceph.mds.c.smithi148.stderr: -5> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.452 INFO:tasks.ceph.mds.c.smithi148.stderr: -4> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:41:43.452 INFO:tasks.ceph.mds.c.smithi148.stderr: -3> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2023-10-24T00:41:43.452 INFO:tasks.ceph.mds.c.smithi148.stderr: -1> 2023-10-24T00:41:43.425+0000 7f41068f9700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:41:43.471 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:41:43.487 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:43.486+0000 7f4aaf6e1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:41:43.557 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:41:43.556+0000 7f4aaf6e1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:41:44.360 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:41:44.359+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:41:44.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.367+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 8 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3044077cf0 con 0x7f3058062a30 2023-10-24T00:41:44.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.368+0000 7f3054ff9700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.368+0000 7f305ca05700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.370+0000 7f305ca05700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f304c007fd0 tx=0x7f304c007e90).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:44.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.372+0000 7f3054ff9700 1 -- 172.21.15.148:0/3765711632 <== mon.2 v2:172.21.15.150:3301/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f304404be20 con 0x7f3058062a30 2023-10-24T00:41:44.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.374+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 msgr2=0x7f303c061680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:44.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.374+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f304c007fd0 tx=0x7f304c007e90).stop 2023-10-24T00:41:44.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.374+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 msgr2=0x7f30580be200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:44.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.374+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 0x7f30580be200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f304400d860 tx=0x7f3044008040).stop 2023-10-24T00:41:44.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 shutdown_connections 2023-10-24T00:41:44.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30580a7c80 0x7f30580be6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f303c05f240 0x7f303c061680 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3058062650 0x7f305814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 --2- 172.21.15.148:0/3765711632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3058062a30 0x7f30580be200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 >> 172.21.15.148:0/3765711632 conn(0x7f30580c3f60 msgr2=0x7f3058066090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:44.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 shutdown_connections 2023-10-24T00:41:44.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.375+0000 7f305ec69700 1 -- 172.21.15.148:0/3765711632 wait complete. 2023-10-24T00:41:44.380 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:41:44.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:41:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.505+0000 7f29fe16c700 1 Processor -- start 2023-10-24T00:41:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.505+0000 7f29fe16c700 1 -- start start 2023-10-24T00:41:44.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29fe16c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29f8150f60 0x7f29f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29fe16c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29f8069910 0x7f29f80c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29fe16c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f8069dc0 con 0x7f29f80c3370 2023-10-24T00:41:44.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29fe16c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80bcc80 con 0x7f29f8150f60 2023-10-24T00:41:44.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29fe16c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f806a520 con 0x7f29f8069910 2023-10-24T00:41:44.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29f77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29f8150f60 0x7f29f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29f77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29f8150f60 0x7f29f8069420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57538/0 (socket says 172.21.15.148:57538) 2023-10-24T00:41:44.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.506+0000 7f29f77fe700 1 -- 172.21.15.148:0/3912801072 learned_addr learned my addr 172.21.15.148:0/3912801072 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:44.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f6ffd700 1 --2- 172.21.15.148:0/3912801072 >> v2:172.21.15.150:3300/0 conn(0x7f29f8069910 0x7f29f80c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f77fe700 1 -- 172.21.15.148:0/3912801072 >> v2:172.21.15.150:3300/0 conn(0x7f29f8069910 msgr2=0x7f29f80c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f77fe700 1 --2- 172.21.15.148:0/3912801072 >> v2:172.21.15.150:3300/0 conn(0x7f29f8069910 0x7f29f80c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f77fe700 1 -- 172.21.15.148:0/3912801072 >> v1:172.21.15.150:6789/0 conn(0x7f29f80c3370 legacy=0x7f29f8154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f77fe700 1 -- 172.21.15.148:0/3912801072 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80c3af0 con 0x7f29f8150f60 2023-10-24T00:41:44.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f77fe700 1 --2- 172.21.15.148:0/3912801072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f8150f60 0x7f29f8069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f29f8155ca0 tx=0x7f29e800ba50).ready entity=mon.0 client_cookie=4fac7727c8d541e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:44.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f67fc700 1 -- 172.21.15.148:0/3912801072 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8010070 con 0x7f29f8150f60 2023-10-24T00:41:44.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f67fc700 1 -- 172.21.15.148:0/3912801072 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800de50 con 0x7f29f8150f60 2023-10-24T00:41:44.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29f67fc700 1 -- 172.21.15.148:0/3912801072 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b2e0 con 0x7f29f8150f60 2023-10-24T00:41:44.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 -- 172.21.15.148:0/3912801072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f8150f60 msgr2=0x7f29f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:44.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 --2- 172.21.15.148:0/3912801072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f8150f60 0x7f29f8069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f29f8155ca0 tx=0x7f29e800ba50).stop 2023-10-24T00:41:44.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 -- 172.21.15.148:0/3912801072 shutdown_connections 2023-10-24T00:41:44.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 --2- 172.21.15.148:0/3912801072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f8150f60 0x7f29f8069420 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 --2- 172.21.15.148:0/3912801072 >> v2:172.21.15.150:3300/0 conn(0x7f29f8069910 0x7f29f80c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.507+0000 7f29fe16c700 1 -- 172.21.15.148:0/3912801072 >> 172.21.15.148:0/3912801072 conn(0x7f29f80c7d20 msgr2=0x7f29f80c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:44.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.508+0000 7f29fe16c700 1 -- 172.21.15.148:0/3912801072 shutdown_connections 2023-10-24T00:41:44.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.508+0000 7f29fe16c700 1 -- 172.21.15.148:0/3912801072 wait complete. 2023-10-24T00:41:44.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.509+0000 7f29fe16c700 1 Processor -- start 2023-10-24T00:41:44.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.509+0000 7f29fe16c700 1 -- start start 2023-10-24T00:41:44.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.509+0000 7f29fe16c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29f8069910 0x7f29f80a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 0x7f29f8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8149e10 con 0x7f29f80c3370 2023-10-24T00:41:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80bfec0 con 0x7f29f8150f60 2023-10-24T00:41:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8149570 con 0x7f29f8069910 2023-10-24T00:41:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57542/0 (socket says 172.21.15.148:57542) 2023-10-24T00:41:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 -- 172.21.15.148:0/459718084 learned_addr learned my addr 172.21.15.148:0/459718084 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:44.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f77fe700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29f8069910 0x7f29f80a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f7fff700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 0x7f29f8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 -- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29f8069910 msgr2=0x7f29f80a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:44.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29f8069910 0x7f29f80a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 -- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 msgr2=0x7f29f8148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 0x7f29f8148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 -- 172.21.15.148:0/459718084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e800bcf0 con 0x7f29f80c3370 2023-10-24T00:41:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f7fff700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 0x7f29f8148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29f6ffd700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f29ec00d890 tx=0x7f29ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0125f0 con 0x7f29f80c3370 2023-10-24T00:41:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec012750 con 0x7f29f80c3370 2023-10-24T00:41:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8149850 con 0x7f29f80c3370 2023-10-24T00:41:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec012ad0 con 0x7f29f80c3370 2023-10-24T00:41:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.510+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f81506d0 con 0x7f29f80c3370 2023-10-24T00:41:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.511+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f806c6b0 con 0x7f29f80c3370 2023-10-24T00:41:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.511+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f29ec013480 con 0x7f29f80c3370 2023-10-24T00:41:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.512+0000 7f29df7fe700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 0x7f29e40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.512+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f29ec07a0b0 con 0x7f29f80c3370 2023-10-24T00:41:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.512+0000 7f29f77fe700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 0x7f29e40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.513+0000 7f29f77fe700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 0x7f29e40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f29e800bb40 tx=0x7f29e800ba50).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:44.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.516+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29ec04b190 con 0x7f29f80c3370 2023-10-24T00:41:44.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:44.721+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f29f80c0030 con 0x7f29f80c3370 2023-10-24T00:41:45.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.414+0000 7f29df7fe700 1 -- 172.21.15.148:0/459718084 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f29f80c0030 con 0x7f29f80c3370 2023-10-24T00:41:45.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 msgr2=0x7f29e40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 0x7f29e40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f29e800bb40 tx=0x7f29e800ba50).stop 2023-10-24T00:41:45.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 msgr2=0x7f29f8148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f29ec00d890 tx=0x7f29ec008040).stop 2023-10-24T00:41:45.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 shutdown_connections 2023-10-24T00:41:45.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29f8150f60 0x7f29f8148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29f8069910 0x7f29f80a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29e405f030 0x7f29e40614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 --2- 172.21.15.148:0/459718084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29f80c3370 0x7f29f8148af0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 >> 172.21.15.148:0/459718084 conn(0x7f29f80c7d20 msgr2=0x7f29f80a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:45.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 shutdown_connections 2023-10-24T00:41:45.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.416+0000 7f29fe16c700 1 -- 172.21.15.148:0/459718084 wait complete. 2023-10-24T00:41:45.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:41:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.549+0000 7f96985bf700 1 Processor -- start 2023-10-24T00:41:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.549+0000 7f96985bf700 1 -- start start 2023-10-24T00:41:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f96985bf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96900a7d00 0x7f96900a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f96985bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96900aa420 0x7f96900c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f96985bf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900c6270 con 0x7f96901544b0 2023-10-24T00:41:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f96985bf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900c60e0 con 0x7f96900a7d00 2023-10-24T00:41:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f96985bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900c0c80 con 0x7f96900aa420 2023-10-24T00:41:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f969635b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f96901544b0 0x7f96900c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47420/0 (socket says 172.21.15.148:47420) 2023-10-24T00:41:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9695b5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96900a7d00 0x7f96900a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f969635b700 1 -- 172.21.15.148:0/1642431964 learned_addr learned my addr 172.21.15.148:0/1642431964 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9696b5c700 1 --2- 172.21.15.148:0/1642431964 >> v2:172.21.15.150:3300/0 conn(0x7f96900aa420 0x7f96900c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9695b5a700 1 -- 172.21.15.148:0/1642431964 >> v2:172.21.15.150:3300/0 conn(0x7f96900aa420 msgr2=0x7f96900c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9695b5a700 1 --2- 172.21.15.148:0/1642431964 >> v2:172.21.15.150:3300/0 conn(0x7f96900aa420 0x7f96900c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9695b5a700 1 -- 172.21.15.148:0/1642431964 >> v1:172.21.15.148:6789/0 conn(0x7f96901544b0 legacy=0x7f96900c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.550+0000 7f9695b5a700 1 -- 172.21.15.148:0/1642431964 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900c0f40 con 0x7f96900a7d00 2023-10-24T00:41:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f9695b5a700 1 --2- 172.21.15.148:0/1642431964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900a7d00 0x7f96900a9f30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9690085ad0 tx=0x7f9680009060).ready entity=mon.0 client_cookie=6d6b6edd9acb1d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f9695359700 1 -- 172.21.15.148:0/1642431964 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000b580 con 0x7f96900a7d00 2023-10-24T00:41:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f9695359700 1 -- 172.21.15.148:0/1642431964 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000b6e0 con 0x7f96900a7d00 2023-10-24T00:41:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f9695359700 1 -- 172.21.15.148:0/1642431964 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000ba60 con 0x7f96900a7d00 2023-10-24T00:41:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 -- 172.21.15.148:0/1642431964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900a7d00 msgr2=0x7f96900a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 --2- 172.21.15.148:0/1642431964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900a7d00 0x7f96900a9f30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9690085ad0 tx=0x7f9680009060).stop 2023-10-24T00:41:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 -- 172.21.15.148:0/1642431964 shutdown_connections 2023-10-24T00:41:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 --2- 172.21.15.148:0/1642431964 >> v2:172.21.15.150:3300/0 conn(0x7f96900aa420 0x7f96900c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 --2- 172.21.15.148:0/1642431964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900a7d00 0x7f96900a9f30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 -- 172.21.15.148:0/1642431964 >> 172.21.15.148:0/1642431964 conn(0x7f96900945d0 msgr2=0x7f969006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 -- 172.21.15.148:0/1642431964 shutdown_connections 2023-10-24T00:41:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.551+0000 7f96985bf700 1 -- 172.21.15.148:0/1642431964 wait complete. 2023-10-24T00:41:45.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.552+0000 7f96985bf700 1 Processor -- start 2023-10-24T00:41:45.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.552+0000 7f96985bf700 1 -- start start 2023-10-24T00:41:45.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900a7d00 0x7f969014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96901544b0 0x7f96900ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690168620 con 0x7f96900aa420 2023-10-24T00:41:45.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690167d30 con 0x7f96901544b0 2023-10-24T00:41:45.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f96985bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9690167fd0 con 0x7f96900a7d00 2023-10-24T00:41:45.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f9695b5a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f9695b5a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57566/0 (socket says 172.21.15.148:57566) 2023-10-24T00:41:45.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.553+0000 7f9695b5a700 1 -- 172.21.15.148:0/1638888025 learned_addr learned my addr 172.21.15.148:0/1638888025 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:45.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 -- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900a7d00 msgr2=0x7f969014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900a7d00 0x7f969014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 -- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96901544b0 msgr2=0x7f96900ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96901544b0 0x7f96900ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 -- 172.21.15.148:0/1638888025 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800092a0 con 0x7f96900aa420 2023-10-24T00:41:45.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f9695b5a700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9680009fd0 tx=0x7f9680017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000b850 con 0x7f96900aa420 2023-10-24T00:41:45.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000b9b0 con 0x7f96900aa420 2023-10-24T00:41:45.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96901682b0 con 0x7f96900aa420 2023-10-24T00:41:45.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968001b660 con 0x7f96900aa420 2023-10-24T00:41:45.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.554+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9690168ab0 con 0x7f96900aa420 2023-10-24T00:41:45.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.555+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9690168900 con 0x7f96900aa420 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.555+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f968001ba90 con 0x7f96900aa420 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.555+0000 7f96867fc700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 0x7f96740614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.556+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f968007bf60 con 0x7f96900aa420 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.556+0000 7f969635b700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 0x7f96740614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.556+0000 7f969635b700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 0x7f96740614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f968c007fd0 tx=0x7f968c007d90).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.560+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f968004d000 con 0x7f96900aa420 2023-10-24T00:41:45.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.723+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9690168760 con 0x7f96900aa420 2023-10-24T00:41:45.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.803+0000 7f96867fc700 1 -- 172.21.15.148:0/1638888025 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9690168760 con 0x7f96900aa420 2023-10-24T00:41:45.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 msgr2=0x7f96740614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 0x7f96740614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f968c007fd0 tx=0x7f968c007d90).stop 2023-10-24T00:41:45.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 msgr2=0x7f96900abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9680009fd0 tx=0x7f9680017000).stop 2023-10-24T00:41:45.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 shutdown_connections 2023-10-24T00:41:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96901544b0 0x7f96900ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900a7d00 0x7f969014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f030 0x7f96740614f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 --2- 172.21.15.148:0/1638888025 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96900aa420 0x7f96900abf20 secure :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0x7f9680009fd0 tx=0x7f9680017000).stop 2023-10-24T00:41:45.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 >> 172.21.15.148:0/1638888025 conn(0x7f96900945d0 msgr2=0x7f96900bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:45.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 shutdown_connections 2023-10-24T00:41:45.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.807+0000 7f96985bf700 1 -- 172.21.15.148:0/1638888025 wait complete. 2023-10-24T00:41:45.813 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:41:45.828 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:41:45.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.944+0000 7f0f3759e700 1 Processor -- start 2023-10-24T00:41:45.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.944+0000 7f0f3759e700 1 -- start start 2023-10-24T00:41:45.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f380a9f40 0x7f0f38155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380aa320 0x7f0f380c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3759e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380c7770 con 0x7f0f380c0820 2023-10-24T00:41:45.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380c86d0 con 0x7f0f380a9f40 2023-10-24T00:41:45.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380c1070 con 0x7f0f380aa320 2023-10-24T00:41:45.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.945+0000 7f0f3659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f380a9f40 0x7f0f38155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f380a9f40 0x7f0f38155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57568/0 (socket says 172.21.15.148:57568) 2023-10-24T00:41:45.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 -- 172.21.15.148:0/3463179151 learned_addr learned my addr 172.21.15.148:0/3463179151 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:45.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 -- 172.21.15.148:0/3463179151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380aa320 msgr2=0x7f0f380c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:45.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 --2- 172.21.15.148:0/3463179151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380aa320 0x7f0f380c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 -- 172.21.15.148:0/3463179151 >> v1:172.21.15.150:6789/0 conn(0x7f0f380c0820 legacy=0x7f0f38153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:45.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 -- 172.21.15.148:0/3463179151 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380c79e0 con 0x7f0f380a9f40 2023-10-24T00:41:45.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3659c700 1 --2- 172.21.15.148:0/3463179151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380a9f40 0x7f0f38155350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0f28009810 tx=0x7f0f28009060).ready entity=mon.0 client_cookie=4716ddc4c018f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f35d9b700 1 -- 172.21.15.148:0/3463179151 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28005880 con 0x7f0f380a9f40 2023-10-24T00:41:45.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f35d9b700 1 -- 172.21.15.148:0/3463179151 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f280059e0 con 0x7f0f380a9f40 2023-10-24T00:41:45.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f35d9b700 1 -- 172.21.15.148:0/3463179151 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28005d60 con 0x7f0f380a9f40 2023-10-24T00:41:45.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 -- 172.21.15.148:0/3463179151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380a9f40 msgr2=0x7f0f38155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 --2- 172.21.15.148:0/3463179151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380a9f40 0x7f0f38155350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0f28009810 tx=0x7f0f28009060).stop 2023-10-24T00:41:45.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 -- 172.21.15.148:0/3463179151 shutdown_connections 2023-10-24T00:41:45.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 --2- 172.21.15.148:0/3463179151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380a9f40 0x7f0f38155350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 --2- 172.21.15.148:0/3463179151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380aa320 0x7f0f380c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:45.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.946+0000 7f0f3759e700 1 -- 172.21.15.148:0/3463179151 >> 172.21.15.148:0/3463179151 conn(0x7f0f38094420 msgr2=0x7f0f3806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:45.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.947+0000 7f0f3759e700 1 -- 172.21.15.148:0/3463179151 shutdown_connections 2023-10-24T00:41:45.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.947+0000 7f0f3759e700 1 -- 172.21.15.148:0/3463179151 wait complete. 2023-10-24T00:41:45.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.948+0000 7f0f3759e700 1 Processor -- start 2023-10-24T00:41:45.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.948+0000 7f0f3759e700 1 -- start start 2023-10-24T00:41:45.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380a9f40 0x7f0f380b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f380aa320 0x7f0f38155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38157140 con 0x7f0f380c0820 2023-10-24T00:41:45.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b0830 con 0x7f0f380aa320 2023-10-24T00:41:45.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f381560a0 con 0x7f0f380a9f40 2023-10-24T00:41:45.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57576/0 (socket says 172.21.15.148:57576) 2023-10-24T00:41:45.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 -- 172.21.15.148:0/1740798982 learned_addr learned my addr 172.21.15.148:0/1740798982 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:45.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f2dd9b700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f380aa320 0x7f0f38155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3659c700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380a9f40 0x7f0f380b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 -- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380a9f40 msgr2=0x7f0f380b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380a9f40 0x7f0f380b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 -- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f380aa320 msgr2=0x7f0f38155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:45.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f380aa320 0x7f0f38155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:45.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 -- 172.21.15.148:0/1740798982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28009300 con 0x7f0f380c0820 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f36d9d700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0f3000b7e0 tx=0x7f0f30009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30001500 con 0x7f0f380c0820 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300016a0 con 0x7f0f380c0820 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f38156380 con 0x7f0f380c0820 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30001a60 con 0x7f0f380c0820 2023-10-24T00:41:45.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.949+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f38156940 con 0x7f0f380c0820 2023-10-24T00:41:45.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.950+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f38047480 con 0x7f0f380c0820 2023-10-24T00:41:45.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.951+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0f30011400 con 0x7f0f380c0820 2023-10-24T00:41:45.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.951+0000 7f0f2effd700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 0x7f0f180614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:45.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.951+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f0f30079aa0 con 0x7f0f380c0820 2023-10-24T00:41:45.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.951+0000 7f0f3659c700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 0x7f0f180614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:45.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.952+0000 7f0f3659c700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 0x7f0f180614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0f28009fd0 tx=0x7f0f28016000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:45.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:45.955+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f30047af0 con 0x7f0f380c0820 2023-10-24T00:41:46.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:46.062+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0f300777f0 con 0x7f0f380c0820 2023-10-24T00:41:46.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:46.123+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f380851d0 con 0x7f0f380c0820 2023-10-24T00:41:47.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.072+0000 7f0f2effd700 1 -- 172.21.15.148:0/1740798982 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0f30075aa0 con 0x7f0f380c0820 2023-10-24T00:41:47.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 msgr2=0x7f0f180614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 0x7f0f180614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0f28009fd0 tx=0x7f0f28016000).stop 2023-10-24T00:41:47.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 msgr2=0x7f0f380aa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0f3000b7e0 tx=0x7f0f30009310).stop 2023-10-24T00:41:47.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 shutdown_connections 2023-10-24T00:41:47.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f1805f030 0x7f0f180614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f380c0820 0x7f0f380aa8c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f380a9f40 0x7f0f380b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 --2- 172.21.15.148:0/1740798982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f380aa320 0x7f0f38155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 >> 172.21.15.148:0/1740798982 conn(0x7f0f38094420 msgr2=0x7f0f38064810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 shutdown_connections 2023-10-24T00:41:47.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.076+0000 7f0f3759e700 1 -- 172.21.15.148:0/1740798982 wait complete. 2023-10-24T00:41:47.080 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:41:47.092 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:41:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.212+0000 7f36533b5700 1 Processor -- start 2023-10-24T00:41:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 -- start start 2023-10-24T00:41:47.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f364c0a8230 0x7f364c0bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f364c156c30 0x7f364c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0bfdb0 con 0x7f364c1560a0 2023-10-24T00:41:47.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c0bfbc0 con 0x7f364c156c30 2023-10-24T00:41:47.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.213+0000 7f36533b5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c0c41a0 con 0x7f364c0a8230 2023-10-24T00:41:47.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f364c156c30 0x7f364c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3650950700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f364c1560a0 0x7f364c156520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47422/0 (socket says 172.21.15.148:47422) 2023-10-24T00:41:47.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3650950700 1 -- 172.21.15.148:0/3369648052 learned_addr learned my addr 172.21.15.148:0/3369648052 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:47.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651151700 1 --2- 172.21.15.148:0/3369648052 >> v2:172.21.15.150:3300/0 conn(0x7f364c0a8230 0x7f364c0bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 -- 172.21.15.148:0/3369648052 >> v2:172.21.15.150:3300/0 conn(0x7f364c0a8230 msgr2=0x7f364c0bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 --2- 172.21.15.148:0/3369648052 >> v2:172.21.15.150:3300/0 conn(0x7f364c0a8230 0x7f364c0bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 -- 172.21.15.148:0/3369648052 >> v1:172.21.15.148:6789/0 conn(0x7f364c1560a0 legacy=0x7f364c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3643fff700 1 -- 172.21.15.148:0/3369648052 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619857739 0 0) 0x7f364c0bfdb0 con 0x7f364c1560a0 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 -- 172.21.15.148:0/3369648052 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0c98b0 con 0x7f364c156c30 2023-10-24T00:41:47.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3651952700 1 --2- 172.21.15.148:0/3369648052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c156c30 0x7f364c152af0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f364c060ff0 tx=0x7f3644009780).ready entity=mon.0 client_cookie=9951daf1b4b588c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3643fff700 1 -- 172.21.15.148:0/3369648052 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e070 con 0x7f364c156c30 2023-10-24T00:41:47.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3643fff700 1 -- 172.21.15.148:0/3369648052 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400bc30 con 0x7f364c156c30 2023-10-24T00:41:47.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.214+0000 7f3643fff700 1 -- 172.21.15.148:0/3369648052 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644012410 con 0x7f364c156c30 2023-10-24T00:41:47.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 -- 172.21.15.148:0/3369648052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c156c30 msgr2=0x7f364c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 --2- 172.21.15.148:0/3369648052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c156c30 0x7f364c152af0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f364c060ff0 tx=0x7f3644009780).stop 2023-10-24T00:41:47.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 -- 172.21.15.148:0/3369648052 shutdown_connections 2023-10-24T00:41:47.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 --2- 172.21.15.148:0/3369648052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c156c30 0x7f364c152af0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 --2- 172.21.15.148:0/3369648052 >> v2:172.21.15.150:3300/0 conn(0x7f364c0a8230 0x7f364c0bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 -- 172.21.15.148:0/3369648052 >> 172.21.15.148:0/3369648052 conn(0x7f364c0630d0 msgr2=0x7f364c0c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 -- 172.21.15.148:0/3369648052 shutdown_connections 2023-10-24T00:41:47.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.215+0000 7f36533b5700 1 -- 172.21.15.148:0/3369648052 wait complete. 2023-10-24T00:41:47.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.216+0000 7f36533b5700 1 Processor -- start 2023-10-24T00:41:47.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.216+0000 7f36533b5700 1 -- start start 2023-10-24T00:41:47.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f364c0a8230 0x7f364c140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c156c30 0x7f364c0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c153480 con 0x7f364c1560a0 2023-10-24T00:41:47.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0ae040 con 0x7f364c0a8230 2023-10-24T00:41:47.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36533b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0ae320 con 0x7f364c156c30 2023-10-24T00:41:47.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57594/0 (socket says 172.21.15.148:57594) 2023-10-24T00:41:47.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 -- 172.21.15.148:0/1554410896 learned_addr learned my addr 172.21.15.148:0/1554410896 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:47.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3651151700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f364c0a8230 0x7f364c140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 -- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c156c30 msgr2=0x7f364c0ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3651952700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c156c30 0x7f364c0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c156c30 0x7f364c0ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 -- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f364c0a8230 msgr2=0x7f364c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f364c0a8230 0x7f364c140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 -- 172.21.15.148:0/1554410896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009a20 con 0x7f364c1560a0 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f3650950700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f363c00c4e0 tx=0x7f363c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.217+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0072e0 con 0x7f364c1560a0 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.218+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c007440 con 0x7f364c1560a0 2023-10-24T00:41:47.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.218+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0057a0 con 0x7f364c1560a0 2023-10-24T00:41:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.218+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c0ae600 con 0x7f364c1560a0 2023-10-24T00:41:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.218+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c0adce0 con 0x7f364c1560a0 2023-10-24T00:41:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.219+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c0aeaa0 con 0x7f364c1560a0 2023-10-24T00:41:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.219+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f363c005b90 con 0x7f364c1560a0 2023-10-24T00:41:47.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.219+0000 7f36417fa700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 0x7f3630061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.219+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f363c079890 con 0x7f364c1560a0 2023-10-24T00:41:47.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.219+0000 7f3651151700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 0x7f3630061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.220+0000 7f3651151700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 0x7f3630061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3648006fd0 tx=0x7f3648008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.223+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f363c04ad00 con 0x7f364c1560a0 2023-10-24T00:41:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.385+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f364c0c5320 con 0x7f364c1560a0 2023-10-24T00:41:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.389+0000 7f36417fa700 1 -- 172.21.15.148:0/1554410896 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v4) v1 ==== 120+0+0 (secure 0 0 0) 0x7f363c04e320 con 0x7f364c1560a0 2023-10-24T00:41:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 msgr2=0x7f3630061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 0x7f3630061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3648006fd0 tx=0x7f3648008040).stop 2023-10-24T00:41:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 msgr2=0x7f364c152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f363c00c4e0 tx=0x7f363c007c70).stop 2023-10-24T00:41:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 shutdown_connections 2023-10-24T00:41:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c156c30 0x7f364c0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f364c0a8230 0x7f364c140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363005f150 0x7f3630061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 --2- 172.21.15.148:0/1554410896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1560a0 0x7f364c152f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 >> 172.21.15.148:0/1554410896 conn(0x7f364c0630d0 msgr2=0x7f364c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 shutdown_connections 2023-10-24T00:41:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.391+0000 7f36533b5700 1 -- 172.21.15.148:0/1554410896 wait complete. 2023-10-24T00:41:47.404 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:41:47.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.524+0000 7fafd410d700 1 Processor -- start 2023-10-24T00:41:47.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.524+0000 7fafd410d700 1 -- start start 2023-10-24T00:41:47.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd410d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc14b3b0 0x7fafcc065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd410d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafcc155270 0x7fafcc0c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd410d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0bbb50 con 0x7fafcc14b790 2023-10-24T00:41:47.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd410d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc0c16e0 con 0x7fafcc155270 2023-10-24T00:41:47.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd410d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc06a5d0 con 0x7fafcc14b3b0 2023-10-24T00:41:47.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafcc155270 0x7fafcc0c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fafcc155270 0x7fafcc0c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57598/0 (socket says 172.21.15.148:57598) 2023-10-24T00:41:47.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd16a8700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fafcc14b790 0x7fafcc154b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47432/0 (socket says 172.21.15.148:47432) 2023-10-24T00:41:47.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 -- 172.21.15.148:0/772051649 learned_addr learned my addr 172.21.15.148:0/772051649 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:47.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd1ea9700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc14b3b0 0x7fafcc065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 -- 172.21.15.148:0/772051649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc14b3b0 msgr2=0x7fafcc065bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:47.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc14b3b0 0x7fafcc065bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 -- 172.21.15.148:0/772051649 >> v1:172.21.15.148:6789/0 conn(0x7fafcc14b790 legacy=0x7fafcc154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.525+0000 7fafd26aa700 1 -- 172.21.15.148:0/772051649 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0bbdf0 con 0x7fafcc155270 2023-10-24T00:41:47.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd26aa700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc155270 0x7fafcc0c11f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fafc4009f20 tx=0x7fafc4009840).ready entity=mon.0 client_cookie=4ce2f8fadf05bf05 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd0ea7700 1 -- 172.21.15.148:0/772051649 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400e070 con 0x7fafcc155270 2023-10-24T00:41:47.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd0ea7700 1 -- 172.21.15.148:0/772051649 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400b980 con 0x7fafcc155270 2023-10-24T00:41:47.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd0ea7700 1 -- 172.21.15.148:0/772051649 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400bd00 con 0x7fafcc155270 2023-10-24T00:41:47.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 -- 172.21.15.148:0/772051649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc155270 msgr2=0x7fafcc0c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc155270 0x7fafcc0c11f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fafc4009f20 tx=0x7fafc4009840).stop 2023-10-24T00:41:47.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 -- 172.21.15.148:0/772051649 shutdown_connections 2023-10-24T00:41:47.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc155270 0x7fafcc0c11f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 --2- 172.21.15.148:0/772051649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc14b3b0 0x7fafcc065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 -- 172.21.15.148:0/772051649 >> 172.21.15.148:0/772051649 conn(0x7fafcc0c6bf0 msgr2=0x7fafcc0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 -- 172.21.15.148:0/772051649 shutdown_connections 2023-10-24T00:41:47.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.526+0000 7fafd410d700 1 -- 172.21.15.148:0/772051649 wait complete. 2023-10-24T00:41:47.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 Processor -- start 2023-10-24T00:41:47.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 -- start start 2023-10-24T00:41:47.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc14b3b0 0x7fafcc0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc155270 0x7fafcc0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0ac290 con 0x7fafcc14b790 2023-10-24T00:41:47.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc14d1f0 con 0x7fafcc14b3b0 2023-10-24T00:41:47.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd410d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc14d4d0 con 0x7fafcc155270 2023-10-24T00:41:47.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd16a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd16a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57608/0 (socket says 172.21.15.148:57608) 2023-10-24T00:41:47.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.528+0000 7fafd16a8700 1 -- 172.21.15.148:0/3564332963 learned_addr learned my addr 172.21.15.148:0/3564332963 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:47.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 -- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc155270 msgr2=0x7fafcc0a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc155270 0x7fafcc0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 -- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc14b3b0 msgr2=0x7fafcc0abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc14b3b0 0x7fafcc0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 -- 172.21.15.148:0/3564332963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009ae0 con 0x7fafcc14b790 2023-10-24T00:41:47.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd16a8700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fafbc00c810 tx=0x7fafbc007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0072e0 con 0x7fafcc14b790 2023-10-24T00:41:47.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc007440 con 0x7fafcc14b790 2023-10-24T00:41:47.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc14d7b0 con 0x7fafcc14b790 2023-10-24T00:41:47.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0058f0 con 0x7fafcc14b790 2023-10-24T00:41:47.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.529+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc14dd70 con 0x7fafcc14b790 2023-10-24T00:41:47.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.530+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc0644c0 con 0x7fafcc14b790 2023-10-24T00:41:47.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.530+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fafbc005ca0 con 0x7fafcc14b790 2023-10-24T00:41:47.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.531+0000 7fafc1ffb700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 0x7fafb00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.531+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fafbc079830 con 0x7fafcc14b790 2023-10-24T00:41:47.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.531+0000 7fafd1ea9700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 0x7fafb00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.531+0000 7fafd1ea9700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 0x7fafb00615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fafcc14e5f0 tx=0x7fafc8008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.535+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fafbc04aca0 con 0x7fafcc14b790 2023-10-24T00:41:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.700+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fafcc14df60 con 0x7fafcc14b790 2023-10-24T00:41:47.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.704+0000 7fafc1ffb700 1 -- 172.21.15.148:0/3564332963 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafbc079030 con 0x7fafcc14b790 2023-10-24T00:41:47.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.705+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 msgr2=0x7fafb00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.705+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 0x7fafb00615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fafcc14e5f0 tx=0x7fafc8008040).stop 2023-10-24T00:41:47.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 msgr2=0x7fafcc161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fafbc00c810 tx=0x7fafbc007d60).stop 2023-10-24T00:41:47.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 shutdown_connections 2023-10-24T00:41:47.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafcc155270 0x7fafcc0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc14b3b0 0x7fafcc0abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafb005f120 0x7fafb00615e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 --2- 172.21.15.148:0/3564332963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafcc14b790 0x7fafcc161e50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 >> 172.21.15.148:0/3564332963 conn(0x7fafcc0c6bf0 msgr2=0x7fafcc0c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 shutdown_connections 2023-10-24T00:41:47.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.706+0000 7fafd410d700 1 -- 172.21.15.148:0/3564332963 wait complete. 2023-10-24T00:41:47.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-24T00:41:47.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.831+0000 7fe47aa11700 1 Processor -- start 2023-10-24T00:41:47.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.831+0000 7fe47aa11700 1 -- start start 2023-10-24T00:41:47.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe47aa11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe4740c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe47aa11700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe47aa11700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4740aa880 con 0x7fe4740aa010 2023-10-24T00:41:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe47aa11700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740c0960 con 0x7fe4740aa3f0 2023-10-24T00:41:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe47aa11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740c0c40 con 0x7fe4740c6710 2023-10-24T00:41:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57610/0 (socket says 172.21.15.148:57610) 2023-10-24T00:41:47.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 -- 172.21.15.148:0/4235119459 learned_addr learned my addr 172.21.15.148:0/4235119459 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:47.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe4737fe700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe4740c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 -- 172.21.15.148:0/4235119459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 msgr2=0x7fe4740c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:47.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe4740c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 -- 172.21.15.148:0/4235119459 >> v1:172.21.15.150:6789/0 conn(0x7fe4740aa010 legacy=0x7fe474158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 -- 172.21.15.148:0/4235119459 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740c0f20 con 0x7fe4740aa3f0 2023-10-24T00:41:47.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe4737fe700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe4740c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:47.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe478fae700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fe46c009f20 tx=0x7fe46c009840).ready entity=mon.0 client_cookie=af2f959b7d529256 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe472ffd700 1 -- 172.21.15.148:0/4235119459 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00e070 con 0x7fe4740aa3f0 2023-10-24T00:41:47.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe472ffd700 1 -- 172.21.15.148:0/4235119459 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c00ba80 con 0x7fe4740aa3f0 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.832+0000 7fe472ffd700 1 -- 172.21.15.148:0/4235119459 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00be00 con 0x7fe4740aa3f0 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 -- 172.21.15.148:0/4235119459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa3f0 msgr2=0x7fe474069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fe46c009f20 tx=0x7fe46c009840).stop 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 -- 172.21.15.148:0/4235119459 shutdown_connections 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 --2- 172.21.15.148:0/4235119459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe4740c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:47.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 -- 172.21.15.148:0/4235119459 >> 172.21.15.148:0/4235119459 conn(0x7fe4740caf40 msgr2=0x7fe4740cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:47.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 -- 172.21.15.148:0/4235119459 shutdown_connections 2023-10-24T00:41:47.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.833+0000 7fe47aa11700 1 -- 172.21.15.148:0/4235119459 wait complete. 2023-10-24T00:41:47.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.834+0000 7fe47aa11700 1 Processor -- start 2023-10-24T00:41:47.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.834+0000 7fe47aa11700 1 -- start start 2023-10-24T00:41:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe47406a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47406a760 con 0x7fe4740aa010 2023-10-24T00:41:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740c2840 con 0x7fe4740aa3f0 2023-10-24T00:41:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe47aa11700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740b0df0 con 0x7fe4740c6710 2023-10-24T00:41:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57622/0 (socket says 172.21.15.148:57622) 2023-10-24T00:41:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 -- 172.21.15.148:0/183253051 learned_addr learned my addr 172.21.15.148:0/183253051 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 -- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 msgr2=0x7fe47406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe47406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 -- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4740aa3f0 msgr2=0x7fe474069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 -- 172.21.15.148:0/183253051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009ae0 con 0x7fe4740aa010 2023-10-24T00:41:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.835+0000 7fe473fff700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fe46400c440 tx=0x7fe464007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.836+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400f470 con 0x7fe4740aa010 2023-10-24T00:41:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.836+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400f5d0 con 0x7fe4740aa010 2023-10-24T00:41:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.836+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4740c2b00 con 0x7fe4740aa010 2023-10-24T00:41:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.836+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400f970 con 0x7fe4740aa010 2023-10-24T00:41:47.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.836+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4740c30c0 con 0x7fe4740aa010 2023-10-24T00:41:47.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.837+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4740c32b0 con 0x7fe4740aa010 2023-10-24T00:41:47.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.837+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe46401b3b0 con 0x7fe4740aa010 2023-10-24T00:41:47.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.837+0000 7fe45bfff700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 0x7fe4600615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:47.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.837+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fe464079390 con 0x7fe4740aa010 2023-10-24T00:41:47.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.837+0000 7fe4737fe700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 0x7fe4600615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:47.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.838+0000 7fe4737fe700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 0x7fe4600615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe468006d80 tx=0x7fe468008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:47.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:47.841+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe464048af0 con 0x7fe4740aa010 2023-10-24T00:41:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:48.069+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fe4740aa880 con 0x7fe4740aa010 2023-10-24T00:41:49.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.074+0000 7fe45bfff700 1 -- 172.21.15.148:0/183253051 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v453) v1 ==== 158+0+0 (secure 0 0 0) 0x7fe4740aa880 con 0x7fe4740aa010 2023-10-24T00:41:49.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 msgr2=0x7fe4600615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 0x7fe4600615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe468006d80 tx=0x7fe468008040).stop 2023-10-24T00:41:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 msgr2=0x7fe4740ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fe46400c440 tx=0x7fe464007dc0).stop 2023-10-24T00:41:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 shutdown_connections 2023-10-24T00:41:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c6710 0x7fe47406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:49.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe46005f120 0x7fe4600615e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4740aa010 0x7fe4740ae550 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 --2- 172.21.15.148:0/183253051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4740aa3f0 0x7fe474069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 >> 172.21.15.148:0/183253051 conn(0x7fe4740caf40 msgr2=0x7fe4740ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.076+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 shutdown_connections 2023-10-24T00:41:49.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.077+0000 7fe47aa11700 1 -- 172.21.15.148:0/183253051 wait complete. 2023-10-24T00:41:49.092 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-10-24T00:41:49.092 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-10-24T00:41:49.093 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:41:49.093 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-24T00:41:49.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.209+0000 7faff6d77700 1 Processor -- start 2023-10-24T00:41:49.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.209+0000 7faff6d77700 1 -- start start 2023-10-24T00:41:49.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff6d77700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faff00aa010 0x7faff00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff6d77700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00c6710 0x7faff00aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff6d77700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00c0960 con 0x7faff0158770 2023-10-24T00:41:49.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff6d77700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00aa8e0 con 0x7faff00aa010 2023-10-24T00:41:49.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff6d77700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff00c0c40 con 0x7faff00c6710 2023-10-24T00:41:49.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faff00aa010 0x7faff00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faff00aa010 0x7faff00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57626/0 (socket says 172.21.15.148:57626) 2023-10-24T00:41:49.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 -- 172.21.15.148:0/899841340 learned_addr learned my addr 172.21.15.148:0/899841340 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:49.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7fafeffff700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00c6710 0x7faff00aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 -- 172.21.15.148:0/899841340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00c6710 msgr2=0x7faff00aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:49.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00c6710 0x7faff00aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 -- 172.21.15.148:0/899841340 >> v1:172.21.15.150:6789/0 conn(0x7faff0158770 legacy=0x7faff0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 -- 172.21.15.148:0/899841340 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00c0f20 con 0x7faff00aa010 2023-10-24T00:41:49.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7faff4b13700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00aa010 0x7faff00c1a00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fafe8009f20 tx=0x7fafe8009840).ready entity=mon.0 client_cookie=fe15930b7c7f3a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:49.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.210+0000 7fafef7fe700 1 -- 172.21.15.148:0/899841340 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800e070 con 0x7faff00aa010 2023-10-24T00:41:49.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7fafef7fe700 1 -- 172.21.15.148:0/899841340 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe800ba80 con 0x7faff00aa010 2023-10-24T00:41:49.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7fafef7fe700 1 -- 172.21.15.148:0/899841340 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800be00 con 0x7faff00aa010 2023-10-24T00:41:49.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 -- 172.21.15.148:0/899841340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00aa010 msgr2=0x7faff00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00aa010 0x7faff00c1a00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fafe8009f20 tx=0x7fafe8009840).stop 2023-10-24T00:41:49.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 -- 172.21.15.148:0/899841340 shutdown_connections 2023-10-24T00:41:49.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00aa010 0x7faff00c1a00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 --2- 172.21.15.148:0/899841340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00c6710 0x7faff00aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 -- 172.21.15.148:0/899841340 >> 172.21.15.148:0/899841340 conn(0x7faff00caf40 msgr2=0x7faff00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:49.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 -- 172.21.15.148:0/899841340 shutdown_connections 2023-10-24T00:41:49.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.211+0000 7faff6d77700 1 -- 172.21.15.148:0/899841340 wait complete. 2023-10-24T00:41:49.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.212+0000 7faff6d77700 1 Processor -- start 2023-10-24T00:41:49.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.212+0000 7faff6d77700 1 -- start start 2023-10-24T00:41:49.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00aa010 0x7faff01570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faff0158770 0x7faff00abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00ac250 con 0x7faff00c6710 2023-10-24T00:41:49.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01565f0 con 0x7faff0158770 2023-10-24T00:41:49.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff6d77700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01559e0 con 0x7faff00aa010 2023-10-24T00:41:49.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57640/0 (socket says 172.21.15.148:57640) 2023-10-24T00:41:49.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 -- 172.21.15.148:0/1744274820 learned_addr learned my addr 172.21.15.148:0/1744274820 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:49.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff4b13700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00aa010 0x7faff01570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 -- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00aa010 msgr2=0x7faff01570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00aa010 0x7faff01570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 -- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faff0158770 msgr2=0x7faff00abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:49.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7faff5314700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faff0158770 0x7faff00abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faff0158770 0x7faff00abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:49.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.213+0000 7fafeffff700 1 -- 172.21.15.148:0/1744274820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009ae0 con 0x7faff00c6710 2023-10-24T00:41:49.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7fafeffff700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fafe000d890 tx=0x7fafe0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:49.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00125f0 con 0x7faff00c6710 2023-10-24T00:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0012750 con 0x7faff00c6710 2023-10-24T00:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff0155cc0 con 0x7faff00c6710 2023-10-24T00:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0012ad0 con 0x7faff00c6710 2023-10-24T00:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.214+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff0156280 con 0x7faff00c6710 2023-10-24T00:41:49.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.215+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff006c6b0 con 0x7faff00c6710 2023-10-24T00:41:49.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.215+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fafe0013480 con 0x7faff00c6710 2023-10-24T00:41:49.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.215+0000 7fafecff9700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 0x7fafd0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:49.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.215+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fafe0079e30 con 0x7faff00c6710 2023-10-24T00:41:49.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.216+0000 7faff4b13700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 0x7fafd0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:49.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.216+0000 7faff4b13700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 0x7fafd0061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fafe80070b0 tx=0x7fafe8009840).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:49.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.219+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fafe004b240 con 0x7faff00c6710 2023-10-24T00:41:49.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:49.446+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7faff0156410 con 0x7faff00c6710 2023-10-24T00:41:50.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.079+0000 7fafecff9700 1 -- 172.21.15.148:0/1744274820 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v454) v1 ==== 157+0+0 (secure 0 0 0) 0x7fafe004e860 con 0x7faff00c6710 2023-10-24T00:41:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 msgr2=0x7fafd0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 0x7fafd0061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fafe80070b0 tx=0x7fafe8009840).stop 2023-10-24T00:41:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 msgr2=0x7faff00ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fafe000d890 tx=0x7fafe0008040).stop 2023-10-24T00:41:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 shutdown_connections 2023-10-24T00:41:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faff0158770 0x7faff00abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faff00aa010 0x7faff01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fafd005f150 0x7fafd0061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 --2- 172.21.15.148:0/1744274820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faff00c6710 0x7faff00ab870 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 >> 172.21.15.148:0/1744274820 conn(0x7faff00caf40 msgr2=0x7faff00cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:50.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 shutdown_connections 2023-10-24T00:41:50.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.081+0000 7faff6d77700 1 -- 172.21.15.148:0/1744274820 wait complete. 2023-10-24T00:41:50.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:41:50.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.210+0000 7f61c2757700 1 Processor -- start 2023-10-24T00:41:50.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.210+0000 7f61c2757700 1 -- start start 2023-10-24T00:41:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c2757700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc154430 0x7f61bc154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c2757700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61bc0bffd0 0x7f61bc0c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c2757700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc0c0970 con 0x7f61bc098bd0 2023-10-24T00:41:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c2757700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc0c6a10 con 0x7f61bc0bffd0 2023-10-24T00:41:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c2757700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0c71d0 con 0x7f61bc154430 2023-10-24T00:41:50.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61bbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc154430 0x7f61bc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c0cf4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61bc0bffd0 0x7f61bc0c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c0cf4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61bc0bffd0 0x7f61bc0c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:42540/0 (socket says 172.21.15.148:42540) 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.211+0000 7f61c0cf4700 1 -- 172.21.15.148:0/772689179 learned_addr learned my addr 172.21.15.148:0/772689179 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61c0cf4700 1 -- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc154430 msgr2=0x7f61bc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61c0cf4700 1 --2- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc154430 0x7f61bc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61c0cf4700 1 -- 172.21.15.148:0/772689179 >> v1:172.21.15.150:6789/0 conn(0x7f61bc098bd0 legacy=0x7f61bc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61c0cf4700 1 -- 172.21.15.148:0/772689179 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0c9410 con 0x7f61bc0bffd0 2023-10-24T00:41:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61c0cf4700 1 --2- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0c0480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f61b4009f50 tx=0x7f61b4009840).ready entity=mon.1 client_cookie=88875487b7621d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61baffd700 1 -- 172.21.15.148:0/772689179 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400e070 con 0x7f61bc0bffd0 2023-10-24T00:41:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61baffd700 1 -- 172.21.15.148:0/772689179 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b400b9c0 con 0x7f61bc0bffd0 2023-10-24T00:41:50.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.212+0000 7f61baffd700 1 -- 172.21.15.148:0/772689179 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400bd40 con 0x7f61bc0bffd0 2023-10-24T00:41:50.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 -- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 msgr2=0x7f61bc0c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 --2- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0c0480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f61b4009f50 tx=0x7f61b4009840).stop 2023-10-24T00:41:50.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 -- 172.21.15.148:0/772689179 shutdown_connections 2023-10-24T00:41:50.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 --2- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0c0480 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 --2- 172.21.15.148:0/772689179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc154430 0x7f61bc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 -- 172.21.15.148:0/772689179 >> 172.21.15.148:0/772689179 conn(0x7f61bc0cb070 msgr2=0x7f61bc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 -- 172.21.15.148:0/772689179 shutdown_connections 2023-10-24T00:41:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.213+0000 7f61c2757700 1 -- 172.21.15.148:0/772689179 wait complete. 2023-10-24T00:41:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.214+0000 7f61c2757700 1 Processor -- start 2023-10-24T00:41:50.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.214+0000 7f61c2757700 1 -- start start 2023-10-24T00:41:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc098bd0 0x7f61bc1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0c38e0 con 0x7f61bc154430 2023-10-24T00:41:50.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0aa1c0 con 0x7f61bc0bffd0 2023-10-24T00:41:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c2757700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0acf30 con 0x7f61bc098bd0 2023-10-24T00:41:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57654/0 (socket says 172.21.15.148:57654) 2023-10-24T00:41:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 -- 172.21.15.148:0/1119437638 learned_addr learned my addr 172.21.15.148:0/1119437638 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:50.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61bb7fe700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61bbfff700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc098bd0 0x7f61bc1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 -- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc098bd0 msgr2=0x7f61bc1505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc098bd0 0x7f61bc1505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 -- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 msgr2=0x7f61bc0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 -- 172.21.15.148:0/1119437638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009ae0 con 0x7f61bc154430 2023-10-24T00:41:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61c0cf4700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f61b400b6c0 tx=0x7f61b4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.215+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40092e0 con 0x7f61bc154430 2023-10-24T00:41:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.216+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b401e470 con 0x7f61bc154430 2023-10-24T00:41:50.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.216+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b401e830 con 0x7f61bc154430 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.216+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc0aa410 con 0x7f61bc154430 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.216+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc0c3af0 con 0x7f61bc154430 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.217+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc0aa910 con 0x7f61bc154430 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.217+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f61b4003040 con 0x7f61bc154430 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.217+0000 7f61a3fff700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 0x7f61a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.217+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f61b407b430 con 0x7f61bc154430 2023-10-24T00:41:50.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.218+0000 7f61bbfff700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 0x7f61a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.218+0000 7f61bbfff700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 0x7f61a8061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f61ac009c30 tx=0x7f61ac009060).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.221+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f61b404c950 con 0x7f61bc154430 2023-10-24T00:41:50.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.385+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f61bc06c6b0 con 0x7f61bc154430 2023-10-24T00:41:50.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.390+0000 7f61a3fff700 1 -- 172.21.15.148:0/1119437638 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61b4023070 con 0x7f61bc154430 2023-10-24T00:41:50.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 msgr2=0x7f61a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 0x7f61a8061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f61ac009c30 tx=0x7f61ac009060).stop 2023-10-24T00:41:50.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 msgr2=0x7f61bc14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f61b400b6c0 tx=0x7f61b4009840).stop 2023-10-24T00:41:50.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 shutdown_connections 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f61a805f150 0x7f61a8061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61bc154430 0x7f61bc14f0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61bc098bd0 0x7f61bc1505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 --2- 172.21.15.148:0/1119437638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61bc0bffd0 0x7f61bc0aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 >> 172.21.15.148:0/1119437638 conn(0x7f61bc0cb070 msgr2=0x7f61bc0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:50.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 shutdown_connections 2023-10-24T00:41:50.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.392+0000 7f61c2757700 1 -- 172.21.15.148:0/1119437638 wait complete. 2023-10-24T00:41:50.405 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:41:50.406 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:41:50.444 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:41:50.498 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:41:50.498 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:41:50.499 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:50.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.610+0000 7f3ea51eb700 1 Processor -- start 2023-10-24T00:41:50.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.610+0000 7f3ea51eb700 1 -- start start 2023-10-24T00:41:50.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3ea51eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3ea51eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ea00c8e80 0x7f3ea0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3ea51eb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea00c93b0 con 0x7f3ea0156140 2023-10-24T00:41:50.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3ea51eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea006a890 con 0x7f3ea00c8e80 2023-10-24T00:41:50.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3ea51eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00c9690 con 0x7f3ea00aa5a0 2023-10-24T00:41:50.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3e9659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ea00c8e80 0x7f3ea0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:48178/0 (socket says 172.21.15.148:48178) 2023-10-24T00:41:50.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3e9659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ea00c8e80 0x7f3ea0155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:42552/0 (socket says 172.21.15.148:42552) 2023-10-24T00:41:50.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.611+0000 7f3e9ed9d700 1 -- 172.21.15.148:0/1679969139 learned_addr learned my addr 172.21.15.148:0/1679969139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:50.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9659c700 1 -- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 msgr2=0x7f3ea01552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:50.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9659c700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9659c700 1 -- 172.21.15.148:0/1679969139 >> v1:172.21.15.150:6789/0 conn(0x7f3ea0156140 legacy=0x7f3ea00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9659c700 1 -- 172.21.15.148:0/1679969139 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00c9970 con 0x7f3ea00c8e80 2023-10-24T00:41:50.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9ed9d700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:50.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9659c700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00c8e80 0x7f3ea0155c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3e88009760 tx=0x7f3e88009060).ready entity=mon.1 client_cookie=38acfff568fd5ae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9e59c700 1 -- 172.21.15.148:0/1679969139 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800f510 con 0x7f3ea00c8e80 2023-10-24T00:41:50.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9e59c700 1 -- 172.21.15.148:0/1679969139 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800f670 con 0x7f3ea00c8e80 2023-10-24T00:41:50.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3e9e59c700 1 -- 172.21.15.148:0/1679969139 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800f9f0 con 0x7f3ea00c8e80 2023-10-24T00:41:50.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 -- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00c8e80 msgr2=0x7f3ea0155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00c8e80 0x7f3ea0155c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f3e88009760 tx=0x7f3e88009060).stop 2023-10-24T00:41:50.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 -- 172.21.15.148:0/1679969139 shutdown_connections 2023-10-24T00:41:50.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00aa5a0 0x7f3ea01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/1679969139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00c8e80 0x7f3ea0155c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 -- 172.21.15.148:0/1679969139 >> 172.21.15.148:0/1679969139 conn(0x7f3ea0084ce0 msgr2=0x7f3ea0094600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:50.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 -- 172.21.15.148:0/1679969139 shutdown_connections 2023-10-24T00:41:50.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.612+0000 7f3ea51eb700 1 -- 172.21.15.148:0/1679969139 wait complete. 2023-10-24T00:41:50.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 Processor -- start 2023-10-24T00:41:50.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 -- start start 2023-10-24T00:41:50.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00aa5a0 0x7f3ea014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00c8e80 0x7f3ea00ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea0168df0 con 0x7f3ea0156140 2023-10-24T00:41:50.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00ab810 con 0x7f3ea00aa5a0 2023-10-24T00:41:50.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.614+0000 7f3ea51eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00abaf0 con 0x7f3ea00c8e80 2023-10-24T00:41:50.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57668/0 (socket says 172.21.15.148:57668) 2023-10-24T00:41:50.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 -- 172.21.15.148:0/4285849817 learned_addr learned my addr 172.21.15.148:0/4285849817 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:50.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9ed9d700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00aa5a0 0x7f3ea014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9659c700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00c8e80 0x7f3ea00ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 -- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00c8e80 msgr2=0x7f3ea00ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00c8e80 0x7f3ea00ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 -- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00aa5a0 msgr2=0x7f3ea014f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00aa5a0 0x7f3ea014f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 -- 172.21.15.148:0/4285849817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009370 con 0x7f3ea0156140 2023-10-24T00:41:50.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e9f59e700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3e9800c7c0 tx=0x7f3e980014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800e4a0 con 0x7f3ea0156140 2023-10-24T00:41:50.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800e600 con 0x7f3ea0156140 2023-10-24T00:41:50.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e880092a0 con 0x7f3ea0156140 2023-10-24T00:41:50.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800e9a0 con 0x7f3ea0156140 2023-10-24T00:41:50.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.615+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea00ac0b0 con 0x7f3ea0156140 2023-10-24T00:41:50.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.616+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea006c6b0 con 0x7f3ea0156140 2023-10-24T00:41:50.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.617+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3e9800ed10 con 0x7f3ea0156140 2023-10-24T00:41:50.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.617+0000 7f3e977fe700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 0x7f3e800615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:50.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.617+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f3e980797e0 con 0x7f3ea0156140 2023-10-24T00:41:50.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.617+0000 7f3e9ed9d700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 0x7f3e800615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:50.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.618+0000 7f3e9ed9d700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 0x7f3e800615e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3e90006fd0 tx=0x7f3e900090f0).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:50.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.621+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3e98047af0 con 0x7f3ea0156140 2023-10-24T00:41:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.824+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ea00c9c50 con 0x7f3ea0156140 2023-10-24T00:41:50.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.825+0000 7f3e977fe700 1 -- 172.21.15.148:0/4285849817 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f3e9804ac50 con 0x7f3ea0156140 2023-10-24T00:41:50.827 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:50.827 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/54850323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54850323},{"type":"v1","addr":"172.21.15.150:6836","nonce":54850323}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2327235600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2327235600},{"type":"v1","addr":"172.21.15.150:6837","nonce":2327235600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5010,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2544895424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2544895424},{"type":"v1","addr":"172.21.15.148:6833","nonce":2544895424}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5781,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3709148619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":3709148619},{"type":"v1","addr":"172.21.15.148:6835","nonce":3709148619}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-10-24T00:41:50.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 msgr2=0x7f3e800615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 0x7f3e800615e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3e90006fd0 tx=0x7f3e900090f0).stop 2023-10-24T00:41:50.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 msgr2=0x7f3ea0168900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:50.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f3e9800c7c0 tx=0x7f3e980014e0).stop 2023-10-24T00:41:50.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 shutdown_connections 2023-10-24T00:41:50.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e8005f120 0x7f3e800615e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3ea0156140 0x7f3ea0168900 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ea00aa5a0 0x7f3ea014f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 --2- 172.21.15.148:0/4285849817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ea00c8e80 0x7f3ea00ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 >> 172.21.15.148:0/4285849817 conn(0x7f3ea0084ce0 msgr2=0x7f3ea0154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:50.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 shutdown_connections 2023-10-24T00:41:50.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:50.827+0000 7f3ea51eb700 1 -- 172.21.15.148:0/4285849817 wait complete. 2023-10-24T00:41:50.834 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2023-10-24T00:41:50.841 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:41:50.841 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:41:50.842 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:41:50.842 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:41:50.843 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:41:50.843 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:41:50.843 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:41:50.843 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:41:50.844 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:41:50.844 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:41:50.845 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:41:50.845 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:41:50.845 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:41:50.846 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:41:50.846 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:41:50.846 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:41:50.852 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:41:50.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:41:50.854 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:41:50.854 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:41:50.859 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:41:50.859 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:41:50.860 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:41:50.860 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:41:50.896 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:41:50.897 DEBUG:teuthology.parallel:result is None 2023-10-24T00:41:50.897 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:41:50.898 DEBUG:teuthology.parallel:result is None 2023-10-24T00:41:50.902 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:41:50.902 DEBUG:teuthology.parallel:result is None 2023-10-24T00:41:50.903 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:41:50.903 DEBUG:teuthology.parallel:result is None 2023-10-24T00:41:50.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:41:50.969 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:41:50.969 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:41:50.984 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:41:50.984 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:41:51.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.026+0000 7f8a2721d700 1 Processor -- start 2023-10-24T00:41:51.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.026+0000 7f8a2721d700 1 -- start start 2023-10-24T00:41:51.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a2721d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a200a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a2721d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a200c01c0 con 0x7f8a20154400 2023-10-24T00:41:51.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a2721d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a200c6150 con 0x7f8a200a82c0 2023-10-24T00:41:51.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a2721d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200aa960 con 0x7f8a201547e0 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a24fb9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8a20154400 0x7f8a200c8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47464/0 (socket says 172.21.15.148:47464) 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.027+0000 7f8a24fb9700 1 -- 172.21.15.148:0/3718510909 learned_addr learned my addr 172.21.15.148:0/3718510909 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a200a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241030963 0 0) 0x7f8a200c01c0 con 0x7f8a20154400 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a100033f0 con 0x7f8a20154400 2023-10-24T00:41:51.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176551745 0 0) 0x7f8a100033f0 con 0x7f8a20154400 2023-10-24T00:41:51.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 msgr2=0x7f8a200a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:51.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a200a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:51.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 >> v1:172.21.15.150:6789/0 conn(0x7f8a200a82c0 legacy=0x7f8a200c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:51.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200c66f0 con 0x7f8a20154400 2023-10-24T00:41:51.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f8a14001470 con 0x7f8a20154400 2023-10-24T00:41:51.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 >> v1:172.21.15.148:6789/0 conn(0x7f8a20154400 legacy=0x7f8a200c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:51.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a10003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a10003e00 0x7f8a10004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10004b80 0x7f8a10005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200aa960 con 0x7f8a10003e00 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000b990 con 0x7f8a10004b80 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000bb50 con 0x7f8a201547e0 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a10003e00 0x7f8a10004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a24fb9700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a10003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a257ba700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10004b80 0x7f8a10005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 msgr2=0x7f8a10003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:51.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201547e0 0x7f8a10003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:51.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10004b80 msgr2=0x7f8a10005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:51.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10004b80 0x7f8a10005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3718510909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100033f0 con 0x7f8a10003e00 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a257ba700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10004b80 0x7f8a10005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.028+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a10003e00 0x7f8a10004690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f8a20154be0 tx=0x7f8a0c009060).ready entity=mon.0 client_cookie=26c7927b55a800e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c009e90 con 0x7f8a10003e00 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c009430 con 0x7f8a10003e00 2023-10-24T00:41:51.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a1f7fe700 1 -- 172.21.15.148:0/3718510909 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00e840 con 0x7f8a10003e00 2023-10-24T00:41:51.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 -- 172.21.15.148:0/3718510909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a10003e00 msgr2=0x7f8a10004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:51.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3718510909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a10003e00 0x7f8a10004690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f8a20154be0 tx=0x7f8a0c009060).stop 2023-10-24T00:41:51.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a257ba700 1 -- 172.21.15.148:0/3718510909 reap_dead start 2023-10-24T00:41:51.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 -- 172.21.15.148:0/3718510909 shutdown_connections 2023-10-24T00:41:51.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 -- 172.21.15.148:0/3718510909 >> 172.21.15.148:0/3718510909 conn(0x7f8a200946a0 msgr2=0x7f8a2006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:51.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 -- 172.21.15.148:0/3718510909 shutdown_connections 2023-10-24T00:41:51.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.029+0000 7f8a2721d700 1 -- 172.21.15.148:0/3718510909 wait complete. 2023-10-24T00:41:51.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.030+0000 7f8a2721d700 1 Processor -- start 2023-10-24T00:41:51.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.030+0000 7f8a2721d700 1 -- start start 2023-10-24T00:41:51.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 0x7f8a200aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201561d0 0x7f8a20156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2014cfa0 con 0x7f8a2014cb20 2023-10-24T00:41:51.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200c22f0 con 0x7f8a10003e00 2023-10-24T00:41:51.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a2721d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20156b40 con 0x7f8a201561d0 2023-10-24T00:41:51.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57704/0 (socket says 172.21.15.148:57704) 2023-10-24T00:41:51.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.031+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3131610113 learned_addr learned my addr 172.21.15.148:0/3131610113 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:51.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a257ba700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201561d0 0x7f8a20156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a24fb9700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 0x7f8a200aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201561d0 msgr2=0x7f8a20156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:51.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201561d0 0x7f8a20156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:51.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 msgr2=0x7f8a200aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:51.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 0x7f8a200aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:51.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 -- 172.21.15.148:0/3131610113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20165980 con 0x7f8a2014cb20 2023-10-24T00:41:51.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a24fb9700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 0x7f8a200aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:51.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1ffff700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f8a0c006f70 tx=0x7f8a0c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:51.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01dc80 con 0x7f8a2014cb20 2023-10-24T00:41:51.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c01dde0 con 0x7f8a2014cb20 2023-10-24T00:41:51.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a200ab100 con 0x7f8a2014cb20 2023-10-24T00:41:51.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01b6c0 con 0x7f8a2014cb20 2023-10-24T00:41:51.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.032+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a200ab6c0 con 0x7f8a2014cb20 2023-10-24T00:41:51.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.033+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8a0c01bab0 con 0x7f8a2014cb20 2023-10-24T00:41:51.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.033+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a200c25d0 con 0x7f8a2014cb20 2023-10-24T00:41:51.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.033+0000 7f8a1cff9700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 0x7f8a04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:51.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.033+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f8a0c07bf60 con 0x7f8a2014cb20 2023-10-24T00:41:51.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.034+0000 7f8a24fb9700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 0x7f8a04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:51.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.034+0000 7f8a24fb9700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 0x7f8a04061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8a14001ed0 tx=0x7f8a14009040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:51.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.038+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8a0c04d3d0 con 0x7f8a2014cb20 2023-10-24T00:41:51.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:51.214+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8a2006c6b0 con 0x7f8a2014cb20 2023-10-24T00:41:52.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.085+0000 7f8a1cff9700 1 -- 172.21.15.148:0/3131610113 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8a0c0509f0 con 0x7f8a2014cb20 2023-10-24T00:41:52.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 msgr2=0x7f8a04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 0x7f8a04061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8a14001ed0 tx=0x7f8a14009040).stop 2023-10-24T00:41:52.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 msgr2=0x7f8a20165490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f8a0c006f70 tx=0x7f8a0c019000).stop 2023-10-24T00:41:52.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 shutdown_connections 2023-10-24T00:41:52.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a201561d0 0x7f8a20156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a10003e00 0x7f8a200aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8a0405f150 0x7f8a04061610 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 --2- 172.21.15.148:0/3131610113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a2014cb20 0x7f8a20165490 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 >> 172.21.15.148:0/3131610113 conn(0x7f8a200946a0 msgr2=0x7f8a200c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 shutdown_connections 2023-10-24T00:41:52.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.088+0000 7f8a2721d700 1 -- 172.21.15.148:0/3131610113 wait complete. 2023-10-24T00:41:52.092 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:41:52.102 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:41:52.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.215+0000 7f63818dd700 1 Processor -- start 2023-10-24T00:41:52.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.215+0000 7f63818dd700 1 -- start start 2023-10-24T00:41:52.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f63818dd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0c86c0 0x7f637c0bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f63818dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a8480 0x7f637c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f63818dd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0a6a50 con 0x7f637c0a6550 2023-10-24T00:41:52.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f63818dd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0a6d30 con 0x7f637c0c86c0 2023-10-24T00:41:52.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f63818dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0a7010 con 0x7f637c0a8480 2023-10-24T00:41:52.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f637affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0c86c0 0x7f637c0bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f637affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0c86c0 0x7f637c0bec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57710/0 (socket says 172.21.15.148:57710) 2023-10-24T00:41:52.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f637affd700 1 -- 172.21.15.148:0/1936649536 learned_addr learned my addr 172.21.15.148:0/1936649536 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:52.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.216+0000 7f637a7fc700 1 --1- 172.21.15.148:0/1936649536 >> v1:172.21.15.148:6789/0 conn(0x7f637c0a6550 0x7f637c0a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47472/0 (socket says 172.21.15.148:47472) 2023-10-24T00:41:52.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637b7fe700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a8480 0x7f637c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637affd700 1 -- 172.21.15.148:0/1936649536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a8480 msgr2=0x7f637c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:52.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637affd700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a8480 0x7f637c15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637affd700 1 -- 172.21.15.148:0/1936649536 >> v1:172.21.15.148:6789/0 conn(0x7f637c0a6550 legacy=0x7f637c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637affd700 1 -- 172.21.15.148:0/1936649536 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0a72f0 con 0x7f637c0c86c0 2023-10-24T00:41:52.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f6379ffb700 1 -- 172.21.15.148:0/1936649536 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840750027 0 0) 0x7f637c0a6a50 con 0x7f637c0a6550 2023-10-24T00:41:52.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f637affd700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0bec40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f636c009f70 tx=0x7f636c009840).ready entity=mon.0 client_cookie=1fa40b9597597d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f6379ffb700 1 -- 172.21.15.148:0/1936649536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c00e070 con 0x7f637c0c86c0 2023-10-24T00:41:52.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f6379ffb700 1 -- 172.21.15.148:0/1936649536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c00bad0 con 0x7f637c0c86c0 2023-10-24T00:41:52.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f6379ffb700 1 -- 172.21.15.148:0/1936649536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c00be50 con 0x7f637c0c86c0 2023-10-24T00:41:52.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f63818dd700 1 -- 172.21.15.148:0/1936649536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 msgr2=0x7f637c0bec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.217+0000 7f63818dd700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0bec40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f636c009f70 tx=0x7f636c009840).stop 2023-10-24T00:41:52.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 -- 172.21.15.148:0/1936649536 shutdown_connections 2023-10-24T00:41:52.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a8480 0x7f637c15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 --2- 172.21.15.148:0/1936649536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0bec40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 -- 172.21.15.148:0/1936649536 >> 172.21.15.148:0/1936649536 conn(0x7f637c092480 msgr2=0x7f637c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 -- 172.21.15.148:0/1936649536 shutdown_connections 2023-10-24T00:41:52.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.218+0000 7f63818dd700 1 -- 172.21.15.148:0/1936649536 wait complete. 2023-10-24T00:41:52.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.219+0000 7f63818dd700 1 Processor -- start 2023-10-24T00:41:52.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.219+0000 7f63818dd700 1 -- start start 2023-10-24T00:41:52.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a6550 0x7f637c0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0a8480 0x7f637c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1530b0 con 0x7f637c0c86c0 2023-10-24T00:41:52.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c153240 con 0x7f637c0a8480 2023-10-24T00:41:52.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0a9120 con 0x7f637c0a6550 2023-10-24T00:41:52.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57726/0 (socket says 172.21.15.148:57726) 2023-10-24T00:41:52.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 -- 172.21.15.148:0/2778976488 learned_addr learned my addr 172.21.15.148:0/2778976488 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:52.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637affd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a6550 0x7f637c0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637a7fc700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0a8480 0x7f637c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 -- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a6550 msgr2=0x7f637c0c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a6550 0x7f637c0c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 -- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0a8480 msgr2=0x7f637c14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0a8480 0x7f637c14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 -- 172.21.15.148:0/2778976488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c009ae0 con 0x7f637c0c86c0 2023-10-24T00:41:52.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f637b7fe700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f637400d630 tx=0x7f6374008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011590 con 0x7f637c0c86c0 2023-10-24T00:41:52.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740116f0 con 0x7f637c0c86c0 2023-10-24T00:41:52.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c0a9400 con 0x7f637c0c86c0 2023-10-24T00:41:52.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.220+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011a70 con 0x7f637c0c86c0 2023-10-24T00:41:52.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.221+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c0a99c0 con 0x7f637c0c86c0 2023-10-24T00:41:52.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.221+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c1533f0 con 0x7f637c0c86c0 2023-10-24T00:41:52.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.222+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6374012420 con 0x7f637c0c86c0 2023-10-24T00:41:52.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.222+0000 7f6362ffd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 0x7f6368061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.222+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6374079780 con 0x7f637c0c86c0 2023-10-24T00:41:52.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.223+0000 7f637affd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 0x7f6368061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.223+0000 7f637affd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 0x7f6368061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f636c009880 tx=0x7f637c0a7af0).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.226+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f637c1533f0 con 0x7f637c0c86c0 2023-10-24T00:41:52.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.452+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f637c1533b0 con 0x7f637c0c86c0 2023-10-24T00:41:52.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.452+0000 7f6362ffd700 1 -- 172.21.15.148:0/2778976488 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f637404ad40 con 0x7f637c0c86c0 2023-10-24T00:41:52.455 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:52.455 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:41:52.456 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:41:52.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.456 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:41:52.456 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:41:52.456 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.457 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.457 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:41:52.457 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:41:52.457 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.458 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.458 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.458 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:41:52.459 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:41:52.459 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.459 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.459 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:41:52.460 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:41:52.460 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.460 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.460 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.460 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.461 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:41:52.461 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:41:52.461 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.461 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.461 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:41:52.462 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:41:52.462 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.462 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.462 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:41:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:41:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.463 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.464 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:41:52.464 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:41:52.464 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.464 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.465 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:41:52.465 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:41:52.465 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.466 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.466 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.466 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.466 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.467 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:41:52.467 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:41:52.467 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.468 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.468 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.468 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.468 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.469 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:41:52.469 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:41:52.469 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.470 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.470 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.470 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.470 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.470 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.471 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.471 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:41:52.471 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:41:52.471 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.471 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.472 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.472 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.472 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.472 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.472 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.473 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:41:52.473 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:41:52.473 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.473 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.474 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.474 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.474 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.474 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.474 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.475 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:41:52.475 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:41:52.475 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.475 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.475 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.476 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.476 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.476 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.476 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:41:52.477 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:41:52.477 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.477 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.477 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.478 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.478 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.478 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:41:52.479 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:41:52.479 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.479 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:41:52.479 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:41:52.479 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.480 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.480 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:41:52.481 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:41:52.481 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.481 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.481 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:41:52.481 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:41:52.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.482 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:41:52.482 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:41:52.483 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.483 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.483 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:41:52.483 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:41:52.484 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:41:52.484 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.484 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:41:52.485 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:41:52.485 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.485 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.485 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:41:52.485 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:41:52.486 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:41:52.486 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.487 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:41:52.487 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:41:52.487 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.487 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:41:52.487 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:41:52.488 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:41:52.488 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:41:52.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.489 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:41:52.489 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:41:52.489 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.489 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:41:52.489 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:41:52.490 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:41:52.490 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.490 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.491 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:41:52.491 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:41:52.491 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.491 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:41:52.492 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:41:52.492 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.492 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:52.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:52.493 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:41:52.493 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:41:52.493 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:41:52.493 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:41:52.493 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:41:52.494 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:41:52.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:52.494 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:41:52.495 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:41:52.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 msgr2=0x7f6368061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 0x7f6368061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f636c009880 tx=0x7f637c0a7af0).stop 2023-10-24T00:41:52.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 msgr2=0x7f637c0a8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f637400d630 tx=0x7f6374008040).stop 2023-10-24T00:41:52.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 shutdown_connections 2023-10-24T00:41:52.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f636805f150 0x7f6368061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0c86c0 0x7f637c0a8860 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0a6550 0x7f637c0c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 --2- 172.21.15.148:0/2778976488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0a8480 0x7f637c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 >> 172.21.15.148:0/2778976488 conn(0x7f637c092480 msgr2=0x7f637c067420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 shutdown_connections 2023-10-24T00:41:52.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.454+0000 7f63818dd700 1 -- 172.21.15.148:0/2778976488 wait complete. 2023-10-24T00:41:52.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.611+0000 7fdc38369700 1 Processor -- start 2023-10-24T00:41:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.612+0000 7fdc38369700 1 -- start start 2023-10-24T00:41:52.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.612+0000 7fdc38369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc30150f60 0x7fdc300c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.612+0000 7fdc38369700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdc30069a90 0x7fdc3015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc38369700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300bdf20 con 0x7fdc300c42f0 2023-10-24T00:41:52.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc38369700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc300664b0 con 0x7fdc30069a90 2023-10-24T00:41:52.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc38369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300bd310 con 0x7fdc30150f60 2023-10-24T00:41:52.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35904700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdc300c42f0 0x7fdc30069380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47488/0 (socket says 172.21.15.148:47488) 2023-10-24T00:41:52.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35904700 1 -- 172.21.15.148:0/2844559026 learned_addr learned my addr 172.21.15.148:0/2844559026 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:52.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36105700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc30150f60 0x7fdc300c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 --2- 172.21.15.148:0/2844559026 >> v2:172.21.15.150:3300/0 conn(0x7fdc30069a90 0x7fdc3015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35103700 1 -- 172.21.15.148:0/2844559026 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280110554 0 0) 0x7fdc300bdf20 con 0x7fdc300c42f0 2023-10-24T00:41:52.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35103700 1 -- 172.21.15.148:0/2844559026 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c0033f0 con 0x7fdc300c42f0 2023-10-24T00:41:52.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 -- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc30150f60 msgr2=0x7fdc300c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:52.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc30150f60 0x7fdc300c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 -- 172.21.15.148:0/2844559026 >> v1:172.21.15.148:6789/0 conn(0x7fdc300c42f0 legacy=0x7fdc30069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 -- 172.21.15.148:0/2844559026 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300bd5f0 con 0x7fdc30069a90 2023-10-24T00:41:52.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc36906700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc3015ac80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fdc28009e60 tx=0x7fdc28009780).ready entity=mon.1 client_cookie=a9c1c39db91edf58 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35103700 1 -- 172.21.15.148:0/2844559026 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800e070 con 0x7fdc30069a90 2023-10-24T00:41:52.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35103700 1 -- 172.21.15.148:0/2844559026 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800bab0 con 0x7fdc30069a90 2023-10-24T00:41:52.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.613+0000 7fdc35103700 1 -- 172.21.15.148:0/2844559026 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800be30 con 0x7fdc30069a90 2023-10-24T00:41:52.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 -- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 msgr2=0x7fdc3015ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc3015ac80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fdc28009e60 tx=0x7fdc28009780).stop 2023-10-24T00:41:52.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 -- 172.21.15.148:0/2844559026 shutdown_connections 2023-10-24T00:41:52.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc3015ac80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 --2- 172.21.15.148:0/2844559026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc30150f60 0x7fdc300c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 -- 172.21.15.148:0/2844559026 >> 172.21.15.148:0/2844559026 conn(0x7fdc30064230 msgr2=0x7fdc300c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 -- 172.21.15.148:0/2844559026 shutdown_connections 2023-10-24T00:41:52.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.614+0000 7fdc38369700 1 -- 172.21.15.148:0/2844559026 wait complete. 2023-10-24T00:41:52.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.615+0000 7fdc38369700 1 Processor -- start 2023-10-24T00:41:52.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.615+0000 7fdc38369700 1 -- start start 2023-10-24T00:41:52.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc300a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc300c42f0 0x7fdc30156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300a86a0 con 0x7fdc30150f60 2023-10-24T00:41:52.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30156740 con 0x7fdc30069a90 2023-10-24T00:41:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc38369700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300a7a90 con 0x7fdc300c42f0 2023-10-24T00:41:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc36906700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc36906700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57730/0 (socket says 172.21.15.148:57730) 2023-10-24T00:41:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc36906700 1 -- 172.21.15.148:0/3790406111 learned_addr learned my addr 172.21.15.148:0/3790406111 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:52.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc36105700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc300a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.616+0000 7fdc35904700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc300c42f0 0x7fdc30156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 -- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc300c42f0 msgr2=0x7fdc30156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc300c42f0 0x7fdc30156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 -- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 msgr2=0x7fdc300a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc300a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 -- 172.21.15.148:0/3790406111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a20 con 0x7fdc30150f60 2023-10-24T00:41:52.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36105700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc300a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:52.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc36906700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fdc28011000 tx=0x7fdc28009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28013ea0 con 0x7fdc30150f60 2023-10-24T00:41:52.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2801d630 con 0x7fdc30150f60 2023-10-24T00:41:52.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc300a7d70 con 0x7fdc30150f60 2023-10-24T00:41:52.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2801d9d0 con 0x7fdc30150f60 2023-10-24T00:41:52.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.617+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc300a8330 con 0x7fdc30150f60 2023-10-24T00:41:52.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.618+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc300a8810 con 0x7fdc30150f60 2023-10-24T00:41:52.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.618+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdc28003040 con 0x7fdc30150f60 2023-10-24T00:41:52.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.618+0000 7fdc267fc700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 0x7fdc140615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.619+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdc2807bc60 con 0x7fdc30150f60 2023-10-24T00:41:52.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.619+0000 7fdc36105700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 0x7fdc140615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.619+0000 7fdc36105700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 0x7fdc140615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdc2c009f90 tx=0x7fdc2c009060).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.623+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdc2804d1c0 con 0x7fdc30150f60 2023-10-24T00:41:52.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.785+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc3006c6b0 con 0x7fdc30150f60 2023-10-24T00:41:52.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.785+0000 7fdc267fc700 1 -- 172.21.15.148:0/3790406111 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fdc280507e0 con 0x7fdc30150f60 2023-10-24T00:41:52.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:52.789 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":59,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:52.080447+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:52.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 msgr2=0x7fdc140615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 0x7fdc140615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdc2c009f90 tx=0x7fdc2c009060).stop 2023-10-24T00:41:52.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 msgr2=0x7fdc3013de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fdc28011000 tx=0x7fdc28009780).stop 2023-10-24T00:41:52.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 shutdown_connections 2023-10-24T00:41:52.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdc1405f120 0x7fdc140615e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc30150f60 0x7fdc3013de30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdc30069a90 0x7fdc300a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 --2- 172.21.15.148:0/3790406111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdc300c42f0 0x7fdc30156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.787+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 >> 172.21.15.148:0/3790406111 conn(0x7fdc30064230 msgr2=0x7fdc300a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.788+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 shutdown_connections 2023-10-24T00:41:52.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.788+0000 7fdc38369700 1 -- 172.21.15.148:0/3790406111 wait complete. 2023-10-24T00:41:52.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:41:52.803 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:41:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 Processor -- start 2023-10-24T00:41:52.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 -- start start 2023-10-24T00:41:52.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51c8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c71d0 con 0x7f51c8154430 2023-10-24T00:41:52.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c9410 con 0x7f51c8098bd0 2023-10-24T00:41:52.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.918+0000 7f51cedd8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c6a10 con 0x7f51c80c06e0 2023-10-24T00:41:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51ccb74700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f51c8154430 0x7f51c80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47490/0 (socket says 172.21.15.148:47490) 2023-10-24T00:41:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51ccb74700 1 -- 172.21.15.148:0/2019066685 learned_addr learned my addr 172.21.15.148:0/2019066685 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51cd375700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51c8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205511179 0 0) 0x7f51c80c71d0 con 0x7f51c8154430 2023-10-24T00:41:52.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b00033f0 con 0x7f51c8154430 2023-10-24T00:41:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928956613 0 0) 0x7f51b00033f0 con 0x7f51c8154430 2023-10-24T00:41:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 msgr2=0x7f51c8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51c8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 >> v1:172.21.15.150:6789/0 conn(0x7f51c8098bd0 legacy=0x7f51c80bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80ca8b0 con 0x7f51c8154430 2023-10-24T00:41:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f51c40017f0 con 0x7f51c8154430 2023-10-24T00:41:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 >> v1:172.21.15.148:6789/0 conn(0x7f51c8154430 legacy=0x7f51c80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51b0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0003e40 0x7f51b0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b0004b80 0x7f51b0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c6a10 con 0x7f51b0003e40 2023-10-24T00:41:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b000b990 con 0x7f51b0004b80 2023-10-24T00:41:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b000bb50 con 0x7f51c80c06e0 2023-10-24T00:41:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51bffff700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0003e40 0x7f51b0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51ccb74700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51b0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.919+0000 7f51cd375700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b0004b80 0x7f51b0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 -- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 msgr2=0x7f51b0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51c80c06e0 0x7f51b0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 -- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b0004b80 msgr2=0x7f51b0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:52.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b0004b80 0x7f51b0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 -- 172.21.15.148:0/2019066685 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00033f0 con 0x7f51b0003e40 2023-10-24T00:41:52.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bffff700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0003e40 0x7f51b0004690 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f51b8001730 tx=0x7f51b8007bb0).ready entity=mon.0 client_cookie=b3d51ed50a64ae39 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8007020 con 0x7f51b0003e40 2023-10-24T00:41:52.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8007180 con 0x7f51b0003e40 2023-10-24T00:41:52.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51bf7fe700 1 -- 172.21.15.148:0/2019066685 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8007500 con 0x7f51b0003e40 2023-10-24T00:41:52.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 -- 172.21.15.148:0/2019066685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0003e40 msgr2=0x7f51b0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 --2- 172.21.15.148:0/2019066685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51b0003e40 0x7f51b0004690 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f51b8001730 tx=0x7f51b8007bb0).stop 2023-10-24T00:41:52.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cd375700 1 -- 172.21.15.148:0/2019066685 reap_dead start 2023-10-24T00:41:52.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 -- 172.21.15.148:0/2019066685 shutdown_connections 2023-10-24T00:41:52.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 -- 172.21.15.148:0/2019066685 >> 172.21.15.148:0/2019066685 conn(0x7f51c80cb070 msgr2=0x7f51c80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:52.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 -- 172.21.15.148:0/2019066685 shutdown_connections 2023-10-24T00:41:52.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.920+0000 7f51cedd8700 1 -- 172.21.15.148:0/2019066685 wait complete. 2023-10-24T00:41:52.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.922+0000 7f51cedd8700 1 Processor -- start 2023-10-24T00:41:52.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.922+0000 7f51cedd8700 1 -- start start 2023-10-24T00:41:52.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.922+0000 7f51cedd8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b0003e40 0x7f51c80afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.922+0000 7f51cedd8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51c814e8d0 0x7f51c814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.922+0000 7f51cedd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cedd8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8167ea0 con 0x7f51c81494a0 2023-10-24T00:41:52.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cedd8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c81689e0 con 0x7f51c814e8d0 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cedd8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c81680b0 con 0x7f51b0003e40 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57746/0 (socket says 172.21.15.148:57746) 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 -- 172.21.15.148:0/1114652957 learned_addr learned my addr 172.21.15.148:0/1114652957 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51ccb74700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b0003e40 0x7f51c80afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51bffff700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51c814e8d0 0x7f51c814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 -- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b0003e40 msgr2=0x7f51c80afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b0003e40 0x7f51c80afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 -- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51c814e8d0 msgr2=0x7f51c814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51c814e8d0 0x7f51c814ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 -- 172.21.15.148:0/1114652957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8168390 con 0x7f51c81494a0 2023-10-24T00:41:52.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cd375700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f51c805fff0 tx=0x7f51c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0013680 con 0x7f51c81494a0 2023-10-24T00:41:52.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c00137e0 con 0x7f51c81494a0 2023-10-24T00:41:52.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0013b80 con 0x7f51c81494a0 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8168670 con 0x7f51c81494a0 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.923+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80afef0 con 0x7f51c81494a0 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.924+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c8168b50 con 0x7f51c81494a0 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.924+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f51c0014440 con 0x7f51c81494a0 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.925+0000 7f51bcff9700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 0x7f51b4061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.925+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f51c007a370 con 0x7f51c81494a0 2023-10-24T00:41:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.925+0000 7f51ccb74700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 0x7f51b4061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.925+0000 7f51ccb74700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 0x7f51b4061640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f51c4001920 tx=0x7f51c80caa40).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:52.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:52.929+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51c004b930 con 0x7f51c81494a0 2023-10-24T00:41:53.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.092+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51c806c6b0 con 0x7f51c81494a0 2023-10-24T00:41:53.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.092+0000 7f51bcff9700 1 -- 172.21.15.148:0/1114652957 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v59) v1 ==== 110+0+10 (secure 0 0 0) 0x7f51c0078e60 con 0x7f51c81494a0 2023-10-24T00:41:53.095 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:41:53.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 msgr2=0x7f51b4061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 0x7f51b4061640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f51c4001920 tx=0x7f51c80caa40).stop 2023-10-24T00:41:53.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 msgr2=0x7f51c8149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f51c805fff0 tx=0x7f51c0009060).stop 2023-10-24T00:41:53.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 shutdown_connections 2023-10-24T00:41:53.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51b405f180 0x7f51b4061640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51c81494a0 0x7f51c8149920 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b0003e40 0x7f51c80afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 --2- 172.21.15.148:0/1114652957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51c814e8d0 0x7f51c814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 >> 172.21.15.148:0/1114652957 conn(0x7f51c80cb070 msgr2=0x7f51c80bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 shutdown_connections 2023-10-24T00:41:53.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.094+0000 7f51cedd8700 1 -- 172.21.15.148:0/1114652957 wait complete. 2023-10-24T00:41:53.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:41:53.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.224+0000 7f107a338700 1 Processor -- start 2023-10-24T00:41:53.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.224+0000 7f107a338700 1 -- start start 2023-10-24T00:41:53.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f107a338700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1074064c00 0x7f10740bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f107a338700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1074063760 con 0x7f10740c6210 2023-10-24T00:41:53.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f107a338700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10740bf2f0 con 0x7f10740c65f0 2023-10-24T00:41:53.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f107a338700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1074154b50 con 0x7f1074064c00 2023-10-24T00:41:53.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f10788d5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1074064c00 0x7f10740bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f1073fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f10740c6210 0x7f10740c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47498/0 (socket says 172.21.15.148:47498) 2023-10-24T00:41:53.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.225+0000 7f1073fff700 1 -- 172.21.15.148:0/4094360729 learned_addr learned my addr 172.21.15.148:0/4094360729 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:53.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f10788d5700 1 -- 172.21.15.148:0/4094360729 >> v1:172.21.15.150:6789/0 conn(0x7f10740c65f0 legacy=0x7f10740be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:53.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f10788d5700 1 -- 172.21.15.148:0/4094360729 >> v1:172.21.15.148:6789/0 conn(0x7f10740c6210 legacy=0x7f10740c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f10788d5700 1 -- 172.21.15.148:0/4094360729 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740bf5d0 con 0x7f1074064c00 2023-10-24T00:41:53.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f10788d5700 1 --2- 172.21.15.148:0/4094360729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740bec80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f106c009e60 tx=0x7f106c009780).ready entity=mon.0 client_cookie=4b9bc41d1062db89 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f1072ffd700 1 -- 172.21.15.148:0/4094360729 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00e070 con 0x7f1074064c00 2023-10-24T00:41:53.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f1072ffd700 1 -- 172.21.15.148:0/4094360729 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c00bbf0 con 0x7f1074064c00 2023-10-24T00:41:53.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f1072ffd700 1 -- 172.21.15.148:0/4094360729 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c012410 con 0x7f1074064c00 2023-10-24T00:41:53.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 -- 172.21.15.148:0/4094360729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 msgr2=0x7f10740bec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 --2- 172.21.15.148:0/4094360729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740bec80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f106c009e60 tx=0x7f106c009780).stop 2023-10-24T00:41:53.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 -- 172.21.15.148:0/4094360729 shutdown_connections 2023-10-24T00:41:53.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 --2- 172.21.15.148:0/4094360729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740bec80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 -- 172.21.15.148:0/4094360729 >> 172.21.15.148:0/4094360729 conn(0x7f1074092510 msgr2=0x7f1074062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 -- 172.21.15.148:0/4094360729 shutdown_connections 2023-10-24T00:41:53.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.226+0000 7f107a338700 1 -- 172.21.15.148:0/4094360729 wait complete. 2023-10-24T00:41:53.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.227+0000 7f107a338700 1 Processor -- start 2023-10-24T00:41:53.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 -- start start 2023-10-24T00:41:53.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 0x7f10740c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 0x7f10740c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c8930 con 0x7f1074064c00 2023-10-24T00:41:53.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074155440 con 0x7f10740c65f0 2023-10-24T00:41:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f107a338700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074155720 con 0x7f10740c6210 2023-10-24T00:41:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f1073fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f1073fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57754/0 (socket says 172.21.15.148:57754) 2023-10-24T00:41:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.228+0000 7f1073fff700 1 -- 172.21.15.148:0/3857556741 learned_addr learned my addr 172.21.15.148:0/3857556741 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f10788d5700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 0x7f10740c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 -- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 msgr2=0x7f10740c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f10737fe700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 0x7f10740c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 0x7f10740c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 -- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 msgr2=0x7f10740c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 0x7f10740c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 -- 172.21.15.148:0/3857556741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c009a20 con 0x7f1074064c00 2023-10-24T00:41:53.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f10788d5700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 0x7f10740c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:53.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f10737fe700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 0x7f10740c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:53.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f1073fff700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f1064007fd0 tx=0x7f1064007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640072e0 con 0x7f1074064c00 2023-10-24T00:41:53.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1064007440 con 0x7f1074064c00 2023-10-24T00:41:53.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10640057a0 con 0x7f1074064c00 2023-10-24T00:41:53.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074155a00 con 0x7f1074064c00 2023-10-24T00:41:53.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.229+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1074155fc0 con 0x7f1074064c00 2023-10-24T00:41:53.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.230+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107406c6b0 con 0x7f1074064c00 2023-10-24T00:41:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.230+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1064005b90 con 0x7f1074064c00 2023-10-24T00:41:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.231+0000 7f105bfff700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 0x7f10600615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.231+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1064079680 con 0x7f1074064c00 2023-10-24T00:41:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.231+0000 7f10737fe700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 0x7f10600615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.231+0000 7f10737fe700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 0x7f10600615e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1074066fb0 tx=0x7f1068009040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.235+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f106404aca0 con 0x7f1074064c00 2023-10-24T00:41:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.396+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1074065f60 con 0x7f1074064c00 2023-10-24T00:41:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.396+0000 7f105bfff700 1 -- 172.21.15.148:0/3857556741 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1064079020 con 0x7f1074064c00 2023-10-24T00:41:53.399 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:41:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 msgr2=0x7f10600615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 0x7f10600615e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1074066fb0 tx=0x7f1068009040).stop 2023-10-24T00:41:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 msgr2=0x7f10740ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f1064007fd0 tx=0x7f1064007df0).stop 2023-10-24T00:41:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 shutdown_connections 2023-10-24T00:41:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10740c65f0 0x7f10740c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f106005f120 0x7f10600615e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1074064c00 0x7f10740ae4e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 --2- 172.21.15.148:0/3857556741 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10740c6210 0x7f10740c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 >> 172.21.15.148:0/3857556741 conn(0x7f1074092510 msgr2=0x7f1074067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 shutdown_connections 2023-10-24T00:41:53.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.398+0000 7f107a338700 1 -- 172.21.15.148:0/3857556741 wait complete. 2023-10-24T00:41:53.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:41:53.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.524+0000 7f7447fff700 1 Processor -- start 2023-10-24T00:41:53.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.524+0000 7f7447fff700 1 -- start start 2023-10-24T00:41:53.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7447fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74480aa140 0x7f74480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7447fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f74480ca110 0x7f74480c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7447fff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480c6410 con 0x7f74480c0cd0 2023-10-24T00:41:53.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7447fff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480c1100 con 0x7f74480ca110 2023-10-24T00:41:53.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7447fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480ca6e0 con 0x7f74480aa140 2023-10-24T00:41:53.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f74480ca110 0x7f74480c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f74480ca110 0x7f74480c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35130/0 (socket says 172.21.15.148:35130) 2023-10-24T00:41:53.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 -- 172.21.15.148:0/2780947828 learned_addr learned my addr 172.21.15.148:0/2780947828 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:53.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f7446ffd700 1 --2- 172.21.15.148:0/2780947828 >> v2:172.21.15.150:3300/0 conn(0x7f74480aa140 0x7f74480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 -- 172.21.15.148:0/2780947828 >> v2:172.21.15.150:3300/0 conn(0x7f74480aa140 msgr2=0x7f74480c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:53.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 --2- 172.21.15.148:0/2780947828 >> v2:172.21.15.150:3300/0 conn(0x7f74480aa140 0x7f74480c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 -- 172.21.15.148:0/2780947828 >> v1:172.21.15.148:6789/0 conn(0x7f74480c0cd0 legacy=0x7f7448157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.525+0000 7f743e7fc700 1 -- 172.21.15.148:0/2780947828 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480ca9c0 con 0x7f74480ca110 2023-10-24T00:41:53.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f743e7fc700 1 --2- 172.21.15.148:0/2780947828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480ca110 0x7f74480c07e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f7448065670 tx=0x7f74300090f0).ready entity=mon.0 client_cookie=55c81df4b32e6669 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f74467fc700 1 -- 172.21.15.148:0/2780947828 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000b520 con 0x7f74480ca110 2023-10-24T00:41:53.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f74467fc700 1 -- 172.21.15.148:0/2780947828 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000b680 con 0x7f74480ca110 2023-10-24T00:41:53.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f74467fc700 1 -- 172.21.15.148:0/2780947828 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743000ba00 con 0x7f74480ca110 2023-10-24T00:41:53.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 -- 172.21.15.148:0/2780947828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480ca110 msgr2=0x7f74480c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 --2- 172.21.15.148:0/2780947828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480ca110 0x7f74480c07e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f7448065670 tx=0x7f74300090f0).stop 2023-10-24T00:41:53.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 -- 172.21.15.148:0/2780947828 shutdown_connections 2023-10-24T00:41:53.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 --2- 172.21.15.148:0/2780947828 >> v2:172.21.15.150:3300/0 conn(0x7f74480aa140 0x7f74480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 --2- 172.21.15.148:0/2780947828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480ca110 0x7f74480c07e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 -- 172.21.15.148:0/2780947828 >> 172.21.15.148:0/2780947828 conn(0x7f74480944a0 msgr2=0x7f744806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 -- 172.21.15.148:0/2780947828 shutdown_connections 2023-10-24T00:41:53.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.526+0000 7f7447fff700 1 -- 172.21.15.148:0/2780947828 wait complete. 2023-10-24T00:41:53.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.527+0000 7f7447fff700 1 Processor -- start 2023-10-24T00:41:53.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.527+0000 7f7447fff700 1 -- start start 2023-10-24T00:41:53.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c0cd0 0x7f74480c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480ca110 0x7f74480addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c2e90 con 0x7f74480aa140 2023-10-24T00:41:53.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c4030 con 0x7f74480ca110 2023-10-24T00:41:53.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7447fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c2bb0 con 0x7f74480c0cd0 2023-10-24T00:41:53.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7446ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7446ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35138/0 (socket says 172.21.15.148:35138) 2023-10-24T00:41:53.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f7446ffd700 1 -- 172.21.15.148:0/1544950803 learned_addr learned my addr 172.21.15.148:0/1544950803 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:53.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f74477fe700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480ca110 0x7f74480addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.528+0000 7f743e7fc700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c0cd0 0x7f74480c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 -- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c0cd0 msgr2=0x7f74480c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c0cd0 0x7f74480c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 -- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480ca110 msgr2=0x7f74480addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480ca110 0x7f74480addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 -- 172.21.15.148:0/1544950803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009370 con 0x7f74480aa140 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7446ffd700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f743800e960 tx=0x7f7438009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800c6a0 con 0x7f74480aa140 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800c800 con 0x7f74480aa140 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74480c39e0 con 0x7f74480aa140 2023-10-24T00:41:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800cb80 con 0x7f74480aa140 2023-10-24T00:41:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.529+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74480c49b0 con 0x7f74480aa140 2023-10-24T00:41:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.530+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74480c4310 con 0x7f74480aa140 2023-10-24T00:41:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.530+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f743801b400 con 0x7f74480aa140 2023-10-24T00:41:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.531+0000 7f743f7fe700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 0x7f74280615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.531+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f743807a350 con 0x7f74480aa140 2023-10-24T00:41:53.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.531+0000 7f743e7fc700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 0x7f74280615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.531+0000 7f743e7fc700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 0x7f74280615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7430009130 tx=0x7f7430017000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.535+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f743804b9c0 con 0x7f74480aa140 2023-10-24T00:41:53.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.700+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74480ae6c0 con 0x7f74480aa140 2023-10-24T00:41:53.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.701+0000 7f743f7fe700 1 -- 172.21.15.148:0/1544950803 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+143 (secure 0 0 0) 0x7f743804efe0 con 0x7f74480aa140 2023-10-24T00:41:53.703 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:53.704 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:41:53.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:53.704 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:41:53.704 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:41:53.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:41:53.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:41:53.705 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:41:53.705 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:41:53.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:41:53.705 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:41:53.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.702+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 msgr2=0x7f74280615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 0x7f74280615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7430009130 tx=0x7f7430017000).stop 2023-10-24T00:41:53.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 msgr2=0x7f7448147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f743800e960 tx=0x7f7438009060).stop 2023-10-24T00:41:53.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 shutdown_connections 2023-10-24T00:41:53.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74480ca110 0x7f74480addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742805f120 0x7f74280615e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74480aa140 0x7f7448147bb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 --2- 172.21.15.148:0/1544950803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74480c0cd0 0x7f74480c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 >> 172.21.15.148:0/1544950803 conn(0x7f74480944a0 msgr2=0x7f7448148a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 shutdown_connections 2023-10-24T00:41:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.703+0000 7f7447fff700 1 -- 172.21.15.148:0/1544950803 wait complete. 2023-10-24T00:41:53.717 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:41:53.717 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:41:53.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.833+0000 7f4ba378d700 1 Processor -- start 2023-10-24T00:41:53.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.833+0000 7f4ba378d700 1 -- start start 2023-10-24T00:41:53.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba378d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba378d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba378d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0c6270 con 0x7f4b9c0c8290 2023-10-24T00:41:53.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba378d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c60e0 con 0x7f4b9c0aa640 2023-10-24T00:41:53.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba378d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c0c80 con 0x7f4b9c1544b0 2023-10-24T00:41:53.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1d2a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba0d28700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4b9c0c8290 0x7f4b9c0a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49690/0 (socket says 172.21.15.148:49690) 2023-10-24T00:41:53.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba0d28700 1 -- 172.21.15.148:0/2521311903 learned_addr learned my addr 172.21.15.148:0/2521311903 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:53.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:37998/0 (socket says 172.21.15.148:37998) 2023-10-24T00:41:53.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1d2a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51628/0 (socket says 172.21.15.148:51628) 2023-10-24T00:41:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 -- 172.21.15.148:0/2521311903 >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 msgr2=0x7f4b9c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 --2- 172.21.15.148:0/2521311903 >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 -- 172.21.15.148:0/2521311903 >> v1:172.21.15.150:6789/0 conn(0x7f4b9c0c8290 legacy=0x7f4b9c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4b9bfff700 1 -- 172.21.15.148:0/2521311903 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866712406 0 0) 0x7f4b9c0c6270 con 0x7f4b9c0c8290 2023-10-24T00:41:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1529700 1 -- 172.21.15.148:0/2521311903 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0c0f40 con 0x7f4b9c1544b0 2023-10-24T00:41:53.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.834+0000 7f4ba1d2a700 1 --2- 172.21.15.148:0/2521311903 >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:53.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba1529700 1 --2- 172.21.15.148:0/2521311903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4b94009760 tx=0x7f4b94009060).ready entity=mon.2 client_cookie=ebf48f3fda02ecab server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4b9bfff700 1 -- 172.21.15.148:0/2521311903 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400f510 con 0x7f4b9c1544b0 2023-10-24T00:41:53.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4b9bfff700 1 -- 172.21.15.148:0/2521311903 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9400f670 con 0x7f4b9c1544b0 2023-10-24T00:41:53.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4b9bfff700 1 -- 172.21.15.148:0/2521311903 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400f9f0 con 0x7f4b9c1544b0 2023-10-24T00:41:53.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 -- 172.21.15.148:0/2521311903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 msgr2=0x7f4b9c0a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 --2- 172.21.15.148:0/2521311903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4b94009760 tx=0x7f4b94009060).stop 2023-10-24T00:41:53.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 -- 172.21.15.148:0/2521311903 shutdown_connections 2023-10-24T00:41:53.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 --2- 172.21.15.148:0/2521311903 >> v2:172.21.15.150:3300/0 conn(0x7f4b9c0aa640 0x7f4b9c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 --2- 172.21.15.148:0/2521311903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c1544b0 0x7f4b9c0a7d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 -- 172.21.15.148:0/2521311903 >> 172.21.15.148:0/2521311903 conn(0x7f4b9c0945d0 msgr2=0x7f4b9c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 -- 172.21.15.148:0/2521311903 shutdown_connections 2023-10-24T00:41:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.835+0000 7f4ba378d700 1 -- 172.21.15.148:0/2521311903 wait complete. 2023-10-24T00:41:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.836+0000 7f4ba378d700 1 Processor -- start 2023-10-24T00:41:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.836+0000 7f4ba378d700 1 -- start start 2023-10-24T00:41:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c0aa640 0x7f4b9c148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b9c0c8290 0x7f4b9c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0ad800 con 0x7f4b9c1544b0 2023-10-24T00:41:53.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0aec30 con 0x7f4b9c0c8290 2023-10-24T00:41:53.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba378d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0af0c0 con 0x7f4b9c0aa640 2023-10-24T00:41:53.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.837+0000 7f4ba1d2a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35146/0 (socket says 172.21.15.148:35146) 2023-10-24T00:41:53.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 -- 172.21.15.148:0/3336483931 learned_addr learned my addr 172.21.15.148:0/3336483931 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:53.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba0d28700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b9c0c8290 0x7f4b9c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1529700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c0aa640 0x7f4b9c148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 -- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c0aa640 msgr2=0x7f4b9c148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c0aa640 0x7f4b9c148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 -- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b9c0c8290 msgr2=0x7f4b9c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:53.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b9c0c8290 0x7f4b9c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:53.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 -- 172.21.15.148:0/3336483931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0092a0 con 0x7f4b9c1544b0 2023-10-24T00:41:53.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba1d2a700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f4b8c00e8e0 tx=0x7f4b8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c012600 con 0x7f4b9c1544b0 2023-10-24T00:41:53.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c012760 con 0x7f4b9c1544b0 2023-10-24T00:41:53.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c012b20 con 0x7f4b9c1544b0 2023-10-24T00:41:53.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b940092a0 con 0x7f4b9c1544b0 2023-10-24T00:41:53.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.838+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c0ae300 con 0x7f4b9c1544b0 2023-10-24T00:41:53.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.839+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c06c6b0 con 0x7f4b9c1544b0 2023-10-24T00:41:53.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.839+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4b8c01b400 con 0x7f4b9c1544b0 2023-10-24T00:41:53.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.840+0000 7f4b997fa700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 0x7f4b88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:53.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.840+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4b8c07a2b0 con 0x7f4b9c1544b0 2023-10-24T00:41:53.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.840+0000 7f4ba1529700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 0x7f4b88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:53.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.840+0000 7f4ba1529700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 0x7f4b88061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4b94009fd0 tx=0x7f4b94017000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:53.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:53.844+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4b8c04b870 con 0x7f4b9c1544b0 2023-10-24T00:41:54.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.005+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4b9c0c1220 con 0x7f4b9c1544b0 2023-10-24T00:41:54.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.090+0000 7f4b997fa700 1 -- 172.21.15.148:0/3336483931 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4b8c016020 con 0x7f4b9c1544b0 2023-10-24T00:41:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 msgr2=0x7f4b88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 0x7f4b88061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4b94009fd0 tx=0x7f4b94017000).stop 2023-10-24T00:41:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 msgr2=0x7f4b9c0ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f4b8c00e8e0 tx=0x7f4b8c009060).stop 2023-10-24T00:41:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 shutdown_connections 2023-10-24T00:41:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4b8805f150 0x7f4b88061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b9c1544b0 0x7f4b9c0ad310 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b9c0aa640 0x7f4b9c148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 --2- 172.21.15.148:0/3336483931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4b9c0c8290 0x7f4b9c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 >> 172.21.15.148:0/3336483931 conn(0x7f4b9c0945d0 msgr2=0x7f4b9c0636f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 shutdown_connections 2023-10-24T00:41:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.093+0000 7f4ba378d700 1 -- 172.21.15.148:0/3336483931 wait complete. 2023-10-24T00:41:54.102 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:41:54.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:41:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.229+0000 7f9697d64700 1 Processor -- start 2023-10-24T00:41:54.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.229+0000 7f9697d64700 1 -- start start 2023-10-24T00:41:54.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.230+0000 7f9697d64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 0x7f9690069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.230+0000 7f9697d64700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9690069910 0x7f96900c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.230+0000 7f9697d64700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900bcc80 con 0x7f96900c3370 2023-10-24T00:41:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.230+0000 7f9697d64700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9690069d90 con 0x7f9690069910 2023-10-24T00:41:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.230+0000 7f9697d64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969006a520 con 0x7f9690150f60 2023-10-24T00:41:54.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9690069910 0x7f96900c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9696301700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f96900c3370 0x7f9690154b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39886/0 (socket says 172.21.15.148:39886) 2023-10-24T00:41:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9696301700 1 -- 172.21.15.148:0/2777890601 learned_addr learned my addr 172.21.15.148:0/2777890601 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 -- 172.21.15.148:0/2777890601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 msgr2=0x7f9690069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9695b00700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 0x7f9690069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9694afe700 1 -- 172.21.15.148:0/2777890601 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967416012 0 0) 0x7f96900bcc80 con 0x7f96900c3370 2023-10-24T00:41:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 0x7f9690069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 -- 172.21.15.148:0/2777890601 >> v1:172.21.15.148:6789/0 conn(0x7f96900c3370 legacy=0x7f9690154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 -- 172.21.15.148:0/2777890601 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900c3af0 con 0x7f9690069910 2023-10-24T00:41:54.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9695b00700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 0x7f9690069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f96952ff700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690069910 0x7f96900c2e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f9680009760 tx=0x7f9680009060).ready entity=mon.0 client_cookie=8375547b0a2873f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9694afe700 1 -- 172.21.15.148:0/2777890601 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800090d0 con 0x7f9690069910 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9694afe700 1 -- 172.21.15.148:0/2777890601 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000b580 con 0x7f9690069910 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.231+0000 7f9694afe700 1 -- 172.21.15.148:0/2777890601 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000b900 con 0x7f9690069910 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 -- 172.21.15.148:0/2777890601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690069910 msgr2=0x7f96900c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690069910 0x7f96900c2e80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f9680009760 tx=0x7f9680009060).stop 2023-10-24T00:41:54.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 -- 172.21.15.148:0/2777890601 shutdown_connections 2023-10-24T00:41:54.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9690150f60 0x7f9690069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 --2- 172.21.15.148:0/2777890601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690069910 0x7f96900c2e80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 -- 172.21.15.148:0/2777890601 >> 172.21.15.148:0/2777890601 conn(0x7f96900c7d20 msgr2=0x7f96900c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:54.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 -- 172.21.15.148:0/2777890601 shutdown_connections 2023-10-24T00:41:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.232+0000 7f9697d64700 1 -- 172.21.15.148:0/2777890601 wait complete. 2023-10-24T00:41:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.233+0000 7f9697d64700 1 Processor -- start 2023-10-24T00:41:54.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.233+0000 7f9697d64700 1 -- start start 2023-10-24T00:41:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9690069910 0x7f96900c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900c3370 0x7f96900c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c7950 con 0x7f9690150f60 2023-10-24T00:41:54.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690163f30 con 0x7f9690069910 2023-10-24T00:41:54.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9690163670 con 0x7f96900c3370 2023-10-24T00:41:54.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35176/0 (socket says 172.21.15.148:35176) 2023-10-24T00:41:54.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 -- 172.21.15.148:0/3151562898 learned_addr learned my addr 172.21.15.148:0/3151562898 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:54.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f96952ff700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900c3370 0x7f96900c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9695b00700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9690069910 0x7f96900c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 -- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900c3370 msgr2=0x7f96900c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900c3370 0x7f96900c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 -- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9690069910 msgr2=0x7f96900c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9690069910 0x7f96900c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:54.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 -- 172.21.15.148:0/3151562898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800092a0 con 0x7f9690150f60 2023-10-24T00:41:54.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9696301700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f968800c810 tx=0x7f9688007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:54.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688005d30 con 0x7f9690150f60 2023-10-24T00:41:54.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688005e90 con 0x7f9690150f60 2023-10-24T00:41:54.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96901638e0 con 0x7f9690150f60 2023-10-24T00:41:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.234+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688007320 con 0x7f9690150f60 2023-10-24T00:41:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.235+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9690163300 con 0x7f9690150f60 2023-10-24T00:41:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.236+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96901640e0 con 0x7f9690150f60 2023-10-24T00:41:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.236+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f96880076d0 con 0x7f9690150f60 2023-10-24T00:41:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.236+0000 7f9685ffb700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.236+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f9688079fb0 con 0x7f9690150f60 2023-10-24T00:41:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.236+0000 7f9695b00700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.237+0000 7f9695b00700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 0x7f9674061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f969014ccd0 tx=0x7f968c008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.240+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96901640e0 con 0x7f9690150f60 2023-10-24T00:41:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:54.405+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f96901640a0 con 0x7f9690150f60 2023-10-24T00:41:55.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.096+0000 7f9685ffb700 1 -- 172.21.15.148:0/3151562898 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f968804b460 con 0x7f9690150f60 2023-10-24T00:41:55.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.105+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 msgr2=0x7f9674061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.105+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 0x7f9674061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f969014ccd0 tx=0x7f968c008040).stop 2023-10-24T00:41:55.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.105+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 msgr2=0x7f9690162540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.105+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f968800c810 tx=0x7f9688007f90).stop 2023-10-24T00:41:55.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 shutdown_connections 2023-10-24T00:41:55.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9690150f60 0x7f9690162540 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9690069910 0x7f96900c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 --2- 172.21.15.148:0/3151562898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96900c3370 0x7f96900c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.110+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 >> 172.21.15.148:0/3151562898 conn(0x7f96900c7d20 msgr2=0x7f9690145b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.115+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 shutdown_connections 2023-10-24T00:41:55.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.116+0000 7f9697d64700 1 -- 172.21.15.148:0/3151562898 wait complete. 2023-10-24T00:41:55.121 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:41:55.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:41:55.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.250+0000 7fcf3237e700 1 Processor -- start 2023-10-24T00:41:55.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.250+0000 7fcf3237e700 1 -- start start 2023-10-24T00:41:55.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.251+0000 7fcf3237e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf2c154430 0x7fcf2c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.251+0000 7fcf3237e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0c71d0 con 0x7fcf2c098bd0 2023-10-24T00:41:55.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.251+0000 7fcf3237e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0c9410 con 0x7fcf2c0bffd0 2023-10-24T00:41:55.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.251+0000 7fcf3237e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c6a10 con 0x7fcf2c154430 2023-10-24T00:41:55.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.251+0000 7fcf2b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcf2c098bd0 0x7fcf2c0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39896/0 (socket says 172.21.15.148:39896) 2023-10-24T00:41:55.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2b7fe700 1 -- 172.21.15.148:0/3153207021 learned_addr learned my addr 172.21.15.148:0/3153207021 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/3153207021 >> v2:172.21.15.150:3300/0 conn(0x7fcf2c154430 0x7fcf2c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704623945 0 0) 0x7fcf2c0c71d0 con 0x7fcf2c098bd0 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf140033f0 con 0x7fcf2c098bd0 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2162139341 0 0) 0x7fcf140033f0 con 0x7fcf2c098bd0 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 >> v2:172.21.15.150:3300/0 conn(0x7fcf2c154430 msgr2=0x7fcf2c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:55.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 --2- 172.21.15.148:0/3153207021 >> v2:172.21.15.150:3300/0 conn(0x7fcf2c154430 0x7fcf2c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 >> v1:172.21.15.150:6789/0 conn(0x7fcf2c0bffd0 legacy=0x7fcf2c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0ca8b0 con 0x7fcf2c098bd0 2023-10-24T00:41:55.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fcf20001470 con 0x7fcf2c098bd0 2023-10-24T00:41:55.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 >> v1:172.21.15.148:6789/0 conn(0x7fcf2c098bd0 legacy=0x7fcf2c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 0x7fcf14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf14004690 0x7fcf14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf14005000 0x7fcf1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c6a10 con 0x7fcf14005000 2023-10-24T00:41:55.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1400bf60 con 0x7fcf140038e0 2023-10-24T00:41:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1400c0f0 con 0x7fcf14004690 2023-10-24T00:41:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 0x7fcf14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf2b7fe700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf14004690 0x7fcf14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.252+0000 7fcf3091b700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf14005000 0x7fcf1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 -- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf14004690 msgr2=0x7fcf14004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf14004690 0x7fcf14004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 -- 172.21.15.148:0/3153207021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf14005000 msgr2=0x7fcf1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf14005000 0x7fcf1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 -- 172.21.15.148:0/3153207021 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140033f0 con 0x7fcf140038e0 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3091b700 1 -- 172.21.15.148:0/3153207021 reap_dead start 2023-10-24T00:41:55.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 0x7fcf14003d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fcf1c009a80 tx=0x7fcf1c009060).ready entity=mon.1 client_cookie=2d2c667cc748071f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c009430 con 0x7fcf140038e0 2023-10-24T00:41:55.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00e640 con 0x7fcf140038e0 2023-10-24T00:41:55.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf2affd700 1 -- 172.21.15.148:0/3153207021 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00e9c0 con 0x7fcf140038e0 2023-10-24T00:41:55.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 -- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 msgr2=0x7fcf14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 0x7fcf14003d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fcf1c009a80 tx=0x7fcf1c009060).stop 2023-10-24T00:41:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 -- 172.21.15.148:0/3153207021 shutdown_connections 2023-10-24T00:41:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 --2- 172.21.15.148:0/3153207021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf140038e0 0x7fcf14003d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 -- 172.21.15.148:0/3153207021 >> 172.21.15.148:0/3153207021 conn(0x7fcf2c0cb070 msgr2=0x7fcf2c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 -- 172.21.15.148:0/3153207021 shutdown_connections 2023-10-24T00:41:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.253+0000 7fcf3237e700 1 -- 172.21.15.148:0/3153207021 wait complete. 2023-10-24T00:41:55.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.254+0000 7fcf3237e700 1 Processor -- start 2023-10-24T00:41:55.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 -- start start 2023-10-24T00:41:55.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf140038e0 0x7fcf2c0c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf2c14be00 0x7fcf2c0ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0adc40 con 0x7fcf2c14c280 2023-10-24T00:41:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c2110 con 0x7fcf2c14be00 2023-10-24T00:41:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.255+0000 7fcf3237e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c29b0 con 0x7fcf140038e0 2023-10-24T00:41:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35192/0 (socket says 172.21.15.148:35192) 2023-10-24T00:41:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 -- 172.21.15.148:0/1586319037 learned_addr learned my addr 172.21.15.148:0/1586319037 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf140038e0 0x7fcf2c0c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf2b7fe700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf2c14be00 0x7fcf2c0ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 -- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf140038e0 msgr2=0x7fcf2c0c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf140038e0 0x7fcf2c0c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 -- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf2c14be00 msgr2=0x7fcf2c0ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf2c14be00 0x7fcf2c0ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 -- 172.21.15.148:0/1586319037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c165800 con 0x7fcf2c14c280 2023-10-24T00:41:55.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3091b700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fcf2c05fff0 tx=0x7fcf24007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24006c30 con 0x7fcf2c14c280 2023-10-24T00:41:55.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24006d90 con 0x7fcf2c14c280 2023-10-24T00:41:55.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c0c2360 con 0x7fcf2c14c280 2023-10-24T00:41:55.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24007260 con 0x7fcf2c14c280 2023-10-24T00:41:55.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.256+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c164ad0 con 0x7fcf2c14c280 2023-10-24T00:41:55.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.257+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0c2b40 con 0x7fcf2c14c280 2023-10-24T00:41:55.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.258+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcf24007610 con 0x7fcf2c14c280 2023-10-24T00:41:55.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.258+0000 7fcf13fff700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 0x7fcf180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.258+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fcf24079990 con 0x7fcf2c14c280 2023-10-24T00:41:55.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.258+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 0x7fcf180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.259+0000 7fcf2bfff700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 0x7fcf180615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcf2c063b50 tx=0x7fcf1c01a000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.262+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf2404acc0 con 0x7fcf2c14c280 2023-10-24T00:41:55.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.465+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcf2c06c6b0 con 0x7fcf2c14c280 2023-10-24T00:41:55.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.472+0000 7fcf13fff700 1 -- 172.21.15.148:0/1586319037 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v16) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcf24019030 con 0x7fcf2c14c280 2023-10-24T00:41:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.475+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 msgr2=0x7fcf180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.475+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 0x7fcf180615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcf2c063b50 tx=0x7fcf1c01a000).stop 2023-10-24T00:41:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.475+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 msgr2=0x7fcf2c0ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.475+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fcf2c05fff0 tx=0x7fcf24007f30).stop 2023-10-24T00:41:55.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 shutdown_connections 2023-10-24T00:41:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf1805f120 0x7fcf180615e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf2c14c280 0x7fcf2c0ad750 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf140038e0 0x7fcf2c0c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 --2- 172.21.15.148:0/1586319037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf2c14be00 0x7fcf2c0ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.477+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 >> 172.21.15.148:0/1586319037 conn(0x7fcf2c0cb070 msgr2=0x7fcf2c0aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.478+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 shutdown_connections 2023-10-24T00:41:55.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.482+0000 7fcf3237e700 1 -- 172.21.15.148:0/1586319037 wait complete. 2023-10-24T00:41:55.489 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 7 and data pool 8 2023-10-24T00:41:55.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:55.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.619+0000 7fc9e85c0700 1 Processor -- start 2023-10-24T00:41:55.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.619+0000 7fc9e85c0700 1 -- start start 2023-10-24T00:41:55.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e85c0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9e00aa010 0x7fc9e00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e85c0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc9e00c6710 0x7fc9e00aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e85c0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00c0960 con 0x7fc9e0158770 2023-10-24T00:41:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e85c0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00aa8e0 con 0x7fc9e00aa010 2023-10-24T00:41:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e85c0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00c0c40 con 0x7fc9e00c6710 2023-10-24T00:41:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e635c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9e00aa010 0x7fc9e00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e635c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9e00aa010 0x7fc9e00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35194/0 (socket says 172.21.15.148:35194) 2023-10-24T00:41:55.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e635c700 1 -- 172.21.15.148:0/3668528450 learned_addr learned my addr 172.21.15.148:0/3668528450 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:55.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e6b5d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc9e0158770 0x7fc9e0069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39902/0 (socket says 172.21.15.148:39902) 2023-10-24T00:41:55.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.620+0000 7fc9e5b5b700 1 --2- 172.21.15.148:0/3668528450 >> v2:172.21.15.150:3300/0 conn(0x7fc9e00c6710 0x7fc9e00aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e635c700 1 -- 172.21.15.148:0/3668528450 >> v2:172.21.15.150:3300/0 conn(0x7fc9e00c6710 msgr2=0x7fc9e00aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:55.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e635c700 1 --2- 172.21.15.148:0/3668528450 >> v2:172.21.15.150:3300/0 conn(0x7fc9e00c6710 0x7fc9e00aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e635c700 1 -- 172.21.15.148:0/3668528450 >> v1:172.21.15.148:6789/0 conn(0x7fc9e0158770 legacy=0x7fc9e0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e635c700 1 -- 172.21.15.148:0/3668528450 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c0f20 con 0x7fc9e00aa010 2023-10-24T00:41:55.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e535a700 1 -- 172.21.15.148:0/3668528450 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641646277 0 0) 0x7fc9e00c0960 con 0x7fc9e0158770 2023-10-24T00:41:55.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e635c700 1 --2- 172.21.15.148:0/3668528450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00aa010 0x7fc9e00c1a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fc9e0157d00 tx=0x7fc9dc009840).ready entity=mon.0 client_cookie=632ad8a7974204e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e535a700 1 -- 172.21.15.148:0/3668528450 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00e070 con 0x7fc9e00aa010 2023-10-24T00:41:55.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e535a700 1 -- 172.21.15.148:0/3668528450 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc00ba50 con 0x7fc9e00aa010 2023-10-24T00:41:55.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e535a700 1 -- 172.21.15.148:0/3668528450 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00bdd0 con 0x7fc9e00aa010 2023-10-24T00:41:55.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 -- 172.21.15.148:0/3668528450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00aa010 msgr2=0x7fc9e00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/3668528450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00aa010 0x7fc9e00c1a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fc9e0157d00 tx=0x7fc9dc009840).stop 2023-10-24T00:41:55.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 -- 172.21.15.148:0/3668528450 shutdown_connections 2023-10-24T00:41:55.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/3668528450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00aa010 0x7fc9e00c1a00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/3668528450 >> v2:172.21.15.150:3300/0 conn(0x7fc9e00c6710 0x7fc9e00aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 -- 172.21.15.148:0/3668528450 >> 172.21.15.148:0/3668528450 conn(0x7fc9e00caf40 msgr2=0x7fc9e00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 -- 172.21.15.148:0/3668528450 shutdown_connections 2023-10-24T00:41:55.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.621+0000 7fc9e85c0700 1 -- 172.21.15.148:0/3668528450 wait complete. 2023-10-24T00:41:55.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.622+0000 7fc9e85c0700 1 Processor -- start 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.622+0000 7fc9e85c0700 1 -- start start 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00aa010 0x7fc9e00a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 0x7fc9e0152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c38a0 con 0x7fc9e00c6710 2023-10-24T00:41:55.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c2c90 con 0x7fc9e00aa010 2023-10-24T00:41:55.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e85c0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00c2f70 con 0x7fc9e0158770 2023-10-24T00:41:55.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e5b5b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e5b5b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35200/0 (socket says 172.21.15.148:35200) 2023-10-24T00:41:55.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e5b5b700 1 -- 172.21.15.148:0/380276139 learned_addr learned my addr 172.21.15.148:0/380276139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:55.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e635c700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00aa010 0x7fc9e00a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.623+0000 7fc9e6b5d700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 0x7fc9e0152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 -- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 msgr2=0x7fc9e0152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 0x7fc9e0152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 -- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00aa010 msgr2=0x7fc9e00a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00aa010 0x7fc9e00a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 -- 172.21.15.148:0/380276139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc009ae0 con 0x7fc9e00c6710 2023-10-24T00:41:55.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e6b5d700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 0x7fc9e0152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:55.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e5b5b700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc9d000d890 tx=0x7fc9d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00125f0 con 0x7fc9e00c6710 2023-10-24T00:41:55.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0012750 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e00c3250 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0012ad0 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.624+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e00c29a0 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.625+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e00aa3f0 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.625+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc9d0013480 con 0x7fc9e00c6710 2023-10-24T00:41:55.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.625+0000 7fc9d67fc700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 0x7fc9c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.626+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc9d0079ed0 con 0x7fc9e00c6710 2023-10-24T00:41:55.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.626+0000 7fc9e635c700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 0x7fc9c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.626+0000 7fc9e635c700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 0x7fc9c4061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc9dc0070b0 tx=0x7fc9dc009840).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.630+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc9d004b140 con 0x7fc9e00c6710 2023-10-24T00:41:55.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.792+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9e00c5f00 con 0x7fc9e00c6710 2023-10-24T00:41:55.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.793+0000 7fc9d67fc700 1 -- 172.21.15.148:0/380276139 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fc9d004e760 con 0x7fc9e00c6710 2023-10-24T00:41:55.796 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:55.796 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:55.467430+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:55.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 msgr2=0x7fc9c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 0x7fc9c4061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc9dc0070b0 tx=0x7fc9dc009840).stop 2023-10-24T00:41:55.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 msgr2=0x7fc9e00c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fc9d000d890 tx=0x7fc9d0008040).stop 2023-10-24T00:41:55.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 shutdown_connections 2023-10-24T00:41:55.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9e0158770 0x7fc9e0152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9e00aa010 0x7fc9e00a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9c405f150 0x7fc9c4061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 --2- 172.21.15.148:0/380276139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9e00c6710 0x7fc9e00c40f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 >> 172.21.15.148:0/380276139 conn(0x7fc9e00caf40 msgr2=0x7fc9e00cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 shutdown_connections 2023-10-24T00:41:55.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.795+0000 7fc9e85c0700 1 -- 172.21.15.148:0/380276139 wait complete. 2023-10-24T00:41:55.810 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:55.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.921+0000 7f740faa9700 1 Processor -- start 2023-10-24T00:41:55.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.921+0000 7f740faa9700 1 -- start start 2023-10-24T00:41:55.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.922+0000 7f740faa9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.922+0000 7f740faa9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.922+0000 7f740faa9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74080c0960 con 0x7f74080c6710 2023-10-24T00:41:55.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.922+0000 7f740faa9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080aa8a0 con 0x7f74080aa3f0 2023-10-24T00:41:55.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.922+0000 7f740faa9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74080c0c40 con 0x7f74080aa010 2023-10-24T00:41:55.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740e046700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:38058/0 (socket says 172.21.15.148:38058) 2023-10-24T00:41:55.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 -- 172.21.15.148:0/2790674675 learned_addr learned my addr 172.21.15.148:0/2790674675 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:55.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d044700 1 --1- 172.21.15.148:0/2790674675 >> v1:172.21.15.150:6789/0 conn(0x7f74080c6710 0x7f7408158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49716/0 (socket says 172.21.15.148:49716) 2023-10-24T00:41:55.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740e046700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51716/0 (socket says 172.21.15.148:51716) 2023-10-24T00:41:55.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 -- 172.21.15.148:0/2790674675 >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 msgr2=0x7f7408069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:55.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 --2- 172.21.15.148:0/2790674675 >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 -- 172.21.15.148:0/2790674675 >> v1:172.21.15.150:6789/0 conn(0x7f74080c6710 legacy=0x7f7408158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 -- 172.21.15.148:0/2790674675 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080c0f20 con 0x7f74080aa010 2023-10-24T00:41:55.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740e046700 1 --2- 172.21.15.148:0/2790674675 >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:41:55.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740d845700 1 --2- 172.21.15.148:0/2790674675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7404006fd0 tx=0x7f74040090f0).ready entity=mon.2 client_cookie=bb173c9578bad0d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740c843700 1 -- 172.21.15.148:0/2790674675 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400b580 con 0x7f74080aa010 2023-10-24T00:41:55.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740c843700 1 -- 172.21.15.148:0/2790674675 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400b6e0 con 0x7f74080aa010 2023-10-24T00:41:55.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.923+0000 7f740c843700 1 -- 172.21.15.148:0/2790674675 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400ba60 con 0x7f74080aa010 2023-10-24T00:41:55.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 -- 172.21.15.148:0/2790674675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 msgr2=0x7f74080c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 --2- 172.21.15.148:0/2790674675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7404006fd0 tx=0x7f74040090f0).stop 2023-10-24T00:41:55.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 -- 172.21.15.148:0/2790674675 shutdown_connections 2023-10-24T00:41:55.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 --2- 172.21.15.148:0/2790674675 >> v2:172.21.15.150:3300/0 conn(0x7f74080aa3f0 0x7f7408069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 --2- 172.21.15.148:0/2790674675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa010 0x7f74080c1a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 -- 172.21.15.148:0/2790674675 >> 172.21.15.148:0/2790674675 conn(0x7f74080caf40 msgr2=0x7f74080cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:55.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 -- 172.21.15.148:0/2790674675 shutdown_connections 2023-10-24T00:41:55.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.924+0000 7f740faa9700 1 -- 172.21.15.148:0/2790674675 wait complete. 2023-10-24T00:41:55.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.925+0000 7f740faa9700 1 Processor -- start 2023-10-24T00:41:55.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.925+0000 7f740faa9700 1 -- start start 2023-10-24T00:41:55.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa3f0 0x7f74080af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74080c6710 0x7f74081507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080b05e0 con 0x7f74080aa010 2023-10-24T00:41:55.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080af9d0 con 0x7f74080c6710 2023-10-24T00:41:55.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740faa9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74080afcb0 con 0x7f74080aa3f0 2023-10-24T00:41:55.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35214/0 (socket says 172.21.15.148:35214) 2023-10-24T00:41:55.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 -- 172.21.15.148:0/3258916966 learned_addr learned my addr 172.21.15.148:0/3258916966 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:55.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d044700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa3f0 0x7f74080af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740e046700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74080c6710 0x7f74081507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 -- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa3f0 msgr2=0x7f74080af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa3f0 0x7f74080af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 -- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74080c6710 msgr2=0x7f74081507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74080c6710 0x7f74081507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.926+0000 7f740d845700 1 -- 172.21.15.148:0/3258916966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009a20 con 0x7f74080aa010 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f740d845700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7404009130 tx=0x7f7404017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400b850 con 0x7f74080aa010 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7404009370 con 0x7f74080aa010 2023-10-24T00:41:55.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400b9d0 con 0x7f74080aa010 2023-10-24T00:41:55.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740401c670 con 0x7f74080aa010 2023-10-24T00:41:55.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.927+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74080b0270 con 0x7f74080aa010 2023-10-24T00:41:55.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.928+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080b08c0 con 0x7f74080aa010 2023-10-24T00:41:55.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.928+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f740401ca60 con 0x7f74080aa010 2023-10-24T00:41:55.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.929+0000 7f73fdffb700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 0x7f73ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:55.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.929+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f740407bf30 con 0x7f74080aa010 2023-10-24T00:41:55.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.929+0000 7f740d044700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 0x7f73ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:55.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.929+0000 7f740d044700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 0x7f73ec061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7408151a50 tx=0x7f73f8009040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:55.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:55.933+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f740404d2a0 con 0x7f74080aa010 2023-10-24T00:41:56.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.098+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f740806c6b0 con 0x7f74080aa010 2023-10-24T00:41:56.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.100+0000 7f73fdffb700 1 -- 172.21.15.148:0/3258916966 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f740402a030 con 0x7f74080aa010 2023-10-24T00:41:56.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:56.103 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:55.467430+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:56.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 msgr2=0x7f73ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 0x7f73ec061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7408151a50 tx=0x7f73f8009040).stop 2023-10-24T00:41:56.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 msgr2=0x7f74080b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f7404009130 tx=0x7f7404017000).stop 2023-10-24T00:41:56.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 shutdown_connections 2023-10-24T00:41:56.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74080c6710 0x7f74081507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f73ec05f150 0x7f73ec061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74080aa010 0x7f74080b0a70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 --2- 172.21.15.148:0/3258916966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74080aa3f0 0x7f74080af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 >> 172.21.15.148:0/3258916966 conn(0x7f74080caf40 msgr2=0x7f7408152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:56.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 shutdown_connections 2023-10-24T00:41:56.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.102+0000 7f740faa9700 1 -- 172.21.15.148:0/3258916966 wait complete. 2023-10-24T00:41:56.117 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:41:56.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.231+0000 7f55fb59e700 1 Processor -- start 2023-10-24T00:41:56.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.231+0000 7f55fb59e700 1 -- start start 2023-10-24T00:41:56.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55fc0c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fb59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc151220 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fb59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0c3210 con 0x7f55fc0c1f10 2023-10-24T00:41:56.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c2390 con 0x7f55fc151970 2023-10-24T00:41:56.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f55fc0bc7a0 0x7f55fc0644a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39906/0 (socket says 172.21.15.148:39906) 2023-10-24T00:41:56.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fad9d700 1 -- 172.21.15.148:0/3287575723 learned_addr learned my addr 172.21.15.148:0/3287575723 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:56.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55fa59c700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55fc0c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838891993 0 0) 0x7f55fc151220 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e40033f0 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208353339 0 0) 0x7f55e40033f0 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 msgr2=0x7f55fc0c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:56.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55fc0c1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 >> v1:172.21.15.150:6789/0 conn(0x7f55fc0c1f10 legacy=0x7f55fc0bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0c2600 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.232+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f55f40017f0 con 0x7f55fc0bc7a0 2023-10-24T00:41:56.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 >> v1:172.21.15.148:6789/0 conn(0x7f55fc0bc7a0 legacy=0x7f55fc0644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e4003910 0x7f55e4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e4004690 0x7f55e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c2390 con 0x7f55e4004690 2023-10-24T00:41:56.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400b8e0 con 0x7f55e4003910 2023-10-24T00:41:56.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400ba50 con 0x7f55fc151970 2023-10-24T00:41:56.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e4004690 0x7f55e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55fa59c700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e4003910 0x7f55e4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55fad9d700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 -- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 msgr2=0x7f55e4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:56.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55fc151970 0x7f55e4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 -- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e4003910 msgr2=0x7f55e4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:56.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55e4003910 0x7f55e4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 -- 172.21.15.148:0/3287575723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40033f0 con 0x7f55e4004690 2023-10-24T00:41:56.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e4004690 0x7f55e4004b10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f55f00017f0 tx=0x7f55f0007b90).ready entity=mon.0 client_cookie=7ea9f62196165600 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:56.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0007ea0 con 0x7f55e4004690 2023-10-24T00:41:56.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f0012400 con 0x7f55e4004690 2023-10-24T00:41:56.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.233+0000 7f55f959a700 1 -- 172.21.15.148:0/3287575723 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0012780 con 0x7f55e4004690 2023-10-24T00:41:56.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 -- 172.21.15.148:0/3287575723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e4004690 msgr2=0x7f55e4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 --2- 172.21.15.148:0/3287575723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55e4004690 0x7f55e4004b10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f55f00017f0 tx=0x7f55f0007b90).stop 2023-10-24T00:41:56.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fad9d700 1 -- 172.21.15.148:0/3287575723 reap_dead start 2023-10-24T00:41:56.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 -- 172.21.15.148:0/3287575723 shutdown_connections 2023-10-24T00:41:56.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 -- 172.21.15.148:0/3287575723 >> 172.21.15.148:0/3287575723 conn(0x7f55fc063120 msgr2=0x7f55fc0c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:56.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 -- 172.21.15.148:0/3287575723 shutdown_connections 2023-10-24T00:41:56.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.234+0000 7f55fb59e700 1 -- 172.21.15.148:0/3287575723 wait complete. 2023-10-24T00:41:56.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.235+0000 7f55fb59e700 1 Processor -- start 2023-10-24T00:41:56.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.235+0000 7f55fb59e700 1 -- start start 2023-10-24T00:41:56.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e4004690 0x7f55fc148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 0x7f55fc1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc148a80 con 0x7f55fc149590 2023-10-24T00:41:56.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc148c70 con 0x7f55fc0bdb20 2023-10-24T00:41:56.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc14ef20 con 0x7f55e4004690 2023-10-24T00:41:56.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35234/0 (socket says 172.21.15.148:35234) 2023-10-24T00:41:56.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 -- 172.21.15.148:0/2852500726 learned_addr learned my addr 172.21.15.148:0/2852500726 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:56.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fa59c700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e4004690 0x7f55fc148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 0x7f55fc1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 -- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e4004690 msgr2=0x7f55fc148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e4004690 0x7f55fc148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 -- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 msgr2=0x7f55fc1490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:56.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 0x7f55fc1490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:56.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 -- 172.21.15.148:0/2852500726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc14f200 con 0x7f55fc149590 2023-10-24T00:41:56.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55f9d9b700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 0x7f55fc1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:56.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fad9d700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f55fc0bdad0 tx=0x7f55f4001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:56.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400f970 con 0x7f55fc149590 2023-10-24T00:41:56.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400fad0 con 0x7f55fc149590 2023-10-24T00:41:56.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc14f4e0 con 0x7f55fc149590 2023-10-24T00:41:56.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.236+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400fe70 con 0x7f55fc149590 2023-10-24T00:41:56.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.237+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0bdfa0 con 0x7f55fc149590 2023-10-24T00:41:56.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.238+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc14fa00 con 0x7f55fc149590 2023-10-24T00:41:56.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.238+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f55f4012560 con 0x7f55fc149590 2023-10-24T00:41:56.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.238+0000 7f55ea7fc700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 0x7f55dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:56.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.238+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f55f4079db0 con 0x7f55fc149590 2023-10-24T00:41:56.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.238+0000 7f55fa59c700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 0x7f55dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:56.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.239+0000 7f55fa59c700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 0x7f55dc061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f55ec006d20 tx=0x7f55ec006f40).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:56.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.242+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f55fc14fa00 con 0x7f55fc149590 2023-10-24T00:41:56.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:56.447+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f55fc047480 con 0x7f55fc149590 2023-10-24T00:41:56.812 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:41:56.811+0000 7f675e326700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:41:57.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.110+0000 7f55ea7fc700 1 -- 172.21.15.148:0/2852500726 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f55f4019020 con 0x7f55fc149590 2023-10-24T00:41:57.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 msgr2=0x7f55dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 0x7f55dc061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f55ec006d20 tx=0x7f55ec006f40).stop 2023-10-24T00:41:57.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 msgr2=0x7f55fc14fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f55fc0bdad0 tx=0x7f55f4001d90).stop 2023-10-24T00:41:57.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 shutdown_connections 2023-10-24T00:41:57.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f55dc05f150 0x7f55dc061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55fc149590 0x7f55fc14fce0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55e4004690 0x7f55fc148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 --2- 172.21.15.148:0/2852500726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55fc0bdb20 0x7f55fc1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 >> 172.21.15.148:0/2852500726 conn(0x7f55fc063120 msgr2=0x7f55fc0c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:57.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 shutdown_connections 2023-10-24T00:41:57.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.112+0000 7f55fb59e700 1 -- 172.21.15.148:0/2852500726 wait complete. 2023-10-24T00:41:57.128 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:41:57.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:41:57.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.244+0000 7f408daa6700 1 Processor -- start 2023-10-24T00:41:57.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.244+0000 7f408daa6700 1 -- start start 2023-10-24T00:41:57.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f408daa6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 0x7f4088154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:57.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f408daa6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40880c71d0 con 0x7f4088154430 2023-10-24T00:41:57.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f408daa6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40880c9410 con 0x7f40880bffd0 2023-10-24T00:41:57.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f408daa6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c6a10 con 0x7f4088098bd0 2023-10-24T00:41:57.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40877fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4088154430 0x7f40880c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39908/0 (socket says 172.21.15.148:39908) 2023-10-24T00:41:57.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40877fe700 1 -- 172.21.15.148:0/2092115723 learned_addr learned my addr 172.21.15.148:0/2092115723 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:57.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f4086ffd700 1 --2- 172.21.15.148:0/2092115723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 0x7f4088154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:57.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072077759 0 0) 0x7f40880c71d0 con 0x7f4088154430 2023-10-24T00:41:57.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40700033f0 con 0x7f4088154430 2023-10-24T00:41:57.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946923996 0 0) 0x7f40880c9410 con 0x7f40880bffd0 2023-10-24T00:41:57.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40880c71d0 con 0x7f40880bffd0 2023-10-24T00:41:57.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f4086ffd700 1 -- 172.21.15.148:0/2092115723 >> v1:172.21.15.150:6789/0 conn(0x7f40880bffd0 legacy=0x7f408815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245753349 0 0) 0x7f40700033f0 con 0x7f4088154430 2023-10-24T00:41:57.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f4086ffd700 1 -- 172.21.15.148:0/2092115723 >> v1:172.21.15.148:6789/0 conn(0x7f4088154430 legacy=0x7f40880c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.245+0000 7f4086ffd700 1 -- 172.21.15.148:0/2092115723 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880ca8b0 con 0x7f4088098bd0 2023-10-24T00:41:57.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f4086ffd700 1 --2- 172.21.15.148:0/2092115723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 0x7f4088154810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f407c0097c0 tx=0x7f407c009060).ready entity=mon.2 client_cookie=d14c254e771faa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:57.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078001470 con 0x7f4088098bd0 2023-10-24T00:41:57.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c011400 con 0x7f4088098bd0 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f40867fc700 1 -- 172.21.15.148:0/2092115723 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c011780 con 0x7f4088098bd0 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 -- 172.21.15.148:0/2092115723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 msgr2=0x7f4088154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 --2- 172.21.15.148:0/2092115723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 0x7f4088154810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f407c0097c0 tx=0x7f407c009060).stop 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 -- 172.21.15.148:0/2092115723 shutdown_connections 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 --2- 172.21.15.148:0/2092115723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4088098bd0 0x7f4088154810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 -- 172.21.15.148:0/2092115723 >> 172.21.15.148:0/2092115723 conn(0x7f40880cb070 msgr2=0x7f40880cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 -- 172.21.15.148:0/2092115723 shutdown_connections 2023-10-24T00:41:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.246+0000 7f408daa6700 1 -- 172.21.15.148:0/2092115723 wait complete. 2023-10-24T00:41:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.247+0000 7f408daa6700 1 Processor -- start 2023-10-24T00:41:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 -- start start 2023-10-24T00:41:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40880bffd0 0x7f4088156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088154430 0x7f40881572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40881577a0 con 0x7f4088098bd0 2023-10-24T00:41:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4088151770 con 0x7f4088154430 2023-10-24T00:41:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f408daa6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4088151a50 con 0x7f40880bffd0 2023-10-24T00:41:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f40877fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f40877fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35238/0 (socket says 172.21.15.148:35238) 2023-10-24T00:41:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f40877fe700 1 -- 172.21.15.148:0/3511246037 learned_addr learned my addr 172.21.15.148:0/3511246037 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.248+0000 7f4086ffd700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40880bffd0 0x7f4088156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f4087fff700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088154430 0x7f40881572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 -- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40880bffd0 msgr2=0x7f4088156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40880bffd0 0x7f4088156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 -- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088154430 msgr2=0x7f40881572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088154430 0x7f40881572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 -- 172.21.15.148:0/3511246037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0092a0 con 0x7f4088098bd0 2023-10-24T00:41:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f40877fe700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f407800c800 tx=0x7f4078001620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078007170 con 0x7f4088098bd0 2023-10-24T00:41:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780072d0 con 0x7f4088098bd0 2023-10-24T00:41:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4088151d30 con 0x7f4088098bd0 2023-10-24T00:41:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40780048c0 con 0x7f4088098bd0 2023-10-24T00:41:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.249+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40881522f0 con 0x7f4088098bd0 2023-10-24T00:41:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.250+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408806c6b0 con 0x7f4088098bd0 2023-10-24T00:41:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.250+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4078004cf0 con 0x7f4088098bd0 2023-10-24T00:41:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.251+0000 7f406f7fe700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 0x7f4074061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.251+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4078079b60 con 0x7f4088098bd0 2023-10-24T00:41:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.251+0000 7f4086ffd700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 0x7f4074061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.251+0000 7f4086ffd700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 0x7f4074061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f407c0097c0 tx=0x7f407c016000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:57.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.255+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f407804ae30 con 0x7f4088098bd0 2023-10-24T00:41:57.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:57.462+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f40880c6c10 con 0x7f4088098bd0 2023-10-24T00:41:58.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.115+0000 7f406f7fe700 1 -- 172.21.15.148:0/3511246037 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f407804e450 con 0x7f4088098bd0 2023-10-24T00:41:58.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 msgr2=0x7f4074061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 0x7f4074061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f407c0097c0 tx=0x7f407c016000).stop 2023-10-24T00:41:58.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 msgr2=0x7f408813fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f407800c800 tx=0x7f4078001620).stop 2023-10-24T00:41:58.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 shutdown_connections 2023-10-24T00:41:58.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4088154430 0x7f40881572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f407405f150 0x7f4074061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4088098bd0 0x7f408813fec0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 --2- 172.21.15.148:0/3511246037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40880bffd0 0x7f4088156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 >> 172.21.15.148:0/3511246037 conn(0x7f40880cb070 msgr2=0x7f40880a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 shutdown_connections 2023-10-24T00:41:58.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.117+0000 7f408daa6700 1 -- 172.21.15.148:0/3511246037 wait complete. 2023-10-24T00:41:58.132 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:41:58.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:58.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.245+0000 7fe2d9037700 1 Processor -- start 2023-10-24T00:41:58.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.245+0000 7fe2d9037700 1 -- start start 2023-10-24T00:41:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d9037700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2d40aa010 0x7fe2d40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d9037700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40aa3f0 0x7fe2d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d9037700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40aa860 con 0x7fe2d40c6710 2023-10-24T00:41:58.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d9037700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d40c0960 con 0x7fe2d40aa010 2023-10-24T00:41:58.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d9037700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40c0c40 con 0x7fe2d40aa3f0 2023-10-24T00:41:58.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2d40aa010 0x7fe2d40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2d40aa010 0x7fe2d40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35248/0 (socket says 172.21.15.148:35248) 2023-10-24T00:41:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.246+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/3750754879 learned_addr learned my addr 172.21.15.148:0/3750754879 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/3750754879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40aa3f0 msgr2=0x7fe2d4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d2d9d700 1 --2- 172.21.15.148:0/3750754879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40aa3f0 0x7fe2d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/3750754879 >> v1:172.21.15.150:6789/0 conn(0x7fe2d40c6710 legacy=0x7fe2d4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:58.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/3750754879 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40c0f20 con 0x7fe2d40aa010 2023-10-24T00:41:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d2d9d700 1 --2- 172.21.15.148:0/3750754879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d40c1a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe2c4006fd0 tx=0x7fe2c40090f0).ready entity=mon.0 client_cookie=67bfe93831d2c4da server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d259c700 1 -- 172.21.15.148:0/3750754879 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400b600 con 0x7fe2d40aa010 2023-10-24T00:41:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d259c700 1 -- 172.21.15.148:0/3750754879 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b760 con 0x7fe2d40aa010 2023-10-24T00:41:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d259c700 1 -- 172.21.15.148:0/3750754879 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bae0 con 0x7fe2d40aa010 2023-10-24T00:41:58.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 -- 172.21.15.148:0/3750754879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 msgr2=0x7fe2d40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 --2- 172.21.15.148:0/3750754879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d40c1a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe2c4006fd0 tx=0x7fe2c40090f0).stop 2023-10-24T00:41:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 -- 172.21.15.148:0/3750754879 shutdown_connections 2023-10-24T00:41:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 --2- 172.21.15.148:0/3750754879 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40aa3f0 0x7fe2d4069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:41:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 --2- 172.21.15.148:0/3750754879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d40c1a00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 -- 172.21.15.148:0/3750754879 >> 172.21.15.148:0/3750754879 conn(0x7fe2d40caf40 msgr2=0x7fe2d40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 -- 172.21.15.148:0/3750754879 shutdown_connections 2023-10-24T00:41:58.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.247+0000 7fe2d9037700 1 -- 172.21.15.148:0/3750754879 wait complete. 2023-10-24T00:41:58.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 Processor -- start 2023-10-24T00:41:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 -- start start 2023-10-24T00:41:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d40aa3f0 0x7fe2d4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40c6710 0x7fe2d41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40ae630 con 0x7fe2d40aa010 2023-10-24T00:41:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d4155d60 con 0x7fe2d40aa3f0 2023-10-24T00:41:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d9037700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d40ae020 con 0x7fe2d40c6710 2023-10-24T00:41:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.249+0000 7fe2d2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35256/0 (socket says 172.21.15.148:35256) 2023-10-24T00:41:58.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/1667618314 learned_addr learned my addr 172.21.15.148:0/1667618314 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d359e700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40c6710 0x7fe2d41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2ca59c700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d40aa3f0 0x7fe2d4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40c6710 msgr2=0x7fe2d41563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40c6710 0x7fe2d41563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d40aa3f0 msgr2=0x7fe2d4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d40aa3f0 0x7fe2d4155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 -- 172.21.15.148:0/1667618314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009370 con 0x7fe2d40aa010 2023-10-24T00:41:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d2d9d700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe2d4084230 tx=0x7fe2c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400bea0 con 0x7fe2d40aa010 2023-10-24T00:41:58.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b8d0 con 0x7fe2d40aa010 2023-10-24T00:41:58.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d4155a80 con 0x7fe2d40aa010 2023-10-24T00:41:58.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c401b660 con 0x7fe2d40aa010 2023-10-24T00:41:58.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.250+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d4148110 con 0x7fe2d40aa010 2023-10-24T00:41:58.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.251+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d406c6b0 con 0x7fe2d40aa010 2023-10-24T00:41:58.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.252+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe2c401b9d0 con 0x7fe2d40aa010 2023-10-24T00:41:58.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.252+0000 7fe2cb7fe700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 0x7fe2b40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.252+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2c407be10 con 0x7fe2d40aa010 2023-10-24T00:41:58.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.253+0000 7fe2ca59c700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 0x7fe2b40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.253+0000 7fe2ca59c700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 0x7fe2b40615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe2d4152ff0 tx=0x7fe2bc006ee0).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.256+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2c404d180 con 0x7fe2d40aa010 2023-10-24T00:41:58.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.460+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2d40c1200 con 0x7fe2d40aa010 2023-10-24T00:41:58.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.460+0000 7fe2cb7fe700 1 -- 172.21.15.148:0/1667618314 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fe2c4029070 con 0x7fe2d40aa010 2023-10-24T00:41:58.463 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:58.463 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:41:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 msgr2=0x7fe2b40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 0x7fe2b40615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe2d4152ff0 tx=0x7fe2bc006ee0).stop 2023-10-24T00:41:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 msgr2=0x7fe2d4147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fe2d4084230 tx=0x7fe2c4017000).stop 2023-10-24T00:41:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 shutdown_connections 2023-10-24T00:41:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2d40c6710 0x7fe2d41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe2b405f120 0x7fe2b40615e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2d40aa010 0x7fe2d4147c20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 --2- 172.21.15.148:0/1667618314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d40aa3f0 0x7fe2d4155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 >> 172.21.15.148:0/1667618314 conn(0x7fe2d40caf40 msgr2=0x7fe2d4153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 shutdown_connections 2023-10-24T00:41:58.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.462+0000 7fe2d9037700 1 -- 172.21.15.148:0/1667618314 wait complete. 2023-10-24T00:41:58.467 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:41:58.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:41:58.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.587+0000 7fc493058700 1 Processor -- start 2023-10-24T00:41:58.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.587+0000 7fc493058700 1 -- start start 2023-10-24T00:41:58.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc493058700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc48c151cb0 0x7fc48c154820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc493058700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc48c06a230 0x7fc48c0a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc493058700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c155710 con 0x7fc48c0aa380 2023-10-24T00:41:58.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc493058700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c154e70 con 0x7fc48c06a230 2023-10-24T00:41:58.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc493058700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c155150 con 0x7fc48c151cb0 2023-10-24T00:41:58.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc483fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc48c06a230 0x7fc48c0a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc4915f5700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc48c0aa380 0x7fc48c0631d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39910/0 (socket says 172.21.15.148:39910) 2023-10-24T00:41:58.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc4915f5700 1 -- 172.21.15.148:0/3664176153 learned_addr learned my addr 172.21.15.148:0/3664176153 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:58.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.588+0000 7fc490df4700 1 --2- 172.21.15.148:0/3664176153 >> v2:172.21.15.150:3300/0 conn(0x7fc48c151cb0 0x7fc48c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc483fff700 1 -- 172.21.15.148:0/3664176153 >> v2:172.21.15.150:3300/0 conn(0x7fc48c151cb0 msgr2=0x7fc48c154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:58.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc483fff700 1 --2- 172.21.15.148:0/3664176153 >> v2:172.21.15.150:3300/0 conn(0x7fc48c151cb0 0x7fc48c154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc483fff700 1 -- 172.21.15.148:0/3664176153 >> v1:172.21.15.148:6789/0 conn(0x7fc48c0aa380 legacy=0x7fc48c0631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc483fff700 1 -- 172.21.15.148:0/3664176153 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c155430 con 0x7fc48c06a230 2023-10-24T00:41:58.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc4837fe700 1 -- 172.21.15.148:0/3664176153 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046464318 0 0) 0x7fc48c155710 con 0x7fc48c0aa380 2023-10-24T00:41:58.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc483fff700 1 --2- 172.21.15.148:0/3664176153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c06a230 0x7fc48c0a9e90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc48c084230 tx=0x7fc47c009060).ready entity=mon.0 client_cookie=5bb5d5218ea124da server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc4837fe700 1 -- 172.21.15.148:0/3664176153 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00f510 con 0x7fc48c06a230 2023-10-24T00:41:58.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc4837fe700 1 -- 172.21.15.148:0/3664176153 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00f670 con 0x7fc48c06a230 2023-10-24T00:41:58.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc4837fe700 1 -- 172.21.15.148:0/3664176153 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00f9f0 con 0x7fc48c06a230 2023-10-24T00:41:58.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 -- 172.21.15.148:0/3664176153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c06a230 msgr2=0x7fc48c0a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 --2- 172.21.15.148:0/3664176153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c06a230 0x7fc48c0a9e90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc48c084230 tx=0x7fc47c009060).stop 2023-10-24T00:41:58.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 -- 172.21.15.148:0/3664176153 shutdown_connections 2023-10-24T00:41:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 --2- 172.21.15.148:0/3664176153 >> v2:172.21.15.150:3300/0 conn(0x7fc48c151cb0 0x7fc48c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 --2- 172.21.15.148:0/3664176153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c06a230 0x7fc48c0a9e90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 -- 172.21.15.148:0/3664176153 >> 172.21.15.148:0/3664176153 conn(0x7fc48c0caf40 msgr2=0x7fc48c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 -- 172.21.15.148:0/3664176153 shutdown_connections 2023-10-24T00:41:58.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.589+0000 7fc493058700 1 -- 172.21.15.148:0/3664176153 wait complete. 2023-10-24T00:41:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.590+0000 7fc493058700 1 Processor -- start 2023-10-24T00:41:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 -- start start 2023-10-24T00:41:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 0x7fc48c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 0x7fc48c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c152580 con 0x7fc48c151cb0 2023-10-24T00:41:58.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0c44b0 con 0x7fc48c0aa380 2023-10-24T00:41:58.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc493058700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c14a2c0 con 0x7fc48c06a230 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.591+0000 7fc4915f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35272/0 (socket says 172.21.15.148:35272) 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 -- 172.21.15.148:0/3531539174 learned_addr learned my addr 172.21.15.148:0/3531539174 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc483fff700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 0x7fc48c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc490df4700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 0x7fc48c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 -- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 msgr2=0x7fc48c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 0x7fc48c152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 -- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 msgr2=0x7fc48c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 0x7fc48c0c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 -- 172.21.15.148:0/3531539174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0092a0 con 0x7fc48c151cb0 2023-10-24T00:41:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc490df4700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 0x7fc48c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc483fff700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 0x7fc48c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc4915f5700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fc48400c490 tx=0x7fc484007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840072e0 con 0x7fc48c151cb0 2023-10-24T00:41:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484007440 con 0x7fc48c151cb0 2023-10-24T00:41:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c153010 con 0x7fc48c151cb0 2023-10-24T00:41:58.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840057a0 con 0x7fc48c151cb0 2023-10-24T00:41:58.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.592+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c152820 con 0x7fc48c151cb0 2023-10-24T00:41:58.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.593+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c06c6b0 con 0x7fc48c151cb0 2023-10-24T00:41:58.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.593+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc484005b90 con 0x7fc48c151cb0 2023-10-24T00:41:58.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.594+0000 7fc480ff9700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 0x7fc478061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.594+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc484079890 con 0x7fc48c151cb0 2023-10-24T00:41:58.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.594+0000 7fc490df4700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 0x7fc478061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.594+0000 7fc490df4700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 0x7fc478061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc488007620 tx=0x7fc48800b040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.598+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc48404ab60 con 0x7fc48c151cb0 2023-10-24T00:41:58.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.761+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c05fc80 con 0x7fc48c151cb0 2023-10-24T00:41:58.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.761+0000 7fc480ff9700 1 -- 172.21.15.148:0/3531539174 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc48404e180 con 0x7fc48c151cb0 2023-10-24T00:41:58.764 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:58.764 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":63,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:41:56.469139+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:41:58.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.763+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 msgr2=0x7fc478061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.763+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 0x7fc478061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc488007620 tx=0x7fc48800b040).stop 2023-10-24T00:41:58.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 msgr2=0x7fc48c149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fc48400c490 tx=0x7fc484007c10).stop 2023-10-24T00:41:58.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 shutdown_connections 2023-10-24T00:41:58.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc47805f150 0x7fc478061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc48c151cb0 0x7fc48c149dd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc48c06a230 0x7fc48c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 --2- 172.21.15.148:0/3531539174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc48c0aa380 0x7fc48c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 >> 172.21.15.148:0/3531539174 conn(0x7fc48c0caf40 msgr2=0x7fc48c0ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 shutdown_connections 2023-10-24T00:41:58.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.764+0000 7fc493058700 1 -- 172.21.15.148:0/3531539174 wait complete. 2023-10-24T00:41:58.778 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:41:58.779 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:41:58.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 Processor -- start 2023-10-24T00:41:58.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 -- start start 2023-10-24T00:41:58.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fab340c86c0 0x7fab340bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a6550 0x7fab340a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fab340a8260 0x7fab340c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab340a8710 con 0x7fab340a8260 2023-10-24T00:41:58.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab340a6a50 con 0x7fab340c86c0 2023-10-24T00:41:58.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.890+0000 7fab3ab8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340a6d30 con 0x7fab340a6550 2023-10-24T00:41:58.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fab340a8260 0x7fab340c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fab340a8260 0x7fab340c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35284/0 (socket says 172.21.15.148:35284) 2023-10-24T00:41:58.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 -- 172.21.15.148:0/2171981332 learned_addr learned my addr 172.21.15.148:0/2171981332 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab33fff700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a6550 0x7fab340a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab38926700 1 --2- 172.21.15.148:0/2171981332 >> v2:172.21.15.150:3300/0 conn(0x7fab340c86c0 0x7fab340bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 -- 172.21.15.148:0/2171981332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a6550 msgr2=0x7fab340a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a6550 0x7fab340a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 -- 172.21.15.148:0/2171981332 >> v2:172.21.15.150:3300/0 conn(0x7fab340c86c0 msgr2=0x7fab340bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 --2- 172.21.15.148:0/2171981332 >> v2:172.21.15.150:3300/0 conn(0x7fab340c86c0 0x7fab340bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 -- 172.21.15.148:0/2171981332 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340a7010 con 0x7fab340a8260 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab39127700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a8260 0x7fab340c6d10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fab340699f0 tx=0x7fab2c009840).ready entity=mon.0 client_cookie=9fb814235d866c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab337fe700 1 -- 172.21.15.148:0/2171981332 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00e070 con 0x7fab340a8260 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab337fe700 1 -- 172.21.15.148:0/2171981332 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c00ba50 con 0x7fab340a8260 2023-10-24T00:41:58.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.891+0000 7fab337fe700 1 -- 172.21.15.148:0/2171981332 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00bdd0 con 0x7fab340a8260 2023-10-24T00:41:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 -- 172.21.15.148:0/2171981332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a8260 msgr2=0x7fab340c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a8260 0x7fab340c6d10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fab340699f0 tx=0x7fab2c009840).stop 2023-10-24T00:41:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 -- 172.21.15.148:0/2171981332 shutdown_connections 2023-10-24T00:41:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a8260 0x7fab340c6d10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/2171981332 >> v2:172.21.15.150:3300/0 conn(0x7fab340c86c0 0x7fab340bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/2171981332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a6550 0x7fab340a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 -- 172.21.15.148:0/2171981332 >> 172.21.15.148:0/2171981332 conn(0x7fab34092480 msgr2=0x7fab34062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 -- 172.21.15.148:0/2171981332 shutdown_connections 2023-10-24T00:41:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.892+0000 7fab3ab8a700 1 -- 172.21.15.148:0/2171981332 wait complete. 2023-10-24T00:41:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.893+0000 7fab3ab8a700 1 Processor -- start 2023-10-24T00:41:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.893+0000 7fab3ab8a700 1 -- start start 2023-10-24T00:41:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 0x7fab340aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab340c86c0 0x7fab34151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340aafa0 con 0x7fab340a6550 2023-10-24T00:41:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab34153bc0 con 0x7fab340c86c0 2023-10-24T00:41:58.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab3ab8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab34152fb0 con 0x7fab340a8260 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35298/0 (socket says 172.21.15.148:35298) 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 -- 172.21.15.148:0/1934112827 learned_addr learned my addr 172.21.15.148:0/1934112827 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab33fff700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 0x7fab340aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab39127700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab340c86c0 0x7fab34151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 -- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 msgr2=0x7fab340aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 0x7fab340aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 -- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab340c86c0 msgr2=0x7fab34151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:58.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab340c86c0 0x7fab34151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:58.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 -- 172.21.15.148:0/1934112827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c009ae0 con 0x7fab340a6550 2023-10-24T00:41:58.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab33fff700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 0x7fab340aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.894+0000 7fab38926700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fab2800d860 tx=0x7fab28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.895+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280125f0 con 0x7fab340a6550 2023-10-24T00:41:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.895+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28012750 con 0x7fab340a6550 2023-10-24T00:41:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.895+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab34153290 con 0x7fab340a6550 2023-10-24T00:41:58.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.895+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28012ad0 con 0x7fab340a6550 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.895+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34153850 con 0x7fab340a6550 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.896+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3406c6b0 con 0x7fab340a6550 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.896+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fab28013480 con 0x7fab340a6550 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.896+0000 7fab30ff9700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 0x7fab18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.896+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fab2807a5c0 con 0x7fab340a6550 2023-10-24T00:41:58.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.896+0000 7fab33fff700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 0x7fab18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.897+0000 7fab33fff700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 0x7fab18061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fab340c2d60 tx=0x7fab20008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:58.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:58.900+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fab2804b830 con 0x7fab340a6550 2023-10-24T00:41:59.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.059+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab340c0480 con 0x7fab1805f150 2023-10-24T00:41:59.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.070+0000 7fab30ff9700 1 -- 172.21.15.148:0/1934112827 <== mgr.5377 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353066 (secure 0 0 0) 0x7fab340c0480 con 0x7fab1805f150 2023-10-24T00:41:59.076 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:59.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 msgr2=0x7fab18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 0x7fab18061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fab340c2d60 tx=0x7fab20008040).stop 2023-10-24T00:41:59.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 msgr2=0x7fab34152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fab2800d860 tx=0x7fab28008040).stop 2023-10-24T00:41:59.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 shutdown_connections 2023-10-24T00:41:59.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab340c86c0 0x7fab34151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fab1805f150 0x7fab18061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab340a6550 0x7fab34152910 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 --2- 172.21.15.148:0/1934112827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab340a8260 0x7fab340aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 >> 172.21.15.148:0/1934112827 conn(0x7fab34092480 msgr2=0x7fab34067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 shutdown_connections 2023-10-24T00:41:59.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.073+0000 7fab3ab8a700 1 -- 172.21.15.148:0/1934112827 wait complete. 2023-10-24T00:41:59.081 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:41:59.087 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:41:57.374908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2406808,"kb_used_data":5464,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752567912,"statfs":{"total":773094113280,"available":770629541888,"internally_reserved":0,"allocated":5595136,"data_stored":2732306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16247759,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-748,"num_write_kb":-16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.430494"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098569+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098673+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098316+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.101418+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096920+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.094503+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.100311+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099205+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099721+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.100992+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098338+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097413+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.095836+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099495+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.094490+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.100366+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096278+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097572+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099762+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.095869+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.094468+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099104+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099548+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099038+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.101863+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097121+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097893+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096948+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099265+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097072+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.093921+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096957+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.101496+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096933+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096830+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096475+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099971+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096465+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098849+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098399+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099060+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096347+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.100840+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.093872+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099577+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099571+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098590+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.093913+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098510+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.095869+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099296+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098888+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096568+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.093876+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098332+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.095820+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.096274+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.086333+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:41:52.086333+0000","last_peered":"2023-10-24T00:41:52.086333+0000","last_clean":"2023-10-24T00:41:52.086333+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:41:52.086333+0000","last_undegraded":"2023-10-24T00:41:52.086333+0000","last_fullsized":"2023-10-24T00:41:52.086333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.101092+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.613714+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:41:52.613714+0000","last_peered":"2023-10-24T00:41:52.613714+0000","last_clean":"2023-10-24T00:41:52.613714+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:41:52.613714+0000","last_undegraded":"2023-10-24T00:41:52.613714+0000","last_fullsized":"2023-10-24T00:41:52.613714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.099557+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.613116+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:41:52.613116+0000","last_peered":"2023-10-24T00:41:52.613116+0000","last_clean":"2023-10-24T00:41:52.613116+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:41:52.613116+0000","last_undegraded":"2023-10-24T00:41:52.613116+0000","last_fullsized":"2023-10-24T00:41:52.613116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098651+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.613694+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:41:52.613694+0000","last_peered":"2023-10-24T00:41:52.613694+0000","last_clean":"2023-10-24T00:41:52.613694+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:41:52.613694+0000","last_undegraded":"2023-10-24T00:41:52.613694+0000","last_fullsized":"2023-10-24T00:41:52.613694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.088964+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:41:52.088964+0000","last_peered":"2023-10-24T00:41:52.088964+0000","last_clean":"2023-10-24T00:41:52.088964+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:41:52.088964+0000","last_undegraded":"2023-10-24T00:41:52.088964+0000","last_fullsized":"2023-10-24T00:41:52.088964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.098635+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.088961+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:41:52.088961+0000","last_peered":"2023-10-24T00:41:52.088961+0000","last_clean":"2023-10-24T00:41:52.088961+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:41:52.088961+0000","last_undegraded":"2023-10-24T00:41:52.088961+0000","last_fullsized":"2023-10-24T00:41:52.088961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.097435+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.088960+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:41:52.088960+0000","last_peered":"2023-10-24T00:41:52.088960+0000","last_clean":"2023-10-24T00:41:52.088960+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:41:52.088960+0000","last_undegraded":"2023-10-24T00:41:52.088960+0000","last_fullsized":"2023-10-24T00:41:52.088960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.092936+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.086349+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:41:52.086349+0000","last_peered":"2023-10-24T00:41:52.086349+0000","last_clean":"2023-10-24T00:41:52.086349+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:41:52.086349+0000","last_undegraded":"2023-10-24T00:41:52.086349+0000","last_fullsized":"2023-10-24T00:41:52.086349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:41:55.090571+0000","last_change":"2023-10-24T00:41:55.090571+0000","last_active":"2023-10-24T00:41:55.090571+0000","last_peered":"2023-10-24T00:41:55.090571+0000","last_clean":"2023-10-24T00:41:55.090571+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:55.090571+0000","last_undegraded":"2023-10-24T00:41:55.090571+0000","last_fullsized":"2023-10-24T00:41:55.090571+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:41:54.086046+0000","last_change":"2023-10-24T00:41:54.093366+0000","last_active":"2023-10-24T00:41:54.086046+0000","last_peered":"2023-10-24T00:41:54.086046+0000","last_clean":"2023-10-24T00:41:54.086046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:41:54.086046+0000","last_undegraded":"2023-10-24T00:41:54.086046+0000","last_fullsized":"2023-10-24T00:41:54.086046+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-24T00:41:52.613643+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:41:52.613643+0000","last_peered":"2023-10-24T00:41:52.613643+0000","last_clean":"2023-10-24T00:41:52.613643+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:41:52.613643+0000","last_undegraded":"2023-10-24T00:41:52.613643+0000","last_fullsized":"2023-10-24T00:41:52.613643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.29799999999999999,"15min":0.22700000000000001},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.73899999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.68000000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.47799999999999998,"5min":0.32800000000000001,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.32600000000000001},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60799999999999998},"min":{"1min":0.51000000000000001,"5min":0.40400000000000003,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.79200000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.621},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.65200000000000002,"5min":0.72199999999999998,"15min":0.73099999999999998},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.79600000000000004},"last":0.745},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.81299999999999994},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.85699999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.33700000000000002},"max":{"1min":0.69499999999999995,"5min":0.77400000000000002,"15min":0.83299999999999996},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.878},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.82799999999999996},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.55900000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":1.786},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.378,"15min":0.33500000000000002},"max":{"1min":0.67100000000000004,"5min":0.75,"15min":3.2160000000000002},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.85599999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":1.873},"last":0.40899999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.316},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.81799999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.91900000000000004},"last":0.502}]},{"osd":4,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.307},"max":{"1min":0.622,"5min":0.73799999999999999,"15min":3.2959999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.74199999999999999},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.54300000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":1.8340000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.55100000000000005},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.628,"5min":0.73199999999999998,"15min":0.84599999999999997},"last":0.48699999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":0.70399999999999996,"5min":0.76700000000000002,"15min":3.2610000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.82099999999999995},"last":0.51000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575009,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.375},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.308}]},{"osd":2,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.23300000000000001},"max":{"1min":0.51400000000000001,"5min":0.57499999999999996,"15min":0.91000000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.70599999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.40400000000000003},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.63200000000000001,"15min":0.93899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42599999999999999},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.27500000000000002},"max":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":1.1859999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77600000000000002,"5min":0.92900000000000005,"15min":1.964},"last":0.443}]},{"osd":5,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83999999999999997,"5min":0.91100000000000003,"15min":1.1040000000000001},"last":0.499},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":1.0029999999999999,"15min":1.022},"last":0.39800000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.89000000000000001,"15min":1.121},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76400000000000001,"5min":0.91000000000000003,"15min":1.879},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.85499999999999998,"5min":0.90100000000000002,"15min":1.5800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.437},"max":{"1min":0.84399999999999997,"5min":0.93899999999999995,"15min":1.6919999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.48799999999999999,"5min":0.53700000000000003,"15min":0.59999999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.378},"min":{"1min":0.31,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52500000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.377}]},{"osd":2,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27800000000000002,"15min":0.215},"max":{"1min":0.55700000000000005,"5min":0.63200000000000001,"15min":0.68600000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.36899999999999999},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.499}]},{"osd":3,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.39300000000000002},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.502,"5min":0.628,"15min":0.628},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46300000000000002,"15min":0.439},"min":{"1min":0.34999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.44600000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.49099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47399999999999998,"5min":0.41699999999999998,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.88100000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.86099999999999999,"15min":0.86899999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.61199999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.29299999999999998,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.54500000000000004,"5min":0.61799999999999999,"15min":0.62},"last":0.245}]},{"osd":1,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38500000000000001,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.20699999999999999},"max":{"1min":0.502,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.317},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.22500000000000001},"max":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.28599999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.41999999999999998},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.63700000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.40300000000000002},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.748,"15min":0.748},"last":0.29499999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.42499999999999999,"15min":0.32100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96599999999999997},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.436},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.624},"min":{"1min":0.46100000000000002,"5min":0.41199999999999998,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.312},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55100000000000005}]},{"osd":7,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.998},"last":0.504},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.5,"5min":0.48199999999999998,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.98599999999999999,"15min":0.999},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":696320,"data_stored":339983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36699999999999999,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.68100000000000005},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.5,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.41499999999999998},"min":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.66900000000000004},"last":0.30099999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.39000000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.438},"min":{"1min":0.34499999999999997,"5min":0.311,"15min":0.30599999999999999},"max":{"1min":0.57799999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.372}]},{"osd":4,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.024},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.498,"5min":0.39900000000000002,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0620000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.995,"15min":0.995},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.42299999999999999},"max":{"1min":0.79700000000000004,"5min":0.95599999999999996,"15min":1.018},"last":0.497},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.621},"min":{"1min":0.47899999999999998,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.042},"last":0.47799999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65800000000000003,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.73399999999999999,"5min":0.98699999999999999,"15min":1.006},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":1.121,"15min":1.121},"last":0.434}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":708608,"data_stored":346204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.76900000000000002},"last":0.379},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55100000000000005,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.30399999999999999},"max":{"1min":0.65000000000000002,"5min":0.80200000000000005,"15min":0.80500000000000005},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.77600000000000002,"15min":0.78100000000000003},"last":0.47999999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32900000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.443},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.75800000000000001,"15min":0.76200000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80000000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542304,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":708608,"data_stored":346204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.44}]},{"osd":1,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.315,"15min":0.249},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.31}]},{"osd":2,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.54900000000000004},"min":{"1min":0.433,"5min":0.41999999999999998,"15min":0.23899999999999999},"max":{"1min":0.77300000000000002,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.37}]},{"osd":3,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.34300000000000003},"max":{"1min":0.71399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.432,"15min":0.45100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.65700000000000003,"15min":0.71099999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48399999999999999,"15min":0.495},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":1.339,"15min":1.339},"last":0.502}]},{"osd":6,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.377,"5min":0.313,"15min":0.313},"max":{"1min":0.68400000000000005,"5min":0.74199999999999999,"15min":0.81999999999999995},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":1.421,"15min":1.421},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":1.772,"15min":1.772},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:41:59.096 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:41:59.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.239+0000 7f601359e700 1 Processor -- start 2023-10-24T00:41:59.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.239+0000 7f601359e700 1 -- start start 2023-10-24T00:41:59.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601359e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60140beb90 0x7f601415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601359e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140c7510 con 0x7f6014153d40 2023-10-24T00:41:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140c89b0 con 0x7f6014154120 2023-10-24T00:41:59.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601359e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140a8470 con 0x7f60140beb90 2023-10-24T00:41:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6012d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60140beb90 0x7f601415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601259c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6014153d40 0x7f6014064cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39918/0 (socket says 172.21.15.148:39918) 2023-10-24T00:41:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f601259c700 1 -- 172.21.15.148:0/1514043201 learned_addr learned my addr 172.21.15.148:0/1514043201 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:41:59.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6012d9d700 1 -- 172.21.15.148:0/1514043201 >> v1:172.21.15.150:6789/0 conn(0x7f6014154120 legacy=0x7f60140be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6012d9d700 1 -- 172.21.15.148:0/1514043201 >> v1:172.21.15.148:6789/0 conn(0x7f6014153d40 legacy=0x7f6014064cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6011d9b700 1 -- 172.21.15.148:0/1514043201 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469334841 0 0) 0x7f60140c7510 con 0x7f6014153d40 2023-10-24T00:41:59.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6012d9d700 1 -- 172.21.15.148:0/1514043201 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014065820 con 0x7f60140beb90 2023-10-24T00:41:59.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.240+0000 7f6012d9d700 1 --2- 172.21.15.148:0/1514043201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60140beb90 0x7f601415ef80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f600c009e60 tx=0x7f600c009780).ready entity=mon.0 client_cookie=bccddfa06cf494c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f6011d9b700 1 -- 172.21.15.148:0/1514043201 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00e070 con 0x7f60140beb90 2023-10-24T00:41:59.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f6011d9b700 1 -- 172.21.15.148:0/1514043201 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00bc30 con 0x7f60140beb90 2023-10-24T00:41:59.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f6011d9b700 1 -- 172.21.15.148:0/1514043201 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c012410 con 0x7f60140beb90 2023-10-24T00:41:59.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 -- 172.21.15.148:0/1514043201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60140beb90 msgr2=0x7f601415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 --2- 172.21.15.148:0/1514043201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60140beb90 0x7f601415ef80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f600c009e60 tx=0x7f600c009780).stop 2023-10-24T00:41:59.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 -- 172.21.15.148:0/1514043201 shutdown_connections 2023-10-24T00:41:59.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 --2- 172.21.15.148:0/1514043201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60140beb90 0x7f601415ef80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 -- 172.21.15.148:0/1514043201 >> 172.21.15.148:0/1514043201 conn(0x7f60140922e0 msgr2=0x7f6014062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 -- 172.21.15.148:0/1514043201 shutdown_connections 2023-10-24T00:41:59.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.241+0000 7f601359e700 1 -- 172.21.15.148:0/1514043201 wait complete. 2023-10-24T00:41:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.242+0000 7f601359e700 1 Processor -- start 2023-10-24T00:41:59.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.242+0000 7f601359e700 1 -- start start 2023-10-24T00:41:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 0x7f60140ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 0x7f60140aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140abbd0 con 0x7f6014154120 2023-10-24T00:41:59.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140ac470 con 0x7f6014153d40 2023-10-24T00:41:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140aae30 con 0x7f60140beb90 2023-10-24T00:41:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35316/0 (socket says 172.21.15.148:35316) 2023-10-24T00:41:59.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 -- 172.21.15.148:0/4050015149 learned_addr learned my addr 172.21.15.148:0/4050015149 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:59.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f601259c700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 0x7f60140ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6009d9b700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 0x7f60140aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 -- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 msgr2=0x7f60140ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 0x7f60140ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 -- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 msgr2=0x7f60140aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 0x7f60140aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.243+0000 7f6012d9d700 1 -- 172.21.15.148:0/4050015149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c009a20 con 0x7f6014154120 2023-10-24T00:41:59.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f601259c700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 0x7f60140ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:59.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f6009d9b700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 0x7f60140aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:59.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f6012d9d700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f600c00b6c0 tx=0x7f600c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00b6f0 con 0x7f6014154120 2023-10-24T00:41:59.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c013e00 con 0x7f6014154120 2023-10-24T00:41:59.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60140ab0f0 con 0x7f6014154120 2023-10-24T00:41:59.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c006ae0 con 0x7f6014154120 2023-10-24T00:41:59.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.244+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60140ac100 con 0x7f6014154120 2023-10-24T00:41:59.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.245+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60140ac600 con 0x7f6014154120 2023-10-24T00:41:59.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.245+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f600c01d630 con 0x7f6014154120 2023-10-24T00:41:59.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.245+0000 7f600affd700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 0x7f5ff4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.246+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f600c07c870 con 0x7f6014154120 2023-10-24T00:41:59.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.246+0000 7f601259c700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 0x7f5ff4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.246+0000 7f601259c700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 0x7f5ff4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6004000c00 tx=0x7f6004009040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.250+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f600c04db40 con 0x7f6014154120 2023-10-24T00:41:59.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.408+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6014047480 con 0x7f5ff405f150 2023-10-24T00:41:59.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.418+0000 7f600affd700 1 -- 172.21.15.148:0/4050015149 <== mgr.5377 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361620 (secure 0 0 0) 0x7f6014047480 con 0x7f5ff405f150 2023-10-24T00:41:59.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:41:59.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 msgr2=0x7f5ff4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 0x7f5ff4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6004000c00 tx=0x7f6004009040).stop 2023-10-24T00:41:59.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 msgr2=0x7f60140ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f600c00b6c0 tx=0x7f600c009780).stop 2023-10-24T00:41:59.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 shutdown_connections 2023-10-24T00:41:59.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ff405f150 0x7f5ff4061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6014154120 0x7f60140ac900 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60140beb90 0x7f60140ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 --2- 172.21.15.148:0/4050015149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6014153d40 0x7f60140aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 >> 172.21.15.148:0/4050015149 conn(0x7f60140922e0 msgr2=0x7f6014151350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 shutdown_connections 2023-10-24T00:41:59.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.422+0000 7f601359e700 1 -- 172.21.15.148:0/4050015149 wait complete. 2023-10-24T00:41:59.430 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:41:59.436 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:41:59.375310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2407232,"kb_used_data":5888,"kb_used_omap":0,"kb_used_meta":2401280,"kb_avail":752567488,"statfs":{"total":773094113280,"available":770629107712,"internally_reserved":0,"allocated":6029312,"data_stored":2938740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458910720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16247759,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-748,"num_write_kb":-16798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.430494"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.484443+0000","last_change":"2023-10-24T00:41:55.477615+0000","last_active":"2023-10-24T00:41:55.484443+0000","last_peered":"2023-10-24T00:41:55.484443+0000","last_clean":"2023-10-24T00:41:55.484443+0000","last_became_active":"2023-10-24T00:41:55.477177+0000","last_became_peered":"2023-10-24T00:41:55.477177+0000","last_unstale":"2023-10-24T00:41:55.484443+0000","last_undegraded":"2023-10-24T00:41:55.484443+0000","last_fullsized":"2023-10-24T00:41:55.484443+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.492081+0000","last_change":"2023-10-24T00:41:55.113275+0000","last_active":"2023-10-24T00:41:55.492081+0000","last_peered":"2023-10-24T00:41:55.492081+0000","last_clean":"2023-10-24T00:41:55.492081+0000","last_became_active":"2023-10-24T00:41:55.113035+0000","last_became_peered":"2023-10-24T00:41:55.113035+0000","last_unstale":"2023-10-24T00:41:55.492081+0000","last_undegraded":"2023-10-24T00:41:55.492081+0000","last_fullsized":"2023-10-24T00:41:55.492081+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.494058+0000","last_change":"2023-10-24T00:41:55.492641+0000","last_active":"2023-10-24T00:41:55.494058+0000","last_peered":"2023-10-24T00:41:55.494058+0000","last_clean":"2023-10-24T00:41:55.494058+0000","last_became_active":"2023-10-24T00:41:55.492403+0000","last_became_peered":"2023-10-24T00:41:55.492403+0000","last_unstale":"2023-10-24T00:41:55.494058+0000","last_undegraded":"2023-10-24T00:41:55.494058+0000","last_fullsized":"2023-10-24T00:41:55.494058+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.483887+0000","last_change":"2023-10-24T00:41:55.123270+0000","last_active":"2023-10-24T00:41:55.483887+0000","last_peered":"2023-10-24T00:41:55.483887+0000","last_clean":"2023-10-24T00:41:55.483887+0000","last_became_active":"2023-10-24T00:41:55.122953+0000","last_became_peered":"2023-10-24T00:41:55.122953+0000","last_unstale":"2023-10-24T00:41:55.483887+0000","last_undegraded":"2023-10-24T00:41:55.483887+0000","last_fullsized":"2023-10-24T00:41:55.483887+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497472+0000","last_change":"2023-10-24T00:41:55.489450+0000","last_active":"2023-10-24T00:41:55.497472+0000","last_peered":"2023-10-24T00:41:55.497472+0000","last_clean":"2023-10-24T00:41:55.497472+0000","last_became_active":"2023-10-24T00:41:55.489182+0000","last_became_peered":"2023-10-24T00:41:55.489182+0000","last_unstale":"2023-10-24T00:41:55.497472+0000","last_undegraded":"2023-10-24T00:41:55.497472+0000","last_fullsized":"2023-10-24T00:41:55.497472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472734+0000","last_change":"2023-10-24T00:41:55.110061+0000","last_active":"2023-10-24T00:41:55.472734+0000","last_peered":"2023-10-24T00:41:55.472734+0000","last_clean":"2023-10-24T00:41:55.472734+0000","last_became_active":"2023-10-24T00:41:55.107467+0000","last_became_peered":"2023-10-24T00:41:55.107467+0000","last_unstale":"2023-10-24T00:41:55.472734+0000","last_undegraded":"2023-10-24T00:41:55.472734+0000","last_fullsized":"2023-10-24T00:41:55.472734+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.489716+0000","last_change":"2023-10-24T00:41:55.484652+0000","last_active":"2023-10-24T00:41:55.489716+0000","last_peered":"2023-10-24T00:41:55.489716+0000","last_clean":"2023-10-24T00:41:55.489716+0000","last_became_active":"2023-10-24T00:41:55.484331+0000","last_became_peered":"2023-10-24T00:41:55.484331+0000","last_unstale":"2023-10-24T00:41:55.489716+0000","last_undegraded":"2023-10-24T00:41:55.489716+0000","last_fullsized":"2023-10-24T00:41:55.489716+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500400+0000","last_change":"2023-10-24T00:41:55.121216+0000","last_active":"2023-10-24T00:41:55.500400+0000","last_peered":"2023-10-24T00:41:55.500400+0000","last_clean":"2023-10-24T00:41:55.500400+0000","last_became_active":"2023-10-24T00:41:55.121007+0000","last_became_peered":"2023-10-24T00:41:55.121007+0000","last_unstale":"2023-10-24T00:41:55.500400+0000","last_undegraded":"2023-10-24T00:41:55.500400+0000","last_fullsized":"2023-10-24T00:41:55.500400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.495136+0000","last_change":"2023-10-24T00:41:55.491665+0000","last_active":"2023-10-24T00:41:55.495136+0000","last_peered":"2023-10-24T00:41:55.495136+0000","last_clean":"2023-10-24T00:41:55.495136+0000","last_became_active":"2023-10-24T00:41:55.490822+0000","last_became_peered":"2023-10-24T00:41:55.490822+0000","last_unstale":"2023-10-24T00:41:55.495136+0000","last_undegraded":"2023-10-24T00:41:55.495136+0000","last_fullsized":"2023-10-24T00:41:55.495136+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499958+0000","last_change":"2023-10-24T00:41:55.123262+0000","last_active":"2023-10-24T00:41:55.499958+0000","last_peered":"2023-10-24T00:41:55.499958+0000","last_clean":"2023-10-24T00:41:55.499958+0000","last_became_active":"2023-10-24T00:41:55.122922+0000","last_became_peered":"2023-10-24T00:41:55.122922+0000","last_unstale":"2023-10-24T00:41:55.499958+0000","last_undegraded":"2023-10-24T00:41:55.499958+0000","last_fullsized":"2023-10-24T00:41:55.499958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485373+0000","last_change":"2023-10-24T00:41:55.482423+0000","last_active":"2023-10-24T00:41:55.485373+0000","last_peered":"2023-10-24T00:41:55.485373+0000","last_clean":"2023-10-24T00:41:55.485373+0000","last_became_active":"2023-10-24T00:41:55.482114+0000","last_became_peered":"2023-10-24T00:41:55.482114+0000","last_unstale":"2023-10-24T00:41:55.485373+0000","last_undegraded":"2023-10-24T00:41:55.485373+0000","last_fullsized":"2023-10-24T00:41:55.485373+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.493859+0000","last_change":"2023-10-24T00:41:55.107967+0000","last_active":"2023-10-24T00:41:55.493859+0000","last_peered":"2023-10-24T00:41:55.493859+0000","last_clean":"2023-10-24T00:41:55.493859+0000","last_became_active":"2023-10-24T00:41:55.107659+0000","last_became_peered":"2023-10-24T00:41:55.107659+0000","last_unstale":"2023-10-24T00:41:55.493859+0000","last_undegraded":"2023-10-24T00:41:55.493859+0000","last_fullsized":"2023-10-24T00:41:55.493859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487609+0000","last_change":"2023-10-24T00:41:55.481887+0000","last_active":"2023-10-24T00:41:55.487609+0000","last_peered":"2023-10-24T00:41:55.487609+0000","last_clean":"2023-10-24T00:41:55.487609+0000","last_became_active":"2023-10-24T00:41:55.481639+0000","last_became_peered":"2023-10-24T00:41:55.481639+0000","last_unstale":"2023-10-24T00:41:55.487609+0000","last_undegraded":"2023-10-24T00:41:55.487609+0000","last_fullsized":"2023-10-24T00:41:55.487609+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473811+0000","last_change":"2023-10-24T00:41:55.113469+0000","last_active":"2023-10-24T00:41:55.473811+0000","last_peered":"2023-10-24T00:41:55.473811+0000","last_clean":"2023-10-24T00:41:55.473811+0000","last_became_active":"2023-10-24T00:41:55.112947+0000","last_became_peered":"2023-10-24T00:41:55.112947+0000","last_unstale":"2023-10-24T00:41:55.473811+0000","last_undegraded":"2023-10-24T00:41:55.473811+0000","last_fullsized":"2023-10-24T00:41:55.473811+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.501560+0000","last_change":"2023-10-24T00:41:55.498552+0000","last_active":"2023-10-24T00:41:55.501560+0000","last_peered":"2023-10-24T00:41:55.501560+0000","last_clean":"2023-10-24T00:41:55.501560+0000","last_became_active":"2023-10-24T00:41:55.498275+0000","last_became_peered":"2023-10-24T00:41:55.498275+0000","last_unstale":"2023-10-24T00:41:55.501560+0000","last_undegraded":"2023-10-24T00:41:55.501560+0000","last_fullsized":"2023-10-24T00:41:55.501560+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486280+0000","last_change":"2023-10-24T00:41:55.121131+0000","last_active":"2023-10-24T00:41:55.486280+0000","last_peered":"2023-10-24T00:41:55.486280+0000","last_clean":"2023-10-24T00:41:55.486280+0000","last_became_active":"2023-10-24T00:41:55.120862+0000","last_became_peered":"2023-10-24T00:41:55.120862+0000","last_unstale":"2023-10-24T00:41:55.486280+0000","last_undegraded":"2023-10-24T00:41:55.486280+0000","last_fullsized":"2023-10-24T00:41:55.486280+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.501554+0000","last_change":"2023-10-24T00:41:55.497554+0000","last_active":"2023-10-24T00:41:55.501554+0000","last_peered":"2023-10-24T00:41:55.501554+0000","last_clean":"2023-10-24T00:41:55.501554+0000","last_became_active":"2023-10-24T00:41:55.497123+0000","last_became_peered":"2023-10-24T00:41:55.497123+0000","last_unstale":"2023-10-24T00:41:55.501554+0000","last_undegraded":"2023-10-24T00:41:55.501554+0000","last_fullsized":"2023-10-24T00:41:55.501554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.492874+0000","last_change":"2023-10-24T00:41:55.118205+0000","last_active":"2023-10-24T00:41:55.492874+0000","last_peered":"2023-10-24T00:41:55.492874+0000","last_clean":"2023-10-24T00:41:55.492874+0000","last_became_active":"2023-10-24T00:41:55.117921+0000","last_became_peered":"2023-10-24T00:41:55.117921+0000","last_unstale":"2023-10-24T00:41:55.492874+0000","last_undegraded":"2023-10-24T00:41:55.492874+0000","last_fullsized":"2023-10-24T00:41:55.492874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.495889+0000","last_change":"2023-10-24T00:41:55.489026+0000","last_active":"2023-10-24T00:41:55.495889+0000","last_peered":"2023-10-24T00:41:55.495889+0000","last_clean":"2023-10-24T00:41:55.495889+0000","last_became_active":"2023-10-24T00:41:55.488793+0000","last_became_peered":"2023-10-24T00:41:55.488793+0000","last_unstale":"2023-10-24T00:41:55.495889+0000","last_undegraded":"2023-10-24T00:41:55.495889+0000","last_fullsized":"2023-10-24T00:41:55.495889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.491645+0000","last_change":"2023-10-24T00:41:55.121842+0000","last_active":"2023-10-24T00:41:55.491645+0000","last_peered":"2023-10-24T00:41:55.491645+0000","last_clean":"2023-10-24T00:41:55.491645+0000","last_became_active":"2023-10-24T00:41:55.121617+0000","last_became_peered":"2023-10-24T00:41:55.121617+0000","last_unstale":"2023-10-24T00:41:55.491645+0000","last_undegraded":"2023-10-24T00:41:55.491645+0000","last_fullsized":"2023-10-24T00:41:55.491645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490681+0000","last_change":"2023-10-24T00:41:55.478952+0000","last_active":"2023-10-24T00:41:55.490681+0000","last_peered":"2023-10-24T00:41:55.490681+0000","last_clean":"2023-10-24T00:41:55.490681+0000","last_became_active":"2023-10-24T00:41:55.478695+0000","last_became_peered":"2023-10-24T00:41:55.478695+0000","last_unstale":"2023-10-24T00:41:55.490681+0000","last_undegraded":"2023-10-24T00:41:55.490681+0000","last_fullsized":"2023-10-24T00:41:55.490681+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487486+0000","last_change":"2023-10-24T00:41:55.123852+0000","last_active":"2023-10-24T00:41:55.487486+0000","last_peered":"2023-10-24T00:41:55.487486+0000","last_clean":"2023-10-24T00:41:55.487486+0000","last_became_active":"2023-10-24T00:41:55.123574+0000","last_became_peered":"2023-10-24T00:41:55.123574+0000","last_unstale":"2023-10-24T00:41:55.487486+0000","last_undegraded":"2023-10-24T00:41:55.487486+0000","last_fullsized":"2023-10-24T00:41:55.487486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.491723+0000","last_change":"2023-10-24T00:41:55.477342+0000","last_active":"2023-10-24T00:41:55.491723+0000","last_peered":"2023-10-24T00:41:55.491723+0000","last_clean":"2023-10-24T00:41:55.491723+0000","last_became_active":"2023-10-24T00:41:55.477069+0000","last_became_peered":"2023-10-24T00:41:55.477069+0000","last_unstale":"2023-10-24T00:41:55.491723+0000","last_undegraded":"2023-10-24T00:41:55.491723+0000","last_fullsized":"2023-10-24T00:41:55.491723+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.504900+0000","last_change":"2023-10-24T00:41:55.112482+0000","last_active":"2023-10-24T00:41:55.504900+0000","last_peered":"2023-10-24T00:41:55.504900+0000","last_clean":"2023-10-24T00:41:55.504900+0000","last_became_active":"2023-10-24T00:41:55.112061+0000","last_became_peered":"2023-10-24T00:41:55.112061+0000","last_unstale":"2023-10-24T00:41:55.504900+0000","last_undegraded":"2023-10-24T00:41:55.504900+0000","last_fullsized":"2023-10-24T00:41:55.504900+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.484983+0000","last_change":"2023-10-24T00:41:55.483957+0000","last_active":"2023-10-24T00:41:55.484983+0000","last_peered":"2023-10-24T00:41:55.484983+0000","last_clean":"2023-10-24T00:41:55.484983+0000","last_became_active":"2023-10-24T00:41:55.483693+0000","last_became_peered":"2023-10-24T00:41:55.483693+0000","last_unstale":"2023-10-24T00:41:55.484983+0000","last_undegraded":"2023-10-24T00:41:55.484983+0000","last_fullsized":"2023-10-24T00:41:55.484983+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486979+0000","last_change":"2023-10-24T00:41:55.112554+0000","last_active":"2023-10-24T00:41:55.486979+0000","last_peered":"2023-10-24T00:41:55.486979+0000","last_clean":"2023-10-24T00:41:55.486979+0000","last_became_active":"2023-10-24T00:41:55.111761+0000","last_became_peered":"2023-10-24T00:41:55.111761+0000","last_unstale":"2023-10-24T00:41:55.486979+0000","last_undegraded":"2023-10-24T00:41:55.486979+0000","last_fullsized":"2023-10-24T00:41:55.486979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496373+0000","last_change":"2023-10-24T00:41:55.487192+0000","last_active":"2023-10-24T00:41:55.496373+0000","last_peered":"2023-10-24T00:41:55.496373+0000","last_clean":"2023-10-24T00:41:55.496373+0000","last_became_active":"2023-10-24T00:41:55.486502+0000","last_became_peered":"2023-10-24T00:41:55.486502+0000","last_unstale":"2023-10-24T00:41:55.496373+0000","last_undegraded":"2023-10-24T00:41:55.496373+0000","last_fullsized":"2023-10-24T00:41:55.496373+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486510+0000","last_change":"2023-10-24T00:41:55.116906+0000","last_active":"2023-10-24T00:41:55.486510+0000","last_peered":"2023-10-24T00:41:55.486510+0000","last_clean":"2023-10-24T00:41:55.486510+0000","last_became_active":"2023-10-24T00:41:55.116583+0000","last_became_peered":"2023-10-24T00:41:55.116583+0000","last_unstale":"2023-10-24T00:41:55.486510+0000","last_undegraded":"2023-10-24T00:41:55.486510+0000","last_fullsized":"2023-10-24T00:41:55.486510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490383+0000","last_change":"2023-10-24T00:41:55.489199+0000","last_active":"2023-10-24T00:41:55.490383+0000","last_peered":"2023-10-24T00:41:55.490383+0000","last_clean":"2023-10-24T00:41:55.490383+0000","last_became_active":"2023-10-24T00:41:55.488831+0000","last_became_peered":"2023-10-24T00:41:55.488831+0000","last_unstale":"2023-10-24T00:41:55.490383+0000","last_undegraded":"2023-10-24T00:41:55.490383+0000","last_fullsized":"2023-10-24T00:41:55.490383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487665+0000","last_change":"2023-10-24T00:41:55.108368+0000","last_active":"2023-10-24T00:41:55.487665+0000","last_peered":"2023-10-24T00:41:55.487665+0000","last_clean":"2023-10-24T00:41:55.487665+0000","last_became_active":"2023-10-24T00:41:55.108112+0000","last_became_peered":"2023-10-24T00:41:55.108112+0000","last_unstale":"2023-10-24T00:41:55.487665+0000","last_undegraded":"2023-10-24T00:41:55.487665+0000","last_fullsized":"2023-10-24T00:41:55.487665+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.489767+0000","last_change":"2023-10-24T00:41:55.484844+0000","last_active":"2023-10-24T00:41:55.489767+0000","last_peered":"2023-10-24T00:41:55.489767+0000","last_clean":"2023-10-24T00:41:55.489767+0000","last_became_active":"2023-10-24T00:41:55.484526+0000","last_became_peered":"2023-10-24T00:41:55.484526+0000","last_unstale":"2023-10-24T00:41:55.489767+0000","last_undegraded":"2023-10-24T00:41:55.489767+0000","last_fullsized":"2023-10-24T00:41:55.489767+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497260+0000","last_change":"2023-10-24T00:41:55.119146+0000","last_active":"2023-10-24T00:41:55.497260+0000","last_peered":"2023-10-24T00:41:55.497260+0000","last_clean":"2023-10-24T00:41:55.497260+0000","last_became_active":"2023-10-24T00:41:55.118777+0000","last_became_peered":"2023-10-24T00:41:55.118777+0000","last_unstale":"2023-10-24T00:41:55.497260+0000","last_undegraded":"2023-10-24T00:41:55.497260+0000","last_fullsized":"2023-10-24T00:41:55.497260+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.494453+0000","last_change":"2023-10-24T00:41:55.492800+0000","last_active":"2023-10-24T00:41:55.494453+0000","last_peered":"2023-10-24T00:41:55.494453+0000","last_clean":"2023-10-24T00:41:55.494453+0000","last_became_active":"2023-10-24T00:41:55.492438+0000","last_became_peered":"2023-10-24T00:41:55.492438+0000","last_unstale":"2023-10-24T00:41:55.494453+0000","last_undegraded":"2023-10-24T00:41:55.494453+0000","last_fullsized":"2023-10-24T00:41:55.494453+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473116+0000","last_change":"2023-10-24T00:41:55.111391+0000","last_active":"2023-10-24T00:41:55.473116+0000","last_peered":"2023-10-24T00:41:55.473116+0000","last_clean":"2023-10-24T00:41:55.473116+0000","last_became_active":"2023-10-24T00:41:55.111107+0000","last_became_peered":"2023-10-24T00:41:55.111107+0000","last_unstale":"2023-10-24T00:41:55.473116+0000","last_undegraded":"2023-10-24T00:41:55.473116+0000","last_fullsized":"2023-10-24T00:41:55.473116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.498760+0000","last_change":"2023-10-24T00:41:55.496971+0000","last_active":"2023-10-24T00:41:55.498760+0000","last_peered":"2023-10-24T00:41:55.498760+0000","last_clean":"2023-10-24T00:41:55.498760+0000","last_became_active":"2023-10-24T00:41:55.496711+0000","last_became_peered":"2023-10-24T00:41:55.496711+0000","last_unstale":"2023-10-24T00:41:55.498760+0000","last_undegraded":"2023-10-24T00:41:55.498760+0000","last_fullsized":"2023-10-24T00:41:55.498760+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472532+0000","last_change":"2023-10-24T00:41:55.117072+0000","last_active":"2023-10-24T00:41:55.472532+0000","last_peered":"2023-10-24T00:41:55.472532+0000","last_clean":"2023-10-24T00:41:55.472532+0000","last_became_active":"2023-10-24T00:41:55.116463+0000","last_became_peered":"2023-10-24T00:41:55.116463+0000","last_unstale":"2023-10-24T00:41:55.472532+0000","last_undegraded":"2023-10-24T00:41:55.472532+0000","last_fullsized":"2023-10-24T00:41:55.472532+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.482664+0000","last_change":"2023-10-24T00:41:55.481467+0000","last_active":"2023-10-24T00:41:55.482664+0000","last_peered":"2023-10-24T00:41:55.482664+0000","last_clean":"2023-10-24T00:41:55.482664+0000","last_became_active":"2023-10-24T00:41:55.481071+0000","last_became_peered":"2023-10-24T00:41:55.481071+0000","last_unstale":"2023-10-24T00:41:55.482664+0000","last_undegraded":"2023-10-24T00:41:55.482664+0000","last_fullsized":"2023-10-24T00:41:55.482664+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500229+0000","last_change":"2023-10-24T00:41:55.123365+0000","last_active":"2023-10-24T00:41:55.500229+0000","last_peered":"2023-10-24T00:41:55.500229+0000","last_clean":"2023-10-24T00:41:55.500229+0000","last_became_active":"2023-10-24T00:41:55.123109+0000","last_became_peered":"2023-10-24T00:41:55.123109+0000","last_unstale":"2023-10-24T00:41:55.500229+0000","last_undegraded":"2023-10-24T00:41:55.500229+0000","last_fullsized":"2023-10-24T00:41:55.500229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497608+0000","last_change":"2023-10-24T00:41:55.492797+0000","last_active":"2023-10-24T00:41:55.497608+0000","last_peered":"2023-10-24T00:41:55.497608+0000","last_clean":"2023-10-24T00:41:55.497608+0000","last_became_active":"2023-10-24T00:41:55.492476+0000","last_became_peered":"2023-10-24T00:41:55.492476+0000","last_unstale":"2023-10-24T00:41:55.497608+0000","last_undegraded":"2023-10-24T00:41:55.497608+0000","last_fullsized":"2023-10-24T00:41:55.497608+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.476828+0000","last_change":"2023-10-24T00:41:55.116347+0000","last_active":"2023-10-24T00:41:55.476828+0000","last_peered":"2023-10-24T00:41:55.476828+0000","last_clean":"2023-10-24T00:41:55.476828+0000","last_became_active":"2023-10-24T00:41:55.116088+0000","last_became_peered":"2023-10-24T00:41:55.116088+0000","last_unstale":"2023-10-24T00:41:55.476828+0000","last_undegraded":"2023-10-24T00:41:55.476828+0000","last_fullsized":"2023-10-24T00:41:55.476828+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499909+0000","last_change":"2023-10-24T00:41:55.489350+0000","last_active":"2023-10-24T00:41:55.499909+0000","last_peered":"2023-10-24T00:41:55.499909+0000","last_clean":"2023-10-24T00:41:55.499909+0000","last_became_active":"2023-10-24T00:41:55.489065+0000","last_became_peered":"2023-10-24T00:41:55.489065+0000","last_unstale":"2023-10-24T00:41:55.499909+0000","last_undegraded":"2023-10-24T00:41:55.499909+0000","last_fullsized":"2023-10-24T00:41:55.499909+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500301+0000","last_change":"2023-10-24T00:41:55.119584+0000","last_active":"2023-10-24T00:41:55.500301+0000","last_peered":"2023-10-24T00:41:55.500301+0000","last_clean":"2023-10-24T00:41:55.500301+0000","last_became_active":"2023-10-24T00:41:55.119290+0000","last_became_peered":"2023-10-24T00:41:55.119290+0000","last_unstale":"2023-10-24T00:41:55.500301+0000","last_undegraded":"2023-10-24T00:41:55.500301+0000","last_fullsized":"2023-10-24T00:41:55.500301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497441+0000","last_change":"2023-10-24T00:41:55.495734+0000","last_active":"2023-10-24T00:41:55.497441+0000","last_peered":"2023-10-24T00:41:55.497441+0000","last_clean":"2023-10-24T00:41:55.497441+0000","last_became_active":"2023-10-24T00:41:55.495355+0000","last_became_peered":"2023-10-24T00:41:55.495355+0000","last_unstale":"2023-10-24T00:41:55.497441+0000","last_undegraded":"2023-10-24T00:41:55.497441+0000","last_fullsized":"2023-10-24T00:41:55.497441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486411+0000","last_change":"2023-10-24T00:41:55.120773+0000","last_active":"2023-10-24T00:41:55.486411+0000","last_peered":"2023-10-24T00:41:55.486411+0000","last_clean":"2023-10-24T00:41:55.486411+0000","last_became_active":"2023-10-24T00:41:55.120548+0000","last_became_peered":"2023-10-24T00:41:55.120548+0000","last_unstale":"2023-10-24T00:41:55.486411+0000","last_undegraded":"2023-10-24T00:41:55.486411+0000","last_fullsized":"2023-10-24T00:41:55.486411+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499042+0000","last_change":"2023-10-24T00:41:55.495034+0000","last_active":"2023-10-24T00:41:55.499042+0000","last_peered":"2023-10-24T00:41:55.499042+0000","last_clean":"2023-10-24T00:41:55.499042+0000","last_became_active":"2023-10-24T00:41:55.491348+0000","last_became_peered":"2023-10-24T00:41:55.491348+0000","last_unstale":"2023-10-24T00:41:55.499042+0000","last_undegraded":"2023-10-24T00:41:55.499042+0000","last_fullsized":"2023-10-24T00:41:55.499042+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485226+0000","last_change":"2023-10-24T00:41:55.112741+0000","last_active":"2023-10-24T00:41:55.485226+0000","last_peered":"2023-10-24T00:41:55.485226+0000","last_clean":"2023-10-24T00:41:55.485226+0000","last_became_active":"2023-10-24T00:41:55.112305+0000","last_became_peered":"2023-10-24T00:41:55.112305+0000","last_unstale":"2023-10-24T00:41:55.485226+0000","last_undegraded":"2023-10-24T00:41:55.485226+0000","last_fullsized":"2023-10-24T00:41:55.485226+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.504438+0000","last_change":"2023-10-24T00:41:55.500426+0000","last_active":"2023-10-24T00:41:55.504438+0000","last_peered":"2023-10-24T00:41:55.504438+0000","last_clean":"2023-10-24T00:41:55.504438+0000","last_became_active":"2023-10-24T00:41:55.499993+0000","last_became_peered":"2023-10-24T00:41:55.499993+0000","last_unstale":"2023-10-24T00:41:55.504438+0000","last_undegraded":"2023-10-24T00:41:55.504438+0000","last_fullsized":"2023-10-24T00:41:55.504438+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.484459+0000","last_change":"2023-10-24T00:41:55.110356+0000","last_active":"2023-10-24T00:41:55.484459+0000","last_peered":"2023-10-24T00:41:55.484459+0000","last_clean":"2023-10-24T00:41:55.484459+0000","last_became_active":"2023-10-24T00:41:55.110056+0000","last_became_peered":"2023-10-24T00:41:55.110056+0000","last_unstale":"2023-10-24T00:41:55.484459+0000","last_undegraded":"2023-10-24T00:41:55.484459+0000","last_fullsized":"2023-10-24T00:41:55.484459+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.501817+0000","last_change":"2023-10-24T00:41:55.498809+0000","last_active":"2023-10-24T00:41:55.501817+0000","last_peered":"2023-10-24T00:41:55.501817+0000","last_clean":"2023-10-24T00:41:55.501817+0000","last_became_active":"2023-10-24T00:41:55.497063+0000","last_became_peered":"2023-10-24T00:41:55.497063+0000","last_unstale":"2023-10-24T00:41:55.501817+0000","last_undegraded":"2023-10-24T00:41:55.501817+0000","last_fullsized":"2023-10-24T00:41:55.501817+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486256+0000","last_change":"2023-10-24T00:41:55.117219+0000","last_active":"2023-10-24T00:41:55.486256+0000","last_peered":"2023-10-24T00:41:55.486256+0000","last_clean":"2023-10-24T00:41:55.486256+0000","last_became_active":"2023-10-24T00:41:55.116898+0000","last_became_peered":"2023-10-24T00:41:55.116898+0000","last_unstale":"2023-10-24T00:41:55.486256+0000","last_undegraded":"2023-10-24T00:41:55.486256+0000","last_fullsized":"2023-10-24T00:41:55.486256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485997+0000","last_change":"2023-10-24T00:41:55.482389+0000","last_active":"2023-10-24T00:41:55.485997+0000","last_peered":"2023-10-24T00:41:55.485997+0000","last_clean":"2023-10-24T00:41:55.485997+0000","last_became_active":"2023-10-24T00:41:55.482133+0000","last_became_peered":"2023-10-24T00:41:55.482133+0000","last_unstale":"2023-10-24T00:41:55.485997+0000","last_undegraded":"2023-10-24T00:41:55.485997+0000","last_fullsized":"2023-10-24T00:41:55.485997+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.988313+0000","last_change":"2023-10-24T00:41:55.112383+0000","last_active":"2023-10-24T00:41:55.988313+0000","last_peered":"2023-10-24T00:41:55.988313+0000","last_clean":"2023-10-24T00:41:55.988313+0000","last_became_active":"2023-10-24T00:41:55.112124+0000","last_became_peered":"2023-10-24T00:41:55.112124+0000","last_unstale":"2023-10-24T00:41:55.988313+0000","last_undegraded":"2023-10-24T00:41:55.988313+0000","last_fullsized":"2023-10-24T00:41:55.988313+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.501568+0000","last_change":"2023-10-24T00:41:55.497192+0000","last_active":"2023-10-24T00:41:55.501568+0000","last_peered":"2023-10-24T00:41:55.501568+0000","last_clean":"2023-10-24T00:41:55.501568+0000","last_became_active":"2023-10-24T00:41:55.496800+0000","last_became_peered":"2023-10-24T00:41:55.496800+0000","last_unstale":"2023-10-24T00:41:55.501568+0000","last_undegraded":"2023-10-24T00:41:55.501568+0000","last_fullsized":"2023-10-24T00:41:55.501568+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472839+0000","last_change":"2023-10-24T00:41:55.110478+0000","last_active":"2023-10-24T00:41:55.472839+0000","last_peered":"2023-10-24T00:41:55.472839+0000","last_clean":"2023-10-24T00:41:55.472839+0000","last_became_active":"2023-10-24T00:41:55.110191+0000","last_became_peered":"2023-10-24T00:41:55.110191+0000","last_unstale":"2023-10-24T00:41:55.472839+0000","last_undegraded":"2023-10-24T00:41:55.472839+0000","last_fullsized":"2023-10-24T00:41:55.472839+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499941+0000","last_change":"2023-10-24T00:41:55.489437+0000","last_active":"2023-10-24T00:41:55.499941+0000","last_peered":"2023-10-24T00:41:55.499941+0000","last_clean":"2023-10-24T00:41:55.499941+0000","last_became_active":"2023-10-24T00:41:55.489104+0000","last_became_peered":"2023-10-24T00:41:55.489104+0000","last_unstale":"2023-10-24T00:41:55.499941+0000","last_undegraded":"2023-10-24T00:41:55.499941+0000","last_fullsized":"2023-10-24T00:41:55.499941+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.480963+0000","last_change":"2023-10-24T00:41:55.112327+0000","last_active":"2023-10-24T00:41:55.480963+0000","last_peered":"2023-10-24T00:41:55.480963+0000","last_clean":"2023-10-24T00:41:55.480963+0000","last_became_active":"2023-10-24T00:41:55.111712+0000","last_became_peered":"2023-10-24T00:41:55.111712+0000","last_unstale":"2023-10-24T00:41:55.480963+0000","last_undegraded":"2023-10-24T00:41:55.480963+0000","last_fullsized":"2023-10-24T00:41:55.480963+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500334+0000","last_change":"2023-10-24T00:41:55.494250+0000","last_active":"2023-10-24T00:41:55.500334+0000","last_peered":"2023-10-24T00:41:55.500334+0000","last_clean":"2023-10-24T00:41:55.500334+0000","last_became_active":"2023-10-24T00:41:55.493979+0000","last_became_peered":"2023-10-24T00:41:55.493979+0000","last_unstale":"2023-10-24T00:41:55.500334+0000","last_undegraded":"2023-10-24T00:41:55.500334+0000","last_fullsized":"2023-10-24T00:41:55.500334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485526+0000","last_change":"2023-10-24T00:41:55.114144+0000","last_active":"2023-10-24T00:41:55.485526+0000","last_peered":"2023-10-24T00:41:55.485526+0000","last_clean":"2023-10-24T00:41:55.485526+0000","last_became_active":"2023-10-24T00:41:55.113861+0000","last_became_peered":"2023-10-24T00:41:55.113861+0000","last_unstale":"2023-10-24T00:41:55.485526+0000","last_undegraded":"2023-10-24T00:41:55.485526+0000","last_fullsized":"2023-10-24T00:41:55.485526+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.498890+0000","last_change":"2023-10-24T00:41:55.493913+0000","last_active":"2023-10-24T00:41:55.498890+0000","last_peered":"2023-10-24T00:41:55.498890+0000","last_clean":"2023-10-24T00:41:55.498890+0000","last_became_active":"2023-10-24T00:41:55.493659+0000","last_became_peered":"2023-10-24T00:41:55.493659+0000","last_unstale":"2023-10-24T00:41:55.498890+0000","last_undegraded":"2023-10-24T00:41:55.498890+0000","last_fullsized":"2023-10-24T00:41:55.498890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.474560+0000","last_change":"2023-10-24T00:41:55.110217+0000","last_active":"2023-10-24T00:41:55.474560+0000","last_peered":"2023-10-24T00:41:55.474560+0000","last_clean":"2023-10-24T00:41:55.474560+0000","last_became_active":"2023-10-24T00:41:55.107560+0000","last_became_peered":"2023-10-24T00:41:55.107560+0000","last_unstale":"2023-10-24T00:41:55.474560+0000","last_undegraded":"2023-10-24T00:41:55.474560+0000","last_fullsized":"2023-10-24T00:41:55.474560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490362+0000","last_change":"2023-10-24T00:41:55.488925+0000","last_active":"2023-10-24T00:41:55.490362+0000","last_peered":"2023-10-24T00:41:55.490362+0000","last_clean":"2023-10-24T00:41:55.490362+0000","last_became_active":"2023-10-24T00:41:55.488554+0000","last_became_peered":"2023-10-24T00:41:55.488554+0000","last_unstale":"2023-10-24T00:41:55.490362+0000","last_undegraded":"2023-10-24T00:41:55.490362+0000","last_fullsized":"2023-10-24T00:41:55.490362+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487568+0000","last_change":"2023-10-24T00:41:55.110202+0000","last_active":"2023-10-24T00:41:55.487568+0000","last_peered":"2023-10-24T00:41:55.487568+0000","last_clean":"2023-10-24T00:41:55.487568+0000","last_became_active":"2023-10-24T00:41:55.109921+0000","last_became_peered":"2023-10-24T00:41:55.109921+0000","last_unstale":"2023-10-24T00:41:55.487568+0000","last_undegraded":"2023-10-24T00:41:55.487568+0000","last_fullsized":"2023-10-24T00:41:55.487568+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496908+0000","last_change":"2023-10-24T00:41:55.492096+0000","last_active":"2023-10-24T00:41:55.496908+0000","last_peered":"2023-10-24T00:41:55.496908+0000","last_clean":"2023-10-24T00:41:55.496908+0000","last_became_active":"2023-10-24T00:41:55.491875+0000","last_became_peered":"2023-10-24T00:41:55.491875+0000","last_unstale":"2023-10-24T00:41:55.496908+0000","last_undegraded":"2023-10-24T00:41:55.496908+0000","last_fullsized":"2023-10-24T00:41:55.496908+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.476503+0000","last_change":"2023-10-24T00:41:55.105641+0000","last_active":"2023-10-24T00:41:55.476503+0000","last_peered":"2023-10-24T00:41:55.476503+0000","last_clean":"2023-10-24T00:41:55.476503+0000","last_became_active":"2023-10-24T00:41:55.105347+0000","last_became_peered":"2023-10-24T00:41:55.105347+0000","last_unstale":"2023-10-24T00:41:55.476503+0000","last_undegraded":"2023-10-24T00:41:55.476503+0000","last_fullsized":"2023-10-24T00:41:55.476503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490644+0000","last_change":"2023-10-24T00:41:55.489470+0000","last_active":"2023-10-24T00:41:55.490644+0000","last_peered":"2023-10-24T00:41:55.490644+0000","last_clean":"2023-10-24T00:41:55.490644+0000","last_became_active":"2023-10-24T00:41:55.488774+0000","last_became_peered":"2023-10-24T00:41:55.488774+0000","last_unstale":"2023-10-24T00:41:55.490644+0000","last_undegraded":"2023-10-24T00:41:55.490644+0000","last_fullsized":"2023-10-24T00:41:55.490644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.494610+0000","last_change":"2023-10-24T00:41:55.115122+0000","last_active":"2023-10-24T00:41:55.494610+0000","last_peered":"2023-10-24T00:41:55.494610+0000","last_clean":"2023-10-24T00:41:55.494610+0000","last_became_active":"2023-10-24T00:41:55.114842+0000","last_became_peered":"2023-10-24T00:41:55.114842+0000","last_unstale":"2023-10-24T00:41:55.494610+0000","last_undegraded":"2023-10-24T00:41:55.494610+0000","last_fullsized":"2023-10-24T00:41:55.494610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.491792+0000","last_change":"2023-10-24T00:41:55.486870+0000","last_active":"2023-10-24T00:41:55.491792+0000","last_peered":"2023-10-24T00:41:55.491792+0000","last_clean":"2023-10-24T00:41:55.491792+0000","last_became_active":"2023-10-24T00:41:55.486549+0000","last_became_peered":"2023-10-24T00:41:55.486549+0000","last_unstale":"2023-10-24T00:41:55.491792+0000","last_undegraded":"2023-10-24T00:41:55.491792+0000","last_fullsized":"2023-10-24T00:41:55.491792+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490274+0000","last_change":"2023-10-24T00:41:55.110441+0000","last_active":"2023-10-24T00:41:55.490274+0000","last_peered":"2023-10-24T00:41:55.490274+0000","last_clean":"2023-10-24T00:41:55.490274+0000","last_became_active":"2023-10-24T00:41:55.110152+0000","last_became_peered":"2023-10-24T00:41:55.110152+0000","last_unstale":"2023-10-24T00:41:55.490274+0000","last_undegraded":"2023-10-24T00:41:55.490274+0000","last_fullsized":"2023-10-24T00:41:55.490274+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499822+0000","last_change":"2023-10-24T00:41:55.489248+0000","last_active":"2023-10-24T00:41:55.499822+0000","last_peered":"2023-10-24T00:41:55.499822+0000","last_clean":"2023-10-24T00:41:55.499822+0000","last_became_active":"2023-10-24T00:41:55.488965+0000","last_became_peered":"2023-10-24T00:41:55.488965+0000","last_unstale":"2023-10-24T00:41:55.499822+0000","last_undegraded":"2023-10-24T00:41:55.499822+0000","last_fullsized":"2023-10-24T00:41:55.499822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.494840+0000","last_change":"2023-10-24T00:41:55.115967+0000","last_active":"2023-10-24T00:41:55.494840+0000","last_peered":"2023-10-24T00:41:55.494840+0000","last_clean":"2023-10-24T00:41:55.494840+0000","last_became_active":"2023-10-24T00:41:55.115641+0000","last_became_peered":"2023-10-24T00:41:55.115641+0000","last_unstale":"2023-10-24T00:41:55.494840+0000","last_undegraded":"2023-10-24T00:41:55.494840+0000","last_fullsized":"2023-10-24T00:41:55.494840+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.489577+0000","last_change":"2023-10-24T00:41:55.483006+0000","last_active":"2023-10-24T00:41:55.489577+0000","last_peered":"2023-10-24T00:41:55.489577+0000","last_clean":"2023-10-24T00:41:55.489577+0000","last_became_active":"2023-10-24T00:41:55.482791+0000","last_became_peered":"2023-10-24T00:41:55.482791+0000","last_unstale":"2023-10-24T00:41:55.489577+0000","last_undegraded":"2023-10-24T00:41:55.489577+0000","last_fullsized":"2023-10-24T00:41:55.489577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.481122+0000","last_change":"2023-10-24T00:41:55.115944+0000","last_active":"2023-10-24T00:41:55.481122+0000","last_peered":"2023-10-24T00:41:55.481122+0000","last_clean":"2023-10-24T00:41:55.481122+0000","last_became_active":"2023-10-24T00:41:55.115603+0000","last_became_peered":"2023-10-24T00:41:55.115603+0000","last_unstale":"2023-10-24T00:41:55.481122+0000","last_undegraded":"2023-10-24T00:41:55.481122+0000","last_fullsized":"2023-10-24T00:41:55.481122+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496773+0000","last_change":"2023-10-24T00:41:55.494192+0000","last_active":"2023-10-24T00:41:55.496773+0000","last_peered":"2023-10-24T00:41:55.496773+0000","last_clean":"2023-10-24T00:41:55.496773+0000","last_became_active":"2023-10-24T00:41:55.493806+0000","last_became_peered":"2023-10-24T00:41:55.493806+0000","last_unstale":"2023-10-24T00:41:55.496773+0000","last_undegraded":"2023-10-24T00:41:55.496773+0000","last_fullsized":"2023-10-24T00:41:55.496773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485650+0000","last_change":"2023-10-24T00:41:55.118920+0000","last_active":"2023-10-24T00:41:55.485650+0000","last_peered":"2023-10-24T00:41:55.485650+0000","last_clean":"2023-10-24T00:41:55.485650+0000","last_became_active":"2023-10-24T00:41:55.118678+0000","last_became_peered":"2023-10-24T00:41:55.118678+0000","last_unstale":"2023-10-24T00:41:55.485650+0000","last_undegraded":"2023-10-24T00:41:55.485650+0000","last_fullsized":"2023-10-24T00:41:55.485650+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.482884+0000","last_change":"2023-10-24T00:41:55.481802+0000","last_active":"2023-10-24T00:41:55.482884+0000","last_peered":"2023-10-24T00:41:55.482884+0000","last_clean":"2023-10-24T00:41:55.482884+0000","last_became_active":"2023-10-24T00:41:55.481513+0000","last_became_peered":"2023-10-24T00:41:55.481513+0000","last_unstale":"2023-10-24T00:41:55.482884+0000","last_undegraded":"2023-10-24T00:41:55.482884+0000","last_fullsized":"2023-10-24T00:41:55.482884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.474511+0000","last_change":"2023-10-24T00:41:55.116034+0000","last_active":"2023-10-24T00:41:55.474511+0000","last_peered":"2023-10-24T00:41:55.474511+0000","last_clean":"2023-10-24T00:41:55.474511+0000","last_became_active":"2023-10-24T00:41:55.115742+0000","last_became_peered":"2023-10-24T00:41:55.115742+0000","last_unstale":"2023-10-24T00:41:55.474511+0000","last_undegraded":"2023-10-24T00:41:55.474511+0000","last_fullsized":"2023-10-24T00:41:55.474511+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.499064+0000","last_change":"2023-10-24T00:41:55.495191+0000","last_active":"2023-10-24T00:41:55.499064+0000","last_peered":"2023-10-24T00:41:55.499064+0000","last_clean":"2023-10-24T00:41:55.499064+0000","last_became_active":"2023-10-24T00:41:55.490933+0000","last_became_peered":"2023-10-24T00:41:55.490933+0000","last_unstale":"2023-10-24T00:41:55.499064+0000","last_undegraded":"2023-10-24T00:41:55.499064+0000","last_fullsized":"2023-10-24T00:41:55.499064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485324+0000","last_change":"2023-10-24T00:41:55.112560+0000","last_active":"2023-10-24T00:41:55.485324+0000","last_peered":"2023-10-24T00:41:55.485324+0000","last_clean":"2023-10-24T00:41:55.485324+0000","last_became_active":"2023-10-24T00:41:55.111975+0000","last_became_peered":"2023-10-24T00:41:55.111975+0000","last_unstale":"2023-10-24T00:41:55.485324+0000","last_undegraded":"2023-10-24T00:41:55.485324+0000","last_fullsized":"2023-10-24T00:41:55.485324+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500758+0000","last_change":"2023-10-24T00:41:55.500093+0000","last_active":"2023-10-24T00:41:55.500758+0000","last_peered":"2023-10-24T00:41:55.500758+0000","last_clean":"2023-10-24T00:41:55.500758+0000","last_became_active":"2023-10-24T00:41:55.499772+0000","last_became_peered":"2023-10-24T00:41:55.499772+0000","last_unstale":"2023-10-24T00:41:55.500758+0000","last_undegraded":"2023-10-24T00:41:55.500758+0000","last_fullsized":"2023-10-24T00:41:55.500758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486204+0000","last_change":"2023-10-24T00:41:55.120496+0000","last_active":"2023-10-24T00:41:55.486204+0000","last_peered":"2023-10-24T00:41:55.486204+0000","last_clean":"2023-10-24T00:41:55.486204+0000","last_became_active":"2023-10-24T00:41:55.120253+0000","last_became_peered":"2023-10-24T00:41:55.120253+0000","last_unstale":"2023-10-24T00:41:55.486204+0000","last_undegraded":"2023-10-24T00:41:55.486204+0000","last_fullsized":"2023-10-24T00:41:55.486204+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.492929+0000","last_change":"2023-10-24T00:41:55.491664+0000","last_active":"2023-10-24T00:41:55.492929+0000","last_peered":"2023-10-24T00:41:55.492929+0000","last_clean":"2023-10-24T00:41:55.492929+0000","last_became_active":"2023-10-24T00:41:55.491342+0000","last_became_peered":"2023-10-24T00:41:55.491342+0000","last_unstale":"2023-10-24T00:41:55.492929+0000","last_undegraded":"2023-10-24T00:41:55.492929+0000","last_fullsized":"2023-10-24T00:41:55.492929+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473179+0000","last_change":"2023-10-24T00:41:55.115157+0000","last_active":"2023-10-24T00:41:55.473179+0000","last_peered":"2023-10-24T00:41:55.473179+0000","last_clean":"2023-10-24T00:41:55.473179+0000","last_became_active":"2023-10-24T00:41:55.114854+0000","last_became_peered":"2023-10-24T00:41:55.114854+0000","last_unstale":"2023-10-24T00:41:55.473179+0000","last_undegraded":"2023-10-24T00:41:55.473179+0000","last_fullsized":"2023-10-24T00:41:55.473179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496919+0000","last_change":"2023-10-24T00:41:55.493546+0000","last_active":"2023-10-24T00:41:55.496919+0000","last_peered":"2023-10-24T00:41:55.496919+0000","last_clean":"2023-10-24T00:41:55.496919+0000","last_became_active":"2023-10-24T00:41:55.493259+0000","last_became_peered":"2023-10-24T00:41:55.493259+0000","last_unstale":"2023-10-24T00:41:55.496919+0000","last_undegraded":"2023-10-24T00:41:55.496919+0000","last_fullsized":"2023-10-24T00:41:55.496919+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472854+0000","last_change":"2023-10-24T00:41:55.117242+0000","last_active":"2023-10-24T00:41:55.472854+0000","last_peered":"2023-10-24T00:41:55.472854+0000","last_clean":"2023-10-24T00:41:55.472854+0000","last_became_active":"2023-10-24T00:41:55.116805+0000","last_became_peered":"2023-10-24T00:41:55.116805+0000","last_unstale":"2023-10-24T00:41:55.472854+0000","last_undegraded":"2023-10-24T00:41:55.472854+0000","last_fullsized":"2023-10-24T00:41:55.472854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.504461+0000","last_change":"2023-10-24T00:41:55.500613+0000","last_active":"2023-10-24T00:41:55.504461+0000","last_peered":"2023-10-24T00:41:55.504461+0000","last_clean":"2023-10-24T00:41:55.504461+0000","last_became_active":"2023-10-24T00:41:55.500349+0000","last_became_peered":"2023-10-24T00:41:55.500349+0000","last_unstale":"2023-10-24T00:41:55.504461+0000","last_undegraded":"2023-10-24T00:41:55.504461+0000","last_fullsized":"2023-10-24T00:41:55.504461+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490271+0000","last_change":"2023-10-24T00:41:55.113696+0000","last_active":"2023-10-24T00:41:55.490271+0000","last_peered":"2023-10-24T00:41:55.490271+0000","last_clean":"2023-10-24T00:41:55.490271+0000","last_became_active":"2023-10-24T00:41:55.113410+0000","last_became_peered":"2023-10-24T00:41:55.113410+0000","last_unstale":"2023-10-24T00:41:55.490271+0000","last_undegraded":"2023-10-24T00:41:55.490271+0000","last_fullsized":"2023-10-24T00:41:55.490271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.492190+0000","last_change":"2023-10-24T00:41:55.487324+0000","last_active":"2023-10-24T00:41:55.492190+0000","last_peered":"2023-10-24T00:41:55.492190+0000","last_clean":"2023-10-24T00:41:55.492190+0000","last_became_active":"2023-10-24T00:41:55.486990+0000","last_became_peered":"2023-10-24T00:41:55.486990+0000","last_unstale":"2023-10-24T00:41:55.492190+0000","last_undegraded":"2023-10-24T00:41:55.492190+0000","last_fullsized":"2023-10-24T00:41:55.492190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496825+0000","last_change":"2023-10-24T00:41:55.113816+0000","last_active":"2023-10-24T00:41:55.496825+0000","last_peered":"2023-10-24T00:41:55.496825+0000","last_clean":"2023-10-24T00:41:55.496825+0000","last_became_active":"2023-10-24T00:41:55.113458+0000","last_became_peered":"2023-10-24T00:41:55.113458+0000","last_unstale":"2023-10-24T00:41:55.496825+0000","last_undegraded":"2023-10-24T00:41:55.496825+0000","last_fullsized":"2023-10-24T00:41:55.496825+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.491848+0000","last_change":"2023-10-24T00:41:55.486643+0000","last_active":"2023-10-24T00:41:55.491848+0000","last_peered":"2023-10-24T00:41:55.491848+0000","last_clean":"2023-10-24T00:41:55.491848+0000","last_became_active":"2023-10-24T00:41:55.486346+0000","last_became_peered":"2023-10-24T00:41:55.486346+0000","last_unstale":"2023-10-24T00:41:55.491848+0000","last_undegraded":"2023-10-24T00:41:55.491848+0000","last_fullsized":"2023-10-24T00:41:55.491848+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497285+0000","last_change":"2023-10-24T00:41:55.114803+0000","last_active":"2023-10-24T00:41:55.497285+0000","last_peered":"2023-10-24T00:41:55.497285+0000","last_clean":"2023-10-24T00:41:55.497285+0000","last_became_active":"2023-10-24T00:41:55.114540+0000","last_became_peered":"2023-10-24T00:41:55.114540+0000","last_unstale":"2023-10-24T00:41:55.497285+0000","last_undegraded":"2023-10-24T00:41:55.497285+0000","last_fullsized":"2023-10-24T00:41:55.497285+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.504387+0000","last_change":"2023-10-24T00:41:55.499680+0000","last_active":"2023-10-24T00:41:55.504387+0000","last_peered":"2023-10-24T00:41:55.504387+0000","last_clean":"2023-10-24T00:41:55.504387+0000","last_became_active":"2023-10-24T00:41:55.499315+0000","last_became_peered":"2023-10-24T00:41:55.499315+0000","last_unstale":"2023-10-24T00:41:55.504387+0000","last_undegraded":"2023-10-24T00:41:55.504387+0000","last_fullsized":"2023-10-24T00:41:55.504387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485707+0000","last_change":"2023-10-24T00:41:55.119361+0000","last_active":"2023-10-24T00:41:55.485707+0000","last_peered":"2023-10-24T00:41:55.485707+0000","last_clean":"2023-10-24T00:41:55.485707+0000","last_became_active":"2023-10-24T00:41:55.119022+0000","last_became_peered":"2023-10-24T00:41:55.119022+0000","last_unstale":"2023-10-24T00:41:55.485707+0000","last_undegraded":"2023-10-24T00:41:55.485707+0000","last_fullsized":"2023-10-24T00:41:55.485707+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.488019+0000","last_change":"2023-10-24T00:41:55.483710+0000","last_active":"2023-10-24T00:41:55.488019+0000","last_peered":"2023-10-24T00:41:55.488019+0000","last_clean":"2023-10-24T00:41:55.488019+0000","last_became_active":"2023-10-24T00:41:55.483298+0000","last_became_peered":"2023-10-24T00:41:55.483298+0000","last_unstale":"2023-10-24T00:41:55.488019+0000","last_undegraded":"2023-10-24T00:41:55.488019+0000","last_fullsized":"2023-10-24T00:41:55.488019+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.474572+0000","last_change":"2023-10-24T00:41:55.117778+0000","last_active":"2023-10-24T00:41:55.474572+0000","last_peered":"2023-10-24T00:41:55.474572+0000","last_clean":"2023-10-24T00:41:55.474572+0000","last_became_active":"2023-10-24T00:41:55.117373+0000","last_became_peered":"2023-10-24T00:41:55.117373+0000","last_unstale":"2023-10-24T00:41:55.474572+0000","last_undegraded":"2023-10-24T00:41:55.474572+0000","last_fullsized":"2023-10-24T00:41:55.474572+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500542+0000","last_change":"2023-10-24T00:41:55.497066+0000","last_active":"2023-10-24T00:41:55.500542+0000","last_peered":"2023-10-24T00:41:55.500542+0000","last_clean":"2023-10-24T00:41:55.500542+0000","last_became_active":"2023-10-24T00:41:55.496695+0000","last_became_peered":"2023-10-24T00:41:55.496695+0000","last_unstale":"2023-10-24T00:41:55.500542+0000","last_undegraded":"2023-10-24T00:41:55.500542+0000","last_fullsized":"2023-10-24T00:41:55.500542+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496919+0000","last_change":"2023-10-24T00:41:55.112547+0000","last_active":"2023-10-24T00:41:55.496919+0000","last_peered":"2023-10-24T00:41:55.496919+0000","last_clean":"2023-10-24T00:41:55.496919+0000","last_became_active":"2023-10-24T00:41:55.112342+0000","last_became_peered":"2023-10-24T00:41:55.112342+0000","last_unstale":"2023-10-24T00:41:55.496919+0000","last_undegraded":"2023-10-24T00:41:55.496919+0000","last_fullsized":"2023-10-24T00:41:55.496919+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496038+0000","last_change":"2023-10-24T00:41:55.491647+0000","last_active":"2023-10-24T00:41:55.496038+0000","last_peered":"2023-10-24T00:41:55.496038+0000","last_clean":"2023-10-24T00:41:55.496038+0000","last_became_active":"2023-10-24T00:41:55.490922+0000","last_became_peered":"2023-10-24T00:41:55.490922+0000","last_unstale":"2023-10-24T00:41:55.496038+0000","last_undegraded":"2023-10-24T00:41:55.496038+0000","last_fullsized":"2023-10-24T00:41:55.496038+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.501815+0000","last_change":"2023-10-24T00:41:55.128248+0000","last_active":"2023-10-24T00:41:55.501815+0000","last_peered":"2023-10-24T00:41:55.501815+0000","last_clean":"2023-10-24T00:41:55.501815+0000","last_became_active":"2023-10-24T00:41:55.127927+0000","last_became_peered":"2023-10-24T00:41:55.127927+0000","last_unstale":"2023-10-24T00:41:55.501815+0000","last_undegraded":"2023-10-24T00:41:55.501815+0000","last_fullsized":"2023-10-24T00:41:55.501815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.504336+0000","last_change":"2023-10-24T00:41:55.499673+0000","last_active":"2023-10-24T00:41:55.504336+0000","last_peered":"2023-10-24T00:41:55.504336+0000","last_clean":"2023-10-24T00:41:55.504336+0000","last_became_active":"2023-10-24T00:41:55.499399+0000","last_became_peered":"2023-10-24T00:41:55.499399+0000","last_unstale":"2023-10-24T00:41:55.504336+0000","last_undegraded":"2023-10-24T00:41:55.504336+0000","last_fullsized":"2023-10-24T00:41:55.504336+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.493466+0000","last_change":"2023-10-24T00:41:55.108528+0000","last_active":"2023-10-24T00:41:55.493466+0000","last_peered":"2023-10-24T00:41:55.493466+0000","last_clean":"2023-10-24T00:41:55.493466+0000","last_became_active":"2023-10-24T00:41:55.108262+0000","last_became_peered":"2023-10-24T00:41:55.108262+0000","last_unstale":"2023-10-24T00:41:55.493466+0000","last_undegraded":"2023-10-24T00:41:55.493466+0000","last_fullsized":"2023-10-24T00:41:55.493466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497008+0000","last_change":"2023-10-24T00:41:55.496188+0000","last_active":"2023-10-24T00:41:55.497008+0000","last_peered":"2023-10-24T00:41:55.497008+0000","last_clean":"2023-10-24T00:41:55.497008+0000","last_became_active":"2023-10-24T00:41:55.495938+0000","last_became_peered":"2023-10-24T00:41:55.495938+0000","last_unstale":"2023-10-24T00:41:55.497008+0000","last_undegraded":"2023-10-24T00:41:55.497008+0000","last_fullsized":"2023-10-24T00:41:55.497008+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.485824+0000","last_change":"2023-10-24T00:41:55.113973+0000","last_active":"2023-10-24T00:41:55.485824+0000","last_peered":"2023-10-24T00:41:55.485824+0000","last_clean":"2023-10-24T00:41:55.485824+0000","last_became_active":"2023-10-24T00:41:55.113700+0000","last_became_peered":"2023-10-24T00:41:55.113700+0000","last_unstale":"2023-10-24T00:41:55.485824+0000","last_undegraded":"2023-10-24T00:41:55.485824+0000","last_fullsized":"2023-10-24T00:41:55.485824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.489735+0000","last_change":"2023-10-24T00:41:55.485220+0000","last_active":"2023-10-24T00:41:55.489735+0000","last_peered":"2023-10-24T00:41:55.489735+0000","last_clean":"2023-10-24T00:41:55.489735+0000","last_became_active":"2023-10-24T00:41:55.484977+0000","last_became_peered":"2023-10-24T00:41:55.484977+0000","last_unstale":"2023-10-24T00:41:55.489735+0000","last_undegraded":"2023-10-24T00:41:55.489735+0000","last_fullsized":"2023-10-24T00:41:55.489735+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.486027+0000","last_change":"2023-10-24T00:41:55.116088+0000","last_active":"2023-10-24T00:41:55.486027+0000","last_peered":"2023-10-24T00:41:55.486027+0000","last_clean":"2023-10-24T00:41:55.486027+0000","last_became_active":"2023-10-24T00:41:55.115826+0000","last_became_peered":"2023-10-24T00:41:55.115826+0000","last_unstale":"2023-10-24T00:41:55.486027+0000","last_undegraded":"2023-10-24T00:41:55.486027+0000","last_fullsized":"2023-10-24T00:41:55.486027+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496852+0000","last_change":"2023-10-24T00:41:55.494057+0000","last_active":"2023-10-24T00:41:55.496852+0000","last_peered":"2023-10-24T00:41:55.496852+0000","last_clean":"2023-10-24T00:41:55.496852+0000","last_became_active":"2023-10-24T00:41:55.493766+0000","last_became_peered":"2023-10-24T00:41:55.493766+0000","last_unstale":"2023-10-24T00:41:55.496852+0000","last_undegraded":"2023-10-24T00:41:55.496852+0000","last_fullsized":"2023-10-24T00:41:55.496852+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.495160+0000","last_change":"2023-10-24T00:41:55.112773+0000","last_active":"2023-10-24T00:41:55.495160+0000","last_peered":"2023-10-24T00:41:55.495160+0000","last_clean":"2023-10-24T00:41:55.495160+0000","last_became_active":"2023-10-24T00:41:55.112485+0000","last_became_peered":"2023-10-24T00:41:55.112485+0000","last_unstale":"2023-10-24T00:41:55.495160+0000","last_undegraded":"2023-10-24T00:41:55.495160+0000","last_fullsized":"2023-10-24T00:41:55.495160+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500288+0000","last_change":"2023-10-24T00:41:55.493853+0000","last_active":"2023-10-24T00:41:55.500288+0000","last_peered":"2023-10-24T00:41:55.500288+0000","last_clean":"2023-10-24T00:41:55.500288+0000","last_became_active":"2023-10-24T00:41:55.493492+0000","last_became_peered":"2023-10-24T00:41:55.493492+0000","last_unstale":"2023-10-24T00:41:55.500288+0000","last_undegraded":"2023-10-24T00:41:55.500288+0000","last_fullsized":"2023-10-24T00:41:55.500288+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487507+0000","last_change":"2023-10-24T00:41:55.116201+0000","last_active":"2023-10-24T00:41:55.487507+0000","last_peered":"2023-10-24T00:41:55.487507+0000","last_clean":"2023-10-24T00:41:55.487507+0000","last_became_active":"2023-10-24T00:41:55.115932+0000","last_became_peered":"2023-10-24T00:41:55.115932+0000","last_unstale":"2023-10-24T00:41:55.487507+0000","last_undegraded":"2023-10-24T00:41:55.487507+0000","last_fullsized":"2023-10-24T00:41:55.487507+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497579+0000","last_change":"2023-10-24T00:41:55.493005+0000","last_active":"2023-10-24T00:41:55.497579+0000","last_peered":"2023-10-24T00:41:55.497579+0000","last_clean":"2023-10-24T00:41:55.497579+0000","last_became_active":"2023-10-24T00:41:55.492554+0000","last_became_peered":"2023-10-24T00:41:55.492554+0000","last_unstale":"2023-10-24T00:41:55.497579+0000","last_undegraded":"2023-10-24T00:41:55.497579+0000","last_fullsized":"2023-10-24T00:41:55.497579+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487095+0000","last_change":"2023-10-24T00:41:55.117468+0000","last_active":"2023-10-24T00:41:55.487095+0000","last_peered":"2023-10-24T00:41:55.487095+0000","last_clean":"2023-10-24T00:41:55.487095+0000","last_became_active":"2023-10-24T00:41:55.117198+0000","last_became_peered":"2023-10-24T00:41:55.117198+0000","last_unstale":"2023-10-24T00:41:55.487095+0000","last_undegraded":"2023-10-24T00:41:55.487095+0000","last_fullsized":"2023-10-24T00:41:55.487095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.491105+0000","last_change":"2023-10-24T00:41:55.487083+0000","last_active":"2023-10-24T00:41:55.491105+0000","last_peered":"2023-10-24T00:41:55.491105+0000","last_clean":"2023-10-24T00:41:55.491105+0000","last_became_active":"2023-10-24T00:41:55.484888+0000","last_became_peered":"2023-10-24T00:41:55.484888+0000","last_unstale":"2023-10-24T00:41:55.491105+0000","last_undegraded":"2023-10-24T00:41:55.491105+0000","last_fullsized":"2023-10-24T00:41:55.491105+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.476599+0000","last_change":"2023-10-24T00:41:55.105979+0000","last_active":"2023-10-24T00:41:55.476599+0000","last_peered":"2023-10-24T00:41:55.476599+0000","last_clean":"2023-10-24T00:41:55.476599+0000","last_became_active":"2023-10-24T00:41:55.105704+0000","last_became_peered":"2023-10-24T00:41:55.105704+0000","last_unstale":"2023-10-24T00:41:55.476599+0000","last_undegraded":"2023-10-24T00:41:55.476599+0000","last_fullsized":"2023-10-24T00:41:55.476599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497359+0000","last_change":"2023-10-24T00:41:55.489673+0000","last_active":"2023-10-24T00:41:55.497359+0000","last_peered":"2023-10-24T00:41:55.497359+0000","last_clean":"2023-10-24T00:41:55.497359+0000","last_became_active":"2023-10-24T00:41:55.489460+0000","last_became_peered":"2023-10-24T00:41:55.489460+0000","last_unstale":"2023-10-24T00:41:55.497359+0000","last_undegraded":"2023-10-24T00:41:55.497359+0000","last_fullsized":"2023-10-24T00:41:55.497359+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472687+0000","last_change":"2023-10-24T00:41:55.113909+0000","last_active":"2023-10-24T00:41:55.472687+0000","last_peered":"2023-10-24T00:41:55.472687+0000","last_clean":"2023-10-24T00:41:55.472687+0000","last_became_active":"2023-10-24T00:41:55.113664+0000","last_became_peered":"2023-10-24T00:41:55.113664+0000","last_unstale":"2023-10-24T00:41:55.472687+0000","last_undegraded":"2023-10-24T00:41:55.472687+0000","last_fullsized":"2023-10-24T00:41:55.472687+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473059+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:41:55.473059+0000","last_peered":"2023-10-24T00:41:55.473059+0000","last_clean":"2023-10-24T00:41:55.473059+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:41:55.473059+0000","last_undegraded":"2023-10-24T00:41:55.473059+0000","last_fullsized":"2023-10-24T00:41:55.473059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.494391+0000","last_change":"2023-10-24T00:41:55.492746+0000","last_active":"2023-10-24T00:41:55.494391+0000","last_peered":"2023-10-24T00:41:55.494391+0000","last_clean":"2023-10-24T00:41:55.494391+0000","last_became_active":"2023-10-24T00:41:55.492425+0000","last_became_peered":"2023-10-24T00:41:55.492425+0000","last_unstale":"2023-10-24T00:41:55.494391+0000","last_undegraded":"2023-10-24T00:41:55.494391+0000","last_fullsized":"2023-10-24T00:41:55.494391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500908+0000","last_change":"2023-10-24T00:41:55.120493+0000","last_active":"2023-10-24T00:41:55.500908+0000","last_peered":"2023-10-24T00:41:55.500908+0000","last_clean":"2023-10-24T00:41:55.500908+0000","last_became_active":"2023-10-24T00:41:55.120304+0000","last_became_peered":"2023-10-24T00:41:55.120304+0000","last_unstale":"2023-10-24T00:41:55.500908+0000","last_undegraded":"2023-10-24T00:41:55.500908+0000","last_fullsized":"2023-10-24T00:41:55.500908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.480687+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:41:55.480687+0000","last_peered":"2023-10-24T00:41:55.480687+0000","last_clean":"2023-10-24T00:41:55.480687+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:41:55.480687+0000","last_undegraded":"2023-10-24T00:41:55.480687+0000","last_fullsized":"2023-10-24T00:41:55.480687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.497395+0000","last_change":"2023-10-24T00:41:55.494465+0000","last_active":"2023-10-24T00:41:55.497395+0000","last_peered":"2023-10-24T00:41:55.497395+0000","last_clean":"2023-10-24T00:41:55.497395+0000","last_became_active":"2023-10-24T00:41:55.494198+0000","last_became_peered":"2023-10-24T00:41:55.494198+0000","last_unstale":"2023-10-24T00:41:55.497395+0000","last_undegraded":"2023-10-24T00:41:55.497395+0000","last_fullsized":"2023-10-24T00:41:55.497395+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487008+0000","last_change":"2023-10-24T00:41:55.116344+0000","last_active":"2023-10-24T00:41:55.487008+0000","last_peered":"2023-10-24T00:41:55.487008+0000","last_clean":"2023-10-24T00:41:55.487008+0000","last_became_active":"2023-10-24T00:41:55.115979+0000","last_became_peered":"2023-10-24T00:41:55.115979+0000","last_unstale":"2023-10-24T00:41:55.487008+0000","last_undegraded":"2023-10-24T00:41:55.487008+0000","last_fullsized":"2023-10-24T00:41:55.487008+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.476683+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:41:55.476683+0000","last_peered":"2023-10-24T00:41:55.476683+0000","last_clean":"2023-10-24T00:41:55.476683+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:41:55.476683+0000","last_undegraded":"2023-10-24T00:41:55.476683+0000","last_fullsized":"2023-10-24T00:41:55.476683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.500123+0000","last_change":"2023-10-24T00:41:55.492516+0000","last_active":"2023-10-24T00:41:55.500123+0000","last_peered":"2023-10-24T00:41:55.500123+0000","last_clean":"2023-10-24T00:41:55.500123+0000","last_became_active":"2023-10-24T00:41:55.492237+0000","last_became_peered":"2023-10-24T00:41:55.492237+0000","last_unstale":"2023-10-24T00:41:55.500123+0000","last_undegraded":"2023-10-24T00:41:55.500123+0000","last_fullsized":"2023-10-24T00:41:55.500123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487381+0000","last_change":"2023-10-24T00:41:55.121949+0000","last_active":"2023-10-24T00:41:55.487381+0000","last_peered":"2023-10-24T00:41:55.487381+0000","last_clean":"2023-10-24T00:41:55.487381+0000","last_became_active":"2023-10-24T00:41:55.121681+0000","last_became_peered":"2023-10-24T00:41:55.121681+0000","last_unstale":"2023-10-24T00:41:55.487381+0000","last_undegraded":"2023-10-24T00:41:55.487381+0000","last_fullsized":"2023-10-24T00:41:55.487381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.481943+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:41:55.481943+0000","last_peered":"2023-10-24T00:41:55.481943+0000","last_clean":"2023-10-24T00:41:55.481943+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:41:55.481943+0000","last_undegraded":"2023-10-24T00:41:55.481943+0000","last_fullsized":"2023-10-24T00:41:55.481943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472558+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:41:55.472558+0000","last_peered":"2023-10-24T00:41:55.472558+0000","last_clean":"2023-10-24T00:41:55.472558+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:41:55.472558+0000","last_undegraded":"2023-10-24T00:41:55.472558+0000","last_fullsized":"2023-10-24T00:41:55.472558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.490701+0000","last_change":"2023-10-24T00:41:55.485184+0000","last_active":"2023-10-24T00:41:55.490701+0000","last_peered":"2023-10-24T00:41:55.490701+0000","last_clean":"2023-10-24T00:41:55.490701+0000","last_became_active":"2023-10-24T00:41:55.484908+0000","last_became_peered":"2023-10-24T00:41:55.484908+0000","last_unstale":"2023-10-24T00:41:55.490701+0000","last_undegraded":"2023-10-24T00:41:55.490701+0000","last_fullsized":"2023-10-24T00:41:55.490701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473565+0000","last_change":"2023-10-24T00:41:55.109828+0000","last_active":"2023-10-24T00:41:55.473565+0000","last_peered":"2023-10-24T00:41:55.473565+0000","last_clean":"2023-10-24T00:41:55.473565+0000","last_became_active":"2023-10-24T00:41:55.109514+0000","last_became_peered":"2023-10-24T00:41:55.109514+0000","last_unstale":"2023-10-24T00:41:55.473565+0000","last_undegraded":"2023-10-24T00:41:55.473565+0000","last_fullsized":"2023-10-24T00:41:55.473565+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.472640+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:41:55.472640+0000","last_peered":"2023-10-24T00:41:55.472640+0000","last_clean":"2023-10-24T00:41:55.472640+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:41:55.472640+0000","last_undegraded":"2023-10-24T00:41:55.472640+0000","last_fullsized":"2023-10-24T00:41:55.472640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.498971+0000","last_change":"2023-10-24T00:41:55.494910+0000","last_active":"2023-10-24T00:41:55.498971+0000","last_peered":"2023-10-24T00:41:55.498971+0000","last_clean":"2023-10-24T00:41:55.498971+0000","last_became_active":"2023-10-24T00:41:55.494605+0000","last_became_peered":"2023-10-24T00:41:55.494605+0000","last_unstale":"2023-10-24T00:41:55.498971+0000","last_undegraded":"2023-10-24T00:41:55.498971+0000","last_fullsized":"2023-10-24T00:41:55.498971+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.481128+0000","last_change":"2023-10-24T00:41:55.111595+0000","last_active":"2023-10-24T00:41:55.481128+0000","last_peered":"2023-10-24T00:41:55.481128+0000","last_clean":"2023-10-24T00:41:55.481128+0000","last_became_active":"2023-10-24T00:41:55.111316+0000","last_became_peered":"2023-10-24T00:41:55.111316+0000","last_unstale":"2023-10-24T00:41:55.481128+0000","last_undegraded":"2023-10-24T00:41:55.481128+0000","last_fullsized":"2023-10-24T00:41:55.481128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473616+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:41:55.473616+0000","last_peered":"2023-10-24T00:41:55.473616+0000","last_clean":"2023-10-24T00:41:55.473616+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:41:55.473616+0000","last_undegraded":"2023-10-24T00:41:55.473616+0000","last_fullsized":"2023-10-24T00:41:55.473616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.496409+0000","last_change":"2023-10-24T00:41:55.491770+0000","last_active":"2023-10-24T00:41:55.496409+0000","last_peered":"2023-10-24T00:41:55.496409+0000","last_clean":"2023-10-24T00:41:55.496409+0000","last_became_active":"2023-10-24T00:41:55.491422+0000","last_became_peered":"2023-10-24T00:41:55.491422+0000","last_unstale":"2023-10-24T00:41:55.496409+0000","last_undegraded":"2023-10-24T00:41:55.496409+0000","last_fullsized":"2023-10-24T00:41:55.496409+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.489241+0000","last_change":"2023-10-24T00:41:55.112130+0000","last_active":"2023-10-24T00:41:55.489241+0000","last_peered":"2023-10-24T00:41:55.489241+0000","last_clean":"2023-10-24T00:41:55.489241+0000","last_became_active":"2023-10-24T00:41:55.111879+0000","last_became_peered":"2023-10-24T00:41:55.111879+0000","last_unstale":"2023-10-24T00:41:55.489241+0000","last_undegraded":"2023-10-24T00:41:55.489241+0000","last_fullsized":"2023-10-24T00:41:55.489241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.473951+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:41:55.473951+0000","last_peered":"2023-10-24T00:41:55.473951+0000","last_clean":"2023-10-24T00:41:55.473951+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:41:55.473951+0000","last_undegraded":"2023-10-24T00:41:55.473951+0000","last_fullsized":"2023-10-24T00:41:55.473951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.484993+0000","last_change":"2023-10-24T00:41:55.484101+0000","last_active":"2023-10-24T00:41:55.484993+0000","last_peered":"2023-10-24T00:41:55.484993+0000","last_clean":"2023-10-24T00:41:55.484993+0000","last_became_active":"2023-10-24T00:41:55.483822+0000","last_became_peered":"2023-10-24T00:41:55.483822+0000","last_unstale":"2023-10-24T00:41:55.484993+0000","last_undegraded":"2023-10-24T00:41:55.484993+0000","last_fullsized":"2023-10-24T00:41:55.484993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:55.090571+0000","last_clean_scrub_stamp":"2023-10-24T00:41:55.090571+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487961+0000","last_change":"2023-10-24T00:41:55.109282+0000","last_active":"2023-10-24T00:41:55.487961+0000","last_peered":"2023-10-24T00:41:55.487961+0000","last_clean":"2023-10-24T00:41:55.487961+0000","last_became_active":"2023-10-24T00:41:55.108997+0000","last_became_peered":"2023-10-24T00:41:55.108997+0000","last_unstale":"2023-10-24T00:41:55.487961+0000","last_undegraded":"2023-10-24T00:41:55.487961+0000","last_fullsized":"2023-10-24T00:41:55.487961+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:41:54.086046+0000","last_clean_scrub_stamp":"2023-10-24T00:41:54.086046+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-24T00:41:55.487927+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:41:55.487927+0000","last_peered":"2023-10-24T00:41:55.487927+0000","last_clean":"2023-10-24T00:41:55.487927+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:41:55.487927+0000","last_undegraded":"2023-10-24T00:41:55.487927+0000","last_fullsized":"2023-10-24T00:41:55.487927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542305,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301932,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069908,"statfs":{"total":96636764160,"available":96327585792,"internally_reserved":0,"allocated":757760,"data_stored":367444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.29799999999999999,"15min":0.22700000000000001},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.48299999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.73899999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.51900000000000002},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.68000000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.47799999999999998,"5min":0.32800000000000001,"15min":0.27600000000000002},"max":{"1min":0.73799999999999999,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.63800000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.32600000000000001},"max":{"1min":0.69499999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.377,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55000000000000004}]},{"osd":3,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60799999999999998},"min":{"1min":0.51000000000000001,"5min":0.40400000000000003,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61399999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47899999999999998,"15min":0.48399999999999999},"min":{"1min":0.34399999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.48999999999999999,"15min":0.48899999999999999},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.65200000000000002,"5min":0.72199999999999998,"15min":0.73099999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.79600000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.35999999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.81299999999999994},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:41:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.35299999999999998},"max":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.85699999999999998},"last":0.624},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.33700000000000002},"max":{"1min":0.69499999999999995,"5min":0.77400000000000002,"15min":0.83299999999999996},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":749568,"data_stored":366836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54400000000000004,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.73999999999999999,"5min":0.75700000000000001,"15min":0.878},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.53800000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.82799999999999996},"last":1.3839999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54600000000000004,"15min":0.55900000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":1.786},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56000000000000005,"15min":0.59099999999999997},"min":{"1min":0.44900000000000001,"5min":0.378,"15min":0.33500000000000002},"max":{"1min":0.67100000000000004,"5min":0.75,"15min":3.2160000000000002},"last":1.573}]},{"osd":2,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54600000000000004,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.73599999999999999,"15min":0.85599999999999998},"last":7.7969999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":1.873},"last":1.5029999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.316},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.81799999999999995},"last":14.597},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.34499999999999997},"max":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.91900000000000004},"last":2.2469999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.307},"max":{"1min":0.622,"5min":0.73799999999999999,"15min":3.2959999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.49199999999999999},"min":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.74199999999999999},"last":7.8559999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.54300000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":1.8340000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.55100000000000005},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.628,"5min":0.73199999999999998,"15min":0.84599999999999997},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.60899999999999999},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.35399999999999998},"max":{"1min":0.70399999999999996,"5min":0.76700000000000002,"15min":3.2610000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.30499999999999999},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.82099999999999995},"last":7.8929999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":366856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":0.58999999999999997,"15min":0.66800000000000004},"last":0.375},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.39800000000000002},"min":{"1min":0.315,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.308}]},{"osd":2,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.23300000000000001},"max":{"1min":0.51400000000000001,"5min":0.57499999999999996,"15min":0.91000000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.40000000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.26400000000000001},"max":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.70599999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.40400000000000003},"min":{"1min":0.313,"5min":0.26900000000000002,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.63200000000000001,"15min":0.93899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.42599999999999999},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.27500000000000002},"max":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.58899999999999997},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85399999999999998,"5min":0.89600000000000002,"15min":1.1859999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77600000000000002,"5min":0.92900000000000005,"15min":1.964},"last":0.443}]},{"osd":5,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83999999999999997,"5min":0.91100000000000003,"15min":1.1040000000000001},"last":0.499},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":1.0029999999999999,"15min":1.022},"last":0.39800000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.59999999999999998},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.89000000000000001,"15min":1.121},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.47599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76400000000000001,"5min":0.91000000000000003,"15min":1.879},"last":0.48399999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.40500000000000003},"max":{"1min":0.85499999999999998,"5min":0.90100000000000002,"15min":1.5800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.437},"max":{"1min":0.84399999999999997,"5min":0.93899999999999995,"15min":1.6919999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297836,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074004,"statfs":{"total":96636764160,"available":96331780096,"internally_reserved":0,"allocated":757760,"data_stored":366892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.20399999999999999},"max":{"1min":0.48799999999999999,"5min":0.53700000000000003,"15min":0.59999999999999998},"last":0.245},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.378},"min":{"1min":0.31,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52500000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.30499999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41499999999999998,"15min":0.39300000000000002},"min":{"1min":0.28399999999999997,"5min":0.27800000000000002,"15min":0.215},"max":{"1min":0.55700000000000005,"5min":0.63200000000000001,"15min":0.68600000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.36899999999999999},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.23599999999999999},"max":{"1min":0.52900000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41199999999999998,"15min":0.39300000000000002},"min":{"1min":0.30599999999999999,"5min":0.28000000000000003,"15min":0.246},"max":{"1min":0.502,"5min":0.628,"15min":0.628},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46300000000000002,"15min":0.439},"min":{"1min":0.34999999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.56999999999999995,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.36899999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.49099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79900000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52700000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.437},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.47399999999999998,"5min":0.41699999999999998,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.51300000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.51700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81799999999999995,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.60799999999999998},"min":{"1min":0.46500000000000002,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.88100000000000001},"last":0.496}]},{"osd":7,"last update":"Tue Oct 24 00:41:07 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.86099999999999999,"15min":0.86899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.505}]}]},{"osd":2,"up_from":14,"seq":60129542305,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301932,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069908,"statfs":{"total":96636764160,"available":96327585792,"internally_reserved":0,"allocated":757760,"data_stored":368302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35799999999999998,"15min":0.35199999999999998},"min":{"1min":0.23200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.50800000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.29299999999999998,"5min":0.22700000000000001,"15min":0.19900000000000001},"max":{"1min":0.54500000000000004,"5min":0.61799999999999999,"15min":0.62},"last":0.433}]},{"osd":1,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38500000000000001,"15min":0.36599999999999999},"min":{"1min":0.25800000000000001,"5min":0.247,"15min":0.20699999999999999},"max":{"1min":0.502,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.22500000000000001},"max":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.39600000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44600000000000001,"15min":0.41999999999999998},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.25900000000000001},"max":{"1min":0.59599999999999997,"5min":0.61599999999999999,"15min":0.63700000000000001},"last":0.317},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.40300000000000002},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.748,"15min":0.748},"last":0.36899999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.42499999999999999,"15min":0.32100000000000001},"max":{"1min":0.77700000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.96599999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46899999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64400000000000002,"15min":0.624},"min":{"1min":0.46100000000000002,"5min":0.41199999999999998,"15min":0.39800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.312},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.5,"5min":0.48199999999999998,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.98599999999999999,"15min":0.999},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301932,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069908,"statfs":{"total":96636764160,"available":96327585792,"internally_reserved":0,"allocated":757760,"data_stored":367432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36699999999999999,"15min":0.34999999999999998},"min":{"1min":0.25600000000000001,"5min":0.255,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.61399999999999999,"15min":0.68100000000000005},"last":0.28799999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.35799999999999998},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.5,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.41499999999999998},"min":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.66900000000000004},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.39000000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.245},"max":{"1min":0.53900000000000003,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.438},"min":{"1min":0.34499999999999997,"5min":0.311,"15min":0.30599999999999999},"max":{"1min":0.57799999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"max":{"1min":0.87,"5min":0.87,"15min":1.024},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.498,"5min":0.39900000000000002,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":1.0620000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.36399999999999999},"max":{"1min":0.78500000000000003,"5min":0.995,"15min":0.995},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.45300000000000001,"15min":0.42299999999999999},"max":{"1min":0.79700000000000004,"5min":0.95599999999999996,"15min":1.018},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65500000000000003,"15min":0.621},"min":{"1min":0.47899999999999998,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":0.83099999999999996,"5min":1.042,"15min":1.042},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65800000000000003,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.41599999999999998,"15min":0.40400000000000003},"max":{"1min":0.73399999999999999,"5min":0.98699999999999999,"15min":1.006},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.64900000000000002},"min":{"1min":0.53000000000000003,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":0.82799999999999996,"5min":1.121,"15min":1.121},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":367320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.76900000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55700000000000005,"15min":0.52400000000000002},"min":{"1min":0.41399999999999998,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.69299999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69199999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55100000000000005,"15min":0.52400000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.26700000000000002},"max":{"1min":0.67200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57199999999999995,"15min":0.53900000000000003},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.30399999999999999},"max":{"1min":0.65000000000000002,"5min":0.80200000000000005,"15min":0.80500000000000005},"last":0.82599999999999996}]},{"osd":2,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70199999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.55800000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.77600000000000002,"15min":0.78100000000000003},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.29699999999999999},"max":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.751,"15min":0.751},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.36099999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.75800000000000001,"15min":0.76200000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Oct 24 00:40:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.80000000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.54700000000000004},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34300000000000003},"max":{"1min":0.71699999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.66100000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542305,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":367658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26100000000000001},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.54000000000000004},"min":{"1min":0.41499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":0.754,"15min":0.754},"last":0.51900000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57599999999999996,"15min":0.54900000000000004},"min":{"1min":0.35099999999999998,"5min":0.315,"15min":0.249},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57699999999999996,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32400000000000001},"max":{"1min":0.77400000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.54900000000000004},"min":{"1min":0.433,"5min":0.41999999999999998,"15min":0.23899999999999999},"max":{"1min":0.77300000000000002,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.45500000000000002,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.40100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.34300000000000003},"max":{"1min":0.71399999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.432,"15min":0.45100000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.65700000000000003,"15min":0.71099999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.48399999999999999,"15min":0.495},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":0.68899999999999995,"5min":1.339,"15min":1.339},"last":0.34599999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.36499999999999999,"5min":0.32200000000000001,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.56000000000000005},"min":{"1min":0.377,"5min":0.313,"15min":0.313},"max":{"1min":0.68400000000000005,"5min":0.74199999999999999,"15min":0.81999999999999995},"last":0.376}]},{"osd":7,"last update":"Tue Oct 24 00:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.55600000000000005},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":1.421,"15min":1.421},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.74199999999999999,"5min":1.772,"15min":1.772},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:41:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:41:59.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:41:59.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.595+0000 7fb1918f4700 1 Processor -- start 2023-10-24T00:41:59.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.595+0000 7fb1918f4700 1 -- start start 2023-10-24T00:41:59.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 0x7fb18c064da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 0x7fb18c065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb18c151570 0x7fb18c065780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c065c70 con 0x7fb18c151570 2023-10-24T00:41:59.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0ad3d0 con 0x7fb18c06b380 2023-10-24T00:41:59.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb1918f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c3800 con 0x7fb18c151190 2023-10-24T00:41:59.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb18b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb18c151570 0x7fb18c065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb18b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb18c151570 0x7fb18c065780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35324/0 (socket says 172.21.15.148:35324) 2023-10-24T00:41:59.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.596+0000 7fb18b7fe700 1 -- 172.21.15.148:0/712700657 learned_addr learned my addr 172.21.15.148:0/712700657 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:59.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18affd700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 0x7fb18c064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18a7fc700 1 --2- 172.21.15.148:0/712700657 >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 0x7fb18c065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 -- 172.21.15.148:0/712700657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 msgr2=0x7fb18c064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:59.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 0x7fb18c064da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 -- 172.21.15.148:0/712700657 >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 msgr2=0x7fb18c065290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:59.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 --2- 172.21.15.148:0/712700657 >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 0x7fb18c065290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 -- 172.21.15.148:0/712700657 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0c3ae0 con 0x7fb18c151570 2023-10-24T00:41:59.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18affd700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 0x7fb18c064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:59.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18a7fc700 1 --2- 172.21.15.148:0/712700657 >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 0x7fb18c065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:41:59.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb18b7fe700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c151570 0x7fb18c065780 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb18c067750 tx=0x7fb184009840).ready entity=mon.0 client_cookie=5bd1bb885d9873bd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb189ffb700 1 -- 172.21.15.148:0/712700657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400e070 con 0x7fb18c151570 2023-10-24T00:41:59.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb189ffb700 1 -- 172.21.15.148:0/712700657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400ba50 con 0x7fb18c151570 2023-10-24T00:41:59.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb189ffb700 1 -- 172.21.15.148:0/712700657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400bdd0 con 0x7fb18c151570 2023-10-24T00:41:59.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb1918f4700 1 -- 172.21.15.148:0/712700657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c151570 msgr2=0x7fb18c065780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.597+0000 7fb1918f4700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c151570 0x7fb18c065780 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb18c067750 tx=0x7fb184009840).stop 2023-10-24T00:41:59.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 -- 172.21.15.148:0/712700657 shutdown_connections 2023-10-24T00:41:59.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c151570 0x7fb18c065780 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 --2- 172.21.15.148:0/712700657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151190 0x7fb18c064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 --2- 172.21.15.148:0/712700657 >> v2:172.21.15.150:3300/0 conn(0x7fb18c06b380 0x7fb18c065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 -- 172.21.15.148:0/712700657 >> 172.21.15.148:0/712700657 conn(0x7fb18c0c3f60 msgr2=0x7fb18c0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 -- 172.21.15.148:0/712700657 shutdown_connections 2023-10-24T00:41:59.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.598+0000 7fb1918f4700 1 -- 172.21.15.148:0/712700657 wait complete. 2023-10-24T00:41:59.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.599+0000 7fb1918f4700 1 Processor -- start 2023-10-24T00:41:59.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.599+0000 7fb1918f4700 1 -- start start 2023-10-24T00:41:59.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb18c151190 0x7fb18c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 0x7fb18c142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c13e6e0 con 0x7fb18c06b380 2023-10-24T00:41:59.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c148040 con 0x7fb18c151190 2023-10-24T00:41:59.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c13e290 con 0x7fb18c151570 2023-10-24T00:41:59.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35330/0 (socket says 172.21.15.148:35330) 2023-10-24T00:41:59.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 -- 172.21.15.148:0/1585331864 learned_addr learned my addr 172.21.15.148:0/1585331864 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:59.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18a7fc700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb18c151190 0x7fb18c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18b7fe700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 0x7fb18c142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 -- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 msgr2=0x7fb18c142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 0x7fb18c142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 -- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb18c151190 msgr2=0x7fb18c1538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb18c151190 0x7fb18c1538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 -- 172.21.15.148:0/1585331864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009ae0 con 0x7fb18c06b380 2023-10-24T00:41:59.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18b7fe700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 0x7fb18c142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:41:59.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb18affd700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fb17c00c880 tx=0x7fb17c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c010580 con 0x7fb18c06b380 2023-10-24T00:41:59.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c0106e0 con 0x7fb18c06b380 2023-10-24T00:41:59.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c147430 con 0x7fb18c06b380 2023-10-24T00:41:59.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c010a60 con 0x7fb18c06b380 2023-10-24T00:41:59.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.600+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c1479f0 con 0x7fb18c06b380 2023-10-24T00:41:59.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.601+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c148320 con 0x7fb18c06b380 2023-10-24T00:41:59.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.601+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb17c01b460 con 0x7fb18c06b380 2023-10-24T00:41:59.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.602+0000 7fb172ffd700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 0x7fb178061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.602+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb17c07a170 con 0x7fb18c06b380 2023-10-24T00:41:59.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.602+0000 7fb18a7fc700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 0x7fb178061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.602+0000 7fb18a7fc700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 0x7fb178061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb18c0c69e0 tx=0x7fb180008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.606+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb17c04b3e0 con 0x7fb18c06b380 2023-10-24T00:41:59.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.833+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb18c06c6b0 con 0x7fb18c06b380 2023-10-24T00:41:59.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.837+0000 7fb172ffd700 1 -- 172.21.15.148:0/1585331864 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb17c04ea00 con 0x7fb18c06b380 2023-10-24T00:41:59.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 msgr2=0x7fb178061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 0x7fb178061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb18c0c69e0 tx=0x7fb180008040).stop 2023-10-24T00:41:59.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 msgr2=0x7fb18c13dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fb17c00c880 tx=0x7fb17c008040).stop 2023-10-24T00:41:59.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 shutdown_connections 2023-10-24T00:41:59.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb18c151570 0x7fb18c142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb17805f180 0x7fb178061640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb18c06b380 0x7fb18c13dda0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 --2- 172.21.15.148:0/1585331864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb18c151190 0x7fb18c1538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 >> 172.21.15.148:0/1585331864 conn(0x7fb18c0c3f60 msgr2=0x7fb18c0a74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 shutdown_connections 2023-10-24T00:41:59.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.839+0000 7fb1918f4700 1 -- 172.21.15.148:0/1585331864 wait complete. 2023-10-24T00:41:59.844 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:41:59.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:41:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.964+0000 7f059bad9700 1 Processor -- start 2023-10-24T00:41:59.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.965+0000 7f059bad9700 1 -- start start 2023-10-24T00:41:59.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.965+0000 7f059bad9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0594098700 0x7f0594098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.965+0000 7f059bad9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 0x7f05940c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f059bad9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940c5910 con 0x7f05940ca640 2023-10-24T00:41:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f059bad9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0594154860 con 0x7f0594098700 2023-10-24T00:41:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f059bad9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05940c6490 con 0x7f05940c1b40 2023-10-24T00:41:59.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599074700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 0x7f05940c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0594098700 0x7f0594098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0594098700 0x7f0594098ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51834/0 (socket says 172.21.15.148:51834) 2023-10-24T00:41:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599074700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 0x7f05940c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:38200/0 (socket says 172.21.15.148:38200) 2023-10-24T00:41:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 -- 172.21.15.148:0/3797214855 learned_addr learned my addr 172.21.15.148:0/3797214855 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:59.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f059a076700 1 --1- 172.21.15.148:0/3797214855 >> v1:172.21.15.150:6789/0 conn(0x7f05940ca640 0x7f05940cb480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49762/0 (socket says 172.21.15.148:49762) 2023-10-24T00:41:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 -- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 msgr2=0x7f05940c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:41:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 --2- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 0x7f05940c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 -- 172.21.15.148:0/3797214855 >> v1:172.21.15.150:6789/0 conn(0x7f05940ca640 legacy=0x7f05940cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 -- 172.21.15.148:0/3797214855 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940c5b60 con 0x7f0594098700 2023-10-24T00:41:59.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0599875700 1 --2- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0594098700 0x7f0594098ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0590009f20 tx=0x7f0590009840).ready entity=mon.1 client_cookie=f5365ad8b2371b64 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0598873700 1 -- 172.21.15.148:0/3797214855 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000e070 con 0x7f0594098700 2023-10-24T00:41:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0598873700 1 -- 172.21.15.148:0/3797214855 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000b9d0 con 0x7f0594098700 2023-10-24T00:41:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.966+0000 7f0598873700 1 -- 172.21.15.148:0/3797214855 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059000bd50 con 0x7f0594098700 2023-10-24T00:41:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 -- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0594098700 msgr2=0x7f0594098ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 --2- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0594098700 0x7f0594098ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0590009f20 tx=0x7f0590009840).stop 2023-10-24T00:41:59.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 -- 172.21.15.148:0/3797214855 shutdown_connections 2023-10-24T00:41:59.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 --2- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0594098700 0x7f0594098ae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 --2- 172.21.15.148:0/3797214855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f05940c1b40 0x7f05940c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 -- 172.21.15.148:0/3797214855 >> 172.21.15.148:0/3797214855 conn(0x7f059406b380 msgr2=0x7f059406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:41:59.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 -- 172.21.15.148:0/3797214855 shutdown_connections 2023-10-24T00:41:59.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.967+0000 7f059bad9700 1 -- 172.21.15.148:0/3797214855 wait complete. 2023-10-24T00:41:59.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.968+0000 7f059bad9700 1 Processor -- start 2023-10-24T00:41:59.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.968+0000 7f059bad9700 1 -- start start 2023-10-24T00:41:59.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0594098700 0x7f05940c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05940c1b40 0x7f0594165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05941525f0 con 0x7f05940ca640 2023-10-24T00:41:59.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940c5410 con 0x7f05940c1b40 2023-10-24T00:41:59.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059bad9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05940ac2f0 con 0x7f0594098700 2023-10-24T00:41:59.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35342/0 (socket says 172.21.15.148:35342) 2023-10-24T00:41:59.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 -- 172.21.15.148:0/1908635186 learned_addr learned my addr 172.21.15.148:0/1908635186 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:41:59.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f0599875700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0594098700 0x7f05940c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f0599074700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05940c1b40 0x7f0594165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 -- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0594098700 msgr2=0x7f05940c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0594098700 0x7f05940c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 -- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05940c1b40 msgr2=0x7f0594165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:41:59.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05940c1b40 0x7f0594165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:41:59.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.969+0000 7f059a076700 1 -- 172.21.15.148:0/1908635186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590009ae0 con 0x7f05940ca640 2023-10-24T00:41:59.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f059a076700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f058c00c440 tx=0x7f058c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0072e0 con 0x7f05940ca640 2023-10-24T00:41:59.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c007440 con 0x7f05940ca640 2023-10-24T00:41:59.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0594165940 con 0x7f05940ca640 2023-10-24T00:41:59.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0058f0 con 0x7f05940ca640 2023-10-24T00:41:59.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.970+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05940aba40 con 0x7f05940ca640 2023-10-24T00:41:59.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.971+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f058c005ce0 con 0x7f05940ca640 2023-10-24T00:41:59.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.971+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059406c6b0 con 0x7f05940ca640 2023-10-24T00:41:59.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.971+0000 7f0589ffb700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 0x7f0578061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:41:59.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.971+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f058c079850 con 0x7f05940ca640 2023-10-24T00:41:59.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.972+0000 7f0599875700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 0x7f0578061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:41:59.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.972+0000 7f0599875700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 0x7f0578061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0590009880 tx=0x7f05940caf00).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:41:59.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:41:59.976+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f058c04ab20 con 0x7f05940ca640 2023-10-24T00:42:00.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.179+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05940ac430 con 0x7f05940ca640 2023-10-24T00:42:00.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.179+0000 7f0589ffb700 1 -- 172.21.15.148:0/1908635186 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f058c04e140 con 0x7f05940ca640 2023-10-24T00:42:00.183 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:42:00.183 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:42:00.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 msgr2=0x7f0578061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 0x7f0578061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0590009880 tx=0x7f05940caf00).stop 2023-10-24T00:42:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 msgr2=0x7f05940ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f058c00c440 tx=0x7f058c007dd0).stop 2023-10-24T00:42:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 shutdown_connections 2023-10-24T00:42:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f057805f150 0x7f0578061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05940ca640 0x7f05940ad060 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0594098700 0x7f05940c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 --2- 172.21.15.148:0/1908635186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05940c1b40 0x7f0594165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 >> 172.21.15.148:0/1908635186 conn(0x7f059406b380 msgr2=0x7f05940cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.181+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 shutdown_connections 2023-10-24T00:42:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.182+0000 7f059bad9700 1 -- 172.21.15.148:0/1908635186 wait complete. 2023-10-24T00:42:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:42:00.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:41:55.467761+0000', 'modified': '2023-10-24T00:41:58.110765+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5865}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5865': {'gid': 5865, 'name': 'd', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6836/1105578724', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 1105578724}, {'type': 'v1', 'addr': '172.21.15.150:6836', 'nonce': 1105578724}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:42:00.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:42:00.600 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-24T00:42:00.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.713+0000 7f343d996700 1 Processor -- start 2023-10-24T00:42:00.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.713+0000 7f343d996700 1 -- start start 2023-10-24T00:42:00.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.714+0000 7f343d996700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 0x7f34380c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.714+0000 7f343d996700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34380c4680 0x7f343815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.714+0000 7f343d996700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380bfcf0 con 0x7f34380c6420 2023-10-24T00:42:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.714+0000 7f343d996700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34380c4af0 con 0x7f34380c4680 2023-10-24T00:42:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.714+0000 7f343d996700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380c6800 con 0x7f3438064a50 2023-10-24T00:42:00.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 0x7f34380c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34380c4680 0x7f343815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 0x7f34380c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:38218/0 (socket says 172.21.15.148:38218) 2023-10-24T00:42:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f3436ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f34380c6420 0x7f34380be600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49764/0 (socket says 172.21.15.148:49764) 2023-10-24T00:42:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f342e7fc700 1 -- 172.21.15.148:0/3194932408 learned_addr learned my addr 172.21.15.148:0/3194932408 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f34380c4680 0x7f343815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51858/0 (socket says 172.21.15.148:51858) 2023-10-24T00:42:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 -- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 msgr2=0x7f34380c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 --2- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 0x7f34380c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 -- 172.21.15.148:0/3194932408 >> v1:172.21.15.150:6789/0 conn(0x7f34380c6420 legacy=0x7f34380be600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34367fc700 1 -- 172.21.15.148:0/3194932408 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076866161 0 0) 0x7f34380bfcf0 con 0x7f34380c6420 2023-10-24T00:42:00.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 -- 172.21.15.148:0/3194932408 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380bf0e0 con 0x7f34380c4680 2023-10-24T00:42:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34377fe700 1 --2- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c4680 0x7f343815e210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3430009e60 tx=0x7f3430009780).ready entity=mon.1 client_cookie=494fa3eef1ea01e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34367fc700 1 -- 172.21.15.148:0/3194932408 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000e070 con 0x7f34380c4680 2023-10-24T00:42:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34367fc700 1 -- 172.21.15.148:0/3194932408 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000bb60 con 0x7f34380c4680 2023-10-24T00:42:00.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.715+0000 7f34367fc700 1 -- 172.21.15.148:0/3194932408 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430012410 con 0x7f34380c4680 2023-10-24T00:42:00.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 -- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c4680 msgr2=0x7f343815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 --2- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c4680 0x7f343815e210 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f3430009e60 tx=0x7f3430009780).stop 2023-10-24T00:42:00.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 -- 172.21.15.148:0/3194932408 shutdown_connections 2023-10-24T00:42:00.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 --2- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c4680 0x7f343815e210 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 --2- 172.21.15.148:0/3194932408 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3438064a50 0x7f34380c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 -- 172.21.15.148:0/3194932408 >> 172.21.15.148:0/3194932408 conn(0x7f3438092510 msgr2=0x7f3438062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 -- 172.21.15.148:0/3194932408 shutdown_connections 2023-10-24T00:42:00.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.716+0000 7f343d996700 1 -- 172.21.15.148:0/3194932408 wait complete. 2023-10-24T00:42:00.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.717+0000 7f343d996700 1 Processor -- start 2023-10-24T00:42:00.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.717+0000 7f343d996700 1 -- start start 2023-10-24T00:42:00.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34380c4680 0x7f34380c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c6420 0x7f34380c1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381539a0 con 0x7f3438064a50 2023-10-24T00:42:00.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438157940 con 0x7f34380c6420 2023-10-24T00:42:00.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f343d996700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380c2b40 con 0x7f34380c4680 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f3436ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f3436ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35348/0 (socket says 172.21.15.148:35348) 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.718+0000 7f3436ffd700 1 -- 172.21.15.148:0/534629153 learned_addr learned my addr 172.21.15.148:0/534629153 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f342e7fc700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34380c4680 0x7f34380c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f34377fe700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c6420 0x7f34380c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 -- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34380c4680 msgr2=0x7f34380c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34380c4680 0x7f34380c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 -- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c6420 msgr2=0x7f34380c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c6420 0x7f34380c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 -- 172.21.15.148:0/534629153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009a20 con 0x7f3438064a50 2023-10-24T00:42:00.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f3436ffd700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f342800c4c0 tx=0x7f3428007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f342f7fe700 1 -- 172.21.15.148:0/534629153 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280072e0 con 0x7f3438064a50 2023-10-24T00:42:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f342f7fe700 1 -- 172.21.15.148:0/534629153 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428007440 con 0x7f3438064a50 2023-10-24T00:42:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34380c1aa0 con 0x7f3438064a50 2023-10-24T00:42:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f342f7fe700 1 -- 172.21.15.148:0/534629153 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428005940 con 0x7f3438064a50 2023-10-24T00:42:00.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.719+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34380c2060 con 0x7f3438064a50 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.720+0000 7f342f7fe700 1 -- 172.21.15.148:0/534629153 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3428013450 con 0x7f3438064a50 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.721+0000 7f342f7fe700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 0x7f3418061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.721+0000 7f342f7fe700 1 -- 172.21.15.148:0/534629153 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3428079a60 con 0x7f3438064a50 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.721+0000 7f342e7fc700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 0x7f3418061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.721+0000 7f342e7fc700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 0x7f3418061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3420006bc0 tx=0x7f3420008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 Processor -- start 2023-10-24T00:42:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 -- start start 2023-10-24T00:42:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ebcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486e341b0 con 0x55b486ebf980 2023-10-24T00:42:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486df9cb0 con 0x55b486ebcb20 2023-10-24T00:42:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.723+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b486e0ec90 con 0x55b486ee6190 2023-10-24T00:42:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35360/0 (socket says 172.21.15.148:35360) 2023-10-24T00:42:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 -- 172.21.15.148:0/2566533140 learned_addr learned my addr 172.21.15.148:0/2566533140 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f342e7fc700 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f3436ffd700 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ebcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 -- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 msgr2=0x55b486eb89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 -- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 msgr2=0x55b486ebcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ebcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 -- 172.21.15.148:0/2566533140 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b486e07e70 con 0x55b486ebf980 2023-10-24T00:42:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f34377fe700 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3438069d60 tx=0x7f34380bfc60).ready entity=mon.0 client_cookie=9821d273c87a9920 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f3417fff700 1 -- 172.21.15.148:0/2566533140 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000bda0 con 0x55b486ebf980 2023-10-24T00:42:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f3417fff700 1 -- 172.21.15.148:0/2566533140 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300127d0 con 0x55b486ebf980 2023-10-24T00:42:00.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.724+0000 7f3417fff700 1 -- 172.21.15.148:0/2566533140 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430012b70 con 0x55b486ebf980 2023-10-24T00:42:00.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- 172.21.15.148:0/2566533140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 msgr2=0x55b486eb8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3438069d60 tx=0x7f34380bfc60).stop 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- 172.21.15.148:0/2566533140 shutdown_connections 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8e90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ebcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 --2- 172.21.15.148:0/2566533140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- 172.21.15.148:0/2566533140 >> 172.21.15.148:0/2566533140 conn(0x55b486c79e40 msgr2=0x55b486f06ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- 172.21.15.148:0/2566533140 shutdown_connections 2023-10-24T00:42:00.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- 172.21.15.148:0/2566533140 wait complete. 2023-10-24T00:42:00.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.725+0000 7f344f32eb80 1 -- start start 2023-10-24T00:42:00.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.726+0000 7f344f32eb80 1 Processor -- start 2023-10-24T00:42:00.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.726+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ee4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.726+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebf980 0x55b486ee4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.726+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486e0edd0 con 0x55b486ee6190 2023-10-24T00:42:00.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486e0f050 con 0x55b486ebcb20 2023-10-24T00:42:00.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b486dda8d0 con 0x55b486ebf980 2023-10-24T00:42:00.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 10 client.0 ll_register_callbacks cb 0x55b486e7d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:42:00.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35366/0 (socket says 172.21.15.148:35366) 2023-10-24T00:42:00.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 -- 172.21.15.148:0/3570663330 learned_addr learned my addr 172.21.15.148:0/3570663330 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f3436ffd700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ee4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f342e7fc700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebf980 0x55b486ee4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 -- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebf980 msgr2=0x55b486ee4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebf980 0x55b486ee4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 -- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 msgr2=0x55b486ee4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ee4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 -- 172.21.15.148:0/3570663330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34380bf0e0 con 0x55b486ee6190 2023-10-24T00:42:00.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34377fe700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3430009e60 tx=0x7f343001e000).ready entity=mon.0 client_cookie=9c2bc02f8802d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34157fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:42:00.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430012660 con 0x55b486ee6190 2023-10-24T00:42:00.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3430030ca0 con 0x55b486ee6190 2023-10-24T00:42:00.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b486eb14e0 con 0x55b486ee6190 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3430030e60 con 0x55b486ee6190 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 10 client.6003 fetch_fsmap learned FSMap version 19 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b486e03480 con 0x55b486ee6190 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.727+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b486eb14e0 con 0x55b486ee6190 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3430025820 con 0x55b486ee6190 2023-10-24T00:42:00.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 10 client.6003 fetch_fsmap finished waiting for FSMap version 19 2023-10-24T00:42:00.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 10 client.6003 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:42:00.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 20 client.6003 populate_metadata read hostname 'smithi148' 2023-10-24T00:42:00.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486ed0220 0x55b486ed0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 4 client.6003 mds_command: new command op to 5865 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 --> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b486e874b0 con 0x55b486ed0220 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f3436ffd700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486ed0220 0x55b486ed0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f34157fa700 10 client.6003 ms_handle_connect on v2:172.21.15.150:6834/1105578724 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.728+0000 7f3436ffd700 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486ed0220 0x55b486ed0600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4b9b47a2d08c309f server_cookie=e46ac3c8290fac3f in_seq=0 out_seq=0 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f34157fa700 1 -- 172.21.15.148:0/3570663330 <== mds.0 v2:172.21.15.150:6834/1105578724 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55b486e874b0 con 0x55b486ed0220 2023-10-24T00:42:00.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f34157fa700 10 client.6003 handle_command_reply: tid=0 2023-10-24T00:42:00.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 client.6003 shutdown 2023-10-24T00:42:00.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 msgr2=0x55b486ee0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3430009e60 tx=0x7f343001e000).stop 2023-10-24T00:42:00.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 shutdown_connections 2023-10-24T00:42:00.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486ed0220 0x55b486ed0600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ee6190 0x55b486ee0cc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f34157fa700 0 client.6003 ms_handle_reset on v2:172.21.15.150:6834/1105578724 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486ee4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 --2- 172.21.15.148:0/3570663330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebf980 0x55b486ee4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 >> 172.21.15.148:0/3570663330 conn(0x55b486c79e40 msgr2=0x55b486f03300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 shutdown_connections 2023-10-24T00:42:00.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 1 -- 172.21.15.148:0/3570663330 wait complete. 2023-10-24T00:42:00.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.729+0000 7f344f32eb80 20 client.6003 trim_cache size 0 max 16384 2023-10-24T00:42:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.745+0000 7f344f32eb80 1 Processor -- start 2023-10-24T00:42:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 -- start start 2023-10-24T00:42:00.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486f06590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486f0bc30 con 0x55b486ebf980 2023-10-24T00:42:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486f126f0 con 0x55b486ebcb20 2023-10-24T00:42:00.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b486f00a90 con 0x55b486ee6190 2023-10-24T00:42:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35368/0 (socket says 172.21.15.148:35368) 2023-10-24T00:42:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.746+0000 7f342e7fc700 1 -- 172.21.15.148:0/612719578 learned_addr learned my addr 172.21.15.148:0/612719578 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 -- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 msgr2=0x55b486eb9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 -- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 msgr2=0x55b486f06590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486f06590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 -- 172.21.15.148:0/612719578 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b486e031d0 con 0x55b486ebf980 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342e7fc700 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f3420011ba0 tx=0x7f3420016000).ready entity=mon.0 client_cookie=9689e8d296036a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342cff9700 1 -- 172.21.15.148:0/612719578 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200159b0 con 0x55b486ebf980 2023-10-24T00:42:00.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342cff9700 1 -- 172.21.15.148:0/612719578 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420015b10 con 0x55b486ebf980 2023-10-24T00:42:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f342cff9700 1 -- 172.21.15.148:0/612719578 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420015e90 con 0x55b486ebf980 2023-10-24T00:42:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 -- 172.21.15.148:0/612719578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 msgr2=0x55b486f12200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f3420011ba0 tx=0x7f3420016000).stop 2023-10-24T00:42:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 -- 172.21.15.148:0/612719578 shutdown_connections 2023-10-24T00:42:00.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ee6190 0x55b486eb9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ebcb20 0x55b486f06590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 --2- 172.21.15.148:0/612719578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486f12200 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 -- 172.21.15.148:0/612719578 >> 172.21.15.148:0/612719578 conn(0x55b486c79e40 msgr2=0x55b486ee4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 -- 172.21.15.148:0/612719578 shutdown_connections 2023-10-24T00:42:00.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.747+0000 7f344f32eb80 1 -- 172.21.15.148:0/612719578 wait complete. 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.748+0000 7f344f32eb80 1 -- start start 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.748+0000 7f344f32eb80 1 Processor -- start 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 0x55b486eb85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 0x55b486f67650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486f6c180 con 0x55b486ebf980 2023-10-24T00:42:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b486ecfff0 con 0x55b486ee6190 2023-10-24T00:42:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b486ebf0d0 con 0x55b486ebcb20 2023-10-24T00:42:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f344f32eb80 10 client.0 ll_register_callbacks cb 0x55b486e7d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:42:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35382/0 (socket says 172.21.15.148:35382) 2023-10-24T00:42:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 -- 172.21.15.148:0/702282144 learned_addr learned my addr 172.21.15.148:0/702282144 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f3436ffd700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 0x55b486eb85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f34377fe700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 0x55b486f67650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 -- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 msgr2=0x55b486eb85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 0x55b486eb85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 -- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 msgr2=0x55b486f67650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 0x55b486f67650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 -- 172.21.15.148:0/702282144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34200119c0 con 0x55b486ebf980 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f34377fe700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 0x55b486f67650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f3436ffd700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 0x55b486eb85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:42:00.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f342e7fc700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f3420009930 tx=0x7f3420019000).ready entity=mon.0 client_cookie=9fe5de38d92da2a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.749+0000 7f34157fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:42:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420035440 con 0x55b486ebf980 2023-10-24T00:42:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3420036e00 con 0x55b486ebf980 2023-10-24T00:42:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34300127d0 con 0x55b486ebf980 2023-10-24T00:42:00.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342002c630 con 0x55b486ebf980 2023-10-24T00:42:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 10 client.6009 fetch_fsmap learned FSMap version 19 2023-10-24T00:42:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b486c7af80 con 0x55b486ebf980 2023-10-24T00:42:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300127d0 con 0x55b486ebf980 2023-10-24T00:42:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 19) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f342002c790 con 0x55b486ebf980 2023-10-24T00:42:00.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 10 client.6009 fetch_fsmap finished waiting for FSMap version 19 2023-10-24T00:42:00.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 10 client.6009 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:42:00.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 20 client.6009 populate_metadata read hostname 'smithi148' 2023-10-24T00:42:00.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486f01c10 0x55b486f01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 4 client.6009 mds_command: new command op to 5865 tid=0[{"prefix": "status"}] 2023-10-24T00:42:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 --> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b486c75ca0 con 0x55b486f01c10 2023-10-24T00:42:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.750+0000 7f3436ffd700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486f01c10 0x55b486f01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f34157fa700 10 client.6009 ms_handle_connect on v2:172.21.15.150:6834/1105578724 2023-10-24T00:42:00.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f3436ffd700 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486f01c10 0x55b486f01ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4a7ab44351b7b75c server_cookie=8e8c631f0b4fe1b9 in_seq=0 out_seq=0 2023-10-24T00:42:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f34157fa700 1 -- 172.21.15.148:0/702282144 <== mds.0 v2:172.21.15.150:6834/1105578724 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b486c75ca0 con 0x55b486f01c10 2023-10-24T00:42:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f34157fa700 10 client.6009 handle_command_reply: tid=0 2023-10-24T00:42:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 client.6009 shutdown 2023-10-24T00:42:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 msgr2=0x55b486eb8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f3420009930 tx=0x7f3420019000).stop 2023-10-24T00:42:00.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 shutdown_connections 2023-10-24T00:42:00.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:6834/1105578724,v1:172.21.15.150:6836/1105578724] conn(0x55b486f01c10 0x55b486f01ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b486ee6190 0x55b486f67650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f34157fa700 0 client.6009 ms_handle_reset on v2:172.21.15.150:6834/1105578724 2023-10-24T00:42:00.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b486ebcb20 0x55b486eb85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 --2- 172.21.15.148:0/702282144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b486ebf980 0x55b486eb8ac0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 >> 172.21.15.148:0/702282144 conn(0x55b486c79e40 msgr2=0x55b486f064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 shutdown_connections 2023-10-24T00:42:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 1 -- 172.21.15.148:0/702282144 wait complete. 2023-10-24T00:42:00.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.751+0000 7f344f32eb80 20 client.6009 trim_cache size 0 max 16384 2023-10-24T00:42:00.778 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:42:00.778 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:42:00.778 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:42:00.778 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 5865, 2023-10-24T00:42:00.779 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:42:00.779 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:42:00.779 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:42:00.779 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 5.2831104069999997, 2023-10-24T00:42:00.779 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 19, 2023-10-24T00:42:00.780 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 63, 2023-10-24T00:42:00.780 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 63, 2023-10-24T00:42:00.780 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 9.767684483 2023-10-24T00:42:00.780 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:42:00.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 msgr2=0x7f3418061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 0x7f3418061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3420006bc0 tx=0x7f3420008040).stop 2023-10-24T00:42:00.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 msgr2=0x7f34380ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f342800c4c0 tx=0x7f3428007c10).stop 2023-10-24T00:42:00.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 shutdown_connections 2023-10-24T00:42:00.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34380c6420 0x7f34380c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f341805f150 0x7f3418061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3438064a50 0x7f34380ae880 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 --2- 172.21.15.148:0/534629153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34380c4680 0x7f34380c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 >> 172.21.15.148:0/534629153 conn(0x7f3438092510 msgr2=0x7f34380c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 shutdown_connections 2023-10-24T00:42:00.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.752+0000 7f343d996700 1 -- 172.21.15.148:0/534629153 wait complete. 2023-10-24T00:42:00.784 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:42:00.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.884+0000 7f6a0ffff700 1 Processor -- start 2023-10-24T00:42:00.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.884+0000 7f6a0ffff700 1 -- start start 2023-10-24T00:42:00.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f6a100ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0ffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100c5410 con 0x7f6a101542a0 2023-10-24T00:42:00.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0ffff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100c56f0 con 0x7f6a100ab0b0 2023-10-24T00:42:00.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100cbd70 con 0x7f6a1006a970 2023-10-24T00:42:00.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a101542a0 0x7f6a100aa9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39928/0 (socket says 172.21.15.148:39928) 2023-10-24T00:42:00.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0effd700 1 -- 172.21.15.148:0/2295078815 learned_addr learned my addr 172.21.15.148:0/2295078815 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:42:00.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a067fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f6a100ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463096761 0 0) 0x7f6a100c5410 con 0x7f6a101542a0 2023-10-24T00:42:00.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69fc0033f0 con 0x7f6a101542a0 2023-10-24T00:42:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2439275924 0 0) 0x7f69fc0033f0 con 0x7f6a101542a0 2023-10-24T00:42:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 msgr2=0x7f6a100ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f6a100ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 >> v1:172.21.15.150:6789/0 conn(0x7f6a100ab0b0 legacy=0x7f6a100c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.885+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100c8db0 con 0x7f6a101542a0 2023-10-24T00:42:00.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6a00001470 con 0x7f6a101542a0 2023-10-24T00:42:00.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 >> v1:172.21.15.148:6789/0 conn(0x7f6a101542a0 legacy=0x7f6a100aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc003910 0x7f69fc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f69fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc004b80 0x7f69fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100cbd70 con 0x7f69fc003910 2023-10-24T00:42:00.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc00b910 con 0x7f69fc004b80 2023-10-24T00:42:00.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc00bad0 con 0x7f6a1006a970 2023-10-24T00:42:00.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc003910 0x7f69fc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a067fc700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f69fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0f7fe700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc004b80 0x7f69fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 -- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 msgr2=0x7f69fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a1006a970 0x7f69fc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 -- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc004b80 msgr2=0x7f69fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc004b80 0x7f69fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 -- 172.21.15.148:0/2295078815 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0033f0 con 0x7f69fc003910 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0effd700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc003910 0x7f69fc003d30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f6a0000c190 tx=0x7f6a00001e50).ready entity=mon.0 client_cookie=6fee0842a90a25c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00007a20 con 0x7f69fc003910 2023-10-24T00:42:00.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000cac0 con 0x7f69fc003910 2023-10-24T00:42:00.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.886+0000 7f6a0e7fc700 1 -- 172.21.15.148:0/2295078815 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ce40 con 0x7f69fc003910 2023-10-24T00:42:00.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 -- 172.21.15.148:0/2295078815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc003910 msgr2=0x7f69fc003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/2295078815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc003910 0x7f69fc003d30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f6a0000c190 tx=0x7f6a00001e50).stop 2023-10-24T00:42:00.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0f7fe700 1 -- 172.21.15.148:0/2295078815 reap_dead start 2023-10-24T00:42:00.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 -- 172.21.15.148:0/2295078815 shutdown_connections 2023-10-24T00:42:00.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 -- 172.21.15.148:0/2295078815 >> 172.21.15.148:0/2295078815 conn(0x7f6a1006a560 msgr2=0x7f6a100cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:00.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 -- 172.21.15.148:0/2295078815 shutdown_connections 2023-10-24T00:42:00.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.887+0000 7f6a0ffff700 1 -- 172.21.15.148:0/2295078815 wait complete. 2023-10-24T00:42:00.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.888+0000 7f6a0ffff700 1 Processor -- start 2023-10-24T00:42:00.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.888+0000 7f6a0ffff700 1 -- start start 2023-10-24T00:42:00.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc003910 0x7f6a100bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a1014b440 0x7f6a100986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1014b8c0 con 0x7f6a101674c0 2023-10-24T00:42:00.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100b0f70 con 0x7f6a1014b440 2023-10-24T00:42:00.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10096160 con 0x7f69fc003910 2023-10-24T00:42:00.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35394/0 (socket says 172.21.15.148:35394) 2023-10-24T00:42:00.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 -- 172.21.15.148:0/438632323 learned_addr learned my addr 172.21.15.148:0/438632323 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:00.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a067fc700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a1014b440 0x7f6a100986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0effd700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc003910 0x7f6a100bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 -- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc003910 msgr2=0x7f6a100bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc003910 0x7f6a100bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 -- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a1014b440 msgr2=0x7f6a100986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:00.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a1014b440 0x7f6a100986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:00.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 -- 172.21.15.148:0/438632323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1014baf0 con 0x7f6a101674c0 2023-10-24T00:42:00.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0f7fe700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6a100838e0 tx=0x7f6a08009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800eea0 con 0x7f6a101674c0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08003030 con 0x7f6a101674c0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080033d0 con 0x7f6a101674c0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a10167e30 con 0x7f6a101674c0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.889+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1014bd60 con 0x7f6a101674c0 2023-10-24T00:42:00.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.890+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1014bf80 con 0x7f6a101674c0 2023-10-24T00:42:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.891+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6a080019a0 con 0x7f6a101674c0 2023-10-24T00:42:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.891+0000 7f6a077fe700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 0x7f69f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.891+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a08079590 con 0x7f6a101674c0 2023-10-24T00:42:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.891+0000 7f6a0effd700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 0x7f69f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:00.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.892+0000 7f6a0effd700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 0x7f69f0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6a00001e90 tx=0x7f6a00015000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:00.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:00.895+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a0804a860 con 0x7f6a101674c0 2023-10-24T00:42:01.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.102+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a100962a0 con 0x7f6a101674c0 2023-10-24T00:42:01.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.102+0000 7f6a077fe700 1 -- 172.21.15.148:0/438632323 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a0801c070 con 0x7f6a101674c0 2023-10-24T00:42:01.105 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:42:01.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 msgr2=0x7f69f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 0x7f69f0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6a00001e90 tx=0x7f6a00015000).stop 2023-10-24T00:42:01.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 msgr2=0x7f6a10167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6a100838e0 tx=0x7f6a08009040).stop 2023-10-24T00:42:01.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 shutdown_connections 2023-10-24T00:42:01.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69f005f150 0x7f69f0061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a101674c0 0x7f6a10167940 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc003910 0x7f6a100bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 --2- 172.21.15.148:0/438632323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a1014b440 0x7f6a100986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 >> 172.21.15.148:0/438632323 conn(0x7f6a1006a560 msgr2=0x7f6a100c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:01.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 shutdown_connections 2023-10-24T00:42:01.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.104+0000 7f6a0ffff700 1 -- 172.21.15.148:0/438632323 wait complete. 2023-10-24T00:42:01.117 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:42:01.117 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:42:01.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:42:01.118 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:42:01.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:42:01.118 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:42:01.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:42:01.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:42:01.119 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:42:01.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.120 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:42:01.136 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:42:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:42:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:42:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:42:01.138 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:42:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:42:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:42:01.138 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:42:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:42:01.139 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:42:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:42:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:42:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41607sec preferred_lft 41607sec 2023-10-24T00:42:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:42:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.140 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:42:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:42:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:42:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:42:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.142 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:42:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:42:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:42:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:42:01.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.143 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:42:01.199 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:42:01.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.201 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:42:01.258 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:42:01.355 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:42:01.356 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:42:01.356 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:42:01.356 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:42:01.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.357 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:42:01.357 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:42:01.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:42:01.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:42:01.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:42:01.359 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:42:01.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.421 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:42:01.435 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:42:01.435 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:42:01.436 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:42:01.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:42:01.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.500 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:42:01.555 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:42:01.555 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:42:01.633 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:42:01.634 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:42:01.660 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:42:01.660 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:42:01.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:42:01.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:42:01.664 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:42:01.729 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:42:01.831 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:42:01.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:42:01.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.886+0000 7fdf774c7700 1 Processor -- start 2023-10-24T00:42:01.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.886+0000 7fdf774c7700 1 -- start start 2023-10-24T00:42:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf774c7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf700c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf774c7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700c01c0 con 0x7fdf701547e0 2023-10-24T00:42:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf774c7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700c6150 con 0x7fdf700c0b30 2023-10-24T00:42:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf774c7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700aa960 con 0x7fdf70154400 2023-10-24T00:42:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf74a62700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdf701547e0 0x7fdf700a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39942/0 (socket says 172.21.15.148:39942) 2023-10-24T00:42:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf74a62700 1 -- 172.21.15.148:0/3659751075 learned_addr learned my addr 172.21.15.148:0/3659751075 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:42:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761105807 0 0) 0x7fdf700c01c0 con 0x7fdf701547e0 2023-10-24T00:42:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf75263700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf700c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5c0033f0 con 0x7fdf701547e0 2023-10-24T00:42:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949628575 0 0) 0x7fdf5c0033f0 con 0x7fdf701547e0 2023-10-24T00:42:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 msgr2=0x7fdf700c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf700c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 >> v1:172.21.15.150:6789/0 conn(0x7fdf700c0b30 legacy=0x7fdf700c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700c66f0 con 0x7fdf701547e0 2023-10-24T00:42:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fdf60001470 con 0x7fdf701547e0 2023-10-24T00:42:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.887+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 >> v1:172.21.15.148:6789/0 conn(0x7fdf701547e0 legacy=0x7fdf700a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf5c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c003e40 0x7fdf5c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf5c004b80 0x7fdf5c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700aa960 con 0x7fdf5c004b80 2023-10-24T00:42:01.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c00ba10 con 0x7fdf5c003e40 2023-10-24T00:42:01.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c00bbd0 con 0x7fdf70154400 2023-10-24T00:42:01.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf5c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf74a62700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c003e40 0x7fdf5c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75a64700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf5c004b80 0x7fdf5c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 -- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c003e40 msgr2=0x7fdf5c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:01.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf5c003e40 0x7fdf5c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 -- 172.21.15.148:0/3659751075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf5c004b80 msgr2=0x7fdf5c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf5c004b80 0x7fdf5c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 -- 172.21.15.148:0/3659751075 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0033f0 con 0x7fdf70154400 2023-10-24T00:42:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf75263700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf5c003910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdf6c009a60 tx=0x7fdf6c009060).ready entity=mon.2 client_cookie=fd13438103205c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c009ea0 con 0x7fdf70154400 2023-10-24T00:42:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c009430 con 0x7fdf70154400 2023-10-24T00:42:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.888+0000 7fdf67fff700 1 -- 172.21.15.148:0/3659751075 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00e870 con 0x7fdf70154400 2023-10-24T00:42:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 -- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 msgr2=0x7fdf5c003910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 --2- 172.21.15.148:0/3659751075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70154400 0x7fdf5c003910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fdf6c009a60 tx=0x7fdf6c009060).stop 2023-10-24T00:42:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf75a64700 1 -- 172.21.15.148:0/3659751075 reap_dead start 2023-10-24T00:42:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 -- 172.21.15.148:0/3659751075 shutdown_connections 2023-10-24T00:42:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 -- 172.21.15.148:0/3659751075 >> 172.21.15.148:0/3659751075 conn(0x7fdf700946a0 msgr2=0x7fdf7006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 -- 172.21.15.148:0/3659751075 shutdown_connections 2023-10-24T00:42:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.889+0000 7fdf774c7700 1 -- 172.21.15.148:0/3659751075 wait complete. 2023-10-24T00:42:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.890+0000 7fdf774c7700 1 Processor -- start 2023-10-24T00:42:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.890+0000 7fdf774c7700 1 -- start start 2023-10-24T00:42:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf70154400 0x7fdf701658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70152710 0x7fdf700b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70154c10 con 0x7fdf700ace20 2023-10-24T00:42:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70165db0 con 0x7fdf70154400 2023-10-24T00:42:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf774c7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70155a30 con 0x7fdf70152710 2023-10-24T00:42:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35406/0 (socket says 172.21.15.148:35406) 2023-10-24T00:42:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 -- 172.21.15.148:0/1814439817 learned_addr learned my addr 172.21.15.148:0/1814439817 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75263700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf70154400 0x7fdf701658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf74a62700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70152710 0x7fdf700b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 -- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70152710 msgr2=0x7fdf700b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70152710 0x7fdf700b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 -- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf70154400 msgr2=0x7fdf701658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf70154400 0x7fdf701658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 -- 172.21.15.148:0/1814439817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700ad790 con 0x7fdf700ace20 2023-10-24T00:42:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.891+0000 7fdf75a64700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fdf70083c90 tx=0x7fdf68007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.892+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68006c30 con 0x7fdf700ace20 2023-10-24T00:42:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.892+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf68006d90 con 0x7fdf700ace20 2023-10-24T00:42:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.892+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70152b90 con 0x7fdf700ace20 2023-10-24T00:42:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.892+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68007280 con 0x7fdf700ace20 2023-10-24T00:42:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.892+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70155100 con 0x7fdf700ace20 2023-10-24T00:42:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.893+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7006c6b0 con 0x7fdf700ace20 2023-10-24T00:42:01.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.893+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdf68007670 con 0x7fdf700ace20 2023-10-24T00:42:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.893+0000 7fdf657fa700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 0x7fdf54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.893+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf68079ad0 con 0x7fdf700ace20 2023-10-24T00:42:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.894+0000 7fdf75263700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 0x7fdf54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.894+0000 7fdf75263700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 0x7fdf54061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf6c006d50 tx=0x7fdf6c01a000).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:01.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:01.897+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf68049af0 con 0x7fdf700ace20 2023-10-24T00:42:02.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.087+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf700bffa0 con 0x7fdf5405f150 2023-10-24T00:42:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.090+0000 7fdf657fa700 1 -- 172.21.15.148:0/1814439817 <== mgr.5377 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdf700bffa0 con 0x7fdf5405f150 2023-10-24T00:42:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:42:02.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:42:02.092 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:42:02.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:42:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:42:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 msgr2=0x7fdf54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 0x7fdf54061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdf6c006d50 tx=0x7fdf6c01a000).stop 2023-10-24T00:42:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 msgr2=0x7fdf700ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fdf70083c90 tx=0x7fdf68007f30).stop 2023-10-24T00:42:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 shutdown_connections 2023-10-24T00:42:02.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5405f150 0x7fdf54061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf700ace20 0x7fdf700ad2a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf70154400 0x7fdf701658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 --2- 172.21.15.148:0/1814439817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf70152710 0x7fdf700b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 >> 172.21.15.148:0/1814439817 conn(0x7fdf700946a0 msgr2=0x7fdf700aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 shutdown_connections 2023-10-24T00:42:02.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.091+0000 7fdf774c7700 1 -- 172.21.15.148:0/1814439817 wait complete. 2023-10-24T00:42:02.105 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:42:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.259+0000 7f264fa1a700 1 Processor -- start 2023-10-24T00:42:02.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.259+0000 7f264fa1a700 1 -- start start 2023-10-24T00:42:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264fa1a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648154430 0x7f2648154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264fa1a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2648098bd0 0x7f26480c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264fa1a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26480c71d0 con 0x7f26480bffd0 2023-10-24T00:42:02.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264fa1a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480c9410 con 0x7f2648098bd0 2023-10-24T00:42:02.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264fa1a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480c6c10 con 0x7f2648154430 2023-10-24T00:42:02.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264cfb5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2648098bd0 0x7f26480c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264cfb5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2648098bd0 0x7f26480c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35412/0 (socket says 172.21.15.148:35412) 2023-10-24T00:42:02.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264cfb5700 1 -- 172.21.15.148:0/2678790722 learned_addr learned my addr 172.21.15.148:0/2678790722 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:02.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.260+0000 7f264d7b6700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648154430 0x7f2648154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264cfb5700 1 -- 172.21.15.148:0/2678790722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648154430 msgr2=0x7f2648154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264cfb5700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648154430 0x7f2648154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264cfb5700 1 -- 172.21.15.148:0/2678790722 >> v1:172.21.15.150:6789/0 conn(0x7f26480bffd0 legacy=0x7f26480c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264cfb5700 1 -- 172.21.15.148:0/2678790722 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480c6ef0 con 0x7f2648098bd0 2023-10-24T00:42:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264cfb5700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648098bd0 0x7f26480c6300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f2638009830 tx=0x7f26380090f0).ready entity=mon.0 client_cookie=37632c51c25981d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f263ffff700 1 -- 172.21.15.148:0/2678790722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800b600 con 0x7f2648098bd0 2023-10-24T00:42:02.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f263ffff700 1 -- 172.21.15.148:0/2678790722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800b760 con 0x7f2648098bd0 2023-10-24T00:42:02.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f263ffff700 1 -- 172.21.15.148:0/2678790722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800bae0 con 0x7f2648098bd0 2023-10-24T00:42:02.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 -- 172.21.15.148:0/2678790722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648098bd0 msgr2=0x7f26480c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648098bd0 0x7f26480c6300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f2638009830 tx=0x7f26380090f0).stop 2023-10-24T00:42:02.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 -- 172.21.15.148:0/2678790722 shutdown_connections 2023-10-24T00:42:02.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648154430 0x7f2648154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2678790722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648098bd0 0x7f26480c6300 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 -- 172.21.15.148:0/2678790722 >> 172.21.15.148:0/2678790722 conn(0x7f26480cb070 msgr2=0x7f26480cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:02.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 -- 172.21.15.148:0/2678790722 shutdown_connections 2023-10-24T00:42:02.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.261+0000 7f264fa1a700 1 -- 172.21.15.148:0/2678790722 wait complete. 2023-10-24T00:42:02.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.263+0000 7f264fa1a700 1 Processor -- start 2023-10-24T00:42:02.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.263+0000 7f264fa1a700 1 -- start start 2023-10-24T00:42:02.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.263+0000 7f264fa1a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648098bd0 0x7f26480aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.263+0000 7f264fa1a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26480bffd0 0x7f264814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.263+0000 7f264fa1a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264fa1a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26480b0940 con 0x7f2648154430 2023-10-24T00:42:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264fa1a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26480afd30 con 0x7f26480bffd0 2023-10-24T00:42:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264fa1a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480b0010 con 0x7f2648098bd0 2023-10-24T00:42:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35428/0 (socket says 172.21.15.148:35428) 2023-10-24T00:42:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 -- 172.21.15.148:0/2316415547 learned_addr learned my addr 172.21.15.148:0/2316415547 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264d7b6700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648098bd0 0x7f26480aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264cfb5700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26480bffd0 0x7f264814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 -- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648098bd0 msgr2=0x7f26480aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648098bd0 0x7f26480aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 -- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26480bffd0 msgr2=0x7f264814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26480bffd0 0x7f264814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 -- 172.21.15.148:0/2316415547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638009370 con 0x7f2648154430 2023-10-24T00:42:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264dfb7700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2640002230 tx=0x7f26400015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000e4a0 con 0x7f2648154430 2023-10-24T00:42:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264000e600 con 0x7f2648154430 2023-10-24T00:42:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26480b02f0 con 0x7f2648154430 2023-10-24T00:42:02.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000e980 con 0x7f2648154430 2023-10-24T00:42:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.264+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26480b0dd0 con 0x7f2648154430 2023-10-24T00:42:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.265+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26480b0ab0 con 0x7f2648154430 2023-10-24T00:42:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.266+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f264001b3b0 con 0x7f2648154430 2023-10-24T00:42:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.266+0000 7f263d7fa700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 0x7f262c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.266+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f26400797f0 con 0x7f2648154430 2023-10-24T00:42:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.266+0000 7f264d7b6700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 0x7f262c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.267+0000 7f264d7b6700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 0x7f262c061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f264400bb10 tx=0x7f2644008040).ready entity=mgr.5377 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.270+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2640048af0 con 0x7f2648154430 2023-10-24T00:42:02.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:02.476+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f26480c90a0 con 0x7f2648154430 2023-10-24T00:42:03.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.145+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f26400775c0 con 0x7f2648154430 2023-10-24T00:42:03.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.146+0000 7f263d7fa700 1 -- 172.21.15.148:0/2316415547 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2640074e70 con 0x7f2648154430 2023-10-24T00:42:03.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 msgr2=0x7f262c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 0x7f262c061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f264400bb10 tx=0x7f2644008040).stop 2023-10-24T00:42:03.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 msgr2=0x7f264814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f2640002230 tx=0x7f26400015e0).stop 2023-10-24T00:42:03.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 shutdown_connections 2023-10-24T00:42:03.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f262c05f150 0x7f262c061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648154430 0x7f264814c9c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2648098bd0 0x7f26480aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 --2- 172.21.15.148:0/2316415547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26480bffd0 0x7f264814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 >> 172.21.15.148:0/2316415547 conn(0x7f26480cb070 msgr2=0x7f26480a87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 shutdown_connections 2023-10-24T00:42:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.148+0000 7f264fa1a700 1 -- 172.21.15.148:0/2316415547 wait complete. 2023-10-24T00:42:03.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:42:03.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.281+0000 7f6d4d11f700 1 Processor -- start 2023-10-24T00:42:03.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.282+0000 7f6d4d11f700 1 -- start start 2023-10-24T00:42:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.282+0000 7f6d4d11f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6d480c4940 0x7f6d48154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.282+0000 7f6d4d11f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480bec40 con 0x7f6d480c95d0 2023-10-24T00:42:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.282+0000 7f6d4d11f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480be650 con 0x7f6d48154430 2023-10-24T00:42:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.282+0000 7f6d4d11f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480a82c0 con 0x7f6d480c4940 2023-10-24T00:42:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6d480c95d0 0x7f6d480c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39964/0 (socket says 172.21.15.148:39964) 2023-10-24T00:42:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4659c700 1 -- 172.21.15.148:0/1205957530 learned_addr learned my addr 172.21.15.148:0/1205957530 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:42:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4759e700 1 --2- 172.21.15.148:0/1205957530 >> v2:172.21.15.150:3300/0 conn(0x7f6d480c4940 0x7f6d48154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301211730 0 0) 0x7f6d480bec40 con 0x7f6d480c95d0 2023-10-24T00:42:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d300033f0 con 0x7f6d480c95d0 2023-10-24T00:42:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290386151 0 0) 0x7f6d480be650 con 0x7f6d48154430 2023-10-24T00:42:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d480bec40 con 0x7f6d48154430 2023-10-24T00:42:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4759e700 1 -- 172.21.15.148:0/1205957530 >> v1:172.21.15.150:6789/0 conn(0x7f6d48154430 legacy=0x7f6d480a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4759e700 1 -- 172.21.15.148:0/1205957530 >> v1:172.21.15.148:6789/0 conn(0x7f6d480c95d0 legacy=0x7f6d480c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4759e700 1 -- 172.21.15.148:0/1205957530 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480a85a0 con 0x7f6d480c4940 2023-10-24T00:42:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d4759e700 1 --2- 172.21.15.148:0/1205957530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d48154810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6d40009e60 tx=0x7f6d40009780).ready entity=mon.1 client_cookie=bbbc126401c94aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000e070 con 0x7f6d480c4940 2023-10-24T00:42:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000bab0 con 0x7f6d480c4940 2023-10-24T00:42:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.283+0000 7f6d45d9b700 1 -- 172.21.15.148:0/1205957530 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000be30 con 0x7f6d480c4940 2023-10-24T00:42:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 -- 172.21.15.148:0/1205957530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 msgr2=0x7f6d48154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/1205957530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d48154810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f6d40009e60 tx=0x7f6d40009780).stop 2023-10-24T00:42:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 -- 172.21.15.148:0/1205957530 shutdown_connections 2023-10-24T00:42:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/1205957530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d48154810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 -- 172.21.15.148:0/1205957530 >> 172.21.15.148:0/1205957530 conn(0x7f6d480630d0 msgr2=0x7f6d480c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 -- 172.21.15.148:0/1205957530 shutdown_connections 2023-10-24T00:42:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.284+0000 7f6d4d11f700 1 -- 172.21.15.148:0/1205957530 wait complete. 2023-10-24T00:42:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.285+0000 7f6d4d11f700 1 Processor -- start 2023-10-24T00:42:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.285+0000 7f6d4d11f700 1 -- start start 2023-10-24T00:42:03.296 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:03.290+0000 7f8167909680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:42:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d4814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d48154430 0x7f6d480c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c2d50 con 0x7f6d480c95d0 2023-10-24T00:42:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c0000 con 0x7f6d480c4940 2023-10-24T00:42:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4d11f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c02e0 con 0x7f6d48154430 2023-10-24T00:42:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35452/0 (socket says 172.21.15.148:35452) 2023-10-24T00:42:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4659c700 1 -- 172.21.15.148:0/3797887334 learned_addr learned my addr 172.21.15.148:0/3797887334 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d4814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d4759e700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d48154430 0x7f6d480c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 -- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d48154430 msgr2=0x7f6d480c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d48154430 0x7f6d480c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 -- 172.21.15.148:0/3797887334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 msgr2=0x7f6d480c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.286+0000 7f6d46d9d700 1 -- 172.21.15.148:0/3797887334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009a20 con 0x7f6d480c4940 2023-10-24T00:42:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d4659c700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:42:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d46d9d700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d4814ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6d3c00c440 tx=0x7f6d3c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c012400 con 0x7f6d480c4940 2023-10-24T00:42:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c012560 con 0x7f6d480c4940 2023-10-24T00:42:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480c05c0 con 0x7f6d480c4940 2023-10-24T00:42:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c012920 con 0x7f6d480c4940 2023-10-24T00:42:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.287+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d481525f0 con 0x7f6d480c4940 2023-10-24T00:42:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4806c6b0 con 0x7f6d480c4940 2023-10-24T00:42:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f6d3c01b3b0 con 0x7f6d480c4940 2023-10-24T00:42:03.304 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:03.288+0000 7ffbec8e4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:42:03.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d2effd700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 0x7f6d34061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d4659c700 1 -- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 msgr2=0x7f6d34061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:03.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6d3c079940 con 0x7f6d480c4940 2023-10-24T00:42:03.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.288+0000 7f6d4659c700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 0x7f6d34061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:42:03.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.293+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6d3c04abb0 con 0x7f6d480c4940 2023-10-24T00:42:03.356 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:03.353+0000 7f8167909680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:42:03.356 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:03.354+0000 7ffbec8e4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:42:03.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.463+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6d480c0140 con 0x7f6d480c4940 2023-10-24T00:42:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.470+0000 7f6d2effd700 1 -- 172.21.15.148:0/3797887334 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6d480c0140 con 0x7f6d480c4940 2023-10-24T00:42:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 msgr2=0x7f6d34061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:42:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 0x7f6d34061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 msgr2=0x7f6d4814ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d4814ebf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f6d3c00c440 tx=0x7f6d3c007b90).stop 2023-10-24T00:42:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 shutdown_connections 2023-10-24T00:42:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6d48154430 0x7f6d480c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d480c4940 0x7f6d4814ebf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d3405f1a0 0x7f6d34061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 --2- 172.21.15.148:0/3797887334 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d480c95d0 0x7f6d480c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 >> 172.21.15.148:0/3797887334 conn(0x7f6d480630d0 msgr2=0x7f6d48066690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 shutdown_connections 2023-10-24T00:42:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.472+0000 7f6d4d11f700 1 -- 172.21.15.148:0/3797887334 wait complete. 2023-10-24T00:42:03.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:03.489 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T00:42:03.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-24T00:42:03.634 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:03.632+0000 7f8167909680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:42:03.646 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:03.643+0000 7ffbec8e4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:42:03.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.670+0000 7f0a5bf4b700 1 Processor -- start 2023-10-24T00:42:03.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.670+0000 7f0a5bf4b700 1 -- start start 2023-10-24T00:42:03.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a54150bd0 0x7f0a541549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 0x7f0a54063660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a54063b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a54064040 con 0x7f0a54150bd0 2023-10-24T00:42:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a54067070 con 0x7f0a540a6a00 2023-10-24T00:42:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5bf4b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54066460 con 0x7f0a54150fb0 2023-10-24T00:42:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a59ce7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a54150bd0 0x7f0a541549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a59ce7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a54150bd0 0x7f0a541549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60154/0 (socket says 172.21.15.148:60154) 2023-10-24T00:42:03.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a59ce7700 1 -- 172.21.15.148:0/937048401 learned_addr learned my addr 172.21.15.148:0/937048401 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a594e6700 1 --2- 172.21.15.148:0/937048401 >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 0x7f0a54063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a5a4e8700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a54063b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a59ce7700 1 -- 172.21.15.148:0/937048401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 msgr2=0x7f0a54063b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.671+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a54063b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a59ce7700 1 -- 172.21.15.148:0/937048401 >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 msgr2=0x7f0a54063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:03.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/937048401 >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 0x7f0a54063660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a59ce7700 1 -- 172.21.15.148:0/937048401 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54066740 con 0x7f0a54150bd0 2023-10-24T00:42:03.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a594e6700 1 --2- 172.21.15.148:0/937048401 >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 0x7f0a54063660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:42:03.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a541549d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f0a54068bd0 tx=0x7f0a500090f0).ready entity=mon.0 client_cookie=9936efaee68a3e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:03.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a58ce5700 1 -- 172.21.15.148:0/937048401 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000f510 con 0x7f0a54150bd0 2023-10-24T00:42:03.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a58ce5700 1 -- 172.21.15.148:0/937048401 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5000f670 con 0x7f0a54150bd0 2023-10-24T00:42:03.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a58ce5700 1 -- 172.21.15.148:0/937048401 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000f9f0 con 0x7f0a54150bd0 2023-10-24T00:42:03.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/937048401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 msgr2=0x7f0a541549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a541549d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f0a54068bd0 tx=0x7f0a500090f0).stop 2023-10-24T00:42:03.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/937048401 shutdown_connections 2023-10-24T00:42:03.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a541549d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/937048401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a54063b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/937048401 >> v2:172.21.15.150:3300/0 conn(0x7f0a540a6a00 0x7f0a54063660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.672+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/937048401 >> 172.21.15.148:0/937048401 conn(0x7f0a540c49e0 msgr2=0x7f0a54068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.673+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/937048401 shutdown_connections 2023-10-24T00:42:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.673+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/937048401 wait complete. 2023-10-24T00:42:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 Processor -- start 2023-10-24T00:42:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 -- start start 2023-10-24T00:42:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a540a6a00 0x7f0a540be980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a5414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5414b2c0 con 0x7f0a54150bd0 2023-10-24T00:42:03.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5414ed90 con 0x7f0a540a6a00 2023-10-24T00:42:03.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.674+0000 7f0a5bf4b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5414f070 con 0x7f0a54150fb0 2023-10-24T00:42:03.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60164/0 (socket says 172.21.15.148:60164) 2023-10-24T00:42:03.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 -- 172.21.15.148:0/2993361305 learned_addr learned my addr 172.21.15.148:0/2993361305 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:03.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a540a6a00 0x7f0a540be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a5a4e8700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a5414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 msgr2=0x7f0a5414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a5414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a540a6a00 msgr2=0x7f0a540be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a540a6a00 0x7f0a540be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440092a0 con 0x7f0a54150bd0 2023-10-24T00:42:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a594e6700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f0a4400ea20 tx=0x7f0a44009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400ee60 con 0x7f0a54150bd0 2023-10-24T00:42:03.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4400c850 con 0x7f0a54150bd0 2023-10-24T00:42:03.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a50009370 con 0x7f0a54150bd0 2023-10-24T00:42:03.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400cbd0 con 0x7f0a54150bd0 2023-10-24T00:42:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.675+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5414f630 con 0x7f0a54150bd0 2023-10-24T00:42:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5406c6b0 con 0x7f0a54150bd0 2023-10-24T00:42:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f0a4401b400 con 0x7f0a54150bd0 2023-10-24T00:42:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a49ffb700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:03.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a4407a6f0 con 0x7f0a54150bd0 2023-10-24T00:42:03.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a59ce7700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:03.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.677+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:42:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.681+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0a4404b960 con 0x7f0a54150bd0 2023-10-24T00:42:03.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.878+0000 7f0a59ce7700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:03.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.878+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:42:03.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:03.878+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a5405f590 con 0x7f0a3805f1a0 2023-10-24T00:42:04.249 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:04.247+0000 7f8167909680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:42:04.272 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:04.269+0000 7ffbec8e4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:42:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:04.279+0000 7f0a59ce7700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:04.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:04.279+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:42:04.321 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:04.319+0000 7f8167909680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:42:04.345 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:04.342+0000 7ffbec8e4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:42:04.507 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:04.504+0000 7f8167909680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:42:04.532 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:04.529+0000 7ffbec8e4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:42:04.928 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:04.926+0000 7f8167909680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:42:04.954 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:04.951+0000 7ffbec8e4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:42:05.031 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.029+0000 7f8167909680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:42:05.057 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.055+0000 7ffbec8e4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:42:05.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:05.080+0000 7f0a59ce7700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:05.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:05.080+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:42:05.184 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.182+0000 7f8167909680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:42:05.211 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.209+0000 7ffbec8e4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:42:05.259 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.257+0000 7f8167909680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:42:05.286 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.284+0000 7ffbec8e4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:42:05.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.324+0000 7f8167909680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:42:05.354 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.351+0000 7ffbec8e4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:42:05.585 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.583+0000 7f8167909680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:42:05.612 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.610+0000 7ffbec8e4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:42:05.768 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:05.765+0000 7f8167909680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:42:05.796 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:05.794+0000 7ffbec8e4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:42:06.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.420+0000 7f8167909680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:42:06.451 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.448+0000 7ffbec8e4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:42:06.491 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.489+0000 7f8167909680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:42:06.520 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.518+0000 7ffbec8e4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:42:06.566 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.564+0000 7f8167909680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:42:06.595 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.593+0000 7ffbec8e4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:42:06.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:06.681+0000 7f0a59ce7700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:42:06.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:06.681+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:42:06.713 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.711+0000 7f8167909680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:42:06.743 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.741+0000 7ffbec8e4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:42:06.782 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.780+0000 7f8167909680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:42:06.815 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.813+0000 7ffbec8e4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:42:06.895 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:06.893+0000 7f8167909680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:42:06.929 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:06.927+0000 7ffbec8e4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:42:07.004 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.002+0000 7f8167909680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:42:07.038 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:07.036+0000 7ffbec8e4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:42:07.294 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.292+0000 7f8167909680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:42:07.330 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:07.328+0000 7ffbec8e4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:42:07.365 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.363+0000 7f8167909680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:42:07.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:07.384+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 16) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f0a440784c0 con 0x7f0a54150bd0 2023-10-24T00:42:07.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:07.385+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a38061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:42:07.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:07.385+0000 7f0a49ffb700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a38061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:42:07.407 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:42:07.404+0000 7ffbec8e4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:42:07.447 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80de895700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.447 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80de895700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.447 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80de895700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.448 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80de895700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.448 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80de895700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.448 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80dc090700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.448 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80dc090700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.448 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80dc090700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.449 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80dc090700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:07.449 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:42:07.444+0000 7f80dc090700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:42:08.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.385+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0a44078840 con 0x7f0a54150bd0 2023-10-24T00:42:08.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.385+0000 7f0a49ffb700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a380615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.385+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a5405f590 con 0x7f0a3805f1a0 2023-10-24T00:42:08.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.387+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a380615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.389+0000 7f0a59ce7700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a380615e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0a50009130 tx=0x7f0a50017000).ready entity=mgr.5668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.411+0000 7f0a49ffb700 1 -- 172.21.15.148:0/2993361305 <== mgr.5668 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0a5405f590 con 0x7f0a3805f1a0 2023-10-24T00:42:08.414 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T00:42:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 msgr2=0x7f0a380615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a380615e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f0a50009130 tx=0x7f0a50017000).stop 2023-10-24T00:42:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 msgr2=0x7f0a5414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f0a4400ea20 tx=0x7f0a44009060).stop 2023-10-24T00:42:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 shutdown_connections 2023-10-24T00:42:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a54150fb0 0x7f0a5414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a540a6a00 0x7f0a540be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a3805f1a0 0x7f0a380615e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 --2- 172.21.15.148:0/2993361305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a54150bd0 0x7f0a5414fe30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.413+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 >> 172.21.15.148:0/2993361305 conn(0x7f0a540c49e0 msgr2=0x7f0a540accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.414+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 shutdown_connections 2023-10-24T00:42:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.414+0000 7f0a5bf4b700 1 -- 172.21.15.148:0/2993361305 wait complete. 2023-10-24T00:42:08.428 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T00:42:08.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-10-24T00:42:08.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.544+0000 7f5f6a484700 1 Processor -- start 2023-10-24T00:42:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.544+0000 7f5f6a484700 1 -- start start 2023-10-24T00:42:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f6a484700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f641544b0 0x7f5f640a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f6a484700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c6270 con 0x7f5f640c8290 2023-10-24T00:42:08.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f6a484700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c0c80 con 0x7f5f640aa640 2023-10-24T00:42:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f6a484700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640c60e0 con 0x7f5f641544b0 2023-10-24T00:42:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f637fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5f640c8290 0x7f5f640a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58544/0 (socket says 172.21.15.148:58544) 2023-10-24T00:42:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f637fe700 1 -- 172.21.15.148:0/1021017942 learned_addr learned my addr 172.21.15.148:0/1021017942 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:42:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f63fff700 1 --2- 172.21.15.148:0/1021017942 >> v2:172.21.15.150:3300/0 conn(0x7f5f641544b0 0x7f5f640a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.545+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774511756 0 0) 0x7f5f640c6270 con 0x7f5f640c8290 2023-10-24T00:42:08.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f4c0033f0 con 0x7f5f640c8290 2023-10-24T00:42:08.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544302787 0 0) 0x7f5f640c0c80 con 0x7f5f640aa640 2023-10-24T00:42:08.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f640c6270 con 0x7f5f640aa640 2023-10-24T00:42:08.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f63fff700 1 -- 172.21.15.148:0/1021017942 >> v1:172.21.15.150:6789/0 conn(0x7f5f640aa640 legacy=0x7f5f640c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f63fff700 1 -- 172.21.15.148:0/1021017942 >> v1:172.21.15.148:6789/0 conn(0x7f5f640c8290 legacy=0x7f5f640a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994652571 0 0) 0x7f5f4c0033f0 con 0x7f5f640c8290 2023-10-24T00:42:08.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f63fff700 1 -- 172.21.15.148:0/1021017942 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640c0f40 con 0x7f5f641544b0 2023-10-24T00:42:08.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f63fff700 1 --2- 172.21.15.148:0/1021017942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f641544b0 0x7f5f640a7d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f5f54009760 tx=0x7f5f54009060).ready entity=mon.1 client_cookie=e0ec8fc191f54b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58001470 con 0x7f5f641544b0 2023-10-24T00:42:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54011400 con 0x7f5f641544b0 2023-10-24T00:42:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f62ffd700 1 -- 172.21.15.148:0/1021017942 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011780 con 0x7f5f641544b0 2023-10-24T00:42:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f6a484700 1 -- 172.21.15.148:0/1021017942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f641544b0 msgr2=0x7f5f640a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.546+0000 7f5f6a484700 1 --2- 172.21.15.148:0/1021017942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f641544b0 0x7f5f640a7d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f5f54009760 tx=0x7f5f54009060).stop 2023-10-24T00:42:08.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.547+0000 7f5f6a484700 1 -- 172.21.15.148:0/1021017942 shutdown_connections 2023-10-24T00:42:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.547+0000 7f5f6a484700 1 --2- 172.21.15.148:0/1021017942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f641544b0 0x7f5f640a7d00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.547+0000 7f5f6a484700 1 -- 172.21.15.148:0/1021017942 >> 172.21.15.148:0/1021017942 conn(0x7f5f640945d0 msgr2=0x7f5f6406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.547+0000 7f5f6a484700 1 -- 172.21.15.148:0/1021017942 shutdown_connections 2023-10-24T00:42:08.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.547+0000 7f5f6a484700 1 -- 172.21.15.148:0/1021017942 wait complete. 2023-10-24T00:42:08.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.548+0000 7f5f6a484700 1 Processor -- start 2023-10-24T00:42:08.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.548+0000 7f5f6a484700 1 -- start start 2023-10-24T00:42:08.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 0x7f5f640adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f641544b0 0x7f5f64156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640ace60 con 0x7f5f640c8290 2023-10-24T00:42:08.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f641571d0 con 0x7f5f640aa640 2023-10-24T00:42:08.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640ae610 con 0x7f5f641544b0 2023-10-24T00:42:08.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60170/0 (socket says 172.21.15.148:60170) 2023-10-24T00:42:08.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 -- 172.21.15.148:0/3790316769 learned_addr learned my addr 172.21.15.148:0/3790316769 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:08.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f63fff700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 0x7f5f640adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f68a21700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f641544b0 0x7f5f64156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 -- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f641544b0 msgr2=0x7f5f64156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f641544b0 0x7f5f64156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 -- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 msgr2=0x7f5f640adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 0x7f5f640adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 -- 172.21.15.148:0/3790316769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540092a0 con 0x7f5f640c8290 2023-10-24T00:42:08.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f63fff700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 0x7f5f640adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:42:08.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f637fe700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f5f5800c800 tx=0x7f5f58001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007170 con 0x7f5f640c8290 2023-10-24T00:42:08.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f580072f0 con 0x7f5f640c8290 2023-10-24T00:42:08.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f640ae8f0 con 0x7f5f640c8290 2023-10-24T00:42:08.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f580048c0 con 0x7f5f640c8290 2023-10-24T00:42:08.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.549+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f640aeeb0 con 0x7f5f640c8290 2023-10-24T00:42:08.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.550+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f64154da0 con 0x7f5f640c8290 2023-10-24T00:42:08.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.551+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5f58004c70 con 0x7f5f640c8290 2023-10-24T00:42:08.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.551+0000 7f5f4bfff700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 0x7f5f50061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.551+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5f58079a40 con 0x7f5f640c8290 2023-10-24T00:42:08.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.551+0000 7f5f63fff700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 0x7f5f50061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.551+0000 7f5f63fff700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 0x7f5f50061510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5f54003000 tx=0x7f5f54016000).ready entity=mgr.5668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.555+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f5804ae80 con 0x7f5f640c8290 2023-10-24T00:42:08.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.742+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f6406c6b0 con 0x7f5f5005f050 2023-10-24T00:42:08.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.747+0000 7f5f4bfff700 1 -- 172.21.15.148:0/3790316769 <== mgr.5668 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5f6406c6b0 con 0x7f5f5005f050 2023-10-24T00:42:08.750 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T00:42:08.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 msgr2=0x7f5f50061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 0x7f5f50061510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5f54003000 tx=0x7f5f54016000).stop 2023-10-24T00:42:08.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 msgr2=0x7f5f640ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f5f5800c800 tx=0x7f5f58001a20).stop 2023-10-24T00:42:08.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 shutdown_connections 2023-10-24T00:42:08.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f641544b0 0x7f5f64156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f640aa640 0x7f5f640adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f5005f050 0x7f5f50061510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 --2- 172.21.15.148:0/3790316769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f640c8290 0x7f5f640ac970 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 >> 172.21.15.148:0/3790316769 conn(0x7f5f640945d0 msgr2=0x7f5f64064920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:08.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 shutdown_connections 2023-10-24T00:42:08.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.748+0000 7f5f6a484700 1 -- 172.21.15.148:0/3790316769 wait complete. 2023-10-24T00:42:08.762 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T00:42:08.763 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-24-00_43_00 in ~52s... 2023-10-24T00:42:08.763 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-24-00_44_00 in ~112s... 2023-10-24T00:42:08.764 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-10-24T00:42:08.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-24T00:42:08.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.878+0000 7ff1c986b700 1 Processor -- start 2023-10-24T00:42:08.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.878+0000 7ff1c986b700 1 -- start start 2023-10-24T00:42:08.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c986b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1c4135390 0x7ff1c40c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c986b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c40c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c986b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c40be9e0 con 0x7ff1c4066490 2023-10-24T00:42:08.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c986b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c40c3e20 con 0x7ff1c4135390 2023-10-24T00:42:08.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c986b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40bde40 con 0x7ff1c41539a0 2023-10-24T00:42:08.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1c4135390 0x7ff1c40c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff1c4135390 0x7ff1c40c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60174/0 (socket says 172.21.15.148:60174) 2023-10-24T00:42:08.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c2ffd700 1 -- 172.21.15.148:0/3731865977 learned_addr learned my addr 172.21.15.148:0/3731865977 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:08.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1c37fe700 1 --1- 172.21.15.148:0/3731865977 >> v1:172.21.15.148:6789/0 conn(0x7ff1c4066490 0x7ff1c40668f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58548/0 (socket says 172.21.15.148:58548) 2023-10-24T00:42:08.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.879+0000 7ff1ba7fc700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c40c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c2ffd700 1 -- 172.21.15.148:0/3731865977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 msgr2=0x7ff1c40c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:42:08.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c2ffd700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c40c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c2ffd700 1 -- 172.21.15.148:0/3731865977 >> v1:172.21.15.148:6789/0 conn(0x7ff1c4066490 legacy=0x7ff1c40668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c27fc700 1 -- 172.21.15.148:0/3731865977 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217240550 0 0) 0x7ff1c40be9e0 con 0x7ff1c4066490 2023-10-24T00:42:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c2ffd700 1 -- 172.21.15.148:0/3731865977 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4135770 con 0x7ff1c4135390 2023-10-24T00:42:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c2ffd700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c40c3440 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7ff1b4009810 tx=0x7ff1b4009060).ready entity=mon.0 client_cookie=7d425542a6cfb719 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c27fc700 1 -- 172.21.15.148:0/3731865977 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4005880 con 0x7ff1c4135390 2023-10-24T00:42:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c27fc700 1 -- 172.21.15.148:0/3731865977 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b40059e0 con 0x7ff1c4135390 2023-10-24T00:42:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c27fc700 1 -- 172.21.15.148:0/3731865977 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4005d60 con 0x7ff1c4135390 2023-10-24T00:42:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 -- 172.21.15.148:0/3731865977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 msgr2=0x7ff1c40c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c40c3440 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7ff1b4009810 tx=0x7ff1b4009060).stop 2023-10-24T00:42:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 -- 172.21.15.148:0/3731865977 shutdown_connections 2023-10-24T00:42:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c40c3440 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 --2- 172.21.15.148:0/3731865977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c40c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 -- 172.21.15.148:0/3731865977 >> 172.21.15.148:0/3731865977 conn(0x7ff1c4063120 msgr2=0x7ff1c40c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 -- 172.21.15.148:0/3731865977 shutdown_connections 2023-10-24T00:42:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.880+0000 7ff1c986b700 1 -- 172.21.15.148:0/3731865977 wait complete. 2023-10-24T00:42:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 Processor -- start 2023-10-24T00:42:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 -- start start 2023-10-24T00:42:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c4066490 0x7ff1c4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40ae710 con 0x7ff1c4135390 2023-10-24T00:42:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40adb00 con 0x7ff1c4066490 2023-10-24T00:42:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.882+0000 7ff1c986b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40adde0 con 0x7ff1c41539a0 2023-10-24T00:42:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60180/0 (socket says 172.21.15.148:60180) 2023-10-24T00:42:08.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 -- 172.21.15.148:0/793700535 learned_addr learned my addr 172.21.15.148:0/793700535 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:42:08.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1c2ffd700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c4066490 0x7ff1c4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1c37fe700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 -- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 msgr2=0x7ff1c4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c4156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 -- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c4066490 msgr2=0x7ff1c4156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:08.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c4066490 0x7ff1c4156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:08.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 -- 172.21.15.148:0/793700535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4009300 con 0x7ff1c4135390 2023-10-24T00:42:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1ba7fc700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff1ac00e900 tx=0x7ff1ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac012600 con 0x7ff1c4135390 2023-10-24T00:42:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac012760 con 0x7ff1c4135390 2023-10-24T00:42:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c40ae0c0 con 0x7ff1c4135390 2023-10-24T00:42:08.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac012ae0 con 0x7ff1c4135390 2023-10-24T00:42:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.883+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c4134a00 con 0x7ff1c4135390 2023-10-24T00:42:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.884+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4155fb0 con 0x7ff1c4135390 2023-10-24T00:42:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.884+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7ff1ac01b400 con 0x7ff1c4135390 2023-10-24T00:42:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.885+0000 7ff1bb7fe700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 0x7ff1a4061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:42:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.885+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff1ac07a390 con 0x7ff1c4135390 2023-10-24T00:42:08.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.885+0000 7ff1c2ffd700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 0x7ff1a4061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:42:08.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.886+0000 7ff1c2ffd700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 0x7ff1a4061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff1c41545f0 tx=0x7ff1b4016000).ready entity=mgr.5668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:42:08.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:08.889+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff1ac04b720 con 0x7ff1c4135390 2023-10-24T00:42:09.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.078+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1c40ae850 con 0x7ff1a405f080 2023-10-24T00:42:09.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.080+0000 7ff1bb7fe700 1 -- 172.21.15.148:0/793700535 <== mgr.5668 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7ff1c40ae850 con 0x7ff1a405f080 2023-10-24T00:42:09.083 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:42:09.083 INFO:teuthology.orchestra.run.smithi148.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-24T00:42:09.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 msgr2=0x7ff1a4061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:09.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 0x7ff1a4061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff1c41545f0 tx=0x7ff1b4016000).stop 2023-10-24T00:42:09.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 msgr2=0x7ff1c4156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:42:09.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff1ac00e900 tx=0x7ff1ac009060).stop 2023-10-24T00:42:09.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 shutdown_connections 2023-10-24T00:42:09.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1c41539a0 0x7ff1c4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c4066490 0x7ff1c4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff1a405f080 0x7ff1a4061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 --2- 172.21.15.148:0/793700535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1c4135390 0x7ff1c4156650 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:42:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 >> 172.21.15.148:0/793700535 conn(0x7ff1c4063120 msgr2=0x7ff1c40c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:42:09.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 shutdown_connections 2023-10-24T00:42:09.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:42:09.082+0000 7ff1c986b700 1 -- 172.21.15.148:0/793700535 wait complete. 2023-10-24T00:42:09.096 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-24T00:42:09.097 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-10-24T00:42:09.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:09.097 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:10.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:10.115 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:11.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:11.134 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:12.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:12.155 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:13.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:13.177 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:14.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:14.198 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:15.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:15.220 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:16.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:16.241 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:17.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:17.261 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:18.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:18.283 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:19.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:19.305 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:20.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:20.326 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:21.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:21.348 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:22.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:22.370 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:23.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:23.391 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:24.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:24.413 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:25.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:25.435 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:26.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:26.455 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:27.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:27.476 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:28.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:28.498 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:29.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:29.519 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:30.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:30.540 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:31.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:31.561 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:31.915 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:42:31.918 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:42:32.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:32.582 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:33.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:33.604 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:34.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:34.625 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:35.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:35.646 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:36.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:36.668 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:37.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:37.689 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:38.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:38.710 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:39.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:39.730 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:40.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:40.751 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:41.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:41.773 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:42.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:42.794 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:43.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:43.815 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:44.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:44.837 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:45.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:45.858 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:46.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:46.882 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:47.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:47.906 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:48.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:48.930 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:49.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:49.951 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:50.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:50.974 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:51.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:51.994 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:53.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:53.015 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:54.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:54.035 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:55.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:55.056 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:56.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:56.078 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:57.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:57.099 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:58.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:58.120 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:42:59.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:42:59.141 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:00.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:00.163 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:00.753 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:43:00.751+0000 7f80ce074700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:43:00.753 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:43:00.751+0000 7f80ce074700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:43:00.754 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:43:00.751+0000 7f80ce074700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:43:00.754 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:43:00.751+0000 7f80ce074700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:43:00.754 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:43:00.751+0000 7f80ce074700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:43:01.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:01.184 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:01.204 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:01.205 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-24-00_43_00_UTC'] 2023-10-24T00:43:01.205 DEBUG:tasks.cephfs.test_snap_schedules:exec=1698108128.7633429, now = 1698108181.2054362, timo = 52 2023-10-24T00:43:01.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:43:01.979 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:43:02.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:02.207 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:02.225 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:03.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:03.229 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:03.249 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:04.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:04.251 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:04.271 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:05.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:05.273 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:05.293 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:06.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:06.294 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:06.314 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:07.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:07.317 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:07.335 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:08.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:08.338 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:08.357 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:09.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:09.359 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:09.379 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:10.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:10.382 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:10.400 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:11.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:11.402 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:11.422 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:12.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:12.424 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:12.443 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:13.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:13.445 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:13.464 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:14.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:14.467 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:14.486 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:15.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:15.489 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:15.508 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:16.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:16.511 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:16.530 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:17.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:17.532 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:17.551 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:18.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:18.554 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:18.573 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:19.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:19.575 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:19.594 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:20.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:20.597 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:20.617 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:21.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:21.620 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:21.638 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:22.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:22.641 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:22.660 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:23.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:23.662 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:23.681 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:24.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:24.683 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:24.704 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:25.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:25.705 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:25.725 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:26.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:26.727 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:26.746 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:27.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:27.748 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:27.768 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:28.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:28.771 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:28.789 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:29.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:29.792 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:29.811 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:30.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:30.813 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:30.833 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:31.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:31.835 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:31.856 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:32.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:43:32.063 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:43:32.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:32.857 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:32.876 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:33.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:33.878 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:33.897 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:34.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:34.899 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:34.919 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:35.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:35.922 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:35.941 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:36.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:36.944 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:36.962 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:37.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:37.965 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:37.985 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:38.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:38.987 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:39.005 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:40.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:40.007 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:40.027 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:41.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:41.029 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:41.048 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:42.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:42.050 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:42.069 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:43.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:43.072 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:43.092 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:44.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:44.093 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:44.112 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:45.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:45.118 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:45.137 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:46.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:46.140 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:46.160 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:47.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:47.163 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:47.183 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:48.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:48.185 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:48.205 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:49.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:49.209 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:49.229 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:50.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:50.231 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:50.250 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:51.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:51.252 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:51.272 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:52.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:52.274 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:52.293 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:53.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:53.295 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:53.315 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:54.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:54.318 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:54.337 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:55.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:55.340 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:55.360 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:56.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:56.362 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:56.382 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:57.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:57.384 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:57.402 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:58.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:58.404 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:58.423 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:43:59.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:43:59.427 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:43:59.447 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:44:00.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:00.448 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:44:00.467 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:44:01.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:01.470 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:44:01.491 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:44:01.491 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_44_00_UTC 2023-10-24T00:44:01.492 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-24-00_44_00_UTC'] 2023-10-24T00:44:01.493 DEBUG:tasks.cephfs.test_snap_schedules:exec=1698108128.7633429, now = 1698108241.4932575, timo = 112 2023-10-24T00:44:02.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:44:02.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:44:02.494 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-24T00:44:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.621+0000 7fe10d2b8700 1 Processor -- start 2023-10-24T00:44:02.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.621+0000 7fe10d2b8700 1 -- start start 2023-10-24T00:44:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe10d2b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1080a7d00 0x7fe1080a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe10d2b8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1080c6270 con 0x7fe1080aa420 2023-10-24T00:44:02.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe10d2b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1080c0c80 con 0x7fe1081544b0 2023-10-24T00:44:02.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe10d2b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080c60e0 con 0x7fe1080a7d00 2023-10-24T00:44:02.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe1077fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe1080aa420 0x7fe1080c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59860/0 (socket says 172.21.15.148:59860) 2023-10-24T00:44:02.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.622+0000 7fe1077fe700 1 -- 172.21.15.148:0/3462485136 learned_addr learned my addr 172.21.15.148:0/3462485136 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:02.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3462485136 >> v2:172.21.15.150:3300/0 conn(0x7fe1080a7d00 0x7fe1080a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59156137 0 0) 0x7fe1080c6270 con 0x7fe1080aa420 2023-10-24T00:44:02.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f40033f0 con 0x7fe1080aa420 2023-10-24T00:44:02.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899037388 0 0) 0x7fe0f40033f0 con 0x7fe1080aa420 2023-10-24T00:44:02.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 >> v2:172.21.15.150:3300/0 conn(0x7fe1080a7d00 msgr2=0x7fe1080a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:02.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 --2- 172.21.15.148:0/3462485136 >> v2:172.21.15.150:3300/0 conn(0x7fe1080a7d00 0x7fe1080a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 >> v1:172.21.15.150:6789/0 conn(0x7fe1081544b0 legacy=0x7fe1080c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1080c0f40 con 0x7fe1080aa420 2023-10-24T00:44:02.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe1000017f0 con 0x7fe1080aa420 2023-10-24T00:44:02.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 >> v1:172.21.15.148:6789/0 conn(0x7fe1080aa420 legacy=0x7fe1080c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40038e0 0x7fe0f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 0x7fe0f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4005000 0x7fe0f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080c60e0 con 0x7fe0f4004690 2023-10-24T00:44:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f400beb0 con 0x7fe0f40038e0 2023-10-24T00:44:02.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f400c070 con 0x7fe0f4005000 2023-10-24T00:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 0x7fe0f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe106ffd700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40038e0 0x7fe0f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1077fe700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4005000 0x7fe0f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4005000 msgr2=0x7fe0f400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4005000 0x7fe0f400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40038e0 msgr2=0x7fe0f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40038e0 0x7fe0f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe1077fe700 1 -- 172.21.15.148:0/3462485136 reap_dead start 2023-10-24T00:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3462485136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40033f0 con 0x7fe0f4004690 2023-10-24T00:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.623+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 0x7fe0f4004b10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe0f0009a80 tx=0x7fe0f0009060).ready entity=mon.0 client_cookie=561c2e3d4fd03534 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0009430 con 0x7fe0f4004690 2023-10-24T00:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000e640 con 0x7fe0f4004690 2023-10-24T00:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe1067fc700 1 -- 172.21.15.148:0/3462485136 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000e9c0 con 0x7fe0f4004690 2023-10-24T00:44:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 msgr2=0x7fe0f4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 0x7fe0f4004b10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe0f0009a80 tx=0x7fe0f0009060).stop 2023-10-24T00:44:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3462485136 shutdown_connections 2023-10-24T00:44:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3462485136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f4004690 0x7fe0f4004b10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3462485136 >> 172.21.15.148:0/3462485136 conn(0x7fe1080945d0 msgr2=0x7fe10806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:02.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3462485136 shutdown_connections 2023-10-24T00:44:02.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.624+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3462485136 wait complete. 2023-10-24T00:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.625+0000 7fe10d2b8700 1 Processor -- start 2023-10-24T00:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 -- start start 2023-10-24T00:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f4004690 0x7fe108168440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1080afba0 0x7fe1080b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080af430 con 0x7fe1080ab5a0 2023-10-24T00:44:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080af710 con 0x7fe0f4004690 2023-10-24T00:44:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe10d2b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe108168c70 con 0x7fe1080afba0 2023-10-24T00:44:02.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe0fe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe0fe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42200/0 (socket says 172.21.15.148:42200) 2023-10-24T00:44:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.626+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3111088788 learned_addr learned my addr 172.21.15.148:0/3111088788 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1080afba0 msgr2=0x7fe1080b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1080afba0 0x7fe1080b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe106ffd700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f4004690 0x7fe108168440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f4004690 msgr2=0x7fe108168440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f4004690 0x7fe108168440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 -- 172.21.15.148:0/3111088788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108168f50 con 0x7fe1080ab5a0 2023-10-24T00:44:02.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0fe7fc700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe0f0006d50 tx=0x7fe0f001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:02.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000ed30 con 0x7fe1080ab5a0 2023-10-24T00:44:02.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000eeb0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe108169230 con 0x7fe1080ab5a0 2023-10-24T00:44:02.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00243f0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.627+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1081578c0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.628+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10806c6b0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.628+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe0f00123f0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.629+0000 7fe0ff7fe700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 0x7fe0e8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:02.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.629+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7fe0f007bb10 con 0x7fe1080ab5a0 2023-10-24T00:44:02.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.629+0000 7fe106ffd700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 0x7fe0e8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:02.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.629+0000 7fe106ffd700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 0x7fe0e8061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe0f8007fd0 tx=0x7fe0f8009040).ready entity=mgr.5668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:02.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.633+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0f004cae0 con 0x7fe1080ab5a0 2023-10-24T00:44:02.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.820+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1080af570 con 0x7fe0e805f2c0 2023-10-24T00:44:02.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.826+0000 7fe0ff7fe700 1 -- 172.21.15.148:0/3111088788 <== mgr.5668 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe0f8003d90 con 0x7fe0e805f2c0 2023-10-24T00:44:02.828 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path snap_test_dir1 2023-10-24T00:44:02.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 msgr2=0x7fe0e8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 0x7fe0e8061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe0f8007fd0 tx=0x7fe0f8009040).stop 2023-10-24T00:44:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 msgr2=0x7fe1081573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fe0f0006d50 tx=0x7fe0f001a000).stop 2023-10-24T00:44:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 shutdown_connections 2023-10-24T00:44:02.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1080afba0 0x7fe1080b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f4004690 0x7fe108168440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e805f2c0 0x7fe0e8061780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 --2- 172.21.15.148:0/3111088788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1080ab5a0 0x7fe1081573d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 >> 172.21.15.148:0/3111088788 conn(0x7fe1080945d0 msgr2=0x7fe1080c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:02.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 shutdown_connections 2023-10-24T00:44:02.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:02.827+0000 7fe10d2b8700 1 -- 172.21.15.148:0/3111088788 wait complete. 2023-10-24T00:44:02.841 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-24T00:44:02.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:02.842 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:44:02.858 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:44:02.858 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_44_00_UTC 2023-10-24T00:44:02.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_43_00_UTC 2023-10-24T00:44:02.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:02.860 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_43_00_UTC) 2023-10-24T00:44:02.923 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_44_00_UTC 2023-10-24T00:44:02.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:02.924 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_44_00_UTC) 2023-10-24T00:44:02.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:02.984 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T00:44:03.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:44:03.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.197+0000 7f0b1a564700 1 Processor -- start 2023-10-24T00:44:03.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.197+0000 7f0b1a564700 1 -- start start 2023-10-24T00:44:03.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b1a564700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b14154150 0x7f0b140a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b1a564700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b140c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b1a564700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140a9830 con 0x7f0b140c0e30 2023-10-24T00:44:03.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b1a564700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b140c12c0 con 0x7f0b14154150 2023-10-24T00:44:03.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b1a564700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140a8c20 con 0x7f0b140aa390 2023-10-24T00:44:03.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b19d63700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0b140c0e30 0x7f0b140c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:59862/0 (socket says 172.21.15.148:59862) 2023-10-24T00:44:03.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b19d63700 1 -- 172.21.15.148:0/3585539206 learned_addr learned my addr 172.21.15.148:0/3585539206 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:03.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305808951 0 0) 0x7f0b140a9830 con 0x7f0b140c0e30 2023-10-24T00:44:03.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b000033f0 con 0x7f0b140c0e30 2023-10-24T00:44:03.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b19562700 1 --2- 172.21.15.148:0/3585539206 >> v2:172.21.15.150:3300/0 conn(0x7f0b14154150 0x7f0b140a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b18d61700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b140c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142580165 0 0) 0x7f0b000033f0 con 0x7f0b140c0e30 2023-10-24T00:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 msgr2=0x7f0b140c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b140c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 >> v2:172.21.15.150:3300/0 conn(0x7f0b14154150 msgr2=0x7f0b140a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:03.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 --2- 172.21.15.148:0/3585539206 >> v2:172.21.15.150:3300/0 conn(0x7f0b14154150 0x7f0b140a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140a8f00 con 0x7f0b140c0e30 2023-10-24T00:44:03.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.198+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f0b0c0017f0 con 0x7f0b140c0e30 2023-10-24T00:44:03.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 >> v1:172.21.15.148:6789/0 conn(0x7f0b140c0e30 legacy=0x7f0b140c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b00003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b00004690 0x7f0b00004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b00005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c12c0 con 0x7f0b000038e0 2023-10-24T00:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140a8c20 con 0x7f0b00004690 2023-10-24T00:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0000b8e0 con 0x7f0b140aa390 2023-10-24T00:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b00003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b18d61700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b00004690 0x7f0b00004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19d63700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b00005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 -- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 msgr2=0x7f0b00005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:03.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b00005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 -- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b00004690 msgr2=0x7f0b00004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:03.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b00004690 0x7f0b00004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 -- 172.21.15.148:0/3585539206 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000033f0 con 0x7f0b000038e0 2023-10-24T00:44:03.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19d63700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140aa390 0x7f0b00005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b19562700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b00003d00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0b10006fd0 tx=0x7f0b10006f40).ready entity=mon.0 client_cookie=d8ad2e75c0d93edb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10009430 con 0x7f0b000038e0 2023-10-24T00:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000e640 con 0x7f0b000038e0 2023-10-24T00:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.199+0000 7f0b0bfff700 1 -- 172.21.15.148:0/3585539206 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000e9c0 con 0x7f0b000038e0 2023-10-24T00:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 -- 172.21.15.148:0/3585539206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 msgr2=0x7f0b00003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3585539206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b00003d00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f0b10006fd0 tx=0x7f0b10006f40).stop 2023-10-24T00:44:03.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b19d63700 1 -- 172.21.15.148:0/3585539206 reap_dead start 2023-10-24T00:44:03.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 -- 172.21.15.148:0/3585539206 shutdown_connections 2023-10-24T00:44:03.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 -- 172.21.15.148:0/3585539206 >> 172.21.15.148:0/3585539206 conn(0x7f0b14094500 msgr2=0x7f0b1406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:03.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 -- 172.21.15.148:0/3585539206 shutdown_connections 2023-10-24T00:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.200+0000 7f0b1a564700 1 -- 172.21.15.148:0/3585539206 wait complete. 2023-10-24T00:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.201+0000 7f0b1a564700 1 Processor -- start 2023-10-24T00:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.201+0000 7f0b1a564700 1 -- start start 2023-10-24T00:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b140ab240 0x7f0b140ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 0x7f0b140c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140aceb0 con 0x7f0b000038e0 2023-10-24T00:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1414ef00 con 0x7f0b140ab240 2023-10-24T00:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140abbb0 con 0x7f0b140c7830 2023-10-24T00:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42222/0 (socket says 172.21.15.148:42222) 2023-10-24T00:44:03.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 -- 172.21.15.148:0/3898415143 learned_addr learned my addr 172.21.15.148:0/3898415143 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:03.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b18d61700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b140ab240 0x7f0b140ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19d63700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 0x7f0b140c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 -- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 msgr2=0x7f0b140c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 0x7f0b140c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 -- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b140ab240 msgr2=0x7f0b140ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b140ab240 0x7f0b140ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 -- 172.21.15.148:0/3898415143 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140c8580 con 0x7f0b000038e0 2023-10-24T00:44:03.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19d63700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 0x7f0b140c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:03.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b19562700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0b1000a010 tx=0x7f0b1001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:03.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000e9c0 con 0x7f0b000038e0 2023-10-24T00:44:03.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10006040 con 0x7f0b000038e0 2023-10-24T00:44:03.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1414f150 con 0x7f0b000038e0 2023-10-24T00:44:03.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.202+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100063c0 con 0x7f0b000038e0 2023-10-24T00:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.203+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1414f710 con 0x7f0b000038e0 2023-10-24T00:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.203+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1414f900 con 0x7f0b000038e0 2023-10-24T00:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.204+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f0b1001d440 con 0x7f0b000038e0 2023-10-24T00:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.205+0000 7f0b097fa700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 0x7f0af8061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.205+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f0b1007c120 con 0x7f0b000038e0 2023-10-24T00:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.205+0000 7f0b18d61700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 0x7f0af8061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.206+0000 7f0b18d61700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 0x7f0af8061750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0b1414ee90 tx=0x7f0b04008040).ready entity=mgr.5668 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.208+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0b1004d1e0 con 0x7f0b000038e0 2023-10-24T00:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.417+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0b14047480 con 0x7f0b000038e0 2023-10-24T00:44:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.924+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0b10079c50 con 0x7f0b000038e0 2023-10-24T00:44:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.925+0000 7f0b097fa700 1 -- 172.21.15.148:0/3898415143 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0b10047ab0 con 0x7f0b000038e0 2023-10-24T00:44:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 msgr2=0x7f0af8061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 0x7f0af8061750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0b1414ee90 tx=0x7f0b04008040).stop 2023-10-24T00:44:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 msgr2=0x7f0b140b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f0b1000a010 tx=0x7f0b1001a000).stop 2023-10-24T00:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 shutdown_connections 2023-10-24T00:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b140c7830 0x7f0b140c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0af805f290 0x7f0af8061750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b000038e0 0x7f0b140b0890 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 --2- 172.21.15.148:0/3898415143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b140ab240 0x7f0b140ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:03.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.927+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 >> 172.21.15.148:0/3898415143 conn(0x7f0b14094500 msgr2=0x7f0b14064a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:03.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.928+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 shutdown_connections 2023-10-24T00:44:03.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:03.928+0000 7f0b1a564700 1 -- 172.21.15.148:0/3898415143 wait complete. 2023-10-24T00:44:03.943 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:44:03.944 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:03.985 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:04.026 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:44:04.026 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:44:04.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:04.027 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:44:04.067 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:04.065+0000 7fa770842680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:04.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:44:04.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:04.073 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:44:04.076 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:04.075+0000 7fe1e85f5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:04.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:04.132 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:04.130+0000 7fa770842680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:04.139 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:04.138+0000 7fe1e85f5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.246+0000 7fd01d71a700 1 Processor -- start 2023-10-24T00:44:04.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.246+0000 7fd01d71a700 1 -- start start 2023-10-24T00:44:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd01d71a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 0x7fd0180699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd01d71a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 0x7fd01813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd01d71a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01813ac70 con 0x7fd01813a7e0 2023-10-24T00:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd01d71a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0180c57b0 con 0x7fd0180695f0 2023-10-24T00:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd01d71a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180c5a90 con 0x7fd0180aacd0 2023-10-24T00:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0167fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 0x7fd01813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd016ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 0x7fd0180699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0177fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd01813a7e0 0x7fd018065fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:42154/0 (socket says 172.21.15.148:42154) 2023-10-24T00:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0177fe700 1 -- 172.21.15.148:0/1474976761 learned_addr learned my addr 172.21.15.148:0/1474976761 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:04.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0167fc700 1 -- 172.21.15.148:0/1474976761 >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 msgr2=0x7fd0180699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:04.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0167fc700 1 --2- 172.21.15.148:0/1474976761 >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 0x7fd0180699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.248+0000 7fd0167fc700 1 -- 172.21.15.148:0/1474976761 >> v1:172.21.15.150:6789/0 conn(0x7fd01813a7e0 legacy=0x7fd018065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd0167fc700 1 -- 172.21.15.148:0/1474976761 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180c5d70 con 0x7fd0180aacd0 2023-10-24T00:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd015ffb700 1 -- 172.21.15.148:0/1474976761 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587911997 0 0) 0x7fd01813ac70 con 0x7fd01813a7e0 2023-10-24T00:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd016ffd700 1 --2- 172.21.15.148:0/1474976761 >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 0x7fd0180699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd0167fc700 1 --2- 172.21.15.148:0/1474976761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 0x7fd01813a2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd008009790 tx=0x7fd008009060).ready entity=mon.2 client_cookie=4095c16a4d446f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd015ffb700 1 -- 172.21.15.148:0/1474976761 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800f510 con 0x7fd0180aacd0 2023-10-24T00:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd015ffb700 1 -- 172.21.15.148:0/1474976761 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800f670 con 0x7fd0180aacd0 2023-10-24T00:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd015ffb700 1 -- 172.21.15.148:0/1474976761 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800f9f0 con 0x7fd0180aacd0 2023-10-24T00:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 -- 172.21.15.148:0/1474976761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 msgr2=0x7fd01813a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 --2- 172.21.15.148:0/1474976761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 0x7fd01813a2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd008009790 tx=0x7fd008009060).stop 2023-10-24T00:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 -- 172.21.15.148:0/1474976761 shutdown_connections 2023-10-24T00:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 --2- 172.21.15.148:0/1474976761 >> v2:172.21.15.150:3300/0 conn(0x7fd0180695f0 0x7fd0180699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 --2- 172.21.15.148:0/1474976761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0180aacd0 0x7fd01813a2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 -- 172.21.15.148:0/1474976761 >> 172.21.15.148:0/1474976761 conn(0x7fd0180641f0 msgr2=0x7fd0180c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 -- 172.21.15.148:0/1474976761 shutdown_connections 2023-10-24T00:44:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.249+0000 7fd01d71a700 1 -- 172.21.15.148:0/1474976761 wait complete. 2023-10-24T00:44:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.251+0000 7fd01d71a700 1 Processor -- start 2023-10-24T00:44:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.251+0000 7fd01d71a700 1 -- start start 2023-10-24T00:44:04.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 0x7fd018150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 0x7fd0180a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd01813a7e0 0x7fd0180bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018153070 con 0x7fd0180695f0 2023-10-24T00:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018152740 con 0x7fd0180aacd0 2023-10-24T00:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd018152a20 con 0x7fd01813a7e0 2023-10-24T00:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd016ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 0x7fd018150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 0x7fd0180a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0177fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd01813a7e0 0x7fd0180bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd016ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 0x7fd018150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40754/0 (socket says 172.21.15.148:40754) 2023-10-24T00:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd016ffd700 1 -- 172.21.15.148:0/2511564384 learned_addr learned my addr 172.21.15.148:0/2511564384 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd01813a7e0 msgr2=0x7fd0180bcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd01813a7e0 0x7fd0180bcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 msgr2=0x7fd018150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 0x7fd018150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 -- 172.21.15.148:0/2511564384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0092a0 con 0x7fd0180aacd0 2023-10-24T00:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd0167fc700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 0x7fd0180a9fa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd008014000 tx=0x7fd008017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800f7e0 con 0x7fd0180aacd0 2023-10-24T00:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800f960 con 0x7fd0180aacd0 2023-10-24T00:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0080092a0 con 0x7fd0180aacd0 2023-10-24T00:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00801b660 con 0x7fd0180aacd0 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.252+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018150e10 con 0x7fd0180aacd0 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.253+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0181531e0 con 0x7fd0180aacd0 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.254+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd00801ba10 con 0x7fd0180aacd0 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.254+0000 7fcffeffd700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 0x7fd004061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.254+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7fd00807bdf0 con 0x7fd0180aacd0 2023-10-24T00:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.254+0000 7fd016ffd700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 msgr2=0x7fd004061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:04.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.254+0000 7fd016ffd700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 0x7fd004061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:04.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.258+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd00804ce20 con 0x7fd0180aacd0 2023-10-24T00:44:04.414 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:04.412+0000 7fe1e85f5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:04.419 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:04.416+0000 7fa770842680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:04.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.455+0000 7fd016ffd700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 msgr2=0x7fd004061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:04.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.455+0000 7fd016ffd700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 0x7fd004061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.471+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0180c6050 con 0x7fd0180aacd0 2023-10-24T00:44:04.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.471+0000 7fcffeffd700 1 -- 172.21.15.148:0/2511564384 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fd008050440 con 0x7fd0180aacd0 2023-10-24T00:44:04.474 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:04.474 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 msgr2=0x7fd004061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 0x7fd004061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 msgr2=0x7fd0180a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 0x7fd0180a9fa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd008014000 tx=0x7fd008017000).stop 2023-10-24T00:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 shutdown_connections 2023-10-24T00:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd01813a7e0 0x7fd0180bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd00405f270 0x7fd004061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd0180695f0 0x7fd018150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.473+0000 7fd01d71a700 1 --2- 172.21.15.148:0/2511564384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0180aacd0 0x7fd0180a9fa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.474+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 >> 172.21.15.148:0/2511564384 conn(0x7fd0180641f0 msgr2=0x7fd0181396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.474+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 shutdown_connections 2023-10-24T00:44:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.474+0000 7fd01d71a700 1 -- 172.21.15.148:0/2511564384 wait complete. 2023-10-24T00:44:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:44:04.488 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.605+0000 7f9f714ad700 1 Processor -- start 2023-10-24T00:44:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.605+0000 7f9f714ad700 1 -- start start 2023-10-24T00:44:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9f6c0aa140 0x7f9f6c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0c0cd0 0x7f9f6c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c0c6410 con 0x7f9f6c0ca110 2023-10-24T00:44:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c0c1140 con 0x7f9f6c0aa140 2023-10-24T00:44:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f714ad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0ca6e0 con 0x7f9f6c0c0cd0 2023-10-24T00:44:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40756/0 (socket says 172.21.15.148:40756) 2023-10-24T00:44:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 -- 172.21.15.148:0/478189793 learned_addr learned my addr 172.21.15.148:0/478189793 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6bfff700 1 --2- 172.21.15.148:0/478189793 >> v2:172.21.15.150:3300/0 conn(0x7f9f6c0aa140 0x7f9f6c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f70cac700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0c0cd0 0x7f9f6c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 -- 172.21.15.148:0/478189793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0c0cd0 msgr2=0x7f9f6c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0c0cd0 0x7f9f6c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 -- 172.21.15.148:0/478189793 >> v2:172.21.15.150:3300/0 conn(0x7f9f6c0aa140 msgr2=0x7f9f6c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 --2- 172.21.15.148:0/478189793 >> v2:172.21.15.150:3300/0 conn(0x7f9f6c0aa140 0x7f9f6c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 -- 172.21.15.148:0/478189793 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0ca9c0 con 0x7f9f6c0ca110 2023-10-24T00:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.606+0000 7f9f6b7fe700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f9f6c065670 tx=0x7f9f5c0090f0).ready entity=mon.0 client_cookie=1062a8feb8ff6786 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f6affd700 1 -- 172.21.15.148:0/478189793 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00f510 con 0x7f9f6c0ca110 2023-10-24T00:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f6affd700 1 -- 172.21.15.148:0/478189793 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c00f670 con 0x7f9f6c0ca110 2023-10-24T00:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f6affd700 1 -- 172.21.15.148:0/478189793 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00fa10 con 0x7f9f6c0ca110 2023-10-24T00:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 -- 172.21.15.148:0/478189793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0ca110 msgr2=0x7f9f6c0c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f9f6c065670 tx=0x7f9f5c0090f0).stop 2023-10-24T00:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 -- 172.21.15.148:0/478189793 shutdown_connections 2023-10-24T00:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0c0cd0 0x7f9f6c157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 --2- 172.21.15.148:0/478189793 >> v2:172.21.15.150:3300/0 conn(0x7f9f6c0aa140 0x7f9f6c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 --2- 172.21.15.148:0/478189793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0c07e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 -- 172.21.15.148:0/478189793 >> 172.21.15.148:0/478189793 conn(0x7f9f6c0944a0 msgr2=0x7f9f6c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:04.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 -- 172.21.15.148:0/478189793 shutdown_connections 2023-10-24T00:44:04.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.607+0000 7f9f714ad700 1 -- 172.21.15.148:0/478189793 wait complete. 2023-10-24T00:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.608+0000 7f9f714ad700 1 Processor -- start 2023-10-24T00:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 -- start start 2023-10-24T00:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0aa140 0x7f9f6c167950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c168330 con 0x7f9f6c0c0cd0 2023-10-24T00:44:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0ae460 con 0x7f9f6c0ca110 2023-10-24T00:44:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f714ad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c0ade50 con 0x7f9f6c0aa140 2023-10-24T00:44:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f6b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f6b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40762/0 (socket says 172.21.15.148:40762) 2023-10-24T00:44:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.609+0000 7f9f6b7fe700 1 -- 172.21.15.148:0/2263636797 learned_addr learned my addr 172.21.15.148:0/2263636797 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f6bfff700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0aa140 0x7f9f6c167950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0aa140 msgr2=0x7f9f6c167950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0aa140 0x7f9f6c167950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 msgr2=0x7f9f6c167e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 -- 172.21.15.148:0/2263636797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c009370 con 0x7f9f6c0ca110 2023-10-24T00:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f6b7fe700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f70cac700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0ab010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f9f64009e50 tx=0x7f9f6400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400caa0 con 0x7f9f6c0ca110 2023-10-24T00:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6400f040 con 0x7f9f6c0ca110 2023-10-24T00:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c0abd40 con 0x7f9f6c0ca110 2023-10-24T00:44:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400ce10 con 0x7f9f6c0ca110 2023-10-24T00:44:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.610+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c0ac020 con 0x7f9f6c0ca110 2023-10-24T00:44:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.611+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9f64013610 con 0x7f9f6c0ca110 2023-10-24T00:44:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.611+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c047480 con 0x7f9f6c0ca110 2023-10-24T00:44:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.612+0000 7f9f53fff700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 0x7f9f58061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.612+0000 7f9f6bfff700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 msgr2=0x7f9f58061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.612+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f9f6407acf0 con 0x7f9f6c0ca110 2023-10-24T00:44:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.612+0000 7f9f6bfff700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 0x7f9f58061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:04.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.616+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9f6404bde0 con 0x7f9f6c0ca110 2023-10-24T00:44:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.813+0000 7f9f6bfff700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 msgr2=0x7f9f58061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.813+0000 7f9f6bfff700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 0x7f9f58061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:04.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.815+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f6c0c60a0 con 0x7f9f6c0ca110 2023-10-24T00:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.816+0000 7f9f53fff700 1 -- 172.21.15.148:0/2263636797 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17411 (secure 0 0 0) 0x7f9f6404f400 con 0x7f9f6c0ca110 2023-10-24T00:44:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:04.819 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":66,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:43:08.916080+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1583211251":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6832/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6833/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:0/491809098":"2023-10-25T00:42:07.378158+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 msgr2=0x7f9f58061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 0x7f9f58061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 msgr2=0x7f9f6c0ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0ab010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f9f64009e50 tx=0x7f9f6400b040).stop 2023-10-24T00:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 shutdown_connections 2023-10-24T00:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f6c0ca110 0x7f9f6c0ab010 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f6c0aa140 0x7f9f6c167950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9f5805f240 0x7f9f58061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 --2- 172.21.15.148:0/2263636797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9f6c0c0cd0 0x7f9f6c167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 >> 172.21.15.148:0/2263636797 conn(0x7f9f6c0944a0 msgr2=0x7f9f6c063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 shutdown_connections 2023-10-24T00:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.818+0000 7f9f714ad700 1 -- 172.21.15.148:0/2263636797 wait complete. 2023-10-24T00:44:04.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:41:54.030189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:41:54.428914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:44:04.837 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:44:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.957+0000 7f4d3a960700 1 Processor -- start 2023-10-24T00:44:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.957+0000 7f4d3a960700 1 -- start start 2023-10-24T00:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d3a960700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d34151190 0x7f4d34064da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d3a960700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d3406b380 0x7f4d34065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d3a960700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340ad3d0 con 0x7f4d34151570 2023-10-24T00:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d3a960700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340c3800 con 0x7f4d3406b380 2023-10-24T00:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d3a960700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340c3ae0 con 0x7f4d34151190 2023-10-24T00:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d3406b380 0x7f4d34065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d3406b380 0x7f4d34065290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40776/0 (socket says 172.21.15.148:40776) 2023-10-24T00:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.958+0000 7f4d337fe700 1 -- 172.21.15.148:0/394566679 learned_addr learned my addr 172.21.15.148:0/394566679 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d33fff700 1 --2- 172.21.15.148:0/394566679 >> v2:172.21.15.150:3300/0 conn(0x7f4d34151190 0x7f4d34064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d337fe700 1 -- 172.21.15.148:0/394566679 >> v2:172.21.15.150:3300/0 conn(0x7f4d34151190 msgr2=0x7f4d34064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d337fe700 1 --2- 172.21.15.148:0/394566679 >> v2:172.21.15.150:3300/0 conn(0x7f4d34151190 0x7f4d34064da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d337fe700 1 -- 172.21.15.148:0/394566679 >> v1:172.21.15.150:6789/0 conn(0x7f4d34151570 legacy=0x7f4d34154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d337fe700 1 -- 172.21.15.148:0/394566679 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340ad060 con 0x7f4d3406b380 2023-10-24T00:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d337fe700 1 --2- 172.21.15.148:0/394566679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d3406b380 0x7f4d34065290 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4d3406be40 tx=0x7f4d240090f0).ready entity=mon.0 client_cookie=53dbf3c44b5360eb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d32ffd700 1 -- 172.21.15.148:0/394566679 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400b520 con 0x7f4d3406b380 2023-10-24T00:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d32ffd700 1 -- 172.21.15.148:0/394566679 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400b680 con 0x7f4d3406b380 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.959+0000 7f4d32ffd700 1 -- 172.21.15.148:0/394566679 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400ba00 con 0x7f4d3406b380 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 -- 172.21.15.148:0/394566679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d3406b380 msgr2=0x7f4d34065290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 --2- 172.21.15.148:0/394566679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d3406b380 0x7f4d34065290 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4d3406be40 tx=0x7f4d240090f0).stop 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 -- 172.21.15.148:0/394566679 shutdown_connections 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 --2- 172.21.15.148:0/394566679 >> v2:172.21.15.150:3300/0 conn(0x7f4d34151190 0x7f4d34064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 --2- 172.21.15.148:0/394566679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d3406b380 0x7f4d34065290 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 -- 172.21.15.148:0/394566679 >> 172.21.15.148:0/394566679 conn(0x7f4d340c3f60 msgr2=0x7f4d340c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:04.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 -- 172.21.15.148:0/394566679 shutdown_connections 2023-10-24T00:44:04.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.960+0000 7f4d3a960700 1 -- 172.21.15.148:0/394566679 wait complete. 2023-10-24T00:44:04.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.961+0000 7f4d3a960700 1 Processor -- start 2023-10-24T00:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.961+0000 7f4d3a960700 1 -- start start 2023-10-24T00:44:04.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 0x7f4d34147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 0x7f4d34062b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34063030 con 0x7f4d34151570 2023-10-24T00:44:04.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34164940 con 0x7f4d34151190 2023-10-24T00:44:04.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d3a960700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34164c00 con 0x7f4d3406b380 2023-10-24T00:44:04.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 0x7f4d34147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d337fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d38efd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 0x7f4d34062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d33fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 0x7f4d34147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:58310/0 (socket says 172.21.15.148:58310) 2023-10-24T00:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d337fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:48432/0 (socket says 172.21.15.148:48432) 2023-10-24T00:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d38efd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 0x7f4d34062b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40784/0 (socket says 172.21.15.148:40784) 2023-10-24T00:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d33fff700 1 -- 172.21.15.148:0/1745413192 learned_addr learned my addr 172.21.15.148:0/1745413192 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d337fe700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 msgr2=0x7f4d34147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.962+0000 7f4d337fe700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 0x7f4d34147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d337fe700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 msgr2=0x7f4d34062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d337fe700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 0x7f4d34062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d337fe700 1 -- 172.21.15.148:0/1745413192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24009370 con 0x7f4d34151190 2023-10-24T00:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d337fe700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4d24014000 tx=0x7f4d24017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:04.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24000bc0 con 0x7f4d34151190 2023-10-24T00:44:04.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400b7f0 con 0x7f4d34151190 2023-10-24T00:44:04.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d34164ee0 con 0x7f4d34151190 2023-10-24T00:44:04.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2401c670 con 0x7f4d34151190 2023-10-24T00:44:04.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.963+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d341654a0 con 0x7f4d34151190 2023-10-24T00:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.964+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d34165810 con 0x7f4d34151190 2023-10-24T00:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.964+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4d2401ca20 con 0x7f4d34151190 2023-10-24T00:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.964+0000 7f4d1bfff700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 0x7f4d20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.965+0000 7f4d33fff700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 msgr2=0x7f4d20061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.965+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f4d2407bf90 con 0x7f4d34151190 2023-10-24T00:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.965+0000 7f4d33fff700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 0x7f4d20061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:04.970+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d240aaaf0 con 0x7f4d34151190 2023-10-24T00:44:05.026 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.024+0000 7fe1e85f5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:05.085 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:05.082+0000 7fa770842680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:05.097 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.096+0000 7fe1e85f5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:05.157 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:05.155+0000 7fa770842680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:05.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.166+0000 7f4d33fff700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 msgr2=0x7f4d20061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:05.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.166+0000 7f4d33fff700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 0x7f4d20061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:05.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.173+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4d3406c6b0 con 0x7f4d34151190 2023-10-24T00:44:05.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.174+0000 7f4d1bfff700 1 -- 172.21.15.148:0/1745413192 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v66) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4d2402a030 con 0x7f4d34151190 2023-10-24T00:44:05.176 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:44:05.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 msgr2=0x7f4d20061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:05.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 0x7f4d20061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 msgr2=0x7f4d34062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4d24014000 tx=0x7f4d24017000).stop 2023-10-24T00:44:05.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 shutdown_connections 2023-10-24T00:44:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d2005f270 0x7f4d20061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d34151570 0x7f4d34062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d3406b380 0x7f4d34147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 --2- 172.21.15.148:0/1745413192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d34151190 0x7f4d34062650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 >> 172.21.15.148:0/1745413192 conn(0x7f4d340c3f60 msgr2=0x7f4d340661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 shutdown_connections 2023-10-24T00:44:05.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.176+0000 7f4d3a960700 1 -- 172.21.15.148:0/1745413192 wait complete. 2023-10-24T00:44:05.191 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:44:05.284 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.283+0000 7fe1e85f5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:05.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.312+0000 7f8872da9700 1 Processor -- start 2023-10-24T00:44:05.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.312+0000 7f8872da9700 1 -- start start 2023-10-24T00:44:05.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8872da9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f886c152120 0x7f886c067150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8872da9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0bcd50 con 0x7f886c069230 2023-10-24T00:44:05.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8872da9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0be1f0 con 0x7f886c151d40 2023-10-24T00:44:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8872da9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c1525a0 con 0x7f886c152120 2023-10-24T00:44:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88725a8700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f886c069230 0x7f886c069660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37198/0 (socket says 172.21.15.148:37198) 2023-10-24T00:44:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88725a8700 1 -- 172.21.15.148:0/2953652296 learned_addr learned my addr 172.21.15.148:0/2953652296 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88715a6700 1 --2- 172.21.15.148:0/2953652296 >> v2:172.21.15.150:3300/0 conn(0x7f886c152120 0x7f886c067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127414160 0 0) 0x7f886c0bcd50 con 0x7f886c069230 2023-10-24T00:44:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88580033f0 con 0x7f886c069230 2023-10-24T00:44:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88715a6700 1 -- 172.21.15.148:0/2953652296 >> v1:172.21.15.150:6789/0 conn(0x7f886c151d40 legacy=0x7f886c063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122886506 0 0) 0x7f886c0be1f0 con 0x7f886c151d40 2023-10-24T00:44:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88715a6700 1 -- 172.21.15.148:0/2953652296 >> v1:172.21.15.148:6789/0 conn(0x7f886c069230 legacy=0x7f886c069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.313+0000 7f88715a6700 1 -- 172.21.15.148:0/2953652296 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0bc460 con 0x7f886c152120 2023-10-24T00:44:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f88715a6700 1 --2- 172.21.15.148:0/2953652296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c067150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f885c009760 tx=0x7f885c009060).ready entity=mon.1 client_cookie=eaa619fe5354403f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00f510 con 0x7f886c152120 2023-10-24T00:44:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00f670 con 0x7f886c152120 2023-10-24T00:44:05.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8870da5700 1 -- 172.21.15.148:0/2953652296 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00f9f0 con 0x7f886c152120 2023-10-24T00:44:05.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 -- 172.21.15.148:0/2953652296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 msgr2=0x7f886c067150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 --2- 172.21.15.148:0/2953652296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c067150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f885c009760 tx=0x7f885c009060).stop 2023-10-24T00:44:05.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 -- 172.21.15.148:0/2953652296 shutdown_connections 2023-10-24T00:44:05.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 --2- 172.21.15.148:0/2953652296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c067150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 -- 172.21.15.148:0/2953652296 >> 172.21.15.148:0/2953652296 conn(0x7f886c0c48a0 msgr2=0x7f886c068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 -- 172.21.15.148:0/2953652296 shutdown_connections 2023-10-24T00:44:05.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.314+0000 7f8872da9700 1 -- 172.21.15.148:0/2953652296 wait complete. 2023-10-24T00:44:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.315+0000 7f8872da9700 1 Processor -- start 2023-10-24T00:44:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 -- start start 2023-10-24T00:44:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f886c151d40 0x7f886c168300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1687f0 con 0x7f886c069230 2023-10-24T00:44:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0a4840 con 0x7f886c152120 2023-10-24T00:44:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8872da9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0be820 con 0x7f886c151d40 2023-10-24T00:44:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8871da7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8871da7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40794/0 (socket says 172.21.15.148:40794) 2023-10-24T00:44:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.316+0000 7f8871da7700 1 -- 172.21.15.148:0/1083112780 learned_addr learned my addr 172.21.15.148:0/1083112780 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f88725a8700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f88715a6700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f886c151d40 0x7f886c168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 -- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f886c151d40 msgr2=0x7f886c168300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f886c151d40 0x7f886c168300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 -- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 msgr2=0x7f886c0a5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c0a5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 -- 172.21.15.148:0/1083112780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0092a0 con 0x7f886c069230 2023-10-24T00:44:05.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8871da7700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8868001eb0 tx=0x7f8868007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800f470 con 0x7f886c069230 2023-10-24T00:44:05.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800f5f0 con 0x7f886c069230 2023-10-24T00:44:05.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0beb00 con 0x7f886c069230 2023-10-24T00:44:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800f9b0 con 0x7f886c069230 2023-10-24T00:44:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.317+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0a4de0 con 0x7f886c069230 2023-10-24T00:44:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.318+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c0a5150 con 0x7f886c069230 2023-10-24T00:44:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.319+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f886800fd20 con 0x7f886c069230 2023-10-24T00:44:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.319+0000 7f8861ffb700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 0x7f8850061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.319+0000 7f88715a6700 1 -- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 msgr2=0x7f8850061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.319+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f8868079ac0 con 0x7f886c069230 2023-10-24T00:44:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.319+0000 7f88715a6700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 0x7f8850061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.323+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f886804aaf0 con 0x7f886c069230 2023-10-24T00:44:05.355 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:05.353+0000 7fa770842680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:05.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.494+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f886c047480 con 0x7f886c069230 2023-10-24T00:44:05.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.495+0000 7f8861ffb700 1 -- 172.21.15.148:0/1083112780 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7f886804e110 con 0x7f886c069230 2023-10-24T00:44:05.497 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:44:05.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 msgr2=0x7f8850061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:05.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 0x7f8850061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 msgr2=0x7f886c13fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8868001eb0 tx=0x7f8868007c70).stop 2023-10-24T00:44:05.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 shutdown_connections 2023-10-24T00:44:05.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f886c152120 0x7f886c0a5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f885005f270 0x7f8850061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f886c069230 0x7f886c13fa50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 --2- 172.21.15.148:0/1083112780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f886c151d40 0x7f886c168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 >> 172.21.15.148:0/1083112780 conn(0x7f886c0c48a0 msgr2=0x7f886c0aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 shutdown_connections 2023-10-24T00:44:05.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.497+0000 7f8872da9700 1 -- 172.21.15.148:0/1083112780 wait complete. 2023-10-24T00:44:05.511 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:44:05.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.632+0000 7fa316385700 1 Processor -- start 2023-10-24T00:44:05.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.632+0000 7fa316385700 1 -- start start 2023-10-24T00:44:05.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa316385700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa31014fcb0 0x7fa310066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa316385700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100677f0 con 0x7fa310066f60 2023-10-24T00:44:05.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa316385700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100a6260 con 0x7fa3100a83d0 2023-10-24T00:44:05.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa316385700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3101536d0 con 0x7fa31014fcb0 2023-10-24T00:44:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa315383700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa31014fcb0 0x7fa310066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa314b82700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa310066f60 0x7fa3100a7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37208/0 (socket says 172.21.15.148:37208) 2023-10-24T00:44:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa314b82700 1 -- 172.21.15.148:0/1328392164 learned_addr learned my addr 172.21.15.148:0/1328392164 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa315383700 1 -- 172.21.15.148:0/1328392164 >> v1:172.21.15.150:6789/0 conn(0x7fa3100a83d0 legacy=0x7fa31015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa315383700 1 -- 172.21.15.148:0/1328392164 >> v1:172.21.15.148:6789/0 conn(0x7fa310066f60 legacy=0x7fa3100a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa307fff700 1 -- 172.21.15.148:0/1328392164 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224155850 0 0) 0x7fa3100a6260 con 0x7fa3100a83d0 2023-10-24T00:44:05.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa315383700 1 -- 172.21.15.148:0/1328392164 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310067510 con 0x7fa31014fcb0 2023-10-24T00:44:05.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa315383700 1 --2- 172.21.15.148:0/1328392164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31014fcb0 0x7fa310066a70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa300006fd0 tx=0x7fa300006f40).ready entity=mon.0 client_cookie=c161eece0385c866 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa307fff700 1 -- 172.21.15.148:0/1328392164 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300005880 con 0x7fa31014fcb0 2023-10-24T00:44:05.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa307fff700 1 -- 172.21.15.148:0/1328392164 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000059e0 con 0x7fa31014fcb0 2023-10-24T00:44:05.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.633+0000 7fa307fff700 1 -- 172.21.15.148:0/1328392164 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300005d60 con 0x7fa31014fcb0 2023-10-24T00:44:05.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 -- 172.21.15.148:0/1328392164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31014fcb0 msgr2=0x7fa310066a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 --2- 172.21.15.148:0/1328392164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31014fcb0 0x7fa310066a70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fa300006fd0 tx=0x7fa300006f40).stop 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 -- 172.21.15.148:0/1328392164 shutdown_connections 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 --2- 172.21.15.148:0/1328392164 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31014fcb0 0x7fa310066a70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 -- 172.21.15.148:0/1328392164 >> 172.21.15.148:0/1328392164 conn(0x7fa3100923d0 msgr2=0x7fa310062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 -- 172.21.15.148:0/1328392164 shutdown_connections 2023-10-24T00:44:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.634+0000 7fa316385700 1 -- 172.21.15.148:0/1328392164 wait complete. 2023-10-24T00:44:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.635+0000 7fa316385700 1 Processor -- start 2023-10-24T00:44:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.635+0000 7fa316385700 1 -- start start 2023-10-24T00:44:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3100a83d0 0x7fa3101621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31014fcb0 0x7fa3100c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310151160 con 0x7fa310066f60 2023-10-24T00:44:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310163150 con 0x7fa3100a83d0 2023-10-24T00:44:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa316385700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa310150e30 con 0x7fa31014fcb0 2023-10-24T00:44:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa315383700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa315383700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40824/0 (socket says 172.21.15.148:40824) 2023-10-24T00:44:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa315383700 1 -- 172.21.15.148:0/3750575013 learned_addr learned my addr 172.21.15.148:0/3750575013 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa314b82700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3100a83d0 0x7fa3101621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.636+0000 7fa315b84700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31014fcb0 0x7fa3100c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 -- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31014fcb0 msgr2=0x7fa3100c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31014fcb0 0x7fa3100c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 -- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3100a83d0 msgr2=0x7fa3101621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3100a83d0 0x7fa3101621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 -- 172.21.15.148:0/3750575013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009250 con 0x7fa310066f60 2023-10-24T00:44:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa315383700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fa300009e80 tx=0x7fa300015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000067f0 con 0x7fa310066f60 2023-10-24T00:44:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000f720 con 0x7fa310066f60 2023-10-24T00:44:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310162b90 con 0x7fa310066f60 2023-10-24T00:44:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000fae0 con 0x7fa310066f60 2023-10-24T00:44:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.637+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa310163360 con 0x7fa310066f60 2023-10-24T00:44:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fa300027460 con 0x7fa310066f60 2023-10-24T00:44:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310047480 con 0x7fa310066f60 2023-10-24T00:44:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa3057fa700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 0x7fa2f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7fa30007bf90 con 0x7fa310066f60 2023-10-24T00:44:05.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa314b82700 1 -- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 msgr2=0x7fa2f4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:05.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.639+0000 7fa314b82700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 0x7fa2f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:05.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.643+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa3000aaaf0 con 0x7fa310066f60 2023-10-24T00:44:05.706 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.704+0000 7fe1e85f5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:05.794 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:05.791+0000 7fa770842680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:05.808 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.807+0000 7fe1e85f5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:05.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.815+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3100a5c10 con 0x7fa310066f60 2023-10-24T00:44:05.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.815+0000 7fa3057fa700 1 -- 172.21.15.148:0/3750575013 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa30004cf60 con 0x7fa310066f60 2023-10-24T00:44:05.818 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:44:05.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 msgr2=0x7fa2f4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:05.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 0x7fa2f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 msgr2=0x7fa310140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fa300009e80 tx=0x7fa300015000).stop 2023-10-24T00:44:05.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 shutdown_connections 2023-10-24T00:44:05.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31014fcb0 0x7fa3100c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa2f405f270 0x7fa2f4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:05.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa310066f60 0x7fa310140bc0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 --2- 172.21.15.148:0/3750575013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3100a83d0 0x7fa3101621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 >> 172.21.15.148:0/3750575013 conn(0x7fa3100923d0 msgr2=0x7fa3100c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 shutdown_connections 2023-10-24T00:44:05.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.817+0000 7fa316385700 1 -- 172.21.15.148:0/3750575013 wait complete. 2023-10-24T00:44:05.834 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:44:05.903 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:05.901+0000 7fa770842680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.952+0000 7f6a4dbb5700 1 Processor -- start 2023-10-24T00:44:05.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.952+0000 7f6a4dbb5700 1 -- start start 2023-10-24T00:44:05.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a4dbb5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a48152290 0x7f6a48155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a4dbb5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a480c6240 0x7f6a480c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a4dbb5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a480c6bb0 con 0x7f6a480c0940 2023-10-24T00:44:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a4dbb5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480c8800 con 0x7f6a48152290 2023-10-24T00:44:05.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a4dbb5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a48155c00 con 0x7f6a480c6240 2023-10-24T00:44:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a477fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a48152290 0x7f6a48155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a477fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a48152290 0x7f6a48155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40832/0 (socket says 172.21.15.148:40832) 2023-10-24T00:44:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a477fe700 1 -- 172.21.15.148:0/2256574801 learned_addr learned my addr 172.21.15.148:0/2256574801 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.953+0000 7f6a3ffff700 1 --2- 172.21.15.148:0/2256574801 >> v2:172.21.15.150:3300/0 conn(0x7f6a480c6240 0x7f6a480c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a477fe700 1 -- 172.21.15.148:0/2256574801 >> v2:172.21.15.150:3300/0 conn(0x7f6a480c6240 msgr2=0x7f6a480c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a477fe700 1 --2- 172.21.15.148:0/2256574801 >> v2:172.21.15.150:3300/0 conn(0x7f6a480c6240 0x7f6a480c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a477fe700 1 -- 172.21.15.148:0/2256574801 >> v1:172.21.15.150:6789/0 conn(0x7f6a480c0940 legacy=0x7f6a480c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a477fe700 1 -- 172.21.15.148:0/2256574801 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480c7b80 con 0x7f6a48152290 2023-10-24T00:44:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a477fe700 1 --2- 172.21.15.148:0/2256574801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a48155710 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f6a480c05a0 tx=0x7f6a380090f0).ready entity=mon.0 client_cookie=a1d21c6b4b49ab1b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a46ffd700 1 -- 172.21.15.148:0/2256574801 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800b520 con 0x7f6a48152290 2023-10-24T00:44:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a46ffd700 1 -- 172.21.15.148:0/2256574801 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3800b680 con 0x7f6a48152290 2023-10-24T00:44:05.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.954+0000 7f6a46ffd700 1 -- 172.21.15.148:0/2256574801 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800ba20 con 0x7f6a48152290 2023-10-24T00:44:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/2256574801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 msgr2=0x7f6a48155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/2256574801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a48155710 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f6a480c05a0 tx=0x7f6a380090f0).stop 2023-10-24T00:44:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/2256574801 shutdown_connections 2023-10-24T00:44:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/2256574801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a48155710 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/2256574801 >> v2:172.21.15.150:3300/0 conn(0x7f6a480c6240 0x7f6a480c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/2256574801 >> 172.21.15.148:0/2256574801 conn(0x7f6a480946c0 msgr2=0x7f6a4806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/2256574801 shutdown_connections 2023-10-24T00:44:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.955+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/2256574801 wait complete. 2023-10-24T00:44:05.964 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:05.962+0000 7fe1e85f5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.956+0000 7f6a4dbb5700 1 Processor -- start 2023-10-24T00:44:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.956+0000 7f6a4dbb5700 1 -- start start 2023-10-24T00:44:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a480c0940 0x7f6a48144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480c6240 0x7f6a4814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48150590 con 0x7f6a48152290 2023-10-24T00:44:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48150870 con 0x7f6a480c6240 2023-10-24T00:44:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48150b50 con 0x7f6a480c0940 2023-10-24T00:44:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a477fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a480c0940 0x7f6a48144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40834/0 (socket says 172.21.15.148:40834) 2023-10-24T00:44:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 -- 172.21.15.148:0/499758434 learned_addr learned my addr 172.21.15.148:0/499758434 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a3ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480c6240 0x7f6a4814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 -- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a480c0940 msgr2=0x7f6a48144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a480c0940 0x7f6a48144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 -- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480c6240 msgr2=0x7f6a4814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480c6240 0x7f6a4814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 -- 172.21.15.148:0/499758434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38009370 con 0x7f6a48152290 2023-10-24T00:44:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a47fff700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f6a4000c7c0 tx=0x7f6a40001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000e4a0 con 0x7f6a48152290 2023-10-24T00:44:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000e600 con 0x7f6a48152290 2023-10-24T00:44:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a48150e30 con 0x7f6a48152290 2023-10-24T00:44:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000e980 con 0x7f6a48152290 2023-10-24T00:44:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.957+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a481453d0 con 0x7f6a48152290 2023-10-24T00:44:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.958+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4806c6b0 con 0x7f6a48152290 2023-10-24T00:44:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.959+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f6a400123f0 con 0x7f6a48152290 2023-10-24T00:44:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.959+0000 7f6a3f7fe700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 0x7f6a28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.959+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f6a40079d50 con 0x7f6a48152290 2023-10-24T00:44:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.959+0000 7f6a477fe700 1 -- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 msgr2=0x7f6a28061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.959+0000 7f6a477fe700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 0x7f6a28061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:05.967+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a40047af0 con 0x7f6a48152290 2023-10-24T00:44:06.039 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:06.037+0000 7fe1e85f5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:06.066 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:06.063+0000 7fa770842680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:06.106 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:06.105+0000 7fe1e85f5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:06.142 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:06.140+0000 7fa770842680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:06.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.140+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a480c7e60 con 0x7f6a48152290 2023-10-24T00:44:06.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.141+0000 7f6a3f7fe700 1 -- 172.21.15.148:0/499758434 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a4004ad20 con 0x7f6a48152290 2023-10-24T00:44:06.144 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:44:06.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.142+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 msgr2=0x7f6a28061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:06.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.142+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 0x7f6a28061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.142+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 msgr2=0x7f6a4814ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.142+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f6a4000c7c0 tx=0x7f6a40001510).stop 2023-10-24T00:44:06.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 shutdown_connections 2023-10-24T00:44:06.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f270 0x7f6a28061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a48152290 0x7f6a4814ffc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a480c0940 0x7f6a48144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 --2- 172.21.15.148:0/499758434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a480c6240 0x7f6a4814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 >> 172.21.15.148:0/499758434 conn(0x7f6a480946c0 msgr2=0x7f6a4806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 shutdown_connections 2023-10-24T00:44:06.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.143+0000 7f6a4dbb5700 1 -- 172.21.15.148:0/499758434 wait complete. 2023-10-24T00:44:06.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:06.214 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:06.212+0000 7fa770842680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:06.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.273+0000 7f7ae1e29700 1 Processor -- start 2023-10-24T00:44:06.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.273+0000 7f7ae1e29700 1 -- start start 2023-10-24T00:44:06.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ae1e29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc0c8360 0x7f7adc0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ae1e29700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7adc0c5ca0 0x7f7adc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ae1e29700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc066320 con 0x7f7adc154100 2023-10-24T00:44:06.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ae1e29700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0c6130 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ae1e29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc065710 con 0x7f7adc0c8360 2023-10-24T00:44:06.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7adc0c5ca0 0x7f7adc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7adc0c5ca0 0x7f7adc0a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40842/0 (socket says 172.21.15.148:40842) 2023-10-24T00:44:06.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 -- 172.21.15.148:0/4121859197 learned_addr learned my addr 172.21.15.148:0/4121859197 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:06.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adaffd700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc0c8360 0x7f7adc0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 -- 172.21.15.148:0/4121859197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc0c8360 msgr2=0x7f7adc0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:06.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc0c8360 0x7f7adc0c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 -- 172.21.15.148:0/4121859197 >> v1:172.21.15.150:6789/0 conn(0x7f7adc154100 legacy=0x7f7adc0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 -- 172.21.15.148:0/4121859197 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0659f0 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7ada7fc700 1 -- 172.21.15.148:0/4121859197 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272981962 0 0) 0x7f7adc066320 con 0x7f7adc154100 2023-10-24T00:44:06.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.274+0000 7f7adbfff700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc0a4840 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7ad4009f20 tx=0x7f7ad4009840).ready entity=mon.0 client_cookie=d47541ebeaa43ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ada7fc700 1 -- 172.21.15.148:0/4121859197 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400e070 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ada7fc700 1 -- 172.21.15.148:0/4121859197 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400b9d0 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ada7fc700 1 -- 172.21.15.148:0/4121859197 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400bd50 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 -- 172.21.15.148:0/4121859197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c5ca0 msgr2=0x7f7adc0a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc0a4840 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f7ad4009f20 tx=0x7f7ad4009840).stop 2023-10-24T00:44:06.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 -- 172.21.15.148:0/4121859197 shutdown_connections 2023-10-24T00:44:06.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc0a4840 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/4121859197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc0c8360 0x7f7adc0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 -- 172.21.15.148:0/4121859197 >> 172.21.15.148:0/4121859197 conn(0x7f7adc0641f0 msgr2=0x7f7adc0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 -- 172.21.15.148:0/4121859197 shutdown_connections 2023-10-24T00:44:06.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.275+0000 7f7ae1e29700 1 -- 172.21.15.148:0/4121859197 wait complete. 2023-10-24T00:44:06.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.276+0000 7f7ae1e29700 1 Processor -- start 2023-10-24T00:44:06.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.276+0000 7f7ae1e29700 1 -- start start 2023-10-24T00:44:06.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc13b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc154100 0x7f7adc0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0a8a40 con 0x7f7adc0c8360 2023-10-24T00:44:06.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0a7e30 con 0x7f7adc0c5ca0 2023-10-24T00:44:06.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.277+0000 7f7ae1e29700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0a8110 con 0x7f7adc154100 2023-10-24T00:44:06.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40848/0 (socket says 172.21.15.148:40848) 2023-10-24T00:44:06.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 -- 172.21.15.148:0/1854043721 learned_addr learned my addr 172.21.15.148:0/1854043721 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:06.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adb7fe700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc13b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adbfff700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc154100 0x7f7adc0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc154100 msgr2=0x7f7adc0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc154100 0x7f7adc0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7adc0c5ca0 msgr2=0x7f7adc13b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc13b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 -- 172.21.15.148:0/1854043721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4009ae0 con 0x7f7adc0c8360 2023-10-24T00:44:06.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7adaffd700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7ad000e950 tx=0x7f7ad0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0009530 con 0x7f7adc0c8360 2023-10-24T00:44:06.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0012600 con 0x7f7adc0c8360 2023-10-24T00:44:06.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc0a83f0 con 0x7f7adc0c8360 2023-10-24T00:44:06.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0012980 con 0x7f7adc0c8360 2023-10-24T00:44:06.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.278+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc167ff0 con 0x7f7adc0c8360 2023-10-24T00:44:06.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.279+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0a8bf0 con 0x7f7adc0c8360 2023-10-24T00:44:06.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.279+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7ad0012d30 con 0x7f7adc0c8360 2023-10-24T00:44:06.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.280+0000 7f7ac37fe700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 0x7f7ac8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.280+0000 7f7adb7fe700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 msgr2=0x7f7ac8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:06.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.280+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7f7ad007a950 con 0x7f7adc0c8360 2023-10-24T00:44:06.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.280+0000 7f7adb7fe700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 0x7f7ac8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:06.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.284+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7adc0a8bf0 con 0x7f7adc0c8360 2023-10-24T00:44:06.362 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:06.361+0000 7fe1e85f5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:06.483 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:06.481+0000 7fa770842680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:06.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.481+0000 7f7adb7fe700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 msgr2=0x7f7ac8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:06.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.481+0000 7f7adb7fe700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 0x7f7ac8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:06.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.496+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7adc0a8b80 con 0x7f7adc0c8360 2023-10-24T00:44:06.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.496+0000 7f7ac37fe700 1 -- 172.21.15.148:0/1854043721 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f7ad004b980 con 0x7f7adc0c8360 2023-10-24T00:44:06.499 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:06.499 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:44:06.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 msgr2=0x7f7ac8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:06.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 0x7f7ac8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 msgr2=0x7f7adc156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7ad000e950 tx=0x7f7ad0009060).stop 2023-10-24T00:44:06.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 shutdown_connections 2023-10-24T00:44:06.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7adc154100 0x7f7adc0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7adc0c5ca0 0x7f7adc13b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ac805f270 0x7f7ac8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 --2- 172.21.15.148:0/1854043721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7adc0c8360 0x7f7adc156d30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 >> 172.21.15.148:0/1854043721 conn(0x7f7adc0641f0 msgr2=0x7f7adc0bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 shutdown_connections 2023-10-24T00:44:06.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.498+0000 7f7ae1e29700 1 -- 172.21.15.148:0/1854043721 wait complete. 2023-10-24T00:44:06.504 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:44:06.513 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:06.545 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:06.544+0000 7fe1e85f5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:06.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.631+0000 7effb3e79700 1 Processor -- start 2023-10-24T00:44:06.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.632+0000 7effb3e79700 1 -- start start 2023-10-24T00:44:06.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.632+0000 7effb3e79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb3e79700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7effac0a6550 0x7effac0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb3e79700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0a8710 con 0x7effac0a8260 2023-10-24T00:44:06.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb3e79700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0a6a50 con 0x7effac0a6550 2023-10-24T00:44:06.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb3e79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0a6d30 con 0x7effac0c86c0 2023-10-24T00:44:06.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7effac0a6550 0x7effac0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb2416700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7effac0a8260 0x7effac0c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37222/0 (socket says 172.21.15.148:37222) 2023-10-24T00:44:06.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb2416700 1 -- 172.21.15.148:0/686171232 learned_addr learned my addr 172.21.15.148:0/686171232 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:06.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1c15700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 -- 172.21.15.148:0/686171232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 msgr2=0x7effac0bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:06.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 -- 172.21.15.148:0/686171232 >> v1:172.21.15.148:6789/0 conn(0x7effac0a8260 legacy=0x7effac0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb0c13700 1 -- 172.21.15.148:0/686171232 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985637245 0 0) 0x7effa4001490 con 0x7effac0a8260 2023-10-24T00:44:06.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 -- 172.21.15.148:0/686171232 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0a7010 con 0x7effac0a6550 2023-10-24T00:44:06.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb1414700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a7d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7effa8009760 tx=0x7effa8009060).ready entity=mon.0 client_cookie=643f02493863b32c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb0c13700 1 -- 172.21.15.148:0/686171232 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800f510 con 0x7effac0a6550 2023-10-24T00:44:06.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb0c13700 1 -- 172.21.15.148:0/686171232 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800f670 con 0x7effac0a6550 2023-10-24T00:44:06.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.633+0000 7effb0c13700 1 -- 172.21.15.148:0/686171232 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800f9f0 con 0x7effac0a6550 2023-10-24T00:44:06.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 -- 172.21.15.148:0/686171232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 msgr2=0x7effac0a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a7d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7effa8009760 tx=0x7effa8009060).stop 2023-10-24T00:44:06.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 -- 172.21.15.148:0/686171232 shutdown_connections 2023-10-24T00:44:06.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 --2- 172.21.15.148:0/686171232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a7d70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 -- 172.21.15.148:0/686171232 >> 172.21.15.148:0/686171232 conn(0x7effac092480 msgr2=0x7effac062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 -- 172.21.15.148:0/686171232 shutdown_connections 2023-10-24T00:44:06.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.634+0000 7effb3e79700 1 -- 172.21.15.148:0/686171232 wait complete. 2023-10-24T00:44:06.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.635+0000 7effb3e79700 1 Processor -- start 2023-10-24T00:44:06.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.635+0000 7effb3e79700 1 -- start start 2023-10-24T00:44:06.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effac0a8260 0x7effac149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0a8da0 con 0x7effac0a6550 2023-10-24T00:44:06.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ad810 con 0x7effac0a8260 2023-10-24T00:44:06.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb3e79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ab1a0 con 0x7effac0c86c0 2023-10-24T00:44:06.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40854/0 (socket says 172.21.15.148:40854) 2023-10-24T00:44:06.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 -- 172.21.15.148:0/601874538 learned_addr learned my addr 172.21.15.148:0/601874538 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:06.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb2416700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1414700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effac0a8260 0x7effac149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 -- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 msgr2=0x7effac0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 -- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effac0a8260 msgr2=0x7effac149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effac0a8260 0x7effac149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.636+0000 7effb1c15700 1 -- 172.21.15.148:0/601874538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80092a0 con 0x7effac0a6550 2023-10-24T00:44:06.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7effb1c15700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7effa000e900 tx=0x7effa0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012600 con 0x7effac0a6550 2023-10-24T00:44:06.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0012760 con 0x7effac0a6550 2023-10-24T00:44:06.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0ab480 con 0x7effac0a6550 2023-10-24T00:44:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012ae0 con 0x7effac0a6550 2023-10-24T00:44:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.637+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0ab760 con 0x7effac0a6550 2023-10-24T00:44:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.638+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0ad300 con 0x7effac0a6550 2023-10-24T00:44:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.638+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7effa001b400 con 0x7effac0a6550 2023-10-24T00:44:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.638+0000 7eff9dffb700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 0x7eff90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.639+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6409+0+0 (secure 0 0 0) 0x7effa007a840 con 0x7effac0a6550 2023-10-24T00:44:06.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.639+0000 7effb1414700 1 -- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 msgr2=0x7eff90061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:06.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.639+0000 7effb1414700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 0x7eff90061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:06.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.643+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7effac0ad300 con 0x7effac0a6550 2023-10-24T00:44:06.676 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:06.674+0000 7fa770842680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:06.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.813+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effac0ad300 con 0x7effac0a6550 2023-10-24T00:44:06.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.814+0000 7eff9dffb700 1 -- 172.21.15.148:0/601874538 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+17411 (secure 0 0 0) 0x7effac0ad300 con 0x7effac0a6550 2023-10-24T00:44:06.817 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:06.817 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":66,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:43:08.916080+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1583211251":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6832/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6833/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:0/491809098":"2023-10-25T00:42:07.378158+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:06.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 msgr2=0x7eff90061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:06.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 0x7eff90061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 msgr2=0x7effac0a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7effa000e900 tx=0x7effa0006f40).stop 2023-10-24T00:44:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 shutdown_connections 2023-10-24T00:44:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7effac0c86c0 0x7effac0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff9005f270 0x7eff90061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effac0a6550 0x7effac0a88b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 --2- 172.21.15.148:0/601874538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effac0a8260 0x7effac149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 >> 172.21.15.148:0/601874538 conn(0x7effac092480 msgr2=0x7effac0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.816+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 shutdown_connections 2023-10-24T00:44:06.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.817+0000 7effb3e79700 1 -- 172.21.15.148:0/601874538 wait complete. 2023-10-24T00:44:06.831 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:44:06.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:06.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 Processor -- start 2023-10-24T00:44:06.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 -- start start 2023-10-24T00:44:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c0be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 0x7fa63c0655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c06a270 con 0x7fa63c069d50 2023-10-24T00:44:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0bcf40 con 0x7fa63c062d60 2023-10-24T00:44:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.951+0000 7fa642282700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0beb20 con 0x7fa63c1541c0 2023-10-24T00:44:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa63c069d50 0x7fa63c062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37234/0 (socket says 172.21.15.148:37234) 2023-10-24T00:44:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63b7fe700 1 -- 172.21.15.148:0/3525822958 learned_addr learned my addr 172.21.15.148:0/3525822958 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa64081f700 1 --2- 172.21.15.148:0/3525822958 >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 0x7fa63c0655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 --2- 172.21.15.148:0/3525822958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c0be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63affd700 1 -- 172.21.15.148:0/3525822958 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250280329 0 0) 0x7fa63c06a270 con 0x7fa63c069d50 2023-10-24T00:44:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63affd700 1 -- 172.21.15.148:0/3525822958 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6280033f0 con 0x7fa63c069d50 2023-10-24T00:44:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 -- 172.21.15.148:0/3525822958 >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 msgr2=0x7fa63c0655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 --2- 172.21.15.148:0/3525822958 >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 0x7fa63c0655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 -- 172.21.15.148:0/3525822958 >> v1:172.21.15.148:6789/0 conn(0x7fa63c069d50 legacy=0x7fa63c062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 -- 172.21.15.148:0/3525822958 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0bcbf0 con 0x7fa63c1541c0 2023-10-24T00:44:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa64081f700 1 --2- 172.21.15.148:0/3525822958 >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 0x7fa63c0655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63bfff700 1 --2- 172.21.15.148:0/3525822958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c0be630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa62c009760 tx=0x7fa62c009060).ready entity=mon.2 client_cookie=9a12c0f2a22a88d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63affd700 1 -- 172.21.15.148:0/3525822958 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c009120 con 0x7fa63c1541c0 2023-10-24T00:44:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63affd700 1 -- 172.21.15.148:0/3525822958 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00d4a0 con 0x7fa63c1541c0 2023-10-24T00:44:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.952+0000 7fa63affd700 1 -- 172.21.15.148:0/3525822958 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00d820 con 0x7fa63c1541c0 2023-10-24T00:44:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 -- 172.21.15.148:0/3525822958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 msgr2=0x7fa63c0be630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 --2- 172.21.15.148:0/3525822958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c0be630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa62c009760 tx=0x7fa62c009060).stop 2023-10-24T00:44:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 -- 172.21.15.148:0/3525822958 shutdown_connections 2023-10-24T00:44:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 --2- 172.21.15.148:0/3525822958 >> v2:172.21.15.150:3300/0 conn(0x7fa63c062d60 0x7fa63c0655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 --2- 172.21.15.148:0/3525822958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c0be630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 -- 172.21.15.148:0/3525822958 >> 172.21.15.148:0/3525822958 conn(0x7fa63c064230 msgr2=0x7fa63c0c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 -- 172.21.15.148:0/3525822958 shutdown_connections 2023-10-24T00:44:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.953+0000 7fa642282700 1 -- 172.21.15.148:0/3525822958 wait complete. 2023-10-24T00:44:06.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.954+0000 7fa642282700 1 Processor -- start 2023-10-24T00:44:06.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.954+0000 7fa642282700 1 -- start start 2023-10-24T00:44:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63c062d60 0x7fa63c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0a7890 con 0x7fa63c069d50 2023-10-24T00:44:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0a86f0 con 0x7fa63c062d60 2023-10-24T00:44:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa642282700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0a7ae0 con 0x7fa63c1541c0 2023-10-24T00:44:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40870/0 (socket says 172.21.15.148:40870) 2023-10-24T00:44:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 -- 172.21.15.148:0/1869548941 learned_addr learned my addr 172.21.15.148:0/1869548941 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63bfff700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63c062d60 0x7fa63c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa64081f700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 msgr2=0x7fa63c14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c14d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63c062d60 msgr2=0x7fa63c14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63c062d60 0x7fa63c14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 -- 172.21.15.148:0/1869548941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634009a20 con 0x7fa63c069d50 2023-10-24T00:44:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.955+0000 7fa63b7fe700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa6240010e0 tx=0x7fa624007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.956+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240070d0 con 0x7fa63c069d50 2023-10-24T00:44:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.956+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624007230 con 0x7fa63c069d50 2023-10-24T00:44:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.956+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0092a0 con 0x7fa63c069d50 2023-10-24T00:44:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.956+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240075b0 con 0x7fa63c069d50 2023-10-24T00:44:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.956+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c0a80a0 con 0x7fa63c069d50 2023-10-24T00:44:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fa6240059b0 con 0x7fa63c069d50 2023-10-24T00:44:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c06c6b0 con 0x7fa63c069d50 2023-10-24T00:44:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa633fff700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 0x7fa61c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6465+0+0 (secure 0 0 0) 0x7fa624079c60 con 0x7fa63c069d50 2023-10-24T00:44:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa63bfff700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 msgr2=0x7fa61c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.957+0000 7fa63bfff700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 0x7fa61c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:06.961+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa62404ac50 con 0x7fa63c069d50 2023-10-24T00:44:07.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.158+0000 7fa63bfff700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 msgr2=0x7fa61c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:07.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.158+0000 7fa63bfff700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 0x7fa61c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:07.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.186+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa63c0633d0 con 0x7fa63c069d50 2023-10-24T00:44:07.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.186+0000 7fa633fff700 1 -- 172.21.15.148:0/1869548941 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fa62404e270 con 0x7fa63c069d50 2023-10-24T00:44:07.189 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:07.189 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:44:07.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 msgr2=0x7fa61c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:07.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 0x7fa61c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 msgr2=0x7fa63c0abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa6240010e0 tx=0x7fa624007c30).stop 2023-10-24T00:44:07.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 shutdown_connections 2023-10-24T00:44:07.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa63c1541c0 0x7fa63c14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa63c062d60 0x7fa63c14b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa61c05f270 0x7fa61c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 --2- 172.21.15.148:0/1869548941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa63c069d50 0x7fa63c0abc10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 >> 172.21.15.148:0/1869548941 conn(0x7fa63c064230 msgr2=0x7fa63c069380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:07.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 shutdown_connections 2023-10-24T00:44:07.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.189+0000 7fa642282700 1 -- 172.21.15.148:0/1869548941 wait complete. 2023-10-24T00:44:07.194 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:44:07.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:07.210 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.209+0000 7fe1e85f5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:07.280 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.278+0000 7fe1e85f5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:07.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.323+0000 7f71fa362700 1 Processor -- start 2023-10-24T00:44:07.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.323+0000 7f71fa362700 1 -- start start 2023-10-24T00:44:07.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71fa362700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 0x7f71f40bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71fa362700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40c30f0 con 0x7f71f4150910 2023-10-24T00:44:07.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71fa362700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40c24e0 con 0x7f71f4150530 2023-10-24T00:44:07.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71fa362700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40c3c90 con 0x7f71f40c1f50 2023-10-24T00:44:07.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71f37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f71f4150910 0x7f71f40638c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37250/0 (socket says 172.21.15.148:37250) 2023-10-24T00:44:07.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71f37fe700 1 -- 172.21.15.148:0/970424885 learned_addr learned my addr 172.21.15.148:0/970424885 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:07.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.324+0000 7f71f88ff700 1 --2- 172.21.15.148:0/970424885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 0x7f71f40bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895573169 0 0) 0x7f71f40c30f0 con 0x7f71f4150910 2023-10-24T00:44:07.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc0033f0 con 0x7f71f4150910 2023-10-24T00:44:07.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660440095 0 0) 0x7f71f40c24e0 con 0x7f71f4150530 2023-10-24T00:44:07.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f40c30f0 con 0x7f71f4150530 2023-10-24T00:44:07.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f88ff700 1 -- 172.21.15.148:0/970424885 >> v1:172.21.15.150:6789/0 conn(0x7f71f4150530 legacy=0x7f71f40c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f88ff700 1 -- 172.21.15.148:0/970424885 >> v1:172.21.15.148:6789/0 conn(0x7f71f4150910 legacy=0x7f71f40638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f88ff700 1 -- 172.21.15.148:0/970424885 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40c27c0 con 0x7f71f40c1f50 2023-10-24T00:44:07.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f88ff700 1 --2- 172.21.15.148:0/970424885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 0x7f71f40bcb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f71ec009e90 tx=0x7f71ec009780).ready entity=mon.2 client_cookie=7c00bc47b8910c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:07.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00e070 con 0x7f71f40c1f50 2023-10-24T00:44:07.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00bab0 con 0x7f71f40c1f50 2023-10-24T00:44:07.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.325+0000 7f71f2ffd700 1 -- 172.21.15.148:0/970424885 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00be30 con 0x7f71f40c1f50 2023-10-24T00:44:07.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 -- 172.21.15.148:0/970424885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 msgr2=0x7f71f40bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 --2- 172.21.15.148:0/970424885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 0x7f71f40bcb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f71ec009e90 tx=0x7f71ec009780).stop 2023-10-24T00:44:07.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 -- 172.21.15.148:0/970424885 shutdown_connections 2023-10-24T00:44:07.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 --2- 172.21.15.148:0/970424885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f40c1f50 0x7f71f40bcb50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 -- 172.21.15.148:0/970424885 >> 172.21.15.148:0/970424885 conn(0x7f71f40c7ee0 msgr2=0x7f71f40c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:07.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 -- 172.21.15.148:0/970424885 shutdown_connections 2023-10-24T00:44:07.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.326+0000 7f71fa362700 1 -- 172.21.15.148:0/970424885 wait complete. 2023-10-24T00:44:07.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.327+0000 7f71fa362700 1 Processor -- start 2023-10-24T00:44:07.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.327+0000 7f71fa362700 1 -- start start 2023-10-24T00:44:07.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4150530 0x7f71f4164100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4150910 0x7f71f41645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f414fca0 con 0x7f71f40c1f50 2023-10-24T00:44:07.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4164c20 con 0x7f71f4150910 2023-10-24T00:44:07.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71fa362700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4164f00 con 0x7f71f4150530 2023-10-24T00:44:07.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40886/0 (socket says 172.21.15.148:40886) 2023-10-24T00:44:07.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 -- 172.21.15.148:0/2878594133 learned_addr learned my addr 172.21.15.148:0/2878594133 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:07.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f88ff700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4150910 0x7f71f41645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f37fe700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4150530 0x7f71f4164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4150530 msgr2=0x7f71f4164100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4150530 0x7f71f4164100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4150910 msgr2=0x7f71f41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4150910 0x7f71f41645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 -- 172.21.15.148:0/2878594133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009a20 con 0x7f71f40c1f50 2023-10-24T00:44:07.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71f3fff700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f71e800c490 tx=0x7f71e8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:07.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.328+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800ce40 con 0x7f71f40c1f50 2023-10-24T00:44:07.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.329+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e800f470 con 0x7f71f40c1f50 2023-10-24T00:44:07.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.329+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f4167700 con 0x7f71f40c1f50 2023-10-24T00:44:07.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.329+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800f830 con 0x7f71f40c1f50 2023-10-24T00:44:07.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.329+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f4167cc0 con 0x7f71f40c1f50 2023-10-24T00:44:07.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f71e800fbe0 con 0x7f71f40c1f50 2023-10-24T00:44:07.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4167ee0 con 0x7f71f40c1f50 2023-10-24T00:44:07.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71dbfff700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 0x7f71e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f71e80799b0 con 0x7f71f40c1f50 2023-10-24T00:44:07.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71f37fe700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 msgr2=0x7f71e0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:07.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.330+0000 7f71f37fe700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 0x7f71e0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:07.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.334+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71e804a9a0 con 0x7f71f40c1f50 2023-10-24T00:44:07.355 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.354+0000 7fe1e85f5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:07.386 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.384+0000 7fa770842680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:07.458 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.456+0000 7fa770842680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:07.503 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.501+0000 7fe1e85f5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:07.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.531+0000 7f71f37fe700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 msgr2=0x7f71e0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:07.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.531+0000 7f71f37fe700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 0x7f71e0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:07.535 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.533+0000 7fa770842680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:07.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.566+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71f406c6b0 con 0x7f71f40c1f50 2023-10-24T00:44:07.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.566+0000 7f71dbfff700 1 -- 172.21.15.148:0/2878594133 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f71e804dfc0 con 0x7f71f40c1f50 2023-10-24T00:44:07.570 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:07.570 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:41:55.467761+0000","modified":"2023-10-24T00:41:58.110765+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5865},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5865":{"gid":5865,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1105578724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1105578724},{"type":"v1","addr":"172.21.15.150:6836","nonce":1105578724}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-24T00:44:07.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 msgr2=0x7f71e0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:07.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 0x7f71e0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 msgr2=0x7f71f414f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f71e800c490 tx=0x7f71e8007c90).stop 2023-10-24T00:44:07.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 shutdown_connections 2023-10-24T00:44:07.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f4150910 0x7f71f41645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f71e005f270 0x7f71e0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71f40c1f50 0x7f71f414f7b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 --2- 172.21.15.148:0/2878594133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f4150530 0x7f71f4164100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.568+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 >> 172.21.15.148:0/2878594133 conn(0x7f71f40c7ee0 msgr2=0x7f71f4064c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:07.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.569+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 shutdown_connections 2023-10-24T00:44:07.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.569+0000 7f71fa362700 1 -- 172.21.15.148:0/2878594133 wait complete. 2023-10-24T00:44:07.575 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2023-10-24T00:44:07.575 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.572+0000 7fe1e85f5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:07.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:07.688 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.687+0000 7fe1e85f5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:07.692 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.690+0000 7fa770842680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:07.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.699+0000 7fd25ff9a700 1 Processor -- start 2023-10-24T00:44:07.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.699+0000 7fd25ff9a700 1 -- start start 2023-10-24T00:44:07.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25ff9a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd2581579f0 0x7fd258069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25ff9a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd258068bd0 0x7fd258069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25ff9a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd258064150 con 0x7fd2580c4b70 2023-10-24T00:44:07.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25ff9a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd258063970 con 0x7fd2581579f0 2023-10-24T00:44:07.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25ff9a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd258062dd0 con 0x7fd258068bd0 2023-10-24T00:44:07.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25dd36700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd2581579f0 0x7fd258069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25dd36700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd2581579f0 0x7fd258069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40896/0 (socket says 172.21.15.148:40896) 2023-10-24T00:44:07.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.700+0000 7fd25dd36700 1 -- 172.21.15.148:0/1291773214 learned_addr learned my addr 172.21.15.148:0/1291773214 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:07.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25e537700 1 --2- 172.21.15.148:0/1291773214 >> v2:172.21.15.150:3300/0 conn(0x7fd258068bd0 0x7fd258069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25dd36700 1 -- 172.21.15.148:0/1291773214 >> v2:172.21.15.150:3300/0 conn(0x7fd258068bd0 msgr2=0x7fd258069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:07.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25dd36700 1 --2- 172.21.15.148:0/1291773214 >> v2:172.21.15.150:3300/0 conn(0x7fd258068bd0 0x7fd258069020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25dd36700 1 -- 172.21.15.148:0/1291773214 >> v1:172.21.15.150:6789/0 conn(0x7fd2580c4b70 legacy=0x7fd258063260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25dd36700 1 -- 172.21.15.148:0/1291773214 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258069510 con 0x7fd2581579f0 2023-10-24T00:44:07.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25cd34700 1 -- 172.21.15.148:0/1291773214 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425336713 0 0) 0x7fd258064150 con 0x7fd2580c4b70 2023-10-24T00:44:07.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25dd36700 1 --2- 172.21.15.148:0/1291773214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd258069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fd258068b60 tx=0x7fd2480090f0).ready entity=mon.0 client_cookie=a6ada54e09cb6ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:07.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25cd34700 1 -- 172.21.15.148:0/1291773214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800b520 con 0x7fd2581579f0 2023-10-24T00:44:07.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25cd34700 1 -- 172.21.15.148:0/1291773214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24800b680 con 0x7fd2581579f0 2023-10-24T00:44:07.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.701+0000 7fd25cd34700 1 -- 172.21.15.148:0/1291773214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800ba20 con 0x7fd2581579f0 2023-10-24T00:44:07.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 -- 172.21.15.148:0/1291773214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 msgr2=0x7fd258069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/1291773214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd258069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fd258068b60 tx=0x7fd2480090f0).stop 2023-10-24T00:44:07.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 -- 172.21.15.148:0/1291773214 shutdown_connections 2023-10-24T00:44:07.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/1291773214 >> v2:172.21.15.150:3300/0 conn(0x7fd258068bd0 0x7fd258069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/1291773214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd258069d80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 -- 172.21.15.148:0/1291773214 >> 172.21.15.148:0/1291773214 conn(0x7fd2580c7ef0 msgr2=0x7fd2580c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:07.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 -- 172.21.15.148:0/1291773214 shutdown_connections 2023-10-24T00:44:07.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.702+0000 7fd25ff9a700 1 -- 172.21.15.148:0/1291773214 wait complete. 2023-10-24T00:44:07.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.703+0000 7fd25ff9a700 1 Processor -- start 2023-10-24T00:44:07.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.703+0000 7fd25ff9a700 1 -- start start 2023-10-24T00:44:07.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd258068bd0 0x7fd258149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2580c4b70 0x7fd2580ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581688b0 con 0x7fd2581579f0 2023-10-24T00:44:07.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258167ca0 con 0x7fd258068bd0 2023-10-24T00:44:07.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd258167f80 con 0x7fd2580c4b70 2023-10-24T00:44:07.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40912/0 (socket says 172.21.15.148:40912) 2023-10-24T00:44:07.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 -- 172.21.15.148:0/2268114172 learned_addr learned my addr 172.21.15.148:0/2268114172 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:07.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25dd36700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd258068bd0 0x7fd258149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25d535700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2580c4b70 0x7fd2580ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:07.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 -- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2580c4b70 msgr2=0x7fd2580ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2580c4b70 0x7fd2580ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 -- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd258068bd0 msgr2=0x7fd258149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd258068bd0 0x7fd258149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 -- 172.21.15.148:0/2268114172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009370 con 0x7fd2581579f0 2023-10-24T00:44:07.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25e537700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd250009df0 tx=0x7fd25000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:07.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000caa0 con 0x7fd2581579f0 2023-10-24T00:44:07.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000f040 con 0x7fd2581579f0 2023-10-24T00:44:07.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd258168260 con 0x7fd2581579f0 2023-10-24T00:44:07.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.704+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000ce10 con 0x7fd2581579f0 2023-10-24T00:44:07.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.705+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580ac140 con 0x7fd2581579f0 2023-10-24T00:44:07.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd258168a20 con 0x7fd2581579f0 2023-10-24T00:44:07.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd250013610 con 0x7fd2581579f0 2023-10-24T00:44:07.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd24dffb700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 0x7fd23c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:07.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd25dd36700 1 -- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 msgr2=0x7fd23c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:07.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6465+0+0 (secure 0 0 0) 0x7fd25007abb0 con 0x7fd2581579f0 2023-10-24T00:44:07.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.706+0000 7fd25dd36700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 0x7fd23c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:07.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.710+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd25004bba0 con 0x7fd2581579f0 2023-10-24T00:44:07.768 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.765+0000 7fa770842680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:07.797 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:07.796+0000 7fe1e85f5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:07.886 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:07.883+0000 7fa770842680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:07.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.883+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd25806c6b0 con 0x7fd2581579f0 2023-10-24T00:44:07.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.884+0000 7fd24dffb700 1 -- 172.21.15.148:0/2268114172 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17519 (secure 0 0 0) 0x7fd25004f1c0 con 0x7fd2581579f0 2023-10-24T00:44:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:07.888 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":67,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:06.925546+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:41:54.030189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-24T00:41:54.428914+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":67,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]},{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1583211251":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6832/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:6833/87479":"2023-10-25T00:42:07.378158+0000","172.21.15.150:0/491809098":"2023-10-25T00:42:07.378158+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:07.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.886+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 msgr2=0x7fd23c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:07.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.886+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 0x7fd23c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 msgr2=0x7fd2580c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:07.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fd250009df0 tx=0x7fd25000b040).stop 2023-10-24T00:44:07.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 shutdown_connections 2023-10-24T00:44:07.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd23c05f270 0x7fd23c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:07.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2581579f0 0x7fd2580c2d90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd258068bd0 0x7fd258149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 --2- 172.21.15.148:0/2268114172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2580c4b70 0x7fd2580ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:07.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 >> 172.21.15.148:0/2268114172 conn(0x7fd2580c7ef0 msgr2=0x7fd2580c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:07.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 shutdown_connections 2023-10-24T00:44:07.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:07.887+0000 7fd25ff9a700 1 -- 172.21.15.148:0/2268114172 wait complete. 2023-10-24T00:44:07.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:44:08.003 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:08.001+0000 7fa770842680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:08.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.019+0000 7f601d430700 1 Processor -- start 2023-10-24T00:44:08.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.019+0000 7f601d430700 1 -- start start 2023-10-24T00:44:08.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f60180bf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f60180a7e70 0x7f60180a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60180c4180 0x7f60180c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180be590 con 0x7f60180c4180 2023-10-24T00:44:08.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180bf3d0 con 0x7f60180a7e70 2023-10-24T00:44:08.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f601d430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180a87e0 con 0x7f6018152270 2023-10-24T00:44:08.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f60177fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60180c4180 0x7f60180c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f60177fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60180c4180 0x7f60180c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40914/0 (socket says 172.21.15.148:40914) 2023-10-24T00:44:08.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.020+0000 7f60177fe700 1 -- 172.21.15.148:0/221326799 learned_addr learned my addr 172.21.15.148:0/221326799 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:08.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60167fc700 1 --2- 172.21.15.148:0/221326799 >> v2:172.21.15.150:3300/0 conn(0x7f60180a7e70 0x7f60180a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f6016ffd700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f60180bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 -- 172.21.15.148:0/221326799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 msgr2=0x7f60180bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:08.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f60180bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 -- 172.21.15.148:0/221326799 >> v2:172.21.15.150:3300/0 conn(0x7f60180a7e70 msgr2=0x7f60180a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:08.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 --2- 172.21.15.148:0/221326799 >> v2:172.21.15.150:3300/0 conn(0x7f60180a7e70 0x7f60180a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 -- 172.21.15.148:0/221326799 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180c4ae0 con 0x7f60180c4180 2023-10-24T00:44:08.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f60177fe700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c45f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f601806a040 tx=0x7f6010009840).ready entity=mon.0 client_cookie=50aeccf5c56a7a78 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:08.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f6015ffb700 1 -- 172.21.15.148:0/221326799 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000e070 con 0x7f60180c4180 2023-10-24T00:44:08.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f6015ffb700 1 -- 172.21.15.148:0/221326799 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601000b970 con 0x7f60180c4180 2023-10-24T00:44:08.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.021+0000 7f6015ffb700 1 -- 172.21.15.148:0/221326799 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000bcf0 con 0x7f60180c4180 2023-10-24T00:44:08.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 -- 172.21.15.148:0/221326799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 msgr2=0x7f60180c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:08.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c45f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f601806a040 tx=0x7f6010009840).stop 2023-10-24T00:44:08.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 -- 172.21.15.148:0/221326799 shutdown_connections 2023-10-24T00:44:08.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c45f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 --2- 172.21.15.148:0/221326799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f60180bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 --2- 172.21.15.148:0/221326799 >> v2:172.21.15.150:3300/0 conn(0x7f60180a7e70 0x7f60180a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 -- 172.21.15.148:0/221326799 >> 172.21.15.148:0/221326799 conn(0x7f6018092510 msgr2=0x7f6018062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 -- 172.21.15.148:0/221326799 shutdown_connections 2023-10-24T00:44:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.022+0000 7f601d430700 1 -- 172.21.15.148:0/221326799 wait complete. 2023-10-24T00:44:08.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.023+0000 7f601d430700 1 Processor -- start 2023-10-24T00:44:08.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.023+0000 7f601d430700 1 -- start start 2023-10-24T00:44:08.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60180a7e70 0x7f6018168b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f6018067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180657d0 con 0x7f60180c4180 2023-10-24T00:44:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180c3290 con 0x7f60180a7e70 2023-10-24T00:44:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f601d430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180c2fb0 con 0x7f6018152270 2023-10-24T00:44:08.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40918/0 (socket says 172.21.15.148:40918) 2023-10-24T00:44:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 -- 172.21.15.148:0/1005757772 learned_addr learned my addr 172.21.15.148:0/1005757772 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f6016ffd700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60180a7e70 0x7f6018168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60177fe700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f6018067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:08.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 -- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 msgr2=0x7f6018067680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:08.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f6018067680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 -- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60180a7e70 msgr2=0x7f6018168b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:08.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60180a7e70 0x7f6018168b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:08.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 -- 172.21.15.148:0/1005757772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010009ae0 con 0x7f60180c4180 2023-10-24T00:44:08.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60177fe700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f6018067680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:08.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.024+0000 7f60167fc700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f600800e900 tx=0x7f6008009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:08.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.025+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008012600 con 0x7f60180c4180 2023-10-24T00:44:08.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.025+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008012760 con 0x7f60180c4180 2023-10-24T00:44:08.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.025+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6018168040 con 0x7f60180c4180 2023-10-24T00:44:08.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.025+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008012ae0 con 0x7f60180c4180 2023-10-24T00:44:08.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.025+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6018168680 con 0x7f60180c4180 2023-10-24T00:44:08.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.026+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601806c6b0 con 0x7f60180c4180 2023-10-24T00:44:08.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.026+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f600801b400 con 0x7f60180c4180 2023-10-24T00:44:08.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.027+0000 7f5ffeffd700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 0x7f6004061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:08.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.027+0000 7f6016ffd700 1 -- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 msgr2=0x7f6004061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:08.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.027+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6465+0+0 (secure 0 0 0) 0x7f600807a9a0 con 0x7f60180c4180 2023-10-24T00:44:08.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.027+0000 7f6016ffd700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 0x7f6004061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:08.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.031+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f600804b930 con 0x7f60180c4180 2023-10-24T00:44:08.089 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.087+0000 7fe1e85f5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:08.160 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.158+0000 7fe1e85f5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:08.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.181+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 22) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f6008078490 con 0x7f60180c4180 2023-10-24T00:44:08.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.181+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 msgr2=0x7f6004061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:08.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.181+0000 7f5ffeffd700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 0x7f6004061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:08.239 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe164d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.239 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe164d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.239 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe164d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.240 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe164d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.240 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe164d8c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.240 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe162587700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.240 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe162587700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.240 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe162587700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.241 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe162587700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.241 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:08.236+0000 7fe162587700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:08.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:08.279+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6018063340 con 0x7f60180c4180 2023-10-24T00:44:08.327 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:08.324+0000 7fa770842680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:08.397 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:08.395+0000 7fa770842680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:09.176 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:44:09.175+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:44:09.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.176+0000 7f5ffeffd700 1 -- 172.21.15.148:0/1005757772 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f600806e390 con 0x7f60180c4180 2023-10-24T00:44:09.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 msgr2=0x7f60180c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f600800e900 tx=0x7f6008009060).stop 2023-10-24T00:44:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 shutdown_connections 2023-10-24T00:44:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6018152270 0x7f6018067680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60180a7e70 0x7f6018168b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f600405f270 0x7f6004061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 --2- 172.21.15.148:0/1005757772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60180c4180 0x7f60180c2660 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 >> 172.21.15.148:0/1005757772 conn(0x7f6018092510 msgr2=0x7f60180666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 shutdown_connections 2023-10-24T00:44:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.179+0000 7f601d430700 1 -- 172.21.15.148:0/1005757772 wait complete. 2023-10-24T00:44:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:44:09.198 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:44:09.218 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:44:09.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.314+0000 7f852b59e700 1 Processor -- start 2023-10-24T00:44:09.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.314+0000 7f852b59e700 1 -- start start 2023-10-24T00:44:09.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f852c154150 0x7f852c0a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f852c0aa390 0x7f852c0c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c0a9830 con 0x7f852c0c0e30 2023-10-24T00:44:09.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0c1280 con 0x7f852c0aa390 2023-10-24T00:44:09.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0a8c20 con 0x7f852c154150 2023-10-24T00:44:09.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f852c0aa390 0x7f852c0c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:09.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f852c0c0e30 0x7f852c0c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37266/0 (socket says 172.21.15.148:37266) 2023-10-24T00:44:09.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852ad9d700 1 -- 172.21.15.148:0/2892857736 learned_addr learned my addr 172.21.15.148:0/2892857736 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:09.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f852c0aa390 0x7f852c0c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40928/0 (socket says 172.21.15.148:40928) 2023-10-24T00:44:09.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852a59c700 1 --2- 172.21.15.148:0/2892857736 >> v2:172.21.15.150:3300/0 conn(0x7f852c154150 0x7f852c0a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:09.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 -- 172.21.15.148:0/2892857736 >> v2:172.21.15.150:3300/0 conn(0x7f852c154150 msgr2=0x7f852c0a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:09.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 --2- 172.21.15.148:0/2892857736 >> v2:172.21.15.150:3300/0 conn(0x7f852c154150 0x7f852c0a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 -- 172.21.15.148:0/2892857736 >> v1:172.21.15.148:6789/0 conn(0x7f852c0c0e30 legacy=0x7f852c0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:09.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852959a700 1 -- 172.21.15.148:0/2892857736 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317063909 0 0) 0x7f852c0a9830 con 0x7f852c0c0e30 2023-10-24T00:44:09.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 -- 172.21.15.148:0/2892857736 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c0a8f00 con 0x7f852c0aa390 2023-10-24T00:44:09.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f8529d9b700 1 --2- 172.21.15.148:0/2892857736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0aa390 0x7f852c0c0940 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f852c0858f0 tx=0x7f8520009060).ready entity=mon.0 client_cookie=81e4eb283083c258 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:09.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852959a700 1 -- 172.21.15.148:0/2892857736 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000f510 con 0x7f852c0aa390 2023-10-24T00:44:09.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852959a700 1 -- 172.21.15.148:0/2892857736 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000f670 con 0x7f852c0aa390 2023-10-24T00:44:09.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.315+0000 7f852959a700 1 -- 172.21.15.148:0/2892857736 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000f9f0 con 0x7f852c0aa390 2023-10-24T00:44:09.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 -- 172.21.15.148:0/2892857736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0aa390 msgr2=0x7f852c0c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:09.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 --2- 172.21.15.148:0/2892857736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0aa390 0x7f852c0c0940 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f852c0858f0 tx=0x7f8520009060).stop 2023-10-24T00:44:09.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 -- 172.21.15.148:0/2892857736 shutdown_connections 2023-10-24T00:44:09.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 --2- 172.21.15.148:0/2892857736 >> v2:172.21.15.150:3300/0 conn(0x7f852c154150 0x7f852c0a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 --2- 172.21.15.148:0/2892857736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0aa390 0x7f852c0c0940 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 -- 172.21.15.148:0/2892857736 >> 172.21.15.148:0/2892857736 conn(0x7f852c094500 msgr2=0x7f852c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:09.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 -- 172.21.15.148:0/2892857736 shutdown_connections 2023-10-24T00:44:09.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.316+0000 7f852b59e700 1 -- 172.21.15.148:0/2892857736 wait complete. 2023-10-24T00:44:09.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.317+0000 7f852b59e700 1 Processor -- start 2023-10-24T00:44:09.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.317+0000 7f852b59e700 1 -- start start 2023-10-24T00:44:09.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f852c0aa390 0x7f852c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f852c154150 0x7f852c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0ae5d0 con 0x7f852c0c0e30 2023-10-24T00:44:09.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0abaf0 con 0x7f852c0aa390 2023-10-24T00:44:09.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0ae890 con 0x7f852c154150 2023-10-24T00:44:09.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:09.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40942/0 (socket says 172.21.15.148:40942) 2023-10-24T00:44:09.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 -- 172.21.15.148:0/302886332 learned_addr learned my addr 172.21.15.148:0/302886332 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:09.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f852a59c700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f852c0aa390 0x7f852c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:09.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 -- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f852c154150 msgr2=0x7f852c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:09.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f852c154150 0x7f852c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:09.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 -- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f852c0aa390 msgr2=0x7f852c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:09.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f852c0aa390 0x7f852c153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:09.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 -- 172.21.15.148:0/302886332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200092a0 con 0x7f852c0c0e30 2023-10-24T00:44:09.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f8529d9b700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8520009dd0 tx=0x7f8520017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:09.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000f7e0 con 0x7f852c0c0e30 2023-10-24T00:44:09.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.318+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000f940 con 0x7f852c0c0e30 2023-10-24T00:44:09.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.319+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c0ab250 con 0x7f852c0c0e30 2023-10-24T00:44:09.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.319+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852001b650 con 0x7f852c0c0e30 2023-10-24T00:44:09.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.319+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c0ab810 con 0x7f852c0c0e30 2023-10-24T00:44:09.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.320+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c0aea00 con 0x7f852c0c0e30 2023-10-24T00:44:09.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.320+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f852001ba40 con 0x7f852c0c0e30 2023-10-24T00:44:09.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.320+0000 7f851a7fc700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 0x7f850c0614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:09.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.320+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6695+0+0 (secure 0 0 0) 0x7f852007b8c0 con 0x7f852c0c0e30 2023-10-24T00:44:09.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.321+0000 7f852a59c700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 0x7f850c0614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:09.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.321+0000 7f852a59c700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 0x7f850c0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f851c009fd0 tx=0x7f851c00b040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:09.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.325+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f852004cb20 con 0x7f852c0c0e30 2023-10-24T00:44:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:09.529+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f852c047480 con 0x7f852c0c0e30 2023-10-24T00:44:10.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.187+0000 7f851a7fc700 1 -- 172.21.15.148:0/302886332 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8520050140 con 0x7f852c0c0e30 2023-10-24T00:44:10.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 msgr2=0x7f850c0614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 0x7f850c0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f851c009fd0 tx=0x7f851c00b040).stop 2023-10-24T00:44:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 msgr2=0x7f852c0aa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f8520009dd0 tx=0x7f8520017000).stop 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 shutdown_connections 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f852c154150 0x7f852c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f852c0aa390 0x7f852c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f850c05f000 0x7f850c0614c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 --2- 172.21.15.148:0/302886332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f852c0c0e30 0x7f852c0aa870 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 >> 172.21.15.148:0/302886332 conn(0x7f852c094500 msgr2=0x7f852c0c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 shutdown_connections 2023-10-24T00:44:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.190+0000 7f852b59e700 1 -- 172.21.15.148:0/302886332 wait complete. 2023-10-24T00:44:10.205 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:44:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.319+0000 7fb94fe69700 1 Processor -- start 2023-10-24T00:44:10.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.319+0000 7fb94fe69700 1 -- start start 2023-10-24T00:44:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94fe69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94fe69700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9480aa420 0x7fb9480c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94fe69700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480c6270 con 0x7fb9481544b0 2023-10-24T00:44:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94fe69700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480c60e0 con 0x7fb9480aa420 2023-10-24T00:44:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94fe69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480aa890 con 0x7fb9480a7d00 2023-10-24T00:44:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94e406700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb9480aa420 0x7fb9480c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94dc05700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb9481544b0 0x7fb9480c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37274/0 (socket says 172.21.15.148:37274) 2023-10-24T00:44:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94dc05700 1 -- 172.21.15.148:0/3003957993 learned_addr learned my addr 172.21.15.148:0/3003957993 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:10.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.320+0000 7fb94d404700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94e406700 1 -- 172.21.15.148:0/3003957993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 msgr2=0x7fb9480a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:10.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94e406700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94e406700 1 -- 172.21.15.148:0/3003957993 >> v1:172.21.15.148:6789/0 conn(0x7fb9481544b0 legacy=0x7fb9480c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:10.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94e406700 1 -- 172.21.15.148:0/3003957993 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480c0c80 con 0x7fb9480aa420 2023-10-24T00:44:10.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94d404700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:10.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94e406700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9480c6700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb940009e60 tx=0x7fb940009780).ready entity=mon.0 client_cookie=fa0c897b31fdc2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94cc03700 1 -- 172.21.15.148:0/3003957993 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000e070 con 0x7fb9480aa420 2023-10-24T00:44:10.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94cc03700 1 -- 172.21.15.148:0/3003957993 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000bbf0 con 0x7fb9480aa420 2023-10-24T00:44:10.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94cc03700 1 -- 172.21.15.148:0/3003957993 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940012410 con 0x7fb9480aa420 2023-10-24T00:44:10.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 -- 172.21.15.148:0/3003957993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 msgr2=0x7fb9480c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9480c6700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fb940009e60 tx=0x7fb940009780).stop 2023-10-24T00:44:10.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 -- 172.21.15.148:0/3003957993 shutdown_connections 2023-10-24T00:44:10.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9480c6700 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3003957993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.321+0000 7fb94fe69700 1 -- 172.21.15.148:0/3003957993 >> 172.21.15.148:0/3003957993 conn(0x7fb9480945d0 msgr2=0x7fb94806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.322+0000 7fb94fe69700 1 -- 172.21.15.148:0/3003957993 shutdown_connections 2023-10-24T00:44:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.322+0000 7fb94fe69700 1 -- 172.21.15.148:0/3003957993 wait complete. 2023-10-24T00:44:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 Processor -- start 2023-10-24T00:44:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 -- start start 2023-10-24T00:44:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9481544b0 0x7fb9481569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948156ea0 con 0x7fb9480aa420 2023-10-24T00:44:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480ab5a0 con 0x7fb9481544b0 2023-10-24T00:44:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94fe69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480c2ef0 con 0x7fb9480a7d00 2023-10-24T00:44:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.323+0000 7fb94d404700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40958/0 (socket says 172.21.15.148:40958) 2023-10-24T00:44:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 -- 172.21.15.148:0/3923518204 learned_addr learned my addr 172.21.15.148:0/3923518204 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94dc05700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 -- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 msgr2=0x7fb9480ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 -- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9481544b0 msgr2=0x7fb9481569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9481544b0 0x7fb9481569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:10.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 -- 172.21.15.148:0/3923518204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009a20 con 0x7fb9480aa420 2023-10-24T00:44:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94d404700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb93c00c880 tx=0x7fb93c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c010580 con 0x7fb9480aa420 2023-10-24T00:44:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c0106e0 con 0x7fb9480aa420 2023-10-24T00:44:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c010a60 con 0x7fb9480aa420 2023-10-24T00:44:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480c31d0 con 0x7fb9480aa420 2023-10-24T00:44:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.324+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480c3790 con 0x7fb9480aa420 2023-10-24T00:44:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.325+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fb93c01b460 con 0x7fb9480aa420 2023-10-24T00:44:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.326+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94806c6b0 con 0x7fb9480aa420 2023-10-24T00:44:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.326+0000 7fb945ffb700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 0x7fb9340614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.326+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6695+0+0 (secure 0 0 0) 0x7fb93c07a370 con 0x7fb9480aa420 2023-10-24T00:44:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.326+0000 7fb94dc05700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 0x7fb9340614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.326+0000 7fb94dc05700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 0x7fb9340614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb93800a750 tx=0x7fb938008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.330+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb93c04b460 con 0x7fb9480aa420 2023-10-24T00:44:10.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.494+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9480c0f40 con 0x7fb9480aa420 2023-10-24T00:44:10.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.833+0000 7fb945ffb700 1 -- 172.21.15.148:0/3923518204 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb93c04ea80 con 0x7fb9480aa420 2023-10-24T00:44:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 msgr2=0x7fb9340614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 0x7fb9340614c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb93800a750 tx=0x7fb938008040).stop 2023-10-24T00:44:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 msgr2=0x7fb9481564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb93c00c880 tx=0x7fb93c008040).stop 2023-10-24T00:44:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 shutdown_connections 2023-10-24T00:44:10.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9481544b0 0x7fb9481569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9480a7d00 0x7fb9480ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb93405f000 0x7fb9340614c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 --2- 172.21.15.148:0/3923518204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb9480aa420 0x7fb9481564c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.836+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 >> 172.21.15.148:0/3923518204 conn(0x7fb9480945d0 msgr2=0x7fb9481535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.837+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 shutdown_connections 2023-10-24T00:44:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.837+0000 7fb94fe69700 1 -- 172.21.15.148:0/3923518204 wait complete. 2023-10-24T00:44:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:44:10.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:44:10.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.969+0000 7f24d0a4a700 1 Processor -- start 2023-10-24T00:44:10.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.969+0000 7f24d0a4a700 1 -- start start 2023-10-24T00:44:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24d0a4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24cc0a9f40 0x7f24cc155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24d0a4a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f24cc0aa320 0x7f24cc0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24d0a4a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc0c7770 con 0x7f24cc0c0820 2023-10-24T00:44:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24d0a4a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0c86d0 con 0x7f24cc0a9f40 2023-10-24T00:44:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24d0a4a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc0c1070 con 0x7f24cc0aa320 2023-10-24T00:44:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24cc0a9f40 0x7f24cc155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24cc0a9f40 0x7f24cc155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40968/0 (socket says 172.21.15.148:40968) 2023-10-24T00:44:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 -- 172.21.15.148:0/2399828182 learned_addr learned my addr 172.21.15.148:0/2399828182 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24caffd700 1 --2- 172.21.15.148:0/2399828182 >> v2:172.21.15.150:3300/0 conn(0x7f24cc0aa320 0x7f24cc0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 -- 172.21.15.148:0/2399828182 >> v2:172.21.15.150:3300/0 conn(0x7f24cc0aa320 msgr2=0x7f24cc0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 --2- 172.21.15.148:0/2399828182 >> v2:172.21.15.150:3300/0 conn(0x7f24cc0aa320 0x7f24cc0c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 -- 172.21.15.148:0/2399828182 >> v1:172.21.15.150:6789/0 conn(0x7f24cc0c0820 legacy=0x7f24cc153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 -- 172.21.15.148:0/2399828182 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc0c79e0 con 0x7f24cc0a9f40 2023-10-24T00:44:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.970+0000 7f24cb7fe700 1 --2- 172.21.15.148:0/2399828182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0a9f40 0x7f24cc155350 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f24cc0c8be0 tx=0x7f24bc009060).ready entity=mon.0 client_cookie=7eec7ce93449626f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24ca7fc700 1 -- 172.21.15.148:0/2399828182 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc005880 con 0x7f24cc0a9f40 2023-10-24T00:44:10.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24ca7fc700 1 -- 172.21.15.148:0/2399828182 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc0059e0 con 0x7f24cc0a9f40 2023-10-24T00:44:10.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24ca7fc700 1 -- 172.21.15.148:0/2399828182 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc005d60 con 0x7f24cc0a9f40 2023-10-24T00:44:10.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2399828182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0a9f40 msgr2=0x7f24cc155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2399828182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0a9f40 0x7f24cc155350 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f24cc0c8be0 tx=0x7f24bc009060).stop 2023-10-24T00:44:10.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2399828182 shutdown_connections 2023-10-24T00:44:10.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2399828182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0a9f40 0x7f24cc155350 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2399828182 >> v2:172.21.15.150:3300/0 conn(0x7f24cc0aa320 0x7f24cc0c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2399828182 >> 172.21.15.148:0/2399828182 conn(0x7f24cc094420 msgr2=0x7f24cc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2399828182 shutdown_connections 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.971+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2399828182 wait complete. 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.972+0000 7f24d0a4a700 1 Processor -- start 2023-10-24T00:44:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 -- start start 2023-10-24T00:44:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24cc0a9f40 0x7f24cc0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 0x7f24cc151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0ca810 con 0x7f24cc0aa320 2023-10-24T00:44:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0c9c00 con 0x7f24cc0c0820 2023-10-24T00:44:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24d0a4a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc0c9ee0 con 0x7f24cc0a9f40 2023-10-24T00:44:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.973+0000 7f24caffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40970/0 (socket says 172.21.15.148:40970) 2023-10-24T00:44:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 -- 172.21.15.148:0/2494560383 learned_addr learned my addr 172.21.15.148:0/2494560383 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24cb7fe700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24cc0a9f40 0x7f24cc0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 -- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24cc0a9f40 msgr2=0x7f24cc0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24cc0a9f40 0x7f24cc0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 -- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 msgr2=0x7f24cc151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24cbfff700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 0x7f24cc151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 0x7f24cc151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 -- 172.21.15.148:0/2494560383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009300 con 0x7f24cc0aa320 2023-10-24T00:44:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24cbfff700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 0x7f24cc151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.974+0000 7f24caffd700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f24c000d890 tx=0x7f24c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.976+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00125f0 con 0x7f24cc0aa320 2023-10-24T00:44:10.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.976+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0012750 con 0x7f24cc0aa320 2023-10-24T00:44:10.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.976+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0012ad0 con 0x7f24cc0aa320 2023-10-24T00:44:10.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.976+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0ca1c0 con 0x7f24cc0aa320 2023-10-24T00:44:10.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.976+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc1575f0 con 0x7f24cc0aa320 2023-10-24T00:44:10.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.978+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc0ca9c0 con 0x7f24cc0aa320 2023-10-24T00:44:10.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.978+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f24c0013480 con 0x7f24cc0aa320 2023-10-24T00:44:10.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.978+0000 7f24b37fe700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 0x7f24b80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:10.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.979+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6199+0+0 (secure 0 0 0) 0x7f24c0079ef0 con 0x7f24cc0aa320 2023-10-24T00:44:10.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.979+0000 7f24cb7fe700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 0x7f24b80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:10.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.979+0000 7f24cb7fe700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 0x7f24b80614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f24bc00b3c0 tx=0x7f24bc016000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:10.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:10.983+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f24cc0ca9c0 con 0x7f24cc0aa320 2023-10-24T00:44:11.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.150+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24cc0ca950 con 0x7f24cc0aa320 2023-10-24T00:44:11.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.189+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f24c0077d30 con 0x7f24cc0aa320 2023-10-24T00:44:11.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.938+0000 7f24b37fe700 1 -- 172.21.15.148:0/2494560383 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7f24c0072180 con 0x7f24cc0aa320 2023-10-24T00:44:11.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 msgr2=0x7f24b80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:11.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 0x7f24b80614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f24bc00b3c0 tx=0x7f24bc016000).stop 2023-10-24T00:44:11.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 msgr2=0x7f24cc0c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:11.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f24c000d890 tx=0x7f24c0008040).stop 2023-10-24T00:44:11.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 shutdown_connections 2023-10-24T00:44:11.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24cc0c0820 0x7f24cc151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:11.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24cc0a9f40 0x7f24cc0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:11.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f24b805f030 0x7f24b80614f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:11.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 --2- 172.21.15.148:0/2494560383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24cc0aa320 0x7f24cc0c4930 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:11.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 >> 172.21.15.148:0/2494560383 conn(0x7f24cc094420 msgr2=0x7f24cc153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:11.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.941+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 shutdown_connections 2023-10-24T00:44:11.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:11.942+0000 7f24d0a4a700 1 -- 172.21.15.148:0/2494560383 wait complete. 2023-10-24T00:44:11.947 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:44:11.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:44:12.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.069+0000 7fa5fbfff700 1 Processor -- start 2023-10-24T00:44:12.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.069+0000 7fa5fbfff700 1 -- start start 2023-10-24T00:44:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5fc154150 0x7fa5fc0a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fbfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5fc0c1050 0x7fa5fc15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fbfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc0a9830 con 0x7fa5fc0aa390 2023-10-24T00:44:12.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fbfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0a8c20 con 0x7fa5fc0c1050 2023-10-24T00:44:12.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fbfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0a8f00 con 0x7fa5fc154150 2023-10-24T00:44:12.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5f27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa5fc0aa390 0x7fa5fc0c0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37284/0 (socket says 172.21.15.148:37284) 2023-10-24T00:44:12.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa5fc0c1050 0x7fa5fc15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5f27fc700 1 -- 172.21.15.148:0/910422992 learned_addr learned my addr 172.21.15.148:0/910422992 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5faffd700 1 --2- 172.21.15.148:0/910422992 >> v2:172.21.15.150:3300/0 conn(0x7fa5fc154150 0x7fa5fc0a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fb7fe700 1 -- 172.21.15.148:0/910422992 >> v2:172.21.15.150:3300/0 conn(0x7fa5fc154150 msgr2=0x7fa5fc0a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fb7fe700 1 --2- 172.21.15.148:0/910422992 >> v2:172.21.15.150:3300/0 conn(0x7fa5fc154150 0x7fa5fc0a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fb7fe700 1 -- 172.21.15.148:0/910422992 >> v1:172.21.15.148:6789/0 conn(0x7fa5fc0aa390 legacy=0x7fa5fc0c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fb7fe700 1 -- 172.21.15.148:0/910422992 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0a91e0 con 0x7fa5fc0c1050 2023-10-24T00:44:12.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.070+0000 7fa5fa7fc700 1 -- 172.21.15.148:0/910422992 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141336082 0 0) 0x7fa5fc0a9830 con 0x7fa5fc0aa390 2023-10-24T00:44:12.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fb7fe700 1 --2- 172.21.15.148:0/910422992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc15dd20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fa5fc0858f0 tx=0x7fa5f4009780).ready entity=mon.0 client_cookie=9c182194782b1e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fa7fc700 1 -- 172.21.15.148:0/910422992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400e070 con 0x7fa5fc0c1050 2023-10-24T00:44:12.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fa7fc700 1 -- 172.21.15.148:0/910422992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f400bc30 con 0x7fa5fc0c1050 2023-10-24T00:44:12.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fa7fc700 1 -- 172.21.15.148:0/910422992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4012410 con 0x7fa5fc0c1050 2023-10-24T00:44:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 -- 172.21.15.148:0/910422992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 msgr2=0x7fa5fc15dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/910422992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc15dd20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fa5fc0858f0 tx=0x7fa5f4009780).stop 2023-10-24T00:44:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 -- 172.21.15.148:0/910422992 shutdown_connections 2023-10-24T00:44:12.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/910422992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc15dd20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/910422992 >> v2:172.21.15.150:3300/0 conn(0x7fa5fc154150 0x7fa5fc0a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 -- 172.21.15.148:0/910422992 >> 172.21.15.148:0/910422992 conn(0x7fa5fc094500 msgr2=0x7fa5fc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 -- 172.21.15.148:0/910422992 shutdown_connections 2023-10-24T00:44:12.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.071+0000 7fa5fbfff700 1 -- 172.21.15.148:0/910422992 wait complete. 2023-10-24T00:44:12.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.072+0000 7fa5fbfff700 1 Processor -- start 2023-10-24T00:44:12.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 -- start start 2023-10-24T00:44:12.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5fc0aa390 0x7fa5fc0c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 0x7fa5fc1672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c3340 con 0x7fa5fc0c1050 2023-10-24T00:44:12.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c3cc0 con 0x7fa5fc0aa390 2023-10-24T00:44:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5fbfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0b0ab0 con 0x7fa5fc154150 2023-10-24T00:44:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40996/0 (socket says 172.21.15.148:40996) 2023-10-24T00:44:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5f27fc700 1 -- 172.21.15.148:0/1391296546 learned_addr learned my addr 172.21.15.148:0/1391296546 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:12.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.073+0000 7fa5faffd700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5fc0aa390 0x7fa5fc0c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5fb7fe700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 0x7fa5fc1672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 -- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 msgr2=0x7fa5fc1672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 0x7fa5fc1672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 -- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5fc0aa390 msgr2=0x7fa5fc0c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5fc0aa390 0x7fa5fc0c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 -- 172.21.15.148:0/1391296546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4009a20 con 0x7fa5fc0c1050 2023-10-24T00:44:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5fb7fe700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 0x7fa5fc1672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f27fc700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa5e400c460 tx=0x7fa5e4007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400ce80 con 0x7fa5fc0c1050 2023-10-24T00:44:12.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e40072e0 con 0x7fa5fc0c1050 2023-10-24T00:44:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc0b0d90 con 0x7fa5fc0c1050 2023-10-24T00:44:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4007660 con 0x7fa5fc0c1050 2023-10-24T00:44:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.074+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc0c2fd0 con 0x7fa5fc0c1050 2023-10-24T00:44:12.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.075+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5fc047480 con 0x7fa5fc0c1050 2023-10-24T00:44:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.075+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa5e40059b0 con 0x7fa5fc0c1050 2023-10-24T00:44:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.076+0000 7fa5f37fe700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 0x7fa5dc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.076+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fa5e4079920 con 0x7fa5fc0c1050 2023-10-24T00:44:12.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.076+0000 7fa5faffd700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 0x7fa5dc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.076+0000 7fa5faffd700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 0x7fa5dc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa5ec006090 tx=0x7fa5ec008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.080+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa5e404ac10 con 0x7fa5fc0c1050 2023-10-24T00:44:12.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.251+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa5fc0a94c0 con 0x7fa5fc0c1050 2023-10-24T00:44:12.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.257+0000 7fa5f37fe700 1 -- 172.21.15.148:0/1391296546 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v8) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa5e404e230 con 0x7fa5fc0c1050 2023-10-24T00:44:12.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 msgr2=0x7fa5dc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 0x7fa5dc061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa5ec006090 tx=0x7fa5ec008040).stop 2023-10-24T00:44:12.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 msgr2=0x7fa5fc153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa5e400c460 tx=0x7fa5e4007e90).stop 2023-10-24T00:44:12.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 shutdown_connections 2023-10-24T00:44:12.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5fc154150 0x7fa5fc1672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5fc0aa390 0x7fa5fc0c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5dc05f270 0x7fa5dc061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 --2- 172.21.15.148:0/1391296546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5fc0c1050 0x7fa5fc153990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 >> 172.21.15.148:0/1391296546 conn(0x7fa5fc094500 msgr2=0x7fa5fc0c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 shutdown_connections 2023-10-24T00:44:12.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.259+0000 7fa5fbfff700 1 -- 172.21.15.148:0/1391296546 wait complete. 2023-10-24T00:44:12.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:44:12.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.387+0000 7f43c2c5b700 1 Processor -- start 2023-10-24T00:44:12.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.387+0000 7f43c2c5b700 1 -- start start 2023-10-24T00:44:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c2c5b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43bc154430 0x7f43bc154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c2c5b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43bc0bffd0 0x7f43bc0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c2c5b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0c71d0 con 0x7f43bc098bd0 2023-10-24T00:44:12.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c2c5b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0c6a10 con 0x7f43bc0bffd0 2023-10-24T00:44:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c2c5b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0c9410 con 0x7f43bc154430 2023-10-24T00:44:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c11f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43bc0bffd0 0x7f43bc0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c11f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f43bc0bffd0 0x7f43bc0c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41006/0 (socket says 172.21.15.148:41006) 2023-10-24T00:44:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.388+0000 7f43c11f8700 1 -- 172.21.15.148:0/2765752243 learned_addr learned my addr 172.21.15.148:0/2765752243 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:12.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c09f7700 1 --2- 172.21.15.148:0/2765752243 >> v2:172.21.15.150:3300/0 conn(0x7f43bc154430 0x7f43bc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c11f8700 1 -- 172.21.15.148:0/2765752243 >> v2:172.21.15.150:3300/0 conn(0x7f43bc154430 msgr2=0x7f43bc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c11f8700 1 --2- 172.21.15.148:0/2765752243 >> v2:172.21.15.150:3300/0 conn(0x7f43bc154430 0x7f43bc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c11f8700 1 -- 172.21.15.148:0/2765752243 >> v1:172.21.15.150:6789/0 conn(0x7f43bc098bd0 legacy=0x7f43bc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c11f8700 1 -- 172.21.15.148:0/2765752243 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0c0950 con 0x7f43bc0bffd0 2023-10-24T00:44:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c11f8700 1 --2- 172.21.15.148:0/2765752243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c0460 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f43bc05ff70 tx=0x7f43b4009840).ready entity=mon.0 client_cookie=2c02371adad76f3f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43b37fe700 1 -- 172.21.15.148:0/2765752243 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400e070 con 0x7f43bc0bffd0 2023-10-24T00:44:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43b37fe700 1 -- 172.21.15.148:0/2765752243 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400ba10 con 0x7f43bc0bffd0 2023-10-24T00:44:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43b37fe700 1 -- 172.21.15.148:0/2765752243 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400bd90 con 0x7f43bc0bffd0 2023-10-24T00:44:12.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 -- 172.21.15.148:0/2765752243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc0bffd0 msgr2=0x7f43bc0c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/2765752243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c0460 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f43bc05ff70 tx=0x7f43b4009840).stop 2023-10-24T00:44:12.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 -- 172.21.15.148:0/2765752243 shutdown_connections 2023-10-24T00:44:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/2765752243 >> v2:172.21.15.150:3300/0 conn(0x7f43bc154430 0x7f43bc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/2765752243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c0460 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.389+0000 7f43c2c5b700 1 -- 172.21.15.148:0/2765752243 >> 172.21.15.148:0/2765752243 conn(0x7f43bc0cb070 msgr2=0x7f43bc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.390+0000 7f43c2c5b700 1 -- 172.21.15.148:0/2765752243 shutdown_connections 2023-10-24T00:44:12.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.390+0000 7f43c2c5b700 1 -- 172.21.15.148:0/2765752243 wait complete. 2023-10-24T00:44:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.391+0000 7f43c2c5b700 1 Processor -- start 2023-10-24T00:44:12.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.391+0000 7f43c2c5b700 1 -- start start 2023-10-24T00:44:12.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.391+0000 7f43c2c5b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43bc098bd0 0x7f43bc151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c4660 con 0x7f43bc154430 2023-10-24T00:44:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc151a80 con 0x7f43bc0bffd0 2023-10-24T00:44:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0c3770 con 0x7f43bc098bd0 2023-10-24T00:44:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41020/0 (socket says 172.21.15.148:41020) 2023-10-24T00:44:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 -- 172.21.15.148:0/225864442 learned_addr learned my addr 172.21.15.148:0/225864442 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:12.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c09f7700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43bc098bd0 0x7f43bc151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43b3fff700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 -- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43bc098bd0 msgr2=0x7f43bc151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43bc098bd0 0x7f43bc151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 -- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43bc0bffd0 msgr2=0x7f43bc0c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 -- 172.21.15.148:0/225864442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4009ae0 con 0x7f43bc154430 2023-10-24T00:44:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c11f8700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f43bc0c5910 tx=0x7f43b4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4013e60 con 0x7f43bc154430 2023-10-24T00:44:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4007170 con 0x7f43bc154430 2023-10-24T00:44:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc0c3a50 con 0x7f43bc154430 2023-10-24T00:44:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b401d640 con 0x7f43bc154430 2023-10-24T00:44:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.392+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc0c4010 con 0x7f43bc154430 2023-10-24T00:44:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.393+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc06c6b0 con 0x7f43bc154430 2023-10-24T00:44:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.394+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f43b401d9b0 con 0x7f43bc154430 2023-10-24T00:44:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.394+0000 7f43b0ff9700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.394+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f43b407bcb0 con 0x7f43bc154430 2023-10-24T00:44:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.394+0000 7f43c09f7700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.394+0000 7f43c09f7700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 0x7f43a8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f43b800bb10 tx=0x7f43b8008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.398+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f43b404cfa0 con 0x7f43bc154430 2023-10-24T00:44:12.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.563+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f43bc06c6b0 con 0x7f43bc154430 2023-10-24T00:44:12.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.566+0000 7f43b0ff9700 1 -- 172.21.15.148:0/225864442 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43b40505c0 con 0x7f43bc154430 2023-10-24T00:44:12.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.568+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 msgr2=0x7f43a8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.568+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 0x7f43a8061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f43b800bb10 tx=0x7f43b8008040).stop 2023-10-24T00:44:12.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.568+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 msgr2=0x7f43bc0abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.568+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f43bc0c5910 tx=0x7f43b4009840).stop 2023-10-24T00:44:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 shutdown_connections 2023-10-24T00:44:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43a805f270 0x7f43a8061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43bc154430 0x7f43bc0abbd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43bc098bd0 0x7f43bc151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 --2- 172.21.15.148:0/225864442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43bc0bffd0 0x7f43bc0c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 >> 172.21.15.148:0/225864442 conn(0x7f43bc0cb070 msgr2=0x7f43bc153380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 shutdown_connections 2023-10-24T00:44:12.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.569+0000 7f43c2c5b700 1 -- 172.21.15.148:0/225864442 wait complete. 2023-10-24T00:44:12.583 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-24T00:44:12.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.694+0000 7fc76aa9a700 1 Processor -- start 2023-10-24T00:44:12.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.694+0000 7fc76aa9a700 1 -- start start 2023-10-24T00:44:12.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc76aa9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc7640c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc76aa9a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc7640aa3f0 0x7fc764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc76aa9a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7640c0960 con 0x7fc7640c6710 2023-10-24T00:44:12.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc76aa9a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640aa8a0 con 0x7fc7640aa3f0 2023-10-24T00:44:12.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc76aa9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c0c40 con 0x7fc7640aa010 2023-10-24T00:44:12.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc75bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc7640c6710 0x7fc764158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:37300/0 (socket says 172.21.15.148:37300) 2023-10-24T00:44:12.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.695+0000 7fc75bfff700 1 -- 172.21.15.148:0/2089033364 learned_addr learned my addr 172.21.15.148:0/2089033364 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:12.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc768836700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc7640c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 --2- 172.21.15.148:0/2089033364 >> v2:172.21.15.150:3300/0 conn(0x7fc7640aa3f0 0x7fc764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069679460 0 0) 0x7fc7640c0960 con 0x7fc7640c6710 2023-10-24T00:44:12.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc74c0033f0 con 0x7fc7640c6710 2023-10-24T00:44:12.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235557841 0 0) 0x7fc74c0033f0 con 0x7fc7640c6710 2023-10-24T00:44:12.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 msgr2=0x7fc7640c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc7640c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 >> v2:172.21.15.150:3300/0 conn(0x7fc7640aa3f0 msgr2=0x7fc764069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 --2- 172.21.15.148:0/2089033364 >> v2:172.21.15.150:3300/0 conn(0x7fc7640aa3f0 0x7fc764069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640c0f20 con 0x7fc7640c6710 2023-10-24T00:44:12.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fc754001470 con 0x7fc7640c6710 2023-10-24T00:44:12.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 >> v1:172.21.15.148:6789/0 conn(0x7fc7640c6710 legacy=0x7fc764158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc74c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc74c003e10 0x7fc74c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc74c004b80 0x7fc74c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640aa8a0 con 0x7fc74c004b80 2023-10-24T00:44:12.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c0c40 con 0x7fc74c003e10 2023-10-24T00:44:12.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c00b8e0 con 0x7fc7640aa010 2023-10-24T00:44:12.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc74c004b80 0x7fc74c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc75bfff700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc74c003e10 0x7fc74c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc768836700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc74c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 -- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 msgr2=0x7fc74c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640aa010 0x7fc74c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 -- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc74c003e10 msgr2=0x7fc74c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:12.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc74c003e10 0x7fc74c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 -- 172.21.15.148:0/2089033364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0033f0 con 0x7fc74c004b80 2023-10-24T00:44:12.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.696+0000 7fc769037700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc74c004b80 0x7fc74c005000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fc75c009ab0 tx=0x7fc75c009060).ready entity=mon.0 client_cookie=674acf9223d96866 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c009430 con 0x7fc74c004b80 2023-10-24T00:44:12.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00e640 con 0x7fc74c004b80 2023-10-24T00:44:12.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc75b7fe700 1 -- 172.21.15.148:0/2089033364 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00e9c0 con 0x7fc74c004b80 2023-10-24T00:44:12.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 -- 172.21.15.148:0/2089033364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc74c004b80 msgr2=0x7fc74c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/2089033364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc74c004b80 0x7fc74c005000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fc75c009ab0 tx=0x7fc75c009060).stop 2023-10-24T00:44:12.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc769037700 1 -- 172.21.15.148:0/2089033364 reap_dead start 2023-10-24T00:44:12.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 -- 172.21.15.148:0/2089033364 shutdown_connections 2023-10-24T00:44:12.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 -- 172.21.15.148:0/2089033364 >> 172.21.15.148:0/2089033364 conn(0x7fc7640caf40 msgr2=0x7fc7640cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 -- 172.21.15.148:0/2089033364 shutdown_connections 2023-10-24T00:44:12.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.697+0000 7fc76aa9a700 1 -- 172.21.15.148:0/2089033364 wait complete. 2023-10-24T00:44:12.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.698+0000 7fc76aa9a700 1 Processor -- start 2023-10-24T00:44:12.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.698+0000 7fc76aa9a700 1 -- start start 2023-10-24T00:44:12.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 0x7fc764150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc764157f40 0x7fc764151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764151900 con 0x7fc76414caf0 2023-10-24T00:44:12.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764159090 con 0x7fc76414ced0 2023-10-24T00:44:12.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc76aa9a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc764158480 con 0x7fc764157f40 2023-10-24T00:44:12.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc768836700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc768836700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41038/0 (socket says 172.21.15.148:41038) 2023-10-24T00:44:12.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc768836700 1 -- 172.21.15.148:0/1224459707 learned_addr learned my addr 172.21.15.148:0/1224459707 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:12.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc769037700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc764157f40 0x7fc764151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.699+0000 7fc75bfff700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 0x7fc764150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 -- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc764157f40 msgr2=0x7fc764151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc764157f40 0x7fc764151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 -- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 msgr2=0x7fc764150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 0x7fc764150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 -- 172.21.15.148:0/1224459707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764158760 con 0x7fc76414caf0 2023-10-24T00:44:12.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc75bfff700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 0x7fc764150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:12.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc768836700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fc760011f00 tx=0x7fc76000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000e040 con 0x7fc76414caf0 2023-10-24T00:44:12.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76000f040 con 0x7fc76414caf0 2023-10-24T00:44:12.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc764158a40 con 0x7fc76414caf0 2023-10-24T00:44:12.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760015450 con 0x7fc76414caf0 2023-10-24T00:44:12.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.700+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc764159b30 con 0x7fc76414caf0 2023-10-24T00:44:12.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.701+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76406c6b0 con 0x7fc76414caf0 2023-10-24T00:44:12.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.701+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc760015880 con 0x7fc76414caf0 2023-10-24T00:44:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.702+0000 7fc758ff9700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 0x7fc750061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.702+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fc76007aec0 con 0x7fc76414caf0 2023-10-24T00:44:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.702+0000 7fc75bfff700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 0x7fc750061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.702+0000 7fc75bfff700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 0x7fc750061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc76405e270 tx=0x7fc754009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.706+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc76004c1b0 con 0x7fc76414caf0 2023-10-24T00:44:12.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.935+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fc7640c1200 con 0x7fc76414caf0 2023-10-24T00:44:12.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.949+0000 7fc758ff9700 1 -- 172.21.15.148:0/1224459707 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v541) v1 ==== 154+0+0 (secure 0 0 0) 0x7fc76004f7d0 con 0x7fc76414caf0 2023-10-24T00:44:12.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 msgr2=0x7fc750061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 0x7fc750061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc76405e270 tx=0x7fc754009040).stop 2023-10-24T00:44:12.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 msgr2=0x7fc764157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:12.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7fc760011f00 tx=0x7fc76000b040).stop 2023-10-24T00:44:12.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 shutdown_connections 2023-10-24T00:44:12.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc764157f40 0x7fc764151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc75005f270 0x7fc750061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc76414caf0 0x7fc764157a50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 --2- 172.21.15.148:0/1224459707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc76414ced0 0x7fc764150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:12.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 >> 172.21.15.148:0/1224459707 conn(0x7fc7640caf40 msgr2=0x7fc7640ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:12.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 shutdown_connections 2023-10-24T00:44:12.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:12.951+0000 7fc76aa9a700 1 -- 172.21.15.148:0/1224459707 wait complete. 2023-10-24T00:44:12.965 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-10-24T00:44:12.966 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-10-24T00:44:12.966 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:44:12.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-24T00:44:13.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.078+0000 7fe8bdc3b700 1 Processor -- start 2023-10-24T00:44:13.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.078+0000 7fe8bdc3b700 1 -- start start 2023-10-24T00:44:13.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80aa010 0x7fe8b80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8b80c6710 0x7fe8b80aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8b8158770 0x7fe8b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80aa8e0 con 0x7fe8b8158770 2023-10-24T00:44:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80c0960 con 0x7fe8b80c6710 2023-10-24T00:44:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8bdc3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80c0c40 con 0x7fe8b80aa010 2023-10-24T00:44:13.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8b7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8b8158770 0x7fe8b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8b7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8b8158770 0x7fe8b8069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41054/0 (socket says 172.21.15.148:41054) 2023-10-24T00:44:13.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.079+0000 7fe8b7fff700 1 -- 172.21.15.148:0/381012151 learned_addr learned my addr 172.21.15.148:0/381012151 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:13.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b77fe700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80aa010 0x7fe8b80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b6ffd700 1 --2- 172.21.15.148:0/381012151 >> v2:172.21.15.150:3300/0 conn(0x7fe8b80c6710 0x7fe8b80aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 -- 172.21.15.148:0/381012151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80aa010 msgr2=0x7fe8b80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:13.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80aa010 0x7fe8b80c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 -- 172.21.15.148:0/381012151 >> v2:172.21.15.150:3300/0 conn(0x7fe8b80c6710 msgr2=0x7fe8b80aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:13.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/381012151 >> v2:172.21.15.150:3300/0 conn(0x7fe8b80c6710 0x7fe8b80aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 -- 172.21.15.148:0/381012151 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80c0f20 con 0x7fe8b8158770 2023-10-24T00:44:13.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe8b806c320 tx=0x7fe8b00090f0).ready entity=mon.0 client_cookie=b6303b6058565377 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b67fc700 1 -- 172.21.15.148:0/381012151 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000b600 con 0x7fe8b8158770 2023-10-24T00:44:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b67fc700 1 -- 172.21.15.148:0/381012151 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b000b760 con 0x7fe8b8158770 2023-10-24T00:44:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8b67fc700 1 -- 172.21.15.148:0/381012151 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000bae0 con 0x7fe8b8158770 2023-10-24T00:44:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/381012151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 msgr2=0x7fe8b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.080+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fe8b806c320 tx=0x7fe8b00090f0).stop 2023-10-24T00:44:13.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/381012151 shutdown_connections 2023-10-24T00:44:13.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8069d80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/381012151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80aa010 0x7fe8b80c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/381012151 >> v2:172.21.15.150:3300/0 conn(0x7fe8b80c6710 0x7fe8b80aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/381012151 >> 172.21.15.148:0/381012151 conn(0x7fe8b80caf40 msgr2=0x7fe8b80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:13.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/381012151 shutdown_connections 2023-10-24T00:44:13.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.081+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/381012151 wait complete. 2023-10-24T00:44:13.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.082+0000 7fe8bdc3b700 1 Processor -- start 2023-10-24T00:44:13.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.082+0000 7fe8bdc3b700 1 -- start start 2023-10-24T00:44:13.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b80aa010 0x7fe8b80b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80c6710 0x7fe8b8143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80afb10 con 0x7fe8b8158770 2023-10-24T00:44:13.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80b00d0 con 0x7fe8b80aa010 2023-10-24T00:44:13.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81680f0 con 0x7fe8b80c6710 2023-10-24T00:44:13.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41058/0 (socket says 172.21.15.148:41058) 2023-10-24T00:44:13.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 -- 172.21.15.148:0/3399350046 learned_addr learned my addr 172.21.15.148:0/3399350046 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:13.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b6ffd700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80c6710 0x7fe8b8143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b77fe700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b80aa010 0x7fe8b80b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 -- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80c6710 msgr2=0x7fe8b8143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:13.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80c6710 0x7fe8b8143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 -- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b80aa010 msgr2=0x7fe8b80b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:13.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b80aa010 0x7fe8b80b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 -- 172.21.15.148:0/3399350046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009370 con 0x7fe8b8158770 2023-10-24T00:44:13.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8b7fff700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe8b0009130 tx=0x7fe8b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:13.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000bae0 con 0x7fe8b8158770 2023-10-24T00:44:13.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b000bea0 con 0x7fe8b8158770 2023-10-24T00:44:13.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b81683d0 con 0x7fe8b8158770 2023-10-24T00:44:13.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b001c670 con 0x7fe8b8158770 2023-10-24T00:44:13.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.083+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b81522a0 con 0x7fe8b8158770 2023-10-24T00:44:13.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.084+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80b0240 con 0x7fe8b8158770 2023-10-24T00:44:13.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.085+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe8b001ca20 con 0x7fe8b8158770 2023-10-24T00:44:13.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.085+0000 7fe89f7fe700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 0x7fe8a4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:13.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.085+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7fe8b007be90 con 0x7fe8b8158770 2023-10-24T00:44:13.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.085+0000 7fe8b77fe700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 0x7fe8a4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:13.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.086+0000 7fe8b77fe700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 0x7fe8a4061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe8a8009fd0 tx=0x7fe8a8009880).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:13.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.089+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe8b0050c60 con 0x7fe8b8158770 2023-10-24T00:44:13.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.317+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fe8b806c6b0 con 0x7fe8b8158770 2023-10-24T00:44:13.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.951+0000 7fe89f7fe700 1 -- 172.21.15.148:0/3399350046 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v542) v1 ==== 159+0+0 (secure 0 0 0) 0x7fe8b0050850 con 0x7fe8b8158770 2023-10-24T00:44:13.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 msgr2=0x7fe8a4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 0x7fe8a4061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe8a8009fd0 tx=0x7fe8a8009880).stop 2023-10-24T00:44:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 msgr2=0x7fe8b8167690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:13.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fe8b0009130 tx=0x7fe8b0017000).stop 2023-10-24T00:44:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 shutdown_connections 2023-10-24T00:44:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe8a405f240 0x7fe8a4061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8b8158770 0x7fe8b8167690 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8b80aa010 0x7fe8b80b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 --2- 172.21.15.148:0/3399350046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8b80c6710 0x7fe8b8143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:13.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 >> 172.21.15.148:0/3399350046 conn(0x7fe8b80caf40 msgr2=0x7fe8b8152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:13.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 shutdown_connections 2023-10-24T00:44:13.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:13.953+0000 7fe8bdc3b700 1 -- 172.21.15.148:0/3399350046 wait complete. 2023-10-24T00:44:13.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:44:14.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.084+0000 7f8c7a34e700 1 Processor -- start 2023-10-24T00:44:14.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.084+0000 7f8c7a34e700 1 -- start start 2023-10-24T00:44:14.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7a34e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c74154150 0x7f8c740a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7a34e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c740aa390 0x7f8c740c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7a34e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c740a9830 con 0x7f8c740c0e30 2023-10-24T00:44:14.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7a34e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740c1280 con 0x7f8c740aa390 2023-10-24T00:44:14.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7a34e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c740a8c20 con 0x7f8c74154150 2023-10-24T00:44:14.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c740aa390 0x7f8c740c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8c740aa390 0x7f8c740c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57176/0 (socket says 172.21.15.148:57176) 2023-10-24T00:44:14.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 -- 172.21.15.148:0/2165893833 learned_addr learned my addr 172.21.15.148:0/2165893833 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:14.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 -- 172.21.15.148:0/2165893833 >> v2:172.21.15.150:3300/0 conn(0x7f8c74154150 msgr2=0x7f8c740a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:14.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c7934c700 1 --2- 172.21.15.148:0/2165893833 >> v2:172.21.15.150:3300/0 conn(0x7f8c74154150 0x7f8c740a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/2165893833 >> v2:172.21.15.150:3300/0 conn(0x7f8c74154150 0x7f8c740a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 -- 172.21.15.148:0/2165893833 >> v1:172.21.15.150:6789/0 conn(0x7f8c740c0e30 legacy=0x7f8c740c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:14.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 -- 172.21.15.148:0/2165893833 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740a8f00 con 0x7f8c740aa390 2023-10-24T00:44:14.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/2165893833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c740c0940 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8c740858f0 tx=0x7f8c680090f0).ready entity=mon.0 client_cookie=5403f4e14f758a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c73fff700 1 -- 172.21.15.148:0/2165893833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800b5a0 con 0x7f8c740aa390 2023-10-24T00:44:14.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c73fff700 1 -- 172.21.15.148:0/2165893833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800b700 con 0x7f8c740aa390 2023-10-24T00:44:14.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.085+0000 7f8c73fff700 1 -- 172.21.15.148:0/2165893833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ba80 con 0x7f8c740aa390 2023-10-24T00:44:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 -- 172.21.15.148:0/2165893833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 msgr2=0x7f8c740c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/2165893833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c740c0940 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8c740858f0 tx=0x7f8c680090f0).stop 2023-10-24T00:44:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 -- 172.21.15.148:0/2165893833 shutdown_connections 2023-10-24T00:44:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/2165893833 >> v2:172.21.15.150:3300/0 conn(0x7f8c74154150 0x7f8c740a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/2165893833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c740c0940 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 -- 172.21.15.148:0/2165893833 >> 172.21.15.148:0/2165893833 conn(0x7f8c74094500 msgr2=0x7f8c7406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:14.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 -- 172.21.15.148:0/2165893833 shutdown_connections 2023-10-24T00:44:14.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.086+0000 7f8c7a34e700 1 -- 172.21.15.148:0/2165893833 wait complete. 2023-10-24T00:44:14.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.087+0000 7f8c7a34e700 1 Processor -- start 2023-10-24T00:44:14.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.087+0000 7f8c7a34e700 1 -- start start 2023-10-24T00:44:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 0x7f8c74163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c74154150 0x7f8c740c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740b0720 con 0x7f8c740aa390 2023-10-24T00:44:14.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c741497a0 con 0x7f8c74154150 2023-10-24T00:44:14.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7a34e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740ae760 con 0x7f8c740c0e30 2023-10-24T00:44:14.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57192/0 (socket says 172.21.15.148:57192) 2023-10-24T00:44:14.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 -- 172.21.15.148:0/1868159849 learned_addr learned my addr 172.21.15.148:0/1868159849 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:14.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c79b4d700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c74154150 0x7f8c740c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 0x7f8c74163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 -- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 msgr2=0x7f8c74163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 0x7f8c74163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 -- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c74154150 msgr2=0x7f8c740c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c74154150 0x7f8c740c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c7934c700 1 -- 172.21.15.148:0/1868159849 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009370 con 0x7f8c740aa390 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.088+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 0x7f8c74163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:14.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c7934c700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f8c6c00a320 tx=0x7f8c6c0078e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00e450 con 0x7f8c740aa390 2023-10-24T00:44:14.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00e5b0 con 0x7f8c740aa390 2023-10-24T00:44:14.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00e930 con 0x7f8c740aa390 2023-10-24T00:44:14.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c740c3510 con 0x7f8c740aa390 2023-10-24T00:44:14.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.089+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c740ae110 con 0x7f8c740aa390 2023-10-24T00:44:14.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.090+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c74047480 con 0x7f8c740aa390 2023-10-24T00:44:14.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.090+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8c6c00ed20 con 0x7f8c740aa390 2023-10-24T00:44:14.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.090+0000 7f8c717fa700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 0x7f8c60061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.090+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f8c6c07aed0 con 0x7f8c740aa390 2023-10-24T00:44:14.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.091+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 0x7f8c60061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.091+0000 7f8c78b4b700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 0x7f8c60061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8c68009700 tx=0x7f8c68015000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.094+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8c6c04c1c0 con 0x7f8c740aa390 2023-10-24T00:44:14.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.258+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c740a91e0 con 0x7f8c740aa390 2023-10-24T00:44:14.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.262+0000 7f8c717fa700 1 -- 172.21.15.148:0/1868159849 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c6c04f7e0 con 0x7f8c740aa390 2023-10-24T00:44:14.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.263+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 msgr2=0x7f8c60061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.263+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 0x7f8c60061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8c68009700 tx=0x7f8c68015000).stop 2023-10-24T00:44:14.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.263+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 msgr2=0x7f8c741492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.263+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f8c6c00a320 tx=0x7f8c6c0078e0).stop 2023-10-24T00:44:14.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 shutdown_connections 2023-10-24T00:44:14.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c74154150 0x7f8c740c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8c6005f240 0x7f8c60061700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c740aa390 0x7f8c741492b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 --2- 172.21.15.148:0/1868159849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c740c0e30 0x7f8c74163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 >> 172.21.15.148:0/1868159849 conn(0x7f8c74094500 msgr2=0x7f8c740c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:14.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 shutdown_connections 2023-10-24T00:44:14.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.264+0000 7f8c7a34e700 1 -- 172.21.15.148:0/1868159849 wait complete. 2023-10-24T00:44:14.278 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:44:14.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:14.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:14.364 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:44:14.365 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:44:14.365 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.477+0000 7f9c0c880700 1 Processor -- start 2023-10-24T00:44:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.477+0000 7f9c0c880700 1 -- start start 2023-10-24T00:44:14.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0c880700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 0x7f9c080c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0c880700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c080c68a0 0x7f9c080c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0c880700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c080c6410 con 0x7f9c080aa140 2023-10-24T00:44:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0c880700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080c1150 con 0x7f9c080c68a0 2023-10-24T00:44:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0c880700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080ca6e0 con 0x7f9c080c07e0 2023-10-24T00:44:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c06d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9c080aa140 0x7f9c080c9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38594/0 (socket says 172.21.15.148:38594) 2023-10-24T00:44:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c0759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9c080c68a0 0x7f9c080c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.478+0000 7f9c06d9d700 1 -- 172.21.15.148:0/3405693616 learned_addr learned my addr 172.21.15.148:0/3405693616 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9bfe59c700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 0x7f9c080c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0759e700 1 -- 172.21.15.148:0/3405693616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 msgr2=0x7f9c080c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0759e700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 0x7f9c080c0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0759e700 1 -- 172.21.15.148:0/3405693616 >> v1:172.21.15.148:6789/0 conn(0x7f9c080aa140 legacy=0x7f9c080c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0659c700 1 -- 172.21.15.148:0/3405693616 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319894924 0 0) 0x7f9c080c6410 con 0x7f9c080aa140 2023-10-24T00:44:14.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0759e700 1 -- 172.21.15.148:0/3405693616 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080ca9c0 con 0x7f9c080c68a0 2023-10-24T00:44:14.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9bfe59c700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 0x7f9c080c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:14.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0759e700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c68a0 0x7f9c080c6d10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9c00009e60 tx=0x7f9c00009780).ready entity=mon.0 client_cookie=f4bb6b0f25f96c81 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0659c700 1 -- 172.21.15.148:0/3405693616 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000e070 con 0x7f9c080c68a0 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0659c700 1 -- 172.21.15.148:0/3405693616 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000bc30 con 0x7f9c080c68a0 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0659c700 1 -- 172.21.15.148:0/3405693616 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00012410 con 0x7f9c080c68a0 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 -- 172.21.15.148:0/3405693616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c68a0 msgr2=0x7f9c080c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c68a0 0x7f9c080c6d10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f9c00009e60 tx=0x7f9c00009780).stop 2023-10-24T00:44:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 -- 172.21.15.148:0/3405693616 shutdown_connections 2023-10-24T00:44:14.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c68a0 0x7f9c080c6d10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3405693616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c07e0 0x7f9c080c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 -- 172.21.15.148:0/3405693616 >> 172.21.15.148:0/3405693616 conn(0x7f9c080944a0 msgr2=0x7f9c0806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:14.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 -- 172.21.15.148:0/3405693616 shutdown_connections 2023-10-24T00:44:14.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.479+0000 7f9c0c880700 1 -- 172.21.15.148:0/3405693616 wait complete. 2023-10-24T00:44:14.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 Processor -- start 2023-10-24T00:44:14.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 -- start start 2023-10-24T00:44:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c080aa140 0x7f9c08148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c68a0 0x7f9c080c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080b0300 con 0x7f9c080c07e0 2023-10-24T00:44:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c4670 con 0x7f9c080aa140 2023-10-24T00:44:14.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.481+0000 7f9c0c880700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c3a60 con 0x7f9c080c68a0 2023-10-24T00:44:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57210/0 (socket says 172.21.15.148:57210) 2023-10-24T00:44:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 -- 172.21.15.148:0/3023960769 learned_addr learned my addr 172.21.15.148:0/3023960769 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:14.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9c0759e700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c68a0 0x7f9c080c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 -- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c68a0 msgr2=0x7f9c080c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c68a0 0x7f9c080c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 -- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c080aa140 msgr2=0x7f9c08148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9c06d9d700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c080aa140 0x7f9c08148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c080aa140 0x7f9c08148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 -- 172.21.15.148:0/3023960769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00009a20 con 0x7f9c080c07e0 2023-10-24T00:44:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bfe59c700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f9bf000c880 tx=0x7f9bf0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0010580 con 0x7f9c080c07e0 2023-10-24T00:44:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf00106e0 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0010a60 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c080c3d40 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.482+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080c4300 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.483+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080c4800 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.483+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9bf001b460 con 0x7f9c080c07e0 2023-10-24T00:44:14.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.484+0000 7f9bff7fe700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 0x7f9be8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.484+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5699+0+0 (secure 0 0 0) 0x7f9bf007a260 con 0x7f9c080c07e0 2023-10-24T00:44:14.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.484+0000 7f9c06d9d700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 0x7f9be8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.484+0000 7f9c06d9d700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 0x7f9be8061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9bf8007fd0 tx=0x7f9bf8009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.489+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9bf004b4f0 con 0x7f9c080c07e0 2023-10-24T00:44:14.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.691+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c08047480 con 0x7f9c080c07e0 2023-10-24T00:44:14.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.692+0000 7f9bff7fe700 1 -- 172.21.15.148:0/3023960769 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f9bf004eb10 con 0x7f9c080c07e0 2023-10-24T00:44:14.695 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:14.695 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5189,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2290067852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2290067852},{"type":"v1","addr":"172.21.15.150:6837","nonce":2290067852}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3146872864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3146872864},{"type":"v1","addr":"172.21.15.148:6834","nonce":3146872864}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2265659423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2265659423},{"type":"v1","addr":"172.21.15.148:6835","nonce":2265659423}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/4011167394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4011167394},{"type":"v1","addr":"172.21.15.150:6836","nonce":4011167394}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-24T00:44:14.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 msgr2=0x7f9be8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 0x7f9be8061700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9bf8007fd0 tx=0x7f9bf8009040).stop 2023-10-24T00:44:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 msgr2=0x7f9c080c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f9bf000c880 tx=0x7f9bf0008040).stop 2023-10-24T00:44:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 shutdown_connections 2023-10-24T00:44:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c080c68a0 0x7f9c080c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c080aa140 0x7f9c08148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9be805f240 0x7f9be8061700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 --2- 172.21.15.148:0/3023960769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c080c07e0 0x7f9c080c3130 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.693+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 >> 172.21.15.148:0/3023960769 conn(0x7f9c080944a0 msgr2=0x7f9c081537a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:14.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.694+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 shutdown_connections 2023-10-24T00:44:14.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.694+0000 7f9c0c880700 1 -- 172.21.15.148:0/3023960769 wait complete. 2023-10-24T00:44:14.699 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 21 2023-10-24T00:44:14.709 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:44:14.709 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:44:14.710 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:44:14.710 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:14.710 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:44:14.711 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:44:14.711 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:44:14.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:14.712 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:44:14.712 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:44:14.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:44:14.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:14.713 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:44:14.713 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:44:14.714 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:44:14.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:14.719 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:44:14.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:44:14.721 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:44:14.721 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:44:14.726 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:44:14.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:44:14.728 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:44:14.728 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:44:14.761 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:44:14.762 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:14.763 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:44:14.763 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:14.769 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:44:14.770 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:14.771 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:44:14.771 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:14.772 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:44:14.835 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:44:14.835 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:44:14.858 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:44:14.859 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:44:14.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.893+0000 7feab6620700 1 Processor -- start 2023-10-24T00:44:14.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.893+0000 7feab6620700 1 -- start start 2023-10-24T00:44:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab6620700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 0x7feab00c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab6620700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feab01547e0 0x7feab00a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab6620700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00c01c0 con 0x7feab00a82c0 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab6620700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00aa960 con 0x7feab01547e0 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab6620700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00c66f0 con 0x7feab0154400 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab4bbd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feab00a82c0 0x7feab00c0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38608/0 (socket says 172.21.15.148:38608) 2023-10-24T00:44:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feab4bbd700 1 -- 172.21.15.148:0/905425990 learned_addr learned my addr 172.21.15.148:0/905425990 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/905425990 >> v2:172.21.15.150:3300/0 conn(0x7feab01547e0 0x7feab00a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.894+0000 7feaaffff700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 0x7feab00c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaeffd700 1 -- 172.21.15.148:0/905425990 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517982056 0 0) 0x7feab00c01c0 con 0x7feab00a82c0 2023-10-24T00:44:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaeffd700 1 -- 172.21.15.148:0/905425990 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea980033f0 con 0x7feab00a82c0 2023-10-24T00:44:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaf7fe700 1 -- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 msgr2=0x7feab00c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 0x7feab00c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaf7fe700 1 -- 172.21.15.148:0/905425990 >> v1:172.21.15.148:6789/0 conn(0x7feab00a82c0 legacy=0x7feab00c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaf7fe700 1 -- 172.21.15.148:0/905425990 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00c6150 con 0x7feab01547e0 2023-10-24T00:44:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaffff700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 0x7feab00c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab01547e0 0x7feab00a7dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7feaa4009760 tx=0x7feaa4009060).ready entity=mon.1 client_cookie=3fbafed71c76b577 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaeffd700 1 -- 172.21.15.148:0/905425990 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40090d0 con 0x7feab01547e0 2023-10-24T00:44:14.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaeffd700 1 -- 172.21.15.148:0/905425990 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400d4a0 con 0x7feab01547e0 2023-10-24T00:44:14.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feaaeffd700 1 -- 172.21.15.148:0/905425990 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400d820 con 0x7feab01547e0 2023-10-24T00:44:14.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 -- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab01547e0 msgr2=0x7feab00a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab01547e0 0x7feab00a7dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7feaa4009760 tx=0x7feaa4009060).stop 2023-10-24T00:44:14.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 -- 172.21.15.148:0/905425990 shutdown_connections 2023-10-24T00:44:14.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab0154400 0x7feab00c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 --2- 172.21.15.148:0/905425990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab01547e0 0x7feab00a7dd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.895+0000 7feab6620700 1 -- 172.21.15.148:0/905425990 >> 172.21.15.148:0/905425990 conn(0x7feab00946a0 msgr2=0x7feab006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:14.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.896+0000 7feab6620700 1 -- 172.21.15.148:0/905425990 shutdown_connections 2023-10-24T00:44:14.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.896+0000 7feab6620700 1 -- 172.21.15.148:0/905425990 wait complete. 2023-10-24T00:44:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 Processor -- start 2023-10-24T00:44:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 -- start start 2023-10-24T00:44:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab0154400 0x7feab00aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab01547e0 0x7feab00c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00c2fa0 con 0x7feab00a82c0 2023-10-24T00:44:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00afa80 con 0x7feab0154400 2023-10-24T00:44:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.897+0000 7feab6620700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab0164a70 con 0x7feab01547e0 2023-10-24T00:44:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57256/0 (socket says 172.21.15.148:57256) 2023-10-24T00:44:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 -- 172.21.15.148:0/2404495196 learned_addr learned my addr 172.21.15.148:0/2404495196 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab0154400 0x7feab00aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feab4bbd700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab01547e0 0x7feab00c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 -- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab01547e0 msgr2=0x7feab00c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab01547e0 0x7feab00c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 -- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab0154400 msgr2=0x7feab00aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab0154400 0x7feab00aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 -- 172.21.15.148:0/2404495196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00092a0 con 0x7feab00a82c0 2023-10-24T00:44:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feaaffff700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7feaa000ea20 tx=0x7feaa0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000ee60 con 0x7feab00a82c0 2023-10-24T00:44:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000c7f0 con 0x7feab00a82c0 2023-10-24T00:44:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40092a0 con 0x7feab00a82c0 2023-10-24T00:44:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000cb70 con 0x7feab00a82c0 2023-10-24T00:44:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.898+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab00c2cc0 con 0x7feab00a82c0 2023-10-24T00:44:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.899+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab00ab230 con 0x7feab00a82c0 2023-10-24T00:44:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.900+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7feaa001b400 con 0x7feab00a82c0 2023-10-24T00:44:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.900+0000 7fea97fff700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 0x7fea9c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.900+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5699+0+0 (secure 0 0 0) 0x7feaa007a6f0 con 0x7feab00a82c0 2023-10-24T00:44:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.900+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 0x7fea9c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.901+0000 7feaaf7fe700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 0x7fea9c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7feaa4009760 tx=0x7feaa4016000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:14.904+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feaa004b980 con 0x7feab00a82c0 2023-10-24T00:44:15.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.083+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feab006c6b0 con 0x7feab00a82c0 2023-10-24T00:44:15.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.956+0000 7fea97fff700 1 -- 172.21.15.148:0/2404495196 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7feaa004efa0 con 0x7feab00a82c0 2023-10-24T00:44:15.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 msgr2=0x7fea9c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:15.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 0x7fea9c061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7feaa4009760 tx=0x7feaa4016000).stop 2023-10-24T00:44:15.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 msgr2=0x7feab00c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:15.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7feaa000ea20 tx=0x7feaa0009060).stop 2023-10-24T00:44:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 shutdown_connections 2023-10-24T00:44:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab01547e0 0x7feab00c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9c05f270 0x7fea9c061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab00a82c0 0x7feab00c20e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 --2- 172.21.15.148:0/2404495196 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab0154400 0x7feab00aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 >> 172.21.15.148:0/2404495196 conn(0x7feab00946a0 msgr2=0x7feab00aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 shutdown_connections 2023-10-24T00:44:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:15.959+0000 7feab6620700 1 -- 172.21.15.148:0/2404495196 wait complete. 2023-10-24T00:44:15.964 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:44:15.973 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:44:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.087+0000 7f65f65be700 1 Processor -- start 2023-10-24T00:44:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.087+0000 7f65f65be700 1 -- start start 2023-10-24T00:44:16.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f65be700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65f01506a0 0x7f65f00a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f65be700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f65f0065250 0x7f65f0062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f65be700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f01553c0 con 0x7f65f00a9bc0 2023-10-24T00:44:16.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f65be700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00aa040 con 0x7f65f0065250 2023-10-24T00:44:16.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f65be700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00658a0 con 0x7f65f01506a0 2023-10-24T00:44:16.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f5dbd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f65f0065250 0x7f65f0062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f5dbd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f65f0065250 0x7f65f0062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57262/0 (socket says 172.21.15.148:57262) 2023-10-24T00:44:16.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.088+0000 7f65f5dbd700 1 -- 172.21.15.148:0/698774023 learned_addr learned my addr 172.21.15.148:0/698774023 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:16.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f55bc700 1 --2- 172.21.15.148:0/698774023 >> v2:172.21.15.150:3300/0 conn(0x7f65f01506a0 0x7f65f00a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f5dbd700 1 -- 172.21.15.148:0/698774023 >> v2:172.21.15.150:3300/0 conn(0x7f65f01506a0 msgr2=0x7f65f00a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:16.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f5dbd700 1 --2- 172.21.15.148:0/698774023 >> v2:172.21.15.150:3300/0 conn(0x7f65f01506a0 0x7f65f00a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f5dbd700 1 -- 172.21.15.148:0/698774023 >> v1:172.21.15.150:6789/0 conn(0x7f65f00a9bc0 legacy=0x7f65f0064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f5dbd700 1 -- 172.21.15.148:0/698774023 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0154600 con 0x7f65f0065250 2023-10-24T00:44:16.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f5dbd700 1 --2- 172.21.15.148:0/698774023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f0065250 0x7f65f0062650 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f65f0067ef0 tx=0x7f65e8009840).ready entity=mon.0 client_cookie=6c6404198303f34c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65e7fff700 1 -- 172.21.15.148:0/698774023 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800e070 con 0x7f65f0065250 2023-10-24T00:44:16.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65e7fff700 1 -- 172.21.15.148:0/698774023 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800ba50 con 0x7f65f0065250 2023-10-24T00:44:16.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65e7fff700 1 -- 172.21.15.148:0/698774023 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800bdd0 con 0x7f65f0065250 2023-10-24T00:44:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f65be700 1 -- 172.21.15.148:0/698774023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f0065250 msgr2=0x7f65f0062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f65be700 1 --2- 172.21.15.148:0/698774023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f0065250 0x7f65f0062650 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f65f0067ef0 tx=0x7f65e8009840).stop 2023-10-24T00:44:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f65be700 1 -- 172.21.15.148:0/698774023 shutdown_connections 2023-10-24T00:44:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.089+0000 7f65f65be700 1 --2- 172.21.15.148:0/698774023 >> v2:172.21.15.150:3300/0 conn(0x7f65f01506a0 0x7f65f00a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.090+0000 7f65f65be700 1 --2- 172.21.15.148:0/698774023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f0065250 0x7f65f0062650 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.090+0000 7f65f65be700 1 -- 172.21.15.148:0/698774023 >> 172.21.15.148:0/698774023 conn(0x7f65f00c72d0 msgr2=0x7f65f00c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.090+0000 7f65f65be700 1 -- 172.21.15.148:0/698774023 shutdown_connections 2023-10-24T00:44:16.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.090+0000 7f65f65be700 1 -- 172.21.15.148:0/698774023 wait complete. 2023-10-24T00:44:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.091+0000 7f65f65be700 1 Processor -- start 2023-10-24T00:44:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.091+0000 7f65f65be700 1 -- start start 2023-10-24T00:44:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 0x7f65f00a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f00a9bc0 0x7f65f014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a0ab0 con 0x7f65f01506a0 2023-10-24T00:44:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a07d0 con 0x7f65f0065250 2023-10-24T00:44:16.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0165b90 con 0x7f65f00a9bc0 2023-10-24T00:44:16.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57278/0 (socket says 172.21.15.148:57278) 2023-10-24T00:44:16.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 -- 172.21.15.148:0/4273463812 learned_addr learned my addr 172.21.15.148:0/4273463812 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:16.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f55bc700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 0x7f65f00a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f4dbb700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f00a9bc0 0x7f65f014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 -- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f00a9bc0 msgr2=0x7f65f014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f00a9bc0 0x7f65f014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 -- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 msgr2=0x7f65f00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 0x7f65f00a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 -- 172.21.15.148:0/4273463812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009ae0 con 0x7f65f01506a0 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f55bc700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 0x7f65f00a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f5dbd700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f65f006c280 tx=0x7f65e8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8009500 con 0x7f65f01506a0 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800bdd0 con 0x7f65f01506a0 2023-10-24T00:44:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f0165e70 con 0x7f65f01506a0 2023-10-24T00:44:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e801c610 con 0x7f65f01506a0 2023-10-24T00:44:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.092+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f00a13e0 con 0x7f65f01506a0 2023-10-24T00:44:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.094+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f0166390 con 0x7f65f01506a0 2023-10-24T00:44:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.094+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f65e801ca40 con 0x7f65f01506a0 2023-10-24T00:44:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.094+0000 7f65e57fa700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 0x7f65d4061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.094+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f65e807b960 con 0x7f65f01506a0 2023-10-24T00:44:16.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.094+0000 7f65f55bc700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 0x7f65d4061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.095+0000 7f65f55bc700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 0x7f65d4061760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f65ec0098c0 tx=0x7f65ec008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.098+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f65f0166390 con 0x7f65f01506a0 2023-10-24T00:44:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.323+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f65f0166390 con 0x7f65f01506a0 2023-10-24T00:44:16.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.323+0000 7f65e57fa700 1 -- 172.21.15.148:0/4273463812 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f65f0166390 con 0x7f65f01506a0 2023-10-24T00:44:16.325 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:16.325 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:44:16.325 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:44:16.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.326 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:44:16.326 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:44:16.326 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.327 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.327 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:16.327 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:16.327 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.328 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.328 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:44:16.328 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:44:16.328 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.330 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:44:16.330 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:44:16.330 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.332 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:44:16.333 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:44:16.333 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.334 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.334 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:16.334 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:44:16.335 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:44:16.336 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.336 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.336 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.336 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.336 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.337 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.337 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.337 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:44:16.337 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:44:16.337 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.338 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.338 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.338 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.338 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.338 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.339 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.339 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:44:16.339 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:44:16.339 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.339 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.340 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.340 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.340 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.340 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.340 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:44:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:44:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.341 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.342 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.342 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.342 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.342 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.342 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:44:16.343 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:44:16.343 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.343 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.343 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.344 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.344 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.344 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.345 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.345 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:44:16.345 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:44:16.345 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.345 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.346 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:44:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:44:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.347 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:44:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:44:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.350 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:44:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:44:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.351 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:44:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:44:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.352 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:44:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:44:16.353 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:16.354 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:44:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:44:16.355 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:16.356 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:44:16.357 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.358 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:16.358 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:16.358 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:16.358 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:16.359 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.359 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.359 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:44:16.359 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:44:16.360 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.360 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:16.360 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:16.360 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:16.360 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.361 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.361 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.361 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:44:16.362 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:44:16.362 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.362 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:16.362 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:44:16.363 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.363 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:16.364 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:16.364 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:44:16.364 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:44:16.364 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:16.365 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:16.365 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:44:16.365 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:16.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:16.366 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:44:16.366 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:44:16.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 msgr2=0x7f65d4061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 0x7f65d4061760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f65ec0098c0 tx=0x7f65ec008040).stop 2023-10-24T00:44:16.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 msgr2=0x7f65f0062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f65f006c280 tx=0x7f65e8009840).stop 2023-10-24T00:44:16.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 shutdown_connections 2023-10-24T00:44:16.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65d405f2a0 0x7f65d4061760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65f01506a0 0x7f65f0062650 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65f0065250 0x7f65f00a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 --2- 172.21.15.148:0/4273463812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65f00a9bc0 0x7f65f014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 >> 172.21.15.148:0/4273463812 conn(0x7f65f00c72d0 msgr2=0x7f65f00aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 shutdown_connections 2023-10-24T00:44:16.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.325+0000 7f65f65be700 1 -- 172.21.15.148:0/4273463812 wait complete. 2023-10-24T00:44:16.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.483+0000 7fe55ea3b700 1 Processor -- start 2023-10-24T00:44:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.483+0000 7fe55ea3b700 1 -- start start 2023-10-24T00:44:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe55ea3b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5580c6710 0x7fe5580c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe55ea3b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580aa820 con 0x7fe5580aa010 2023-10-24T00:44:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe55ea3b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580c0960 con 0x7fe5580aa3f0 2023-10-24T00:44:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe55ea3b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580c0c40 con 0x7fe5580c6710 2023-10-24T00:44:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe557fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe5580aa010 0x7fe558158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38618/0 (socket says 172.21.15.148:38618) 2023-10-24T00:44:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe557fff700 1 -- 172.21.15.148:0/93245028 learned_addr learned my addr 172.21.15.148:0/93245028 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe5577fe700 1 --2- 172.21.15.148:0/93245028 >> v2:172.21.15.150:3300/0 conn(0x7fe5580c6710 0x7fe5580c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736463555 0 0) 0x7fe5580aa820 con 0x7fe5580aa010 2023-10-24T00:44:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.484+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5400033f0 con 0x7fe5580aa010 2023-10-24T00:44:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263431352 0 0) 0x7fe5400033f0 con 0x7fe5580aa010 2023-10-24T00:44:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe5577fe700 1 -- 172.21.15.148:0/93245028 >> v1:172.21.15.150:6789/0 conn(0x7fe5580aa3f0 legacy=0x7fe558069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe5577fe700 1 -- 172.21.15.148:0/93245028 >> v1:172.21.15.148:6789/0 conn(0x7fe5580aa010 legacy=0x7fe558158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe5577fe700 1 -- 172.21.15.148:0/93245028 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580c0f20 con 0x7fe5580c6710 2023-10-24T00:44:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe5577fe700 1 --2- 172.21.15.148:0/93245028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580c6710 0x7fe5580c1a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe54c009760 tx=0x7fe54c009060).ready entity=mon.1 client_cookie=ac8c609eb607c77f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548001470 con 0x7fe5580c6710 2023-10-24T00:44:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c011400 con 0x7fe5580c6710 2023-10-24T00:44:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe556ffd700 1 -- 172.21.15.148:0/93245028 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c011780 con 0x7fe5580c6710 2023-10-24T00:44:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe55ea3b700 1 -- 172.21.15.148:0/93245028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580c6710 msgr2=0x7fe5580c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/93245028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580c6710 0x7fe5580c1a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fe54c009760 tx=0x7fe54c009060).stop 2023-10-24T00:44:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe55ea3b700 1 -- 172.21.15.148:0/93245028 shutdown_connections 2023-10-24T00:44:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/93245028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580c6710 0x7fe5580c1a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.485+0000 7fe55ea3b700 1 -- 172.21.15.148:0/93245028 >> 172.21.15.148:0/93245028 conn(0x7fe5580caf40 msgr2=0x7fe5580cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.486+0000 7fe55ea3b700 1 -- 172.21.15.148:0/93245028 shutdown_connections 2023-10-24T00:44:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.486+0000 7fe55ea3b700 1 -- 172.21.15.148:0/93245028 wait complete. 2023-10-24T00:44:16.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.487+0000 7fe55ea3b700 1 Processor -- start 2023-10-24T00:44:16.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.487+0000 7fe55ea3b700 1 -- start start 2023-10-24T00:44:16.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580aa010 0x7fe5580c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580aa3f0 0x7fe558143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580c27c0 con 0x7fe5580c6710 2023-10-24T00:44:16.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580c2aa0 con 0x7fe5580aa010 2023-10-24T00:44:16.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580c2d80 con 0x7fe5580aa3f0 2023-10-24T00:44:16.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe557fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580aa010 0x7fe5580c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57294/0 (socket says 172.21.15.148:57294) 2023-10-24T00:44:16.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 -- 172.21.15.148:0/1437567598 learned_addr learned my addr 172.21.15.148:0/1437567598 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:16.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe5577fe700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580aa3f0 0x7fe558143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 -- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580aa3f0 msgr2=0x7fe558143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580aa3f0 0x7fe558143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 -- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580aa010 msgr2=0x7fe5580c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580aa010 0x7fe5580c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 -- 172.21.15.148:0/1437567598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0092a0 con 0x7fe5580c6710 2023-10-24T00:44:16.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55cfd8700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe550002230 tx=0x7fe5500015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000e4a0 con 0x7fe5580c6710 2023-10-24T00:44:16.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000e600 con 0x7fe5580c6710 2023-10-24T00:44:16.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5580c3060 con 0x7fe5580c6710 2023-10-24T00:44:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55000e980 con 0x7fe5580c6710 2023-10-24T00:44:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.488+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5580c24d0 con 0x7fe5580c6710 2023-10-24T00:44:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.489+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5580c3560 con 0x7fe5580c6710 2023-10-24T00:44:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.490+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe55001b3b0 con 0x7fe5580c6710 2023-10-24T00:44:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.490+0000 7fe53ffff700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 0x7fe544061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.490+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe550079660 con 0x7fe5580c6710 2023-10-24T00:44:16.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.490+0000 7fe557fff700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 0x7fe544061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.491+0000 7fe557fff700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 0x7fe544061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe548000c00 tx=0x7fe548001660).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.494+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe550048af0 con 0x7fe5580c6710 2023-10-24T00:44:16.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.659+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55806c6b0 con 0x7fe5580c6710 2023-10-24T00:44:16.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.659+0000 7fe53ffff700 1 -- 172.21.15.148:0/1437567598 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fe55004ab50 con 0x7fe5580c6710 2023-10-24T00:44:16.661 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:16.661 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":77,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:15.954848+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:16.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 msgr2=0x7fe544061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 0x7fe544061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe548000c00 tx=0x7fe548001660).stop 2023-10-24T00:44:16.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 msgr2=0x7fe558155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe550002230 tx=0x7fe5500015e0).stop 2023-10-24T00:44:16.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 shutdown_connections 2023-10-24T00:44:16.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe54405f270 0x7fe544061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5580c6710 0x7fe558155560 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5580aa010 0x7fe5580c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 --2- 172.21.15.148:0/1437567598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580aa3f0 0x7fe558143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.661+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 >> 172.21.15.148:0/1437567598 conn(0x7fe5580caf40 msgr2=0x7fe558152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.662+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 shutdown_connections 2023-10-24T00:44:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.662+0000 7fe55ea3b700 1 -- 172.21.15.148:0/1437567598 wait complete. 2023-10-24T00:44:16.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:44:16.676 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:44:16.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.790+0000 7f9fdb118700 1 Processor -- start 2023-10-24T00:44:16.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.790+0000 7f9fdb118700 1 -- start start 2023-10-24T00:44:16.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 0x7f9fd4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9fd4098bd0 0x7f9fd40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40c71d0 con 0x7f9fd4098bd0 2023-10-24T00:44:16.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd40c9410 con 0x7f9fd4154430 2023-10-24T00:44:16.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fdb118700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40c0950 con 0x7f9fd40bffd0 2023-10-24T00:44:16.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fd3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9fd4098bd0 0x7f9fd40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fd3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9fd4098bd0 0x7f9fd40c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57302/0 (socket says 172.21.15.148:57302) 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.791+0000 7f9fd3fff700 1 -- 172.21.15.148:0/3338018999 learned_addr learned my addr 172.21.15.148:0/3338018999 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd96b5700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd8eb4700 1 --2- 172.21.15.148:0/3338018999 >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 0x7f9fd4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 -- 172.21.15.148:0/3338018999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 msgr2=0x7f9fd40c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 -- 172.21.15.148:0/3338018999 >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 msgr2=0x7f9fd4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:16.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 --2- 172.21.15.148:0/3338018999 >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 0x7f9fd4154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 -- 172.21.15.148:0/3338018999 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40c6c10 con 0x7f9fd4098bd0 2023-10-24T00:44:16.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd8eb4700 1 --2- 172.21.15.148:0/3338018999 >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 0x7f9fd4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:16.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd3fff700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40c6300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f9fd405ff70 tx=0x7f9fbc0090f0).ready entity=mon.0 client_cookie=e505ccf72b936174 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd37fe700 1 -- 172.21.15.148:0/3338018999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc00b600 con 0x7f9fd4098bd0 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd37fe700 1 -- 172.21.15.148:0/3338018999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc00b760 con 0x7f9fd4098bd0 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fd37fe700 1 -- 172.21.15.148:0/3338018999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc00bae0 con 0x7f9fd4098bd0 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 -- 172.21.15.148:0/3338018999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4098bd0 msgr2=0x7f9fd40c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40c6300 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f9fd405ff70 tx=0x7f9fbc0090f0).stop 2023-10-24T00:44:16.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 -- 172.21.15.148:0/3338018999 shutdown_connections 2023-10-24T00:44:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 --2- 172.21.15.148:0/3338018999 >> v2:172.21.15.150:3300/0 conn(0x7f9fd4154430 0x7f9fd4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 --2- 172.21.15.148:0/3338018999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40c6300 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.792+0000 7f9fdb118700 1 -- 172.21.15.148:0/3338018999 >> 172.21.15.148:0/3338018999 conn(0x7f9fd40cb070 msgr2=0x7f9fd40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.793+0000 7f9fdb118700 1 -- 172.21.15.148:0/3338018999 shutdown_connections 2023-10-24T00:44:16.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.793+0000 7f9fdb118700 1 -- 172.21.15.148:0/3338018999 wait complete. 2023-10-24T00:44:16.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.794+0000 7f9fdb118700 1 Processor -- start 2023-10-24T00:44:16.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.794+0000 7f9fdb118700 1 -- start start 2023-10-24T00:44:16.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.794+0000 7f9fdb118700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.794+0000 7f9fdb118700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40ad770 con 0x7f9fd4154430 2023-10-24T00:44:16.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40acdf0 con 0x7f9fd4098bd0 2023-10-24T00:44:16.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40ac1e0 con 0x7f9fd40bffd0 2023-10-24T00:44:16.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57316/0 (socket says 172.21.15.148:57316) 2023-10-24T00:44:16.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 -- 172.21.15.148:0/1452738492 learned_addr learned my addr 172.21.15.148:0/1452738492 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:16.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd8eb4700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd3fff700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 -- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 msgr2=0x7f9fd40ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 -- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fd4098bd0 msgr2=0x7f9fd40abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 -- 172.21.15.148:0/1452738492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc009370 con 0x7f9fd4154430 2023-10-24T00:44:16.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd96b5700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f9fcc00d890 tx=0x7f9fcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc011590 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0116f0 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd40ac4c0 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc011a70 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.795+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd40aca80 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.796+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd406c6b0 con 0x7f9fd4154430 2023-10-24T00:44:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.797+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9fcc012420 con 0x7f9fd4154430 2023-10-24T00:44:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.797+0000 7f9fd0ff9700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 0x7f9fb4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.797+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9fcc0799e0 con 0x7f9fd4154430 2023-10-24T00:44:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.797+0000 7f9fd8eb4700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 0x7f9fb4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.797+0000 7f9fd8eb4700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 0x7f9fb4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9fc400f600 tx=0x7f9fc40077b0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.801+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9fcc04ae20 con 0x7f9fd4154430 2023-10-24T00:44:16.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.966+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9fd40c6ef0 con 0x7f9fd4154430 2023-10-24T00:44:16.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.966+0000 7f9fd0ff9700 1 -- 172.21.15.148:0/1452738492 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9fcc04e440 con 0x7f9fd4154430 2023-10-24T00:44:16.968 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:44:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 msgr2=0x7f9fb4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 0x7f9fb4061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9fc400f600 tx=0x7f9fc40077b0).stop 2023-10-24T00:44:16.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 msgr2=0x7f9fd41507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f9fcc00d890 tx=0x7f9fcc008040).stop 2023-10-24T00:44:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 shutdown_connections 2023-10-24T00:44:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9fb405f270 0x7f9fb4061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9fd4154430 0x7f9fd41507e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9fd4098bd0 0x7f9fd40abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 --2- 172.21.15.148:0/1452738492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9fd40bffd0 0x7f9fd40ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.968+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 >> 172.21.15.148:0/1452738492 conn(0x7f9fd40cb070 msgr2=0x7f9fd40c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.969+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 shutdown_connections 2023-10-24T00:44:16.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:16.969+0000 7f9fdb118700 1 -- 172.21.15.148:0/1452738492 wait complete. 2023-10-24T00:44:16.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:44:17.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.098+0000 7f29c6a0d700 1 Processor -- start 2023-10-24T00:44:17.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.098+0000 7f29c6a0d700 1 -- start start 2023-10-24T00:44:17.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.099+0000 7f29c6a0d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.099+0000 7f29c6a0d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29c00bffd0 0x7f29c00c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.099+0000 7f29c6a0d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00c0970 con 0x7f29c0154430 2023-10-24T00:44:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.099+0000 7f29c6a0d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00c6a10 con 0x7f29c00bffd0 2023-10-24T00:44:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.099+0000 7f29c6a0d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00c71d0 con 0x7f29c0098bd0 2023-10-24T00:44:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29b7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29c00bffd0 0x7f29c00c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29b7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54396/0 (socket says 172.21.15.148:54396) 2023-10-24T00:44:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29b7fff700 1 -- 172.21.15.148:0/1787623177 learned_addr learned my addr 172.21.15.148:0/1787623177 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29c00bffd0 0x7f29c00c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:41190/0 (socket says 172.21.15.148:41190) 2023-10-24T00:44:17.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 -- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 msgr2=0x7f29c0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 -- 172.21.15.148:0/1787623177 >> v1:172.21.15.150:6789/0 conn(0x7f29c0154430 legacy=0x7f29c00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 -- 172.21.15.148:0/1787623177 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00c9410 con 0x7f29c00bffd0 2023-10-24T00:44:17.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29b7fff700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:17.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29c4faa700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00bffd0 0x7f29c00c0480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f29b8009e90 tx=0x7f29b8009780).ready entity=mon.1 client_cookie=6d5bbb080d3ae0bb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29bf7fe700 1 -- 172.21.15.148:0/1787623177 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800e070 con 0x7f29c00bffd0 2023-10-24T00:44:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29bf7fe700 1 -- 172.21.15.148:0/1787623177 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800bb20 con 0x7f29c00bffd0 2023-10-24T00:44:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.100+0000 7f29bf7fe700 1 -- 172.21.15.148:0/1787623177 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800bea0 con 0x7f29c00bffd0 2023-10-24T00:44:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 -- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00bffd0 msgr2=0x7f29c00c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00bffd0 0x7f29c00c0480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f29b8009e90 tx=0x7f29b8009780).stop 2023-10-24T00:44:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 -- 172.21.15.148:0/1787623177 shutdown_connections 2023-10-24T00:44:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c00bffd0 0x7f29c00c0480 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/1787623177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c0098bd0 0x7f29c0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 -- 172.21.15.148:0/1787623177 >> 172.21.15.148:0/1787623177 conn(0x7f29c00cb070 msgr2=0x7f29c00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 -- 172.21.15.148:0/1787623177 shutdown_connections 2023-10-24T00:44:17.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.101+0000 7f29c6a0d700 1 -- 172.21.15.148:0/1787623177 wait complete. 2023-10-24T00:44:17.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.102+0000 7f29c6a0d700 1 Processor -- start 2023-10-24T00:44:17.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.102+0000 7f29c6a0d700 1 -- start start 2023-10-24T00:44:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c00bffd0 0x7f29c00afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c0154430 0x7f29c00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0151680 con 0x7f29c0098bd0 2023-10-24T00:44:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00b0980 con 0x7f29c0154430 2023-10-24T00:44:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0164740 con 0x7f29c00bffd0 2023-10-24T00:44:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57324/0 (socket says 172.21.15.148:57324) 2023-10-24T00:44:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 -- 172.21.15.148:0/2285654240 learned_addr learned my addr 172.21.15.148:0/2285654240 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29b7fff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c00bffd0 0x7f29c00afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c4faa700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c0154430 0x7f29c00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 -- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c00bffd0 msgr2=0x7f29c00afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c00bffd0 0x7f29c00afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 -- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c0154430 msgr2=0x7f29c00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c0154430 0x7f29c00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 -- 172.21.15.148:0/2285654240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8009370 con 0x7f29c0098bd0 2023-10-24T00:44:17.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bffff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f29b000c440 tx=0x7f29b0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0007020 con 0x7f29c0098bd0 2023-10-24T00:44:17.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0007180 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0007520 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b8009a20 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.103+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c0164d80 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.104+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c006c6b0 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.105+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f29b00068b0 con 0x7f29c0098bd0 2023-10-24T00:44:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.105+0000 7f29bcff9700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 0x7f29a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.105+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f29b00790f0 con 0x7f29c0098bd0 2023-10-24T00:44:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.105+0000 7f29b7fff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 0x7f29a0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.106+0000 7f29b7fff700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 0x7f29a0061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f29c00af860 tx=0x7f29a80090f0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.109+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29b0047af0 con 0x7f29c0098bd0 2023-10-24T00:44:17.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.271+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f29c00c0970 con 0x7f29c0098bd0 2023-10-24T00:44:17.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.271+0000 7f29bcff9700 1 -- 172.21.15.148:0/2285654240 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29c00c0970 con 0x7f29c0098bd0 2023-10-24T00:44:17.273 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:44:17.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 msgr2=0x7f29a0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 0x7f29a0061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f29c00af860 tx=0x7f29a80090f0).stop 2023-10-24T00:44:17.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 msgr2=0x7f29c0150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f29b000c440 tx=0x7f29b0007e00).stop 2023-10-24T00:44:17.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 shutdown_connections 2023-10-24T00:44:17.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29c0154430 0x7f29c00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29a005f270 0x7f29a0061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29c0098bd0 0x7f29c0150580 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 --2- 172.21.15.148:0/2285654240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29c00bffd0 0x7f29c00afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 >> 172.21.15.148:0/2285654240 conn(0x7f29c00cb070 msgr2=0x7f29c0154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 shutdown_connections 2023-10-24T00:44:17.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.273+0000 7f29c6a0d700 1 -- 172.21.15.148:0/2285654240 wait complete. 2023-10-24T00:44:17.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:44:17.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.400+0000 7fa25ecf1700 1 Processor -- start 2023-10-24T00:44:17.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.400+0000 7fa25ecf1700 1 -- start start 2023-10-24T00:44:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25ecf1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 0x7fa2580c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25ecf1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2580c0ef0 0x7fa2580c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25ecf1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2580c6410 con 0x7fa2580ca110 2023-10-24T00:44:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25ecf1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2580ca6e0 con 0x7fa2580c0ef0 2023-10-24T00:44:17.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25ecf1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580ca9c0 con 0x7fa2580aa140 2023-10-24T00:44:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2580c0ef0 0x7fa2580c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2580c0ef0 0x7fa2580c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57328/0 (socket says 172.21.15.148:57328) 2023-10-24T00:44:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 -- 172.21.15.148:0/1884263714 learned_addr learned my addr 172.21.15.148:0/1884263714 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 -- 172.21.15.148:0/1884263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 msgr2=0x7fa2580c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25dcef700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 0x7fa2580c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 0x7fa2580c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 -- 172.21.15.148:0/1884263714 >> v1:172.21.15.150:6789/0 conn(0x7fa2580ca110 legacy=0x7fa2580c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25e4f0700 1 -- 172.21.15.148:0/1884263714 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580c60a0 con 0x7fa2580c0ef0 2023-10-24T00:44:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.401+0000 7fa25dcef700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 0x7fa2580c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25e4f0700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c68a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fa250006fd0 tx=0x7fa2500090f0).ready entity=mon.0 client_cookie=783b1ff082711097 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25cced700 1 -- 172.21.15.148:0/1884263714 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25000b600 con 0x7fa2580c0ef0 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25cced700 1 -- 172.21.15.148:0/1884263714 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25000b760 con 0x7fa2580c0ef0 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25cced700 1 -- 172.21.15.148:0/1884263714 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25000bb00 con 0x7fa2580c0ef0 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 -- 172.21.15.148:0/1884263714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580c0ef0 msgr2=0x7fa2580c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c68a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fa250006fd0 tx=0x7fa2500090f0).stop 2023-10-24T00:44:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 -- 172.21.15.148:0/1884263714 shutdown_connections 2023-10-24T00:44:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580aa140 0x7fa2580c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/1884263714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c68a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 -- 172.21.15.148:0/1884263714 >> 172.21.15.148:0/1884263714 conn(0x7fa2580944a0 msgr2=0x7fa25806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 -- 172.21.15.148:0/1884263714 shutdown_connections 2023-10-24T00:44:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.402+0000 7fa25ecf1700 1 -- 172.21.15.148:0/1884263714 wait complete. 2023-10-24T00:44:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.403+0000 7fa25ecf1700 1 Processor -- start 2023-10-24T00:44:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.403+0000 7fa25ecf1700 1 -- start start 2023-10-24T00:44:17.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580ca110 0x7fa258167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580c50d0 con 0x7fa2580aa140 2023-10-24T00:44:17.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580c4510 con 0x7fa2580c0ef0 2023-10-24T00:44:17.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25ecf1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580c47a0 con 0x7fa2580ca110 2023-10-24T00:44:17.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25dcef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25dcef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57342/0 (socket says 172.21.15.148:57342) 2023-10-24T00:44:17.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25dcef700 1 -- 172.21.15.148:0/2493930150 learned_addr learned my addr 172.21.15.148:0/2493930150 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:17.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25e4f0700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580ca110 0x7fa258167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.404+0000 7fa25d4ee700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 -- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580ca110 msgr2=0x7fa258167750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580ca110 0x7fa258167750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 -- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 msgr2=0x7fa2580c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 -- 172.21.15.148:0/2493930150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250009370 con 0x7fa2580aa140 2023-10-24T00:44:17.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25d4ee700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:17.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25dcef700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa24800a400 tx=0x7fa248007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800ae20 con 0x7fa2580aa140 2023-10-24T00:44:17.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800d650 con 0x7fa2580aa140 2023-10-24T00:44:17.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2580c4a80 con 0x7fa2580aa140 2023-10-24T00:44:17.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800d9d0 con 0x7fa2580aa140 2023-10-24T00:44:17.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.405+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2580c2390 con 0x7fa2580aa140 2023-10-24T00:44:17.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.406+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258047480 con 0x7fa2580aa140 2023-10-24T00:44:17.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.406+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa248013070 con 0x7fa2580aa140 2023-10-24T00:44:17.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.407+0000 7fa255ffb700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 0x7fa244061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.407+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa24807a730 con 0x7fa2580aa140 2023-10-24T00:44:17.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.407+0000 7fa25d4ee700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 0x7fa244061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.407+0000 7fa25d4ee700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 0x7fa244061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa258152920 tx=0x7fa24c008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.411+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa24804bbd0 con 0x7fa2580aa140 2023-10-24T00:44:17.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.574+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa2580c5d50 con 0x7fa2580aa140 2023-10-24T00:44:17.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.574+0000 7fa255ffb700 1 -- 172.21.15.148:0/2493930150 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa2480079a0 con 0x7fa2580aa140 2023-10-24T00:44:17.576 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:17.576 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:44:17.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:17.577 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:44:17.577 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:44:17.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:17.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:17.578 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:44:17.578 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:44:17.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:17.578 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:44:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 msgr2=0x7fa244061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 0x7fa244061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa258152920 tx=0x7fa24c008040).stop 2023-10-24T00:44:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 msgr2=0x7fa2581507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa24800a400 tx=0x7fa248007910).stop 2023-10-24T00:44:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 shutdown_connections 2023-10-24T00:44:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2580ca110 0x7fa258167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa24405f270 0x7fa244061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2580aa140 0x7fa2581507f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 --2- 172.21.15.148:0/2493930150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2580c0ef0 0x7fa2580c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 >> 172.21.15.148:0/2493930150 conn(0x7fa2580944a0 msgr2=0x7fa2580a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 shutdown_connections 2023-10-24T00:44:17.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.576+0000 7fa25ecf1700 1 -- 172.21.15.148:0/2493930150 wait complete. 2023-10-24T00:44:17.590 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:44:17.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:44:17.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.708+0000 7fba77db9700 1 Processor -- start 2023-10-24T00:44:17.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.708+0000 7fba77db9700 1 -- start start 2023-10-24T00:44:17.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba77db9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba701544b0 0x7fba700a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba77db9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba700c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba77db9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba700c6270 con 0x7fba700c8290 2023-10-24T00:44:17.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba77db9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba700c60e0 con 0x7fba701544b0 2023-10-24T00:44:17.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba77db9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c0c80 con 0x7fba700aa640 2023-10-24T00:44:17.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba75354700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fba700c8290 0x7fba700a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38620/0 (socket says 172.21.15.148:38620) 2023-10-24T00:44:17.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba75354700 1 -- 172.21.15.148:0/3007807994 learned_addr learned my addr 172.21.15.148:0/3007807994 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:17.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba75b55700 1 --2- 172.21.15.148:0/3007807994 >> v2:172.21.15.150:3300/0 conn(0x7fba701544b0 0x7fba700a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba76356700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba700c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813515237 0 0) 0x7fba700c6270 con 0x7fba700c8290 2023-10-24T00:44:17.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba580033f0 con 0x7fba700c8290 2023-10-24T00:44:17.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.709+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2324180748 0 0) 0x7fba580033f0 con 0x7fba700c8290 2023-10-24T00:44:17.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 msgr2=0x7fba700c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba700c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 >> v2:172.21.15.150:3300/0 conn(0x7fba701544b0 msgr2=0x7fba700a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 --2- 172.21.15.148:0/3007807994 >> v2:172.21.15.150:3300/0 conn(0x7fba701544b0 0x7fba700a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700c0f40 con 0x7fba700c8290 2023-10-24T00:44:17.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fba64001470 con 0x7fba700c8290 2023-10-24T00:44:17.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 >> v1:172.21.15.148:6789/0 conn(0x7fba700c8290 legacy=0x7fba700a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580038e0 0x7fba58003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba58004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58004b80 0x7fba58005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c60e0 con 0x7fba58004b80 2023-10-24T00:44:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba700c0c80 con 0x7fba580038e0 2023-10-24T00:44:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5800b8e0 con 0x7fba700aa640 2023-10-24T00:44:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba75b55700 1 --2- 172.21.15.148:0/3007807994 >> v2:172.21.15.150:3300/0 conn(0x7fba701544b0 0x7fba700a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58004b80 0x7fba58005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba75354700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba58004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba75b55700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580038e0 0x7fba58003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 -- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 msgr2=0x7fba58004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba58004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 -- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580038e0 msgr2=0x7fba58003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580038e0 0x7fba58003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 -- 172.21.15.148:0/3007807994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580033f0 con 0x7fba58004b80 2023-10-24T00:44:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba75354700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700aa640 0x7fba58004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba76356700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58004b80 0x7fba58005000 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fba70085af0 tx=0x7fba60009060).ready entity=mon.0 client_cookie=a805a059f2b1218e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60009e90 con 0x7fba58004b80 2023-10-24T00:44:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60009430 con 0x7fba58004b80 2023-10-24T00:44:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.710+0000 7fba74b53700 1 -- 172.21.15.148:0/3007807994 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000e850 con 0x7fba58004b80 2023-10-24T00:44:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 -- 172.21.15.148:0/3007807994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58004b80 msgr2=0x7fba58005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 --2- 172.21.15.148:0/3007807994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba58004b80 0x7fba58005000 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fba70085af0 tx=0x7fba60009060).stop 2023-10-24T00:44:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba76356700 1 -- 172.21.15.148:0/3007807994 reap_dead start 2023-10-24T00:44:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 -- 172.21.15.148:0/3007807994 shutdown_connections 2023-10-24T00:44:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 -- 172.21.15.148:0/3007807994 >> 172.21.15.148:0/3007807994 conn(0x7fba700945d0 msgr2=0x7fba7006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 -- 172.21.15.148:0/3007807994 shutdown_connections 2023-10-24T00:44:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.711+0000 7fba77db9700 1 -- 172.21.15.148:0/3007807994 wait complete. 2023-10-24T00:44:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.712+0000 7fba77db9700 1 Processor -- start 2023-10-24T00:44:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.712+0000 7fba77db9700 1 -- start start 2023-10-24T00:44:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700af920 0x7fba7014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 0x7fba70155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7014f560 con 0x7fba700af540 2023-10-24T00:44:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba701657a0 con 0x7fba7014f0e0 2023-10-24T00:44:17.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70164b90 con 0x7fba700af920 2023-10-24T00:44:17.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57360/0 (socket says 172.21.15.148:57360) 2023-10-24T00:44:17.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 -- 172.21.15.148:0/2304436221 learned_addr learned my addr 172.21.15.148:0/2304436221 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:17.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75354700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700af920 0x7fba7014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba76356700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 0x7fba70155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 -- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700af920 msgr2=0x7fba7014ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700af920 0x7fba7014ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 -- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 msgr2=0x7fba70155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 0x7fba70155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 -- 172.21.15.148:0/2304436221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70164e70 con 0x7fba700af540 2023-10-24T00:44:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba76356700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 0x7fba70155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba75b55700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fba68011550 tx=0x7fba6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800e030 con 0x7fba700af540 2023-10-24T00:44:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba680153f0 con 0x7fba700af540 2023-10-24T00:44:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba70165150 con 0x7fba700af540 2023-10-24T00:44:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.713+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68015770 con 0x7fba700af540 2023-10-24T00:44:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.714+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba701574f0 con 0x7fba700af540 2023-10-24T00:44:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.715+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7006c6b0 con 0x7fba700af540 2023-10-24T00:44:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.715+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fba68015b60 con 0x7fba700af540 2023-10-24T00:44:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.715+0000 7fba6dffb700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 0x7fba5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.715+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fba6800f070 con 0x7fba700af540 2023-10-24T00:44:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.715+0000 7fba75354700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 0x7fba5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.716+0000 7fba75354700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 0x7fba5c061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba64000c00 tx=0x7fba64007040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.719+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fba6804c180 con 0x7fba700af540 2023-10-24T00:44:17.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.883+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fba700c1220 con 0x7fba700af540 2023-10-24T00:44:17.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.970+0000 7fba6dffb700 1 -- 172.21.15.148:0/2304436221 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 152+0+0 (secure 0 0 0) 0x7fba6804f7a0 con 0x7fba700af540 2023-10-24T00:44:17.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.973+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 msgr2=0x7fba5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.973+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 0x7fba5c061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba64000c00 tx=0x7fba64007040).stop 2023-10-24T00:44:17.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.973+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 msgr2=0x7fba700ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:17.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.973+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fba68011550 tx=0x7fba6800b040).stop 2023-10-24T00:44:17.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.978+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 shutdown_connections 2023-10-24T00:44:17.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.978+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7014f0e0 0x7fba70155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.978+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba5c05f270 0x7fba5c061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.978+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba700af540 0x7fba700ad4b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.978+0000 7fba77db9700 1 --2- 172.21.15.148:0/2304436221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba700af920 0x7fba7014ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:17.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.979+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 >> 172.21.15.148:0/2304436221 conn(0x7fba700945d0 msgr2=0x7fba70153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:17.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.979+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 shutdown_connections 2023-10-24T00:44:17.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:17.979+0000 7fba77db9700 1 -- 172.21.15.148:0/2304436221 wait complete. 2023-10-24T00:44:17.982 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:44:17.992 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:44:18.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.111+0000 7fdefc96d700 1 Processor -- start 2023-10-24T00:44:18.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.111+0000 7fdefc96d700 1 -- start start 2023-10-24T00:44:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdefc96d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdef8154430 0x7fdef8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdefc96d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 0x7fdef80c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdefc96d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80c71d0 con 0x7fdef8098bd0 2023-10-24T00:44:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdefc96d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80c6a10 con 0x7fdef8154430 2023-10-24T00:44:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdefc96d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80c9410 con 0x7fdef80bffd0 2023-10-24T00:44:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef5d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdef8098bd0 0x7fdef80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38634/0 (socket says 172.21.15.148:38634) 2023-10-24T00:44:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef5d9b700 1 -- 172.21.15.148:0/2340732095 learned_addr learned my addr 172.21.15.148:0/2340732095 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/2340732095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 0x7fdef80c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef659c700 1 --2- 172.21.15.148:0/2340732095 >> v2:172.21.15.150:3300/0 conn(0x7fdef8154430 0x7fdef8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265677089 0 0) 0x7fdef80c71d0 con 0x7fdef8098bd0 2023-10-24T00:44:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee00033f0 con 0x7fdef8098bd0 2023-10-24T00:44:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 -- 172.21.15.148:0/2340732095 >> v2:172.21.15.150:3300/0 conn(0x7fdef8154430 msgr2=0x7fdef8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/2340732095 >> v2:172.21.15.150:3300/0 conn(0x7fdef8154430 0x7fdef8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 -- 172.21.15.148:0/2340732095 >> v1:172.21.15.148:6789/0 conn(0x7fdef8098bd0 legacy=0x7fdef80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194817978 0 0) 0x7fdee00033f0 con 0x7fdef8098bd0 2023-10-24T00:44:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 -- 172.21.15.148:0/2340732095 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80c0950 con 0x7fdef80bffd0 2023-10-24T00:44:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.112+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/2340732095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 0x7fdef80c0460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdef0009e60 tx=0x7fdef0009780).ready entity=mon.2 client_cookie=da31d4369202ab8e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000e070 con 0x7fdef80bffd0 2023-10-24T00:44:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000b7a0 con 0x7fdef80bffd0 2023-10-24T00:44:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdef559a700 1 -- 172.21.15.148:0/2340732095 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec001470 con 0x7fdef80bffd0 2023-10-24T00:44:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 -- 172.21.15.148:0/2340732095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 msgr2=0x7fdef80c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 --2- 172.21.15.148:0/2340732095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 0x7fdef80c0460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdef0009e60 tx=0x7fdef0009780).stop 2023-10-24T00:44:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 -- 172.21.15.148:0/2340732095 shutdown_connections 2023-10-24T00:44:18.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 --2- 172.21.15.148:0/2340732095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef80bffd0 0x7fdef80c0460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 --2- 172.21.15.148:0/2340732095 >> v2:172.21.15.150:3300/0 conn(0x7fdef8154430 0x7fdef8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 -- 172.21.15.148:0/2340732095 >> 172.21.15.148:0/2340732095 conn(0x7fdef80cb070 msgr2=0x7fdef80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:18.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 -- 172.21.15.148:0/2340732095 shutdown_connections 2023-10-24T00:44:18.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.113+0000 7fdefc96d700 1 -- 172.21.15.148:0/2340732095 wait complete. 2023-10-24T00:44:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.114+0000 7fdefc96d700 1 Processor -- start 2023-10-24T00:44:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.114+0000 7fdefc96d700 1 -- start start 2023-10-24T00:44:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef8098bd0 0x7fdef80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef80bffd0 0x7fdef80b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80b1050 con 0x7fdef8154430 2023-10-24T00:44:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80af440 con 0x7fdef80bffd0 2023-10-24T00:44:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdefc96d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80ae830 con 0x7fdef8098bd0 2023-10-24T00:44:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdef6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdef6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57362/0 (socket says 172.21.15.148:57362) 2023-10-24T00:44:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.115+0000 7fdef6d9d700 1 -- 172.21.15.148:0/679480835 learned_addr learned my addr 172.21.15.148:0/679480835 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef659c700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef8098bd0 0x7fdef80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef5d9b700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef80bffd0 0x7fdef80b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 -- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef8098bd0 msgr2=0x7fdef80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef8098bd0 0x7fdef80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 -- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef80bffd0 msgr2=0x7fdef80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef80bffd0 0x7fdef80b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 -- 172.21.15.148:0/679480835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009a20 con 0x7fdef8154430 2023-10-24T00:44:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdef6d9d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdef80c9550 tx=0x7fdef8154d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0021070 con 0x7fdef8154430 2023-10-24T00:44:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef001d420 con 0x7fdef8154430 2023-10-24T00:44:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80aeb10 con 0x7fdef8154430 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef001d7c0 con 0x7fdef8154430 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.116+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80af0d0 con 0x7fdef8154430 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.117+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef80af5b0 con 0x7fdef8154430 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.118+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdef0003040 con 0x7fdef8154430 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.118+0000 7fdee67fc700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 0x7fded8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:18.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.118+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fdef007b750 con 0x7fdef8154430 2023-10-24T00:44:18.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.118+0000 7fdef659c700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 0x7fded8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:18.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.119+0000 7fdef659c700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 0x7fded8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdef814f970 tx=0x7fdee8008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:18.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.122+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdef004ca80 con 0x7fdef8154430 2023-10-24T00:44:18.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.288+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdef8062c40 con 0x7fdef8154430 2023-10-24T00:44:18.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.976+0000 7fdee67fc700 1 -- 172.21.15.148:0/679480835 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdef00500a0 con 0x7fdef8154430 2023-10-24T00:44:18.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.980+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 msgr2=0x7fded8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.980+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 0x7fded8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdef814f970 tx=0x7fdee8008040).stop 2023-10-24T00:44:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.980+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 msgr2=0x7fdef80b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:18.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.980+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fdef80c9550 tx=0x7fdef8154d00).stop 2023-10-24T00:44:18.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 shutdown_connections 2023-10-24T00:44:18.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fded805f270 0x7fded8061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef8154430 0x7fdef80b0b60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdef8098bd0 0x7fdef80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 --2- 172.21.15.148:0/679480835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdef80bffd0 0x7fdef80b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:18.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.981+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 >> 172.21.15.148:0/679480835 conn(0x7fdef80cb070 msgr2=0x7fdef814fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:18.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.984+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 shutdown_connections 2023-10-24T00:44:18.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:18.984+0000 7fdefc96d700 1 -- 172.21.15.148:0/679480835 wait complete. 2023-10-24T00:44:18.991 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:44:19.009 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:44:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.127+0000 7fdd43159700 1 Processor -- start 2023-10-24T00:44:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.127+0000 7fdd43159700 1 -- start start 2023-10-24T00:44:19.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd43159700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd3c154150 0x7fdd3c0a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd43159700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd3c0aa390 0x7fdd3c0c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd43159700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0a9830 con 0x7fdd3c0c0e30 2023-10-24T00:44:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd43159700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0c1280 con 0x7fdd3c0aa390 2023-10-24T00:44:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd43159700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0a8c20 con 0x7fdd3c154150 2023-10-24T00:44:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd3c0aa390 0x7fdd3c0c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd3c0aa390 0x7fdd3c0c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57378/0 (socket says 172.21.15.148:57378) 2023-10-24T00:44:19.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 -- 172.21.15.148:0/3670342011 learned_addr learned my addr 172.21.15.148:0/3670342011 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 -- 172.21.15.148:0/3670342011 >> v2:172.21.15.150:3300/0 conn(0x7fdd3c154150 msgr2=0x7fdd3c0a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd42157700 1 --2- 172.21.15.148:0/3670342011 >> v2:172.21.15.150:3300/0 conn(0x7fdd3c154150 0x7fdd3c0a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 --2- 172.21.15.148:0/3670342011 >> v2:172.21.15.150:3300/0 conn(0x7fdd3c154150 0x7fdd3c0a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 -- 172.21.15.148:0/3670342011 >> v1:172.21.15.150:6789/0 conn(0x7fdd3c0c0e30 legacy=0x7fdd3c0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 -- 172.21.15.148:0/3670342011 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0a8f00 con 0x7fdd3c0aa390 2023-10-24T00:44:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41956700 1 --2- 172.21.15.148:0/3670342011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c0c0940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fdd3c0858f0 tx=0x7fdd2c0090f0).ready entity=mon.0 client_cookie=77723e657cf5bc9b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41155700 1 -- 172.21.15.148:0/3670342011 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00b5a0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41155700 1 -- 172.21.15.148:0/3670342011 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00b700 con 0x7fdd3c0aa390 2023-10-24T00:44:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.128+0000 7fdd41155700 1 -- 172.21.15.148:0/3670342011 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00ba80 con 0x7fdd3c0aa390 2023-10-24T00:44:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 -- 172.21.15.148:0/3670342011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 msgr2=0x7fdd3c0c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 --2- 172.21.15.148:0/3670342011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c0c0940 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fdd3c0858f0 tx=0x7fdd2c0090f0).stop 2023-10-24T00:44:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 -- 172.21.15.148:0/3670342011 shutdown_connections 2023-10-24T00:44:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 --2- 172.21.15.148:0/3670342011 >> v2:172.21.15.150:3300/0 conn(0x7fdd3c154150 0x7fdd3c0a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 --2- 172.21.15.148:0/3670342011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c0c0940 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 -- 172.21.15.148:0/3670342011 >> 172.21.15.148:0/3670342011 conn(0x7fdd3c094500 msgr2=0x7fdd3c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 -- 172.21.15.148:0/3670342011 shutdown_connections 2023-10-24T00:44:19.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.129+0000 7fdd43159700 1 -- 172.21.15.148:0/3670342011 wait complete. 2023-10-24T00:44:19.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.130+0000 7fdd43159700 1 Processor -- start 2023-10-24T00:44:19.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.130+0000 7fdd43159700 1 -- start start 2023-10-24T00:44:19.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0c0e30 0x7fdd3c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd3c154150 0x7fdd3c1645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c164ad0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c152d60 con 0x7fdd3c0c0e30 2023-10-24T00:44:19.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c167460 con 0x7fdd3c154150 2023-10-24T00:44:19.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57380/0 (socket says 172.21.15.148:57380) 2023-10-24T00:44:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 -- 172.21.15.148:0/1022121999 learned_addr learned my addr 172.21.15.148:0/1022121999 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd41956700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0c0e30 0x7fdd3c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42958700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd3c154150 0x7fdd3c1645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 -- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd3c154150 msgr2=0x7fdd3c1645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd3c154150 0x7fdd3c1645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 -- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0c0e30 msgr2=0x7fdd3c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0c0e30 0x7fdd3c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 -- 172.21.15.148:0/1022121999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009370 con 0x7fdd3c0aa390 2023-10-24T00:44:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd42157700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fdd3800a320 tx=0x7fdd38007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800e450 con 0x7fdd3c0aa390 2023-10-24T00:44:19.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800e5b0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c0ae4b0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800e930 con 0x7fdd3c0aa390 2023-10-24T00:44:19.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.131+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c164cd0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.132+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c047480 con 0x7fdd3c0aa390 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.133+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdd3800ed20 con 0x7fdd3c0aa390 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.133+0000 7fdd327fc700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 0x7fdd20061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.133+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fdd3807b980 con 0x7fdd3c0aa390 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.133+0000 7fdd41956700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 0x7fdd20061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.134+0000 7fdd41956700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 0x7fdd20061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd2c009130 tx=0x7fdd2c015000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.137+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd3804c1c0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.342+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdd3c0a91e0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.349+0000 7fdd327fc700 1 -- 172.21.15.148:0/1022121999 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v23) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdd3804f7e0 con 0x7fdd3c0aa390 2023-10-24T00:44:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 msgr2=0x7fdd20061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 0x7fdd20061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdd2c009130 tx=0x7fdd2c015000).stop 2023-10-24T00:44:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 msgr2=0x7fdd3c152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fdd3800a320 tx=0x7fdd38007900).stop 2023-10-24T00:44:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 shutdown_connections 2023-10-24T00:44:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd3c154150 0x7fdd3c1645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdd2005f240 0x7fdd20061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd3c0aa390 0x7fdd3c152520 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 --2- 172.21.15.148:0/1022121999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd3c0c0e30 0x7fdd3c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.354+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 >> 172.21.15.148:0/1022121999 conn(0x7fdd3c094500 msgr2=0x7fdd3c1533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.355+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 shutdown_connections 2023-10-24T00:44:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.355+0000 7fdd43159700 1 -- 172.21.15.148:0/1022121999 wait complete. 2023-10-24T00:44:19.359 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 9 and data pool 10 2023-10-24T00:44:19.377 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:19.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.490+0000 7f59d586f700 1 Processor -- start 2023-10-24T00:44:19.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.490+0000 7f59d586f700 1 -- start start 2023-10-24T00:44:19.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59d586f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f59d00aa010 0x7f59d00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59d586f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00aa820 con 0x7f59d00c6710 2023-10-24T00:44:19.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59d586f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00c0960 con 0x7f59d00aa3f0 2023-10-24T00:44:19.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59d586f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00c0c40 con 0x7f59d00aa010 2023-10-24T00:44:19.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f59d00aa010 0x7f59d00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ce7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f59d00c6710 0x7f59d0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38646/0 (socket says 172.21.15.148:38646) 2023-10-24T00:44:19.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f59d00aa010 0x7f59d00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57392/0 (socket says 172.21.15.148:57392) 2023-10-24T00:44:19.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ce7fc700 1 -- 172.21.15.148:0/244536791 learned_addr learned my addr 172.21.15.148:0/244536791 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:19.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 -- 172.21.15.148:0/244536791 >> v1:172.21.15.150:6789/0 conn(0x7f59d00aa3f0 legacy=0x7f59d0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 -- 172.21.15.148:0/244536791 >> v1:172.21.15.148:6789/0 conn(0x7f59d00c6710 legacy=0x7f59d0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59cdffb700 1 -- 172.21.15.148:0/244536791 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309745742 0 0) 0x7f59d00c0960 con 0x7f59d00aa3f0 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 -- 172.21.15.148:0/244536791 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00c0f20 con 0x7f59d00aa010 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59ceffd700 1 --2- 172.21.15.148:0/244536791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d00c1a00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f59c0009760 tx=0x7f59c0009060).ready entity=mon.0 client_cookie=b101ad6b863ce654 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59cdffb700 1 -- 172.21.15.148:0/244536791 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00090d0 con 0x7f59d00aa010 2023-10-24T00:44:19.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59cdffb700 1 -- 172.21.15.148:0/244536791 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000f510 con 0x7f59d00aa010 2023-10-24T00:44:19.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.491+0000 7f59cdffb700 1 -- 172.21.15.148:0/244536791 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000f890 con 0x7f59d00aa010 2023-10-24T00:44:19.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 -- 172.21.15.148:0/244536791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 msgr2=0x7f59d00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 --2- 172.21.15.148:0/244536791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d00c1a00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f59c0009760 tx=0x7f59c0009060).stop 2023-10-24T00:44:19.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 -- 172.21.15.148:0/244536791 shutdown_connections 2023-10-24T00:44:19.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 --2- 172.21.15.148:0/244536791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d00c1a00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 -- 172.21.15.148:0/244536791 >> 172.21.15.148:0/244536791 conn(0x7f59d00caf40 msgr2=0x7f59d00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 -- 172.21.15.148:0/244536791 shutdown_connections 2023-10-24T00:44:19.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.492+0000 7f59d586f700 1 -- 172.21.15.148:0/244536791 wait complete. 2023-10-24T00:44:19.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.493+0000 7f59d586f700 1 Processor -- start 2023-10-24T00:44:19.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.493+0000 7f59d586f700 1 -- start start 2023-10-24T00:44:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59d00aa3f0 0x7f59d0146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00c6710 0x7f59d0157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00aeb80 con 0x7f59d00aa010 2023-10-24T00:44:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d0146f50 con 0x7f59d00c6710 2023-10-24T00:44:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59d586f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00adf70 con 0x7f59d00aa3f0 2023-10-24T00:44:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57398/0 (socket says 172.21.15.148:57398) 2023-10-24T00:44:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 -- 172.21.15.148:0/2043645525 learned_addr learned my addr 172.21.15.148:0/2043645525 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ce7fc700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59d00aa3f0 0x7f59d0146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59cf7fe700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00c6710 0x7f59d0157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 -- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59d00aa3f0 msgr2=0x7f59d0146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59d00aa3f0 0x7f59d0146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 -- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00c6710 msgr2=0x7f59d0157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00c6710 0x7f59d0157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.494+0000 7f59ceffd700 1 -- 172.21.15.148:0/2043645525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00092a0 con 0x7f59d00aa010 2023-10-24T00:44:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59ceffd700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f59c0009eb0 tx=0x7f59c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0000d10 con 0x7f59d00aa010 2023-10-24T00:44:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c0011b40 con 0x7f59d00aa010 2023-10-24T00:44:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00ae250 con 0x7f59d00aa010 2023-10-24T00:44:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c001c420 con 0x7f59d00aa010 2023-10-24T00:44:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.495+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d00ae810 con 0x7f59d00aa010 2023-10-24T00:44:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.496+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d00aee60 con 0x7f59d00aa010 2023-10-24T00:44:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.496+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f59c001c810 con 0x7f59d00aa010 2023-10-24T00:44:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.497+0000 7f59b6ffd700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 0x7f59bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.497+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f59c007be30 con 0x7f59d00aa010 2023-10-24T00:44:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.497+0000 7f59ce7fc700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 0x7f59bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.497+0000 7f59ce7fc700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 0x7f59bc061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f59d0158e00 tx=0x7f59c4009040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.501+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f59c004cf80 con 0x7f59d00aa010 2023-10-24T00:44:19.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.666+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59d006c6b0 con 0x7f59d00aa010 2023-10-24T00:44:19.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.667+0000 7f59b6ffd700 1 -- 172.21.15.148:0/2043645525 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f59c0020070 con 0x7f59d00aa010 2023-10-24T00:44:19.669 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:19.669 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:19.342985+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:19.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.669+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 msgr2=0x7f59bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.669+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 0x7f59bc061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f59d0158e00 tx=0x7f59c4009040).stop 2023-10-24T00:44:19.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.669+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 msgr2=0x7f59d0151e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.669+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f59c0009eb0 tx=0x7f59c0017000).stop 2023-10-24T00:44:19.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 shutdown_connections 2023-10-24T00:44:19.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00c6710 0x7f59d0157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f59bc05f270 0x7f59bc061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d00aa010 0x7f59d0151e80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 --2- 172.21.15.148:0/2043645525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f59d00aa3f0 0x7f59d0146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 >> 172.21.15.148:0/2043645525 conn(0x7f59d00caf40 msgr2=0x7f59d0152b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 shutdown_connections 2023-10-24T00:44:19.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.670+0000 7f59d586f700 1 -- 172.21.15.148:0/2043645525 wait complete. 2023-10-24T00:44:19.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.796+0000 7f7346b04700 1 Processor -- start 2023-10-24T00:44:19.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.796+0000 7f7346b04700 1 -- start start 2023-10-24T00:44:19.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346b04700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73400aa140 0x7f73400c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346b04700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400c6410 con 0x7f73400c0ef0 2023-10-24T00:44:19.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346b04700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400ca6e0 con 0x7f73400ca110 2023-10-24T00:44:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346b04700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73400ca9c0 con 0x7f73400aa140 2023-10-24T00:44:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346303700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f73400c0ef0 0x7f73400c68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38648/0 (socket says 172.21.15.148:38648) 2023-10-24T00:44:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7346303700 1 -- 172.21.15.148:0/3678441002 learned_addr learned my addr 172.21.15.148:0/3678441002 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7345b02700 1 --2- 172.21.15.148:0/3678441002 >> v2:172.21.15.150:3300/0 conn(0x7f73400aa140 0x7f73400c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366161121 0 0) 0x7f73400c6410 con 0x7f73400c0ef0 2023-10-24T00:44:19.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f732c0033f0 con 0x7f73400c0ef0 2023-10-24T00:44:19.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969402720 0 0) 0x7f732c0033f0 con 0x7f73400c0ef0 2023-10-24T00:44:19.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 >> v2:172.21.15.150:3300/0 conn(0x7f73400aa140 msgr2=0x7f73400c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:19.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 --2- 172.21.15.148:0/3678441002 >> v2:172.21.15.150:3300/0 conn(0x7f73400aa140 0x7f73400c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 >> v1:172.21.15.150:6789/0 conn(0x7f73400ca110 legacy=0x7f73400c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.797+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400c60a0 con 0x7f73400c0ef0 2023-10-24T00:44:19.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f733c0017f0 con 0x7f73400c0ef0 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 >> v1:172.21.15.148:6789/0 conn(0x7f73400c0ef0 legacy=0x7f73400c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c0038e0 0x7f732c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f732c004690 0x7f732c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 0x7f732c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400ca9c0 con 0x7f732c005000 2023-10-24T00:44:19.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c00bf60 con 0x7f732c0038e0 2023-10-24T00:44:19.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c00c0f0 con 0x7f732c004690 2023-10-24T00:44:19.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 0x7f732c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7345b02700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c0038e0 0x7f732c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7345301700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f732c004690 0x7f732c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 -- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f732c004690 msgr2=0x7f732c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:19.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f732c004690 0x7f732c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 -- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c0038e0 msgr2=0x7f732c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:19.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c0038e0 0x7f732c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 -- 172.21.15.148:0/3678441002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0033f0 con 0x7f732c005000 2023-10-24T00:44:19.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 -- 172.21.15.148:0/3678441002 reap_dead start 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7346303700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 0x7f732c00b8e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f733c00c480 tx=0x7f733c00c790).ready entity=mon.0 client_cookie=b7724e618529560b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c002030 con 0x7f732c005000 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00ce20 con 0x7f732c005000 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.798+0000 7f7344b00700 1 -- 172.21.15.148:0/3678441002 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c005d30 con 0x7f732c005000 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 -- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 msgr2=0x7f732c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 0x7f732c00b8e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f733c00c480 tx=0x7f733c00c790).stop 2023-10-24T00:44:19.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 -- 172.21.15.148:0/3678441002 shutdown_connections 2023-10-24T00:44:19.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 --2- 172.21.15.148:0/3678441002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c005000 0x7f732c00b8e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 -- 172.21.15.148:0/3678441002 >> 172.21.15.148:0/3678441002 conn(0x7f73400944a0 msgr2=0x7f734006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 -- 172.21.15.148:0/3678441002 shutdown_connections 2023-10-24T00:44:19.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.799+0000 7f7346b04700 1 -- 172.21.15.148:0/3678441002 wait complete. 2023-10-24T00:44:19.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.800+0000 7f7346b04700 1 Processor -- start 2023-10-24T00:44:19.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.800+0000 7f7346b04700 1 -- start start 2023-10-24T00:44:19.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c005000 0x7f73400addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73401521b0 0x7f73400631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400aa930 con 0x7f73400ae2a0 2023-10-24T00:44:19.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400ae770 con 0x7f732c005000 2023-10-24T00:44:19.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400aea50 con 0x7f73401521b0 2023-10-24T00:44:19.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57416/0 (socket says 172.21.15.148:57416) 2023-10-24T00:44:19.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 -- 172.21.15.148:0/4108471988 learned_addr learned my addr 172.21.15.148:0/4108471988 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:19.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345b02700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c005000 0x7f73400addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346303700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73401521b0 0x7f73400631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 -- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73401521b0 msgr2=0x7f73400631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73401521b0 0x7f73400631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 -- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c005000 msgr2=0x7f73400addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c005000 0x7f73400addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 -- 172.21.15.148:0/4108471988 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400aed30 con 0x7f73400ae2a0 2023-10-24T00:44:19.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7345301700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7330007cc0 tx=0x7f7330007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011590 con 0x7f73400ae2a0 2023-10-24T00:44:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73300116f0 con 0x7f73400ae2a0 2023-10-24T00:44:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73400aa5c0 con 0x7f73400ae2a0 2023-10-24T00:44:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.801+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330011a90 con 0x7f73400ae2a0 2023-10-24T00:44:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.802+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400636a0 con 0x7f73400ae2a0 2023-10-24T00:44:19.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.803+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7340047480 con 0x7f73400ae2a0 2023-10-24T00:44:19.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.803+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f733001d3b0 con 0x7f73400ae2a0 2023-10-24T00:44:19.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.803+0000 7f7335ffb700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 0x7f7324061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:19.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.803+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f733007a030 con 0x7f73400ae2a0 2023-10-24T00:44:19.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.804+0000 7f7345b02700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 0x7f7324061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:19.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.804+0000 7f7345b02700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 0x7f7324061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7338006d50 tx=0x7f7338008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:19.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.807+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f733004b1d0 con 0x7f73400ae2a0 2023-10-24T00:44:19.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.968+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73400c5d50 con 0x7f73400ae2a0 2023-10-24T00:44:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.969+0000 7f7335ffb700 1 -- 172.21.15.148:0/4108471988 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f733004e7f0 con 0x7f73400ae2a0 2023-10-24T00:44:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:19.972 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:19.342985+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 msgr2=0x7f7324061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 0x7f7324061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7338006d50 tx=0x7f7338008040).stop 2023-10-24T00:44:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 msgr2=0x7f7340151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7330007cc0 tx=0x7f7330007bb0).stop 2023-10-24T00:44:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 shutdown_connections 2023-10-24T00:44:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73401521b0 0x7f73400631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f732c005000 0x7f73400addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f732405f270 0x7f7324061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 --2- 172.21.15.148:0/4108471988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73400ae2a0 0x7f7340151cc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 >> 172.21.15.148:0/4108471988 conn(0x7f73400944a0 msgr2=0x7f7340152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 shutdown_connections 2023-10-24T00:44:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:19.971+0000 7f7346b04700 1 -- 172.21.15.148:0/4108471988 wait complete. 2023-10-24T00:44:19.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:44:20.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.101+0000 7fa98ff33700 1 Processor -- start 2023-10-24T00:44:20.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.101+0000 7fa98ff33700 1 -- start start 2023-10-24T00:44:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98ff33700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa988154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98ff33700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880c71d0 con 0x7fa988154430 2023-10-24T00:44:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98ff33700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880c9410 con 0x7fa988098bd0 2023-10-24T00:44:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98ff33700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c6a10 con 0x7fa9880c06e0 2023-10-24T00:44:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98dccf700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa988154430 0x7fa9880c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38656/0 (socket says 172.21.15.148:38656) 2023-10-24T00:44:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98dccf700 1 -- 172.21.15.148:0/3130153195 learned_addr learned my addr 172.21.15.148:0/3130153195 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98e4d0700 1 --2- 172.21.15.148:0/3130153195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa988154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943679361 0 0) 0x7fa9880c71d0 con 0x7fa988154430 2023-10-24T00:44:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9740033f0 con 0x7fa988154430 2023-10-24T00:44:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022797010 0 0) 0x7fa9880c9410 con 0x7fa988098bd0 2023-10-24T00:44:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.102+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9880c71d0 con 0x7fa988098bd0 2023-10-24T00:44:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586699851 0 0) 0x7fa9740033f0 con 0x7fa988154430 2023-10-24T00:44:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98e4d0700 1 -- 172.21.15.148:0/3130153195 >> v1:172.21.15.150:6789/0 conn(0x7fa988098bd0 legacy=0x7fa9880bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98e4d0700 1 -- 172.21.15.148:0/3130153195 >> v1:172.21.15.148:6789/0 conn(0x7fa988154430 legacy=0x7fa9880c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98e4d0700 1 -- 172.21.15.148:0/3130153195 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880ca8b0 con 0x7fa9880c06e0 2023-10-24T00:44:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98e4d0700 1 --2- 172.21.15.148:0/3130153195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa988154810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa980009e90 tx=0x7fa980009780).ready entity=mon.2 client_cookie=141c5d3653e62b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98000e070 con 0x7fa9880c06e0 2023-10-24T00:44:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98000b7a0 con 0x7fa9880c06e0 2023-10-24T00:44:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98cccd700 1 -- 172.21.15.148:0/3130153195 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984001470 con 0x7fa9880c06e0 2023-10-24T00:44:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98ff33700 1 -- 172.21.15.148:0/3130153195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 msgr2=0x7fa988154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98ff33700 1 --2- 172.21.15.148:0/3130153195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa988154810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa980009e90 tx=0x7fa980009780).stop 2023-10-24T00:44:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98ff33700 1 -- 172.21.15.148:0/3130153195 shutdown_connections 2023-10-24T00:44:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98ff33700 1 --2- 172.21.15.148:0/3130153195 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa988154810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.103+0000 7fa98ff33700 1 -- 172.21.15.148:0/3130153195 >> 172.21.15.148:0/3130153195 conn(0x7fa9880cb070 msgr2=0x7fa9880cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.104+0000 7fa98ff33700 1 -- 172.21.15.148:0/3130153195 shutdown_connections 2023-10-24T00:44:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.104+0000 7fa98ff33700 1 -- 172.21.15.148:0/3130153195 wait complete. 2023-10-24T00:44:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 Processor -- start 2023-10-24T00:44:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 -- start start 2023-10-24T00:44:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa988098bd0 0x7fa988165320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa9880ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988149640 con 0x7fa988154430 2023-10-24T00:44:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880aec10 con 0x7fa988098bd0 2023-10-24T00:44:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98ff33700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880affe0 con 0x7fa9880c06e0 2023-10-24T00:44:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98e4d0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98e4d0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57424/0 (socket says 172.21.15.148:57424) 2023-10-24T00:44:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.105+0000 7fa98e4d0700 1 -- 172.21.15.148:0/1968334186 learned_addr learned my addr 172.21.15.148:0/1968334186 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98dccf700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa988098bd0 0x7fa988165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98d4ce700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa9880ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 -- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 msgr2=0x7fa9880ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa9880ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 -- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa988098bd0 msgr2=0x7fa988165320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa988098bd0 0x7fa988165320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 -- 172.21.15.148:0/1968334186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009a20 con 0x7fa988154430 2023-10-24T00:44:20.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98e4d0700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fa9880c5910 tx=0x7fa9880caa40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98001d440 con 0x7fa988154430 2023-10-24T00:44:20.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98001d5a0 con 0x7fa988154430 2023-10-24T00:44:20.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9880af0a0 con 0x7fa988154430 2023-10-24T00:44:20.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98001d940 con 0x7fa988154430 2023-10-24T00:44:20.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.106+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9880ae2e0 con 0x7fa988154430 2023-10-24T00:44:20.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.107+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98806c6b0 con 0x7fa988154430 2023-10-24T00:44:20.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.108+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa98001dcf0 con 0x7fa988154430 2023-10-24T00:44:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.108+0000 7fa97dffb700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 0x7fa96c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.108+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa98007c450 con 0x7fa988154430 2023-10-24T00:44:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.109+0000 7fa98dccf700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 0x7fa96c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.109+0000 7fa98dccf700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 0x7fa96c061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa984000fb0 tx=0x7fa984001620).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.112+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa98004d4e0 con 0x7fa988154430 2023-10-24T00:44:20.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.318+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa988062c40 con 0x7fa988154430 2023-10-24T00:44:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.355+0000 7fa97dffb700 1 -- 172.21.15.148:0/1968334186 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa980050b00 con 0x7fa988154430 2023-10-24T00:44:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 msgr2=0x7fa96c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 0x7fa96c061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa984000fb0 tx=0x7fa984001620).stop 2023-10-24T00:44:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 msgr2=0x7fa9880afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fa9880c5910 tx=0x7fa9880caa40).stop 2023-10-24T00:44:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 shutdown_connections 2023-10-24T00:44:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa96c05f270 0x7fa96c061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988154430 0x7fa9880afaf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa988098bd0 0x7fa988165320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 --2- 172.21.15.148:0/1968334186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9880c06e0 0x7fa9880ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 >> 172.21.15.148:0/1968334186 conn(0x7fa9880cb070 msgr2=0x7fa9880c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:20.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 shutdown_connections 2023-10-24T00:44:20.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.357+0000 7fa98ff33700 1 -- 172.21.15.148:0/1968334186 wait complete. 2023-10-24T00:44:20.370 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:44:20.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:44:20.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.486+0000 7fccf2097700 1 Processor -- start 2023-10-24T00:44:20.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.486+0000 7fccf2097700 1 -- start start 2023-10-24T00:44:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fccf2097700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccec154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fccf2097700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0c71d0 con 0x7fccec098bd0 2023-10-24T00:44:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fccf2097700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0c9410 con 0x7fccec0bffd0 2023-10-24T00:44:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fccf2097700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c6a10 con 0x7fccec154430 2023-10-24T00:44:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fcceaffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fccec098bd0 0x7fccec0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38658/0 (socket says 172.21.15.148:38658) 2023-10-24T00:44:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.487+0000 7fcceaffd700 1 -- 172.21.15.148:0/16261729 learned_addr learned my addr 172.21.15.148:0/16261729 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccec154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064782786 0 0) 0x7fccec0c71d0 con 0x7fccec098bd0 2023-10-24T00:44:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd40033f0 con 0x7fccec098bd0 2023-10-24T00:44:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232267664 0 0) 0x7fccec0c9410 con 0x7fccec0bffd0 2023-10-24T00:44:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccec0c71d0 con 0x7fccec0bffd0 2023-10-24T00:44:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040859708 0 0) 0x7fccd40033f0 con 0x7fccec098bd0 2023-10-24T00:44:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 msgr2=0x7fccec154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccec154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 >> v1:172.21.15.150:6789/0 conn(0x7fccec0bffd0 legacy=0x7fccec15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0ca8b0 con 0x7fccec098bd0 2023-10-24T00:44:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fcce0001470 con 0x7fccec098bd0 2023-10-24T00:44:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccec154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 >> v1:172.21.15.148:6789/0 conn(0x7fccec098bd0 legacy=0x7fccec0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd4003aa0 0x7fccd4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd4004690 0x7fccd4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccd4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c6a10 con 0x7fccd4004690 2023-10-24T00:44:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd400b8e0 con 0x7fccd4003aa0 2023-10-24T00:44:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd400ba70 con 0x7fccec154430 2023-10-24T00:44:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd4004690 0x7fccd4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd4003aa0 0x7fccd4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fccebfff700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccd4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 -- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 msgr2=0x7fccd4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccec154430 0x7fccd4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 -- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd4003aa0 msgr2=0x7fccd4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccd4003aa0 0x7fccd4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.488+0000 7fcceaffd700 1 -- 172.21.15.148:0/16261729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009a20 con 0x7fccd4004690 2023-10-24T00:44:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fcceaffd700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd4004690 0x7fccd4004b10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fcce000c0e0 tx=0x7fccec0caa40).ready entity=mon.0 client_cookie=c91f9d37d09a3755 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00079b0 con 0x7fccd4004690 2023-10-24T00:44:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000ca10 con 0x7fccd4004690 2023-10-24T00:44:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccea7fc700 1 -- 172.21.15.148:0/16261729 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000cdb0 con 0x7fccd4004690 2023-10-24T00:44:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 -- 172.21.15.148:0/16261729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd4004690 msgr2=0x7fccd4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 --2- 172.21.15.148:0/16261729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccd4004690 0x7fccd4004b10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fcce000c0e0 tx=0x7fccec0caa40).stop 2023-10-24T00:44:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccebfff700 1 -- 172.21.15.148:0/16261729 reap_dead start 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 -- 172.21.15.148:0/16261729 shutdown_connections 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 -- 172.21.15.148:0/16261729 >> 172.21.15.148:0/16261729 conn(0x7fccec0cb070 msgr2=0x7fccec0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 -- 172.21.15.148:0/16261729 shutdown_connections 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.489+0000 7fccf2097700 1 -- 172.21.15.148:0/16261729 wait complete. 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 Processor -- start 2023-10-24T00:44:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 -- start start 2023-10-24T00:44:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4004690 0x7fccec0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccec0ad010 0x7fccec151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec150070 con 0x7fccec1502d0 2023-10-24T00:44:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0adc40 con 0x7fccec0ad010 2023-10-24T00:44:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fccf2097700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0c2890 con 0x7fccd4004690 2023-10-24T00:44:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fcceaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fcceaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57440/0 (socket says 172.21.15.148:57440) 2023-10-24T00:44:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.491+0000 7fcceaffd700 1 -- 172.21.15.148:0/338495241 learned_addr learned my addr 172.21.15.148:0/338495241 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccebfff700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccec0ad010 0x7fccec151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4004690 0x7fccec0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 -- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4004690 msgr2=0x7fccec0c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4004690 0x7fccec0c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 -- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccec0ad010 msgr2=0x7fccec151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccec0ad010 0x7fccec151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 -- 172.21.15.148:0/338495241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0ad960 con 0x7fccec1502d0 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fcceaffd700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fcce0001cf0 tx=0x7fcce0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00074f0 con 0x7fccec1502d0 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0007650 con 0x7fccec1502d0 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0c2240 con 0x7fccec1502d0 2023-10-24T00:44:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00048e0 con 0x7fccec1502d0 2023-10-24T00:44:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.492+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0ad490 con 0x7fccec1502d0 2023-10-24T00:44:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.493+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec0c26e0 con 0x7fccec1502d0 2023-10-24T00:44:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.493+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcce0004c50 con 0x7fccec1502d0 2023-10-24T00:44:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.494+0000 7fccd37fe700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 0x7fccd8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.494+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcce0019020 con 0x7fccec1502d0 2023-10-24T00:44:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.494+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 0x7fccd8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.494+0000 7fcceb7fe700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 0x7fccd8061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fccec0a9050 tx=0x7fccdc00b040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.498+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcce004c5e0 con 0x7fccec1502d0 2023-10-24T00:44:20.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:20.705+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fccec06c6b0 con 0x7fccec1502d0 2023-10-24T00:44:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.356+0000 7fccd37fe700 1 -- 172.21.15.148:0/338495241 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcce004fc00 con 0x7fccec1502d0 2023-10-24T00:44:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 msgr2=0x7fccd8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 0x7fccd8061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fccec0a9050 tx=0x7fccdc00b040).stop 2023-10-24T00:44:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 msgr2=0x7fccec14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fcce0001cf0 tx=0x7fcce0015000).stop 2023-10-24T00:44:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 shutdown_connections 2023-10-24T00:44:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccec0ad010 0x7fccec151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccd4004690 0x7fccec0c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccd805f270 0x7fccd8061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 --2- 172.21.15.148:0/338495241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccec1502d0 0x7fccec14fb80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 >> 172.21.15.148:0/338495241 conn(0x7fccec0cb070 msgr2=0x7fccec153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 shutdown_connections 2023-10-24T00:44:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.358+0000 7fccf2097700 1 -- 172.21.15.148:0/338495241 wait complete. 2023-10-24T00:44:21.372 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:44:21.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:21.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.485+0000 7fecf22c5700 1 Processor -- start 2023-10-24T00:44:21.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.485+0000 7fecf22c5700 1 -- start start 2023-10-24T00:44:21.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf22c5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf22c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf22c5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec0a6a50 con 0x7fecec0c86c0 2023-10-24T00:44:21.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf22c5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0bf350 con 0x7fecec0c7d20 2023-10-24T00:44:21.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf22c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0a8750 con 0x7fecec0a6550 2023-10-24T00:44:21.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7feceb7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54552/0 (socket says 172.21.15.148:54552) 2023-10-24T00:44:21.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7feceb7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:41326/0 (socket says 172.21.15.148:41326) 2023-10-24T00:44:21.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 -- 172.21.15.148:0/3356007340 learned_addr learned my addr 172.21.15.148:0/3356007340 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:21.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecebfff700 1 --1- 172.21.15.148:0/3356007340 >> v1:172.21.15.150:6789/0 conn(0x7fecec0c86c0 0x7fecec0bec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:58998/0 (socket says 172.21.15.148:58998) 2023-10-24T00:44:21.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 -- 172.21.15.148:0/3356007340 >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 msgr2=0x7fecec0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:21.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 --2- 172.21.15.148:0/3356007340 >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 -- 172.21.15.148:0/3356007340 >> v1:172.21.15.150:6789/0 conn(0x7fecec0c86c0 legacy=0x7fecec0bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7fecf0862700 1 -- 172.21.15.148:0/3356007340 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0a6d30 con 0x7fecec0a6550 2023-10-24T00:44:21.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7feceaffd700 1 -- 172.21.15.148:0/3356007340 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458405654 0 0) 0x7fecec0a6a50 con 0x7fecec0c86c0 2023-10-24T00:44:21.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.486+0000 7feceb7fe700 1 --2- 172.21.15.148:0/3356007340 >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:21.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf0862700 1 --2- 172.21.15.148:0/3356007340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fece4009f20 tx=0x7fece4009840).ready entity=mon.2 client_cookie=cce2b92ebe4fb597 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7feceaffd700 1 -- 172.21.15.148:0/3356007340 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400e070 con 0x7fecec0a6550 2023-10-24T00:44:21.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7feceaffd700 1 -- 172.21.15.148:0/3356007340 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece400b9d0 con 0x7fecec0a6550 2023-10-24T00:44:21.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7feceaffd700 1 -- 172.21.15.148:0/3356007340 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece400bd50 con 0x7fecec0a6550 2023-10-24T00:44:21.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 -- 172.21.15.148:0/3356007340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 msgr2=0x7fecec0a8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 --2- 172.21.15.148:0/3356007340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fece4009f20 tx=0x7fece4009840).stop 2023-10-24T00:44:21.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 -- 172.21.15.148:0/3356007340 shutdown_connections 2023-10-24T00:44:21.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 --2- 172.21.15.148:0/3356007340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0a6550 0x7fecec0a8260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 --2- 172.21.15.148:0/3356007340 >> v2:172.21.15.150:3300/0 conn(0x7fecec0c7d20 0x7fecec0a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 -- 172.21.15.148:0/3356007340 >> 172.21.15.148:0/3356007340 conn(0x7fecec092480 msgr2=0x7fecec062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:21.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 -- 172.21.15.148:0/3356007340 shutdown_connections 2023-10-24T00:44:21.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.487+0000 7fecf22c5700 1 -- 172.21.15.148:0/3356007340 wait complete. 2023-10-24T00:44:21.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.488+0000 7fecf22c5700 1 Processor -- start 2023-10-24T00:44:21.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 -- start start 2023-10-24T00:44:21.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0c7d20 0x7fecec064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecec0c86c0 0x7fecec0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec065560 con 0x7fecec0a6550 2023-10-24T00:44:21.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec158040 con 0x7fecec0c86c0 2023-10-24T00:44:21.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecf22c5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec064620 con 0x7fecec0c7d20 2023-10-24T00:44:21.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.489+0000 7fecebfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57448/0 (socket says 172.21.15.148:57448) 2023-10-24T00:44:21.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 -- 172.21.15.148:0/301419030 learned_addr learned my addr 172.21.15.148:0/301419030 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:21.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7feceb7fe700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0c7d20 0x7fecec064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecf0862700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecec0c86c0 0x7fecec0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 -- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0c7d20 msgr2=0x7fecec064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0c7d20 0x7fecec064130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 -- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecec0c86c0 msgr2=0x7fecec0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecec0c86c0 0x7fecec0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 -- 172.21.15.148:0/301419030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00092a0 con 0x7fecec0a6550 2023-10-24T00:44:21.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecebfff700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fecdc00c4c0 tx=0x7fecdc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00ce30 con 0x7fecec0a6550 2023-10-24T00:44:21.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc0072e0 con 0x7fecec0a6550 2023-10-24T00:44:21.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4009ae0 con 0x7fecec0a6550 2023-10-24T00:44:21.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc005730 con 0x7fecec0a6550 2023-10-24T00:44:21.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.490+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec064ea0 con 0x7fecec0a6550 2023-10-24T00:44:21.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.491+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec06a0a0 con 0x7fecec0a6550 2023-10-24T00:44:21.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.491+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fecdc005b60 con 0x7fecec0a6550 2023-10-24T00:44:21.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.492+0000 7fecd3fff700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 0x7fecd8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.492+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fecdc079ba0 con 0x7fecec0a6550 2023-10-24T00:44:21.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.492+0000 7feceb7fe700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 0x7fecd8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.492+0000 7feceb7fe700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 0x7fecd8061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fecec0af000 tx=0x7fece0009060).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.496+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fecdc04ac30 con 0x7fecec0a6550 2023-10-24T00:44:21.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.699+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecec06c6b0 con 0x7fecec0a6550 2023-10-24T00:44:21.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.699+0000 7fecd3fff700 1 -- 172.21.15.148:0/301419030 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fecdc04e250 con 0x7fecec0a6550 2023-10-24T00:44:21.701 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:21.701 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 msgr2=0x7fecd8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 0x7fecd8061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fecec0af000 tx=0x7fece0009060).stop 2023-10-24T00:44:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 msgr2=0x7fecec157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fecdc00c4c0 tx=0x7fecdc007c10).stop 2023-10-24T00:44:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 shutdown_connections 2023-10-24T00:44:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecec0c86c0 0x7fecec0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fecd805f240 0x7fecd8061700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fecec0a6550 0x7fecec157b50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 --2- 172.21.15.148:0/301419030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fecec0c7d20 0x7fecec064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 >> 172.21.15.148:0/301419030 conn(0x7fecec092480 msgr2=0x7fecec0c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 shutdown_connections 2023-10-24T00:44:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.701+0000 7fecf22c5700 1 -- 172.21.15.148:0/301419030 wait complete. 2023-10-24T00:44:21.705 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:21.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:21.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.827+0000 7fa3aa3ab700 1 Processor -- start 2023-10-24T00:44:21.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.827+0000 7fa3aa3ab700 1 -- start start 2023-10-24T00:44:21.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3a40aa140 0x7fa3a40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 0x7fa3a4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40c6410 con 0x7fa3a40aa140 2023-10-24T00:44:21.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40c1140 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3aa3ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40ca6e0 con 0x7fa3a40ca110 2023-10-24T00:44:21.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3a40aa140 0x7fa3a40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa3a40aa140 0x7fa3a40c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57456/0 (socket says 172.21.15.148:57456) 2023-10-24T00:44:21.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 -- 172.21.15.148:0/1315711624 learned_addr learned my addr 172.21.15.148:0/1315711624 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:21.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a8ba8700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a9baa700 1 --2- 172.21.15.148:0/1315711624 >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 0x7fa3a4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 -- 172.21.15.148:0/1315711624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 msgr2=0x7fa3a40c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:21.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 -- 172.21.15.148:0/1315711624 >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 msgr2=0x7fa3a4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:21.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/1315711624 >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 0x7fa3a4157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a93a9700 1 -- 172.21.15.148:0/1315711624 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40ca9c0 con 0x7fa3a40aa140 2023-10-24T00:44:21.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.828+0000 7fa3a9baa700 1 --2- 172.21.15.148:0/1315711624 >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 0x7fa3a4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:21.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40aa140 0x7fa3a40c9c20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fa3a40845d0 tx=0x7fa394009840).ready entity=mon.0 client_cookie=d0fa2ec96e460998 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3a3fff700 1 -- 172.21.15.148:0/1315711624 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400e070 con 0x7fa3a40aa140 2023-10-24T00:44:21.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3a3fff700 1 -- 172.21.15.148:0/1315711624 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400ba50 con 0x7fa3a40aa140 2023-10-24T00:44:21.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3a3fff700 1 -- 172.21.15.148:0/1315711624 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400bdd0 con 0x7fa3a40aa140 2023-10-24T00:44:21.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/1315711624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40aa140 msgr2=0x7fa3a40c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40aa140 0x7fa3a40c9c20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fa3a40845d0 tx=0x7fa394009840).stop 2023-10-24T00:44:21.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/1315711624 shutdown_connections 2023-10-24T00:44:21.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40aa140 0x7fa3a40c9c20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/1315711624 >> v2:172.21.15.150:3300/0 conn(0x7fa3a40c0cd0 0x7fa3a4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/1315711624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/1315711624 >> 172.21.15.148:0/1315711624 conn(0x7fa3a40944a0 msgr2=0x7fa3a406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:21.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/1315711624 shutdown_connections 2023-10-24T00:44:21.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.829+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/1315711624 wait complete. 2023-10-24T00:44:21.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.830+0000 7fa3aa3ab700 1 Processor -- start 2023-10-24T00:44:21.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.830+0000 7fa3aa3ab700 1 -- start start 2023-10-24T00:44:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a40aa140 0x7fa3a4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40aeea0 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4164a10 con 0x7fa3a40aa140 2023-10-24T00:44:21.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3aa3ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a4164cf0 con 0x7fa3a40ca110 2023-10-24T00:44:21.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3a8ba8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3a8ba8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57466/0 (socket says 172.21.15.148:57466) 2023-10-24T00:44:21.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.831+0000 7fa3a8ba8700 1 -- 172.21.15.148:0/26236226 learned_addr learned my addr 172.21.15.148:0/26236226 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:21.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a40aa140 0x7fa3a4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a9baa700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 -- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 msgr2=0x7fa3a40ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 -- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a40aa140 msgr2=0x7fa3a4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a40aa140 0x7fa3a4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 -- 172.21.15.148:0/26236226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009ae0 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a8ba8700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fa39800d860 tx=0x7fa398008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011590 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980116f0 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a4164fd0 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011a70 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.832+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40ac820 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.833+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a41654f0 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.833+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa39801c460 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.834+0000 7fa3a17fa700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 0x7fa390061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.834+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa39807a030 con 0x7fa3a40c0cd0 2023-10-24T00:44:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.834+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 0x7fa390061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.834+0000 7fa3a93a9700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 0x7fa390061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa3a4153f40 tx=0x7fa394009840).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:21.838+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa3a41654f0 con 0x7fa3a40c0cd0 2023-10-24T00:44:22.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.001+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3a41654f0 con 0x7fa3a40c0cd0 2023-10-24T00:44:22.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.002+0000 7fa3a17fa700 1 -- 172.21.15.148:0/26236226 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16978 (secure 0 0 0) 0x7fa3a41654f0 con 0x7fa3a40c0cd0 2023-10-24T00:44:22.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:22.004 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":81,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:20.344562+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:22.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 msgr2=0x7fa390061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 0x7fa390061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa3a4153f40 tx=0x7fa394009840).stop 2023-10-24T00:44:22.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 msgr2=0x7fa3a40986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fa39800d860 tx=0x7fa398008040).stop 2023-10-24T00:44:22.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 shutdown_connections 2023-10-24T00:44:22.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3a40ca110 0x7fa3a40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3a40aa140 0x7fa3a4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa39005f270 0x7fa390061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 --2- 172.21.15.148:0/26236226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3a40c0cd0 0x7fa3a40986d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 >> 172.21.15.148:0/26236226 conn(0x7fa3a40944a0 msgr2=0x7fa3a4151860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 shutdown_connections 2023-10-24T00:44:22.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.004+0000 7fa3aa3ab700 1 -- 172.21.15.148:0/26236226 wait complete. 2023-10-24T00:44:22.017 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:44:22.018 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:22.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.130+0000 7f6a1ffff700 1 Processor -- start 2023-10-24T00:44:22.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.130+0000 7f6a1ffff700 1 -- start start 2023-10-24T00:44:22.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a200aa140 0x7f6a200c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1ffff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200c6410 con 0x7f6a200c0ef0 2023-10-24T00:44:22.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1ffff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200ca6e0 con 0x7f6a200ca110 2023-10-24T00:44:22.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1ffff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200ca9c0 con 0x7f6a200aa140 2023-10-24T00:44:22.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a200aa140 0x7f6a200c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a200aa140 0x7f6a200c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57478/0 (socket says 172.21.15.148:57478) 2023-10-24T00:44:22.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a200c0ef0 0x7f6a200c68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38668/0 (socket says 172.21.15.148:38668) 2023-10-24T00:44:22.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 -- 172.21.15.148:0/4105897287 learned_addr learned my addr 172.21.15.148:0/4105897287 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:22.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 -- 172.21.15.148:0/4105897287 >> v1:172.21.15.150:6789/0 conn(0x7f6a200ca110 legacy=0x7f6a200c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:22.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 -- 172.21.15.148:0/4105897287 >> v1:172.21.15.148:6789/0 conn(0x7f6a200c0ef0 legacy=0x7f6a200c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 -- 172.21.15.148:0/4105897287 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200c60a0 con 0x7f6a200aa140 2023-10-24T00:44:22.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.131+0000 7f6a1effd700 1 --2- 172.21.15.148:0/4105897287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200aa140 0x7f6a200c9c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f6a10006fd0 tx=0x7f6a100090f0).ready entity=mon.0 client_cookie=df9a9bc04067fcff server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1e7fc700 1 -- 172.21.15.148:0/4105897287 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000b600 con 0x7f6a200aa140 2023-10-24T00:44:22.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1e7fc700 1 -- 172.21.15.148:0/4105897287 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000b760 con 0x7f6a200aa140 2023-10-24T00:44:22.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1e7fc700 1 -- 172.21.15.148:0/4105897287 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000bae0 con 0x7f6a200aa140 2023-10-24T00:44:22.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 -- 172.21.15.148:0/4105897287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200aa140 msgr2=0x7f6a200c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/4105897287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200aa140 0x7f6a200c9c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f6a10006fd0 tx=0x7f6a100090f0).stop 2023-10-24T00:44:22.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 -- 172.21.15.148:0/4105897287 shutdown_connections 2023-10-24T00:44:22.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/4105897287 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200aa140 0x7f6a200c9c20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 -- 172.21.15.148:0/4105897287 >> 172.21.15.148:0/4105897287 conn(0x7f6a200944a0 msgr2=0x7f6a2006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 -- 172.21.15.148:0/4105897287 shutdown_connections 2023-10-24T00:44:22.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.132+0000 7f6a1ffff700 1 -- 172.21.15.148:0/4105897287 wait complete. 2023-10-24T00:44:22.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.133+0000 7f6a1ffff700 1 Processor -- start 2023-10-24T00:44:22.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.133+0000 7f6a1ffff700 1 -- start start 2023-10-24T00:44:22.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 0x7f6a200abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a200c0ef0 0x7f6a200c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20169030 con 0x7f6a200ca110 2023-10-24T00:44:22.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c3620 con 0x7f6a200c0ef0 2023-10-24T00:44:22.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1ffff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201446a0 con 0x7f6a200aa140 2023-10-24T00:44:22.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57494/0 (socket says 172.21.15.148:57494) 2023-10-24T00:44:22.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.134+0000 7f6a1f7fe700 1 -- 172.21.15.148:0/903932832 learned_addr learned my addr 172.21.15.148:0/903932832 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:22.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1effd700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 0x7f6a200abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 -- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 msgr2=0x7f6a200abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a167fc700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a200c0ef0 0x7f6a200c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 0x7f6a200abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 -- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a200c0ef0 msgr2=0x7f6a200c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a200c0ef0 0x7f6a200c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 -- 172.21.15.148:0/903932832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10009370 con 0x7f6a200ca110 2023-10-24T00:44:22.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1effd700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 0x7f6a200abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:22.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1f7fe700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f6a1800c790 tx=0x7f6a180015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18005c70 con 0x7f6a200ca110 2023-10-24T00:44:22.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18005dd0 con 0x7f6a200ca110 2023-10-24T00:44:22.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200c2a10 con 0x7f6a200ca110 2023-10-24T00:44:22.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18007320 con 0x7f6a200ca110 2023-10-24T00:44:22.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.135+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a200c2fd0 con 0x7f6a200ca110 2023-10-24T00:44:22.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.136+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a200c3790 con 0x7f6a200ca110 2023-10-24T00:44:22.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.136+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6a18007690 con 0x7f6a200ca110 2023-10-24T00:44:22.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.137+0000 7f6a177fe700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 0x7f6a00061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.137+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a1807a3c0 con 0x7f6a200ca110 2023-10-24T00:44:22.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.137+0000 7f6a1effd700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 0x7f6a00061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.137+0000 7f6a1effd700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 0x7f6a00061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6a1000b3c0 tx=0x7f6a10017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.141+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a1804b510 con 0x7f6a200ca110 2023-10-24T00:44:22.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.301+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a20047480 con 0x7f6a0005f270 2023-10-24T00:44:22.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.312+0000 7f6a177fe700 1 -- 172.21.15.148:0/903932832 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358636 (secure 0 0 0) 0x7f6a20047480 con 0x7f6a0005f270 2023-10-24T00:44:22.317 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:22.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 msgr2=0x7f6a00061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 0x7f6a00061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6a1000b3c0 tx=0x7f6a10017000).stop 2023-10-24T00:44:22.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 msgr2=0x7f6a200c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f6a1800c790 tx=0x7f6a180015e0).stop 2023-10-24T00:44:22.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 shutdown_connections 2023-10-24T00:44:22.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a0005f270 0x7f6a00061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a200ca110 0x7f6a200c2390 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a200aa140 0x7f6a200abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 --2- 172.21.15.148:0/903932832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a200c0ef0 0x7f6a200c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 >> 172.21.15.148:0/903932832 conn(0x7f6a200944a0 msgr2=0x7f6a200a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 shutdown_connections 2023-10-24T00:44:22.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.315+0000 7f6a1ffff700 1 -- 172.21.15.148:0/903932832 wait complete. 2023-10-24T00:44:22.323 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:22.328 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:22.189603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2412780,"kb_used_data":7340,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752561940,"statfs":{"total":773094113280,"available":770623426560,"internally_reserved":0,"allocated":7516160,"data_stored":3721687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.639894"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983042+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995327+0000","last_change":"2023-10-24T00:44:18.995327+0000","last_active":"2023-10-24T00:44:18.995327+0000","last_peered":"2023-10-24T00:44:18.995327+0000","last_clean":"2023-10-24T00:44:18.995327+0000","last_became_active":"2023-10-24T00:44:18.995010+0000","last_became_peered":"2023-10-24T00:44:18.995010+0000","last_unstale":"2023-10-24T00:44:18.995327+0000","last_undegraded":"2023-10-24T00:44:18.995327+0000","last_fullsized":"2023-10-24T00:44:18.995327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982818+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992361+0000","last_change":"2023-10-24T00:44:18.992361+0000","last_active":"2023-10-24T00:44:18.992361+0000","last_peered":"2023-10-24T00:44:18.992361+0000","last_clean":"2023-10-24T00:44:18.992361+0000","last_became_active":"2023-10-24T00:44:18.991850+0000","last_became_peered":"2023-10-24T00:44:18.991850+0000","last_unstale":"2023-10-24T00:44:18.992361+0000","last_undegraded":"2023-10-24T00:44:18.992361+0000","last_fullsized":"2023-10-24T00:44:18.992361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979781+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001836+0000","last_change":"2023-10-24T00:44:19.001836+0000","last_active":"2023-10-24T00:44:19.001836+0000","last_peered":"2023-10-24T00:44:19.001836+0000","last_clean":"2023-10-24T00:44:19.001836+0000","last_became_active":"2023-10-24T00:44:19.001581+0000","last_became_peered":"2023-10-24T00:44:19.001581+0000","last_unstale":"2023-10-24T00:44:19.001836+0000","last_undegraded":"2023-10-24T00:44:19.001836+0000","last_fullsized":"2023-10-24T00:44:19.001836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981364+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001842+0000","last_change":"2023-10-24T00:44:19.001842+0000","last_active":"2023-10-24T00:44:19.001842+0000","last_peered":"2023-10-24T00:44:19.001842+0000","last_clean":"2023-10-24T00:44:19.001842+0000","last_became_active":"2023-10-24T00:44:19.001587+0000","last_became_peered":"2023-10-24T00:44:19.001587+0000","last_unstale":"2023-10-24T00:44:19.001842+0000","last_undegraded":"2023-10-24T00:44:19.001842+0000","last_fullsized":"2023-10-24T00:44:19.001842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985085+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998242+0000","last_change":"2023-10-24T00:44:18.998242+0000","last_active":"2023-10-24T00:44:18.998242+0000","last_peered":"2023-10-24T00:44:18.998242+0000","last_clean":"2023-10-24T00:44:18.998242+0000","last_became_active":"2023-10-24T00:44:18.997861+0000","last_became_peered":"2023-10-24T00:44:18.997861+0000","last_unstale":"2023-10-24T00:44:18.998242+0000","last_undegraded":"2023-10-24T00:44:18.998242+0000","last_fullsized":"2023-10-24T00:44:18.998242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979743+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987699+0000","last_change":"2023-10-24T00:44:18.987699+0000","last_active":"2023-10-24T00:44:18.987699+0000","last_peered":"2023-10-24T00:44:18.987699+0000","last_clean":"2023-10-24T00:44:18.987699+0000","last_became_active":"2023-10-24T00:44:18.987428+0000","last_became_peered":"2023-10-24T00:44:18.987428+0000","last_unstale":"2023-10-24T00:44:18.987699+0000","last_undegraded":"2023-10-24T00:44:18.987699+0000","last_fullsized":"2023-10-24T00:44:18.987699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983671+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996982+0000","last_change":"2023-10-24T00:44:18.996982+0000","last_active":"2023-10-24T00:44:18.996982+0000","last_peered":"2023-10-24T00:44:18.996982+0000","last_clean":"2023-10-24T00:44:18.996982+0000","last_became_active":"2023-10-24T00:44:18.996744+0000","last_became_peered":"2023-10-24T00:44:18.996744+0000","last_unstale":"2023-10-24T00:44:18.996982+0000","last_undegraded":"2023-10-24T00:44:18.996982+0000","last_fullsized":"2023-10-24T00:44:18.996982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988617+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993846+0000","last_change":"2023-10-24T00:44:18.993846+0000","last_active":"2023-10-24T00:44:18.993846+0000","last_peered":"2023-10-24T00:44:18.993846+0000","last_clean":"2023-10-24T00:44:18.993846+0000","last_became_active":"2023-10-24T00:44:18.993586+0000","last_became_peered":"2023-10-24T00:44:18.993586+0000","last_unstale":"2023-10-24T00:44:18.993846+0000","last_undegraded":"2023-10-24T00:44:18.993846+0000","last_fullsized":"2023-10-24T00:44:18.993846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993276+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991340+0000","last_change":"2023-10-24T00:44:18.991340+0000","last_active":"2023-10-24T00:44:18.991340+0000","last_peered":"2023-10-24T00:44:18.991340+0000","last_clean":"2023-10-24T00:44:18.991340+0000","last_became_active":"2023-10-24T00:44:18.991062+0000","last_became_peered":"2023-10-24T00:44:18.991062+0000","last_unstale":"2023-10-24T00:44:18.991340+0000","last_undegraded":"2023-10-24T00:44:18.991340+0000","last_fullsized":"2023-10-24T00:44:18.991340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983961+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001116+0000","last_change":"2023-10-24T00:44:19.001116+0000","last_active":"2023-10-24T00:44:19.001116+0000","last_peered":"2023-10-24T00:44:19.001116+0000","last_clean":"2023-10-24T00:44:19.001116+0000","last_became_active":"2023-10-24T00:44:19.000863+0000","last_became_peered":"2023-10-24T00:44:19.000863+0000","last_unstale":"2023-10-24T00:44:19.001116+0000","last_undegraded":"2023-10-24T00:44:19.001116+0000","last_fullsized":"2023-10-24T00:44:19.001116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983845+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994598+0000","last_change":"2023-10-24T00:44:18.994598+0000","last_active":"2023-10-24T00:44:18.994598+0000","last_peered":"2023-10-24T00:44:18.994598+0000","last_clean":"2023-10-24T00:44:18.994598+0000","last_became_active":"2023-10-24T00:44:18.994336+0000","last_became_peered":"2023-10-24T00:44:18.994336+0000","last_unstale":"2023-10-24T00:44:18.994598+0000","last_undegraded":"2023-10-24T00:44:18.994598+0000","last_fullsized":"2023-10-24T00:44:18.994598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984665+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999007+0000","last_change":"2023-10-24T00:44:18.999007+0000","last_active":"2023-10-24T00:44:18.999007+0000","last_peered":"2023-10-24T00:44:18.999007+0000","last_clean":"2023-10-24T00:44:18.999007+0000","last_became_active":"2023-10-24T00:44:18.998780+0000","last_became_peered":"2023-10-24T00:44:18.998780+0000","last_unstale":"2023-10-24T00:44:18.999007+0000","last_undegraded":"2023-10-24T00:44:18.999007+0000","last_fullsized":"2023-10-24T00:44:18.999007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979461+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002466+0000","last_change":"2023-10-24T00:44:19.002466+0000","last_active":"2023-10-24T00:44:19.002466+0000","last_peered":"2023-10-24T00:44:19.002466+0000","last_clean":"2023-10-24T00:44:19.002466+0000","last_became_active":"2023-10-24T00:44:19.002207+0000","last_became_peered":"2023-10-24T00:44:19.002207+0000","last_unstale":"2023-10-24T00:44:19.002466+0000","last_undegraded":"2023-10-24T00:44:19.002466+0000","last_fullsized":"2023-10-24T00:44:19.002466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982544+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.986943+0000","last_change":"2023-10-24T00:44:18.986943+0000","last_active":"2023-10-24T00:44:18.986943+0000","last_peered":"2023-10-24T00:44:18.986943+0000","last_clean":"2023-10-24T00:44:18.986943+0000","last_became_active":"2023-10-24T00:44:18.986663+0000","last_became_peered":"2023-10-24T00:44:18.986663+0000","last_unstale":"2023-10-24T00:44:18.986943+0000","last_undegraded":"2023-10-24T00:44:18.986943+0000","last_fullsized":"2023-10-24T00:44:18.986943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983294+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.988568+0000","last_change":"2023-10-24T00:44:18.988568+0000","last_active":"2023-10-24T00:44:18.988568+0000","last_peered":"2023-10-24T00:44:18.988568+0000","last_clean":"2023-10-24T00:44:18.988568+0000","last_became_active":"2023-10-24T00:44:18.988285+0000","last_became_peered":"2023-10-24T00:44:18.988285+0000","last_unstale":"2023-10-24T00:44:18.988568+0000","last_undegraded":"2023-10-24T00:44:18.988568+0000","last_fullsized":"2023-10-24T00:44:18.988568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990408+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001732+0000","last_change":"2023-10-24T00:44:19.001732+0000","last_active":"2023-10-24T00:44:19.001732+0000","last_peered":"2023-10-24T00:44:19.001732+0000","last_clean":"2023-10-24T00:44:19.001732+0000","last_became_active":"2023-10-24T00:44:19.001421+0000","last_became_peered":"2023-10-24T00:44:19.001421+0000","last_unstale":"2023-10-24T00:44:19.001732+0000","last_undegraded":"2023-10-24T00:44:19.001732+0000","last_fullsized":"2023-10-24T00:44:19.001732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986105+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002313+0000","last_change":"2023-10-24T00:44:19.002313+0000","last_active":"2023-10-24T00:44:19.002313+0000","last_peered":"2023-10-24T00:44:19.002313+0000","last_clean":"2023-10-24T00:44:19.002313+0000","last_became_active":"2023-10-24T00:44:19.002038+0000","last_became_peered":"2023-10-24T00:44:19.002038+0000","last_unstale":"2023-10-24T00:44:19.002313+0000","last_undegraded":"2023-10-24T00:44:19.002313+0000","last_fullsized":"2023-10-24T00:44:19.002313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990466+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998777+0000","last_change":"2023-10-24T00:44:18.998777+0000","last_active":"2023-10-24T00:44:18.998777+0000","last_peered":"2023-10-24T00:44:18.998777+0000","last_clean":"2023-10-24T00:44:18.998777+0000","last_became_active":"2023-10-24T00:44:18.998456+0000","last_became_peered":"2023-10-24T00:44:18.998456+0000","last_unstale":"2023-10-24T00:44:18.998777+0000","last_undegraded":"2023-10-24T00:44:18.998777+0000","last_fullsized":"2023-10-24T00:44:18.998777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982731+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995473+0000","last_change":"2023-10-24T00:44:18.995473+0000","last_active":"2023-10-24T00:44:18.995473+0000","last_peered":"2023-10-24T00:44:18.995473+0000","last_clean":"2023-10-24T00:44:18.995473+0000","last_became_active":"2023-10-24T00:44:18.995177+0000","last_became_peered":"2023-10-24T00:44:18.995177+0000","last_unstale":"2023-10-24T00:44:18.995473+0000","last_undegraded":"2023-10-24T00:44:18.995473+0000","last_fullsized":"2023-10-24T00:44:18.995473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979191+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994564+0000","last_change":"2023-10-24T00:44:18.994564+0000","last_active":"2023-10-24T00:44:18.994564+0000","last_peered":"2023-10-24T00:44:18.994564+0000","last_clean":"2023-10-24T00:44:18.994564+0000","last_became_active":"2023-10-24T00:44:18.994259+0000","last_became_peered":"2023-10-24T00:44:18.994259+0000","last_unstale":"2023-10-24T00:44:18.994564+0000","last_undegraded":"2023-10-24T00:44:18.994564+0000","last_fullsized":"2023-10-24T00:44:18.994564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983432+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000062+0000","last_change":"2023-10-24T00:44:19.000062+0000","last_active":"2023-10-24T00:44:19.000062+0000","last_peered":"2023-10-24T00:44:19.000062+0000","last_clean":"2023-10-24T00:44:19.000062+0000","last_became_active":"2023-10-24T00:44:18.999667+0000","last_became_peered":"2023-10-24T00:44:18.999667+0000","last_unstale":"2023-10-24T00:44:19.000062+0000","last_undegraded":"2023-10-24T00:44:19.000062+0000","last_fullsized":"2023-10-24T00:44:19.000062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985584+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995307+0000","last_change":"2023-10-24T00:44:18.995307+0000","last_active":"2023-10-24T00:44:18.995307+0000","last_peered":"2023-10-24T00:44:18.995307+0000","last_clean":"2023-10-24T00:44:18.995307+0000","last_became_active":"2023-10-24T00:44:18.994003+0000","last_became_peered":"2023-10-24T00:44:18.994003+0000","last_unstale":"2023-10-24T00:44:18.995307+0000","last_undegraded":"2023-10-24T00:44:18.995307+0000","last_fullsized":"2023-10-24T00:44:18.995307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986045+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996786+0000","last_change":"2023-10-24T00:44:18.996786+0000","last_active":"2023-10-24T00:44:18.996786+0000","last_peered":"2023-10-24T00:44:18.996786+0000","last_clean":"2023-10-24T00:44:18.996786+0000","last_became_active":"2023-10-24T00:44:18.996212+0000","last_became_peered":"2023-10-24T00:44:18.996212+0000","last_unstale":"2023-10-24T00:44:18.996786+0000","last_undegraded":"2023-10-24T00:44:18.996786+0000","last_fullsized":"2023-10-24T00:44:18.996786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003506+0000","last_change":"2023-10-24T00:44:19.003506+0000","last_active":"2023-10-24T00:44:19.003506+0000","last_peered":"2023-10-24T00:44:19.003506+0000","last_clean":"2023-10-24T00:44:19.003506+0000","last_became_active":"2023-10-24T00:44:19.003226+0000","last_became_peered":"2023-10-24T00:44:19.003226+0000","last_unstale":"2023-10-24T00:44:19.003506+0000","last_undegraded":"2023-10-24T00:44:19.003506+0000","last_fullsized":"2023-10-24T00:44:19.003506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979990+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987366+0000","last_change":"2023-10-24T00:44:18.987366+0000","last_active":"2023-10-24T00:44:18.987366+0000","last_peered":"2023-10-24T00:44:18.987366+0000","last_clean":"2023-10-24T00:44:18.987366+0000","last_became_active":"2023-10-24T00:44:18.987107+0000","last_became_peered":"2023-10-24T00:44:18.987107+0000","last_unstale":"2023-10-24T00:44:18.987366+0000","last_undegraded":"2023-10-24T00:44:18.987366+0000","last_fullsized":"2023-10-24T00:44:18.987366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981346+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997611+0000","last_change":"2023-10-24T00:44:18.997611+0000","last_active":"2023-10-24T00:44:18.997611+0000","last_peered":"2023-10-24T00:44:18.997611+0000","last_clean":"2023-10-24T00:44:18.997611+0000","last_became_active":"2023-10-24T00:44:18.997316+0000","last_became_peered":"2023-10-24T00:44:18.997316+0000","last_unstale":"2023-10-24T00:44:18.997611+0000","last_undegraded":"2023-10-24T00:44:18.997611+0000","last_fullsized":"2023-10-24T00:44:18.997611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998858+0000","last_change":"2023-10-24T00:44:18.998858+0000","last_active":"2023-10-24T00:44:18.998858+0000","last_peered":"2023-10-24T00:44:18.998858+0000","last_clean":"2023-10-24T00:44:18.998858+0000","last_became_active":"2023-10-24T00:44:18.998489+0000","last_became_peered":"2023-10-24T00:44:18.998489+0000","last_unstale":"2023-10-24T00:44:18.998858+0000","last_undegraded":"2023-10-24T00:44:18.998858+0000","last_fullsized":"2023-10-24T00:44:18.998858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985113+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997086+0000","last_change":"2023-10-24T00:44:18.997086+0000","last_active":"2023-10-24T00:44:18.997086+0000","last_peered":"2023-10-24T00:44:18.997086+0000","last_clean":"2023-10-24T00:44:18.997086+0000","last_became_active":"2023-10-24T00:44:18.996790+0000","last_became_peered":"2023-10-24T00:44:18.996790+0000","last_unstale":"2023-10-24T00:44:18.997086+0000","last_undegraded":"2023-10-24T00:44:18.997086+0000","last_fullsized":"2023-10-24T00:44:18.997086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984952+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996828+0000","last_change":"2023-10-24T00:44:18.996828+0000","last_active":"2023-10-24T00:44:18.996828+0000","last_peered":"2023-10-24T00:44:18.996828+0000","last_clean":"2023-10-24T00:44:18.996828+0000","last_became_active":"2023-10-24T00:44:18.996571+0000","last_became_peered":"2023-10-24T00:44:18.996571+0000","last_unstale":"2023-10-24T00:44:18.996828+0000","last_undegraded":"2023-10-24T00:44:18.996828+0000","last_fullsized":"2023-10-24T00:44:18.996828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982112+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998001+0000","last_change":"2023-10-24T00:44:18.998001+0000","last_active":"2023-10-24T00:44:18.998001+0000","last_peered":"2023-10-24T00:44:18.998001+0000","last_clean":"2023-10-24T00:44:18.998001+0000","last_became_active":"2023-10-24T00:44:18.997726+0000","last_became_peered":"2023-10-24T00:44:18.997726+0000","last_unstale":"2023-10-24T00:44:18.998001+0000","last_undegraded":"2023-10-24T00:44:18.998001+0000","last_fullsized":"2023-10-24T00:44:18.998001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.992639+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987755+0000","last_change":"2023-10-24T00:44:18.987755+0000","last_active":"2023-10-24T00:44:18.987755+0000","last_peered":"2023-10-24T00:44:18.987755+0000","last_clean":"2023-10-24T00:44:18.987755+0000","last_became_active":"2023-10-24T00:44:18.987473+0000","last_became_peered":"2023-10-24T00:44:18.987473+0000","last_unstale":"2023-10-24T00:44:18.987755+0000","last_undegraded":"2023-10-24T00:44:18.987755+0000","last_fullsized":"2023-10-24T00:44:18.987755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982631+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997838+0000","last_change":"2023-10-24T00:44:18.997838+0000","last_active":"2023-10-24T00:44:18.997838+0000","last_peered":"2023-10-24T00:44:18.997838+0000","last_clean":"2023-10-24T00:44:18.997838+0000","last_became_active":"2023-10-24T00:44:18.997228+0000","last_became_peered":"2023-10-24T00:44:18.997228+0000","last_unstale":"2023-10-24T00:44:18.997838+0000","last_undegraded":"2023-10-24T00:44:18.997838+0000","last_fullsized":"2023-10-24T00:44:18.997838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986832+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002540+0000","last_change":"2023-10-24T00:44:19.002540+0000","last_active":"2023-10-24T00:44:19.002540+0000","last_peered":"2023-10-24T00:44:19.002540+0000","last_clean":"2023-10-24T00:44:19.002540+0000","last_became_active":"2023-10-24T00:44:19.002270+0000","last_became_peered":"2023-10-24T00:44:19.002270+0000","last_unstale":"2023-10-24T00:44:19.002540+0000","last_undegraded":"2023-10-24T00:44:19.002540+0000","last_fullsized":"2023-10-24T00:44:19.002540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980802+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000438+0000","last_change":"2023-10-24T00:44:19.000438+0000","last_active":"2023-10-24T00:44:19.000438+0000","last_peered":"2023-10-24T00:44:19.000438+0000","last_clean":"2023-10-24T00:44:19.000438+0000","last_became_active":"2023-10-24T00:44:18.999186+0000","last_became_peered":"2023-10-24T00:44:18.999186+0000","last_unstale":"2023-10-24T00:44:19.000438+0000","last_undegraded":"2023-10-24T00:44:19.000438+0000","last_fullsized":"2023-10-24T00:44:19.000438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984082+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998792+0000","last_change":"2023-10-24T00:44:18.998792+0000","last_active":"2023-10-24T00:44:18.998792+0000","last_peered":"2023-10-24T00:44:18.998792+0000","last_clean":"2023-10-24T00:44:18.998792+0000","last_became_active":"2023-10-24T00:44:18.998121+0000","last_became_peered":"2023-10-24T00:44:18.998121+0000","last_unstale":"2023-10-24T00:44:18.998792+0000","last_undegraded":"2023-10-24T00:44:18.998792+0000","last_fullsized":"2023-10-24T00:44:18.998792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984232+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993303+0000","last_change":"2023-10-24T00:44:18.993303+0000","last_active":"2023-10-24T00:44:18.993303+0000","last_peered":"2023-10-24T00:44:18.993303+0000","last_clean":"2023-10-24T00:44:18.993303+0000","last_became_active":"2023-10-24T00:44:18.993034+0000","last_became_peered":"2023-10-24T00:44:18.993034+0000","last_unstale":"2023-10-24T00:44:18.993303+0000","last_undegraded":"2023-10-24T00:44:18.993303+0000","last_fullsized":"2023-10-24T00:44:18.993303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978535+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994424+0000","last_change":"2023-10-24T00:44:18.994424+0000","last_active":"2023-10-24T00:44:18.994424+0000","last_peered":"2023-10-24T00:44:18.994424+0000","last_clean":"2023-10-24T00:44:18.994424+0000","last_became_active":"2023-10-24T00:44:18.994144+0000","last_became_peered":"2023-10-24T00:44:18.994144+0000","last_unstale":"2023-10-24T00:44:18.994424+0000","last_undegraded":"2023-10-24T00:44:18.994424+0000","last_fullsized":"2023-10-24T00:44:18.994424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979288+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994274+0000","last_change":"2023-10-24T00:44:18.994274+0000","last_active":"2023-10-24T00:44:18.994274+0000","last_peered":"2023-10-24T00:44:18.994274+0000","last_clean":"2023-10-24T00:44:18.994274+0000","last_became_active":"2023-10-24T00:44:18.993980+0000","last_became_peered":"2023-10-24T00:44:18.993980+0000","last_unstale":"2023-10-24T00:44:18.994274+0000","last_undegraded":"2023-10-24T00:44:18.994274+0000","last_fullsized":"2023-10-24T00:44:18.994274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993269+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996096+0000","last_change":"2023-10-24T00:44:18.996096+0000","last_active":"2023-10-24T00:44:18.996096+0000","last_peered":"2023-10-24T00:44:18.996096+0000","last_clean":"2023-10-24T00:44:18.996096+0000","last_became_active":"2023-10-24T00:44:18.995720+0000","last_became_peered":"2023-10-24T00:44:18.995720+0000","last_unstale":"2023-10-24T00:44:18.996096+0000","last_undegraded":"2023-10-24T00:44:18.996096+0000","last_fullsized":"2023-10-24T00:44:18.996096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985632+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999502+0000","last_change":"2023-10-24T00:44:18.999502+0000","last_active":"2023-10-24T00:44:18.999502+0000","last_peered":"2023-10-24T00:44:18.999502+0000","last_clean":"2023-10-24T00:44:18.999502+0000","last_became_active":"2023-10-24T00:44:18.999191+0000","last_became_peered":"2023-10-24T00:44:18.999191+0000","last_unstale":"2023-10-24T00:44:18.999502+0000","last_undegraded":"2023-10-24T00:44:18.999502+0000","last_fullsized":"2023-10-24T00:44:18.999502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979612+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005035+0000","last_change":"2023-10-24T00:44:19.005035+0000","last_active":"2023-10-24T00:44:19.005035+0000","last_peered":"2023-10-24T00:44:19.005035+0000","last_clean":"2023-10-24T00:44:19.005035+0000","last_became_active":"2023-10-24T00:44:19.004782+0000","last_became_peered":"2023-10-24T00:44:19.004782+0000","last_unstale":"2023-10-24T00:44:19.005035+0000","last_undegraded":"2023-10-24T00:44:19.005035+0000","last_fullsized":"2023-10-24T00:44:19.005035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993054+0000","last_change":"2023-10-24T00:44:18.993054+0000","last_active":"2023-10-24T00:44:18.993054+0000","last_peered":"2023-10-24T00:44:18.993054+0000","last_clean":"2023-10-24T00:44:18.993054+0000","last_became_active":"2023-10-24T00:44:18.992750+0000","last_became_peered":"2023-10-24T00:44:18.992750+0000","last_unstale":"2023-10-24T00:44:18.993054+0000","last_undegraded":"2023-10-24T00:44:18.993054+0000","last_fullsized":"2023-10-24T00:44:18.993054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988183+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003478+0000","last_change":"2023-10-24T00:44:19.003478+0000","last_active":"2023-10-24T00:44:19.003478+0000","last_peered":"2023-10-24T00:44:19.003478+0000","last_clean":"2023-10-24T00:44:19.003478+0000","last_became_active":"2023-10-24T00:44:19.003192+0000","last_became_peered":"2023-10-24T00:44:19.003192+0000","last_unstale":"2023-10-24T00:44:19.003478+0000","last_undegraded":"2023-10-24T00:44:19.003478+0000","last_fullsized":"2023-10-24T00:44:19.003478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983783+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991279+0000","last_change":"2023-10-24T00:44:18.991279+0000","last_active":"2023-10-24T00:44:18.991279+0000","last_peered":"2023-10-24T00:44:18.991279+0000","last_clean":"2023-10-24T00:44:18.991279+0000","last_became_active":"2023-10-24T00:44:18.990733+0000","last_became_peered":"2023-10-24T00:44:18.990733+0000","last_unstale":"2023-10-24T00:44:18.991279+0000","last_undegraded":"2023-10-24T00:44:18.991279+0000","last_fullsized":"2023-10-24T00:44:18.991279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999146+0000","last_change":"2023-10-24T00:44:18.999146+0000","last_active":"2023-10-24T00:44:18.999146+0000","last_peered":"2023-10-24T00:44:18.999146+0000","last_clean":"2023-10-24T00:44:18.999146+0000","last_became_active":"2023-10-24T00:44:18.998413+0000","last_became_peered":"2023-10-24T00:44:18.998413+0000","last_unstale":"2023-10-24T00:44:18.999146+0000","last_undegraded":"2023-10-24T00:44:18.999146+0000","last_fullsized":"2023-10-24T00:44:18.999146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985680+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003962+0000","last_change":"2023-10-24T00:44:19.003962+0000","last_active":"2023-10-24T00:44:19.003962+0000","last_peered":"2023-10-24T00:44:19.003962+0000","last_clean":"2023-10-24T00:44:19.003962+0000","last_became_active":"2023-10-24T00:44:19.003238+0000","last_became_peered":"2023-10-24T00:44:19.003238+0000","last_unstale":"2023-10-24T00:44:19.003962+0000","last_undegraded":"2023-10-24T00:44:19.003962+0000","last_fullsized":"2023-10-24T00:44:19.003962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987897+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996949+0000","last_change":"2023-10-24T00:44:18.996949+0000","last_active":"2023-10-24T00:44:18.996949+0000","last_peered":"2023-10-24T00:44:18.996949+0000","last_clean":"2023-10-24T00:44:18.996949+0000","last_became_active":"2023-10-24T00:44:18.996508+0000","last_became_peered":"2023-10-24T00:44:18.996508+0000","last_unstale":"2023-10-24T00:44:18.996949+0000","last_undegraded":"2023-10-24T00:44:18.996949+0000","last_fullsized":"2023-10-24T00:44:18.996949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978371+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997143+0000","last_change":"2023-10-24T00:44:18.997143+0000","last_active":"2023-10-24T00:44:18.997143+0000","last_peered":"2023-10-24T00:44:18.997143+0000","last_clean":"2023-10-24T00:44:18.997143+0000","last_became_active":"2023-10-24T00:44:18.996829+0000","last_became_peered":"2023-10-24T00:44:18.996829+0000","last_unstale":"2023-10-24T00:44:18.997143+0000","last_undegraded":"2023-10-24T00:44:18.997143+0000","last_fullsized":"2023-10-24T00:44:18.997143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983812+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999768+0000","last_change":"2023-10-24T00:44:18.999768+0000","last_active":"2023-10-24T00:44:18.999768+0000","last_peered":"2023-10-24T00:44:18.999768+0000","last_clean":"2023-10-24T00:44:18.999768+0000","last_became_active":"2023-10-24T00:44:18.999468+0000","last_became_peered":"2023-10-24T00:44:18.999468+0000","last_unstale":"2023-10-24T00:44:18.999768+0000","last_undegraded":"2023-10-24T00:44:18.999768+0000","last_fullsized":"2023-10-24T00:44:18.999768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980255+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996209+0000","last_change":"2023-10-24T00:44:18.996209+0000","last_active":"2023-10-24T00:44:18.996209+0000","last_peered":"2023-10-24T00:44:18.996209+0000","last_clean":"2023-10-24T00:44:18.996209+0000","last_became_active":"2023-10-24T00:44:18.995918+0000","last_became_peered":"2023-10-24T00:44:18.995918+0000","last_unstale":"2023-10-24T00:44:18.996209+0000","last_undegraded":"2023-10-24T00:44:18.996209+0000","last_fullsized":"2023-10-24T00:44:18.996209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988664+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998681+0000","last_change":"2023-10-24T00:44:18.998681+0000","last_active":"2023-10-24T00:44:18.998681+0000","last_peered":"2023-10-24T00:44:18.998681+0000","last_clean":"2023-10-24T00:44:18.998681+0000","last_became_active":"2023-10-24T00:44:18.997838+0000","last_became_peered":"2023-10-24T00:44:18.997838+0000","last_unstale":"2023-10-24T00:44:18.998681+0000","last_undegraded":"2023-10-24T00:44:18.998681+0000","last_fullsized":"2023-10-24T00:44:18.998681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991597+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.990704+0000","last_change":"2023-10-24T00:44:18.990704+0000","last_active":"2023-10-24T00:44:18.990704+0000","last_peered":"2023-10-24T00:44:18.990704+0000","last_clean":"2023-10-24T00:44:18.990704+0000","last_became_active":"2023-10-24T00:44:18.990361+0000","last_became_peered":"2023-10-24T00:44:18.990361+0000","last_unstale":"2023-10-24T00:44:18.990704+0000","last_undegraded":"2023-10-24T00:44:18.990704+0000","last_fullsized":"2023-10-24T00:44:18.990704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990323+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999336+0000","last_change":"2023-10-24T00:44:18.999336+0000","last_active":"2023-10-24T00:44:18.999336+0000","last_peered":"2023-10-24T00:44:18.999336+0000","last_clean":"2023-10-24T00:44:18.999336+0000","last_became_active":"2023-10-24T00:44:18.998739+0000","last_became_peered":"2023-10-24T00:44:18.998739+0000","last_unstale":"2023-10-24T00:44:18.999336+0000","last_undegraded":"2023-10-24T00:44:18.999336+0000","last_fullsized":"2023-10-24T00:44:18.999336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981493+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987757+0000","last_change":"2023-10-24T00:44:18.987757+0000","last_active":"2023-10-24T00:44:18.987757+0000","last_peered":"2023-10-24T00:44:18.987757+0000","last_clean":"2023-10-24T00:44:18.987757+0000","last_became_active":"2023-10-24T00:44:18.987454+0000","last_became_peered":"2023-10-24T00:44:18.987454+0000","last_unstale":"2023-10-24T00:44:18.987757+0000","last_undegraded":"2023-10-24T00:44:18.987757+0000","last_fullsized":"2023-10-24T00:44:18.987757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978024+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995961+0000","last_change":"2023-10-24T00:44:18.995961+0000","last_active":"2023-10-24T00:44:18.995961+0000","last_peered":"2023-10-24T00:44:18.995961+0000","last_clean":"2023-10-24T00:44:18.995961+0000","last_became_active":"2023-10-24T00:44:18.995687+0000","last_became_peered":"2023-10-24T00:44:18.995687+0000","last_unstale":"2023-10-24T00:44:18.995961+0000","last_undegraded":"2023-10-24T00:44:18.995961+0000","last_fullsized":"2023-10-24T00:44:18.995961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978946+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999552+0000","last_change":"2023-10-24T00:44:18.999552+0000","last_active":"2023-10-24T00:44:18.999552+0000","last_peered":"2023-10-24T00:44:18.999552+0000","last_clean":"2023-10-24T00:44:18.999552+0000","last_became_active":"2023-10-24T00:44:18.999258+0000","last_became_peered":"2023-10-24T00:44:18.999258+0000","last_unstale":"2023-10-24T00:44:18.999552+0000","last_undegraded":"2023-10-24T00:44:18.999552+0000","last_fullsized":"2023-10-24T00:44:18.999552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983055+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995213+0000","last_change":"2023-10-24T00:44:18.995213+0000","last_active":"2023-10-24T00:44:18.995213+0000","last_peered":"2023-10-24T00:44:18.995213+0000","last_clean":"2023-10-24T00:44:18.995213+0000","last_became_active":"2023-10-24T00:44:18.994931+0000","last_became_peered":"2023-10-24T00:44:18.994931+0000","last_unstale":"2023-10-24T00:44:18.995213+0000","last_undegraded":"2023-10-24T00:44:18.995213+0000","last_fullsized":"2023-10-24T00:44:18.995213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975423+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:17.975423+0000","last_peered":"2023-10-24T00:44:17.975423+0000","last_clean":"2023-10-24T00:44:17.975423+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:17.975423+0000","last_undegraded":"2023-10-24T00:44:17.975423+0000","last_fullsized":"2023-10-24T00:44:17.975423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986924+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999384+0000","last_change":"2023-10-24T00:44:18.999384+0000","last_active":"2023-10-24T00:44:18.999384+0000","last_peered":"2023-10-24T00:44:18.999384+0000","last_clean":"2023-10-24T00:44:18.999384+0000","last_became_active":"2023-10-24T00:44:18.999120+0000","last_became_peered":"2023-10-24T00:44:18.999120+0000","last_unstale":"2023-10-24T00:44:18.999384+0000","last_undegraded":"2023-10-24T00:44:18.999384+0000","last_fullsized":"2023-10-24T00:44:18.999384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974142+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:17.974142+0000","last_peered":"2023-10-24T00:44:17.974142+0000","last_clean":"2023-10-24T00:44:17.974142+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:17.974142+0000","last_undegraded":"2023-10-24T00:44:17.974142+0000","last_fullsized":"2023-10-24T00:44:17.974142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988657+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000031+0000","last_change":"2023-10-24T00:44:19.000031+0000","last_active":"2023-10-24T00:44:19.000031+0000","last_peered":"2023-10-24T00:44:19.000031+0000","last_clean":"2023-10-24T00:44:19.000031+0000","last_became_active":"2023-10-24T00:44:18.999739+0000","last_became_peered":"2023-10-24T00:44:18.999739+0000","last_unstale":"2023-10-24T00:44:19.000031+0000","last_undegraded":"2023-10-24T00:44:19.000031+0000","last_fullsized":"2023-10-24T00:44:19.000031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.970712+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:17.970712+0000","last_peered":"2023-10-24T00:44:17.970712+0000","last_clean":"2023-10-24T00:44:17.970712+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:17.970712+0000","last_undegraded":"2023-10-24T00:44:17.970712+0000","last_fullsized":"2023-10-24T00:44:17.970712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988206+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995012+0000","last_change":"2023-10-24T00:44:18.995012+0000","last_active":"2023-10-24T00:44:18.995012+0000","last_peered":"2023-10-24T00:44:18.995012+0000","last_clean":"2023-10-24T00:44:18.995012+0000","last_became_active":"2023-10-24T00:44:18.994740+0000","last_became_peered":"2023-10-24T00:44:18.994740+0000","last_unstale":"2023-10-24T00:44:18.995012+0000","last_undegraded":"2023-10-24T00:44:18.995012+0000","last_fullsized":"2023-10-24T00:44:18.995012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974149+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:17.974149+0000","last_peered":"2023-10-24T00:44:17.974149+0000","last_clean":"2023-10-24T00:44:17.974149+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:17.974149+0000","last_undegraded":"2023-10-24T00:44:17.974149+0000","last_fullsized":"2023-10-24T00:44:17.974149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974688+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:17.974688+0000","last_peered":"2023-10-24T00:44:17.974688+0000","last_clean":"2023-10-24T00:44:17.974688+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:17.974688+0000","last_undegraded":"2023-10-24T00:44:17.974688+0000","last_fullsized":"2023-10-24T00:44:17.974688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982974+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997386+0000","last_change":"2023-10-24T00:44:18.997386+0000","last_active":"2023-10-24T00:44:18.997386+0000","last_peered":"2023-10-24T00:44:18.997386+0000","last_clean":"2023-10-24T00:44:18.997386+0000","last_became_active":"2023-10-24T00:44:18.997004+0000","last_became_peered":"2023-10-24T00:44:18.997004+0000","last_unstale":"2023-10-24T00:44:18.997386+0000","last_undegraded":"2023-10-24T00:44:18.997386+0000","last_fullsized":"2023-10-24T00:44:18.997386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974809+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:17.974809+0000","last_peered":"2023-10-24T00:44:17.974809+0000","last_clean":"2023-10-24T00:44:17.974809+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:17.974809+0000","last_undegraded":"2023-10-24T00:44:17.974809+0000","last_fullsized":"2023-10-24T00:44:17.974809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990044+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001810+0000","last_change":"2023-10-24T00:44:19.001810+0000","last_active":"2023-10-24T00:44:19.001810+0000","last_peered":"2023-10-24T00:44:19.001810+0000","last_clean":"2023-10-24T00:44:19.001810+0000","last_became_active":"2023-10-24T00:44:19.001524+0000","last_became_peered":"2023-10-24T00:44:19.001524+0000","last_unstale":"2023-10-24T00:44:19.001810+0000","last_undegraded":"2023-10-24T00:44:19.001810+0000","last_fullsized":"2023-10-24T00:44:19.001810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975087+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:17.975087+0000","last_peered":"2023-10-24T00:44:17.975087+0000","last_clean":"2023-10-24T00:44:17.975087+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:17.975087+0000","last_undegraded":"2023-10-24T00:44:17.975087+0000","last_fullsized":"2023-10-24T00:44:17.975087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982321+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005142+0000","last_change":"2023-10-24T00:44:19.005142+0000","last_active":"2023-10-24T00:44:19.005142+0000","last_peered":"2023-10-24T00:44:19.005142+0000","last_clean":"2023-10-24T00:44:19.005142+0000","last_became_active":"2023-10-24T00:44:19.004839+0000","last_became_peered":"2023-10-24T00:44:19.004839+0000","last_unstale":"2023-10-24T00:44:19.005142+0000","last_undegraded":"2023-10-24T00:44:19.005142+0000","last_fullsized":"2023-10-24T00:44:19.005142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975438+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:17.975438+0000","last_peered":"2023-10-24T00:44:17.975438+0000","last_clean":"2023-10-24T00:44:17.975438+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:17.975438+0000","last_undegraded":"2023-10-24T00:44:17.975438+0000","last_fullsized":"2023-10-24T00:44:17.975438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987260+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992422+0000","last_change":"2023-10-24T00:44:18.992422+0000","last_active":"2023-10-24T00:44:18.992422+0000","last_peered":"2023-10-24T00:44:18.992422+0000","last_clean":"2023-10-24T00:44:18.992422+0000","last_became_active":"2023-10-24T00:44:18.992112+0000","last_became_peered":"2023-10-24T00:44:18.992112+0000","last_unstale":"2023-10-24T00:44:18.992422+0000","last_undegraded":"2023-10-24T00:44:18.992422+0000","last_fullsized":"2023-10-24T00:44:18.992422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.976468+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:17.976468+0000","last_peered":"2023-10-24T00:44:17.976468+0000","last_clean":"2023-10-24T00:44:17.976468+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:17.976468+0000","last_undegraded":"2023-10-24T00:44:17.976468+0000","last_fullsized":"2023-10-24T00:44:17.976468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":471055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.65700000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.498,"5min":0.46700000000000003,"15min":0.32600000000000001},"max":{"1min":0.753,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.246,"15min":0.246},"max":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.40699999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56299999999999994,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":4.351,"15min":4.351},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.83299999999999996},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.495}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.48099999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.439}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.499},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.374}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.34300000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33800000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.376}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.433}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.5}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.59199999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.625}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:22.336 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.481+0000 7f88a7fd0700 1 Processor -- start 2023-10-24T00:44:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.481+0000 7f88a7fd0700 1 -- start start 2023-10-24T00:44:22.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a7fd0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a7fd0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88a00aa3f0 0x7f88a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a7fd0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a00c0960 con 0x7f88a00c6710 2023-10-24T00:44:22.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a7fd0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00aa8a0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a7fd0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00c0c40 con 0x7f88a00aa010 2023-10-24T00:44:22.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a656d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88a00aa3f0 0x7f88a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a5d6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a5d6c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54604/0 (socket says 172.21.15.148:54604) 2023-10-24T00:44:22.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a5d6c700 1 -- 172.21.15.148:0/2732992475 learned_addr learned my addr 172.21.15.148:0/2732992475 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:22.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a656d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88a00aa3f0 0x7f88a0069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:41366/0 (socket says 172.21.15.148:41366) 2023-10-24T00:44:22.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a556b700 1 --1- 172.21.15.148:0/2732992475 >> v1:172.21.15.150:6789/0 conn(0x7f88a00c6710 0x7f88a0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:59022/0 (socket says 172.21.15.148:59022) 2023-10-24T00:44:22.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.482+0000 7f88a656d700 1 -- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 msgr2=0x7f88a00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:22.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a656d700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a656d700 1 -- 172.21.15.148:0/2732992475 >> v1:172.21.15.150:6789/0 conn(0x7f88a00c6710 legacy=0x7f88a0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a4d6a700 1 -- 172.21.15.148:0/2732992475 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004896747 0 0) 0x7f88a00c0960 con 0x7f88a00c6710 2023-10-24T00:44:22.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a656d700 1 -- 172.21.15.148:0/2732992475 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00c0f20 con 0x7f88a00aa3f0 2023-10-24T00:44:22.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a5d6c700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:22.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a656d700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa3f0 0x7f88a0069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8898009e60 tx=0x7f8898009780).ready entity=mon.1 client_cookie=b7fb9fb7f17a1d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a4d6a700 1 -- 172.21.15.148:0/2732992475 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889800e070 con 0x7f88a00aa3f0 2023-10-24T00:44:22.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a4d6a700 1 -- 172.21.15.148:0/2732992475 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889800bb60 con 0x7f88a00aa3f0 2023-10-24T00:44:22.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a4d6a700 1 -- 172.21.15.148:0/2732992475 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898012410 con 0x7f88a00aa3f0 2023-10-24T00:44:22.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 -- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa3f0 msgr2=0x7f88a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa3f0 0x7f88a0069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8898009e60 tx=0x7f8898009780).stop 2023-10-24T00:44:22.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 -- 172.21.15.148:0/2732992475 shutdown_connections 2023-10-24T00:44:22.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa3f0 0x7f88a0069d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/2732992475 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00aa010 0x7f88a00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 -- 172.21.15.148:0/2732992475 >> 172.21.15.148:0/2732992475 conn(0x7f88a00caf40 msgr2=0x7f88a00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.483+0000 7f88a7fd0700 1 -- 172.21.15.148:0/2732992475 shutdown_connections 2023-10-24T00:44:22.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.484+0000 7f88a7fd0700 1 -- 172.21.15.148:0/2732992475 wait complete. 2023-10-24T00:44:22.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 Processor -- start 2023-10-24T00:44:22.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 -- start start 2023-10-24T00:44:22.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa010 0x7f88a0166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00c6710 0x7f88a00afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01681a0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0167870 con 0x7f88a00aa010 2023-10-24T00:44:22.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a7fd0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0167b50 con 0x7f88a00c6710 2023-10-24T00:44:22.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.485+0000 7f88a556b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57496/0 (socket says 172.21.15.148:57496) 2023-10-24T00:44:22.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 -- 172.21.15.148:0/729584032 learned_addr learned my addr 172.21.15.148:0/729584032 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:22.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a5d6c700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa010 0x7f88a0166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a656d700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00c6710 0x7f88a00afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 -- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00c6710 msgr2=0x7f88a00afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00c6710 0x7f88a00afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 -- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa010 msgr2=0x7f88a0166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa010 0x7f88a0166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 -- 172.21.15.148:0/729584032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009370 con 0x7f88a00aa3f0 2023-10-24T00:44:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a556b700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f889000c490 tx=0x7f8890007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900070d0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890007230 con 0x7f88a00aa3f0 2023-10-24T00:44:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8898009a20 con 0x7f88a00aa3f0 2023-10-24T00:44:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900056e0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.486+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a00b0190 con 0x7f88a00aa3f0 2023-10-24T00:44:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.487+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a006c6b0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.488+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8890005ca0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.488+0000 7f8895ffb700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 0x7f8884061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.488+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8890079ca0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.488+0000 7f88a5d6c700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 0x7f8884061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.489+0000 7f88a5d6c700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 0x7f8884061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f889c006fd0 tx=0x7f889c0090f0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.492+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f889004adf0 con 0x7f88a00aa3f0 2023-10-24T00:44:22.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.650+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88a0168530 con 0x7f888405f270 2023-10-24T00:44:22.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.660+0000 7f8895ffb700 1 -- 172.21.15.148:0/729584032 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358636 (secure 0 0 0) 0x7f88a0168530 con 0x7f888405f270 2023-10-24T00:44:22.666 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:22.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 msgr2=0x7f8884061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 0x7f8884061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f889c006fd0 tx=0x7f889c0090f0).stop 2023-10-24T00:44:22.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 msgr2=0x7f88a00c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f889000c490 tx=0x7f8890007e00).stop 2023-10-24T00:44:22.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 shutdown_connections 2023-10-24T00:44:22.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88a00c6710 0x7f88a00afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88a00aa010 0x7f88a0166fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f888405f270 0x7f8884061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 --2- 172.21.15.148:0/729584032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f88a00aa3f0 0x7f88a00c96e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 >> 172.21.15.148:0/729584032 conn(0x7f88a00caf40 msgr2=0x7f88a00c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 shutdown_connections 2023-10-24T00:44:22.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.664+0000 7f88a7fd0700 1 -- 172.21.15.148:0/729584032 wait complete. 2023-10-24T00:44:22.674 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:22.677 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:22.189603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2412780,"kb_used_data":7340,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752561940,"statfs":{"total":773094113280,"available":770623426560,"internally_reserved":0,"allocated":7516160,"data_stored":3721687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.639894"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983042+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995327+0000","last_change":"2023-10-24T00:44:18.995327+0000","last_active":"2023-10-24T00:44:18.995327+0000","last_peered":"2023-10-24T00:44:18.995327+0000","last_clean":"2023-10-24T00:44:18.995327+0000","last_became_active":"2023-10-24T00:44:18.995010+0000","last_became_peered":"2023-10-24T00:44:18.995010+0000","last_unstale":"2023-10-24T00:44:18.995327+0000","last_undegraded":"2023-10-24T00:44:18.995327+0000","last_fullsized":"2023-10-24T00:44:18.995327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982818+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992361+0000","last_change":"2023-10-24T00:44:18.992361+0000","last_active":"2023-10-24T00:44:18.992361+0000","last_peered":"2023-10-24T00:44:18.992361+0000","last_clean":"2023-10-24T00:44:18.992361+0000","last_became_active":"2023-10-24T00:44:18.991850+0000","last_became_peered":"2023-10-24T00:44:18.991850+0000","last_unstale":"2023-10-24T00:44:18.992361+0000","last_undegraded":"2023-10-24T00:44:18.992361+0000","last_fullsized":"2023-10-24T00:44:18.992361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979781+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001836+0000","last_change":"2023-10-24T00:44:19.001836+0000","last_active":"2023-10-24T00:44:19.001836+0000","last_peered":"2023-10-24T00:44:19.001836+0000","last_clean":"2023-10-24T00:44:19.001836+0000","last_became_active":"2023-10-24T00:44:19.001581+0000","last_became_peered":"2023-10-24T00:44:19.001581+0000","last_unstale":"2023-10-24T00:44:19.001836+0000","last_undegraded":"2023-10-24T00:44:19.001836+0000","last_fullsized":"2023-10-24T00:44:19.001836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981364+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001842+0000","last_change":"2023-10-24T00:44:19.001842+0000","last_active":"2023-10-24T00:44:19.001842+0000","last_peered":"2023-10-24T00:44:19.001842+0000","last_clean":"2023-10-24T00:44:19.001842+0000","last_became_active":"2023-10-24T00:44:19.001587+0000","last_became_peered":"2023-10-24T00:44:19.001587+0000","last_unstale":"2023-10-24T00:44:19.001842+0000","last_undegraded":"2023-10-24T00:44:19.001842+0000","last_fullsized":"2023-10-24T00:44:19.001842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985085+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998242+0000","last_change":"2023-10-24T00:44:18.998242+0000","last_active":"2023-10-24T00:44:18.998242+0000","last_peered":"2023-10-24T00:44:18.998242+0000","last_clean":"2023-10-24T00:44:18.998242+0000","last_became_active":"2023-10-24T00:44:18.997861+0000","last_became_peered":"2023-10-24T00:44:18.997861+0000","last_unstale":"2023-10-24T00:44:18.998242+0000","last_undegraded":"2023-10-24T00:44:18.998242+0000","last_fullsized":"2023-10-24T00:44:18.998242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979743+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987699+0000","last_change":"2023-10-24T00:44:18.987699+0000","last_active":"2023-10-24T00:44:18.987699+0000","last_peered":"2023-10-24T00:44:18.987699+0000","last_clean":"2023-10-24T00:44:18.987699+0000","last_became_active":"2023-10-24T00:44:18.987428+0000","last_became_peered":"2023-10-24T00:44:18.987428+0000","last_unstale":"2023-10-24T00:44:18.987699+0000","last_undegraded":"2023-10-24T00:44:18.987699+0000","last_fullsized":"2023-10-24T00:44:18.987699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983671+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996982+0000","last_change":"2023-10-24T00:44:18.996982+0000","last_active":"2023-10-24T00:44:18.996982+0000","last_peered":"2023-10-24T00:44:18.996982+0000","last_clean":"2023-10-24T00:44:18.996982+0000","last_became_active":"2023-10-24T00:44:18.996744+0000","last_became_peered":"2023-10-24T00:44:18.996744+0000","last_unstale":"2023-10-24T00:44:18.996982+0000","last_undegraded":"2023-10-24T00:44:18.996982+0000","last_fullsized":"2023-10-24T00:44:18.996982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988617+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993846+0000","last_change":"2023-10-24T00:44:18.993846+0000","last_active":"2023-10-24T00:44:18.993846+0000","last_peered":"2023-10-24T00:44:18.993846+0000","last_clean":"2023-10-24T00:44:18.993846+0000","last_became_active":"2023-10-24T00:44:18.993586+0000","last_became_peered":"2023-10-24T00:44:18.993586+0000","last_unstale":"2023-10-24T00:44:18.993846+0000","last_undegraded":"2023-10-24T00:44:18.993846+0000","last_fullsized":"2023-10-24T00:44:18.993846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993276+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991340+0000","last_change":"2023-10-24T00:44:18.991340+0000","last_active":"2023-10-24T00:44:18.991340+0000","last_peered":"2023-10-24T00:44:18.991340+0000","last_clean":"2023-10-24T00:44:18.991340+0000","last_became_active":"2023-10-24T00:44:18.991062+0000","last_became_peered":"2023-10-24T00:44:18.991062+0000","last_unstale":"2023-10-24T00:44:18.991340+0000","last_undegraded":"2023-10-24T00:44:18.991340+0000","last_fullsized":"2023-10-24T00:44:18.991340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983961+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001116+0000","last_change":"2023-10-24T00:44:19.001116+0000","last_active":"2023-10-24T00:44:19.001116+0000","last_peered":"2023-10-24T00:44:19.001116+0000","last_clean":"2023-10-24T00:44:19.001116+0000","last_became_active":"2023-10-24T00:44:19.000863+0000","last_became_peered":"2023-10-24T00:44:19.000863+0000","last_unstale":"2023-10-24T00:44:19.001116+0000","last_undegraded":"2023-10-24T00:44:19.001116+0000","last_fullsized":"2023-10-24T00:44:19.001116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983845+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994598+0000","last_change":"2023-10-24T00:44:18.994598+0000","last_active":"2023-10-24T00:44:18.994598+0000","last_peered":"2023-10-24T00:44:18.994598+0000","last_clean":"2023-10-24T00:44:18.994598+0000","last_became_active":"2023-10-24T00:44:18.994336+0000","last_became_peered":"2023-10-24T00:44:18.994336+0000","last_unstale":"2023-10-24T00:44:18.994598+0000","last_undegraded":"2023-10-24T00:44:18.994598+0000","last_fullsized":"2023-10-24T00:44:18.994598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984665+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999007+0000","last_change":"2023-10-24T00:44:18.999007+0000","last_active":"2023-10-24T00:44:18.999007+0000","last_peered":"2023-10-24T00:44:18.999007+0000","last_clean":"2023-10-24T00:44:18.999007+0000","last_became_active":"2023-10-24T00:44:18.998780+0000","last_became_peered":"2023-10-24T00:44:18.998780+0000","last_unstale":"2023-10-24T00:44:18.999007+0000","last_undegraded":"2023-10-24T00:44:18.999007+0000","last_fullsized":"2023-10-24T00:44:18.999007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979461+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002466+0000","last_change":"2023-10-24T00:44:19.002466+0000","last_active":"2023-10-24T00:44:19.002466+0000","last_peered":"2023-10-24T00:44:19.002466+0000","last_clean":"2023-10-24T00:44:19.002466+0000","last_became_active":"2023-10-24T00:44:19.002207+0000","last_became_peered":"2023-10-24T00:44:19.002207+0000","last_unstale":"2023-10-24T00:44:19.002466+0000","last_undegraded":"2023-10-24T00:44:19.002466+0000","last_fullsized":"2023-10-24T00:44:19.002466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982544+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.986943+0000","last_change":"2023-10-24T00:44:18.986943+0000","last_active":"2023-10-24T00:44:18.986943+0000","last_peered":"2023-10-24T00:44:18.986943+0000","last_clean":"2023-10-24T00:44:18.986943+0000","last_became_active":"2023-10-24T00:44:18.986663+0000","last_became_peered":"2023-10-24T00:44:18.986663+0000","last_unstale":"2023-10-24T00:44:18.986943+0000","last_undegraded":"2023-10-24T00:44:18.986943+0000","last_fullsized":"2023-10-24T00:44:18.986943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983294+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.988568+0000","last_change":"2023-10-24T00:44:18.988568+0000","last_active":"2023-10-24T00:44:18.988568+0000","last_peered":"2023-10-24T00:44:18.988568+0000","last_clean":"2023-10-24T00:44:18.988568+0000","last_became_active":"2023-10-24T00:44:18.988285+0000","last_became_peered":"2023-10-24T00:44:18.988285+0000","last_unstale":"2023-10-24T00:44:18.988568+0000","last_undegraded":"2023-10-24T00:44:18.988568+0000","last_fullsized":"2023-10-24T00:44:18.988568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990408+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001732+0000","last_change":"2023-10-24T00:44:19.001732+0000","last_active":"2023-10-24T00:44:19.001732+0000","last_peered":"2023-10-24T00:44:19.001732+0000","last_clean":"2023-10-24T00:44:19.001732+0000","last_became_active":"2023-10-24T00:44:19.001421+0000","last_became_peered":"2023-10-24T00:44:19.001421+0000","last_unstale":"2023-10-24T00:44:19.001732+0000","last_undegraded":"2023-10-24T00:44:19.001732+0000","last_fullsized":"2023-10-24T00:44:19.001732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986105+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002313+0000","last_change":"2023-10-24T00:44:19.002313+0000","last_active":"2023-10-24T00:44:19.002313+0000","last_peered":"2023-10-24T00:44:19.002313+0000","last_clean":"2023-10-24T00:44:19.002313+0000","last_became_active":"2023-10-24T00:44:19.002038+0000","last_became_peered":"2023-10-24T00:44:19.002038+0000","last_unstale":"2023-10-24T00:44:19.002313+0000","last_undegraded":"2023-10-24T00:44:19.002313+0000","last_fullsized":"2023-10-24T00:44:19.002313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990466+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998777+0000","last_change":"2023-10-24T00:44:18.998777+0000","last_active":"2023-10-24T00:44:18.998777+0000","last_peered":"2023-10-24T00:44:18.998777+0000","last_clean":"2023-10-24T00:44:18.998777+0000","last_became_active":"2023-10-24T00:44:18.998456+0000","last_became_peered":"2023-10-24T00:44:18.998456+0000","last_unstale":"2023-10-24T00:44:18.998777+0000","last_undegraded":"2023-10-24T00:44:18.998777+0000","last_fullsized":"2023-10-24T00:44:18.998777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982731+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995473+0000","last_change":"2023-10-24T00:44:18.995473+0000","last_active":"2023-10-24T00:44:18.995473+0000","last_peered":"2023-10-24T00:44:18.995473+0000","last_clean":"2023-10-24T00:44:18.995473+0000","last_became_active":"2023-10-24T00:44:18.995177+0000","last_became_peered":"2023-10-24T00:44:18.995177+0000","last_unstale":"2023-10-24T00:44:18.995473+0000","last_undegraded":"2023-10-24T00:44:18.995473+0000","last_fullsized":"2023-10-24T00:44:18.995473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979191+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994564+0000","last_change":"2023-10-24T00:44:18.994564+0000","last_active":"2023-10-24T00:44:18.994564+0000","last_peered":"2023-10-24T00:44:18.994564+0000","last_clean":"2023-10-24T00:44:18.994564+0000","last_became_active":"2023-10-24T00:44:18.994259+0000","last_became_peered":"2023-10-24T00:44:18.994259+0000","last_unstale":"2023-10-24T00:44:18.994564+0000","last_undegraded":"2023-10-24T00:44:18.994564+0000","last_fullsized":"2023-10-24T00:44:18.994564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983432+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000062+0000","last_change":"2023-10-24T00:44:19.000062+0000","last_active":"2023-10-24T00:44:19.000062+0000","last_peered":"2023-10-24T00:44:19.000062+0000","last_clean":"2023-10-24T00:44:19.000062+0000","last_became_active":"2023-10-24T00:44:18.999667+0000","last_became_peered":"2023-10-24T00:44:18.999667+0000","last_unstale":"2023-10-24T00:44:19.000062+0000","last_undegraded":"2023-10-24T00:44:19.000062+0000","last_fullsized":"2023-10-24T00:44:19.000062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985584+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995307+0000","last_change":"2023-10-24T00:44:18.995307+0000","last_active":"2023-10-24T00:44:18.995307+0000","last_peered":"2023-10-24T00:44:18.995307+0000","last_clean":"2023-10-24T00:44:18.995307+0000","last_became_active":"2023-10-24T00:44:18.994003+0000","last_became_peered":"2023-10-24T00:44:18.994003+0000","last_unstale":"2023-10-24T00:44:18.995307+0000","last_undegraded":"2023-10-24T00:44:18.995307+0000","last_fullsized":"2023-10-24T00:44:18.995307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986045+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996786+0000","last_change":"2023-10-24T00:44:18.996786+0000","last_active":"2023-10-24T00:44:18.996786+0000","last_peered":"2023-10-24T00:44:18.996786+0000","last_clean":"2023-10-24T00:44:18.996786+0000","last_became_active":"2023-10-24T00:44:18.996212+0000","last_became_peered":"2023-10-24T00:44:18.996212+0000","last_unstale":"2023-10-24T00:44:18.996786+0000","last_undegraded":"2023-10-24T00:44:18.996786+0000","last_fullsized":"2023-10-24T00:44:18.996786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003506+0000","last_change":"2023-10-24T00:44:19.003506+0000","last_active":"2023-10-24T00:44:19.003506+0000","last_peered":"2023-10-24T00:44:19.003506+0000","last_clean":"2023-10-24T00:44:19.003506+0000","last_became_active":"2023-10-24T00:44:19.003226+0000","last_became_peered":"2023-10-24T00:44:19.003226+0000","last_unstale":"2023-10-24T00:44:19.003506+0000","last_undegraded":"2023-10-24T00:44:19.003506+0000","last_fullsized":"2023-10-24T00:44:19.003506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979990+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987366+0000","last_change":"2023-10-24T00:44:18.987366+0000","last_active":"2023-10-24T00:44:18.987366+0000","last_peered":"2023-10-24T00:44:18.987366+0000","last_clean":"2023-10-24T00:44:18.987366+0000","last_became_active":"2023-10-24T00:44:18.987107+0000","last_became_peered":"2023-10-24T00:44:18.987107+0000","last_unstale":"2023-10-24T00:44:18.987366+0000","last_undegraded":"2023-10-24T00:44:18.987366+0000","last_fullsized":"2023-10-24T00:44:18.987366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981346+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997611+0000","last_change":"2023-10-24T00:44:18.997611+0000","last_active":"2023-10-24T00:44:18.997611+0000","last_peered":"2023-10-24T00:44:18.997611+0000","last_clean":"2023-10-24T00:44:18.997611+0000","last_became_active":"2023-10-24T00:44:18.997316+0000","last_became_peered":"2023-10-24T00:44:18.997316+0000","last_unstale":"2023-10-24T00:44:18.997611+0000","last_undegraded":"2023-10-24T00:44:18.997611+0000","last_fullsized":"2023-10-24T00:44:18.997611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998858+0000","last_change":"2023-10-24T00:44:18.998858+0000","last_active":"2023-10-24T00:44:18.998858+0000","last_peered":"2023-10-24T00:44:18.998858+0000","last_clean":"2023-10-24T00:44:18.998858+0000","last_became_active":"2023-10-24T00:44:18.998489+0000","last_became_peered":"2023-10-24T00:44:18.998489+0000","last_unstale":"2023-10-24T00:44:18.998858+0000","last_undegraded":"2023-10-24T00:44:18.998858+0000","last_fullsized":"2023-10-24T00:44:18.998858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985113+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997086+0000","last_change":"2023-10-24T00:44:18.997086+0000","last_active":"2023-10-24T00:44:18.997086+0000","last_peered":"2023-10-24T00:44:18.997086+0000","last_clean":"2023-10-24T00:44:18.997086+0000","last_became_active":"2023-10-24T00:44:18.996790+0000","last_became_peered":"2023-10-24T00:44:18.996790+0000","last_unstale":"2023-10-24T00:44:18.997086+0000","last_undegraded":"2023-10-24T00:44:18.997086+0000","last_fullsized":"2023-10-24T00:44:18.997086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984952+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996828+0000","last_change":"2023-10-24T00:44:18.996828+0000","last_active":"2023-10-24T00:44:18.996828+0000","last_peered":"2023-10-24T00:44:18.996828+0000","last_clean":"2023-10-24T00:44:18.996828+0000","last_became_active":"2023-10-24T00:44:18.996571+0000","last_became_peered":"2023-10-24T00:44:18.996571+0000","last_unstale":"2023-10-24T00:44:18.996828+0000","last_undegraded":"2023-10-24T00:44:18.996828+0000","last_fullsized":"2023-10-24T00:44:18.996828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982112+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998001+0000","last_change":"2023-10-24T00:44:18.998001+0000","last_active":"2023-10-24T00:44:18.998001+0000","last_peered":"2023-10-24T00:44:18.998001+0000","last_clean":"2023-10-24T00:44:18.998001+0000","last_became_active":"2023-10-24T00:44:18.997726+0000","last_became_peered":"2023-10-24T00:44:18.997726+0000","last_unstale":"2023-10-24T00:44:18.998001+0000","last_undegraded":"2023-10-24T00:44:18.998001+0000","last_fullsized":"2023-10-24T00:44:18.998001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.992639+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987755+0000","last_change":"2023-10-24T00:44:18.987755+0000","last_active":"2023-10-24T00:44:18.987755+0000","last_peered":"2023-10-24T00:44:18.987755+0000","last_clean":"2023-10-24T00:44:18.987755+0000","last_became_active":"2023-10-24T00:44:18.987473+0000","last_became_peered":"2023-10-24T00:44:18.987473+0000","last_unstale":"2023-10-24T00:44:18.987755+0000","last_undegraded":"2023-10-24T00:44:18.987755+0000","last_fullsized":"2023-10-24T00:44:18.987755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982631+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997838+0000","last_change":"2023-10-24T00:44:18.997838+0000","last_active":"2023-10-24T00:44:18.997838+0000","last_peered":"2023-10-24T00:44:18.997838+0000","last_clean":"2023-10-24T00:44:18.997838+0000","last_became_active":"2023-10-24T00:44:18.997228+0000","last_became_peered":"2023-10-24T00:44:18.997228+0000","last_unstale":"2023-10-24T00:44:18.997838+0000","last_undegraded":"2023-10-24T00:44:18.997838+0000","last_fullsized":"2023-10-24T00:44:18.997838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986832+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002540+0000","last_change":"2023-10-24T00:44:19.002540+0000","last_active":"2023-10-24T00:44:19.002540+0000","last_peered":"2023-10-24T00:44:19.002540+0000","last_clean":"2023-10-24T00:44:19.002540+0000","last_became_active":"2023-10-24T00:44:19.002270+0000","last_became_peered":"2023-10-24T00:44:19.002270+0000","last_unstale":"2023-10-24T00:44:19.002540+0000","last_undegraded":"2023-10-24T00:44:19.002540+0000","last_fullsized":"2023-10-24T00:44:19.002540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980802+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000438+0000","last_change":"2023-10-24T00:44:19.000438+0000","last_active":"2023-10-24T00:44:19.000438+0000","last_peered":"2023-10-24T00:44:19.000438+0000","last_clean":"2023-10-24T00:44:19.000438+0000","last_became_active":"2023-10-24T00:44:18.999186+0000","last_became_peered":"2023-10-24T00:44:18.999186+0000","last_unstale":"2023-10-24T00:44:19.000438+0000","last_undegraded":"2023-10-24T00:44:19.000438+0000","last_fullsized":"2023-10-24T00:44:19.000438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984082+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998792+0000","last_change":"2023-10-24T00:44:18.998792+0000","last_active":"2023-10-24T00:44:18.998792+0000","last_peered":"2023-10-24T00:44:18.998792+0000","last_clean":"2023-10-24T00:44:18.998792+0000","last_became_active":"2023-10-24T00:44:18.998121+0000","last_became_peered":"2023-10-24T00:44:18.998121+0000","last_unstale":"2023-10-24T00:44:18.998792+0000","last_undegraded":"2023-10-24T00:44:18.998792+0000","last_fullsized":"2023-10-24T00:44:18.998792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984232+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993303+0000","last_change":"2023-10-24T00:44:18.993303+0000","last_active":"2023-10-24T00:44:18.993303+0000","last_peered":"2023-10-24T00:44:18.993303+0000","last_clean":"2023-10-24T00:44:18.993303+0000","last_became_active":"2023-10-24T00:44:18.993034+0000","last_became_peered":"2023-10-24T00:44:18.993034+0000","last_unstale":"2023-10-24T00:44:18.993303+0000","last_undegraded":"2023-10-24T00:44:18.993303+0000","last_fullsized":"2023-10-24T00:44:18.993303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978535+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994424+0000","last_change":"2023-10-24T00:44:18.994424+0000","last_active":"2023-10-24T00:44:18.994424+0000","last_peered":"2023-10-24T00:44:18.994424+0000","last_clean":"2023-10-24T00:44:18.994424+0000","last_became_active":"2023-10-24T00:44:18.994144+0000","last_became_peered":"2023-10-24T00:44:18.994144+0000","last_unstale":"2023-10-24T00:44:18.994424+0000","last_undegraded":"2023-10-24T00:44:18.994424+0000","last_fullsized":"2023-10-24T00:44:18.994424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979288+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994274+0000","last_change":"2023-10-24T00:44:18.994274+0000","last_active":"2023-10-24T00:44:18.994274+0000","last_peered":"2023-10-24T00:44:18.994274+0000","last_clean":"2023-10-24T00:44:18.994274+0000","last_became_active":"2023-10-24T00:44:18.993980+0000","last_became_peered":"2023-10-24T00:44:18.993980+0000","last_unstale":"2023-10-24T00:44:18.994274+0000","last_undegraded":"2023-10-24T00:44:18.994274+0000","last_fullsized":"2023-10-24T00:44:18.994274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993269+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996096+0000","last_change":"2023-10-24T00:44:18.996096+0000","last_active":"2023-10-24T00:44:18.996096+0000","last_peered":"2023-10-24T00:44:18.996096+0000","last_clean":"2023-10-24T00:44:18.996096+0000","last_became_active":"2023-10-24T00:44:18.995720+0000","last_became_peered":"2023-10-24T00:44:18.995720+0000","last_unstale":"2023-10-24T00:44:18.996096+0000","last_undegraded":"2023-10-24T00:44:18.996096+0000","last_fullsized":"2023-10-24T00:44:18.996096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985632+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999502+0000","last_change":"2023-10-24T00:44:18.999502+0000","last_active":"2023-10-24T00:44:18.999502+0000","last_peered":"2023-10-24T00:44:18.999502+0000","last_clean":"2023-10-24T00:44:18.999502+0000","last_became_active":"2023-10-24T00:44:18.999191+0000","last_became_peered":"2023-10-24T00:44:18.999191+0000","last_unstale":"2023-10-24T00:44:18.999502+0000","last_undegraded":"2023-10-24T00:44:18.999502+0000","last_fullsized":"2023-10-24T00:44:18.999502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979612+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005035+0000","last_change":"2023-10-24T00:44:19.005035+0000","last_active":"2023-10-24T00:44:19.005035+0000","last_peered":"2023-10-24T00:44:19.005035+0000","last_clean":"2023-10-24T00:44:19.005035+0000","last_became_active":"2023-10-24T00:44:19.004782+0000","last_became_peered":"2023-10-24T00:44:19.004782+0000","last_unstale":"2023-10-24T00:44:19.005035+0000","last_undegraded":"2023-10-24T00:44:19.005035+0000","last_fullsized":"2023-10-24T00:44:19.005035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993054+0000","last_change":"2023-10-24T00:44:18.993054+0000","last_active":"2023-10-24T00:44:18.993054+0000","last_peered":"2023-10-24T00:44:18.993054+0000","last_clean":"2023-10-24T00:44:18.993054+0000","last_became_active":"2023-10-24T00:44:18.992750+0000","last_became_peered":"2023-10-24T00:44:18.992750+0000","last_unstale":"2023-10-24T00:44:18.993054+0000","last_undegraded":"2023-10-24T00:44:18.993054+0000","last_fullsized":"2023-10-24T00:44:18.993054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988183+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003478+0000","last_change":"2023-10-24T00:44:19.003478+0000","last_active":"2023-10-24T00:44:19.003478+0000","last_peered":"2023-10-24T00:44:19.003478+0000","last_clean":"2023-10-24T00:44:19.003478+0000","last_became_active":"2023-10-24T00:44:19.003192+0000","last_became_peered":"2023-10-24T00:44:19.003192+0000","last_unstale":"2023-10-24T00:44:19.003478+0000","last_undegraded":"2023-10-24T00:44:19.003478+0000","last_fullsized":"2023-10-24T00:44:19.003478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983783+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991279+0000","last_change":"2023-10-24T00:44:18.991279+0000","last_active":"2023-10-24T00:44:18.991279+0000","last_peered":"2023-10-24T00:44:18.991279+0000","last_clean":"2023-10-24T00:44:18.991279+0000","last_became_active":"2023-10-24T00:44:18.990733+0000","last_became_peered":"2023-10-24T00:44:18.990733+0000","last_unstale":"2023-10-24T00:44:18.991279+0000","last_undegraded":"2023-10-24T00:44:18.991279+0000","last_fullsized":"2023-10-24T00:44:18.991279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999146+0000","last_change":"2023-10-24T00:44:18.999146+0000","last_active":"2023-10-24T00:44:18.999146+0000","last_peered":"2023-10-24T00:44:18.999146+0000","last_clean":"2023-10-24T00:44:18.999146+0000","last_became_active":"2023-10-24T00:44:18.998413+0000","last_became_peered":"2023-10-24T00:44:18.998413+0000","last_unstale":"2023-10-24T00:44:18.999146+0000","last_undegraded":"2023-10-24T00:44:18.999146+0000","last_fullsized":"2023-10-24T00:44:18.999146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985680+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003962+0000","last_change":"2023-10-24T00:44:19.003962+0000","last_active":"2023-10-24T00:44:19.003962+0000","last_peered":"2023-10-24T00:44:19.003962+0000","last_clean":"2023-10-24T00:44:19.003962+0000","last_became_active":"2023-10-24T00:44:19.003238+0000","last_became_peered":"2023-10-24T00:44:19.003238+0000","last_unstale":"2023-10-24T00:44:19.003962+0000","last_undegraded":"2023-10-24T00:44:19.003962+0000","last_fullsized":"2023-10-24T00:44:19.003962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987897+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996949+0000","last_change":"2023-10-24T00:44:18.996949+0000","last_active":"2023-10-24T00:44:18.996949+0000","last_peered":"2023-10-24T00:44:18.996949+0000","last_clean":"2023-10-24T00:44:18.996949+0000","last_became_active":"2023-10-24T00:44:18.996508+0000","last_became_peered":"2023-10-24T00:44:18.996508+0000","last_unstale":"2023-10-24T00:44:18.996949+0000","last_undegraded":"2023-10-24T00:44:18.996949+0000","last_fullsized":"2023-10-24T00:44:18.996949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978371+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997143+0000","last_change":"2023-10-24T00:44:18.997143+0000","last_active":"2023-10-24T00:44:18.997143+0000","last_peered":"2023-10-24T00:44:18.997143+0000","last_clean":"2023-10-24T00:44:18.997143+0000","last_became_active":"2023-10-24T00:44:18.996829+0000","last_became_peered":"2023-10-24T00:44:18.996829+0000","last_unstale":"2023-10-24T00:44:18.997143+0000","last_undegraded":"2023-10-24T00:44:18.997143+0000","last_fullsized":"2023-10-24T00:44:18.997143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983812+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999768+0000","last_change":"2023-10-24T00:44:18.999768+0000","last_active":"2023-10-24T00:44:18.999768+0000","last_peered":"2023-10-24T00:44:18.999768+0000","last_clean":"2023-10-24T00:44:18.999768+0000","last_became_active":"2023-10-24T00:44:18.999468+0000","last_became_peered":"2023-10-24T00:44:18.999468+0000","last_unstale":"2023-10-24T00:44:18.999768+0000","last_undegraded":"2023-10-24T00:44:18.999768+0000","last_fullsized":"2023-10-24T00:44:18.999768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980255+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996209+0000","last_change":"2023-10-24T00:44:18.996209+0000","last_active":"2023-10-24T00:44:18.996209+0000","last_peered":"2023-10-24T00:44:18.996209+0000","last_clean":"2023-10-24T00:44:18.996209+0000","last_became_active":"2023-10-24T00:44:18.995918+0000","last_became_peered":"2023-10-24T00:44:18.995918+0000","last_unstale":"2023-10-24T00:44:18.996209+0000","last_undegraded":"2023-10-24T00:44:18.996209+0000","last_fullsized":"2023-10-24T00:44:18.996209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988664+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998681+0000","last_change":"2023-10-24T00:44:18.998681+0000","last_active":"2023-10-24T00:44:18.998681+0000","last_peered":"2023-10-24T00:44:18.998681+0000","last_clean":"2023-10-24T00:44:18.998681+0000","last_became_active":"2023-10-24T00:44:18.997838+0000","last_became_peered":"2023-10-24T00:44:18.997838+0000","last_unstale":"2023-10-24T00:44:18.998681+0000","last_undegraded":"2023-10-24T00:44:18.998681+0000","last_fullsized":"2023-10-24T00:44:18.998681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991597+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.990704+0000","last_change":"2023-10-24T00:44:18.990704+0000","last_active":"2023-10-24T00:44:18.990704+0000","last_peered":"2023-10-24T00:44:18.990704+0000","last_clean":"2023-10-24T00:44:18.990704+0000","last_became_active":"2023-10-24T00:44:18.990361+0000","last_became_peered":"2023-10-24T00:44:18.990361+0000","last_unstale":"2023-10-24T00:44:18.990704+0000","last_undegraded":"2023-10-24T00:44:18.990704+0000","last_fullsized":"2023-10-24T00:44:18.990704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990323+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999336+0000","last_change":"2023-10-24T00:44:18.999336+0000","last_active":"2023-10-24T00:44:18.999336+0000","last_peered":"2023-10-24T00:44:18.999336+0000","last_clean":"2023-10-24T00:44:18.999336+0000","last_became_active":"2023-10-24T00:44:18.998739+0000","last_became_peered":"2023-10-24T00:44:18.998739+0000","last_unstale":"2023-10-24T00:44:18.999336+0000","last_undegraded":"2023-10-24T00:44:18.999336+0000","last_fullsized":"2023-10-24T00:44:18.999336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981493+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987757+0000","last_change":"2023-10-24T00:44:18.987757+0000","last_active":"2023-10-24T00:44:18.987757+0000","last_peered":"2023-10-24T00:44:18.987757+0000","last_clean":"2023-10-24T00:44:18.987757+0000","last_became_active":"2023-10-24T00:44:18.987454+0000","last_became_peered":"2023-10-24T00:44:18.987454+0000","last_unstale":"2023-10-24T00:44:18.987757+0000","last_undegraded":"2023-10-24T00:44:18.987757+0000","last_fullsized":"2023-10-24T00:44:18.987757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978024+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995961+0000","last_change":"2023-10-24T00:44:18.995961+0000","last_active":"2023-10-24T00:44:18.995961+0000","last_peered":"2023-10-24T00:44:18.995961+0000","last_clean":"2023-10-24T00:44:18.995961+0000","last_became_active":"2023-10-24T00:44:18.995687+0000","last_became_peered":"2023-10-24T00:44:18.995687+0000","last_unstale":"2023-10-24T00:44:18.995961+0000","last_undegraded":"2023-10-24T00:44:18.995961+0000","last_fullsized":"2023-10-24T00:44:18.995961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978946+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999552+0000","last_change":"2023-10-24T00:44:18.999552+0000","last_active":"2023-10-24T00:44:18.999552+0000","last_peered":"2023-10-24T00:44:18.999552+0000","last_clean":"2023-10-24T00:44:18.999552+0000","last_became_active":"2023-10-24T00:44:18.999258+0000","last_became_peered":"2023-10-24T00:44:18.999258+0000","last_unstale":"2023-10-24T00:44:18.999552+0000","last_undegraded":"2023-10-24T00:44:18.999552+0000","last_fullsized":"2023-10-24T00:44:18.999552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983055+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995213+0000","last_change":"2023-10-24T00:44:18.995213+0000","last_active":"2023-10-24T00:44:18.995213+0000","last_peered":"2023-10-24T00:44:18.995213+0000","last_clean":"2023-10-24T00:44:18.995213+0000","last_became_active":"2023-10-24T00:44:18.994931+0000","last_became_peered":"2023-10-24T00:44:18.994931+0000","last_unstale":"2023-10-24T00:44:18.995213+0000","last_undegraded":"2023-10-24T00:44:18.995213+0000","last_fullsized":"2023-10-24T00:44:18.995213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975423+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:17.975423+0000","last_peered":"2023-10-24T00:44:17.975423+0000","last_clean":"2023-10-24T00:44:17.975423+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:17.975423+0000","last_undegraded":"2023-10-24T00:44:17.975423+0000","last_fullsized":"2023-10-24T00:44:17.975423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986924+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999384+0000","last_change":"2023-10-24T00:44:18.999384+0000","last_active":"2023-10-24T00:44:18.999384+0000","last_peered":"2023-10-24T00:44:18.999384+0000","last_clean":"2023-10-24T00:44:18.999384+0000","last_became_active":"2023-10-24T00:44:18.999120+0000","last_became_peered":"2023-10-24T00:44:18.999120+0000","last_unstale":"2023-10-24T00:44:18.999384+0000","last_undegraded":"2023-10-24T00:44:18.999384+0000","last_fullsized":"2023-10-24T00:44:18.999384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974142+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:17.974142+0000","last_peered":"2023-10-24T00:44:17.974142+0000","last_clean":"2023-10-24T00:44:17.974142+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:17.974142+0000","last_undegraded":"2023-10-24T00:44:17.974142+0000","last_fullsized":"2023-10-24T00:44:17.974142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988657+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000031+0000","last_change":"2023-10-24T00:44:19.000031+0000","last_active":"2023-10-24T00:44:19.000031+0000","last_peered":"2023-10-24T00:44:19.000031+0000","last_clean":"2023-10-24T00:44:19.000031+0000","last_became_active":"2023-10-24T00:44:18.999739+0000","last_became_peered":"2023-10-24T00:44:18.999739+0000","last_unstale":"2023-10-24T00:44:19.000031+0000","last_undegraded":"2023-10-24T00:44:19.000031+0000","last_fullsized":"2023-10-24T00:44:19.000031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.970712+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:17.970712+0000","last_peered":"2023-10-24T00:44:17.970712+0000","last_clean":"2023-10-24T00:44:17.970712+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:17.970712+0000","last_undegraded":"2023-10-24T00:44:17.970712+0000","last_fullsized":"2023-10-24T00:44:17.970712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988206+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995012+0000","last_change":"2023-10-24T00:44:18.995012+0000","last_active":"2023-10-24T00:44:18.995012+0000","last_peered":"2023-10-24T00:44:18.995012+0000","last_clean":"2023-10-24T00:44:18.995012+0000","last_became_active":"2023-10-24T00:44:18.994740+0000","last_became_peered":"2023-10-24T00:44:18.994740+0000","last_unstale":"2023-10-24T00:44:18.995012+0000","last_undegraded":"2023-10-24T00:44:18.995012+0000","last_fullsized":"2023-10-24T00:44:18.995012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974149+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:17.974149+0000","last_peered":"2023-10-24T00:44:17.974149+0000","last_clean":"2023-10-24T00:44:17.974149+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:17.974149+0000","last_undegraded":"2023-10-24T00:44:17.974149+0000","last_fullsized":"2023-10-24T00:44:17.974149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974688+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:17.974688+0000","last_peered":"2023-10-24T00:44:17.974688+0000","last_clean":"2023-10-24T00:44:17.974688+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:17.974688+0000","last_undegraded":"2023-10-24T00:44:17.974688+0000","last_fullsized":"2023-10-24T00:44:17.974688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982974+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997386+0000","last_change":"2023-10-24T00:44:18.997386+0000","last_active":"2023-10-24T00:44:18.997386+0000","last_peered":"2023-10-24T00:44:18.997386+0000","last_clean":"2023-10-24T00:44:18.997386+0000","last_became_active":"2023-10-24T00:44:18.997004+0000","last_became_peered":"2023-10-24T00:44:18.997004+0000","last_unstale":"2023-10-24T00:44:18.997386+0000","last_undegraded":"2023-10-24T00:44:18.997386+0000","last_fullsized":"2023-10-24T00:44:18.997386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974809+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:17.974809+0000","last_peered":"2023-10-24T00:44:17.974809+0000","last_clean":"2023-10-24T00:44:17.974809+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:17.974809+0000","last_undegraded":"2023-10-24T00:44:17.974809+0000","last_fullsized":"2023-10-24T00:44:17.974809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990044+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001810+0000","last_change":"2023-10-24T00:44:19.001810+0000","last_active":"2023-10-24T00:44:19.001810+0000","last_peered":"2023-10-24T00:44:19.001810+0000","last_clean":"2023-10-24T00:44:19.001810+0000","last_became_active":"2023-10-24T00:44:19.001524+0000","last_became_peered":"2023-10-24T00:44:19.001524+0000","last_unstale":"2023-10-24T00:44:19.001810+0000","last_undegraded":"2023-10-24T00:44:19.001810+0000","last_fullsized":"2023-10-24T00:44:19.001810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975087+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:17.975087+0000","last_peered":"2023-10-24T00:44:17.975087+0000","last_clean":"2023-10-24T00:44:17.975087+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:17.975087+0000","last_undegraded":"2023-10-24T00:44:17.975087+0000","last_fullsized":"2023-10-24T00:44:17.975087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982321+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005142+0000","last_change":"2023-10-24T00:44:19.005142+0000","last_active":"2023-10-24T00:44:19.005142+0000","last_peered":"2023-10-24T00:44:19.005142+0000","last_clean":"2023-10-24T00:44:19.005142+0000","last_became_active":"2023-10-24T00:44:19.004839+0000","last_became_peered":"2023-10-24T00:44:19.004839+0000","last_unstale":"2023-10-24T00:44:19.005142+0000","last_undegraded":"2023-10-24T00:44:19.005142+0000","last_fullsized":"2023-10-24T00:44:19.005142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975438+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:17.975438+0000","last_peered":"2023-10-24T00:44:17.975438+0000","last_clean":"2023-10-24T00:44:17.975438+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:17.975438+0000","last_undegraded":"2023-10-24T00:44:17.975438+0000","last_fullsized":"2023-10-24T00:44:17.975438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987260+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992422+0000","last_change":"2023-10-24T00:44:18.992422+0000","last_active":"2023-10-24T00:44:18.992422+0000","last_peered":"2023-10-24T00:44:18.992422+0000","last_clean":"2023-10-24T00:44:18.992422+0000","last_became_active":"2023-10-24T00:44:18.992112+0000","last_became_peered":"2023-10-24T00:44:18.992112+0000","last_unstale":"2023-10-24T00:44:18.992422+0000","last_undegraded":"2023-10-24T00:44:18.992422+0000","last_fullsized":"2023-10-24T00:44:18.992422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.976468+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:17.976468+0000","last_peered":"2023-10-24T00:44:17.976468+0000","last_clean":"2023-10-24T00:44:17.976468+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:17.976468+0000","last_undegraded":"2023-10-24T00:44:17.976468+0000","last_fullsized":"2023-10-24T00:44:17.976468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":471055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.65700000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.498,"5min":0.46700000000000003,"15min":0.32600000000000001},"max":{"1min":0.753,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.246,"15min":0.246},"max":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.40699999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56299999999999994,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":4.351,"15min":4.351},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.83299999999999996},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.495}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.48099999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.439}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.499},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.374}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.34300000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33800000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.376}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.433}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.5}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.59199999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.625}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:22.685 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:22.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.829+0000 7f0e5cc8f700 1 Processor -- start 2023-10-24T00:44:22.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.829+0000 7f0e5cc8f700 1 -- start start 2023-10-24T00:44:22.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5cc8f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 0x7f0e580c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5cc8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 0x7f0e58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5cc8f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580aa860 con 0x7f0e580c6710 2023-10-24T00:44:22.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5cc8f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580c0960 con 0x7f0e580aa010 2023-10-24T00:44:22.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5cc8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580c0c40 con 0x7f0e580aa3f0 2023-10-24T00:44:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e4dd9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0e580c6710 0x7f0e58158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:38674/0 (socket says 172.21.15.148:38674) 2023-10-24T00:44:22.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e4dd9b700 1 -- 172.21.15.148:0/726116380 learned_addr learned my addr 172.21.15.148:0/726116380 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e5659c700 1 --2- 172.21.15.148:0/726116380 >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 0x7f0e580c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e56d9d700 1 --2- 172.21.15.148:0/726116380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 0x7f0e58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133097072 0 0) 0x7f0e580aa860 con 0x7f0e580c6710 2023-10-24T00:44:22.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.830+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e440033f0 con 0x7f0e580c6710 2023-10-24T00:44:22.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221064093 0 0) 0x7f0e440033f0 con 0x7f0e580c6710 2023-10-24T00:44:22.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e56d9d700 1 -- 172.21.15.148:0/726116380 >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 msgr2=0x7f0e580c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:22.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e56d9d700 1 --2- 172.21.15.148:0/726116380 >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 0x7f0e580c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e56d9d700 1 -- 172.21.15.148:0/726116380 >> v1:172.21.15.148:6789/0 conn(0x7f0e580c6710 legacy=0x7f0e58158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e56d9d700 1 -- 172.21.15.148:0/726116380 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580c0f20 con 0x7f0e580aa3f0 2023-10-24T00:44:22.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e5659c700 1 --2- 172.21.15.148:0/726116380 >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 0x7f0e580c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:22.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e56d9d700 1 --2- 172.21.15.148:0/726116380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 0x7f0e58069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0e50009e60 tx=0x7f0e50009780).ready entity=mon.2 client_cookie=d0c6590ed8ebd1fa server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000e070 con 0x7f0e580aa3f0 2023-10-24T00:44:22.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000b7a0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e55d9b700 1 -- 172.21.15.148:0/726116380 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40001470 con 0x7f0e580aa3f0 2023-10-24T00:44:22.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/726116380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 msgr2=0x7f0e58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/726116380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 0x7f0e58069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0e50009e60 tx=0x7f0e50009780).stop 2023-10-24T00:44:22.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.831+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/726116380 shutdown_connections 2023-10-24T00:44:22.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.832+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/726116380 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa3f0 0x7f0e58069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.832+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/726116380 >> v2:172.21.15.150:3300/0 conn(0x7f0e580aa010 0x7f0e580c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.832+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/726116380 >> 172.21.15.148:0/726116380 conn(0x7f0e580caf40 msgr2=0x7f0e580cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.832+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/726116380 shutdown_connections 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.832+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/726116380 wait complete. 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.833+0000 7f0e5cc8f700 1 Processor -- start 2023-10-24T00:44:22.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.833+0000 7f0e5cc8f700 1 -- start start 2023-10-24T00:44:22.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa010 0x7f0e580af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e580c6710 0x7f0e58152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58154ac0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58156270 con 0x7f0e580c6710 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b0770 con 0x7f0e580aa010 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57506/0 (socket says 172.21.15.148:57506) 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 -- 172.21.15.148:0/3709475749 learned_addr learned my addr 172.21.15.148:0/3709475749 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:22.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5659c700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa010 0x7f0e580af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e56d9d700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e580c6710 0x7f0e58152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 -- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa010 msgr2=0x7f0e580af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa010 0x7f0e580af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 -- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e580c6710 msgr2=0x7f0e58152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e580c6710 0x7f0e58152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 -- 172.21.15.148:0/3709475749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480092a0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4dd9b700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f0e4000c810 tx=0x7f0e40001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40007170 con 0x7f0e580aa3f0 2023-10-24T00:44:22.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e400072d0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50009a20 con 0x7f0e580aa3f0 2023-10-24T00:44:22.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400048c0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.834+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58155e90 con 0x7f0e580aa3f0 2023-10-24T00:44:22.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.835+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580b0ef0 con 0x7f0e580aa3f0 2023-10-24T00:44:22.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.836+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0e40004c30 con 0x7f0e580aa3f0 2023-10-24T00:44:22.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.836+0000 7f0e4effd700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 0x7f0e38061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:22.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.836+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e40079d70 con 0x7f0e580aa3f0 2023-10-24T00:44:22.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.836+0000 7f0e5659c700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 0x7f0e38061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:22.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.837+0000 7f0e5659c700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 0x7f0e38061760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0e48009d20 tx=0x7f0e48009060).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:22.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:22.840+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0e580b0ef0 con 0x7f0e580aa3f0 2023-10-24T00:44:23.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.000+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e580b0bc0 con 0x7f0e3805f2a0 2023-10-24T00:44:23.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.010+0000 7f0e4effd700 1 -- 172.21.15.148:0/3709475749 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358636 (secure 0 0 0) 0x7f0e580b0bc0 con 0x7f0e3805f2a0 2023-10-24T00:44:23.016 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:23.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 msgr2=0x7f0e38061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 0x7f0e38061760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0e48009d20 tx=0x7f0e48009060).stop 2023-10-24T00:44:23.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 msgr2=0x7f0e58151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f0e4000c810 tx=0x7f0e40001b50).stop 2023-10-24T00:44:23.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 shutdown_connections 2023-10-24T00:44:23.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e580c6710 0x7f0e58152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e580aa010 0x7f0e580af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0e3805f2a0 0x7f0e38061760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 --2- 172.21.15.148:0/3709475749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e580aa3f0 0x7f0e58151680 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 >> 172.21.15.148:0/3709475749 conn(0x7f0e580caf40 msgr2=0x7f0e580ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:23.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 shutdown_connections 2023-10-24T00:44:23.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.014+0000 7f0e5cc8f700 1 -- 172.21.15.148:0/3709475749 wait complete. 2023-10-24T00:44:23.021 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:23.027 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:22.189603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2412780,"kb_used_data":7340,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752561940,"statfs":{"total":773094113280,"available":770623426560,"internally_reserved":0,"allocated":7516160,"data_stored":3721687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.639894"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983042+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995327+0000","last_change":"2023-10-24T00:44:18.995327+0000","last_active":"2023-10-24T00:44:18.995327+0000","last_peered":"2023-10-24T00:44:18.995327+0000","last_clean":"2023-10-24T00:44:18.995327+0000","last_became_active":"2023-10-24T00:44:18.995010+0000","last_became_peered":"2023-10-24T00:44:18.995010+0000","last_unstale":"2023-10-24T00:44:18.995327+0000","last_undegraded":"2023-10-24T00:44:18.995327+0000","last_fullsized":"2023-10-24T00:44:18.995327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982818+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992361+0000","last_change":"2023-10-24T00:44:18.992361+0000","last_active":"2023-10-24T00:44:18.992361+0000","last_peered":"2023-10-24T00:44:18.992361+0000","last_clean":"2023-10-24T00:44:18.992361+0000","last_became_active":"2023-10-24T00:44:18.991850+0000","last_became_peered":"2023-10-24T00:44:18.991850+0000","last_unstale":"2023-10-24T00:44:18.992361+0000","last_undegraded":"2023-10-24T00:44:18.992361+0000","last_fullsized":"2023-10-24T00:44:18.992361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979781+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001836+0000","last_change":"2023-10-24T00:44:19.001836+0000","last_active":"2023-10-24T00:44:19.001836+0000","last_peered":"2023-10-24T00:44:19.001836+0000","last_clean":"2023-10-24T00:44:19.001836+0000","last_became_active":"2023-10-24T00:44:19.001581+0000","last_became_peered":"2023-10-24T00:44:19.001581+0000","last_unstale":"2023-10-24T00:44:19.001836+0000","last_undegraded":"2023-10-24T00:44:19.001836+0000","last_fullsized":"2023-10-24T00:44:19.001836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981364+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001842+0000","last_change":"2023-10-24T00:44:19.001842+0000","last_active":"2023-10-24T00:44:19.001842+0000","last_peered":"2023-10-24T00:44:19.001842+0000","last_clean":"2023-10-24T00:44:19.001842+0000","last_became_active":"2023-10-24T00:44:19.001587+0000","last_became_peered":"2023-10-24T00:44:19.001587+0000","last_unstale":"2023-10-24T00:44:19.001842+0000","last_undegraded":"2023-10-24T00:44:19.001842+0000","last_fullsized":"2023-10-24T00:44:19.001842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985085+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998242+0000","last_change":"2023-10-24T00:44:18.998242+0000","last_active":"2023-10-24T00:44:18.998242+0000","last_peered":"2023-10-24T00:44:18.998242+0000","last_clean":"2023-10-24T00:44:18.998242+0000","last_became_active":"2023-10-24T00:44:18.997861+0000","last_became_peered":"2023-10-24T00:44:18.997861+0000","last_unstale":"2023-10-24T00:44:18.998242+0000","last_undegraded":"2023-10-24T00:44:18.998242+0000","last_fullsized":"2023-10-24T00:44:18.998242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979743+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987699+0000","last_change":"2023-10-24T00:44:18.987699+0000","last_active":"2023-10-24T00:44:18.987699+0000","last_peered":"2023-10-24T00:44:18.987699+0000","last_clean":"2023-10-24T00:44:18.987699+0000","last_became_active":"2023-10-24T00:44:18.987428+0000","last_became_peered":"2023-10-24T00:44:18.987428+0000","last_unstale":"2023-10-24T00:44:18.987699+0000","last_undegraded":"2023-10-24T00:44:18.987699+0000","last_fullsized":"2023-10-24T00:44:18.987699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983671+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996982+0000","last_change":"2023-10-24T00:44:18.996982+0000","last_active":"2023-10-24T00:44:18.996982+0000","last_peered":"2023-10-24T00:44:18.996982+0000","last_clean":"2023-10-24T00:44:18.996982+0000","last_became_active":"2023-10-24T00:44:18.996744+0000","last_became_peered":"2023-10-24T00:44:18.996744+0000","last_unstale":"2023-10-24T00:44:18.996982+0000","last_undegraded":"2023-10-24T00:44:18.996982+0000","last_fullsized":"2023-10-24T00:44:18.996982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988617+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993846+0000","last_change":"2023-10-24T00:44:18.993846+0000","last_active":"2023-10-24T00:44:18.993846+0000","last_peered":"2023-10-24T00:44:18.993846+0000","last_clean":"2023-10-24T00:44:18.993846+0000","last_became_active":"2023-10-24T00:44:18.993586+0000","last_became_peered":"2023-10-24T00:44:18.993586+0000","last_unstale":"2023-10-24T00:44:18.993846+0000","last_undegraded":"2023-10-24T00:44:18.993846+0000","last_fullsized":"2023-10-24T00:44:18.993846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993276+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991340+0000","last_change":"2023-10-24T00:44:18.991340+0000","last_active":"2023-10-24T00:44:18.991340+0000","last_peered":"2023-10-24T00:44:18.991340+0000","last_clean":"2023-10-24T00:44:18.991340+0000","last_became_active":"2023-10-24T00:44:18.991062+0000","last_became_peered":"2023-10-24T00:44:18.991062+0000","last_unstale":"2023-10-24T00:44:18.991340+0000","last_undegraded":"2023-10-24T00:44:18.991340+0000","last_fullsized":"2023-10-24T00:44:18.991340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983961+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001116+0000","last_change":"2023-10-24T00:44:19.001116+0000","last_active":"2023-10-24T00:44:19.001116+0000","last_peered":"2023-10-24T00:44:19.001116+0000","last_clean":"2023-10-24T00:44:19.001116+0000","last_became_active":"2023-10-24T00:44:19.000863+0000","last_became_peered":"2023-10-24T00:44:19.000863+0000","last_unstale":"2023-10-24T00:44:19.001116+0000","last_undegraded":"2023-10-24T00:44:19.001116+0000","last_fullsized":"2023-10-24T00:44:19.001116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983845+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994598+0000","last_change":"2023-10-24T00:44:18.994598+0000","last_active":"2023-10-24T00:44:18.994598+0000","last_peered":"2023-10-24T00:44:18.994598+0000","last_clean":"2023-10-24T00:44:18.994598+0000","last_became_active":"2023-10-24T00:44:18.994336+0000","last_became_peered":"2023-10-24T00:44:18.994336+0000","last_unstale":"2023-10-24T00:44:18.994598+0000","last_undegraded":"2023-10-24T00:44:18.994598+0000","last_fullsized":"2023-10-24T00:44:18.994598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984665+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999007+0000","last_change":"2023-10-24T00:44:18.999007+0000","last_active":"2023-10-24T00:44:18.999007+0000","last_peered":"2023-10-24T00:44:18.999007+0000","last_clean":"2023-10-24T00:44:18.999007+0000","last_became_active":"2023-10-24T00:44:18.998780+0000","last_became_peered":"2023-10-24T00:44:18.998780+0000","last_unstale":"2023-10-24T00:44:18.999007+0000","last_undegraded":"2023-10-24T00:44:18.999007+0000","last_fullsized":"2023-10-24T00:44:18.999007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979461+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002466+0000","last_change":"2023-10-24T00:44:19.002466+0000","last_active":"2023-10-24T00:44:19.002466+0000","last_peered":"2023-10-24T00:44:19.002466+0000","last_clean":"2023-10-24T00:44:19.002466+0000","last_became_active":"2023-10-24T00:44:19.002207+0000","last_became_peered":"2023-10-24T00:44:19.002207+0000","last_unstale":"2023-10-24T00:44:19.002466+0000","last_undegraded":"2023-10-24T00:44:19.002466+0000","last_fullsized":"2023-10-24T00:44:19.002466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982544+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.986943+0000","last_change":"2023-10-24T00:44:18.986943+0000","last_active":"2023-10-24T00:44:18.986943+0000","last_peered":"2023-10-24T00:44:18.986943+0000","last_clean":"2023-10-24T00:44:18.986943+0000","last_became_active":"2023-10-24T00:44:18.986663+0000","last_became_peered":"2023-10-24T00:44:18.986663+0000","last_unstale":"2023-10-24T00:44:18.986943+0000","last_undegraded":"2023-10-24T00:44:18.986943+0000","last_fullsized":"2023-10-24T00:44:18.986943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983294+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.988568+0000","last_change":"2023-10-24T00:44:18.988568+0000","last_active":"2023-10-24T00:44:18.988568+0000","last_peered":"2023-10-24T00:44:18.988568+0000","last_clean":"2023-10-24T00:44:18.988568+0000","last_became_active":"2023-10-24T00:44:18.988285+0000","last_became_peered":"2023-10-24T00:44:18.988285+0000","last_unstale":"2023-10-24T00:44:18.988568+0000","last_undegraded":"2023-10-24T00:44:18.988568+0000","last_fullsized":"2023-10-24T00:44:18.988568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990408+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001732+0000","last_change":"2023-10-24T00:44:19.001732+0000","last_active":"2023-10-24T00:44:19.001732+0000","last_peered":"2023-10-24T00:44:19.001732+0000","last_clean":"2023-10-24T00:44:19.001732+0000","last_became_active":"2023-10-24T00:44:19.001421+0000","last_became_peered":"2023-10-24T00:44:19.001421+0000","last_unstale":"2023-10-24T00:44:19.001732+0000","last_undegraded":"2023-10-24T00:44:19.001732+0000","last_fullsized":"2023-10-24T00:44:19.001732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986105+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002313+0000","last_change":"2023-10-24T00:44:19.002313+0000","last_active":"2023-10-24T00:44:19.002313+0000","last_peered":"2023-10-24T00:44:19.002313+0000","last_clean":"2023-10-24T00:44:19.002313+0000","last_became_active":"2023-10-24T00:44:19.002038+0000","last_became_peered":"2023-10-24T00:44:19.002038+0000","last_unstale":"2023-10-24T00:44:19.002313+0000","last_undegraded":"2023-10-24T00:44:19.002313+0000","last_fullsized":"2023-10-24T00:44:19.002313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990466+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998777+0000","last_change":"2023-10-24T00:44:18.998777+0000","last_active":"2023-10-24T00:44:18.998777+0000","last_peered":"2023-10-24T00:44:18.998777+0000","last_clean":"2023-10-24T00:44:18.998777+0000","last_became_active":"2023-10-24T00:44:18.998456+0000","last_became_peered":"2023-10-24T00:44:18.998456+0000","last_unstale":"2023-10-24T00:44:18.998777+0000","last_undegraded":"2023-10-24T00:44:18.998777+0000","last_fullsized":"2023-10-24T00:44:18.998777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982731+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995473+0000","last_change":"2023-10-24T00:44:18.995473+0000","last_active":"2023-10-24T00:44:18.995473+0000","last_peered":"2023-10-24T00:44:18.995473+0000","last_clean":"2023-10-24T00:44:18.995473+0000","last_became_active":"2023-10-24T00:44:18.995177+0000","last_became_peered":"2023-10-24T00:44:18.995177+0000","last_unstale":"2023-10-24T00:44:18.995473+0000","last_undegraded":"2023-10-24T00:44:18.995473+0000","last_fullsized":"2023-10-24T00:44:18.995473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979191+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994564+0000","last_change":"2023-10-24T00:44:18.994564+0000","last_active":"2023-10-24T00:44:18.994564+0000","last_peered":"2023-10-24T00:44:18.994564+0000","last_clean":"2023-10-24T00:44:18.994564+0000","last_became_active":"2023-10-24T00:44:18.994259+0000","last_became_peered":"2023-10-24T00:44:18.994259+0000","last_unstale":"2023-10-24T00:44:18.994564+0000","last_undegraded":"2023-10-24T00:44:18.994564+0000","last_fullsized":"2023-10-24T00:44:18.994564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983432+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000062+0000","last_change":"2023-10-24T00:44:19.000062+0000","last_active":"2023-10-24T00:44:19.000062+0000","last_peered":"2023-10-24T00:44:19.000062+0000","last_clean":"2023-10-24T00:44:19.000062+0000","last_became_active":"2023-10-24T00:44:18.999667+0000","last_became_peered":"2023-10-24T00:44:18.999667+0000","last_unstale":"2023-10-24T00:44:19.000062+0000","last_undegraded":"2023-10-24T00:44:19.000062+0000","last_fullsized":"2023-10-24T00:44:19.000062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985584+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995307+0000","last_change":"2023-10-24T00:44:18.995307+0000","last_active":"2023-10-24T00:44:18.995307+0000","last_peered":"2023-10-24T00:44:18.995307+0000","last_clean":"2023-10-24T00:44:18.995307+0000","last_became_active":"2023-10-24T00:44:18.994003+0000","last_became_peered":"2023-10-24T00:44:18.994003+0000","last_unstale":"2023-10-24T00:44:18.995307+0000","last_undegraded":"2023-10-24T00:44:18.995307+0000","last_fullsized":"2023-10-24T00:44:18.995307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986045+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996786+0000","last_change":"2023-10-24T00:44:18.996786+0000","last_active":"2023-10-24T00:44:18.996786+0000","last_peered":"2023-10-24T00:44:18.996786+0000","last_clean":"2023-10-24T00:44:18.996786+0000","last_became_active":"2023-10-24T00:44:18.996212+0000","last_became_peered":"2023-10-24T00:44:18.996212+0000","last_unstale":"2023-10-24T00:44:18.996786+0000","last_undegraded":"2023-10-24T00:44:18.996786+0000","last_fullsized":"2023-10-24T00:44:18.996786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003506+0000","last_change":"2023-10-24T00:44:19.003506+0000","last_active":"2023-10-24T00:44:19.003506+0000","last_peered":"2023-10-24T00:44:19.003506+0000","last_clean":"2023-10-24T00:44:19.003506+0000","last_became_active":"2023-10-24T00:44:19.003226+0000","last_became_peered":"2023-10-24T00:44:19.003226+0000","last_unstale":"2023-10-24T00:44:19.003506+0000","last_undegraded":"2023-10-24T00:44:19.003506+0000","last_fullsized":"2023-10-24T00:44:19.003506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979990+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987366+0000","last_change":"2023-10-24T00:44:18.987366+0000","last_active":"2023-10-24T00:44:18.987366+0000","last_peered":"2023-10-24T00:44:18.987366+0000","last_clean":"2023-10-24T00:44:18.987366+0000","last_became_active":"2023-10-24T00:44:18.987107+0000","last_became_peered":"2023-10-24T00:44:18.987107+0000","last_unstale":"2023-10-24T00:44:18.987366+0000","last_undegraded":"2023-10-24T00:44:18.987366+0000","last_fullsized":"2023-10-24T00:44:18.987366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981346+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997611+0000","last_change":"2023-10-24T00:44:18.997611+0000","last_active":"2023-10-24T00:44:18.997611+0000","last_peered":"2023-10-24T00:44:18.997611+0000","last_clean":"2023-10-24T00:44:18.997611+0000","last_became_active":"2023-10-24T00:44:18.997316+0000","last_became_peered":"2023-10-24T00:44:18.997316+0000","last_unstale":"2023-10-24T00:44:18.997611+0000","last_undegraded":"2023-10-24T00:44:18.997611+0000","last_fullsized":"2023-10-24T00:44:18.997611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998858+0000","last_change":"2023-10-24T00:44:18.998858+0000","last_active":"2023-10-24T00:44:18.998858+0000","last_peered":"2023-10-24T00:44:18.998858+0000","last_clean":"2023-10-24T00:44:18.998858+0000","last_became_active":"2023-10-24T00:44:18.998489+0000","last_became_peered":"2023-10-24T00:44:18.998489+0000","last_unstale":"2023-10-24T00:44:18.998858+0000","last_undegraded":"2023-10-24T00:44:18.998858+0000","last_fullsized":"2023-10-24T00:44:18.998858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985113+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997086+0000","last_change":"2023-10-24T00:44:18.997086+0000","last_active":"2023-10-24T00:44:18.997086+0000","last_peered":"2023-10-24T00:44:18.997086+0000","last_clean":"2023-10-24T00:44:18.997086+0000","last_became_active":"2023-10-24T00:44:18.996790+0000","last_became_peered":"2023-10-24T00:44:18.996790+0000","last_unstale":"2023-10-24T00:44:18.997086+0000","last_undegraded":"2023-10-24T00:44:18.997086+0000","last_fullsized":"2023-10-24T00:44:18.997086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984952+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996828+0000","last_change":"2023-10-24T00:44:18.996828+0000","last_active":"2023-10-24T00:44:18.996828+0000","last_peered":"2023-10-24T00:44:18.996828+0000","last_clean":"2023-10-24T00:44:18.996828+0000","last_became_active":"2023-10-24T00:44:18.996571+0000","last_became_peered":"2023-10-24T00:44:18.996571+0000","last_unstale":"2023-10-24T00:44:18.996828+0000","last_undegraded":"2023-10-24T00:44:18.996828+0000","last_fullsized":"2023-10-24T00:44:18.996828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982112+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998001+0000","last_change":"2023-10-24T00:44:18.998001+0000","last_active":"2023-10-24T00:44:18.998001+0000","last_peered":"2023-10-24T00:44:18.998001+0000","last_clean":"2023-10-24T00:44:18.998001+0000","last_became_active":"2023-10-24T00:44:18.997726+0000","last_became_peered":"2023-10-24T00:44:18.997726+0000","last_unstale":"2023-10-24T00:44:18.998001+0000","last_undegraded":"2023-10-24T00:44:18.998001+0000","last_fullsized":"2023-10-24T00:44:18.998001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.992639+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987755+0000","last_change":"2023-10-24T00:44:18.987755+0000","last_active":"2023-10-24T00:44:18.987755+0000","last_peered":"2023-10-24T00:44:18.987755+0000","last_clean":"2023-10-24T00:44:18.987755+0000","last_became_active":"2023-10-24T00:44:18.987473+0000","last_became_peered":"2023-10-24T00:44:18.987473+0000","last_unstale":"2023-10-24T00:44:18.987755+0000","last_undegraded":"2023-10-24T00:44:18.987755+0000","last_fullsized":"2023-10-24T00:44:18.987755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982631+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997838+0000","last_change":"2023-10-24T00:44:18.997838+0000","last_active":"2023-10-24T00:44:18.997838+0000","last_peered":"2023-10-24T00:44:18.997838+0000","last_clean":"2023-10-24T00:44:18.997838+0000","last_became_active":"2023-10-24T00:44:18.997228+0000","last_became_peered":"2023-10-24T00:44:18.997228+0000","last_unstale":"2023-10-24T00:44:18.997838+0000","last_undegraded":"2023-10-24T00:44:18.997838+0000","last_fullsized":"2023-10-24T00:44:18.997838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986832+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002540+0000","last_change":"2023-10-24T00:44:19.002540+0000","last_active":"2023-10-24T00:44:19.002540+0000","last_peered":"2023-10-24T00:44:19.002540+0000","last_clean":"2023-10-24T00:44:19.002540+0000","last_became_active":"2023-10-24T00:44:19.002270+0000","last_became_peered":"2023-10-24T00:44:19.002270+0000","last_unstale":"2023-10-24T00:44:19.002540+0000","last_undegraded":"2023-10-24T00:44:19.002540+0000","last_fullsized":"2023-10-24T00:44:19.002540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980802+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000438+0000","last_change":"2023-10-24T00:44:19.000438+0000","last_active":"2023-10-24T00:44:19.000438+0000","last_peered":"2023-10-24T00:44:19.000438+0000","last_clean":"2023-10-24T00:44:19.000438+0000","last_became_active":"2023-10-24T00:44:18.999186+0000","last_became_peered":"2023-10-24T00:44:18.999186+0000","last_unstale":"2023-10-24T00:44:19.000438+0000","last_undegraded":"2023-10-24T00:44:19.000438+0000","last_fullsized":"2023-10-24T00:44:19.000438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984082+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998792+0000","last_change":"2023-10-24T00:44:18.998792+0000","last_active":"2023-10-24T00:44:18.998792+0000","last_peered":"2023-10-24T00:44:18.998792+0000","last_clean":"2023-10-24T00:44:18.998792+0000","last_became_active":"2023-10-24T00:44:18.998121+0000","last_became_peered":"2023-10-24T00:44:18.998121+0000","last_unstale":"2023-10-24T00:44:18.998792+0000","last_undegraded":"2023-10-24T00:44:18.998792+0000","last_fullsized":"2023-10-24T00:44:18.998792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984232+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993303+0000","last_change":"2023-10-24T00:44:18.993303+0000","last_active":"2023-10-24T00:44:18.993303+0000","last_peered":"2023-10-24T00:44:18.993303+0000","last_clean":"2023-10-24T00:44:18.993303+0000","last_became_active":"2023-10-24T00:44:18.993034+0000","last_became_peered":"2023-10-24T00:44:18.993034+0000","last_unstale":"2023-10-24T00:44:18.993303+0000","last_undegraded":"2023-10-24T00:44:18.993303+0000","last_fullsized":"2023-10-24T00:44:18.993303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978535+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994424+0000","last_change":"2023-10-24T00:44:18.994424+0000","last_active":"2023-10-24T00:44:18.994424+0000","last_peered":"2023-10-24T00:44:18.994424+0000","last_clean":"2023-10-24T00:44:18.994424+0000","last_became_active":"2023-10-24T00:44:18.994144+0000","last_became_peered":"2023-10-24T00:44:18.994144+0000","last_unstale":"2023-10-24T00:44:18.994424+0000","last_undegraded":"2023-10-24T00:44:18.994424+0000","last_fullsized":"2023-10-24T00:44:18.994424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979288+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994274+0000","last_change":"2023-10-24T00:44:18.994274+0000","last_active":"2023-10-24T00:44:18.994274+0000","last_peered":"2023-10-24T00:44:18.994274+0000","last_clean":"2023-10-24T00:44:18.994274+0000","last_became_active":"2023-10-24T00:44:18.993980+0000","last_became_peered":"2023-10-24T00:44:18.993980+0000","last_unstale":"2023-10-24T00:44:18.994274+0000","last_undegraded":"2023-10-24T00:44:18.994274+0000","last_fullsized":"2023-10-24T00:44:18.994274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993269+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996096+0000","last_change":"2023-10-24T00:44:18.996096+0000","last_active":"2023-10-24T00:44:18.996096+0000","last_peered":"2023-10-24T00:44:18.996096+0000","last_clean":"2023-10-24T00:44:18.996096+0000","last_became_active":"2023-10-24T00:44:18.995720+0000","last_became_peered":"2023-10-24T00:44:18.995720+0000","last_unstale":"2023-10-24T00:44:18.996096+0000","last_undegraded":"2023-10-24T00:44:18.996096+0000","last_fullsized":"2023-10-24T00:44:18.996096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985632+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999502+0000","last_change":"2023-10-24T00:44:18.999502+0000","last_active":"2023-10-24T00:44:18.999502+0000","last_peered":"2023-10-24T00:44:18.999502+0000","last_clean":"2023-10-24T00:44:18.999502+0000","last_became_active":"2023-10-24T00:44:18.999191+0000","last_became_peered":"2023-10-24T00:44:18.999191+0000","last_unstale":"2023-10-24T00:44:18.999502+0000","last_undegraded":"2023-10-24T00:44:18.999502+0000","last_fullsized":"2023-10-24T00:44:18.999502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979612+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005035+0000","last_change":"2023-10-24T00:44:19.005035+0000","last_active":"2023-10-24T00:44:19.005035+0000","last_peered":"2023-10-24T00:44:19.005035+0000","last_clean":"2023-10-24T00:44:19.005035+0000","last_became_active":"2023-10-24T00:44:19.004782+0000","last_became_peered":"2023-10-24T00:44:19.004782+0000","last_unstale":"2023-10-24T00:44:19.005035+0000","last_undegraded":"2023-10-24T00:44:19.005035+0000","last_fullsized":"2023-10-24T00:44:19.005035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993054+0000","last_change":"2023-10-24T00:44:18.993054+0000","last_active":"2023-10-24T00:44:18.993054+0000","last_peered":"2023-10-24T00:44:18.993054+0000","last_clean":"2023-10-24T00:44:18.993054+0000","last_became_active":"2023-10-24T00:44:18.992750+0000","last_became_peered":"2023-10-24T00:44:18.992750+0000","last_unstale":"2023-10-24T00:44:18.993054+0000","last_undegraded":"2023-10-24T00:44:18.993054+0000","last_fullsized":"2023-10-24T00:44:18.993054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988183+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003478+0000","last_change":"2023-10-24T00:44:19.003478+0000","last_active":"2023-10-24T00:44:19.003478+0000","last_peered":"2023-10-24T00:44:19.003478+0000","last_clean":"2023-10-24T00:44:19.003478+0000","last_became_active":"2023-10-24T00:44:19.003192+0000","last_became_peered":"2023-10-24T00:44:19.003192+0000","last_unstale":"2023-10-24T00:44:19.003478+0000","last_undegraded":"2023-10-24T00:44:19.003478+0000","last_fullsized":"2023-10-24T00:44:19.003478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983783+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991279+0000","last_change":"2023-10-24T00:44:18.991279+0000","last_active":"2023-10-24T00:44:18.991279+0000","last_peered":"2023-10-24T00:44:18.991279+0000","last_clean":"2023-10-24T00:44:18.991279+0000","last_became_active":"2023-10-24T00:44:18.990733+0000","last_became_peered":"2023-10-24T00:44:18.990733+0000","last_unstale":"2023-10-24T00:44:18.991279+0000","last_undegraded":"2023-10-24T00:44:18.991279+0000","last_fullsized":"2023-10-24T00:44:18.991279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999146+0000","last_change":"2023-10-24T00:44:18.999146+0000","last_active":"2023-10-24T00:44:18.999146+0000","last_peered":"2023-10-24T00:44:18.999146+0000","last_clean":"2023-10-24T00:44:18.999146+0000","last_became_active":"2023-10-24T00:44:18.998413+0000","last_became_peered":"2023-10-24T00:44:18.998413+0000","last_unstale":"2023-10-24T00:44:18.999146+0000","last_undegraded":"2023-10-24T00:44:18.999146+0000","last_fullsized":"2023-10-24T00:44:18.999146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985680+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003962+0000","last_change":"2023-10-24T00:44:19.003962+0000","last_active":"2023-10-24T00:44:19.003962+0000","last_peered":"2023-10-24T00:44:19.003962+0000","last_clean":"2023-10-24T00:44:19.003962+0000","last_became_active":"2023-10-24T00:44:19.003238+0000","last_became_peered":"2023-10-24T00:44:19.003238+0000","last_unstale":"2023-10-24T00:44:19.003962+0000","last_undegraded":"2023-10-24T00:44:19.003962+0000","last_fullsized":"2023-10-24T00:44:19.003962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987897+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996949+0000","last_change":"2023-10-24T00:44:18.996949+0000","last_active":"2023-10-24T00:44:18.996949+0000","last_peered":"2023-10-24T00:44:18.996949+0000","last_clean":"2023-10-24T00:44:18.996949+0000","last_became_active":"2023-10-24T00:44:18.996508+0000","last_became_peered":"2023-10-24T00:44:18.996508+0000","last_unstale":"2023-10-24T00:44:18.996949+0000","last_undegraded":"2023-10-24T00:44:18.996949+0000","last_fullsized":"2023-10-24T00:44:18.996949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978371+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997143+0000","last_change":"2023-10-24T00:44:18.997143+0000","last_active":"2023-10-24T00:44:18.997143+0000","last_peered":"2023-10-24T00:44:18.997143+0000","last_clean":"2023-10-24T00:44:18.997143+0000","last_became_active":"2023-10-24T00:44:18.996829+0000","last_became_peered":"2023-10-24T00:44:18.996829+0000","last_unstale":"2023-10-24T00:44:18.997143+0000","last_undegraded":"2023-10-24T00:44:18.997143+0000","last_fullsized":"2023-10-24T00:44:18.997143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983812+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999768+0000","last_change":"2023-10-24T00:44:18.999768+0000","last_active":"2023-10-24T00:44:18.999768+0000","last_peered":"2023-10-24T00:44:18.999768+0000","last_clean":"2023-10-24T00:44:18.999768+0000","last_became_active":"2023-10-24T00:44:18.999468+0000","last_became_peered":"2023-10-24T00:44:18.999468+0000","last_unstale":"2023-10-24T00:44:18.999768+0000","last_undegraded":"2023-10-24T00:44:18.999768+0000","last_fullsized":"2023-10-24T00:44:18.999768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980255+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996209+0000","last_change":"2023-10-24T00:44:18.996209+0000","last_active":"2023-10-24T00:44:18.996209+0000","last_peered":"2023-10-24T00:44:18.996209+0000","last_clean":"2023-10-24T00:44:18.996209+0000","last_became_active":"2023-10-24T00:44:18.995918+0000","last_became_peered":"2023-10-24T00:44:18.995918+0000","last_unstale":"2023-10-24T00:44:18.996209+0000","last_undegraded":"2023-10-24T00:44:18.996209+0000","last_fullsized":"2023-10-24T00:44:18.996209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988664+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998681+0000","last_change":"2023-10-24T00:44:18.998681+0000","last_active":"2023-10-24T00:44:18.998681+0000","last_peered":"2023-10-24T00:44:18.998681+0000","last_clean":"2023-10-24T00:44:18.998681+0000","last_became_active":"2023-10-24T00:44:18.997838+0000","last_became_peered":"2023-10-24T00:44:18.997838+0000","last_unstale":"2023-10-24T00:44:18.998681+0000","last_undegraded":"2023-10-24T00:44:18.998681+0000","last_fullsized":"2023-10-24T00:44:18.998681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991597+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.990704+0000","last_change":"2023-10-24T00:44:18.990704+0000","last_active":"2023-10-24T00:44:18.990704+0000","last_peered":"2023-10-24T00:44:18.990704+0000","last_clean":"2023-10-24T00:44:18.990704+0000","last_became_active":"2023-10-24T00:44:18.990361+0000","last_became_peered":"2023-10-24T00:44:18.990361+0000","last_unstale":"2023-10-24T00:44:18.990704+0000","last_undegraded":"2023-10-24T00:44:18.990704+0000","last_fullsized":"2023-10-24T00:44:18.990704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990323+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999336+0000","last_change":"2023-10-24T00:44:18.999336+0000","last_active":"2023-10-24T00:44:18.999336+0000","last_peered":"2023-10-24T00:44:18.999336+0000","last_clean":"2023-10-24T00:44:18.999336+0000","last_became_active":"2023-10-24T00:44:18.998739+0000","last_became_peered":"2023-10-24T00:44:18.998739+0000","last_unstale":"2023-10-24T00:44:18.999336+0000","last_undegraded":"2023-10-24T00:44:18.999336+0000","last_fullsized":"2023-10-24T00:44:18.999336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981493+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987757+0000","last_change":"2023-10-24T00:44:18.987757+0000","last_active":"2023-10-24T00:44:18.987757+0000","last_peered":"2023-10-24T00:44:18.987757+0000","last_clean":"2023-10-24T00:44:18.987757+0000","last_became_active":"2023-10-24T00:44:18.987454+0000","last_became_peered":"2023-10-24T00:44:18.987454+0000","last_unstale":"2023-10-24T00:44:18.987757+0000","last_undegraded":"2023-10-24T00:44:18.987757+0000","last_fullsized":"2023-10-24T00:44:18.987757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978024+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995961+0000","last_change":"2023-10-24T00:44:18.995961+0000","last_active":"2023-10-24T00:44:18.995961+0000","last_peered":"2023-10-24T00:44:18.995961+0000","last_clean":"2023-10-24T00:44:18.995961+0000","last_became_active":"2023-10-24T00:44:18.995687+0000","last_became_peered":"2023-10-24T00:44:18.995687+0000","last_unstale":"2023-10-24T00:44:18.995961+0000","last_undegraded":"2023-10-24T00:44:18.995961+0000","last_fullsized":"2023-10-24T00:44:18.995961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978946+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999552+0000","last_change":"2023-10-24T00:44:18.999552+0000","last_active":"2023-10-24T00:44:18.999552+0000","last_peered":"2023-10-24T00:44:18.999552+0000","last_clean":"2023-10-24T00:44:18.999552+0000","last_became_active":"2023-10-24T00:44:18.999258+0000","last_became_peered":"2023-10-24T00:44:18.999258+0000","last_unstale":"2023-10-24T00:44:18.999552+0000","last_undegraded":"2023-10-24T00:44:18.999552+0000","last_fullsized":"2023-10-24T00:44:18.999552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983055+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995213+0000","last_change":"2023-10-24T00:44:18.995213+0000","last_active":"2023-10-24T00:44:18.995213+0000","last_peered":"2023-10-24T00:44:18.995213+0000","last_clean":"2023-10-24T00:44:18.995213+0000","last_became_active":"2023-10-24T00:44:18.994931+0000","last_became_peered":"2023-10-24T00:44:18.994931+0000","last_unstale":"2023-10-24T00:44:18.995213+0000","last_undegraded":"2023-10-24T00:44:18.995213+0000","last_fullsized":"2023-10-24T00:44:18.995213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975423+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:17.975423+0000","last_peered":"2023-10-24T00:44:17.975423+0000","last_clean":"2023-10-24T00:44:17.975423+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:17.975423+0000","last_undegraded":"2023-10-24T00:44:17.975423+0000","last_fullsized":"2023-10-24T00:44:17.975423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986924+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999384+0000","last_change":"2023-10-24T00:44:18.999384+0000","last_active":"2023-10-24T00:44:18.999384+0000","last_peered":"2023-10-24T00:44:18.999384+0000","last_clean":"2023-10-24T00:44:18.999384+0000","last_became_active":"2023-10-24T00:44:18.999120+0000","last_became_peered":"2023-10-24T00:44:18.999120+0000","last_unstale":"2023-10-24T00:44:18.999384+0000","last_undegraded":"2023-10-24T00:44:18.999384+0000","last_fullsized":"2023-10-24T00:44:18.999384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974142+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:17.974142+0000","last_peered":"2023-10-24T00:44:17.974142+0000","last_clean":"2023-10-24T00:44:17.974142+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:17.974142+0000","last_undegraded":"2023-10-24T00:44:17.974142+0000","last_fullsized":"2023-10-24T00:44:17.974142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988657+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000031+0000","last_change":"2023-10-24T00:44:19.000031+0000","last_active":"2023-10-24T00:44:19.000031+0000","last_peered":"2023-10-24T00:44:19.000031+0000","last_clean":"2023-10-24T00:44:19.000031+0000","last_became_active":"2023-10-24T00:44:18.999739+0000","last_became_peered":"2023-10-24T00:44:18.999739+0000","last_unstale":"2023-10-24T00:44:19.000031+0000","last_undegraded":"2023-10-24T00:44:19.000031+0000","last_fullsized":"2023-10-24T00:44:19.000031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.970712+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:17.970712+0000","last_peered":"2023-10-24T00:44:17.970712+0000","last_clean":"2023-10-24T00:44:17.970712+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:17.970712+0000","last_undegraded":"2023-10-24T00:44:17.970712+0000","last_fullsized":"2023-10-24T00:44:17.970712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988206+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995012+0000","last_change":"2023-10-24T00:44:18.995012+0000","last_active":"2023-10-24T00:44:18.995012+0000","last_peered":"2023-10-24T00:44:18.995012+0000","last_clean":"2023-10-24T00:44:18.995012+0000","last_became_active":"2023-10-24T00:44:18.994740+0000","last_became_peered":"2023-10-24T00:44:18.994740+0000","last_unstale":"2023-10-24T00:44:18.995012+0000","last_undegraded":"2023-10-24T00:44:18.995012+0000","last_fullsized":"2023-10-24T00:44:18.995012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974149+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:17.974149+0000","last_peered":"2023-10-24T00:44:17.974149+0000","last_clean":"2023-10-24T00:44:17.974149+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:17.974149+0000","last_undegraded":"2023-10-24T00:44:17.974149+0000","last_fullsized":"2023-10-24T00:44:17.974149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974688+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:17.974688+0000","last_peered":"2023-10-24T00:44:17.974688+0000","last_clean":"2023-10-24T00:44:17.974688+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:17.974688+0000","last_undegraded":"2023-10-24T00:44:17.974688+0000","last_fullsized":"2023-10-24T00:44:17.974688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982974+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997386+0000","last_change":"2023-10-24T00:44:18.997386+0000","last_active":"2023-10-24T00:44:18.997386+0000","last_peered":"2023-10-24T00:44:18.997386+0000","last_clean":"2023-10-24T00:44:18.997386+0000","last_became_active":"2023-10-24T00:44:18.997004+0000","last_became_peered":"2023-10-24T00:44:18.997004+0000","last_unstale":"2023-10-24T00:44:18.997386+0000","last_undegraded":"2023-10-24T00:44:18.997386+0000","last_fullsized":"2023-10-24T00:44:18.997386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974809+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:17.974809+0000","last_peered":"2023-10-24T00:44:17.974809+0000","last_clean":"2023-10-24T00:44:17.974809+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:17.974809+0000","last_undegraded":"2023-10-24T00:44:17.974809+0000","last_fullsized":"2023-10-24T00:44:17.974809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990044+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001810+0000","last_change":"2023-10-24T00:44:19.001810+0000","last_active":"2023-10-24T00:44:19.001810+0000","last_peered":"2023-10-24T00:44:19.001810+0000","last_clean":"2023-10-24T00:44:19.001810+0000","last_became_active":"2023-10-24T00:44:19.001524+0000","last_became_peered":"2023-10-24T00:44:19.001524+0000","last_unstale":"2023-10-24T00:44:19.001810+0000","last_undegraded":"2023-10-24T00:44:19.001810+0000","last_fullsized":"2023-10-24T00:44:19.001810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975087+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:17.975087+0000","last_peered":"2023-10-24T00:44:17.975087+0000","last_clean":"2023-10-24T00:44:17.975087+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:17.975087+0000","last_undegraded":"2023-10-24T00:44:17.975087+0000","last_fullsized":"2023-10-24T00:44:17.975087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982321+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005142+0000","last_change":"2023-10-24T00:44:19.005142+0000","last_active":"2023-10-24T00:44:19.005142+0000","last_peered":"2023-10-24T00:44:19.005142+0000","last_clean":"2023-10-24T00:44:19.005142+0000","last_became_active":"2023-10-24T00:44:19.004839+0000","last_became_peered":"2023-10-24T00:44:19.004839+0000","last_unstale":"2023-10-24T00:44:19.005142+0000","last_undegraded":"2023-10-24T00:44:19.005142+0000","last_fullsized":"2023-10-24T00:44:19.005142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975438+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:17.975438+0000","last_peered":"2023-10-24T00:44:17.975438+0000","last_clean":"2023-10-24T00:44:17.975438+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:17.975438+0000","last_undegraded":"2023-10-24T00:44:17.975438+0000","last_fullsized":"2023-10-24T00:44:17.975438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987260+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992422+0000","last_change":"2023-10-24T00:44:18.992422+0000","last_active":"2023-10-24T00:44:18.992422+0000","last_peered":"2023-10-24T00:44:18.992422+0000","last_clean":"2023-10-24T00:44:18.992422+0000","last_became_active":"2023-10-24T00:44:18.992112+0000","last_became_peered":"2023-10-24T00:44:18.992112+0000","last_unstale":"2023-10-24T00:44:18.992422+0000","last_undegraded":"2023-10-24T00:44:18.992422+0000","last_fullsized":"2023-10-24T00:44:18.992422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.976468+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:17.976468+0000","last_peered":"2023-10-24T00:44:17.976468+0000","last_clean":"2023-10-24T00:44:17.976468+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:17.976468+0000","last_undegraded":"2023-10-24T00:44:17.976468+0000","last_fullsized":"2023-10-24T00:44:17.976468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":471055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.65700000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.498,"5min":0.46700000000000003,"15min":0.32600000000000001},"max":{"1min":0.753,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.246,"15min":0.246},"max":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.40699999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56299999999999994,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":4.351,"15min":4.351},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.83299999999999996},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.495}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.48099999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.439}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.499},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.374}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.34300000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33800000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.376}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.433}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.5}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.59199999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.625}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:23.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-10-24T00:44:23.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983042+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-10-24T00:44:23.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982818+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-10-24T00:44:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979781+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-10-24T00:44:23.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.981364+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-10-24T00:44:23.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985085+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-10-24T00:44:23.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979743+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:23.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-10-24T00:44:23.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983671+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:23.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-10-24T00:44:23.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.988617+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-10-24T00:44:23.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.993276+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-10-24T00:44:23.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983961+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-10-24T00:44:23.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983845+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-10-24T00:44:23.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.984665+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-10-24T00:44:23.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979461+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:23.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-10-24T00:44:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982544+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-10-24T00:44:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983294+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-10-24T00:44:23.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.990408+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-10-24T00:44:23.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.986105+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:23.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-10-24T00:44:23.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.990466+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-10-24T00:44:23.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982731+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-10-24T00:44:23.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979191+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-10-24T00:44:23.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983432+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-10-24T00:44:23.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985584+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:23.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-10-24T00:44:23.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.986045+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:23.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-10-24T00:44:23.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985969+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-10-24T00:44:23.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979990+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-10-24T00:44:23.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.981346+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-10-24T00:44:23.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.991969+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-10-24T00:44:23.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985113+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-10-24T00:44:23.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.984952+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:23.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-10-24T00:44:23.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982112+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-10-24T00:44:23.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.992639+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-10-24T00:44:23.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982631+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-24T00:44:23.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.986832+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-24T00:44:23.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.980802+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-24T00:44:23.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.984082+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:23.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-24T00:44:23.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.984232+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-24T00:44:23.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.978535+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:23.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-24T00:44:23.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979288+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-24T00:44:23.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.993269+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-24T00:44:23.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985632+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:23.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-24T00:44:23.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.979612+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-24T00:44:23.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985600+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:23.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-24T00:44:23.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.988183+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-24T00:44:23.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983783+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-24T00:44:23.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.981600+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-24T00:44:23.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.985680+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-24T00:44:23.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.987897+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-24T00:44:23.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.978371+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-24T00:44:23.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983812+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:23.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-24T00:44:23.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.980255+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:23.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-24T00:44:23.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.988664+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-24T00:44:23.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.991597+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-24T00:44:23.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.990323+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-24T00:44:23.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.981493+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-24T00:44:23.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.978024+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:23.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-24T00:44:23.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.978946+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:23.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-24T00:44:23.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.983055+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:23.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-24T00:44:23.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.986924+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-24T00:44:23.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.988657+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:23.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-24T00:44:23.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.988206+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-24T00:44:23.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982974+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:23.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-24T00:44:23.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.990044+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-24T00:44:23.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.982321+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:23.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-24T00:44:23.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:18.969466+0000', 'last_change': '2023-10-24T00:44:18.987260+0000', 'last_active': '2023-10-24T00:44:18.969466+0000', 'last_peered': '2023-10-24T00:44:18.969466+0000', 'last_clean': '2023-10-24T00:44:18.969466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:18.969466+0000', 'last_undegraded': '2023-10-24T00:44:18.969466+0000', 'last_fullsized': '2023-10-24T00:44:18.969466+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:18.969466+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:23.085 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:44:23.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.195+0000 7f4bf426d700 1 Processor -- start 2023-10-24T00:44:23.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.195+0000 7f4bf426d700 1 -- start start 2023-10-24T00:44:23.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.196+0000 7f4bf426d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4bec152240 0x7f4bec0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.196+0000 7f4bf426d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.196+0000 7f4bf426d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0a8710 con 0x7f4bec0be740 2023-10-24T00:44:23.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.196+0000 7f4bf426d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0c45f0 con 0x7f4bec152240 2023-10-24T00:44:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.196+0000 7f4bf426d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c5190 con 0x7f4bec0a7d70 2023-10-24T00:44:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf280a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4bec152240 0x7f4bec0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf280a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:54638/0 (socket says 172.21.15.148:54638) 2023-10-24T00:44:23.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf280a700 1 -- 172.21.15.148:0/167434894 learned_addr learned my addr 172.21.15.148:0/167434894 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 -- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 msgr2=0x7f4bec0a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 -- 172.21.15.148:0/167434894 >> v1:172.21.15.150:6789/0 conn(0x7f4bec0be740 legacy=0x7f4bec0c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 -- 172.21.15.148:0/167434894 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0bef90 con 0x7f4bec152240 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf280a700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:23.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.197+0000 7f4bf2009700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec152240 0x7f4bec0c6480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4bdc009e60 tx=0x7f4bdc009780).ready entity=mon.1 client_cookie=9679935e35905ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf1007700 1 -- 172.21.15.148:0/167434894 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00e070 con 0x7f4bec152240 2023-10-24T00:44:23.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf1007700 1 -- 172.21.15.148:0/167434894 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00bb60 con 0x7f4bec152240 2023-10-24T00:44:23.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf1007700 1 -- 172.21.15.148:0/167434894 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc012410 con 0x7f4bec152240 2023-10-24T00:44:23.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 -- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec152240 msgr2=0x7f4bec0c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec152240 0x7f4bec0c6480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f4bdc009e60 tx=0x7f4bdc009780).stop 2023-10-24T00:44:23.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 -- 172.21.15.148:0/167434894 shutdown_connections 2023-10-24T00:44:23.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0a7d70 0x7f4bec0a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 --2- 172.21.15.148:0/167434894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec152240 0x7f4bec0c6480 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 -- 172.21.15.148:0/167434894 >> 172.21.15.148:0/167434894 conn(0x7f4bec082f60 msgr2=0x7f4bec062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 -- 172.21.15.148:0/167434894 shutdown_connections 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.198+0000 7f4bf426d700 1 -- 172.21.15.148:0/167434894 wait complete. 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.199+0000 7f4bf426d700 1 Processor -- start 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.199+0000 7f4bf426d700 1 -- start start 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec0a7d70 0x7f4bec0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0be740 0x7f4bec144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c8ad0 con 0x7f4bec152240 2023-10-24T00:44:23.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec14b1e0 con 0x7f4bec0a7d70 2023-10-24T00:44:23.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf426d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0c9550 con 0x7f4bec0be740 2023-10-24T00:44:23.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57518/0 (socket says 172.21.15.148:57518) 2023-10-24T00:44:23.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 -- 172.21.15.148:0/3256338114 learned_addr learned my addr 172.21.15.148:0/3256338114 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:23.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf2009700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec0a7d70 0x7f4bec0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf1808700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0be740 0x7f4bec144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 -- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0be740 msgr2=0x7f4bec144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0be740 0x7f4bec144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 -- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec0a7d70 msgr2=0x7f4bec0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec0a7d70 0x7f4bec0c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.200+0000 7f4bf280a700 1 -- 172.21.15.148:0/3256338114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009370 con 0x7f4bec152240 2023-10-24T00:44:23.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bf280a700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f4be400e8e0 tx=0x7f4be40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be400ee80 con 0x7f4bec152240 2023-10-24T00:44:23.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be400c850 con 0x7f4bec152240 2023-10-24T00:44:23.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc009a20 con 0x7f4bec152240 2023-10-24T00:44:23.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be400cbf0 con 0x7f4bec152240 2023-10-24T00:44:23.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.201+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec0c9270 con 0x7f4bec152240 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.202+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec06c6b0 con 0x7f4bec152240 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.202+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4be401b400 con 0x7f4bec152240 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.202+0000 7f4bea7fc700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 0x7f4bd8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.203+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4be407a980 con 0x7f4bec152240 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.203+0000 7f4bf2009700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 0x7f4bd8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.203+0000 7f4bf2009700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 0x7f4bd8061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4bdc009fd0 tx=0x7f4bdc009780).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.207+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4be404ba70 con 0x7f4bec152240 2023-10-24T00:44:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.438+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4bec0bf270 con 0x7f4bec152240 2023-10-24T00:44:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.438+0000 7f4bea7fc700 1 -- 172.21.15.148:0/3256338114 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7f4be4016020 con 0x7f4bec152240 2023-10-24T00:44:23.440 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:23.440 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":947,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2470686720,"bytes_avail":770623426560,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":25,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6309}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-24T00:43:09.408742+0000","services":{}},"progress_events":{}} 2023-10-24T00:44:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 msgr2=0x7f4bd8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 0x7f4bd8061700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4bdc009fd0 tx=0x7f4bdc009780).stop 2023-10-24T00:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 msgr2=0x7f4bec14e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f4be400e8e0 tx=0x7f4be40090f0).stop 2023-10-24T00:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 shutdown_connections 2023-10-24T00:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4bd805f240 0x7f4bd8061700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bec152240 0x7f4bec14e620 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bec0a7d70 0x7f4bec0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 --2- 172.21.15.148:0/3256338114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bec0be740 0x7f4bec144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 >> 172.21.15.148:0/3256338114 conn(0x7f4bec082f60 msgr2=0x7f4bec0ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:23.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 shutdown_connections 2023-10-24T00:44:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.440+0000 7f4bf426d700 1 -- 172.21.15.148:0/3256338114 wait complete. 2023-10-24T00:44:23.453 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:44:23.453 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.566+0000 7f077559d700 1 Processor -- start 2023-10-24T00:44:23.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.566+0000 7f077559d700 1 -- start start 2023-10-24T00:44:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f077559d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0770062810 0x7f0770062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f077559d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700a6f70 0x7f0770151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f077559d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077006a160 con 0x7f07701554c0 2023-10-24T00:44:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f077559d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07700650f0 con 0x7f0770062810 2023-10-24T00:44:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f077559d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0770069550 con 0x7f07700a6f70 2023-10-24T00:44:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f076ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0770062810 0x7f0770062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f076ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0770062810 0x7f0770062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40534/0 (socket says 172.21.15.148:40534) 2023-10-24T00:44:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f076f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f07701554c0 0x7f07700a6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60914/0 (socket says 172.21.15.148:60914) 2023-10-24T00:44:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.567+0000 7f076ffff700 1 -- 172.21.15.148:0/2391700143 learned_addr learned my addr 172.21.15.148:0/2391700143 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f0774d9c700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700a6f70 0x7f0770151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076ffff700 1 -- 172.21.15.148:0/2391700143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700a6f70 msgr2=0x7f0770151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:23.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076ffff700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700a6f70 0x7f0770151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076ffff700 1 -- 172.21.15.148:0/2391700143 >> v1:172.21.15.148:6789/0 conn(0x7f07701554c0 legacy=0x7f07700a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076effd700 1 -- 172.21.15.148:0/2391700143 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109873042 0 0) 0x7f077006a160 con 0x7f07701554c0 2023-10-24T00:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076ffff700 1 -- 172.21.15.148:0/2391700143 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770069830 con 0x7f0770062810 2023-10-24T00:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076ffff700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0770062810 0x7f0770062bf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0760006fd0 tx=0x7f07600090f0).ready entity=mon.0 client_cookie=6f8da56c3a99cfe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076effd700 1 -- 172.21.15.148:0/2391700143 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000b600 con 0x7f0770062810 2023-10-24T00:44:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076effd700 1 -- 172.21.15.148:0/2391700143 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000b760 con 0x7f0770062810 2023-10-24T00:44:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f076effd700 1 -- 172.21.15.148:0/2391700143 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000bae0 con 0x7f0770062810 2023-10-24T00:44:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f077559d700 1 -- 172.21.15.148:0/2391700143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0770062810 msgr2=0x7f0770062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f077559d700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0770062810 0x7f0770062bf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f0760006fd0 tx=0x7f07600090f0).stop 2023-10-24T00:44:23.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f077559d700 1 -- 172.21.15.148:0/2391700143 shutdown_connections 2023-10-24T00:44:23.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f077559d700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700a6f70 0x7f0770151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.568+0000 7f077559d700 1 --2- 172.21.15.148:0/2391700143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0770062810 0x7f0770062bf0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.569+0000 7f077559d700 1 -- 172.21.15.148:0/2391700143 >> 172.21.15.148:0/2391700143 conn(0x7f07700c7ad0 msgr2=0x7f07700c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:23.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.569+0000 7f077559d700 1 -- 172.21.15.148:0/2391700143 shutdown_connections 2023-10-24T00:44:23.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.569+0000 7f077559d700 1 -- 172.21.15.148:0/2391700143 wait complete. 2023-10-24T00:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.570+0000 7f077559d700 1 Processor -- start 2023-10-24T00:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.570+0000 7f077559d700 1 -- start start 2023-10-24T00:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.570+0000 7f077559d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 0x7f0770153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.570+0000 7f077559d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 0x7f07700c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07700c3540 con 0x7f07700a6f70 2023-10-24T00:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07700c3820 con 0x7f0770062810 2023-10-24T00:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07700c3b00 con 0x7f07701554c0 2023-10-24T00:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40546/0 (socket says 172.21.15.148:40546) 2023-10-24T00:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 -- 172.21.15.148:0/3104528543 learned_addr learned my addr 172.21.15.148:0/3104528543 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f0774d9c700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 0x7f07700c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 -- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 msgr2=0x7f07700c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076ffff700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 0x7f0770153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 0x7f07700c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 -- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 msgr2=0x7f0770153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 0x7f0770153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 -- 172.21.15.148:0/3104528543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009370 con 0x7f07700a6f70 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f0774d9c700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 0x7f07700c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076ffff700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 0x7f0770153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:23.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f076f7fe700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f076400c440 tx=0x7f0764007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640072e0 con 0x7f07700a6f70 2023-10-24T00:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764007440 con 0x7f07700a6f70 2023-10-24T00:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07700c3de0 con 0x7f07700a6f70 2023-10-24T00:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764005910 con 0x7f07700a6f70 2023-10-24T00:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.571+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07700a7820 con 0x7f07700a6f70 2023-10-24T00:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.572+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0770047480 con 0x7f07700a6f70 2023-10-24T00:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.572+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0764005d00 con 0x7f07700a6f70 2023-10-24T00:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.573+0000 7f0757fff700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.573+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0764079a90 con 0x7f07700a6f70 2023-10-24T00:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.573+0000 7f076ffff700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.574+0000 7f076ffff700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0760006fd0 tx=0x7f0760017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.577+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f076404abe0 con 0x7f07700a6f70 2023-10-24T00:44:23.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.736+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07700c3680 con 0x7f075c05f270 2023-10-24T00:44:23.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.746+0000 7f0757fff700 1 -- 172.21.15.148:0/3104528543 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358636 (secure 0 0 0) 0x7f07700c3680 con 0x7f075c05f270 2023-10-24T00:44:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 msgr2=0x7f075c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0760006fd0 tx=0x7f0760017000).stop 2023-10-24T00:44:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 msgr2=0x7f07700c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:23.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f076400c440 tx=0x7f0764007e30).stop 2023-10-24T00:44:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 shutdown_connections 2023-10-24T00:44:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07701554c0 0x7f07700c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0770062810 0x7f0770153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 --2- 172.21.15.148:0/3104528543 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07700a6f70 0x7f07700c2a80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 >> 172.21.15.148:0/3104528543 conn(0x7f07700c7ad0 msgr2=0x7f07700be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 shutdown_connections 2023-10-24T00:44:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:23.750+0000 7f077559d700 1 -- 172.21.15.148:0/3104528543 wait complete. 2023-10-24T00:44:23.757 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:23.763 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:22.189603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2412780,"kb_used_data":7340,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752561940,"statfs":{"total":773094113280,"available":770623426560,"internally_reserved":0,"allocated":7516160,"data_stored":3721687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28927,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.639894"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983042+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995327+0000","last_change":"2023-10-24T00:44:18.995327+0000","last_active":"2023-10-24T00:44:18.995327+0000","last_peered":"2023-10-24T00:44:18.995327+0000","last_clean":"2023-10-24T00:44:18.995327+0000","last_became_active":"2023-10-24T00:44:18.995010+0000","last_became_peered":"2023-10-24T00:44:18.995010+0000","last_unstale":"2023-10-24T00:44:18.995327+0000","last_undegraded":"2023-10-24T00:44:18.995327+0000","last_fullsized":"2023-10-24T00:44:18.995327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982818+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992361+0000","last_change":"2023-10-24T00:44:18.992361+0000","last_active":"2023-10-24T00:44:18.992361+0000","last_peered":"2023-10-24T00:44:18.992361+0000","last_clean":"2023-10-24T00:44:18.992361+0000","last_became_active":"2023-10-24T00:44:18.991850+0000","last_became_peered":"2023-10-24T00:44:18.991850+0000","last_unstale":"2023-10-24T00:44:18.992361+0000","last_undegraded":"2023-10-24T00:44:18.992361+0000","last_fullsized":"2023-10-24T00:44:18.992361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979781+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001836+0000","last_change":"2023-10-24T00:44:19.001836+0000","last_active":"2023-10-24T00:44:19.001836+0000","last_peered":"2023-10-24T00:44:19.001836+0000","last_clean":"2023-10-24T00:44:19.001836+0000","last_became_active":"2023-10-24T00:44:19.001581+0000","last_became_peered":"2023-10-24T00:44:19.001581+0000","last_unstale":"2023-10-24T00:44:19.001836+0000","last_undegraded":"2023-10-24T00:44:19.001836+0000","last_fullsized":"2023-10-24T00:44:19.001836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981364+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001842+0000","last_change":"2023-10-24T00:44:19.001842+0000","last_active":"2023-10-24T00:44:19.001842+0000","last_peered":"2023-10-24T00:44:19.001842+0000","last_clean":"2023-10-24T00:44:19.001842+0000","last_became_active":"2023-10-24T00:44:19.001587+0000","last_became_peered":"2023-10-24T00:44:19.001587+0000","last_unstale":"2023-10-24T00:44:19.001842+0000","last_undegraded":"2023-10-24T00:44:19.001842+0000","last_fullsized":"2023-10-24T00:44:19.001842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985085+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998242+0000","last_change":"2023-10-24T00:44:18.998242+0000","last_active":"2023-10-24T00:44:18.998242+0000","last_peered":"2023-10-24T00:44:18.998242+0000","last_clean":"2023-10-24T00:44:18.998242+0000","last_became_active":"2023-10-24T00:44:18.997861+0000","last_became_peered":"2023-10-24T00:44:18.997861+0000","last_unstale":"2023-10-24T00:44:18.998242+0000","last_undegraded":"2023-10-24T00:44:18.998242+0000","last_fullsized":"2023-10-24T00:44:18.998242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979743+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987699+0000","last_change":"2023-10-24T00:44:18.987699+0000","last_active":"2023-10-24T00:44:18.987699+0000","last_peered":"2023-10-24T00:44:18.987699+0000","last_clean":"2023-10-24T00:44:18.987699+0000","last_became_active":"2023-10-24T00:44:18.987428+0000","last_became_peered":"2023-10-24T00:44:18.987428+0000","last_unstale":"2023-10-24T00:44:18.987699+0000","last_undegraded":"2023-10-24T00:44:18.987699+0000","last_fullsized":"2023-10-24T00:44:18.987699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983671+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996982+0000","last_change":"2023-10-24T00:44:18.996982+0000","last_active":"2023-10-24T00:44:18.996982+0000","last_peered":"2023-10-24T00:44:18.996982+0000","last_clean":"2023-10-24T00:44:18.996982+0000","last_became_active":"2023-10-24T00:44:18.996744+0000","last_became_peered":"2023-10-24T00:44:18.996744+0000","last_unstale":"2023-10-24T00:44:18.996982+0000","last_undegraded":"2023-10-24T00:44:18.996982+0000","last_fullsized":"2023-10-24T00:44:18.996982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988617+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993846+0000","last_change":"2023-10-24T00:44:18.993846+0000","last_active":"2023-10-24T00:44:18.993846+0000","last_peered":"2023-10-24T00:44:18.993846+0000","last_clean":"2023-10-24T00:44:18.993846+0000","last_became_active":"2023-10-24T00:44:18.993586+0000","last_became_peered":"2023-10-24T00:44:18.993586+0000","last_unstale":"2023-10-24T00:44:18.993846+0000","last_undegraded":"2023-10-24T00:44:18.993846+0000","last_fullsized":"2023-10-24T00:44:18.993846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993276+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991340+0000","last_change":"2023-10-24T00:44:18.991340+0000","last_active":"2023-10-24T00:44:18.991340+0000","last_peered":"2023-10-24T00:44:18.991340+0000","last_clean":"2023-10-24T00:44:18.991340+0000","last_became_active":"2023-10-24T00:44:18.991062+0000","last_became_peered":"2023-10-24T00:44:18.991062+0000","last_unstale":"2023-10-24T00:44:18.991340+0000","last_undegraded":"2023-10-24T00:44:18.991340+0000","last_fullsized":"2023-10-24T00:44:18.991340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983961+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001116+0000","last_change":"2023-10-24T00:44:19.001116+0000","last_active":"2023-10-24T00:44:19.001116+0000","last_peered":"2023-10-24T00:44:19.001116+0000","last_clean":"2023-10-24T00:44:19.001116+0000","last_became_active":"2023-10-24T00:44:19.000863+0000","last_became_peered":"2023-10-24T00:44:19.000863+0000","last_unstale":"2023-10-24T00:44:19.001116+0000","last_undegraded":"2023-10-24T00:44:19.001116+0000","last_fullsized":"2023-10-24T00:44:19.001116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983845+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994598+0000","last_change":"2023-10-24T00:44:18.994598+0000","last_active":"2023-10-24T00:44:18.994598+0000","last_peered":"2023-10-24T00:44:18.994598+0000","last_clean":"2023-10-24T00:44:18.994598+0000","last_became_active":"2023-10-24T00:44:18.994336+0000","last_became_peered":"2023-10-24T00:44:18.994336+0000","last_unstale":"2023-10-24T00:44:18.994598+0000","last_undegraded":"2023-10-24T00:44:18.994598+0000","last_fullsized":"2023-10-24T00:44:18.994598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984665+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999007+0000","last_change":"2023-10-24T00:44:18.999007+0000","last_active":"2023-10-24T00:44:18.999007+0000","last_peered":"2023-10-24T00:44:18.999007+0000","last_clean":"2023-10-24T00:44:18.999007+0000","last_became_active":"2023-10-24T00:44:18.998780+0000","last_became_peered":"2023-10-24T00:44:18.998780+0000","last_unstale":"2023-10-24T00:44:18.999007+0000","last_undegraded":"2023-10-24T00:44:18.999007+0000","last_fullsized":"2023-10-24T00:44:18.999007+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979461+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002466+0000","last_change":"2023-10-24T00:44:19.002466+0000","last_active":"2023-10-24T00:44:19.002466+0000","last_peered":"2023-10-24T00:44:19.002466+0000","last_clean":"2023-10-24T00:44:19.002466+0000","last_became_active":"2023-10-24T00:44:19.002207+0000","last_became_peered":"2023-10-24T00:44:19.002207+0000","last_unstale":"2023-10-24T00:44:19.002466+0000","last_undegraded":"2023-10-24T00:44:19.002466+0000","last_fullsized":"2023-10-24T00:44:19.002466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982544+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.986943+0000","last_change":"2023-10-24T00:44:18.986943+0000","last_active":"2023-10-24T00:44:18.986943+0000","last_peered":"2023-10-24T00:44:18.986943+0000","last_clean":"2023-10-24T00:44:18.986943+0000","last_became_active":"2023-10-24T00:44:18.986663+0000","last_became_peered":"2023-10-24T00:44:18.986663+0000","last_unstale":"2023-10-24T00:44:18.986943+0000","last_undegraded":"2023-10-24T00:44:18.986943+0000","last_fullsized":"2023-10-24T00:44:18.986943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983294+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.988568+0000","last_change":"2023-10-24T00:44:18.988568+0000","last_active":"2023-10-24T00:44:18.988568+0000","last_peered":"2023-10-24T00:44:18.988568+0000","last_clean":"2023-10-24T00:44:18.988568+0000","last_became_active":"2023-10-24T00:44:18.988285+0000","last_became_peered":"2023-10-24T00:44:18.988285+0000","last_unstale":"2023-10-24T00:44:18.988568+0000","last_undegraded":"2023-10-24T00:44:18.988568+0000","last_fullsized":"2023-10-24T00:44:18.988568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990408+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001732+0000","last_change":"2023-10-24T00:44:19.001732+0000","last_active":"2023-10-24T00:44:19.001732+0000","last_peered":"2023-10-24T00:44:19.001732+0000","last_clean":"2023-10-24T00:44:19.001732+0000","last_became_active":"2023-10-24T00:44:19.001421+0000","last_became_peered":"2023-10-24T00:44:19.001421+0000","last_unstale":"2023-10-24T00:44:19.001732+0000","last_undegraded":"2023-10-24T00:44:19.001732+0000","last_fullsized":"2023-10-24T00:44:19.001732+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986105+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002313+0000","last_change":"2023-10-24T00:44:19.002313+0000","last_active":"2023-10-24T00:44:19.002313+0000","last_peered":"2023-10-24T00:44:19.002313+0000","last_clean":"2023-10-24T00:44:19.002313+0000","last_became_active":"2023-10-24T00:44:19.002038+0000","last_became_peered":"2023-10-24T00:44:19.002038+0000","last_unstale":"2023-10-24T00:44:19.002313+0000","last_undegraded":"2023-10-24T00:44:19.002313+0000","last_fullsized":"2023-10-24T00:44:19.002313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990466+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998777+0000","last_change":"2023-10-24T00:44:18.998777+0000","last_active":"2023-10-24T00:44:18.998777+0000","last_peered":"2023-10-24T00:44:18.998777+0000","last_clean":"2023-10-24T00:44:18.998777+0000","last_became_active":"2023-10-24T00:44:18.998456+0000","last_became_peered":"2023-10-24T00:44:18.998456+0000","last_unstale":"2023-10-24T00:44:18.998777+0000","last_undegraded":"2023-10-24T00:44:18.998777+0000","last_fullsized":"2023-10-24T00:44:18.998777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982731+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995473+0000","last_change":"2023-10-24T00:44:18.995473+0000","last_active":"2023-10-24T00:44:18.995473+0000","last_peered":"2023-10-24T00:44:18.995473+0000","last_clean":"2023-10-24T00:44:18.995473+0000","last_became_active":"2023-10-24T00:44:18.995177+0000","last_became_peered":"2023-10-24T00:44:18.995177+0000","last_unstale":"2023-10-24T00:44:18.995473+0000","last_undegraded":"2023-10-24T00:44:18.995473+0000","last_fullsized":"2023-10-24T00:44:18.995473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979191+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994564+0000","last_change":"2023-10-24T00:44:18.994564+0000","last_active":"2023-10-24T00:44:18.994564+0000","last_peered":"2023-10-24T00:44:18.994564+0000","last_clean":"2023-10-24T00:44:18.994564+0000","last_became_active":"2023-10-24T00:44:18.994259+0000","last_became_peered":"2023-10-24T00:44:18.994259+0000","last_unstale":"2023-10-24T00:44:18.994564+0000","last_undegraded":"2023-10-24T00:44:18.994564+0000","last_fullsized":"2023-10-24T00:44:18.994564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983432+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000062+0000","last_change":"2023-10-24T00:44:19.000062+0000","last_active":"2023-10-24T00:44:19.000062+0000","last_peered":"2023-10-24T00:44:19.000062+0000","last_clean":"2023-10-24T00:44:19.000062+0000","last_became_active":"2023-10-24T00:44:18.999667+0000","last_became_peered":"2023-10-24T00:44:18.999667+0000","last_unstale":"2023-10-24T00:44:19.000062+0000","last_undegraded":"2023-10-24T00:44:19.000062+0000","last_fullsized":"2023-10-24T00:44:19.000062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985584+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995307+0000","last_change":"2023-10-24T00:44:18.995307+0000","last_active":"2023-10-24T00:44:18.995307+0000","last_peered":"2023-10-24T00:44:18.995307+0000","last_clean":"2023-10-24T00:44:18.995307+0000","last_became_active":"2023-10-24T00:44:18.994003+0000","last_became_peered":"2023-10-24T00:44:18.994003+0000","last_unstale":"2023-10-24T00:44:18.995307+0000","last_undegraded":"2023-10-24T00:44:18.995307+0000","last_fullsized":"2023-10-24T00:44:18.995307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986045+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996786+0000","last_change":"2023-10-24T00:44:18.996786+0000","last_active":"2023-10-24T00:44:18.996786+0000","last_peered":"2023-10-24T00:44:18.996786+0000","last_clean":"2023-10-24T00:44:18.996786+0000","last_became_active":"2023-10-24T00:44:18.996212+0000","last_became_peered":"2023-10-24T00:44:18.996212+0000","last_unstale":"2023-10-24T00:44:18.996786+0000","last_undegraded":"2023-10-24T00:44:18.996786+0000","last_fullsized":"2023-10-24T00:44:18.996786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003506+0000","last_change":"2023-10-24T00:44:19.003506+0000","last_active":"2023-10-24T00:44:19.003506+0000","last_peered":"2023-10-24T00:44:19.003506+0000","last_clean":"2023-10-24T00:44:19.003506+0000","last_became_active":"2023-10-24T00:44:19.003226+0000","last_became_peered":"2023-10-24T00:44:19.003226+0000","last_unstale":"2023-10-24T00:44:19.003506+0000","last_undegraded":"2023-10-24T00:44:19.003506+0000","last_fullsized":"2023-10-24T00:44:19.003506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979990+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987366+0000","last_change":"2023-10-24T00:44:18.987366+0000","last_active":"2023-10-24T00:44:18.987366+0000","last_peered":"2023-10-24T00:44:18.987366+0000","last_clean":"2023-10-24T00:44:18.987366+0000","last_became_active":"2023-10-24T00:44:18.987107+0000","last_became_peered":"2023-10-24T00:44:18.987107+0000","last_unstale":"2023-10-24T00:44:18.987366+0000","last_undegraded":"2023-10-24T00:44:18.987366+0000","last_fullsized":"2023-10-24T00:44:18.987366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981346+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997611+0000","last_change":"2023-10-24T00:44:18.997611+0000","last_active":"2023-10-24T00:44:18.997611+0000","last_peered":"2023-10-24T00:44:18.997611+0000","last_clean":"2023-10-24T00:44:18.997611+0000","last_became_active":"2023-10-24T00:44:18.997316+0000","last_became_peered":"2023-10-24T00:44:18.997316+0000","last_unstale":"2023-10-24T00:44:18.997611+0000","last_undegraded":"2023-10-24T00:44:18.997611+0000","last_fullsized":"2023-10-24T00:44:18.997611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991969+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998858+0000","last_change":"2023-10-24T00:44:18.998858+0000","last_active":"2023-10-24T00:44:18.998858+0000","last_peered":"2023-10-24T00:44:18.998858+0000","last_clean":"2023-10-24T00:44:18.998858+0000","last_became_active":"2023-10-24T00:44:18.998489+0000","last_became_peered":"2023-10-24T00:44:18.998489+0000","last_unstale":"2023-10-24T00:44:18.998858+0000","last_undegraded":"2023-10-24T00:44:18.998858+0000","last_fullsized":"2023-10-24T00:44:18.998858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985113+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997086+0000","last_change":"2023-10-24T00:44:18.997086+0000","last_active":"2023-10-24T00:44:18.997086+0000","last_peered":"2023-10-24T00:44:18.997086+0000","last_clean":"2023-10-24T00:44:18.997086+0000","last_became_active":"2023-10-24T00:44:18.996790+0000","last_became_peered":"2023-10-24T00:44:18.996790+0000","last_unstale":"2023-10-24T00:44:18.997086+0000","last_undegraded":"2023-10-24T00:44:18.997086+0000","last_fullsized":"2023-10-24T00:44:18.997086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984952+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996828+0000","last_change":"2023-10-24T00:44:18.996828+0000","last_active":"2023-10-24T00:44:18.996828+0000","last_peered":"2023-10-24T00:44:18.996828+0000","last_clean":"2023-10-24T00:44:18.996828+0000","last_became_active":"2023-10-24T00:44:18.996571+0000","last_became_peered":"2023-10-24T00:44:18.996571+0000","last_unstale":"2023-10-24T00:44:18.996828+0000","last_undegraded":"2023-10-24T00:44:18.996828+0000","last_fullsized":"2023-10-24T00:44:18.996828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982112+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998001+0000","last_change":"2023-10-24T00:44:18.998001+0000","last_active":"2023-10-24T00:44:18.998001+0000","last_peered":"2023-10-24T00:44:18.998001+0000","last_clean":"2023-10-24T00:44:18.998001+0000","last_became_active":"2023-10-24T00:44:18.997726+0000","last_became_peered":"2023-10-24T00:44:18.997726+0000","last_unstale":"2023-10-24T00:44:18.998001+0000","last_undegraded":"2023-10-24T00:44:18.998001+0000","last_fullsized":"2023-10-24T00:44:18.998001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.992639+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987755+0000","last_change":"2023-10-24T00:44:18.987755+0000","last_active":"2023-10-24T00:44:18.987755+0000","last_peered":"2023-10-24T00:44:18.987755+0000","last_clean":"2023-10-24T00:44:18.987755+0000","last_became_active":"2023-10-24T00:44:18.987473+0000","last_became_peered":"2023-10-24T00:44:18.987473+0000","last_unstale":"2023-10-24T00:44:18.987755+0000","last_undegraded":"2023-10-24T00:44:18.987755+0000","last_fullsized":"2023-10-24T00:44:18.987755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982631+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997838+0000","last_change":"2023-10-24T00:44:18.997838+0000","last_active":"2023-10-24T00:44:18.997838+0000","last_peered":"2023-10-24T00:44:18.997838+0000","last_clean":"2023-10-24T00:44:18.997838+0000","last_became_active":"2023-10-24T00:44:18.997228+0000","last_became_peered":"2023-10-24T00:44:18.997228+0000","last_unstale":"2023-10-24T00:44:18.997838+0000","last_undegraded":"2023-10-24T00:44:18.997838+0000","last_fullsized":"2023-10-24T00:44:18.997838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986832+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.002540+0000","last_change":"2023-10-24T00:44:19.002540+0000","last_active":"2023-10-24T00:44:19.002540+0000","last_peered":"2023-10-24T00:44:19.002540+0000","last_clean":"2023-10-24T00:44:19.002540+0000","last_became_active":"2023-10-24T00:44:19.002270+0000","last_became_peered":"2023-10-24T00:44:19.002270+0000","last_unstale":"2023-10-24T00:44:19.002540+0000","last_undegraded":"2023-10-24T00:44:19.002540+0000","last_fullsized":"2023-10-24T00:44:19.002540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980802+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000438+0000","last_change":"2023-10-24T00:44:19.000438+0000","last_active":"2023-10-24T00:44:19.000438+0000","last_peered":"2023-10-24T00:44:19.000438+0000","last_clean":"2023-10-24T00:44:19.000438+0000","last_became_active":"2023-10-24T00:44:18.999186+0000","last_became_peered":"2023-10-24T00:44:18.999186+0000","last_unstale":"2023-10-24T00:44:19.000438+0000","last_undegraded":"2023-10-24T00:44:19.000438+0000","last_fullsized":"2023-10-24T00:44:19.000438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984082+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998792+0000","last_change":"2023-10-24T00:44:18.998792+0000","last_active":"2023-10-24T00:44:18.998792+0000","last_peered":"2023-10-24T00:44:18.998792+0000","last_clean":"2023-10-24T00:44:18.998792+0000","last_became_active":"2023-10-24T00:44:18.998121+0000","last_became_peered":"2023-10-24T00:44:18.998121+0000","last_unstale":"2023-10-24T00:44:18.998792+0000","last_undegraded":"2023-10-24T00:44:18.998792+0000","last_fullsized":"2023-10-24T00:44:18.998792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.984232+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993303+0000","last_change":"2023-10-24T00:44:18.993303+0000","last_active":"2023-10-24T00:44:18.993303+0000","last_peered":"2023-10-24T00:44:18.993303+0000","last_clean":"2023-10-24T00:44:18.993303+0000","last_became_active":"2023-10-24T00:44:18.993034+0000","last_became_peered":"2023-10-24T00:44:18.993034+0000","last_unstale":"2023-10-24T00:44:18.993303+0000","last_undegraded":"2023-10-24T00:44:18.993303+0000","last_fullsized":"2023-10-24T00:44:18.993303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978535+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994424+0000","last_change":"2023-10-24T00:44:18.994424+0000","last_active":"2023-10-24T00:44:18.994424+0000","last_peered":"2023-10-24T00:44:18.994424+0000","last_clean":"2023-10-24T00:44:18.994424+0000","last_became_active":"2023-10-24T00:44:18.994144+0000","last_became_peered":"2023-10-24T00:44:18.994144+0000","last_unstale":"2023-10-24T00:44:18.994424+0000","last_undegraded":"2023-10-24T00:44:18.994424+0000","last_fullsized":"2023-10-24T00:44:18.994424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979288+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.994274+0000","last_change":"2023-10-24T00:44:18.994274+0000","last_active":"2023-10-24T00:44:18.994274+0000","last_peered":"2023-10-24T00:44:18.994274+0000","last_clean":"2023-10-24T00:44:18.994274+0000","last_became_active":"2023-10-24T00:44:18.993980+0000","last_became_peered":"2023-10-24T00:44:18.993980+0000","last_unstale":"2023-10-24T00:44:18.994274+0000","last_undegraded":"2023-10-24T00:44:18.994274+0000","last_fullsized":"2023-10-24T00:44:18.994274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.993269+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996096+0000","last_change":"2023-10-24T00:44:18.996096+0000","last_active":"2023-10-24T00:44:18.996096+0000","last_peered":"2023-10-24T00:44:18.996096+0000","last_clean":"2023-10-24T00:44:18.996096+0000","last_became_active":"2023-10-24T00:44:18.995720+0000","last_became_peered":"2023-10-24T00:44:18.995720+0000","last_unstale":"2023-10-24T00:44:18.996096+0000","last_undegraded":"2023-10-24T00:44:18.996096+0000","last_fullsized":"2023-10-24T00:44:18.996096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985632+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999502+0000","last_change":"2023-10-24T00:44:18.999502+0000","last_active":"2023-10-24T00:44:18.999502+0000","last_peered":"2023-10-24T00:44:18.999502+0000","last_clean":"2023-10-24T00:44:18.999502+0000","last_became_active":"2023-10-24T00:44:18.999191+0000","last_became_peered":"2023-10-24T00:44:18.999191+0000","last_unstale":"2023-10-24T00:44:18.999502+0000","last_undegraded":"2023-10-24T00:44:18.999502+0000","last_fullsized":"2023-10-24T00:44:18.999502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.979612+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005035+0000","last_change":"2023-10-24T00:44:19.005035+0000","last_active":"2023-10-24T00:44:19.005035+0000","last_peered":"2023-10-24T00:44:19.005035+0000","last_clean":"2023-10-24T00:44:19.005035+0000","last_became_active":"2023-10-24T00:44:19.004782+0000","last_became_peered":"2023-10-24T00:44:19.004782+0000","last_unstale":"2023-10-24T00:44:19.005035+0000","last_undegraded":"2023-10-24T00:44:19.005035+0000","last_fullsized":"2023-10-24T00:44:19.005035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.993054+0000","last_change":"2023-10-24T00:44:18.993054+0000","last_active":"2023-10-24T00:44:18.993054+0000","last_peered":"2023-10-24T00:44:18.993054+0000","last_clean":"2023-10-24T00:44:18.993054+0000","last_became_active":"2023-10-24T00:44:18.992750+0000","last_became_peered":"2023-10-24T00:44:18.992750+0000","last_unstale":"2023-10-24T00:44:18.993054+0000","last_undegraded":"2023-10-24T00:44:18.993054+0000","last_fullsized":"2023-10-24T00:44:18.993054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988183+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003478+0000","last_change":"2023-10-24T00:44:19.003478+0000","last_active":"2023-10-24T00:44:19.003478+0000","last_peered":"2023-10-24T00:44:19.003478+0000","last_clean":"2023-10-24T00:44:19.003478+0000","last_became_active":"2023-10-24T00:44:19.003192+0000","last_became_peered":"2023-10-24T00:44:19.003192+0000","last_unstale":"2023-10-24T00:44:19.003478+0000","last_undegraded":"2023-10-24T00:44:19.003478+0000","last_fullsized":"2023-10-24T00:44:19.003478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983783+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.991279+0000","last_change":"2023-10-24T00:44:18.991279+0000","last_active":"2023-10-24T00:44:18.991279+0000","last_peered":"2023-10-24T00:44:18.991279+0000","last_clean":"2023-10-24T00:44:18.991279+0000","last_became_active":"2023-10-24T00:44:18.990733+0000","last_became_peered":"2023-10-24T00:44:18.990733+0000","last_unstale":"2023-10-24T00:44:18.991279+0000","last_undegraded":"2023-10-24T00:44:18.991279+0000","last_fullsized":"2023-10-24T00:44:18.991279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981600+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999146+0000","last_change":"2023-10-24T00:44:18.999146+0000","last_active":"2023-10-24T00:44:18.999146+0000","last_peered":"2023-10-24T00:44:18.999146+0000","last_clean":"2023-10-24T00:44:18.999146+0000","last_became_active":"2023-10-24T00:44:18.998413+0000","last_became_peered":"2023-10-24T00:44:18.998413+0000","last_unstale":"2023-10-24T00:44:18.999146+0000","last_undegraded":"2023-10-24T00:44:18.999146+0000","last_fullsized":"2023-10-24T00:44:18.999146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.985680+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.003962+0000","last_change":"2023-10-24T00:44:19.003962+0000","last_active":"2023-10-24T00:44:19.003962+0000","last_peered":"2023-10-24T00:44:19.003962+0000","last_clean":"2023-10-24T00:44:19.003962+0000","last_became_active":"2023-10-24T00:44:19.003238+0000","last_became_peered":"2023-10-24T00:44:19.003238+0000","last_unstale":"2023-10-24T00:44:19.003962+0000","last_undegraded":"2023-10-24T00:44:19.003962+0000","last_fullsized":"2023-10-24T00:44:19.003962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987897+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996949+0000","last_change":"2023-10-24T00:44:18.996949+0000","last_active":"2023-10-24T00:44:18.996949+0000","last_peered":"2023-10-24T00:44:18.996949+0000","last_clean":"2023-10-24T00:44:18.996949+0000","last_became_active":"2023-10-24T00:44:18.996508+0000","last_became_peered":"2023-10-24T00:44:18.996508+0000","last_unstale":"2023-10-24T00:44:18.996949+0000","last_undegraded":"2023-10-24T00:44:18.996949+0000","last_fullsized":"2023-10-24T00:44:18.996949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978371+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997143+0000","last_change":"2023-10-24T00:44:18.997143+0000","last_active":"2023-10-24T00:44:18.997143+0000","last_peered":"2023-10-24T00:44:18.997143+0000","last_clean":"2023-10-24T00:44:18.997143+0000","last_became_active":"2023-10-24T00:44:18.996829+0000","last_became_peered":"2023-10-24T00:44:18.996829+0000","last_unstale":"2023-10-24T00:44:18.997143+0000","last_undegraded":"2023-10-24T00:44:18.997143+0000","last_fullsized":"2023-10-24T00:44:18.997143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983812+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999768+0000","last_change":"2023-10-24T00:44:18.999768+0000","last_active":"2023-10-24T00:44:18.999768+0000","last_peered":"2023-10-24T00:44:18.999768+0000","last_clean":"2023-10-24T00:44:18.999768+0000","last_became_active":"2023-10-24T00:44:18.999468+0000","last_became_peered":"2023-10-24T00:44:18.999468+0000","last_unstale":"2023-10-24T00:44:18.999768+0000","last_undegraded":"2023-10-24T00:44:18.999768+0000","last_fullsized":"2023-10-24T00:44:18.999768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.980255+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.996209+0000","last_change":"2023-10-24T00:44:18.996209+0000","last_active":"2023-10-24T00:44:18.996209+0000","last_peered":"2023-10-24T00:44:18.996209+0000","last_clean":"2023-10-24T00:44:18.996209+0000","last_became_active":"2023-10-24T00:44:18.995918+0000","last_became_peered":"2023-10-24T00:44:18.995918+0000","last_unstale":"2023-10-24T00:44:18.996209+0000","last_undegraded":"2023-10-24T00:44:18.996209+0000","last_fullsized":"2023-10-24T00:44:18.996209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988664+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.998681+0000","last_change":"2023-10-24T00:44:18.998681+0000","last_active":"2023-10-24T00:44:18.998681+0000","last_peered":"2023-10-24T00:44:18.998681+0000","last_clean":"2023-10-24T00:44:18.998681+0000","last_became_active":"2023-10-24T00:44:18.997838+0000","last_became_peered":"2023-10-24T00:44:18.997838+0000","last_unstale":"2023-10-24T00:44:18.998681+0000","last_undegraded":"2023-10-24T00:44:18.998681+0000","last_fullsized":"2023-10-24T00:44:18.998681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.991597+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.990704+0000","last_change":"2023-10-24T00:44:18.990704+0000","last_active":"2023-10-24T00:44:18.990704+0000","last_peered":"2023-10-24T00:44:18.990704+0000","last_clean":"2023-10-24T00:44:18.990704+0000","last_became_active":"2023-10-24T00:44:18.990361+0000","last_became_peered":"2023-10-24T00:44:18.990361+0000","last_unstale":"2023-10-24T00:44:18.990704+0000","last_undegraded":"2023-10-24T00:44:18.990704+0000","last_fullsized":"2023-10-24T00:44:18.990704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990323+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999336+0000","last_change":"2023-10-24T00:44:18.999336+0000","last_active":"2023-10-24T00:44:18.999336+0000","last_peered":"2023-10-24T00:44:18.999336+0000","last_clean":"2023-10-24T00:44:18.999336+0000","last_became_active":"2023-10-24T00:44:18.998739+0000","last_became_peered":"2023-10-24T00:44:18.998739+0000","last_unstale":"2023-10-24T00:44:18.999336+0000","last_undegraded":"2023-10-24T00:44:18.999336+0000","last_fullsized":"2023-10-24T00:44:18.999336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.981493+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.987757+0000","last_change":"2023-10-24T00:44:18.987757+0000","last_active":"2023-10-24T00:44:18.987757+0000","last_peered":"2023-10-24T00:44:18.987757+0000","last_clean":"2023-10-24T00:44:18.987757+0000","last_became_active":"2023-10-24T00:44:18.987454+0000","last_became_peered":"2023-10-24T00:44:18.987454+0000","last_unstale":"2023-10-24T00:44:18.987757+0000","last_undegraded":"2023-10-24T00:44:18.987757+0000","last_fullsized":"2023-10-24T00:44:18.987757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978024+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995961+0000","last_change":"2023-10-24T00:44:18.995961+0000","last_active":"2023-10-24T00:44:18.995961+0000","last_peered":"2023-10-24T00:44:18.995961+0000","last_clean":"2023-10-24T00:44:18.995961+0000","last_became_active":"2023-10-24T00:44:18.995687+0000","last_became_peered":"2023-10-24T00:44:18.995687+0000","last_unstale":"2023-10-24T00:44:18.995961+0000","last_undegraded":"2023-10-24T00:44:18.995961+0000","last_fullsized":"2023-10-24T00:44:18.995961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.978946+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999552+0000","last_change":"2023-10-24T00:44:18.999552+0000","last_active":"2023-10-24T00:44:18.999552+0000","last_peered":"2023-10-24T00:44:18.999552+0000","last_clean":"2023-10-24T00:44:18.999552+0000","last_became_active":"2023-10-24T00:44:18.999258+0000","last_became_peered":"2023-10-24T00:44:18.999258+0000","last_unstale":"2023-10-24T00:44:18.999552+0000","last_undegraded":"2023-10-24T00:44:18.999552+0000","last_fullsized":"2023-10-24T00:44:18.999552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.983055+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995213+0000","last_change":"2023-10-24T00:44:18.995213+0000","last_active":"2023-10-24T00:44:18.995213+0000","last_peered":"2023-10-24T00:44:18.995213+0000","last_clean":"2023-10-24T00:44:18.995213+0000","last_became_active":"2023-10-24T00:44:18.994931+0000","last_became_peered":"2023-10-24T00:44:18.994931+0000","last_unstale":"2023-10-24T00:44:18.995213+0000","last_undegraded":"2023-10-24T00:44:18.995213+0000","last_fullsized":"2023-10-24T00:44:18.995213+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975423+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:17.975423+0000","last_peered":"2023-10-24T00:44:17.975423+0000","last_clean":"2023-10-24T00:44:17.975423+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:17.975423+0000","last_undegraded":"2023-10-24T00:44:17.975423+0000","last_fullsized":"2023-10-24T00:44:17.975423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.986924+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.999384+0000","last_change":"2023-10-24T00:44:18.999384+0000","last_active":"2023-10-24T00:44:18.999384+0000","last_peered":"2023-10-24T00:44:18.999384+0000","last_clean":"2023-10-24T00:44:18.999384+0000","last_became_active":"2023-10-24T00:44:18.999120+0000","last_became_peered":"2023-10-24T00:44:18.999120+0000","last_unstale":"2023-10-24T00:44:18.999384+0000","last_undegraded":"2023-10-24T00:44:18.999384+0000","last_fullsized":"2023-10-24T00:44:18.999384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974142+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:17.974142+0000","last_peered":"2023-10-24T00:44:17.974142+0000","last_clean":"2023-10-24T00:44:17.974142+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:17.974142+0000","last_undegraded":"2023-10-24T00:44:17.974142+0000","last_fullsized":"2023-10-24T00:44:17.974142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988657+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.000031+0000","last_change":"2023-10-24T00:44:19.000031+0000","last_active":"2023-10-24T00:44:19.000031+0000","last_peered":"2023-10-24T00:44:19.000031+0000","last_clean":"2023-10-24T00:44:19.000031+0000","last_became_active":"2023-10-24T00:44:18.999739+0000","last_became_peered":"2023-10-24T00:44:18.999739+0000","last_unstale":"2023-10-24T00:44:19.000031+0000","last_undegraded":"2023-10-24T00:44:19.000031+0000","last_fullsized":"2023-10-24T00:44:19.000031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.970712+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:17.970712+0000","last_peered":"2023-10-24T00:44:17.970712+0000","last_clean":"2023-10-24T00:44:17.970712+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:17.970712+0000","last_undegraded":"2023-10-24T00:44:17.970712+0000","last_fullsized":"2023-10-24T00:44:17.970712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.988206+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.995012+0000","last_change":"2023-10-24T00:44:18.995012+0000","last_active":"2023-10-24T00:44:18.995012+0000","last_peered":"2023-10-24T00:44:18.995012+0000","last_clean":"2023-10-24T00:44:18.995012+0000","last_became_active":"2023-10-24T00:44:18.994740+0000","last_became_peered":"2023-10-24T00:44:18.994740+0000","last_unstale":"2023-10-24T00:44:18.995012+0000","last_undegraded":"2023-10-24T00:44:18.995012+0000","last_fullsized":"2023-10-24T00:44:18.995012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974149+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:17.974149+0000","last_peered":"2023-10-24T00:44:17.974149+0000","last_clean":"2023-10-24T00:44:17.974149+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:17.974149+0000","last_undegraded":"2023-10-24T00:44:17.974149+0000","last_fullsized":"2023-10-24T00:44:17.974149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974688+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:17.974688+0000","last_peered":"2023-10-24T00:44:17.974688+0000","last_clean":"2023-10-24T00:44:17.974688+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:17.974688+0000","last_undegraded":"2023-10-24T00:44:17.974688+0000","last_fullsized":"2023-10-24T00:44:17.974688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982974+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.997386+0000","last_change":"2023-10-24T00:44:18.997386+0000","last_active":"2023-10-24T00:44:18.997386+0000","last_peered":"2023-10-24T00:44:18.997386+0000","last_clean":"2023-10-24T00:44:18.997386+0000","last_became_active":"2023-10-24T00:44:18.997004+0000","last_became_peered":"2023-10-24T00:44:18.997004+0000","last_unstale":"2023-10-24T00:44:18.997386+0000","last_undegraded":"2023-10-24T00:44:18.997386+0000","last_fullsized":"2023-10-24T00:44:18.997386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.974809+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:17.974809+0000","last_peered":"2023-10-24T00:44:17.974809+0000","last_clean":"2023-10-24T00:44:17.974809+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:17.974809+0000","last_undegraded":"2023-10-24T00:44:17.974809+0000","last_fullsized":"2023-10-24T00:44:17.974809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.990044+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.001810+0000","last_change":"2023-10-24T00:44:19.001810+0000","last_active":"2023-10-24T00:44:19.001810+0000","last_peered":"2023-10-24T00:44:19.001810+0000","last_clean":"2023-10-24T00:44:19.001810+0000","last_became_active":"2023-10-24T00:44:19.001524+0000","last_became_peered":"2023-10-24T00:44:19.001524+0000","last_unstale":"2023-10-24T00:44:19.001810+0000","last_undegraded":"2023-10-24T00:44:19.001810+0000","last_fullsized":"2023-10-24T00:44:19.001810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975087+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:17.975087+0000","last_peered":"2023-10-24T00:44:17.975087+0000","last_clean":"2023-10-24T00:44:17.975087+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:17.975087+0000","last_undegraded":"2023-10-24T00:44:17.975087+0000","last_fullsized":"2023-10-24T00:44:17.975087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.982321+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.005142+0000","last_change":"2023-10-24T00:44:19.005142+0000","last_active":"2023-10-24T00:44:19.005142+0000","last_peered":"2023-10-24T00:44:19.005142+0000","last_clean":"2023-10-24T00:44:19.005142+0000","last_became_active":"2023-10-24T00:44:19.004839+0000","last_became_peered":"2023-10-24T00:44:19.004839+0000","last_unstale":"2023-10-24T00:44:19.005142+0000","last_undegraded":"2023-10-24T00:44:19.005142+0000","last_fullsized":"2023-10-24T00:44:19.005142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.975438+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:17.975438+0000","last_peered":"2023-10-24T00:44:17.975438+0000","last_clean":"2023-10-24T00:44:17.975438+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:17.975438+0000","last_undegraded":"2023-10-24T00:44:17.975438+0000","last_fullsized":"2023-10-24T00:44:17.975438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:18.969466+0000","last_change":"2023-10-24T00:44:18.987260+0000","last_active":"2023-10-24T00:44:18.969466+0000","last_peered":"2023-10-24T00:44:18.969466+0000","last_clean":"2023-10-24T00:44:18.969466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:18.969466+0000","last_undegraded":"2023-10-24T00:44:18.969466+0000","last_fullsized":"2023-10-24T00:44:18.969466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-10-24T00:44:18.992422+0000","last_change":"2023-10-24T00:44:18.992422+0000","last_active":"2023-10-24T00:44:18.992422+0000","last_peered":"2023-10-24T00:44:18.992422+0000","last_clean":"2023-10-24T00:44:18.992422+0000","last_became_active":"2023-10-24T00:44:18.992112+0000","last_became_peered":"2023-10-24T00:44:18.992112+0000","last_unstale":"2023-10-24T00:44:18.992422+0000","last_undegraded":"2023-10-24T00:44:18.992422+0000","last_fullsized":"2023-10-24T00:44:18.992422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-24T00:44:17.976468+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:17.976468+0000","last_peered":"2023-10-24T00:44:17.976468+0000","last_clean":"2023-10-24T00:44:17.976468+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:17.976468+0000","last_undegraded":"2023-10-24T00:44:17.976468+0000","last_fullsized":"2023-10-24T00:44:17.976468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542332,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":471055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.74199999999999999,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.66900000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.318,"15min":0.307},"max":{"1min":0.69099999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.41099999999999998,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.81100000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.72499999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.434,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.65700000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.498,"5min":0.46700000000000003,"15min":0.32600000000000001},"max":{"1min":0.753,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.246,"15min":0.246},"max":{"1min":0.70299999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.498},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69799999999999995,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.40699999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56299999999999994,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.72199999999999998,"5min":4.351,"15min":4.351},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:43:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.83299999999999996},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.495}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.48099999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.439}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.499},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.59299999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.374}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.34300000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.38500000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.42499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52600000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.33800000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.376}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.433}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.5}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.59199999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":937984,"data_stored":464376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.625}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.67300000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:25.268 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:44:25.267+0000 7fee59b10700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:44:26.773 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:26.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.899+0000 7fcf47147700 1 Processor -- start 2023-10-24T00:44:26.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.900+0000 7fcf47147700 1 -- start start 2023-10-24T00:44:26.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.900+0000 7fcf47147700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf400640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.900+0000 7fcf47147700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400a5bd0 con 0x7fcf400645a0 2023-10-24T00:44:26.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.900+0000 7fcf47147700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf40064ab0 con 0x7fcf400a8480 2023-10-24T00:44:26.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.900+0000 7fcf47147700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40064d90 con 0x7fcf40154540 2023-10-24T00:44:26.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf37fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcf400645a0 0x7fcf400a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60920/0 (socket says 172.21.15.148:60920) 2023-10-24T00:44:26.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf37fff700 1 -- 172.21.15.148:0/1482061925 learned_addr learned my addr 172.21.15.148:0/1482061925 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:26.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf44ee3700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf400640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729602432 0 0) 0x7fcf400a5bd0 con 0x7fcf400645a0 2023-10-24T00:44:26.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf280033f0 con 0x7fcf400645a0 2023-10-24T00:44:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470826209 0 0) 0x7fcf280033f0 con 0x7fcf400645a0 2023-10-24T00:44:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 msgr2=0x7fcf400640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf400640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 >> v1:172.21.15.150:6789/0 conn(0x7fcf400a8480 legacy=0x7fcf400a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:26.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40065070 con 0x7fcf400645a0 2023-10-24T00:44:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fcf30001470 con 0x7fcf400645a0 2023-10-24T00:44:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 >> v1:172.21.15.148:6789/0 conn(0x7fcf400645a0 legacy=0x7fcf400a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf28003910 0x7fcf28003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf28004b80 0x7fcf28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40064d90 con 0x7fcf28004b80 2023-10-24T00:44:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2800b8e0 con 0x7fcf28003910 2023-10-24T00:44:26.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2800ba50 con 0x7fcf40154540 2023-10-24T00:44:26.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf456e4700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf28004b80 0x7fcf28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf44ee3700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf28003910 0x7fcf28003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.901+0000 7fcf37fff700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 -- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 msgr2=0x7fcf28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:26.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf40154540 0x7fcf28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:26.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 -- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf28003910 msgr2=0x7fcf28003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:26.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf28003910 0x7fcf28003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:26.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 -- 172.21.15.148:0/1482061925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280033f0 con 0x7fcf28004b80 2023-10-24T00:44:26.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf28004b80 0x7fcf28005000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fcf40063ea0 tx=0x7fcf38007b90).ready entity=mon.0 client_cookie=31e3804cd66b33bb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:26.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38007ea0 con 0x7fcf28004b80 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38012400 con 0x7fcf28004b80 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf377fe700 1 -- 172.21.15.148:0/1482061925 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380127a0 con 0x7fcf28004b80 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 -- 172.21.15.148:0/1482061925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf28004b80 msgr2=0x7fcf28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 --2- 172.21.15.148:0/1482061925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf28004b80 0x7fcf28005000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7fcf40063ea0 tx=0x7fcf38007b90).stop 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf456e4700 1 -- 172.21.15.148:0/1482061925 reap_dead start 2023-10-24T00:44:26.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 -- 172.21.15.148:0/1482061925 shutdown_connections 2023-10-24T00:44:26.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 -- 172.21.15.148:0/1482061925 >> 172.21.15.148:0/1482061925 conn(0x7fcf40092480 msgr2=0x7fcf40062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:26.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 -- 172.21.15.148:0/1482061925 shutdown_connections 2023-10-24T00:44:26.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.902+0000 7fcf47147700 1 -- 172.21.15.148:0/1482061925 wait complete. 2023-10-24T00:44:26.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.904+0000 7fcf47147700 1 Processor -- start 2023-10-24T00:44:26.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.904+0000 7fcf47147700 1 -- start start 2023-10-24T00:44:26.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.904+0000 7fcf47147700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf400c2800 0x7fcf40164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.904+0000 7fcf47147700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400ade80 0x7fcf400c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.904+0000 7fcf47147700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf47147700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400abef0 con 0x7fcf400c57f0 2023-10-24T00:44:26.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf47147700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400c6160 con 0x7fcf400c2800 2023-10-24T00:44:26.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf47147700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40164770 con 0x7fcf400ade80 2023-10-24T00:44:26.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40562/0 (socket says 172.21.15.148:40562) 2023-10-24T00:44:26.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 -- 172.21.15.148:0/2423089904 learned_addr learned my addr 172.21.15.148:0/2423089904 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:26.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf37fff700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400ade80 0x7fcf400c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf44ee3700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf400c2800 0x7fcf40164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 -- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400ade80 msgr2=0x7fcf400c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:26.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400ade80 0x7fcf400c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:26.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 -- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf400c2800 msgr2=0x7fcf40164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:26.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf400c2800 0x7fcf40164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:26.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 -- 172.21.15.148:0/2423089904 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40164a50 con 0x7fcf400c57f0 2023-10-24T00:44:26.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf456e4700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fcf280045b0 tx=0x7fcf38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:26.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38007ea0 con 0x7fcf400c57f0 2023-10-24T00:44:26.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38007240 con 0x7fcf400c57f0 2023-10-24T00:44:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380118c0 con 0x7fcf400c57f0 2023-10-24T00:44:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf40164d30 con 0x7fcf400c57f0 2023-10-24T00:44:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.905+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf400c4500 con 0x7fcf400c57f0 2023-10-24T00:44:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.906+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf400ac060 con 0x7fcf400c57f0 2023-10-24T00:44:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.907+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcf38019070 con 0x7fcf400c57f0 2023-10-24T00:44:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.907+0000 7fcf34ff9700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 0x7fcf2c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.907+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcf3807a6c0 con 0x7fcf400c57f0 2023-10-24T00:44:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.907+0000 7fcf44ee3700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 0x7fcf2c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.908+0000 7fcf44ee3700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 0x7fcf2c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcf3c0094d0 tx=0x7fcf3c00b040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:26.911+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf3804b8c0 con 0x7fcf400c57f0 2023-10-24T00:44:27.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.072+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf4006c6b0 con 0x7fcf2c05f270 2023-10-24T00:44:27.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.083+0000 7fcf34ff9700 1 -- 172.21.15.148:0/2423089904 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361483 (secure 0 0 0) 0x7fcf4006c6b0 con 0x7fcf2c05f270 2023-10-24T00:44:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:27.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 msgr2=0x7fcf2c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 0x7fcf2c061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcf3c0094d0 tx=0x7fcf3c00b040).stop 2023-10-24T00:44:27.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 msgr2=0x7fcf400c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fcf280045b0 tx=0x7fcf38017000).stop 2023-10-24T00:44:27.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 shutdown_connections 2023-10-24T00:44:27.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf2c05f270 0x7fcf2c061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf400c57f0 0x7fcf400c5c70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf400c2800 0x7fcf40164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 --2- 172.21.15.148:0/2423089904 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf400ade80 0x7fcf400c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 >> 172.21.15.148:0/2423089904 conn(0x7fcf40092480 msgr2=0x7fcf400a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 shutdown_connections 2023-10-24T00:44:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.087+0000 7fcf47147700 1 -- 172.21.15.148:0/2423089904 wait complete. 2023-10-24T00:44:27.094 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:27.100 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-24T00:44:26.190593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2413120,"kb_used_data":7680,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752561600,"statfs":{"total":773094113280,"available":770623078400,"internally_reserved":0,"allocated":7864320,"data_stored":3884116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27889,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.640346"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374417+0000","last_change":"2023-10-24T00:44:19.368483+0000","last_active":"2023-10-24T00:44:19.374417+0000","last_peered":"2023-10-24T00:44:19.374417+0000","last_clean":"2023-10-24T00:44:19.374417+0000","last_became_active":"2023-10-24T00:44:19.367261+0000","last_became_peered":"2023-10-24T00:44:19.367261+0000","last_unstale":"2023-10-24T00:44:19.374417+0000","last_undegraded":"2023-10-24T00:44:19.374417+0000","last_fullsized":"2023-10-24T00:44:19.374417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369235+0000","last_change":"2023-10-24T00:44:18.995327+0000","last_active":"2023-10-24T00:44:19.369235+0000","last_peered":"2023-10-24T00:44:19.369235+0000","last_clean":"2023-10-24T00:44:19.369235+0000","last_became_active":"2023-10-24T00:44:18.995010+0000","last_became_peered":"2023-10-24T00:44:18.995010+0000","last_unstale":"2023-10-24T00:44:19.369235+0000","last_undegraded":"2023-10-24T00:44:19.369235+0000","last_fullsized":"2023-10-24T00:44:19.369235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370666+0000","last_change":"2023-10-24T00:44:19.368380+0000","last_active":"2023-10-24T00:44:19.370666+0000","last_peered":"2023-10-24T00:44:19.370666+0000","last_clean":"2023-10-24T00:44:19.370666+0000","last_became_active":"2023-10-24T00:44:19.368044+0000","last_became_peered":"2023-10-24T00:44:19.368044+0000","last_unstale":"2023-10-24T00:44:19.370666+0000","last_undegraded":"2023-10-24T00:44:19.370666+0000","last_fullsized":"2023-10-24T00:44:19.370666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356617+0000","last_change":"2023-10-24T00:44:18.992361+0000","last_active":"2023-10-24T00:44:19.356617+0000","last_peered":"2023-10-24T00:44:19.356617+0000","last_clean":"2023-10-24T00:44:19.356617+0000","last_became_active":"2023-10-24T00:44:18.991850+0000","last_became_peered":"2023-10-24T00:44:18.991850+0000","last_unstale":"2023-10-24T00:44:19.356617+0000","last_undegraded":"2023-10-24T00:44:19.356617+0000","last_fullsized":"2023-10-24T00:44:19.356617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372028+0000","last_change":"2023-10-24T00:44:19.369486+0000","last_active":"2023-10-24T00:44:19.372028+0000","last_peered":"2023-10-24T00:44:19.372028+0000","last_clean":"2023-10-24T00:44:19.372028+0000","last_became_active":"2023-10-24T00:44:19.369223+0000","last_became_peered":"2023-10-24T00:44:19.369223+0000","last_unstale":"2023-10-24T00:44:19.372028+0000","last_undegraded":"2023-10-24T00:44:19.372028+0000","last_fullsized":"2023-10-24T00:44:19.372028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358215+0000","last_change":"2023-10-24T00:44:19.001836+0000","last_active":"2023-10-24T00:44:19.358215+0000","last_peered":"2023-10-24T00:44:19.358215+0000","last_clean":"2023-10-24T00:44:19.358215+0000","last_became_active":"2023-10-24T00:44:19.001581+0000","last_became_peered":"2023-10-24T00:44:19.001581+0000","last_unstale":"2023-10-24T00:44:19.358215+0000","last_undegraded":"2023-10-24T00:44:19.358215+0000","last_fullsized":"2023-10-24T00:44:19.358215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.373182+0000","last_change":"2023-10-24T00:44:19.370581+0000","last_active":"2023-10-24T00:44:19.373182+0000","last_peered":"2023-10-24T00:44:19.373182+0000","last_clean":"2023-10-24T00:44:19.373182+0000","last_became_active":"2023-10-24T00:44:19.370320+0000","last_became_peered":"2023-10-24T00:44:19.370320+0000","last_unstale":"2023-10-24T00:44:19.373182+0000","last_undegraded":"2023-10-24T00:44:19.373182+0000","last_fullsized":"2023-10-24T00:44:19.373182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374104+0000","last_change":"2023-10-24T00:44:19.001842+0000","last_active":"2023-10-24T00:44:19.374104+0000","last_peered":"2023-10-24T00:44:19.374104+0000","last_clean":"2023-10-24T00:44:19.374104+0000","last_became_active":"2023-10-24T00:44:19.001587+0000","last_became_peered":"2023-10-24T00:44:19.001587+0000","last_unstale":"2023-10-24T00:44:19.374104+0000","last_undegraded":"2023-10-24T00:44:19.374104+0000","last_fullsized":"2023-10-24T00:44:19.374104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372047+0000","last_change":"2023-10-24T00:44:19.367095+0000","last_active":"2023-10-24T00:44:19.372047+0000","last_peered":"2023-10-24T00:44:19.372047+0000","last_clean":"2023-10-24T00:44:19.372047+0000","last_became_active":"2023-10-24T00:44:19.366370+0000","last_became_peered":"2023-10-24T00:44:19.366370+0000","last_unstale":"2023-10-24T00:44:19.372047+0000","last_undegraded":"2023-10-24T00:44:19.372047+0000","last_fullsized":"2023-10-24T00:44:19.372047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370195+0000","last_change":"2023-10-24T00:44:18.998242+0000","last_active":"2023-10-24T00:44:19.370195+0000","last_peered":"2023-10-24T00:44:19.370195+0000","last_clean":"2023-10-24T00:44:19.370195+0000","last_became_active":"2023-10-24T00:44:18.997861+0000","last_became_peered":"2023-10-24T00:44:18.997861+0000","last_unstale":"2023-10-24T00:44:19.370195+0000","last_undegraded":"2023-10-24T00:44:19.370195+0000","last_fullsized":"2023-10-24T00:44:19.370195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371792+0000","last_change":"2023-10-24T00:44:19.367632+0000","last_active":"2023-10-24T00:44:19.371792+0000","last_peered":"2023-10-24T00:44:19.371792+0000","last_clean":"2023-10-24T00:44:19.371792+0000","last_became_active":"2023-10-24T00:44:19.367346+0000","last_became_peered":"2023-10-24T00:44:19.367346+0000","last_unstale":"2023-10-24T00:44:19.371792+0000","last_undegraded":"2023-10-24T00:44:19.371792+0000","last_fullsized":"2023-10-24T00:44:19.371792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.364671+0000","last_change":"2023-10-24T00:44:18.987699+0000","last_active":"2023-10-24T00:44:19.364671+0000","last_peered":"2023-10-24T00:44:19.364671+0000","last_clean":"2023-10-24T00:44:19.364671+0000","last_became_active":"2023-10-24T00:44:18.987428+0000","last_became_peered":"2023-10-24T00:44:18.987428+0000","last_unstale":"2023-10-24T00:44:19.364671+0000","last_undegraded":"2023-10-24T00:44:19.364671+0000","last_fullsized":"2023-10-24T00:44:19.364671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371057+0000","last_change":"2023-10-24T00:44:19.366594+0000","last_active":"2023-10-24T00:44:19.371057+0000","last_peered":"2023-10-24T00:44:19.371057+0000","last_clean":"2023-10-24T00:44:19.371057+0000","last_became_active":"2023-10-24T00:44:19.366121+0000","last_became_peered":"2023-10-24T00:44:19.366121+0000","last_unstale":"2023-10-24T00:44:19.371057+0000","last_undegraded":"2023-10-24T00:44:19.371057+0000","last_fullsized":"2023-10-24T00:44:19.371057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348338+0000","last_change":"2023-10-24T00:44:18.996982+0000","last_active":"2023-10-24T00:44:19.348338+0000","last_peered":"2023-10-24T00:44:19.348338+0000","last_clean":"2023-10-24T00:44:19.348338+0000","last_became_active":"2023-10-24T00:44:18.996744+0000","last_became_peered":"2023-10-24T00:44:18.996744+0000","last_unstale":"2023-10-24T00:44:19.348338+0000","last_undegraded":"2023-10-24T00:44:19.348338+0000","last_fullsized":"2023-10-24T00:44:19.348338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376902+0000","last_change":"2023-10-24T00:44:19.370796+0000","last_active":"2023-10-24T00:44:19.376902+0000","last_peered":"2023-10-24T00:44:19.376902+0000","last_clean":"2023-10-24T00:44:19.376902+0000","last_became_active":"2023-10-24T00:44:19.370496+0000","last_became_peered":"2023-10-24T00:44:19.370496+0000","last_unstale":"2023-10-24T00:44:19.376902+0000","last_undegraded":"2023-10-24T00:44:19.376902+0000","last_fullsized":"2023-10-24T00:44:19.376902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351268+0000","last_change":"2023-10-24T00:44:18.993846+0000","last_active":"2023-10-24T00:44:19.351268+0000","last_peered":"2023-10-24T00:44:19.351268+0000","last_clean":"2023-10-24T00:44:19.351268+0000","last_became_active":"2023-10-24T00:44:18.993586+0000","last_became_peered":"2023-10-24T00:44:18.993586+0000","last_unstale":"2023-10-24T00:44:19.351268+0000","last_undegraded":"2023-10-24T00:44:19.351268+0000","last_fullsized":"2023-10-24T00:44:19.351268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372099+0000","last_change":"2023-10-24T00:44:19.367324+0000","last_active":"2023-10-24T00:44:19.372099+0000","last_peered":"2023-10-24T00:44:19.372099+0000","last_clean":"2023-10-24T00:44:19.372099+0000","last_became_active":"2023-10-24T00:44:19.366571+0000","last_became_peered":"2023-10-24T00:44:19.366571+0000","last_unstale":"2023-10-24T00:44:19.372099+0000","last_undegraded":"2023-10-24T00:44:19.372099+0000","last_fullsized":"2023-10-24T00:44:19.372099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348662+0000","last_change":"2023-10-24T00:44:18.991340+0000","last_active":"2023-10-24T00:44:19.348662+0000","last_peered":"2023-10-24T00:44:19.348662+0000","last_clean":"2023-10-24T00:44:19.348662+0000","last_became_active":"2023-10-24T00:44:18.991062+0000","last_became_peered":"2023-10-24T00:44:18.991062+0000","last_unstale":"2023-10-24T00:44:19.348662+0000","last_undegraded":"2023-10-24T00:44:19.348662+0000","last_fullsized":"2023-10-24T00:44:19.348662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368481+0000","last_change":"2023-10-24T00:44:19.359559+0000","last_active":"2023-10-24T00:44:19.368481+0000","last_peered":"2023-10-24T00:44:19.368481+0000","last_clean":"2023-10-24T00:44:19.368481+0000","last_became_active":"2023-10-24T00:44:19.359237+0000","last_became_peered":"2023-10-24T00:44:19.359237+0000","last_unstale":"2023-10-24T00:44:19.368481+0000","last_undegraded":"2023-10-24T00:44:19.368481+0000","last_fullsized":"2023-10-24T00:44:19.368481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.349259+0000","last_change":"2023-10-24T00:44:19.001116+0000","last_active":"2023-10-24T00:44:19.349259+0000","last_peered":"2023-10-24T00:44:19.349259+0000","last_clean":"2023-10-24T00:44:19.349259+0000","last_became_active":"2023-10-24T00:44:19.000863+0000","last_became_peered":"2023-10-24T00:44:19.000863+0000","last_unstale":"2023-10-24T00:44:19.349259+0000","last_undegraded":"2023-10-24T00:44:19.349259+0000","last_fullsized":"2023-10-24T00:44:19.349259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.379543+0000","last_change":"2023-10-24T00:44:19.374336+0000","last_active":"2023-10-24T00:44:19.379543+0000","last_peered":"2023-10-24T00:44:19.379543+0000","last_clean":"2023-10-24T00:44:19.379543+0000","last_became_active":"2023-10-24T00:44:19.374001+0000","last_became_peered":"2023-10-24T00:44:19.374001+0000","last_unstale":"2023-10-24T00:44:19.379543+0000","last_undegraded":"2023-10-24T00:44:19.379543+0000","last_fullsized":"2023-10-24T00:44:19.379543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348814+0000","last_change":"2023-10-24T00:44:18.994598+0000","last_active":"2023-10-24T00:44:19.348814+0000","last_peered":"2023-10-24T00:44:19.348814+0000","last_clean":"2023-10-24T00:44:19.348814+0000","last_became_active":"2023-10-24T00:44:18.994336+0000","last_became_peered":"2023-10-24T00:44:18.994336+0000","last_unstale":"2023-10-24T00:44:19.348814+0000","last_undegraded":"2023-10-24T00:44:19.348814+0000","last_fullsized":"2023-10-24T00:44:19.348814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376867+0000","last_change":"2023-10-24T00:44:19.373920+0000","last_active":"2023-10-24T00:44:19.376867+0000","last_peered":"2023-10-24T00:44:19.376867+0000","last_clean":"2023-10-24T00:44:19.376867+0000","last_became_active":"2023-10-24T00:44:19.373391+0000","last_became_peered":"2023-10-24T00:44:19.373391+0000","last_unstale":"2023-10-24T00:44:19.376867+0000","last_undegraded":"2023-10-24T00:44:19.376867+0000","last_fullsized":"2023-10-24T00:44:19.376867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.377105+0000","last_change":"2023-10-24T00:44:18.999007+0000","last_active":"2023-10-24T00:44:19.377105+0000","last_peered":"2023-10-24T00:44:19.377105+0000","last_clean":"2023-10-24T00:44:19.377105+0000","last_became_active":"2023-10-24T00:44:18.998780+0000","last_became_peered":"2023-10-24T00:44:18.998780+0000","last_unstale":"2023-10-24T00:44:19.377105+0000","last_undegraded":"2023-10-24T00:44:19.377105+0000","last_fullsized":"2023-10-24T00:44:19.377105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371702+0000","last_change":"2023-10-24T00:44:19.365864+0000","last_active":"2023-10-24T00:44:19.371702+0000","last_peered":"2023-10-24T00:44:19.371702+0000","last_clean":"2023-10-24T00:44:19.371702+0000","last_became_active":"2023-10-24T00:44:19.365582+0000","last_became_peered":"2023-10-24T00:44:19.365582+0000","last_unstale":"2023-10-24T00:44:19.371702+0000","last_undegraded":"2023-10-24T00:44:19.371702+0000","last_fullsized":"2023-10-24T00:44:19.371702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369383+0000","last_change":"2023-10-24T00:44:19.002466+0000","last_active":"2023-10-24T00:44:19.369383+0000","last_peered":"2023-10-24T00:44:19.369383+0000","last_clean":"2023-10-24T00:44:19.369383+0000","last_became_active":"2023-10-24T00:44:19.002207+0000","last_became_peered":"2023-10-24T00:44:19.002207+0000","last_unstale":"2023-10-24T00:44:19.369383+0000","last_undegraded":"2023-10-24T00:44:19.369383+0000","last_fullsized":"2023-10-24T00:44:19.369383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376834+0000","last_change":"2023-10-24T00:44:19.373209+0000","last_active":"2023-10-24T00:44:19.376834+0000","last_peered":"2023-10-24T00:44:19.376834+0000","last_clean":"2023-10-24T00:44:19.376834+0000","last_became_active":"2023-10-24T00:44:19.372904+0000","last_became_peered":"2023-10-24T00:44:19.372904+0000","last_unstale":"2023-10-24T00:44:19.376834+0000","last_undegraded":"2023-10-24T00:44:19.376834+0000","last_fullsized":"2023-10-24T00:44:19.376834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.347758+0000","last_change":"2023-10-24T00:44:18.986943+0000","last_active":"2023-10-24T00:44:19.347758+0000","last_peered":"2023-10-24T00:44:19.347758+0000","last_clean":"2023-10-24T00:44:19.347758+0000","last_became_active":"2023-10-24T00:44:18.986663+0000","last_became_peered":"2023-10-24T00:44:18.986663+0000","last_unstale":"2023-10-24T00:44:19.347758+0000","last_undegraded":"2023-10-24T00:44:19.347758+0000","last_fullsized":"2023-10-24T00:44:19.347758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370725+0000","last_change":"2023-10-24T00:44:19.368086+0000","last_active":"2023-10-24T00:44:19.370725+0000","last_peered":"2023-10-24T00:44:19.370725+0000","last_clean":"2023-10-24T00:44:19.370725+0000","last_became_active":"2023-10-24T00:44:19.367756+0000","last_became_peered":"2023-10-24T00:44:19.367756+0000","last_unstale":"2023-10-24T00:44:19.370725+0000","last_undegraded":"2023-10-24T00:44:19.370725+0000","last_fullsized":"2023-10-24T00:44:19.370725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348465+0000","last_change":"2023-10-24T00:44:18.988568+0000","last_active":"2023-10-24T00:44:19.348465+0000","last_peered":"2023-10-24T00:44:19.348465+0000","last_clean":"2023-10-24T00:44:19.348465+0000","last_became_active":"2023-10-24T00:44:18.988285+0000","last_became_peered":"2023-10-24T00:44:18.988285+0000","last_unstale":"2023-10-24T00:44:19.348465+0000","last_undegraded":"2023-10-24T00:44:19.348465+0000","last_fullsized":"2023-10-24T00:44:19.348465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374272+0000","last_change":"2023-10-24T00:44:19.370559+0000","last_active":"2023-10-24T00:44:19.374272+0000","last_peered":"2023-10-24T00:44:19.374272+0000","last_clean":"2023-10-24T00:44:19.374272+0000","last_became_active":"2023-10-24T00:44:19.370227+0000","last_became_peered":"2023-10-24T00:44:19.370227+0000","last_unstale":"2023-10-24T00:44:19.374272+0000","last_undegraded":"2023-10-24T00:44:19.374272+0000","last_fullsized":"2023-10-24T00:44:19.374272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.375440+0000","last_change":"2023-10-24T00:44:19.001732+0000","last_active":"2023-10-24T00:44:19.375440+0000","last_peered":"2023-10-24T00:44:19.375440+0000","last_clean":"2023-10-24T00:44:19.375440+0000","last_became_active":"2023-10-24T00:44:19.001421+0000","last_became_peered":"2023-10-24T00:44:19.001421+0000","last_unstale":"2023-10-24T00:44:19.375440+0000","last_undegraded":"2023-10-24T00:44:19.375440+0000","last_fullsized":"2023-10-24T00:44:19.375440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.366956+0000","last_change":"2023-10-24T00:44:19.363531+0000","last_active":"2023-10-24T00:44:19.366956+0000","last_peered":"2023-10-24T00:44:19.366956+0000","last_clean":"2023-10-24T00:44:19.366956+0000","last_became_active":"2023-10-24T00:44:19.363251+0000","last_became_peered":"2023-10-24T00:44:19.363251+0000","last_unstale":"2023-10-24T00:44:19.366956+0000","last_undegraded":"2023-10-24T00:44:19.366956+0000","last_fullsized":"2023-10-24T00:44:19.366956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356844+0000","last_change":"2023-10-24T00:44:19.002313+0000","last_active":"2023-10-24T00:44:19.356844+0000","last_peered":"2023-10-24T00:44:19.356844+0000","last_clean":"2023-10-24T00:44:19.356844+0000","last_became_active":"2023-10-24T00:44:19.002038+0000","last_became_peered":"2023-10-24T00:44:19.002038+0000","last_unstale":"2023-10-24T00:44:19.356844+0000","last_undegraded":"2023-10-24T00:44:19.356844+0000","last_fullsized":"2023-10-24T00:44:19.356844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376973+0000","last_change":"2023-10-24T00:44:19.369812+0000","last_active":"2023-10-24T00:44:19.376973+0000","last_peered":"2023-10-24T00:44:19.376973+0000","last_clean":"2023-10-24T00:44:19.376973+0000","last_became_active":"2023-10-24T00:44:19.369535+0000","last_became_peered":"2023-10-24T00:44:19.369535+0000","last_unstale":"2023-10-24T00:44:19.376973+0000","last_undegraded":"2023-10-24T00:44:19.376973+0000","last_fullsized":"2023-10-24T00:44:19.376973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358633+0000","last_change":"2023-10-24T00:44:18.998777+0000","last_active":"2023-10-24T00:44:19.358633+0000","last_peered":"2023-10-24T00:44:19.358633+0000","last_clean":"2023-10-24T00:44:19.358633+0000","last_became_active":"2023-10-24T00:44:18.998456+0000","last_became_peered":"2023-10-24T00:44:18.998456+0000","last_unstale":"2023-10-24T00:44:19.358633+0000","last_undegraded":"2023-10-24T00:44:19.358633+0000","last_fullsized":"2023-10-24T00:44:19.358633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371758+0000","last_change":"2023-10-24T00:44:19.367583+0000","last_active":"2023-10-24T00:44:19.371758+0000","last_peered":"2023-10-24T00:44:19.371758+0000","last_clean":"2023-10-24T00:44:19.371758+0000","last_became_active":"2023-10-24T00:44:19.367246+0000","last_became_peered":"2023-10-24T00:44:19.367246+0000","last_unstale":"2023-10-24T00:44:19.371758+0000","last_undegraded":"2023-10-24T00:44:19.371758+0000","last_fullsized":"2023-10-24T00:44:19.371758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368499+0000","last_change":"2023-10-24T00:44:18.995473+0000","last_active":"2023-10-24T00:44:19.368499+0000","last_peered":"2023-10-24T00:44:19.368499+0000","last_clean":"2023-10-24T00:44:19.368499+0000","last_became_active":"2023-10-24T00:44:18.995177+0000","last_became_peered":"2023-10-24T00:44:18.995177+0000","last_unstale":"2023-10-24T00:44:19.368499+0000","last_undegraded":"2023-10-24T00:44:19.368499+0000","last_fullsized":"2023-10-24T00:44:19.368499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370660+0000","last_change":"2023-10-24T00:44:19.359535+0000","last_active":"2023-10-24T00:44:19.370660+0000","last_peered":"2023-10-24T00:44:19.370660+0000","last_clean":"2023-10-24T00:44:19.370660+0000","last_became_active":"2023-10-24T00:44:19.359249+0000","last_became_peered":"2023-10-24T00:44:19.359249+0000","last_unstale":"2023-10-24T00:44:19.370660+0000","last_undegraded":"2023-10-24T00:44:19.370660+0000","last_fullsized":"2023-10-24T00:44:19.370660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356815+0000","last_change":"2023-10-24T00:44:18.994564+0000","last_active":"2023-10-24T00:44:19.356815+0000","last_peered":"2023-10-24T00:44:19.356815+0000","last_clean":"2023-10-24T00:44:19.356815+0000","last_became_active":"2023-10-24T00:44:18.994259+0000","last_became_peered":"2023-10-24T00:44:18.994259+0000","last_unstale":"2023-10-24T00:44:19.356815+0000","last_undegraded":"2023-10-24T00:44:19.356815+0000","last_fullsized":"2023-10-24T00:44:19.356815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374386+0000","last_change":"2023-10-24T00:44:19.370996+0000","last_active":"2023-10-24T00:44:19.374386+0000","last_peered":"2023-10-24T00:44:19.374386+0000","last_clean":"2023-10-24T00:44:19.374386+0000","last_became_active":"2023-10-24T00:44:19.370733+0000","last_became_peered":"2023-10-24T00:44:19.370733+0000","last_unstale":"2023-10-24T00:44:19.374386+0000","last_undegraded":"2023-10-24T00:44:19.374386+0000","last_fullsized":"2023-10-24T00:44:19.374386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368913+0000","last_change":"2023-10-24T00:44:19.000062+0000","last_active":"2023-10-24T00:44:19.368913+0000","last_peered":"2023-10-24T00:44:19.368913+0000","last_clean":"2023-10-24T00:44:19.368913+0000","last_became_active":"2023-10-24T00:44:18.999667+0000","last_became_peered":"2023-10-24T00:44:18.999667+0000","last_unstale":"2023-10-24T00:44:19.368913+0000","last_undegraded":"2023-10-24T00:44:19.368913+0000","last_fullsized":"2023-10-24T00:44:19.368913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.363074+0000","last_change":"2023-10-24T00:44:19.357441+0000","last_active":"2023-10-24T00:44:19.363074+0000","last_peered":"2023-10-24T00:44:19.363074+0000","last_clean":"2023-10-24T00:44:19.363074+0000","last_became_active":"2023-10-24T00:44:19.357165+0000","last_became_peered":"2023-10-24T00:44:19.357165+0000","last_unstale":"2023-10-24T00:44:19.363074+0000","last_undegraded":"2023-10-24T00:44:19.363074+0000","last_fullsized":"2023-10-24T00:44:19.363074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356402+0000","last_change":"2023-10-24T00:44:18.995307+0000","last_active":"2023-10-24T00:44:19.356402+0000","last_peered":"2023-10-24T00:44:19.356402+0000","last_clean":"2023-10-24T00:44:19.356402+0000","last_became_active":"2023-10-24T00:44:18.994003+0000","last_became_peered":"2023-10-24T00:44:18.994003+0000","last_unstale":"2023-10-24T00:44:19.356402+0000","last_undegraded":"2023-10-24T00:44:19.356402+0000","last_fullsized":"2023-10-24T00:44:19.356402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.362995+0000","last_change":"2023-10-24T00:44:19.357355+0000","last_active":"2023-10-24T00:44:19.362995+0000","last_peered":"2023-10-24T00:44:19.362995+0000","last_clean":"2023-10-24T00:44:19.362995+0000","last_became_active":"2023-10-24T00:44:19.357115+0000","last_became_peered":"2023-10-24T00:44:19.357115+0000","last_unstale":"2023-10-24T00:44:19.362995+0000","last_undegraded":"2023-10-24T00:44:19.362995+0000","last_fullsized":"2023-10-24T00:44:19.362995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356339+0000","last_change":"2023-10-24T00:44:18.996786+0000","last_active":"2023-10-24T00:44:19.356339+0000","last_peered":"2023-10-24T00:44:19.356339+0000","last_clean":"2023-10-24T00:44:19.356339+0000","last_became_active":"2023-10-24T00:44:18.996212+0000","last_became_peered":"2023-10-24T00:44:18.996212+0000","last_unstale":"2023-10-24T00:44:19.356339+0000","last_undegraded":"2023-10-24T00:44:19.356339+0000","last_fullsized":"2023-10-24T00:44:19.356339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372056+0000","last_change":"2023-10-24T00:44:19.366865+0000","last_active":"2023-10-24T00:44:19.372056+0000","last_peered":"2023-10-24T00:44:19.372056+0000","last_clean":"2023-10-24T00:44:19.372056+0000","last_became_active":"2023-10-24T00:44:19.366340+0000","last_became_peered":"2023-10-24T00:44:19.366340+0000","last_unstale":"2023-10-24T00:44:19.372056+0000","last_undegraded":"2023-10-24T00:44:19.372056+0000","last_fullsized":"2023-10-24T00:44:19.372056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.352632+0000","last_change":"2023-10-24T00:44:19.003506+0000","last_active":"2023-10-24T00:44:19.352632+0000","last_peered":"2023-10-24T00:44:19.352632+0000","last_clean":"2023-10-24T00:44:19.352632+0000","last_became_active":"2023-10-24T00:44:19.003226+0000","last_became_peered":"2023-10-24T00:44:19.003226+0000","last_unstale":"2023-10-24T00:44:19.352632+0000","last_undegraded":"2023-10-24T00:44:19.352632+0000","last_fullsized":"2023-10-24T00:44:19.352632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371952+0000","last_change":"2023-10-24T00:44:19.366815+0000","last_active":"2023-10-24T00:44:19.371952+0000","last_peered":"2023-10-24T00:44:19.371952+0000","last_clean":"2023-10-24T00:44:19.371952+0000","last_became_active":"2023-10-24T00:44:19.366325+0000","last_became_peered":"2023-10-24T00:44:19.366325+0000","last_unstale":"2023-10-24T00:44:19.371952+0000","last_undegraded":"2023-10-24T00:44:19.371952+0000","last_fullsized":"2023-10-24T00:44:19.371952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358653+0000","last_change":"2023-10-24T00:44:18.987366+0000","last_active":"2023-10-24T00:44:19.358653+0000","last_peered":"2023-10-24T00:44:19.358653+0000","last_clean":"2023-10-24T00:44:19.358653+0000","last_became_active":"2023-10-24T00:44:18.987107+0000","last_became_peered":"2023-10-24T00:44:18.987107+0000","last_unstale":"2023-10-24T00:44:19.358653+0000","last_undegraded":"2023-10-24T00:44:19.358653+0000","last_fullsized":"2023-10-24T00:44:19.358653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376832+0000","last_change":"2023-10-24T00:44:19.371942+0000","last_active":"2023-10-24T00:44:19.376832+0000","last_peered":"2023-10-24T00:44:19.376832+0000","last_clean":"2023-10-24T00:44:19.376832+0000","last_became_active":"2023-10-24T00:44:19.371640+0000","last_became_peered":"2023-10-24T00:44:19.371640+0000","last_unstale":"2023-10-24T00:44:19.376832+0000","last_undegraded":"2023-10-24T00:44:19.376832+0000","last_fullsized":"2023-10-24T00:44:19.376832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357974+0000","last_change":"2023-10-24T00:44:18.997611+0000","last_active":"2023-10-24T00:44:19.357974+0000","last_peered":"2023-10-24T00:44:19.357974+0000","last_clean":"2023-10-24T00:44:19.357974+0000","last_became_active":"2023-10-24T00:44:18.997316+0000","last_became_peered":"2023-10-24T00:44:18.997316+0000","last_unstale":"2023-10-24T00:44:19.357974+0000","last_undegraded":"2023-10-24T00:44:19.357974+0000","last_fullsized":"2023-10-24T00:44:19.357974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371876+0000","last_change":"2023-10-24T00:44:19.366634+0000","last_active":"2023-10-24T00:44:19.371876+0000","last_peered":"2023-10-24T00:44:19.371876+0000","last_clean":"2023-10-24T00:44:19.371876+0000","last_became_active":"2023-10-24T00:44:19.366311+0000","last_became_peered":"2023-10-24T00:44:19.366311+0000","last_unstale":"2023-10-24T00:44:19.371876+0000","last_undegraded":"2023-10-24T00:44:19.371876+0000","last_fullsized":"2023-10-24T00:44:19.371876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351591+0000","last_change":"2023-10-24T00:44:18.998858+0000","last_active":"2023-10-24T00:44:19.351591+0000","last_peered":"2023-10-24T00:44:19.351591+0000","last_clean":"2023-10-24T00:44:19.351591+0000","last_became_active":"2023-10-24T00:44:18.998489+0000","last_became_peered":"2023-10-24T00:44:18.998489+0000","last_unstale":"2023-10-24T00:44:19.351591+0000","last_undegraded":"2023-10-24T00:44:19.351591+0000","last_fullsized":"2023-10-24T00:44:19.351591+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374355+0000","last_change":"2023-10-24T00:44:19.370111+0000","last_active":"2023-10-24T00:44:19.374355+0000","last_peered":"2023-10-24T00:44:19.374355+0000","last_clean":"2023-10-24T00:44:19.374355+0000","last_became_active":"2023-10-24T00:44:19.369848+0000","last_became_peered":"2023-10-24T00:44:19.369848+0000","last_unstale":"2023-10-24T00:44:19.374355+0000","last_undegraded":"2023-10-24T00:44:19.374355+0000","last_fullsized":"2023-10-24T00:44:19.374355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358547+0000","last_change":"2023-10-24T00:44:18.997086+0000","last_active":"2023-10-24T00:44:19.358547+0000","last_peered":"2023-10-24T00:44:19.358547+0000","last_clean":"2023-10-24T00:44:19.358547+0000","last_became_active":"2023-10-24T00:44:18.996790+0000","last_became_peered":"2023-10-24T00:44:18.996790+0000","last_unstale":"2023-10-24T00:44:19.358547+0000","last_undegraded":"2023-10-24T00:44:19.358547+0000","last_fullsized":"2023-10-24T00:44:19.358547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.375663+0000","last_change":"2023-10-24T00:44:19.370879+0000","last_active":"2023-10-24T00:44:19.375663+0000","last_peered":"2023-10-24T00:44:19.375663+0000","last_clean":"2023-10-24T00:44:19.375663+0000","last_became_active":"2023-10-24T00:44:19.370484+0000","last_became_peered":"2023-10-24T00:44:19.370484+0000","last_unstale":"2023-10-24T00:44:19.375663+0000","last_undegraded":"2023-10-24T00:44:19.375663+0000","last_fullsized":"2023-10-24T00:44:19.375663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357394+0000","last_change":"2023-10-24T00:44:18.996828+0000","last_active":"2023-10-24T00:44:19.357394+0000","last_peered":"2023-10-24T00:44:19.357394+0000","last_clean":"2023-10-24T00:44:19.357394+0000","last_became_active":"2023-10-24T00:44:18.996571+0000","last_became_peered":"2023-10-24T00:44:18.996571+0000","last_unstale":"2023-10-24T00:44:19.357394+0000","last_undegraded":"2023-10-24T00:44:19.357394+0000","last_fullsized":"2023-10-24T00:44:19.357394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369667+0000","last_change":"2023-10-24T00:44:19.363195+0000","last_active":"2023-10-24T00:44:19.369667+0000","last_peered":"2023-10-24T00:44:19.369667+0000","last_clean":"2023-10-24T00:44:19.369667+0000","last_became_active":"2023-10-24T00:44:19.362864+0000","last_became_peered":"2023-10-24T00:44:19.362864+0000","last_unstale":"2023-10-24T00:44:19.369667+0000","last_undegraded":"2023-10-24T00:44:19.369667+0000","last_fullsized":"2023-10-24T00:44:19.369667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357912+0000","last_change":"2023-10-24T00:44:18.998001+0000","last_active":"2023-10-24T00:44:19.357912+0000","last_peered":"2023-10-24T00:44:19.357912+0000","last_clean":"2023-10-24T00:44:19.357912+0000","last_became_active":"2023-10-24T00:44:18.997726+0000","last_became_peered":"2023-10-24T00:44:18.997726+0000","last_unstale":"2023-10-24T00:44:19.357912+0000","last_undegraded":"2023-10-24T00:44:19.357912+0000","last_fullsized":"2023-10-24T00:44:19.357912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371917+0000","last_change":"2023-10-24T00:44:19.365741+0000","last_active":"2023-10-24T00:44:19.371917+0000","last_peered":"2023-10-24T00:44:19.371917+0000","last_clean":"2023-10-24T00:44:19.371917+0000","last_became_active":"2023-10-24T00:44:19.365453+0000","last_became_peered":"2023-10-24T00:44:19.365453+0000","last_unstale":"2023-10-24T00:44:19.371917+0000","last_undegraded":"2023-10-24T00:44:19.371917+0000","last_fullsized":"2023-10-24T00:44:19.371917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357745+0000","last_change":"2023-10-24T00:44:18.987755+0000","last_active":"2023-10-24T00:44:19.357745+0000","last_peered":"2023-10-24T00:44:19.357745+0000","last_clean":"2023-10-24T00:44:19.357745+0000","last_became_active":"2023-10-24T00:44:18.987473+0000","last_became_peered":"2023-10-24T00:44:18.987473+0000","last_unstale":"2023-10-24T00:44:19.357745+0000","last_undegraded":"2023-10-24T00:44:19.357745+0000","last_fullsized":"2023-10-24T00:44:19.357745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376840+0000","last_change":"2023-10-24T00:44:19.373766+0000","last_active":"2023-10-24T00:44:19.376840+0000","last_peered":"2023-10-24T00:44:19.376840+0000","last_clean":"2023-10-24T00:44:19.376840+0000","last_became_active":"2023-10-24T00:44:19.373476+0000","last_became_peered":"2023-10-24T00:44:19.373476+0000","last_unstale":"2023-10-24T00:44:19.376840+0000","last_undegraded":"2023-10-24T00:44:19.376840+0000","last_fullsized":"2023-10-24T00:44:19.376840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.361159+0000","last_change":"2023-10-24T00:44:18.997838+0000","last_active":"2023-10-24T00:44:19.361159+0000","last_peered":"2023-10-24T00:44:19.361159+0000","last_clean":"2023-10-24T00:44:19.361159+0000","last_became_active":"2023-10-24T00:44:18.997228+0000","last_became_peered":"2023-10-24T00:44:18.997228+0000","last_unstale":"2023-10-24T00:44:19.361159+0000","last_undegraded":"2023-10-24T00:44:19.361159+0000","last_fullsized":"2023-10-24T00:44:19.361159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.375083+0000","last_change":"2023-10-24T00:44:19.365067+0000","last_active":"2023-10-24T00:44:19.375083+0000","last_peered":"2023-10-24T00:44:19.375083+0000","last_clean":"2023-10-24T00:44:19.375083+0000","last_became_active":"2023-10-24T00:44:19.364782+0000","last_became_peered":"2023-10-24T00:44:19.364782+0000","last_unstale":"2023-10-24T00:44:19.375083+0000","last_undegraded":"2023-10-24T00:44:19.375083+0000","last_fullsized":"2023-10-24T00:44:19.375083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370963+0000","last_change":"2023-10-24T00:44:19.002540+0000","last_active":"2023-10-24T00:44:19.370963+0000","last_peered":"2023-10-24T00:44:19.370963+0000","last_clean":"2023-10-24T00:44:19.370963+0000","last_became_active":"2023-10-24T00:44:19.002270+0000","last_became_peered":"2023-10-24T00:44:19.002270+0000","last_unstale":"2023-10-24T00:44:19.370963+0000","last_undegraded":"2023-10-24T00:44:19.370963+0000","last_fullsized":"2023-10-24T00:44:19.370963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368601+0000","last_change":"2023-10-24T00:44:19.363598+0000","last_active":"2023-10-24T00:44:19.368601+0000","last_peered":"2023-10-24T00:44:19.368601+0000","last_clean":"2023-10-24T00:44:19.368601+0000","last_became_active":"2023-10-24T00:44:19.363331+0000","last_became_peered":"2023-10-24T00:44:19.363331+0000","last_unstale":"2023-10-24T00:44:19.368601+0000","last_undegraded":"2023-10-24T00:44:19.368601+0000","last_fullsized":"2023-10-24T00:44:19.368601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.367238+0000","last_change":"2023-10-24T00:44:19.000438+0000","last_active":"2023-10-24T00:44:19.367238+0000","last_peered":"2023-10-24T00:44:19.367238+0000","last_clean":"2023-10-24T00:44:19.367238+0000","last_became_active":"2023-10-24T00:44:18.999186+0000","last_became_peered":"2023-10-24T00:44:18.999186+0000","last_unstale":"2023-10-24T00:44:19.367238+0000","last_undegraded":"2023-10-24T00:44:19.367238+0000","last_fullsized":"2023-10-24T00:44:19.367238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370821+0000","last_change":"2023-10-24T00:44:19.365237+0000","last_active":"2023-10-24T00:44:19.370821+0000","last_peered":"2023-10-24T00:44:19.370821+0000","last_clean":"2023-10-24T00:44:19.370821+0000","last_became_active":"2023-10-24T00:44:19.364760+0000","last_became_peered":"2023-10-24T00:44:19.364760+0000","last_unstale":"2023-10-24T00:44:19.370821+0000","last_undegraded":"2023-10-24T00:44:19.370821+0000","last_fullsized":"2023-10-24T00:44:19.370821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.366686+0000","last_change":"2023-10-24T00:44:18.998792+0000","last_active":"2023-10-24T00:44:19.366686+0000","last_peered":"2023-10-24T00:44:19.366686+0000","last_clean":"2023-10-24T00:44:19.366686+0000","last_became_active":"2023-10-24T00:44:18.998121+0000","last_became_peered":"2023-10-24T00:44:18.998121+0000","last_unstale":"2023-10-24T00:44:19.366686+0000","last_undegraded":"2023-10-24T00:44:19.366686+0000","last_fullsized":"2023-10-24T00:44:19.366686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376877+0000","last_change":"2023-10-24T00:44:19.373938+0000","last_active":"2023-10-24T00:44:19.376877+0000","last_peered":"2023-10-24T00:44:19.376877+0000","last_clean":"2023-10-24T00:44:19.376877+0000","last_became_active":"2023-10-24T00:44:19.373612+0000","last_became_peered":"2023-10-24T00:44:19.373612+0000","last_unstale":"2023-10-24T00:44:19.376877+0000","last_undegraded":"2023-10-24T00:44:19.376877+0000","last_fullsized":"2023-10-24T00:44:19.376877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.361212+0000","last_change":"2023-10-24T00:44:18.993303+0000","last_active":"2023-10-24T00:44:19.361212+0000","last_peered":"2023-10-24T00:44:19.361212+0000","last_clean":"2023-10-24T00:44:19.361212+0000","last_became_active":"2023-10-24T00:44:18.993034+0000","last_became_peered":"2023-10-24T00:44:18.993034+0000","last_unstale":"2023-10-24T00:44:19.361212+0000","last_undegraded":"2023-10-24T00:44:19.361212+0000","last_fullsized":"2023-10-24T00:44:19.361212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368976+0000","last_change":"2023-10-24T00:44:19.361467+0000","last_active":"2023-10-24T00:44:19.368976+0000","last_peered":"2023-10-24T00:44:19.368976+0000","last_clean":"2023-10-24T00:44:19.368976+0000","last_became_active":"2023-10-24T00:44:19.360360+0000","last_became_peered":"2023-10-24T00:44:19.360360+0000","last_unstale":"2023-10-24T00:44:19.368976+0000","last_undegraded":"2023-10-24T00:44:19.368976+0000","last_fullsized":"2023-10-24T00:44:19.368976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357501+0000","last_change":"2023-10-24T00:44:18.994424+0000","last_active":"2023-10-24T00:44:19.357501+0000","last_peered":"2023-10-24T00:44:19.357501+0000","last_clean":"2023-10-24T00:44:19.357501+0000","last_became_active":"2023-10-24T00:44:18.994144+0000","last_became_peered":"2023-10-24T00:44:18.994144+0000","last_unstale":"2023-10-24T00:44:19.357501+0000","last_undegraded":"2023-10-24T00:44:19.357501+0000","last_fullsized":"2023-10-24T00:44:19.357501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370348+0000","last_change":"2023-10-24T00:44:19.359129+0000","last_active":"2023-10-24T00:44:19.370348+0000","last_peered":"2023-10-24T00:44:19.370348+0000","last_clean":"2023-10-24T00:44:19.370348+0000","last_became_active":"2023-10-24T00:44:19.358908+0000","last_became_peered":"2023-10-24T00:44:19.358908+0000","last_unstale":"2023-10-24T00:44:19.370348+0000","last_undegraded":"2023-10-24T00:44:19.370348+0000","last_fullsized":"2023-10-24T00:44:19.370348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356506+0000","last_change":"2023-10-24T00:44:18.994274+0000","last_active":"2023-10-24T00:44:19.356506+0000","last_peered":"2023-10-24T00:44:19.356506+0000","last_clean":"2023-10-24T00:44:19.356506+0000","last_became_active":"2023-10-24T00:44:18.993980+0000","last_became_peered":"2023-10-24T00:44:18.993980+0000","last_unstale":"2023-10-24T00:44:19.356506+0000","last_undegraded":"2023-10-24T00:44:19.356506+0000","last_fullsized":"2023-10-24T00:44:19.356506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376888+0000","last_change":"2023-10-24T00:44:19.369047+0000","last_active":"2023-10-24T00:44:19.376888+0000","last_peered":"2023-10-24T00:44:19.376888+0000","last_clean":"2023-10-24T00:44:19.376888+0000","last_became_active":"2023-10-24T00:44:19.365978+0000","last_became_peered":"2023-10-24T00:44:19.365978+0000","last_unstale":"2023-10-24T00:44:19.376888+0000","last_undegraded":"2023-10-24T00:44:19.376888+0000","last_fullsized":"2023-10-24T00:44:19.376888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351582+0000","last_change":"2023-10-24T00:44:18.996096+0000","last_active":"2023-10-24T00:44:19.351582+0000","last_peered":"2023-10-24T00:44:19.351582+0000","last_clean":"2023-10-24T00:44:19.351582+0000","last_became_active":"2023-10-24T00:44:18.995720+0000","last_became_peered":"2023-10-24T00:44:18.995720+0000","last_unstale":"2023-10-24T00:44:19.351582+0000","last_undegraded":"2023-10-24T00:44:19.351582+0000","last_fullsized":"2023-10-24T00:44:19.351582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.370621+0000","last_change":"2023-10-24T00:44:19.368614+0000","last_active":"2023-10-24T00:44:19.370621+0000","last_peered":"2023-10-24T00:44:19.370621+0000","last_clean":"2023-10-24T00:44:19.370621+0000","last_became_active":"2023-10-24T00:44:19.368363+0000","last_became_peered":"2023-10-24T00:44:19.368363+0000","last_unstale":"2023-10-24T00:44:19.370621+0000","last_undegraded":"2023-10-24T00:44:19.370621+0000","last_fullsized":"2023-10-24T00:44:19.370621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.352738+0000","last_change":"2023-10-24T00:44:18.999502+0000","last_active":"2023-10-24T00:44:19.352738+0000","last_peered":"2023-10-24T00:44:19.352738+0000","last_clean":"2023-10-24T00:44:19.352738+0000","last_became_active":"2023-10-24T00:44:18.999191+0000","last_became_peered":"2023-10-24T00:44:18.999191+0000","last_unstale":"2023-10-24T00:44:19.352738+0000","last_undegraded":"2023-10-24T00:44:19.352738+0000","last_fullsized":"2023-10-24T00:44:19.352738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371930+0000","last_change":"2023-10-24T00:44:19.366655+0000","last_active":"2023-10-24T00:44:19.371930+0000","last_peered":"2023-10-24T00:44:19.371930+0000","last_clean":"2023-10-24T00:44:19.371930+0000","last_became_active":"2023-10-24T00:44:19.365996+0000","last_became_peered":"2023-10-24T00:44:19.365996+0000","last_unstale":"2023-10-24T00:44:19.371930+0000","last_undegraded":"2023-10-24T00:44:19.371930+0000","last_fullsized":"2023-10-24T00:44:19.371930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358851+0000","last_change":"2023-10-24T00:44:19.005035+0000","last_active":"2023-10-24T00:44:19.358851+0000","last_peered":"2023-10-24T00:44:19.358851+0000","last_clean":"2023-10-24T00:44:19.358851+0000","last_became_active":"2023-10-24T00:44:19.004782+0000","last_became_peered":"2023-10-24T00:44:19.004782+0000","last_unstale":"2023-10-24T00:44:19.358851+0000","last_undegraded":"2023-10-24T00:44:19.358851+0000","last_fullsized":"2023-10-24T00:44:19.358851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368212+0000","last_change":"2023-10-24T00:44:19.366506+0000","last_active":"2023-10-24T00:44:19.368212+0000","last_peered":"2023-10-24T00:44:19.368212+0000","last_clean":"2023-10-24T00:44:19.368212+0000","last_became_active":"2023-10-24T00:44:19.366219+0000","last_became_peered":"2023-10-24T00:44:19.366219+0000","last_unstale":"2023-10-24T00:44:19.368212+0000","last_undegraded":"2023-10-24T00:44:19.368212+0000","last_fullsized":"2023-10-24T00:44:19.368212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348550+0000","last_change":"2023-10-24T00:44:18.993054+0000","last_active":"2023-10-24T00:44:19.348550+0000","last_peered":"2023-10-24T00:44:19.348550+0000","last_clean":"2023-10-24T00:44:19.348550+0000","last_became_active":"2023-10-24T00:44:18.992750+0000","last_became_peered":"2023-10-24T00:44:18.992750+0000","last_unstale":"2023-10-24T00:44:19.348550+0000","last_undegraded":"2023-10-24T00:44:19.348550+0000","last_fullsized":"2023-10-24T00:44:19.348550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376714+0000","last_change":"2023-10-24T00:44:19.368730+0000","last_active":"2023-10-24T00:44:19.376714+0000","last_peered":"2023-10-24T00:44:19.376714+0000","last_clean":"2023-10-24T00:44:19.376714+0000","last_became_active":"2023-10-24T00:44:19.368452+0000","last_became_peered":"2023-10-24T00:44:19.368452+0000","last_unstale":"2023-10-24T00:44:19.376714+0000","last_undegraded":"2023-10-24T00:44:19.376714+0000","last_fullsized":"2023-10-24T00:44:19.376714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"80'3","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374849+0000","last_change":"2023-10-24T00:44:19.003478+0000","last_active":"2023-10-24T00:44:19.374849+0000","last_peered":"2023-10-24T00:44:19.374849+0000","last_clean":"2023-10-24T00:44:19.374849+0000","last_became_active":"2023-10-24T00:44:19.003192+0000","last_became_peered":"2023-10-24T00:44:19.003192+0000","last_unstale":"2023-10-24T00:44:19.374849+0000","last_undegraded":"2023-10-24T00:44:19.374849+0000","last_fullsized":"2023-10-24T00:44:19.374849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368912+0000","last_change":"2023-10-24T00:44:19.363993+0000","last_active":"2023-10-24T00:44:19.368912+0000","last_peered":"2023-10-24T00:44:19.368912+0000","last_clean":"2023-10-24T00:44:19.368912+0000","last_became_active":"2023-10-24T00:44:19.363693+0000","last_became_peered":"2023-10-24T00:44:19.363693+0000","last_unstale":"2023-10-24T00:44:19.368912+0000","last_undegraded":"2023-10-24T00:44:19.368912+0000","last_fullsized":"2023-10-24T00:44:19.368912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.363458+0000","last_change":"2023-10-24T00:44:18.991279+0000","last_active":"2023-10-24T00:44:19.363458+0000","last_peered":"2023-10-24T00:44:19.363458+0000","last_clean":"2023-10-24T00:44:19.363458+0000","last_became_active":"2023-10-24T00:44:18.990733+0000","last_became_peered":"2023-10-24T00:44:18.990733+0000","last_unstale":"2023-10-24T00:44:19.363458+0000","last_undegraded":"2023-10-24T00:44:19.363458+0000","last_fullsized":"2023-10-24T00:44:19.363458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.367519+0000","last_change":"2023-10-24T00:44:19.355949+0000","last_active":"2023-10-24T00:44:19.367519+0000","last_peered":"2023-10-24T00:44:19.367519+0000","last_clean":"2023-10-24T00:44:19.367519+0000","last_became_active":"2023-10-24T00:44:19.355683+0000","last_became_peered":"2023-10-24T00:44:19.355683+0000","last_unstale":"2023-10-24T00:44:19.367519+0000","last_undegraded":"2023-10-24T00:44:19.367519+0000","last_fullsized":"2023-10-24T00:44:19.367519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369068+0000","last_change":"2023-10-24T00:44:18.999146+0000","last_active":"2023-10-24T00:44:19.369068+0000","last_peered":"2023-10-24T00:44:19.369068+0000","last_clean":"2023-10-24T00:44:19.369068+0000","last_became_active":"2023-10-24T00:44:18.998413+0000","last_became_peered":"2023-10-24T00:44:18.998413+0000","last_unstale":"2023-10-24T00:44:19.369068+0000","last_undegraded":"2023-10-24T00:44:19.369068+0000","last_fullsized":"2023-10-24T00:44:19.369068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369968+0000","last_change":"2023-10-24T00:44:19.364355+0000","last_active":"2023-10-24T00:44:19.369968+0000","last_peered":"2023-10-24T00:44:19.369968+0000","last_clean":"2023-10-24T00:44:19.369968+0000","last_became_active":"2023-10-24T00:44:19.364077+0000","last_became_peered":"2023-10-24T00:44:19.364077+0000","last_unstale":"2023-10-24T00:44:19.369968+0000","last_undegraded":"2023-10-24T00:44:19.369968+0000","last_fullsized":"2023-10-24T00:44:19.369968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.353246+0000","last_change":"2023-10-24T00:44:19.003962+0000","last_active":"2023-10-24T00:44:19.353246+0000","last_peered":"2023-10-24T00:44:19.353246+0000","last_clean":"2023-10-24T00:44:19.353246+0000","last_became_active":"2023-10-24T00:44:19.003238+0000","last_became_peered":"2023-10-24T00:44:19.003238+0000","last_unstale":"2023-10-24T00:44:19.353246+0000","last_undegraded":"2023-10-24T00:44:19.353246+0000","last_fullsized":"2023-10-24T00:44:19.353246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368857+0000","last_change":"2023-10-24T00:44:19.357435+0000","last_active":"2023-10-24T00:44:19.368857+0000","last_peered":"2023-10-24T00:44:19.368857+0000","last_clean":"2023-10-24T00:44:19.368857+0000","last_became_active":"2023-10-24T00:44:19.357152+0000","last_became_peered":"2023-10-24T00:44:19.357152+0000","last_unstale":"2023-10-24T00:44:19.368857+0000","last_undegraded":"2023-10-24T00:44:19.368857+0000","last_fullsized":"2023-10-24T00:44:19.368857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356447+0000","last_change":"2023-10-24T00:44:18.996949+0000","last_active":"2023-10-24T00:44:19.356447+0000","last_peered":"2023-10-24T00:44:19.356447+0000","last_clean":"2023-10-24T00:44:19.356447+0000","last_became_active":"2023-10-24T00:44:18.996508+0000","last_became_peered":"2023-10-24T00:44:18.996508+0000","last_unstale":"2023-10-24T00:44:19.356447+0000","last_undegraded":"2023-10-24T00:44:19.356447+0000","last_fullsized":"2023-10-24T00:44:19.356447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.359055+0000","last_change":"2023-10-24T00:44:19.355777+0000","last_active":"2023-10-24T00:44:19.359055+0000","last_peered":"2023-10-24T00:44:19.359055+0000","last_clean":"2023-10-24T00:44:19.359055+0000","last_became_active":"2023-10-24T00:44:19.355232+0000","last_became_peered":"2023-10-24T00:44:19.355232+0000","last_unstale":"2023-10-24T00:44:19.359055+0000","last_undegraded":"2023-10-24T00:44:19.359055+0000","last_fullsized":"2023-10-24T00:44:19.359055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"80'4","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372406+0000","last_change":"2023-10-24T00:44:18.997143+0000","last_active":"2023-10-24T00:44:19.372406+0000","last_peered":"2023-10-24T00:44:19.372406+0000","last_clean":"2023-10-24T00:44:19.372406+0000","last_became_active":"2023-10-24T00:44:18.996829+0000","last_became_peered":"2023-10-24T00:44:18.996829+0000","last_unstale":"2023-10-24T00:44:19.372406+0000","last_undegraded":"2023-10-24T00:44:19.372406+0000","last_fullsized":"2023-10-24T00:44:19.372406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.378539+0000","last_change":"2023-10-24T00:44:19.372727+0000","last_active":"2023-10-24T00:44:19.378539+0000","last_peered":"2023-10-24T00:44:19.378539+0000","last_clean":"2023-10-24T00:44:19.378539+0000","last_became_active":"2023-10-24T00:44:19.372447+0000","last_became_peered":"2023-10-24T00:44:19.372447+0000","last_unstale":"2023-10-24T00:44:19.378539+0000","last_undegraded":"2023-10-24T00:44:19.378539+0000","last_fullsized":"2023-10-24T00:44:19.378539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368848+0000","last_change":"2023-10-24T00:44:18.999768+0000","last_active":"2023-10-24T00:44:19.368848+0000","last_peered":"2023-10-24T00:44:19.368848+0000","last_clean":"2023-10-24T00:44:19.368848+0000","last_became_active":"2023-10-24T00:44:18.999468+0000","last_became_peered":"2023-10-24T00:44:18.999468+0000","last_unstale":"2023-10-24T00:44:19.368848+0000","last_undegraded":"2023-10-24T00:44:19.368848+0000","last_fullsized":"2023-10-24T00:44:19.368848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372769+0000","last_change":"2023-10-24T00:44:19.368184+0000","last_active":"2023-10-24T00:44:19.372769+0000","last_peered":"2023-10-24T00:44:19.372769+0000","last_clean":"2023-10-24T00:44:19.372769+0000","last_became_active":"2023-10-24T00:44:19.367920+0000","last_became_peered":"2023-10-24T00:44:19.367920+0000","last_unstale":"2023-10-24T00:44:19.372769+0000","last_undegraded":"2023-10-24T00:44:19.372769+0000","last_fullsized":"2023-10-24T00:44:19.372769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.355073+0000","last_change":"2023-10-24T00:44:18.996209+0000","last_active":"2023-10-24T00:44:19.355073+0000","last_peered":"2023-10-24T00:44:19.355073+0000","last_clean":"2023-10-24T00:44:19.355073+0000","last_became_active":"2023-10-24T00:44:18.995918+0000","last_became_peered":"2023-10-24T00:44:18.995918+0000","last_unstale":"2023-10-24T00:44:19.355073+0000","last_undegraded":"2023-10-24T00:44:19.355073+0000","last_fullsized":"2023-10-24T00:44:19.355073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.372260+0000","last_change":"2023-10-24T00:44:19.367539+0000","last_active":"2023-10-24T00:44:19.372260+0000","last_peered":"2023-10-24T00:44:19.372260+0000","last_clean":"2023-10-24T00:44:19.372260+0000","last_became_active":"2023-10-24T00:44:19.366513+0000","last_became_peered":"2023-10-24T00:44:19.366513+0000","last_unstale":"2023-10-24T00:44:19.372260+0000","last_undegraded":"2023-10-24T00:44:19.372260+0000","last_fullsized":"2023-10-24T00:44:19.372260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351692+0000","last_change":"2023-10-24T00:44:18.998681+0000","last_active":"2023-10-24T00:44:19.351692+0000","last_peered":"2023-10-24T00:44:19.351692+0000","last_clean":"2023-10-24T00:44:19.351692+0000","last_became_active":"2023-10-24T00:44:18.997838+0000","last_became_peered":"2023-10-24T00:44:18.997838+0000","last_unstale":"2023-10-24T00:44:19.351692+0000","last_undegraded":"2023-10-24T00:44:19.351692+0000","last_fullsized":"2023-10-24T00:44:19.351692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376785+0000","last_change":"2023-10-24T00:44:19.369326+0000","last_active":"2023-10-24T00:44:19.376785+0000","last_peered":"2023-10-24T00:44:19.376785+0000","last_clean":"2023-10-24T00:44:19.376785+0000","last_became_active":"2023-10-24T00:44:19.365629+0000","last_became_peered":"2023-10-24T00:44:19.365629+0000","last_unstale":"2023-10-24T00:44:19.376785+0000","last_undegraded":"2023-10-24T00:44:19.376785+0000","last_fullsized":"2023-10-24T00:44:19.376785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348393+0000","last_change":"2023-10-24T00:44:18.990704+0000","last_active":"2023-10-24T00:44:19.348393+0000","last_peered":"2023-10-24T00:44:19.348393+0000","last_clean":"2023-10-24T00:44:19.348393+0000","last_became_active":"2023-10-24T00:44:18.990361+0000","last_became_peered":"2023-10-24T00:44:18.990361+0000","last_unstale":"2023-10-24T00:44:19.348393+0000","last_undegraded":"2023-10-24T00:44:19.348393+0000","last_fullsized":"2023-10-24T00:44:19.348393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.363453+0000","last_change":"2023-10-24T00:44:19.360146+0000","last_active":"2023-10-24T00:44:19.363453+0000","last_peered":"2023-10-24T00:44:19.363453+0000","last_clean":"2023-10-24T00:44:19.363453+0000","last_became_active":"2023-10-24T00:44:19.359849+0000","last_became_peered":"2023-10-24T00:44:19.359849+0000","last_unstale":"2023-10-24T00:44:19.363453+0000","last_undegraded":"2023-10-24T00:44:19.363453+0000","last_fullsized":"2023-10-24T00:44:19.363453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358408+0000","last_change":"2023-10-24T00:44:18.999336+0000","last_active":"2023-10-24T00:44:19.358408+0000","last_peered":"2023-10-24T00:44:19.358408+0000","last_clean":"2023-10-24T00:44:19.358408+0000","last_became_active":"2023-10-24T00:44:18.998739+0000","last_became_peered":"2023-10-24T00:44:18.998739+0000","last_unstale":"2023-10-24T00:44:19.358408+0000","last_undegraded":"2023-10-24T00:44:19.358408+0000","last_fullsized":"2023-10-24T00:44:19.358408+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.369646+0000","last_change":"2023-10-24T00:44:19.355935+0000","last_active":"2023-10-24T00:44:19.369646+0000","last_peered":"2023-10-24T00:44:19.369646+0000","last_clean":"2023-10-24T00:44:19.369646+0000","last_became_active":"2023-10-24T00:44:19.355650+0000","last_became_peered":"2023-10-24T00:44:19.355650+0000","last_unstale":"2023-10-24T00:44:19.369646+0000","last_undegraded":"2023-10-24T00:44:19.369646+0000","last_fullsized":"2023-10-24T00:44:19.369646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356541+0000","last_change":"2023-10-24T00:44:18.987757+0000","last_active":"2023-10-24T00:44:19.356541+0000","last_peered":"2023-10-24T00:44:19.356541+0000","last_clean":"2023-10-24T00:44:19.356541+0000","last_became_active":"2023-10-24T00:44:18.987454+0000","last_became_peered":"2023-10-24T00:44:18.987454+0000","last_unstale":"2023-10-24T00:44:19.356541+0000","last_undegraded":"2023-10-24T00:44:19.356541+0000","last_fullsized":"2023-10-24T00:44:19.356541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.362073+0000","last_change":"2023-10-24T00:44:19.358443+0000","last_active":"2023-10-24T00:44:19.362073+0000","last_peered":"2023-10-24T00:44:19.362073+0000","last_clean":"2023-10-24T00:44:19.362073+0000","last_became_active":"2023-10-24T00:44:19.358207+0000","last_became_peered":"2023-10-24T00:44:19.358207+0000","last_unstale":"2023-10-24T00:44:19.362073+0000","last_undegraded":"2023-10-24T00:44:19.362073+0000","last_fullsized":"2023-10-24T00:44:19.362073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351664+0000","last_change":"2023-10-24T00:44:18.995961+0000","last_active":"2023-10-24T00:44:19.351664+0000","last_peered":"2023-10-24T00:44:19.351664+0000","last_clean":"2023-10-24T00:44:19.351664+0000","last_became_active":"2023-10-24T00:44:18.995687+0000","last_became_peered":"2023-10-24T00:44:18.995687+0000","last_unstale":"2023-10-24T00:44:19.351664+0000","last_undegraded":"2023-10-24T00:44:19.351664+0000","last_fullsized":"2023-10-24T00:44:19.351664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371636+0000","last_change":"2023-10-24T00:44:19.366739+0000","last_active":"2023-10-24T00:44:19.371636+0000","last_peered":"2023-10-24T00:44:19.371636+0000","last_clean":"2023-10-24T00:44:19.371636+0000","last_became_active":"2023-10-24T00:44:19.366414+0000","last_became_peered":"2023-10-24T00:44:19.366414+0000","last_unstale":"2023-10-24T00:44:19.371636+0000","last_undegraded":"2023-10-24T00:44:19.371636+0000","last_fullsized":"2023-10-24T00:44:19.371636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348034+0000","last_change":"2023-10-24T00:44:18.999552+0000","last_active":"2023-10-24T00:44:19.348034+0000","last_peered":"2023-10-24T00:44:19.348034+0000","last_clean":"2023-10-24T00:44:19.348034+0000","last_became_active":"2023-10-24T00:44:18.999258+0000","last_became_peered":"2023-10-24T00:44:18.999258+0000","last_unstale":"2023-10-24T00:44:19.348034+0000","last_undegraded":"2023-10-24T00:44:19.348034+0000","last_fullsized":"2023-10-24T00:44:19.348034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376954+0000","last_change":"2023-10-24T00:44:19.373673+0000","last_active":"2023-10-24T00:44:19.376954+0000","last_peered":"2023-10-24T00:44:19.376954+0000","last_clean":"2023-10-24T00:44:19.376954+0000","last_became_active":"2023-10-24T00:44:19.373411+0000","last_became_peered":"2023-10-24T00:44:19.373411+0000","last_unstale":"2023-10-24T00:44:19.376954+0000","last_undegraded":"2023-10-24T00:44:19.376954+0000","last_fullsized":"2023-10-24T00:44:19.376954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374862+0000","last_change":"2023-10-24T00:44:18.995213+0000","last_active":"2023-10-24T00:44:19.374862+0000","last_peered":"2023-10-24T00:44:19.374862+0000","last_clean":"2023-10-24T00:44:19.374862+0000","last_became_active":"2023-10-24T00:44:18.994931+0000","last_became_peered":"2023-10-24T00:44:18.994931+0000","last_unstale":"2023-10-24T00:44:19.374862+0000","last_undegraded":"2023-10-24T00:44:19.374862+0000","last_fullsized":"2023-10-24T00:44:19.374862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.348291+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:19.348291+0000","last_peered":"2023-10-24T00:44:19.348291+0000","last_clean":"2023-10-24T00:44:19.348291+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:19.348291+0000","last_undegraded":"2023-10-24T00:44:19.348291+0000","last_fullsized":"2023-10-24T00:44:19.348291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376875+0000","last_change":"2023-10-24T00:44:19.366049+0000","last_active":"2023-10-24T00:44:19.376875+0000","last_peered":"2023-10-24T00:44:19.376875+0000","last_clean":"2023-10-24T00:44:19.376875+0000","last_became_active":"2023-10-24T00:44:19.365779+0000","last_became_peered":"2023-10-24T00:44:19.365779+0000","last_unstale":"2023-10-24T00:44:19.376875+0000","last_undegraded":"2023-10-24T00:44:19.376875+0000","last_fullsized":"2023-10-24T00:44:19.376875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351210+0000","last_change":"2023-10-24T00:44:18.999384+0000","last_active":"2023-10-24T00:44:19.351210+0000","last_peered":"2023-10-24T00:44:19.351210+0000","last_clean":"2023-10-24T00:44:19.351210+0000","last_became_active":"2023-10-24T00:44:18.999120+0000","last_became_peered":"2023-10-24T00:44:18.999120+0000","last_unstale":"2023-10-24T00:44:19.351210+0000","last_undegraded":"2023-10-24T00:44:19.351210+0000","last_fullsized":"2023-10-24T00:44:19.351210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.353332+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:19.353332+0000","last_peered":"2023-10-24T00:44:19.353332+0000","last_clean":"2023-10-24T00:44:19.353332+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:19.353332+0000","last_undegraded":"2023-10-24T00:44:19.353332+0000","last_fullsized":"2023-10-24T00:44:19.353332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374233+0000","last_change":"2023-10-24T00:44:19.370083+0000","last_active":"2023-10-24T00:44:19.374233+0000","last_peered":"2023-10-24T00:44:19.374233+0000","last_clean":"2023-10-24T00:44:19.374233+0000","last_became_active":"2023-10-24T00:44:19.369778+0000","last_became_peered":"2023-10-24T00:44:19.369778+0000","last_unstale":"2023-10-24T00:44:19.374233+0000","last_undegraded":"2023-10-24T00:44:19.374233+0000","last_fullsized":"2023-10-24T00:44:19.374233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.353280+0000","last_change":"2023-10-24T00:44:19.000031+0000","last_active":"2023-10-24T00:44:19.353280+0000","last_peered":"2023-10-24T00:44:19.353280+0000","last_clean":"2023-10-24T00:44:19.353280+0000","last_became_active":"2023-10-24T00:44:18.999739+0000","last_became_peered":"2023-10-24T00:44:18.999739+0000","last_unstale":"2023-10-24T00:44:19.353280+0000","last_undegraded":"2023-10-24T00:44:19.353280+0000","last_fullsized":"2023-10-24T00:44:19.353280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.357834+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:19.357834+0000","last_peered":"2023-10-24T00:44:19.357834+0000","last_clean":"2023-10-24T00:44:19.357834+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:19.357834+0000","last_undegraded":"2023-10-24T00:44:19.357834+0000","last_fullsized":"2023-10-24T00:44:19.357834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.363071+0000","last_change":"2023-10-24T00:44:19.360107+0000","last_active":"2023-10-24T00:44:19.363071+0000","last_peered":"2023-10-24T00:44:19.363071+0000","last_clean":"2023-10-24T00:44:19.363071+0000","last_became_active":"2023-10-24T00:44:19.359826+0000","last_became_peered":"2023-10-24T00:44:19.359826+0000","last_unstale":"2023-10-24T00:44:19.363071+0000","last_undegraded":"2023-10-24T00:44:19.363071+0000","last_fullsized":"2023-10-24T00:44:19.363071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.351359+0000","last_change":"2023-10-24T00:44:18.995012+0000","last_active":"2023-10-24T00:44:19.351359+0000","last_peered":"2023-10-24T00:44:19.351359+0000","last_clean":"2023-10-24T00:44:19.351359+0000","last_became_active":"2023-10-24T00:44:18.994740+0000","last_became_peered":"2023-10-24T00:44:18.994740+0000","last_unstale":"2023-10-24T00:44:19.351359+0000","last_undegraded":"2023-10-24T00:44:19.351359+0000","last_fullsized":"2023-10-24T00:44:19.351359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.361769+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:19.361769+0000","last_peered":"2023-10-24T00:44:19.361769+0000","last_clean":"2023-10-24T00:44:19.361769+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:19.361769+0000","last_undegraded":"2023-10-24T00:44:19.361769+0000","last_fullsized":"2023-10-24T00:44:19.361769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.355771+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:19.355771+0000","last_peered":"2023-10-24T00:44:19.355771+0000","last_clean":"2023-10-24T00:44:19.355771+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:19.355771+0000","last_undegraded":"2023-10-24T00:44:19.355771+0000","last_fullsized":"2023-10-24T00:44:19.355771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.371738+0000","last_change":"2023-10-24T00:44:19.370031+0000","last_active":"2023-10-24T00:44:19.371738+0000","last_peered":"2023-10-24T00:44:19.371738+0000","last_clean":"2023-10-24T00:44:19.371738+0000","last_became_active":"2023-10-24T00:44:19.369754+0000","last_became_peered":"2023-10-24T00:44:19.369754+0000","last_unstale":"2023-10-24T00:44:19.371738+0000","last_undegraded":"2023-10-24T00:44:19.371738+0000","last_fullsized":"2023-10-24T00:44:19.371738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.363506+0000","last_change":"2023-10-24T00:44:18.997386+0000","last_active":"2023-10-24T00:44:19.363506+0000","last_peered":"2023-10-24T00:44:19.363506+0000","last_clean":"2023-10-24T00:44:19.363506+0000","last_became_active":"2023-10-24T00:44:18.997004+0000","last_became_peered":"2023-10-24T00:44:18.997004+0000","last_unstale":"2023-10-24T00:44:19.363506+0000","last_undegraded":"2023-10-24T00:44:19.363506+0000","last_fullsized":"2023-10-24T00:44:19.363506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356093+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:19.356093+0000","last_peered":"2023-10-24T00:44:19.356093+0000","last_clean":"2023-10-24T00:44:19.356093+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:19.356093+0000","last_undegraded":"2023-10-24T00:44:19.356093+0000","last_fullsized":"2023-10-24T00:44:19.356093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.376983+0000","last_change":"2023-10-24T00:44:19.370863+0000","last_active":"2023-10-24T00:44:19.376983+0000","last_peered":"2023-10-24T00:44:19.376983+0000","last_clean":"2023-10-24T00:44:19.376983+0000","last_became_active":"2023-10-24T00:44:19.370558+0000","last_became_peered":"2023-10-24T00:44:19.370558+0000","last_unstale":"2023-10-24T00:44:19.376983+0000","last_undegraded":"2023-10-24T00:44:19.376983+0000","last_fullsized":"2023-10-24T00:44:19.376983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.374641+0000","last_change":"2023-10-24T00:44:19.001810+0000","last_active":"2023-10-24T00:44:19.374641+0000","last_peered":"2023-10-24T00:44:19.374641+0000","last_clean":"2023-10-24T00:44:19.374641+0000","last_became_active":"2023-10-24T00:44:19.001524+0000","last_became_peered":"2023-10-24T00:44:19.001524+0000","last_unstale":"2023-10-24T00:44:19.374641+0000","last_undegraded":"2023-10-24T00:44:19.374641+0000","last_fullsized":"2023-10-24T00:44:19.374641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.360072+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:19.360072+0000","last_peered":"2023-10-24T00:44:19.360072+0000","last_clean":"2023-10-24T00:44:19.360072+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:19.360072+0000","last_undegraded":"2023-10-24T00:44:19.360072+0000","last_fullsized":"2023-10-24T00:44:19.360072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.368396+0000","last_change":"2023-10-24T00:44:19.359089+0000","last_active":"2023-10-24T00:44:19.368396+0000","last_peered":"2023-10-24T00:44:19.368396+0000","last_clean":"2023-10-24T00:44:19.368396+0000","last_became_active":"2023-10-24T00:44:19.358877+0000","last_became_peered":"2023-10-24T00:44:19.358877+0000","last_unstale":"2023-10-24T00:44:19.368396+0000","last_undegraded":"2023-10-24T00:44:19.368396+0000","last_fullsized":"2023-10-24T00:44:19.368396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.358641+0000","last_change":"2023-10-24T00:44:19.005142+0000","last_active":"2023-10-24T00:44:19.358641+0000","last_peered":"2023-10-24T00:44:19.358641+0000","last_clean":"2023-10-24T00:44:19.358641+0000","last_became_active":"2023-10-24T00:44:19.004839+0000","last_became_peered":"2023-10-24T00:44:19.004839+0000","last_unstale":"2023-10-24T00:44:19.358641+0000","last_undegraded":"2023-10-24T00:44:19.358641+0000","last_fullsized":"2023-10-24T00:44:19.358641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.349305+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:19.349305+0000","last_peered":"2023-10-24T00:44:19.349305+0000","last_clean":"2023-10-24T00:44:19.349305+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:19.349305+0000","last_undegraded":"2023-10-24T00:44:19.349305+0000","last_fullsized":"2023-10-24T00:44:19.349305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.375258+0000","last_change":"2023-10-24T00:44:19.365763+0000","last_active":"2023-10-24T00:44:19.375258+0000","last_peered":"2023-10-24T00:44:19.375258+0000","last_clean":"2023-10-24T00:44:19.375258+0000","last_became_active":"2023-10-24T00:44:19.365259+0000","last_became_peered":"2023-10-24T00:44:19.365259+0000","last_unstale":"2023-10-24T00:44:19.375258+0000","last_undegraded":"2023-10-24T00:44:19.375258+0000","last_fullsized":"2023-10-24T00:44:19.375258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:18.969466+0000","last_clean_scrub_stamp":"2023-10-24T00:44:18.969466+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.356919+0000","last_change":"2023-10-24T00:44:18.992422+0000","last_active":"2023-10-24T00:44:19.356919+0000","last_peered":"2023-10-24T00:44:19.356919+0000","last_clean":"2023-10-24T00:44:19.356919+0000","last_became_active":"2023-10-24T00:44:18.992112+0000","last_became_peered":"2023-10-24T00:44:18.992112+0000","last_unstale":"2023-10-24T00:44:19.356919+0000","last_undegraded":"2023-10-24T00:44:19.356919+0000","last_fullsized":"2023-10-24T00:44:19.356919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:17.963912+0000","last_clean_scrub_stamp":"2023-10-24T00:44:17.963912+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-10-24T00:44:19.355983+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:19.355983+0000","last_peered":"2023-10-24T00:44:19.355983+0000","last_clean":"2023-10-24T00:44:19.355983+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:19.355983+0000","last_undegraded":"2023-10-24T00:44:19.355983+0000","last_fullsized":"2023-10-24T00:44:19.355983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542333,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302156,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069684,"statfs":{"total":96636764160,"available":96327356416,"internally_reserved":0,"allocated":987136,"data_stored":485954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.377}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46200000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302148,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069692,"statfs":{"total":96636764160,"available":96327364608,"internally_reserved":0,"allocated":978944,"data_stored":484972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.621},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.52800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.496},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.56200000000000006}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.437}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302160,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069680,"statfs":{"total":96636764160,"available":96327352320,"internally_reserved":0,"allocated":991232,"data_stored":485694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.32000000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.34899999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.379}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.77700000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.746}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298048,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073792,"statfs":{"total":96636764160,"available":96331563008,"internally_reserved":0,"allocated":974848,"data_stored":484938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.28100000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.38500000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.502},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.59899999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542333,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":983040,"data_stored":485562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.33500000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.27900000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.32100000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.495},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.40799999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.439}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.41599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":983040,"data_stored":485562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.371},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.28599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.308},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.502},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":983040,"data_stored":485582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.48799999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.437}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.313},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35899999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.497}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":983040,"data_stored":485852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.46899999999999997}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.495}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.56499999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:27.108 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:44:27.108 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:44:27.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.259+0000 7f503bc18700 1 Processor -- start 2023-10-24T00:44:27.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 -- start start 2023-10-24T00:44:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f5034154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f50340bffd0 0x7f50340c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340c0970 con 0x7f5034154430 2023-10-24T00:44:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340c6a10 con 0x7f50340bffd0 2023-10-24T00:44:27.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.260+0000 7f503bc18700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c71d0 con 0x7f5034098bd0 2023-10-24T00:44:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50399b4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5034154430 0x7f50340c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60926/0 (socket says 172.21.15.148:60926) 2023-10-24T00:44:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f50340bffd0 0x7f50340c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50399b4700 1 -- 172.21.15.148:0/2046414330 learned_addr learned my addr 172.21.15.148:0/2046414330 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:27.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 -- 172.21.15.148:0/2046414330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 msgr2=0x7f5034154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:27.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50391b3700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f5034154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f5034154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 -- 172.21.15.148:0/2046414330 >> v1:172.21.15.148:6789/0 conn(0x7f5034154430 legacy=0x7f50340c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 -- 172.21.15.148:0/2046414330 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c9410 con 0x7f50340bffd0 2023-10-24T00:44:27.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50389b2700 1 -- 172.21.15.148:0/2046414330 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593857635 0 0) 0x7f5024001490 con 0x7f5034154430 2023-10-24T00:44:27.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50391b3700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f5034154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:27.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f503a1b5700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50340c0480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f502c009790 tx=0x7f502c009060).ready entity=mon.0 client_cookie=19ece983b9fa6867 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50389b2700 1 -- 172.21.15.148:0/2046414330 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00b580 con 0x7f50340bffd0 2023-10-24T00:44:27.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50389b2700 1 -- 172.21.15.148:0/2046414330 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00b6e0 con 0x7f50340bffd0 2023-10-24T00:44:27.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.261+0000 7f50389b2700 1 -- 172.21.15.148:0/2046414330 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00ba60 con 0x7f50340bffd0 2023-10-24T00:44:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 -- 172.21.15.148:0/2046414330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 msgr2=0x7f50340c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50340c0480 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f502c009790 tx=0x7f502c009060).stop 2023-10-24T00:44:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 -- 172.21.15.148:0/2046414330 shutdown_connections 2023-10-24T00:44:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50340c0480 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 --2- 172.21.15.148:0/2046414330 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f5034154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 -- 172.21.15.148:0/2046414330 >> 172.21.15.148:0/2046414330 conn(0x7f50340cb070 msgr2=0x7f50340cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 -- 172.21.15.148:0/2046414330 shutdown_connections 2023-10-24T00:44:27.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.262+0000 7f503bc18700 1 -- 172.21.15.148:0/2046414330 wait complete. 2023-10-24T00:44:27.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.263+0000 7f503bc18700 1 Processor -- start 2023-10-24T00:44:27.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.263+0000 7f503bc18700 1 -- start start 2023-10-24T00:44:27.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f503414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5034154430 0x7f50340b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503414f8d0 con 0x7f50340bffd0 2023-10-24T00:44:27.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341538e0 con 0x7f5034154430 2023-10-24T00:44:27.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5034152cd0 con 0x7f5034098bd0 2023-10-24T00:44:27.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40580/0 (socket says 172.21.15.148:40580) 2023-10-24T00:44:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 -- 172.21.15.148:0/1305948873 learned_addr learned my addr 172.21.15.148:0/1305948873 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50399b4700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f503414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503a1b5700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5034154430 0x7f50340b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 -- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 msgr2=0x7f503414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f503414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 -- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5034154430 msgr2=0x7f50340b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5034154430 0x7f50340b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 -- 172.21.15.148:0/1305948873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0092a0 con 0x7f50340bffd0 2023-10-24T00:44:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f50391b3700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f502800c8b0 tx=0x7f5028008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028010580 con 0x7f50340bffd0 2023-10-24T00:44:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280106e0 con 0x7f50340bffd0 2023-10-24T00:44:27.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5034152fb0 con 0x7f50340bffd0 2023-10-24T00:44:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.264+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028010a60 con 0x7f50340bffd0 2023-10-24T00:44:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.265+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034153570 con 0x7f50340bffd0 2023-10-24T00:44:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.266+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f502801b460 con 0x7f50340bffd0 2023-10-24T00:44:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.266+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340c33c0 con 0x7f50340bffd0 2023-10-24T00:44:27.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.266+0000 7f5031ffb700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 0x7f5020061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.266+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f502807a1d0 con 0x7f50340bffd0 2023-10-24T00:44:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.267+0000 7f50399b4700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 0x7f5020061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.267+0000 7f50399b4700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 0x7f5020061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5024007fd0 tx=0x7f5024007d90).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.271+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f502804b2c0 con 0x7f50340bffd0 2023-10-24T00:44:27.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.503+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f503406c6b0 con 0x7f50340bffd0 2023-10-24T00:44:27.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.507+0000 7f5031ffb700 1 -- 172.21.15.148:0/1305948873 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f502804e8e0 con 0x7f50340bffd0 2023-10-24T00:44:27.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 msgr2=0x7f5020061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 0x7f5020061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5024007fd0 tx=0x7f5024007d90).stop 2023-10-24T00:44:27.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 msgr2=0x7f50341523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f502800c8b0 tx=0x7f5028008040).stop 2023-10-24T00:44:27.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 shutdown_connections 2023-10-24T00:44:27.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5034154430 0x7f50340b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5034098bd0 0x7f503414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f502005f270 0x7f5020061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 --2- 172.21.15.148:0/1305948873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50340bffd0 0x7f50341523d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 >> 172.21.15.148:0/1305948873 conn(0x7f50340cb070 msgr2=0x7f50340a8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:27.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 shutdown_connections 2023-10-24T00:44:27.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.509+0000 7f503bc18700 1 -- 172.21.15.148:0/1305948873 wait complete. 2023-10-24T00:44:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:44:27.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:27.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.634+0000 7fc30c5d5700 1 Processor -- start 2023-10-24T00:44:27.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.634+0000 7fc30c5d5700 1 -- start start 2023-10-24T00:44:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.635+0000 7fc30c5d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 0x7fc3040c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.635+0000 7fc30c5d5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040aa880 con 0x7fc3040aa3f0 2023-10-24T00:44:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.635+0000 7fc30c5d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040c0960 con 0x7fc3040aa010 2023-10-24T00:44:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.635+0000 7fc30c5d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c0c40 con 0x7fc3040c6710 2023-10-24T00:44:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30ab72700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc3040aa3f0 0x7fc304069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60928/0 (socket says 172.21.15.148:60928) 2023-10-24T00:44:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30ab72700 1 -- 172.21.15.148:0/2708193892 learned_addr learned my addr 172.21.15.148:0/2708193892 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc309b70700 1 --2- 172.21.15.148:0/2708193892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 0x7fc3040c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246436014 0 0) 0x7fc2fc001110 con 0x7fc3040aa3f0 2023-10-24T00:44:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f00033f0 con 0x7fc3040aa3f0 2023-10-24T00:44:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616330838 0 0) 0x7fc3040c0960 con 0x7fc3040aa010 2023-10-24T00:44:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2fc001110 con 0x7fc3040aa010 2023-10-24T00:44:27.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc309b70700 1 -- 172.21.15.148:0/2708193892 >> v1:172.21.15.150:6789/0 conn(0x7fc3040aa010 legacy=0x7fc304158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc309b70700 1 -- 172.21.15.148:0/2708193892 >> v1:172.21.15.148:6789/0 conn(0x7fc3040aa3f0 legacy=0x7fc304069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc309b70700 1 -- 172.21.15.148:0/2708193892 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040c0f20 con 0x7fc3040c6710 2023-10-24T00:44:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc309b70700 1 --2- 172.21.15.148:0/2708193892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 0x7fc3040c1a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc2f4009790 tx=0x7fc2f4009060).ready entity=mon.2 client_cookie=6b1bb868a5627dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400f510 con 0x7fc3040c6710 2023-10-24T00:44:27.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400f670 con 0x7fc3040c6710 2023-10-24T00:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.636+0000 7fc30936f700 1 -- 172.21.15.148:0/2708193892 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400f9f0 con 0x7fc3040c6710 2023-10-24T00:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 -- 172.21.15.148:0/2708193892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 msgr2=0x7fc3040c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/2708193892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 0x7fc3040c1a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fc2f4009790 tx=0x7fc2f4009060).stop 2023-10-24T00:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 -- 172.21.15.148:0/2708193892 shutdown_connections 2023-10-24T00:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/2708193892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040c6710 0x7fc3040c1a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 -- 172.21.15.148:0/2708193892 >> 172.21.15.148:0/2708193892 conn(0x7fc3040caf40 msgr2=0x7fc3040cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 -- 172.21.15.148:0/2708193892 shutdown_connections 2023-10-24T00:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.637+0000 7fc30c5d5700 1 -- 172.21.15.148:0/2708193892 wait complete. 2023-10-24T00:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.638+0000 7fc30c5d5700 1 Processor -- start 2023-10-24T00:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.638+0000 7fc30c5d5700 1 -- start start 2023-10-24T00:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040aa3f0 0x7fc3041554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3040c6710 0x7fc3041559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304153e50 con 0x7fc3040aa010 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c2fb0 con 0x7fc3040c6710 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30c5d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c3270 con 0x7fc3040aa3f0 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40596/0 (socket says 172.21.15.148:40596) 2023-10-24T00:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 -- 172.21.15.148:0/1761087720 learned_addr learned my addr 172.21.15.148:0/1761087720 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc309b70700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040aa3f0 0x7fc3041554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30ab72700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3040c6710 0x7fc3041559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 -- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040aa3f0 msgr2=0x7fc3041554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040aa3f0 0x7fc3041554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 -- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3040c6710 msgr2=0x7fc3041559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3040c6710 0x7fc3041559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 -- 172.21.15.148:0/1761087720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40092a0 con 0x7fc3040aa010 2023-10-24T00:44:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.639+0000 7fc30a371700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fc30000c7c0 tx=0x7fc300002650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.640+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300010510 con 0x7fc3040aa010 2023-10-24T00:44:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.640+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300010670 con 0x7fc3040aa010 2023-10-24T00:44:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.640+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040c3550 con 0x7fc3040aa010 2023-10-24T00:44:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.640+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300010a10 con 0x7fc3040aa010 2023-10-24T00:44:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.640+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040c3b10 con 0x7fc3040aa010 2023-10-24T00:44:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.641+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30406c6b0 con 0x7fc3040aa010 2023-10-24T00:44:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.641+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc30001b400 con 0x7fc3040aa010 2023-10-24T00:44:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.641+0000 7fc2fa7fc700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 0x7fc2e8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.641+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc30007a1b0 con 0x7fc3040aa010 2023-10-24T00:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.642+0000 7fc309b70700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 0x7fc2e8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.642+0000 7fc309b70700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 0x7fc2e8061760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc2f4009fd0 tx=0x7fc2f4017000).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.646+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc30004b1e0 con 0x7fc3040aa010 2023-10-24T00:44:27.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.852+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3040c1200 con 0x7fc3040aa010 2023-10-24T00:44:27.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.853+0000 7fc2fa7fc700 1 -- 172.21.15.148:0/1761087720 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fc30004e800 con 0x7fc3040aa010 2023-10-24T00:44:27.855 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:27.855 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:27.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.854+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 msgr2=0x7fc2e8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.854+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 0x7fc2e8061760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc2f4009fd0 tx=0x7fc2f4017000).stop 2023-10-24T00:44:27.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.854+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 msgr2=0x7fc30414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:27.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.854+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fc30000c7c0 tx=0x7fc300002650).stop 2023-10-24T00:44:27.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.854+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 shutdown_connections 2023-10-24T00:44:27.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3040c6710 0x7fc3041559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc2e805f2a0 0x7fc2e8061760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3040aa010 0x7fc30414fad0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 --2- 172.21.15.148:0/1761087720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3040aa3f0 0x7fc3041554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:27.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 >> 172.21.15.148:0/1761087720 conn(0x7fc3040caf40 msgr2=0x7fc3040c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:27.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 shutdown_connections 2023-10-24T00:44:27.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:27.855+0000 7fc30c5d5700 1 -- 172.21.15.148:0/1761087720 wait complete. 2023-10-24T00:44:27.861 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:28.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:44:19.343320+0000', 'modified': '2023-10-24T00:44:21.353927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'c', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/1132167935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 1132167935}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 1132167935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:44:28.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:44:28.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-24T00:44:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.390+0000 7fcaa99f5700 1 Processor -- start 2023-10-24T00:44:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.390+0000 7fcaa99f5700 1 -- start start 2023-10-24T00:44:28.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa99f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fcaa40c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa99f5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40c01c0 con 0x7fcaa41547e0 2023-10-24T00:44:28.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa99f5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa40c6150 con 0x7fcaa4154400 2023-10-24T00:44:28.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa99f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40aa960 con 0x7fcaa40c0b30 2023-10-24T00:44:28.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcaa41547e0 0x7fcaa40a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60944/0 (socket says 172.21.15.148:60944) 2023-10-24T00:44:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa27fc700 1 -- 172.21.15.148:0/3120330701 learned_addr learned my addr 172.21.15.148:0/3120330701 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fcaa40c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903434953 0 0) 0x7fcaa40c01c0 con 0x7fcaa41547e0 2023-10-24T00:44:28.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca8c0033f0 con 0x7fcaa41547e0 2023-10-24T00:44:28.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1997555595 0 0) 0x7fca8c0033f0 con 0x7fcaa41547e0 2023-10-24T00:44:28.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 msgr2=0x7fcaa40c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fcaa40c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 >> v1:172.21.15.150:6789/0 conn(0x7fcaa4154400 legacy=0x7fcaa40c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40c66f0 con 0x7fcaa41547e0 2023-10-24T00:44:28.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fca980017f0 con 0x7fcaa41547e0 2023-10-24T00:44:28.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 >> v1:172.21.15.148:6789/0 conn(0x7fcaa41547e0 legacy=0x7fcaa40a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fca8c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fca8c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca8c004b80 0x7fca8c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40aa960 con 0x7fca8c003910 2023-10-24T00:44:28.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c00b990 con 0x7fca8c004b80 2023-10-24T00:44:28.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c00bb00 con 0x7fcaa40c0b30 2023-10-24T00:44:28.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.391+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fca8c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fca8c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca8c004b80 0x7fca8c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 msgr2=0x7fca8c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fca8c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca8c004b80 msgr2=0x7fca8c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca8c004b80 0x7fca8c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/3120330701 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0033f0 con 0x7fca8c003910 2023-10-24T00:44:28.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca8c004b80 0x7fca8c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:28.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa40c0b30 0x7fca8c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:28.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fca8c003cf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fca9c001820 tx=0x7fca9c007b90).ready entity=mon.0 client_cookie=3857c240b1c626e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007ea0 con 0x7fca8c003910 2023-10-24T00:44:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c012400 con 0x7fca8c003910 2023-10-24T00:44:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa1ffb700 1 -- 172.21.15.148:0/3120330701 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0127c0 con 0x7fca8c003910 2023-10-24T00:44:28.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa99f5700 1 -- 172.21.15.148:0/3120330701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 msgr2=0x7fca8c003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/3120330701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fca8c003cf0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fca9c001820 tx=0x7fca9c007b90).stop 2023-10-24T00:44:28.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa37fe700 1 -- 172.21.15.148:0/3120330701 reap_dead start 2023-10-24T00:44:28.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.392+0000 7fcaa99f5700 1 -- 172.21.15.148:0/3120330701 shutdown_connections 2023-10-24T00:44:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.393+0000 7fcaa99f5700 1 -- 172.21.15.148:0/3120330701 >> 172.21.15.148:0/3120330701 conn(0x7fcaa40946a0 msgr2=0x7fcaa406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.393+0000 7fcaa99f5700 1 -- 172.21.15.148:0/3120330701 shutdown_connections 2023-10-24T00:44:28.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.393+0000 7fcaa99f5700 1 -- 172.21.15.148:0/3120330701 wait complete. 2023-10-24T00:44:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.394+0000 7fcaa99f5700 1 Processor -- start 2023-10-24T00:44:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.394+0000 7fcaa99f5700 1 -- start start 2023-10-24T00:44:28.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa414ec70 0x7fcaa40a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa40a9880 0x7fcaa414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa414f410 con 0x7fca8c003910 2023-10-24T00:44:28.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4153240 con 0x7fcaa40a9880 2023-10-24T00:44:28.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4153520 con 0x7fcaa414ec70 2023-10-24T00:44:28.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40618/0 (socket says 172.21.15.148:40618) 2023-10-24T00:44:28.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/121279227 learned_addr learned my addr 172.21.15.148:0/121279227 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa414ec70 0x7fcaa40a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa40a9880 0x7fcaa414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa414ec70 msgr2=0x7fcaa40a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa414ec70 0x7fcaa40a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa40a9880 msgr2=0x7fcaa414db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa40a9880 0x7fcaa414db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/121279227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40abcb0 con 0x7fca8c003910 2023-10-24T00:44:28.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fca9c001e10 tx=0x7fca9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fca8affd700 1 -- 172.21.15.148:0/121279227 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007ea0 con 0x7fca8c003910 2023-10-24T00:44:28.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fca8affd700 1 -- 172.21.15.148:0/121279227 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c007240 con 0x7fca8c003910 2023-10-24T00:44:28.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fca8affd700 1 -- 172.21.15.148:0/121279227 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0066a0 con 0x7fca8c003910 2023-10-24T00:44:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40abf90 con 0x7fca8c003910 2023-10-24T00:44:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.395+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa414e010 con 0x7fca8c003910 2023-10-24T00:44:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.397+0000 7fca8affd700 1 -- 172.21.15.148:0/121279227 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fca9c006a90 con 0x7fca8c003910 2023-10-24T00:44:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.397+0000 7fca8affd700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 0x7fca90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.397+0000 7fca8affd700 1 -- 172.21.15.148:0/121279227 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca9c07afe0 con 0x7fca8c003910 2023-10-24T00:44:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.397+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 0x7fca90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.398+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 0x7fca90061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fca98001190 tx=0x7fca980017b0).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.399+0000 7fcabb38db80 1 Processor -- start 2023-10-24T00:44:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.399+0000 7fcabb38db80 1 -- start start 2023-10-24T00:44:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f78e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f785d1b0 con 0x5590f790f190 2023-10-24T00:44:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f7822cb0 con 0x5590f78e8980 2023-10-24T00:44:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590f7837c90 con 0x5590f78e5b20 2023-10-24T00:44:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcaa27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcaa27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40624/0 (socket says 172.21.15.148:40624) 2023-10-24T00:44:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1887944632 learned_addr learned my addr 172.21.15.148:0/1887944632 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f78e5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.400+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 msgr2=0x5590f78e5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f78e5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 msgr2=0x5590f78e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1887944632 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590f7830e70 con 0x5590f790f190 2023-10-24T00:44:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fca980076d0 tx=0x7fca98015000).ready entity=mon.0 client_cookie=807d209d2bddd22 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fca83fff700 1 -- 172.21.15.148:0/1887944632 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98016b20 con 0x5590f790f190 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fca83fff700 1 -- 172.21.15.148:0/1887944632 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98016c80 con 0x5590f790f190 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fca83fff700 1 -- 172.21.15.148:0/1887944632 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98022410 con 0x5590f790f190 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcabb38db80 1 -- 172.21.15.148:0/1887944632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 msgr2=0x5590f78e19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.401+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7fca980076d0 tx=0x7fca98015000).stop 2023-10-24T00:44:28.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 -- 172.21.15.148:0/1887944632 shutdown_connections 2023-10-24T00:44:28.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f78e5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1887944632 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e19a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 -- 172.21.15.148:0/1887944632 >> 172.21.15.148:0/1887944632 conn(0x5590f76a2e40 msgr2=0x5590f792fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 -- 172.21.15.148:0/1887944632 shutdown_connections 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 -- 172.21.15.148:0/1887944632 wait complete. 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 -- start start 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.402+0000 7fcabb38db80 1 Processor -- start 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e8980 0x5590f790bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 0x5590f790f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f7837dd0 con 0x5590f78e5b20 2023-10-24T00:44:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f7838050 con 0x5590f790f190 2023-10-24T00:44:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590f78038d0 con 0x5590f78e8980 2023-10-24T00:44:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcabb38db80 10 client.0 ll_register_callbacks cb 0x5590f78a6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:44:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcaa2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcaa2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40626/0 (socket says 172.21.15.148:40626) 2023-10-24T00:44:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/270312902 learned_addr learned my addr 172.21.15.148:0/270312902 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e8980 0x5590f790bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.403+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 0x5590f790f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e8980 msgr2=0x5590f790bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e8980 0x5590f790bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 msgr2=0x5590f790f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 0x5590f790f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 -- 172.21.15.148:0/270312902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9800f040 con 0x5590f78e5b20 2023-10-24T00:44:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 0x5590f790f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fca9c04fc60 tx=0x7fca9c003040).ready entity=mon.0 client_cookie=4e729d28d38ebfeb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:44:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c054070 con 0x5590f78e5b20 2023-10-24T00:44:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca9c01c340 con 0x5590f78e5b20 2023-10-24T00:44:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590f78da4e0 con 0x5590f78e5b20 2023-10-24T00:44:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9c04e1a0 con 0x5590f78e5b20 2023-10-24T00:44:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 10 client.6468 fetch_fsmap learned FSMap version 25 2023-10-24T00:44:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5590f782c480 con 0x5590f78e5b20 2023-10-24T00:44:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590f78da4e0 con 0x5590f78e5b20 2023-10-24T00:44:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fca9c04f220 con 0x5590f78e5b20 2023-10-24T00:44:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 10 client.6468 fetch_fsmap finished waiting for FSMap version 25 2023-10-24T00:44:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 10 client.6468 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:44:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 20 client.6468 populate_metadata read hostname 'smithi148' 2023-10-24T00:44:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f7931010 0x5590f79313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 4 client.6468 mds_command: new command op to 6309 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 --> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590f78b04b0 con 0x5590f7931010 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.404+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f7931010 0x5590f79313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fca817fa700 10 client.6468 ms_handle_connect on v2:172.21.15.148:6833/1132167935 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f7931010 0x5590f79313f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=34f6bfd8937ff7b5 server_cookie=5d386900d00b4382 in_seq=0 out_seq=0 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fca817fa700 1 -- 172.21.15.148:0/270312902 <== mds.0 v2:172.21.15.148:6833/1132167935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5590f78b04b0 con 0x5590f7931010 2023-10-24T00:44:28.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fca817fa700 10 client.6468 handle_command_reply: tid=0 2023-10-24T00:44:28.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fcabb38db80 1 client.6468 shutdown 2023-10-24T00:44:28.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 msgr2=0x5590f790b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.405+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fca9c04fc60 tx=0x7fca9c003040).stop 2023-10-24T00:44:28.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 shutdown_connections 2023-10-24T00:44:28.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f7931010 0x5590f79313f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f790f190 0x5590f790f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fca817fa700 0 client.6468 ms_handle_reset on v2:172.21.15.148:6833/1132167935 2023-10-24T00:44:28.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e5b20 0x5590f790b6d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 --2- 172.21.15.148:0/270312902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e8980 0x5590f790bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 >> 172.21.15.148:0/270312902 conn(0x5590f76a2e40 msgr2=0x5590f792c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 shutdown_connections 2023-10-24T00:44:28.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 1 -- 172.21.15.148:0/270312902 wait complete. 2023-10-24T00:44:28.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.406+0000 7fcabb38db80 20 client.6468 trim_cache size 0 max 16384 2023-10-24T00:44:28.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.422+0000 7fcabb38db80 1 Processor -- start 2023-10-24T00:44:28.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.422+0000 7fcabb38db80 1 -- start start 2023-10-24T00:44:28.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e5b20 0x5590f792dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f790f190 0x5590f792c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f78de0c0 con 0x5590f78e8980 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f792a610 con 0x5590f78e5b20 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590f7910c90 con 0x5590f790f190 2023-10-24T00:44:28.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40640/0 (socket says 172.21.15.148:40640) 2023-10-24T00:44:28.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1307251776 learned_addr learned my addr 172.21.15.148:0/1307251776 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f790f190 msgr2=0x5590f792c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e5b20 0x5590f792dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f790f190 0x5590f792c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f790f190 0x5590f792c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e5b20 msgr2=0x5590f792dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e5b20 0x5590f792dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 -- 172.21.15.148:0/1307251776 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590f782c1d0 con 0x5590f78e8980 2023-10-24T00:44:28.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fca98007620 tx=0x7fca98018000).ready entity=mon.0 client_cookie=94d6e8f6ff58209d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fca88ff9700 1 -- 172.21.15.148:0/1307251776 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98016b20 con 0x5590f78e8980 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fca88ff9700 1 -- 172.21.15.148:0/1307251776 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98022780 con 0x5590f78e8980 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.423+0000 7fca88ff9700 1 -- 172.21.15.148:0/1307251776 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98022410 con 0x5590f78e8980 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- 172.21.15.148:0/1307251776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 msgr2=0x5590f78f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fca98007620 tx=0x7fca98018000).stop 2023-10-24T00:44:28.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- 172.21.15.148:0/1307251776 shutdown_connections 2023-10-24T00:44:28.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f790f190 0x5590f792c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e5b20 0x5590f792dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 --2- 172.21.15.148:0/1307251776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f78e8980 0x5590f78f5cb0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- 172.21.15.148:0/1307251776 >> 172.21.15.148:0/1307251776 conn(0x5590f76a2e40 msgr2=0x5590f78e5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- 172.21.15.148:0/1307251776 shutdown_connections 2023-10-24T00:44:28.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- 172.21.15.148:0/1307251776 wait complete. 2023-10-24T00:44:28.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.424+0000 7fcabb38db80 1 -- start start 2023-10-24T00:44:28.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 Processor -- start 2023-10-24T00:44:28.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f79762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f79767c0 con 0x5590f790f190 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590f7931480 con 0x5590f78e8980 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590f78e2360 con 0x5590f78e5b20 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.425+0000 7fcabb38db80 10 client.0 ll_register_callbacks cb 0x5590f78a6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:44:28.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40652/0 (socket says 172.21.15.148:40652) 2023-10-24T00:44:28.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 -- 172.21.15.148:0/2373553876 learned_addr learned my addr 172.21.15.148:0/2373553876 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f79762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa27fc700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 -- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 msgr2=0x5590f79762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f79762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 -- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 msgr2=0x5590f78e1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 -- 172.21.15.148:0/2373553876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98026040 con 0x5590f790f190 2023-10-24T00:44:28.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f79762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcaa37fe700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fcaa4083c90 tx=0x7fca94008040).ready entity=mon.0 client_cookie=da6f960cbe0d774f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94016670 con 0x5590f790f190 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca940167d0 con 0x5590f790f190 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca98016c80 con 0x5590f790f190 2023-10-24T00:44:28.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca94016ba0 con 0x5590f790f190 2023-10-24T00:44:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 10 client.6474 fetch_fsmap learned FSMap version 25 2023-10-24T00:44:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5590f76a3f80 con 0x5590f790f190 2023-10-24T00:44:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98016c80 con 0x5590f790f190 2023-10-24T00:44:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fca94016d00 con 0x5590f790f190 2023-10-24T00:44:28.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 10 client.6474 fetch_fsmap finished waiting for FSMap version 25 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 10 client.6474 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 20 client.6474 populate_metadata read hostname 'smithi148' 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f793db90 0x5590f793df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 4 client.6474 mds_command: new command op to 6309 tid=0[{"prefix": "status"}] 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.426+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 --> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5590f769eca0 con 0x5590f793db90 2023-10-24T00:44:28.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f793db90 0x5590f793df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fca817fa700 10 client.6474 ms_handle_connect on v2:172.21.15.148:6833/1132167935 2023-10-24T00:44:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcaa2ffd700 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f793db90 0x5590f793df70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f5c3a518280ccf2a server_cookie=62f41ad2844b2618 in_seq=0 out_seq=0 2023-10-24T00:44:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fca817fa700 1 -- 172.21.15.148:0/2373553876 <== mds.0 v2:172.21.15.148:6833/1132167935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5590f769eca0 con 0x5590f793db90 2023-10-24T00:44:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fca817fa700 10 client.6474 handle_command_reply: tid=0 2023-10-24T00:44:28.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 client.6474 shutdown 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 msgr2=0x5590f78e1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fcaa4083c90 tx=0x7fca94008040).stop 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 shutdown_connections 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5590f790f190 0x5590f78e1d70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5590f78e5b20 0x5590f79762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.148:6833/1132167935,v1:172.21.15.148:6835/1132167935] conn(0x5590f793db90 0x5590f793df70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 --2- 172.21.15.148:0/2373553876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590f78e8980 0x5590f78e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fca817fa700 0 client.6474 ms_handle_reset on v2:172.21.15.148:6833/1132167935 2023-10-24T00:44:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 >> 172.21.15.148:0/2373553876 conn(0x5590f76a2e40 msgr2=0x5590f790c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 shutdown_connections 2023-10-24T00:44:28.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 1 -- 172.21.15.148:0/2373553876 wait complete. 2023-10-24T00:44:28.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.427+0000 7fcabb38db80 20 client.6474 trim_cache size 0 max 16384 2023-10-24T00:44:28.473 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:44:28.473 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:44:28.473 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:44:28.474 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 6309, 2023-10-24T00:44:28.474 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:44:28.474 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:44:28.474 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:44:28.474 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.0830767550000004, 2023-10-24T00:44:28.475 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 25, 2023-10-24T00:44:28.475 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 81, 2023-10-24T00:44:28.475 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 81, 2023-10-24T00:44:28.475 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 13.59193205 2023-10-24T00:44:28.475 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:44:28.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 msgr2=0x7fca90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 0x7fca90061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fca98001190 tx=0x7fca980017b0).stop 2023-10-24T00:44:28.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 msgr2=0x7fcaa414e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7fca9c001e10 tx=0x7fca9c016000).stop 2023-10-24T00:44:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 shutdown_connections 2023-10-24T00:44:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa40a9880 0x7fcaa414db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca9005f270 0x7fca90061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca8c003910 0x7fcaa414e740 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 --2- 172.21.15.148:0/121279227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcaa414ec70 0x7fcaa40a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 >> 172.21.15.148:0/121279227 conn(0x7fcaa40946a0 msgr2=0x7fcaa4063470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 shutdown_connections 2023-10-24T00:44:28.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.428+0000 7fcaa99f5700 1 -- 172.21.15.148:0/121279227 wait complete. 2023-10-24T00:44:28.479 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:44:28.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.579+0000 7f5be8c79700 1 Processor -- start 2023-10-24T00:44:28.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.579+0000 7f5be8c79700 1 -- start start 2023-10-24T00:44:28.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be8c79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be8c79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 0x7f5be40ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be8c79700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40ae6c0 con 0x7f5be40aaae0 2023-10-24T00:44:28.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be8c79700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40cae10 con 0x7f5be41579c0 2023-10-24T00:44:28.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be8c79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c94c0 con 0x7f5be41575e0 2023-10-24T00:44:28.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be1d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 0x7f5be40ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:49130/0 (socket says 172.21.15.148:49130) 2023-10-24T00:44:28.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be259c700 1 -- 172.21.15.148:0/322091978 learned_addr learned my addr 172.21.15.148:0/322091978 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.580+0000 7f5be2d9d700 1 --1- 172.21.15.148:0/322091978 >> v1:172.21.15.150:6789/0 conn(0x7f5be40aaae0 0x7f5be40aaef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:38208/0 (socket says 172.21.15.148:38208) 2023-10-24T00:44:28.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be259c700 1 -- 172.21.15.148:0/322091978 >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 msgr2=0x7f5be40ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:28.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be259c700 1 --2- 172.21.15.148:0/322091978 >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 0x7f5be40ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be259c700 1 -- 172.21.15.148:0/322091978 >> v1:172.21.15.150:6789/0 conn(0x7f5be40aaae0 legacy=0x7f5be40aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be259c700 1 -- 172.21.15.148:0/322091978 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40c8f40 con 0x7f5be41575e0 2023-10-24T00:44:28.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be1d9b700 1 --2- 172.21.15.148:0/322091978 >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 0x7f5be40ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:28.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be259c700 1 --2- 172.21.15.148:0/322091978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5bd4009f70 tx=0x7f5bd4009840).ready entity=mon.2 client_cookie=eead016785be2560 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be159a700 1 -- 172.21.15.148:0/322091978 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400e070 con 0x7f5be41575e0 2023-10-24T00:44:28.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be159a700 1 -- 172.21.15.148:0/322091978 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400ba20 con 0x7f5be41575e0 2023-10-24T00:44:28.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.581+0000 7f5be159a700 1 -- 172.21.15.148:0/322091978 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400bda0 con 0x7f5be41575e0 2023-10-24T00:44:28.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 -- 172.21.15.148:0/322091978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 msgr2=0x7f5be40ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 --2- 172.21.15.148:0/322091978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5bd4009f70 tx=0x7f5bd4009840).stop 2023-10-24T00:44:28.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 -- 172.21.15.148:0/322091978 shutdown_connections 2023-10-24T00:44:28.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 --2- 172.21.15.148:0/322091978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be41575e0 0x7f5be40ca920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 --2- 172.21.15.148:0/322091978 >> v2:172.21.15.150:3300/0 conn(0x7f5be41579c0 0x7f5be40ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 -- 172.21.15.148:0/322091978 >> 172.21.15.148:0/322091978 conn(0x7f5be4094520 msgr2=0x7f5be406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 -- 172.21.15.148:0/322091978 shutdown_connections 2023-10-24T00:44:28.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.582+0000 7f5be8c79700 1 -- 172.21.15.148:0/322091978 wait complete. 2023-10-24T00:44:28.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.583+0000 7f5be8c79700 1 Processor -- start 2023-10-24T00:44:28.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.583+0000 7f5be8c79700 1 -- start start 2023-10-24T00:44:28.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 0x7f5be4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 0x7f5be409b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be409bc40 con 0x7f5be41579c0 2023-10-24T00:44:28.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4156b50 con 0x7f5be41575e0 2023-10-24T00:44:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4166530 con 0x7f5be40aaae0 2023-10-24T00:44:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 0x7f5be409b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40662/0 (socket says 172.21.15.148:40662) 2023-10-24T00:44:28.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be259c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 0x7f5be4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be2d9d700 1 -- 172.21.15.148:0/600207990 learned_addr learned my addr 172.21.15.148:0/600207990 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:28.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 -- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 msgr2=0x7f5be4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 0x7f5be4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 -- 172.21.15.148:0/600207990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 msgr2=0x7f5be409b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 -- 172.21.15.148:0/600207990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80092a0 con 0x7f5be41575e0 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be2d9d700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be259c700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 0x7f5be4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be1d9b700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 0x7f5be409b260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f5bd800e850 tx=0x7f5bd8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8012600 con 0x7f5be41575e0 2023-10-24T00:44:28.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8012760 con 0x7f5be41575e0 2023-10-24T00:44:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8012ae0 con 0x7f5be41575e0 2023-10-24T00:44:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.584+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd4009ae0 con 0x7f5be41575e0 2023-10-24T00:44:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.585+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4166af0 con 0x7f5be41575e0 2023-10-24T00:44:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.585+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be4047480 con 0x7f5be41575e0 2023-10-24T00:44:28.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.586+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5bd801b400 con 0x7f5be41575e0 2023-10-24T00:44:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.586+0000 7f5bd27fc700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 0x7f5bc4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.586+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5bd807a750 con 0x7f5be41575e0 2023-10-24T00:44:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.586+0000 7f5be259c700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 0x7f5bc4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:28.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.587+0000 7f5be259c700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 0x7f5bc4061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5bd400c010 tx=0x7f5bd4009840).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:28.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.591+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5bd804b840 con 0x7f5be41575e0 2023-10-24T00:44:28.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.798+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5be40ad7f0 con 0x7f5be41575e0 2023-10-24T00:44:28.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.798+0000 7f5bd27fc700 1 -- 172.21.15.148:0/600207990 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5bd8016070 con 0x7f5be41575e0 2023-10-24T00:44:28.800 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:44:28.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 msgr2=0x7f5bc4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 0x7f5bc4061700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5bd400c010 tx=0x7f5bd4009840).stop 2023-10-24T00:44:28.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 msgr2=0x7f5be409b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:28.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 0x7f5be409b260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f5bd800e850 tx=0x7f5bd8009060).stop 2023-10-24T00:44:28.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 shutdown_connections 2023-10-24T00:44:28.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5bc405f240 0x7f5bc4061700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5be41579c0 0x7f5be409b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5be40aaae0 0x7f5be4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 --2- 172.21.15.148:0/600207990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5be41575e0 0x7f5be409b260 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:28.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 >> 172.21.15.148:0/600207990 conn(0x7f5be4094520 msgr2=0x7f5be40af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:28.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 shutdown_connections 2023-10-24T00:44:28.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:28.800+0000 7f5be8c79700 1 -- 172.21.15.148:0/600207990 wait complete. 2023-10-24T00:44:28.812 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:44:28.813 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:44:28.813 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:44:28.813 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:44:28.814 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:44:28.814 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:44:28.814 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:44:28.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:44:28.815 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:44:28.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:28.816 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:44:28.831 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:44:28.831 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:44:28.833 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:44:28.833 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.833 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:44:28.834 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.834 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:44:28.834 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:44:28.834 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:44:28.835 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:44:28.835 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:44:28.835 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:44:28.835 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:44:28.835 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:44:28.836 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:44:28.836 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:44:28.836 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:44:28.836 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41460sec preferred_lft 41460sec 2023-10-24T00:44:28.836 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.837 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:44:28.838 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.838 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:44:28.838 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:44:28.838 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:44:28.838 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.839 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:44:28.839 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:44:28.839 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:44:28.839 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:44:28.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:28.840 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:44:28.894 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:44:28.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:28.896 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:44:28.953 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:44:28.953 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:44:28.953 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:44:28.953 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:44:28.954 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:44:28.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:28.955 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:44:28.955 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:44:28.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:44:28.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:44:28.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:44:28.957 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:44:29.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:29.054 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:44:29.069 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:44:29.069 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:44:29.070 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:44:29.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:29.071 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:44:29.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:29.134 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:44:29.189 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:44:29.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:44:29.268 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:44:29.269 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:44:29.295 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:44:29.295 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:44:29.297 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:44:29.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:29.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:44:29.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:44:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.514+0000 7f760b59e700 1 Processor -- start 2023-10-24T00:44:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.514+0000 7f760b59e700 1 -- start start 2023-10-24T00:44:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 0x7f760c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f760c0c0f20 0x7f760c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c06a860 con 0x7f760c154e70 2023-10-24T00:44:29.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0c9d90 con 0x7f760c0c0f20 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0c9180 con 0x7f760c154a90 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f760c0c0f20 0x7f760c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f760c0c0f20 0x7f760c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40670/0 (socket says 172.21.15.148:40670) 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 -- 172.21.15.148:0/2970696029 learned_addr learned my addr 172.21.15.148:0/2970696029 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760a59c700 1 --2- 172.21.15.148:0/2970696029 >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 0x7f760c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 -- 172.21.15.148:0/2970696029 >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 msgr2=0x7f760c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 --2- 172.21.15.148:0/2970696029 >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 0x7f760c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 -- 172.21.15.148:0/2970696029 >> v1:172.21.15.150:6789/0 conn(0x7f760c154e70 legacy=0x7f760c0c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 -- 172.21.15.148:0/2970696029 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0c9460 con 0x7f760c0c0f20 2023-10-24T00:44:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760a59c700 1 --2- 172.21.15.148:0/2970696029 >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 0x7f760c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.515+0000 7f760ad9d700 1 --2- 172.21.15.148:0/2970696029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c0c0f20 0x7f760c1552f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f75fc006fd0 tx=0x7f75fc0090f0).ready entity=mon.0 client_cookie=13ba51dd0bc016c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760959a700 1 -- 172.21.15.148:0/2970696029 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00b580 con 0x7f760c0c0f20 2023-10-24T00:44:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760959a700 1 -- 172.21.15.148:0/2970696029 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00b6e0 con 0x7f760c0c0f20 2023-10-24T00:44:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760959a700 1 -- 172.21.15.148:0/2970696029 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00ba60 con 0x7f760c0c0f20 2023-10-24T00:44:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 -- 172.21.15.148:0/2970696029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c0c0f20 msgr2=0x7f760c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 --2- 172.21.15.148:0/2970696029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c0c0f20 0x7f760c1552f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f75fc006fd0 tx=0x7f75fc0090f0).stop 2023-10-24T00:44:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 -- 172.21.15.148:0/2970696029 shutdown_connections 2023-10-24T00:44:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 --2- 172.21.15.148:0/2970696029 >> v2:172.21.15.150:3300/0 conn(0x7f760c154a90 0x7f760c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 --2- 172.21.15.148:0/2970696029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c0c0f20 0x7f760c1552f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 -- 172.21.15.148:0/2970696029 >> 172.21.15.148:0/2970696029 conn(0x7f760c084c20 msgr2=0x7f760c094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 -- 172.21.15.148:0/2970696029 shutdown_connections 2023-10-24T00:44:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.516+0000 7f760b59e700 1 -- 172.21.15.148:0/2970696029 wait complete. 2023-10-24T00:44:29.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.517+0000 7f760b59e700 1 Processor -- start 2023-10-24T00:44:29.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.517+0000 7f760b59e700 1 -- start start 2023-10-24T00:44:29.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f760c0c0f20 0x7f760c164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 0x7f760c0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b0ed0 con 0x7f760c154a90 2023-10-24T00:44:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0aef50 con 0x7f760c0c0f20 2023-10-24T00:44:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c1649d0 con 0x7f760c154e70 2023-10-24T00:44:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40686/0 (socket says 172.21.15.148:40686) 2023-10-24T00:44:29.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 -- 172.21.15.148:0/3393018914 learned_addr learned my addr 172.21.15.148:0/3393018914 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760a59c700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f760c0c0f20 0x7f760c164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760ad9d700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 0x7f760c0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 -- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 msgr2=0x7f760c0c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 0x7f760c0c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 -- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f760c0c0f20 msgr2=0x7f760c164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f760c0c0f20 0x7f760c164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f7609d9b700 1 -- 172.21.15.148:0/3393018914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009370 con 0x7f760c154a90 2023-10-24T00:44:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.518+0000 7f760ad9d700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 0x7f760c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f7609d9b700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f760000b7e0 tx=0x7f7600009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000d5a0 con 0x7f760c154a90 2023-10-24T00:44:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000d740 con 0x7f760c154a90 2023-10-24T00:44:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c164cb0 con 0x7f760c154a90 2023-10-24T00:44:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000db00 con 0x7f760c154a90 2023-10-24T00:44:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.519+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c165270 con 0x7f760c154a90 2023-10-24T00:44:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.520+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0af0c0 con 0x7f760c154a90 2023-10-24T00:44:29.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.520+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7600019460 con 0x7f760c154a90 2023-10-24T00:44:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.520+0000 7f75fa7fc700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 0x7f75ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.520+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f760007a320 con 0x7f760c154a90 2023-10-24T00:44:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.521+0000 7f760a59c700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 0x7f75ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.521+0000 7f760a59c700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 0x7f75ec061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f760c0c3600 tx=0x7f7604008040).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.524+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f760004b410 con 0x7f760c154a90 2023-10-24T00:44:29.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.715+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f760c0c0220 con 0x7f75ec05f270 2023-10-24T00:44:29.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.717+0000 7f75fa7fc700 1 -- 172.21.15.148:0/3393018914 <== mgr.5372 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f760c0c0220 con 0x7f75ec05f270 2023-10-24T00:44:29.719 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:44:29.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:29.719 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:44:29.719 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:29.719 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:44:29.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 msgr2=0x7f75ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 0x7f75ec061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f760c0c3600 tx=0x7f7604008040).stop 2023-10-24T00:44:29.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 msgr2=0x7f760c0b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f760000b7e0 tx=0x7f7600009310).stop 2023-10-24T00:44:29.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 shutdown_connections 2023-10-24T00:44:29.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f760c154e70 0x7f760c0c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f760c0c0f20 0x7f760c164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75ec05f270 0x7f75ec061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 --2- 172.21.15.148:0/3393018914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f760c154a90 0x7f760c0b09e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 >> 172.21.15.148:0/3393018914 conn(0x7f760c084c20 msgr2=0x7f760c0ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:29.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 shutdown_connections 2023-10-24T00:44:29.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.719+0000 7f760b59e700 1 -- 172.21.15.148:0/3393018914 wait complete. 2023-10-24T00:44:29.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:44:29.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.847+0000 7fd53a411700 1 Processor -- start 2023-10-24T00:44:29.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.847+0000 7fd53a411700 1 -- start start 2023-10-24T00:44:29.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53a411700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd534157780 0x7fd5340c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53a411700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 0x7fd5340a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53a411700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340c6770 con 0x7fd5340a8120 2023-10-24T00:44:29.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53a411700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340c1120 con 0x7fd534157780 2023-10-24T00:44:29.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53a411700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c1400 con 0x7fd5340c0960 2023-10-24T00:44:29.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53940f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd534157780 0x7fd5340c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53940f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd534157780 0x7fd5340c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40694/0 (socket says 172.21.15.148:40694) 2023-10-24T00:44:29.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd53940f700 1 -- 172.21.15.148:0/1272455611 learned_addr learned my addr 172.21.15.148:0/1272455611 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:29.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.848+0000 7fd538c0e700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 0x7fd5340a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53940f700 1 -- 172.21.15.148:0/1272455611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 msgr2=0x7fd5340a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:29.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53940f700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 0x7fd5340a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53940f700 1 -- 172.21.15.148:0/1272455611 >> v1:172.21.15.150:6789/0 conn(0x7fd5340a8120 legacy=0x7fd5340a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53940f700 1 -- 172.21.15.148:0/1272455611 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340c6120 con 0x7fd534157780 2023-10-24T00:44:29.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd538c0e700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 0x7fd5340a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:29.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53940f700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd534157780 0x7fd5340c8530 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fd524009f70 tx=0x7fd524009840).ready entity=mon.0 client_cookie=831d2cc25458881c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd533fff700 1 -- 172.21.15.148:0/1272455611 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400e070 con 0x7fd534157780 2023-10-24T00:44:29.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd533fff700 1 -- 172.21.15.148:0/1272455611 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400bad0 con 0x7fd534157780 2023-10-24T00:44:29.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd533fff700 1 -- 172.21.15.148:0/1272455611 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400be50 con 0x7fd534157780 2023-10-24T00:44:29.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 -- 172.21.15.148:0/1272455611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd534157780 msgr2=0x7fd5340c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd534157780 0x7fd5340c8530 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fd524009f70 tx=0x7fd524009840).stop 2023-10-24T00:44:29.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 -- 172.21.15.148:0/1272455611 shutdown_connections 2023-10-24T00:44:29.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd534157780 0x7fd5340c8530 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 --2- 172.21.15.148:0/1272455611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5340c0960 0x7fd5340a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 -- 172.21.15.148:0/1272455611 >> 172.21.15.148:0/1272455611 conn(0x7fd534094570 msgr2=0x7fd53406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:29.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 -- 172.21.15.148:0/1272455611 shutdown_connections 2023-10-24T00:44:29.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.849+0000 7fd53a411700 1 -- 172.21.15.148:0/1272455611 wait complete. 2023-10-24T00:44:29.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.850+0000 7fd53a411700 1 Processor -- start 2023-10-24T00:44:29.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 -- start start 2023-10-24T00:44:29.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5340a8120 0x7fd5340aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd534157780 0x7fd5341427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c1f90 con 0x7fd5340c0960 2023-10-24T00:44:29.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c2830 con 0x7fd5340a8120 2023-10-24T00:44:29.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd53a411700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340af770 con 0x7fd534157780 2023-10-24T00:44:29.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.851+0000 7fd538c0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40698/0 (socket says 172.21.15.148:40698) 2023-10-24T00:44:29.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 -- 172.21.15.148:0/2470693371 learned_addr learned my addr 172.21.15.148:0/2470693371 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:29.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd53940f700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5340a8120 0x7fd5340aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd539c10700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd534157780 0x7fd5341427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 -- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd534157780 msgr2=0x7fd5341427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd534157780 0x7fd5341427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 -- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5340a8120 msgr2=0x7fd5340aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:29.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5340a8120 0x7fd5340aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:29.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 -- 172.21.15.148:0/2470693371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524009ae0 con 0x7fd5340c0960 2023-10-24T00:44:29.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd538c0e700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fd52800d890 tx=0x7fd528008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011590 con 0x7fd5340c0960 2023-10-24T00:44:29.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5280116f0 con 0x7fd5340c0960 2023-10-24T00:44:29.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011a70 con 0x7fd5340c0960 2023-10-24T00:44:29.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340c21e0 con 0x7fd5340c0960 2023-10-24T00:44:29.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340adfe0 con 0x7fd5340c0960 2023-10-24T00:44:29.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.853+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340c29e0 con 0x7fd5340c0960 2023-10-24T00:44:29.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.854+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd52801c460 con 0x7fd5340c0960 2023-10-24T00:44:29.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.854+0000 7fd5317fa700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 0x7fd520061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:29.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.854+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd52807a140 con 0x7fd5340c0960 2023-10-24T00:44:29.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.854+0000 7fd53940f700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 0x7fd520061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:29.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.855+0000 7fd53940f700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 0x7fd520061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd524009930 tx=0x7fd524009840).ready entity=mgr.5372 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:29.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:29.858+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5340c29e0 con 0x7fd5340c0960 2023-10-24T00:44:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.066+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd5340c29e0 con 0x7fd5340c0960 2023-10-24T00:44:30.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.848+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd528077d90 con 0x7fd5340c0960 2023-10-24T00:44:30.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.850+0000 7fd5317fa700 1 -- 172.21.15.148:0/2470693371 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd5280724f0 con 0x7fd5340c0960 2023-10-24T00:44:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 msgr2=0x7fd520061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 0x7fd520061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd524009930 tx=0x7fd524009840).stop 2023-10-24T00:44:30.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 msgr2=0x7fd5340c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:30.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fd52800d890 tx=0x7fd528008040).stop 2023-10-24T00:44:30.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 shutdown_connections 2023-10-24T00:44:30.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd534157780 0x7fd5341427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5340a8120 0x7fd5340aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd52005f270 0x7fd520061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 --2- 172.21.15.148:0/2470693371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5340c0960 0x7fd5340c4570 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 >> 172.21.15.148:0/2470693371 conn(0x7fd534094570 msgr2=0x7fd5340c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 shutdown_connections 2023-10-24T00:44:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.852+0000 7fd53a411700 1 -- 172.21.15.148:0/2470693371 wait complete. 2023-10-24T00:44:30.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:44:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.988+0000 7eff36015700 1 Processor -- start 2023-10-24T00:44:30.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.988+0000 7eff36015700 1 -- start start 2023-10-24T00:44:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff36015700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff30150f50 0x7eff30069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff36015700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30069720 0x7eff300c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff36015700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff30069bb0 con 0x7eff30150b70 2023-10-24T00:44:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff36015700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff30155940 con 0x7eff30069720 2023-10-24T00:44:30.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff36015700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff30064150 con 0x7eff30150f50 2023-10-24T00:44:30.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30069720 0x7eff300c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:30.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30069720 0x7eff300c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40730/0 (socket says 172.21.15.148:40730) 2023-10-24T00:44:30.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 -- 172.21.15.148:0/4117528641 learned_addr learned my addr 172.21.15.148:0/4117528641 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:30.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff34812700 1 --2- 172.21.15.148:0/4117528641 >> v2:172.21.15.150:3300/0 conn(0x7eff30150f50 0x7eff30069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:30.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 -- 172.21.15.148:0/4117528641 >> v2:172.21.15.150:3300/0 conn(0x7eff30150f50 msgr2=0x7eff30069230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:30.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 --2- 172.21.15.148:0/4117528641 >> v2:172.21.15.150:3300/0 conn(0x7eff30150f50 0x7eff30069230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 -- 172.21.15.148:0/4117528641 >> v1:172.21.15.150:6789/0 conn(0x7eff30150b70 legacy=0x7eff30063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 -- 172.21.15.148:0/4117528641 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30154b80 con 0x7eff30069720 2023-10-24T00:44:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.989+0000 7eff35814700 1 --2- 172.21.15.148:0/4117528641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30069720 0x7eff300c1960 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7eff28009f20 tx=0x7eff28009840).ready entity=mon.0 client_cookie=e30fe149c2e376ca server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff27fff700 1 -- 172.21.15.148:0/4117528641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800e070 con 0x7eff30069720 2023-10-24T00:44:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff27fff700 1 -- 172.21.15.148:0/4117528641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800b990 con 0x7eff30069720 2023-10-24T00:44:30.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff27fff700 1 -- 172.21.15.148:0/4117528641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800bd10 con 0x7eff30069720 2023-10-24T00:44:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 -- 172.21.15.148:0/4117528641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30069720 msgr2=0x7eff300c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 --2- 172.21.15.148:0/4117528641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30069720 0x7eff300c1960 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7eff28009f20 tx=0x7eff28009840).stop 2023-10-24T00:44:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 -- 172.21.15.148:0/4117528641 shutdown_connections 2023-10-24T00:44:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 --2- 172.21.15.148:0/4117528641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30069720 0x7eff300c1960 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 --2- 172.21.15.148:0/4117528641 >> v2:172.21.15.150:3300/0 conn(0x7eff30150f50 0x7eff30069230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:30.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 -- 172.21.15.148:0/4117528641 >> 172.21.15.148:0/4117528641 conn(0x7eff300c48a0 msgr2=0x7eff30068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:30.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 -- 172.21.15.148:0/4117528641 shutdown_connections 2023-10-24T00:44:30.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.990+0000 7eff36015700 1 -- 172.21.15.148:0/4117528641 wait complete. 2023-10-24T00:44:30.997 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:30.991+0000 7f3db15cc680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:30.999 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:30.992+0000 7ffbd1de5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:31.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.991+0000 7eff36015700 1 Processor -- start 2023-10-24T00:44:31.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.991+0000 7eff36015700 1 -- start start 2023-10-24T00:44:31.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30069720 0x7eff30165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff30150b70 0x7eff30164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff30165e10 con 0x7eff30150f50 2023-10-24T00:44:31.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3014f890 con 0x7eff30069720 2023-10-24T00:44:31.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.992+0000 7eff36015700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff30161dc0 con 0x7eff30150b70 2023-10-24T00:44:31.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40740/0 (socket says 172.21.15.148:40740) 2023-10-24T00:44:31.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 -- 172.21.15.148:0/2353647379 learned_addr learned my addr 172.21.15.148:0/2353647379 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:31.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff34812700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff30150b70 0x7eff30164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35013700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30069720 0x7eff30165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 -- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff30150b70 msgr2=0x7eff30164790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff30150b70 0x7eff30164790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 -- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30069720 msgr2=0x7eff30165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30069720 0x7eff30165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 -- 172.21.15.148:0/2353647379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009ae0 con 0x7eff30150f50 2023-10-24T00:44:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff35814700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7eff2800b610 tx=0x7eff28009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280092e0 con 0x7eff30150f50 2023-10-24T00:44:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2801e470 con 0x7eff30150f50 2023-10-24T00:44:31.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff301620a0 con 0x7eff30150f50 2023-10-24T00:44:31.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2801e810 con 0x7eff30150f50 2023-10-24T00:44:31.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.993+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff30162660 con 0x7eff30150f50 2023-10-24T00:44:31.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.994+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff30047480 con 0x7eff30150f50 2023-10-24T00:44:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.994+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7eff28003040 con 0x7eff30150f50 2023-10-24T00:44:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.995+0000 7eff257fa700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 0x7eff14061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.995+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff2807b790 con 0x7eff30150f50 2023-10-24T00:44:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.995+0000 7eff35013700 1 -- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 msgr2=0x7eff14061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.995+0000 7eff35013700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 0x7eff14061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:31.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:30.999+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff2804c990 con 0x7eff30150f50 2023-10-24T00:44:31.058 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:31.055+0000 7ffbd1de5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:31.058 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:31.056+0000 7f3db15cc680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:31.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.172+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7eff30154e60 con 0x7eff30150f50 2023-10-24T00:44:31.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.175+0000 7eff257fa700 1 -- 172.21.15.148:0/2353647379 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff28023020 con 0x7eff30150f50 2023-10-24T00:44:31.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 msgr2=0x7eff14061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:31.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 0x7eff14061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:31.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 msgr2=0x7eff300bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7eff2800b610 tx=0x7eff28009840).stop 2023-10-24T00:44:31.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 shutdown_connections 2023-10-24T00:44:31.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff1405f2c0 0x7eff14061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:31.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30150f50 0x7eff300bc2c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30069720 0x7eff30165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.177+0000 7eff36015700 1 --2- 172.21.15.148:0/2353647379 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff30150b70 0x7eff30164790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.178+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 >> 172.21.15.148:0/2353647379 conn(0x7eff300c48a0 msgr2=0x7eff30063a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:31.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.178+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 shutdown_connections 2023-10-24T00:44:31.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.178+0000 7eff36015700 1 -- 172.21.15.148:0/2353647379 wait complete. 2023-10-24T00:44:31.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:31.192 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T00:44:31.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-24T00:44:31.333 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:31.331+0000 7ffbd1de5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:31.345 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:31.344+0000 7f3db15cc680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:31.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.371+0000 7fe0fdbe7700 1 Processor -- start 2023-10-24T00:44:31.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.371+0000 7fe0fdbe7700 1 -- start start 2023-10-24T00:44:31.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0fdbe7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f81543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0fdbe7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 0x7fe0f80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0fdbe7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f80c5050 con 0x7fe0f80659c0 2023-10-24T00:44:31.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0fdbe7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f8154980 con 0x7fe0f81508f0 2023-10-24T00:44:31.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0fdbe7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f8154c60 con 0x7fe0f8150510 2023-10-24T00:44:31.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe0f80659c0 0x7fe0f8063660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60952/0 (socket says 172.21.15.148:60952) 2023-10-24T00:44:31.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f7fff700 1 -- 172.21.15.148:0/1460006994 learned_addr learned my addr 172.21.15.148:0/1460006994 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:31.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1460006994 >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 0x7fe0f80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1460006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f81543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f6ffd700 1 -- 172.21.15.148:0/1460006994 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703969316 0 0) 0x7fe0f80c5050 con 0x7fe0f80659c0 2023-10-24T00:44:31.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f6ffd700 1 -- 172.21.15.148:0/1460006994 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e40033f0 con 0x7fe0f80659c0 2023-10-24T00:44:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1460006994 >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 msgr2=0x7fe0f80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1460006994 >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 0x7fe0f80c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1460006994 >> v1:172.21.15.148:6789/0 conn(0x7fe0f80659c0 legacy=0x7fe0f8063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1460006994 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f8154f40 con 0x7fe0f8150510 2023-10-24T00:44:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1460006994 >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 0x7fe0f80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.373+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1460006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f81543a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe0e8009760 tx=0x7fe0e8009060).ready entity=mon.2 client_cookie=ca4f909431fee6ca server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0f6ffd700 1 -- 172.21.15.148:0/1460006994 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8009120 con 0x7fe0f8150510 2023-10-24T00:44:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0f6ffd700 1 -- 172.21.15.148:0/1460006994 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e800d4a0 con 0x7fe0f8150510 2023-10-24T00:44:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0f6ffd700 1 -- 172.21.15.148:0/1460006994 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e800d820 con 0x7fe0f8150510 2023-10-24T00:44:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1460006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 msgr2=0x7fe0f81543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 --2- 172.21.15.148:0/1460006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f81543a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe0e8009760 tx=0x7fe0e8009060).stop 2023-10-24T00:44:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1460006994 shutdown_connections 2023-10-24T00:44:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 --2- 172.21.15.148:0/1460006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f81543a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 --2- 172.21.15.148:0/1460006994 >> v2:172.21.15.150:3300/0 conn(0x7fe0f81508f0 0x7fe0f80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.374+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1460006994 >> 172.21.15.148:0/1460006994 conn(0x7fe0f80c49d0 msgr2=0x7fe0f8068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.375+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1460006994 shutdown_connections 2023-10-24T00:44:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.375+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1460006994 wait complete. 2023-10-24T00:44:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.376+0000 7fe0fdbe7700 1 Processor -- start 2023-10-24T00:44:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.377+0000 7fe0fdbe7700 1 -- start start 2023-10-24T00:44:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f80659c0 0x7fe0f80a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f8141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f81508f0 0x7fe0f80ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80a7c80 con 0x7fe0f80659c0 2023-10-24T00:44:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f8151eb0 con 0x7fe0f81508f0 2023-10-24T00:44:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0fdbe7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80a8720 con 0x7fe0f8150510 2023-10-24T00:44:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f80659c0 0x7fe0f80a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f80659c0 0x7fe0f80a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40746/0 (socket says 172.21.15.148:40746) 2023-10-24T00:44:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1759078362 learned_addr learned my addr 172.21.15.148:0/1759078362 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f8141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f7fff700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f81508f0 0x7fe0f80ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:31.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 msgr2=0x7fe0f8141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f8150510 0x7fe0f8141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f81508f0 msgr2=0x7fe0f80ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:31.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f81508f0 0x7fe0f80ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00092a0 con 0x7fe0f80659c0 2023-10-24T00:44:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.378+0000 7fe0f77fe700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f80659c0 0x7fe0f80a7790 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fe0f8154da0 tx=0x7fe0e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.379+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8012870 con 0x7fe0f80659c0 2023-10-24T00:44:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.379+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80129d0 con 0x7fe0f80659c0 2023-10-24T00:44:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.379+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80092a0 con 0x7fe0f80659c0 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.379+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8012d50 con 0x7fe0f80659c0 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.379+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f80a8160 con 0x7fe0f80659c0 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.380+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f806c6b0 con 0x7fe0f80659c0 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.380+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fe0e801c630 con 0x7fe0f80659c0 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.380+0000 7fe0effff700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.381+0000 7fe0eeffd700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.381+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe0e807b760 con 0x7fe0f80659c0 2023-10-24T00:44:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.381+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.385+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0e804c8b0 con 0x7fe0f80659c0 2023-10-24T00:44:31.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.580+0000 7fe0fdbe7700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f8152460 con 0x7fe0d805f290 2023-10-24T00:44:31.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.582+0000 7fe0eeffd700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:31.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.582+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:31.947 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:31.945+0000 7ffbd1de5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:31.970 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:31.969+0000 7f3db15cc680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:31.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.983+0000 7fe0eeffd700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:31.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:31.983+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:44:32.020 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.017+0000 7ffbd1de5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:32.043 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.042+0000 7f3db15cc680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:32.206 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.204+0000 7ffbd1de5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:32.229 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.228+0000 7f3db15cc680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:32.233 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:44:32.235 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:44:32.631 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.628+0000 7ffbd1de5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:32.653 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.652+0000 7f3db15cc680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:32.734 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.732+0000 7ffbd1de5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:32.757 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.756+0000 7f3db15cc680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:32.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:32.784+0000 7fe0eeffd700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:32.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:32.784+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:44:32.889 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.887+0000 7ffbd1de5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:32.911 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.909+0000 7f3db15cc680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:32.963 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:32.961+0000 7ffbd1de5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:32.984 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:32.983+0000 7f3db15cc680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:33.030 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:33.027+0000 7ffbd1de5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:33.051 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:33.050+0000 7f3db15cc680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:33.286 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:33.283+0000 7ffbd1de5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:33.308 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:33.307+0000 7f3db15cc680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:33.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:33.471+0000 7ffbd1de5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:33.492 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:33.491+0000 7f3db15cc680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:34.120 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.118+0000 7ffbd1de5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:34.139 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.138+0000 7f3db15cc680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:34.189 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.186+0000 7ffbd1de5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:34.208 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.206+0000 7f3db15cc680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:34.263 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.261+0000 7ffbd1de5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:34.283 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.282+0000 7f3db15cc680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:34.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:34.385+0000 7fe0eeffd700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:34.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:34.385+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:44:34.410 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.407+0000 7ffbd1de5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:34.430 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.429+0000 7f3db15cc680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:34.480 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.478+0000 7ffbd1de5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:34.502 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.500+0000 7f3db15cc680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:34.594 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.592+0000 7ffbd1de5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:34.617 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.616+0000 7f3db15cc680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:34.702 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.700+0000 7ffbd1de5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:34.725 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:34.724+0000 7f3db15cc680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:34.993 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:34.991+0000 7ffbd1de5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:35.019 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:35.018+0000 7f3db15cc680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:35.068 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.066+0000 7ffbd1de5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:35.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:35.087+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 26) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fe0e80793b0 con 0x7fe0f80659c0 2023-10-24T00:44:35.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:35.087+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 msgr2=0x7fe0d8061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:35.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:35.087+0000 7fe0effff700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d8061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:35.092 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:35.091+0000 7f3db15cc680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:35.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb4656c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb4656c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb4656c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb4656c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb4656c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb49572700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.154 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb49572700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.155 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb49572700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.155 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb49572700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:35.155 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:35.150+0000 7ffb49572700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:36.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.091+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe0e8079730 con 0x7fe0f80659c0 2023-10-24T00:44:36.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.092+0000 7fe0effff700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d80616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.092+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0d8030b50 con 0x7fe0d805f290 2023-10-24T00:44:36.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.093+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d80616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.094+0000 7fe0eeffd700 1 --2- 172.21.15.148:0/1759078362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0d805f290 0x7fe0d80616d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fe0f81547d0 tx=0x7fe0e0009060).ready entity=mgr.5645 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:36.098 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:36.096+0000 7ffb50d81700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-24T00:44:36.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.106+0000 7fe0effff700 1 -- 172.21.15.148:0/1759078362 <== mgr.5645 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fe0e0009bc0 con 0x7fe0d805f290 2023-10-24T00:44:36.109 INFO:teuthology.orchestra.run.smithi148.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-24T00:44:36.112 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-24T00:44:36.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:36.113 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T00:44:36.131 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:44:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 Processor -- start 2023-10-24T00:44:36.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 -- start start 2023-10-24T00:44:36.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4840150f60 0x7f4840069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f48400c3590 0x7f48400bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4840069dc0 con 0x7f4840069910 2023-10-24T00:44:36.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400bcc80 con 0x7f4840150f60 2023-10-24T00:44:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.286+0000 7f4845e61700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484006a520 con 0x7f48400c3590 2023-10-24T00:44:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4840150f60 0x7f4840069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4840069910 0x7f48400c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56072/0 (socket says 172.21.15.148:56072) 2023-10-24T00:44:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483effd700 1 -- 172.21.15.148:0/441778065 learned_addr learned my addr 172.21.15.148:0/441778065 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483ffff700 1 --2- 172.21.15.148:0/441778065 >> v2:172.21.15.150:3300/0 conn(0x7f48400c3590 0x7f48400bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 -- 172.21.15.148:0/441778065 >> v2:172.21.15.150:3300/0 conn(0x7f48400c3590 msgr2=0x7f48400bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 --2- 172.21.15.148:0/441778065 >> v2:172.21.15.150:3300/0 conn(0x7f48400c3590 0x7f48400bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 -- 172.21.15.148:0/441778065 >> v1:172.21.15.148:6789/0 conn(0x7f4840069910 legacy=0x7f48400c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 -- 172.21.15.148:0/441778065 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400c3af0 con 0x7f4840150f60 2023-10-24T00:44:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483e7fc700 1 -- 172.21.15.148:0/441778065 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382916264 0 0) 0x7f4828001110 con 0x7f4840069910 2023-10-24T00:44:36.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483f7fe700 1 --2- 172.21.15.148:0/441778065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f4840069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f484006ac20 tx=0x7f483800b990).ready entity=mon.0 client_cookie=b155ef23bc394f80 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:36.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483e7fc700 1 -- 172.21.15.148:0/441778065 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838010070 con 0x7f4840150f60 2023-10-24T00:44:36.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483e7fc700 1 -- 172.21.15.148:0/441778065 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800b2e0 con 0x7f4840150f60 2023-10-24T00:44:36.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.287+0000 7f483e7fc700 1 -- 172.21.15.148:0/441778065 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800dd10 con 0x7f4840150f60 2023-10-24T00:44:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 -- 172.21.15.148:0/441778065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 msgr2=0x7f4840069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 --2- 172.21.15.148:0/441778065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f4840069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f484006ac20 tx=0x7f483800b990).stop 2023-10-24T00:44:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 -- 172.21.15.148:0/441778065 shutdown_connections 2023-10-24T00:44:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 --2- 172.21.15.148:0/441778065 >> v2:172.21.15.150:3300/0 conn(0x7f48400c3590 0x7f48400bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 --2- 172.21.15.148:0/441778065 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f4840069420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 -- 172.21.15.148:0/441778065 >> 172.21.15.148:0/441778065 conn(0x7f48400c7d20 msgr2=0x7f48400c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 -- 172.21.15.148:0/441778065 shutdown_connections 2023-10-24T00:44:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.288+0000 7f4845e61700 1 -- 172.21.15.148:0/441778065 wait complete. 2023-10-24T00:44:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.289+0000 7f4845e61700 1 Processor -- start 2023-10-24T00:44:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.289+0000 7f4845e61700 1 -- start start 2023-10-24T00:44:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4840069910 0x7f4840150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 0x7f48400a7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400ac740 con 0x7f4840150f60 2023-10-24T00:44:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401606c0 con 0x7f48400c3590 2023-10-24T00:44:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f4845e61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400abe10 con 0x7f4840069910 2023-10-24T00:44:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57354/0 (socket says 172.21.15.148:57354) 2023-10-24T00:44:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 -- 172.21.15.148:0/2931308147 learned_addr learned my addr 172.21.15.148:0/2931308147 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483effd700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 0x7f48400a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 -- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4840069910 msgr2=0x7f4840150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4840069910 0x7f4840150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 -- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 msgr2=0x7f48400a7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 0x7f48400a7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 -- 172.21.15.148:0/2931308147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483800bc30 con 0x7f4840150f60 2023-10-24T00:44:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483effd700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 0x7f48400a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.290+0000 7f483ffff700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f483000e900 tx=0x7f4830009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.291+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830009530 con 0x7f4840150f60 2023-10-24T00:44:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.291+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483000eea0 con 0x7f4840150f60 2023-10-24T00:44:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.291+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48400ac0f0 con 0x7f4840150f60 2023-10-24T00:44:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.291+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483000ca60 con 0x7f4840150f60 2023-10-24T00:44:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.291+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48400a7da0 con 0x7f4840150f60 2023-10-24T00:44:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.292+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484006c6b0 con 0x7f4840150f60 2023-10-24T00:44:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.292+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f483001b400 con 0x7f4840150f60 2023-10-24T00:44:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.292+0000 7f48377fe700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 0x7f4820061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.292+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f483007a660 con 0x7f4840150f60 2023-10-24T00:44:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.292+0000 7f483f7fe700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 0x7f4820061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.293+0000 7f483f7fe700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 0x7f4820061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f483800ba80 tx=0x7f483800b990).ready entity=mgr.5645 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.296+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f483004b9a0 con 0x7f4840150f60 2023-10-24T00:44:36.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:36.503+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f48400ac880 con 0x7f4840150f60 2023-10-24T00:44:37.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.145+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4830078500 con 0x7f4840150f60 2023-10-24T00:44:37.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.147+0000 7f48377fe700 1 -- 172.21.15.148:0/2931308147 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4830071f90 con 0x7f4840150f60 2023-10-24T00:44:37.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 msgr2=0x7f4820061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 0x7f4820061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f483800ba80 tx=0x7f483800b990).stop 2023-10-24T00:44:37.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 msgr2=0x7f48400a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f483000e900 tx=0x7f4830009060).stop 2023-10-24T00:44:37.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 shutdown_connections 2023-10-24T00:44:37.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f482005f080 0x7f4820061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4840150f60 0x7f48400a9270 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4840069910 0x7f4840150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:37.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 --2- 172.21.15.148:0/2931308147 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48400c3590 0x7f48400a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 >> 172.21.15.148:0/2931308147 conn(0x7f48400c7d20 msgr2=0x7f48400c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:37.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 shutdown_connections 2023-10-24T00:44:37.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.149+0000 7f4845e61700 1 -- 172.21.15.148:0/2931308147 wait complete. 2023-10-24T00:44:37.164 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:44:37.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:37.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:37.267 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:44:37.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:44:37.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:44:37.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:44:37.291 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:37.288+0000 7f2d20bba680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:37.297 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:37.295+0000 7f60848d5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:44:37.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:44:37.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:44:37.311 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:44:37.358 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:37.356+0000 7f2d20bba680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:37.361 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:37.359+0000 7f60848d5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:44:37.366 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:37.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.521+0000 7fe439e4b700 1 Processor -- start 2023-10-24T00:44:37.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.521+0000 7fe439e4b700 1 -- start start 2023-10-24T00:44:37.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe439e4b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4340695f0 0x7fe4340699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe439e4b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe43413aa00 0x7fe434065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe439e4b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340c57b0 con 0x7fe4340aacd0 2023-10-24T00:44:37.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe4337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4340695f0 0x7fe4340699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe439e4b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4340c5a90 con 0x7fe4340695f0 2023-10-24T00:44:37.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe439e4b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340c5d70 con 0x7fe43413aa00 2023-10-24T00:44:37.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe4337fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4340695f0 0x7fe4340699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57384/0 (socket says 172.21.15.148:57384) 2023-10-24T00:44:37.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.522+0000 7fe4337fe700 1 -- 172.21.15.148:0/1211863263 learned_addr learned my addr 172.21.15.148:0/1211863263 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:37.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe433fff700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe43413aa00 0x7fe434065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4337fe700 1 -- 172.21.15.148:0/1211863263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe43413aa00 msgr2=0x7fe434065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:37.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4337fe700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe43413aa00 0x7fe434065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4327fc700 1 -- 172.21.15.148:0/1211863263 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722024354 0 0) 0x7fe4340c57b0 con 0x7fe4340aacd0 2023-10-24T00:44:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4337fe700 1 -- 172.21.15.148:0/1211863263 >> v1:172.21.15.150:6789/0 conn(0x7fe4340aacd0 legacy=0x7fe43413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4337fe700 1 -- 172.21.15.148:0/1211863263 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340c6050 con 0x7fe4340695f0 2023-10-24T00:44:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4337fe700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340695f0 0x7fe4340699d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fe428006fd0 tx=0x7fe4280090f0).ready entity=mon.0 client_cookie=f76b7049ff882351 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4327fc700 1 -- 172.21.15.148:0/1211863263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800b600 con 0x7fe4340695f0 2023-10-24T00:44:37.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4327fc700 1 -- 172.21.15.148:0/1211863263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800b760 con 0x7fe4340695f0 2023-10-24T00:44:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.523+0000 7fe4327fc700 1 -- 172.21.15.148:0/1211863263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800bae0 con 0x7fe4340695f0 2023-10-24T00:44:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 -- 172.21.15.148:0/1211863263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340695f0 msgr2=0x7fe4340699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340695f0 0x7fe4340699d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fe428006fd0 tx=0x7fe4280090f0).stop 2023-10-24T00:44:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 -- 172.21.15.148:0/1211863263 shutdown_connections 2023-10-24T00:44:37.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe43413aa00 0x7fe434065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1211863263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340695f0 0x7fe4340699d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 -- 172.21.15.148:0/1211863263 >> 172.21.15.148:0/1211863263 conn(0x7fe4340641f0 msgr2=0x7fe4340c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 -- 172.21.15.148:0/1211863263 shutdown_connections 2023-10-24T00:44:37.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.524+0000 7fe439e4b700 1 -- 172.21.15.148:0/1211863263 wait complete. 2023-10-24T00:44:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.525+0000 7fe439e4b700 1 Processor -- start 2023-10-24T00:44:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.525+0000 7fe439e4b700 1 -- start start 2023-10-24T00:44:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4340695f0 0x7fe4341520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe43413aa00 0x7fe4340c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4341525e0 con 0x7fe4340aacd0 2023-10-24T00:44:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340bfd60 con 0x7fe43413aa00 2023-10-24T00:44:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe439e4b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe434132d80 con 0x7fe4340695f0 2023-10-24T00:44:37.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57390/0 (socket says 172.21.15.148:57390) 2023-10-24T00:44:37.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 -- 172.21.15.148:0/1635968846 learned_addr learned my addr 172.21.15.148:0/1635968846 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:37.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe4337fe700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4340695f0 0x7fe4341520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe433fff700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe43413aa00 0x7fe4340c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4340695f0 msgr2=0x7fe4341520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4340695f0 0x7fe4341520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe43413aa00 msgr2=0x7fe4340c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe43413aa00 0x7fe4340c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 -- 172.21.15.148:0/1635968846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428009370 con 0x7fe4340aacd0 2023-10-24T00:44:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.526+0000 7fe432ffd700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fe424001eb0 tx=0x7fe424007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.527+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ce60 con 0x7fe4340aacd0 2023-10-24T00:44:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.527+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42400f470 con 0x7fe4340aacd0 2023-10-24T00:44:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.527+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe434152860 con 0x7fe4340aacd0 2023-10-24T00:44:37.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.527+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400f810 con 0x7fe4340aacd0 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.527+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4340c02e0 con 0x7fe4340aacd0 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43406c6b0 con 0x7fe4340aacd0 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe42400fb80 con 0x7fe4340aacd0 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe41b7fe700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 0x7fe4200617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fe424079a00 con 0x7fe4340aacd0 2023-10-24T00:44:37.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe4337fe700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 msgr2=0x7fe4200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:37.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.528+0000 7fe4337fe700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 0x7fe4200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:37.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.532+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe42404a9d0 con 0x7fe4340aacd0 2023-10-24T00:44:37.635 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:37.633+0000 7f60848d5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:37.649 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:37.645+0000 7f2d20bba680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:44:37.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.729+0000 7fe4337fe700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 msgr2=0x7fe4200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:37.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.729+0000 7fe4337fe700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 0x7fe4200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:37.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.746+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4340c6330 con 0x7fe4340aacd0 2023-10-24T00:44:37.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.747+0000 7fe41b7fe700 1 -- 172.21.15.148:0/1635968846 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fe42404dff0 con 0x7fe4340aacd0 2023-10-24T00:44:37.749 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:37.750 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:37.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 msgr2=0x7fe4200617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:37.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 0x7fe4200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:37.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 msgr2=0x7fe434132890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fe424001eb0 tx=0x7fe424007c70).stop 2023-10-24T00:44:37.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 shutdown_connections 2023-10-24T00:44:37.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe43413aa00 0x7fe4340c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4340695f0 0x7fe4341520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42005f300 0x7fe4200617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:37.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.748+0000 7fe439e4b700 1 --2- 172.21.15.148:0/1635968846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4340aacd0 0x7fe434132890 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.749+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 >> 172.21.15.148:0/1635968846 conn(0x7fe4340641f0 msgr2=0x7fe4340ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:37.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.749+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 shutdown_connections 2023-10-24T00:44:37.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.749+0000 7fe439e4b700 1 -- 172.21.15.148:0/1635968846 wait complete. 2023-10-24T00:44:37.754 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:37.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:37.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.877+0000 7fc5483ac700 1 Processor -- start 2023-10-24T00:44:37.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.878+0000 7fc5483ac700 1 -- start start 2023-10-24T00:44:37.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.878+0000 7fc5483ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc5401481a0 0x7fc540063760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.878+0000 7fc5483ac700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400c2d70 con 0x7fc540063c50 2023-10-24T00:44:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.878+0000 7fc5483ac700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400c2780 con 0x7fc540147dc0 2023-10-24T00:44:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.878+0000 7fc5483ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54006b780 con 0x7fc5401481a0 2023-10-24T00:44:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc546949700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc540063c50 0x7fc5400bcbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56078/0 (socket says 172.21.15.148:56078) 2023-10-24T00:44:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc546949700 1 -- 172.21.15.148:0/272828689 learned_addr learned my addr 172.21.15.148:0/272828689 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:37.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545947700 1 --2- 172.21.15.148:0/272828689 >> v2:172.21.15.150:3300/0 conn(0x7fc5401481a0 0x7fc540063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495001628 0 0) 0x7fc5400c2d70 con 0x7fc540063c50 2023-10-24T00:44:37.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc52c0033f0 con 0x7fc540063c50 2023-10-24T00:44:37.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351108672 0 0) 0x7fc52c0033f0 con 0x7fc540063c50 2023-10-24T00:44:37.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 >> v2:172.21.15.150:3300/0 conn(0x7fc5401481a0 msgr2=0x7fc540063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:37.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 --2- 172.21.15.148:0/272828689 >> v2:172.21.15.150:3300/0 conn(0x7fc5401481a0 0x7fc540063760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 >> v1:172.21.15.150:6789/0 conn(0x7fc540147dc0 legacy=0x7fc5400c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400640c0 con 0x7fc540063c50 2023-10-24T00:44:37.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fc5380017f0 con 0x7fc540063c50 2023-10-24T00:44:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 >> v1:172.21.15.148:6789/0 conn(0x7fc540063c50 legacy=0x7fc5400bcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc52c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc52c004690 0x7fc52c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc52c005000 0x7fc52c00daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54006b780 con 0x7fc52c0038e0 2023-10-24T00:44:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c00e0c0 con 0x7fc52c005000 2023-10-24T00:44:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c00e280 con 0x7fc52c004690 2023-10-24T00:44:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc546148700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc52c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc545947700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc52c004690 0x7fc52c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.879+0000 7fc546949700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc52c005000 0x7fc52c00daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 -- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc52c004690 msgr2=0x7fc52c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc52c004690 0x7fc52c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 -- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc52c005000 msgr2=0x7fc52c00daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc52c005000 0x7fc52c00daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546949700 1 -- 172.21.15.148:0/272828689 reap_dead start 2023-10-24T00:44:37.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 -- 172.21.15.148:0/272828689 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0033f0 con 0x7fc52c0038e0 2023-10-24T00:44:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc546148700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc52c003d00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc530001730 tx=0x7fc530007bb0).ready entity=mon.0 client_cookie=6039d291e778fd81 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530007020 con 0x7fc52c0038e0 2023-10-24T00:44:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530007180 con 0x7fc52c0038e0 2023-10-24T00:44:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc545146700 1 -- 172.21.15.148:0/272828689 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530007520 con 0x7fc52c0038e0 2023-10-24T00:44:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc5483ac700 1 -- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 msgr2=0x7fc52c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.880+0000 7fc5483ac700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc52c003d00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fc530001730 tx=0x7fc530007bb0).stop 2023-10-24T00:44:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.881+0000 7fc5483ac700 1 -- 172.21.15.148:0/272828689 shutdown_connections 2023-10-24T00:44:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.881+0000 7fc5483ac700 1 --2- 172.21.15.148:0/272828689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc52c003d00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.881+0000 7fc5483ac700 1 -- 172.21.15.148:0/272828689 >> 172.21.15.148:0/272828689 conn(0x7fc5400c7eb0 msgr2=0x7fc5400c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.881+0000 7fc5483ac700 1 -- 172.21.15.148:0/272828689 shutdown_connections 2023-10-24T00:44:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.881+0000 7fc5483ac700 1 -- 172.21.15.148:0/272828689 wait complete. 2023-10-24T00:44:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 Processor -- start 2023-10-24T00:44:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 -- start start 2023-10-24T00:44:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5400acae0 0x7fc540165b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 0x7fc5400ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400aa470 con 0x7fc52c0038e0 2023-10-24T00:44:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540164dd0 con 0x7fc5400acae0 2023-10-24T00:44:37.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.882+0000 7fc5483ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401650b0 con 0x7fc5400aac30 2023-10-24T00:44:37.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57418/0 (socket says 172.21.15.148:57418) 2023-10-24T00:44:37.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 -- 172.21.15.148:0/2427534295 learned_addr learned my addr 172.21.15.148:0/2427534295 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:37.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546949700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 0x7fc5400ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc545947700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5400acae0 0x7fc540165b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 -- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 msgr2=0x7fc5400ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 0x7fc5400ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 -- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5400acae0 msgr2=0x7fc540165b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5400acae0 0x7fc540165b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:37.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 -- 172.21.15.148:0/2427534295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400aa710 con 0x7fc52c0038e0 2023-10-24T00:44:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546949700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 0x7fc5400ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc546148700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc52c00e090 tx=0x7fc530015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530006f80 con 0x7fc52c0038e0 2023-10-24T00:44:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530013670 con 0x7fc52c0038e0 2023-10-24T00:44:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530013a30 con 0x7fc52c0038e0 2023-10-24T00:44:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc540165390 con 0x7fc52c0038e0 2023-10-24T00:44:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.883+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5400c5840 con 0x7fc52c0038e0 2023-10-24T00:44:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.884+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5400aaa80 con 0x7fc52c0038e0 2023-10-24T00:44:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.885+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc53001f430 con 0x7fc52c0038e0 2023-10-24T00:44:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.885+0000 7fc5367fc700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 0x7fc5240617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.885+0000 7fc545947700 1 -- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 msgr2=0x7fc5240617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.885+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fc53007af80 con 0x7fc52c0038e0 2023-10-24T00:44:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.885+0000 7fc545947700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 0x7fc5240617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:37.889+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc53004bef0 con 0x7fc52c0038e0 2023-10-24T00:44:38.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.059+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54006c6b0 con 0x7fc52c0038e0 2023-10-24T00:44:38.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.060+0000 7fc5367fc700 1 -- 172.21.15.148:0/2427534295 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17350 (secure 0 0 0) 0x7fc53004f510 con 0x7fc52c0038e0 2023-10-24T00:44:38.063 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:38.063 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":82,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:35.081010+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/4011676657":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6833/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6832/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2148779355":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/242651982":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2555703333":"2023-10-25T00:44:35.080967+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 msgr2=0x7fc5240617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 0x7fc5240617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 msgr2=0x7fc540165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fc52c00e090 tx=0x7fc530015000).stop 2023-10-24T00:44:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 shutdown_connections 2023-10-24T00:44:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5400aac30 0x7fc5400ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc52405f300 0x7fc5240617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc52c0038e0 0x7fc540165630 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 --2- 172.21.15.148:0/2427534295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5400acae0 0x7fc540165b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 >> 172.21.15.148:0/2427534295 conn(0x7fc5400c7eb0 msgr2=0x7fc5400c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 shutdown_connections 2023-10-24T00:44:38.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.063+0000 7fc5483ac700 1 -- 172.21.15.148:0/2427534295 wait complete. 2023-10-24T00:44:38.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:44:17.906193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:44:18.311635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:44:38.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:44:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.198+0000 7fdea5d69700 1 Processor -- start 2023-10-24T00:44:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.198+0000 7fdea5d69700 1 -- start start 2023-10-24T00:44:38.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5d69700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdea00c62b0 0x7fdea0063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5d69700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdea00bec40 0x7fdea00c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5d69700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea0065740 con 0x7fdea00644d0 2023-10-24T00:44:38.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5d69700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea0064b30 con 0x7fdea00c62b0 2023-10-24T00:44:38.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5d69700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea0064e10 con 0x7fdea00bec40 2023-10-24T00:44:38.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdea00c62b0 0x7fdea0063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdea00c62b0 0x7fdea0063fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57430/0 (socket says 172.21.15.148:57430) 2023-10-24T00:44:38.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 -- 172.21.15.148:0/2806382062 learned_addr learned my addr 172.21.15.148:0/2806382062 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea5568700 1 --2- 172.21.15.148:0/2806382062 >> v2:172.21.15.150:3300/0 conn(0x7fdea00bec40 0x7fdea00c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 -- 172.21.15.148:0/2806382062 >> v2:172.21.15.150:3300/0 conn(0x7fdea00bec40 msgr2=0x7fdea00c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 --2- 172.21.15.148:0/2806382062 >> v2:172.21.15.150:3300/0 conn(0x7fdea00bec40 0x7fdea00c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 -- 172.21.15.148:0/2806382062 >> v1:172.21.15.150:6789/0 conn(0x7fdea00644d0 legacy=0x7fdea00be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 -- 172.21.15.148:0/2806382062 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00650f0 con 0x7fdea00c62b0 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fdea4d67700 1 --2- 172.21.15.148:0/2806382062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea0063fe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fdea0063540 tx=0x7fde940090f0).ready entity=mon.0 client_cookie=9332f557a0491453 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fde9f7fe700 1 -- 172.21.15.148:0/2806382062 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400b5a0 con 0x7fdea00c62b0 2023-10-24T00:44:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.199+0000 7fde9f7fe700 1 -- 172.21.15.148:0/2806382062 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9400b700 con 0x7fdea00c62b0 2023-10-24T00:44:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fde9f7fe700 1 -- 172.21.15.148:0/2806382062 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400ba80 con 0x7fdea00c62b0 2023-10-24T00:44:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 -- 172.21.15.148:0/2806382062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 msgr2=0x7fdea0063fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 --2- 172.21.15.148:0/2806382062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea0063fe0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7fdea0063540 tx=0x7fde940090f0).stop 2023-10-24T00:44:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 -- 172.21.15.148:0/2806382062 shutdown_connections 2023-10-24T00:44:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 --2- 172.21.15.148:0/2806382062 >> v2:172.21.15.150:3300/0 conn(0x7fdea00bec40 0x7fdea00c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 --2- 172.21.15.148:0/2806382062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea0063fe0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 -- 172.21.15.148:0/2806382062 >> 172.21.15.148:0/2806382062 conn(0x7fdea00923c0 msgr2=0x7fdea0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 -- 172.21.15.148:0/2806382062 shutdown_connections 2023-10-24T00:44:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.200+0000 7fdea5d69700 1 -- 172.21.15.148:0/2806382062 wait complete. 2023-10-24T00:44:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.202+0000 7fdea5d69700 1 Processor -- start 2023-10-24T00:44:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.202+0000 7fdea5d69700 1 -- start start 2023-10-24T00:44:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdea00644d0 0x7fdea00aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdea00bec40 0x7fdea00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00a8790 con 0x7fdea00c62b0 2023-10-24T00:44:38.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00ae4c0 con 0x7fdea00644d0 2023-10-24T00:44:38.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5d69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00ae7a0 con 0x7fdea00bec40 2023-10-24T00:44:38.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5568700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5568700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57442/0 (socket says 172.21.15.148:57442) 2023-10-24T00:44:38.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea5568700 1 -- 172.21.15.148:0/1869673273 learned_addr learned my addr 172.21.15.148:0/1869673273 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fdea4d67700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdea00644d0 0x7fdea00aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.203+0000 7fde9ffff700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdea00bec40 0x7fdea00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdea00bec40 msgr2=0x7fdea00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdea00bec40 0x7fdea00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdea00644d0 msgr2=0x7fdea00aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdea00644d0 0x7fdea00aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 -- 172.21.15.148:0/1869673273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009370 con 0x7fdea00c62b0 2023-10-24T00:44:38.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5568700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fde98007f30 tx=0x7fde980098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9800eb90 con 0x7fdea00c62b0 2023-10-24T00:44:38.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9800ecf0 con 0x7fdea00c62b0 2023-10-24T00:44:38.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea00aea80 con 0x7fdea00c62b0 2023-10-24T00:44:38.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98014610 con 0x7fdea00c62b0 2023-10-24T00:44:38.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.204+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea0066aa0 con 0x7fdea00c62b0 2023-10-24T00:44:38.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.205+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea00a8be0 con 0x7fdea00c62b0 2023-10-24T00:44:38.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.205+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fde98014a00 con 0x7fdea00c62b0 2023-10-24T00:44:38.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.206+0000 7fde9cff9700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 0x7fde840617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.206+0000 7fdea4d67700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 msgr2=0x7fde840617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:38.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.206+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fde9807a990 con 0x7fdea00c62b0 2023-10-24T00:44:38.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.206+0000 7fdea4d67700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 0x7fde840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:38.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.210+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdea00a8be0 con 0x7fdea00c62b0 2023-10-24T00:44:38.251 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:38.249+0000 7f60848d5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:38.296 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:38.291+0000 7f2d20bba680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:44:38.322 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:38.320+0000 7f60848d5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:38.367 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:38.365+0000 7f2d20bba680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:44:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.407+0000 7fdea4d67700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 msgr2=0x7fde840617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.407+0000 7fdea4d67700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 0x7fde840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:38.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.413+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdea00a8be0 con 0x7fdea00c62b0 2023-10-24T00:44:38.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.414+0000 7fde9cff9700 1 -- 172.21.15.148:0/1869673273 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v82) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdea00a8be0 con 0x7fdea00c62b0 2023-10-24T00:44:38.416 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:44:38.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 msgr2=0x7fde840617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:38.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 0x7fde840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 msgr2=0x7fdea00665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fde98007f30 tx=0x7fde980098e0).stop 2023-10-24T00:44:38.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 shutdown_connections 2023-10-24T00:44:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8405f300 0x7fde840617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdea00c62b0 0x7fdea00665b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdea00644d0 0x7fdea00aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 --2- 172.21.15.148:0/1869673273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdea00bec40 0x7fdea00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 >> 172.21.15.148:0/1869673273 conn(0x7fdea00923c0 msgr2=0x7fdea00a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 shutdown_connections 2023-10-24T00:44:38.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.416+0000 7fdea5d69700 1 -- 172.21.15.148:0/1869673273 wait complete. 2023-10-24T00:44:38.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:44:38.509 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:38.507+0000 7f60848d5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.550+0000 7f6a044e4700 1 Processor -- start 2023-10-24T00:44:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.550+0000 7f6a044e4700 1 -- start start 2023-10-24T00:44:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a044e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a044e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a044e4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc155c00 con 0x7f69fc0c6240 2023-10-24T00:44:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a044e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0c8800 con 0x7f69fc0c66c0 2023-10-24T00:44:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a044e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c6b70 con 0x7f69fc152290 2023-10-24T00:44:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a02a81700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a02280700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a02a81700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:59580/0 (socket says 172.21.15.148:59580) 2023-10-24T00:44:38.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a02280700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:46236/0 (socket says 172.21.15.148:46236) 2023-10-24T00:44:38.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.551+0000 7f6a02a81700 1 -- 172.21.15.148:0/1223144892 learned_addr learned my addr 172.21.15.148:0/1223144892 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02280700 1 -- 172.21.15.148:0/1223144892 >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 msgr2=0x7f69fc0c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:38.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02280700 1 --2- 172.21.15.148:0/1223144892 >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02280700 1 -- 172.21.15.148:0/1223144892 >> v1:172.21.15.150:6789/0 conn(0x7f69fc0c6240 legacy=0x7f69fc0c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02280700 1 -- 172.21.15.148:0/1223144892 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0c7b80 con 0x7f69fc152290 2023-10-24T00:44:38.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02a81700 1 --2- 172.21.15.148:0/1223144892 >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:38.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a02280700 1 --2- 172.21.15.148:0/1223144892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f69ec009760 tx=0x7f69ec009060).ready entity=mon.2 client_cookie=8dc3b763216d0893 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a0127e700 1 -- 172.21.15.148:0/1223144892 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0090d0 con 0x7f69fc152290 2023-10-24T00:44:38.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a0127e700 1 -- 172.21.15.148:0/1223144892 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00f510 con 0x7f69fc152290 2023-10-24T00:44:38.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.552+0000 7f6a0127e700 1 -- 172.21.15.148:0/1223144892 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00f890 con 0x7f69fc152290 2023-10-24T00:44:38.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 -- 172.21.15.148:0/1223144892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 msgr2=0x7f69fc155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1223144892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f69ec009760 tx=0x7f69ec009060).stop 2023-10-24T00:44:38.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 -- 172.21.15.148:0/1223144892 shutdown_connections 2023-10-24T00:44:38.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1223144892 >> v2:172.21.15.150:3300/0 conn(0x7f69fc0c66c0 0x7f69fc0c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1223144892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc155710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 -- 172.21.15.148:0/1223144892 >> 172.21.15.148:0/1223144892 conn(0x7f69fc0946c0 msgr2=0x7f69fc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 -- 172.21.15.148:0/1223144892 shutdown_connections 2023-10-24T00:44:38.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.553+0000 7f6a044e4700 1 -- 172.21.15.148:0/1223144892 wait complete. 2023-10-24T00:44:38.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.554+0000 7f6a044e4700 1 Processor -- start 2023-10-24T00:44:38.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.554+0000 7f6a044e4700 1 -- start start 2023-10-24T00:44:38.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc0c66c0 0x7f69fc064590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c29c0 con 0x7f69fc0c6240 2023-10-24T00:44:38.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0a87a0 con 0x7f69fc0c66c0 2023-10-24T00:44:38.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc064a80 con 0x7f69fc152290 2023-10-24T00:44:38.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57454/0 (socket says 172.21.15.148:57454) 2023-10-24T00:44:38.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 -- 172.21.15.148:0/1454355794 learned_addr learned my addr 172.21.15.148:0/1454355794 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02a81700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a01a7f700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc0c66c0 0x7f69fc064590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 -- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 msgr2=0x7f69fc13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc13fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 -- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc0c66c0 msgr2=0x7f69fc064590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc0c66c0 0x7f69fc064590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 -- 172.21.15.148:0/1454355794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009ae0 con 0x7f69fc0c6240 2023-10-24T00:44:38.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a02280700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f69ec009e00 tx=0x7f69ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec006970 con 0x7f69fc0c6240 2023-10-24T00:44:38.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00fc90 con 0x7f69fc0c6240 2023-10-24T00:44:38.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00f8d0 con 0x7f69fc0c6240 2023-10-24T00:44:38.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec0092a0 con 0x7f69fc0c6240 2023-10-24T00:44:38.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.555+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc0a8150 con 0x7f69fc0c6240 2023-10-24T00:44:38.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.556+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0a8a80 con 0x7f69fc0c6240 2023-10-24T00:44:38.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.557+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f69ec01b620 con 0x7f69fc0c6240 2023-10-24T00:44:38.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.557+0000 7f69f27fc700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 0x7f69e00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.557+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f69ec07bfb0 con 0x7f69fc0c6240 2023-10-24T00:44:38.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.557+0000 7f6a01a7f700 1 -- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 msgr2=0x7f69e00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:38.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.557+0000 7f6a01a7f700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 0x7f69e00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:38.570 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:38.565+0000 7f2d20bba680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:44:38.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.565+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f69ec04cf40 con 0x7f69fc0c6240 2023-10-24T00:44:38.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.737+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69fc06c6b0 con 0x7f69fc0c6240 2023-10-24T00:44:38.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.737+0000 7f69f27fc700 1 -- 172.21.15.148:0/1454355794 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7f69ec01f020 con 0x7f69fc0c6240 2023-10-24T00:44:38.740 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:44:38.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 msgr2=0x7f69e00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:38.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 0x7f69e00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 msgr2=0x7f69fc0c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f69ec009e00 tx=0x7f69ec017000).stop 2023-10-24T00:44:38.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 shutdown_connections 2023-10-24T00:44:38.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69fc152290 0x7f69fc13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69e005f300 0x7f69e00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:38.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69fc0c6240 0x7f69fc0c2100 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 --2- 172.21.15.148:0/1454355794 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69fc0c66c0 0x7f69fc064590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 >> 172.21.15.148:0/1454355794 conn(0x7f69fc0946c0 msgr2=0x7f69fc0c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 shutdown_connections 2023-10-24T00:44:38.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.739+0000 7f6a044e4700 1 -- 172.21.15.148:0/1454355794 wait complete. 2023-10-24T00:44:38.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:44:38.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 Processor -- start 2023-10-24T00:44:38.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 -- start start 2023-10-24T00:44:38.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25200c6210 0x7f25200c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c65f0 0x7f25200c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2520063760 con 0x7f25200be570 2023-10-24T00:44:38.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2520154b50 con 0x7f25200c6210 2023-10-24T00:44:38.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.875+0000 7f2525eb4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c4be0 con 0x7f25200c65f0 2023-10-24T00:44:38.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25200c6210 0x7f25200c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25200c6210 0x7f25200c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57458/0 (socket says 172.21.15.148:57458) 2023-10-24T00:44:38.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 -- 172.21.15.148:0/814896288 learned_addr learned my addr 172.21.15.148:0/814896288 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251effd700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c65f0 0x7f25200c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 -- 172.21.15.148:0/814896288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c65f0 msgr2=0x7f25200c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:38.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c65f0 0x7f25200c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 -- 172.21.15.148:0/814896288 >> v1:172.21.15.150:6789/0 conn(0x7f25200be570 legacy=0x7f25200bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 -- 172.21.15.148:0/814896288 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200bf2f0 con 0x7f25200c6210 2023-10-24T00:44:38.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251f7fe700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c6210 0x7f25200c4200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f2514006fd0 tx=0x7f25140090f0).ready entity=mon.0 client_cookie=2519dc8ef55797c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251e7fc700 1 -- 172.21.15.148:0/814896288 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400b580 con 0x7f25200c6210 2023-10-24T00:44:38.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251e7fc700 1 -- 172.21.15.148:0/814896288 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400b6e0 con 0x7f25200c6210 2023-10-24T00:44:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.876+0000 7f251e7fc700 1 -- 172.21.15.148:0/814896288 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400ba60 con 0x7f25200c6210 2023-10-24T00:44:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 -- 172.21.15.148:0/814896288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c6210 msgr2=0x7f25200c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c6210 0x7f25200c4200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f2514006fd0 tx=0x7f25140090f0).stop 2023-10-24T00:44:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 -- 172.21.15.148:0/814896288 shutdown_connections 2023-10-24T00:44:38.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c6210 0x7f25200c4200 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 --2- 172.21.15.148:0/814896288 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c65f0 0x7f25200c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 -- 172.21.15.148:0/814896288 >> 172.21.15.148:0/814896288 conn(0x7f2520092510 msgr2=0x7f2520062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:38.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 -- 172.21.15.148:0/814896288 shutdown_connections 2023-10-24T00:44:38.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.877+0000 7f2525eb4700 1 -- 172.21.15.148:0/814896288 wait complete. 2023-10-24T00:44:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.878+0000 7f2525eb4700 1 Processor -- start 2023-10-24T00:44:38.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.878+0000 7f2525eb4700 1 -- start start 2023-10-24T00:44:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25200be570 0x7f25200ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c6210 0x7f25200ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200ae4f0 con 0x7f25200c65f0 2023-10-24T00:44:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200acdb0 con 0x7f25200be570 2023-10-24T00:44:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f2525eb4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200ad8e0 con 0x7f25200c6210 2023-10-24T00:44:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57460/0 (socket says 172.21.15.148:57460) 2023-10-24T00:44:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 -- 172.21.15.148:0/1489759592 learned_addr learned my addr 172.21.15.148:0/1489759592 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251f7fe700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25200be570 0x7f25200ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251effd700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c6210 0x7f25200ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:38.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 -- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c6210 msgr2=0x7f25200ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c6210 0x7f25200ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 -- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25200be570 msgr2=0x7f25200ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:38.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25200be570 0x7f25200ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:38.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 -- 172.21.15.148:0/1489759592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009370 con 0x7f25200c65f0 2023-10-24T00:44:38.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f251ffff700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2518002230 tx=0x7f25180015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:38.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.879+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e4a0 con 0x7f25200c65f0 2023-10-24T00:44:38.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.880+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800e600 con 0x7f25200c65f0 2023-10-24T00:44:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.880+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e980 con 0x7f25200c65f0 2023-10-24T00:44:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.880+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200adbc0 con 0x7f25200c65f0 2023-10-24T00:44:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.880+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25200ae180 con 0x7f25200c65f0 2023-10-24T00:44:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f251801b3b0 con 0x7f25200c65f0 2023-10-24T00:44:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252006c6b0 con 0x7f25200c65f0 2023-10-24T00:44:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f25077fe700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 0x7f250c061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f251f7fe700 1 -- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 msgr2=0x7f250c061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f2518079c70 con 0x7f25200c65f0 2023-10-24T00:44:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.881+0000 7f251f7fe700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 0x7f250c061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:38.885+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2518048af0 con 0x7f25200c65f0 2023-10-24T00:44:38.930 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:38.927+0000 7f60848d5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:39.029 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.026+0000 7f2d20bba680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:44:39.032 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.030+0000 7f60848d5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:39.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.077+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25200666d0 con 0x7f25200c65f0 2023-10-24T00:44:39.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.077+0000 7f25077fe700 1 -- 172.21.15.148:0/1489759592 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f251804ac90 con 0x7f25200c65f0 2023-10-24T00:44:39.082 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:44:39.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 msgr2=0x7f250c061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:39.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 0x7f250c061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 msgr2=0x7f25200ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2518002230 tx=0x7f25180015e0).stop 2023-10-24T00:44:39.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 shutdown_connections 2023-10-24T00:44:39.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f250c05f2d0 0x7f250c061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25200c65f0 0x7f25200ab2c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25200be570 0x7f25200ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 --2- 172.21.15.148:0/1489759592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25200c6210 0x7f25200ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 >> 172.21.15.148:0/1489759592 conn(0x7f2520092510 msgr2=0x7f2520063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 shutdown_connections 2023-10-24T00:44:39.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.079+0000 7f2525eb4700 1 -- 172.21.15.148:0/1489759592 wait complete. 2023-10-24T00:44:39.094 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:44:39.138 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.136+0000 7f2d20bba680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:39.186 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.184+0000 7f60848d5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:39.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.213+0000 7fa5b40ab700 1 Processor -- start 2023-10-24T00:44:39.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.213+0000 7fa5b40ab700 1 -- start start 2023-10-24T00:44:39.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b40ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 0x7fa5ac155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b40ab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c6240 0x7fa5ac0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b40ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c6bb0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b40ab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c8800 con 0x7fa5ac0c6240 2023-10-24T00:44:39.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b40ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac155c00 con 0x7fa5ac152290 2023-10-24T00:44:39.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b2648700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa5ac0c0940 0x7fa5ac0c0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56086/0 (socket says 172.21.15.148:56086) 2023-10-24T00:44:39.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b2648700 1 -- 172.21.15.148:0/1310616396 learned_addr learned my addr 172.21.15.148:0/1310616396 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:39.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/1310616396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 0x7fa5ac155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.214+0000 7fa5b1646700 1 --2- 172.21.15.148:0/1310616396 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c6240 0x7fa5ac0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b0e45700 1 -- 172.21.15.148:0/1310616396 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294574298 0 0) 0x7fa5ac0c6bb0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b0e45700 1 -- 172.21.15.148:0/1310616396 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5980033f0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b1e47700 1 -- 172.21.15.148:0/1310616396 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c6240 msgr2=0x7fa5ac0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:39.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/1310616396 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c6240 0x7fa5ac0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b1e47700 1 -- 172.21.15.148:0/1310616396 >> v1:172.21.15.148:6789/0 conn(0x7fa5ac0c0940 legacy=0x7fa5ac0c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b1e47700 1 -- 172.21.15.148:0/1310616396 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c7b80 con 0x7fa5ac152290 2023-10-24T00:44:39.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/1310616396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 0x7fa5ac155710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa59c009760 tx=0x7fa59c009060).ready entity=mon.2 client_cookie=7bf18830ec84388b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b0e45700 1 -- 172.21.15.148:0/1310616396 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0090d0 con 0x7fa5ac152290 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b0e45700 1 -- 172.21.15.148:0/1310616396 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00d4a0 con 0x7fa5ac152290 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.215+0000 7fa5b0e45700 1 -- 172.21.15.148:0/1310616396 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00d820 con 0x7fa5ac152290 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 -- 172.21.15.148:0/1310616396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 msgr2=0x7fa5ac155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/1310616396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 0x7fa5ac155710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa59c009760 tx=0x7fa59c009060).stop 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 -- 172.21.15.148:0/1310616396 shutdown_connections 2023-10-24T00:44:39.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/1310616396 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac152290 0x7fa5ac155710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/1310616396 >> v2:172.21.15.150:3300/0 conn(0x7fa5ac0c6240 0x7fa5ac0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 -- 172.21.15.148:0/1310616396 >> 172.21.15.148:0/1310616396 conn(0x7fa5ac0946c0 msgr2=0x7fa5ac06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 -- 172.21.15.148:0/1310616396 shutdown_connections 2023-10-24T00:44:39.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.216+0000 7fa5b40ab700 1 -- 172.21.15.148:0/1310616396 wait complete. 2023-10-24T00:44:39.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.217+0000 7fa5b40ab700 1 Processor -- start 2023-10-24T00:44:39.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.217+0000 7fa5b40ab700 1 -- start start 2023-10-24T00:44:39.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 0x7fa5ac0c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 0x7fa5ac0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b0720 con 0x7fa5ac0c0940 2023-10-24T00:44:39.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c2410 con 0x7fa5ac152290 2023-10-24T00:44:39.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b40ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0afb10 con 0x7fa5ac0c6240 2023-10-24T00:44:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57476/0 (socket says 172.21.15.148:57476) 2023-10-24T00:44:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1646700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 0x7fa5ac0c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 -- 172.21.15.148:0/753346002 learned_addr learned my addr 172.21.15.148:0/753346002 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b2648700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 0x7fa5ac0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 -- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 msgr2=0x7fa5ac0c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 0x7fa5ac0c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 -- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 msgr2=0x7fa5ac0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 0x7fa5ac0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 -- 172.21.15.148:0/753346002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0092a0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b2648700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 0x7fa5ac0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:39.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1646700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 0x7fa5ac0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:39.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.218+0000 7fa5b1e47700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fa59c009d50 tx=0x7fa59c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.219+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c012770 con 0x7fa5ac0c0940 2023-10-24T00:44:39.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.219+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0128d0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.219+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0afdf0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.219+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c012c90 con 0x7fa5ac0c0940 2023-10-24T00:44:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.219+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac0b03b0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.220+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac0b0a00 con 0x7fa5ac0c0940 2023-10-24T00:44:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.220+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa59c026460 con 0x7fa5ac0c0940 2023-10-24T00:44:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.221+0000 7fa5a1ffb700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 0x7fa5900617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.221+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fa59c07b8c0 con 0x7fa5ac0c0940 2023-10-24T00:44:39.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.221+0000 7fa5b1646700 1 -- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 msgr2=0x7fa5900617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:39.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.221+0000 7fa5b1646700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 0x7fa5900617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:39.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.225+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa59c04c830 con 0x7fa5ac0c0940 2023-10-24T00:44:39.261 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.259+0000 7f60848d5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:39.299 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.297+0000 7f2d20bba680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:39.328 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.325+0000 7f60848d5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:39.375 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.373+0000 7f2d20bba680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:44:39.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.392+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5ac0c7e60 con 0x7fa5ac0c0940 2023-10-24T00:44:39.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.393+0000 7fa5a1ffb700 1 -- 172.21.15.148:0/753346002 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa59c04fe50 con 0x7fa5ac0c0940 2023-10-24T00:44:39.396 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 msgr2=0x7fa5900617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 0x7fa5900617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 msgr2=0x7fa5ac0c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fa59c009d50 tx=0x7fa59c016000).stop 2023-10-24T00:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 shutdown_connections 2023-10-24T00:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5ac152290 0x7fa5ac0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa59005f300 0x7fa5900617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5ac0c0940 0x7fa5ac0c3020 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 --2- 172.21.15.148:0/753346002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa5ac0c6240 0x7fa5ac0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 >> 172.21.15.148:0/753346002 conn(0x7fa5ac0946c0 msgr2=0x7fa5ac0c6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 shutdown_connections 2023-10-24T00:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.395+0000 7fa5b40ab700 1 -- 172.21.15.148:0/753346002 wait complete. 2023-10-24T00:44:39.410 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:39.446 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.443+0000 7f2d20bba680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:44:39.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 Processor -- start 2023-10-24T00:44:39.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 -- start start 2023-10-24T00:44:39.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f351c0c8360 0x7f351c0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c066320 con 0x7f351c154100 2023-10-24T00:44:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c0c6130 con 0x7f351c0c5ca0 2023-10-24T00:44:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.560+0000 7f3522102700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c065710 con 0x7f351c0c8360 2023-10-24T00:44:39.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f351c154100 0x7f351c0667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56092/0 (socket says 172.21.15.148:56092) 2023-10-24T00:44:39.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351b7fe700 1 -- 172.21.15.148:0/2538862377 learned_addr learned my addr 172.21.15.148:0/2538862377 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:39.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f3513fff700 1 --2- 172.21.15.148:0/2538862377 >> v2:172.21.15.150:3300/0 conn(0x7f351c0c8360 0x7f351c0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460861162 0 0) 0x7f351c066320 con 0x7f351c154100 2023-10-24T00:44:39.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35080033f0 con 0x7f351c154100 2023-10-24T00:44:39.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f3513fff700 1 -- 172.21.15.148:0/2538862377 >> v1:172.21.15.150:6789/0 conn(0x7f351c0c5ca0 legacy=0x7f351c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625961906 0 0) 0x7f351c0c6130 con 0x7f351c0c5ca0 2023-10-24T00:44:39.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f3513fff700 1 -- 172.21.15.148:0/2538862377 >> v1:172.21.15.148:6789/0 conn(0x7f351c154100 legacy=0x7f351c0667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f3513fff700 1 -- 172.21.15.148:0/2538862377 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0659f0 con 0x7f351c0c8360 2023-10-24T00:44:39.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f3513fff700 1 --2- 172.21.15.148:0/2538862377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0c57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f3504009760 tx=0x7f3504009060).ready entity=mon.1 client_cookie=a722205e46702dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c001470 con 0x7f351c0c8360 2023-10-24T00:44:39.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504012410 con 0x7f351c0c8360 2023-10-24T00:44:39.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.561+0000 7f351affd700 1 -- 172.21.15.148:0/2538862377 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504012790 con 0x7f351c0c8360 2023-10-24T00:44:39.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 -- 172.21.15.148:0/2538862377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 msgr2=0x7f351c0c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 --2- 172.21.15.148:0/2538862377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0c57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f3504009760 tx=0x7f3504009060).stop 2023-10-24T00:44:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 -- 172.21.15.148:0/2538862377 shutdown_connections 2023-10-24T00:44:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 --2- 172.21.15.148:0/2538862377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0c57b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 -- 172.21.15.148:0/2538862377 >> 172.21.15.148:0/2538862377 conn(0x7f351c0641f0 msgr2=0x7f351c0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 -- 172.21.15.148:0/2538862377 shutdown_connections 2023-10-24T00:44:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.562+0000 7f3522102700 1 -- 172.21.15.148:0/2538862377 wait complete. 2023-10-24T00:44:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.563+0000 7f3522102700 1 Processor -- start 2023-10-24T00:44:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.563+0000 7f3522102700 1 -- start start 2023-10-24T00:44:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 0x7f351c142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0bd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0bdd00 con 0x7f351c154100 2023-10-24T00:44:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c155d40 con 0x7f351c0c8360 2023-10-24T00:44:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3522102700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c155130 con 0x7f351c0c5ca0 2023-10-24T00:44:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57484/0 (socket says 172.21.15.148:57484) 2023-10-24T00:44:39.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351bfff700 1 -- 172.21.15.148:0/4017345503 learned_addr learned my addr 172.21.15.148:0/4017345503 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:39.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 0x7f351c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f3513fff700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 msgr2=0x7f351c0bd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0bd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 msgr2=0x7f351c0bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351b7fe700 1 -- 172.21.15.148:0/4017345503 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35040092a0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.564+0000 7f351bfff700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:39.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f351b7fe700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 0x7f351c142690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f350c00c810 tx=0x7f350c001ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c007170 con 0x7f351c0c5ca0 2023-10-24T00:44:39.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0072f0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c155410 con 0x7f351c0c5ca0 2023-10-24T00:44:39.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0048c0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.565+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c1559d0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c06c6b0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f350c004cb0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f35137fe700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 0x7f34fc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f350c07a5a0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f3513fff700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 msgr2=0x7f34fc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:39.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.566+0000 7f3513fff700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 0x7f34fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:39.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.571+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f350c04b570 con 0x7f351c0c5ca0 2023-10-24T00:44:39.587 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.585+0000 7f60848d5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:39.718 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.715+0000 7f2d20bba680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:44:39.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.767+0000 7f3513fff700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 msgr2=0x7f34fc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:39.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.767+0000 7f3513fff700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 0x7f34fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:39.770 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:39.767+0000 7f60848d5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:39.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.777+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f351c065cd0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.778+0000 7f35137fe700 1 -- 172.21.15.148:0/4017345503 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f350c001bf0 con 0x7f351c0c5ca0 2023-10-24T00:44:39.781 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:39.781 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:39.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 msgr2=0x7f34fc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:39.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 0x7f34fc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 msgr2=0x7f351c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 0x7f351c142690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f350c00c810 tx=0x7f350c001ab0).stop 2023-10-24T00:44:39.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 shutdown_connections 2023-10-24T00:44:39.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34fc05f300 0x7f34fc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:39.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c154100 0x7f351c0bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f351c0c5ca0 0x7f351c142690 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 --2- 172.21.15.148:0/4017345503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c0c8360 0x7f351c0bd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 >> 172.21.15.148:0/4017345503 conn(0x7f351c0641f0 msgr2=0x7f351c159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 shutdown_connections 2023-10-24T00:44:39.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.780+0000 7f3522102700 1 -- 172.21.15.148:0/4017345503 wait complete. 2023-10-24T00:44:39.785 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:39.795 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:39.908 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:39.905+0000 7f2d20bba680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:44:39.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.912+0000 7f51e677d700 1 Processor -- start 2023-10-24T00:44:39.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.912+0000 7f51e677d700 1 -- start start 2023-10-24T00:44:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e677d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f51e0069040 0x7f51e00aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e677d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51e00ab1d0 0x7f51e0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e677d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e0063730 con 0x7f51e0068c60 2023-10-24T00:44:39.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e677d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e006a000 con 0x7f51e00ab1d0 2023-10-24T00:44:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e677d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00697f0 con 0x7f51e0069040 2023-10-24T00:44:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e5f7c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f51e00ab1d0 0x7f51e0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e577b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f51e0068c60 0x7f51e0063020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56094/0 (socket says 172.21.15.148:56094) 2023-10-24T00:44:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e577b700 1 -- 172.21.15.148:0/3412733062 learned_addr learned my addr 172.21.15.148:0/3412733062 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:39.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e4f7a700 1 --2- 172.21.15.148:0/3412733062 >> v2:172.21.15.150:3300/0 conn(0x7f51e0069040 0x7f51e00aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51d7fff700 1 -- 172.21.15.148:0/3412733062 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126427839 0 0) 0x7f51d0001110 con 0x7f51e0068c60 2023-10-24T00:44:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51d7fff700 1 -- 172.21.15.148:0/3412733062 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51cc0033f0 con 0x7f51e0068c60 2023-10-24T00:44:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e5f7c700 1 -- 172.21.15.148:0/3412733062 >> v2:172.21.15.150:3300/0 conn(0x7f51e0069040 msgr2=0x7f51e00aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e5f7c700 1 --2- 172.21.15.148:0/3412733062 >> v2:172.21.15.150:3300/0 conn(0x7f51e0069040 0x7f51e00aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e5f7c700 1 -- 172.21.15.148:0/3412733062 >> v1:172.21.15.148:6789/0 conn(0x7f51e0068c60 legacy=0x7f51e0063020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.913+0000 7f51e5f7c700 1 -- 172.21.15.148:0/3412733062 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0069a40 con 0x7f51e00ab1d0 2023-10-24T00:44:39.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e5f7c700 1 --2- 172.21.15.148:0/3412733062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e00ab1d0 0x7f51e0150c80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f51e00aa1a0 tx=0x7f51d8009780).ready entity=mon.0 client_cookie=481109910cd3476f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51d7fff700 1 -- 172.21.15.148:0/3412733062 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800e070 con 0x7f51e00ab1d0 2023-10-24T00:44:39.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51d7fff700 1 -- 172.21.15.148:0/3412733062 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800bab0 con 0x7f51e00ab1d0 2023-10-24T00:44:39.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51d7fff700 1 -- 172.21.15.148:0/3412733062 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800be30 con 0x7f51e00ab1d0 2023-10-24T00:44:39.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 -- 172.21.15.148:0/3412733062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e00ab1d0 msgr2=0x7f51e0150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 --2- 172.21.15.148:0/3412733062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e00ab1d0 0x7f51e0150c80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f51e00aa1a0 tx=0x7f51d8009780).stop 2023-10-24T00:44:39.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 -- 172.21.15.148:0/3412733062 shutdown_connections 2023-10-24T00:44:39.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 --2- 172.21.15.148:0/3412733062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e00ab1d0 0x7f51e0150c80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 --2- 172.21.15.148:0/3412733062 >> v2:172.21.15.150:3300/0 conn(0x7f51e0069040 0x7f51e00aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 -- 172.21.15.148:0/3412733062 >> 172.21.15.148:0/3412733062 conn(0x7f51e00c72d0 msgr2=0x7f51e00c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:39.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.914+0000 7f51e677d700 1 -- 172.21.15.148:0/3412733062 shutdown_connections 2023-10-24T00:44:39.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.915+0000 7f51e677d700 1 -- 172.21.15.148:0/3412733062 wait complete. 2023-10-24T00:44:39.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.916+0000 7f51e677d700 1 Processor -- start 2023-10-24T00:44:39.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.916+0000 7f51e677d700 1 -- start start 2023-10-24T00:44:39.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e0069040 0x7f51e0167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e00ab1d0 0x7f51e0167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01529a0 con 0x7f51e0068c60 2023-10-24T00:44:39.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0168830 con 0x7f51e00ab1d0 2023-10-24T00:44:39.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e01682e0 con 0x7f51e0069040 2023-10-24T00:44:39.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57504/0 (socket says 172.21.15.148:57504) 2023-10-24T00:44:39.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 -- 172.21.15.148:0/3460318443 learned_addr learned my addr 172.21.15.148:0/3460318443 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:39.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e5f7c700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e00ab1d0 0x7f51e0167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e4f7a700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e0069040 0x7f51e0167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:39.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 -- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e0069040 msgr2=0x7f51e0167900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e0069040 0x7f51e0167900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 -- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e00ab1d0 msgr2=0x7f51e0167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:39.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e00ab1d0 0x7f51e0167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:39.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 -- 172.21.15.148:0/3460318443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009a20 con 0x7f51e0068c60 2023-10-24T00:44:39.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e577b700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f51d000c4d0 tx=0x7f51d0007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000ce00 con 0x7f51e0068c60 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00072e0 con 0x7f51e0068c60 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0168550 con 0x7f51e0068c60 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00057a0 con 0x7f51e0068c60 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.917+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e0153150 con 0x7f51e0068c60 2023-10-24T00:44:39.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.918+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e0047480 con 0x7f51e0068c60 2023-10-24T00:44:39.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.919+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f51d0005b50 con 0x7f51e0068c60 2023-10-24T00:44:39.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.919+0000 7f51d57fa700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 0x7f51c4061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:39.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.919+0000 7f51e4f7a700 1 -- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 msgr2=0x7f51c4061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:39.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.919+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f51d0079960 con 0x7f51e0068c60 2023-10-24T00:44:39.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.919+0000 7f51e4f7a700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 0x7f51c4061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:39.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:39.923+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51d004e360 con 0x7f51e0068c60 2023-10-24T00:44:40.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.090+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e0063730 con 0x7f51e0068c60 2023-10-24T00:44:40.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.091+0000 7f51d57fa700 1 -- 172.21.15.148:0/3460318443 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17350 (secure 0 0 0) 0x7f51e0063730 con 0x7f51e0068c60 2023-10-24T00:44:40.094 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:40.094 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":82,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:35.081010+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/4011676657":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6833/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6832/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2148779355":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/242651982":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2555703333":"2023-10-25T00:44:35.080967+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:40.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 msgr2=0x7f51c4061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:40.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 0x7f51c4061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 msgr2=0x7f51e00c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f51d000c4d0 tx=0x7f51d0007ab0).stop 2023-10-24T00:44:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 shutdown_connections 2023-10-24T00:44:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e00ab1d0 0x7f51e0167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f51c405f2d0 0x7f51c4061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51e0068c60 0x7f51e00c0890 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 --2- 172.21.15.148:0/3460318443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e0069040 0x7f51e0167900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 >> 172.21.15.148:0/3460318443 conn(0x7f51e00c72d0 msgr2=0x7f51e00c2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 shutdown_connections 2023-10-24T00:44:40.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.093+0000 7f51e677d700 1 -- 172.21.15.148:0/3460318443 wait complete. 2023-10-24T00:44:40.108 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:44:40.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:40.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.224+0000 7f2874947700 1 Processor -- start 2023-10-24T00:44:40.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.224+0000 7f2874947700 1 -- start start 2023-10-24T00:44:40.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.225+0000 7f2874947700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2870069380 0x7f2870069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.225+0000 7f2874947700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 0x7f287015b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.225+0000 7f2874947700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700bdf20 con 0x7f2870150f60 2023-10-24T00:44:40.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.225+0000 7f2874947700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870069cf0 con 0x7f2870069380 2023-10-24T00:44:40.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.225+0000 7f2874947700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700664b0 con 0x7f2870158c70 2023-10-24T00:44:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2870069380 0x7f2870069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 0x7f287015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 0x7f287015b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:46324/0 (socket says 172.21.15.148:46324) 2023-10-24T00:44:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286ed9d700 1 -- 172.21.15.148:0/473009432 learned_addr learned my addr 172.21.15.148:0/473009432 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 -- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 msgr2=0x7f287015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 --2- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 0x7f287015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 -- 172.21.15.148:0/473009432 >> v1:172.21.15.150:6789/0 conn(0x7f2870150f60 legacy=0x7f28700c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286d59a700 1 -- 172.21.15.148:0/473009432 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383657474 0 0) 0x7f28700bdf20 con 0x7f2870150f60 2023-10-24T00:44:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 -- 172.21.15.148:0/473009432 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700c4510 con 0x7f2870069380 2023-10-24T00:44:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286dd9b700 1 --2- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870069380 0x7f2870069800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2860009760 tx=0x7f2860009060).ready entity=mon.1 client_cookie=a5d68d2d3a458d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286d59a700 1 -- 172.21.15.148:0/473009432 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000f510 con 0x7f2870069380 2023-10-24T00:44:40.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286d59a700 1 -- 172.21.15.148:0/473009432 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000f670 con 0x7f2870069380 2023-10-24T00:44:40.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.226+0000 7f286d59a700 1 -- 172.21.15.148:0/473009432 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000f9f0 con 0x7f2870069380 2023-10-24T00:44:40.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 -- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870069380 msgr2=0x7f2870069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 --2- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870069380 0x7f2870069800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f2860009760 tx=0x7f2860009060).stop 2023-10-24T00:44:40.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 -- 172.21.15.148:0/473009432 shutdown_connections 2023-10-24T00:44:40.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 --2- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870158c70 0x7f287015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 --2- 172.21.15.148:0/473009432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870069380 0x7f2870069800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 -- 172.21.15.148:0/473009432 >> 172.21.15.148:0/473009432 conn(0x7f2870064230 msgr2=0x7f28700c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 -- 172.21.15.148:0/473009432 shutdown_connections 2023-10-24T00:44:40.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.227+0000 7f2874947700 1 -- 172.21.15.148:0/473009432 wait complete. 2023-10-24T00:44:40.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.228+0000 7f2874947700 1 Processor -- start 2023-10-24T00:44:40.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.228+0000 7f2874947700 1 -- start start 2023-10-24T00:44:40.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870069380 0x7f28700bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870158c70 0x7f287014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700c1c30 con 0x7f2870150f60 2023-10-24T00:44:40.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700c0950 con 0x7f2870158c70 2023-10-24T00:44:40.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f2874947700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700c17a0 con 0x7f2870069380 2023-10-24T00:44:40.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57516/0 (socket says 172.21.15.148:57516) 2023-10-24T00:44:40.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 -- 172.21.15.148:0/1479992377 learned_addr learned my addr 172.21.15.148:0/1479992377 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286e59c700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870069380 0x7f28700bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286ed9d700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870158c70 0x7f287014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870069380 msgr2=0x7f28700bfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870069380 0x7f28700bfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870158c70 msgr2=0x7f287014ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870158c70 0x7f287014ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 -- 172.21.15.148:0/1479992377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600092a0 con 0x7f2870150f60 2023-10-24T00:44:40.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f286dd9b700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f2870068e90 tx=0x7f2860017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.229+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000f7e0 con 0x7f2870150f60 2023-10-24T00:44:40.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.230+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000f960 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.230+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286001b660 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.230+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700c0b90 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.230+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700c1150 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.231+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287006c6b0 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.231+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f286001b9d0 con 0x7f2870150f60 2023-10-24T00:44:40.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.231+0000 7f285e7fc700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 0x7f28500617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.232+0000 7f286e59c700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 msgr2=0x7f28500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:40.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.232+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f286007bf10 con 0x7f2870150f60 2023-10-24T00:44:40.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.232+0000 7f286e59c700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 0x7f28500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:40.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.236+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f286004cee0 con 0x7f2870150f60 2023-10-24T00:44:40.421 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.419+0000 7f60848d5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:40.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.433+0000 7f286e59c700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 msgr2=0x7f28500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:40.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.433+0000 7f286e59c700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 0x7f28500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:40.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.446+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28700c2290 con 0x7f2870150f60 2023-10-24T00:44:40.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.447+0000 7f285e7fc700 1 -- 172.21.15.148:0/1479992377 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f2860050500 con 0x7f2870150f60 2023-10-24T00:44:40.449 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:40.450 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:40.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 msgr2=0x7f28500617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:40.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 0x7f28500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 msgr2=0x7f28700c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f2870068e90 tx=0x7f2860017000).stop 2023-10-24T00:44:40.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 shutdown_connections 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2870158c70 0x7f287014ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2870069380 0x7f28700bfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285005f300 0x7f28500617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 --2- 172.21.15.148:0/1479992377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2870150f60 0x7f28700c0460 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 >> 172.21.15.148:0/1479992377 conn(0x7f2870064230 msgr2=0x7f2870062f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 shutdown_connections 2023-10-24T00:44:40.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.449+0000 7f2874947700 1 -- 172.21.15.148:0/1479992377 wait complete. 2023-10-24T00:44:40.454 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:40.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:40.489 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.488+0000 7f60848d5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:40.564 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.562+0000 7f60848d5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:40.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.582+0000 7f49fa168700 1 Processor -- start 2023-10-24T00:44:40.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.582+0000 7f49fa168700 1 -- start start 2023-10-24T00:44:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49fa168700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49f4068c60 0x7f49f4069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49fa168700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f40634a0 0x7f49f4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49fa168700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40697f0 con 0x7f49f4063020 2023-10-24T00:44:40.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49fa168700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f406a000 con 0x7f49f4068c60 2023-10-24T00:44:40.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49fa168700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4069a40 con 0x7f49f40634a0 2023-10-24T00:44:40.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9166700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49f4068c60 0x7f49f4069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9166700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f49f4068c60 0x7f49f4069040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57532/0 (socket says 172.21.15.148:57532) 2023-10-24T00:44:40.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9166700 1 -- 172.21.15.148:0/384315650 learned_addr learned my addr 172.21.15.148:0/384315650 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9967700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f40634a0 0x7f49f4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9166700 1 -- 172.21.15.148:0/384315650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f40634a0 msgr2=0x7f49f4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.583+0000 7f49f9166700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f40634a0 0x7f49f4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49f9166700 1 -- 172.21.15.148:0/384315650 >> v1:172.21.15.150:6789/0 conn(0x7f49f4063020 legacy=0x7f49f40aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49f9166700 1 -- 172.21.15.148:0/384315650 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4069d20 con 0x7f49f4068c60 2023-10-24T00:44:40.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49f9166700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f4068c60 0x7f49f4069040 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f49e4006fd0 tx=0x7f49e40090f0).ready entity=mon.0 client_cookie=e4406df7f2e96df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49ebfff700 1 -- 172.21.15.148:0/384315650 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400b580 con 0x7f49f4068c60 2023-10-24T00:44:40.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49ebfff700 1 -- 172.21.15.148:0/384315650 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400b6e0 con 0x7f49f4068c60 2023-10-24T00:44:40.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49ebfff700 1 -- 172.21.15.148:0/384315650 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400ba60 con 0x7f49f4068c60 2023-10-24T00:44:40.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 -- 172.21.15.148:0/384315650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f4068c60 msgr2=0x7f49f4069040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f4068c60 0x7f49f4069040 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f49e4006fd0 tx=0x7f49e40090f0).stop 2023-10-24T00:44:40.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 -- 172.21.15.148:0/384315650 shutdown_connections 2023-10-24T00:44:40.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f40634a0 0x7f49f4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 --2- 172.21.15.148:0/384315650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f4068c60 0x7f49f4069040 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 -- 172.21.15.148:0/384315650 >> 172.21.15.148:0/384315650 conn(0x7f49f40c72d0 msgr2=0x7f49f40c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 -- 172.21.15.148:0/384315650 shutdown_connections 2023-10-24T00:44:40.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.584+0000 7f49fa168700 1 -- 172.21.15.148:0/384315650 wait complete. 2023-10-24T00:44:40.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.586+0000 7f49fa168700 1 Processor -- start 2023-10-24T00:44:40.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.586+0000 7f49fa168700 1 -- start start 2023-10-24T00:44:40.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 0x7f49f413d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f4068c60 0x7f49f413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f413e690 con 0x7f49f40634a0 2023-10-24T00:44:40.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4147870 con 0x7f49f4063020 2023-10-24T00:44:40.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4147b50 con 0x7f49f4068c60 2023-10-24T00:44:40.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57534/0 (socket says 172.21.15.148:57534) 2023-10-24T00:44:40.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f9166700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 0x7f49f413d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 -- 172.21.15.148:0/1690581381 learned_addr learned my addr 172.21.15.148:0/1690581381 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f9967700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f4068c60 0x7f49f413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f4068c60 msgr2=0x7f49f413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f4068c60 0x7f49f413c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 msgr2=0x7f49f413d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 0x7f49f413d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 -- 172.21.15.148:0/1690581381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009370 con 0x7f49f40634a0 2023-10-24T00:44:40.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f9166700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 0x7f49f413d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:40.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49f8965700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f49f000c440 tx=0x7f49f0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0012400 con 0x7f49f40634a0 2023-10-24T00:44:40.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f0012580 con 0x7f49f40634a0 2023-10-24T00:44:40.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0012940 con 0x7f49f40634a0 2023-10-24T00:44:40.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f413e8e0 con 0x7f49f40634a0 2023-10-24T00:44:40.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.587+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4147580 con 0x7f49f40634a0 2023-10-24T00:44:40.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.588+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f4047480 con 0x7f49f40634a0 2023-10-24T00:44:40.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.589+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f49f001b3b0 con 0x7f49f40634a0 2023-10-24T00:44:40.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.589+0000 7f49e97fa700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 0x7f49d80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.589+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f49f00797a0 con 0x7f49f40634a0 2023-10-24T00:44:40.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.589+0000 7f49f9166700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 msgr2=0x7f49d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:40.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.589+0000 7f49f9166700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 0x7f49d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:40.601 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:40.590+0000 7f2d20bba680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:44:40.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.593+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f49f0048af0 con 0x7f49f40634a0 2023-10-24T00:44:40.665 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:40.663+0000 7f2d20bba680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:44:40.711 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.710+0000 7f60848d5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:40.744 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:40.741+0000 7f2d20bba680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:44:40.781 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.780+0000 7f60848d5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.790+0000 7f49f9166700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 msgr2=0x7f49d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:40.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.790+0000 7f49f9166700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 0x7f49d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:44:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.807+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49f40c1e10 con 0x7f49f40634a0 2023-10-24T00:44:40.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.808+0000 7f49e97fa700 1 -- 172.21.15.148:0/1690581381 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f49f0017070 con 0x7f49f40634a0 2023-10-24T00:44:40.810 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:40.811 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:19.343320+0000","modified":"2023-10-24T00:44:21.353927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1132167935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1132167935},{"type":"v1","addr":"172.21.15.148:6835","nonce":1132167935}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-24T00:44:40.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 msgr2=0x7f49d80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:40.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 0x7f49d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 msgr2=0x7f49f4147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f49f000c440 tx=0x7f49f0007dc0).stop 2023-10-24T00:44:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 shutdown_connections 2023-10-24T00:44:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49f4068c60 0x7f49f413c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49f4063020 0x7f49f413d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f49d805f300 0x7f49d80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 --2- 172.21.15.148:0/1690581381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49f40634a0 0x7f49f4147090 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 >> 172.21.15.148:0/1690581381 conn(0x7f49f40c72d0 msgr2=0x7f49f40ab420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 shutdown_connections 2023-10-24T00:44:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.810+0000 7f49fa168700 1 -- 172.21.15.148:0/1690581381 wait complete. 2023-10-24T00:44:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2023-10-24T00:44:40.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:40.898 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:40.897+0000 7f60848d5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:40.900 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:40.898+0000 7f2d20bba680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:44:40.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.939+0000 7f44ae96c700 1 Processor -- start 2023-10-24T00:44:40.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.939+0000 7f44ae96c700 1 -- start start 2023-10-24T00:44:40.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44ae96c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a8152020 0x7f44a80bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44ae96c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44a80c45c0 0x7f44a8063660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44ae96c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a8065fc0 con 0x7f44a8152400 2023-10-24T00:44:40.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44ae96c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a8066b60 con 0x7f44a80c45c0 2023-10-24T00:44:40.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44ae96c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80be300 con 0x7f44a8152020 2023-10-24T00:44:40.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44acf09700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44a80c45c0 0x7f44a8063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44acf09700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44a80c45c0 0x7f44a8063660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57540/0 (socket says 172.21.15.148:57540) 2023-10-24T00:44:40.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.940+0000 7f44acf09700 1 -- 172.21.15.148:0/796423541 learned_addr learned my addr 172.21.15.148:0/796423541 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44a7fff700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a8152020 0x7f44a80bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44a6ffd700 1 -- 172.21.15.148:0/796423541 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593126447 0 0) 0x7f44a8065fc0 con 0x7f44a8152400 2023-10-24T00:44:40.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44acf09700 1 -- 172.21.15.148:0/796423541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a8152020 msgr2=0x7f44a80bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:40.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44acf09700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a8152020 0x7f44a80bc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44acf09700 1 -- 172.21.15.148:0/796423541 >> v1:172.21.15.150:6789/0 conn(0x7f44a8152400 legacy=0x7f44a8066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44acf09700 1 -- 172.21.15.148:0/796423541 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80bca00 con 0x7f44a80c45c0 2023-10-24T00:44:40.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44acf09700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a80c45c0 0x7f44a8063660 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f44a0009f20 tx=0x7f44a0009840).ready entity=mon.0 client_cookie=82949a52c9ef24d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44a6ffd700 1 -- 172.21.15.148:0/796423541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000e070 con 0x7f44a80c45c0 2023-10-24T00:44:40.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44a6ffd700 1 -- 172.21.15.148:0/796423541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000b9d0 con 0x7f44a80c45c0 2023-10-24T00:44:40.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.941+0000 7f44a6ffd700 1 -- 172.21.15.148:0/796423541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000bd50 con 0x7f44a80c45c0 2023-10-24T00:44:40.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 -- 172.21.15.148:0/796423541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a80c45c0 msgr2=0x7f44a8063660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a80c45c0 0x7f44a8063660 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f44a0009f20 tx=0x7f44a0009840).stop 2023-10-24T00:44:40.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 -- 172.21.15.148:0/796423541 shutdown_connections 2023-10-24T00:44:40.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a8152020 0x7f44a80bc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 --2- 172.21.15.148:0/796423541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a80c45c0 0x7f44a8063660 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 -- 172.21.15.148:0/796423541 >> 172.21.15.148:0/796423541 conn(0x7f44a80c7ee0 msgr2=0x7f44a80c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:40.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 -- 172.21.15.148:0/796423541 shutdown_connections 2023-10-24T00:44:40.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.942+0000 7f44ae96c700 1 -- 172.21.15.148:0/796423541 wait complete. 2023-10-24T00:44:40.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.943+0000 7f44ae96c700 1 Processor -- start 2023-10-24T00:44:40.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.943+0000 7f44ae96c700 1 -- start start 2023-10-24T00:44:40.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a80c45c0 0x7f44a8165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a8152020 0x7f44a80aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8157400 con 0x7f44a8152400 2023-10-24T00:44:40.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80aab50 con 0x7f44a8152020 2023-10-24T00:44:40.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44ae96c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80aa8f0 con 0x7f44a80c45c0 2023-10-24T00:44:40.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57556/0 (socket says 172.21.15.148:57556) 2023-10-24T00:44:40.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a80c45c0 0x7f44a8165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 -- 172.21.15.148:0/4195500914 learned_addr learned my addr 172.21.15.148:0/4195500914 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:40.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44a77fe700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a8152020 0x7f44a80aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:40.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 -- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a80c45c0 msgr2=0x7f44a8165cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a80c45c0 0x7f44a8165cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 -- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a8152020 msgr2=0x7f44a80aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:40.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a8152020 0x7f44a80aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:40.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 -- 172.21.15.148:0/4195500914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0009ae0 con 0x7f44a8152400 2023-10-24T00:44:40.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f44acf09700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f44a000b610 tx=0x7f44a0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:40.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.944+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000b640 con 0x7f44a8152400 2023-10-24T00:44:40.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.945+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00092e0 con 0x7f44a8152400 2023-10-24T00:44:40.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.945+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a8157630 con 0x7f44a8152400 2023-10-24T00:44:40.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.945+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a001e6a0 con 0x7f44a8152400 2023-10-24T00:44:40.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.945+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a8157bf0 con 0x7f44a8152400 2023-10-24T00:44:40.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.946+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a806c6b0 con 0x7f44a8152400 2023-10-24T00:44:40.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.946+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f44a0003040 con 0x7f44a8152400 2023-10-24T00:44:40.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.946+0000 7f448ffff700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 0x7f44940617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:40.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.946+0000 7f44a7fff700 1 -- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 msgr2=0x7f44940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:40.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.946+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f44a007bb40 con 0x7f44a8152400 2023-10-24T00:44:40.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.947+0000 7f44a7fff700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 0x7f44940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:40.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:40.951+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f44a004ca00 con 0x7f44a8152400 2023-10-24T00:44:40.975 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:40.973+0000 7f2d20bba680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:44:41.006 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.005+0000 7f60848d5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:41.093 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:41.091+0000 7f2d20bba680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:44:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.122+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44a805f600 con 0x7f44a8152400 2023-10-24T00:44:41.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.123+0000 7f448ffff700 1 -- 172.21.15.148:0/4195500914 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17350 (secure 0 0 0) 0x7f44a0023070 con 0x7f44a8152400 2023-10-24T00:44:41.126 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:41.126 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":82,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:35.081010+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:17.906193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:18.311635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/4011676657":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6833/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:6832/87479":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2148779355":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/242651982":"2023-10-25T00:44:35.080967+0000","172.21.15.150:0/2555703333":"2023-10-25T00:44:35.080967+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 msgr2=0x7f44940617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 0x7f44940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 msgr2=0x7f44a8150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:41.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f44a000b610 tx=0x7f44a0009840).stop 2023-10-24T00:44:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 shutdown_connections 2023-10-24T00:44:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f449405f300 0x7f44940617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44a8152400 0x7f44a8150de0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44a80c45c0 0x7f44a8165cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 --2- 172.21.15.148:0/4195500914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44a8152020 0x7f44a80aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 >> 172.21.15.148:0/4195500914 conn(0x7f44a80c7ee0 msgr2=0x7f44a80c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:41.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.125+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 shutdown_connections 2023-10-24T00:44:41.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.126+0000 7f44ae96c700 1 -- 172.21.15.148:0/4195500914 wait complete. 2023-10-24T00:44:41.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:44:41.209 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:41.207+0000 7f2d20bba680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:44:41.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.255+0000 7f68f014e700 1 Processor -- start 2023-10-24T00:44:41.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.255+0000 7f68f014e700 1 -- start start 2023-10-24T00:44:41.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68f014e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 0x7f68e80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68f014e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 0x7f68e80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68f014e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e81561a0 con 0x7f68e8064ca0 2023-10-24T00:44:41.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68f014e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e8066220 con 0x7f68e80ac970 2023-10-24T00:44:41.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68f014e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e806b8c0 con 0x7f68e806b380 2023-10-24T00:44:41.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68ee6eb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f68e8064ca0 0x7f68e8065110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56100/0 (socket says 172.21.15.148:56100) 2023-10-24T00:44:41.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68ee6eb700 1 -- 172.21.15.148:0/965297348 learned_addr learned my addr 172.21.15.148:0/965297348 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:41.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/965297348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 0x7f68e80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:41.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.256+0000 7f68edeea700 1 --2- 172.21.15.148:0/965297348 >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 0x7f68e80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:41.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ecee8700 1 -- 172.21.15.148:0/965297348 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142424663 0 0) 0x7f68e81561a0 con 0x7f68e8064ca0 2023-10-24T00:44:41.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ecee8700 1 -- 172.21.15.148:0/965297348 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d40033f0 con 0x7f68e8064ca0 2023-10-24T00:44:41.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ed6e9700 1 -- 172.21.15.148:0/965297348 >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 msgr2=0x7f68e80acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:41.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/965297348 >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 0x7f68e80acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ed6e9700 1 -- 172.21.15.148:0/965297348 >> v1:172.21.15.148:6789/0 conn(0x7f68e8064ca0 legacy=0x7f68e8065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:41.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ed6e9700 1 -- 172.21.15.148:0/965297348 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e81563f0 con 0x7f68e806b380 2023-10-24T00:44:41.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68edeea700 1 --2- 172.21.15.148:0/965297348 >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 0x7f68e80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:41.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/965297348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 0x7f68e80c3830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f68d8009760 tx=0x7f68d8009060).ready entity=mon.2 client_cookie=e2ea1349df8beaa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ecee8700 1 -- 172.21.15.148:0/965297348 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800d4a0 con 0x7f68e806b380 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ecee8700 1 -- 172.21.15.148:0/965297348 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800d600 con 0x7f68e806b380 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.257+0000 7f68ecee8700 1 -- 172.21.15.148:0/965297348 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800d980 con 0x7f68e806b380 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 -- 172.21.15.148:0/965297348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 msgr2=0x7f68e80c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 --2- 172.21.15.148:0/965297348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 0x7f68e80c3830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f68d8009760 tx=0x7f68d8009060).stop 2023-10-24T00:44:41.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 -- 172.21.15.148:0/965297348 shutdown_connections 2023-10-24T00:44:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 --2- 172.21.15.148:0/965297348 >> v2:172.21.15.150:3300/0 conn(0x7f68e80ac970 0x7f68e80acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 --2- 172.21.15.148:0/965297348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e806b380 0x7f68e80c3830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 -- 172.21.15.148:0/965297348 >> 172.21.15.148:0/965297348 conn(0x7f68e80c7f50 msgr2=0x7f68e80c3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 -- 172.21.15.148:0/965297348 shutdown_connections 2023-10-24T00:44:41.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.258+0000 7f68f014e700 1 -- 172.21.15.148:0/965297348 wait complete. 2023-10-24T00:44:41.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.259+0000 7f68f014e700 1 Processor -- start 2023-10-24T00:44:41.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.259+0000 7f68f014e700 1 -- start start 2023-10-24T00:44:41.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e8064ca0 0x7f68e814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e80ac970 0x7f68e80c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e8063270 con 0x7f68e806b380 2023-10-24T00:44:41.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e81560c0 con 0x7f68e80ac970 2023-10-24T00:44:41.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68f014e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e81554b0 con 0x7f68e8064ca0 2023-10-24T00:44:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57562/0 (socket says 172.21.15.148:57562) 2023-10-24T00:44:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 -- 172.21.15.148:0/2300119503 learned_addr learned my addr 172.21.15.148:0/2300119503 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68edeea700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e8064ca0 0x7f68e814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:41.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ee6eb700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e80ac970 0x7f68e80c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e8064ca0 msgr2=0x7f68e814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e8064ca0 0x7f68e814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e80ac970 msgr2=0x7f68e80c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e80ac970 0x7f68e80c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:41.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 -- 172.21.15.148:0/2300119503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40092a0 con 0x7f68e806b380 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.260+0000 7f68ed6e9700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f68d8009d50 tx=0x7f68d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.261+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800dd40 con 0x7f68e806b380 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.261+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800d770 con 0x7f68e806b380 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.261+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d80092a0 con 0x7f68e806b380 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.261+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800dea0 con 0x7f68e806b380 2023-10-24T00:44:41.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.261+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e8155a70 con 0x7f68e806b380 2023-10-24T00:44:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.262+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e8156200 con 0x7f68e806b380 2023-10-24T00:44:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.262+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f68d8018070 con 0x7f68e806b380 2023-10-24T00:44:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.263+0000 7f68ddffb700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.263+0000 7f68edeea700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 msgr2=0x7f68cc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:44:41.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.263+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f68d807bd50 con 0x7f68e806b380 2023-10-24T00:44:41.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.263+0000 7f68edeea700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:44:41.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.270+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f68e8156200 con 0x7f68e806b380 2023-10-24T00:44:41.298 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.297+0000 7f60848d5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:41.369 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.367+0000 7f60848d5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.387+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 29) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f68d8079820 con 0x7f68e806b380 2023-10-24T00:44:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.387+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 msgr2=0x7f68cc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:44:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.387+0000 7f68ddffb700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:41.434 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f5fff068700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f5fff068700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f5fff068700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f5fff068700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f5fff068700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f600186d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f600186d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f600186d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f600186d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:44:41.433+0000 7f600186d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:44:41.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:41.491+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68e8156200 con 0x7f68e806b380 2023-10-24T00:44:41.519 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:41.517+0000 7f2d20bba680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:44:41.591 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:44:41.589+0000 7f2d20bba680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:44:42.387 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:44:42.384+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:44:42.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.390+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f68d8079ba0 con 0x7f68e806b380 2023-10-24T00:44:42.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.390+0000 7f68ddffb700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.391+0000 7f68edeea700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.392+0000 7f68edeea700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc061740 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f68e4009650 tx=0x7f68e4009060).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:42.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.395+0000 7f68ddffb700 1 -- 172.21.15.148:0/2300119503 <== mon.0 v2:172.21.15.148:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68d804dd30 con 0x7f68e806b380 2023-10-24T00:44:42.399 INFO:tasks.ceph.mds.c.smithi148.stderr: -2369> 2023-10-24T00:44:25.267+0000 7fee59b10700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:44:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 msgr2=0x7f68cc061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc061740 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f68e4009650 tx=0x7f68e4009060).stop 2023-10-24T00:44:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 msgr2=0x7f68e81536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f68d8009d50 tx=0x7f68d8016000).stop 2023-10-24T00:44:42.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 shutdown_connections 2023-10-24T00:44:42.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68e80ac970 0x7f68e80c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68e8064ca0 0x7f68e814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68cc05f300 0x7f68cc061740 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 --2- 172.21.15.148:0/2300119503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68e806b380 0x7f68e81536a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 >> 172.21.15.148:0/2300119503 conn(0x7f68e80c7f50 msgr2=0x7f68e81502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:42.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 shutdown_connections 2023-10-24T00:44:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.398+0000 7f68f014e700 1 -- 172.21.15.148:0/2300119503 wait complete. 2023-10-24T00:44:42.403 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:44:42.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:44:42.422 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:44:42.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.528+0000 7f3d6b718700 1 Processor -- start 2023-10-24T00:44:42.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.528+0000 7f3d6b718700 1 -- start start 2023-10-24T00:44:42.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d6b718700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 0x7f3d64154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d6b718700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d640c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d6b718700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d640c71d0 con 0x7f3d64098bd0 2023-10-24T00:44:42.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d6b718700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d640c6a10 con 0x7f3d64154430 2023-10-24T00:44:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d6b718700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640c9410 con 0x7f3d640bffd0 2023-10-24T00:44:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d68cb3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3d64098bd0 0x7f3d640c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:56122/0 (socket says 172.21.15.148:56122) 2023-10-24T00:44:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d68cb3700 1 -- 172.21.15.148:0/925816824 learned_addr learned my addr 172.21.15.148:0/925816824 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d694b4700 1 --2- 172.21.15.148:0/925816824 >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 0x7f3d64154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d69cb5700 1 --2- 172.21.15.148:0/925816824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d640c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.529+0000 7f3d5bfff700 1 -- 172.21.15.148:0/925816824 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651364894 0 0) 0x7f3d640c71d0 con 0x7f3d64098bd0 2023-10-24T00:44:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d5bfff700 1 -- 172.21.15.148:0/925816824 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d500033f0 con 0x7f3d64098bd0 2023-10-24T00:44:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d69cb5700 1 -- 172.21.15.148:0/925816824 >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 msgr2=0x7f3d64154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:42.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d69cb5700 1 --2- 172.21.15.148:0/925816824 >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 0x7f3d64154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d69cb5700 1 -- 172.21.15.148:0/925816824 >> v1:172.21.15.148:6789/0 conn(0x7f3d64098bd0 legacy=0x7f3d640c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d69cb5700 1 -- 172.21.15.148:0/925816824 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d640c0950 con 0x7f3d640bffd0 2023-10-24T00:44:42.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d694b4700 1 --2- 172.21.15.148:0/925816824 >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 0x7f3d64154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:42.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d69cb5700 1 --2- 172.21.15.148:0/925816824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d640c0460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3d5c009e60 tx=0x7f3d5c009780).ready entity=mon.2 client_cookie=e03536950a53be30 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:42.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d5bfff700 1 -- 172.21.15.148:0/925816824 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00e070 con 0x7f3d640bffd0 2023-10-24T00:44:42.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d5bfff700 1 -- 172.21.15.148:0/925816824 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c00bab0 con 0x7f3d640bffd0 2023-10-24T00:44:42.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d5bfff700 1 -- 172.21.15.148:0/925816824 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00be30 con 0x7f3d640bffd0 2023-10-24T00:44:42.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 -- 172.21.15.148:0/925816824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 msgr2=0x7f3d640c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 --2- 172.21.15.148:0/925816824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d640c0460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3d5c009e60 tx=0x7f3d5c009780).stop 2023-10-24T00:44:42.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 -- 172.21.15.148:0/925816824 shutdown_connections 2023-10-24T00:44:42.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 --2- 172.21.15.148:0/925816824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d640c0460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 --2- 172.21.15.148:0/925816824 >> v2:172.21.15.150:3300/0 conn(0x7f3d64154430 0x7f3d64154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.530+0000 7f3d6b718700 1 -- 172.21.15.148:0/925816824 >> 172.21.15.148:0/925816824 conn(0x7f3d640cb070 msgr2=0x7f3d640cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:42.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.531+0000 7f3d6b718700 1 -- 172.21.15.148:0/925816824 shutdown_connections 2023-10-24T00:44:42.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.531+0000 7f3d6b718700 1 -- 172.21.15.148:0/925816824 wait complete. 2023-10-24T00:44:42.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.532+0000 7f3d6b718700 1 Processor -- start 2023-10-24T00:44:42.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.532+0000 7f3d6b718700 1 -- start start 2023-10-24T00:44:42.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d641508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d64154430 0x7f3d64150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640b0730 con 0x7f3d64098bd0 2023-10-24T00:44:42.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640b0b50 con 0x7f3d64154430 2023-10-24T00:44:42.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641512a0 con 0x7f3d640bffd0 2023-10-24T00:44:42.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57600/0 (socket says 172.21.15.148:57600) 2023-10-24T00:44:42.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 -- 172.21.15.148:0/173713661 learned_addr learned my addr 172.21.15.148:0/173713661 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:42.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d69cb5700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d64154430 0x7f3d64150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d68cb3700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d641508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 -- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 msgr2=0x7f3d641508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d641508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 -- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d64154430 msgr2=0x7f3d64150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:42.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d64154430 0x7f3d64150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:42.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 -- 172.21.15.148:0/173713661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600092a0 con 0x7f3d64098bd0 2023-10-24T00:44:42.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d694b4700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f3d6000ea50 tx=0x7f3d60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:42.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000ee90 con 0x7f3d64098bd0 2023-10-24T00:44:42.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6000c850 con 0x7f3d64098bd0 2023-10-24T00:44:42.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c009a20 con 0x7f3d64098bd0 2023-10-24T00:44:42.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000cbd0 con 0x7f3d64098bd0 2023-10-24T00:44:42.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.533+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d640afd90 con 0x7f3d64098bd0 2023-10-24T00:44:42.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.534+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d640b09a0 con 0x7f3d64098bd0 2023-10-24T00:44:42.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.535+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3d6001b400 con 0x7f3d64098bd0 2023-10-24T00:44:42.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.535+0000 7f3d597fa700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 0x7f3d480614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:42.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.535+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f3d6007a6c0 con 0x7f3d64098bd0 2023-10-24T00:44:42.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.535+0000 7f3d68cb3700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 0x7f3d480614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:42.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.535+0000 7f3d68cb3700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 0x7f3d480614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3d54007fd0 tx=0x7f3d54009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:42.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.539+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3d6004b980 con 0x7f3d64098bd0 2023-10-24T00:44:42.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:42.747+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3d64062780 con 0x7f3d64098bd0 2023-10-24T00:44:43.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.398+0000 7f3d597fa700 1 -- 172.21.15.148:0/173713661 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3d6004efa0 con 0x7f3d64098bd0 2023-10-24T00:44:43.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 msgr2=0x7f3d480614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 0x7f3d480614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3d54007fd0 tx=0x7f3d54009040).stop 2023-10-24T00:44:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 msgr2=0x7f3d640af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f3d6000ea50 tx=0x7f3d60009060).stop 2023-10-24T00:44:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 shutdown_connections 2023-10-24T00:44:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d64154430 0x7f3d64150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3d4805f030 0x7f3d480614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d64098bd0 0x7f3d640af180 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 --2- 172.21.15.148:0/173713661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d640bffd0 0x7f3d641508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 >> 172.21.15.148:0/173713661 conn(0x7f3d640cb070 msgr2=0x7f3d6414ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 shutdown_connections 2023-10-24T00:44:43.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.401+0000 7f3d6b718700 1 -- 172.21.15.148:0/173713661 wait complete. 2023-10-24T00:44:43.416 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:44:43.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.571+0000 7f1faa654700 1 Processor -- start 2023-10-24T00:44:43.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.571+0000 7f1faa654700 1 -- start start 2023-10-24T00:44:43.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1faa654700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1fa4135550 0x7f1fa4066540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1faa654700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fa4066a30 0x7f1fa4152890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1faa654700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa4155e60 con 0x7f1fa4135170 2023-10-24T00:44:43.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1faa654700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa41569e0 con 0x7f1fa4135550 2023-10-24T00:44:43.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1faa654700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4066e60 con 0x7f1fa4066a30 2023-10-24T00:44:43.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1fa3fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1fa4135170 0x7f1fa40c3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48152/0 (socket says 172.21.15.148:48152) 2023-10-24T00:44:43.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1fa3fff700 1 -- 172.21.15.148:0/2933219742 learned_addr learned my addr 172.21.15.148:0/2933219742 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:43.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/2933219742 >> v2:172.21.15.150:3300/0 conn(0x7f1fa4135550 0x7f1fa4066540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.572+0000 7f1fa8bf1700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fa4066a30 0x7f1fa4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998929912 0 0) 0x7f1fa4155e60 con 0x7f1fa4135170 2023-10-24T00:44:43.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c0033f0 con 0x7f1fa4135170 2023-10-24T00:44:43.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438706414 0 0) 0x7f1f8c0033f0 con 0x7f1fa4135170 2023-10-24T00:44:43.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fa4066a30 msgr2=0x7f1fa4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:43.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fa4066a30 0x7f1fa4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 >> v2:172.21.15.150:3300/0 conn(0x7f1fa4135550 msgr2=0x7f1fa4066540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:43.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 --2- 172.21.15.148:0/2933219742 >> v2:172.21.15.150:3300/0 conn(0x7f1fa4135550 0x7f1fa4066540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa41560b0 con 0x7f1fa4135170 2023-10-24T00:44:43.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f1f94001470 con 0x7f1fa4135170 2023-10-24T00:44:43.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 >> v1:172.21.15.148:6789/0 conn(0x7f1fa4135170 legacy=0x7f1fa40c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f8c0038e0 0x7f1f8c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f8c004690 0x7f1f8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c005000 0x7f1f8c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41569e0 con 0x7f1f8c0038e0 2023-10-24T00:44:43.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4066e60 con 0x7f1f8c004690 2023-10-24T00:44:43.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c00bdd0 con 0x7f1f8c005000 2023-10-24T00:44:43.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa8bf1700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fa4066a30 0x7f1fa4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:43.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/2933219742 >> v2:172.21.15.150:3300/0 conn(0x7f1fa4135550 0x7f1fa4066540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:43.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f8c0038e0 0x7f1f8c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f8c004690 0x7f1f8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa8bf1700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c005000 0x7f1f8c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 -- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c005000 msgr2=0x7f1f8c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:43.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c005000 0x7f1f8c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 -- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f8c004690 msgr2=0x7f1f8c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:43.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f8c004690 0x7f1f8c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 -- 172.21.15.148:0/2933219742 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0033f0 con 0x7f1f8c0038e0 2023-10-24T00:44:43.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f8c004690 0x7f1f8c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:43.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f8c0038e0 0x7f1f8c003d00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f1f9400c240 tx=0x7f1f94001e90).ready entity=mon.0 client_cookie=8824d854355bdb79 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:43.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.573+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94007a60 con 0x7f1f8c0038e0 2023-10-24T00:44:43.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9400cad0 con 0x7f1f8c0038e0 2023-10-24T00:44:43.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1fa2ffd700 1 -- 172.21.15.148:0/2933219742 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400ce70 con 0x7f1f8c0038e0 2023-10-24T00:44:43.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 -- 172.21.15.148:0/2933219742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f8c0038e0 msgr2=0x7f1f8c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 --2- 172.21.15.148:0/2933219742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f8c0038e0 0x7f1f8c003d00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f1f9400c240 tx=0x7f1f94001e90).stop 2023-10-24T00:44:43.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1fa8bf1700 1 -- 172.21.15.148:0/2933219742 reap_dead start 2023-10-24T00:44:43.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 -- 172.21.15.148:0/2933219742 shutdown_connections 2023-10-24T00:44:43.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 -- 172.21.15.148:0/2933219742 >> 172.21.15.148:0/2933219742 conn(0x7f1fa4063120 msgr2=0x7f1fa40c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:43.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 -- 172.21.15.148:0/2933219742 shutdown_connections 2023-10-24T00:44:43.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.574+0000 7f1faa654700 1 -- 172.21.15.148:0/2933219742 wait complete. 2023-10-24T00:44:43.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.575+0000 7f1faa654700 1 Processor -- start 2023-10-24T00:44:43.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.575+0000 7f1faa654700 1 -- start start 2023-10-24T00:44:43.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c0038e0 0x7f1fa4152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fa4162ff0 0x7f1fa40c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4162b60 con 0x7f1fa4155600 2023-10-24T00:44:43.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4153530 con 0x7f1fa4162ff0 2023-10-24T00:44:43.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1faa654700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4153810 con 0x7f1f8c0038e0 2023-10-24T00:44:43.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54532/0 (socket says 172.21.15.148:54532) 2023-10-24T00:44:43.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 -- 172.21.15.148:0/3259135505 learned_addr learned my addr 172.21.15.148:0/3259135505 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:43.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c0038e0 0x7f1fa4152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa8bf1700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fa4162ff0 0x7f1fa40c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 -- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c0038e0 msgr2=0x7f1fa4152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c0038e0 0x7f1fa4152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 -- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fa4162ff0 msgr2=0x7f1fa40c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fa4162ff0 0x7f1fa40c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:43.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.576+0000 7f1fa37fe700 1 -- 172.21.15.148:0/3259135505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4153af0 con 0x7f1fa4155600 2023-10-24T00:44:43.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1fa37fe700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f1f98011960 tx=0x7f1f98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:43.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800f800 con 0x7f1fa4155600 2023-10-24T00:44:43.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800f960 con 0x7f1fa4155600 2023-10-24T00:44:43.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa4162780 con 0x7f1fa4155600 2023-10-24T00:44:43.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800fce0 con 0x7f1fa4155600 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.577+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa4134cd0 con 0x7f1fa4155600 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.578+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa406c6b0 con 0x7f1fa4155600 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.578+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f1f98015690 con 0x7f1fa4155600 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.578+0000 7f1f8bfff700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 0x7f1f900614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.578+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f1f9807abf0 con 0x7f1fa4155600 2023-10-24T00:44:43.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.579+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 0x7f1f900614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:43.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.579+0000 7f1fa3fff700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 0x7f1f900614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1f94001ed0 tx=0x7f1f94015000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:43.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.582+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1f9804be60 con 0x7f1fa4155600 2023-10-24T00:44:43.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:43.748+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fa4156390 con 0x7f1fa4155600 2023-10-24T00:44:44.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.157+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1f98078960 con 0x7f1fa4155600 2023-10-24T00:44:44.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.403+0000 7f1f8bfff700 1 -- 172.21.15.148:0/3259135505 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1f9806f560 con 0x7f1fa4155600 2023-10-24T00:44:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.405+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 msgr2=0x7f1f900614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.405+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 0x7f1f900614f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1f94001ed0 tx=0x7f1f94015000).stop 2023-10-24T00:44:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.405+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 msgr2=0x7f1fa41347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.405+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f1f98011960 tx=0x7f1f98008040).stop 2023-10-24T00:44:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 shutdown_connections 2023-10-24T00:44:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fa4162ff0 0x7f1fa40c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f8c0038e0 0x7f1fa4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1f9005f030 0x7f1f900614f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 --2- 172.21.15.148:0/3259135505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa4155600 0x7f1fa41347e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 >> 172.21.15.148:0/3259135505 conn(0x7f1fa4063120 msgr2=0x7f1fa414b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 shutdown_connections 2023-10-24T00:44:44.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.406+0000 7f1faa654700 1 -- 172.21.15.148:0/3259135505 wait complete. 2023-10-24T00:44:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:44:44.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:44:44.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.538+0000 7f95b9290700 1 Processor -- start 2023-10-24T00:44:44.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.538+0000 7f95b9290700 1 -- start start 2023-10-24T00:44:44.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b9290700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95b40aa640 0x7f95b40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b9290700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40c6270 con 0x7f95b41544b0 2023-10-24T00:44:44.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b9290700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40c0c80 con 0x7f95b40a7d00 2023-10-24T00:44:44.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b9290700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40c60e0 con 0x7f95b40aa640 2023-10-24T00:44:44.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b2ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f95b41544b0 0x7f95b40c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48154/0 (socket says 172.21.15.148:48154) 2023-10-24T00:44:44.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b2ffd700 1 -- 172.21.15.148:0/2134392771 learned_addr learned my addr 172.21.15.148:0/2134392771 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:44.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b37fe700 1 --2- 172.21.15.148:0/2134392771 >> v2:172.21.15.150:3300/0 conn(0x7f95b40aa640 0x7f95b40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403897999 0 0) 0x7f95b40c6270 con 0x7f95b41544b0 2023-10-24T00:44:44.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.539+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a00033f0 con 0x7f95b41544b0 2023-10-24T00:44:44.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636942466 0 0) 0x7f95b40c0c80 con 0x7f95b40a7d00 2023-10-24T00:44:44.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b40c6270 con 0x7f95b40a7d00 2023-10-24T00:44:44.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357652367 0 0) 0x7f95a00033f0 con 0x7f95b41544b0 2023-10-24T00:44:44.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 >> v2:172.21.15.150:3300/0 conn(0x7f95b40aa640 msgr2=0x7f95b40c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:44.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 --2- 172.21.15.148:0/2134392771 >> v2:172.21.15.150:3300/0 conn(0x7f95b40aa640 0x7f95b40c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 >> v1:172.21.15.150:6789/0 conn(0x7f95b40a7d00 legacy=0x7f95b40a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40c0f40 con 0x7f95b41544b0 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f95ac0017f0 con 0x7f95b41544b0 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 >> v1:172.21.15.148:6789/0 conn(0x7f95b41544b0 legacy=0x7f95b40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 0x7f95a0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0004690 0x7f95a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a0005000 0x7f95a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c60e0 con 0x7f95a0003ac0 2023-10-24T00:44:44.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a000beb0 con 0x7f95a0005000 2023-10-24T00:44:44.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a000c070 con 0x7f95a0004690 2023-10-24T00:44:44.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b37fe700 1 --2- 172.21.15.148:0/2134392771 >> v2:172.21.15.150:3300/0 conn(0x7f95b40aa640 0x7f95b40c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:44.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 0x7f95a0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b27fc700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0004690 0x7f95a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b37fe700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a0005000 0x7f95a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 -- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0004690 msgr2=0x7f95a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0004690 0x7f95a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 -- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a0005000 msgr2=0x7f95a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95a0005000 0x7f95a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b37fe700 1 -- 172.21.15.148:0/2134392771 reap_dead start 2023-10-24T00:44:44.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 -- 172.21.15.148:0/2134392771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00033f0 con 0x7f95a0003ac0 2023-10-24T00:44:44.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 0x7f95a0003ec0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f95ac00c440 tx=0x7f95b4085380).ready entity=mon.0 client_cookie=56932e9dd767b313 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:44.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00cd10 con 0x7f95a0003ac0 2023-10-24T00:44:44.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00ce70 con 0x7f95a0003ac0 2023-10-24T00:44:44.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.540+0000 7f95b1ffb700 1 -- 172.21.15.148:0/2134392771 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac005d30 con 0x7f95a0003ac0 2023-10-24T00:44:44.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 -- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 msgr2=0x7f95a0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 0x7f95a0003ec0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f95ac00c440 tx=0x7f95b4085380).stop 2023-10-24T00:44:44.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 -- 172.21.15.148:0/2134392771 shutdown_connections 2023-10-24T00:44:44.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 --2- 172.21.15.148:0/2134392771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95a0003ac0 0x7f95a0003ec0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 -- 172.21.15.148:0/2134392771 >> 172.21.15.148:0/2134392771 conn(0x7f95b40945d0 msgr2=0x7f95b406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:44.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 -- 172.21.15.148:0/2134392771 shutdown_connections 2023-10-24T00:44:44.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.541+0000 7f95b9290700 1 -- 172.21.15.148:0/2134392771 wait complete. 2023-10-24T00:44:44.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.542+0000 7f95b9290700 1 Processor -- start 2023-10-24T00:44:44.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.542+0000 7f95b9290700 1 -- start start 2023-10-24T00:44:44.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0003ac0 0x7f95b40aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95b4168950 0x7f95b413c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c3040 con 0x7f95b40ab010 2023-10-24T00:44:44.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c3600 con 0x7f95b4168950 2023-10-24T00:44:44.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b9290700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4168d90 con 0x7f95a0003ac0 2023-10-24T00:44:44.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54554/0 (socket says 172.21.15.148:54554) 2023-10-24T00:44:44.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 -- 172.21.15.148:0/237396222 learned_addr learned my addr 172.21.15.148:0/237396222 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:44.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0003ac0 0x7f95b40aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b37fe700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95b4168950 0x7f95b413c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 -- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0003ac0 msgr2=0x7f95b40aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0003ac0 0x7f95b40aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 -- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95b4168950 msgr2=0x7f95b413c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:44.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95b4168950 0x7f95b413c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:44.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 -- 172.21.15.148:0/237396222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40ad6a0 con 0x7f95b40ab010 2023-10-24T00:44:44.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.543+0000 7f95b27fc700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f959c00e840 tx=0x7f959c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:44.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.544+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0015c0 con 0x7f95b40ab010 2023-10-24T00:44:44.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.544+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c001720 con 0x7f95b40ab010 2023-10-24T00:44:44.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.544+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c001aa0 con 0x7f95b40ab010 2023-10-24T00:44:44.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.544+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40ad980 con 0x7f95b40ab010 2023-10-24T00:44:44.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.544+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b40ad2c0 con 0x7f95b40ab010 2023-10-24T00:44:44.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.545+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b406c6b0 con 0x7f95b40ab010 2023-10-24T00:44:44.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.545+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f959c014430 con 0x7f95b40ab010 2023-10-24T00:44:44.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.545+0000 7f95aaffd700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 0x7f9594061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:44.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.545+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f959c07a320 con 0x7f95b40ab010 2023-10-24T00:44:44.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.545+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 0x7f9594061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:44.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.546+0000 7f95b2ffd700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 0x7f9594061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f95b40ae280 tx=0x7f95ac013000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:44.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.549+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f959c049af0 con 0x7f95b40ab010 2023-10-24T00:44:44.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:44.718+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95b40c1220 con 0x7f95b40ab010 2023-10-24T00:44:45.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.406+0000 7f95aaffd700 1 -- 172.21.15.148:0/237396222 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f959c04b390 con 0x7f95b40ab010 2023-10-24T00:44:45.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 msgr2=0x7f9594061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 0x7f9594061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f95b40ae280 tx=0x7f95ac013000).stop 2023-10-24T00:44:45.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 msgr2=0x7f95b4168460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f959c00e840 tx=0x7f959c009040).stop 2023-10-24T00:44:45.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 shutdown_connections 2023-10-24T00:44:45.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95b4168950 0x7f95b413c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95a0003ac0 0x7f95b40aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f959405f270 0x7f9594061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 --2- 172.21.15.148:0/237396222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95b40ab010 0x7f95b4168460 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 >> 172.21.15.148:0/237396222 conn(0x7f95b40945d0 msgr2=0x7f95b40c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:45.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 shutdown_connections 2023-10-24T00:44:45.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.409+0000 7f95b9290700 1 -- 172.21.15.148:0/237396222 wait complete. 2023-10-24T00:44:45.415 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:44:45.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:44:45.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.537+0000 7f49aedf7700 1 Processor -- start 2023-10-24T00:44:45.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.537+0000 7f49aedf7700 1 -- start start 2023-10-24T00:44:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f49aedf7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49a8154430 0x7f49a8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f49aedf7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80c71d0 con 0x7f49a8098bd0 2023-10-24T00:44:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f49aedf7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a80c9410 con 0x7f49a80bffd0 2023-10-24T00:44:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f49aedf7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80c6a10 con 0x7f49a8154430 2023-10-24T00:44:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f499ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f49a8098bd0 0x7f49a80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48158/0 (socket says 172.21.15.148:48158) 2023-10-24T00:44:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.538+0000 7f499ffff700 1 -- 172.21.15.148:0/106613277 learned_addr learned my addr 172.21.15.148:0/106613277 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f49acb93700 1 --2- 172.21.15.148:0/106613277 >> v2:172.21.15.150:3300/0 conn(0x7f49a8154430 0x7f49a8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823772176 0 0) 0x7f49a80c71d0 con 0x7f49a8098bd0 2023-10-24T00:44:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49900033f0 con 0x7f49a8098bd0 2023-10-24T00:44:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334676989 0 0) 0x7f49900033f0 con 0x7f49a8098bd0 2023-10-24T00:44:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 >> v2:172.21.15.150:3300/0 conn(0x7f49a8154430 msgr2=0x7f49a8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 --2- 172.21.15.148:0/106613277 >> v2:172.21.15.150:3300/0 conn(0x7f49a8154430 0x7f49a8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 >> v1:172.21.15.150:6789/0 conn(0x7f49a80bffd0 legacy=0x7f49a815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80ca8b0 con 0x7f49a8098bd0 2023-10-24T00:44:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f4998001470 con 0x7f49a8098bd0 2023-10-24T00:44:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 >> v1:172.21.15.148:6789/0 conn(0x7f49a8098bd0 legacy=0x7f49a80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49900038e0 0x7f4990003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 0x7f4990004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990005000 0x7f499000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c6a10 con 0x7f4990004690 2023-10-24T00:44:45.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499000bf60 con 0x7f49900038e0 2023-10-24T00:44:45.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499000c0f0 con 0x7f4990005000 2023-10-24T00:44:45.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 0x7f4990004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f49acb93700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49900038e0 0x7f4990003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f49ad394700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990005000 0x7f499000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 -- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990005000 msgr2=0x7f499000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990005000 0x7f499000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 -- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49900038e0 msgr2=0x7f4990003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49900038e0 0x7f4990003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 -- 172.21.15.148:0/106613277 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900033f0 con 0x7f4990004690 2023-10-24T00:44:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f49ad394700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990005000 0x7f499000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f49ad394700 1 -- 172.21.15.148:0/106613277 reap_dead start 2023-10-24T00:44:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.539+0000 7f499ffff700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 0x7f4990004b10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f499800c190 tx=0x7f4998001e50).ready entity=mon.0 client_cookie=6ad36ad610ca19ae server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998007a20 con 0x7f4990004690 2023-10-24T00:44:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499800cac0 con 0x7f4990004690 2023-10-24T00:44:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f499f7fe700 1 -- 172.21.15.148:0/106613277 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800ce40 con 0x7f4990004690 2023-10-24T00:44:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 -- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 msgr2=0x7f4990004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 0x7f4990004b10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f499800c190 tx=0x7f4998001e50).stop 2023-10-24T00:44:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 -- 172.21.15.148:0/106613277 shutdown_connections 2023-10-24T00:44:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 --2- 172.21.15.148:0/106613277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4990004690 0x7f4990004b10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 -- 172.21.15.148:0/106613277 >> 172.21.15.148:0/106613277 conn(0x7f49a80cb070 msgr2=0x7f49a80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 -- 172.21.15.148:0/106613277 shutdown_connections 2023-10-24T00:44:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.540+0000 7f49aedf7700 1 -- 172.21.15.148:0/106613277 wait complete. 2023-10-24T00:44:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.541+0000 7f49aedf7700 1 Processor -- start 2023-10-24T00:44:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.541+0000 7f49aedf7700 1 -- start start 2023-10-24T00:44:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990004690 0x7f49a8148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80ad960 0x7f49a80afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8149360 con 0x7f49a80c45b0 2023-10-24T00:44:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80af8d0 con 0x7f49a80ad960 2023-10-24T00:44:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f49aedf7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a81486b0 con 0x7f4990004690 2023-10-24T00:44:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f499ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f499ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54568/0 (socket says 172.21.15.148:54568) 2023-10-24T00:44:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.542+0000 7f499ffff700 1 -- 172.21.15.148:0/3736249420 learned_addr learned my addr 172.21.15.148:0/3736249420 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:45.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f49ad394700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80ad960 0x7f49a80afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f49acb93700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990004690 0x7f49a8148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 -- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990004690 msgr2=0x7f49a8148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990004690 0x7f49a8148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 -- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80ad960 msgr2=0x7f49a80afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80ad960 0x7f49a80afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 -- 172.21.15.148:0/3736249420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80af310 con 0x7f49a80c45b0 2023-10-24T00:44:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499ffff700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f4990005640 tx=0x7f4998015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980074b0 con 0x7f49a80c45b0 2023-10-24T00:44:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998007610 con 0x7f49a80c45b0 2023-10-24T00:44:45.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49980048e0 con 0x7f49a80c45b0 2023-10-24T00:44:45.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80af5f0 con 0x7f49a80c45b0 2023-10-24T00:44:45.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.543+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a80c4a30 con 0x7f49a80c45b0 2023-10-24T00:44:45.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.544+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a8148b90 con 0x7f49a80c45b0 2023-10-24T00:44:45.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.544+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f499801c070 con 0x7f49a80c45b0 2023-10-24T00:44:45.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.544+0000 7f499cff9700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 0x7f4994061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.545+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f499807aa10 con 0x7f49a80c45b0 2023-10-24T00:44:45.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.545+0000 7f49acb93700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 0x7f4994061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.545+0000 7f49acb93700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 0x7f4994061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f49a40094d0 tx=0x7f49a400b040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.549+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f499804bc80 con 0x7f49a80c45b0 2023-10-24T00:44:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.713+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f49a81484d0 con 0x7f49a80c45b0 2023-10-24T00:44:45.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.717+0000 7f499cff9700 1 -- 172.21.15.148:0/3736249420 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v12) v1 ==== 120+0+0 (secure 0 0 0) 0x7f4998024070 con 0x7f49a80c45b0 2023-10-24T00:44:45.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 msgr2=0x7f4994061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 0x7f4994061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f49a40094d0 tx=0x7f49a400b040).stop 2023-10-24T00:44:45.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 msgr2=0x7f49a80ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f4990005640 tx=0x7f4998015000).stop 2023-10-24T00:44:45.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 shutdown_connections 2023-10-24T00:44:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49a80ad960 0x7f49a80afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4990004690 0x7f49a8148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f499405f240 0x7f4994061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 --2- 172.21.15.148:0/3736249420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a80c45b0 0x7f49a80ad470 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 >> 172.21.15.148:0/3736249420 conn(0x7f49a80cb070 msgr2=0x7f49a80c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 shutdown_connections 2023-10-24T00:44:45.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.719+0000 7f49aedf7700 1 -- 172.21.15.148:0/3736249420 wait complete. 2023-10-24T00:44:45.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:44:45.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.846+0000 7f16d7a3d700 1 Processor -- start 2023-10-24T00:44:45.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.847+0000 7f16d7a3d700 1 -- start start 2023-10-24T00:44:45.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.847+0000 7f16d7a3d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 0x7f16d0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.847+0000 7f16d7a3d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16d00c95d0 0x7f16d00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d7a3d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00bec40 con 0x7f16d00a60e0 2023-10-24T00:44:45.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d7a3d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00be650 con 0x7f16d00c95d0 2023-10-24T00:44:45.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d7a3d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00a82c0 con 0x7f16d0154430 2023-10-24T00:44:45.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f16d00c95d0 0x7f16d00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d5fda700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f16d00a60e0 0x7f16d00c4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48166/0 (socket says 172.21.15.148:48166) 2023-10-24T00:44:45.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d5fda700 1 -- 172.21.15.148:0/1626254751 learned_addr learned my addr 172.21.15.148:0/1626254751 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:45.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d57d9700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 0x7f16d0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 -- 172.21.15.148:0/1626254751 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 msgr2=0x7f16d0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:45.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 0x7f16d0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 -- 172.21.15.148:0/1626254751 >> v1:172.21.15.148:6789/0 conn(0x7f16d00a60e0 legacy=0x7f16d00c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 -- 172.21.15.148:0/1626254751 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00a85a0 con 0x7f16d00c95d0 2023-10-24T00:44:45.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16cffff700 1 -- 172.21.15.148:0/1626254751 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495080469 0 0) 0x7f16d00bec40 con 0x7f16d00a60e0 2023-10-24T00:44:45.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d57d9700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 0x7f16d0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:45.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16d4fd8700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00c95d0 0x7f16d00a5bf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f16c4009760 tx=0x7f16c4009060).ready entity=mon.0 client_cookie=80f8d05c1a8d9e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16cffff700 1 -- 172.21.15.148:0/1626254751 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400b580 con 0x7f16d00c95d0 2023-10-24T00:44:45.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16cffff700 1 -- 172.21.15.148:0/1626254751 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400b6e0 con 0x7f16d00c95d0 2023-10-24T00:44:45.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.848+0000 7f16cffff700 1 -- 172.21.15.148:0/1626254751 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400ba60 con 0x7f16d00c95d0 2023-10-24T00:44:45.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 -- 172.21.15.148:0/1626254751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00c95d0 msgr2=0x7f16d00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00c95d0 0x7f16d00a5bf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f16c4009760 tx=0x7f16c4009060).stop 2023-10-24T00:44:45.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 -- 172.21.15.148:0/1626254751 shutdown_connections 2023-10-24T00:44:45.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d0154430 0x7f16d0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/1626254751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00c95d0 0x7f16d00a5bf0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:45.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 -- 172.21.15.148:0/1626254751 >> 172.21.15.148:0/1626254751 conn(0x7f16d00630d0 msgr2=0x7f16d00c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:45.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 -- 172.21.15.148:0/1626254751 shutdown_connections 2023-10-24T00:44:45.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.849+0000 7f16d7a3d700 1 -- 172.21.15.148:0/1626254751 wait complete. 2023-10-24T00:44:45.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.850+0000 7f16d7a3d700 1 Processor -- start 2023-10-24T00:44:45.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.850+0000 7f16d7a3d700 1 -- start start 2023-10-24T00:44:45.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d00c95d0 0x7f16d0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16d0154430 0x7f16d0163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00aab10 con 0x7f16d00a60e0 2023-10-24T00:44:45.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00aafa0 con 0x7f16d0154430 2023-10-24T00:44:45.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d7a3d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00a9f00 con 0x7f16d00c95d0 2023-10-24T00:44:45.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d57d9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d57d9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54592/0 (socket says 172.21.15.148:54592) 2023-10-24T00:44:45.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d57d9700 1 -- 172.21.15.148:0/3316799912 learned_addr learned my addr 172.21.15.148:0/3316799912 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:45.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d57d9700 1 -- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d00c95d0 msgr2=0x7f16d0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.851+0000 7f16d57d9700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d00c95d0 0x7f16d0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:45.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d57d9700 1 -- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16d0154430 msgr2=0x7f16d0163d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:45.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d57d9700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16d0154430 0x7f16d0163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:45.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d57d9700 1 -- 172.21.15.148:0/3316799912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40092a0 con 0x7f16d00a60e0 2023-10-24T00:44:45.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d57d9700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f16c000d890 tx=0x7f16c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00125f0 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0012750 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00aa1e0 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0012ad0 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.852+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d00aa7a0 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.853+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d006c6b0 con 0x7f16d00a60e0 2023-10-24T00:44:45.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.853+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f16c0013480 con 0x7f16d00a60e0 2023-10-24T00:44:45.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.853+0000 7f16cd7fa700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 0x7f16bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:45.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.854+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f16c007a440 con 0x7f16d00a60e0 2023-10-24T00:44:45.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.854+0000 7f16d4fd8700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 0x7f16bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:45.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.854+0000 7f16d4fd8700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 0x7f16bc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f16d0060fc0 tx=0x7f16c4017000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:45.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:45.858+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f16c004b6b0 con 0x7f16d00a60e0 2023-10-24T00:44:46.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.019+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f16d006a920 con 0x7f16d00a60e0 2023-10-24T00:44:46.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.023+0000 7f16cd7fa700 1 -- 172.21.15.148:0/3316799912 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16c004ecd0 con 0x7f16d00a60e0 2023-10-24T00:44:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 msgr2=0x7f16bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 0x7f16bc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f16d0060fc0 tx=0x7f16c4017000).stop 2023-10-24T00:44:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 msgr2=0x7f16d00a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f16c000d890 tx=0x7f16c0008040).stop 2023-10-24T00:44:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 shutdown_connections 2023-10-24T00:44:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16d0154430 0x7f16d0163d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f16bc05f270 0x7f16bc061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16d00a60e0 0x7f16d00a9890 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 --2- 172.21.15.148:0/3316799912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16d00c95d0 0x7f16d0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 >> 172.21.15.148:0/3316799912 conn(0x7f16d00630d0 msgr2=0x7f16d00c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 shutdown_connections 2023-10-24T00:44:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.025+0000 7f16d7a3d700 1 -- 172.21.15.148:0/3316799912 wait complete. 2023-10-24T00:44:46.039 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-24T00:44:46.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.150+0000 7f0721e53700 1 Processor -- start 2023-10-24T00:44:46.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f0721e53700 1 -- start start 2023-10-24T00:44:46.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f0721e53700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f071c150f60 0x7f071c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f0721e53700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0bdf20 con 0x7f071c069a90 2023-10-24T00:44:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f0721e53700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0664b0 con 0x7f071c0c42f0 2023-10-24T00:44:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f0721e53700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c0bd310 con 0x7f071c150f60 2023-10-24T00:44:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.151+0000 7f071bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f071c069a90 0x7f071c15ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48178/0 (socket says 172.21.15.148:48178) 2023-10-24T00:44:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071bfff700 1 -- 172.21.15.148:0/2271432420 learned_addr learned my addr 172.21.15.148:0/2271432420 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760725461 0 0) 0x7f071c0bdf20 con 0x7f071c069a90 2023-10-24T00:44:46.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071b7fe700 1 --2- 172.21.15.148:0/2271432420 >> v2:172.21.15.150:3300/0 conn(0x7f071c150f60 0x7f071c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07040033f0 con 0x7f071c069a90 2023-10-24T00:44:46.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2547333607 0 0) 0x7f07040033f0 con 0x7f071c069a90 2023-10-24T00:44:46.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 >> v2:172.21.15.150:3300/0 conn(0x7f071c150f60 msgr2=0x7f071c0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:46.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 --2- 172.21.15.148:0/2271432420 >> v2:172.21.15.150:3300/0 conn(0x7f071c150f60 0x7f071c0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 >> v1:172.21.15.150:6789/0 conn(0x7f071c0c42f0 legacy=0x7f071c069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0bd5f0 con 0x7f071c069a90 2023-10-24T00:44:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f0714001470 con 0x7f071c069a90 2023-10-24T00:44:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 >> v1:172.21.15.148:6789/0 conn(0x7f071c069a90 legacy=0x7f071c15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07040038e0 0x7f0704003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 0x7f070400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0bd310 con 0x7f0704005050 2023-10-24T00:44:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070400bfe0 con 0x7f07040038e0 2023-10-24T00:44:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070400c1a0 con 0x7f0704004690 2023-10-24T00:44:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071bfff700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 0x7f070400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071b7fe700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07040038e0 0x7f0704003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071affd700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071bfff700 1 -- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0704004690 msgr2=0x7f0704004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.152+0000 7f071bfff700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071bfff700 1 -- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07040038e0 msgr2=0x7f0704003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071bfff700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07040038e0 0x7f0704003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071bfff700 1 -- 172.21.15.148:0/2271432420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040033f0 con 0x7f0704005050 2023-10-24T00:44:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071bfff700 1 -- 172.21.15.148:0/2271432420 reap_dead start 2023-10-24T00:44:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071bfff700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 0x7f070400b8e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f071400c190 tx=0x7f0714001e50).ready entity=mon.0 client_cookie=fe83c150fe062b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714007a20 con 0x7f0704005050 2023-10-24T00:44:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071400cac0 con 0x7f0704005050 2023-10-24T00:44:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f071a7fc700 1 -- 172.21.15.148:0/2271432420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400ce60 con 0x7f0704005050 2023-10-24T00:44:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 -- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 msgr2=0x7f070400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 0x7f070400b8e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f071400c190 tx=0x7f0714001e50).stop 2023-10-24T00:44:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 -- 172.21.15.148:0/2271432420 shutdown_connections 2023-10-24T00:44:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 --2- 172.21.15.148:0/2271432420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0704005050 0x7f070400b8e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 -- 172.21.15.148:0/2271432420 >> 172.21.15.148:0/2271432420 conn(0x7f071c064230 msgr2=0x7f071c0c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 -- 172.21.15.148:0/2271432420 shutdown_connections 2023-10-24T00:44:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.153+0000 7f0721e53700 1 -- 172.21.15.148:0/2271432420 wait complete. 2023-10-24T00:44:46.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 Processor -- start 2023-10-24T00:44:46.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 -- start start 2023-10-24T00:44:46.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704005050 0x7f071c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c146970 0x7f071c0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c168500 con 0x7f071c0c15d0 2023-10-24T00:44:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c1678f0 con 0x7f0704005050 2023-10-24T00:44:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.155+0000 7f0721e53700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c167bd0 con 0x7f071c146970 2023-10-24T00:44:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54602/0 (socket says 172.21.15.148:54602) 2023-10-24T00:44:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 -- 172.21.15.148:0/3808640341 learned_addr learned my addr 172.21.15.148:0/3808640341 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071b7fe700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704005050 0x7f071c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071affd700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c146970 0x7f071c0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 -- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c146970 msgr2=0x7f071c0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c146970 0x7f071c0a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 -- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704005050 msgr2=0x7f071c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704005050 0x7f071c150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 -- 172.21.15.148:0/3808640341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c167eb0 con 0x7f071c0c15d0 2023-10-24T00:44:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f071bfff700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f0714001e90 tx=0x7f0714015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714007a20 con 0x7f071c0c15d0 2023-10-24T00:44:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714001430 con 0x7f071c0c15d0 2023-10-24T00:44:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c168190 con 0x7f071c0c15d0 2023-10-24T00:44:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140136a0 con 0x7f071c0c15d0 2023-10-24T00:44:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.156+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c0a5f20 con 0x7f071c0c15d0 2023-10-24T00:44:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.157+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c168320 con 0x7f071c0c15d0 2023-10-24T00:44:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.157+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0714013a10 con 0x7f071c0c15d0 2023-10-24T00:44:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.158+0000 7f07037fe700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 0x7f0708061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.158+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f071407b170 con 0x7f071c0c15d0 2023-10-24T00:44:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.158+0000 7f071b7fe700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 0x7f0708061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.158+0000 7f071b7fe700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 0x7f0708061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f070c009840 tx=0x7f070c009710).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.162+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f071404c3e0 con 0x7f071c0c15d0 2023-10-24T00:44:46.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.388+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f071c06c6b0 con 0x7f071c0c15d0 2023-10-24T00:44:46.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.406+0000 7f07037fe700 1 -- 172.21.15.148:0/3808640341 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v570) v1 ==== 156+0+0 (secure 0 0 0) 0x7f071404fa00 con 0x7f071c0c15d0 2023-10-24T00:44:46.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 msgr2=0x7f0708061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 0x7f0708061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f070c009840 tx=0x7f070c009710).stop 2023-10-24T00:44:46.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 msgr2=0x7f071c0a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f0714001e90 tx=0x7f0714015000).stop 2023-10-24T00:44:46.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 shutdown_connections 2023-10-24T00:44:46.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f070805f270 0x7f0708061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f071c0c15d0 0x7f071c0a5a30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704005050 0x7f071c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 --2- 172.21.15.148:0/3808640341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c146970 0x7f071c0a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 >> 172.21.15.148:0/3808640341 conn(0x7f071c064230 msgr2=0x7f071c0a4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:46.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 shutdown_connections 2023-10-24T00:44:46.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.408+0000 7f0721e53700 1 -- 172.21.15.148:0/3808640341 wait complete. 2023-10-24T00:44:46.422 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-10-24T00:44:46.423 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-10-24T00:44:46.423 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:44:46.424 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-24T00:44:46.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.536+0000 7f96b869f700 1 Processor -- start 2023-10-24T00:44:46.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.536+0000 7f96b869f700 1 -- start start 2023-10-24T00:44:46.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b869f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96b00c6710 0x7f96b00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b869f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96b00aa3f0 0x7f96b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b869f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00aa820 con 0x7f96b00aa010 2023-10-24T00:44:46.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b869f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00c0960 con 0x7f96b00c6710 2023-10-24T00:44:46.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b869f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00c0c40 con 0x7f96b00aa3f0 2023-10-24T00:44:46.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.537+0000 7f96b5c3a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96b00c6710 0x7f96b00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f96b00c6710 0x7f96b00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54606/0 (socket says 172.21.15.148:54606) 2023-10-24T00:44:46.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 -- 172.21.15.148:0/1732938396 learned_addr learned my addr 172.21.15.148:0/1732938396 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:46.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b6c3c700 1 --2- 172.21.15.148:0/1732938396 >> v2:172.21.15.150:3300/0 conn(0x7f96b00aa3f0 0x7f96b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 -- 172.21.15.148:0/1732938396 >> v2:172.21.15.150:3300/0 conn(0x7f96b00aa3f0 msgr2=0x7f96b0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 --2- 172.21.15.148:0/1732938396 >> v2:172.21.15.150:3300/0 conn(0x7f96b00aa3f0 0x7f96b0069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 -- 172.21.15.148:0/1732938396 >> v1:172.21.15.150:6789/0 conn(0x7f96b00aa010 legacy=0x7f96b0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 -- 172.21.15.148:0/1732938396 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00c0f20 con 0x7f96b00c6710 2023-10-24T00:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5c3a700 1 --2- 172.21.15.148:0/1732938396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b00c1a00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f96b0158e80 tx=0x7f96a00090f0).ready entity=mon.0 client_cookie=7211dba39c8fe503 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5439700 1 -- 172.21.15.148:0/1732938396 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000b600 con 0x7f96b00c6710 2023-10-24T00:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5439700 1 -- 172.21.15.148:0/1732938396 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000b760 con 0x7f96b00c6710 2023-10-24T00:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.538+0000 7f96b5439700 1 -- 172.21.15.148:0/1732938396 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000bae0 con 0x7f96b00c6710 2023-10-24T00:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 -- 172.21.15.148:0/1732938396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 msgr2=0x7f96b00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 --2- 172.21.15.148:0/1732938396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b00c1a00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f96b0158e80 tx=0x7f96a00090f0).stop 2023-10-24T00:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 -- 172.21.15.148:0/1732938396 shutdown_connections 2023-10-24T00:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 --2- 172.21.15.148:0/1732938396 >> v2:172.21.15.150:3300/0 conn(0x7f96b00aa3f0 0x7f96b0069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 --2- 172.21.15.148:0/1732938396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b00c1a00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 -- 172.21.15.148:0/1732938396 >> 172.21.15.148:0/1732938396 conn(0x7f96b00caf40 msgr2=0x7f96b00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 -- 172.21.15.148:0/1732938396 shutdown_connections 2023-10-24T00:44:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.539+0000 7f96b869f700 1 -- 172.21.15.148:0/1732938396 wait complete. 2023-10-24T00:44:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.540+0000 7f96b869f700 1 Processor -- start 2023-10-24T00:44:46.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.540+0000 7f96b869f700 1 -- start start 2023-10-24T00:44:46.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.540+0000 7f96b869f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b00aa010 0x7f96b01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b00aa3f0 0x7f96b00b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01523e0 con 0x7f96b00c6710 2023-10-24T00:44:46.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00c3b40 con 0x7f96b00aa3f0 2023-10-24T00:44:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b0370 con 0x7f96b00aa010 2023-10-24T00:44:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54614/0 (socket says 172.21.15.148:54614) 2023-10-24T00:44:46.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 -- 172.21.15.148:0/3974749913 learned_addr learned my addr 172.21.15.148:0/3974749913 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b5c3a700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b00aa3f0 0x7f96b00b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b643b700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b00aa010 0x7f96b01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 -- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b00aa010 msgr2=0x7f96b01438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b00aa010 0x7f96b01438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 -- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b00aa3f0 msgr2=0x7f96b00b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b00aa3f0 0x7f96b00b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 -- 172.21.15.148:0/3974749913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0009370 con 0x7f96b00c6710 2023-10-24T00:44:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b6c3c700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f96a8009fa0 tx=0x7f96a8009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800eb60 con 0x7f96b00c6710 2023-10-24T00:44:46.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a800ecc0 con 0x7f96b00c6710 2023-10-24T00:44:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00afa40 con 0x7f96b00c6710 2023-10-24T00:44:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8014610 con 0x7f96b00c6710 2023-10-24T00:44:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.541+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00b0000 con 0x7f96b00c6710 2023-10-24T00:44:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.542+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b006c6b0 con 0x7f96b00c6710 2023-10-24T00:44:46.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.543+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f96a801d3b0 con 0x7f96b00c6710 2023-10-24T00:44:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.543+0000 7f96a67fc700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 0x7f9694061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:46.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.543+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f96a807a6a0 con 0x7f96b00c6710 2023-10-24T00:44:46.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.543+0000 7f96b643b700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 0x7f9694061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:46.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.544+0000 7f96b643b700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 0x7f9694061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f96ac0038e0 tx=0x7f96ac007d40).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:46.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.547+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96a804b8b0 con 0x7f96b00c6710 2023-10-24T00:44:46.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:46.772+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f96b00c1200 con 0x7f96b00c6710 2023-10-24T00:44:47.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.410+0000 7f96a67fc700 1 -- 172.21.15.148:0/3974749913 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v571) v1 ==== 169+0+0 (secure 0 0 0) 0x7f96a804eed0 con 0x7f96b00c6710 2023-10-24T00:44:47.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 msgr2=0x7f9694061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 0x7f9694061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f96ac0038e0 tx=0x7f96ac007d40).stop 2023-10-24T00:44:47.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 msgr2=0x7f96b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f96a8009fa0 tx=0x7f96a8009900).stop 2023-10-24T00:44:47.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 shutdown_connections 2023-10-24T00:44:47.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f969405f270 0x7f9694061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96b00c6710 0x7f96b0069d80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b00aa010 0x7f96b01438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 --2- 172.21.15.148:0/3974749913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b00aa3f0 0x7f96b00b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 >> 172.21.15.148:0/3974749913 conn(0x7f96b00caf40 msgr2=0x7f96b00c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:47.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 shutdown_connections 2023-10-24T00:44:47.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.412+0000 7f96b869f700 1 -- 172.21.15.148:0/3974749913 wait complete. 2023-10-24T00:44:47.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:44:47.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.542+0000 7fe0f94df700 1 Processor -- start 2023-10-24T00:44:47.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.542+0000 7fe0f94df700 1 -- start start 2023-10-24T00:44:47.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f94df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0f4150f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f94df700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f4154b80 con 0x7fe0f4069940 2023-10-24T00:44:47.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f94df700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f4154e60 con 0x7fe0f4063a40 2023-10-24T00:44:47.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f94df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4155940 con 0x7fe0f4150b70 2023-10-24T00:44:47.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f8cde700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe0f4069940 0x7fe0f40c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48182/0 (socket says 172.21.15.148:48182) 2023-10-24T00:44:47.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f8cde700 1 -- 172.21.15.148:0/500698071 learned_addr learned my addr 172.21.15.148:0/500698071 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:47.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f3fff700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0f4150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958312562 0 0) 0x7fe0f4154b80 con 0x7fe0f4069940 2023-10-24T00:44:47.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.543+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0dc0033f0 con 0x7fe0f4069940 2023-10-24T00:44:47.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087374235 0 0) 0x7fe0f4154e60 con 0x7fe0f4063a40 2023-10-24T00:44:47.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f4154b80 con 0x7fe0f4063a40 2023-10-24T00:44:47.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 977544911 0 0) 0x7fe0dc0033f0 con 0x7fe0f4069940 2023-10-24T00:44:47.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 msgr2=0x7fe0f4150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0f4150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 >> v1:172.21.15.150:6789/0 conn(0x7fe0f4063a40 legacy=0x7fe0f4069230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4155140 con 0x7fe0f4069940 2023-10-24T00:44:47.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe0ec0017f0 con 0x7fe0f4069940 2023-10-24T00:44:47.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 >> v1:172.21.15.148:6789/0 conn(0x7fe0f4069940 legacy=0x7fe0f40c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0dc003aa0 0x7fe0dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0dc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4155940 con 0x7fe0dc004b80 2023-10-24T00:44:47.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc00b990 con 0x7fe0dc003aa0 2023-10-24T00:44:47.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc00bb50 con 0x7fe0f4150b70 2023-10-24T00:44:47.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f3fff700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0dc003aa0 0x7fe0dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f37fe700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0dc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 -- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 msgr2=0x7fe0dc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f4150b70 0x7fe0dc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 -- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0dc003aa0 msgr2=0x7fe0dc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0dc003aa0 0x7fe0dc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 -- 172.21.15.148:0/500698071 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0033f0 con 0x7fe0dc004b80 2023-10-24T00:44:47.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0dc005000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fe0f4069d40 tx=0x7fe0ec007f40).ready entity=mon.0 client_cookie=742c280bad43353b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00cd90 con 0x7fe0dc004b80 2023-10-24T00:44:47.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec005b20 con 0x7fe0dc004b80 2023-10-24T00:44:47.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.544+0000 7fe0f2ffd700 1 -- 172.21.15.148:0/500698071 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0070d0 con 0x7fe0dc004b80 2023-10-24T00:44:47.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 -- 172.21.15.148:0/500698071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 msgr2=0x7fe0dc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 --2- 172.21.15.148:0/500698071 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0dc005000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fe0f4069d40 tx=0x7fe0ec007f40).stop 2023-10-24T00:44:47.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f8cde700 1 -- 172.21.15.148:0/500698071 reap_dead start 2023-10-24T00:44:47.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 -- 172.21.15.148:0/500698071 shutdown_connections 2023-10-24T00:44:47.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 -- 172.21.15.148:0/500698071 >> 172.21.15.148:0/500698071 conn(0x7fe0f40c48a0 msgr2=0x7fe0f4068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:47.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 -- 172.21.15.148:0/500698071 shutdown_connections 2023-10-24T00:44:47.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.545+0000 7fe0f94df700 1 -- 172.21.15.148:0/500698071 wait complete. 2023-10-24T00:44:47.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.546+0000 7fe0f94df700 1 Processor -- start 2023-10-24T00:44:47.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.546+0000 7fe0f94df700 1 -- start start 2023-10-24T00:44:47.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 0x7fe0f4145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 0x7fe0f41459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4145ee0 con 0x7fe0dc004b80 2023-10-24T00:44:47.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41514a0 con 0x7fe0f40c54b0 2023-10-24T00:44:47.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f94df700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40c59f0 con 0x7fe0f40c5030 2023-10-24T00:44:47.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54628/0 (socket says 172.21.15.148:54628) 2023-10-24T00:44:47.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 -- 172.21.15.148:0/437727067 learned_addr learned my addr 172.21.15.148:0/437727067 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:47.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 -- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 msgr2=0x7fe0f4145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f37fe700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 0x7fe0f4145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 0x7fe0f41459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 0x7fe0f4145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 -- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 msgr2=0x7fe0f41459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 0x7fe0f41459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 -- 172.21.15.148:0/437727067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40ab530 con 0x7fe0dc004b80 2023-10-24T00:44:47.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f8cde700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 0x7fe0f41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:47.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f37fe700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 0x7fe0f4145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:47.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.547+0000 7fe0f3fff700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fe0e40119c0 tx=0x7fe0e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.548+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400f8e0 con 0x7fe0dc004b80 2023-10-24T00:44:47.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.548+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400fa40 con 0x7fe0dc004b80 2023-10-24T00:44:47.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.548+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f40ab810 con 0x7fe0dc004b80 2023-10-24T00:44:47.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.548+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400fdc0 con 0x7fe0dc004b80 2023-10-24T00:44:47.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.548+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f40abdd0 con 0x7fe0dc004b80 2023-10-24T00:44:47.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.549+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f40abff0 con 0x7fe0dc004b80 2023-10-24T00:44:47.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.549+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe0e4014650 con 0x7fe0dc004b80 2023-10-24T00:44:47.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.549+0000 7fe0dbfff700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 0x7fe0e0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.549+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7fe0e407ae80 con 0x7fe0dc004b80 2023-10-24T00:44:47.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.549+0000 7fe0f37fe700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 0x7fe0e0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.550+0000 7fe0f37fe700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 0x7fe0e0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0e8000c00 tx=0x7fe0e8009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.553+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0e404c0f0 con 0x7fe0dc004b80 2023-10-24T00:44:47.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.717+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe0f4047480 con 0x7fe0dc004b80 2023-10-24T00:44:47.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.721+0000 7fe0dbfff700 1 -- 172.21.15.148:0/437727067 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0e404f710 con 0x7fe0dc004b80 2023-10-24T00:44:47.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.722+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 msgr2=0x7fe0e0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.722+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 0x7fe0e0061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0e8000c00 tx=0x7fe0e8009040).stop 2023-10-24T00:44:47.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 msgr2=0x7fe0f4143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fe0e40119c0 tx=0x7fe0e4009060).stop 2023-10-24T00:44:47.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 shutdown_connections 2023-10-24T00:44:47.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0f40c54b0 0x7fe0f41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0e005f270 0x7fe0e0061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0dc004b80 0x7fe0f4143f20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 --2- 172.21.15.148:0/437727067 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0f40c5030 0x7fe0f4145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 >> 172.21.15.148:0/437727067 conn(0x7fe0f40c48a0 msgr2=0x7fe0f40bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:47.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 shutdown_connections 2023-10-24T00:44:47.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.723+0000 7fe0f94df700 1 -- 172.21.15.148:0/437727067 wait complete. 2023-10-24T00:44:47.737 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:44:47.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:47.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:44:47.818 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:44:47.818 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:44:47.819 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.929+0000 7f4d8378b700 1 Processor -- start 2023-10-24T00:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.929+0000 7f4d8378b700 1 -- start start 2023-10-24T00:44:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d8378b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d7c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d8378b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0aa880 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d8378b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0c0960 con 0x7f4d7c0aa010 2023-10-24T00:44:47.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d8378b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c0c40 con 0x7f4d7c0c6710 2023-10-24T00:44:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d81d28700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4d7c0aa3f0 0x7f4d7c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48186/0 (socket says 172.21.15.148:48186) 2023-10-24T00:44:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d81d28700 1 -- 172.21.15.148:0/1021594735 learned_addr learned my addr 172.21.15.148:0/1021594735 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.930+0000 7f4d80d26700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d7c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268962003 0 0) 0x7f4d74001110 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d680033f0 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983599615 0 0) 0x7f4d7c0c0960 con 0x7f4d7c0aa010 2023-10-24T00:44:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d74001110 con 0x7f4d7c0aa010 2023-10-24T00:44:47.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991800091 0 0) 0x7f4d680033f0 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 msgr2=0x7f4d7c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d7c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 >> v1:172.21.15.150:6789/0 conn(0x7f4d7c0aa010 legacy=0x7f4d7c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0c0f20 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f4d74001600 con 0x7f4d7c0aa3f0 2023-10-24T00:44:47.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 >> v1:172.21.15.148:6789/0 conn(0x7f4d7c0aa3f0 legacy=0x7f4d7c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68003aa0 0x7f4d68003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68004690 0x7f4d68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c0c40 con 0x7f4d68003aa0 2023-10-24T00:44:47.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6800b910 con 0x7f4d68004690 2023-10-24T00:44:47.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6800bad0 con 0x7f4d7c0c6710 2023-10-24T00:44:47.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68003aa0 0x7f4d68003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d80d26700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68004690 0x7f4d68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81d28700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 -- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 msgr2=0x7f4d68005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d7c0c6710 0x7f4d68005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 -- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68004690 msgr2=0x7f4d68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:47.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68004690 0x7f4d68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 -- 172.21.15.148:0/1021594735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680033f0 con 0x7f4d68003aa0 2023-10-24T00:44:47.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.931+0000 7f4d81527700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68003aa0 0x7f4d68003ea0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4d78001f90 tx=0x7f4d78007f30).ready entity=mon.0 client_cookie=6c96122b2eaef90e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780020f0 con 0x7f4d68003aa0 2023-10-24T00:44:47.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78006a20 con 0x7f4d68003aa0 2023-10-24T00:44:47.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d73fff700 1 -- 172.21.15.148:0/1021594735 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78006dc0 con 0x7f4d68003aa0 2023-10-24T00:44:47.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 -- 172.21.15.148:0/1021594735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68003aa0 msgr2=0x7f4d68003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 --2- 172.21.15.148:0/1021594735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68003aa0 0x7f4d68003ea0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f4d78001f90 tx=0x7f4d78007f30).stop 2023-10-24T00:44:47.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d81d28700 1 -- 172.21.15.148:0/1021594735 reap_dead start 2023-10-24T00:44:47.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 -- 172.21.15.148:0/1021594735 shutdown_connections 2023-10-24T00:44:47.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 -- 172.21.15.148:0/1021594735 >> 172.21.15.148:0/1021594735 conn(0x7f4d7c0caf40 msgr2=0x7f4d7c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:47.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 -- 172.21.15.148:0/1021594735 shutdown_connections 2023-10-24T00:44:47.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.932+0000 7f4d8378b700 1 -- 172.21.15.148:0/1021594735 wait complete. 2023-10-24T00:44:47.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.933+0000 7f4d8378b700 1 Processor -- start 2023-10-24T00:44:47.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.933+0000 7f4d8378b700 1 -- start start 2023-10-24T00:44:47.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 0x7f4d7c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 0x7f4d7c165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0aed50 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c167870 con 0x7f4d7c1652b0 2023-10-24T00:44:47.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d8378b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0ae4b0 con 0x7f4d68003aa0 2023-10-24T00:44:47.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d80d26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d80d26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54644/0 (socket says 172.21.15.148:54644) 2023-10-24T00:44:47.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d80d26700 1 -- 172.21.15.148:0/2917985021 learned_addr learned my addr 172.21.15.148:0/2917985021 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:47.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d81527700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 0x7f4d7c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.934+0000 7f4d81d28700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 0x7f4d7c165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 -- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 msgr2=0x7f4d7c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 0x7f4d7c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 -- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 msgr2=0x7f4d7c165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:47.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 0x7f4d7c165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:47.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 -- 172.21.15.148:0/2917985021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0ae790 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d81d28700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 0x7f4d7c165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d81527700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 0x7f4d7c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:47.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d80d26700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4d6c011a20 tx=0x7f4d6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00f940 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00faa0 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0aea70 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00fe20 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.935+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c14be40 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.936+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c06c6b0 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.936+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4d6c014650 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.936+0000 7f4d717fa700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 0x7f4d60061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:47.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.937+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f4d6c07af30 con 0x7f4d7c0c35e0 2023-10-24T00:44:47.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.937+0000 7f4d81527700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 0x7f4d60061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:47.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.937+0000 7f4d81527700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 0x7f4d60061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4d78001760 tx=0x7f4d78016000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:47.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:47.940+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d6c04c1a0 con 0x7f4d7c0c35e0 2023-10-24T00:44:48.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.141+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d7c0c1200 con 0x7f4d7c0c35e0 2023-10-24T00:44:48.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.141+0000 7f4d717fa700 1 -- 172.21.15.148:0/2917985021 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f4d6c04f7c0 con 0x7f4d7c0c35e0 2023-10-24T00:44:48.144 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:48.144 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1534594420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1534594420},{"type":"v1","addr":"172.21.15.150:6835","nonce":1534594420}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5929,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1688432730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1688432730},{"type":"v1","addr":"172.21.15.150:6837","nonce":1688432730}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1267199345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1267199345},{"type":"v1","addr":"172.21.15.148:6834","nonce":1267199345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6663,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/47763362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":47763362},{"type":"v1","addr":"172.21.15.148:6835","nonce":47763362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-24T00:44:48.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 msgr2=0x7f4d60061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 0x7f4d60061730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4d78001760 tx=0x7f4d78016000).stop 2023-10-24T00:44:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 msgr2=0x7f4d7c14b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f4d6c011a20 tx=0x7f4d6c009060).stop 2023-10-24T00:44:48.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 shutdown_connections 2023-10-24T00:44:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d7c1652b0 0x7f4d7c165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68003aa0 0x7f4d7c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d6005f270 0x7f4d60061730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 --2- 172.21.15.148:0/2917985021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d7c0c35e0 0x7f4d7c14b950 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 >> 172.21.15.148:0/2917985021 conn(0x7f4d7c0caf40 msgr2=0x7f4d7c0ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 shutdown_connections 2023-10-24T00:44:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.143+0000 7f4d8378b700 1 -- 172.21.15.148:0/2917985021 wait complete. 2023-10-24T00:44:48.148 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 27 2023-10-24T00:44:48.158 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:44:48.158 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:44:48.159 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:44:48.159 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:48.159 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:44:48.160 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:44:48.160 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:44:48.160 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:48.161 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:44:48.161 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:44:48.161 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:44:48.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:48.162 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:44:48.162 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:44:48.162 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:44:48.163 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:44:48.169 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:44:48.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:44:48.170 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:44:48.171 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:44:48.172 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:44:48.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:44:48.173 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:44:48.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:44:48.211 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:44:48.212 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:48.213 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:44:48.213 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:48.215 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:44:48.216 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:48.216 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:44:48.217 DEBUG:teuthology.parallel:result is None 2023-10-24T00:44:48.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:44:48.284 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:44:48.284 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:44:48.297 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:44:48.298 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:44:48.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.341+0000 7efdd7061700 1 Processor -- start 2023-10-24T00:44:48.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.341+0000 7efdd7061700 1 -- start start 2023-10-24T00:44:48.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd7061700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 0x7efdd00bf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd7061700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd7061700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd00be590 con 0x7efdd00a7e70 2023-10-24T00:44:48.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd7061700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd00a8810 con 0x7efdd0152270 2023-10-24T00:44:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd7061700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00bf3d0 con 0x7efdd00c4890 2023-10-24T00:44:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efdd00a7e70 0x7efdd00c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48224/0 (socket says 172.21.15.148:48224) 2023-10-24T00:44:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc7fff700 1 -- 172.21.15.148:0/4003299528 learned_addr learned my addr 172.21.15.148:0/4003299528 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 --2- 172.21.15.148:0/4003299528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd4dfd700 1 --2- 172.21.15.148:0/4003299528 >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 0x7efdd00bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc77fe700 1 -- 172.21.15.148:0/4003299528 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812622452 0 0) 0x7efdd00be590 con 0x7efdd00a7e70 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc77fe700 1 -- 172.21.15.148:0/4003299528 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb80033f0 con 0x7efdd00a7e70 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 -- 172.21.15.148:0/4003299528 >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 msgr2=0x7efdd00bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 --2- 172.21.15.148:0/4003299528 >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 0x7efdd00bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 -- 172.21.15.148:0/4003299528 >> v1:172.21.15.148:6789/0 conn(0x7efdd00a7e70 legacy=0x7efdd00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 -- 172.21.15.148:0/4003299528 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00be7c0 con 0x7efdd00c4890 2023-10-24T00:44:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd4dfd700 1 --2- 172.21.15.148:0/4003299528 >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 0x7efdd00bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdd55fe700 1 --2- 172.21.15.148:0/4003299528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7efdc8009760 tx=0x7efdc8009060).ready entity=mon.2 client_cookie=1625bc193629c43e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc77fe700 1 -- 172.21.15.148:0/4003299528 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800d4a0 con 0x7efdd00c4890 2023-10-24T00:44:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc77fe700 1 -- 172.21.15.148:0/4003299528 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800d600 con 0x7efdd00c4890 2023-10-24T00:44:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.342+0000 7efdc77fe700 1 -- 172.21.15.148:0/4003299528 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800d980 con 0x7efdd00c4890 2023-10-24T00:44:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 -- 172.21.15.148:0/4003299528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 msgr2=0x7efdd00a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 --2- 172.21.15.148:0/4003299528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7efdc8009760 tx=0x7efdc8009060).stop 2023-10-24T00:44:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 -- 172.21.15.148:0/4003299528 shutdown_connections 2023-10-24T00:44:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 --2- 172.21.15.148:0/4003299528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 --2- 172.21.15.148:0/4003299528 >> v2:172.21.15.150:3300/0 conn(0x7efdd0152270 0x7efdd00bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 -- 172.21.15.148:0/4003299528 >> 172.21.15.148:0/4003299528 conn(0x7efdd0092510 msgr2=0x7efdd0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 -- 172.21.15.148:0/4003299528 shutdown_connections 2023-10-24T00:44:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.343+0000 7efdd7061700 1 -- 172.21.15.148:0/4003299528 wait complete. 2023-10-24T00:44:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.344+0000 7efdd7061700 1 Processor -- start 2023-10-24T00:44:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.344+0000 7efdd7061700 1 -- start start 2023-10-24T00:44:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00a7e70 0x7efdd00ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00a9cf0 con 0x7efdd0152270 2023-10-24T00:44:48.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00a8e80 con 0x7efdd00a7e70 2023-10-24T00:44:48.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd7061700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00a90e0 con 0x7efdd00c4890 2023-10-24T00:44:48.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54694/0 (socket says 172.21.15.148:54694) 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 -- 172.21.15.148:0/2939696126 learned_addr learned my addr 172.21.15.148:0/2939696126 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdc7fff700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd4dfd700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00a7e70 0x7efdd00ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 -- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 msgr2=0x7efdd00a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.345+0000 7efdd55fe700 1 -- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00a7e70 msgr2=0x7efdd00ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdd55fe700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00a7e70 0x7efdd00ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdd55fe700 1 -- 172.21.15.148:0/2939696126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009a20 con 0x7efdd0152270 2023-10-24T00:44:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdd55fe700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7efdc8010000 tx=0x7efdc8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800d770 con 0x7efdd0152270 2023-10-24T00:44:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800d8d0 con 0x7efdd0152270 2023-10-24T00:44:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80092a0 con 0x7efdd0152270 2023-10-24T00:44:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc801d660 con 0x7efdd0152270 2023-10-24T00:44:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.346+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd00a96a0 con 0x7efdd0152270 2023-10-24T00:44:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.347+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd006c6b0 con 0x7efdd0152270 2023-10-24T00:44:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.347+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efdc801d9d0 con 0x7efdd0152270 2023-10-24T00:44:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.348+0000 7efdc4ff9700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 0x7efdbc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.348+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5828+0+0 (secure 0 0 0) 0x7efdc807bc10 con 0x7efdd0152270 2023-10-24T00:44:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.348+0000 7efdd4dfd700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 0x7efdbc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.348+0000 7efdd4dfd700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 0x7efdbc061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7efdcc0099f0 tx=0x7efdcc00b040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.352+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efdc804ce80 con 0x7efdd0152270 2023-10-24T00:44:48.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:48.528+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efdd00a9e30 con 0x7efdd0152270 2023-10-24T00:44:49.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.422+0000 7efdc4ff9700 1 -- 172.21.15.148:0/2939696126 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7efdd00a9e30 con 0x7efdd0152270 2023-10-24T00:44:49.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 msgr2=0x7efdbc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 0x7efdbc061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7efdcc0099f0 tx=0x7efdcc00b040).stop 2023-10-24T00:44:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 msgr2=0x7efdd014bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7efdc8010000 tx=0x7efdc8016000).stop 2023-10-24T00:44:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 shutdown_connections 2023-10-24T00:44:49.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdbc05f270 0x7efdbc061730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdd0152270 0x7efdd014bc40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdd00a7e70 0x7efdd00ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 --2- 172.21.15.148:0/2939696126 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdd00c4890 0x7efdd00a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 >> 172.21.15.148:0/2939696126 conn(0x7efdd0092510 msgr2=0x7efdd00666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:49.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 shutdown_connections 2023-10-24T00:44:49.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.425+0000 7efdd7061700 1 -- 172.21.15.148:0/2939696126 wait complete. 2023-10-24T00:44:49.430 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:44:49.442 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:44:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.559+0000 7fea1ddc2700 1 Processor -- start 2023-10-24T00:44:49.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.559+0000 7fea1ddc2700 1 -- start start 2023-10-24T00:44:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea1ddc2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 0x7fea180c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea1ddc2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea1ddc2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180aa820 con 0x7fea180aa010 2023-10-24T00:44:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea1ddc2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c0960 con 0x7fea180aa3f0 2023-10-24T00:44:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea1ddc2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c0c40 con 0x7fea180c6710 2023-10-24T00:44:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea17fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea177fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fea180aa010 0x7fea18158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48234/0 (socket says 172.21.15.148:48234) 2023-10-24T00:44:49.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.560+0000 7fea177fe700 1 -- 172.21.15.148:0/895795992 learned_addr learned my addr 172.21.15.148:0/895795992 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea16ffd700 1 --2- 172.21.15.148:0/895795992 >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 0x7fea180c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea17fff700 1 -- 172.21.15.148:0/895795992 >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 msgr2=0x7fea180c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea17fff700 1 --2- 172.21.15.148:0/895795992 >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 0x7fea180c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea17fff700 1 -- 172.21.15.148:0/895795992 >> v1:172.21.15.148:6789/0 conn(0x7fea180aa010 legacy=0x7fea18158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea167fc700 1 -- 172.21.15.148:0/895795992 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779693963 0 0) 0x7fea180aa820 con 0x7fea180aa010 2023-10-24T00:44:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea17fff700 1 -- 172.21.15.148:0/895795992 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180c0f20 con 0x7fea180aa3f0 2023-10-24T00:44:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea16ffd700 1 --2- 172.21.15.148:0/895795992 >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 0x7fea180c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:49.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea17fff700 1 --2- 172.21.15.148:0/895795992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea18069d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fea18157d00 tx=0x7fea10009060).ready entity=mon.0 client_cookie=331a6bb8cac38632 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea167fc700 1 -- 172.21.15.148:0/895795992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000b580 con 0x7fea180aa3f0 2023-10-24T00:44:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea167fc700 1 -- 172.21.15.148:0/895795992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000b6e0 con 0x7fea180aa3f0 2023-10-24T00:44:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea167fc700 1 -- 172.21.15.148:0/895795992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000ba60 con 0x7fea180aa3f0 2023-10-24T00:44:49.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 -- 172.21.15.148:0/895795992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 msgr2=0x7fea18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/895795992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea18069d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fea18157d00 tx=0x7fea10009060).stop 2023-10-24T00:44:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 -- 172.21.15.148:0/895795992 shutdown_connections 2023-10-24T00:44:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/895795992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/895795992 >> v2:172.21.15.150:3300/0 conn(0x7fea180c6710 0x7fea180c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 -- 172.21.15.148:0/895795992 >> 172.21.15.148:0/895795992 conn(0x7fea180caf40 msgr2=0x7fea180cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 -- 172.21.15.148:0/895795992 shutdown_connections 2023-10-24T00:44:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.561+0000 7fea1ddc2700 1 -- 172.21.15.148:0/895795992 wait complete. 2023-10-24T00:44:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 Processor -- start 2023-10-24T00:44:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 -- start start 2023-10-24T00:44:49.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180aa3f0 0x7fea180c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180c6710 0x7fea180ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18157980 con 0x7fea180aa010 2023-10-24T00:44:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c2ed0 con 0x7fea180aa3f0 2023-10-24T00:44:49.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.563+0000 7fea1ddc2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c46c0 con 0x7fea180c6710 2023-10-24T00:44:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54720/0 (socket says 172.21.15.148:54720) 2023-10-24T00:44:49.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 -- 172.21.15.148:0/1861744097 learned_addr learned my addr 172.21.15.148:0/1861744097 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 -- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180c6710 msgr2=0x7fea180ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180c6710 0x7fea180ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 -- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180aa3f0 msgr2=0x7fea180c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180aa3f0 0x7fea180c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:49.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 -- 172.21.15.148:0/1861744097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100092a0 con 0x7fea180aa010 2023-10-24T00:44:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea177fe700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fea0800c960 tx=0x7fea08001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800cea0 con 0x7fea180aa010 2023-10-24T00:44:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08005d30 con 0x7fea180aa010 2023-10-24T00:44:49.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180c1fe0 con 0x7fea180aa010 2023-10-24T00:44:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08005ea0 con 0x7fea180aa010 2023-10-24T00:44:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.564+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180c25a0 con 0x7fea180aa010 2023-10-24T00:44:49.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.565+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1806c6b0 con 0x7fea180aa010 2023-10-24T00:44:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.565+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fea080075f0 con 0x7fea180aa010 2023-10-24T00:44:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.566+0000 7fe9ff7fe700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.566+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fea0807a1d0 con 0x7fea180aa010 2023-10-24T00:44:49.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.566+0000 7fea16ffd700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.566+0000 7fea16ffd700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fea180a9fe0 tx=0x7fea0c008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:49.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.570+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea0804b670 con 0x7fea180aa010 2023-10-24T00:44:49.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.797+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fea180c1200 con 0x7fea180aa010 2023-10-24T00:44:49.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.797+0000 7fe9ff7fe700 1 -- 172.21.15.148:0/1861744097 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fea08001770 con 0x7fea180aa010 2023-10-24T00:44:49.800 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:49.801 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:44:49.801 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:44:49.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.802 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:44:49.802 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:44:49.802 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.802 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.803 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:49.803 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:49.803 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.803 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.804 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:44:49.805 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:44:49.805 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.805 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.806 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:49.806 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:49.807 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.808 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:44:49.808 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:44:49.808 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.809 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.809 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:49.810 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:49.810 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.811 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:44:49.811 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:44:49.811 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.812 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.813 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:49.813 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:49.813 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.815 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:44:49.815 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:44:49.815 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.816 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.816 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.816 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.817 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.818 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:44:49.818 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:44:49.819 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.820 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.821 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:44:49.822 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:44:49.822 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.822 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.823 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.823 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.824 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:44:49.825 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:44:49.825 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.825 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.826 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.826 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.828 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:44:49.828 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:44:49.829 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.829 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.829 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.830 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.831 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:44:49.831 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:44:49.831 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.831 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.832 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.832 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.833 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:44:49.834 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:44:49.834 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.834 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.834 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:44:49.835 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:44:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:44:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:44:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.837 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:44:49.837 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:44:49.838 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.838 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.838 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:44:49.839 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:44:49.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.840 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:44:49.840 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:44:49.840 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.840 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.840 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:49.841 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:49.841 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:49.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.842 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:44:49.842 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:44:49.842 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.843 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.843 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:49.843 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:49.843 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:49.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.844 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:44:49.845 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:44:49.845 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.845 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:44:49.845 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:44:49.845 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:44:49.846 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:44:49.846 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.846 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:44:49.847 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:44:49.847 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.847 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:49.847 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:44:49.848 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:44:49.848 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.848 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.849 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:44:49.849 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:44:49.849 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.849 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:49.850 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:44:49.850 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:49.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:49.851 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:44:49.851 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:44:49.851 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:44:49.851 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:44:49.851 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:44:49.852 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:44:49.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:49.852 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:44:49.852 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:44:49.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 msgr2=0x7fea04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fea180a9fe0 tx=0x7fea0c008040).stop 2023-10-24T00:44:49.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 msgr2=0x7fea1814f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fea0800c960 tx=0x7fea08001630).stop 2023-10-24T00:44:49.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 shutdown_connections 2023-10-24T00:44:49.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180c6710 0x7fea180ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:49.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea1814f5c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 --2- 172.21.15.148:0/1861744097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180aa3f0 0x7fea180c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:44:49.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 >> 172.21.15.148:0/1861744097 conn(0x7fea180caf40 msgr2=0x7fea180aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:49.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 shutdown_connections 2023-10-24T00:44:49.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.799+0000 7fea1ddc2700 1 -- 172.21.15.148:0/1861744097 wait complete. 2023-10-24T00:44:49.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:49.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.970+0000 7fdf44993700 1 Processor -- start 2023-10-24T00:44:49.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.970+0000 7fdf44993700 1 -- start start 2023-10-24T00:44:49.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.971+0000 7fdf44993700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf4006a490 0x7fdf400c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.971+0000 7fdf44993700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf400c0960 con 0x7fdf400aa010 2023-10-24T00:44:49.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.971+0000 7fdf44993700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf400c0c40 con 0x7fdf400c6710 2023-10-24T00:44:49.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.971+0000 7fdf44993700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf400c0f20 con 0x7fdf4006a490 2023-10-24T00:44:49.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf4006a490 0x7fdf400c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdf400aa010 0x7fdf40158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48240/0 (socket says 172.21.15.148:48240) 2023-10-24T00:44:49.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3e59c700 1 -- 172.21.15.148:0/3634291434 learned_addr learned my addr 172.21.15.148:0/3634291434 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:49.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3634291434 >> v1:172.21.15.150:6789/0 conn(0x7fdf400c6710 legacy=0x7fdf40069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:49.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3634291434 >> v1:172.21.15.148:6789/0 conn(0x7fdf400aa010 legacy=0x7fdf40158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3d59a700 1 -- 172.21.15.148:0/3634291434 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085119640 0 0) 0x7fdf400c0960 con 0x7fdf400aa010 2023-10-24T00:44:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3634291434 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400c1200 con 0x7fdf4006a490 2023-10-24T00:44:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3ed9d700 1 --2- 172.21.15.148:0/3634291434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf4006a490 0x7fdf400c1a00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fdf30009760 tx=0x7fdf30009060).ready entity=mon.0 client_cookie=c6c031facd24fe44 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3d59a700 1 -- 172.21.15.148:0/3634291434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000b520 con 0x7fdf4006a490 2023-10-24T00:44:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3d59a700 1 -- 172.21.15.148:0/3634291434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3000b680 con 0x7fdf4006a490 2023-10-24T00:44:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.972+0000 7fdf3d59a700 1 -- 172.21.15.148:0/3634291434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000ba00 con 0x7fdf4006a490 2023-10-24T00:44:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 -- 172.21.15.148:0/3634291434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf4006a490 msgr2=0x7fdf400c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 --2- 172.21.15.148:0/3634291434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf4006a490 0x7fdf400c1a00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fdf30009760 tx=0x7fdf30009060).stop 2023-10-24T00:44:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 -- 172.21.15.148:0/3634291434 shutdown_connections 2023-10-24T00:44:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 --2- 172.21.15.148:0/3634291434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf4006a490 0x7fdf400c1a00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 -- 172.21.15.148:0/3634291434 >> 172.21.15.148:0/3634291434 conn(0x7fdf400caf40 msgr2=0x7fdf400cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 -- 172.21.15.148:0/3634291434 shutdown_connections 2023-10-24T00:44:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.973+0000 7fdf44993700 1 -- 172.21.15.148:0/3634291434 wait complete. 2023-10-24T00:44:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.974+0000 7fdf44993700 1 Processor -- start 2023-10-24T00:44:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.974+0000 7fdf44993700 1 -- start start 2023-10-24T00:44:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 0x7fdf40152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 0x7fdf40155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400ae9c0 con 0x7fdf400c6710 2023-10-24T00:44:49.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400b0f20 con 0x7fdf4006a490 2023-10-24T00:44:49.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400ae090 con 0x7fdf400aa010 2023-10-24T00:44:49.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54726/0 (socket says 172.21.15.148:54726) 2023-10-24T00:44:49.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3969696933 learned_addr learned my addr 172.21.15.148:0/3969696933 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:49.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3e59c700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 0x7fdf40152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3dd9b700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 0x7fdf40155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:49.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 msgr2=0x7fdf40155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 0x7fdf40155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 msgr2=0x7fdf40152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:49.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 0x7fdf40152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:49.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 -- 172.21.15.148:0/3969696933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300092a0 con 0x7fdf400c6710 2023-10-24T00:44:49.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3e59c700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 0x7fdf40152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:49.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3dd9b700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 0x7fdf40155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:49.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf3ed9d700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fdf30009eb0 tx=0x7fdf30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:49.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000ba00 con 0x7fdf400c6710 2023-10-24T00:44:49.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3001b410 con 0x7fdf400c6710 2023-10-24T00:44:49.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf400ae370 con 0x7fdf400c6710 2023-10-24T00:44:49.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001b7b0 con 0x7fdf400c6710 2023-10-24T00:44:49.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.975+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf40152f20 con 0x7fdf400c6710 2023-10-24T00:44:49.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.976+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf40153110 con 0x7fdf400c6710 2023-10-24T00:44:49.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.977+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdf3001bba0 con 0x7fdf400c6710 2023-10-24T00:44:49.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.977+0000 7fdf367fc700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 0x7fdf20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:49.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.977+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf3007c000 con 0x7fdf400c6710 2023-10-24T00:44:50.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.977+0000 7fdf3e59c700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 0x7fdf20061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.978+0000 7fdf3e59c700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 0x7fdf20061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdf38001e40 tx=0x7fdf38009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:49.981+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf3004d4a0 con 0x7fdf400c6710 2023-10-24T00:44:50.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.147+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf4006c6b0 con 0x7fdf400c6710 2023-10-24T00:44:50.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.148+0000 7fdf367fc700 1 -- 172.21.15.148:0/3969696933 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+13761 (secure 0 0 0) 0x7fdf30050ac0 con 0x7fdf400c6710 2023-10-24T00:44:50.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:50.152 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":92,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:49.412905+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:50.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 msgr2=0x7fdf20061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 0x7fdf20061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fdf38001e40 tx=0x7fdf38009040).stop 2023-10-24T00:44:50.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 msgr2=0x7fdf401559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fdf30009eb0 tx=0x7fdf30017000).stop 2023-10-24T00:44:50.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 shutdown_connections 2023-10-24T00:44:50.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf2005f270 0x7fdf20061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf400c6710 0x7fdf401559f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf4006a490 0x7fdf40152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 --2- 172.21.15.148:0/3969696933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf400aa010 0x7fdf40155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 >> 172.21.15.148:0/3969696933 conn(0x7fdf400caf40 msgr2=0x7fdf400c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 shutdown_connections 2023-10-24T00:44:50.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.150+0000 7fdf44993700 1 -- 172.21.15.148:0/3969696933 wait complete. 2023-10-24T00:44:50.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:44:50.167 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:44:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 Processor -- start 2023-10-24T00:44:50.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 -- start start 2023-10-24T00:44:50.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe558154430 0x7fe558154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 0x7fe5580c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580c71d0 con 0x7fe558098bd0 2023-10-24T00:44:50.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580c6a10 con 0x7fe558154430 2023-10-24T00:44:50.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.283+0000 7fe55ca0e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580c9410 con 0x7fe5580bffd0 2023-10-24T00:44:50.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe558154430 0x7fe558154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe54dd9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe558098bd0 0x7fe5580c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48248/0 (socket says 172.21.15.148:48248) 2023-10-24T00:44:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe54dd9b700 1 -- 172.21.15.148:0/3822148455 learned_addr learned my addr 172.21.15.148:0/3822148455 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe556d9d700 1 --2- 172.21.15.148:0/3822148455 >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 0x7fe5580c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 -- 172.21.15.148:0/3822148455 >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 msgr2=0x7fe5580c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 --2- 172.21.15.148:0/3822148455 >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 0x7fe5580c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe555d9b700 1 -- 172.21.15.148:0/3822148455 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004442616 0 0) 0x7fe5580c71d0 con 0x7fe558098bd0 2023-10-24T00:44:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 -- 172.21.15.148:0/3822148455 >> v1:172.21.15.148:6789/0 conn(0x7fe558098bd0 legacy=0x7fe5580c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 -- 172.21.15.148:0/3822148455 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580c0950 con 0x7fe558154430 2023-10-24T00:44:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe556d9d700 1 --2- 172.21.15.148:0/3822148455 >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 0x7fe5580c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe55659c700 1 --2- 172.21.15.148:0/3822148455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558154430 0x7fe558154810 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe5580aab20 tx=0x7fe548009060).ready entity=mon.0 client_cookie=af375d13faa4e4c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe555d9b700 1 -- 172.21.15.148:0/3822148455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800b580 con 0x7fe558154430 2023-10-24T00:44:50.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe555d9b700 1 -- 172.21.15.148:0/3822148455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54800b6e0 con 0x7fe558154430 2023-10-24T00:44:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.284+0000 7fe555d9b700 1 -- 172.21.15.148:0/3822148455 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800ba60 con 0x7fe558154430 2023-10-24T00:44:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3822148455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558154430 msgr2=0x7fe558154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3822148455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558154430 0x7fe558154810 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fe5580aab20 tx=0x7fe548009060).stop 2023-10-24T00:44:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3822148455 shutdown_connections 2023-10-24T00:44:50.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3822148455 >> v2:172.21.15.150:3300/0 conn(0x7fe5580bffd0 0x7fe5580c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3822148455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558154430 0x7fe558154810 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3822148455 >> 172.21.15.148:0/3822148455 conn(0x7fe5580cb070 msgr2=0x7fe5580cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3822148455 shutdown_connections 2023-10-24T00:44:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.285+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3822148455 wait complete. 2023-10-24T00:44:50.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.286+0000 7fe55ca0e700 1 Processor -- start 2023-10-24T00:44:50.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.286+0000 7fe55ca0e700 1 -- start start 2023-10-24T00:44:50.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 0x7fe558149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 0x7fe5580acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558149320 con 0x7fe558098bd0 2023-10-24T00:44:50.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580abfe0 con 0x7fe558154430 2023-10-24T00:44:50.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55ca0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55814c9f0 con 0x7fe5580bffd0 2023-10-24T00:44:50.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54740/0 (socket says 172.21.15.148:54740) 2023-10-24T00:44:50.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 -- 172.21.15.148:0/3479288856 learned_addr learned my addr 172.21.15.148:0/3479288856 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe54dd9b700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 0x7fe558149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe556d9d700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 0x7fe5580acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 -- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 msgr2=0x7fe558149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 0x7fe558149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 -- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 msgr2=0x7fe5580acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 0x7fe5580acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 -- 172.21.15.148:0/3479288856 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480092a0 con 0x7fe558098bd0 2023-10-24T00:44:50.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe54dd9b700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 0x7fe558149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:50.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe556d9d700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 0x7fe5580acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:50.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.287+0000 7fe55659c700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fe5580c5910 tx=0x7fe548017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.288+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800ba60 con 0x7fe558098bd0 2023-10-24T00:44:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.288+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548000c90 con 0x7fe558098bd0 2023-10-24T00:44:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.288+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54801b640 con 0x7fe558098bd0 2023-10-24T00:44:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.288+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55814ccd0 con 0x7fe558098bd0 2023-10-24T00:44:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.288+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5580abc70 con 0x7fe558098bd0 2023-10-24T00:44:50.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.289+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55806c6b0 con 0x7fe558098bd0 2023-10-24T00:44:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.289+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe54801ba70 con 0x7fe558098bd0 2023-10-24T00:44:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.290+0000 7fe54effd700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 0x7fe538061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.290+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe54807bf10 con 0x7fe558098bd0 2023-10-24T00:44:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.290+0000 7fe54dd9b700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 0x7fe538061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.290+0000 7fe54dd9b700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 0x7fe538061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe540007fd0 tx=0x7fe540009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.293+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe54804d470 con 0x7fe558098bd0 2023-10-24T00:44:50.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.458+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe558062c40 con 0x7fe558098bd0 2023-10-24T00:44:50.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.459+0000 7fe54effd700 1 -- 172.21.15.148:0/3479288856 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v92) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe54801f020 con 0x7fe558098bd0 2023-10-24T00:44:50.462 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:44:50.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 msgr2=0x7fe538061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 0x7fe538061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fe540007fd0 tx=0x7fe540009040).stop 2023-10-24T00:44:50.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 msgr2=0x7fe558148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fe5580c5910 tx=0x7fe548017000).stop 2023-10-24T00:44:50.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 shutdown_connections 2023-10-24T00:44:50.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe558154430 0x7fe5580acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe53805f270 0x7fe538061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe558098bd0 0x7fe558148880 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 --2- 172.21.15.148:0/3479288856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5580bffd0 0x7fe558149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 >> 172.21.15.148:0/3479288856 conn(0x7fe5580cb070 msgr2=0x7fe5580a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 shutdown_connections 2023-10-24T00:44:50.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.461+0000 7fe55ca0e700 1 -- 172.21.15.148:0/3479288856 wait complete. 2023-10-24T00:44:50.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:44:50.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.590+0000 7f40feec9700 1 Processor -- start 2023-10-24T00:44:50.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.590+0000 7f40feec9700 1 -- start start 2023-10-24T00:44:50.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40feec9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f40f8154430 0x7f40f8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40feec9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80c71d0 con 0x7f40f8098bd0 2023-10-24T00:44:50.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40feec9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80c9410 con 0x7f40f80bffd0 2023-10-24T00:44:50.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40feec9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80c6a10 con 0x7f40f8154430 2023-10-24T00:44:50.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40f7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f40f8098bd0 0x7f40f80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48260/0 (socket says 172.21.15.148:48260) 2023-10-24T00:44:50.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40f7fff700 1 -- 172.21.15.148:0/829870050 learned_addr learned my addr 172.21.15.148:0/829870050 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:50.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40fcc65700 1 --2- 172.21.15.148:0/829870050 >> v2:172.21.15.150:3300/0 conn(0x7f40f8154430 0x7f40f8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275107377 0 0) 0x7f40f80c71d0 con 0x7f40f8098bd0 2023-10-24T00:44:50.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e40033f0 con 0x7f40f8098bd0 2023-10-24T00:44:50.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40fcc65700 1 -- 172.21.15.148:0/829870050 >> v1:172.21.15.150:6789/0 conn(0x7f40f80bffd0 legacy=0x7f40f815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260395524 0 0) 0x7f40f80c9410 con 0x7f40f80bffd0 2023-10-24T00:44:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40fcc65700 1 -- 172.21.15.148:0/829870050 >> v1:172.21.15.148:6789/0 conn(0x7f40f8098bd0 legacy=0x7f40f80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.591+0000 7f40fcc65700 1 -- 172.21.15.148:0/829870050 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80ca8b0 con 0x7f40f8154430 2023-10-24T00:44:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40fcc65700 1 --2- 172.21.15.148:0/829870050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f8154430 0x7f40f8154810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f40f0009e60 tx=0x7f40f0009780).ready entity=mon.1 client_cookie=f87cd178b3494900 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000e070 con 0x7f40f8154430 2023-10-24T00:44:50.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000b850 con 0x7f40f8154430 2023-10-24T00:44:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40f77fe700 1 -- 172.21.15.148:0/829870050 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8001470 con 0x7f40f8154430 2023-10-24T00:44:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 -- 172.21.15.148:0/829870050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f8154430 msgr2=0x7f40f8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 --2- 172.21.15.148:0/829870050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f8154430 0x7f40f8154810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f40f0009e60 tx=0x7f40f0009780).stop 2023-10-24T00:44:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 -- 172.21.15.148:0/829870050 shutdown_connections 2023-10-24T00:44:50.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 --2- 172.21.15.148:0/829870050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f8154430 0x7f40f8154810 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 -- 172.21.15.148:0/829870050 >> 172.21.15.148:0/829870050 conn(0x7f40f80cb070 msgr2=0x7f40f80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 -- 172.21.15.148:0/829870050 shutdown_connections 2023-10-24T00:44:50.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.592+0000 7f40feec9700 1 -- 172.21.15.148:0/829870050 wait complete. 2023-10-24T00:44:50.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.593+0000 7f40feec9700 1 Processor -- start 2023-10-24T00:44:50.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 -- start start 2023-10-24T00:44:50.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 0x7f40f80ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f80bffd0 0x7f40f814ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80c3340 con 0x7f40f8154430 2023-10-24T00:44:50.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80c2730 con 0x7f40f80bffd0 2023-10-24T00:44:50.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40feec9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80c2a10 con 0x7f40f8098bd0 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40fd466700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40fd466700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54750/0 (socket says 172.21.15.148:54750) 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.594+0000 7f40fd466700 1 -- 172.21.15.148:0/472936215 learned_addr learned my addr 172.21.15.148:0/472936215 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fcc65700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 0x7f40f80ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40f7fff700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f80bffd0 0x7f40f814ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 -- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 msgr2=0x7f40f80ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 0x7f40f80ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 -- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f80bffd0 msgr2=0x7f40f814ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f80bffd0 0x7f40f814ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 -- 172.21.15.148:0/472936215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009a20 con 0x7f40f8154430 2023-10-24T00:44:50.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fcc65700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 0x7f40f80ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:50.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40fd466700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f40e000c490 tx=0x7f40e0007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000ce90 con 0x7f40f8154430 2023-10-24T00:44:50.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e000f470 con 0x7f40f8154430 2023-10-24T00:44:50.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f80c2cf0 con 0x7f40f8154430 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000f810 con 0x7f40f8154430 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.595+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f80c23e0 con 0x7f40f8154430 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.596+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f806c6b0 con 0x7f40f8154430 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.596+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f40e000fc00 con 0x7f40f8154430 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.597+0000 7f40f4ff9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 0x7f40d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.597+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f40e0079690 con 0x7f40f8154430 2023-10-24T00:44:50.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.597+0000 7f40fcc65700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 0x7f40d8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.597+0000 7f40fcc65700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 0x7f40d8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f40f0009480 tx=0x7f40f0009780).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.601+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f40e004ab30 con 0x7f40f8154430 2023-10-24T00:44:50.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.762+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40f8062c40 con 0x7f40f8154430 2023-10-24T00:44:50.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.763+0000 7f40f4ff9700 1 -- 172.21.15.148:0/472936215 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40e004e150 con 0x7f40f8154430 2023-10-24T00:44:50.766 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:44:50.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 msgr2=0x7f40d8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 0x7f40d8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f40f0009480 tx=0x7f40f0009780).stop 2023-10-24T00:44:50.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 msgr2=0x7f40f80af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f40e000c490 tx=0x7f40e0007bf0).stop 2023-10-24T00:44:50.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 shutdown_connections 2023-10-24T00:44:50.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f40d805f270 0x7f40d8061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f8154430 0x7f40f80af210 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40f8098bd0 0x7f40f80ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 --2- 172.21.15.148:0/472936215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40f80bffd0 0x7f40f814ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 >> 172.21.15.148:0/472936215 conn(0x7f40f80cb070 msgr2=0x7f40f81531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 shutdown_connections 2023-10-24T00:44:50.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.765+0000 7f40feec9700 1 -- 172.21.15.148:0/472936215 wait complete. 2023-10-24T00:44:50.779 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:44:50.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.891+0000 7f607b60c700 1 Processor -- start 2023-10-24T00:44:50.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.891+0000 7f607b60c700 1 -- start start 2023-10-24T00:44:50.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f607b60c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60740c6710 0x7f60740c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f607b60c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740aa820 con 0x7f60740aa3f0 2023-10-24T00:44:50.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f607b60c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c0960 con 0x7f60740aa010 2023-10-24T00:44:50.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f607b60c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740c0c40 con 0x7f60740c6710 2023-10-24T00:44:50.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f6078ba7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f60740c6710 0x7f60740c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f6079ba9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f60740aa3f0 0x7f6074069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48262/0 (socket says 172.21.15.148:48262) 2023-10-24T00:44:50.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.892+0000 7f6079ba9700 1 -- 172.21.15.148:0/3253012931 learned_addr learned my addr 172.21.15.148:0/3253012931 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:50.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f6078ba7700 1 -- 172.21.15.148:0/3253012931 >> v1:172.21.15.150:6789/0 conn(0x7f60740aa010 legacy=0x7f6074158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:50.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f6078ba7700 1 -- 172.21.15.148:0/3253012931 >> v1:172.21.15.148:6789/0 conn(0x7f60740aa3f0 legacy=0x7f6074069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f6078ba7700 1 -- 172.21.15.148:0/3253012931 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740c0f20 con 0x7f60740c6710 2023-10-24T00:44:50.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f606bfff700 1 -- 172.21.15.148:0/3253012931 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097019053 0 0) 0x7f60740aa820 con 0x7f60740aa3f0 2023-10-24T00:44:50.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f6078ba7700 1 --2- 172.21.15.148:0/3253012931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740c6710 0x7f60740c1a00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6064009760 tx=0x7f6064009060).ready entity=mon.0 client_cookie=57c2d74e9280c8cf server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f606bfff700 1 -- 172.21.15.148:0/3253012931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400b520 con 0x7f60740c6710 2023-10-24T00:44:50.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f606bfff700 1 -- 172.21.15.148:0/3253012931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400b680 con 0x7f60740c6710 2023-10-24T00:44:50.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f606bfff700 1 -- 172.21.15.148:0/3253012931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400ba00 con 0x7f60740c6710 2023-10-24T00:44:50.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f607b60c700 1 -- 172.21.15.148:0/3253012931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740c6710 msgr2=0x7f60740c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f607b60c700 1 --2- 172.21.15.148:0/3253012931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740c6710 0x7f60740c1a00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6064009760 tx=0x7f6064009060).stop 2023-10-24T00:44:50.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f607b60c700 1 -- 172.21.15.148:0/3253012931 shutdown_connections 2023-10-24T00:44:50.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f607b60c700 1 --2- 172.21.15.148:0/3253012931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740c6710 0x7f60740c1a00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.893+0000 7f607b60c700 1 -- 172.21.15.148:0/3253012931 >> 172.21.15.148:0/3253012931 conn(0x7f60740caf40 msgr2=0x7f60740cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:50.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.894+0000 7f607b60c700 1 -- 172.21.15.148:0/3253012931 shutdown_connections 2023-10-24T00:44:50.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.894+0000 7f607b60c700 1 -- 172.21.15.148:0/3253012931 wait complete. 2023-10-24T00:44:50.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.895+0000 7f607b60c700 1 Processor -- start 2023-10-24T00:44:50.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.895+0000 7f607b60c700 1 -- start start 2023-10-24T00:44:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740aa010 0x7f60741404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 0x7f607406a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607406a760 con 0x7f60740aa3f0 2023-10-24T00:44:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60741679f0 con 0x7f60740aa010 2023-10-24T00:44:50.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074168570 con 0x7f60740c6710 2023-10-24T00:44:50.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54768/0 (socket says 172.21.15.148:54768) 2023-10-24T00:44:50.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 -- 172.21.15.148:0/1071131694 learned_addr learned my addr 172.21.15.148:0/1071131694 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:50.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f60793a8700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740aa010 0x7f60741404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6079ba9700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 0x7f607406a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 -- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 msgr2=0x7f607406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 0x7f607406a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 -- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740aa010 msgr2=0x7f60741404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:50.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740aa010 0x7f60741404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:50.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 -- 172.21.15.148:0/1071131694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640092a0 con 0x7f60740aa3f0 2023-10-24T00:44:50.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6079ba9700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 0x7f607406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:50.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f6078ba7700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6064006df0 tx=0x7f6064017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400b7f0 con 0x7f60740aa3f0 2023-10-24T00:44:50.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400b950 con 0x7f60740aa3f0 2023-10-24T00:44:50.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740aee10 con 0x7f60740aa3f0 2023-10-24T00:44:50.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606401b620 con 0x7f60740aa3f0 2023-10-24T00:44:50.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.896+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6074167f20 con 0x7f60740aa3f0 2023-10-24T00:44:50.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.897+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607406c6b0 con 0x7f60740aa3f0 2023-10-24T00:44:50.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.898+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f606401b9d0 con 0x7f60740aa3f0 2023-10-24T00:44:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.898+0000 7f60697fa700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 0x7f6058061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.898+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f606407bb00 con 0x7f60740aa3f0 2023-10-24T00:44:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.898+0000 7f60793a8700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 0x7f6058061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:50.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.899+0000 7f60793a8700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 0x7f6058061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6070003e80 tx=0x7f6070009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:50.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:50.902+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f606404cfa0 con 0x7f60740aa3f0 2023-10-24T00:44:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.067+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60740c1200 con 0x7f60740aa3f0 2023-10-24T00:44:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.068+0000 7f60697fa700 1 -- 172.21.15.148:0/1071131694 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6064029020 con 0x7f60740aa3f0 2023-10-24T00:44:51.071 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:51.071 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:44:51.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:51.071 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:44:51.072 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:44:51.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:44:51.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:44:51.072 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:44:51.072 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:44:51.073 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:44:51.073 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:44:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 msgr2=0x7f6058061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 0x7f6058061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6070003e80 tx=0x7f6070009040).stop 2023-10-24T00:44:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 msgr2=0x7f6074069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6064006df0 tx=0x7f6064017000).stop 2023-10-24T00:44:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 shutdown_connections 2023-10-24T00:44:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60740c6710 0x7f607406a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60740aa010 0x7f60741404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f605805f270 0x7f6058061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 --2- 172.21.15.148:0/1071131694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60740aa3f0 0x7f6074069d80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 >> 172.21.15.148:0/1071131694 conn(0x7f60740caf40 msgr2=0x7f60740ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 shutdown_connections 2023-10-24T00:44:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.070+0000 7f607b60c700 1 -- 172.21.15.148:0/1071131694 wait complete. 2023-10-24T00:44:51.084 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:44:51.085 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:44:51.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.200+0000 7f9b763a1700 1 Processor -- start 2023-10-24T00:44:51.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.200+0000 7f9b763a1700 1 -- start start 2023-10-24T00:44:51.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b763a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b70155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b763a1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700c7770 con 0x7f9b700c81e0 2023-10-24T00:44:51.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b763a1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700c8690 con 0x7f9b700aa320 2023-10-24T00:44:51.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b763a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700c1070 con 0x7f9b700a9f40 2023-10-24T00:44:51.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b75ba0700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9b700c81e0 0x7f9b70153b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48264/0 (socket says 172.21.15.148:48264) 2023-10-24T00:44:51.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b75ba0700 1 -- 172.21.15.148:0/2463709458 learned_addr learned my addr 172.21.15.148:0/2463709458 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:51.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b7539f700 1 --2- 172.21.15.148:0/2463709458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b70155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.201+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35090950 0 0) 0x7f9b700c7770 con 0x7f9b700c81e0 2023-10-24T00:44:51.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c0033f0 con 0x7f9b700c81e0 2023-10-24T00:44:51.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160377442 0 0) 0x7f9b700c8690 con 0x7f9b700aa320 2023-10-24T00:44:51.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b700c7770 con 0x7f9b700aa320 2023-10-24T00:44:51.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3801546118 0 0) 0x7f9b5c0033f0 con 0x7f9b700c81e0 2023-10-24T00:44:51.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b7539f700 1 -- 172.21.15.148:0/2463709458 >> v1:172.21.15.150:6789/0 conn(0x7f9b700aa320 legacy=0x7f9b700c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b7539f700 1 -- 172.21.15.148:0/2463709458 >> v1:172.21.15.148:6789/0 conn(0x7f9b700c81e0 legacy=0x7f9b70153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b7539f700 1 -- 172.21.15.148:0/2463709458 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700c79e0 con 0x7f9b700a9f40 2023-10-24T00:44:51.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b7539f700 1 --2- 172.21.15.148:0/2463709458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b70155350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9b6c009760 tx=0x7f9b6c006f40).ready entity=mon.2 client_cookie=49fe4d4905100499 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:51.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680017f0 con 0x7f9b700a9f40 2023-10-24T00:44:51.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c005880 con 0x7f9b700a9f40 2023-10-24T00:44:51.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.202+0000 7f9b67fff700 1 -- 172.21.15.148:0/2463709458 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c005c00 con 0x7f9b700a9f40 2023-10-24T00:44:51.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 -- 172.21.15.148:0/2463709458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 msgr2=0x7f9b70155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 --2- 172.21.15.148:0/2463709458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b70155350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9b6c009760 tx=0x7f9b6c006f40).stop 2023-10-24T00:44:51.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 -- 172.21.15.148:0/2463709458 shutdown_connections 2023-10-24T00:44:51.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 --2- 172.21.15.148:0/2463709458 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b70155350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 -- 172.21.15.148:0/2463709458 >> 172.21.15.148:0/2463709458 conn(0x7f9b70094420 msgr2=0x7f9b7006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:51.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 -- 172.21.15.148:0/2463709458 shutdown_connections 2023-10-24T00:44:51.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.203+0000 7f9b763a1700 1 -- 172.21.15.148:0/2463709458 wait complete. 2023-10-24T00:44:51.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.204+0000 7f9b763a1700 1 Processor -- start 2023-10-24T00:44:51.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.204+0000 7f9b763a1700 1 -- start start 2023-10-24T00:44:51.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b700c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c81e0 0x7f9b70064250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700aea40 con 0x7f9b700aa320 2023-10-24T00:44:51.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700ade30 con 0x7f9b700c81e0 2023-10-24T00:44:51.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700ae110 con 0x7f9b700a9f40 2023-10-24T00:44:51.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54780/0 (socket says 172.21.15.148:54780) 2023-10-24T00:44:51.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 -- 172.21.15.148:0/3259458046 learned_addr learned my addr 172.21.15.148:0/3259458046 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:51.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b7539f700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b700c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b75ba0700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c81e0 0x7f9b70064250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 -- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 msgr2=0x7f9b700c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b700c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 -- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c81e0 msgr2=0x7f9b70064250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c81e0 0x7f9b70064250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 -- 172.21.15.148:0/3259458046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c009250 con 0x7f9b700aa320 2023-10-24T00:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b74b9e700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f9b6000c420 tx=0x7f9b60007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60012400 con 0x7f9b700aa320 2023-10-24T00:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60012560 con 0x7f9b700aa320 2023-10-24T00:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60012920 con 0x7f9b700aa320 2023-10-24T00:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b700ae3f0 con 0x7f9b700aa320 2023-10-24T00:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.205+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b700aeed0 con 0x7f9b700aa320 2023-10-24T00:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.206+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b700aebb0 con 0x7f9b700aa320 2023-10-24T00:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.207+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9b6001b3b0 con 0x7f9b700aa320 2023-10-24T00:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.207+0000 7f9b657fa700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 0x7f9b54061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.207+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9b600797a0 con 0x7f9b700aa320 2023-10-24T00:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.207+0000 7f9b7539f700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 0x7f9b54061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.208+0000 7f9b7539f700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 0x7f9b54061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9b6c006cd0 tx=0x7f9b6c015000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:51.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.211+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b6004abe0 con 0x7f9b700aa320 2023-10-24T00:44:51.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.377+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f9b70047480 con 0x7f9b700aa320 2023-10-24T00:44:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.844+0000 7f9b657fa700 1 -- 172.21.15.148:0/3259458046 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 152+0+0 (secure 0 0 0) 0x7f9b6004e200 con 0x7f9b700aa320 2023-10-24T00:44:51.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 msgr2=0x7f9b54061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 0x7f9b54061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9b6c006cd0 tx=0x7f9b6c015000).stop 2023-10-24T00:44:51.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 msgr2=0x7f9b70156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f9b6000c420 tx=0x7f9b60007c60).stop 2023-10-24T00:44:51.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 shutdown_connections 2023-10-24T00:44:51.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b700c81e0 0x7f9b70064250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b700a9f40 0x7f9b700c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b5405f270 0x7f9b54061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 --2- 172.21.15.148:0/3259458046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b700aa320 0x7f9b70156230 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 >> 172.21.15.148:0/3259458046 conn(0x7f9b70094420 msgr2=0x7f9b70150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:51.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 shutdown_connections 2023-10-24T00:44:51.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.848+0000 7f9b763a1700 1 -- 172.21.15.148:0/3259458046 wait complete. 2023-10-24T00:44:51.855 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:44:51.865 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:44:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.983+0000 7f52ab366700 1 Processor -- start 2023-10-24T00:44:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.983+0000 7f52ab366700 1 -- start start 2023-10-24T00:44:51.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52ab366700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52a4098bd0 0x7f52a4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52ab366700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40c71d0 con 0x7f52a40bffd0 2023-10-24T00:44:51.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52ab366700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40c9410 con 0x7f52a4154430 2023-10-24T00:44:51.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52ab366700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40c6a10 con 0x7f52a4098bd0 2023-10-24T00:44:51.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52a8901700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52a4098bd0 0x7f52a4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52a8901700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52a4098bd0 0x7f52a4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54796/0 (socket says 172.21.15.148:54796) 2023-10-24T00:44:51.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52a9903700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f52a40bffd0 0x7f52a415e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48280/0 (socket says 172.21.15.148:48280) 2023-10-24T00:44:51.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.984+0000 7f52a8901700 1 -- 172.21.15.148:0/3853167505 learned_addr learned my addr 172.21.15.148:0/3853167505 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:51.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52a8901700 1 -- 172.21.15.148:0/3853167505 >> v1:172.21.15.150:6789/0 conn(0x7f52a4154430 legacy=0x7f52a40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:51.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52a8901700 1 -- 172.21.15.148:0/3853167505 >> v1:172.21.15.148:6789/0 conn(0x7f52a40bffd0 legacy=0x7f52a415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52a8901700 1 -- 172.21.15.148:0/3853167505 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40ca8b0 con 0x7f52a4098bd0 2023-10-24T00:44:51.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f529bfff700 1 -- 172.21.15.148:0/3853167505 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964582426 0 0) 0x7f52a40c71d0 con 0x7f52a40bffd0 2023-10-24T00:44:51.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52a8901700 1 --2- 172.21.15.148:0/3853167505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4098bd0 0x7f52a4154810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f5294006fd0 tx=0x7f52940090f0).ready entity=mon.0 client_cookie=3be5712c393d3d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:51.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f529bfff700 1 -- 172.21.15.148:0/3853167505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529400b600 con 0x7f52a4098bd0 2023-10-24T00:44:51.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f529bfff700 1 -- 172.21.15.148:0/3853167505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529400b760 con 0x7f52a4098bd0 2023-10-24T00:44:51.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f529bfff700 1 -- 172.21.15.148:0/3853167505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529400bae0 con 0x7f52a4098bd0 2023-10-24T00:44:51.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52ab366700 1 -- 172.21.15.148:0/3853167505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4098bd0 msgr2=0x7f52a4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52ab366700 1 --2- 172.21.15.148:0/3853167505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4098bd0 0x7f52a4154810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f5294006fd0 tx=0x7f52940090f0).stop 2023-10-24T00:44:51.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52ab366700 1 -- 172.21.15.148:0/3853167505 shutdown_connections 2023-10-24T00:44:51.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52ab366700 1 --2- 172.21.15.148:0/3853167505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a4098bd0 0x7f52a4154810 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:51.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.985+0000 7f52ab366700 1 -- 172.21.15.148:0/3853167505 >> 172.21.15.148:0/3853167505 conn(0x7f52a40cb070 msgr2=0x7f52a40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:51.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.986+0000 7f52ab366700 1 -- 172.21.15.148:0/3853167505 shutdown_connections 2023-10-24T00:44:51.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.986+0000 7f52ab366700 1 -- 172.21.15.148:0/3853167505 wait complete. 2023-10-24T00:44:51.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.987+0000 7f52ab366700 1 Processor -- start 2023-10-24T00:44:51.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.987+0000 7f52ab366700 1 -- start start 2023-10-24T00:44:51.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.987+0000 7f52ab366700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 0x7f52a4143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 0x7f52a40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:51.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4144ca0 con 0x7f52a40bffd0 2023-10-24T00:44:51.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4159ba0 con 0x7f52a4098bd0 2023-10-24T00:44:51.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a41598c0 con 0x7f52a4154430 2023-10-24T00:44:51.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54810/0 (socket says 172.21.15.148:54810) 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 -- 172.21.15.148:0/2189774996 learned_addr learned my addr 172.21.15.148:0/2189774996 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a9102700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 0x7f52a4143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 -- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 msgr2=0x7f52a40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a9903700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 0x7f52a40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:51.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 0x7f52a40c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 -- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 msgr2=0x7f52a4143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:52.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 0x7f52a4143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 -- 172.21.15.148:0/2189774996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009370 con 0x7f52a40bffd0 2023-10-24T00:44:52.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a9102700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 0x7f52a4143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:52.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a9903700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 0x7f52a40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:52.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52a8901700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f52a40c5910 tx=0x7f5294017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:52.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529400bae0 con 0x7f52a40bffd0 2023-10-24T00:44:52.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294000c90 con 0x7f52a40bffd0 2023-10-24T00:44:52.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4144650 con 0x7f52a40bffd0 2023-10-24T00:44:52.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529401a430 con 0x7f52a40bffd0 2023-10-24T00:44:52.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.988+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40c4720 con 0x7f52a40bffd0 2023-10-24T00:44:52.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.989+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4144e10 con 0x7f52a40bffd0 2023-10-24T00:44:52.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.989+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5294021020 con 0x7f52a40bffd0 2023-10-24T00:44:52.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.990+0000 7f52997fa700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 0x7f5288061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:52.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.990+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f529407b8f0 con 0x7f52a40bffd0 2023-10-24T00:44:52.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.990+0000 7f52a9102700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 0x7f5288061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:52.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.990+0000 7f52a9102700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 0x7f5288061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f52a0007b00 tx=0x7f52a0008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:52.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:51.994+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f529404cc20 con 0x7f52a40bffd0 2023-10-24T00:44:52.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.158+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f52a406c6b0 con 0x7f52a40bffd0 2023-10-24T00:44:52.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.847+0000 7f52997fa700 1 -- 172.21.15.148:0/2189774996 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5294029030 con 0x7f52a40bffd0 2023-10-24T00:44:52.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.852+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 msgr2=0x7f5288061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:52.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.852+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 0x7f5288061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f52a0007b00 tx=0x7f52a0008040).stop 2023-10-24T00:44:52.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.852+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 msgr2=0x7f52a40c3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:52.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.852+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f52a40c5910 tx=0x7f5294017000).stop 2023-10-24T00:44:52.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 shutdown_connections 2023-10-24T00:44:52.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52a4154430 0x7f52a40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52a4098bd0 0x7f52a4143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f528805f270 0x7f5288061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 --2- 172.21.15.148:0/2189774996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52a40bffd0 0x7f52a40c3d40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:52.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.853+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 >> 172.21.15.148:0/2189774996 conn(0x7f52a40cb070 msgr2=0x7f52a40a82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:52.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.855+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 shutdown_connections 2023-10-24T00:44:52.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.855+0000 7f52ab366700 1 -- 172.21.15.148:0/2189774996 wait complete. 2023-10-24T00:44:52.859 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:44:52.878 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:44:52.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.993+0000 7fe22bd24700 1 Processor -- start 2023-10-24T00:44:52.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.993+0000 7fe22bd24700 1 -- start start 2023-10-24T00:44:53.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe22bd24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2240c06e0 0x7fe224154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe22bd24700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240c71d0 con 0x7fe224098bd0 2023-10-24T00:44:53.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe22bd24700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2240c9410 con 0x7fe224154430 2023-10-24T00:44:53.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe22bd24700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2240c6a10 con 0x7fe2240c06e0 2023-10-24T00:44:53.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe2292bf700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe224098bd0 0x7fe2240bffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48292/0 (socket says 172.21.15.148:48292) 2023-10-24T00:44:53.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.994+0000 7fe2292bf700 1 -- 172.21.15.148:0/1808143421 learned_addr learned my addr 172.21.15.148:0/1808143421 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:53.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe22a2c1700 1 --2- 172.21.15.148:0/1808143421 >> v2:172.21.15.150:3300/0 conn(0x7fe2240c06e0 0x7fe224154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358914941 0 0) 0x7fe2240c71d0 con 0x7fe224098bd0 2023-10-24T00:44:53.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2100033f0 con 0x7fe224098bd0 2023-10-24T00:44:53.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504969994 0 0) 0x7fe2240c9410 con 0x7fe224154430 2023-10-24T00:44:53.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2240c71d0 con 0x7fe224154430 2023-10-24T00:44:53.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629604750 0 0) 0x7fe2100033f0 con 0x7fe224098bd0 2023-10-24T00:44:53.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 >> v2:172.21.15.150:3300/0 conn(0x7fe2240c06e0 msgr2=0x7fe224154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 --2- 172.21.15.148:0/1808143421 >> v2:172.21.15.150:3300/0 conn(0x7fe2240c06e0 0x7fe224154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 >> v1:172.21.15.150:6789/0 conn(0x7fe224154430 legacy=0x7fe2240c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240ca8b0 con 0x7fe224098bd0 2023-10-24T00:44:53.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe214001470 con 0x7fe224098bd0 2023-10-24T00:44:53.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 >> v1:172.21.15.148:6789/0 conn(0x7fe224098bd0 legacy=0x7fe2240bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 0x7fe210003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe210004690 0x7fe210004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210005000 0x7fe21000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2240c6a10 con 0x7fe210003a70 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000bf60 con 0x7fe210005000 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21000c0d0 con 0x7fe210004690 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 0x7fe210003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe2292bf700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe210004690 0x7fe210004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe22a2c1700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210005000 0x7fe21000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 -- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe210004690 msgr2=0x7fe210004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe210004690 0x7fe210004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 -- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210005000 msgr2=0x7fe21000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210005000 0x7fe21000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe229ac0700 1 -- 172.21.15.148:0/1808143421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100033f0 con 0x7fe210003a70 2023-10-24T00:44:53.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.995+0000 7fe22a2c1700 1 -- 172.21.15.148:0/1808143421 reap_dead start 2023-10-24T00:44:53.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe229ac0700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 0x7fe210003e70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fe220001890 tx=0x7fe220007bb0).ready entity=mon.0 client_cookie=2f90110bf85ec58e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220007020 con 0x7fe210003a70 2023-10-24T00:44:53.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe220007180 con 0x7fe210003a70 2023-10-24T00:44:53.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe228abe700 1 -- 172.21.15.148:0/1808143421 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220007500 con 0x7fe210003a70 2023-10-24T00:44:53.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 -- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 msgr2=0x7fe210003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 0x7fe210003e70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fe220001890 tx=0x7fe220007bb0).stop 2023-10-24T00:44:53.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 -- 172.21.15.148:0/1808143421 shutdown_connections 2023-10-24T00:44:53.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 --2- 172.21.15.148:0/1808143421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe210003a70 0x7fe210003e70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 -- 172.21.15.148:0/1808143421 >> 172.21.15.148:0/1808143421 conn(0x7fe2240cb070 msgr2=0x7fe2240cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 -- 172.21.15.148:0/1808143421 shutdown_connections 2023-10-24T00:44:53.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.996+0000 7fe22bd24700 1 -- 172.21.15.148:0/1808143421 wait complete. 2023-10-24T00:44:53.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.997+0000 7fe22bd24700 1 Processor -- start 2023-10-24T00:44:53.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.997+0000 7fe22bd24700 1 -- start start 2023-10-24T00:44:53.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210003a70 0x7fe2240ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe224151060 0x7fe2240b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224153870 con 0x7fe2240aab50 2023-10-24T00:44:53.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe224153030 con 0x7fe210003a70 2023-10-24T00:44:53.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22bd24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2241532b0 con 0x7fe224151060 2023-10-24T00:44:53.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe2292bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe2292bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54828/0 (socket says 172.21.15.148:54828) 2023-10-24T00:44:53.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe2292bf700 1 -- 172.21.15.148:0/905181535 learned_addr learned my addr 172.21.15.148:0/905181535 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe229ac0700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210003a70 0x7fe2240ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.998+0000 7fe22a2c1700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe224151060 0x7fe2240b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 -- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe224151060 msgr2=0x7fe2240b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe224151060 0x7fe2240b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 -- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210003a70 msgr2=0x7fe2240ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210003a70 0x7fe2240ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 -- 172.21.15.148:0/905181535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224153590 con 0x7fe2240aab50 2023-10-24T00:44:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe2292bf700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fe214001ba0 tx=0x7fe2240caa40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140114c0 con 0x7fe2240aab50 2023-10-24T00:44:53.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214011620 con 0x7fe2240aab50 2023-10-24T00:44:53.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2240c3aa0 con 0x7fe2240aab50 2023-10-24T00:44:53.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140119c0 con 0x7fe2240aab50 2023-10-24T00:44:53.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:52.999+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2241514e0 con 0x7fe2240aab50 2023-10-24T00:44:53.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.000+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2240c3900 con 0x7fe2240aab50 2023-10-24T00:44:53.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.001+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe21401d3b0 con 0x7fe2240aab50 2023-10-24T00:44:53.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.001+0000 7fe219ffb700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 0x7fe208061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.001+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe214079b40 con 0x7fe2240aab50 2023-10-24T00:44:53.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.001+0000 7fe229ac0700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 0x7fe208061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.002+0000 7fe229ac0700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 0x7fe208061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe220000c00 tx=0x7fe220015000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.005+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2240c3900 con 0x7fe2240aab50 2023-10-24T00:44:53.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.212+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe2240c3900 con 0x7fe2240aab50 2023-10-24T00:44:53.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.225+0000 7fe219ffb700 1 -- 172.21.15.148:0/905181535 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe2240c3900 con 0x7fe2240aab50 2023-10-24T00:44:53.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.231+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 msgr2=0x7fe208061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.231+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 0x7fe208061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe220000c00 tx=0x7fe220015000).stop 2023-10-24T00:44:53.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.231+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 msgr2=0x7fe224152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.231+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fe214001ba0 tx=0x7fe2240caa40).stop 2023-10-24T00:44:53.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 shutdown_connections 2023-10-24T00:44:53.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe224151060 0x7fe2240b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe210003a70 0x7fe2240ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe20805f270 0x7fe208061730 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0x7fe220000c00 tx=0x7fe220015000).stop 2023-10-24T00:44:53.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 --2- 172.21.15.148:0/905181535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2240aab50 0x7fe224152b40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.232+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 >> 172.21.15.148:0/905181535 conn(0x7fe2240cb070 msgr2=0x7fe2240a97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.235+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 shutdown_connections 2023-10-24T00:44:53.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.235+0000 7fe22bd24700 1 -- 172.21.15.148:0/905181535 wait complete. 2023-10-24T00:44:53.239 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 11 and data pool 12 2023-10-24T00:44:53.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:53.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.367+0000 7f07804e7700 1 Processor -- start 2023-10-24T00:44:53.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.367+0000 7f07804e7700 1 -- start start 2023-10-24T00:44:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.368+0000 7f07804e7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 0x7f07780699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.368+0000 7f07804e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07780aacd0 0x7f077813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f07804e7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f077813a7e0 0x7f0778065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f07804e7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077813ac70 con 0x7f077813a7e0 2023-10-24T00:44:53.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f07804e7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780c57b0 con 0x7f07780695f0 2023-10-24T00:44:53.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f07804e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c5a90 con 0x7f07780aacd0 2023-10-24T00:44:53.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f077813a7e0 0x7f0778065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f077813a7e0 0x7f0778065fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36624/0 (socket says 172.21.15.148:36624) 2023-10-24T00:44:53.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 -- 172.21.15.148:0/3272778630 learned_addr learned my addr 172.21.15.148:0/3272778630 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077e283700 1 --2- 172.21.15.148:0/3272778630 >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 0x7f07780699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077da82700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07780aacd0 0x7f077813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 -- 172.21.15.148:0/3272778630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07780aacd0 msgr2=0x7f077813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07780aacd0 0x7f077813a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 -- 172.21.15.148:0/3272778630 >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 msgr2=0x7f07780699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 --2- 172.21.15.148:0/3272778630 >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 0x7f07780699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 -- 172.21.15.148:0/3272778630 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780c5d70 con 0x7f077813a7e0 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077e283700 1 --2- 172.21.15.148:0/3272778630 >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 0x7f07780699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:53.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077ea84700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077813a7e0 0x7f0778065fb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f077000d1a0 tx=0x7f077000ba50).ready entity=mon.0 client_cookie=1e7a5c18ec7fcb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077d281700 1 -- 172.21.15.148:0/3272778630 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770010070 con 0x7f077813a7e0 2023-10-24T00:44:53.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077d281700 1 -- 172.21.15.148:0/3272778630 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000de80 con 0x7f077813a7e0 2023-10-24T00:44:53.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.369+0000 7f077d281700 1 -- 172.21.15.148:0/3272778630 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000b2e0 con 0x7f077813a7e0 2023-10-24T00:44:53.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 -- 172.21.15.148:0/3272778630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077813a7e0 msgr2=0x7f0778065fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077813a7e0 0x7f0778065fb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f077000d1a0 tx=0x7f077000ba50).stop 2023-10-24T00:44:53.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 -- 172.21.15.148:0/3272778630 shutdown_connections 2023-10-24T00:44:53.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f077813a7e0 0x7f0778065fb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 --2- 172.21.15.148:0/3272778630 >> v2:172.21.15.150:3300/0 conn(0x7f07780695f0 0x7f07780699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 --2- 172.21.15.148:0/3272778630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07780aacd0 0x7f077813a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 -- 172.21.15.148:0/3272778630 >> 172.21.15.148:0/3272778630 conn(0x7f07780641f0 msgr2=0x7f07780c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 -- 172.21.15.148:0/3272778630 shutdown_connections 2023-10-24T00:44:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.370+0000 7f07804e7700 1 -- 172.21.15.148:0/3272778630 wait complete. 2023-10-24T00:44:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.371+0000 7f07804e7700 1 Processor -- start 2023-10-24T00:44:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.371+0000 7f07804e7700 1 -- start start 2023-10-24T00:44:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07780aacd0 0x7f0778163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f077813a7e0 0x7f07781354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778136390 con 0x7f07780695f0 2023-10-24T00:44:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778163400 con 0x7f07780aacd0 2023-10-24T00:44:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f07804e7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0778135dd0 con 0x7f077813a7e0 2023-10-24T00:44:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36626/0 (socket says 172.21.15.148:36626) 2023-10-24T00:44:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 -- 172.21.15.148:0/1418493500 learned_addr learned my addr 172.21.15.148:0/1418493500 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077da82700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07780aacd0 0x7f0778163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077ea84700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f077813a7e0 0x7f07781354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 -- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f077813a7e0 msgr2=0x7f07781354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f077813a7e0 0x7f07781354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 -- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07780aacd0 msgr2=0x7f0778163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07780aacd0 0x7f0778163890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 -- 172.21.15.148:0/1418493500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077000bcf0 con 0x7f07780695f0 2023-10-24T00:44:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f077e283700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f077400d860 tx=0x7f0774008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.372+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400f520 con 0x7f07780695f0 2023-10-24T00:44:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.373+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400f680 con 0x7f07780695f0 2023-10-24T00:44:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.373+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07781360b0 con 0x7f07780695f0 2023-10-24T00:44:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.373+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400fa00 con 0x7f07780695f0 2023-10-24T00:44:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.373+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778163d80 con 0x7f07780695f0 2023-10-24T00:44:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.374+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07781636e0 con 0x7f07780695f0 2023-10-24T00:44:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.374+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0774013480 con 0x7f07780695f0 2023-10-24T00:44:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.374+0000 7f076e7fc700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.374+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0774079f90 con 0x7f07780695f0 2023-10-24T00:44:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.375+0000 7f077da82700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.375+0000 7f077da82700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f077813a230 tx=0x7f0768008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.379+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f077404eab0 con 0x7f07780695f0 2023-10-24T00:44:53.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.541+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0778154870 con 0x7f07780695f0 2023-10-24T00:44:53.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.542+0000 7f076e7fc700 1 -- 172.21.15.148:0/1418493500 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f077400b3f0 con 0x7f07780695f0 2023-10-24T00:44:53.545 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:53.545 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":95,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:53.214445+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:53.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 msgr2=0x7f075c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f077813a230 tx=0x7f0768008040).stop 2023-10-24T00:44:53.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 msgr2=0x7f07780c1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f077400d860 tx=0x7f0774008040).stop 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 shutdown_connections 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f077813a7e0 0x7f07781354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f075c05f270 0x7f075c061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780695f0 0x7f07780c1750 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 --2- 172.21.15.148:0/1418493500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07780aacd0 0x7f0778163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 >> 172.21.15.148:0/1418493500 conn(0x7f07780641f0 msgr2=0x7f0778137db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 shutdown_connections 2023-10-24T00:44:53.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.544+0000 7f07804e7700 1 -- 172.21.15.148:0/1418493500 wait complete. 2023-10-24T00:44:53.559 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:53.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.670+0000 7fe43d2ba700 1 Processor -- start 2023-10-24T00:44:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.670+0000 7fe43d2ba700 1 -- start start 2023-10-24T00:44:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 0x7fe438154120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe438064cb0 0x7fe4380650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4380be480 0x7fe4380be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380655e0 con 0x7fe438064cb0 2023-10-24T00:44:53.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4380c7510 con 0x7fe438153d40 2023-10-24T00:44:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43d2ba700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380bedc0 con 0x7fe4380be480 2023-10-24T00:44:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe438064cb0 0x7fe4380650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe438064cb0 0x7fe4380650f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36634/0 (socket says 172.21.15.148:36634) 2023-10-24T00:44:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 -- 172.21.15.148:0/1220655657 learned_addr learned my addr 172.21.15.148:0/1220655657 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe437fff700 1 --2- 172.21.15.148:0/1220655657 >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 0x7fe438154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe43cab9700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4380be480 0x7fe4380be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 -- 172.21.15.148:0/1220655657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4380be480 msgr2=0x7fe4380be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4380be480 0x7fe4380be8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 -- 172.21.15.148:0/1220655657 >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 msgr2=0x7fe438154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 --2- 172.21.15.148:0/1220655657 >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 0x7fe438154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe4377fe700 1 -- 172.21.15.148:0/1220655657 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4380a8470 con 0x7fe438064cb0 2023-10-24T00:44:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.671+0000 7fe437fff700 1 --2- 172.21.15.148:0/1220655657 >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 0x7fe438154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe4377fe700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe438064cb0 0x7fe4380650f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fe4380696b0 tx=0x7fe4280090f0).ready entity=mon.0 client_cookie=74da4d1efc92e811 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe436ffd700 1 -- 172.21.15.148:0/1220655657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800b600 con 0x7fe438064cb0 2023-10-24T00:44:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe436ffd700 1 -- 172.21.15.148:0/1220655657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800b760 con 0x7fe438064cb0 2023-10-24T00:44:53.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe436ffd700 1 -- 172.21.15.148:0/1220655657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800bae0 con 0x7fe438064cb0 2023-10-24T00:44:53.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 -- 172.21.15.148:0/1220655657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe438064cb0 msgr2=0x7fe4380650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe438064cb0 0x7fe4380650f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fe4380696b0 tx=0x7fe4280090f0).stop 2023-10-24T00:44:53.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 -- 172.21.15.148:0/1220655657 shutdown_connections 2023-10-24T00:44:53.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4380be480 0x7fe4380be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/1220655657 >> v2:172.21.15.150:3300/0 conn(0x7fe438153d40 0x7fe438154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/1220655657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe438064cb0 0x7fe4380650f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 -- 172.21.15.148:0/1220655657 >> 172.21.15.148:0/1220655657 conn(0x7fe4380922e0 msgr2=0x7fe438062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 -- 172.21.15.148:0/1220655657 shutdown_connections 2023-10-24T00:44:53.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.672+0000 7fe43d2ba700 1 -- 172.21.15.148:0/1220655657 wait complete. 2023-10-24T00:44:53.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.673+0000 7fe43d2ba700 1 Processor -- start 2023-10-24T00:44:53.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 -- start start 2023-10-24T00:44:53.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe438064cb0 0x7fe438092a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe438153d40 0x7fe4380aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe438092ef0 con 0x7fe4380be480 2023-10-24T00:44:53.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe438151d50 con 0x7fe438064cb0 2023-10-24T00:44:53.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe43d2ba700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe438152230 con 0x7fe438153d40 2023-10-24T00:44:53.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.674+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36646/0 (socket says 172.21.15.148:36646) 2023-10-24T00:44:53.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 -- 172.21.15.148:0/898078641 learned_addr learned my addr 172.21.15.148:0/898078641 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe43cab9700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe438153d40 0x7fe4380aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 -- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe438153d40 msgr2=0x7fe4380aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe438153d40 0x7fe4380aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 -- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe438064cb0 msgr2=0x7fe438092a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe437fff700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe438064cb0 0x7fe438092a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe438064cb0 0x7fe438092a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 -- 172.21.15.148:0/898078641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428009370 con 0x7fe4380be480 2023-10-24T00:44:53.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe4377fe700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe438065f00 tx=0x7fe428017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800b8d0 con 0x7fe4380be480 2023-10-24T00:44:53.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800ba50 con 0x7fe4380be480 2023-10-24T00:44:53.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4381660a0 con 0x7fe4380be480 2023-10-24T00:44:53.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42801c670 con 0x7fe4380be480 2023-10-24T00:44:53.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.675+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe438165770 con 0x7fe4380be480 2023-10-24T00:44:53.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.676+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe438096b50 con 0x7fe4380be480 2023-10-24T00:44:53.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.677+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe42801c9e0 con 0x7fe4380be480 2023-10-24T00:44:53.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.678+0000 7fe41ffff700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 0x7fe424061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.678+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe42807c590 con 0x7fe4380be480 2023-10-24T00:44:53.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.678+0000 7fe437fff700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 0x7fe424061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.678+0000 7fe437fff700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 0x7fe424061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe4380a7ef0 tx=0x7fe42c008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.681+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe4280511d0 con 0x7fe4380be480 2023-10-24T00:44:53.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.844+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe438166230 con 0x7fe4380be480 2023-10-24T00:44:53.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.845+0000 7fe41ffff700 1 -- 172.21.15.148:0/898078641 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16992 (secure 0 0 0) 0x7fe428050dc0 con 0x7fe4380be480 2023-10-24T00:44:53.848 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:53.848 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":95,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:53.214445+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 msgr2=0x7fe424061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 0x7fe424061700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe4380a7ef0 tx=0x7fe42c008040).stop 2023-10-24T00:44:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 msgr2=0x7fe438151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe438065f00 tx=0x7fe428017000).stop 2023-10-24T00:44:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 shutdown_connections 2023-10-24T00:44:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe438153d40 0x7fe4380aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe438064cb0 0x7fe438092a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe42405f240 0x7fe424061700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 --2- 172.21.15.148:0/898078641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4380be480 0x7fe438151860 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 >> 172.21.15.148:0/898078641 conn(0x7fe4380922e0 msgr2=0x7fe438152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 shutdown_connections 2023-10-24T00:44:53.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.847+0000 7fe43d2ba700 1 -- 172.21.15.148:0/898078641 wait complete. 2023-10-24T00:44:53.863 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:44:53.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.977+0000 7f93a6f4a700 1 Processor -- start 2023-10-24T00:44:53.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.977+0000 7f93a6f4a700 1 -- start start 2023-10-24T00:44:53.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a6f4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93a0154430 0x7f93a0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a6f4a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 0x7f93a00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a6f4a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00c71d0 con 0x7f93a00bffd0 2023-10-24T00:44:53.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a6f4a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00c9410 con 0x7f93a0154430 2023-10-24T00:44:53.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a6f4a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00c6c10 con 0x7f93a0098bd0 2023-10-24T00:44:53.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93a0154430 0x7f93a0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f93a0154430 0x7f93a0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36662/0 (socket says 172.21.15.148:36662) 2023-10-24T00:44:53.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 -- 172.21.15.148:0/2063274264 learned_addr learned my addr 172.21.15.148:0/2063274264 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f9397fff700 1 --2- 172.21.15.148:0/2063274264 >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 0x7f93a00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 -- 172.21.15.148:0/2063274264 >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 msgr2=0x7f93a00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:53.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 --2- 172.21.15.148:0/2063274264 >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 0x7f93a00c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 -- 172.21.15.148:0/2063274264 >> v1:172.21.15.150:6789/0 conn(0x7f93a00bffd0 legacy=0x7f93a00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f93a4ce6700 1 -- 172.21.15.148:0/2063274264 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00c6ef0 con 0x7f93a0154430 2023-10-24T00:44:53.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.978+0000 7f9397fff700 1 --2- 172.21.15.148:0/2063274264 >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 0x7f93a00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:53.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a4ce6700 1 --2- 172.21.15.148:0/2063274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a0154430 0x7f93a0154810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f93a00c23b0 tx=0x7f939c009840).ready entity=mon.0 client_cookie=1dc3a69538cd07e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93977fe700 1 -- 172.21.15.148:0/2063274264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00e070 con 0x7f93a0154430 2023-10-24T00:44:53.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93977fe700 1 -- 172.21.15.148:0/2063274264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00ba50 con 0x7f93a0154430 2023-10-24T00:44:53.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93977fe700 1 -- 172.21.15.148:0/2063274264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00bdd0 con 0x7f93a0154430 2023-10-24T00:44:53.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 -- 172.21.15.148:0/2063274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a0154430 msgr2=0x7f93a0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/2063274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a0154430 0x7f93a0154810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f93a00c23b0 tx=0x7f939c009840).stop 2023-10-24T00:44:53.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 -- 172.21.15.148:0/2063274264 shutdown_connections 2023-10-24T00:44:53.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/2063274264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a0154430 0x7f93a0154810 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/2063274264 >> v2:172.21.15.150:3300/0 conn(0x7f93a0098bd0 0x7f93a00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 -- 172.21.15.148:0/2063274264 >> 172.21.15.148:0/2063274264 conn(0x7f93a00cb070 msgr2=0x7f93a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:53.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 -- 172.21.15.148:0/2063274264 shutdown_connections 2023-10-24T00:44:53.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.979+0000 7f93a6f4a700 1 -- 172.21.15.148:0/2063274264 wait complete. 2023-10-24T00:44:53.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.980+0000 7f93a6f4a700 1 Processor -- start 2023-10-24T00:44:53.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 -- start start 2023-10-24T00:44:53.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93a0098bd0 0x7f93a01516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 0x7f93a00af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00ad8e0 con 0x7f93a00bffd0 2023-10-24T00:44:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00af8f0 con 0x7f93a0098bd0 2023-10-24T00:44:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f93a6f4a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00b0370 con 0x7f93a0154430 2023-10-24T00:44:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f9397fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f9397fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36670/0 (socket says 172.21.15.148:36670) 2023-10-24T00:44:53.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.981+0000 7f9397fff700 1 -- 172.21.15.148:0/3682465241 learned_addr learned my addr 172.21.15.148:0/3682465241 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:53.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f93a4ce6700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93a0098bd0 0x7f93a01516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f93a54e7700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 0x7f93a00af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 -- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 msgr2=0x7f93a00af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 0x7f93a00af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 -- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93a0098bd0 msgr2=0x7f93a01516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93a0098bd0 0x7f93a01516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 -- 172.21.15.148:0/3682465241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009ae0 con 0x7f93a00bffd0 2023-10-24T00:44:53.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f93a54e7700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 0x7f93a00af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:53.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9397fff700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f939000d860 tx=0x7f9390008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011590 con 0x7f93a00bffd0 2023-10-24T00:44:53.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93900116f0 con 0x7f93a00bffd0 2023-10-24T00:44:53.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a00aad80 con 0x7f93a00bffd0 2023-10-24T00:44:53.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011a70 con 0x7f93a00bffd0 2023-10-24T00:44:53.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.982+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a00b0090 con 0x7f93a00bffd0 2023-10-24T00:44:53.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.983+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00aaf10 con 0x7f93a00bffd0 2023-10-24T00:44:53.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.983+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9390012420 con 0x7f93a00bffd0 2023-10-24T00:44:53.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.984+0000 7f9394ff9700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 0x7f938c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:53.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.984+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9390079e30 con 0x7f93a00bffd0 2023-10-24T00:44:53.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.984+0000 7f93a4ce6700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 0x7f938c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:53.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.984+0000 7f93a4ce6700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 0x7f938c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f939c009ab0 tx=0x7f939c009840).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:53.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:53.988+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f939004af20 con 0x7f93a00bffd0 2023-10-24T00:44:54.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.195+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f93a006c6b0 con 0x7f93a00bffd0 2023-10-24T00:44:54.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.221+0000 7f9394ff9700 1 -- 172.21.15.148:0/3682465241 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f939004e540 con 0x7f93a00bffd0 2023-10-24T00:44:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 msgr2=0x7f938c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 0x7f938c061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f939c009ab0 tx=0x7f939c009840).stop 2023-10-24T00:44:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 msgr2=0x7f93a00aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f939000d860 tx=0x7f9390008040).stop 2023-10-24T00:44:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 shutdown_connections 2023-10-24T00:44:54.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93a0154430 0x7f93a00af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93a0098bd0 0x7f93a01516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f938c05f270 0x7f938c061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 --2- 172.21.15.148:0/3682465241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93a00bffd0 0x7f93a00aef10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.223+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 >> 172.21.15.148:0/3682465241 conn(0x7f93a00cb070 msgr2=0x7f93a0063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.224+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 shutdown_connections 2023-10-24T00:44:54.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.224+0000 7f93a6f4a700 1 -- 172.21.15.148:0/3682465241 wait complete. 2023-10-24T00:44:54.238 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:44:54.238 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:44:54.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.352+0000 7f43e7497700 1 Processor -- start 2023-10-24T00:44:54.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.352+0000 7f43e7497700 1 -- start start 2023-10-24T00:44:54.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e7497700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43e0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e7497700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00c71d0 con 0x7f43e0154430 2023-10-24T00:44:54.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e7497700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00c9410 con 0x7f43e0098bd0 2023-10-24T00:44:54.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e7497700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c6a10 con 0x7f43e00c06e0 2023-10-24T00:44:54.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e5233700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f43e0154430 0x7f43e00c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43328/0 (socket says 172.21.15.148:43328) 2023-10-24T00:44:54.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e5233700 1 -- 172.21.15.148:0/3156956420 learned_addr learned my addr 172.21.15.148:0/3156956420 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:54.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223982978 0 0) 0x7f43e00c71d0 con 0x7f43e0154430 2023-10-24T00:44:54.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc0033f0 con 0x7f43e0154430 2023-10-24T00:44:54.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.353+0000 7f43e5a34700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43e0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449159846 0 0) 0x7f43cc0033f0 con 0x7f43e0154430 2023-10-24T00:44:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 msgr2=0x7f43e0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43e0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 >> v1:172.21.15.150:6789/0 conn(0x7f43e0098bd0 legacy=0x7f43e00bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00ca8b0 con 0x7f43e0154430 2023-10-24T00:44:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f43dc001470 con 0x7f43e0154430 2023-10-24T00:44:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 >> v1:172.21.15.148:6789/0 conn(0x7f43e0154430 legacy=0x7f43e00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43cc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43cc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc004b80 0x7f43cc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c6a10 con 0x7f43cc003910 2023-10-24T00:44:54.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc00b910 con 0x7f43cc004b80 2023-10-24T00:44:54.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc00bad0 con 0x7f43e00c06e0 2023-10-24T00:44:54.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43cc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e4a32700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43cc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5a34700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc004b80 0x7f43cc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 -- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 msgr2=0x7f43cc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:54.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e00c06e0 0x7f43cc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 -- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc004b80 msgr2=0x7f43cc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc004b80 0x7f43cc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 -- 172.21.15.148:0/3156956420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0033f0 con 0x7f43cc003910 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5a34700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc004b80 0x7f43cc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43e5233700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43cc003d30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f43dc00c160 tx=0x7f43e00caa40).ready entity=mon.0 client_cookie=63c0e5978b4092dc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00ca90 con 0x7f43cc003910 2023-10-24T00:44:54.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00cbf0 con 0x7f43cc003910 2023-10-24T00:44:54.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.354+0000 7f43d7fff700 1 -- 172.21.15.148:0/3156956420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0070d0 con 0x7f43cc003910 2023-10-24T00:44:54.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 -- 172.21.15.148:0/3156956420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 msgr2=0x7f43cc003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 --2- 172.21.15.148:0/3156956420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43cc003d30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f43dc00c160 tx=0x7f43e00caa40).stop 2023-10-24T00:44:54.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e5a34700 1 -- 172.21.15.148:0/3156956420 reap_dead start 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 -- 172.21.15.148:0/3156956420 shutdown_connections 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 -- 172.21.15.148:0/3156956420 >> 172.21.15.148:0/3156956420 conn(0x7f43e00cb070 msgr2=0x7f43e00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 -- 172.21.15.148:0/3156956420 shutdown_connections 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.355+0000 7f43e7497700 1 -- 172.21.15.148:0/3156956420 wait complete. 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.356+0000 7f43e7497700 1 Processor -- start 2023-10-24T00:44:54.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.356+0000 7f43e7497700 1 -- start start 2023-10-24T00:44:54.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e01596f0 0x7f43e0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 0x7f43e0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c2ae0 con 0x7f43cc003910 2023-10-24T00:44:54.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c53d0 con 0x7f43e01573f0 2023-10-24T00:44:54.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e7497700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c5190 con 0x7f43e01596f0 2023-10-24T00:44:54.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36686/0 (socket says 172.21.15.148:36686) 2023-10-24T00:44:54.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 -- 172.21.15.148:0/1337802161 learned_addr learned my addr 172.21.15.148:0/1337802161 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:54.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e4a32700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e01596f0 0x7f43e0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5a34700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 0x7f43e0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 -- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e01596f0 msgr2=0x7f43e0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e01596f0 0x7f43e0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 -- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 msgr2=0x7f43e0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:54.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 0x7f43e0157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:54.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.357+0000 7f43e5233700 1 -- 172.21.15.148:0/1337802161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00c35f0 con 0x7f43cc003910 2023-10-24T00:44:54.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43e5a34700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 0x7f43e0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:54.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43e5233700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f43dc007180 tx=0x7f43dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:54.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00ceb0 con 0x7f43cc003910 2023-10-24T00:44:54.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc0046b0 con 0x7f43cc003910 2023-10-24T00:44:54.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc004a30 con 0x7f43cc003910 2023-10-24T00:44:54.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e0157d60 con 0x7f43cc003910 2023-10-24T00:44:54.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.358+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e00c3a80 con 0x7f43cc003910 2023-10-24T00:44:54.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.359+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e00c38d0 con 0x7f43cc003910 2023-10-24T00:44:54.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.359+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f43dc020480 con 0x7f43cc003910 2023-10-24T00:44:54.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.359+0000 7f43d57fa700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 0x7f43c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:54.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.359+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43dc07b130 con 0x7f43cc003910 2023-10-24T00:44:54.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.360+0000 7f43e4a32700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 0x7f43c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:54.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.360+0000 7f43e4a32700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 0x7f43c4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f43d0000c00 tx=0x7f43d0009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:54.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.363+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f43dc04c220 con 0x7f43cc003910 2023-10-24T00:44:54.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:54.569+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f43e006c6b0 con 0x7f43cc003910 2023-10-24T00:44:55.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.222+0000 7f43d57fa700 1 -- 172.21.15.148:0/1337802161 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43dc025020 con 0x7f43cc003910 2023-10-24T00:44:55.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 msgr2=0x7f43c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 0x7f43c4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f43d0000c00 tx=0x7f43d0009040).stop 2023-10-24T00:44:55.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 msgr2=0x7f43e00c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f43dc007180 tx=0x7f43dc015000).stop 2023-10-24T00:44:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 shutdown_connections 2023-10-24T00:44:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43e01573f0 0x7f43e0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f43c405f270 0x7f43c4061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43cc003910 0x7f43e00c4ca0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 --2- 172.21.15.148:0/1337802161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43e01596f0 0x7f43e0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 >> 172.21.15.148:0/1337802161 conn(0x7f43e00cb070 msgr2=0x7f43e00bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:55.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 shutdown_connections 2023-10-24T00:44:55.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.224+0000 7f43e7497700 1 -- 172.21.15.148:0/1337802161 wait complete. 2023-10-24T00:44:55.240 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:44:55.240 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:44:55.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.352+0000 7fe79bc40700 1 Processor -- start 2023-10-24T00:44:55.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.352+0000 7fe79bc40700 1 -- start start 2023-10-24T00:44:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe79bc40700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe7940c6710 0x7fe7940c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe79bc40700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940aa820 con 0x7fe7940aa010 2023-10-24T00:44:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe79bc40700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940c0960 con 0x7fe7940aa3f0 2023-10-24T00:44:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe79bc40700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940c0c40 con 0x7fe7940c6710 2023-10-24T00:44:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe7999dc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe7940aa010 0x7fe794158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43340/0 (socket says 172.21.15.148:43340) 2023-10-24T00:44:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe7999dc700 1 -- 172.21.15.148:0/26775657 learned_addr learned my addr 172.21.15.148:0/26775657 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.353+0000 7fe7991db700 1 --2- 172.21.15.148:0/26775657 >> v2:172.21.15.148:3300/0 conn(0x7fe7940c6710 0x7fe7940c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7989da700 1 -- 172.21.15.148:0/26775657 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397902577 0 0) 0x7fe7940aa820 con 0x7fe7940aa010 2023-10-24T00:44:55.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7989da700 1 -- 172.21.15.148:0/26775657 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7800033f0 con 0x7fe7940aa010 2023-10-24T00:44:55.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7991db700 1 -- 172.21.15.148:0/26775657 >> v1:172.21.15.150:6789/0 conn(0x7fe7940aa3f0 legacy=0x7fe794069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7991db700 1 -- 172.21.15.148:0/26775657 >> v1:172.21.15.148:6789/0 conn(0x7fe7940aa010 legacy=0x7fe794158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7991db700 1 -- 172.21.15.148:0/26775657 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940c0f20 con 0x7fe7940c6710 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7991db700 1 --2- 172.21.15.148:0/26775657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940c1a00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe784009760 tx=0x7fe784009060).ready entity=mon.0 client_cookie=1b94d98fa45bf192 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7989da700 1 -- 172.21.15.148:0/26775657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400f510 con 0x7fe7940c6710 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7989da700 1 -- 172.21.15.148:0/26775657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400f670 con 0x7fe7940c6710 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.354+0000 7fe7989da700 1 -- 172.21.15.148:0/26775657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400f9f0 con 0x7fe7940c6710 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 -- 172.21.15.148:0/26775657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 msgr2=0x7fe7940c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 --2- 172.21.15.148:0/26775657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940c1a00 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe784009760 tx=0x7fe784009060).stop 2023-10-24T00:44:55.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 -- 172.21.15.148:0/26775657 shutdown_connections 2023-10-24T00:44:55.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 --2- 172.21.15.148:0/26775657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940c1a00 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 -- 172.21.15.148:0/26775657 >> 172.21.15.148:0/26775657 conn(0x7fe7940caf40 msgr2=0x7fe7940cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:55.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 -- 172.21.15.148:0/26775657 shutdown_connections 2023-10-24T00:44:55.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.355+0000 7fe79bc40700 1 -- 172.21.15.148:0/26775657 wait complete. 2023-10-24T00:44:55.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.356+0000 7fe79bc40700 1 Processor -- start 2023-10-24T00:44:55.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.356+0000 7fe79bc40700 1 -- start start 2023-10-24T00:44:55.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7940aa010 0x7fe79414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7940aa3f0 0x7fe7941591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941555f0 con 0x7fe7940c6710 2023-10-24T00:44:55.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941549e0 con 0x7fe7940aa3f0 2023-10-24T00:44:55.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe794154cc0 con 0x7fe7940aa010 2023-10-24T00:44:55.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36702/0 (socket says 172.21.15.148:36702) 2023-10-24T00:44:55.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 -- 172.21.15.148:0/908939756 learned_addr learned my addr 172.21.15.148:0/908939756 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:55.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe7999dc700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7940aa010 0x7fe79414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe7991db700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7940aa3f0 0x7fe7941591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 -- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7940aa010 msgr2=0x7fe79414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7940aa010 0x7fe79414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 -- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7940aa3f0 msgr2=0x7fe7941591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7940aa3f0 0x7fe7941591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 -- 172.21.15.148:0/908939756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840092a0 con 0x7fe7940c6710 2023-10-24T00:44:55.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79a1dd700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe78c002230 tx=0x7fe78c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00e4a0 con 0x7fe7940c6710 2023-10-24T00:44:55.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00e600 con 0x7fe7940c6710 2023-10-24T00:44:55.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe794154fa0 con 0x7fe7940c6710 2023-10-24T00:44:55.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.357+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00e980 con 0x7fe7940c6710 2023-10-24T00:44:55.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.358+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7941571e0 con 0x7fe7940c6710 2023-10-24T00:44:55.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.359+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79406c6b0 con 0x7fe7940c6710 2023-10-24T00:44:55.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.359+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe78c01b3b0 con 0x7fe7940c6710 2023-10-24T00:44:55.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.359+0000 7fe789ffb700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 0x7fe778061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.359+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe78c0799d0 con 0x7fe7940c6710 2023-10-24T00:44:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.359+0000 7fe7999dc700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 0x7fe778061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.360+0000 7fe7999dc700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 0x7fe778061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe790007fd0 tx=0x7fe790009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.363+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe78c048af0 con 0x7fe7940c6710 2023-10-24T00:44:55.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.568+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7940c1200 con 0x7fe7940c6710 2023-10-24T00:44:55.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.569+0000 7fe789ffb700 1 -- 172.21.15.148:0/908939756 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fe78c079020 con 0x7fe7940c6710 2023-10-24T00:44:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:55.572 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:44:55.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 msgr2=0x7fe778061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 0x7fe778061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe790007fd0 tx=0x7fe790009040).stop 2023-10-24T00:44:55.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 msgr2=0x7fe7940ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe78c002230 tx=0x7fe78c0015e0).stop 2023-10-24T00:44:55.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 shutdown_connections 2023-10-24T00:44:55.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe77805f270 0x7fe778061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7940c6710 0x7fe7940ae8c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7940aa010 0x7fe79414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 --2- 172.21.15.148:0/908939756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7940aa3f0 0x7fe7941591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 >> 172.21.15.148:0/908939756 conn(0x7fe7940caf40 msgr2=0x7fe7940aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:55.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 shutdown_connections 2023-10-24T00:44:55.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.571+0000 7fe79bc40700 1 -- 172.21.15.148:0/908939756 wait complete. 2023-10-24T00:44:55.576 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:44:55.585 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:44:55.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 Processor -- start 2023-10-24T00:44:55.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 -- start start 2023-10-24T00:44:55.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680aa140 0x7f00680c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00680ca110 0x7f00680c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f00680c0cd0 0x7f0068157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680c6410 con 0x7f00680ca110 2023-10-24T00:44:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680c1160 con 0x7f00680c0cd0 2023-10-24T00:44:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f006cdec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ca6e0 con 0x7f00680aa140 2023-10-24T00:44:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00680ca110 0x7f00680c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00680ca110 0x7f00680c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36716/0 (socket says 172.21.15.148:36716) 2023-10-24T00:44:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 -- 172.21.15.148:0/1566023109 learned_addr learned my addr 172.21.15.148:0/1566023109 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0067fff700 1 --2- 172.21.15.148:0/1566023109 >> v2:172.21.15.150:3300/0 conn(0x7f00680c0cd0 0x7f0068157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f00677fe700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680aa140 0x7f00680c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 -- 172.21.15.148:0/1566023109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680aa140 msgr2=0x7f00680c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680aa140 0x7f00680c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 -- 172.21.15.148:0/1566023109 >> v2:172.21.15.150:3300/0 conn(0x7f00680c0cd0 msgr2=0x7f0068157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.698+0000 7f0066ffd700 1 --2- 172.21.15.148:0/1566023109 >> v2:172.21.15.150:3300/0 conn(0x7f00680c0cd0 0x7f0068157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f0066ffd700 1 -- 172.21.15.148:0/1566023109 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680ca9c0 con 0x7f00680ca110 2023-10-24T00:44:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f0066ffd700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680ca110 0x7f00680c07e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f00680845d0 tx=0x7f005c0090f0).ready entity=mon.0 client_cookie=a3f7e646c0815942 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f00667fc700 1 -- 172.21.15.148:0/1566023109 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00b600 con 0x7f00680ca110 2023-10-24T00:44:55.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f00667fc700 1 -- 172.21.15.148:0/1566023109 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00b760 con 0x7f00680ca110 2023-10-24T00:44:55.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f00667fc700 1 -- 172.21.15.148:0/1566023109 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00bae0 con 0x7f00680ca110 2023-10-24T00:44:55.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 -- 172.21.15.148:0/1566023109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680ca110 msgr2=0x7f00680c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680ca110 0x7f00680c07e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f00680845d0 tx=0x7f005c0090f0).stop 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 -- 172.21.15.148:0/1566023109 shutdown_connections 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 --2- 172.21.15.148:0/1566023109 >> v2:172.21.15.150:3300/0 conn(0x7f00680c0cd0 0x7f0068157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680aa140 0x7f00680c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 --2- 172.21.15.148:0/1566023109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680ca110 0x7f00680c07e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 -- 172.21.15.148:0/1566023109 >> 172.21.15.148:0/1566023109 conn(0x7f00680944a0 msgr2=0x7f006806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:55.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 -- 172.21.15.148:0/1566023109 shutdown_connections 2023-10-24T00:44:55.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.699+0000 7f006cdec700 1 -- 172.21.15.148:0/1566023109 wait complete. 2023-10-24T00:44:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 Processor -- start 2023-10-24T00:44:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 -- start start 2023-10-24T00:44:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00680c0cd0 0x7f00680af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 0x7f00680afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.701+0000 7f006cdec700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ab200 con 0x7f00680aa140 2023-10-24T00:44:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f006cdec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ab750 con 0x7f00680c0cd0 2023-10-24T00:44:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f006cdec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680b01e0 con 0x7f00680ca110 2023-10-24T00:44:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36728/0 (socket says 172.21.15.148:36728) 2023-10-24T00:44:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 -- 172.21.15.148:0/3324567544 learned_addr learned my addr 172.21.15.148:0/3324567544 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f0066ffd700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00680c0cd0 0x7f00680af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f0067fff700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 0x7f00680afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 -- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 msgr2=0x7f00680afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 0x7f00680afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 -- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00680c0cd0 msgr2=0x7f00680af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00680c0cd0 0x7f00680af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 -- 172.21.15.148:0/3324567544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009370 con 0x7f00680aa140 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f0067fff700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 0x7f00680afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f00677fe700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f005800cfc0 tx=0x7f00580078b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800ae40 con 0x7f00680aa140 2023-10-24T00:44:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058016400 con 0x7f00680aa140 2023-10-24T00:44:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680b04c0 con 0x7f00680aa140 2023-10-24T00:44:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058016780 con 0x7f00680aa140 2023-10-24T00:44:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.702+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006814ce40 con 0x7f00680aa140 2023-10-24T00:44:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.703+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680841d0 con 0x7f00680aa140 2023-10-24T00:44:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.703+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0058009030 con 0x7f00680aa140 2023-10-24T00:44:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.704+0000 7f004f7fe700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 0x7f0054061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.704+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f005807a830 con 0x7f00680aa140 2023-10-24T00:44:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.704+0000 7f0066ffd700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 0x7f0054061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.704+0000 7f0066ffd700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 0x7f0054061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f00680845d0 tx=0x7f005c017000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.709+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f005804b980 con 0x7f00680aa140 2023-10-24T00:44:55.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.872+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00680b06b0 con 0x7f00680aa140 2023-10-24T00:44:55.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.873+0000 7f004f7fe700 1 -- 172.21.15.148:0/3324567544 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16979 (secure 0 0 0) 0x7f005801b020 con 0x7f00680aa140 2023-10-24T00:44:55.876 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:55.876 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":96,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:44:54.216682+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:44:55.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 msgr2=0x7f0054061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 0x7f0054061700 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f00680845d0 tx=0x7f005c017000).stop 2023-10-24T00:44:55.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 msgr2=0x7f00681390e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:55.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f005800cfc0 tx=0x7f00580078b0).stop 2023-10-24T00:44:55.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 shutdown_connections 2023-10-24T00:44:55.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00680ca110 0x7f00680afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005405f240 0x7f0054061700 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.875+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00680aa140 0x7f00681390e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.876+0000 7f006cdec700 1 --2- 172.21.15.148:0/3324567544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00680c0cd0 0x7f00680af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:55.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.876+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 >> 172.21.15.148:0/3324567544 conn(0x7f00680944a0 msgr2=0x7f00680a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:55.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.876+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 shutdown_connections 2023-10-24T00:44:55.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:55.876+0000 7f006cdec700 1 -- 172.21.15.148:0/3324567544 wait complete. 2023-10-24T00:44:55.890 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:44:55.891 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:56.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 Processor -- start 2023-10-24T00:44:56.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 -- start start 2023-10-24T00:44:56.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f66080a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f66080964f0 0x7f66080a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080bf5c0 con 0x7f66080a84b0 2023-10-24T00:44:56.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080be9b0 con 0x7f66080964f0 2023-10-24T00:44:56.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.004+0000 7f6610780700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080bec90 con 0x7f66081543a0 2023-10-24T00:44:56.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f66080964f0 0x7f66080a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660dd1b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f66080a84b0 0x7f6608095de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43352/0 (socket says 172.21.15.148:43352) 2023-10-24T00:44:56.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660dd1b700 1 -- 172.21.15.148:0/238386376 learned_addr learned my addr 172.21.15.148:0/238386376 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:56.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660e51c700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f66080a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 -- 172.21.15.148:0/238386376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 msgr2=0x7f66080a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:56.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f66080a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 -- 172.21.15.148:0/238386376 >> v1:172.21.15.148:6789/0 conn(0x7f66080a84b0 legacy=0x7f6608095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660d51a700 1 -- 172.21.15.148:0/238386376 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626604168 0 0) 0x7f66080bf5c0 con 0x7f66080a84b0 2023-10-24T00:44:56.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 -- 172.21.15.148:0/238386376 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080bef70 con 0x7f66080964f0 2023-10-24T00:44:56.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660ed1d700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080964f0 0x7f66080a5b60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6600009760 tx=0x7f6600009060).ready entity=mon.0 client_cookie=d5057da1e2e3a1d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660d51a700 1 -- 172.21.15.148:0/238386376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660000b610 con 0x7f66080964f0 2023-10-24T00:44:56.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660d51a700 1 -- 172.21.15.148:0/238386376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660000b770 con 0x7f66080964f0 2023-10-24T00:44:56.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.005+0000 7f660d51a700 1 -- 172.21.15.148:0/238386376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660000baf0 con 0x7f66080964f0 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 -- 172.21.15.148:0/238386376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080964f0 msgr2=0x7f66080a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080964f0 0x7f66080a5b60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f6600009760 tx=0x7f6600009060).stop 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 -- 172.21.15.148:0/238386376 shutdown_connections 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080964f0 0x7f66080a5b60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 --2- 172.21.15.148:0/238386376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f66080a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 -- 172.21.15.148:0/238386376 >> 172.21.15.148:0/238386376 conn(0x7f66080630f0 msgr2=0x7f66080c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 -- 172.21.15.148:0/238386376 shutdown_connections 2023-10-24T00:44:56.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.006+0000 7f6610780700 1 -- 172.21.15.148:0/238386376 wait complete. 2023-10-24T00:44:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.007+0000 7f6610780700 1 Processor -- start 2023-10-24T00:44:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.007+0000 7f6610780700 1 -- start start 2023-10-24T00:44:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 0x7f66080ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f6608064930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080ae950 con 0x7f66080a84b0 2023-10-24T00:44:56.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66081514e0 con 0x7f66080964f0 2023-10-24T00:44:56.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080addd0 con 0x7f66081543a0 2023-10-24T00:44:56.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36754/0 (socket says 172.21.15.148:36754) 2023-10-24T00:44:56.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 -- 172.21.15.148:0/1859531496 learned_addr learned my addr 172.21.15.148:0/1859531496 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:56.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660ed1d700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f6608064930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660e51c700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 0x7f66080ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 -- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 msgr2=0x7f6608064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f6608064930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 -- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 msgr2=0x7f66080ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 0x7f66080ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 -- 172.21.15.148:0/1859531496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000092a0 con 0x7f66080a84b0 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660e51c700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 0x7f66080ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f660dd1b700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f65f800c440 tx=0x7f65f8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800cea0 con 0x7f66080a84b0 2023-10-24T00:44:56.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f80072e0 con 0x7f66080a84b0 2023-10-24T00:44:56.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66080ae0b0 con 0x7f66080a84b0 2023-10-24T00:44:56.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8007660 con 0x7f66080a84b0 2023-10-24T00:44:56.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.008+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66080ad9b0 con 0x7f66080a84b0 2023-10-24T00:44:56.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.009+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660806c6b0 con 0x7f66080a84b0 2023-10-24T00:44:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.010+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f65f80059b0 con 0x7f66080a84b0 2023-10-24T00:44:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.010+0000 7f65fe7fc700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 0x7f65ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.010+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f65f8079c10 con 0x7f66080a84b0 2023-10-24T00:44:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.010+0000 7f660e51c700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 0x7f65ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.011+0000 7f660e51c700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 0x7f65ec061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6604009fd0 tx=0x7f6604009740).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.015+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f65f804ad60 con 0x7f66080a84b0 2023-10-24T00:44:56.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.176+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6608151670 con 0x7f65ec05f270 2023-10-24T00:44:56.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.187+0000 7f65fe7fc700 1 -- 172.21.15.148:0/1859531496 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353215 (secure 0 0 0) 0x7f6604009dd0 con 0x7f65ec05f270 2023-10-24T00:44:56.193 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:56.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 msgr2=0x7f65ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 0x7f65ec061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6604009fd0 tx=0x7f6604009740).stop 2023-10-24T00:44:56.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 msgr2=0x7f66081535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f65f800c440 tx=0x7f65f8007bd0).stop 2023-10-24T00:44:56.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 shutdown_connections 2023-10-24T00:44:56.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66081543a0 0x7f6608064930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66080964f0 0x7f66080ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f65ec05f270 0x7f65ec061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 --2- 172.21.15.148:0/1859531496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66080a84b0 0x7f66081535a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 >> 172.21.15.148:0/1859531496 conn(0x7f66080630f0 msgr2=0x7f6608095de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 shutdown_connections 2023-10-24T00:44:56.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.191+0000 7f6610780700 1 -- 172.21.15.148:0/1859531496 wait complete. 2023-10-24T00:44:56.199 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:56.204 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:55.400253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418308,"kb_used_data":8772,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556412,"statfs":{"total":773094113280,"available":770617765888,"internally_reserved":0,"allocated":8982528,"data_stored":4469743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007327"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849041+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851037+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852803+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847423+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848294+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851534+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852106+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851009+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848275+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849273+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847708+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851305+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848199+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849133+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850796+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849040+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848657+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847429+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847434+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848276+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853482+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852419+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848668+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851418+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852053+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851648+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851464+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848784+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848102+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849129+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.854089+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848545+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851536+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850938+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848190+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848647+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852488+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848716+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853731+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852950+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847865+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848958+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850783+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851398+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850849+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848725+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847426+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852076+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848201+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851007+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846508+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848266+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671492+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:49.671492+0000","last_peered":"2023-10-24T00:44:49.671492+0000","last_clean":"2023-10-24T00:44:49.671492+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:49.671492+0000","last_undegraded":"2023-10-24T00:44:49.671492+0000","last_fullsized":"2023-10-24T00:44:49.671492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851069+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387123+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:50.387123+0000","last_peered":"2023-10-24T00:44:50.387123+0000","last_clean":"2023-10-24T00:44:50.387123+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:50.387123+0000","last_undegraded":"2023-10-24T00:44:50.387123+0000","last_fullsized":"2023-10-24T00:44:50.387123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850080+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.748853+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:49.748853+0000","last_peered":"2023-10-24T00:44:49.748853+0000","last_clean":"2023-10-24T00:44:49.748853+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:49.748853+0000","last_undegraded":"2023-10-24T00:44:49.748853+0000","last_fullsized":"2023-10-24T00:44:49.748853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852001+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387128+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:50.387128+0000","last_peered":"2023-10-24T00:44:50.387128+0000","last_clean":"2023-10-24T00:44:50.387128+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:50.387128+0000","last_undegraded":"2023-10-24T00:44:50.387128+0000","last_fullsized":"2023-10-24T00:44:50.387128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426014+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:49.426014+0000","last_peered":"2023-10-24T00:44:49.426014+0000","last_clean":"2023-10-24T00:44:49.426014+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:49.426014+0000","last_undegraded":"2023-10-24T00:44:49.426014+0000","last_fullsized":"2023-10-24T00:44:49.426014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850554+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426011+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:49.426011+0000","last_peered":"2023-10-24T00:44:49.426011+0000","last_clean":"2023-10-24T00:44:49.426011+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:49.426011+0000","last_undegraded":"2023-10-24T00:44:49.426011+0000","last_fullsized":"2023-10-24T00:44:49.426011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846996+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.425998+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:49.425998+0000","last_peered":"2023-10-24T00:44:49.425998+0000","last_clean":"2023-10-24T00:44:49.425998+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:49.425998+0000","last_undegraded":"2023-10-24T00:44:49.425998+0000","last_fullsized":"2023-10-24T00:44:49.425998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847486+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671495+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:49.671495+0000","last_peered":"2023-10-24T00:44:49.671495+0000","last_clean":"2023-10-24T00:44:49.671495+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:49.671495+0000","last_undegraded":"2023-10-24T00:44:49.671495+0000","last_fullsized":"2023-10-24T00:44:49.671495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848871+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.727273+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:49.727273+0000","last_peered":"2023-10-24T00:44:49.727273+0000","last_clean":"2023-10-24T00:44:49.727273+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:49.727273+0000","last_undegraded":"2023-10-24T00:44:49.727273+0000","last_fullsized":"2023-10-24T00:44:49.727273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.499},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.39900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.40999999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.63600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.316},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.221}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.315}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.308},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.495},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68500000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.80600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.372}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:56.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:56.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.356+0000 7f611a859700 1 Processor -- start 2023-10-24T00:44:56.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.356+0000 7f611a859700 1 -- start start 2023-10-24T00:44:56.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f61140c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 0x7f61140aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61140c0960 con 0x7f6114158770 2023-10-24T00:44:56.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140aa8e0 con 0x7f61140c6710 2023-10-24T00:44:56.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140c0c40 con 0x7f61140aa010 2023-10-24T00:44:56.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6118df6700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6114158770 0x7f6114069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43368/0 (socket says 172.21.15.148:43368) 2023-10-24T00:44:56.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6118df6700 1 -- 172.21.15.148:0/2594583835 learned_addr learned my addr 172.21.15.148:0/2594583835 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:56.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 --2- 172.21.15.148:0/2594583835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f61140c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f61137fe700 1 --2- 172.21.15.148:0/2594583835 >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 0x7f61140aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6112ffd700 1 -- 172.21.15.148:0/2594583835 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128324128 0 0) 0x7f61140c0960 con 0x7f6114158770 2023-10-24T00:44:56.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6112ffd700 1 -- 172.21.15.148:0/2594583835 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc0033f0 con 0x7f6114158770 2023-10-24T00:44:56.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 -- 172.21.15.148:0/2594583835 >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 msgr2=0x7f61140aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:56.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 --2- 172.21.15.148:0/2594583835 >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 0x7f61140aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 -- 172.21.15.148:0/2594583835 >> v1:172.21.15.148:6789/0 conn(0x7f6114158770 legacy=0x7f6114069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 -- 172.21.15.148:0/2594583835 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140c0f20 con 0x7f61140aa010 2023-10-24T00:44:56.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f61137fe700 1 --2- 172.21.15.148:0/2594583835 >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 0x7f61140aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:56.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6113fff700 1 --2- 172.21.15.148:0/2594583835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f61140c1a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).ready entity=mon.2 client_cookie=375f623f50d9a0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6112ffd700 1 -- 172.21.15.148:0/2594583835 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400d4a0 con 0x7f61140aa010 2023-10-24T00:44:56.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6112ffd700 1 -- 172.21.15.148:0/2594583835 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400d600 con 0x7f61140aa010 2023-10-24T00:44:56.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f6112ffd700 1 -- 172.21.15.148:0/2594583835 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400d980 con 0x7f61140aa010 2023-10-24T00:44:56.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 -- 172.21.15.148:0/2594583835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 msgr2=0x7f61140c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.358+0000 7f611a859700 1 --2- 172.21.15.148:0/2594583835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f61140c1a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).stop 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 -- 172.21.15.148:0/2594583835 shutdown_connections 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 --2- 172.21.15.148:0/2594583835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f61140c1a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 --2- 172.21.15.148:0/2594583835 >> v2:172.21.15.150:3300/0 conn(0x7f61140c6710 0x7f61140aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 -- 172.21.15.148:0/2594583835 >> 172.21.15.148:0/2594583835 conn(0x7f61140caf40 msgr2=0x7f61140cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 -- 172.21.15.148:0/2594583835 shutdown_connections 2023-10-24T00:44:56.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.359+0000 7f611a859700 1 -- 172.21.15.148:0/2594583835 wait complete. 2023-10-24T00:44:56.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.360+0000 7f611a859700 1 Processor -- start 2023-10-24T00:44:56.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.360+0000 7f611a859700 1 -- start start 2023-10-24T00:44:56.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f6114151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114158770 0x7f61140ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114154f30 con 0x7f61140c6710 2023-10-24T00:44:56.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114152460 con 0x7f6114158770 2023-10-24T00:44:56.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114156900 con 0x7f61140aa010 2023-10-24T00:44:56.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36766/0 (socket says 172.21.15.148:36766) 2023-10-24T00:44:56.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 -- 172.21.15.148:0/2353619075 learned_addr learned my addr 172.21.15.148:0/2353619075 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:56.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f6113fff700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f6114151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f6118df6700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114158770 0x7f61140ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 -- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 msgr2=0x7f6114151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f6114151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 -- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114158770 msgr2=0x7f61140ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114158770 0x7f61140ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 -- 172.21.15.148:0/2353619075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080092a0 con 0x7f61140c6710 2023-10-24T00:44:56.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f61137fe700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f610800ea00 tx=0x7f6108009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800c850 con 0x7f61140c6710 2023-10-24T00:44:56.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800c9b0 con 0x7f61140c6710 2023-10-24T00:44:56.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61040092a0 con 0x7f61140c6710 2023-10-24T00:44:56.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800cd30 con 0x7f61140c6710 2023-10-24T00:44:56.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6114154bc0 con 0x7f61140c6710 2023-10-24T00:44:56.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.362+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611406c6b0 con 0x7f61140c6710 2023-10-24T00:44:56.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.363+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6108012600 con 0x7f61140c6710 2023-10-24T00:44:56.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.363+0000 7f60fbfff700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 0x7f6100061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.363+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f610807aa30 con 0x7f61140c6710 2023-10-24T00:44:56.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.363+0000 7f6113fff700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 0x7f6100061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.364+0000 7f6113fff700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 0x7f6100061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f610400d260 tx=0x7f6104016000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.367+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f610807ce60 con 0x7f61140c6710 2023-10-24T00:44:56.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.527+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61140c1200 con 0x7f610005f270 2023-10-24T00:44:56.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.537+0000 7f60fbfff700 1 -- 172.21.15.148:0/2353619075 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353215 (secure 0 0 0) 0x7f61140c1200 con 0x7f610005f270 2023-10-24T00:44:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:56.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 msgr2=0x7f6100061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 0x7f6100061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f610400d260 tx=0x7f6104016000).stop 2023-10-24T00:44:56.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 msgr2=0x7f61141553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f610800ea00 tx=0x7f6108009060).stop 2023-10-24T00:44:56.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 shutdown_connections 2023-10-24T00:44:56.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6114158770 0x7f61140ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61140aa010 0x7f6114151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f610005f270 0x7f6100061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 --2- 172.21.15.148:0/2353619075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61140c6710 0x7f61141553c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 >> 172.21.15.148:0/2353619075 conn(0x7f61140caf40 msgr2=0x7f6114069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 shutdown_connections 2023-10-24T00:44:56.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.540+0000 7f611a859700 1 -- 172.21.15.148:0/2353619075 wait complete. 2023-10-24T00:44:56.550 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:56.554 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:55.400253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418308,"kb_used_data":8772,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556412,"statfs":{"total":773094113280,"available":770617765888,"internally_reserved":0,"allocated":8982528,"data_stored":4469743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007327"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849041+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851037+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852803+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847423+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848294+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851534+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852106+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851009+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848275+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849273+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847708+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851305+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848199+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849133+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850796+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849040+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848657+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847429+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847434+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848276+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853482+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852419+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848668+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851418+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852053+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851648+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851464+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848784+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848102+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849129+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.854089+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848545+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851536+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850938+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848190+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848647+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852488+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848716+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853731+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852950+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847865+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848958+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850783+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851398+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850849+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848725+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847426+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852076+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848201+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851007+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846508+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848266+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671492+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:49.671492+0000","last_peered":"2023-10-24T00:44:49.671492+0000","last_clean":"2023-10-24T00:44:49.671492+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:49.671492+0000","last_undegraded":"2023-10-24T00:44:49.671492+0000","last_fullsized":"2023-10-24T00:44:49.671492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851069+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387123+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:50.387123+0000","last_peered":"2023-10-24T00:44:50.387123+0000","last_clean":"2023-10-24T00:44:50.387123+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:50.387123+0000","last_undegraded":"2023-10-24T00:44:50.387123+0000","last_fullsized":"2023-10-24T00:44:50.387123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850080+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.748853+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:49.748853+0000","last_peered":"2023-10-24T00:44:49.748853+0000","last_clean":"2023-10-24T00:44:49.748853+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:49.748853+0000","last_undegraded":"2023-10-24T00:44:49.748853+0000","last_fullsized":"2023-10-24T00:44:49.748853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852001+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387128+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:50.387128+0000","last_peered":"2023-10-24T00:44:50.387128+0000","last_clean":"2023-10-24T00:44:50.387128+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:50.387128+0000","last_undegraded":"2023-10-24T00:44:50.387128+0000","last_fullsized":"2023-10-24T00:44:50.387128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426014+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:49.426014+0000","last_peered":"2023-10-24T00:44:49.426014+0000","last_clean":"2023-10-24T00:44:49.426014+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:49.426014+0000","last_undegraded":"2023-10-24T00:44:49.426014+0000","last_fullsized":"2023-10-24T00:44:49.426014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850554+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426011+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:49.426011+0000","last_peered":"2023-10-24T00:44:49.426011+0000","last_clean":"2023-10-24T00:44:49.426011+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:49.426011+0000","last_undegraded":"2023-10-24T00:44:49.426011+0000","last_fullsized":"2023-10-24T00:44:49.426011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846996+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.425998+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:49.425998+0000","last_peered":"2023-10-24T00:44:49.425998+0000","last_clean":"2023-10-24T00:44:49.425998+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:49.425998+0000","last_undegraded":"2023-10-24T00:44:49.425998+0000","last_fullsized":"2023-10-24T00:44:49.425998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847486+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671495+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:49.671495+0000","last_peered":"2023-10-24T00:44:49.671495+0000","last_clean":"2023-10-24T00:44:49.671495+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:49.671495+0000","last_undegraded":"2023-10-24T00:44:49.671495+0000","last_fullsized":"2023-10-24T00:44:49.671495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848871+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.727273+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:49.727273+0000","last_peered":"2023-10-24T00:44:49.727273+0000","last_clean":"2023-10-24T00:44:49.727273+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:49.727273+0000","last_undegraded":"2023-10-24T00:44:49.727273+0000","last_fullsized":"2023-10-24T00:44:49.727273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.499},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.39900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.40999999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.63600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.316},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.221}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.315}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.308},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.495},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68500000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.80600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.372}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:56.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:56.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.706+0000 7f36522c4700 1 Processor -- start 2023-10-24T00:44:56.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.706+0000 7f36522c4700 1 -- start start 2023-10-24T00:44:56.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f36522c4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f364c06a490 0x7f364c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f36522c4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0c0960 con 0x7f364c0aa010 2023-10-24T00:44:56.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f36522c4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0c0c40 con 0x7f364c0c6710 2023-10-24T00:44:56.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f36522c4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c0c0f20 con 0x7f364c06a490 2023-10-24T00:44:56.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f364bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f364c0aa010 0x7f364c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43372/0 (socket says 172.21.15.148:43372) 2023-10-24T00:44:56.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f364bfff700 1 -- 172.21.15.148:0/654396772 learned_addr learned my addr 172.21.15.148:0/654396772 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:56.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.707+0000 7f3650861700 1 --2- 172.21.15.148:0/654396772 >> v2:172.21.15.150:3300/0 conn(0x7f364c06a490 0x7f364c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673448643 0 0) 0x7f364c0c0960 con 0x7f364c0aa010 2023-10-24T00:44:56.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36340033f0 con 0x7f364c0aa010 2023-10-24T00:44:56.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768774204 0 0) 0x7f364c0c0c40 con 0x7f364c0c6710 2023-10-24T00:44:56.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f364c0c0960 con 0x7f364c0c6710 2023-10-24T00:44:56.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052414394 0 0) 0x7f36340033f0 con 0x7f364c0aa010 2023-10-24T00:44:56.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 >> v2:172.21.15.150:3300/0 conn(0x7f364c06a490 msgr2=0x7f364c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:56.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 --2- 172.21.15.148:0/654396772 >> v2:172.21.15.150:3300/0 conn(0x7f364c06a490 0x7f364c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 >> v1:172.21.15.150:6789/0 conn(0x7f364c0c6710 legacy=0x7f364c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0c1200 con 0x7f364c0aa010 2023-10-24T00:44:56.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f363c001470 con 0x7f364c0aa010 2023-10-24T00:44:56.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 >> v1:172.21.15.148:6789/0 conn(0x7f364c0aa010 legacy=0x7f364c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 0x7f3634003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3634004690 0x7f3634004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634005000 0x7f363400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0c0f20 con 0x7f3634003a70 2023-10-24T00:44:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363400bf60 con 0x7f3634005000 2023-10-24T00:44:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363400c0d0 con 0x7f3634004690 2023-10-24T00:44:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f3650861700 1 --2- 172.21.15.148:0/654396772 >> v2:172.21.15.150:3300/0 conn(0x7f364c06a490 0x7f364c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:44:56.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 0x7f3634003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f3650861700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634005000 0x7f363400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364b7fe700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3634004690 0x7f3634004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 -- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3634004690 msgr2=0x7f3634004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:56.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3634004690 0x7f3634004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 -- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634005000 msgr2=0x7f363400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634005000 0x7f363400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f3650861700 1 -- 172.21.15.148:0/654396772 reap_dead start 2023-10-24T00:44:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 -- 172.21.15.148:0/654396772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340033f0 con 0x7f3634003a70 2023-10-24T00:44:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.708+0000 7f364bfff700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 0x7f3634003e70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f363c00c190 tx=0x7f363c001e10).ready entity=mon.0 client_cookie=519efee0f4642a5c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00ca00 con 0x7f3634003a70 2023-10-24T00:44:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00cb60 con 0x7f3634003a70 2023-10-24T00:44:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f364affd700 1 -- 172.21.15.148:0/654396772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0070d0 con 0x7f3634003a70 2023-10-24T00:44:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 -- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 msgr2=0x7f3634003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 0x7f3634003e70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f363c00c190 tx=0x7f363c001e10).stop 2023-10-24T00:44:56.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 -- 172.21.15.148:0/654396772 shutdown_connections 2023-10-24T00:44:56.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 --2- 172.21.15.148:0/654396772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3634003a70 0x7f3634003e70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 -- 172.21.15.148:0/654396772 >> 172.21.15.148:0/654396772 conn(0x7f364c0caf40 msgr2=0x7f364c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 -- 172.21.15.148:0/654396772 shutdown_connections 2023-10-24T00:44:56.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.709+0000 7f36522c4700 1 -- 172.21.15.148:0/654396772 wait complete. 2023-10-24T00:44:56.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.710+0000 7f36522c4700 1 Processor -- start 2023-10-24T00:44:56.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.710+0000 7f36522c4700 1 -- start start 2023-10-24T00:44:56.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 0x7f364c156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 0x7f364c0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0c3c50 con 0x7f364c1646a0 2023-10-24T00:44:56.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0acb10 con 0x7f3634003a70 2023-10-24T00:44:56.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f36522c4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c157660 con 0x7f364c0ac1c0 2023-10-24T00:44:56.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36792/0 (socket says 172.21.15.148:36792) 2023-10-24T00:44:56.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 -- 172.21.15.148:0/3714367439 learned_addr learned my addr 172.21.15.148:0/3714367439 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f3650861700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 0x7f364c0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364bfff700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 0x7f364c156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 -- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 msgr2=0x7f364c0ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 0x7f364c0ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 -- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 msgr2=0x7f364c156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 0x7f364c156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364b7fe700 1 -- 172.21.15.148:0/3714367439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c154c20 con 0x7f364c1646a0 2023-10-24T00:44:56.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f3650861700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 0x7f364c0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:56.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.711+0000 7f364bfff700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 0x7f364c156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f364b7fe700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f364000e590 tx=0x7f3640009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640001570 con 0x7f364c1646a0 2023-10-24T00:44:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400016d0 con 0x7f364c1646a0 2023-10-24T00:44:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c154f00 con 0x7f364c1646a0 2023-10-24T00:44:56.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640001a50 con 0x7f364c1646a0 2023-10-24T00:44:56.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.712+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c1554c0 con 0x7f364c1646a0 2023-10-24T00:44:56.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.713+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c06c6b0 con 0x7f364c1646a0 2023-10-24T00:44:56.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.713+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3640014430 con 0x7f364c1646a0 2023-10-24T00:44:56.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.713+0000 7f3633fff700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 0x7f3638061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:56.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.713+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f364007a120 con 0x7f364c1646a0 2023-10-24T00:44:56.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.714+0000 7f364bfff700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 0x7f3638061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:56.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.714+0000 7f364bfff700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 0x7f3638061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f363c001120 tx=0x7f363c015000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:56.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.717+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3640049af0 con 0x7f364c1646a0 2023-10-24T00:44:56.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.877+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f364c0c14e0 con 0x7f363805f270 2023-10-24T00:44:56.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.887+0000 7f3633fff700 1 -- 172.21.15.148:0/3714367439 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353215 (secure 0 0 0) 0x7f364c0c14e0 con 0x7f363805f270 2023-10-24T00:44:56.893 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 msgr2=0x7f3638061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 0x7f3638061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f363c001120 tx=0x7f363c015000).stop 2023-10-24T00:44:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 msgr2=0x7f364c0a93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f364000e590 tx=0x7f3640009040).stop 2023-10-24T00:44:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 shutdown_connections 2023-10-24T00:44:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f364c0ac1c0 0x7f364c0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3634003a70 0x7f364c156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f363805f270 0x7f3638061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 --2- 172.21.15.148:0/3714367439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f364c1646a0 0x7f364c0a93f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.890+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 >> 172.21.15.148:0/3714367439 conn(0x7f364c0caf40 msgr2=0x7f364c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.891+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 shutdown_connections 2023-10-24T00:44:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:56.891+0000 7f36522c4700 1 -- 172.21.15.148:0/3714367439 wait complete. 2023-10-24T00:44:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:56.904 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:44:55.400253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418308,"kb_used_data":8772,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556412,"statfs":{"total":773094113280,"available":770617765888,"internally_reserved":0,"allocated":8982528,"data_stored":4469743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007327"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849041+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851037+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852803+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847423+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848294+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851534+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852106+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851009+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848275+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849273+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847708+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851305+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848199+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849133+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846598+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852585+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850796+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849040+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848657+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847429+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847434+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848276+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853482+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852419+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848668+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851418+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852053+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851648+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851464+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848784+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848102+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.849129+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.854089+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848545+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851536+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850938+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848190+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848647+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852488+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848716+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.853731+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852950+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847865+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848958+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850783+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851398+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850849+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848725+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847426+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852076+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848201+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851007+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846508+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848266+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671492+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:49.671492+0000","last_peered":"2023-10-24T00:44:49.671492+0000","last_clean":"2023-10-24T00:44:49.671492+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:49.671492+0000","last_undegraded":"2023-10-24T00:44:49.671492+0000","last_fullsized":"2023-10-24T00:44:49.671492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.851069+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387123+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:50.387123+0000","last_peered":"2023-10-24T00:44:50.387123+0000","last_clean":"2023-10-24T00:44:50.387123+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:50.387123+0000","last_undegraded":"2023-10-24T00:44:50.387123+0000","last_fullsized":"2023-10-24T00:44:50.387123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850080+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.748853+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:49.748853+0000","last_peered":"2023-10-24T00:44:49.748853+0000","last_clean":"2023-10-24T00:44:49.748853+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:49.748853+0000","last_undegraded":"2023-10-24T00:44:49.748853+0000","last_fullsized":"2023-10-24T00:44:49.748853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.852001+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:50.387128+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:50.387128+0000","last_peered":"2023-10-24T00:44:50.387128+0000","last_clean":"2023-10-24T00:44:50.387128+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:50.387128+0000","last_undegraded":"2023-10-24T00:44:50.387128+0000","last_fullsized":"2023-10-24T00:44:50.387128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426014+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:49.426014+0000","last_peered":"2023-10-24T00:44:49.426014+0000","last_clean":"2023-10-24T00:44:49.426014+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:49.426014+0000","last_undegraded":"2023-10-24T00:44:49.426014+0000","last_fullsized":"2023-10-24T00:44:49.426014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.850554+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.426011+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:49.426011+0000","last_peered":"2023-10-24T00:44:49.426011+0000","last_clean":"2023-10-24T00:44:49.426011+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:49.426011+0000","last_undegraded":"2023-10-24T00:44:49.426011+0000","last_fullsized":"2023-10-24T00:44:49.426011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.846996+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.425998+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:49.425998+0000","last_peered":"2023-10-24T00:44:49.425998+0000","last_clean":"2023-10-24T00:44:49.425998+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:49.425998+0000","last_undegraded":"2023-10-24T00:44:49.425998+0000","last_fullsized":"2023-10-24T00:44:49.425998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.847486+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.671495+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:49.671495+0000","last_peered":"2023-10-24T00:44:49.671495+0000","last_clean":"2023-10-24T00:44:49.671495+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:49.671495+0000","last_undegraded":"2023-10-24T00:44:49.671495+0000","last_fullsized":"2023-10-24T00:44:49.671495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:44:52.844059+0000","last_change":"2023-10-24T00:44:52.844059+0000","last_active":"2023-10-24T00:44:52.844059+0000","last_peered":"2023-10-24T00:44:52.844059+0000","last_clean":"2023-10-24T00:44:52.844059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:52.844059+0000","last_undegraded":"2023-10-24T00:44:52.844059+0000","last_fullsized":"2023-10-24T00:44:52.844059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:44:51.840671+0000","last_change":"2023-10-24T00:44:51.848871+0000","last_active":"2023-10-24T00:44:51.840671+0000","last_peered":"2023-10-24T00:44:51.840671+0000","last_clean":"2023-10-24T00:44:51.840671+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:44:51.840671+0000","last_undegraded":"2023-10-24T00:44:51.840671+0000","last_fullsized":"2023-10-24T00:44:51.840671+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-24T00:44:49.727273+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:49.727273+0000","last_peered":"2023-10-24T00:44:49.727273+0000","last_clean":"2023-10-24T00:44:49.727273+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:49.727273+0000","last_undegraded":"2023-10-24T00:44:49.727273+0000","last_fullsized":"2023-10-24T00:44:49.727273+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.42499999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.66400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.499},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.38}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.39900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.40999999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.26100000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.63600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.316},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.29999999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.33000000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302296,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069544,"statfs":{"total":96636764160,"available":96327213056,"internally_reserved":0,"allocated":1130496,"data_stored":562606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.221}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.315}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.308},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.495},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68500000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.80600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302284,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069556,"statfs":{"total":96636764160,"available":96327225344,"internally_reserved":0,"allocated":1118208,"data_stored":556385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.372}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.501}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.51000000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:56.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-10-24T00:44:56.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-24T00:44:56.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.849041+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-10-24T00:44:56.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-24T00:44:56.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851037+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-10-24T00:44:56.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-24T00:44:56.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852803+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:56.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-10-24T00:44:56.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-24T00:44:56.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847423+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:56.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-10-24T00:44:56.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-24T00:44:56.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848294+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-10-24T00:44:56.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-24T00:44:56.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851534+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-10-24T00:44:56.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-24T00:44:56.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852106+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-10-24T00:44:56.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-24T00:44:56.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851009+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-10-24T00:44:56.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-24T00:44:56.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848275+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-10-24T00:44:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-24T00:44:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.849273+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-10-24T00:44:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-24T00:44:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847708+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-10-24T00:44:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-24T00:44:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.846598+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-10-24T00:44:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-24T00:44:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851585+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-10-24T00:44:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-24T00:44:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848598+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-10-24T00:44:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-24T00:44:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851305+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-10-24T00:44:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-24T00:44:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848199+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-10-24T00:44:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-24T00:44:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.849133+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-10-24T00:44:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-24T00:44:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.846598+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-10-24T00:44:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-24T00:44:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852585+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-10-24T00:44:56.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-24T00:44:56.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850796+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-10-24T00:44:56.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-24T00:44:56.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.849040+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-10-24T00:44:56.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-24T00:44:56.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848657+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-10-24T00:44:56.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-24T00:44:56.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847429+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-10-24T00:44:56.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-24T00:44:56.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847434+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-10-24T00:44:56.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-24T00:44:56.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848276+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-10-24T00:44:56.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-24T00:44:56.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.853482+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-10-24T00:44:56.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-24T00:44:56.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852419+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:56.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-10-24T00:44:56.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-24T00:44:56.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848668+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-10-24T00:44:56.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-24T00:44:56.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851418+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:56.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-10-24T00:44:56.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-24T00:44:56.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852053+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-10-24T00:44:56.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-24T00:44:56.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851648+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-10-24T00:44:56.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-24T00:44:56.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851464+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-10-24T00:44:56.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-24T00:44:56.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848784+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-24T00:44:56.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-24T00:44:56.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848102+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-10-24T00:44:56.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-24T00:44:56.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.849129+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-10-24T00:44:56.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-24T00:44:56.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.854089+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-24T00:44:56.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-24T00:44:56.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848545+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:56.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-24T00:44:56.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-24T00:44:56.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851536+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-10-24T00:44:56.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-24T00:44:56.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850938+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-10-24T00:44:56.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-24T00:44:56.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848190+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-24T00:44:56.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-24T00:44:56.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848647+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-24T00:44:56.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-24T00:44:56.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852488+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-24T00:44:56.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-24T00:44:56.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848716+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-10-24T00:44:56.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-24T00:44:56.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.853731+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-24T00:44:56.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-24T00:44:56.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852950+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-10-24T00:44:56.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-24T00:44:56.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847865+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-10-24T00:44:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-24T00:44:56.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848958+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-10-24T00:44:56.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-24T00:44:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850783+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-10-24T00:44:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-24T00:44:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851398+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:44:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-10-24T00:44:56.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-24T00:44:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850849+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:44:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-10-24T00:44:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-24T00:44:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848725+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-24T00:44:56.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-24T00:44:56.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847426+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-10-24T00:44:56.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-24T00:44:56.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852076+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:56.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-10-24T00:44:56.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:56.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-24T00:44:56.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848201+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:56.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-10-24T00:44:57.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-24T00:44:57.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851007+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:44:57.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-10-24T00:44:57.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-24T00:44:57.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.846508+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:57.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-24T00:44:57.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-24T00:44:57.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848266+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:44:57.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-24T00:44:57.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-24T00:44:57.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.851069+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:57.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-10-24T00:44:57.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-24T00:44:57.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850080+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:57.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-24T00:44:57.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-24T00:44:57.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.852001+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:57.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-24T00:44:57.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-24T00:44:57.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.850554+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:44:57.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-24T00:44:57.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-24T00:44:57.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.846996+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:44:57.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-24T00:44:57.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-24T00:44:57.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.847486+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:44:57.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-24T00:44:57.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:44:52.844059+0000', 'last_change': '2023-10-24T00:44:52.844059+0000', 'last_active': '2023-10-24T00:44:52.844059+0000', 'last_peered': '2023-10-24T00:44:52.844059+0000', 'last_clean': '2023-10-24T00:44:52.844059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:52.844059+0000', 'last_undegraded': '2023-10-24T00:44:52.844059+0000', 'last_fullsized': '2023-10-24T00:44:52.844059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:52.844059+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:44:57.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-24T00:44:57.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:44:51.840671+0000', 'last_change': '2023-10-24T00:44:51.848871+0000', 'last_active': '2023-10-24T00:44:51.840671+0000', 'last_peered': '2023-10-24T00:44:51.840671+0000', 'last_clean': '2023-10-24T00:44:51.840671+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:44:51.840671+0000', 'last_undegraded': '2023-10-24T00:44:51.840671+0000', 'last_fullsized': '2023-10-24T00:44:51.840671+0000', 'mapping_epoch': 93, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 93, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'last_clean_scrub_stamp': '2023-10-24T00:44:51.840671+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:44:57.015 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:44:57.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.127+0000 7fbf8501d700 1 Processor -- start 2023-10-24T00:44:57.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.127+0000 7fbf8501d700 1 -- start start 2023-10-24T00:44:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8501d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8501d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf80151750 0x7fbf80151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8501d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf80152760 con 0x7fbf80065d30 2023-10-24T00:44:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8501d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf800c3490 con 0x7fbf80151750 2023-10-24T00:44:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8501d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800c2e80 con 0x7fbf8014ec20 2023-10-24T00:44:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbf80151750 0x7fbf80151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8481c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbf80065d30 0x7fbf800c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43386/0 (socket says 172.21.15.148:43386) 2023-10-24T00:44:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf8481c700 1 -- 172.21.15.148:0/4255896090 learned_addr learned my addr 172.21.15.148:0/4255896090 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:44:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7ffff700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7f7fe700 1 -- 172.21.15.148:0/4255896090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 msgr2=0x7fbf800bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7f7fe700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7f7fe700 1 -- 172.21.15.148:0/4255896090 >> v1:172.21.15.148:6789/0 conn(0x7fbf80065d30 legacy=0x7fbf800c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.128+0000 7fbf7effd700 1 -- 172.21.15.148:0/4255896090 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768120718 0 0) 0x7fbf78001490 con 0x7fbf80065d30 2023-10-24T00:44:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf7f7fe700 1 -- 172.21.15.148:0/4255896090 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf801521a0 con 0x7fbf80151750 2023-10-24T00:44:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf7f7fe700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80151750 0x7fbf80151bd0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fbf74009760 tx=0x7fbf74009060).ready entity=mon.0 client_cookie=bb7f8a09f683d268 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf7effd700 1 -- 172.21.15.148:0/4255896090 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400b580 con 0x7fbf80151750 2023-10-24T00:44:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf7effd700 1 -- 172.21.15.148:0/4255896090 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400b6e0 con 0x7fbf80151750 2023-10-24T00:44:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf7effd700 1 -- 172.21.15.148:0/4255896090 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400ba60 con 0x7fbf80151750 2023-10-24T00:44:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 -- 172.21.15.148:0/4255896090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80151750 msgr2=0x7fbf80151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80151750 0x7fbf80151bd0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fbf74009760 tx=0x7fbf74009060).stop 2023-10-24T00:44:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 -- 172.21.15.148:0/4255896090 shutdown_connections 2023-10-24T00:44:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 --2- 172.21.15.148:0/4255896090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80151750 0x7fbf80151bd0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 -- 172.21.15.148:0/4255896090 >> 172.21.15.148:0/4255896090 conn(0x7fbf800c7ad0 msgr2=0x7fbf800c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 -- 172.21.15.148:0/4255896090 shutdown_connections 2023-10-24T00:44:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.129+0000 7fbf8501d700 1 -- 172.21.15.148:0/4255896090 wait complete. 2023-10-24T00:44:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.130+0000 7fbf8501d700 1 Processor -- start 2023-10-24T00:44:57.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 -- start start 2023-10-24T00:44:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80151750 0x7fbf80135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8013aa60 con 0x7fbf80065d30 2023-10-24T00:44:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8013a1c0 con 0x7fbf80151750 2023-10-24T00:44:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf8501d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8013a4a0 con 0x7fbf8014ec20 2023-10-24T00:44:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36824/0 (socket says 172.21.15.148:36824) 2023-10-24T00:44:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.131+0000 7fbf7ffff700 1 -- 172.21.15.148:0/51099104 learned_addr learned my addr 172.21.15.148:0/51099104 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7f7fe700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf8481c700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80151750 0x7fbf80135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 -- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 msgr2=0x7fbf800bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 -- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80151750 msgr2=0x7fbf80135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80151750 0x7fbf80135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 -- 172.21.15.148:0/51099104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf740092a0 con 0x7fbf80065d30 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf7ffff700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fbf7000d890 tx=0x7fbf70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700125f0 con 0x7fbf80065d30 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70012750 con 0x7fbf80065d30 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70012ad0 con 0x7fbf80065d30 2023-10-24T00:44:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8013a780 con 0x7fbf80065d30 2023-10-24T00:44:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.132+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf80139db0 con 0x7fbf80065d30 2023-10-24T00:44:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.133+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf80138180 con 0x7fbf80065d30 2023-10-24T00:44:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.133+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbf70013480 con 0x7fbf80065d30 2023-10-24T00:44:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.134+0000 7fbf67fff700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 0x7fbf6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.134+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbf7007a1d0 con 0x7fbf80065d30 2023-10-24T00:44:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.134+0000 7fbf7f7fe700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 0x7fbf6c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.134+0000 7fbf7f7fe700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 0x7fbf6c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf74009760 tx=0x7fbf74017000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.138+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbf80138180 con 0x7fbf80065d30 2023-10-24T00:44:57.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.364+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbf80138180 con 0x7fbf80065d30 2023-10-24T00:44:57.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.364+0000 7fbf67fff700 1 -- 172.21.15.148:0/51099104 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7fbf7004b2c0 con 0x7fbf80065d30 2023-10-24T00:44:57.366 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:57.367 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":981,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":96,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2476347392,"bytes_avail":770617765888,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":31,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6732}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-24T00:43:09.408742+0000","services":{}},"progress_events":{}} 2023-10-24T00:44:57.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 msgr2=0x7fbf6c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 0x7fbf6c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf74009760 tx=0x7fbf74017000).stop 2023-10-24T00:44:57.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 msgr2=0x7fbf801398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fbf7000d890 tx=0x7fbf70008040).stop 2023-10-24T00:44:57.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 shutdown_connections 2023-10-24T00:44:57.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80151750 0x7fbf80135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf6c05f270 0x7fbf6c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf80065d30 0x7fbf801398c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 --2- 172.21.15.148:0/51099104 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf8014ec20 0x7fbf800bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 >> 172.21.15.148:0/51099104 conn(0x7fbf800c7ad0 msgr2=0x7fbf80064fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:57.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 shutdown_connections 2023-10-24T00:44:57.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.366+0000 7fbf8501d700 1 -- 172.21.15.148:0/51099104 wait complete. 2023-10-24T00:44:57.380 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:44:57.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:44:57.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.492+0000 7fbfb292f700 1 Processor -- start 2023-10-24T00:44:57.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.492+0000 7fbfb292f700 1 -- start start 2023-10-24T00:44:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfac153d40 0x7fbfac154120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfac064cb0 0x7fbfac0650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac0be480 0x7fbfac0be8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0655e0 con 0x7fbfac153d40 2023-10-24T00:44:57.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0c7510 con 0x7fbfac064cb0 2023-10-24T00:44:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb292f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0bedc0 con 0x7fbfac0be480 2023-10-24T00:44:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfac153d40 0x7fbfac154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfac153d40 0x7fbfac154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36836/0 (socket says 172.21.15.148:36836) 2023-10-24T00:44:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 -- 172.21.15.148:0/10369478 learned_addr learned my addr 172.21.15.148:0/10369478 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb112c700 1 --2- 172.21.15.148:0/10369478 >> v2:172.21.15.150:3300/0 conn(0x7fbfac064cb0 0x7fbfac0650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb212e700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac0be480 0x7fbfac0be8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 -- 172.21.15.148:0/10369478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac0be480 msgr2=0x7fbfac0be8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac0be480 0x7fbfac0be8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 -- 172.21.15.148:0/10369478 >> v2:172.21.15.150:3300/0 conn(0x7fbfac064cb0 msgr2=0x7fbfac0650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:44:57.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 --2- 172.21.15.148:0/10369478 >> v2:172.21.15.150:3300/0 conn(0x7fbfac064cb0 0x7fbfac0650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 -- 172.21.15.148:0/10369478 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0a8470 con 0x7fbfac153d40 2023-10-24T00:44:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb192d700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac153d40 0x7fbfac154120 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fbfac0bfc90 tx=0x7fbfa40090f0).ready entity=mon.0 client_cookie=3c1066eec16aceff server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.493+0000 7fbfb092b700 1 -- 172.21.15.148:0/10369478 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400b520 con 0x7fbfac153d40 2023-10-24T00:44:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb092b700 1 -- 172.21.15.148:0/10369478 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400b680 con 0x7fbfac153d40 2023-10-24T00:44:57.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb092b700 1 -- 172.21.15.148:0/10369478 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400ba00 con 0x7fbfac153d40 2023-10-24T00:44:57.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 -- 172.21.15.148:0/10369478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac153d40 msgr2=0x7fbfac154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac153d40 0x7fbfac154120 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fbfac0bfc90 tx=0x7fbfa40090f0).stop 2023-10-24T00:44:57.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 -- 172.21.15.148:0/10369478 shutdown_connections 2023-10-24T00:44:57.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac153d40 0x7fbfac154120 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 --2- 172.21.15.148:0/10369478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac0be480 0x7fbfac0be8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 --2- 172.21.15.148:0/10369478 >> v2:172.21.15.150:3300/0 conn(0x7fbfac064cb0 0x7fbfac0650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 -- 172.21.15.148:0/10369478 >> 172.21.15.148:0/10369478 conn(0x7fbfac0922e0 msgr2=0x7fbfac062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:57.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 -- 172.21.15.148:0/10369478 shutdown_connections 2023-10-24T00:44:57.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.494+0000 7fbfb292f700 1 -- 172.21.15.148:0/10369478 wait complete. 2023-10-24T00:44:57.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.495+0000 7fbfb292f700 1 Processor -- start 2023-10-24T00:44:57.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.495+0000 7fbfb292f700 1 -- start start 2023-10-24T00:44:57.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac064cb0 0x7fbfac158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 0x7fbfac0953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0aa590 con 0x7fbfac0be480 2023-10-24T00:44:57.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac158510 con 0x7fbfac153d40 2023-10-24T00:44:57.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb292f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0934d0 con 0x7fbfac064cb0 2023-10-24T00:44:57.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36848/0 (socket says 172.21.15.148:36848) 2023-10-24T00:44:57.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 -- 172.21.15.148:0/2692887940 learned_addr learned my addr 172.21.15.148:0/2692887940 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:44:57.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 -- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac064cb0 msgr2=0x7fbfac158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb192d700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac064cb0 0x7fbfac158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac064cb0 0x7fbfac158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb212e700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 0x7fbfac0953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 -- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 msgr2=0x7fbfac0953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 0x7fbfac0953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb112c700 1 -- 172.21.15.148:0/2692887940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009370 con 0x7fbfac0be480 2023-10-24T00:44:57.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.496+0000 7fbfb212e700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 0x7fbfac0953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:44:57.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfb112c700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fbfa0009f20 tx=0x7fbfa000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000cc80 con 0x7fbfac0be480 2023-10-24T00:44:57.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa000f040 con 0x7fbfac0be480 2023-10-24T00:44:57.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0a9cf0 con 0x7fbfac0be480 2023-10-24T00:44:57.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0013400 con 0x7fbfac0be480 2023-10-24T00:44:57.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.497+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac0aa2b0 con 0x7fbfac0be480 2023-10-24T00:44:57.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.498+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac093800 con 0x7fbfac0be480 2023-10-24T00:44:57.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.498+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbfa0013770 con 0x7fbfac0be480 2023-10-24T00:44:57.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.499+0000 7fbfa9ffb700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 0x7fbf98061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:44:57.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.499+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbfa007acc0 con 0x7fbfac0be480 2023-10-24T00:44:57.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.499+0000 7fbfb192d700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 0x7fbf98061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:44:57.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.499+0000 7fbfb192d700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 0x7fbf98061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbfa4009130 tx=0x7fbfa4017000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:44:57.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.503+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbfa004be10 con 0x7fbfac0be480 2023-10-24T00:44:57.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.662+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfac093330 con 0x7fbf9805f270 2023-10-24T00:44:57.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.672+0000 7fbfa9ffb700 1 -- 172.21.15.148:0/2692887940 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361533 (secure 0 0 0) 0x7fbfac093330 con 0x7fbf9805f270 2023-10-24T00:44:57.678 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:44:57.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 msgr2=0x7fbf98061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 0x7fbf98061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fbfa4009130 tx=0x7fbfa4017000).stop 2023-10-24T00:44:57.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 msgr2=0x7fbfac0a93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:44:57.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fbfa0009f20 tx=0x7fbfa000b040).stop 2023-10-24T00:44:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 shutdown_connections 2023-10-24T00:44:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfac153d40 0x7fbfac0953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfac064cb0 0x7fbfac158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbf9805f270 0x7fbf98061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 --2- 172.21.15.148:0/2692887940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfac0be480 0x7fbfac0a93d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:44:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 >> 172.21.15.148:0/2692887940 conn(0x7fbfac0922e0 msgr2=0x7fbfac152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:44:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 shutdown_connections 2023-10-24T00:44:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:44:57.676+0000 7fbfb292f700 1 -- 172.21.15.148:0/2692887940 wait complete. 2023-10-24T00:44:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:44:57.689 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:44:57.400651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418720,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556000,"statfs":{"total":773094113280,"available":770617344000,"internally_reserved":0,"allocated":9404416,"data_stored":4669956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.007327"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241625+0000","last_change":"2023-10-24T00:44:53.231586+0000","last_active":"2023-10-24T00:44:53.241625+0000","last_peered":"2023-10-24T00:44:53.241625+0000","last_clean":"2023-10-24T00:44:53.241625+0000","last_became_active":"2023-10-24T00:44:53.231321+0000","last_became_peered":"2023-10-24T00:44:53.231321+0000","last_unstale":"2023-10-24T00:44:53.241625+0000","last_undegraded":"2023-10-24T00:44:53.241625+0000","last_fullsized":"2023-10-24T00:44:53.241625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245141+0000","last_change":"2023-10-24T00:44:52.866534+0000","last_active":"2023-10-24T00:44:53.245141+0000","last_peered":"2023-10-24T00:44:53.245141+0000","last_clean":"2023-10-24T00:44:53.245141+0000","last_became_active":"2023-10-24T00:44:52.865484+0000","last_became_peered":"2023-10-24T00:44:52.865484+0000","last_unstale":"2023-10-24T00:44:53.245141+0000","last_undegraded":"2023-10-24T00:44:53.245141+0000","last_fullsized":"2023-10-24T00:44:53.245141+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242202+0000","last_change":"2023-10-24T00:44:53.239128+0000","last_active":"2023-10-24T00:44:53.242202+0000","last_peered":"2023-10-24T00:44:53.242202+0000","last_clean":"2023-10-24T00:44:53.242202+0000","last_became_active":"2023-10-24T00:44:53.238704+0000","last_became_peered":"2023-10-24T00:44:53.238704+0000","last_unstale":"2023-10-24T00:44:53.242202+0000","last_undegraded":"2023-10-24T00:44:53.242202+0000","last_fullsized":"2023-10-24T00:44:53.242202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226983+0000","last_change":"2023-10-24T00:44:52.875475+0000","last_active":"2023-10-24T00:44:53.226983+0000","last_peered":"2023-10-24T00:44:53.226983+0000","last_clean":"2023-10-24T00:44:53.226983+0000","last_became_active":"2023-10-24T00:44:52.875178+0000","last_became_peered":"2023-10-24T00:44:52.875178+0000","last_unstale":"2023-10-24T00:44:53.226983+0000","last_undegraded":"2023-10-24T00:44:53.226983+0000","last_fullsized":"2023-10-24T00:44:53.226983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243889+0000","last_change":"2023-10-24T00:44:53.236614+0000","last_active":"2023-10-24T00:44:53.243889+0000","last_peered":"2023-10-24T00:44:53.243889+0000","last_clean":"2023-10-24T00:44:53.243889+0000","last_became_active":"2023-10-24T00:44:53.236304+0000","last_became_peered":"2023-10-24T00:44:53.236304+0000","last_unstale":"2023-10-24T00:44:53.243889+0000","last_undegraded":"2023-10-24T00:44:53.243889+0000","last_fullsized":"2023-10-24T00:44:53.243889+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224432+0000","last_change":"2023-10-24T00:44:52.869154+0000","last_active":"2023-10-24T00:44:53.224432+0000","last_peered":"2023-10-24T00:44:53.224432+0000","last_clean":"2023-10-24T00:44:53.224432+0000","last_became_active":"2023-10-24T00:44:52.868881+0000","last_became_peered":"2023-10-24T00:44:52.868881+0000","last_unstale":"2023-10-24T00:44:53.224432+0000","last_undegraded":"2023-10-24T00:44:53.224432+0000","last_fullsized":"2023-10-24T00:44:53.224432+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244884+0000","last_change":"2023-10-24T00:44:53.236547+0000","last_active":"2023-10-24T00:44:53.244884+0000","last_peered":"2023-10-24T00:44:53.244884+0000","last_clean":"2023-10-24T00:44:53.244884+0000","last_became_active":"2023-10-24T00:44:53.236182+0000","last_became_peered":"2023-10-24T00:44:53.236182+0000","last_unstale":"2023-10-24T00:44:53.244884+0000","last_undegraded":"2023-10-24T00:44:53.244884+0000","last_fullsized":"2023-10-24T00:44:53.244884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.237709+0000","last_change":"2023-10-24T00:44:52.879633+0000","last_active":"2023-10-24T00:44:53.237709+0000","last_peered":"2023-10-24T00:44:53.237709+0000","last_clean":"2023-10-24T00:44:53.237709+0000","last_became_active":"2023-10-24T00:44:52.879389+0000","last_became_peered":"2023-10-24T00:44:52.879389+0000","last_unstale":"2023-10-24T00:44:53.237709+0000","last_undegraded":"2023-10-24T00:44:53.237709+0000","last_fullsized":"2023-10-24T00:44:53.237709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244560+0000","last_change":"2023-10-24T00:44:53.241020+0000","last_active":"2023-10-24T00:44:53.244560+0000","last_peered":"2023-10-24T00:44:53.244560+0000","last_clean":"2023-10-24T00:44:53.244560+0000","last_became_active":"2023-10-24T00:44:53.240362+0000","last_became_peered":"2023-10-24T00:44:53.240362+0000","last_unstale":"2023-10-24T00:44:53.244560+0000","last_undegraded":"2023-10-24T00:44:53.244560+0000","last_fullsized":"2023-10-24T00:44:53.244560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235450+0000","last_change":"2023-10-24T00:44:52.862357+0000","last_active":"2023-10-24T00:44:53.235450+0000","last_peered":"2023-10-24T00:44:53.235450+0000","last_clean":"2023-10-24T00:44:53.235450+0000","last_became_active":"2023-10-24T00:44:52.862088+0000","last_became_peered":"2023-10-24T00:44:52.862088+0000","last_unstale":"2023-10-24T00:44:53.235450+0000","last_undegraded":"2023-10-24T00:44:53.235450+0000","last_fullsized":"2023-10-24T00:44:53.235450+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247922+0000","last_change":"2023-10-24T00:44:53.247382+0000","last_active":"2023-10-24T00:44:53.247922+0000","last_peered":"2023-10-24T00:44:53.247922+0000","last_clean":"2023-10-24T00:44:53.247922+0000","last_became_active":"2023-10-24T00:44:53.247132+0000","last_became_peered":"2023-10-24T00:44:53.247132+0000","last_unstale":"2023-10-24T00:44:53.247922+0000","last_undegraded":"2023-10-24T00:44:53.247922+0000","last_fullsized":"2023-10-24T00:44:53.247922+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240264+0000","last_change":"2023-10-24T00:44:52.873476+0000","last_active":"2023-10-24T00:44:53.240264+0000","last_peered":"2023-10-24T00:44:53.240264+0000","last_clean":"2023-10-24T00:44:53.240264+0000","last_became_active":"2023-10-24T00:44:52.873160+0000","last_became_peered":"2023-10-24T00:44:52.873160+0000","last_unstale":"2023-10-24T00:44:53.240264+0000","last_undegraded":"2023-10-24T00:44:53.240264+0000","last_fullsized":"2023-10-24T00:44:53.240264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245029+0000","last_change":"2023-10-24T00:44:53.235077+0000","last_active":"2023-10-24T00:44:53.245029+0000","last_peered":"2023-10-24T00:44:53.245029+0000","last_clean":"2023-10-24T00:44:53.245029+0000","last_became_active":"2023-10-24T00:44:53.234771+0000","last_became_peered":"2023-10-24T00:44:53.234771+0000","last_unstale":"2023-10-24T00:44:53.245029+0000","last_undegraded":"2023-10-24T00:44:53.245029+0000","last_fullsized":"2023-10-24T00:44:53.245029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224290+0000","last_change":"2023-10-24T00:44:52.866284+0000","last_active":"2023-10-24T00:44:53.224290+0000","last_peered":"2023-10-24T00:44:53.224290+0000","last_clean":"2023-10-24T00:44:53.224290+0000","last_became_active":"2023-10-24T00:44:52.865991+0000","last_became_peered":"2023-10-24T00:44:52.865991+0000","last_unstale":"2023-10-24T00:44:53.224290+0000","last_undegraded":"2023-10-24T00:44:53.224290+0000","last_fullsized":"2023-10-24T00:44:53.224290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240830+0000","last_change":"2023-10-24T00:44:53.238911+0000","last_active":"2023-10-24T00:44:53.240830+0000","last_peered":"2023-10-24T00:44:53.240830+0000","last_clean":"2023-10-24T00:44:53.240830+0000","last_became_active":"2023-10-24T00:44:53.238649+0000","last_became_peered":"2023-10-24T00:44:53.238649+0000","last_unstale":"2023-10-24T00:44:53.240830+0000","last_undegraded":"2023-10-24T00:44:53.240830+0000","last_fullsized":"2023-10-24T00:44:53.240830+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226824+0000","last_change":"2023-10-24T00:44:52.876205+0000","last_active":"2023-10-24T00:44:53.226824+0000","last_peered":"2023-10-24T00:44:53.226824+0000","last_clean":"2023-10-24T00:44:53.226824+0000","last_became_active":"2023-10-24T00:44:52.875971+0000","last_became_peered":"2023-10-24T00:44:52.875971+0000","last_unstale":"2023-10-24T00:44:53.226824+0000","last_undegraded":"2023-10-24T00:44:53.226824+0000","last_fullsized":"2023-10-24T00:44:53.226824+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.230166+0000","last_change":"2023-10-24T00:44:53.225651+0000","last_active":"2023-10-24T00:44:53.230166+0000","last_peered":"2023-10-24T00:44:53.230166+0000","last_clean":"2023-10-24T00:44:53.230166+0000","last_became_active":"2023-10-24T00:44:53.225361+0000","last_became_peered":"2023-10-24T00:44:53.225361+0000","last_unstale":"2023-10-24T00:44:53.230166+0000","last_undegraded":"2023-10-24T00:44:53.230166+0000","last_fullsized":"2023-10-24T00:44:53.230166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220518+0000","last_change":"2023-10-24T00:44:52.864136+0000","last_active":"2023-10-24T00:44:53.220518+0000","last_peered":"2023-10-24T00:44:53.220518+0000","last_clean":"2023-10-24T00:44:53.220518+0000","last_became_active":"2023-10-24T00:44:52.863448+0000","last_became_peered":"2023-10-24T00:44:52.863448+0000","last_unstale":"2023-10-24T00:44:53.220518+0000","last_undegraded":"2023-10-24T00:44:53.220518+0000","last_fullsized":"2023-10-24T00:44:53.220518+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243581+0000","last_change":"2023-10-24T00:44:53.234371+0000","last_active":"2023-10-24T00:44:53.243581+0000","last_peered":"2023-10-24T00:44:53.243581+0000","last_clean":"2023-10-24T00:44:53.243581+0000","last_became_active":"2023-10-24T00:44:53.234148+0000","last_became_peered":"2023-10-24T00:44:53.234148+0000","last_unstale":"2023-10-24T00:44:53.243581+0000","last_undegraded":"2023-10-24T00:44:53.243581+0000","last_fullsized":"2023-10-24T00:44:53.243581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.227752+0000","last_change":"2023-10-24T00:44:52.866713+0000","last_active":"2023-10-24T00:44:53.227752+0000","last_peered":"2023-10-24T00:44:53.227752+0000","last_clean":"2023-10-24T00:44:53.227752+0000","last_became_active":"2023-10-24T00:44:52.865786+0000","last_became_peered":"2023-10-24T00:44:52.865786+0000","last_unstale":"2023-10-24T00:44:53.227752+0000","last_undegraded":"2023-10-24T00:44:53.227752+0000","last_fullsized":"2023-10-24T00:44:53.227752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244677+0000","last_change":"2023-10-24T00:44:53.237847+0000","last_active":"2023-10-24T00:44:53.244677+0000","last_peered":"2023-10-24T00:44:53.244677+0000","last_clean":"2023-10-24T00:44:53.244677+0000","last_became_active":"2023-10-24T00:44:53.237604+0000","last_became_peered":"2023-10-24T00:44:53.237604+0000","last_unstale":"2023-10-24T00:44:53.244677+0000","last_undegraded":"2023-10-24T00:44:53.244677+0000","last_fullsized":"2023-10-24T00:44:53.244677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219976+0000","last_change":"2023-10-24T00:44:52.865866+0000","last_active":"2023-10-24T00:44:53.219976+0000","last_peered":"2023-10-24T00:44:53.219976+0000","last_clean":"2023-10-24T00:44:53.219976+0000","last_became_active":"2023-10-24T00:44:52.865536+0000","last_became_peered":"2023-10-24T00:44:52.865536+0000","last_unstale":"2023-10-24T00:44:53.219976+0000","last_undegraded":"2023-10-24T00:44:53.219976+0000","last_fullsized":"2023-10-24T00:44:53.219976+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244732+0000","last_change":"2023-10-24T00:44:53.236082+0000","last_active":"2023-10-24T00:44:53.244732+0000","last_peered":"2023-10-24T00:44:53.244732+0000","last_clean":"2023-10-24T00:44:53.244732+0000","last_became_active":"2023-10-24T00:44:53.235704+0000","last_became_peered":"2023-10-24T00:44:53.235704+0000","last_unstale":"2023-10-24T00:44:53.244732+0000","last_undegraded":"2023-10-24T00:44:53.244732+0000","last_fullsized":"2023-10-24T00:44:53.244732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245559+0000","last_change":"2023-10-24T00:44:52.863063+0000","last_active":"2023-10-24T00:44:53.245559+0000","last_peered":"2023-10-24T00:44:53.245559+0000","last_clean":"2023-10-24T00:44:53.245559+0000","last_became_active":"2023-10-24T00:44:52.862619+0000","last_became_peered":"2023-10-24T00:44:52.862619+0000","last_unstale":"2023-10-24T00:44:53.245559+0000","last_undegraded":"2023-10-24T00:44:53.245559+0000","last_fullsized":"2023-10-24T00:44:53.245559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238710+0000","last_change":"2023-10-24T00:44:53.234338+0000","last_active":"2023-10-24T00:44:53.238710+0000","last_peered":"2023-10-24T00:44:53.238710+0000","last_clean":"2023-10-24T00:44:53.238710+0000","last_became_active":"2023-10-24T00:44:53.234078+0000","last_became_peered":"2023-10-24T00:44:53.234078+0000","last_unstale":"2023-10-24T00:44:53.238710+0000","last_undegraded":"2023-10-24T00:44:53.238710+0000","last_fullsized":"2023-10-24T00:44:53.238710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233694+0000","last_change":"2023-10-24T00:44:52.878338+0000","last_active":"2023-10-24T00:44:53.233694+0000","last_peered":"2023-10-24T00:44:53.233694+0000","last_clean":"2023-10-24T00:44:53.233694+0000","last_became_active":"2023-10-24T00:44:52.878109+0000","last_became_peered":"2023-10-24T00:44:52.878109+0000","last_unstale":"2023-10-24T00:44:53.233694+0000","last_undegraded":"2023-10-24T00:44:53.233694+0000","last_fullsized":"2023-10-24T00:44:53.233694+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248731+0000","last_change":"2023-10-24T00:44:53.246690+0000","last_active":"2023-10-24T00:44:53.248731+0000","last_peered":"2023-10-24T00:44:53.248731+0000","last_clean":"2023-10-24T00:44:53.248731+0000","last_became_active":"2023-10-24T00:44:53.240775+0000","last_became_peered":"2023-10-24T00:44:53.240775+0000","last_unstale":"2023-10-24T00:44:53.248731+0000","last_undegraded":"2023-10-24T00:44:53.248731+0000","last_fullsized":"2023-10-24T00:44:53.248731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219781+0000","last_change":"2023-10-24T00:44:52.864512+0000","last_active":"2023-10-24T00:44:53.219781+0000","last_peered":"2023-10-24T00:44:53.219781+0000","last_clean":"2023-10-24T00:44:53.219781+0000","last_became_active":"2023-10-24T00:44:52.863937+0000","last_became_peered":"2023-10-24T00:44:52.863937+0000","last_unstale":"2023-10-24T00:44:53.219781+0000","last_undegraded":"2023-10-24T00:44:53.219781+0000","last_fullsized":"2023-10-24T00:44:53.219781+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236007+0000","last_change":"2023-10-24T00:44:53.233331+0000","last_active":"2023-10-24T00:44:53.236007+0000","last_peered":"2023-10-24T00:44:53.236007+0000","last_clean":"2023-10-24T00:44:53.236007+0000","last_became_active":"2023-10-24T00:44:53.233022+0000","last_became_peered":"2023-10-24T00:44:53.233022+0000","last_unstale":"2023-10-24T00:44:53.236007+0000","last_undegraded":"2023-10-24T00:44:53.236007+0000","last_fullsized":"2023-10-24T00:44:53.236007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220793+0000","last_change":"2023-10-24T00:44:52.869954+0000","last_active":"2023-10-24T00:44:53.220793+0000","last_peered":"2023-10-24T00:44:53.220793+0000","last_clean":"2023-10-24T00:44:53.220793+0000","last_became_active":"2023-10-24T00:44:52.869693+0000","last_became_peered":"2023-10-24T00:44:52.869693+0000","last_unstale":"2023-10-24T00:44:53.220793+0000","last_undegraded":"2023-10-24T00:44:53.220793+0000","last_fullsized":"2023-10-24T00:44:53.220793+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240351+0000","last_change":"2023-10-24T00:44:53.237184+0000","last_active":"2023-10-24T00:44:53.240351+0000","last_peered":"2023-10-24T00:44:53.240351+0000","last_clean":"2023-10-24T00:44:53.240351+0000","last_became_active":"2023-10-24T00:44:53.236868+0000","last_became_peered":"2023-10-24T00:44:53.236868+0000","last_unstale":"2023-10-24T00:44:53.240351+0000","last_undegraded":"2023-10-24T00:44:53.240351+0000","last_fullsized":"2023-10-24T00:44:53.240351+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240283+0000","last_change":"2023-10-24T00:44:52.871760+0000","last_active":"2023-10-24T00:44:53.240283+0000","last_peered":"2023-10-24T00:44:53.240283+0000","last_clean":"2023-10-24T00:44:53.240283+0000","last_became_active":"2023-10-24T00:44:52.871466+0000","last_became_peered":"2023-10-24T00:44:52.871466+0000","last_unstale":"2023-10-24T00:44:53.240283+0000","last_undegraded":"2023-10-24T00:44:53.240283+0000","last_fullsized":"2023-10-24T00:44:53.240283+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.234623+0000","last_change":"2023-10-24T00:44:53.225403+0000","last_active":"2023-10-24T00:44:53.234623+0000","last_peered":"2023-10-24T00:44:53.234623+0000","last_clean":"2023-10-24T00:44:53.234623+0000","last_became_active":"2023-10-24T00:44:53.225145+0000","last_became_peered":"2023-10-24T00:44:53.225145+0000","last_unstale":"2023-10-24T00:44:53.234623+0000","last_undegraded":"2023-10-24T00:44:53.234623+0000","last_fullsized":"2023-10-24T00:44:53.234623+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220406+0000","last_change":"2023-10-24T00:44:52.864369+0000","last_active":"2023-10-24T00:44:53.220406+0000","last_peered":"2023-10-24T00:44:53.220406+0000","last_clean":"2023-10-24T00:44:53.220406+0000","last_became_active":"2023-10-24T00:44:52.864101+0000","last_became_peered":"2023-10-24T00:44:52.864101+0000","last_unstale":"2023-10-24T00:44:53.220406+0000","last_undegraded":"2023-10-24T00:44:53.220406+0000","last_fullsized":"2023-10-24T00:44:53.220406+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240364+0000","last_change":"2023-10-24T00:44:53.236562+0000","last_active":"2023-10-24T00:44:53.240364+0000","last_peered":"2023-10-24T00:44:53.240364+0000","last_clean":"2023-10-24T00:44:53.240364+0000","last_became_active":"2023-10-24T00:44:53.236290+0000","last_became_peered":"2023-10-24T00:44:53.236290+0000","last_unstale":"2023-10-24T00:44:53.240364+0000","last_undegraded":"2023-10-24T00:44:53.240364+0000","last_fullsized":"2023-10-24T00:44:53.240364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223707+0000","last_change":"2023-10-24T00:44:52.873448+0000","last_active":"2023-10-24T00:44:53.223707+0000","last_peered":"2023-10-24T00:44:53.223707+0000","last_clean":"2023-10-24T00:44:53.223707+0000","last_became_active":"2023-10-24T00:44:52.873178+0000","last_became_peered":"2023-10-24T00:44:52.873178+0000","last_unstale":"2023-10-24T00:44:53.223707+0000","last_undegraded":"2023-10-24T00:44:53.223707+0000","last_fullsized":"2023-10-24T00:44:53.223707+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244878+0000","last_change":"2023-10-24T00:44:53.236091+0000","last_active":"2023-10-24T00:44:53.244878+0000","last_peered":"2023-10-24T00:44:53.244878+0000","last_clean":"2023-10-24T00:44:53.244878+0000","last_became_active":"2023-10-24T00:44:53.235821+0000","last_became_peered":"2023-10-24T00:44:53.235821+0000","last_unstale":"2023-10-24T00:44:53.244878+0000","last_undegraded":"2023-10-24T00:44:53.244878+0000","last_fullsized":"2023-10-24T00:44:53.244878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239394+0000","last_change":"2023-10-24T00:44:52.874740+0000","last_active":"2023-10-24T00:44:53.239394+0000","last_peered":"2023-10-24T00:44:53.239394+0000","last_clean":"2023-10-24T00:44:53.239394+0000","last_became_active":"2023-10-24T00:44:52.874458+0000","last_became_peered":"2023-10-24T00:44:52.874458+0000","last_unstale":"2023-10-24T00:44:53.239394+0000","last_undegraded":"2023-10-24T00:44:53.239394+0000","last_fullsized":"2023-10-24T00:44:53.239394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240425+0000","last_change":"2023-10-24T00:44:53.235081+0000","last_active":"2023-10-24T00:44:53.240425+0000","last_peered":"2023-10-24T00:44:53.240425+0000","last_clean":"2023-10-24T00:44:53.240425+0000","last_became_active":"2023-10-24T00:44:53.234738+0000","last_became_peered":"2023-10-24T00:44:53.234738+0000","last_unstale":"2023-10-24T00:44:53.240425+0000","last_undegraded":"2023-10-24T00:44:53.240425+0000","last_fullsized":"2023-10-24T00:44:53.240425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223792+0000","last_change":"2023-10-24T00:44:52.866873+0000","last_active":"2023-10-24T00:44:53.223792+0000","last_peered":"2023-10-24T00:44:53.223792+0000","last_clean":"2023-10-24T00:44:53.223792+0000","last_became_active":"2023-10-24T00:44:52.866628+0000","last_became_peered":"2023-10-24T00:44:52.866628+0000","last_unstale":"2023-10-24T00:44:53.223792+0000","last_undegraded":"2023-10-24T00:44:53.223792+0000","last_fullsized":"2023-10-24T00:44:53.223792+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244768+0000","last_change":"2023-10-24T00:44:53.236265+0000","last_active":"2023-10-24T00:44:53.244768+0000","last_peered":"2023-10-24T00:44:53.244768+0000","last_clean":"2023-10-24T00:44:53.244768+0000","last_became_active":"2023-10-24T00:44:53.235991+0000","last_became_peered":"2023-10-24T00:44:53.235991+0000","last_unstale":"2023-10-24T00:44:53.244768+0000","last_undegraded":"2023-10-24T00:44:53.244768+0000","last_fullsized":"2023-10-24T00:44:53.244768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245103+0000","last_change":"2023-10-24T00:44:52.876267+0000","last_active":"2023-10-24T00:44:53.245103+0000","last_peered":"2023-10-24T00:44:53.245103+0000","last_clean":"2023-10-24T00:44:53.245103+0000","last_became_active":"2023-10-24T00:44:52.876014+0000","last_became_peered":"2023-10-24T00:44:52.876014+0000","last_unstale":"2023-10-24T00:44:53.245103+0000","last_undegraded":"2023-10-24T00:44:53.245103+0000","last_fullsized":"2023-10-24T00:44:53.245103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235215+0000","last_change":"2023-10-24T00:44:53.234330+0000","last_active":"2023-10-24T00:44:53.235215+0000","last_peered":"2023-10-24T00:44:53.235215+0000","last_clean":"2023-10-24T00:44:53.235215+0000","last_became_active":"2023-10-24T00:44:53.234069+0000","last_became_peered":"2023-10-24T00:44:53.234069+0000","last_unstale":"2023-10-24T00:44:53.235215+0000","last_undegraded":"2023-10-24T00:44:53.235215+0000","last_fullsized":"2023-10-24T00:44:53.235215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.225478+0000","last_change":"2023-10-24T00:44:52.865761+0000","last_active":"2023-10-24T00:44:53.225478+0000","last_peered":"2023-10-24T00:44:53.225478+0000","last_clean":"2023-10-24T00:44:53.225478+0000","last_became_active":"2023-10-24T00:44:52.865462+0000","last_became_peered":"2023-10-24T00:44:52.865462+0000","last_unstale":"2023-10-24T00:44:53.225478+0000","last_undegraded":"2023-10-24T00:44:53.225478+0000","last_fullsized":"2023-10-24T00:44:53.225478+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245308+0000","last_change":"2023-10-24T00:44:53.242962+0000","last_active":"2023-10-24T00:44:53.245308+0000","last_peered":"2023-10-24T00:44:53.245308+0000","last_clean":"2023-10-24T00:44:53.245308+0000","last_became_active":"2023-10-24T00:44:53.242107+0000","last_became_peered":"2023-10-24T00:44:53.242107+0000","last_unstale":"2023-10-24T00:44:53.245308+0000","last_undegraded":"2023-10-24T00:44:53.245308+0000","last_fullsized":"2023-10-24T00:44:53.245308+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219469+0000","last_change":"2023-10-24T00:44:52.867563+0000","last_active":"2023-10-24T00:44:53.219469+0000","last_peered":"2023-10-24T00:44:53.219469+0000","last_clean":"2023-10-24T00:44:53.219469+0000","last_became_active":"2023-10-24T00:44:52.866919+0000","last_became_peered":"2023-10-24T00:44:52.866919+0000","last_unstale":"2023-10-24T00:44:53.219469+0000","last_undegraded":"2023-10-24T00:44:53.219469+0000","last_fullsized":"2023-10-24T00:44:53.219469+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244718+0000","last_change":"2023-10-24T00:44:53.232728+0000","last_active":"2023-10-24T00:44:53.244718+0000","last_peered":"2023-10-24T00:44:53.244718+0000","last_clean":"2023-10-24T00:44:53.244718+0000","last_became_active":"2023-10-24T00:44:53.232164+0000","last_became_peered":"2023-10-24T00:44:53.232164+0000","last_unstale":"2023-10-24T00:44:53.244718+0000","last_undegraded":"2023-10-24T00:44:53.244718+0000","last_fullsized":"2023-10-24T00:44:53.244718+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219752+0000","last_change":"2023-10-24T00:44:52.880224+0000","last_active":"2023-10-24T00:44:53.219752+0000","last_peered":"2023-10-24T00:44:53.219752+0000","last_clean":"2023-10-24T00:44:53.219752+0000","last_became_active":"2023-10-24T00:44:52.879960+0000","last_became_peered":"2023-10-24T00:44:52.879960+0000","last_unstale":"2023-10-24T00:44:53.219752+0000","last_undegraded":"2023-10-24T00:44:53.219752+0000","last_fullsized":"2023-10-24T00:44:53.219752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235071+0000","last_change":"2023-10-24T00:44:53.232846+0000","last_active":"2023-10-24T00:44:53.235071+0000","last_peered":"2023-10-24T00:44:53.235071+0000","last_clean":"2023-10-24T00:44:53.235071+0000","last_became_active":"2023-10-24T00:44:53.231493+0000","last_became_peered":"2023-10-24T00:44:53.231493+0000","last_unstale":"2023-10-24T00:44:53.235071+0000","last_undegraded":"2023-10-24T00:44:53.235071+0000","last_fullsized":"2023-10-24T00:44:53.235071+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.227566+0000","last_change":"2023-10-24T00:44:52.860400+0000","last_active":"2023-10-24T00:44:53.227566+0000","last_peered":"2023-10-24T00:44:53.227566+0000","last_clean":"2023-10-24T00:44:53.227566+0000","last_became_active":"2023-10-24T00:44:52.860093+0000","last_became_peered":"2023-10-24T00:44:52.860093+0000","last_unstale":"2023-10-24T00:44:53.227566+0000","last_undegraded":"2023-10-24T00:44:53.227566+0000","last_fullsized":"2023-10-24T00:44:53.227566+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238966+0000","last_change":"2023-10-24T00:44:53.237442+0000","last_active":"2023-10-24T00:44:53.238966+0000","last_peered":"2023-10-24T00:44:53.238966+0000","last_clean":"2023-10-24T00:44:53.238966+0000","last_became_active":"2023-10-24T00:44:53.237233+0000","last_became_peered":"2023-10-24T00:44:53.237233+0000","last_unstale":"2023-10-24T00:44:53.238966+0000","last_undegraded":"2023-10-24T00:44:53.238966+0000","last_fullsized":"2023-10-24T00:44:53.238966+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223426+0000","last_change":"2023-10-24T00:44:52.875693+0000","last_active":"2023-10-24T00:44:53.223426+0000","last_peered":"2023-10-24T00:44:53.223426+0000","last_clean":"2023-10-24T00:44:53.223426+0000","last_became_active":"2023-10-24T00:44:52.875347+0000","last_became_peered":"2023-10-24T00:44:52.875347+0000","last_unstale":"2023-10-24T00:44:53.223426+0000","last_undegraded":"2023-10-24T00:44:53.223426+0000","last_fullsized":"2023-10-24T00:44:53.223426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.229044+0000","last_change":"2023-10-24T00:44:53.226466+0000","last_active":"2023-10-24T00:44:53.229044+0000","last_peered":"2023-10-24T00:44:53.229044+0000","last_clean":"2023-10-24T00:44:53.229044+0000","last_became_active":"2023-10-24T00:44:53.226179+0000","last_became_peered":"2023-10-24T00:44:53.226179+0000","last_unstale":"2023-10-24T00:44:53.229044+0000","last_undegraded":"2023-10-24T00:44:53.229044+0000","last_fullsized":"2023-10-24T00:44:53.229044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224527+0000","last_change":"2023-10-24T00:44:52.865616+0000","last_active":"2023-10-24T00:44:53.224527+0000","last_peered":"2023-10-24T00:44:53.224527+0000","last_clean":"2023-10-24T00:44:53.224527+0000","last_became_active":"2023-10-24T00:44:52.865358+0000","last_became_peered":"2023-10-24T00:44:52.865358+0000","last_unstale":"2023-10-24T00:44:53.224527+0000","last_undegraded":"2023-10-24T00:44:53.224527+0000","last_fullsized":"2023-10-24T00:44:53.224527+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248607+0000","last_change":"2023-10-24T00:44:53.240714+0000","last_active":"2023-10-24T00:44:53.248607+0000","last_peered":"2023-10-24T00:44:53.248607+0000","last_clean":"2023-10-24T00:44:53.248607+0000","last_became_active":"2023-10-24T00:44:53.235034+0000","last_became_peered":"2023-10-24T00:44:53.235034+0000","last_unstale":"2023-10-24T00:44:53.248607+0000","last_undegraded":"2023-10-24T00:44:53.248607+0000","last_fullsized":"2023-10-24T00:44:53.248607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223064+0000","last_change":"2023-10-24T00:44:52.866310+0000","last_active":"2023-10-24T00:44:53.223064+0000","last_peered":"2023-10-24T00:44:53.223064+0000","last_clean":"2023-10-24T00:44:53.223064+0000","last_became_active":"2023-10-24T00:44:52.865989+0000","last_became_peered":"2023-10-24T00:44:52.865989+0000","last_unstale":"2023-10-24T00:44:53.223064+0000","last_undegraded":"2023-10-24T00:44:53.223064+0000","last_fullsized":"2023-10-24T00:44:53.223064+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245040+0000","last_change":"2023-10-24T00:44:53.237121+0000","last_active":"2023-10-24T00:44:53.245040+0000","last_peered":"2023-10-24T00:44:53.245040+0000","last_clean":"2023-10-24T00:44:53.245040+0000","last_became_active":"2023-10-24T00:44:53.236844+0000","last_became_peered":"2023-10-24T00:44:53.236844+0000","last_unstale":"2023-10-24T00:44:53.245040+0000","last_undegraded":"2023-10-24T00:44:53.245040+0000","last_fullsized":"2023-10-24T00:44:53.245040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223765+0000","last_change":"2023-10-24T00:44:52.861611+0000","last_active":"2023-10-24T00:44:53.223765+0000","last_peered":"2023-10-24T00:44:53.223765+0000","last_clean":"2023-10-24T00:44:53.223765+0000","last_became_active":"2023-10-24T00:44:52.861335+0000","last_became_peered":"2023-10-24T00:44:52.861335+0000","last_unstale":"2023-10-24T00:44:53.223765+0000","last_undegraded":"2023-10-24T00:44:53.223765+0000","last_fullsized":"2023-10-24T00:44:53.223765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.231376+0000","last_change":"2023-10-24T00:44:53.225773+0000","last_active":"2023-10-24T00:44:53.231376+0000","last_peered":"2023-10-24T00:44:53.231376+0000","last_clean":"2023-10-24T00:44:53.231376+0000","last_became_active":"2023-10-24T00:44:53.225494+0000","last_became_peered":"2023-10-24T00:44:53.225494+0000","last_unstale":"2023-10-24T00:44:53.231376+0000","last_undegraded":"2023-10-24T00:44:53.231376+0000","last_fullsized":"2023-10-24T00:44:53.231376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223131+0000","last_change":"2023-10-24T00:44:52.870767+0000","last_active":"2023-10-24T00:44:53.223131+0000","last_peered":"2023-10-24T00:44:53.223131+0000","last_clean":"2023-10-24T00:44:53.223131+0000","last_became_active":"2023-10-24T00:44:52.870493+0000","last_became_peered":"2023-10-24T00:44:52.870493+0000","last_unstale":"2023-10-24T00:44:53.223131+0000","last_undegraded":"2023-10-24T00:44:53.223131+0000","last_fullsized":"2023-10-24T00:44:53.223131+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240435+0000","last_change":"2023-10-24T00:44:53.236323+0000","last_active":"2023-10-24T00:44:53.240435+0000","last_peered":"2023-10-24T00:44:53.240435+0000","last_clean":"2023-10-24T00:44:53.240435+0000","last_became_active":"2023-10-24T00:44:53.236038+0000","last_became_peered":"2023-10-24T00:44:53.236038+0000","last_unstale":"2023-10-24T00:44:53.240435+0000","last_undegraded":"2023-10-24T00:44:53.240435+0000","last_fullsized":"2023-10-24T00:44:53.240435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224303+0000","last_change":"2023-10-24T00:44:52.863478+0000","last_active":"2023-10-24T00:44:53.224303+0000","last_peered":"2023-10-24T00:44:53.224303+0000","last_clean":"2023-10-24T00:44:53.224303+0000","last_became_active":"2023-10-24T00:44:52.863224+0000","last_became_peered":"2023-10-24T00:44:52.863224+0000","last_unstale":"2023-10-24T00:44:53.224303+0000","last_undegraded":"2023-10-24T00:44:53.224303+0000","last_fullsized":"2023-10-24T00:44:53.224303+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248586+0000","last_change":"2023-10-24T00:44:53.235294+0000","last_active":"2023-10-24T00:44:53.248586+0000","last_peered":"2023-10-24T00:44:53.248586+0000","last_clean":"2023-10-24T00:44:53.248586+0000","last_became_active":"2023-10-24T00:44:53.234987+0000","last_became_peered":"2023-10-24T00:44:53.234987+0000","last_unstale":"2023-10-24T00:44:53.248586+0000","last_undegraded":"2023-10-24T00:44:53.248586+0000","last_fullsized":"2023-10-24T00:44:53.248586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.230742+0000","last_change":"2023-10-24T00:44:52.873938+0000","last_active":"2023-10-24T00:44:53.230742+0000","last_peered":"2023-10-24T00:44:53.230742+0000","last_clean":"2023-10-24T00:44:53.230742+0000","last_became_active":"2023-10-24T00:44:52.873027+0000","last_became_peered":"2023-10-24T00:44:52.873027+0000","last_unstale":"2023-10-24T00:44:53.230742+0000","last_undegraded":"2023-10-24T00:44:53.230742+0000","last_fullsized":"2023-10-24T00:44:53.230742+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244207+0000","last_change":"2023-10-24T00:44:53.242406+0000","last_active":"2023-10-24T00:44:53.244207+0000","last_peered":"2023-10-24T00:44:53.244207+0000","last_clean":"2023-10-24T00:44:53.244207+0000","last_became_active":"2023-10-24T00:44:53.242072+0000","last_became_peered":"2023-10-24T00:44:53.242072+0000","last_unstale":"2023-10-24T00:44:53.244207+0000","last_undegraded":"2023-10-24T00:44:53.244207+0000","last_fullsized":"2023-10-24T00:44:53.244207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238426+0000","last_change":"2023-10-24T00:44:52.864322+0000","last_active":"2023-10-24T00:44:53.238426+0000","last_peered":"2023-10-24T00:44:53.238426+0000","last_clean":"2023-10-24T00:44:53.238426+0000","last_became_active":"2023-10-24T00:44:52.863798+0000","last_became_peered":"2023-10-24T00:44:52.863798+0000","last_unstale":"2023-10-24T00:44:53.238426+0000","last_undegraded":"2023-10-24T00:44:53.238426+0000","last_fullsized":"2023-10-24T00:44:53.238426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.234611+0000","last_change":"2023-10-24T00:44:53.226685+0000","last_active":"2023-10-24T00:44:53.234611+0000","last_peered":"2023-10-24T00:44:53.234611+0000","last_clean":"2023-10-24T00:44:53.234611+0000","last_became_active":"2023-10-24T00:44:53.226369+0000","last_became_peered":"2023-10-24T00:44:53.226369+0000","last_unstale":"2023-10-24T00:44:53.234611+0000","last_undegraded":"2023-10-24T00:44:53.234611+0000","last_fullsized":"2023-10-24T00:44:53.234611+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236695+0000","last_change":"2023-10-24T00:44:52.879474+0000","last_active":"2023-10-24T00:44:53.236695+0000","last_peered":"2023-10-24T00:44:53.236695+0000","last_clean":"2023-10-24T00:44:53.236695+0000","last_became_active":"2023-10-24T00:44:52.879013+0000","last_became_peered":"2023-10-24T00:44:52.879013+0000","last_unstale":"2023-10-24T00:44:53.236695+0000","last_undegraded":"2023-10-24T00:44:53.236695+0000","last_fullsized":"2023-10-24T00:44:53.236695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240466+0000","last_change":"2023-10-24T00:44:53.235730+0000","last_active":"2023-10-24T00:44:53.240466+0000","last_peered":"2023-10-24T00:44:53.240466+0000","last_clean":"2023-10-24T00:44:53.240466+0000","last_became_active":"2023-10-24T00:44:53.235436+0000","last_became_peered":"2023-10-24T00:44:53.235436+0000","last_unstale":"2023-10-24T00:44:53.240466+0000","last_undegraded":"2023-10-24T00:44:53.240466+0000","last_fullsized":"2023-10-24T00:44:53.240466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247390+0000","last_change":"2023-10-24T00:44:52.872354+0000","last_active":"2023-10-24T00:44:53.247390+0000","last_peered":"2023-10-24T00:44:53.247390+0000","last_clean":"2023-10-24T00:44:53.247390+0000","last_became_active":"2023-10-24T00:44:52.872066+0000","last_became_peered":"2023-10-24T00:44:52.872066+0000","last_unstale":"2023-10-24T00:44:53.247390+0000","last_undegraded":"2023-10-24T00:44:53.247390+0000","last_fullsized":"2023-10-24T00:44:53.247390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240405+0000","last_change":"2023-10-24T00:44:53.235064+0000","last_active":"2023-10-24T00:44:53.240405+0000","last_peered":"2023-10-24T00:44:53.240405+0000","last_clean":"2023-10-24T00:44:53.240405+0000","last_became_active":"2023-10-24T00:44:53.234700+0000","last_became_peered":"2023-10-24T00:44:53.234700+0000","last_unstale":"2023-10-24T00:44:53.240405+0000","last_undegraded":"2023-10-24T00:44:53.240405+0000","last_fullsized":"2023-10-24T00:44:53.240405+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.231746+0000","last_change":"2023-10-24T00:44:52.878921+0000","last_active":"2023-10-24T00:44:53.231746+0000","last_peered":"2023-10-24T00:44:53.231746+0000","last_clean":"2023-10-24T00:44:53.231746+0000","last_became_active":"2023-10-24T00:44:52.878189+0000","last_became_peered":"2023-10-24T00:44:52.878189+0000","last_unstale":"2023-10-24T00:44:53.231746+0000","last_undegraded":"2023-10-24T00:44:53.231746+0000","last_fullsized":"2023-10-24T00:44:53.231746+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243535+0000","last_change":"2023-10-24T00:44:53.231785+0000","last_active":"2023-10-24T00:44:53.243535+0000","last_peered":"2023-10-24T00:44:53.243535+0000","last_clean":"2023-10-24T00:44:53.243535+0000","last_became_active":"2023-10-24T00:44:53.231446+0000","last_became_peered":"2023-10-24T00:44:53.231446+0000","last_unstale":"2023-10-24T00:44:53.243535+0000","last_undegraded":"2023-10-24T00:44:53.243535+0000","last_fullsized":"2023-10-24T00:44:53.243535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224394+0000","last_change":"2023-10-24T00:44:52.862768+0000","last_active":"2023-10-24T00:44:53.224394+0000","last_peered":"2023-10-24T00:44:53.224394+0000","last_clean":"2023-10-24T00:44:53.224394+0000","last_became_active":"2023-10-24T00:44:52.862472+0000","last_became_peered":"2023-10-24T00:44:52.862472+0000","last_unstale":"2023-10-24T00:44:53.224394+0000","last_undegraded":"2023-10-24T00:44:53.224394+0000","last_fullsized":"2023-10-24T00:44:53.224394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248742+0000","last_change":"2023-10-24T00:44:53.246709+0000","last_active":"2023-10-24T00:44:53.248742+0000","last_peered":"2023-10-24T00:44:53.248742+0000","last_clean":"2023-10-24T00:44:53.248742+0000","last_became_active":"2023-10-24T00:44:53.235083+0000","last_became_peered":"2023-10-24T00:44:53.235083+0000","last_unstale":"2023-10-24T00:44:53.248742+0000","last_undegraded":"2023-10-24T00:44:53.248742+0000","last_fullsized":"2023-10-24T00:44:53.248742+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223245+0000","last_change":"2023-10-24T00:44:52.866288+0000","last_active":"2023-10-24T00:44:53.223245+0000","last_peered":"2023-10-24T00:44:53.223245+0000","last_clean":"2023-10-24T00:44:53.223245+0000","last_became_active":"2023-10-24T00:44:52.865921+0000","last_became_peered":"2023-10-24T00:44:52.865921+0000","last_unstale":"2023-10-24T00:44:53.223245+0000","last_undegraded":"2023-10-24T00:44:53.223245+0000","last_fullsized":"2023-10-24T00:44:53.223245+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240784+0000","last_change":"2023-10-24T00:44:53.238872+0000","last_active":"2023-10-24T00:44:53.240784+0000","last_peered":"2023-10-24T00:44:53.240784+0000","last_clean":"2023-10-24T00:44:53.240784+0000","last_became_active":"2023-10-24T00:44:53.238512+0000","last_became_peered":"2023-10-24T00:44:53.238512+0000","last_unstale":"2023-10-24T00:44:53.240784+0000","last_undegraded":"2023-10-24T00:44:53.240784+0000","last_fullsized":"2023-10-24T00:44:53.240784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220794+0000","last_change":"2023-10-24T00:44:52.872280+0000","last_active":"2023-10-24T00:44:53.220794+0000","last_peered":"2023-10-24T00:44:53.220794+0000","last_clean":"2023-10-24T00:44:53.220794+0000","last_became_active":"2023-10-24T00:44:52.872009+0000","last_became_peered":"2023-10-24T00:44:52.872009+0000","last_unstale":"2023-10-24T00:44:53.220794+0000","last_undegraded":"2023-10-24T00:44:53.220794+0000","last_fullsized":"2023-10-24T00:44:53.220794+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242191+0000","last_change":"2023-10-24T00:44:53.238934+0000","last_active":"2023-10-24T00:44:53.242191+0000","last_peered":"2023-10-24T00:44:53.242191+0000","last_clean":"2023-10-24T00:44:53.242191+0000","last_became_active":"2023-10-24T00:44:53.238636+0000","last_became_peered":"2023-10-24T00:44:53.238636+0000","last_unstale":"2023-10-24T00:44:53.242191+0000","last_undegraded":"2023-10-24T00:44:53.242191+0000","last_fullsized":"2023-10-24T00:44:53.242191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.218453+0000","last_change":"2023-10-24T00:44:52.866192+0000","last_active":"2023-10-24T00:44:53.218453+0000","last_peered":"2023-10-24T00:44:53.218453+0000","last_clean":"2023-10-24T00:44:53.218453+0000","last_became_active":"2023-10-24T00:44:52.865838+0000","last_became_peered":"2023-10-24T00:44:52.865838+0000","last_unstale":"2023-10-24T00:44:53.218453+0000","last_undegraded":"2023-10-24T00:44:53.218453+0000","last_fullsized":"2023-10-24T00:44:53.218453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242826+0000","last_change":"2023-10-24T00:44:53.231518+0000","last_active":"2023-10-24T00:44:53.242826+0000","last_peered":"2023-10-24T00:44:53.242826+0000","last_clean":"2023-10-24T00:44:53.242826+0000","last_became_active":"2023-10-24T00:44:53.231245+0000","last_became_peered":"2023-10-24T00:44:53.231245+0000","last_unstale":"2023-10-24T00:44:53.242826+0000","last_undegraded":"2023-10-24T00:44:53.242826+0000","last_fullsized":"2023-10-24T00:44:53.242826+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220335+0000","last_change":"2023-10-24T00:44:52.879349+0000","last_active":"2023-10-24T00:44:53.220335+0000","last_peered":"2023-10-24T00:44:53.220335+0000","last_clean":"2023-10-24T00:44:53.220335+0000","last_became_active":"2023-10-24T00:44:52.879088+0000","last_became_peered":"2023-10-24T00:44:52.879088+0000","last_unstale":"2023-10-24T00:44:53.220335+0000","last_undegraded":"2023-10-24T00:44:53.220335+0000","last_fullsized":"2023-10-24T00:44:53.220335+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242085+0000","last_change":"2023-10-24T00:44:53.240738+0000","last_active":"2023-10-24T00:44:53.242085+0000","last_peered":"2023-10-24T00:44:53.242085+0000","last_clean":"2023-10-24T00:44:53.242085+0000","last_became_active":"2023-10-24T00:44:53.240447+0000","last_became_peered":"2023-10-24T00:44:53.240447+0000","last_unstale":"2023-10-24T00:44:53.242085+0000","last_undegraded":"2023-10-24T00:44:53.242085+0000","last_fullsized":"2023-10-24T00:44:53.242085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223511+0000","last_change":"2023-10-24T00:44:52.861471+0000","last_active":"2023-10-24T00:44:53.223511+0000","last_peered":"2023-10-24T00:44:53.223511+0000","last_clean":"2023-10-24T00:44:53.223511+0000","last_became_active":"2023-10-24T00:44:52.861167+0000","last_became_peered":"2023-10-24T00:44:52.861167+0000","last_unstale":"2023-10-24T00:44:53.223511+0000","last_undegraded":"2023-10-24T00:44:53.223511+0000","last_fullsized":"2023-10-24T00:44:53.223511+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235342+0000","last_change":"2023-10-24T00:44:53.234243+0000","last_active":"2023-10-24T00:44:53.235342+0000","last_peered":"2023-10-24T00:44:53.235342+0000","last_clean":"2023-10-24T00:44:53.235342+0000","last_became_active":"2023-10-24T00:44:53.233994+0000","last_became_peered":"2023-10-24T00:44:53.233994+0000","last_unstale":"2023-10-24T00:44:53.235342+0000","last_undegraded":"2023-10-24T00:44:53.235342+0000","last_fullsized":"2023-10-24T00:44:53.235342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244913+0000","last_change":"2023-10-24T00:44:52.865340+0000","last_active":"2023-10-24T00:44:53.244913+0000","last_peered":"2023-10-24T00:44:53.244913+0000","last_clean":"2023-10-24T00:44:53.244913+0000","last_became_active":"2023-10-24T00:44:52.865078+0000","last_became_peered":"2023-10-24T00:44:52.865078+0000","last_unstale":"2023-10-24T00:44:53.244913+0000","last_undegraded":"2023-10-24T00:44:53.244913+0000","last_fullsized":"2023-10-24T00:44:53.244913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244250+0000","last_change":"2023-10-24T00:44:53.242804+0000","last_active":"2023-10-24T00:44:53.244250+0000","last_peered":"2023-10-24T00:44:53.244250+0000","last_clean":"2023-10-24T00:44:53.244250+0000","last_became_active":"2023-10-24T00:44:53.242524+0000","last_became_peered":"2023-10-24T00:44:53.242524+0000","last_unstale":"2023-10-24T00:44:53.244250+0000","last_undegraded":"2023-10-24T00:44:53.244250+0000","last_fullsized":"2023-10-24T00:44:53.244250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241192+0000","last_change":"2023-10-24T00:44:52.879117+0000","last_active":"2023-10-24T00:44:53.241192+0000","last_peered":"2023-10-24T00:44:53.241192+0000","last_clean":"2023-10-24T00:44:53.241192+0000","last_became_active":"2023-10-24T00:44:52.878528+0000","last_became_peered":"2023-10-24T00:44:52.878528+0000","last_unstale":"2023-10-24T00:44:53.241192+0000","last_undegraded":"2023-10-24T00:44:53.241192+0000","last_fullsized":"2023-10-24T00:44:53.241192+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240648+0000","last_change":"2023-10-24T00:44:53.235960+0000","last_active":"2023-10-24T00:44:53.240648+0000","last_peered":"2023-10-24T00:44:53.240648+0000","last_clean":"2023-10-24T00:44:53.240648+0000","last_became_active":"2023-10-24T00:44:53.235688+0000","last_became_peered":"2023-10-24T00:44:53.235688+0000","last_unstale":"2023-10-24T00:44:53.240648+0000","last_undegraded":"2023-10-24T00:44:53.240648+0000","last_fullsized":"2023-10-24T00:44:53.240648+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240028+0000","last_change":"2023-10-24T00:44:52.865289+0000","last_active":"2023-10-24T00:44:53.240028+0000","last_peered":"2023-10-24T00:44:53.240028+0000","last_clean":"2023-10-24T00:44:53.240028+0000","last_became_active":"2023-10-24T00:44:52.864991+0000","last_became_peered":"2023-10-24T00:44:52.864991+0000","last_unstale":"2023-10-24T00:44:53.240028+0000","last_undegraded":"2023-10-24T00:44:53.240028+0000","last_fullsized":"2023-10-24T00:44:53.240028+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242216+0000","last_change":"2023-10-24T00:44:53.239236+0000","last_active":"2023-10-24T00:44:53.242216+0000","last_peered":"2023-10-24T00:44:53.242216+0000","last_clean":"2023-10-24T00:44:53.242216+0000","last_became_active":"2023-10-24T00:44:53.238972+0000","last_became_peered":"2023-10-24T00:44:53.238972+0000","last_unstale":"2023-10-24T00:44:53.242216+0000","last_undegraded":"2023-10-24T00:44:53.242216+0000","last_fullsized":"2023-10-24T00:44:53.242216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219472+0000","last_change":"2023-10-24T00:44:52.865878+0000","last_active":"2023-10-24T00:44:53.219472+0000","last_peered":"2023-10-24T00:44:53.219472+0000","last_clean":"2023-10-24T00:44:53.219472+0000","last_became_active":"2023-10-24T00:44:52.865595+0000","last_became_peered":"2023-10-24T00:44:52.865595+0000","last_unstale":"2023-10-24T00:44:53.219472+0000","last_undegraded":"2023-10-24T00:44:53.219472+0000","last_fullsized":"2023-10-24T00:44:53.219472+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244600+0000","last_change":"2023-10-24T00:44:53.241628+0000","last_active":"2023-10-24T00:44:53.244600+0000","last_peered":"2023-10-24T00:44:53.244600+0000","last_clean":"2023-10-24T00:44:53.244600+0000","last_became_active":"2023-10-24T00:44:53.241324+0000","last_became_peered":"2023-10-24T00:44:53.241324+0000","last_unstale":"2023-10-24T00:44:53.244600+0000","last_undegraded":"2023-10-24T00:44:53.244600+0000","last_fullsized":"2023-10-24T00:44:53.244600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.218942+0000","last_change":"2023-10-24T00:44:52.863663+0000","last_active":"2023-10-24T00:44:53.218942+0000","last_peered":"2023-10-24T00:44:53.218942+0000","last_clean":"2023-10-24T00:44:53.218942+0000","last_became_active":"2023-10-24T00:44:52.863414+0000","last_became_peered":"2023-10-24T00:44:52.863414+0000","last_unstale":"2023-10-24T00:44:53.218942+0000","last_undegraded":"2023-10-24T00:44:53.218942+0000","last_fullsized":"2023-10-24T00:44:53.218942+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238812+0000","last_change":"2023-10-24T00:44:53.235690+0000","last_active":"2023-10-24T00:44:53.238812+0000","last_peered":"2023-10-24T00:44:53.238812+0000","last_clean":"2023-10-24T00:44:53.238812+0000","last_became_active":"2023-10-24T00:44:53.235400+0000","last_became_peered":"2023-10-24T00:44:53.235400+0000","last_unstale":"2023-10-24T00:44:53.238812+0000","last_undegraded":"2023-10-24T00:44:53.238812+0000","last_fullsized":"2023-10-24T00:44:53.238812+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240838+0000","last_change":"2023-10-24T00:44:52.878636+0000","last_active":"2023-10-24T00:44:53.240838+0000","last_peered":"2023-10-24T00:44:53.240838+0000","last_clean":"2023-10-24T00:44:53.240838+0000","last_became_active":"2023-10-24T00:44:52.878332+0000","last_became_peered":"2023-10-24T00:44:52.878332+0000","last_unstale":"2023-10-24T00:44:53.240838+0000","last_undegraded":"2023-10-24T00:44:53.240838+0000","last_fullsized":"2023-10-24T00:44:53.240838+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240648+0000","last_change":"2023-10-24T00:44:53.237845+0000","last_active":"2023-10-24T00:44:53.240648+0000","last_peered":"2023-10-24T00:44:53.240648+0000","last_clean":"2023-10-24T00:44:53.240648+0000","last_became_active":"2023-10-24T00:44:53.237547+0000","last_became_peered":"2023-10-24T00:44:53.237547+0000","last_unstale":"2023-10-24T00:44:53.240648+0000","last_undegraded":"2023-10-24T00:44:53.240648+0000","last_fullsized":"2023-10-24T00:44:53.240648+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235003+0000","last_change":"2023-10-24T00:44:52.862580+0000","last_active":"2023-10-24T00:44:53.235003+0000","last_peered":"2023-10-24T00:44:53.235003+0000","last_clean":"2023-10-24T00:44:53.235003+0000","last_became_active":"2023-10-24T00:44:52.862315+0000","last_became_peered":"2023-10-24T00:44:52.862315+0000","last_unstale":"2023-10-24T00:44:53.235003+0000","last_undegraded":"2023-10-24T00:44:53.235003+0000","last_fullsized":"2023-10-24T00:44:53.235003+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238350+0000","last_change":"2023-10-24T00:44:53.235784+0000","last_active":"2023-10-24T00:44:53.238350+0000","last_peered":"2023-10-24T00:44:53.238350+0000","last_clean":"2023-10-24T00:44:53.238350+0000","last_became_active":"2023-10-24T00:44:53.235496+0000","last_became_peered":"2023-10-24T00:44:53.235496+0000","last_unstale":"2023-10-24T00:44:53.238350+0000","last_undegraded":"2023-10-24T00:44:53.238350+0000","last_fullsized":"2023-10-24T00:44:53.238350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226686+0000","last_change":"2023-10-24T00:44:52.868350+0000","last_active":"2023-10-24T00:44:53.226686+0000","last_peered":"2023-10-24T00:44:53.226686+0000","last_clean":"2023-10-24T00:44:53.226686+0000","last_became_active":"2023-10-24T00:44:52.868063+0000","last_became_peered":"2023-10-24T00:44:52.868063+0000","last_unstale":"2023-10-24T00:44:53.226686+0000","last_undegraded":"2023-10-24T00:44:53.226686+0000","last_fullsized":"2023-10-24T00:44:53.226686+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240448+0000","last_change":"2023-10-24T00:44:53.234195+0000","last_active":"2023-10-24T00:44:53.240448+0000","last_peered":"2023-10-24T00:44:53.240448+0000","last_clean":"2023-10-24T00:44:53.240448+0000","last_became_active":"2023-10-24T00:44:53.233836+0000","last_became_peered":"2023-10-24T00:44:53.233836+0000","last_unstale":"2023-10-24T00:44:53.240448+0000","last_undegraded":"2023-10-24T00:44:53.240448+0000","last_fullsized":"2023-10-24T00:44:53.240448+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219979+0000","last_change":"2023-10-24T00:44:52.868122+0000","last_active":"2023-10-24T00:44:53.219979+0000","last_peered":"2023-10-24T00:44:53.219979+0000","last_clean":"2023-10-24T00:44:53.219979+0000","last_became_active":"2023-10-24T00:44:52.867785+0000","last_became_peered":"2023-10-24T00:44:52.867785+0000","last_unstale":"2023-10-24T00:44:53.219979+0000","last_undegraded":"2023-10-24T00:44:53.219979+0000","last_fullsized":"2023-10-24T00:44:53.219979+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241961+0000","last_change":"2023-10-24T00:44:53.227900+0000","last_active":"2023-10-24T00:44:53.241961+0000","last_peered":"2023-10-24T00:44:53.241961+0000","last_clean":"2023-10-24T00:44:53.241961+0000","last_became_active":"2023-10-24T00:44:53.227638+0000","last_became_peered":"2023-10-24T00:44:53.227638+0000","last_unstale":"2023-10-24T00:44:53.241961+0000","last_undegraded":"2023-10-24T00:44:53.241961+0000","last_fullsized":"2023-10-24T00:44:53.241961+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219583+0000","last_change":"2023-10-24T00:44:52.880350+0000","last_active":"2023-10-24T00:44:53.219583+0000","last_peered":"2023-10-24T00:44:53.219583+0000","last_clean":"2023-10-24T00:44:53.219583+0000","last_became_active":"2023-10-24T00:44:52.880053+0000","last_became_peered":"2023-10-24T00:44:52.880053+0000","last_unstale":"2023-10-24T00:44:53.219583+0000","last_undegraded":"2023-10-24T00:44:53.219583+0000","last_fullsized":"2023-10-24T00:44:53.219583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239091+0000","last_change":"2023-10-24T00:44:53.236282+0000","last_active":"2023-10-24T00:44:53.239091+0000","last_peered":"2023-10-24T00:44:53.239091+0000","last_clean":"2023-10-24T00:44:53.239091+0000","last_became_active":"2023-10-24T00:44:53.235993+0000","last_became_peered":"2023-10-24T00:44:53.235993+0000","last_unstale":"2023-10-24T00:44:53.239091+0000","last_undegraded":"2023-10-24T00:44:53.239091+0000","last_fullsized":"2023-10-24T00:44:53.239091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226642+0000","last_change":"2023-10-24T00:44:52.875374+0000","last_active":"2023-10-24T00:44:53.226642+0000","last_peered":"2023-10-24T00:44:53.226642+0000","last_clean":"2023-10-24T00:44:53.226642+0000","last_became_active":"2023-10-24T00:44:52.875096+0000","last_became_peered":"2023-10-24T00:44:52.875096+0000","last_unstale":"2023-10-24T00:44:53.226642+0000","last_undegraded":"2023-10-24T00:44:53.226642+0000","last_fullsized":"2023-10-24T00:44:53.226642+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247696+0000","last_change":"2023-10-24T00:44:53.245680+0000","last_active":"2023-10-24T00:44:53.247696+0000","last_peered":"2023-10-24T00:44:53.247696+0000","last_clean":"2023-10-24T00:44:53.247696+0000","last_became_active":"2023-10-24T00:44:53.245397+0000","last_became_peered":"2023-10-24T00:44:53.245397+0000","last_unstale":"2023-10-24T00:44:53.247696+0000","last_undegraded":"2023-10-24T00:44:53.247696+0000","last_fullsized":"2023-10-24T00:44:53.247696+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219880+0000","last_change":"2023-10-24T00:44:52.864694+0000","last_active":"2023-10-24T00:44:53.219880+0000","last_peered":"2023-10-24T00:44:53.219880+0000","last_clean":"2023-10-24T00:44:53.219880+0000","last_became_active":"2023-10-24T00:44:52.864268+0000","last_became_peered":"2023-10-24T00:44:52.864268+0000","last_unstale":"2023-10-24T00:44:53.219880+0000","last_undegraded":"2023-10-24T00:44:53.219880+0000","last_fullsized":"2023-10-24T00:44:53.219880+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245319+0000","last_change":"2023-10-24T00:44:53.243468+0000","last_active":"2023-10-24T00:44:53.245319+0000","last_peered":"2023-10-24T00:44:53.245319+0000","last_clean":"2023-10-24T00:44:53.245319+0000","last_became_active":"2023-10-24T00:44:53.243214+0000","last_became_peered":"2023-10-24T00:44:53.243214+0000","last_unstale":"2023-10-24T00:44:53.245319+0000","last_undegraded":"2023-10-24T00:44:53.245319+0000","last_fullsized":"2023-10-24T00:44:53.245319+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.228159+0000","last_change":"2023-10-24T00:44:52.870514+0000","last_active":"2023-10-24T00:44:53.228159+0000","last_peered":"2023-10-24T00:44:53.228159+0000","last_clean":"2023-10-24T00:44:53.228159+0000","last_became_active":"2023-10-24T00:44:52.870036+0000","last_became_peered":"2023-10-24T00:44:52.870036+0000","last_unstale":"2023-10-24T00:44:53.228159+0000","last_undegraded":"2023-10-24T00:44:53.228159+0000","last_fullsized":"2023-10-24T00:44:53.228159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238879+0000","last_change":"2023-10-24T00:44:53.236835+0000","last_active":"2023-10-24T00:44:53.238879+0000","last_peered":"2023-10-24T00:44:53.238879+0000","last_clean":"2023-10-24T00:44:53.238879+0000","last_became_active":"2023-10-24T00:44:53.236438+0000","last_became_peered":"2023-10-24T00:44:53.236438+0000","last_unstale":"2023-10-24T00:44:53.238879+0000","last_undegraded":"2023-10-24T00:44:53.238879+0000","last_fullsized":"2023-10-24T00:44:53.238879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.222501+0000","last_change":"2023-10-24T00:44:52.860242+0000","last_active":"2023-10-24T00:44:53.222501+0000","last_peered":"2023-10-24T00:44:53.222501+0000","last_clean":"2023-10-24T00:44:53.222501+0000","last_became_active":"2023-10-24T00:44:52.859955+0000","last_became_peered":"2023-10-24T00:44:52.859955+0000","last_unstale":"2023-10-24T00:44:53.222501+0000","last_undegraded":"2023-10-24T00:44:53.222501+0000","last_fullsized":"2023-10-24T00:44:53.222501+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233435+0000","last_change":"2023-10-24T00:44:53.228619+0000","last_active":"2023-10-24T00:44:53.233435+0000","last_peered":"2023-10-24T00:44:53.233435+0000","last_clean":"2023-10-24T00:44:53.233435+0000","last_became_active":"2023-10-24T00:44:53.228342+0000","last_became_peered":"2023-10-24T00:44:53.228342+0000","last_unstale":"2023-10-24T00:44:53.233435+0000","last_undegraded":"2023-10-24T00:44:53.233435+0000","last_fullsized":"2023-10-24T00:44:53.233435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219943+0000","last_change":"2023-10-24T00:44:52.862532+0000","last_active":"2023-10-24T00:44:53.219943+0000","last_peered":"2023-10-24T00:44:53.219943+0000","last_clean":"2023-10-24T00:44:53.219943+0000","last_became_active":"2023-10-24T00:44:52.862033+0000","last_became_peered":"2023-10-24T00:44:52.862033+0000","last_unstale":"2023-10-24T00:44:53.219943+0000","last_undegraded":"2023-10-24T00:44:53.219943+0000","last_fullsized":"2023-10-24T00:44:53.219943+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.225078+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:53.225078+0000","last_peered":"2023-10-24T00:44:53.225078+0000","last_clean":"2023-10-24T00:44:53.225078+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:53.225078+0000","last_undegraded":"2023-10-24T00:44:53.225078+0000","last_fullsized":"2023-10-24T00:44:53.225078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240823+0000","last_change":"2023-10-24T00:44:53.229919+0000","last_active":"2023-10-24T00:44:53.240823+0000","last_peered":"2023-10-24T00:44:53.240823+0000","last_clean":"2023-10-24T00:44:53.240823+0000","last_became_active":"2023-10-24T00:44:53.229668+0000","last_became_peered":"2023-10-24T00:44:53.229668+0000","last_unstale":"2023-10-24T00:44:53.240823+0000","last_undegraded":"2023-10-24T00:44:53.240823+0000","last_fullsized":"2023-10-24T00:44:53.240823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233760+0000","last_change":"2023-10-24T00:44:52.860145+0000","last_active":"2023-10-24T00:44:53.233760+0000","last_peered":"2023-10-24T00:44:53.233760+0000","last_clean":"2023-10-24T00:44:53.233760+0000","last_became_active":"2023-10-24T00:44:52.859928+0000","last_became_peered":"2023-10-24T00:44:52.859928+0000","last_unstale":"2023-10-24T00:44:53.233760+0000","last_undegraded":"2023-10-24T00:44:53.233760+0000","last_fullsized":"2023-10-24T00:44:53.233760+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223327+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:53.223327+0000","last_peered":"2023-10-24T00:44:53.223327+0000","last_clean":"2023-10-24T00:44:53.223327+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:53.223327+0000","last_undegraded":"2023-10-24T00:44:53.223327+0000","last_fullsized":"2023-10-24T00:44:53.223327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239607+0000","last_change":"2023-10-24T00:44:53.237510+0000","last_active":"2023-10-24T00:44:53.239607+0000","last_peered":"2023-10-24T00:44:53.239607+0000","last_clean":"2023-10-24T00:44:53.239607+0000","last_became_active":"2023-10-24T00:44:53.237228+0000","last_became_peered":"2023-10-24T00:44:53.237228+0000","last_unstale":"2023-10-24T00:44:53.239607+0000","last_undegraded":"2023-10-24T00:44:53.239607+0000","last_fullsized":"2023-10-24T00:44:53.239607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224794+0000","last_change":"2023-10-24T00:44:52.873860+0000","last_active":"2023-10-24T00:44:53.224794+0000","last_peered":"2023-10-24T00:44:53.224794+0000","last_clean":"2023-10-24T00:44:53.224794+0000","last_became_active":"2023-10-24T00:44:52.873540+0000","last_became_peered":"2023-10-24T00:44:52.873540+0000","last_unstale":"2023-10-24T00:44:53.224794+0000","last_undegraded":"2023-10-24T00:44:53.224794+0000","last_fullsized":"2023-10-24T00:44:53.224794+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219025+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:53.219025+0000","last_peered":"2023-10-24T00:44:53.219025+0000","last_clean":"2023-10-24T00:44:53.219025+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:53.219025+0000","last_undegraded":"2023-10-24T00:44:53.219025+0000","last_fullsized":"2023-10-24T00:44:53.219025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236044+0000","last_change":"2023-10-24T00:44:53.234191+0000","last_active":"2023-10-24T00:44:53.236044+0000","last_peered":"2023-10-24T00:44:53.236044+0000","last_clean":"2023-10-24T00:44:53.236044+0000","last_became_active":"2023-10-24T00:44:53.233898+0000","last_became_peered":"2023-10-24T00:44:53.233898+0000","last_unstale":"2023-10-24T00:44:53.236044+0000","last_undegraded":"2023-10-24T00:44:53.236044+0000","last_fullsized":"2023-10-24T00:44:53.236044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223709+0000","last_change":"2023-10-24T00:44:52.878748+0000","last_active":"2023-10-24T00:44:53.223709+0000","last_peered":"2023-10-24T00:44:53.223709+0000","last_clean":"2023-10-24T00:44:53.223709+0000","last_became_active":"2023-10-24T00:44:52.878423+0000","last_became_peered":"2023-10-24T00:44:52.878423+0000","last_unstale":"2023-10-24T00:44:53.223709+0000","last_undegraded":"2023-10-24T00:44:53.223709+0000","last_fullsized":"2023-10-24T00:44:53.223709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223435+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:53.223435+0000","last_peered":"2023-10-24T00:44:53.223435+0000","last_clean":"2023-10-24T00:44:53.223435+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:53.223435+0000","last_undegraded":"2023-10-24T00:44:53.223435+0000","last_fullsized":"2023-10-24T00:44:53.223435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219844+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:53.219844+0000","last_peered":"2023-10-24T00:44:53.219844+0000","last_clean":"2023-10-24T00:44:53.219844+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:53.219844+0000","last_undegraded":"2023-10-24T00:44:53.219844+0000","last_fullsized":"2023-10-24T00:44:53.219844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248641+0000","last_change":"2023-10-24T00:44:53.241158+0000","last_active":"2023-10-24T00:44:53.248641+0000","last_peered":"2023-10-24T00:44:53.248641+0000","last_clean":"2023-10-24T00:44:53.248641+0000","last_became_active":"2023-10-24T00:44:53.240897+0000","last_became_peered":"2023-10-24T00:44:53.240897+0000","last_unstale":"2023-10-24T00:44:53.248641+0000","last_undegraded":"2023-10-24T00:44:53.248641+0000","last_fullsized":"2023-10-24T00:44:53.248641+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223846+0000","last_change":"2023-10-24T00:44:52.872146+0000","last_active":"2023-10-24T00:44:53.223846+0000","last_peered":"2023-10-24T00:44:53.223846+0000","last_clean":"2023-10-24T00:44:53.223846+0000","last_became_active":"2023-10-24T00:44:52.871882+0000","last_became_peered":"2023-10-24T00:44:52.871882+0000","last_unstale":"2023-10-24T00:44:53.223846+0000","last_undegraded":"2023-10-24T00:44:53.223846+0000","last_fullsized":"2023-10-24T00:44:53.223846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219937+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:53.219937+0000","last_peered":"2023-10-24T00:44:53.219937+0000","last_clean":"2023-10-24T00:44:53.219937+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:53.219937+0000","last_undegraded":"2023-10-24T00:44:53.219937+0000","last_fullsized":"2023-10-24T00:44:53.219937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235348+0000","last_change":"2023-10-24T00:44:53.234240+0000","last_active":"2023-10-24T00:44:53.235348+0000","last_peered":"2023-10-24T00:44:53.235348+0000","last_clean":"2023-10-24T00:44:53.235348+0000","last_became_active":"2023-10-24T00:44:53.233982+0000","last_became_peered":"2023-10-24T00:44:53.233982+0000","last_unstale":"2023-10-24T00:44:53.235348+0000","last_undegraded":"2023-10-24T00:44:53.235348+0000","last_fullsized":"2023-10-24T00:44:53.235348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224920+0000","last_change":"2023-10-24T00:44:52.862840+0000","last_active":"2023-10-24T00:44:53.224920+0000","last_peered":"2023-10-24T00:44:53.224920+0000","last_clean":"2023-10-24T00:44:53.224920+0000","last_became_active":"2023-10-24T00:44:52.862297+0000","last_became_peered":"2023-10-24T00:44:52.862297+0000","last_unstale":"2023-10-24T00:44:53.224920+0000","last_undegraded":"2023-10-24T00:44:53.224920+0000","last_fullsized":"2023-10-24T00:44:53.224920+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220096+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:53.220096+0000","last_peered":"2023-10-24T00:44:53.220096+0000","last_clean":"2023-10-24T00:44:53.220096+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:53.220096+0000","last_undegraded":"2023-10-24T00:44:53.220096+0000","last_fullsized":"2023-10-24T00:44:53.220096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235185+0000","last_change":"2023-10-24T00:44:53.234157+0000","last_active":"2023-10-24T00:44:53.235185+0000","last_peered":"2023-10-24T00:44:53.235185+0000","last_clean":"2023-10-24T00:44:53.235185+0000","last_became_active":"2023-10-24T00:44:53.233870+0000","last_became_peered":"2023-10-24T00:44:53.233870+0000","last_unstale":"2023-10-24T00:44:53.235185+0000","last_undegraded":"2023-10-24T00:44:53.235185+0000","last_fullsized":"2023-10-24T00:44:53.235185+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239054+0000","last_change":"2023-10-24T00:44:52.867818+0000","last_active":"2023-10-24T00:44:53.239054+0000","last_peered":"2023-10-24T00:44:53.239054+0000","last_clean":"2023-10-24T00:44:53.239054+0000","last_became_active":"2023-10-24T00:44:52.867536+0000","last_became_peered":"2023-10-24T00:44:52.867536+0000","last_unstale":"2023-10-24T00:44:53.239054+0000","last_undegraded":"2023-10-24T00:44:53.239054+0000","last_fullsized":"2023-10-24T00:44:53.239054+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223783+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:53.223783+0000","last_peered":"2023-10-24T00:44:53.223783+0000","last_clean":"2023-10-24T00:44:53.223783+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:53.223783+0000","last_undegraded":"2023-10-24T00:44:53.223783+0000","last_fullsized":"2023-10-24T00:44:53.223783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244776+0000","last_change":"2023-10-24T00:44:53.232542+0000","last_active":"2023-10-24T00:44:53.244776+0000","last_peered":"2023-10-24T00:44:53.244776+0000","last_clean":"2023-10-24T00:44:53.244776+0000","last_became_active":"2023-10-24T00:44:53.232227+0000","last_became_peered":"2023-10-24T00:44:53.232227+0000","last_unstale":"2023-10-24T00:44:53.244776+0000","last_undegraded":"2023-10-24T00:44:53.244776+0000","last_fullsized":"2023-10-24T00:44:53.244776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240584+0000","last_change":"2023-10-24T00:44:52.863391+0000","last_active":"2023-10-24T00:44:53.240584+0000","last_peered":"2023-10-24T00:44:53.240584+0000","last_clean":"2023-10-24T00:44:53.240584+0000","last_became_active":"2023-10-24T00:44:52.862950+0000","last_became_peered":"2023-10-24T00:44:52.862950+0000","last_unstale":"2023-10-24T00:44:53.240584+0000","last_undegraded":"2023-10-24T00:44:53.240584+0000","last_fullsized":"2023-10-24T00:44:53.240584+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.228405+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:53.228405+0000","last_peered":"2023-10-24T00:44:53.228405+0000","last_clean":"2023-10-24T00:44:53.228405+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:53.228405+0000","last_undegraded":"2023-10-24T00:44:53.228405+0000","last_fullsized":"2023-10-24T00:44:53.228405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":1175552,"data_stored":583744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55000000000000004}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.746},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":583882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.375}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302348,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069492,"statfs":{"total":96636764160,"available":96327159808,"internally_reserved":0,"allocated":1183744,"data_stored":584242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.378}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.312}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.372},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":1167360,"data_stored":583168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.42399999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.312}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.434}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":584704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.497},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":1167360,"data_stored":583168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.374}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.30499999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.748},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":583846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.318}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.434},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.378}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.42699999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.49199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542339,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302336,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069504,"statfs":{"total":96636764160,"available":96327172096,"internally_reserved":0,"allocated":1171456,"data_stored":583202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.44600000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.435},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.501},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.57299999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.65000000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.60799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:44:58.730 INFO:tasks.ceph.mds.a.smithi148.stderr:2023-10-24T00:44:58.729+0000 7f748bfa6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:45:00.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.824+0000 7f0c238a2700 1 Processor -- start 2023-10-24T00:45:00.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.824+0000 7f0c238a2700 1 -- start start 2023-10-24T00:45:00.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c238a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c1c0aa010 0x7f0c1c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:00.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c238a2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0aa820 con 0x7f0c1c0c6710 2023-10-24T00:45:00.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c238a2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c0960 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c238a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c0c0c40 con 0x7f0c1c0aa010 2023-10-24T00:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c20e3d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0c1c0c6710 0x7f0c1c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43390/0 (socket says 172.21.15.148:43390) 2023-10-24T00:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c20e3d700 1 -- 172.21.15.148:0/1070235405 learned_addr learned my addr 172.21.15.148:0/1070235405 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c2163e700 1 --2- 172.21.15.148:0/1070235405 >> v2:172.21.15.150:3300/0 conn(0x7f0c1c0aa010 0x7f0c1c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518971284 0 0) 0x7f0c1c0aa820 con 0x7f0c1c0c6710 2023-10-24T00:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c080033f0 con 0x7f0c1c0c6710 2023-10-24T00:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957715172 0 0) 0x7f0c1c0c0960 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c1c0aa820 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c2163e700 1 -- 172.21.15.148:0/1070235405 >> v1:172.21.15.150:6789/0 conn(0x7f0c1c0aa3f0 legacy=0x7f0c1c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148070536 0 0) 0x7f0c080033f0 con 0x7f0c1c0c6710 2023-10-24T00:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c2163e700 1 -- 172.21.15.148:0/1070235405 >> v1:172.21.15.148:6789/0 conn(0x7f0c1c0c6710 legacy=0x7f0c1c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.825+0000 7f0c2163e700 1 -- 172.21.15.148:0/1070235405 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0c0f20 con 0x7f0c1c0aa010 2023-10-24T00:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c2163e700 1 --2- 172.21.15.148:0/1070235405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c0c1a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0c18009760 tx=0x7f0c18009060).ready entity=mon.1 client_cookie=9e8a3ebb121282de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c001470 con 0x7f0c1c0aa010 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c18011400 con 0x7f0c1c0aa010 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c13fff700 1 -- 172.21.15.148:0/1070235405 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011780 con 0x7f0c1c0aa010 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 -- 172.21.15.148:0/1070235405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 msgr2=0x7f0c1c0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 --2- 172.21.15.148:0/1070235405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c0c1a00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f0c18009760 tx=0x7f0c18009060).stop 2023-10-24T00:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 -- 172.21.15.148:0/1070235405 shutdown_connections 2023-10-24T00:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 --2- 172.21.15.148:0/1070235405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c0c1a00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 -- 172.21.15.148:0/1070235405 >> 172.21.15.148:0/1070235405 conn(0x7f0c1c0caf40 msgr2=0x7f0c1c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 -- 172.21.15.148:0/1070235405 shutdown_connections 2023-10-24T00:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.826+0000 7f0c238a2700 1 -- 172.21.15.148:0/1070235405 wait complete. 2023-10-24T00:45:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 Processor -- start 2023-10-24T00:45:00.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 -- start start 2023-10-24T00:45:00.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:00.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:00.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 0x7f0c1c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c154050 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c0b0c10 con 0x7f0c1c0aa010 2023-10-24T00:45:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.828+0000 7f0c238a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c0b0650 con 0x7f0c1c0c6710 2023-10-24T00:45:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36854/0 (socket says 172.21.15.148:36854) 2023-10-24T00:45:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 -- 172.21.15.148:0/3094700821 learned_addr learned my addr 172.21.15.148:0/3094700821 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c2163e700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c21e3f700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 0x7f0c1c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 -- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 msgr2=0x7f0c1c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 0x7f0c1c153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 -- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 msgr2=0x7f0c1c143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 -- 172.21.15.148:0/3094700821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180092a0 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c21e3f700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 0x7f0c1c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c20e3d700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0c0c00c7c0 tx=0x7f0c0c001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c007170 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c0072f0 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c0b0930 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0048c0 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.829+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c0c23f0 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.830+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1c0c2610 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.830+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0c0c004c70 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.831+0000 7f0c117fa700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 0x7f0c00061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:00.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.831+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0c0c07a250 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.831+0000 7f0c2163e700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 0x7f0c00061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:00.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.831+0000 7f0c2163e700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 0x7f0c00061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0c1c064440 tx=0x7f0c18016000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:00.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.835+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c0c04b450 con 0x7f0c1c0aa3f0 2023-10-24T00:45:00.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:00.998+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c1c06c6b0 con 0x7f0c0005f240 2023-10-24T00:45:01.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.008+0000 7f0c117fa700 1 -- 172.21.15.148:0/3094700821 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361533 (secure 0 0 0) 0x7f0c1c06c6b0 con 0x7f0c0005f240 2023-10-24T00:45:01.014 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:01.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 msgr2=0x7f0c00061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 0x7f0c00061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0c1c064440 tx=0x7f0c18016000).stop 2023-10-24T00:45:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 msgr2=0x7f0c1c153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0c0c00c7c0 tx=0x7f0c0c001b50).stop 2023-10-24T00:45:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 shutdown_connections 2023-10-24T00:45:01.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c1c0c6710 0x7f0c1c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c1c0aa010 0x7f0c1c143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0c0005f240 0x7f0c00061700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 --2- 172.21.15.148:0/3094700821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c1c0aa3f0 0x7f0c1c153670 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 >> 172.21.15.148:0/3094700821 conn(0x7f0c1c0caf40 msgr2=0x7f0c1c152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:01.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 shutdown_connections 2023-10-24T00:45:01.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.011+0000 7f0c238a2700 1 -- 172.21.15.148:0/3094700821 wait complete. 2023-10-24T00:45:01.020 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:01.024 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-24T00:44:59.401290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418720,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556000,"statfs":{"total":773094113280,"available":770617344000,"internally_reserved":0,"allocated":9404416,"data_stored":4669956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11233,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007967"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241625+0000","last_change":"2023-10-24T00:44:53.231586+0000","last_active":"2023-10-24T00:44:53.241625+0000","last_peered":"2023-10-24T00:44:53.241625+0000","last_clean":"2023-10-24T00:44:53.241625+0000","last_became_active":"2023-10-24T00:44:53.231321+0000","last_became_peered":"2023-10-24T00:44:53.231321+0000","last_unstale":"2023-10-24T00:44:53.241625+0000","last_undegraded":"2023-10-24T00:44:53.241625+0000","last_fullsized":"2023-10-24T00:44:53.241625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245141+0000","last_change":"2023-10-24T00:44:52.866534+0000","last_active":"2023-10-24T00:44:53.245141+0000","last_peered":"2023-10-24T00:44:53.245141+0000","last_clean":"2023-10-24T00:44:53.245141+0000","last_became_active":"2023-10-24T00:44:52.865484+0000","last_became_peered":"2023-10-24T00:44:52.865484+0000","last_unstale":"2023-10-24T00:44:53.245141+0000","last_undegraded":"2023-10-24T00:44:53.245141+0000","last_fullsized":"2023-10-24T00:44:53.245141+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242202+0000","last_change":"2023-10-24T00:44:53.239128+0000","last_active":"2023-10-24T00:44:53.242202+0000","last_peered":"2023-10-24T00:44:53.242202+0000","last_clean":"2023-10-24T00:44:53.242202+0000","last_became_active":"2023-10-24T00:44:53.238704+0000","last_became_peered":"2023-10-24T00:44:53.238704+0000","last_unstale":"2023-10-24T00:44:53.242202+0000","last_undegraded":"2023-10-24T00:44:53.242202+0000","last_fullsized":"2023-10-24T00:44:53.242202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226983+0000","last_change":"2023-10-24T00:44:52.875475+0000","last_active":"2023-10-24T00:44:53.226983+0000","last_peered":"2023-10-24T00:44:53.226983+0000","last_clean":"2023-10-24T00:44:53.226983+0000","last_became_active":"2023-10-24T00:44:52.875178+0000","last_became_peered":"2023-10-24T00:44:52.875178+0000","last_unstale":"2023-10-24T00:44:53.226983+0000","last_undegraded":"2023-10-24T00:44:53.226983+0000","last_fullsized":"2023-10-24T00:44:53.226983+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243889+0000","last_change":"2023-10-24T00:44:53.236614+0000","last_active":"2023-10-24T00:44:53.243889+0000","last_peered":"2023-10-24T00:44:53.243889+0000","last_clean":"2023-10-24T00:44:53.243889+0000","last_became_active":"2023-10-24T00:44:53.236304+0000","last_became_peered":"2023-10-24T00:44:53.236304+0000","last_unstale":"2023-10-24T00:44:53.243889+0000","last_undegraded":"2023-10-24T00:44:53.243889+0000","last_fullsized":"2023-10-24T00:44:53.243889+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224432+0000","last_change":"2023-10-24T00:44:52.869154+0000","last_active":"2023-10-24T00:44:53.224432+0000","last_peered":"2023-10-24T00:44:53.224432+0000","last_clean":"2023-10-24T00:44:53.224432+0000","last_became_active":"2023-10-24T00:44:52.868881+0000","last_became_peered":"2023-10-24T00:44:52.868881+0000","last_unstale":"2023-10-24T00:44:53.224432+0000","last_undegraded":"2023-10-24T00:44:53.224432+0000","last_fullsized":"2023-10-24T00:44:53.224432+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244884+0000","last_change":"2023-10-24T00:44:53.236547+0000","last_active":"2023-10-24T00:44:53.244884+0000","last_peered":"2023-10-24T00:44:53.244884+0000","last_clean":"2023-10-24T00:44:53.244884+0000","last_became_active":"2023-10-24T00:44:53.236182+0000","last_became_peered":"2023-10-24T00:44:53.236182+0000","last_unstale":"2023-10-24T00:44:53.244884+0000","last_undegraded":"2023-10-24T00:44:53.244884+0000","last_fullsized":"2023-10-24T00:44:53.244884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.237709+0000","last_change":"2023-10-24T00:44:52.879633+0000","last_active":"2023-10-24T00:44:53.237709+0000","last_peered":"2023-10-24T00:44:53.237709+0000","last_clean":"2023-10-24T00:44:53.237709+0000","last_became_active":"2023-10-24T00:44:52.879389+0000","last_became_peered":"2023-10-24T00:44:52.879389+0000","last_unstale":"2023-10-24T00:44:53.237709+0000","last_undegraded":"2023-10-24T00:44:53.237709+0000","last_fullsized":"2023-10-24T00:44:53.237709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244560+0000","last_change":"2023-10-24T00:44:53.241020+0000","last_active":"2023-10-24T00:44:53.244560+0000","last_peered":"2023-10-24T00:44:53.244560+0000","last_clean":"2023-10-24T00:44:53.244560+0000","last_became_active":"2023-10-24T00:44:53.240362+0000","last_became_peered":"2023-10-24T00:44:53.240362+0000","last_unstale":"2023-10-24T00:44:53.244560+0000","last_undegraded":"2023-10-24T00:44:53.244560+0000","last_fullsized":"2023-10-24T00:44:53.244560+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235450+0000","last_change":"2023-10-24T00:44:52.862357+0000","last_active":"2023-10-24T00:44:53.235450+0000","last_peered":"2023-10-24T00:44:53.235450+0000","last_clean":"2023-10-24T00:44:53.235450+0000","last_became_active":"2023-10-24T00:44:52.862088+0000","last_became_peered":"2023-10-24T00:44:52.862088+0000","last_unstale":"2023-10-24T00:44:53.235450+0000","last_undegraded":"2023-10-24T00:44:53.235450+0000","last_fullsized":"2023-10-24T00:44:53.235450+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247922+0000","last_change":"2023-10-24T00:44:53.247382+0000","last_active":"2023-10-24T00:44:53.247922+0000","last_peered":"2023-10-24T00:44:53.247922+0000","last_clean":"2023-10-24T00:44:53.247922+0000","last_became_active":"2023-10-24T00:44:53.247132+0000","last_became_peered":"2023-10-24T00:44:53.247132+0000","last_unstale":"2023-10-24T00:44:53.247922+0000","last_undegraded":"2023-10-24T00:44:53.247922+0000","last_fullsized":"2023-10-24T00:44:53.247922+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240264+0000","last_change":"2023-10-24T00:44:52.873476+0000","last_active":"2023-10-24T00:44:53.240264+0000","last_peered":"2023-10-24T00:44:53.240264+0000","last_clean":"2023-10-24T00:44:53.240264+0000","last_became_active":"2023-10-24T00:44:52.873160+0000","last_became_peered":"2023-10-24T00:44:52.873160+0000","last_unstale":"2023-10-24T00:44:53.240264+0000","last_undegraded":"2023-10-24T00:44:53.240264+0000","last_fullsized":"2023-10-24T00:44:53.240264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245029+0000","last_change":"2023-10-24T00:44:53.235077+0000","last_active":"2023-10-24T00:44:53.245029+0000","last_peered":"2023-10-24T00:44:53.245029+0000","last_clean":"2023-10-24T00:44:53.245029+0000","last_became_active":"2023-10-24T00:44:53.234771+0000","last_became_peered":"2023-10-24T00:44:53.234771+0000","last_unstale":"2023-10-24T00:44:53.245029+0000","last_undegraded":"2023-10-24T00:44:53.245029+0000","last_fullsized":"2023-10-24T00:44:53.245029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224290+0000","last_change":"2023-10-24T00:44:52.866284+0000","last_active":"2023-10-24T00:44:53.224290+0000","last_peered":"2023-10-24T00:44:53.224290+0000","last_clean":"2023-10-24T00:44:53.224290+0000","last_became_active":"2023-10-24T00:44:52.865991+0000","last_became_peered":"2023-10-24T00:44:52.865991+0000","last_unstale":"2023-10-24T00:44:53.224290+0000","last_undegraded":"2023-10-24T00:44:53.224290+0000","last_fullsized":"2023-10-24T00:44:53.224290+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240830+0000","last_change":"2023-10-24T00:44:53.238911+0000","last_active":"2023-10-24T00:44:53.240830+0000","last_peered":"2023-10-24T00:44:53.240830+0000","last_clean":"2023-10-24T00:44:53.240830+0000","last_became_active":"2023-10-24T00:44:53.238649+0000","last_became_peered":"2023-10-24T00:44:53.238649+0000","last_unstale":"2023-10-24T00:44:53.240830+0000","last_undegraded":"2023-10-24T00:44:53.240830+0000","last_fullsized":"2023-10-24T00:44:53.240830+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226824+0000","last_change":"2023-10-24T00:44:52.876205+0000","last_active":"2023-10-24T00:44:53.226824+0000","last_peered":"2023-10-24T00:44:53.226824+0000","last_clean":"2023-10-24T00:44:53.226824+0000","last_became_active":"2023-10-24T00:44:52.875971+0000","last_became_peered":"2023-10-24T00:44:52.875971+0000","last_unstale":"2023-10-24T00:44:53.226824+0000","last_undegraded":"2023-10-24T00:44:53.226824+0000","last_fullsized":"2023-10-24T00:44:53.226824+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.230166+0000","last_change":"2023-10-24T00:44:53.225651+0000","last_active":"2023-10-24T00:44:53.230166+0000","last_peered":"2023-10-24T00:44:53.230166+0000","last_clean":"2023-10-24T00:44:53.230166+0000","last_became_active":"2023-10-24T00:44:53.225361+0000","last_became_peered":"2023-10-24T00:44:53.225361+0000","last_unstale":"2023-10-24T00:44:53.230166+0000","last_undegraded":"2023-10-24T00:44:53.230166+0000","last_fullsized":"2023-10-24T00:44:53.230166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220518+0000","last_change":"2023-10-24T00:44:52.864136+0000","last_active":"2023-10-24T00:44:53.220518+0000","last_peered":"2023-10-24T00:44:53.220518+0000","last_clean":"2023-10-24T00:44:53.220518+0000","last_became_active":"2023-10-24T00:44:52.863448+0000","last_became_peered":"2023-10-24T00:44:52.863448+0000","last_unstale":"2023-10-24T00:44:53.220518+0000","last_undegraded":"2023-10-24T00:44:53.220518+0000","last_fullsized":"2023-10-24T00:44:53.220518+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243581+0000","last_change":"2023-10-24T00:44:53.234371+0000","last_active":"2023-10-24T00:44:53.243581+0000","last_peered":"2023-10-24T00:44:53.243581+0000","last_clean":"2023-10-24T00:44:53.243581+0000","last_became_active":"2023-10-24T00:44:53.234148+0000","last_became_peered":"2023-10-24T00:44:53.234148+0000","last_unstale":"2023-10-24T00:44:53.243581+0000","last_undegraded":"2023-10-24T00:44:53.243581+0000","last_fullsized":"2023-10-24T00:44:53.243581+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.227752+0000","last_change":"2023-10-24T00:44:52.866713+0000","last_active":"2023-10-24T00:44:53.227752+0000","last_peered":"2023-10-24T00:44:53.227752+0000","last_clean":"2023-10-24T00:44:53.227752+0000","last_became_active":"2023-10-24T00:44:52.865786+0000","last_became_peered":"2023-10-24T00:44:52.865786+0000","last_unstale":"2023-10-24T00:44:53.227752+0000","last_undegraded":"2023-10-24T00:44:53.227752+0000","last_fullsized":"2023-10-24T00:44:53.227752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244677+0000","last_change":"2023-10-24T00:44:53.237847+0000","last_active":"2023-10-24T00:44:53.244677+0000","last_peered":"2023-10-24T00:44:53.244677+0000","last_clean":"2023-10-24T00:44:53.244677+0000","last_became_active":"2023-10-24T00:44:53.237604+0000","last_became_peered":"2023-10-24T00:44:53.237604+0000","last_unstale":"2023-10-24T00:44:53.244677+0000","last_undegraded":"2023-10-24T00:44:53.244677+0000","last_fullsized":"2023-10-24T00:44:53.244677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219976+0000","last_change":"2023-10-24T00:44:52.865866+0000","last_active":"2023-10-24T00:44:53.219976+0000","last_peered":"2023-10-24T00:44:53.219976+0000","last_clean":"2023-10-24T00:44:53.219976+0000","last_became_active":"2023-10-24T00:44:52.865536+0000","last_became_peered":"2023-10-24T00:44:52.865536+0000","last_unstale":"2023-10-24T00:44:53.219976+0000","last_undegraded":"2023-10-24T00:44:53.219976+0000","last_fullsized":"2023-10-24T00:44:53.219976+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244732+0000","last_change":"2023-10-24T00:44:53.236082+0000","last_active":"2023-10-24T00:44:53.244732+0000","last_peered":"2023-10-24T00:44:53.244732+0000","last_clean":"2023-10-24T00:44:53.244732+0000","last_became_active":"2023-10-24T00:44:53.235704+0000","last_became_peered":"2023-10-24T00:44:53.235704+0000","last_unstale":"2023-10-24T00:44:53.244732+0000","last_undegraded":"2023-10-24T00:44:53.244732+0000","last_fullsized":"2023-10-24T00:44:53.244732+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245559+0000","last_change":"2023-10-24T00:44:52.863063+0000","last_active":"2023-10-24T00:44:53.245559+0000","last_peered":"2023-10-24T00:44:53.245559+0000","last_clean":"2023-10-24T00:44:53.245559+0000","last_became_active":"2023-10-24T00:44:52.862619+0000","last_became_peered":"2023-10-24T00:44:52.862619+0000","last_unstale":"2023-10-24T00:44:53.245559+0000","last_undegraded":"2023-10-24T00:44:53.245559+0000","last_fullsized":"2023-10-24T00:44:53.245559+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238710+0000","last_change":"2023-10-24T00:44:53.234338+0000","last_active":"2023-10-24T00:44:53.238710+0000","last_peered":"2023-10-24T00:44:53.238710+0000","last_clean":"2023-10-24T00:44:53.238710+0000","last_became_active":"2023-10-24T00:44:53.234078+0000","last_became_peered":"2023-10-24T00:44:53.234078+0000","last_unstale":"2023-10-24T00:44:53.238710+0000","last_undegraded":"2023-10-24T00:44:53.238710+0000","last_fullsized":"2023-10-24T00:44:53.238710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233694+0000","last_change":"2023-10-24T00:44:52.878338+0000","last_active":"2023-10-24T00:44:53.233694+0000","last_peered":"2023-10-24T00:44:53.233694+0000","last_clean":"2023-10-24T00:44:53.233694+0000","last_became_active":"2023-10-24T00:44:52.878109+0000","last_became_peered":"2023-10-24T00:44:52.878109+0000","last_unstale":"2023-10-24T00:44:53.233694+0000","last_undegraded":"2023-10-24T00:44:53.233694+0000","last_fullsized":"2023-10-24T00:44:53.233694+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248731+0000","last_change":"2023-10-24T00:44:53.246690+0000","last_active":"2023-10-24T00:44:53.248731+0000","last_peered":"2023-10-24T00:44:53.248731+0000","last_clean":"2023-10-24T00:44:53.248731+0000","last_became_active":"2023-10-24T00:44:53.240775+0000","last_became_peered":"2023-10-24T00:44:53.240775+0000","last_unstale":"2023-10-24T00:44:53.248731+0000","last_undegraded":"2023-10-24T00:44:53.248731+0000","last_fullsized":"2023-10-24T00:44:53.248731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219781+0000","last_change":"2023-10-24T00:44:52.864512+0000","last_active":"2023-10-24T00:44:53.219781+0000","last_peered":"2023-10-24T00:44:53.219781+0000","last_clean":"2023-10-24T00:44:53.219781+0000","last_became_active":"2023-10-24T00:44:52.863937+0000","last_became_peered":"2023-10-24T00:44:52.863937+0000","last_unstale":"2023-10-24T00:44:53.219781+0000","last_undegraded":"2023-10-24T00:44:53.219781+0000","last_fullsized":"2023-10-24T00:44:53.219781+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236007+0000","last_change":"2023-10-24T00:44:53.233331+0000","last_active":"2023-10-24T00:44:53.236007+0000","last_peered":"2023-10-24T00:44:53.236007+0000","last_clean":"2023-10-24T00:44:53.236007+0000","last_became_active":"2023-10-24T00:44:53.233022+0000","last_became_peered":"2023-10-24T00:44:53.233022+0000","last_unstale":"2023-10-24T00:44:53.236007+0000","last_undegraded":"2023-10-24T00:44:53.236007+0000","last_fullsized":"2023-10-24T00:44:53.236007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220793+0000","last_change":"2023-10-24T00:44:52.869954+0000","last_active":"2023-10-24T00:44:53.220793+0000","last_peered":"2023-10-24T00:44:53.220793+0000","last_clean":"2023-10-24T00:44:53.220793+0000","last_became_active":"2023-10-24T00:44:52.869693+0000","last_became_peered":"2023-10-24T00:44:52.869693+0000","last_unstale":"2023-10-24T00:44:53.220793+0000","last_undegraded":"2023-10-24T00:44:53.220793+0000","last_fullsized":"2023-10-24T00:44:53.220793+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240351+0000","last_change":"2023-10-24T00:44:53.237184+0000","last_active":"2023-10-24T00:44:53.240351+0000","last_peered":"2023-10-24T00:44:53.240351+0000","last_clean":"2023-10-24T00:44:53.240351+0000","last_became_active":"2023-10-24T00:44:53.236868+0000","last_became_peered":"2023-10-24T00:44:53.236868+0000","last_unstale":"2023-10-24T00:44:53.240351+0000","last_undegraded":"2023-10-24T00:44:53.240351+0000","last_fullsized":"2023-10-24T00:44:53.240351+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240283+0000","last_change":"2023-10-24T00:44:52.871760+0000","last_active":"2023-10-24T00:44:53.240283+0000","last_peered":"2023-10-24T00:44:53.240283+0000","last_clean":"2023-10-24T00:44:53.240283+0000","last_became_active":"2023-10-24T00:44:52.871466+0000","last_became_peered":"2023-10-24T00:44:52.871466+0000","last_unstale":"2023-10-24T00:44:53.240283+0000","last_undegraded":"2023-10-24T00:44:53.240283+0000","last_fullsized":"2023-10-24T00:44:53.240283+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.234623+0000","last_change":"2023-10-24T00:44:53.225403+0000","last_active":"2023-10-24T00:44:53.234623+0000","last_peered":"2023-10-24T00:44:53.234623+0000","last_clean":"2023-10-24T00:44:53.234623+0000","last_became_active":"2023-10-24T00:44:53.225145+0000","last_became_peered":"2023-10-24T00:44:53.225145+0000","last_unstale":"2023-10-24T00:44:53.234623+0000","last_undegraded":"2023-10-24T00:44:53.234623+0000","last_fullsized":"2023-10-24T00:44:53.234623+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220406+0000","last_change":"2023-10-24T00:44:52.864369+0000","last_active":"2023-10-24T00:44:53.220406+0000","last_peered":"2023-10-24T00:44:53.220406+0000","last_clean":"2023-10-24T00:44:53.220406+0000","last_became_active":"2023-10-24T00:44:52.864101+0000","last_became_peered":"2023-10-24T00:44:52.864101+0000","last_unstale":"2023-10-24T00:44:53.220406+0000","last_undegraded":"2023-10-24T00:44:53.220406+0000","last_fullsized":"2023-10-24T00:44:53.220406+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240364+0000","last_change":"2023-10-24T00:44:53.236562+0000","last_active":"2023-10-24T00:44:53.240364+0000","last_peered":"2023-10-24T00:44:53.240364+0000","last_clean":"2023-10-24T00:44:53.240364+0000","last_became_active":"2023-10-24T00:44:53.236290+0000","last_became_peered":"2023-10-24T00:44:53.236290+0000","last_unstale":"2023-10-24T00:44:53.240364+0000","last_undegraded":"2023-10-24T00:44:53.240364+0000","last_fullsized":"2023-10-24T00:44:53.240364+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223707+0000","last_change":"2023-10-24T00:44:52.873448+0000","last_active":"2023-10-24T00:44:53.223707+0000","last_peered":"2023-10-24T00:44:53.223707+0000","last_clean":"2023-10-24T00:44:53.223707+0000","last_became_active":"2023-10-24T00:44:52.873178+0000","last_became_peered":"2023-10-24T00:44:52.873178+0000","last_unstale":"2023-10-24T00:44:53.223707+0000","last_undegraded":"2023-10-24T00:44:53.223707+0000","last_fullsized":"2023-10-24T00:44:53.223707+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244878+0000","last_change":"2023-10-24T00:44:53.236091+0000","last_active":"2023-10-24T00:44:53.244878+0000","last_peered":"2023-10-24T00:44:53.244878+0000","last_clean":"2023-10-24T00:44:53.244878+0000","last_became_active":"2023-10-24T00:44:53.235821+0000","last_became_peered":"2023-10-24T00:44:53.235821+0000","last_unstale":"2023-10-24T00:44:53.244878+0000","last_undegraded":"2023-10-24T00:44:53.244878+0000","last_fullsized":"2023-10-24T00:44:53.244878+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239394+0000","last_change":"2023-10-24T00:44:52.874740+0000","last_active":"2023-10-24T00:44:53.239394+0000","last_peered":"2023-10-24T00:44:53.239394+0000","last_clean":"2023-10-24T00:44:53.239394+0000","last_became_active":"2023-10-24T00:44:52.874458+0000","last_became_peered":"2023-10-24T00:44:52.874458+0000","last_unstale":"2023-10-24T00:44:53.239394+0000","last_undegraded":"2023-10-24T00:44:53.239394+0000","last_fullsized":"2023-10-24T00:44:53.239394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240425+0000","last_change":"2023-10-24T00:44:53.235081+0000","last_active":"2023-10-24T00:44:53.240425+0000","last_peered":"2023-10-24T00:44:53.240425+0000","last_clean":"2023-10-24T00:44:53.240425+0000","last_became_active":"2023-10-24T00:44:53.234738+0000","last_became_peered":"2023-10-24T00:44:53.234738+0000","last_unstale":"2023-10-24T00:44:53.240425+0000","last_undegraded":"2023-10-24T00:44:53.240425+0000","last_fullsized":"2023-10-24T00:44:53.240425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223792+0000","last_change":"2023-10-24T00:44:52.866873+0000","last_active":"2023-10-24T00:44:53.223792+0000","last_peered":"2023-10-24T00:44:53.223792+0000","last_clean":"2023-10-24T00:44:53.223792+0000","last_became_active":"2023-10-24T00:44:52.866628+0000","last_became_peered":"2023-10-24T00:44:52.866628+0000","last_unstale":"2023-10-24T00:44:53.223792+0000","last_undegraded":"2023-10-24T00:44:53.223792+0000","last_fullsized":"2023-10-24T00:44:53.223792+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244768+0000","last_change":"2023-10-24T00:44:53.236265+0000","last_active":"2023-10-24T00:44:53.244768+0000","last_peered":"2023-10-24T00:44:53.244768+0000","last_clean":"2023-10-24T00:44:53.244768+0000","last_became_active":"2023-10-24T00:44:53.235991+0000","last_became_peered":"2023-10-24T00:44:53.235991+0000","last_unstale":"2023-10-24T00:44:53.244768+0000","last_undegraded":"2023-10-24T00:44:53.244768+0000","last_fullsized":"2023-10-24T00:44:53.244768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245103+0000","last_change":"2023-10-24T00:44:52.876267+0000","last_active":"2023-10-24T00:44:53.245103+0000","last_peered":"2023-10-24T00:44:53.245103+0000","last_clean":"2023-10-24T00:44:53.245103+0000","last_became_active":"2023-10-24T00:44:52.876014+0000","last_became_peered":"2023-10-24T00:44:52.876014+0000","last_unstale":"2023-10-24T00:44:53.245103+0000","last_undegraded":"2023-10-24T00:44:53.245103+0000","last_fullsized":"2023-10-24T00:44:53.245103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235215+0000","last_change":"2023-10-24T00:44:53.234330+0000","last_active":"2023-10-24T00:44:53.235215+0000","last_peered":"2023-10-24T00:44:53.235215+0000","last_clean":"2023-10-24T00:44:53.235215+0000","last_became_active":"2023-10-24T00:44:53.234069+0000","last_became_peered":"2023-10-24T00:44:53.234069+0000","last_unstale":"2023-10-24T00:44:53.235215+0000","last_undegraded":"2023-10-24T00:44:53.235215+0000","last_fullsized":"2023-10-24T00:44:53.235215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.225478+0000","last_change":"2023-10-24T00:44:52.865761+0000","last_active":"2023-10-24T00:44:53.225478+0000","last_peered":"2023-10-24T00:44:53.225478+0000","last_clean":"2023-10-24T00:44:53.225478+0000","last_became_active":"2023-10-24T00:44:52.865462+0000","last_became_peered":"2023-10-24T00:44:52.865462+0000","last_unstale":"2023-10-24T00:44:53.225478+0000","last_undegraded":"2023-10-24T00:44:53.225478+0000","last_fullsized":"2023-10-24T00:44:53.225478+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245308+0000","last_change":"2023-10-24T00:44:53.242962+0000","last_active":"2023-10-24T00:44:53.245308+0000","last_peered":"2023-10-24T00:44:53.245308+0000","last_clean":"2023-10-24T00:44:53.245308+0000","last_became_active":"2023-10-24T00:44:53.242107+0000","last_became_peered":"2023-10-24T00:44:53.242107+0000","last_unstale":"2023-10-24T00:44:53.245308+0000","last_undegraded":"2023-10-24T00:44:53.245308+0000","last_fullsized":"2023-10-24T00:44:53.245308+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219469+0000","last_change":"2023-10-24T00:44:52.867563+0000","last_active":"2023-10-24T00:44:53.219469+0000","last_peered":"2023-10-24T00:44:53.219469+0000","last_clean":"2023-10-24T00:44:53.219469+0000","last_became_active":"2023-10-24T00:44:52.866919+0000","last_became_peered":"2023-10-24T00:44:52.866919+0000","last_unstale":"2023-10-24T00:44:53.219469+0000","last_undegraded":"2023-10-24T00:44:53.219469+0000","last_fullsized":"2023-10-24T00:44:53.219469+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244718+0000","last_change":"2023-10-24T00:44:53.232728+0000","last_active":"2023-10-24T00:44:53.244718+0000","last_peered":"2023-10-24T00:44:53.244718+0000","last_clean":"2023-10-24T00:44:53.244718+0000","last_became_active":"2023-10-24T00:44:53.232164+0000","last_became_peered":"2023-10-24T00:44:53.232164+0000","last_unstale":"2023-10-24T00:44:53.244718+0000","last_undegraded":"2023-10-24T00:44:53.244718+0000","last_fullsized":"2023-10-24T00:44:53.244718+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219752+0000","last_change":"2023-10-24T00:44:52.880224+0000","last_active":"2023-10-24T00:44:53.219752+0000","last_peered":"2023-10-24T00:44:53.219752+0000","last_clean":"2023-10-24T00:44:53.219752+0000","last_became_active":"2023-10-24T00:44:52.879960+0000","last_became_peered":"2023-10-24T00:44:52.879960+0000","last_unstale":"2023-10-24T00:44:53.219752+0000","last_undegraded":"2023-10-24T00:44:53.219752+0000","last_fullsized":"2023-10-24T00:44:53.219752+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235071+0000","last_change":"2023-10-24T00:44:53.232846+0000","last_active":"2023-10-24T00:44:53.235071+0000","last_peered":"2023-10-24T00:44:53.235071+0000","last_clean":"2023-10-24T00:44:53.235071+0000","last_became_active":"2023-10-24T00:44:53.231493+0000","last_became_peered":"2023-10-24T00:44:53.231493+0000","last_unstale":"2023-10-24T00:44:53.235071+0000","last_undegraded":"2023-10-24T00:44:53.235071+0000","last_fullsized":"2023-10-24T00:44:53.235071+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.227566+0000","last_change":"2023-10-24T00:44:52.860400+0000","last_active":"2023-10-24T00:44:53.227566+0000","last_peered":"2023-10-24T00:44:53.227566+0000","last_clean":"2023-10-24T00:44:53.227566+0000","last_became_active":"2023-10-24T00:44:52.860093+0000","last_became_peered":"2023-10-24T00:44:52.860093+0000","last_unstale":"2023-10-24T00:44:53.227566+0000","last_undegraded":"2023-10-24T00:44:53.227566+0000","last_fullsized":"2023-10-24T00:44:53.227566+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238966+0000","last_change":"2023-10-24T00:44:53.237442+0000","last_active":"2023-10-24T00:44:53.238966+0000","last_peered":"2023-10-24T00:44:53.238966+0000","last_clean":"2023-10-24T00:44:53.238966+0000","last_became_active":"2023-10-24T00:44:53.237233+0000","last_became_peered":"2023-10-24T00:44:53.237233+0000","last_unstale":"2023-10-24T00:44:53.238966+0000","last_undegraded":"2023-10-24T00:44:53.238966+0000","last_fullsized":"2023-10-24T00:44:53.238966+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223426+0000","last_change":"2023-10-24T00:44:52.875693+0000","last_active":"2023-10-24T00:44:53.223426+0000","last_peered":"2023-10-24T00:44:53.223426+0000","last_clean":"2023-10-24T00:44:53.223426+0000","last_became_active":"2023-10-24T00:44:52.875347+0000","last_became_peered":"2023-10-24T00:44:52.875347+0000","last_unstale":"2023-10-24T00:44:53.223426+0000","last_undegraded":"2023-10-24T00:44:53.223426+0000","last_fullsized":"2023-10-24T00:44:53.223426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.229044+0000","last_change":"2023-10-24T00:44:53.226466+0000","last_active":"2023-10-24T00:44:53.229044+0000","last_peered":"2023-10-24T00:44:53.229044+0000","last_clean":"2023-10-24T00:44:53.229044+0000","last_became_active":"2023-10-24T00:44:53.226179+0000","last_became_peered":"2023-10-24T00:44:53.226179+0000","last_unstale":"2023-10-24T00:44:53.229044+0000","last_undegraded":"2023-10-24T00:44:53.229044+0000","last_fullsized":"2023-10-24T00:44:53.229044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224527+0000","last_change":"2023-10-24T00:44:52.865616+0000","last_active":"2023-10-24T00:44:53.224527+0000","last_peered":"2023-10-24T00:44:53.224527+0000","last_clean":"2023-10-24T00:44:53.224527+0000","last_became_active":"2023-10-24T00:44:52.865358+0000","last_became_peered":"2023-10-24T00:44:52.865358+0000","last_unstale":"2023-10-24T00:44:53.224527+0000","last_undegraded":"2023-10-24T00:44:53.224527+0000","last_fullsized":"2023-10-24T00:44:53.224527+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248607+0000","last_change":"2023-10-24T00:44:53.240714+0000","last_active":"2023-10-24T00:44:53.248607+0000","last_peered":"2023-10-24T00:44:53.248607+0000","last_clean":"2023-10-24T00:44:53.248607+0000","last_became_active":"2023-10-24T00:44:53.235034+0000","last_became_peered":"2023-10-24T00:44:53.235034+0000","last_unstale":"2023-10-24T00:44:53.248607+0000","last_undegraded":"2023-10-24T00:44:53.248607+0000","last_fullsized":"2023-10-24T00:44:53.248607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223064+0000","last_change":"2023-10-24T00:44:52.866310+0000","last_active":"2023-10-24T00:44:53.223064+0000","last_peered":"2023-10-24T00:44:53.223064+0000","last_clean":"2023-10-24T00:44:53.223064+0000","last_became_active":"2023-10-24T00:44:52.865989+0000","last_became_peered":"2023-10-24T00:44:52.865989+0000","last_unstale":"2023-10-24T00:44:53.223064+0000","last_undegraded":"2023-10-24T00:44:53.223064+0000","last_fullsized":"2023-10-24T00:44:53.223064+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245040+0000","last_change":"2023-10-24T00:44:53.237121+0000","last_active":"2023-10-24T00:44:53.245040+0000","last_peered":"2023-10-24T00:44:53.245040+0000","last_clean":"2023-10-24T00:44:53.245040+0000","last_became_active":"2023-10-24T00:44:53.236844+0000","last_became_peered":"2023-10-24T00:44:53.236844+0000","last_unstale":"2023-10-24T00:44:53.245040+0000","last_undegraded":"2023-10-24T00:44:53.245040+0000","last_fullsized":"2023-10-24T00:44:53.245040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223765+0000","last_change":"2023-10-24T00:44:52.861611+0000","last_active":"2023-10-24T00:44:53.223765+0000","last_peered":"2023-10-24T00:44:53.223765+0000","last_clean":"2023-10-24T00:44:53.223765+0000","last_became_active":"2023-10-24T00:44:52.861335+0000","last_became_peered":"2023-10-24T00:44:52.861335+0000","last_unstale":"2023-10-24T00:44:53.223765+0000","last_undegraded":"2023-10-24T00:44:53.223765+0000","last_fullsized":"2023-10-24T00:44:53.223765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.231376+0000","last_change":"2023-10-24T00:44:53.225773+0000","last_active":"2023-10-24T00:44:53.231376+0000","last_peered":"2023-10-24T00:44:53.231376+0000","last_clean":"2023-10-24T00:44:53.231376+0000","last_became_active":"2023-10-24T00:44:53.225494+0000","last_became_peered":"2023-10-24T00:44:53.225494+0000","last_unstale":"2023-10-24T00:44:53.231376+0000","last_undegraded":"2023-10-24T00:44:53.231376+0000","last_fullsized":"2023-10-24T00:44:53.231376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223131+0000","last_change":"2023-10-24T00:44:52.870767+0000","last_active":"2023-10-24T00:44:53.223131+0000","last_peered":"2023-10-24T00:44:53.223131+0000","last_clean":"2023-10-24T00:44:53.223131+0000","last_became_active":"2023-10-24T00:44:52.870493+0000","last_became_peered":"2023-10-24T00:44:52.870493+0000","last_unstale":"2023-10-24T00:44:53.223131+0000","last_undegraded":"2023-10-24T00:44:53.223131+0000","last_fullsized":"2023-10-24T00:44:53.223131+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240435+0000","last_change":"2023-10-24T00:44:53.236323+0000","last_active":"2023-10-24T00:44:53.240435+0000","last_peered":"2023-10-24T00:44:53.240435+0000","last_clean":"2023-10-24T00:44:53.240435+0000","last_became_active":"2023-10-24T00:44:53.236038+0000","last_became_peered":"2023-10-24T00:44:53.236038+0000","last_unstale":"2023-10-24T00:44:53.240435+0000","last_undegraded":"2023-10-24T00:44:53.240435+0000","last_fullsized":"2023-10-24T00:44:53.240435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224303+0000","last_change":"2023-10-24T00:44:52.863478+0000","last_active":"2023-10-24T00:44:53.224303+0000","last_peered":"2023-10-24T00:44:53.224303+0000","last_clean":"2023-10-24T00:44:53.224303+0000","last_became_active":"2023-10-24T00:44:52.863224+0000","last_became_peered":"2023-10-24T00:44:52.863224+0000","last_unstale":"2023-10-24T00:44:53.224303+0000","last_undegraded":"2023-10-24T00:44:53.224303+0000","last_fullsized":"2023-10-24T00:44:53.224303+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248586+0000","last_change":"2023-10-24T00:44:53.235294+0000","last_active":"2023-10-24T00:44:53.248586+0000","last_peered":"2023-10-24T00:44:53.248586+0000","last_clean":"2023-10-24T00:44:53.248586+0000","last_became_active":"2023-10-24T00:44:53.234987+0000","last_became_peered":"2023-10-24T00:44:53.234987+0000","last_unstale":"2023-10-24T00:44:53.248586+0000","last_undegraded":"2023-10-24T00:44:53.248586+0000","last_fullsized":"2023-10-24T00:44:53.248586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.230742+0000","last_change":"2023-10-24T00:44:52.873938+0000","last_active":"2023-10-24T00:44:53.230742+0000","last_peered":"2023-10-24T00:44:53.230742+0000","last_clean":"2023-10-24T00:44:53.230742+0000","last_became_active":"2023-10-24T00:44:52.873027+0000","last_became_peered":"2023-10-24T00:44:52.873027+0000","last_unstale":"2023-10-24T00:44:53.230742+0000","last_undegraded":"2023-10-24T00:44:53.230742+0000","last_fullsized":"2023-10-24T00:44:53.230742+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244207+0000","last_change":"2023-10-24T00:44:53.242406+0000","last_active":"2023-10-24T00:44:53.244207+0000","last_peered":"2023-10-24T00:44:53.244207+0000","last_clean":"2023-10-24T00:44:53.244207+0000","last_became_active":"2023-10-24T00:44:53.242072+0000","last_became_peered":"2023-10-24T00:44:53.242072+0000","last_unstale":"2023-10-24T00:44:53.244207+0000","last_undegraded":"2023-10-24T00:44:53.244207+0000","last_fullsized":"2023-10-24T00:44:53.244207+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238426+0000","last_change":"2023-10-24T00:44:52.864322+0000","last_active":"2023-10-24T00:44:53.238426+0000","last_peered":"2023-10-24T00:44:53.238426+0000","last_clean":"2023-10-24T00:44:53.238426+0000","last_became_active":"2023-10-24T00:44:52.863798+0000","last_became_peered":"2023-10-24T00:44:52.863798+0000","last_unstale":"2023-10-24T00:44:53.238426+0000","last_undegraded":"2023-10-24T00:44:53.238426+0000","last_fullsized":"2023-10-24T00:44:53.238426+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.234611+0000","last_change":"2023-10-24T00:44:53.226685+0000","last_active":"2023-10-24T00:44:53.234611+0000","last_peered":"2023-10-24T00:44:53.234611+0000","last_clean":"2023-10-24T00:44:53.234611+0000","last_became_active":"2023-10-24T00:44:53.226369+0000","last_became_peered":"2023-10-24T00:44:53.226369+0000","last_unstale":"2023-10-24T00:44:53.234611+0000","last_undegraded":"2023-10-24T00:44:53.234611+0000","last_fullsized":"2023-10-24T00:44:53.234611+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236695+0000","last_change":"2023-10-24T00:44:52.879474+0000","last_active":"2023-10-24T00:44:53.236695+0000","last_peered":"2023-10-24T00:44:53.236695+0000","last_clean":"2023-10-24T00:44:53.236695+0000","last_became_active":"2023-10-24T00:44:52.879013+0000","last_became_peered":"2023-10-24T00:44:52.879013+0000","last_unstale":"2023-10-24T00:44:53.236695+0000","last_undegraded":"2023-10-24T00:44:53.236695+0000","last_fullsized":"2023-10-24T00:44:53.236695+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240466+0000","last_change":"2023-10-24T00:44:53.235730+0000","last_active":"2023-10-24T00:44:53.240466+0000","last_peered":"2023-10-24T00:44:53.240466+0000","last_clean":"2023-10-24T00:44:53.240466+0000","last_became_active":"2023-10-24T00:44:53.235436+0000","last_became_peered":"2023-10-24T00:44:53.235436+0000","last_unstale":"2023-10-24T00:44:53.240466+0000","last_undegraded":"2023-10-24T00:44:53.240466+0000","last_fullsized":"2023-10-24T00:44:53.240466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247390+0000","last_change":"2023-10-24T00:44:52.872354+0000","last_active":"2023-10-24T00:44:53.247390+0000","last_peered":"2023-10-24T00:44:53.247390+0000","last_clean":"2023-10-24T00:44:53.247390+0000","last_became_active":"2023-10-24T00:44:52.872066+0000","last_became_peered":"2023-10-24T00:44:52.872066+0000","last_unstale":"2023-10-24T00:44:53.247390+0000","last_undegraded":"2023-10-24T00:44:53.247390+0000","last_fullsized":"2023-10-24T00:44:53.247390+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240405+0000","last_change":"2023-10-24T00:44:53.235064+0000","last_active":"2023-10-24T00:44:53.240405+0000","last_peered":"2023-10-24T00:44:53.240405+0000","last_clean":"2023-10-24T00:44:53.240405+0000","last_became_active":"2023-10-24T00:44:53.234700+0000","last_became_peered":"2023-10-24T00:44:53.234700+0000","last_unstale":"2023-10-24T00:44:53.240405+0000","last_undegraded":"2023-10-24T00:44:53.240405+0000","last_fullsized":"2023-10-24T00:44:53.240405+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.231746+0000","last_change":"2023-10-24T00:44:52.878921+0000","last_active":"2023-10-24T00:44:53.231746+0000","last_peered":"2023-10-24T00:44:53.231746+0000","last_clean":"2023-10-24T00:44:53.231746+0000","last_became_active":"2023-10-24T00:44:52.878189+0000","last_became_peered":"2023-10-24T00:44:52.878189+0000","last_unstale":"2023-10-24T00:44:53.231746+0000","last_undegraded":"2023-10-24T00:44:53.231746+0000","last_fullsized":"2023-10-24T00:44:53.231746+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.243535+0000","last_change":"2023-10-24T00:44:53.231785+0000","last_active":"2023-10-24T00:44:53.243535+0000","last_peered":"2023-10-24T00:44:53.243535+0000","last_clean":"2023-10-24T00:44:53.243535+0000","last_became_active":"2023-10-24T00:44:53.231446+0000","last_became_peered":"2023-10-24T00:44:53.231446+0000","last_unstale":"2023-10-24T00:44:53.243535+0000","last_undegraded":"2023-10-24T00:44:53.243535+0000","last_fullsized":"2023-10-24T00:44:53.243535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224394+0000","last_change":"2023-10-24T00:44:52.862768+0000","last_active":"2023-10-24T00:44:53.224394+0000","last_peered":"2023-10-24T00:44:53.224394+0000","last_clean":"2023-10-24T00:44:53.224394+0000","last_became_active":"2023-10-24T00:44:52.862472+0000","last_became_peered":"2023-10-24T00:44:52.862472+0000","last_unstale":"2023-10-24T00:44:53.224394+0000","last_undegraded":"2023-10-24T00:44:53.224394+0000","last_fullsized":"2023-10-24T00:44:53.224394+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248742+0000","last_change":"2023-10-24T00:44:53.246709+0000","last_active":"2023-10-24T00:44:53.248742+0000","last_peered":"2023-10-24T00:44:53.248742+0000","last_clean":"2023-10-24T00:44:53.248742+0000","last_became_active":"2023-10-24T00:44:53.235083+0000","last_became_peered":"2023-10-24T00:44:53.235083+0000","last_unstale":"2023-10-24T00:44:53.248742+0000","last_undegraded":"2023-10-24T00:44:53.248742+0000","last_fullsized":"2023-10-24T00:44:53.248742+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223245+0000","last_change":"2023-10-24T00:44:52.866288+0000","last_active":"2023-10-24T00:44:53.223245+0000","last_peered":"2023-10-24T00:44:53.223245+0000","last_clean":"2023-10-24T00:44:53.223245+0000","last_became_active":"2023-10-24T00:44:52.865921+0000","last_became_peered":"2023-10-24T00:44:52.865921+0000","last_unstale":"2023-10-24T00:44:53.223245+0000","last_undegraded":"2023-10-24T00:44:53.223245+0000","last_fullsized":"2023-10-24T00:44:53.223245+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240784+0000","last_change":"2023-10-24T00:44:53.238872+0000","last_active":"2023-10-24T00:44:53.240784+0000","last_peered":"2023-10-24T00:44:53.240784+0000","last_clean":"2023-10-24T00:44:53.240784+0000","last_became_active":"2023-10-24T00:44:53.238512+0000","last_became_peered":"2023-10-24T00:44:53.238512+0000","last_unstale":"2023-10-24T00:44:53.240784+0000","last_undegraded":"2023-10-24T00:44:53.240784+0000","last_fullsized":"2023-10-24T00:44:53.240784+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220794+0000","last_change":"2023-10-24T00:44:52.872280+0000","last_active":"2023-10-24T00:44:53.220794+0000","last_peered":"2023-10-24T00:44:53.220794+0000","last_clean":"2023-10-24T00:44:53.220794+0000","last_became_active":"2023-10-24T00:44:52.872009+0000","last_became_peered":"2023-10-24T00:44:52.872009+0000","last_unstale":"2023-10-24T00:44:53.220794+0000","last_undegraded":"2023-10-24T00:44:53.220794+0000","last_fullsized":"2023-10-24T00:44:53.220794+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242191+0000","last_change":"2023-10-24T00:44:53.238934+0000","last_active":"2023-10-24T00:44:53.242191+0000","last_peered":"2023-10-24T00:44:53.242191+0000","last_clean":"2023-10-24T00:44:53.242191+0000","last_became_active":"2023-10-24T00:44:53.238636+0000","last_became_peered":"2023-10-24T00:44:53.238636+0000","last_unstale":"2023-10-24T00:44:53.242191+0000","last_undegraded":"2023-10-24T00:44:53.242191+0000","last_fullsized":"2023-10-24T00:44:53.242191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.218453+0000","last_change":"2023-10-24T00:44:52.866192+0000","last_active":"2023-10-24T00:44:53.218453+0000","last_peered":"2023-10-24T00:44:53.218453+0000","last_clean":"2023-10-24T00:44:53.218453+0000","last_became_active":"2023-10-24T00:44:52.865838+0000","last_became_peered":"2023-10-24T00:44:52.865838+0000","last_unstale":"2023-10-24T00:44:53.218453+0000","last_undegraded":"2023-10-24T00:44:53.218453+0000","last_fullsized":"2023-10-24T00:44:53.218453+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242826+0000","last_change":"2023-10-24T00:44:53.231518+0000","last_active":"2023-10-24T00:44:53.242826+0000","last_peered":"2023-10-24T00:44:53.242826+0000","last_clean":"2023-10-24T00:44:53.242826+0000","last_became_active":"2023-10-24T00:44:53.231245+0000","last_became_peered":"2023-10-24T00:44:53.231245+0000","last_unstale":"2023-10-24T00:44:53.242826+0000","last_undegraded":"2023-10-24T00:44:53.242826+0000","last_fullsized":"2023-10-24T00:44:53.242826+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220335+0000","last_change":"2023-10-24T00:44:52.879349+0000","last_active":"2023-10-24T00:44:53.220335+0000","last_peered":"2023-10-24T00:44:53.220335+0000","last_clean":"2023-10-24T00:44:53.220335+0000","last_became_active":"2023-10-24T00:44:52.879088+0000","last_became_peered":"2023-10-24T00:44:52.879088+0000","last_unstale":"2023-10-24T00:44:53.220335+0000","last_undegraded":"2023-10-24T00:44:53.220335+0000","last_fullsized":"2023-10-24T00:44:53.220335+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242085+0000","last_change":"2023-10-24T00:44:53.240738+0000","last_active":"2023-10-24T00:44:53.242085+0000","last_peered":"2023-10-24T00:44:53.242085+0000","last_clean":"2023-10-24T00:44:53.242085+0000","last_became_active":"2023-10-24T00:44:53.240447+0000","last_became_peered":"2023-10-24T00:44:53.240447+0000","last_unstale":"2023-10-24T00:44:53.242085+0000","last_undegraded":"2023-10-24T00:44:53.242085+0000","last_fullsized":"2023-10-24T00:44:53.242085+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223511+0000","last_change":"2023-10-24T00:44:52.861471+0000","last_active":"2023-10-24T00:44:53.223511+0000","last_peered":"2023-10-24T00:44:53.223511+0000","last_clean":"2023-10-24T00:44:53.223511+0000","last_became_active":"2023-10-24T00:44:52.861167+0000","last_became_peered":"2023-10-24T00:44:52.861167+0000","last_unstale":"2023-10-24T00:44:53.223511+0000","last_undegraded":"2023-10-24T00:44:53.223511+0000","last_fullsized":"2023-10-24T00:44:53.223511+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235342+0000","last_change":"2023-10-24T00:44:53.234243+0000","last_active":"2023-10-24T00:44:53.235342+0000","last_peered":"2023-10-24T00:44:53.235342+0000","last_clean":"2023-10-24T00:44:53.235342+0000","last_became_active":"2023-10-24T00:44:53.233994+0000","last_became_peered":"2023-10-24T00:44:53.233994+0000","last_unstale":"2023-10-24T00:44:53.235342+0000","last_undegraded":"2023-10-24T00:44:53.235342+0000","last_fullsized":"2023-10-24T00:44:53.235342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"95'3","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244913+0000","last_change":"2023-10-24T00:44:52.865340+0000","last_active":"2023-10-24T00:44:53.244913+0000","last_peered":"2023-10-24T00:44:53.244913+0000","last_clean":"2023-10-24T00:44:53.244913+0000","last_became_active":"2023-10-24T00:44:52.865078+0000","last_became_peered":"2023-10-24T00:44:52.865078+0000","last_unstale":"2023-10-24T00:44:53.244913+0000","last_undegraded":"2023-10-24T00:44:53.244913+0000","last_fullsized":"2023-10-24T00:44:53.244913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244250+0000","last_change":"2023-10-24T00:44:53.242804+0000","last_active":"2023-10-24T00:44:53.244250+0000","last_peered":"2023-10-24T00:44:53.244250+0000","last_clean":"2023-10-24T00:44:53.244250+0000","last_became_active":"2023-10-24T00:44:53.242524+0000","last_became_peered":"2023-10-24T00:44:53.242524+0000","last_unstale":"2023-10-24T00:44:53.244250+0000","last_undegraded":"2023-10-24T00:44:53.244250+0000","last_fullsized":"2023-10-24T00:44:53.244250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241192+0000","last_change":"2023-10-24T00:44:52.879117+0000","last_active":"2023-10-24T00:44:53.241192+0000","last_peered":"2023-10-24T00:44:53.241192+0000","last_clean":"2023-10-24T00:44:53.241192+0000","last_became_active":"2023-10-24T00:44:52.878528+0000","last_became_peered":"2023-10-24T00:44:52.878528+0000","last_unstale":"2023-10-24T00:44:53.241192+0000","last_undegraded":"2023-10-24T00:44:53.241192+0000","last_fullsized":"2023-10-24T00:44:53.241192+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240648+0000","last_change":"2023-10-24T00:44:53.235960+0000","last_active":"2023-10-24T00:44:53.240648+0000","last_peered":"2023-10-24T00:44:53.240648+0000","last_clean":"2023-10-24T00:44:53.240648+0000","last_became_active":"2023-10-24T00:44:53.235688+0000","last_became_peered":"2023-10-24T00:44:53.235688+0000","last_unstale":"2023-10-24T00:44:53.240648+0000","last_undegraded":"2023-10-24T00:44:53.240648+0000","last_fullsized":"2023-10-24T00:44:53.240648+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240028+0000","last_change":"2023-10-24T00:44:52.865289+0000","last_active":"2023-10-24T00:44:53.240028+0000","last_peered":"2023-10-24T00:44:53.240028+0000","last_clean":"2023-10-24T00:44:53.240028+0000","last_became_active":"2023-10-24T00:44:52.864991+0000","last_became_peered":"2023-10-24T00:44:52.864991+0000","last_unstale":"2023-10-24T00:44:53.240028+0000","last_undegraded":"2023-10-24T00:44:53.240028+0000","last_fullsized":"2023-10-24T00:44:53.240028+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.242216+0000","last_change":"2023-10-24T00:44:53.239236+0000","last_active":"2023-10-24T00:44:53.242216+0000","last_peered":"2023-10-24T00:44:53.242216+0000","last_clean":"2023-10-24T00:44:53.242216+0000","last_became_active":"2023-10-24T00:44:53.238972+0000","last_became_peered":"2023-10-24T00:44:53.238972+0000","last_unstale":"2023-10-24T00:44:53.242216+0000","last_undegraded":"2023-10-24T00:44:53.242216+0000","last_fullsized":"2023-10-24T00:44:53.242216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219472+0000","last_change":"2023-10-24T00:44:52.865878+0000","last_active":"2023-10-24T00:44:53.219472+0000","last_peered":"2023-10-24T00:44:53.219472+0000","last_clean":"2023-10-24T00:44:53.219472+0000","last_became_active":"2023-10-24T00:44:52.865595+0000","last_became_peered":"2023-10-24T00:44:52.865595+0000","last_unstale":"2023-10-24T00:44:53.219472+0000","last_undegraded":"2023-10-24T00:44:53.219472+0000","last_fullsized":"2023-10-24T00:44:53.219472+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244600+0000","last_change":"2023-10-24T00:44:53.241628+0000","last_active":"2023-10-24T00:44:53.244600+0000","last_peered":"2023-10-24T00:44:53.244600+0000","last_clean":"2023-10-24T00:44:53.244600+0000","last_became_active":"2023-10-24T00:44:53.241324+0000","last_became_peered":"2023-10-24T00:44:53.241324+0000","last_unstale":"2023-10-24T00:44:53.244600+0000","last_undegraded":"2023-10-24T00:44:53.244600+0000","last_fullsized":"2023-10-24T00:44:53.244600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.218942+0000","last_change":"2023-10-24T00:44:52.863663+0000","last_active":"2023-10-24T00:44:53.218942+0000","last_peered":"2023-10-24T00:44:53.218942+0000","last_clean":"2023-10-24T00:44:53.218942+0000","last_became_active":"2023-10-24T00:44:52.863414+0000","last_became_peered":"2023-10-24T00:44:52.863414+0000","last_unstale":"2023-10-24T00:44:53.218942+0000","last_undegraded":"2023-10-24T00:44:53.218942+0000","last_fullsized":"2023-10-24T00:44:53.218942+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238812+0000","last_change":"2023-10-24T00:44:53.235690+0000","last_active":"2023-10-24T00:44:53.238812+0000","last_peered":"2023-10-24T00:44:53.238812+0000","last_clean":"2023-10-24T00:44:53.238812+0000","last_became_active":"2023-10-24T00:44:53.235400+0000","last_became_peered":"2023-10-24T00:44:53.235400+0000","last_unstale":"2023-10-24T00:44:53.238812+0000","last_undegraded":"2023-10-24T00:44:53.238812+0000","last_fullsized":"2023-10-24T00:44:53.238812+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"95'4","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240838+0000","last_change":"2023-10-24T00:44:52.878636+0000","last_active":"2023-10-24T00:44:53.240838+0000","last_peered":"2023-10-24T00:44:53.240838+0000","last_clean":"2023-10-24T00:44:53.240838+0000","last_became_active":"2023-10-24T00:44:52.878332+0000","last_became_peered":"2023-10-24T00:44:52.878332+0000","last_unstale":"2023-10-24T00:44:53.240838+0000","last_undegraded":"2023-10-24T00:44:53.240838+0000","last_fullsized":"2023-10-24T00:44:53.240838+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240648+0000","last_change":"2023-10-24T00:44:53.237845+0000","last_active":"2023-10-24T00:44:53.240648+0000","last_peered":"2023-10-24T00:44:53.240648+0000","last_clean":"2023-10-24T00:44:53.240648+0000","last_became_active":"2023-10-24T00:44:53.237547+0000","last_became_peered":"2023-10-24T00:44:53.237547+0000","last_unstale":"2023-10-24T00:44:53.240648+0000","last_undegraded":"2023-10-24T00:44:53.240648+0000","last_fullsized":"2023-10-24T00:44:53.240648+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235003+0000","last_change":"2023-10-24T00:44:52.862580+0000","last_active":"2023-10-24T00:44:53.235003+0000","last_peered":"2023-10-24T00:44:53.235003+0000","last_clean":"2023-10-24T00:44:53.235003+0000","last_became_active":"2023-10-24T00:44:52.862315+0000","last_became_peered":"2023-10-24T00:44:52.862315+0000","last_unstale":"2023-10-24T00:44:53.235003+0000","last_undegraded":"2023-10-24T00:44:53.235003+0000","last_fullsized":"2023-10-24T00:44:53.235003+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238350+0000","last_change":"2023-10-24T00:44:53.235784+0000","last_active":"2023-10-24T00:44:53.238350+0000","last_peered":"2023-10-24T00:44:53.238350+0000","last_clean":"2023-10-24T00:44:53.238350+0000","last_became_active":"2023-10-24T00:44:53.235496+0000","last_became_peered":"2023-10-24T00:44:53.235496+0000","last_unstale":"2023-10-24T00:44:53.238350+0000","last_undegraded":"2023-10-24T00:44:53.238350+0000","last_fullsized":"2023-10-24T00:44:53.238350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226686+0000","last_change":"2023-10-24T00:44:52.868350+0000","last_active":"2023-10-24T00:44:53.226686+0000","last_peered":"2023-10-24T00:44:53.226686+0000","last_clean":"2023-10-24T00:44:53.226686+0000","last_became_active":"2023-10-24T00:44:52.868063+0000","last_became_peered":"2023-10-24T00:44:52.868063+0000","last_unstale":"2023-10-24T00:44:53.226686+0000","last_undegraded":"2023-10-24T00:44:53.226686+0000","last_fullsized":"2023-10-24T00:44:53.226686+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240448+0000","last_change":"2023-10-24T00:44:53.234195+0000","last_active":"2023-10-24T00:44:53.240448+0000","last_peered":"2023-10-24T00:44:53.240448+0000","last_clean":"2023-10-24T00:44:53.240448+0000","last_became_active":"2023-10-24T00:44:53.233836+0000","last_became_peered":"2023-10-24T00:44:53.233836+0000","last_unstale":"2023-10-24T00:44:53.240448+0000","last_undegraded":"2023-10-24T00:44:53.240448+0000","last_fullsized":"2023-10-24T00:44:53.240448+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219979+0000","last_change":"2023-10-24T00:44:52.868122+0000","last_active":"2023-10-24T00:44:53.219979+0000","last_peered":"2023-10-24T00:44:53.219979+0000","last_clean":"2023-10-24T00:44:53.219979+0000","last_became_active":"2023-10-24T00:44:52.867785+0000","last_became_peered":"2023-10-24T00:44:52.867785+0000","last_unstale":"2023-10-24T00:44:53.219979+0000","last_undegraded":"2023-10-24T00:44:53.219979+0000","last_fullsized":"2023-10-24T00:44:53.219979+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.241961+0000","last_change":"2023-10-24T00:44:53.227900+0000","last_active":"2023-10-24T00:44:53.241961+0000","last_peered":"2023-10-24T00:44:53.241961+0000","last_clean":"2023-10-24T00:44:53.241961+0000","last_became_active":"2023-10-24T00:44:53.227638+0000","last_became_peered":"2023-10-24T00:44:53.227638+0000","last_unstale":"2023-10-24T00:44:53.241961+0000","last_undegraded":"2023-10-24T00:44:53.241961+0000","last_fullsized":"2023-10-24T00:44:53.241961+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219583+0000","last_change":"2023-10-24T00:44:52.880350+0000","last_active":"2023-10-24T00:44:53.219583+0000","last_peered":"2023-10-24T00:44:53.219583+0000","last_clean":"2023-10-24T00:44:53.219583+0000","last_became_active":"2023-10-24T00:44:52.880053+0000","last_became_peered":"2023-10-24T00:44:52.880053+0000","last_unstale":"2023-10-24T00:44:53.219583+0000","last_undegraded":"2023-10-24T00:44:53.219583+0000","last_fullsized":"2023-10-24T00:44:53.219583+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239091+0000","last_change":"2023-10-24T00:44:53.236282+0000","last_active":"2023-10-24T00:44:53.239091+0000","last_peered":"2023-10-24T00:44:53.239091+0000","last_clean":"2023-10-24T00:44:53.239091+0000","last_became_active":"2023-10-24T00:44:53.235993+0000","last_became_peered":"2023-10-24T00:44:53.235993+0000","last_unstale":"2023-10-24T00:44:53.239091+0000","last_undegraded":"2023-10-24T00:44:53.239091+0000","last_fullsized":"2023-10-24T00:44:53.239091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.226642+0000","last_change":"2023-10-24T00:44:52.875374+0000","last_active":"2023-10-24T00:44:53.226642+0000","last_peered":"2023-10-24T00:44:53.226642+0000","last_clean":"2023-10-24T00:44:53.226642+0000","last_became_active":"2023-10-24T00:44:52.875096+0000","last_became_peered":"2023-10-24T00:44:52.875096+0000","last_unstale":"2023-10-24T00:44:53.226642+0000","last_undegraded":"2023-10-24T00:44:53.226642+0000","last_fullsized":"2023-10-24T00:44:53.226642+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.247696+0000","last_change":"2023-10-24T00:44:53.245680+0000","last_active":"2023-10-24T00:44:53.247696+0000","last_peered":"2023-10-24T00:44:53.247696+0000","last_clean":"2023-10-24T00:44:53.247696+0000","last_became_active":"2023-10-24T00:44:53.245397+0000","last_became_peered":"2023-10-24T00:44:53.245397+0000","last_unstale":"2023-10-24T00:44:53.247696+0000","last_undegraded":"2023-10-24T00:44:53.247696+0000","last_fullsized":"2023-10-24T00:44:53.247696+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219880+0000","last_change":"2023-10-24T00:44:52.864694+0000","last_active":"2023-10-24T00:44:53.219880+0000","last_peered":"2023-10-24T00:44:53.219880+0000","last_clean":"2023-10-24T00:44:53.219880+0000","last_became_active":"2023-10-24T00:44:52.864268+0000","last_became_peered":"2023-10-24T00:44:52.864268+0000","last_unstale":"2023-10-24T00:44:53.219880+0000","last_undegraded":"2023-10-24T00:44:53.219880+0000","last_fullsized":"2023-10-24T00:44:53.219880+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.245319+0000","last_change":"2023-10-24T00:44:53.243468+0000","last_active":"2023-10-24T00:44:53.245319+0000","last_peered":"2023-10-24T00:44:53.245319+0000","last_clean":"2023-10-24T00:44:53.245319+0000","last_became_active":"2023-10-24T00:44:53.243214+0000","last_became_peered":"2023-10-24T00:44:53.243214+0000","last_unstale":"2023-10-24T00:44:53.245319+0000","last_undegraded":"2023-10-24T00:44:53.245319+0000","last_fullsized":"2023-10-24T00:44:53.245319+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.228159+0000","last_change":"2023-10-24T00:44:52.870514+0000","last_active":"2023-10-24T00:44:53.228159+0000","last_peered":"2023-10-24T00:44:53.228159+0000","last_clean":"2023-10-24T00:44:53.228159+0000","last_became_active":"2023-10-24T00:44:52.870036+0000","last_became_peered":"2023-10-24T00:44:52.870036+0000","last_unstale":"2023-10-24T00:44:53.228159+0000","last_undegraded":"2023-10-24T00:44:53.228159+0000","last_fullsized":"2023-10-24T00:44:53.228159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.238879+0000","last_change":"2023-10-24T00:44:53.236835+0000","last_active":"2023-10-24T00:44:53.238879+0000","last_peered":"2023-10-24T00:44:53.238879+0000","last_clean":"2023-10-24T00:44:53.238879+0000","last_became_active":"2023-10-24T00:44:53.236438+0000","last_became_peered":"2023-10-24T00:44:53.236438+0000","last_unstale":"2023-10-24T00:44:53.238879+0000","last_undegraded":"2023-10-24T00:44:53.238879+0000","last_fullsized":"2023-10-24T00:44:53.238879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.222501+0000","last_change":"2023-10-24T00:44:52.860242+0000","last_active":"2023-10-24T00:44:53.222501+0000","last_peered":"2023-10-24T00:44:53.222501+0000","last_clean":"2023-10-24T00:44:53.222501+0000","last_became_active":"2023-10-24T00:44:52.859955+0000","last_became_peered":"2023-10-24T00:44:52.859955+0000","last_unstale":"2023-10-24T00:44:53.222501+0000","last_undegraded":"2023-10-24T00:44:53.222501+0000","last_fullsized":"2023-10-24T00:44:53.222501+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233435+0000","last_change":"2023-10-24T00:44:53.228619+0000","last_active":"2023-10-24T00:44:53.233435+0000","last_peered":"2023-10-24T00:44:53.233435+0000","last_clean":"2023-10-24T00:44:53.233435+0000","last_became_active":"2023-10-24T00:44:53.228342+0000","last_became_peered":"2023-10-24T00:44:53.228342+0000","last_unstale":"2023-10-24T00:44:53.233435+0000","last_undegraded":"2023-10-24T00:44:53.233435+0000","last_fullsized":"2023-10-24T00:44:53.233435+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219943+0000","last_change":"2023-10-24T00:44:52.862532+0000","last_active":"2023-10-24T00:44:53.219943+0000","last_peered":"2023-10-24T00:44:53.219943+0000","last_clean":"2023-10-24T00:44:53.219943+0000","last_became_active":"2023-10-24T00:44:52.862033+0000","last_became_peered":"2023-10-24T00:44:52.862033+0000","last_unstale":"2023-10-24T00:44:53.219943+0000","last_undegraded":"2023-10-24T00:44:53.219943+0000","last_fullsized":"2023-10-24T00:44:53.219943+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.225078+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:44:53.225078+0000","last_peered":"2023-10-24T00:44:53.225078+0000","last_clean":"2023-10-24T00:44:53.225078+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:44:53.225078+0000","last_undegraded":"2023-10-24T00:44:53.225078+0000","last_fullsized":"2023-10-24T00:44:53.225078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240823+0000","last_change":"2023-10-24T00:44:53.229919+0000","last_active":"2023-10-24T00:44:53.240823+0000","last_peered":"2023-10-24T00:44:53.240823+0000","last_clean":"2023-10-24T00:44:53.240823+0000","last_became_active":"2023-10-24T00:44:53.229668+0000","last_became_peered":"2023-10-24T00:44:53.229668+0000","last_unstale":"2023-10-24T00:44:53.240823+0000","last_undegraded":"2023-10-24T00:44:53.240823+0000","last_fullsized":"2023-10-24T00:44:53.240823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.233760+0000","last_change":"2023-10-24T00:44:52.860145+0000","last_active":"2023-10-24T00:44:53.233760+0000","last_peered":"2023-10-24T00:44:53.233760+0000","last_clean":"2023-10-24T00:44:53.233760+0000","last_became_active":"2023-10-24T00:44:52.859928+0000","last_became_peered":"2023-10-24T00:44:52.859928+0000","last_unstale":"2023-10-24T00:44:53.233760+0000","last_undegraded":"2023-10-24T00:44:53.233760+0000","last_fullsized":"2023-10-24T00:44:53.233760+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223327+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:44:53.223327+0000","last_peered":"2023-10-24T00:44:53.223327+0000","last_clean":"2023-10-24T00:44:53.223327+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:44:53.223327+0000","last_undegraded":"2023-10-24T00:44:53.223327+0000","last_fullsized":"2023-10-24T00:44:53.223327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239607+0000","last_change":"2023-10-24T00:44:53.237510+0000","last_active":"2023-10-24T00:44:53.239607+0000","last_peered":"2023-10-24T00:44:53.239607+0000","last_clean":"2023-10-24T00:44:53.239607+0000","last_became_active":"2023-10-24T00:44:53.237228+0000","last_became_peered":"2023-10-24T00:44:53.237228+0000","last_unstale":"2023-10-24T00:44:53.239607+0000","last_undegraded":"2023-10-24T00:44:53.239607+0000","last_fullsized":"2023-10-24T00:44:53.239607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224794+0000","last_change":"2023-10-24T00:44:52.873860+0000","last_active":"2023-10-24T00:44:53.224794+0000","last_peered":"2023-10-24T00:44:53.224794+0000","last_clean":"2023-10-24T00:44:53.224794+0000","last_became_active":"2023-10-24T00:44:52.873540+0000","last_became_peered":"2023-10-24T00:44:52.873540+0000","last_unstale":"2023-10-24T00:44:53.224794+0000","last_undegraded":"2023-10-24T00:44:53.224794+0000","last_fullsized":"2023-10-24T00:44:53.224794+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219025+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:44:53.219025+0000","last_peered":"2023-10-24T00:44:53.219025+0000","last_clean":"2023-10-24T00:44:53.219025+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:44:53.219025+0000","last_undegraded":"2023-10-24T00:44:53.219025+0000","last_fullsized":"2023-10-24T00:44:53.219025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.236044+0000","last_change":"2023-10-24T00:44:53.234191+0000","last_active":"2023-10-24T00:44:53.236044+0000","last_peered":"2023-10-24T00:44:53.236044+0000","last_clean":"2023-10-24T00:44:53.236044+0000","last_became_active":"2023-10-24T00:44:53.233898+0000","last_became_peered":"2023-10-24T00:44:53.233898+0000","last_unstale":"2023-10-24T00:44:53.236044+0000","last_undegraded":"2023-10-24T00:44:53.236044+0000","last_fullsized":"2023-10-24T00:44:53.236044+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223709+0000","last_change":"2023-10-24T00:44:52.878748+0000","last_active":"2023-10-24T00:44:53.223709+0000","last_peered":"2023-10-24T00:44:53.223709+0000","last_clean":"2023-10-24T00:44:53.223709+0000","last_became_active":"2023-10-24T00:44:52.878423+0000","last_became_peered":"2023-10-24T00:44:52.878423+0000","last_unstale":"2023-10-24T00:44:53.223709+0000","last_undegraded":"2023-10-24T00:44:53.223709+0000","last_fullsized":"2023-10-24T00:44:53.223709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223435+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:44:53.223435+0000","last_peered":"2023-10-24T00:44:53.223435+0000","last_clean":"2023-10-24T00:44:53.223435+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:44:53.223435+0000","last_undegraded":"2023-10-24T00:44:53.223435+0000","last_fullsized":"2023-10-24T00:44:53.223435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219844+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:44:53.219844+0000","last_peered":"2023-10-24T00:44:53.219844+0000","last_clean":"2023-10-24T00:44:53.219844+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:44:53.219844+0000","last_undegraded":"2023-10-24T00:44:53.219844+0000","last_fullsized":"2023-10-24T00:44:53.219844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.248641+0000","last_change":"2023-10-24T00:44:53.241158+0000","last_active":"2023-10-24T00:44:53.248641+0000","last_peered":"2023-10-24T00:44:53.248641+0000","last_clean":"2023-10-24T00:44:53.248641+0000","last_became_active":"2023-10-24T00:44:53.240897+0000","last_became_peered":"2023-10-24T00:44:53.240897+0000","last_unstale":"2023-10-24T00:44:53.248641+0000","last_undegraded":"2023-10-24T00:44:53.248641+0000","last_fullsized":"2023-10-24T00:44:53.248641+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223846+0000","last_change":"2023-10-24T00:44:52.872146+0000","last_active":"2023-10-24T00:44:53.223846+0000","last_peered":"2023-10-24T00:44:53.223846+0000","last_clean":"2023-10-24T00:44:53.223846+0000","last_became_active":"2023-10-24T00:44:52.871882+0000","last_became_peered":"2023-10-24T00:44:52.871882+0000","last_unstale":"2023-10-24T00:44:53.223846+0000","last_undegraded":"2023-10-24T00:44:53.223846+0000","last_fullsized":"2023-10-24T00:44:53.223846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.219937+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:44:53.219937+0000","last_peered":"2023-10-24T00:44:53.219937+0000","last_clean":"2023-10-24T00:44:53.219937+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:44:53.219937+0000","last_undegraded":"2023-10-24T00:44:53.219937+0000","last_fullsized":"2023-10-24T00:44:53.219937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235348+0000","last_change":"2023-10-24T00:44:53.234240+0000","last_active":"2023-10-24T00:44:53.235348+0000","last_peered":"2023-10-24T00:44:53.235348+0000","last_clean":"2023-10-24T00:44:53.235348+0000","last_became_active":"2023-10-24T00:44:53.233982+0000","last_became_peered":"2023-10-24T00:44:53.233982+0000","last_unstale":"2023-10-24T00:44:53.235348+0000","last_undegraded":"2023-10-24T00:44:53.235348+0000","last_fullsized":"2023-10-24T00:44:53.235348+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.224920+0000","last_change":"2023-10-24T00:44:52.862840+0000","last_active":"2023-10-24T00:44:53.224920+0000","last_peered":"2023-10-24T00:44:53.224920+0000","last_clean":"2023-10-24T00:44:53.224920+0000","last_became_active":"2023-10-24T00:44:52.862297+0000","last_became_peered":"2023-10-24T00:44:52.862297+0000","last_unstale":"2023-10-24T00:44:53.224920+0000","last_undegraded":"2023-10-24T00:44:53.224920+0000","last_fullsized":"2023-10-24T00:44:53.224920+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.220096+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:44:53.220096+0000","last_peered":"2023-10-24T00:44:53.220096+0000","last_clean":"2023-10-24T00:44:53.220096+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:44:53.220096+0000","last_undegraded":"2023-10-24T00:44:53.220096+0000","last_fullsized":"2023-10-24T00:44:53.220096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.235185+0000","last_change":"2023-10-24T00:44:53.234157+0000","last_active":"2023-10-24T00:44:53.235185+0000","last_peered":"2023-10-24T00:44:53.235185+0000","last_clean":"2023-10-24T00:44:53.235185+0000","last_became_active":"2023-10-24T00:44:53.233870+0000","last_became_peered":"2023-10-24T00:44:53.233870+0000","last_unstale":"2023-10-24T00:44:53.235185+0000","last_undegraded":"2023-10-24T00:44:53.235185+0000","last_fullsized":"2023-10-24T00:44:53.235185+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"95'1","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.239054+0000","last_change":"2023-10-24T00:44:52.867818+0000","last_active":"2023-10-24T00:44:53.239054+0000","last_peered":"2023-10-24T00:44:53.239054+0000","last_clean":"2023-10-24T00:44:53.239054+0000","last_became_active":"2023-10-24T00:44:52.867536+0000","last_became_peered":"2023-10-24T00:44:52.867536+0000","last_unstale":"2023-10-24T00:44:53.239054+0000","last_undegraded":"2023-10-24T00:44:53.239054+0000","last_fullsized":"2023-10-24T00:44:53.239054+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.223783+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:44:53.223783+0000","last_peered":"2023-10-24T00:44:53.223783+0000","last_clean":"2023-10-24T00:44:53.223783+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:44:53.223783+0000","last_undegraded":"2023-10-24T00:44:53.223783+0000","last_fullsized":"2023-10-24T00:44:53.223783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.244776+0000","last_change":"2023-10-24T00:44:53.232542+0000","last_active":"2023-10-24T00:44:53.244776+0000","last_peered":"2023-10-24T00:44:53.244776+0000","last_clean":"2023-10-24T00:44:53.244776+0000","last_became_active":"2023-10-24T00:44:53.232227+0000","last_became_peered":"2023-10-24T00:44:53.232227+0000","last_unstale":"2023-10-24T00:44:53.244776+0000","last_undegraded":"2023-10-24T00:44:53.244776+0000","last_fullsized":"2023-10-24T00:44:53.244776+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:52.844059+0000","last_clean_scrub_stamp":"2023-10-24T00:44:52.844059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"95'2","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.240584+0000","last_change":"2023-10-24T00:44:52.863391+0000","last_active":"2023-10-24T00:44:53.240584+0000","last_peered":"2023-10-24T00:44:53.240584+0000","last_clean":"2023-10-24T00:44:53.240584+0000","last_became_active":"2023-10-24T00:44:52.862950+0000","last_became_peered":"2023-10-24T00:44:52.862950+0000","last_unstale":"2023-10-24T00:44:53.240584+0000","last_undegraded":"2023-10-24T00:44:53.240584+0000","last_fullsized":"2023-10-24T00:44:53.240584+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:44:51.840671+0000","last_clean_scrub_stamp":"2023-10-24T00:44:51.840671+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2023-10-24T00:44:53.228405+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:44:53.228405+0000","last_peered":"2023-10-24T00:44:53.228405+0000","last_clean":"2023-10-24T00:44:53.228405+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:44:53.228405+0000","last_undegraded":"2023-10-24T00:44:53.228405+0000","last_fullsized":"2023-10-24T00:44:53.228405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302340,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069500,"statfs":{"total":96636764160,"available":96327168000,"internally_reserved":0,"allocated":1175552,"data_stored":583744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.78700000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.67900000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.307},"max":{"1min":0.67100000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.38800000000000001,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.76600000000000001,"15min":0.81100000000000005},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.34300000000000003,"15min":0.315},"max":{"1min":0.66600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.55000000000000004}]},{"osd":3,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69499999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.747,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.79200000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.497},"min":{"1min":0.376,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.754,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.78200000000000003,"5min":4.351,"15min":4.351},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79300000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56100000000000005},"min":{"1min":0.46100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76800000000000002,"5min":1.054,"15min":1.054},"last":0.746},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56399999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":583882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.878},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.76200000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.375}]},{"osd":1,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.35199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":1.786},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":3.2160000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60199999999999998,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81299999999999994,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.438,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":1.5029999999999999,"15min":1.873},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.67600000000000005,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":14.597,"15min":14.597},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.34499999999999997},"max":{"1min":0.74099999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":3.2959999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.55700000000000005,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71799999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":1.4530000000000001,"15min":1.8340000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.41399999999999998,"5min":0.36099999999999999,"15min":0.35299999999999998},"max":{"1min":0.69299999999999995,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.63300000000000001}]},{"osd":7,"last update":"Tue Oct 24 00:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35399999999999998},"max":{"1min":0.69799999999999995,"5min":0.872,"15min":3.2610000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.60999999999999999,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302348,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069492,"statfs":{"total":96636764160,"available":96327159808,"internally_reserved":0,"allocated":1183744,"data_stored":584242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.57999999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41799999999999998,"15min":0.40999999999999998},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.26600000000000001},"max":{"1min":0.53000000000000003,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.378}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42499999999999999,"15min":0.39000000000000001},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65000000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55600000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.312}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26400000000000001},"max":{"1min":0.66600000000000004,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.372},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.61599999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.38900000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.143,"15min":1.1859999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":1.964},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60599999999999998,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39800000000000002,"15min":0.36499999999999999},"max":{"1min":0.77500000000000002,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.57599999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.61299999999999999},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.88200000000000001,"15min":1.121},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80600000000000005,"5min":1.109,"15min":1.5800000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":1.6919999999999999},"last":0.52700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":1167360,"data_stored":583168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.27900000000000003,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56399999999999995,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.42399999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.308,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.68600000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":0.58299999999999996,"15min":0.63100000000000001},"last":0.312}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.628},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.622,"5min":0.65700000000000003,"15min":0.82199999999999995},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.78300000000000003,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.504},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.91200000000000003,"15min":0.93700000000000006},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78400000000000003,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.45900000000000002,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.434}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":584704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35499999999999998,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.50900000000000001,"5min":0.54900000000000004,"15min":0.57199999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.62},"last":0.40300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.377},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.20699999999999999},"max":{"1min":0.63,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.54100000000000004,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.433},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25900000000000001},"max":{"1min":0.60799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.41399999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53100000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58999999999999997,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.43099999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.876,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.34399999999999997},"max":{"1min":0.89400000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.33900000000000002},"max":{"1min":0.75900000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.70599999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.38500000000000001,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.50900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":1.083,"15min":1.083},"last":0.497},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.48999999999999999,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":0.999},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302332,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069508,"statfs":{"total":96636764160,"available":96327176192,"internally_reserved":0,"allocated":1167360,"data_stored":583168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53200000000000003,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.29399999999999998,"5min":0.219,"15min":0.219},"max":{"1min":0.58099999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.374}]},{"osd":1,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.38,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51600000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.33400000000000002,"5min":0.28799999999999998,"15min":0.25600000000000001},"max":{"1min":0.59899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57699999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.34699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.30499999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72399999999999998,"5min":0.87,"15min":1.024},"last":0.748},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.995},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:44:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":1.018},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.42699999999999999},"max":{"1min":0.80600000000000005,"5min":0.84899999999999998,"15min":1.042},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.51500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82399999999999995,"5min":1.514,"15min":1.514},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.121},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":1179648,"data_stored":583846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.42799999999999999,"5min":0.30599999999999999,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.46100000000000002,"5min":0.33300000000000002,"15min":0.27900000000000003},"max":{"1min":0.72599999999999998,"5min":0.755,"15min":0.77700000000000002},"last":0.318}]},{"osd":1,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.30299999999999999,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.434},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.30399999999999999},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.378}]},{"osd":2,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.45800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69299999999999995,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73999999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.72299999999999998,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.42699999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.44400000000000001,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.57299999999999995,"5min":0.70899999999999996,"15min":0.72099999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.751},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":0.68600000000000005,"15min":0.76200000000000001},"last":0.47499999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68799999999999994,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51100000000000001,"15min":0.53800000000000003},"min":{"1min":0.33800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67500000000000004,"5min":0.78200000000000003,"15min":0.78300000000000003},"last":0.49199999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542339,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302336,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069504,"statfs":{"total":96636764160,"available":96327172096,"internally_reserved":0,"allocated":1171456,"data_stored":583202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.26800000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.77400000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.44600000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.76900000000000002,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.435},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77000000000000002},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74299999999999999,"5min":0.77600000000000002,"15min":0.94199999999999995},"last":0.501},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.36399999999999999,"15min":0.35399999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":1.339},"last":0.57299999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.29799999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.313,"15min":0.313},"max":{"1min":0.66100000000000003,"5min":0.745,"15min":0.81999999999999995},"last":0.65000000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51900000000000002,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70099999999999996,"5min":0.78800000000000003,"15min":1.421},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.77800000000000002,"15min":1.772},"last":0.60799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:01.032 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:45:01.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.183+0000 7f3694c4b700 1 Processor -- start 2023-10-24T00:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 -- start start 2023-10-24T00:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36900a9e60 0x7f36900c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36900c6fb0 0x7f36900a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900aa3e0 con 0x7f36901574f0 2023-10-24T00:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900c5700 con 0x7f36900a9e60 2023-10-24T00:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.184+0000 7f3694c4b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900aa680 con 0x7f36900c6fb0 2023-10-24T00:45:01.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36900a9e60 0x7f36900c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36900a9e60 0x7f36900c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36862/0 (socket says 172.21.15.148:36862) 2023-10-24T00:45:01.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 -- 172.21.15.148:0/3725942139 learned_addr learned my addr 172.21.15.148:0/3725942139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:01.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368ffff700 1 --2- 172.21.15.148:0/3725942139 >> v2:172.21.15.150:3300/0 conn(0x7f36900c6fb0 0x7f36900a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 -- 172.21.15.148:0/3725942139 >> v2:172.21.15.150:3300/0 conn(0x7f36900c6fb0 msgr2=0x7f36900a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:01.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 --2- 172.21.15.148:0/3725942139 >> v2:172.21.15.150:3300/0 conn(0x7f36900c6fb0 0x7f36900a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 -- 172.21.15.148:0/3725942139 >> v1:172.21.15.150:6789/0 conn(0x7f36901574f0 legacy=0x7f36900c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:01.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 -- 172.21.15.148:0/3725942139 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900c62c0 con 0x7f36900a9e60 2023-10-24T00:45:01.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368effd700 1 --2- 172.21.15.148:0/3725942139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900a9e60 0x7f36900c6ac0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f3690062e20 tx=0x7f36800090f0).ready entity=mon.0 client_cookie=ce59be3e124e1c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368e7fc700 1 -- 172.21.15.148:0/3725942139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000b5a0 con 0x7f36900a9e60 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368e7fc700 1 -- 172.21.15.148:0/3725942139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000b700 con 0x7f36900a9e60 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.185+0000 7f368e7fc700 1 -- 172.21.15.148:0/3725942139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000ba80 con 0x7f36900a9e60 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 -- 172.21.15.148:0/3725942139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900a9e60 msgr2=0x7f36900c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 --2- 172.21.15.148:0/3725942139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900a9e60 0x7f36900c6ac0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f3690062e20 tx=0x7f36800090f0).stop 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 -- 172.21.15.148:0/3725942139 shutdown_connections 2023-10-24T00:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 --2- 172.21.15.148:0/3725942139 >> v2:172.21.15.150:3300/0 conn(0x7f36900c6fb0 0x7f36900a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 --2- 172.21.15.148:0/3725942139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900a9e60 0x7f36900c6ac0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 -- 172.21.15.148:0/3725942139 >> 172.21.15.148:0/3725942139 conn(0x7f3690094500 msgr2=0x7f369006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 -- 172.21.15.148:0/3725942139 shutdown_connections 2023-10-24T00:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.186+0000 7f3694c4b700 1 -- 172.21.15.148:0/3725942139 wait complete. 2023-10-24T00:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.187+0000 7f3694c4b700 1 Processor -- start 2023-10-24T00:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.187+0000 7f3694c4b700 1 -- start start 2023-10-24T00:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36900a9e60 0x7f369014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36901574f0 0x7f36900c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900aed00 con 0x7f36900c6fb0 2023-10-24T00:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900ca900 con 0x7f36901574f0 2023-10-24T00:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900cabe0 con 0x7f36900a9e60 2023-10-24T00:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36876/0 (socket says 172.21.15.148:36876) 2023-10-24T00:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 -- 172.21.15.148:0/707512388 learned_addr learned my addr 172.21.15.148:0/707512388 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368f7fe700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36900a9e60 0x7f369014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 -- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36900a9e60 msgr2=0x7f369014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36900a9e60 0x7f369014fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368ffff700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36901574f0 0x7f36900c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 -- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36901574f0 msgr2=0x7f36900c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36901574f0 0x7f36900c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 -- 172.21.15.148:0/707512388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009370 con 0x7f36900c6fb0 2023-10-24T00:45:01.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f368effd700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3680009130 tx=0x7f3680015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000b870 con 0x7f36900c6fb0 2023-10-24T00:45:01.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000b9d0 con 0x7f36900c6fb0 2023-10-24T00:45:01.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900caec0 con 0x7f36900c6fb0 2023-10-24T00:45:01.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368001c670 con 0x7f36900c6fb0 2023-10-24T00:45:01.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.188+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690150140 con 0x7f36900c6fb0 2023-10-24T00:45:01.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.189+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900614e0 con 0x7f36900c6fb0 2023-10-24T00:45:01.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.190+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f368001c9e0 con 0x7f36900c6fb0 2023-10-24T00:45:01.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.190+0000 7f36777fe700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 0x7f367c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.190+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f368007bbb0 con 0x7f36900c6fb0 2023-10-24T00:45:01.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.190+0000 7f368f7fe700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 0x7f367c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.191+0000 7f368f7fe700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 0x7f367c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f368400a730 tx=0x7f3684008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.194+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36900614e0 con 0x7f36900c6fb0 2023-10-24T00:45:01.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.425+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f36900614e0 con 0x7f36900c6fb0 2023-10-24T00:45:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.429+0000 7f36777fe700 1 -- 172.21.15.148:0/707512388 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f36900614e0 con 0x7f36900c6fb0 2023-10-24T00:45:01.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 msgr2=0x7f367c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 0x7f367c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f368400a730 tx=0x7f3684008040).stop 2023-10-24T00:45:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 msgr2=0x7f36900c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f3680009130 tx=0x7f3680015000).stop 2023-10-24T00:45:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 shutdown_connections 2023-10-24T00:45:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36901574f0 0x7f36900c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36900a9e60 0x7f369014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f367c05f270 0x7f367c061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 --2- 172.21.15.148:0/707512388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36900c6fb0 0x7f36900c9f90 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 >> 172.21.15.148:0/707512388 conn(0x7f3690094500 msgr2=0x7f3690150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 shutdown_connections 2023-10-24T00:45:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.431+0000 7f3694c4b700 1 -- 172.21.15.148:0/707512388 wait complete. 2023-10-24T00:45:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:45:01.444 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:01.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.558+0000 7f7c79ffb700 1 Processor -- start 2023-10-24T00:45:01.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.558+0000 7f7c79ffb700 1 -- start start 2023-10-24T00:45:01.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c79ffb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7c74069f70 0x7f7c74154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c79ffb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740693d0 con 0x7f7c74150740 2023-10-24T00:45:01.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c79ffb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c74064bc0 con 0x7f7c741543a0 2023-10-24T00:45:01.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c79ffb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c74154cf0 con 0x7f7c74069f70 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c73fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7c74069f70 0x7f7c74154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c737fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7c74150740 0x7f7c740644b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43400/0 (socket says 172.21.15.148:43400) 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c737fe700 1 -- 172.21.15.148:0/2005999458 learned_addr learned my addr 172.21.15.148:0/2005999458 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c73fff700 1 -- 172.21.15.148:0/2005999458 >> v1:172.21.15.150:6789/0 conn(0x7f7c741543a0 legacy=0x7f7c74069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c73fff700 1 -- 172.21.15.148:0/2005999458 >> v1:172.21.15.148:6789/0 conn(0x7f7c74150740 legacy=0x7f7c740644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c727fc700 1 -- 172.21.15.148:0/2005999458 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316649762 0 0) 0x7f7c740693d0 con 0x7f7c74150740 2023-10-24T00:45:01.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c73fff700 1 -- 172.21.15.148:0/2005999458 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740c6760 con 0x7f7c74069f70 2023-10-24T00:45:01.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c73fff700 1 --2- 172.21.15.148:0/2005999458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c74154800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f7c6c009e60 tx=0x7f7c6c009780).ready entity=mon.0 client_cookie=70ca2e179009153b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c727fc700 1 -- 172.21.15.148:0/2005999458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00e070 con 0x7f7c74069f70 2023-10-24T00:45:01.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c727fc700 1 -- 172.21.15.148:0/2005999458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00bcc0 con 0x7f7c74069f70 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.559+0000 7f7c727fc700 1 -- 172.21.15.148:0/2005999458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c012620 con 0x7f7c74069f70 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2005999458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 msgr2=0x7f7c74154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2005999458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c74154800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f7c6c009e60 tx=0x7f7c6c009780).stop 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2005999458 shutdown_connections 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2005999458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c74154800 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2005999458 >> 172.21.15.148:0/2005999458 conn(0x7f7c74063120 msgr2=0x7f7c740c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:01.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2005999458 shutdown_connections 2023-10-24T00:45:01.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.560+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2005999458 wait complete. 2023-10-24T00:45:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.561+0000 7f7c79ffb700 1 Processor -- start 2023-10-24T00:45:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.561+0000 7f7c79ffb700 1 -- start start 2023-10-24T00:45:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c74150740 0x7f7c7415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c741543a0 0x7f7c740bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74160000 con 0x7f7c74069f70 2023-10-24T00:45:01.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740a79f0 con 0x7f7c74150740 2023-10-24T00:45:01.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740a7cd0 con 0x7f7c741543a0 2023-10-24T00:45:01.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36882/0 (socket says 172.21.15.148:36882) 2023-10-24T00:45:01.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 -- 172.21.15.148:0/2210934717 learned_addr learned my addr 172.21.15.148:0/2210934717 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:01.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c72ffd700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c74150740 0x7f7c7415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c73fff700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c741543a0 0x7f7c740bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 -- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c741543a0 msgr2=0x7f7c740bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c741543a0 0x7f7c740bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 -- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c74150740 msgr2=0x7f7c7415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c74150740 0x7f7c7415fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 -- 172.21.15.148:0/2210934717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009a20 con 0x7f7c74069f70 2023-10-24T00:45:01.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c737fe700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f7c6400c4e0 tx=0x7f7c64007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640072e0 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64007440 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c740a7fb0 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640057a0 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.562+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c740a8570 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.563+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7406c6b0 con 0x7f7c74069f70 2023-10-24T00:45:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.564+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7c64005bd0 con 0x7f7c74069f70 2023-10-24T00:45:01.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.564+0000 7f7c5b7fe700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 0x7f7c60061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:01.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.564+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c64079cc0 con 0x7f7c74069f70 2023-10-24T00:45:01.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.564+0000 7f7c72ffd700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 0x7f7c60061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:01.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.565+0000 7f7c72ffd700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 0x7f7c60061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7c740c43f0 tx=0x7f7c68008040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:01.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.568+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7c6404ae10 con 0x7f7c74069f70 2023-10-24T00:45:01.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.771+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c740c4d70 con 0x7f7c74069f70 2023-10-24T00:45:01.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.772+0000 7f7c5b7fe700 1 -- 172.21.15.148:0/2210934717 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f7c64018030 con 0x7f7c74069f70 2023-10-24T00:45:01.774 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:01.774 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:45:01.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 msgr2=0x7f7c60061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 0x7f7c60061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7c740c43f0 tx=0x7f7c68008040).stop 2023-10-24T00:45:01.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 msgr2=0x7f7c740ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:01.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f7c6400c4e0 tx=0x7f7c64007c70).stop 2023-10-24T00:45:01.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 shutdown_connections 2023-10-24T00:45:01.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7c741543a0 0x7f7c740bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7c6005f270 0x7f7c60061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7c74069f70 0x7f7c740ab600 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 --2- 172.21.15.148:0/2210934717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c74150740 0x7f7c7415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:01.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 >> 172.21.15.148:0/2210934717 conn(0x7f7c74063120 msgr2=0x7f7c740656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:01.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 shutdown_connections 2023-10-24T00:45:01.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:01.774+0000 7f7c79ffb700 1 -- 172.21.15.148:0/2210934717 wait complete. 2023-10-24T00:45:01.778 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:45:02.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:44:53.214771+0000', 'modified': '2023-10-24T00:44:55.221062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6732}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6732': {'gid': 6732, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/193862178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 193862178}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 193862178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:45:02.191 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:45:02.191 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-24T00:45:02.292 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:45:02.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:45:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.307+0000 7ff3b2b19700 1 Processor -- start 2023-10-24T00:45:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.307+0000 7ff3b2b19700 1 -- start start 2023-10-24T00:45:02.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b2b19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0bf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b2b19700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 0x7ff3ac0a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b2b19700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0be590 con 0x7ff3ac0c4180 2023-10-24T00:45:02.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b2b19700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac0bf3d0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b2b19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a87e0 con 0x7ff3ac152270 2023-10-24T00:45:02.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b10b6700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff3ac0c4180 0x7ff3ac0a5c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43414/0 (socket says 172.21.15.148:43414) 2023-10-24T00:45:02.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b10b6700 1 -- 172.21.15.148:0/869921490 learned_addr learned my addr 172.21.15.148:0/869921490 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/869921490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3abfff700 1 --2- 172.21.15.148:0/869921490 >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 0x7ff3ac0a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3ab7fe700 1 -- 172.21.15.148:0/869921490 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221700590 0 0) 0x7ff3ac0be590 con 0x7ff3ac0c4180 2023-10-24T00:45:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3ab7fe700 1 -- 172.21.15.148:0/869921490 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff39c0033f0 con 0x7ff3ac0c4180 2023-10-24T00:45:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b08b5700 1 -- 172.21.15.148:0/869921490 >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 msgr2=0x7ff3ac0a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/869921490 >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 0x7ff3ac0a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b08b5700 1 -- 172.21.15.148:0/869921490 >> v1:172.21.15.148:6789/0 conn(0x7ff3ac0c4180 legacy=0x7ff3ac0a5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3b08b5700 1 -- 172.21.15.148:0/869921490 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0be7c0 con 0x7ff3ac152270 2023-10-24T00:45:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.308+0000 7ff3abfff700 1 --2- 172.21.15.148:0/869921490 >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 0x7ff3ac0a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/869921490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0bf860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff3a0006fd0 tx=0x7ff3a0006f40).ready entity=mon.2 client_cookie=1b4eed71c852569e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3ab7fe700 1 -- 172.21.15.148:0/869921490 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0005880 con 0x7ff3ac152270 2023-10-24T00:45:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3ab7fe700 1 -- 172.21.15.148:0/869921490 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a00059e0 con 0x7ff3ac152270 2023-10-24T00:45:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3ab7fe700 1 -- 172.21.15.148:0/869921490 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0005d60 con 0x7ff3ac152270 2023-10-24T00:45:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3b2b19700 1 -- 172.21.15.148:0/869921490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 msgr2=0x7ff3ac0bf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.309+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/869921490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0bf860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff3a0006fd0 tx=0x7ff3a0006f40).stop 2023-10-24T00:45:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 -- 172.21.15.148:0/869921490 shutdown_connections 2023-10-24T00:45:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/869921490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0bf860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/869921490 >> v2:172.21.15.150:3300/0 conn(0x7ff3ac0a7e70 0x7ff3ac0a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 -- 172.21.15.148:0/869921490 >> 172.21.15.148:0/869921490 conn(0x7ff3ac092510 msgr2=0x7ff3ac062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 -- 172.21.15.148:0/869921490 shutdown_connections 2023-10-24T00:45:02.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.310+0000 7ff3b2b19700 1 -- 172.21.15.148:0/869921490 wait complete. 2023-10-24T00:45:02.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.311+0000 7ff3b2b19700 1 Processor -- start 2023-10-24T00:45:02.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.311+0000 7ff3b2b19700 1 -- start start 2023-10-24T00:45:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.312+0000 7ff3b2b19700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.312+0000 7ff3b2b19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3ac0c4180 0x7ff3ac0a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.312+0000 7ff3b2b19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b2b19700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a9600 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b2b19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac14d440 con 0x7ff3ac0c4180 2023-10-24T00:45:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b2b19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a89f0 con 0x7ff3ac152270 2023-10-24T00:45:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36896/0 (socket says 172.21.15.148:36896) 2023-10-24T00:45:02.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 -- 172.21.15.148:0/3154690866 learned_addr learned my addr 172.21.15.148:0/3154690866 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3ac0c4180 0x7ff3ac0a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 -- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 msgr2=0x7ff3ac0a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 -- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3ac0c4180 msgr2=0x7ff3ac0a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3ac0c4180 0x7ff3ac0a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 -- 172.21.15.148:0/3154690866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980092a0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff3ac06ab00 tx=0x7ff3a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3a8ff9700 1 -- 172.21.15.148:0/3154690866 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0006bf0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3a8ff9700 1 -- 172.21.15.148:0/3154690866 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a000d6b0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0009250 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3a8ff9700 1 -- 172.21.15.148:0/3154690866 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000da50 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.313+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac0a8fb0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.315+0000 7ff3a8ff9700 1 -- 172.21.15.148:0/3154690866 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff3a00113f0 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.315+0000 7ff3a8ff9700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 0x7ff390061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.315+0000 7ff3a8ff9700 1 -- 172.21.15.148:0/3154690866 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff3a007b800 con 0x7ff3ac0a7e70 2023-10-24T00:45:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.316+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 0x7ff390061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.316+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 0x7ff390061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff3ac068e00 tx=0x7ff398009060).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.317+0000 7ff3c44b1b80 1 Processor -- start 2023-10-24T00:45:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.317+0000 7ff3c44b1b80 1 -- start start 2023-10-24T00:45:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b2f30 0x5571fa8fc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8dac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa8291b0 con 0x5571fa8b52b0 2023-10-24T00:45:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa7eecb0 con 0x5571fa8b2f30 2023-10-24T00:45:02.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fa803c90 con 0x5571fa8b3310 2023-10-24T00:45:02.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36908/0 (socket says 172.21.15.148:36908) 2023-10-24T00:45:02.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3abfff700 1 -- 172.21.15.148:0/4116894200 learned_addr learned my addr 172.21.15.148:0/4116894200 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8dac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.318+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b2f30 0x5571fa8fc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 -- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 msgr2=0x5571fa8dac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8dac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 -- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b2f30 msgr2=0x5571fa8fc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b2f30 0x5571fa8fc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 -- 172.21.15.148:0/4116894200 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fa7fce70 con 0x5571fa8b52b0 2023-10-24T00:45:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3abfff700 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7ff398011de0 tx=0x7ff398016000).ready entity=mon.0 client_cookie=8d99a4450d7b27bc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff395ffb700 1 -- 172.21.15.148:0/4116894200 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398011ee0 con 0x5571fa8b52b0 2023-10-24T00:45:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff395ffb700 1 -- 172.21.15.148:0/4116894200 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398014dc0 con 0x5571fa8b52b0 2023-10-24T00:45:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff395ffb700 1 -- 172.21.15.148:0/4116894200 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39801f650 con 0x5571fa8b52b0 2023-10-24T00:45:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/4116894200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 msgr2=0x5571fa8b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.319+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7ff398011de0 tx=0x7ff398016000).stop 2023-10-24T00:45:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/4116894200 shutdown_connections 2023-10-24T00:45:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8dac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b2f30 0x5571fa8fc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/4116894200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa8b48f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/4116894200 >> 172.21.15.148:0/4116894200 conn(0x5571fa66ee40 msgr2=0x5571fa8fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/4116894200 shutdown_connections 2023-10-24T00:45:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/4116894200 wait complete. 2023-10-24T00:45:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 -- start start 2023-10-24T00:45:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.320+0000 7ff3c44b1b80 1 Processor -- start 2023-10-24T00:45:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8f5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa803dd0 con 0x5571fa8b2f30 2023-10-24T00:45:02.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa804050 con 0x5571fa8b52b0 2023-10-24T00:45:02.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fa7cf8d0 con 0x5571fa8b3310 2023-10-24T00:45:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3c44b1b80 10 client.0 ll_register_callbacks cb 0x5571fa872030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:45:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3b08b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3b08b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36922/0 (socket says 172.21.15.148:36922) 2023-10-24T00:45:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3b08b5700 1 -- 172.21.15.148:0/115708056 learned_addr learned my addr 172.21.15.148:0/115708056 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.321+0000 7ff3abfff700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 -- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 msgr2=0x5571fa8f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 -- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 msgr2=0x5571fa8e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 -- 172.21.15.148:0/115708056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff398011ad0 con 0x5571fa8b2f30 2023-10-24T00:45:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ff3a0009d20 tx=0x7ff3a0052040).ready entity=mon.0 client_cookie=728f0cbb50df5e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:45:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0055040 con 0x5571fa8b2f30 2023-10-24T00:45:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff3a004fb90 con 0x5571fa8b2f30 2023-10-24T00:45:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571fa8a64e0 con 0x5571fa8b2f30 2023-10-24T00:45:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3a004eb10 con 0x5571fa8b2f30 2023-10-24T00:45:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 10 client.6921 fetch_fsmap learned FSMap version 31 2023-10-24T00:45:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5571fa7f8480 con 0x5571fa8b2f30 2023-10-24T00:45:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571fa8a64e0 con 0x5571fa8b2f30 2023-10-24T00:45:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3a004c490 con 0x5571fa8b2f30 2023-10-24T00:45:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 10 client.6921 fetch_fsmap finished waiting for FSMap version 31 2023-10-24T00:45:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 10 client.6921 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-24T00:45:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 20 client.6921 populate_metadata read hostname 'smithi148' 2023-10-24T00:45:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d8370 0x5571fa8d8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 4 client.6921 mds_command: new command op to 6732 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:45:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 --> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571fa87c4b0 con 0x5571fa8d8370 2023-10-24T00:45:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.322+0000 7ff3abfff700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d8370 0x5571fa8d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff38affd700 10 client.6921 ms_handle_connect on v2:172.21.15.148:6833/193862178 2023-10-24T00:45:02.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3abfff700 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d8370 0x5571fa8d8750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9532a6b98bf782b4 server_cookie=f81c136c9611f37f in_seq=0 out_seq=0 2023-10-24T00:45:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff38affd700 1 -- 172.21.15.148:0/115708056 <== mds.0 v2:172.21.15.148:6833/193862178 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5571fa87c4b0 con 0x5571fa8d8370 2023-10-24T00:45:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff38affd700 10 client.6921 handle_command_reply: tid=0 2023-10-24T00:45:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 client.6921 shutdown 2023-10-24T00:45:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 msgr2=0x5571fa8d75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ff3a0009d20 tx=0x7ff3a0052040).stop 2023-10-24T00:45:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 shutdown_connections 2023-10-24T00:45:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d8370 0x5571fa8d8750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.323+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b2f30 0x5571fa8d75b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff38affd700 0 client.6921 ms_handle_reset on v2:172.21.15.148:6833/193862178 2023-10-24T00:45:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/115708056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b3310 0x5571fa8f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 >> 172.21.15.148:0/115708056 conn(0x5571fa66ee40 msgr2=0x5571fa8d7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 shutdown_connections 2023-10-24T00:45:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/115708056 wait complete. 2023-10-24T00:45:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.324+0000 7ff3c44b1b80 20 client.6921 trim_cache size 0 max 16384 2023-10-24T00:45:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.340+0000 7ff3c44b1b80 1 Processor -- start 2023-10-24T00:45:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.340+0000 7ff3c44b1b80 1 -- start start 2023-10-24T00:45:02.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa8dd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8d9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa8b0320 con 0x5571fa8b3310 2023-10-24T00:45:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa8b4080 con 0x5571fa8b52b0 2023-10-24T00:45:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fa8ad1f0 con 0x5571fa8b2f30 2023-10-24T00:45:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36938/0 (socket says 172.21.15.148:36938) 2023-10-24T00:45:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 -- 172.21.15.148:0/3056363808 learned_addr learned my addr 172.21.15.148:0/3056363808 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 -- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 msgr2=0x5571fa8dd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa8dd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 -- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 msgr2=0x5571fa8d9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 -- 172.21.15.148:0/3056363808 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fa7f81d0 con 0x5571fa8b3310 2023-10-24T00:45:02.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3abfff700 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff398009650 tx=0x7ff398033280).ready entity=mon.0 client_cookie=da7814ca995d5444 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3967fc700 1 -- 172.21.15.148:0/3056363808 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398032070 con 0x5571fa8b3310 2023-10-24T00:45:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3967fc700 1 -- 172.21.15.148:0/3056363808 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398011eb0 con 0x5571fa8b3310 2023-10-24T00:45:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.341+0000 7ff3967fc700 1 -- 172.21.15.148:0/3056363808 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39801f400 con 0x5571fa8b3310 2023-10-24T00:45:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/3056363808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 msgr2=0x5571fa8f7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff398009650 tx=0x7ff398033280).stop 2023-10-24T00:45:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/3056363808 shutdown_connections 2023-10-24T00:45:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b52b0 0x5571fa8d9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa8dd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/3056363808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b3310 0x5571fa8f7eb0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/3056363808 >> 172.21.15.148:0/3056363808 conn(0x5571fa66ee40 msgr2=0x5571fa8e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/3056363808 shutdown_connections 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/3056363808 wait complete. 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.342+0000 7ff3c44b1b80 1 -- start start 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 Processor -- start 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa962060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b3310 0x5571fa964b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa961c40 con 0x5571fa8b52b0 2023-10-24T00:45:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fa8df720 con 0x5571fa8b3310 2023-10-24T00:45:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571fa90ade0 con 0x5571fa8b2f30 2023-10-24T00:45:02.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.343+0000 7ff3c44b1b80 10 client.0 ll_register_callbacks cb 0x5571fa872030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:45:02.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36950/0 (socket says 172.21.15.148:36950) 2023-10-24T00:45:02.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 -- 172.21.15.148:0/2830585661 learned_addr learned my addr 172.21.15.148:0/2830585661 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3abfff700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b3310 0x5571fa964b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa962060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 -- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 msgr2=0x5571fa962060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa962060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 -- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b3310 msgr2=0x5571fa964b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b3310 0x5571fa964b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 -- 172.21.15.148:0/2830585661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571fa7fce70 con 0x5571fa8b52b0 2023-10-24T00:45:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3b10b6700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7ff3a4005ad0 tx=0x7ff3a4009040).ready entity=mon.0 client_cookie=536b57b30ae94ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:45:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4005b00 con 0x5571fa8b52b0 2023-10-24T00:45:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff3a4005c60 con 0x5571fa8b52b0 2023-10-24T00:45:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff398014dc0 con 0x5571fa8b52b0 2023-10-24T00:45:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3a4005e20 con 0x5571fa8b52b0 2023-10-24T00:45:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 10 client.6927 fetch_fsmap learned FSMap version 31 2023-10-24T00:45:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x5571fa66ff80 con 0x5571fa8b52b0 2023-10-24T00:45:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398014dc0 con 0x5571fa8b52b0 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3a4012030 con 0x5571fa8b52b0 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 10 client.6927 fetch_fsmap finished waiting for FSMap version 31 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 10 client.6927 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 20 client.6927 populate_metadata read hostname 'smithi148' 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d96b0 0x5571fa8f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 4 client.6927 mds_command: new command op to 6732 tid=0[{"prefix": "status"}] 2023-10-24T00:45:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.344+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 --> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5571fa66aca0 con 0x5571fa8d96b0 2023-10-24T00:45:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d96b0 0x5571fa8f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff38affd700 10 client.6927 ms_handle_connect on v2:172.21.15.148:6833/193862178 2023-10-24T00:45:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3b08b5700 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d96b0 0x5571fa8f6aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6a3321d05d172cf3 server_cookie=ced429605a83bc0a in_seq=0 out_seq=0 2023-10-24T00:45:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff38affd700 1 -- 172.21.15.148:0/2830585661 <== mds.0 v2:172.21.15.148:6833/193862178 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5571fa66aca0 con 0x5571fa8d96b0 2023-10-24T00:45:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff38affd700 10 client.6927 handle_command_reply: tid=0 2023-10-24T00:45:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 client.6927 shutdown 2023-10-24T00:45:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 msgr2=0x5571fa965060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7ff3a4005ad0 tx=0x7ff3a4009040).stop 2023-10-24T00:45:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 shutdown_connections 2023-10-24T00:45:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:6833/193862178,v1:172.21.15.148:6835/193862178] conn(0x5571fa8d96b0 0x5571fa8f6aa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5571fa8b52b0 0x5571fa965060 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff38affd700 0 client.6927 ms_handle_reset on v2:172.21.15.148:6833/193862178 2023-10-24T00:45:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5571fa8b2f30 0x5571fa962060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 --2- 172.21.15.148:0/2830585661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5571fa8b3310 0x5571fa964b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 >> 172.21.15.148:0/2830585661 conn(0x5571fa66ee40 msgr2=0x5571fa8e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 shutdown_connections 2023-10-24T00:45:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 1 -- 172.21.15.148:0/2830585661 wait complete. 2023-10-24T00:45:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.345+0000 7ff3c44b1b80 20 client.6927 trim_cache size 0 max 16384 2023-10-24T00:45:02.369 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:45:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:45:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:45:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 6732, 2023-10-24T00:45:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:45:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:45:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:45:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.1293469629999997, 2023-10-24T00:45:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 31, 2023-10-24T00:45:02.371 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 96, 2023-10-24T00:45:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 96, 2023-10-24T00:45:02.372 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 14.060620524999999 2023-10-24T00:45:02.372 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:45:02.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 msgr2=0x7ff390061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 0x7ff390061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff3ac068e00 tx=0x7ff398009060).stop 2023-10-24T00:45:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 msgr2=0x7ff3ac14cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ff3ac06ab00 tx=0x7ff3a0015000).stop 2023-10-24T00:45:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 shutdown_connections 2023-10-24T00:45:02.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3ac152270 0x7ff3ac0a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff39005f270 0x7ff390061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3ac0a7e70 0x7ff3ac14cf50 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 --2- 172.21.15.148:0/3154690866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3ac0c4180 0x7ff3ac0a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 >> 172.21.15.148:0/3154690866 conn(0x7ff3ac092510 msgr2=0x7ff3ac0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 shutdown_connections 2023-10-24T00:45:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.346+0000 7ff3b2b19700 1 -- 172.21.15.148:0/3154690866 wait complete. 2023-10-24T00:45:02.376 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:45:02.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.532+0000 7f0de35a9700 1 Processor -- start 2023-10-24T00:45:02.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.532+0000 7f0de35a9700 1 -- start start 2023-10-24T00:45:02.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ddc1575e0 0x7f0ddc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0ddc1579c0 0x7f0ddc0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc0aaae0 0x7f0ddc0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cae10 con 0x7f0ddc1575e0 2023-10-24T00:45:02.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c94c0 con 0x7f0ddc1579c0 2023-10-24T00:45:02.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de35a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ae140 con 0x7f0ddc0aaae0 2023-10-24T00:45:02.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de1345700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ddc1575e0 0x7f0ddc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de1345700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0ddc1575e0 0x7f0ddc0ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36960/0 (socket says 172.21.15.148:36960) 2023-10-24T00:45:02.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.533+0000 7f0de1345700 1 -- 172.21.15.148:0/2411231249 learned_addr learned my addr 172.21.15.148:0/2411231249 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 -- 172.21.15.148:0/2411231249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc0aaae0 msgr2=0x7f0ddc0aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 --2- 172.21.15.148:0/2411231249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc0aaae0 0x7f0ddc0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 -- 172.21.15.148:0/2411231249 >> v2:172.21.15.150:3300/0 conn(0x7f0ddc1579c0 msgr2=0x7f0ddc0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:02.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 --2- 172.21.15.148:0/2411231249 >> v2:172.21.15.150:3300/0 conn(0x7f0ddc1579c0 0x7f0ddc0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 -- 172.21.15.148:0/2411231249 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0ae6c0 con 0x7f0ddc1575e0 2023-10-24T00:45:02.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de1345700 1 --2- 172.21.15.148:0/2411231249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0ca920 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f0ddc0abae0 tx=0x7f0dd8009060).ready entity=mon.0 client_cookie=f28e93f192ef233f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0dd3fff700 1 -- 172.21.15.148:0/2411231249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8005880 con 0x7f0ddc1575e0 2023-10-24T00:45:02.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0dd3fff700 1 -- 172.21.15.148:0/2411231249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80059e0 con 0x7f0ddc1575e0 2023-10-24T00:45:02.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0dd3fff700 1 -- 172.21.15.148:0/2411231249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8005d60 con 0x7f0ddc1575e0 2023-10-24T00:45:02.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 -- 172.21.15.148:0/2411231249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 msgr2=0x7f0ddc0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 --2- 172.21.15.148:0/2411231249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0ca920 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f0ddc0abae0 tx=0x7f0dd8009060).stop 2023-10-24T00:45:02.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 -- 172.21.15.148:0/2411231249 shutdown_connections 2023-10-24T00:45:02.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 --2- 172.21.15.148:0/2411231249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0ca920 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 --2- 172.21.15.148:0/2411231249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc0aaae0 0x7f0ddc0aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 --2- 172.21.15.148:0/2411231249 >> v2:172.21.15.150:3300/0 conn(0x7f0ddc1579c0 0x7f0ddc0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:02.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.534+0000 7f0de35a9700 1 -- 172.21.15.148:0/2411231249 >> 172.21.15.148:0/2411231249 conn(0x7f0ddc094520 msgr2=0x7f0ddc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.535+0000 7f0de35a9700 1 -- 172.21.15.148:0/2411231249 shutdown_connections 2023-10-24T00:45:02.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.535+0000 7f0de35a9700 1 -- 172.21.15.148:0/2411231249 wait complete. 2023-10-24T00:45:02.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.536+0000 7f0de35a9700 1 Processor -- start 2023-10-24T00:45:02.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.536+0000 7f0de35a9700 1 -- start start 2023-10-24T00:45:02.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 0x7f0ddc155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 0x7f0ddc0a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc096970 con 0x7f0ddc1575e0 2023-10-24T00:45:02.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc095d60 con 0x7f0ddc0aaae0 2023-10-24T00:45:02.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc096040 con 0x7f0ddc1579c0 2023-10-24T00:45:02.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36964/0 (socket says 172.21.15.148:36964) 2023-10-24T00:45:02.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 -- 172.21.15.148:0/23293391 learned_addr learned my addr 172.21.15.148:0/23293391 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:02.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de1345700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 0x7f0ddc155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de1b46700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 0x7f0ddc0a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 -- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 msgr2=0x7f0ddc0a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 0x7f0ddc0a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 -- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 msgr2=0x7f0ddc155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 0x7f0ddc155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 -- 172.21.15.148:0/23293391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8009300 con 0x7f0ddc1575e0 2023-10-24T00:45:02.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de1345700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 0x7f0ddc155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:02.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de1b46700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 0x7f0ddc0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:02.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de0b44700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f0dcc00b490 tx=0x7f0dcc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc012410 con 0x7f0ddc1575e0 2023-10-24T00:45:02.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0125b0 con 0x7f0ddc1575e0 2023-10-24T00:45:02.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc096320 con 0x7f0ddc1575e0 2023-10-24T00:45:02.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc012970 con 0x7f0ddc1575e0 2023-10-24T00:45:02.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.537+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc156100 con 0x7f0ddc1575e0 2023-10-24T00:45:02.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.538+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc047480 con 0x7f0ddc1575e0 2023-10-24T00:45:02.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.538+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0dcc012d20 con 0x7f0ddc1575e0 2023-10-24T00:45:02.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.539+0000 7f0dd17fa700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 0x7f0dc0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:02.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.539+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0dcc07a140 con 0x7f0ddc1575e0 2023-10-24T00:45:02.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.539+0000 7f0de1345700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 0x7f0dc0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:02.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.539+0000 7f0de1345700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 0x7f0dc0061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0dd8005fd0 tx=0x7f0dd8016000).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:02.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.543+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0dcc04b290 con 0x7f0ddc1575e0 2023-10-24T00:45:02.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.749+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ddc064f70 con 0x7f0ddc1575e0 2023-10-24T00:45:02.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.749+0000 7f0dd17fa700 1 -- 172.21.15.148:0/23293391 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0dcc04e8b0 con 0x7f0ddc1575e0 2023-10-24T00:45:02.751 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:45:02.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 msgr2=0x7f0dc0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 0x7f0dc0061730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f0dd8005fd0 tx=0x7f0dd8016000).stop 2023-10-24T00:45:02.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 msgr2=0x7f0ddc0a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:02.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f0dcc00b490 tx=0x7f0dcc006ef0).stop 2023-10-24T00:45:02.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 shutdown_connections 2023-10-24T00:45:02.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ddc1579c0 0x7f0ddc0a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ddc0aaae0 0x7f0ddc155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0dc005f270 0x7f0dc0061730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 --2- 172.21.15.148:0/23293391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0ddc1575e0 0x7f0ddc0a5c20 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:02.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 >> 172.21.15.148:0/23293391 conn(0x7f0ddc094520 msgr2=0x7f0ddc0af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:02.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 shutdown_connections 2023-10-24T00:45:02.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:02.751+0000 7f0de35a9700 1 -- 172.21.15.148:0/23293391 wait complete. 2023-10-24T00:45:02.763 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:45:02.764 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:45:02.765 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:45:02.765 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:45:02.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:02.766 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:45:02.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:45:02.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:45:02.769 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:45:02.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:02.770 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:45:02.785 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:45:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:45:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:45:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.786 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:45:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.787 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:02.787 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:45:02.787 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:45:02.788 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:02.788 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:02.788 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:45:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:45:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41426sec preferred_lft 41426sec 2023-10-24T00:45:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:45:02.789 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.790 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:45:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:45:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.790 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:45:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.791 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:45:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:45:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:45:02.791 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.792 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:45:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:45:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:45:02.792 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:02.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:02.793 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:45:02.849 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:45:02.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:02.851 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:45:02.908 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:45:02.909 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:45:02.909 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:45:02.909 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:45:02.910 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:45:02.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:02.911 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:45:02.912 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:45:02.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:45:02.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:45:02.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:45:02.915 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:45:03.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:03.009 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:45:03.023 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:45:03.023 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:45:03.024 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:45:03.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:03.025 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:45:03.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:03.090 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:03.144 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:45:03.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:03.223 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:03.224 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:45:03.248 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:03.248 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:45:03.250 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:45:03.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:03.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:03.315 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:45:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.468+0000 7f2c2d36e700 1 Processor -- start 2023-10-24T00:45:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.468+0000 7f2c2d36e700 1 -- start start 2023-10-24T00:45:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c2d36e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c280c56c0 0x7f2c280be890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c2d36e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c280bed80 0x7f2c280c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c2d36e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806a960 con 0x7f2c280a8540 2023-10-24T00:45:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c2d36e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28065640 con 0x7f2c280bed80 2023-10-24T00:45:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c2d36e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280bf1f0 con 0x7f2c280c56c0 2023-10-24T00:45:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c277fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c280bed80 0x7f2c280c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c26ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2c280a8540 0x7f2c280641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36228/0 (socket says 172.21.15.148:36228) 2023-10-24T00:45:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c26ffd700 1 -- 172.21.15.148:0/2905116684 learned_addr learned my addr 172.21.15.148:0/2905116684 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:03.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.469+0000 7f2c1e7fc700 1 --2- 172.21.15.148:0/2905116684 >> v2:172.21.15.150:3300/0 conn(0x7f2c280c56c0 0x7f2c280be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c277fe700 1 -- 172.21.15.148:0/2905116684 >> v2:172.21.15.150:3300/0 conn(0x7f2c280c56c0 msgr2=0x7f2c280be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c277fe700 1 --2- 172.21.15.148:0/2905116684 >> v2:172.21.15.150:3300/0 conn(0x7f2c280c56c0 0x7f2c280be890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c277fe700 1 -- 172.21.15.148:0/2905116684 >> v1:172.21.15.148:6789/0 conn(0x7f2c280a8540 legacy=0x7f2c280641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c267fc700 1 -- 172.21.15.148:0/2905116684 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494848472 0 0) 0x7f2c2806a960 con 0x7f2c280a8540 2023-10-24T00:45:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c277fe700 1 -- 172.21.15.148:0/2905116684 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28064a30 con 0x7f2c280bed80 2023-10-24T00:45:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c277fe700 1 --2- 172.21.15.148:0/2905116684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280bed80 0x7f2c280c3640 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2c280699c0 tx=0x7f2c20009780).ready entity=mon.0 client_cookie=d2a2f813481118b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c267fc700 1 -- 172.21.15.148:0/2905116684 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000e070 con 0x7f2c280bed80 2023-10-24T00:45:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c267fc700 1 -- 172.21.15.148:0/2905116684 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000bc30 con 0x7f2c280bed80 2023-10-24T00:45:03.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c267fc700 1 -- 172.21.15.148:0/2905116684 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20012410 con 0x7f2c280bed80 2023-10-24T00:45:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 -- 172.21.15.148:0/2905116684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280bed80 msgr2=0x7f2c280c3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/2905116684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280bed80 0x7f2c280c3640 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f2c280699c0 tx=0x7f2c20009780).stop 2023-10-24T00:45:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 -- 172.21.15.148:0/2905116684 shutdown_connections 2023-10-24T00:45:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/2905116684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280bed80 0x7f2c280c3640 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/2905116684 >> v2:172.21.15.150:3300/0 conn(0x7f2c280c56c0 0x7f2c280be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 -- 172.21.15.148:0/2905116684 >> 172.21.15.148:0/2905116684 conn(0x7f2c28082f60 msgr2=0x7f2c28062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:03.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 -- 172.21.15.148:0/2905116684 shutdown_connections 2023-10-24T00:45:03.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.470+0000 7f2c2d36e700 1 -- 172.21.15.148:0/2905116684 wait complete. 2023-10-24T00:45:03.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 Processor -- start 2023-10-24T00:45:03.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 -- start start 2023-10-24T00:45:03.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280a8540 0x7f2c28163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 0x7f2c28164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28152970 con 0x7f2c280c56c0 2023-10-24T00:45:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28166230 con 0x7f2c280bed80 2023-10-24T00:45:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.472+0000 7f2c2d36e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280a6f20 con 0x7f2c280a8540 2023-10-24T00:45:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48044/0 (socket says 172.21.15.148:48044) 2023-10-24T00:45:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 -- 172.21.15.148:0/965319712 learned_addr learned my addr 172.21.15.148:0/965319712 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c1e7fc700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 0x7f2c28164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c26ffd700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280a8540 0x7f2c28163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 -- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280a8540 msgr2=0x7f2c28163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280a8540 0x7f2c28163da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 -- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 msgr2=0x7f2c28164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 0x7f2c28164fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 -- 172.21.15.148:0/965319712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009a20 con 0x7f2c280c56c0 2023-10-24T00:45:03.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c1e7fc700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 0x7f2c28164fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:03.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c277fe700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f2c28066370 tx=0x7f2c20009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2001c660 con 0x7f2c280c56c0 2023-10-24T00:45:03.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2001c7c0 con 0x7f2c280c56c0 2023-10-24T00:45:03.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28165620 con 0x7f2c280c56c0 2023-10-24T00:45:03.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2001cb80 con 0x7f2c280c56c0 2023-10-24T00:45:03.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.473+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c28165be0 con 0x7f2c280c56c0 2023-10-24T00:45:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.474+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c281663c0 con 0x7f2c280c56c0 2023-10-24T00:45:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.474+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2c2001d420 con 0x7f2c280c56c0 2023-10-24T00:45:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.475+0000 7f2c1f7fe700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 0x7f2c08061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.475+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c2007c410 con 0x7f2c280c56c0 2023-10-24T00:45:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.475+0000 7f2c26ffd700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 0x7f2c08061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.475+0000 7f2c26ffd700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 0x7f2c08061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2c18001570 tx=0x7f2c18009040).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.479+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c2004d500 con 0x7f2c280c56c0 2023-10-24T00:45:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.666+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c28064d10 con 0x7f2c0805f270 2023-10-24T00:45:03.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.668+0000 7f2c1f7fe700 1 -- 172.21.15.148:0/965319712 <== mgr.5690 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2c28064d10 con 0x7f2c0805f270 2023-10-24T00:45:03.670 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:45:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:03.670 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:45:03.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:03.671 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:45:03.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 msgr2=0x7f2c08061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 0x7f2c08061730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2c18001570 tx=0x7f2c18009040).stop 2023-10-24T00:45:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 msgr2=0x7f2c281647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f2c28066370 tx=0x7f2c20009780).stop 2023-10-24T00:45:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 shutdown_connections 2023-10-24T00:45:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c0805f270 0x7f2c08061730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c280c56c0 0x7f2c281647f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c280a8540 0x7f2c28163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 --2- 172.21.15.148:0/965319712 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280bed80 0x7f2c28164fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 >> 172.21.15.148:0/965319712 conn(0x7f2c28082f60 msgr2=0x7f2c280c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:03.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 shutdown_connections 2023-10-24T00:45:03.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.670+0000 7f2c2d36e700 1 -- 172.21.15.148:0/965319712 wait complete. 2023-10-24T00:45:03.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:45:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.799+0000 7f3534dd3700 1 Processor -- start 2023-10-24T00:45:03.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.799+0000 7f3534dd3700 1 -- start start 2023-10-24T00:45:03.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f3534dd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f3530154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f3534dd3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300c71d0 con 0x7f3530154430 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f3534dd3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300c9410 con 0x7f35300bffd0 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f3534dd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c6a10 con 0x7f3530098bd0 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f352e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3530154430 0x7f35300c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36230/0 (socket says 172.21.15.148:36230) 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f352e59c700 1 -- 172.21.15.148:0/416107630 learned_addr learned my addr 172.21.15.148:0/416107630 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:03.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384074153 0 0) 0x7f35300c71d0 con 0x7f3530154430 2023-10-24T00:45:03.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f3525d9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f3530154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.800+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c0033f0 con 0x7f3530154430 2023-10-24T00:45:03.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009875517 0 0) 0x7f351c0033f0 con 0x7f3530154430 2023-10-24T00:45:03.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 msgr2=0x7f3530154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:03.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f3530154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 >> v1:172.21.15.150:6789/0 conn(0x7f35300bffd0 legacy=0x7f353015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300ca8b0 con 0x7f3530154430 2023-10-24T00:45:03.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f3520001470 con 0x7f3530154430 2023-10-24T00:45:03.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 >> v1:172.21.15.148:6789/0 conn(0x7f3530154430 legacy=0x7f35300c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c003910 0x7f351c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f351c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c004b80 0x7f351c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c6a10 con 0x7f351c004b80 2023-10-24T00:45:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00b910 con 0x7f351c003910 2023-10-24T00:45:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c00bad0 con 0x7f3530098bd0 2023-10-24T00:45:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c004b80 0x7f351c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352e59c700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c003910 0x7f351c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f3525d9b700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f351c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 -- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 msgr2=0x7f351c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:03.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3530098bd0 0x7f351c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 -- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c003910 msgr2=0x7f351c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:03.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c003910 0x7f351c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 -- 172.21.15.148:0/416107630 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0033f0 con 0x7f351c004b80 2023-10-24T00:45:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352ed9d700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c004b80 0x7f351c005000 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f3528001f20 tx=0x7f3528007f10).ready entity=mon.0 client_cookie=c25888df7ba546f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280017e0 con 0x7f351c004b80 2023-10-24T00:45:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800c6d0 con 0x7f351c004b80 2023-10-24T00:45:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.801+0000 7f352dd9b700 1 -- 172.21.15.148:0/416107630 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800ca50 con 0x7f351c004b80 2023-10-24T00:45:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 -- 172.21.15.148:0/416107630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c004b80 msgr2=0x7f351c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 --2- 172.21.15.148:0/416107630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f351c004b80 0x7f351c005000 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f3528001f20 tx=0x7f3528007f10).stop 2023-10-24T00:45:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f352ed9d700 1 -- 172.21.15.148:0/416107630 reap_dead start 2023-10-24T00:45:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 -- 172.21.15.148:0/416107630 shutdown_connections 2023-10-24T00:45:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 -- 172.21.15.148:0/416107630 >> 172.21.15.148:0/416107630 conn(0x7f35300cb070 msgr2=0x7f35300cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 -- 172.21.15.148:0/416107630 shutdown_connections 2023-10-24T00:45:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.802+0000 7f3534dd3700 1 -- 172.21.15.148:0/416107630 wait complete. 2023-10-24T00:45:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.803+0000 7f3534dd3700 1 Processor -- start 2023-10-24T00:45:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.803+0000 7f3534dd3700 1 -- start start 2023-10-24T00:45:03.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c004b80 0x7f353013cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35300c4420 0x7f3530148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530149900 con 0x7f35300c48a0 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c3f90 con 0x7f351c004b80 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3534dd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353013d200 con 0x7f35300c4420 2023-10-24T00:45:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48070/0 (socket says 172.21.15.148:48070) 2023-10-24T00:45:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 -- 172.21.15.148:0/2520185229 learned_addr learned my addr 172.21.15.148:0/2520185229 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f3525d9b700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35300c4420 0x7f3530148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352e59c700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c004b80 0x7f353013cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 -- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35300c4420 msgr2=0x7f3530148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35300c4420 0x7f3530148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 -- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c004b80 msgr2=0x7f353013cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c004b80 0x7f353013cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 -- 172.21.15.148:0/2520185229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530168500 con 0x7f35300c48a0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.804+0000 7f352ed9d700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f3528011000 tx=0x7f3528017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.805+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280017e0 con 0x7f35300c48a0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.805+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352800c840 con 0x7f35300c48a0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.805+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530149b50 con 0x7f35300c48a0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.805+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801e680 con 0x7f35300c48a0 2023-10-24T00:45:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.805+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300c3c20 con 0x7f35300c48a0 2023-10-24T00:45:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.806+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300c4100 con 0x7f35300c48a0 2023-10-24T00:45:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.806+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f352801e9f0 con 0x7f35300c48a0 2023-10-24T00:45:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.806+0000 7f3526ffd700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 0x7f3510061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.806+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f352807bd80 con 0x7f35300c48a0 2023-10-24T00:45:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.807+0000 7f352e59c700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 0x7f3510061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.807+0000 7f352e59c700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 0x7f3510061730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3520001ea0 tx=0x7f35300caa40).ready entity=mgr.5690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:03.810+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f352804ced0 con 0x7f35300c48a0 2023-10-24T00:45:04.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.016+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f353006c6b0 con 0x7f35300c48a0 2023-10-24T00:45:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.861+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f35280799d0 con 0x7f35300c48a0 2023-10-24T00:45:04.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.862+0000 7f3526ffd700 1 -- 172.21.15.148:0/2520185229 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7f35280435b0 con 0x7f35300c48a0 2023-10-24T00:45:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 msgr2=0x7f3510061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 0x7f3510061730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3520001ea0 tx=0x7f35300caa40).stop 2023-10-24T00:45:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 msgr2=0x7f3530167710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f3528011000 tx=0x7f3528017000).stop 2023-10-24T00:45:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 shutdown_connections 2023-10-24T00:45:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f351005f270 0x7f3510061730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:04.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35300c48a0 0x7f3530167710 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:04.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f351c004b80 0x7f353013cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:04.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 --2- 172.21.15.148:0/2520185229 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35300c4420 0x7f3530148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 >> 172.21.15.148:0/2520185229 conn(0x7f35300cb070 msgr2=0x7f35300a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 shutdown_connections 2023-10-24T00:45:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:04.865+0000 7f3534dd3700 1 -- 172.21.15.148:0/2520185229 wait complete. 2023-10-24T00:45:04.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:45:05.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.000+0000 7fdf6aa39700 1 Processor -- start 2023-10-24T00:45:05.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.000+0000 7fdf6aa39700 1 -- start start 2023-10-24T00:45:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf6aa39700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf64064c00 0x7fdf640bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf6aa39700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf64063760 con 0x7fdf640c6210 2023-10-24T00:45:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf6aa39700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640bf2f0 con 0x7fdf640c65f0 2023-10-24T00:45:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf6aa39700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf64154b50 con 0x7fdf64064c00 2023-10-24T00:45:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf68fd6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf64064c00 0x7fdf640bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf68fd6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf64064c00 0x7fdf640bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48092/0 (socket says 172.21.15.148:48092) 2023-10-24T00:45:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf63fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdf640c6210 0x7fdf640c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36246/0 (socket says 172.21.15.148:36246) 2023-10-24T00:45:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.001+0000 7fdf68fd6700 1 -- 172.21.15.148:0/3896294953 learned_addr learned my addr 172.21.15.148:0/3896294953 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf68fd6700 1 -- 172.21.15.148:0/3896294953 >> v1:172.21.15.150:6789/0 conn(0x7fdf640c65f0 legacy=0x7fdf640be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf68fd6700 1 -- 172.21.15.148:0/3896294953 >> v1:172.21.15.148:6789/0 conn(0x7fdf640c6210 legacy=0x7fdf640c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf62ffd700 1 -- 172.21.15.148:0/3896294953 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557063414 0 0) 0x7fdf64063760 con 0x7fdf640c6210 2023-10-24T00:45:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf68fd6700 1 -- 172.21.15.148:0/3896294953 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640bf5d0 con 0x7fdf64064c00 2023-10-24T00:45:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf68fd6700 1 --2- 172.21.15.148:0/3896294953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf640bec80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fdf5c009f20 tx=0x7fdf5c009840).ready entity=mon.0 client_cookie=34cfd2561cb58854 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf62ffd700 1 -- 172.21.15.148:0/3896294953 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00e070 con 0x7fdf64064c00 2023-10-24T00:45:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf62ffd700 1 -- 172.21.15.148:0/3896294953 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00ba80 con 0x7fdf64064c00 2023-10-24T00:45:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf62ffd700 1 -- 172.21.15.148:0/3896294953 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00be00 con 0x7fdf64064c00 2023-10-24T00:45:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf6aa39700 1 -- 172.21.15.148:0/3896294953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 msgr2=0x7fdf640bec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/3896294953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf640bec80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fdf5c009f20 tx=0x7fdf5c009840).stop 2023-10-24T00:45:05.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.002+0000 7fdf6aa39700 1 -- 172.21.15.148:0/3896294953 shutdown_connections 2023-10-24T00:45:05.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.003+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/3896294953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf640bec80 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.003+0000 7fdf6aa39700 1 -- 172.21.15.148:0/3896294953 >> 172.21.15.148:0/3896294953 conn(0x7fdf64092510 msgr2=0x7fdf64062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:05.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.003+0000 7fdf6aa39700 1 -- 172.21.15.148:0/3896294953 shutdown_connections 2023-10-24T00:45:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.003+0000 7fdf6aa39700 1 -- 172.21.15.148:0/3896294953 wait complete. 2023-10-24T00:45:05.010 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:05.006+0000 7f8fb8de3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:05.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.004+0000 7fdf6aa39700 1 Processor -- start 2023-10-24T00:45:05.011 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:05.004+0000 7fe05cdc5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.004+0000 7fdf6aa39700 1 -- start start 2023-10-24T00:45:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf640c6210 0x7fdf6414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf640c65f0 0x7fdf64156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6414ebe0 con 0x7fdf64064c00 2023-10-24T00:45:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6414f1a0 con 0x7fdf640c6210 2023-10-24T00:45:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64155130 con 0x7fdf640c65f0 2023-10-24T00:45:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48100/0 (socket says 172.21.15.148:48100) 2023-10-24T00:45:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 -- 172.21.15.148:0/2756519175 learned_addr learned my addr 172.21.15.148:0/2756519175 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf68fd6700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf640c65f0 0x7fdf64156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf637fe700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf640c6210 0x7fdf6414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 -- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf640c65f0 msgr2=0x7fdf64156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf640c65f0 0x7fdf64156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 -- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf640c6210 msgr2=0x7fdf6414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf640c6210 0x7fdf6414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 -- 172.21.15.148:0/2756519175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009ae0 con 0x7fdf64064c00 2023-10-24T00:45:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf63fff700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fdf5800c4c0 tx=0x7fdf58007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800ce30 con 0x7fdf64064c00 2023-10-24T00:45:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580072e0 con 0x7fdf64064c00 2023-10-24T00:45:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf64155410 con 0x7fdf64064c00 2023-10-24T00:45:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.005+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580056e0 con 0x7fdf64064c00 2023-10-24T00:45:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.006+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf64150d10 con 0x7fdf64064c00 2023-10-24T00:45:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6406c6b0 con 0x7fdf64064c00 2023-10-24T00:45:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fdf58005a90 con 0x7fdf64064c00 2023-10-24T00:45:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf4bfff700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 0x7fdf50061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf637fe700 1 -- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 msgr2=0x7fdf50061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf58079ad0 con 0x7fdf64064c00 2023-10-24T00:45:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.007+0000 7fdf637fe700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 0x7fdf50061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.012+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf5804ac20 con 0x7fdf64064c00 2023-10-24T00:45:05.071 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:05.070+0000 7f8fb8de3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:05.072 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:05.070+0000 7fe05cdc5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:05.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.183+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdf64155600 con 0x7fdf64064c00 2023-10-24T00:45:05.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.187+0000 7fdf4bfff700 1 -- 172.21.15.148:0/2756519175 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdf5804e240 con 0x7fdf64064c00 2023-10-24T00:45:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 msgr2=0x7fdf50061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 0x7fdf50061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 msgr2=0x7fdf64150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fdf5800c4c0 tx=0x7fdf58007c10).stop 2023-10-24T00:45:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 shutdown_connections 2023-10-24T00:45:05.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf640c65f0 0x7fdf64156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf5005f290 0x7fdf50061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf64064c00 0x7fdf64150820 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 --2- 172.21.15.148:0/2756519175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf640c6210 0x7fdf6414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 >> 172.21.15.148:0/2756519175 conn(0x7fdf64092510 msgr2=0x7fdf64067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:05.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 shutdown_connections 2023-10-24T00:45:05.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.189+0000 7fdf6aa39700 1 -- 172.21.15.148:0/2756519175 wait complete. 2023-10-24T00:45:05.203 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-24T00:45:05.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.321+0000 7f8e7e9f6700 1 Processor -- start 2023-10-24T00:45:05.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.321+0000 7f8e7e9f6700 1 -- start start 2023-10-24T00:45:05.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e780c5f50 0x7f8e780a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8e78064c10 0x7f8e78065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e780be780 0x7f8e780bec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e78065540 con 0x7f8e780be780 2023-10-24T00:45:05.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780bf120 con 0x7f8e78064c10 2023-10-24T00:45:05.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7e9f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780c7a20 con 0x7f8e780c5f50 2023-10-24T00:45:05.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7cf93700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e780be780 0x7f8e780bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7cf93700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e780be780 0x7f8e780bec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48116/0 (socket says 172.21.15.148:48116) 2023-10-24T00:45:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7cf93700 1 -- 172.21.15.148:0/999969687 learned_addr learned my addr 172.21.15.148:0/999969687 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e777fe700 1 --2- 172.21.15.148:0/999969687 >> v2:172.21.15.150:3300/0 conn(0x7f8e78064c10 0x7f8e78065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e77fff700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e780c5f50 0x7f8e780a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.322+0000 7f8e7cf93700 1 -- 172.21.15.148:0/999969687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e780c5f50 msgr2=0x7f8e780a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e780c5f50 0x7f8e780a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7cf93700 1 -- 172.21.15.148:0/999969687 >> v2:172.21.15.150:3300/0 conn(0x7f8e78064c10 msgr2=0x7f8e78065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/999969687 >> v2:172.21.15.150:3300/0 conn(0x7f8e78064c10 0x7f8e78065050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7cf93700 1 -- 172.21.15.148:0/999969687 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780c6330 con 0x7f8e780be780 2023-10-24T00:45:05.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780be780 0x7f8e780bec30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f8e7806aa00 tx=0x7f8e70009840).ready entity=mon.0 client_cookie=d10c55723d4db185 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e76ffd700 1 -- 172.21.15.148:0/999969687 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000e070 con 0x7f8e780be780 2023-10-24T00:45:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e76ffd700 1 -- 172.21.15.148:0/999969687 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7000b970 con 0x7f8e780be780 2023-10-24T00:45:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e76ffd700 1 -- 172.21.15.148:0/999969687 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000bcf0 con 0x7f8e780be780 2023-10-24T00:45:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/999969687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780be780 msgr2=0x7f8e780bec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780be780 0x7f8e780bec30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f8e7806aa00 tx=0x7f8e70009840).stop 2023-10-24T00:45:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/999969687 shutdown_connections 2023-10-24T00:45:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780be780 0x7f8e780bec30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 --2- 172.21.15.148:0/999969687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e780c5f50 0x7f8e780a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 --2- 172.21.15.148:0/999969687 >> v2:172.21.15.150:3300/0 conn(0x7f8e78064c10 0x7f8e78065050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/999969687 >> 172.21.15.148:0/999969687 conn(0x7f8e78082f60 msgr2=0x7f8e78092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/999969687 shutdown_connections 2023-10-24T00:45:05.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.323+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/999969687 wait complete. 2023-10-24T00:45:05.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.325+0000 7f8e7e9f6700 1 Processor -- start 2023-10-24T00:45:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.325+0000 7f8e7e9f6700 1 -- start start 2023-10-24T00:45:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.325+0000 7f8e7e9f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e78064c10 0x7f8e78153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.325+0000 7f8e7e9f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e780be780 0x7f8e780ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.325+0000 7f8e7e9f6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780c5f50 0x7f8e78153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7e9f6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e78153860 con 0x7f8e780c5f50 2023-10-24T00:45:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7e9f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780aa120 con 0x7f8e780be780 2023-10-24T00:45:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7e9f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780aa400 con 0x7f8e78064c10 2023-10-24T00:45:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780c5f50 0x7f8e78153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780c5f50 0x7f8e78153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48120/0 (socket says 172.21.15.148:48120) 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 -- 172.21.15.148:0/1568637227 learned_addr learned my addr 172.21.15.148:0/1568637227 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e777fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e780be780 0x7f8e780ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e78064c10 0x7f8e78153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e78064c10 msgr2=0x7f8e78153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e78064c10 0x7f8e78153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e780be780 msgr2=0x7f8e780ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e780be780 0x7f8e780ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70009ae0 con 0x7f8e780c5f50 2023-10-24T00:45:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7cf93700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e780c5f50 0x7f8e78153c50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f8e7806a220 tx=0x7f8e78154aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000bee0 con 0x7f8e780c5f50 2023-10-24T00:45:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e700092e0 con 0x7f8e780c5f50 2023-10-24T00:45:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e780aa6e0 con 0x7f8e780c5f50 2023-10-24T00:45:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7001e6c0 con 0x7f8e780c5f50 2023-10-24T00:45:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.326+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e780aaca0 con 0x7f8e780c5f50 2023-10-24T00:45:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.327+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e780aaec0 con 0x7f8e780c5f50 2023-10-24T00:45:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.328+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8e70003040 con 0x7f8e780c5f50 2023-10-24T00:45:05.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.328+0000 7f8e5ffff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:05.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.328+0000 7f8e77fff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:05.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.328+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e7007b7c0 con 0x7f8e780c5f50 2023-10-24T00:45:05.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.328+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:05.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.336+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e7004c9c0 con 0x7f8e780c5f50 2023-10-24T00:45:05.345 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:05.344+0000 7f8fb8de3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:05.362 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:05.361+0000 7fe05cdc5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.529+0000 7f8e77fff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:05.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.529+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:05.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.535+0000 7f8e7e9f6700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e7806c6b0 con 0x7f8e6405f2c0 2023-10-24T00:45:05.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.930+0000 7f8e77fff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:05.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:05.930+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:45:05.961 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:05.960+0000 7f8fb8de3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:05.986 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:05.984+0000 7fe05cdc5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:06.033 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.032+0000 7f8fb8de3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:06.057 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.056+0000 7fe05cdc5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:06.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.218+0000 7f8fb8de3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:06.246 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.244+0000 7fe05cdc5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:06.638 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.637+0000 7f8fb8de3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:06.665 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.664+0000 7fe05cdc5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:06.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:06.731+0000 7f8e77fff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:06.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:06.731+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:45:06.742 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.740+0000 7f8fb8de3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:06.770 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.769+0000 7fe05cdc5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:06.895 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.894+0000 7f8fb8de3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:06.924 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.923+0000 7fe05cdc5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:06.969 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:06.968+0000 7f8fb8de3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:06.999 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:06.998+0000 7fe05cdc5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:07.036 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:07.035+0000 7f8fb8de3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:07.066 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:07.065+0000 7fe05cdc5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:07.295 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:07.294+0000 7f8fb8de3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:07.327 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:07.325+0000 7fe05cdc5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:07.478 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:07.477+0000 7f8fb8de3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:07.512 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:07.510+0000 7fe05cdc5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:08.126 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.125+0000 7f8fb8de3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:08.165 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.164+0000 7fe05cdc5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:08.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.192+0000 7f8fb8de3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:08.234 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.232+0000 7fe05cdc5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:08.269 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.268+0000 7f8fb8de3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:08.309 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.308+0000 7fe05cdc5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:08.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:08.332+0000 7f8e77fff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:08.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:08.332+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:45:08.416 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.415+0000 7f8fb8de3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:08.457 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.456+0000 7fe05cdc5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:08.487 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.486+0000 7f8fb8de3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:08.529 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.527+0000 7fe05cdc5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:08.602 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.600+0000 7f8fb8de3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:08.645 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.644+0000 7fe05cdc5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:08.710 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:08.709+0000 7f8fb8de3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:08.753 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:08.751+0000 7fe05cdc5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:09.002 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.001+0000 7f8fb8de3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:09.047 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:09.046+0000 7fe05cdc5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:09.073 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.072+0000 7f8fb8de3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:09.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:09.095+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 33) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f8e70079410 con 0x7f8e780c5f50 2023-10-24T00:45:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:09.095+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 msgr2=0x7f8e64061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:09.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:09.095+0000 7f8e5ffff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:09.122 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:09.121+0000 7fe05cdc5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:09.160 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2d56a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.160 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2d56a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.160 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2d56a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.160 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2d56a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2d56a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2fd6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2fd6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2fd6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2fd6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:09.162 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:09.158+0000 7f8f2fd6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.094+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 34) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8e70079790 con 0x7f8e780c5f50 2023-10-24T00:45:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.095+0000 7f8e5ffff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.095+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e7806c6b0 con 0x7f8e6405f2c0 2023-10-24T00:45:10.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.095+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.096+0000 7f8e77fff700 1 --2- 172.21.15.148:0/1568637227 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6405f2c0 0x7f8e64061700 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8e6c0094a0 tx=0x7f8e6c009060).ready entity=mgr.6490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:10.102 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:10.101+0000 7f8f38580700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-24T00:45:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.101+0000 7f8e5ffff700 1 -- 172.21.15.148:0/1568637227 <== mgr.6490 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f8e7806c6b0 con 0x7f8e6405f2c0 2023-10-24T00:45:10.104 INFO:teuthology.orchestra.run.smithi148.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-24T00:45:10.107 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-24T00:45:10.108 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:45:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.225+0000 7f25f81ad700 1 Processor -- start 2023-10-24T00:45:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.225+0000 7f25f81ad700 1 -- start start 2023-10-24T00:45:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f81ad700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 0x7f25f0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f81ad700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25f0098bd0 0x7f25f00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f81ad700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00c71d0 con 0x7f25f00bffd0 2023-10-24T00:45:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f81ad700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f00c9410 con 0x7f25f0098bd0 2023-10-24T00:45:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f81ad700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f00c6c10 con 0x7f25f0154430 2023-10-24T00:45:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f5748700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25f0098bd0 0x7f25f00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f5748700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25f0098bd0 0x7f25f00c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48124/0 (socket says 172.21.15.148:48124) 2023-10-24T00:45:10.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f5748700 1 -- 172.21.15.148:0/1984893812 learned_addr learned my addr 172.21.15.148:0/1984893812 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:10.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f5f49700 1 --2- 172.21.15.148:0/1984893812 >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 0x7f25f0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.226+0000 7f25f5748700 1 -- 172.21.15.148:0/1984893812 >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 msgr2=0x7f25f0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f5748700 1 --2- 172.21.15.148:0/1984893812 >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 0x7f25f0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f5748700 1 -- 172.21.15.148:0/1984893812 >> v1:172.21.15.150:6789/0 conn(0x7f25f00bffd0 legacy=0x7f25f00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f5748700 1 -- 172.21.15.148:0/1984893812 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00c6ef0 con 0x7f25f0098bd0 2023-10-24T00:45:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f5f49700 1 --2- 172.21.15.148:0/1984893812 >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 0x7f25f0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f5748700 1 --2- 172.21.15.148:0/1984893812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0098bd0 0x7f25f00c6300 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f25f005ff70 tx=0x7f25e00090f0).ready entity=mon.0 client_cookie=6e98787e7dbd49c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f4f47700 1 -- 172.21.15.148:0/1984893812 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000b600 con 0x7f25f0098bd0 2023-10-24T00:45:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f4f47700 1 -- 172.21.15.148:0/1984893812 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000b760 con 0x7f25f0098bd0 2023-10-24T00:45:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f4f47700 1 -- 172.21.15.148:0/1984893812 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000bae0 con 0x7f25f0098bd0 2023-10-24T00:45:10.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 -- 172.21.15.148:0/1984893812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0098bd0 msgr2=0x7f25f00c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:10.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 --2- 172.21.15.148:0/1984893812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0098bd0 0x7f25f00c6300 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f25f005ff70 tx=0x7f25e00090f0).stop 2023-10-24T00:45:10.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 -- 172.21.15.148:0/1984893812 shutdown_connections 2023-10-24T00:45:10.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 --2- 172.21.15.148:0/1984893812 >> v2:172.21.15.150:3300/0 conn(0x7f25f0154430 0x7f25f0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 --2- 172.21.15.148:0/1984893812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0098bd0 0x7f25f00c6300 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 -- 172.21.15.148:0/1984893812 >> 172.21.15.148:0/1984893812 conn(0x7f25f00cb070 msgr2=0x7f25f00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 -- 172.21.15.148:0/1984893812 shutdown_connections 2023-10-24T00:45:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.227+0000 7f25f81ad700 1 -- 172.21.15.148:0/1984893812 wait complete. 2023-10-24T00:45:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 Processor -- start 2023-10-24T00:45:10.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 -- start start 2023-10-24T00:45:10.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f0098bd0 0x7f25f0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00bffd0 0x7f25f00aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00ac1b0 con 0x7f25f0154430 2023-10-24T00:45:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00ab5a0 con 0x7f25f0098bd0 2023-10-24T00:45:10.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f81ad700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00ab880 con 0x7f25f00bffd0 2023-10-24T00:45:10.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f674a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f674a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48136/0 (socket says 172.21.15.148:48136) 2023-10-24T00:45:10.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.229+0000 7f25f674a700 1 -- 172.21.15.148:0/2158452743 learned_addr learned my addr 172.21.15.148:0/2158452743 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f5748700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00bffd0 0x7f25f00aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 -- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00bffd0 msgr2=0x7f25f00aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00bffd0 0x7f25f00aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 -- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f0098bd0 msgr2=0x7f25f0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f0098bd0 0x7f25f0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 -- 172.21.15.148:0/2158452743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0009370 con 0x7f25f0154430 2023-10-24T00:45:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f674a700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f25e8002230 tx=0x7f25e80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8010510 con 0x7f25f0154430 2023-10-24T00:45:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8010670 con 0x7f25f0154430 2023-10-24T00:45:10.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f00abb60 con 0x7f25f0154430 2023-10-24T00:45:10.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80109f0 con 0x7f25f0154430 2023-10-24T00:45:10.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.230+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f00b07a0 con 0x7f25f0154430 2023-10-24T00:45:10.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.231+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f25e801b400 con 0x7f25f0154430 2023-10-24T00:45:10.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.231+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f006c6b0 con 0x7f25f0154430 2023-10-24T00:45:10.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.231+0000 7f25e5ffb700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 0x7f25d4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:10.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.232+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f25e8079f70 con 0x7f25f0154430 2023-10-24T00:45:10.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.232+0000 7f25f5f49700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 0x7f25d4061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.232+0000 7f25f5f49700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 0x7f25d4061510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f25ec00a880 tx=0x7f25ec008040).ready entity=mgr.6490 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.236+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f25e80a8af0 con 0x7f25f0154430 2023-10-24T00:45:10.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:10.441+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f25f00ac2f0 con 0x7f25f0154430 2023-10-24T00:45:11.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.153+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f25e8077e10 con 0x7f25f0154430 2023-10-24T00:45:11.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.154+0000 7f25e5ffb700 1 -- 172.21.15.148:0/2158452743 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f25e8073c40 con 0x7f25f0154430 2023-10-24T00:45:11.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.157+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 msgr2=0x7f25d4061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.157+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 0x7f25d4061510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f25ec00a880 tx=0x7f25ec008040).stop 2023-10-24T00:45:11.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 msgr2=0x7f25f00af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f25e8002230 tx=0x7f25e80015e0).stop 2023-10-24T00:45:11.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 shutdown_connections 2023-10-24T00:45:11.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f25d405f050 0x7f25d4061510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25f0154430 0x7f25f00af540 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25f0098bd0 0x7f25f0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 --2- 172.21.15.148:0/2158452743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25f00bffd0 0x7f25f00aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 >> 172.21.15.148:0/2158452743 conn(0x7f25f00cb070 msgr2=0x7f25f00a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 shutdown_connections 2023-10-24T00:45:11.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.158+0000 7f25f81ad700 1 -- 172.21.15.148:0/2158452743 wait complete. 2023-10-24T00:45:11.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:45:11.177 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:45:11.224 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:45:11.266 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:45:11.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:45:11.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:45:11.267 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:11.298 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:11.296+0000 7f452fbea680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:11.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:45:11.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:11.305 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:45:11.306 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:11.305+0000 7f63c6d59680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:11.321 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:11.360 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:11.358+0000 7f452fbea680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:11.372 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:11.371+0000 7f63c6d59680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:11.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.477+0000 7fd2d3260700 1 Processor -- start 2023-10-24T00:45:11.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.477+0000 7fd2d3260700 1 -- start start 2023-10-24T00:45:11.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d3260700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d3260700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d3260700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc0c6410 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d3260700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc0c1160 con 0x7fd2cc0ca110 2023-10-24T00:45:11.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d3260700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0ca6e0 con 0x7fd2cc0aa140 2023-10-24T00:45:11.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d225e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d1a5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d225e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:50582/0 (socket says 172.21.15.148:50582) 2023-10-24T00:45:11.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d1a5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51894/0 (socket says 172.21.15.148:51894) 2023-10-24T00:45:11.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d225e700 1 -- 172.21.15.148:0/3459161218 learned_addr learned my addr 172.21.15.148:0/3459161218 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:11.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.478+0000 7fd2d2a5f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd2cc0c0cd0 0x7fd2cc157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:43304/0 (socket says 172.21.15.148:43304) 2023-10-24T00:45:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 msgr2=0x7fd2cc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d1a5d700 1 --2- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/3459161218 >> v1:172.21.15.150:6789/0 conn(0x7fd2cc0c0cd0 legacy=0x7fd2cc157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/3459161218 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc0ca9c0 con 0x7fd2cc0ca110 2023-10-24T00:45:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d125c700 1 -- 172.21.15.148:0/3459161218 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883180727 0 0) 0x7fd2cc0c6410 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d1a5d700 1 --2- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd2c8009760 tx=0x7fd2c8009060).ready entity=mon.1 client_cookie=846b3c82a6f89898 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d125c700 1 -- 172.21.15.148:0/3459161218 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800f510 con 0x7fd2cc0ca110 2023-10-24T00:45:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d125c700 1 -- 172.21.15.148:0/3459161218 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c800f670 con 0x7fd2cc0ca110 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d125c700 1 -- 172.21.15.148:0/3459161218 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800f9f0 con 0x7fd2cc0ca110 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d3260700 1 -- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 msgr2=0x7fd2cc0c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.479+0000 7fd2d3260700 1 --2- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd2c8009760 tx=0x7fd2c8009060).stop 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 -- 172.21.15.148:0/3459161218 shutdown_connections 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 --2- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 --2- 172.21.15.148:0/3459161218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c07e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 -- 172.21.15.148:0/3459161218 >> 172.21.15.148:0/3459161218 conn(0x7fd2cc0944a0 msgr2=0x7fd2cc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:11.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 -- 172.21.15.148:0/3459161218 shutdown_connections 2023-10-24T00:45:11.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.480+0000 7fd2d3260700 1 -- 172.21.15.148:0/3459161218 wait complete. 2023-10-24T00:45:11.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 Processor -- start 2023-10-24T00:45:11.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 -- start start 2023-10-24T00:45:11.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc152510 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0ac040 con 0x7fd2cc0ca110 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.481+0000 7fd2d3260700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc0ab430 con 0x7fd2cc0aa140 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48156/0 (socket says 172.21.15.148:48156) 2023-10-24T00:45:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/2973486629 learned_addr learned my addr 172.21.15.148:0/2973486629 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d225e700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d2a5f700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 msgr2=0x7fd2cc157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 msgr2=0x7fd2cc0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 -- 172.21.15.148:0/2973486629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80092a0 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d1a5d700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fd2cc05f860 tx=0x7fd2c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:11.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800f7e0 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c800f940 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc0ab710 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c801b660 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.482+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc0abcd0 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.483+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc047480 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.483+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd2c801ba50 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.484+0000 7fd2c27fc700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 0x7fd2b00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.484+0000 7fd2d225e700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 msgr2=0x7fd2b00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:11.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.484+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fd2c807be30 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.484+0000 7fd2d225e700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 0x7fd2b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:11.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.488+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd2c804ce00 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.633 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:11.631+0000 7f452fbea680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:11.657 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:11.656+0000 7f63c6d59680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.685+0000 7fd2d225e700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 msgr2=0x7fd2b00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.685+0000 7fd2d225e700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 0x7fd2b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:11.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.697+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2cc0c60a0 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.697+0000 7fd2c27fc700 1 -- 172.21.15.148:0/2973486629 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fd2c801f020 con 0x7fd2cc0c0cd0 2023-10-24T00:45:11.699 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:11.699 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:45:11.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.699+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 msgr2=0x7fd2b00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:11.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.699+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 0x7fd2b00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:11.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.699+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 msgr2=0x7fd2cc0af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.699+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fd2cc05f860 tx=0x7fd2c8017000).stop 2023-10-24T00:45:11.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 shutdown_connections 2023-10-24T00:45:11.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2cc0ca110 0x7fd2cc0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd2cc0aa140 0x7fd2cc157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2b005f300 0x7fd2b00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:11.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 --2- 172.21.15.148:0/2973486629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd2cc0c0cd0 0x7fd2cc0af670 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 >> 172.21.15.148:0/2973486629 conn(0x7fd2cc0944a0 msgr2=0x7fd2cc152cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:11.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 shutdown_connections 2023-10-24T00:45:11.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.700+0000 7fd2d3260700 1 -- 172.21.15.148:0/2973486629 wait complete. 2023-10-24T00:45:11.704 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:45:11.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.868+0000 7f1274b7d700 1 Processor -- start 2023-10-24T00:45:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.868+0000 7f1274b7d700 1 -- start start 2023-10-24T00:45:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f1274b7d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1270153f40 0x7f1270062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f1274b7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1270154320 0x7f1270062b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f1274b7d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127006a040 con 0x7f12700c57b0 2023-10-24T00:45:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f1274b7d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1270063030 con 0x7f1270153f40 2023-10-24T00:45:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f1274b7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c88e0 con 0x7f1270154320 2023-10-24T00:45:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f126ed9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f12700c57b0 0x7f12700c5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36260/0 (socket says 172.21.15.148:36260) 2023-10-24T00:45:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.869+0000 7f126ed9d700 1 -- 172.21.15.148:0/1071583812 learned_addr learned my addr 172.21.15.148:0/1071583812 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 --2- 172.21.15.148:0/1071583812 >> v2:172.21.15.150:3300/0 conn(0x7f1270153f40 0x7f1270062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126dd9b700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1270154320 0x7f1270062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126d59a700 1 -- 172.21.15.148:0/1071583812 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801460849 0 0) 0x7f127006a040 con 0x7f12700c57b0 2023-10-24T00:45:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126d59a700 1 -- 172.21.15.148:0/1071583812 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c0033f0 con 0x7f12700c57b0 2023-10-24T00:45:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 -- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1270154320 msgr2=0x7f1270062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1270154320 0x7f1270062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 -- 172.21.15.148:0/1071583812 >> v1:172.21.15.148:6789/0 conn(0x7f12700c57b0 legacy=0x7f12700c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 -- 172.21.15.148:0/1071583812 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270069430 con 0x7f1270153f40 2023-10-24T00:45:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126e59c700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270153f40 0x7f1270062650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f1258009760 tx=0x7f1258009060).ready entity=mon.1 client_cookie=4e86d2dab0e019ce server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126d59a700 1 -- 172.21.15.148:0/1071583812 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800d4a0 con 0x7f1270153f40 2023-10-24T00:45:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126d59a700 1 -- 172.21.15.148:0/1071583812 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125800d600 con 0x7f1270153f40 2023-10-24T00:45:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.870+0000 7f126d59a700 1 -- 172.21.15.148:0/1071583812 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800d980 con 0x7f1270153f40 2023-10-24T00:45:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 -- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270153f40 msgr2=0x7f1270062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270153f40 0x7f1270062650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f1258009760 tx=0x7f1258009060).stop 2023-10-24T00:45:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 -- 172.21.15.148:0/1071583812 shutdown_connections 2023-10-24T00:45:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270153f40 0x7f1270062650 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1071583812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1270154320 0x7f1270062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 -- 172.21.15.148:0/1071583812 >> 172.21.15.148:0/1071583812 conn(0x7f1270064200 msgr2=0x7f12700c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:11.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 -- 172.21.15.148:0/1071583812 shutdown_connections 2023-10-24T00:45:11.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.871+0000 7f1274b7d700 1 -- 172.21.15.148:0/1071583812 wait complete. 2023-10-24T00:45:11.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.872+0000 7f1274b7d700 1 Processor -- start 2023-10-24T00:45:11.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.872+0000 7f1274b7d700 1 -- start start 2023-10-24T00:45:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 0x7f127014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 0x7f12700a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127014f810 con 0x7f1270153f40 2023-10-24T00:45:11.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127014fa80 con 0x7f1270154320 2023-10-24T00:45:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127014ddb0 con 0x7f12700c57b0 2023-10-24T00:45:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126e59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 0x7f127014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48164/0 (socket says 172.21.15.148:48164) 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 0x7f12700a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126dd9b700 1 -- 172.21.15.148:0/1556483296 learned_addr learned my addr 172.21.15.148:0/1556483296 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 -- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 msgr2=0x7f127014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 0x7f127014d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 -- 172.21.15.148:0/1556483296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 msgr2=0x7f12700aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:11.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 -- 172.21.15.148:0/1556483296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580092a0 con 0x7f1270154320 2023-10-24T00:45:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126e59c700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 0x7f127014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126dd9b700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:11.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f126ed9d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 0x7f12700a9cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f12700c6310 tx=0x7f1268007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:11.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268005d30 con 0x7f1270154320 2023-10-24T00:45:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268005e90 con 0x7f1270154320 2023-10-24T00:45:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.873+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12700ab5e0 con 0x7f1270154320 2023-10-24T00:45:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.874+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680072e0 con 0x7f1270154320 2023-10-24T00:45:11.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.874+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12700abba0 con 0x7f1270154320 2023-10-24T00:45:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.874+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127006c6b0 con 0x7f1270154320 2023-10-24T00:45:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.875+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f1268007710 con 0x7f1270154320 2023-10-24T00:45:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.875+0000 7f12667fc700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 0x7f12500617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.875+0000 7f126e59c700 1 -- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 msgr2=0x7f12500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:11.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.875+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f1268079dc0 con 0x7f1270154320 2023-10-24T00:45:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.875+0000 7f126e59c700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 0x7f12500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:11.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:11.879+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f126804ad90 con 0x7f1270154320 2023-10-24T00:45:12.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.048+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1270061440 con 0x7f1270154320 2023-10-24T00:45:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.049+0000 7f12667fc700 1 -- 172.21.15.148:0/1556483296 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17351 (secure 0 0 0) 0x7f126804e3b0 con 0x7f1270154320 2023-10-24T00:45:12.051 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:12.051 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":97,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:09.086232+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/823834847":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6833/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/3639739776":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2863574378":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2981343771":"2023-10-25T00:45:09.086183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:12.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.051+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 msgr2=0x7f12500617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:12.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.051+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 0x7f12500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.051+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 msgr2=0x7f12700a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.051+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 0x7f12700a9cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f12700c6310 tx=0x7f1268007f10).stop 2023-10-24T00:45:12.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 shutdown_connections 2023-10-24T00:45:12.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1270154320 0x7f12700a9cd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12700c57b0 0x7f127014d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f125005f300 0x7f12500617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 --2- 172.21.15.148:0/1556483296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270153f40 0x7f12700aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 >> 172.21.15.148:0/1556483296 conn(0x7f1270064200 msgr2=0x7f1270152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 shutdown_connections 2023-10-24T00:45:12.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.052+0000 7f1274b7d700 1 -- 172.21.15.148:0/1556483296 wait complete. 2023-10-24T00:45:12.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:44:51.401595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:44:52.182796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:45:12.066 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:45:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.187+0000 7fb735141700 1 Processor -- start 2023-10-24T00:45:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.187+0000 7fb735141700 1 -- start start 2023-10-24T00:45:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb735141700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb730154590 0x7fb7300a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb735141700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7300a4ef0 con 0x7fb7301541b0 2023-10-24T00:45:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb735141700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7300a48e0 con 0x7fb7300c32d0 2023-10-24T00:45:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb735141700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7300a72c0 con 0x7fb730154590 2023-10-24T00:45:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb730154590 0x7fb7300a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb730154590 0x7fb7300a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48180/0 (socket says 172.21.15.148:48180) 2023-10-24T00:45:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb72ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb7301541b0 0x7fb7300c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36272/0 (socket says 172.21.15.148:36272) 2023-10-24T00:45:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 -- 172.21.15.148:0/3123751616 learned_addr learned my addr 172.21.15.148:0/3123751616 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:12.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 -- 172.21.15.148:0/3123751616 >> v1:172.21.15.150:6789/0 conn(0x7fb7300c32d0 legacy=0x7fb7300a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 -- 172.21.15.148:0/3123751616 >> v1:172.21.15.148:6789/0 conn(0x7fb7301541b0 legacy=0x7fb7300c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb72effd700 1 -- 172.21.15.148:0/3123751616 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873304607 0 0) 0x7fb7300a4ef0 con 0x7fb7301541b0 2023-10-24T00:45:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 -- 172.21.15.148:0/3123751616 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300c4fe0 con 0x7fb730154590 2023-10-24T00:45:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.188+0000 7fb734940700 1 --2- 172.21.15.148:0/3123751616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7300a6dd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fb728009f20 tx=0x7fb728009840).ready entity=mon.0 client_cookie=e0f23b84fa7dbaac server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb72effd700 1 -- 172.21.15.148:0/3123751616 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800e070 con 0x7fb730154590 2023-10-24T00:45:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb72effd700 1 -- 172.21.15.148:0/3123751616 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800ba80 con 0x7fb730154590 2023-10-24T00:45:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb72effd700 1 -- 172.21.15.148:0/3123751616 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800be00 con 0x7fb730154590 2023-10-24T00:45:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 -- 172.21.15.148:0/3123751616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 msgr2=0x7fb7300a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 --2- 172.21.15.148:0/3123751616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7300a6dd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fb728009f20 tx=0x7fb728009840).stop 2023-10-24T00:45:12.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 -- 172.21.15.148:0/3123751616 shutdown_connections 2023-10-24T00:45:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 --2- 172.21.15.148:0/3123751616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7300a6dd0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 -- 172.21.15.148:0/3123751616 >> 172.21.15.148:0/3123751616 conn(0x7fb7300c86e0 msgr2=0x7fb7300c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 -- 172.21.15.148:0/3123751616 shutdown_connections 2023-10-24T00:45:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.189+0000 7fb735141700 1 -- 172.21.15.148:0/3123751616 wait complete. 2023-10-24T00:45:12.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.190+0000 7fb735141700 1 Processor -- start 2023-10-24T00:45:12.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.190+0000 7fb735141700 1 -- start start 2023-10-24T00:45:12.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7300c32d0 0x7fb730154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7301541b0 0x7fb7301567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300a86a0 con 0x7fb730154590 2023-10-24T00:45:12.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730157240 con 0x7fb7300c32d0 2023-10-24T00:45:12.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb735141700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb730157520 con 0x7fb7301541b0 2023-10-24T00:45:12.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb734940700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb734940700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48190/0 (socket says 172.21.15.148:48190) 2023-10-24T00:45:12.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb734940700 1 -- 172.21.15.148:0/4146481425 learned_addr learned my addr 172.21.15.148:0/4146481425 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:12.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb72ffff700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7300c32d0 0x7fb730154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.191+0000 7fb72f7fe700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7301541b0 0x7fb7301567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7301541b0 msgr2=0x7fb7301567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7301541b0 0x7fb7301567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7300c32d0 msgr2=0x7fb730154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7300c32d0 0x7fb730154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 -- 172.21.15.148:0/4146481425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009ae0 con 0x7fb730154590 2023-10-24T00:45:12.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb734940700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fb73005f5d0 tx=0x7fb728009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800be00 con 0x7fb730154590 2023-10-24T00:45:12.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280092e0 con 0x7fb730154590 2023-10-24T00:45:12.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72801c610 con 0x7fb730154590 2023-10-24T00:45:12.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb730157800 con 0x7fb730154590 2023-10-24T00:45:12.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.192+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb730155280 con 0x7fb730154590 2023-10-24T00:45:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.193+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb72801c980 con 0x7fb730154590 2023-10-24T00:45:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.193+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7300a8810 con 0x7fb730154590 2023-10-24T00:45:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.194+0000 7fb717fff700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 0x7fb71c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.194+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fb72807c000 con 0x7fb730154590 2023-10-24T00:45:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.194+0000 7fb72ffff700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 msgr2=0x7fb71c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.194+0000 7fb72ffff700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 0x7fb71c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:12.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.198+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb7280508f0 con 0x7fb730154590 2023-10-24T00:45:12.256 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:12.244+0000 7f452fbea680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:12.308 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:12.299+0000 7f63c6d59680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:12.318 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:12.316+0000 7f452fbea680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:12.374 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:12.373+0000 7f63c6d59680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.395+0000 7fb72ffff700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 msgr2=0x7fb71c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:12.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.395+0000 7fb72ffff700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 0x7fb71c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.400+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb730047480 con 0x7fb730154590 2023-10-24T00:45:12.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.400+0000 7fb717fff700 1 -- 172.21.15.148:0/4146481425 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb7280504e0 con 0x7fb730154590 2023-10-24T00:45:12.403 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:45:12.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 msgr2=0x7fb71c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 0x7fb71c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 msgr2=0x7fb7301645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fb73005f5d0 tx=0x7fb728009840).stop 2023-10-24T00:45:12.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 shutdown_connections 2023-10-24T00:45:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb71c05f300 0x7fb71c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb730154590 0x7fb7301645f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7300c32d0 0x7fb730154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 --2- 172.21.15.148:0/4146481425 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7301541b0 0x7fb7301567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.402+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 >> 172.21.15.148:0/4146481425 conn(0x7fb7300c86e0 msgr2=0x7fb7300bd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.403+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 shutdown_connections 2023-10-24T00:45:12.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.403+0000 7fb735141700 1 -- 172.21.15.148:0/4146481425 wait complete. 2023-10-24T00:45:12.416 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:45:12.504 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:12.502+0000 7f452fbea680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:12.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.537+0000 7fdeb0b5f700 1 Processor -- start 2023-10-24T00:45:12.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.537+0000 7fdeb0b5f700 1 -- start start 2023-10-24T00:45:12.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeb0b5f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdeac1541c0 0x7fdeac065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeb0b5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 0x7fdeac0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeb0b5f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0c7c80 con 0x7fdeac1545a0 2023-10-24T00:45:12.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeb0b5f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac0c7070 con 0x7fdeac1541c0 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeb0b5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c7350 con 0x7fdeac0c6be0 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeabfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdeac1545a0 0x7fdeac0be790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36274/0 (socket says 172.21.15.148:36274) 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeabfff700 1 -- 172.21.15.148:0/1501648776 learned_addr learned my addr 172.21.15.148:0/1501648776 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1501648776 >> v2:172.21.15.150:3300/0 conn(0x7fdeac1541c0 0x7fdeac065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdea3fff700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 0x7fdeac0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.538+0000 7fdeaaffd700 1 -- 172.21.15.148:0/1501648776 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080297583 0 0) 0x7fdeac0c7c80 con 0x7fdeac1545a0 2023-10-24T00:45:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeaaffd700 1 -- 172.21.15.148:0/1501648776 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde980033f0 con 0x7fdeac1545a0 2023-10-24T00:45:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 msgr2=0x7fdeac0a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 0x7fdeac0a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1501648776 >> v1:172.21.15.148:6789/0 conn(0x7fdeac1545a0 legacy=0x7fdeac0be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1501648776 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c7630 con 0x7fdeac1541c0 2023-10-24T00:45:12.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdea3fff700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 0x7fdeac0a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:12.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac1541c0 0x7fdeac065200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fde9c009760 tx=0x7fde9c009060).ready entity=mon.1 client_cookie=608eef810de1e994 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeaaffd700 1 -- 172.21.15.148:0/1501648776 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00d4a0 con 0x7fdeac1541c0 2023-10-24T00:45:12.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeaaffd700 1 -- 172.21.15.148:0/1501648776 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00d600 con 0x7fdeac1541c0 2023-10-24T00:45:12.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.539+0000 7fdeaaffd700 1 -- 172.21.15.148:0/1501648776 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00d980 con 0x7fdeac1541c0 2023-10-24T00:45:12.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac1541c0 msgr2=0x7fdeac065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac1541c0 0x7fdeac065200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fde9c009760 tx=0x7fde9c009060).stop 2023-10-24T00:45:12.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1501648776 shutdown_connections 2023-10-24T00:45:12.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac1541c0 0x7fdeac065200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1501648776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac0c6be0 0x7fdeac0a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1501648776 >> 172.21.15.148:0/1501648776 conn(0x7fdeac092350 msgr2=0x7fdeac062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1501648776 shutdown_connections 2023-10-24T00:45:12.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.540+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1501648776 wait complete. 2023-10-24T00:45:12.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.541+0000 7fdeb0b5f700 1 Processor -- start 2023-10-24T00:45:12.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.541+0000 7fdeb0b5f700 1 -- start start 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac1545a0 0x7fdeac0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0c94d0 0x7fdeac0c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac158b20 con 0x7fdeac1541c0 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14f950 con 0x7fdeac0c94d0 2023-10-24T00:45:12.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac164940 con 0x7fdeac1545a0 2023-10-24T00:45:12.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48204/0 (socket says 172.21.15.148:48204) 2023-10-24T00:45:12.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1363185619 learned_addr learned my addr 172.21.15.148:0/1363185619 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:12.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdea3fff700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac1545a0 0x7fdeac0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeabfff700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0c94d0 0x7fdeac0c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac1545a0 msgr2=0x7fdeac0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac1545a0 0x7fdeac0c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0c94d0 msgr2=0x7fdeac0c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0c94d0 0x7fdeac0c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 -- 172.21.15.148:0/1363185619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940092a0 con 0x7fdeac1541c0 2023-10-24T00:45:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeab7fe700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fde9c009d50 tx=0x7fde9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c021070 con 0x7fdeac1541c0 2023-10-24T00:45:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c000bc0 con 0x7fdeac1541c0 2023-10-24T00:45:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c0092a0 con 0x7fdeac1541c0 2023-10-24T00:45:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00d980 con 0x7fdeac1541c0 2023-10-24T00:45:12.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.542+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0c5fc0 con 0x7fdeac1541c0 2023-10-24T00:45:12.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.543+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac047480 con 0x7fdeac1541c0 2023-10-24T00:45:12.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.544+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fde9c01d640 con 0x7fdeac1541c0 2023-10-24T00:45:12.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.544+0000 7fdea37fe700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 0x7fde8c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.544+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fde9c07ba20 con 0x7fdeac1541c0 2023-10-24T00:45:12.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.544+0000 7fdea3fff700 1 -- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 msgr2=0x7fde8c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:12.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.544+0000 7fdea3fff700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 0x7fde8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:12.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.548+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde9c04c9f0 con 0x7fdeac1541c0 2023-10-24T00:45:12.571 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:12.570+0000 7f63c6d59680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.717+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdeac06a7c0 con 0x7fdeac1541c0 2023-10-24T00:45:12.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.718+0000 7fdea37fe700 1 -- 172.21.15.148:0/1363185619 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde9c050010 con 0x7fdeac1541c0 2023-10-24T00:45:12.720 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:45:12.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 msgr2=0x7fde8c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:12.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 0x7fde8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 msgr2=0x7fdeac151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fde9c009d50 tx=0x7fde9c016000).stop 2023-10-24T00:45:12.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 shutdown_connections 2023-10-24T00:45:12.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeac0c94d0 0x7fdeac0c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fde8c05f300 0x7fde8c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:12.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeac1541c0 0x7fdeac151820 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 --2- 172.21.15.148:0/1363185619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeac1545a0 0x7fdeac0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 >> 172.21.15.148:0/1363185619 conn(0x7fdeac092350 msgr2=0x7fdeac0ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 shutdown_connections 2023-10-24T00:45:12.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.720+0000 7fdeb0b5f700 1 -- 172.21.15.148:0/1363185619 wait complete. 2023-10-24T00:45:12.734 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:45:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.856+0000 7fa76f183700 1 Processor -- start 2023-10-24T00:45:12.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.856+0000 7fa76f183700 1 -- start start 2023-10-24T00:45:12.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.857+0000 7fa76f183700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa7680a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.857+0000 7fa76f183700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680659b0 con 0x7fa7680a4d30 2023-10-24T00:45:12.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.857+0000 7fa76f183700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa768065e40 con 0x7fa768158690 2023-10-24T00:45:12.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.857+0000 7fa76f183700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768064da0 con 0x7fa7680a6b10 2023-10-24T00:45:12.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa767fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa7680a4d30 0x7fa768157f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36280/0 (socket says 172.21.15.148:36280) 2023-10-24T00:45:12.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa767fff700 1 -- 172.21.15.148:0/2127411820 learned_addr learned my addr 172.21.15.148:0/2127411820 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa76cf1f700 1 --2- 172.21.15.148:0/2127411820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa7680a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580341786 0 0) 0x7fa7680659b0 con 0x7fa7680a4d30 2023-10-24T00:45:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7580033f0 con 0x7fa7680a4d30 2023-10-24T00:45:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234162647 0 0) 0x7fa768065e40 con 0x7fa768158690 2023-10-24T00:45:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7680659b0 con 0x7fa768158690 2023-10-24T00:45:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa76cf1f700 1 -- 172.21.15.148:0/2127411820 >> v1:172.21.15.150:6789/0 conn(0x7fa768158690 legacy=0x7fa768062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa76cf1f700 1 -- 172.21.15.148:0/2127411820 >> v1:172.21.15.148:6789/0 conn(0x7fa7680a4d30 legacy=0x7fa768157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa76cf1f700 1 -- 172.21.15.148:0/2127411820 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768065080 con 0x7fa7680a6b10 2023-10-24T00:45:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa76cf1f700 1 --2- 172.21.15.148:0/2127411820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa7680a4840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa75c009790 tx=0x7fa75c009060).ready entity=mon.2 client_cookie=4076debc7657df10 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0090d0 con 0x7fa7680a6b10 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00f510 con 0x7fa7680a6b10 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.858+0000 7fa7677fe700 1 -- 172.21.15.148:0/2127411820 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00f890 con 0x7fa7680a6b10 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 -- 172.21.15.148:0/2127411820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 msgr2=0x7fa7680a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 --2- 172.21.15.148:0/2127411820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa7680a4840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa75c009790 tx=0x7fa75c009060).stop 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 -- 172.21.15.148:0/2127411820 shutdown_connections 2023-10-24T00:45:12.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 --2- 172.21.15.148:0/2127411820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa7680a4840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 -- 172.21.15.148:0/2127411820 >> 172.21.15.148:0/2127411820 conn(0x7fa7680c3f60 msgr2=0x7fa7680c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 -- 172.21.15.148:0/2127411820 shutdown_connections 2023-10-24T00:45:12.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.859+0000 7fa76f183700 1 -- 172.21.15.148:0/2127411820 wait complete. 2023-10-24T00:45:12.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.860+0000 7fa76f183700 1 Processor -- start 2023-10-24T00:45:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.860+0000 7fa76f183700 1 -- start start 2023-10-24T00:45:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa768148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa768158690 0x7fa7681536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680aa980 con 0x7fa7680a4d30 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768154220 con 0x7fa768158690 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76f183700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768154500 con 0x7fa7680a6b10 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48216/0 (socket says 172.21.15.148:48216) 2023-10-24T00:45:12.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 -- 172.21.15.148:0/3113903590 learned_addr learned my addr 172.21.15.148:0/3113903590 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76d720700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa768158690 0x7fa7681536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa767fff700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa768148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 -- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 msgr2=0x7fa768148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa768148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 -- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa768158690 msgr2=0x7fa7681536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.861+0000 7fa76cf1f700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa768158690 0x7fa7681536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa76cf1f700 1 -- 172.21.15.148:0/3113903590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0092a0 con 0x7fa7680a4d30 2023-10-24T00:45:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa76cf1f700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fa76806be90 tx=0x7fa75c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00f890 con 0x7fa7680a4d30 2023-10-24T00:45:12.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00fc50 con 0x7fa7680a4d30 2023-10-24T00:45:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c01b410 con 0x7fa7680a4d30 2023-10-24T00:45:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7681547e0 con 0x7fa7680a4d30 2023-10-24T00:45:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.862+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7680ad490 con 0x7fa7680a4d30 2023-10-24T00:45:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.863+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76806c6b0 con 0x7fa7680a4d30 2023-10-24T00:45:12.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.863+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa75c01b780 con 0x7fa7680a4d30 2023-10-24T00:45:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.864+0000 7fa764ff9700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 0x7fa74c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.864+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fa75c07be60 con 0x7fa7680a4d30 2023-10-24T00:45:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.864+0000 7fa767fff700 1 -- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 msgr2=0x7fa74c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:12.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.864+0000 7fa767fff700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 0x7fa74c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:12.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:12.868+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa75c04ce30 con 0x7fa7680a4d30 2023-10-24T00:45:12.925 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:12.923+0000 7f452fbea680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:13.011 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.009+0000 7f63c6d59680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:13.028 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.026+0000 7f452fbea680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:13.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.041+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa768065360 con 0x7fa7680a4d30 2023-10-24T00:45:13.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.041+0000 7fa764ff9700 1 -- 172.21.15.148:0/3113903590 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa75c050450 con 0x7fa7680a4d30 2023-10-24T00:45:13.043 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:45:13.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 msgr2=0x7fa74c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:13.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 0x7fa74c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 msgr2=0x7fa7680a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fa76806be90 tx=0x7fa75c017000).stop 2023-10-24T00:45:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 shutdown_connections 2023-10-24T00:45:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa768158690 0x7fa7681536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa74c05f300 0x7fa74c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7680a4d30 0x7fa7680a71a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 --2- 172.21.15.148:0/3113903590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7680a6b10 0x7fa768148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 >> 172.21.15.148:0/3113903590 conn(0x7fa7680c3f60 msgr2=0x7fa7680c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 shutdown_connections 2023-10-24T00:45:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.043+0000 7fa76f183700 1 -- 172.21.15.148:0/3113903590 wait complete. 2023-10-24T00:45:13.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:45:13.121 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.120+0000 7f63c6d59680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:13.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.175+0000 7f56b7c54700 1 Processor -- start 2023-10-24T00:45:13.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.176+0000 7f56b7c54700 1 -- start start 2023-10-24T00:45:13.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.176+0000 7f56b7c54700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f56b00a6b10 0x7f56b00a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b7c54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b7c54700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00659b0 con 0x7f56b0158470 2023-10-24T00:45:13.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b7c54700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b0158900 con 0x7f56b00a6b10 2023-10-24T00:45:13.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b7c54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0065e40 con 0x7f56b00a4d30 2023-10-24T00:45:13.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f56b00a6b10 0x7f56b00a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b61f1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f56b0158470 0x7f56b0154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36288/0 (socket says 172.21.15.148:36288) 2023-10-24T00:45:13.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b61f1700 1 -- 172.21.15.148:0/2332962056 learned_addr learned my addr 172.21.15.148:0/2332962056 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:13.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b51ef700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b49ee700 1 -- 172.21.15.148:0/2332962056 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467912471 0 0) 0x7f56b00659b0 con 0x7f56b0158470 2023-10-24T00:45:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b49ee700 1 -- 172.21.15.148:0/2332962056 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c0033f0 con 0x7f56b0158470 2023-10-24T00:45:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 -- 172.21.15.148:0/2332962056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 msgr2=0x7f56b0157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 -- 172.21.15.148:0/2332962056 >> v1:172.21.15.148:6789/0 conn(0x7f56b0158470 legacy=0x7f56b0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 -- 172.21.15.148:0/2332962056 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0064da0 con 0x7f56b00a6b10 2023-10-24T00:45:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b59f0700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00a4840 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f56a0009760 tx=0x7f56a0009060).ready entity=mon.0 client_cookie=78274f5ed8fc51f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b49ee700 1 -- 172.21.15.148:0/2332962056 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a00090d0 con 0x7f56b00a6b10 2023-10-24T00:45:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b49ee700 1 -- 172.21.15.148:0/2332962056 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000d4a0 con 0x7f56b00a6b10 2023-10-24T00:45:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.177+0000 7f56b49ee700 1 -- 172.21.15.148:0/2332962056 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000d820 con 0x7f56b00a6b10 2023-10-24T00:45:13.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 -- 172.21.15.148:0/2332962056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 msgr2=0x7f56b00a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00a4840 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f56a0009760 tx=0x7f56a0009060).stop 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 -- 172.21.15.148:0/2332962056 shutdown_connections 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00a4840 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 --2- 172.21.15.148:0/2332962056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 -- 172.21.15.148:0/2332962056 >> 172.21.15.148:0/2332962056 conn(0x7f56b00c3f60 msgr2=0x7f56b00c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 -- 172.21.15.148:0/2332962056 shutdown_connections 2023-10-24T00:45:13.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.178+0000 7f56b7c54700 1 -- 172.21.15.148:0/2332962056 wait complete. 2023-10-24T00:45:13.185 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.180+0000 7f452fbea680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.179+0000 7f56b7c54700 1 Processor -- start 2023-10-24T00:45:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.179+0000 7f56b7c54700 1 -- start start 2023-10-24T00:45:13.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b0158470 0x7f56b00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00aaff0 con 0x7f56b00a6b10 2023-10-24T00:45:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0155150 con 0x7f56b0158470 2023-10-24T00:45:13.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b7c54700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00abde0 con 0x7f56b00a4d30 2023-10-24T00:45:13.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48232/0 (socket says 172.21.15.148:48232) 2023-10-24T00:45:13.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 -- 172.21.15.148:0/3085104925 learned_addr learned my addr 172.21.15.148:0/3085104925 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:13.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b59f0700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b61f1700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b0158470 0x7f56b00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 -- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 msgr2=0x7f56b0140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 -- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b0158470 msgr2=0x7f56b00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b0158470 0x7f56b00aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.180+0000 7f56b51ef700 1 -- 172.21.15.148:0/3085104925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00092a0 con 0x7f56b00a6b10 2023-10-24T00:45:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56b51ef700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f56ac00e900 tx=0x7f56ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac012600 con 0x7f56b00a6b10 2023-10-24T00:45:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac012760 con 0x7f56b00a6b10 2023-10-24T00:45:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b00ab1d0 con 0x7f56b00a6b10 2023-10-24T00:45:13.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac012ae0 con 0x7f56b00a6b10 2023-10-24T00:45:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.181+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b00ab560 con 0x7f56b00a6b10 2023-10-24T00:45:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.182+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f56ac01b400 con 0x7f56b00a6b10 2023-10-24T00:45:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.182+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b006c6b0 con 0x7f56b00a6b10 2023-10-24T00:45:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.182+0000 7f56a5ffb700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 0x7f56940617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.183+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f56ac07a840 con 0x7f56b00a6b10 2023-10-24T00:45:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.183+0000 7f56b59f0700 1 -- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 msgr2=0x7f56940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.183+0000 7f56b59f0700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 0x7f56940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:13.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.187+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f56ac04b7b0 con 0x7f56b00a6b10 2023-10-24T00:45:13.257 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.254+0000 7f452fbea680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:13.292 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.291+0000 7f63c6d59680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:13.324 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.321+0000 7f452fbea680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:13.367 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.366+0000 7f63c6d59680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:13.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.368+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56b0065080 con 0x7f56b00a6b10 2023-10-24T00:45:13.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.369+0000 7f56a5ffb700 1 -- 172.21.15.148:0/3085104925 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56ac04edd0 con 0x7f56b00a6b10 2023-10-24T00:45:13.370 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:45:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 msgr2=0x7f56940617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 0x7f56940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 msgr2=0x7f56b00aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f56ac00e900 tx=0x7f56ac009060).stop 2023-10-24T00:45:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 shutdown_connections 2023-10-24T00:45:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56b0158470 0x7f56b00aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56b00a4d30 0x7f56b0140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f569405f300 0x7f56940617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 --2- 172.21.15.148:0/3085104925 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56b00a6b10 0x7f56b00aa610 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 >> 172.21.15.148:0/3085104925 conn(0x7f56b00c3f60 msgr2=0x7f56b0062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 shutdown_connections 2023-10-24T00:45:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.371+0000 7f56b7c54700 1 -- 172.21.15.148:0/3085104925 wait complete. 2023-10-24T00:45:13.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:13.440 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.439+0000 7f63c6d59680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:13.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.501+0000 7f2e1f495700 1 Processor -- start 2023-10-24T00:45:13.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.501+0000 7f2e1f495700 1 -- start start 2023-10-24T00:45:13.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1f495700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2e180c07e0 0x7f2e180c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1f495700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e180c68a0 0x7f2e180c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1f495700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180c1180 con 0x7f2e180aa140 2023-10-24T00:45:13.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1f495700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e180c6410 con 0x7f2e180c68a0 2023-10-24T00:45:13.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1f495700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e180ca6e0 con 0x7f2e180c07e0 2023-10-24T00:45:13.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e180c68a0 0x7f2e180c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2e180c68a0 0x7f2e180c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33696/0 (socket says 172.21.15.148:33696) 2023-10-24T00:45:13.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 -- 172.21.15.148:0/413463553 learned_addr learned my addr 172.21.15.148:0/413463553 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:13.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1dc92700 1 --2- 172.21.15.148:0/413463553 >> v2:172.21.15.150:3300/0 conn(0x7f2e180c07e0 0x7f2e180c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 -- 172.21.15.148:0/413463553 >> v2:172.21.15.150:3300/0 conn(0x7f2e180c07e0 msgr2=0x7f2e180c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:13.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 --2- 172.21.15.148:0/413463553 >> v2:172.21.15.150:3300/0 conn(0x7f2e180c07e0 0x7f2e180c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 -- 172.21.15.148:0/413463553 >> v1:172.21.15.150:6789/0 conn(0x7f2e180aa140 legacy=0x7f2e180c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 -- 172.21.15.148:0/413463553 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180ca9c0 con 0x7f2e180c68a0 2023-10-24T00:45:13.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1ec94700 1 --2- 172.21.15.148:0/413463553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c68a0 0x7f2e180c6cd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f2e18085440 tx=0x7f2e10009840).ready entity=mon.0 client_cookie=83bdc4aa308029d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1d491700 1 -- 172.21.15.148:0/413463553 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000e070 con 0x7f2e180c68a0 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1d491700 1 -- 172.21.15.148:0/413463553 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000ba50 con 0x7f2e180c68a0 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.502+0000 7f2e1d491700 1 -- 172.21.15.148:0/413463553 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000bdd0 con 0x7f2e180c68a0 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 -- 172.21.15.148:0/413463553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c68a0 msgr2=0x7f2e180c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 --2- 172.21.15.148:0/413463553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c68a0 0x7f2e180c6cd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f2e18085440 tx=0x7f2e10009840).stop 2023-10-24T00:45:13.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 -- 172.21.15.148:0/413463553 shutdown_connections 2023-10-24T00:45:13.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 --2- 172.21.15.148:0/413463553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c68a0 0x7f2e180c6cd0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 --2- 172.21.15.148:0/413463553 >> v2:172.21.15.150:3300/0 conn(0x7f2e180c07e0 0x7f2e180c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 -- 172.21.15.148:0/413463553 >> 172.21.15.148:0/413463553 conn(0x7f2e180944a0 msgr2=0x7f2e1806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 -- 172.21.15.148:0/413463553 shutdown_connections 2023-10-24T00:45:13.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.503+0000 7f2e1f495700 1 -- 172.21.15.148:0/413463553 wait complete. 2023-10-24T00:45:13.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.504+0000 7f2e1f495700 1 Processor -- start 2023-10-24T00:45:13.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 -- start start 2023-10-24T00:45:13.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e180aa140 0x7f2e18152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e180c68a0 0x7f2e180c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18165800 con 0x7f2e180c07e0 2023-10-24T00:45:13.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18165620 con 0x7f2e180aa140 2023-10-24T00:45:13.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1f495700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18164a10 con 0x7f2e180c68a0 2023-10-24T00:45:13.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1dc92700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1dc92700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33708/0 (socket says 172.21.15.148:33708) 2023-10-24T00:45:13.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1dc92700 1 -- 172.21.15.148:0/1340920949 learned_addr learned my addr 172.21.15.148:0/1340920949 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.505+0000 7f2e1e493700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e180aa140 0x7f2e18152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1ec94700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e180c68a0 0x7f2e180c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e180c68a0 msgr2=0x7f2e180c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e180c68a0 0x7f2e180c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e180aa140 msgr2=0x7f2e18152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e180aa140 0x7f2e18152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 -- 172.21.15.148:0/1340920949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10009ae0 con 0x7f2e180c07e0 2023-10-24T00:45:13.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1dc92700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f2e0800d890 tx=0x7f2e08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011590 con 0x7f2e180c07e0 2023-10-24T00:45:13.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080116f0 con 0x7f2e180c07e0 2023-10-24T00:45:13.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e18164cf0 con 0x7f2e180c07e0 2023-10-24T00:45:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011a70 con 0x7f2e180c07e0 2023-10-24T00:45:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.506+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181652b0 con 0x7f2e180c07e0 2023-10-24T00:45:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.507+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e180aa520 con 0x7f2e180c07e0 2023-10-24T00:45:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.507+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2e0801c460 con 0x7f2e180c07e0 2023-10-24T00:45:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.508+0000 7f2e0e7fc700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 0x7f2dfc061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.508+0000 7f2e1e493700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 msgr2=0x7f2dfc061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.508+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f2e0807a2a0 con 0x7f2e180c07e0 2023-10-24T00:45:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.508+0000 7f2e1e493700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 0x7f2dfc061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.516+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2e180aa520 con 0x7f2e180c07e0 2023-10-24T00:45:13.580 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.578+0000 7f452fbea680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:13.709 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.708+0000 7f63c6d59680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:13.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.709+0000 7f2e1e493700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 msgr2=0x7f2dfc061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:13.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.709+0000 7f2e1e493700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 0x7f2dfc061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:13.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.724+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e180aa520 con 0x7f2e180c07e0 2023-10-24T00:45:13.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.725+0000 7f2e0e7fc700 1 -- 172.21.15.148:0/1340920949 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f2e180aa520 con 0x7f2e180c07e0 2023-10-24T00:45:13.727 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:13.727 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:45:13.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 msgr2=0x7f2dfc061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:13.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 0x7f2dfc061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 msgr2=0x7f2e180abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f2e0800d890 tx=0x7f2e08008040).stop 2023-10-24T00:45:13.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 shutdown_connections 2023-10-24T00:45:13.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e180c68a0 0x7f2e180c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e180aa140 0x7f2e18152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2dfc05f2d0 0x7f2dfc061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:13.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 --2- 172.21.15.148:0/1340920949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e180c07e0 0x7f2e180abfd0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 >> 172.21.15.148:0/1340920949 conn(0x7f2e180944a0 msgr2=0x7f2e180a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 shutdown_connections 2023-10-24T00:45:13.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.727+0000 7f2e1f495700 1 -- 172.21.15.148:0/1340920949 wait complete. 2023-10-24T00:45:13.733 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:45:13.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:13.769 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:13.765+0000 7f452fbea680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:13.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.860+0000 7f77fe8ec700 1 Processor -- start 2023-10-24T00:45:13.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.860+0000 7f77fe8ec700 1 -- start start 2023-10-24T00:45:13.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.860+0000 7f77fe8ec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77f80c6710 0x7f77f80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77fe8ec700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80aa820 con 0x7f77f80aa010 2023-10-24T00:45:13.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77fe8ec700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80c0960 con 0x7f77f80aa3f0 2023-10-24T00:45:13.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77fe8ec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80c0c40 con 0x7f77f80c6710 2023-10-24T00:45:13.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f77f80aa010 0x7f77f8158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39010/0 (socket says 172.21.15.148:39010) 2023-10-24T00:45:13.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f7fff700 1 -- 172.21.15.148:0/2577241743 learned_addr learned my addr 172.21.15.148:0/2577241743 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:13.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f77fe700 1 --2- 172.21.15.148:0/2577241743 >> v2:172.21.15.150:3300/0 conn(0x7f77f80c6710 0x7f77f80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243718015 0 0) 0x7f77f80aa820 con 0x7f77f80aa010 2023-10-24T00:45:13.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e00033f0 con 0x7f77f80aa010 2023-10-24T00:45:13.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655605039 0 0) 0x7f77f80c0960 con 0x7f77f80aa3f0 2023-10-24T00:45:13.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f80aa820 con 0x7f77f80aa3f0 2023-10-24T00:45:13.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f77fe700 1 -- 172.21.15.148:0/2577241743 >> v1:172.21.15.150:6789/0 conn(0x7f77f80aa3f0 legacy=0x7f77f8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f77fe700 1 -- 172.21.15.148:0/2577241743 >> v1:172.21.15.148:6789/0 conn(0x7f77f80aa010 legacy=0x7f77f8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f77fe700 1 -- 172.21.15.148:0/2577241743 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80c0f20 con 0x7f77f80c6710 2023-10-24T00:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f77fe700 1 --2- 172.21.15.148:0/2577241743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80c6710 0x7f77f80c1a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f77ec009760 tx=0x7f77ec009060).ready entity=mon.1 client_cookie=a99056765ffa5ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.861+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00d4a0 con 0x7f77f80c6710 2023-10-24T00:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00d600 con 0x7f77f80c6710 2023-10-24T00:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77f6ffd700 1 -- 172.21.15.148:0/2577241743 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00d980 con 0x7f77f80c6710 2023-10-24T00:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2577241743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80c6710 msgr2=0x7f77f80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2577241743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80c6710 0x7f77f80c1a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f77ec009760 tx=0x7f77ec009060).stop 2023-10-24T00:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2577241743 shutdown_connections 2023-10-24T00:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2577241743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80c6710 0x7f77f80c1a00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2577241743 >> 172.21.15.148:0/2577241743 conn(0x7f77f80caf40 msgr2=0x7f77f80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:13.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2577241743 shutdown_connections 2023-10-24T00:45:13.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.862+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2577241743 wait complete. 2023-10-24T00:45:13.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.863+0000 7f77fe8ec700 1 Processor -- start 2023-10-24T00:45:13.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 -- start start 2023-10-24T00:45:13.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 0x7f77f814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f80aa3f0 0x7f77f8155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80af280 con 0x7f77f80c6710 2023-10-24T00:45:13.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f813c2d0 con 0x7f77f80aa010 2023-10-24T00:45:13.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fe8ec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80ae670 con 0x7f77f80aa3f0 2023-10-24T00:45:13.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.864+0000 7f77fce89700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77f7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 0x7f77f814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33724/0 (socket says 172.21.15.148:33724) 2023-10-24T00:45:13.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 -- 172.21.15.148:0/2753815947 learned_addr learned my addr 172.21.15.148:0/2753815947 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:13.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77f77fe700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f80aa3f0 0x7f77f8155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:13.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 -- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f80aa3f0 msgr2=0x7f77f8155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f80aa3f0 0x7f77f8155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 -- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 msgr2=0x7f77f814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:13.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 0x7f77f814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:13.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 -- 172.21.15.148:0/2753815947 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0092a0 con 0x7f77f80c6710 2023-10-24T00:45:13.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77f7fff700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 0x7f77f814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:13.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fce89700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f77f000c740 tx=0x7f77f000ca50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:13.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000e4a0 con 0x7f77f80c6710 2023-10-24T00:45:13.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000e600 con 0x7f77f80c6710 2023-10-24T00:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80ae950 con 0x7f77f80c6710 2023-10-24T00:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000e980 con 0x7f77f80c6710 2023-10-24T00:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.865+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f80aef10 con 0x7f77f80c6710 2023-10-24T00:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.866+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f80af3f0 con 0x7f77f80c6710 2023-10-24T00:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.867+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f77f0012400 con 0x7f77f80c6710 2023-10-24T00:45:13.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.867+0000 7f77dffff700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 0x7f77e40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:13.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.868+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f77f0079c00 con 0x7f77f80c6710 2023-10-24T00:45:13.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.868+0000 7f77f7fff700 1 -- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 msgr2=0x7f77e40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:13.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.868+0000 7f77f7fff700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 0x7f77e40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:13.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:13.872+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f77f0048af0 con 0x7f77f80c6710 2023-10-24T00:45:13.905 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:13.903+0000 7f63c6d59680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.047+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77f806c6b0 con 0x7f77f80c6710 2023-10-24T00:45:14.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.048+0000 7f77dffff700 1 -- 172.21.15.148:0/2753815947 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17351 (secure 0 0 0) 0x7f77f0017070 con 0x7f77f80c6710 2023-10-24T00:45:14.051 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:14.051 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":97,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:09.086232+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/823834847":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6833/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/3639739776":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2863574378":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2981343771":"2023-10-25T00:45:09.086183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:14.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 msgr2=0x7f77e40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:14.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 0x7f77e40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 msgr2=0x7f77f8155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f77f000c740 tx=0x7f77f000ca50).stop 2023-10-24T00:45:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 shutdown_connections 2023-10-24T00:45:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f77e405f300 0x7f77e40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f80c6710 0x7f77f8155d00 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f80aa010 0x7f77f814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 --2- 172.21.15.148:0/2753815947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f80aa3f0 0x7f77f8155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.050+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 >> 172.21.15.148:0/2753815947 conn(0x7f77f80caf40 msgr2=0x7f77f8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.051+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 shutdown_connections 2023-10-24T00:45:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.051+0000 7f77fe8ec700 1 -- 172.21.15.148:0/2753815947 wait complete. 2023-10-24T00:45:14.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:45:14.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:14.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.182+0000 7f78b1986700 1 Processor -- start 2023-10-24T00:45:14.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.182+0000 7f78b1986700 1 -- start start 2023-10-24T00:45:14.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78b1986700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78ac0c1a50 0x7f78ac15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78b1986700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac155710 con 0x7f78ac154820 2023-10-24T00:45:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78b1986700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac154e70 con 0x7f78ac151cb0 2023-10-24T00:45:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78b1986700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac155150 con 0x7f78ac0c1a50 2023-10-24T00:45:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78ab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78ac0c1a50 0x7f78ac15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78aa7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f78ac154820 0x7f78ac0a9e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39016/0 (socket says 172.21.15.148:39016) 2023-10-24T00:45:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78aa7fc700 1 -- 172.21.15.148:0/2491766079 learned_addr learned my addr 172.21.15.148:0/2491766079 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78ab7fe700 1 -- 172.21.15.148:0/2491766079 >> v1:172.21.15.150:6789/0 conn(0x7f78ac151cb0 legacy=0x7f78ac06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78ab7fe700 1 -- 172.21.15.148:0/2491766079 >> v1:172.21.15.148:6789/0 conn(0x7f78ac154820 legacy=0x7f78ac0a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78a9ffb700 1 -- 172.21.15.148:0/2491766079 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017951911 0 0) 0x7f78ac155710 con 0x7f78ac154820 2023-10-24T00:45:14.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78ab7fe700 1 -- 172.21.15.148:0/2491766079 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac155430 con 0x7f78ac0c1a50 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78ab7fe700 1 --2- 172.21.15.148:0/2491766079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac15edc0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f78a4009e60 tx=0x7f78a4009780).ready entity=mon.0 client_cookie=a09cb7869f399251 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78a9ffb700 1 -- 172.21.15.148:0/2491766079 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400e070 con 0x7f78ac0c1a50 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78a9ffb700 1 -- 172.21.15.148:0/2491766079 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400bc30 con 0x7f78ac0c1a50 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.183+0000 7f78a9ffb700 1 -- 172.21.15.148:0/2491766079 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4012410 con 0x7f78ac0c1a50 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 -- 172.21.15.148:0/2491766079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 msgr2=0x7f78ac15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 --2- 172.21.15.148:0/2491766079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac15edc0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f78a4009e60 tx=0x7f78a4009780).stop 2023-10-24T00:45:14.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 -- 172.21.15.148:0/2491766079 shutdown_connections 2023-10-24T00:45:14.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 --2- 172.21.15.148:0/2491766079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac15edc0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 -- 172.21.15.148:0/2491766079 >> 172.21.15.148:0/2491766079 conn(0x7f78ac0caf40 msgr2=0x7f78ac0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 -- 172.21.15.148:0/2491766079 shutdown_connections 2023-10-24T00:45:14.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.184+0000 7f78b1986700 1 -- 172.21.15.148:0/2491766079 wait complete. 2023-10-24T00:45:14.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.185+0000 7f78b1986700 1 Processor -- start 2023-10-24T00:45:14.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.185+0000 7f78b1986700 1 -- start start 2023-10-24T00:45:14.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ac151cb0 0x7f78ac0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ac154820 0x7f78ac1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0ab330 con 0x7f78ac0c1a50 2023-10-24T00:45:14.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac13c750 con 0x7f78ac154820 2023-10-24T00:45:14.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78b1986700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac0b0810 con 0x7f78ac151cb0 2023-10-24T00:45:14.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33730/0 (socket says 172.21.15.148:33730) 2023-10-24T00:45:14.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 -- 172.21.15.148:0/3534309424 learned_addr learned my addr 172.21.15.148:0/3534309424 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:14.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78ab7fe700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ac154820 0x7f78ac1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aa7fc700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ac151cb0 0x7f78ac0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ac151cb0 msgr2=0x7f78ac0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ac151cb0 0x7f78ac0adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ac154820 msgr2=0x7f78ac1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ac154820 0x7f78ac1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 -- 172.21.15.148:0/3534309424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009a20 con 0x7f78ac0c1a50 2023-10-24T00:45:14.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.186+0000 7f78aaffd700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f789c00c4c0 tx=0x7f789c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.187+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ce70 con 0x7f78ac0c1a50 2023-10-24T00:45:14.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.187+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c001e90 con 0x7f78ac0c1a50 2023-10-24T00:45:14.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.187+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c007270 con 0x7f78ac0c1a50 2023-10-24T00:45:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.187+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac0b0af0 con 0x7f78ac0c1a50 2023-10-24T00:45:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.187+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac0aafc0 con 0x7f78ac0c1a50 2023-10-24T00:45:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.188+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac06c6b0 con 0x7f78ac0c1a50 2023-10-24T00:45:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.188+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f789c0066a0 con 0x7f78ac0c1a50 2023-10-24T00:45:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.188+0000 7f7892ffd700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 0x7f78980617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.189+0000 7f78aa7fc700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 msgr2=0x7f78980617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:14.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.189+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f789c079d40 con 0x7f78ac0c1a50 2023-10-24T00:45:14.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.189+0000 7f78aa7fc700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 0x7f78980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:14.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.196+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f789c04ad10 con 0x7f78ac0c1a50 2023-10-24T00:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.390+0000 7f78aa7fc700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 msgr2=0x7f78980617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.390+0000 7f78aa7fc700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 0x7f78980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.409+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78ac0c0520 con 0x7f78ac0c1a50 2023-10-24T00:45:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.410+0000 7f7892ffd700 1 -- 172.21.15.148:0/3534309424 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f789c04e330 con 0x7f78ac0c1a50 2023-10-24T00:45:14.412 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:14.412 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:45:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 msgr2=0x7f78980617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 0x7f78980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 msgr2=0x7f78ac13c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f789c00c4c0 tx=0x7f789c007e00).stop 2023-10-24T00:45:14.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 shutdown_connections 2023-10-24T00:45:14.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78ac154820 0x7f78ac1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789805f300 0x7f78980617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78ac0c1a50 0x7f78ac13c260 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 --2- 172.21.15.148:0/3534309424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78ac151cb0 0x7f78ac0adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 >> 172.21.15.148:0/3534309424 conn(0x7f78ac0caf40 msgr2=0x7f78ac0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 shutdown_connections 2023-10-24T00:45:14.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.412+0000 7f78b1986700 1 -- 172.21.15.148:0/3534309424 wait complete. 2023-10-24T00:45:14.417 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:45:14.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.420+0000 7f452fbea680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:14.426 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:14.491 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.488+0000 7f452fbea680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.547+0000 7f2635250700 1 Processor -- start 2023-10-24T00:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.547+0000 7f2635250700 1 -- start start 2023-10-24T00:45:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f2635250700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2630150740 0x7f26300644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f2635250700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26300649a0 0x7f26301543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f2635250700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2630154d40 con 0x7f2630154890 2023-10-24T00:45:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f2635250700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300693d0 con 0x7f2630150740 2023-10-24T00:45:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f2635250700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300c6760 con 0x7f26300649a0 2023-10-24T00:45:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2630150740 0x7f26300644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262f59e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2630154890 0x7f2630069860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39024/0 (socket says 172.21.15.148:39024) 2023-10-24T00:45:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262f59e700 1 -- 172.21.15.148:0/3489592073 learned_addr learned my addr 172.21.15.148:0/3489592073 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262e59c700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26300649a0 0x7f26301543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 -- 172.21.15.148:0/3489592073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26300649a0 msgr2=0x7f26301543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:14.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26300649a0 0x7f26301543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 -- 172.21.15.148:0/3489592073 >> v1:172.21.15.148:6789/0 conn(0x7f2630154890 legacy=0x7f2630069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262dd9b700 1 -- 172.21.15.148:0/3489592073 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133323152 0 0) 0x7f2628001490 con 0x7f2630154890 2023-10-24T00:45:14.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 -- 172.21.15.148:0/3489592073 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630068d80 con 0x7f2630150740 2023-10-24T00:45:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262ed9d700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630150740 0x7f26300644b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f2620009760 tx=0x7f2620009060).ready entity=mon.0 client_cookie=9c0695b7f886dac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262dd9b700 1 -- 172.21.15.148:0/3489592073 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000b590 con 0x7f2630150740 2023-10-24T00:45:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262dd9b700 1 -- 172.21.15.148:0/3489592073 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000b6f0 con 0x7f2630150740 2023-10-24T00:45:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.548+0000 7f262dd9b700 1 -- 172.21.15.148:0/3489592073 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000ba70 con 0x7f2630150740 2023-10-24T00:45:14.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 -- 172.21.15.148:0/3489592073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630150740 msgr2=0x7f26300644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630150740 0x7f26300644b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f2620009760 tx=0x7f2620009060).stop 2023-10-24T00:45:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 -- 172.21.15.148:0/3489592073 shutdown_connections 2023-10-24T00:45:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630150740 0x7f26300644b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 --2- 172.21.15.148:0/3489592073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26300649a0 0x7f26301543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 -- 172.21.15.148:0/3489592073 >> 172.21.15.148:0/3489592073 conn(0x7f2630063120 msgr2=0x7f26300c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 -- 172.21.15.148:0/3489592073 shutdown_connections 2023-10-24T00:45:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.549+0000 7f2635250700 1 -- 172.21.15.148:0/3489592073 wait complete. 2023-10-24T00:45:14.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.550+0000 7f2635250700 1 Processor -- start 2023-10-24T00:45:14.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.550+0000 7f2635250700 1 -- start start 2023-10-24T00:45:14.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26300649a0 0x7f26301530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2630150740 0x7f2630151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26301535a0 con 0x7f2630154890 2023-10-24T00:45:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630152170 con 0x7f26300649a0 2023-10-24T00:45:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f2635250700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300a52a0 con 0x7f2630150740 2023-10-24T00:45:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33744/0 (socket says 172.21.15.148:33744) 2023-10-24T00:45:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 -- 172.21.15.148:0/2393943862 learned_addr learned my addr 172.21.15.148:0/2393943862 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262ed9d700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26300649a0 0x7f26301530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262e59c700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2630150740 0x7f2630151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2630150740 msgr2=0x7f2630151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2630150740 0x7f2630151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26300649a0 msgr2=0x7f26301530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26300649a0 0x7f26301530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.551+0000 7f262f59e700 1 -- 172.21.15.148:0/2393943862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200092a0 con 0x7f2630154890 2023-10-24T00:45:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f262f59e700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f262800c840 tx=0x7f26280014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628005d30 con 0x7f2630154890 2023-10-24T00:45:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628005e90 con 0x7f2630154890 2023-10-24T00:45:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630151f10 con 0x7f2630154890 2023-10-24T00:45:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280072e0 con 0x7f2630154890 2023-10-24T00:45:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.552+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300a4c50 con 0x7f2630154890 2023-10-24T00:45:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.553+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263006c6b0 con 0x7f2630154890 2023-10-24T00:45:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.553+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f26280076d0 con 0x7f2630154890 2023-10-24T00:45:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.553+0000 7f2616ffd700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 0x7f261c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.554+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f2628079db0 con 0x7f2630154890 2023-10-24T00:45:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.554+0000 7f262ed9d700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 msgr2=0x7f261c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:14.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.554+0000 7f262ed9d700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 0x7f261c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:14.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.558+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f262804ad80 con 0x7f2630154890 2023-10-24T00:45:14.569 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.564+0000 7f452fbea680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:14.598 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:14.596+0000 7f63c6d59680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:14.670 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:14.669+0000 7f63c6d59680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:14.715 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.711+0000 7f452fbea680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:14.748 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:14.746+0000 7f63c6d59680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:14.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.755+0000 7f262ed9d700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 msgr2=0x7f261c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:14.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.755+0000 7f262ed9d700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 0x7f261c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:14.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.776+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2630154d40 con 0x7f2630154890 2023-10-24T00:45:14.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.776+0000 7f2616ffd700 1 -- 172.21.15.148:0/2393943862 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f2630154d40 con 0x7f2630154890 2023-10-24T00:45:14.778 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:14.779 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:44:53.214771+0000","modified":"2023-10-24T00:44:55.221062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6732":{"gid":6732,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/193862178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":193862178},{"type":"v1","addr":"172.21.15.148:6835","nonce":193862178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-24T00:45:14.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 msgr2=0x7f261c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:14.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 0x7f261c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 msgr2=0x7f26300a66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f262800c840 tx=0x7f26280014d0).stop 2023-10-24T00:45:14.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 shutdown_connections 2023-10-24T00:45:14.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f261c05f300 0x7f261c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:14.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2630154890 0x7f26300a66a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26300649a0 0x7f26301530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 --2- 172.21.15.148:0/2393943862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2630150740 0x7f2630151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 >> 172.21.15.148:0/2393943862 conn(0x7f2630063120 msgr2=0x7f26300c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 shutdown_connections 2023-10-24T00:45:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.778+0000 7f2635250700 1 -- 172.21.15.148:0/2393943862 wait complete. 2023-10-24T00:45:14.783 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2023-10-24T00:45:14.784 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.782+0000 7f452fbea680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:14.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:14.900 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:14.897+0000 7f452fbea680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:14.906 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:14.905+0000 7f63c6d59680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.910+0000 7f2880795700 1 Processor -- start 2023-10-24T00:45:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.910+0000 7f2880795700 1 -- start start 2023-10-24T00:45:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f2880795700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2878150c80 0x7f2878151060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f2880795700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780c32f0 con 0x7f28780c2810 2023-10-24T00:45:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f2880795700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780c35d0 con 0x7f2878063e70 2023-10-24T00:45:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f2880795700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2878064d10 con 0x7f2878150c80 2023-10-24T00:45:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2878150c80 0x7f2878151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287dd30700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f28780c2810 0x7f2878063760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39030/0 (socket says 172.21.15.148:39030) 2023-10-24T00:45:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2878150c80 0x7f2878151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33756/0 (socket says 172.21.15.148:33756) 2023-10-24T00:45:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287dd30700 1 -- 172.21.15.148:0/3973345123 learned_addr learned my addr 172.21.15.148:0/3973345123 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 -- 172.21.15.148:0/3973345123 >> v1:172.21.15.150:6789/0 conn(0x7f2878063e70 legacy=0x7f2878065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 -- 172.21.15.148:0/3973345123 >> v1:172.21.15.148:6789/0 conn(0x7f28780c2810 legacy=0x7f2878063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 -- 172.21.15.148:0/3973345123 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780c38b0 con 0x7f2878150c80 2023-10-24T00:45:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287e531700 1 --2- 172.21.15.148:0/3973345123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878151060 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f2874009760 tx=0x7f2874009060).ready entity=mon.0 client_cookie=aa04b49e0dcbcb42 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.911+0000 7f287d52f700 1 -- 172.21.15.148:0/3973345123 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b580 con 0x7f2878150c80 2023-10-24T00:45:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f287d52f700 1 -- 172.21.15.148:0/3973345123 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b6e0 con 0x7f2878150c80 2023-10-24T00:45:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f287d52f700 1 -- 172.21.15.148:0/3973345123 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400ba60 con 0x7f2878150c80 2023-10-24T00:45:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 -- 172.21.15.148:0/3973345123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 msgr2=0x7f2878151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 --2- 172.21.15.148:0/3973345123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878151060 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f2874009760 tx=0x7f2874009060).stop 2023-10-24T00:45:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 -- 172.21.15.148:0/3973345123 shutdown_connections 2023-10-24T00:45:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 --2- 172.21.15.148:0/3973345123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878151060 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 -- 172.21.15.148:0/3973345123 >> 172.21.15.148:0/3973345123 conn(0x7f28780c7ee0 msgr2=0x7f28780c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 -- 172.21.15.148:0/3973345123 shutdown_connections 2023-10-24T00:45:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.912+0000 7f2880795700 1 -- 172.21.15.148:0/3973345123 wait complete. 2023-10-24T00:45:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.913+0000 7f2880795700 1 Processor -- start 2023-10-24T00:45:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.913+0000 7f2880795700 1 -- start start 2023-10-24T00:45:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2878063e70 0x7f2878151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28780c2810 0x7f287813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878140490 con 0x7f2878150c80 2023-10-24T00:45:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2878153650 con 0x7f28780c2810 2023-10-24T00:45:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f2880795700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28781531c0 con 0x7f2878063e70 2023-10-24T00:45:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f287ed32700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f287ed32700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33764/0 (socket says 172.21.15.148:33764) 2023-10-24T00:45:14.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f287ed32700 1 -- 172.21.15.148:0/718884690 learned_addr learned my addr 172.21.15.148:0/718884690 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f287e531700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2878063e70 0x7f2878151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.914+0000 7f287dd30700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28780c2810 0x7f287813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 -- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2878063e70 msgr2=0x7f2878151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2878063e70 0x7f2878151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 -- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28780c2810 msgr2=0x7f287813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28780c2810 0x7f287813ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 -- 172.21.15.148:0/718884690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740092a0 con 0x7f2878150c80 2023-10-24T00:45:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f287ed32700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f287000c7f0 tx=0x7f2870001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000e4a0 con 0x7f2878150c80 2023-10-24T00:45:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000e600 con 0x7f2878150c80 2023-10-24T00:45:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28781525b0 con 0x7f2878150c80 2023-10-24T00:45:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000e980 con 0x7f2878150c80 2023-10-24T00:45:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.915+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2878152b70 con 0x7f2878150c80 2023-10-24T00:45:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.916+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2878153330 con 0x7f2878150c80 2023-10-24T00:45:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.916+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f28700123f0 con 0x7f2878150c80 2023-10-24T00:45:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.917+0000 7f286e7fc700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 0x7f285c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.917+0000 7f287e531700 1 -- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 msgr2=0x7f285c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.917+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f2870079da0 con 0x7f2878150c80 2023-10-24T00:45:14.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.917+0000 7f287e531700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 0x7f285c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:14.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:14.924+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2870047af0 con 0x7f2878150c80 2023-10-24T00:45:14.985 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:14.984+0000 7f63c6d59680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:15.010 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.008+0000 7f452fbea680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:15.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.092+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28780c3b90 con 0x7f2878150c80 2023-10-24T00:45:15.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.094+0000 7f286e7fc700 1 -- 172.21.15.148:0/718884690 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17351 (secure 0 0 0) 0x7f287004ad10 con 0x7f2878150c80 2023-10-24T00:45:15.095 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:15.096 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":97,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:09.086232+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:44:51.401595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-24T00:44:52.182796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/823834847":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6833/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/3639739776":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2863574378":"2023-10-25T00:45:09.086183+0000","172.21.15.150:0/2981343771":"2023-10-25T00:45:09.086183+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:15.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 msgr2=0x7f285c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 0x7f285c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 msgr2=0x7f2878154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f287000c7f0 tx=0x7f2870001560).stop 2023-10-24T00:45:15.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 shutdown_connections 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f285c05f300 0x7f285c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2878150c80 0x7f2878154040 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2878063e70 0x7f2878151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 --2- 172.21.15.148:0/718884690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28780c2810 0x7f287813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 >> 172.21.15.148:0/718884690 conn(0x7f28780c7ee0 msgr2=0x7f28780c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 shutdown_connections 2023-10-24T00:45:15.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.096+0000 7f2880795700 1 -- 172.21.15.148:0/718884690 wait complete. 2023-10-24T00:45:15.104 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:15.103+0000 7f63c6d59680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:15.110 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:45:15.221 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:15.220+0000 7f63c6d59680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.227+0000 7fb8f43ab700 1 Processor -- start 2023-10-24T00:45:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.227+0000 7fb8f43ab700 1 -- start start 2023-10-24T00:45:15.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f43ab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f43ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f43ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec063b40 con 0x7fb8ec0a7a40 2023-10-24T00:45:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f43ab700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ec0a7270 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f43ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0ad200 con 0x7fb8ec0aa610 2023-10-24T00:45:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f2147700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:15.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f2948700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb8ec0a7a40 0x7fb8ec1546d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39038/0 (socket says 172.21.15.148:39038) 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f2147700 1 --2- 172.21.15.148:0/4050648174 >> v2:172.21.15.148:3300/0 conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33774/0 (socket says 172.21.15.148:33774) 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f2948700 1 -- 172.21.15.148:0/4050648174 learned_addr learned my addr 172.21.15.148:0/4050648174 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.228+0000 7fb8f1946700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f2147700 1 -- 172.21.15.148:0/4050648174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 msgr2=0x7fb8ec1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f2147700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec1541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f2147700 1 -- 172.21.15.148:0/4050648174 >> v1:172.21.15.148:6789/0 conn(0x7fb8ec0a7a40 legacy=0x7fb8ec1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f1145700 1 -- 172.21.15.148:0/4050648174 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244384163 0 0) 0x7fb8ec063b40 con 0x7fb8ec0a7a40 2023-10-24T00:45:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f2147700 1 -- 172.21.15.148:0/4050648174 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0ad4e0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f2147700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fb8dc009760 tx=0x7fb8dc009060).ready entity=mon.0 client_cookie=453e23dfd0530aba server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:15.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f1145700 1 -- 172.21.15.148:0/4050648174 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0090d0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f1145700 1 -- 172.21.15.148:0/4050648174 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00f510 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f1145700 1 -- 172.21.15.148:0/4050648174 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00f890 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f43ab700 1 -- 172.21.15.148:0/4050648174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 msgr2=0x7fb8ec0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.229+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7fb8dc009760 tx=0x7fb8dc009060).stop 2023-10-24T00:45:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 -- 172.21.15.148:0/4050648174 shutdown_connections 2023-10-24T00:45:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0a84a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/4050648174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 -- 172.21.15.148:0/4050648174 >> 172.21.15.148:0/4050648174 conn(0x7fb8ec0c3f60 msgr2=0x7fb8ec0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 -- 172.21.15.148:0/4050648174 shutdown_connections 2023-10-24T00:45:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.230+0000 7fb8f43ab700 1 -- 172.21.15.148:0/4050648174 wait complete. 2023-10-24T00:45:15.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 Processor -- start 2023-10-24T00:45:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 -- start start 2023-10-24T00:45:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec0a7a40 0x7fb8ec0a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c28d0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c1cc0 con 0x7fb8ec0a7a40 2023-10-24T00:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.231+0000 7fb8f43ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c1fa0 con 0x7fb8ec0aa610 2023-10-24T00:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33782/0 (socket says 172.21.15.148:33782) 2023-10-24T00:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 -- 172.21.15.148:0/3321575562 learned_addr learned my addr 172.21.15.148:0/3321575562 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f2147700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec0a7a40 0x7fb8ec0a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f2948700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 -- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 msgr2=0x7fb8ec062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 -- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec0a7a40 msgr2=0x7fb8ec0a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec0a7a40 0x7fb8ec0a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 -- 172.21.15.148:0/3321575562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0092a0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f1946700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fb8e800e8d0 tx=0x7fb8e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8009390 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8012600 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec0c2280 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8012980 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.232+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec0a10e0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.233+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb8e8012cf0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.234+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec06c6b0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.234+0000 7fb8e27fc700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 0x7fb8d00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.234+0000 7fb8f2147700 1 -- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 msgr2=0x7fb8d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.234+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6379+0+0 (secure 0 0 0) 0x7fb8e807a7c0 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.234+0000 7fb8f2147700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 0x7fb8d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:15.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.238+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb8e804b790 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.302 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.300+0000 7f452fbea680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:15.373 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.371+0000 7f452fbea680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:15.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.399+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 36) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fb8e8078290 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.399+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 msgr2=0x7fb8d00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:15.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.399+0000 7fb8e27fc700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 0x7fb8d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:15.449 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44ad383700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.450 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44ad383700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.450 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44ad383700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.450 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44ad383700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.450 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44ad383700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.451 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44a9b7c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.451 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44a9b7c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.451 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44a9b7c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.451 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44a9b7c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.451 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:15.447+0000 7f44a9b7c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:15.470+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8ec069f10 con 0x7fb8ec0a80c0 2023-10-24T00:45:15.534 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:15.532+0000 7f63c6d59680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:15.606 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:15.604+0000 7f63c6d59680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:16.390 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:45:16.388+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:45:16.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.393+0000 7fb8e27fc700 1 -- 172.21.15.148:0/3321575562 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8e8016090 con 0x7fb8ec0a80c0 2023-10-24T00:45:16.395 INFO:tasks.ceph.mds.a.smithi148.stderr: -1392> 2023-10-24T00:44:58.729+0000 7f748bfa6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:45:16.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.395+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 msgr2=0x7fb8ec0c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:16.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.395+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fb8e800e8d0 tx=0x7fb8e8009060).stop 2023-10-24T00:45:16.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 shutdown_connections 2023-10-24T00:45:16.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8ec0aa610 0x7fb8ec062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8ec0a7a40 0x7fb8ec0a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb8d005f300 0x7fb8d00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:16.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 --2- 172.21.15.148:0/3321575562 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8ec0a80c0 0x7fb8ec0c2d60 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 >> 172.21.15.148:0/3321575562 conn(0x7fb8ec0c3f60 msgr2=0x7fb8ec0c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:16.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 shutdown_connections 2023-10-24T00:45:16.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.396+0000 7fb8f43ab700 1 -- 172.21.15.148:0/3321575562 wait complete. 2023-10-24T00:45:16.400 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:45:16.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:45:16.424 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:45:16.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.535+0000 7f46c69bd700 1 Processor -- start 2023-10-24T00:45:16.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.535+0000 7f46c69bd700 1 -- start start 2023-10-24T00:45:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c69bd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f46c0098bd0 0x7f46c0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c69bd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46c00bffd0 0x7f46c00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c69bd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00c71d0 con 0x7f46c0154430 2023-10-24T00:45:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c69bd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00c6a10 con 0x7f46c00bffd0 2023-10-24T00:45:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c69bd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00c9410 con 0x7f46c0098bd0 2023-10-24T00:45:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46c00bffd0 0x7f46c00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46c00bffd0 0x7f46c00c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33804/0 (socket says 172.21.15.148:33804) 2023-10-24T00:45:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 -- 172.21.15.148:0/2057218920 learned_addr learned my addr 172.21.15.148:0/2057218920 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 -- 172.21.15.148:0/2057218920 >> v2:172.21.15.150:3300/0 conn(0x7f46c0098bd0 msgr2=0x7f46c0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46bf7fe700 1 --2- 172.21.15.148:0/2057218920 >> v2:172.21.15.150:3300/0 conn(0x7f46c0098bd0 0x7f46c0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 --2- 172.21.15.148:0/2057218920 >> v2:172.21.15.150:3300/0 conn(0x7f46c0098bd0 0x7f46c0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.536+0000 7f46c4f5a700 1 -- 172.21.15.148:0/2057218920 >> v1:172.21.15.150:6789/0 conn(0x7f46c0154430 legacy=0x7f46c00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:16.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c4f5a700 1 -- 172.21.15.148:0/2057218920 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00c0950 con 0x7f46c00bffd0 2023-10-24T00:45:16.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c4f5a700 1 --2- 172.21.15.148:0/2057218920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00bffd0 0x7f46c00c0460 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f46c00c23b0 tx=0x7f46b8009840).ready entity=mon.0 client_cookie=a6c7ee9304e2e7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:16.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46beffd700 1 -- 172.21.15.148:0/2057218920 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800e070 con 0x7f46c00bffd0 2023-10-24T00:45:16.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46beffd700 1 -- 172.21.15.148:0/2057218920 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800ba10 con 0x7f46c00bffd0 2023-10-24T00:45:16.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46beffd700 1 -- 172.21.15.148:0/2057218920 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800bd90 con 0x7f46c00bffd0 2023-10-24T00:45:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 -- 172.21.15.148:0/2057218920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00bffd0 msgr2=0x7f46c00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 --2- 172.21.15.148:0/2057218920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00bffd0 0x7f46c00c0460 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f46c00c23b0 tx=0x7f46b8009840).stop 2023-10-24T00:45:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 -- 172.21.15.148:0/2057218920 shutdown_connections 2023-10-24T00:45:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 --2- 172.21.15.148:0/2057218920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c00bffd0 0x7f46c00c0460 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 --2- 172.21.15.148:0/2057218920 >> v2:172.21.15.150:3300/0 conn(0x7f46c0098bd0 0x7f46c0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 -- 172.21.15.148:0/2057218920 >> 172.21.15.148:0/2057218920 conn(0x7f46c00cb070 msgr2=0x7f46c00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:16.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 -- 172.21.15.148:0/2057218920 shutdown_connections 2023-10-24T00:45:16.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.537+0000 7f46c69bd700 1 -- 172.21.15.148:0/2057218920 wait complete. 2023-10-24T00:45:16.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.538+0000 7f46c69bd700 1 Processor -- start 2023-10-24T00:45:16.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 -- start start 2023-10-24T00:45:16.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c0098bd0 0x7f46c01516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 0x7f46c00c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0151bd0 con 0x7f46c0154430 2023-10-24T00:45:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0168ad0 con 0x7f46c0098bd0 2023-10-24T00:45:16.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c69bd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0167ec0 con 0x7f46c00bffd0 2023-10-24T00:45:16.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.539+0000 7f46c4f5a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33808/0 (socket says 172.21.15.148:33808) 2023-10-24T00:45:16.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 -- 172.21.15.148:0/4080233427 learned_addr learned my addr 172.21.15.148:0/4080233427 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:16.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46bffff700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c0098bd0 0x7f46c01516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46bf7fe700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 0x7f46c00c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 -- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 msgr2=0x7f46c00c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:16.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 0x7f46c00c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 -- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c0098bd0 msgr2=0x7f46c01516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:16.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c0098bd0 0x7f46c01516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:16.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 -- 172.21.15.148:0/4080233427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8009ae0 con 0x7f46c0154430 2023-10-24T00:45:16.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46bf7fe700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 0x7f46c00c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:16.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c4f5a700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f46c00c5910 tx=0x7f46b8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:16.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80092e0 con 0x7f46c0154430 2023-10-24T00:45:16.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b801d410 con 0x7f46c0154430 2023-10-24T00:45:16.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01681a0 con 0x7f46c0154430 2023-10-24T00:45:16.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b801d7b0 con 0x7f46c0154430 2023-10-24T00:45:16.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.540+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0168760 con 0x7f46c0154430 2023-10-24T00:45:16.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.541+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c006c6b0 con 0x7f46c0154430 2023-10-24T00:45:16.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.541+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 37) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f46b801db60 con 0x7f46c0154430 2023-10-24T00:45:16.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.542+0000 7f46a7fff700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 0x7f46ac0614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:16.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.542+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f46b807bea0 con 0x7f46c0154430 2023-10-24T00:45:16.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.542+0000 7f46bffff700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 0x7f46ac0614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:16.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.542+0000 7f46bffff700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 0x7f46ac0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f46b000b9b0 tx=0x7f46b0008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:16.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.548+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f46b804d110 con 0x7f46c0154430 2023-10-24T00:45:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:16.755+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46c006c6b0 con 0x7f46c0154430 2023-10-24T00:45:17.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.403+0000 7f46a7fff700 1 -- 172.21.15.148:0/4080233427 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46b8050730 con 0x7f46c0154430 2023-10-24T00:45:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 msgr2=0x7f46ac0614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 0x7f46ac0614c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f46b000b9b0 tx=0x7f46b0008040).stop 2023-10-24T00:45:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 msgr2=0x7f46c00c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f46c00c5910 tx=0x7f46b8009840).stop 2023-10-24T00:45:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 shutdown_connections 2023-10-24T00:45:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f46ac05f000 0x7f46ac0614c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46c0154430 0x7f46c00c2db0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46c0098bd0 0x7f46c01516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 --2- 172.21.15.148:0/4080233427 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46c00bffd0 0x7f46c00c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.405+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 >> 172.21.15.148:0/4080233427 conn(0x7f46c00cb070 msgr2=0x7f46c0153380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.406+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 shutdown_connections 2023-10-24T00:45:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.406+0000 7f46c69bd700 1 -- 172.21.15.148:0/4080233427 wait complete. 2023-10-24T00:45:17.419 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:45:17.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.577+0000 7f281d115700 1 Processor -- start 2023-10-24T00:45:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.577+0000 7f281d115700 1 -- start start 2023-10-24T00:45:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f281d115700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f28180a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f281d115700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180644a0 con 0x7f2818154250 2023-10-24T00:45:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f281d115700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180a8520 con 0x7f28180a8090 2023-10-24T00:45:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f281d115700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2818154630 con 0x7f28180c3220 2023-10-24T00:45:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2817fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2818154250 0x7f28180c5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39052/0 (socket says 172.21.15.148:39052) 2023-10-24T00:45:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2817fff700 1 -- 172.21.15.148:0/1604388595 learned_addr learned my addr 172.21.15.148:0/1604388595 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f28177fe700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f28180a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653587152 0 0) 0x7f28180644a0 con 0x7f2818154250 2023-10-24T00:45:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28000033f0 con 0x7f2818154250 2023-10-24T00:45:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524784260 0 0) 0x7f28180a8520 con 0x7f28180a8090 2023-10-24T00:45:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28180644a0 con 0x7f28180a8090 2023-10-24T00:45:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495478341 0 0) 0x7f28000033f0 con 0x7f2818154250 2023-10-24T00:45:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 msgr2=0x7f28180a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f28180a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 >> v1:172.21.15.150:6789/0 conn(0x7f28180a8090 legacy=0x7f2818064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180c6530 con 0x7f2818154250 2023-10-24T00:45:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f28080015f0 con 0x7f2818154250 2023-10-24T00:45:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f28177fe700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f28180a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 >> v1:172.21.15.148:6789/0 conn(0x7f2818154250 legacy=0x7f28180c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f2800003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800003f90 0x7f2800004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800004b80 0x7f2800005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818154630 con 0x7f2800004b80 2023-10-24T00:45:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280000b940 con 0x7f2800003f90 2023-10-24T00:45:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.578+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280000bb00 con 0x7f28180c3220 2023-10-24T00:45:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800004b80 0x7f2800005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f28177fe700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800003f90 0x7f2800004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f2817fff700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f2800003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 -- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 msgr2=0x7f2800003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180c3220 0x7f2800003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 -- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800003f90 msgr2=0x7f2800004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:17.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800003f90 0x7f2800004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 -- 172.21.15.148:0/1604388595 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0092a0 con 0x7f2800004b80 2023-10-24T00:45:17.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f281c914700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800004b80 0x7f2800005000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f2810001f90 tx=0x7f2810007f30).ready entity=mon.0 client_cookie=25c37c6f732fb0c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:17.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100020f0 con 0x7f2800004b80 2023-10-24T00:45:17.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810006a20 con 0x7f2800004b80 2023-10-24T00:45:17.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.579+0000 7f2816ffd700 1 -- 172.21.15.148:0/1604388595 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810006dc0 con 0x7f2800004b80 2023-10-24T00:45:17.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 -- 172.21.15.148:0/1604388595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800004b80 msgr2=0x7f2800005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 --2- 172.21.15.148:0/1604388595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2800004b80 0x7f2800005000 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f2810001f90 tx=0x7f2810007f30).stop 2023-10-24T00:45:17.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281c914700 1 -- 172.21.15.148:0/1604388595 reap_dead start 2023-10-24T00:45:17.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 -- 172.21.15.148:0/1604388595 shutdown_connections 2023-10-24T00:45:17.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 -- 172.21.15.148:0/1604388595 >> 172.21.15.148:0/1604388595 conn(0x7f2818092240 msgr2=0x7f2818062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:17.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 -- 172.21.15.148:0/1604388595 shutdown_connections 2023-10-24T00:45:17.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.580+0000 7f281d115700 1 -- 172.21.15.148:0/1604388595 wait complete. 2023-10-24T00:45:17.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.581+0000 7f281d115700 1 Processor -- start 2023-10-24T00:45:17.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.581+0000 7f281d115700 1 -- start start 2023-10-24T00:45:17.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800004b80 0x7f28180aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180acbd0 0x7f28180c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180aaae0 con 0x7f28180c17c0 2023-10-24T00:45:17.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180a9ed0 con 0x7f2800004b80 2023-10-24T00:45:17.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180aa1b0 con 0x7f28180acbd0 2023-10-24T00:45:17.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33832/0 (socket says 172.21.15.148:33832) 2023-10-24T00:45:17.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 -- 172.21.15.148:0/1492411915 learned_addr learned my addr 172.21.15.148:0/1492411915 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:17.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f2817fff700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800004b80 0x7f28180aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f28177fe700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180acbd0 0x7f28180c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 -- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180acbd0 msgr2=0x7f28180c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180acbd0 0x7f28180c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 -- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800004b80 msgr2=0x7f28180aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:17.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800004b80 0x7f28180aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 -- 172.21.15.148:0/1492411915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180aa490 con 0x7f28180c17c0 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281c914700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2810001760 tx=0x7f2810016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810012400 con 0x7f28180c17c0 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810012560 con 0x7f28180c17c0 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28180aa770 con 0x7f28180c17c0 2023-10-24T00:45:17.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.582+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810012900 con 0x7f28180c17c0 2023-10-24T00:45:17.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.583+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28180a9ad0 con 0x7f28180c17c0 2023-10-24T00:45:17.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.584+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2818047480 con 0x7f28180c17c0 2023-10-24T00:45:17.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.584+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 37) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f2810012cb0 con 0x7f28180c17c0 2023-10-24T00:45:17.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.584+0000 7f27fffff700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 0x7f28040614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:17.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.584+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f281007afa0 con 0x7f28180c17c0 2023-10-24T00:45:17.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.584+0000 7f2817fff700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 0x7f28040614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:17.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.585+0000 7f2817fff700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 0x7f28040614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2808002e10 tx=0x7f2808009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:17.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.588+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f281004c210 con 0x7f28180c17c0 2023-10-24T00:45:17.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:17.752+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f281806c160 con 0x7f28180c17c0 2023-10-24T00:45:18.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.401+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2810078d10 con 0x7f28180c17c0 2023-10-24T00:45:18.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.412+0000 7f27fffff700 1 -- 172.21.15.148:0/1492411915 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7f281006f910 con 0x7f28180c17c0 2023-10-24T00:45:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.414+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 msgr2=0x7f28040614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.414+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 0x7f28040614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2808002e10 tx=0x7f2808009040).stop 2023-10-24T00:45:18.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.414+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 msgr2=0x7f281814f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.414+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2810001760 tx=0x7f2810016000).stop 2023-10-24T00:45:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.414+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 shutdown_connections 2023-10-24T00:45:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f280405f030 0x7f28040614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28180c17c0 0x7f281814f920 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2800004b80 0x7f28180aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 --2- 172.21.15.148:0/1492411915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f28180acbd0 0x7f28180c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 >> 172.21.15.148:0/1492411915 conn(0x7f2818092240 msgr2=0x7f28180c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 shutdown_connections 2023-10-24T00:45:18.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.415+0000 7f281d115700 1 -- 172.21.15.148:0/1492411915 wait complete. 2023-10-24T00:45:18.420 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:45:18.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:45:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.546+0000 7fbced056700 1 Processor -- start 2023-10-24T00:45:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.546+0000 7fbced056700 1 -- start start 2023-10-24T00:45:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbced056700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 0x7fbce8151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbced056700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbce80c1a60 0x7fbce80c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbced056700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80c3c30 con 0x7fbce8069910 2023-10-24T00:45:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbced056700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80667a0 con 0x7fbce80c1a60 2023-10-24T00:45:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbced056700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80c3670 con 0x7fbce8150e30 2023-10-24T00:45:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbce80c1a60 0x7fbce80c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbcde59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbce8069910 0x7fbce80c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39064/0 (socket says 172.21.15.148:39064) 2023-10-24T00:45:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbce80c1a60 0x7fbce80c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33842/0 (socket says 172.21.15.148:33842) 2023-10-24T00:45:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbcde59c700 1 -- 172.21.15.148:0/1764018223 learned_addr learned my addr 172.21.15.148:0/1764018223 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce6d9d700 1 --2- 172.21.15.148:0/1764018223 >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 0x7fbce8151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 -- 172.21.15.148:0/1764018223 >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 msgr2=0x7fbce8151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 --2- 172.21.15.148:0/1764018223 >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 0x7fbce8151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce659c700 1 -- 172.21.15.148:0/1764018223 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119059514 0 0) 0x7fbce80c3c30 con 0x7fbce8069910 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 -- 172.21.15.148:0/1764018223 >> v1:172.21.15.148:6789/0 conn(0x7fbce8069910 legacy=0x7fbce80c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 -- 172.21.15.148:0/1764018223 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80c3950 con 0x7fbce80c1a60 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce6d9d700 1 --2- 172.21.15.148:0/1764018223 >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 0x7fbce8151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.547+0000 7fbce759e700 1 --2- 172.21.15.148:0/1764018223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce80c1a60 0x7fbce80c1e90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fbce80be3d0 tx=0x7fbce0009780).ready entity=mon.0 client_cookie=5807803c48cb67e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbce659c700 1 -- 172.21.15.148:0/1764018223 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000e070 con 0x7fbce80c1a60 2023-10-24T00:45:18.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbce659c700 1 -- 172.21.15.148:0/1764018223 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000bc30 con 0x7fbce80c1a60 2023-10-24T00:45:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbce659c700 1 -- 172.21.15.148:0/1764018223 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0012410 con 0x7fbce80c1a60 2023-10-24T00:45:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 -- 172.21.15.148:0/1764018223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce80c1a60 msgr2=0x7fbce80c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 --2- 172.21.15.148:0/1764018223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce80c1a60 0x7fbce80c1e90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fbce80be3d0 tx=0x7fbce0009780).stop 2023-10-24T00:45:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 -- 172.21.15.148:0/1764018223 shutdown_connections 2023-10-24T00:45:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 --2- 172.21.15.148:0/1764018223 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce80c1a60 0x7fbce80c1e90 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 --2- 172.21.15.148:0/1764018223 >> v2:172.21.15.150:3300/0 conn(0x7fbce8150e30 0x7fbce8151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 -- 172.21.15.148:0/1764018223 >> 172.21.15.148:0/1764018223 conn(0x7fbce80c49d0 msgr2=0x7fbce8068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 -- 172.21.15.148:0/1764018223 shutdown_connections 2023-10-24T00:45:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.548+0000 7fbced056700 1 -- 172.21.15.148:0/1764018223 wait complete. 2023-10-24T00:45:18.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.549+0000 7fbced056700 1 Processor -- start 2023-10-24T00:45:18.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.549+0000 7fbced056700 1 -- start start 2023-10-24T00:45:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 0x7fbce80bd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbce8150e30 0x7fbce80bda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80a24c0 con 0x7fbce8069910 2023-10-24T00:45:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80bdf50 con 0x7fbce80c1a60 2023-10-24T00:45:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbced056700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8165910 con 0x7fbce8150e30 2023-10-24T00:45:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbce6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:18.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbce6d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33856/0 (socket says 172.21.15.148:33856) 2023-10-24T00:45:18.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.550+0000 7fbce6d9d700 1 -- 172.21.15.148:0/3035994576 learned_addr learned my addr 172.21.15.148:0/3035994576 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:18.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 -- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbce8150e30 msgr2=0x7fbce80bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbcde59c700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 0x7fbce80bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:18.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbce8150e30 0x7fbce80bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:18.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 -- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 msgr2=0x7fbce80bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 0x7fbce80bd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 -- 172.21.15.148:0/3035994576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a20 con 0x7fbce8069910 2023-10-24T00:45:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbcde59c700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 0x7fbce80bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbce6d9d700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fbcd800c880 tx=0x7fbcd8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:18.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8010580 con 0x7fbce8069910 2023-10-24T00:45:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd80106e0 con 0x7fbce8069910 2023-10-24T00:45:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce8162810 con 0x7fbce8069910 2023-10-24T00:45:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8010a80 con 0x7fbce8069910 2023-10-24T00:45:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.551+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8162dd0 con 0x7fbce8069910 2023-10-24T00:45:18.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.552+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce806c6b0 con 0x7fbce8069910 2023-10-24T00:45:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.552+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fbcd801b460 con 0x7fbce8069910 2023-10-24T00:45:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.553+0000 7fbcdf7fe700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 0x7fbcc8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.553+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fbcd807a3b0 con 0x7fbce8069910 2023-10-24T00:45:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.553+0000 7fbcde59c700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 0x7fbcc8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:18.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.553+0000 7fbcde59c700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 0x7fbcc8061700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbce80aa020 tx=0x7fbcd0009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:18.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.557+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbcd804b420 con 0x7fbce8069910 2023-10-24T00:45:18.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:18.723+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbce8066430 con 0x7fbce8069910 2023-10-24T00:45:19.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.415+0000 7fbcdf7fe700 1 -- 172.21.15.148:0/3035994576 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbcd804ea40 con 0x7fbce8069910 2023-10-24T00:45:19.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 msgr2=0x7fbcc8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 0x7fbcc8061700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbce80aa020 tx=0x7fbcd0009040).stop 2023-10-24T00:45:19.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 msgr2=0x7fbce8165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fbcd800c880 tx=0x7fbcd8008040).stop 2023-10-24T00:45:19.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 shutdown_connections 2023-10-24T00:45:19.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbce8150e30 0x7fbce80bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:19.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbcc805f240 0x7fbcc8061700 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbce8069910 0x7fbce8165da0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 --2- 172.21.15.148:0/3035994576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbce80c1a60 0x7fbce80bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 >> 172.21.15.148:0/3035994576 conn(0x7fbce80c49d0 msgr2=0x7fbce80acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:19.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 shutdown_connections 2023-10-24T00:45:19.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.419+0000 7fbced056700 1 -- 172.21.15.148:0/3035994576 wait complete. 2023-10-24T00:45:19.424 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:45:19.436 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:45:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.551+0000 7efe43295700 1 Processor -- start 2023-10-24T00:45:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.552+0000 7efe43295700 1 -- start start 2023-10-24T00:45:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe43295700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe3c154430 0x7efe3c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe43295700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe43295700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0c71d0 con 0x7efe3c098bd0 2023-10-24T00:45:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe43295700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0c6a10 con 0x7efe3c154430 2023-10-24T00:45:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe43295700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0c9410 con 0x7efe3c0bffd0 2023-10-24T00:45:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe41832700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe41031700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe3c154430 0x7efe3c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe41832700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:41840/0 (socket says 172.21.15.148:41840) 2023-10-24T00:45:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.553+0000 7efe41832700 1 -- 172.21.15.148:0/4244581839 learned_addr learned my addr 172.21.15.148:0/4244581839 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:19.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.555+0000 7efe41832700 1 -- 172.21.15.148:0/4244581839 >> v2:172.21.15.150:3300/0 conn(0x7efe3c154430 msgr2=0x7efe3c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:19.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.555+0000 7efe41832700 1 --2- 172.21.15.148:0/4244581839 >> v2:172.21.15.150:3300/0 conn(0x7efe3c154430 0x7efe3c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.555+0000 7efe41832700 1 -- 172.21.15.148:0/4244581839 >> v1:172.21.15.150:6789/0 conn(0x7efe3c098bd0 legacy=0x7efe3c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.555+0000 7efe41832700 1 -- 172.21.15.148:0/4244581839 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0c0950 con 0x7efe3c0bffd0 2023-10-24T00:45:19.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.555+0000 7efe41832700 1 --2- 172.21.15.148:0/4244581839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efe2c006fd0 tx=0x7efe2c0090f0).ready entity=mon.2 client_cookie=d2456044c8548b1f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.556+0000 7efe33fff700 1 -- 172.21.15.148:0/4244581839 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00f510 con 0x7efe3c0bffd0 2023-10-24T00:45:19.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.556+0000 7efe33fff700 1 -- 172.21.15.148:0/4244581839 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00f670 con 0x7efe3c0bffd0 2023-10-24T00:45:19.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.556+0000 7efe33fff700 1 -- 172.21.15.148:0/4244581839 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00fa10 con 0x7efe3c0bffd0 2023-10-24T00:45:19.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.558+0000 7efe43295700 1 -- 172.21.15.148:0/4244581839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 msgr2=0x7efe3c0c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.558+0000 7efe43295700 1 --2- 172.21.15.148:0/4244581839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7efe2c006fd0 tx=0x7efe2c0090f0).stop 2023-10-24T00:45:19.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.559+0000 7efe43295700 1 -- 172.21.15.148:0/4244581839 shutdown_connections 2023-10-24T00:45:19.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.559+0000 7efe43295700 1 --2- 172.21.15.148:0/4244581839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c0bffd0 0x7efe3c0c0460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.559+0000 7efe43295700 1 --2- 172.21.15.148:0/4244581839 >> v2:172.21.15.150:3300/0 conn(0x7efe3c154430 0x7efe3c154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.559+0000 7efe43295700 1 -- 172.21.15.148:0/4244581839 >> 172.21.15.148:0/4244581839 conn(0x7efe3c0cb070 msgr2=0x7efe3c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:19.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.559+0000 7efe43295700 1 -- 172.21.15.148:0/4244581839 shutdown_connections 2023-10-24T00:45:19.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.561+0000 7efe43295700 1 -- 172.21.15.148:0/4244581839 wait complete. 2023-10-24T00:45:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.562+0000 7efe43295700 1 Processor -- start 2023-10-24T00:45:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.562+0000 7efe43295700 1 -- start start 2023-10-24T00:45:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe3c098bd0 0x7efe3c148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c154430 0x7efe3c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c168b40 con 0x7efe3c0bffd0 2023-10-24T00:45:19.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c148d20 con 0x7efe3c098bd0 2023-10-24T00:45:19.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe43295700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c168250 con 0x7efe3c154430 2023-10-24T00:45:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe40830700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe40830700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33864/0 (socket says 172.21.15.148:33864) 2023-10-24T00:45:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe40830700 1 -- 172.21.15.148:0/2042464184 learned_addr learned my addr 172.21.15.148:0/2042464184 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe41832700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c154430 0x7efe3c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.563+0000 7efe41031700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe3c098bd0 0x7efe3c148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 -- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c154430 msgr2=0x7efe3c0644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c154430 0x7efe3c0644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 -- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe3c098bd0 msgr2=0x7efe3c148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe3c098bd0 0x7efe3c148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 -- 172.21.15.148:0/2042464184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009370 con 0x7efe3c0bffd0 2023-10-24T00:45:19.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe40830700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7efe3400c530 tx=0x7efe34007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400cea0 con 0x7efe3c0bffd0 2023-10-24T00:45:19.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400f470 con 0x7efe3c0bffd0 2023-10-24T00:45:19.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400f830 con 0x7efe3c0bffd0 2023-10-24T00:45:19.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c150e30 con 0x7efe3c0bffd0 2023-10-24T00:45:19.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.564+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c1687d0 con 0x7efe3c0bffd0 2023-10-24T00:45:19.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.565+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c06c6b0 con 0x7efe3c0bffd0 2023-10-24T00:45:19.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.566+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7efe3400fbe0 con 0x7efe3c0bffd0 2023-10-24T00:45:19.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.566+0000 7efe317fa700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 0x7efe20061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.566+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7efe340797e0 con 0x7efe3c0bffd0 2023-10-24T00:45:19.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.566+0000 7efe41031700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 0x7efe20061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.567+0000 7efe41031700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 0x7efe20061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efe380075a0 tx=0x7efe380097e0).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.570+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efe3404aa50 con 0x7efe3c0bffd0 2023-10-24T00:45:19.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.735+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7efe3c0c8c50 con 0x7efe3c0bffd0 2023-10-24T00:45:19.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.738+0000 7efe317fa700 1 -- 172.21.15.148:0/2042464184 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7efe3404e070 con 0x7efe3c0bffd0 2023-10-24T00:45:19.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 msgr2=0x7efe20061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 0x7efe20061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efe380075a0 tx=0x7efe380097e0).stop 2023-10-24T00:45:19.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 msgr2=0x7efe3c150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7efe3400c530 tx=0x7efe34007d60).stop 2023-10-24T00:45:19.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 shutdown_connections 2023-10-24T00:45:19.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe3c154430 0x7efe3c0644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe3c098bd0 0x7efe3c148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe2005f270 0x7efe20061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 --2- 172.21.15.148:0/2042464184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe3c0bffd0 0x7efe3c150940 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 >> 172.21.15.148:0/2042464184 conn(0x7efe3c0cb070 msgr2=0x7efe3c1575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:19.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 shutdown_connections 2023-10-24T00:45:19.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.740+0000 7efe43295700 1 -- 172.21.15.148:0/2042464184 wait complete. 2023-10-24T00:45:19.754 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:45:19.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.870+0000 7f92d277d700 1 Processor -- start 2023-10-24T00:45:19.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.870+0000 7f92d277d700 1 -- start start 2023-10-24T00:45:19.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d277d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 0x7f92cc154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d277d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92cc098bd0 0x7f92cc0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d277d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc0c71d0 con 0x7f92cc0bffd0 2023-10-24T00:45:19.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d277d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0c9410 con 0x7f92cc098bd0 2023-10-24T00:45:19.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d277d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0c6c10 con 0x7f92cc154430 2023-10-24T00:45:19.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92cb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92cc098bd0 0x7f92cc0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d0d1a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f92cc0bffd0 0x7f92cc0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39070/0 (socket says 172.21.15.148:39070) 2023-10-24T00:45:19.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92cb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92cc098bd0 0x7f92cc0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33870/0 (socket says 172.21.15.148:33870) 2023-10-24T00:45:19.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.871+0000 7f92d0d1a700 1 -- 172.21.15.148:0/1851170445 learned_addr learned my addr 172.21.15.148:0/1851170445 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:19.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cbfff700 1 --2- 172.21.15.148:0/1851170445 >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 0x7f92cc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cb7fe700 1 -- 172.21.15.148:0/1851170445 >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 msgr2=0x7f92cc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:19.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cb7fe700 1 --2- 172.21.15.148:0/1851170445 >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 0x7f92cc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cb7fe700 1 -- 172.21.15.148:0/1851170445 >> v1:172.21.15.148:6789/0 conn(0x7f92cc0bffd0 legacy=0x7f92cc0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92caffd700 1 -- 172.21.15.148:0/1851170445 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111366225 0 0) 0x7f92cc0c71d0 con 0x7f92cc0bffd0 2023-10-24T00:45:19.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cb7fe700 1 -- 172.21.15.148:0/1851170445 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0c6ef0 con 0x7f92cc098bd0 2023-10-24T00:45:19.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cbfff700 1 --2- 172.21.15.148:0/1851170445 >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 0x7f92cc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:19.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92cb7fe700 1 --2- 172.21.15.148:0/1851170445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc098bd0 0x7f92cc0c6300 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f92cc05ff70 tx=0x7f92c0009060).ready entity=mon.0 client_cookie=50f3d2dc2b62e13a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92caffd700 1 -- 172.21.15.148:0/1851170445 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000b580 con 0x7f92cc098bd0 2023-10-24T00:45:19.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92caffd700 1 -- 172.21.15.148:0/1851170445 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000b6e0 con 0x7f92cc098bd0 2023-10-24T00:45:19.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92caffd700 1 -- 172.21.15.148:0/1851170445 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000ba60 con 0x7f92cc098bd0 2023-10-24T00:45:19.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 -- 172.21.15.148:0/1851170445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc098bd0 msgr2=0x7f92cc0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 --2- 172.21.15.148:0/1851170445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc098bd0 0x7f92cc0c6300 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f92cc05ff70 tx=0x7f92c0009060).stop 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 -- 172.21.15.148:0/1851170445 shutdown_connections 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 --2- 172.21.15.148:0/1851170445 >> v2:172.21.15.150:3300/0 conn(0x7f92cc154430 0x7f92cc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 --2- 172.21.15.148:0/1851170445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc098bd0 0x7f92cc0c6300 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.872+0000 7f92d277d700 1 -- 172.21.15.148:0/1851170445 >> 172.21.15.148:0/1851170445 conn(0x7f92cc0cb070 msgr2=0x7f92cc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.873+0000 7f92d277d700 1 -- 172.21.15.148:0/1851170445 shutdown_connections 2023-10-24T00:45:19.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.873+0000 7f92d277d700 1 -- 172.21.15.148:0/1851170445 wait complete. 2023-10-24T00:45:19.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.874+0000 7f92d277d700 1 Processor -- start 2023-10-24T00:45:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.874+0000 7f92d277d700 1 -- start start 2023-10-24T00:45:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92cc098bd0 0x7f92cc1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 0x7f92cc0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c2320 con 0x7f92cc154430 2023-10-24T00:45:19.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1497d0 con 0x7f92cc098bd0 2023-10-24T00:45:19.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0c2e60 con 0x7f92cc0bffd0 2023-10-24T00:45:19.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33886/0 (socket says 172.21.15.148:33886) 2023-10-24T00:45:19.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 -- 172.21.15.148:0/44962715 learned_addr learned my addr 172.21.15.148:0/44962715 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:19.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92cbfff700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92cc098bd0 0x7f92cc1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92cb7fe700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 0x7f92cc0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 -- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 msgr2=0x7f92cc0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 0x7f92cc0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 -- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92cc098bd0 msgr2=0x7f92cc1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:19.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92cc098bd0 0x7f92cc1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:19.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 -- 172.21.15.148:0/44962715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00092a0 con 0x7f92cc154430 2023-10-24T00:45:19.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92cb7fe700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 0x7f92cc0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:19.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d0d1a700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f92c400c790 tx=0x7f92c4007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4005d30 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4007110 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc0c2530 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40074d0 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.875+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc0c2af0 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.876+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc06c6b0 con 0x7f92cc154430 2023-10-24T00:45:19.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.877+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f92c4007840 con 0x7f92cc154430 2023-10-24T00:45:19.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.877+0000 7f92b3fff700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 0x7f92b8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:19.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.877+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f92c407a350 con 0x7f92cc154430 2023-10-24T00:45:19.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.877+0000 7f92cbfff700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 0x7f92b8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:19.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.878+0000 7f92cbfff700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 0x7f92b8061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f92bc00a9d0 tx=0x7f92bc008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:19.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:19.881+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f92c404b5c0 con 0x7f92cc154430 2023-10-24T00:45:20.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.044+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f92cc0c2fa0 con 0x7f92cc154430 2023-10-24T00:45:20.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.048+0000 7f92b3fff700 1 -- 172.21.15.148:0/44962715 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92c404ebe0 con 0x7f92cc154430 2023-10-24T00:45:20.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 msgr2=0x7f92b8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 0x7f92b8061700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f92bc00a9d0 tx=0x7f92bc008040).stop 2023-10-24T00:45:20.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 msgr2=0x7f92cc0c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f92c400c790 tx=0x7f92c4007f30).stop 2023-10-24T00:45:20.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 shutdown_connections 2023-10-24T00:45:20.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92b805f240 0x7f92b8061700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92cc154430 0x7f92cc0c32f0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92cc098bd0 0x7f92cc1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 --2- 172.21.15.148:0/44962715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92cc0bffd0 0x7f92cc0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 >> 172.21.15.148:0/44962715 conn(0x7f92cc0cb070 msgr2=0x7f92cc063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:20.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 shutdown_connections 2023-10-24T00:45:20.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.050+0000 7f92d277d700 1 -- 172.21.15.148:0/44962715 wait complete. 2023-10-24T00:45:20.064 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-24T00:45:20.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.175+0000 7f2fd2084700 1 Processor -- start 2023-10-24T00:45:20.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.175+0000 7f2fd2084700 1 -- start start 2023-10-24T00:45:20.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fd2084700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fd2084700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc0c6710 0x7f2fcc0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fd2084700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0c0960 con 0x7f2fcc158770 2023-10-24T00:45:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fd2084700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc0aa8e0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fd2084700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c0c40 con 0x7f2fcc0c6710 2023-10-24T00:45:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fcb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fcbfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2fcc158770 0x7f2fcc069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39074/0 (socket says 172.21.15.148:39074) 2023-10-24T00:45:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fcb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33898/0 (socket says 172.21.15.148:33898) 2023-10-24T00:45:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.176+0000 7f2fcbfff700 1 -- 172.21.15.148:0/1861638191 learned_addr learned my addr 172.21.15.148:0/1861638191 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcaffd700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc0c6710 0x7f2fcc0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/1861638191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc0c6710 msgr2=0x7f2fcc0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:20.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcb7fe700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc0c6710 0x7f2fcc0aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/1861638191 >> v1:172.21.15.148:6789/0 conn(0x7f2fcc158770 legacy=0x7f2fcc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fca7fc700 1 -- 172.21.15.148:0/1861638191 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920117593 0 0) 0x7f2fcc0c0960 con 0x7f2fcc158770 2023-10-24T00:45:20.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/1861638191 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0c0f20 con 0x7f2fcc0aa010 2023-10-24T00:45:20.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fcb7fe700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f2fbc009760 tx=0x7f2fbc009060).ready entity=mon.0 client_cookie=90b6e7ef6d90f9b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:20.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fca7fc700 1 -- 172.21.15.148:0/1861638191 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b580 con 0x7f2fcc0aa010 2023-10-24T00:45:20.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fca7fc700 1 -- 172.21.15.148:0/1861638191 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00b6e0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fca7fc700 1 -- 172.21.15.148:0/1861638191 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00ba60 con 0x7f2fcc0aa010 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 -- 172.21.15.148:0/1861638191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 msgr2=0x7f2fcc0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f2fbc009760 tx=0x7f2fbc009060).stop 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 -- 172.21.15.148:0/1861638191 shutdown_connections 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc0c1a00 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 --2- 172.21.15.148:0/1861638191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc0c6710 0x7f2fcc0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.177+0000 7f2fd2084700 1 -- 172.21.15.148:0/1861638191 >> 172.21.15.148:0/1861638191 conn(0x7f2fcc0caf40 msgr2=0x7f2fcc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:20.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.178+0000 7f2fd2084700 1 -- 172.21.15.148:0/1861638191 shutdown_connections 2023-10-24T00:45:20.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.178+0000 7f2fd2084700 1 -- 172.21.15.148:0/1861638191 wait complete. 2023-10-24T00:45:20.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.179+0000 7f2fd2084700 1 Processor -- start 2023-10-24T00:45:20.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.179+0000 7f2fd2084700 1 -- start start 2023-10-24T00:45:20.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 0x7f2fcc156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc158770 0x7f2fcc157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c3350 con 0x7f2fcc0aa010 2023-10-24T00:45:20.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc157640 con 0x7f2fcc0c6710 2023-10-24T00:45:20.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c4190 con 0x7f2fcc158770 2023-10-24T00:45:20.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33904/0 (socket says 172.21.15.148:33904) 2023-10-24T00:45:20.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/3360984964 learned_addr learned my addr 172.21.15.148:0/3360984964 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:20.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcbfff700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc158770 0x7f2fcc157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcaffd700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 0x7f2fcc156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc158770 msgr2=0x7f2fcc157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc158770 0x7f2fcc157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 msgr2=0x7f2fcc156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:20.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 0x7f2fcc156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:20.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 -- 172.21.15.148:0/3360984964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0092a0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcaffd700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 0x7f2fcc156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fcb7fe700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2fbc009eb0 tx=0x7f2fbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b850 con 0x7f2fcc0aa010 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00b9b0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc0c3580 con 0x7f2fcc0aa010 2023-10-24T00:45:20.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc01b660 con 0x7f2fcc0aa010 2023-10-24T00:45:20.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.180+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc0c3b40 con 0x7f2fcc0aa010 2023-10-24T00:45:20.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.181+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc06c6b0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.181+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2fbc01ba90 con 0x7f2fcc0aa010 2023-10-24T00:45:20.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.182+0000 7f2fb37fe700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 0x7f2fb8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:20.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.182+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f2fbc07bc80 con 0x7f2fcc0aa010 2023-10-24T00:45:20.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.182+0000 7f2fcaffd700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 0x7f2fb8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:20.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.182+0000 7f2fcaffd700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 0x7f2fb8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2fcc06a980 tx=0x7f2fc0008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:20.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.186+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2fbc04cef0 con 0x7f2fcc0aa010 2023-10-24T00:45:20.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:20.425+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f2fcc0c1200 con 0x7f2fcc0aa010 2023-10-24T00:45:21.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.416+0000 7f2fb37fe700 1 -- 172.21.15.148:0/3360984964 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v599) v1 ==== 166+0+0 (secure 0 0 0) 0x7f2fbc01f020 con 0x7f2fcc0aa010 2023-10-24T00:45:21.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 msgr2=0x7f2fb8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 0x7f2fb8061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2fcc06a980 tx=0x7f2fc0008040).stop 2023-10-24T00:45:21.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 msgr2=0x7f2fcc154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2fbc009eb0 tx=0x7f2fbc017000).stop 2023-10-24T00:45:21.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 shutdown_connections 2023-10-24T00:45:21.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fcc158770 0x7f2fcc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2fb805f270 0x7f2fb8061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2fcc0aa010 0x7f2fcc154840 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 --2- 172.21.15.148:0/3360984964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fcc0c6710 0x7f2fcc156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 >> 172.21.15.148:0/3360984964 conn(0x7f2fcc0caf40 msgr2=0x7f2fcc0ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:21.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 shutdown_connections 2023-10-24T00:45:21.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.418+0000 7f2fd2084700 1 -- 172.21.15.148:0/3360984964 wait complete. 2023-10-24T00:45:21.433 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-10-24T00:45:21.433 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-10-24T00:45:21.434 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:45:21.434 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-24T00:45:21.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 Processor -- start 2023-10-24T00:45:21.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 -- start start 2023-10-24T00:45:21.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:21.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248c0c05b0 con 0x7f248c151c40 2023-10-24T00:45:21.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248c154e20 con 0x7f248c0a9e90 2023-10-24T00:45:21.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.547+0000 7f249138f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c155100 con 0x7f248c152020 2023-10-24T00:45:21.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f248c151c40 0x7f248c06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39084/0 (socket says 172.21.15.148:39084) 2023-10-24T00:45:21.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248affd700 1 -- 172.21.15.148:0/2138817846 learned_addr learned my addr 172.21.15.148:0/2138817846 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:21.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f24827fc700 1 --2- 172.21.15.148:0/2138817846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:21.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720871176 0 0) 0x7f248c0c05b0 con 0x7f248c151c40 2023-10-24T00:45:21.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24780033f0 con 0x7f248c151c40 2023-10-24T00:45:21.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526905415 0 0) 0x7f248c154e20 con 0x7f248c0a9e90 2023-10-24T00:45:21.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c0c05b0 con 0x7f248c0a9e90 2023-10-24T00:45:21.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f24827fc700 1 -- 172.21.15.148:0/2138817846 >> v1:172.21.15.150:6789/0 conn(0x7f248c0a9e90 legacy=0x7f248c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f24827fc700 1 -- 172.21.15.148:0/2138817846 >> v1:172.21.15.148:6789/0 conn(0x7f248c151c40 legacy=0x7f248c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071016801 0 0) 0x7f24780033f0 con 0x7f248c151c40 2023-10-24T00:45:21.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f24827fc700 1 -- 172.21.15.148:0/2138817846 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c1553e0 con 0x7f248c152020 2023-10-24T00:45:21.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f24827fc700 1 --2- 172.21.15.148:0/2138817846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c1547b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2474009790 tx=0x7f2474009060).ready entity=mon.2 client_cookie=2b9b97413960abd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c001470 con 0x7f248c152020 2023-10-24T00:45:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474011400 con 0x7f248c152020 2023-10-24T00:45:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.548+0000 7f248a7fc700 1 -- 172.21.15.148:0/2138817846 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474011780 con 0x7f248c152020 2023-10-24T00:45:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 -- 172.21.15.148:0/2138817846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 msgr2=0x7f248c1547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 --2- 172.21.15.148:0/2138817846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c1547b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2474009790 tx=0x7f2474009060).stop 2023-10-24T00:45:21.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 -- 172.21.15.148:0/2138817846 shutdown_connections 2023-10-24T00:45:21.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 --2- 172.21.15.148:0/2138817846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c1547b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 -- 172.21.15.148:0/2138817846 >> 172.21.15.148:0/2138817846 conn(0x7f248c0caf40 msgr2=0x7f248c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:21.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 -- 172.21.15.148:0/2138817846 shutdown_connections 2023-10-24T00:45:21.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.549+0000 7f249138f700 1 -- 172.21.15.148:0/2138817846 wait complete. 2023-10-24T00:45:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.550+0000 7f249138f700 1 Processor -- start 2023-10-24T00:45:21.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.550+0000 7f249138f700 1 -- start start 2023-10-24T00:45:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f248c0a9e90 0x7f248c164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c165450 con 0x7f248c151c40 2023-10-24T00:45:21.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c0ab530 con 0x7f248c0a9e90 2023-10-24T00:45:21.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f249138f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c167b30 con 0x7f248c152020 2023-10-24T00:45:21.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:21.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33906/0 (socket says 172.21.15.148:33906) 2023-10-24T00:45:21.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 -- 172.21.15.148:0/2383030448 learned_addr learned my addr 172.21.15.148:0/2383030448 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:21.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f248b7fe700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f248affd700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f248c0a9e90 0x7f248c164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 -- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 msgr2=0x7f248c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c0c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 -- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f248c0a9e90 msgr2=0x7f248c164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:21.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f248c0a9e90 0x7f248c164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.551+0000 7f24827fc700 1 -- 172.21.15.148:0/2383030448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740092a0 con 0x7f248c151c40 2023-10-24T00:45:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f24827fc700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f2474009260 tx=0x7f2474016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474010950 con 0x7f248c151c40 2023-10-24T00:45:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474010ab0 con 0x7f248c151c40 2023-10-24T00:45:21.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c0c2080 con 0x7f248c151c40 2023-10-24T00:45:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474010e50 con 0x7f248c151c40 2023-10-24T00:45:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.552+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c0b0a80 con 0x7f248c151c40 2023-10-24T00:45:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.553+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c06c6b0 con 0x7f248c151c40 2023-10-24T00:45:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.553+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f24740263b0 con 0x7f248c151c40 2023-10-24T00:45:21.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.553+0000 7f24837fe700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 0x7f246c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:21.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.553+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f247407b180 con 0x7f248c151c40 2023-10-24T00:45:21.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.554+0000 7f248affd700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 0x7f246c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:21.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.554+0000 7f248affd700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 0x7f246c061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f247c001660 tx=0x7f247c001520).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:21.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.558+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f247404c390 con 0x7f248c151c40 2023-10-24T00:45:21.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:21.790+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f248c1556c0 con 0x7f248c151c40 2023-10-24T00:45:22.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.417+0000 7f24837fe700 1 -- 172.21.15.148:0/2383030448 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v600) v1 ==== 186+0+0 (secure 0 0 0) 0x7f247404f9b0 con 0x7f248c151c40 2023-10-24T00:45:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 msgr2=0x7f246c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 0x7f246c061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f247c001660 tx=0x7f247c001520).stop 2023-10-24T00:45:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 msgr2=0x7f248c0b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f2474009260 tx=0x7f2474016000).stop 2023-10-24T00:45:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 shutdown_connections 2023-10-24T00:45:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f248c152020 0x7f248c0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f248c0a9e90 0x7f248c164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f246c05f270 0x7f246c061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 --2- 172.21.15.148:0/2383030448 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f248c151c40 0x7f248c0b0590 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 >> 172.21.15.148:0/2383030448 conn(0x7f248c0caf40 msgr2=0x7f248c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 shutdown_connections 2023-10-24T00:45:22.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.419+0000 7f249138f700 1 -- 172.21.15.148:0/2383030448 wait complete. 2023-10-24T00:45:22.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:45:22.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.549+0000 7f32cba50700 1 Processor -- start 2023-10-24T00:45:22.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.549+0000 7f32cba50700 1 -- start start 2023-10-24T00:45:22.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32cba50700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f32c4154430 0x7f32c4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32cba50700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40c71d0 con 0x7f32c40bffd0 2023-10-24T00:45:22.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32cba50700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40c9410 con 0x7f32c4098bd0 2023-10-24T00:45:22.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32cba50700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40c6a10 con 0x7f32c4154430 2023-10-24T00:45:22.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32c97ec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f32c4154430 0x7f32c4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32c9fed700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f32c40bffd0 0x7f32c415e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39094/0 (socket says 172.21.15.148:39094) 2023-10-24T00:45:22.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.550+0000 7f32c9fed700 1 -- 172.21.15.148:0/1679859701 learned_addr learned my addr 172.21.15.148:0/1679859701 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:22.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32c97ec700 1 -- 172.21.15.148:0/1679859701 >> v1:172.21.15.150:6789/0 conn(0x7f32c4098bd0 legacy=0x7f32c40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32c97ec700 1 -- 172.21.15.148:0/1679859701 >> v1:172.21.15.148:6789/0 conn(0x7f32c40bffd0 legacy=0x7f32c415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32c97ec700 1 -- 172.21.15.148:0/1679859701 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40ca8b0 con 0x7f32c4154430 2023-10-24T00:45:22.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32bbfff700 1 -- 172.21.15.148:0/1679859701 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986226801 0 0) 0x7f32c40c71d0 con 0x7f32c40bffd0 2023-10-24T00:45:22.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32c97ec700 1 --2- 172.21.15.148:0/1679859701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4154430 0x7f32c4154810 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f32c0009e60 tx=0x7f32c0009780).ready entity=mon.0 client_cookie=37f5d0dff6f1bd73 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32bbfff700 1 -- 172.21.15.148:0/1679859701 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c000e070 con 0x7f32c4154430 2023-10-24T00:45:22.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32bbfff700 1 -- 172.21.15.148:0/1679859701 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c000bc30 con 0x7f32c4154430 2023-10-24T00:45:22.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.551+0000 7f32bbfff700 1 -- 172.21.15.148:0/1679859701 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0012410 con 0x7f32c4154430 2023-10-24T00:45:22.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 -- 172.21.15.148:0/1679859701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4154430 msgr2=0x7f32c4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 --2- 172.21.15.148:0/1679859701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4154430 0x7f32c4154810 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f32c0009e60 tx=0x7f32c0009780).stop 2023-10-24T00:45:22.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 -- 172.21.15.148:0/1679859701 shutdown_connections 2023-10-24T00:45:22.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 --2- 172.21.15.148:0/1679859701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4154430 0x7f32c4154810 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 -- 172.21.15.148:0/1679859701 >> 172.21.15.148:0/1679859701 conn(0x7f32c40cb070 msgr2=0x7f32c40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 -- 172.21.15.148:0/1679859701 shutdown_connections 2023-10-24T00:45:22.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.552+0000 7f32cba50700 1 -- 172.21.15.148:0/1679859701 wait complete. 2023-10-24T00:45:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.553+0000 7f32cba50700 1 Processor -- start 2023-10-24T00:45:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.553+0000 7f32cba50700 1 -- start start 2023-10-24T00:45:22.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32c40bffd0 0x7f32c4146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32c4154430 0x7f32c414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40aea80 con 0x7f32c4098bd0 2023-10-24T00:45:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40af8e0 con 0x7f32c4154430 2023-10-24T00:45:22.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32cba50700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40aecd0 con 0x7f32c40bffd0 2023-10-24T00:45:22.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32c97ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32c97ec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33930/0 (socket says 172.21.15.148:33930) 2023-10-24T00:45:22.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.554+0000 7f32c97ec700 1 -- 172.21.15.148:0/2898547192 learned_addr learned my addr 172.21.15.148:0/2898547192 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:22.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 -- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32c40bffd0 msgr2=0x7f32c4146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32c40bffd0 0x7f32c4146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 -- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32c4154430 msgr2=0x7f32c414d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32c4154430 0x7f32c414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 -- 172.21.15.148:0/2898547192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009a20 con 0x7f32c4098bd0 2023-10-24T00:45:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32c97ec700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f32c000b6c0 tx=0x7f32c0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0006320 con 0x7f32c4098bd0 2023-10-24T00:45:22.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0006480 con 0x7f32c4098bd0 2023-10-24T00:45:22.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c40aefb0 con 0x7f32c4098bd0 2023-10-24T00:45:22.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0006840 con 0x7f32c4098bd0 2023-10-24T00:45:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.555+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c40af570 con 0x7f32c4098bd0 2023-10-24T00:45:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.556+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c40afed0 con 0x7f32c4098bd0 2023-10-24T00:45:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.556+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f32c0027460 con 0x7f32c4098bd0 2023-10-24T00:45:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.556+0000 7f32b97fa700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 0x7f32a8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.557+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f32c007c730 con 0x7f32c4098bd0 2023-10-24T00:45:22.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.557+0000 7f32c8feb700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 0x7f32a8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.557+0000 7f32c8feb700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 0x7f32a8061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f32b4007fd0 tx=0x7f32b4007930).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.561+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f32c004d940 con 0x7f32c4098bd0 2023-10-24T00:45:22.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.724+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f32c406c6b0 con 0x7f32c4098bd0 2023-10-24T00:45:22.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.728+0000 7f32b97fa700 1 -- 172.21.15.148:0/2898547192 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32c0050f60 con 0x7f32c4098bd0 2023-10-24T00:45:22.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 msgr2=0x7f32a8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 0x7f32a8061700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f32b4007fd0 tx=0x7f32b4007930).stop 2023-10-24T00:45:22.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 msgr2=0x7f32c40ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f32c000b6c0 tx=0x7f32c0009780).stop 2023-10-24T00:45:22.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 shutdown_connections 2023-10-24T00:45:22.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32c4154430 0x7f32c414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:22.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f32a805f240 0x7f32a8061700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32c4098bd0 0x7f32c40ae1d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 --2- 172.21.15.148:0/2898547192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32c40bffd0 0x7f32c4146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:22.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 >> 172.21.15.148:0/2898547192 conn(0x7f32c40cb070 msgr2=0x7f32c40a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:22.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 shutdown_connections 2023-10-24T00:45:22.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.730+0000 7f32cba50700 1 -- 172.21.15.148:0/2898547192 wait complete. 2023-10-24T00:45:22.744 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:45:22.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:45:22.783 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:45:22.831 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:45:22.832 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:45:22.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.945+0000 7f8be575f700 1 Processor -- start 2023-10-24T00:45:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.945+0000 7f8be575f700 1 -- start start 2023-10-24T00:45:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8be575f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 0x7f8be00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8be575f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 0x7f8be0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8be575f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be00aa860 con 0x7f8be00c6710 2023-10-24T00:45:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8be575f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be00c0960 con 0x7f8be00aa010 2023-10-24T00:45:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8be575f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00c0c40 con 0x7f8be00aa3f0 2023-10-24T00:45:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdeffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 0x7f8be00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdf7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 0x7f8be0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bde7fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8be00c6710 0x7f8be0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56138/0 (socket says 172.21.15.148:56138) 2023-10-24T00:45:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bde7fc700 1 -- 172.21.15.148:0/2616857097 learned_addr learned my addr 172.21.15.148:0/2616857097 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdf7fe700 1 -- 172.21.15.148:0/2616857097 >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 msgr2=0x7f8be00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdf7fe700 1 --2- 172.21.15.148:0/2616857097 >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 0x7f8be00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdf7fe700 1 -- 172.21.15.148:0/2616857097 >> v1:172.21.15.150:6789/0 conn(0x7f8be00c6710 legacy=0x7f8be0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bddffb700 1 -- 172.21.15.148:0/2616857097 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800188384 0 0) 0x7f8be00aa860 con 0x7f8be00c6710 2023-10-24T00:45:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdf7fe700 1 -- 172.21.15.148:0/2616857097 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00c0f20 con 0x7f8be00aa3f0 2023-10-24T00:45:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.946+0000 7f8bdeffd700 1 --2- 172.21.15.148:0/2616857097 >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 0x7f8be00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8bdf7fe700 1 --2- 172.21.15.148:0/2616857097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 0x7f8be0069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8bd0009760 tx=0x7f8bd0009060).ready entity=mon.2 client_cookie=babbb3bb873db36e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8bddffb700 1 -- 172.21.15.148:0/2616857097 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000f510 con 0x7f8be00aa3f0 2023-10-24T00:45:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8bddffb700 1 -- 172.21.15.148:0/2616857097 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd000f670 con 0x7f8be00aa3f0 2023-10-24T00:45:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8bddffb700 1 -- 172.21.15.148:0/2616857097 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000f9f0 con 0x7f8be00aa3f0 2023-10-24T00:45:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 -- 172.21.15.148:0/2616857097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 msgr2=0x7f8be0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 --2- 172.21.15.148:0/2616857097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 0x7f8be0069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8bd0009760 tx=0x7f8bd0009060).stop 2023-10-24T00:45:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 -- 172.21.15.148:0/2616857097 shutdown_connections 2023-10-24T00:45:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 --2- 172.21.15.148:0/2616857097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00aa3f0 0x7f8be0069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 --2- 172.21.15.148:0/2616857097 >> v2:172.21.15.150:3300/0 conn(0x7f8be00aa010 0x7f8be00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 -- 172.21.15.148:0/2616857097 >> 172.21.15.148:0/2616857097 conn(0x7f8be00caf40 msgr2=0x7f8be00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 -- 172.21.15.148:0/2616857097 shutdown_connections 2023-10-24T00:45:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.947+0000 7f8be575f700 1 -- 172.21.15.148:0/2616857097 wait complete. 2023-10-24T00:45:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 Processor -- start 2023-10-24T00:45:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 -- start start 2023-10-24T00:45:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 0x7f8be014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 0x7f8be0157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00af6e0 con 0x7f8be00aa010 2023-10-24T00:45:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be014c0a0 con 0x7f8be00aa3f0 2023-10-24T00:45:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8be575f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be00ae520 con 0x7f8be00c6710 2023-10-24T00:45:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.949+0000 7f8bdeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33946/0 (socket says 172.21.15.148:33946) 2023-10-24T00:45:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 -- 172.21.15.148:0/1873038991 learned_addr learned my addr 172.21.15.148:0/1873038991 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdf7fe700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 0x7f8be0157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bde7fc700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 0x7f8be014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 -- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 msgr2=0x7f8be0157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 0x7f8be0157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 -- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 msgr2=0x7f8be014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 0x7f8be014bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 -- 172.21.15.148:0/1873038991 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8009a20 con 0x7f8be00aa010 2023-10-24T00:45:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bde7fc700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 0x7f8be014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdf7fe700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 0x7f8be0157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:22.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bdeffd700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f8bd800c0c0 tx=0x7f8bd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800cd60 con 0x7f8be00aa010 2023-10-24T00:45:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd800f040 con 0x7f8be00aa010 2023-10-24T00:45:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd00092a0 con 0x7f8be00aa010 2023-10-24T00:45:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8013610 con 0x7f8be00aa010 2023-10-24T00:45:22.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.950+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be00afbb0 con 0x7f8be00aa010 2023-10-24T00:45:22.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.951+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be006c6b0 con 0x7f8be00aa010 2023-10-24T00:45:22.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.951+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8bd80139c0 con 0x7f8be00aa010 2023-10-24T00:45:22.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.952+0000 7f8bd6ffd700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 0x7f8bc0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:22.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.952+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f8bd807aca0 con 0x7f8be00aa010 2023-10-24T00:45:22.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.952+0000 7f8bde7fc700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 0x7f8bc0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:22.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.952+0000 7f8bde7fc700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 0x7f8bc0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8bc8007fd0 tx=0x7f8bc8009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:22.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:22.956+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8bd804bf10 con 0x7f8be00aa010 2023-10-24T00:45:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.158+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8be00ae2f0 con 0x7f8be00aa010 2023-10-24T00:45:23.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.159+0000 7f8bd6ffd700 1 -- 172.21.15.148:0/1873038991 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f8be00ae2f0 con 0x7f8be00aa010 2023-10-24T00:45:23.162 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:23.162 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6343,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1647695338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1647695338},{"type":"v1","addr":"172.21.15.150:6836","nonce":1647695338}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6346,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3903282503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3903282503},{"type":"v1","addr":"172.21.15.150:6837","nonce":3903282503}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3553360968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3553360968},{"type":"v1","addr":"172.21.15.148:6834","nonce":3553360968}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":7137,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2742899443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2742899443},{"type":"v1","addr":"172.21.15.148:6835","nonce":2742899443}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2023-10-24T00:45:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 msgr2=0x7f8bc0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 0x7f8bc0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f8bc8007fd0 tx=0x7f8bc8009040).stop 2023-10-24T00:45:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 msgr2=0x7f8be00af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f8bd800c0c0 tx=0x7f8bd800b040).stop 2023-10-24T00:45:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 shutdown_connections 2023-10-24T00:45:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8be00c6710 0x7f8be0157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bc005f270 0x7f8bc0061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8be00aa010 0x7f8be00af1f0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 --2- 172.21.15.148:0/1873038991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8be00aa3f0 0x7f8be014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 >> 172.21.15.148:0/1873038991 conn(0x7f8be00caf40 msgr2=0x7f8be0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 shutdown_connections 2023-10-24T00:45:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.161+0000 7f8be575f700 1 -- 172.21.15.148:0/1873038991 wait complete. 2023-10-24T00:45:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2023-10-24T00:45:23.175 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:45:23.176 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:45:23.176 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:45:23.177 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:45:23.177 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:45:23.177 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:45:23.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:45:23.178 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:45:23.178 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:45:23.178 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:45:23.179 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:45:23.179 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:45:23.179 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:45:23.180 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:45:23.180 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:45:23.180 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:45:23.185 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:45:23.185 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:45:23.187 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:45:23.187 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:45:23.189 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:45:23.190 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:45:23.191 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:45:23.191 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:45:23.229 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:45:23.230 DEBUG:teuthology.parallel:result is None 2023-10-24T00:45:23.230 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:45:23.231 DEBUG:teuthology.parallel:result is None 2023-10-24T00:45:23.233 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:45:23.233 DEBUG:teuthology.parallel:result is None 2023-10-24T00:45:23.234 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:45:23.234 DEBUG:teuthology.parallel:result is None 2023-10-24T00:45:23.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:45:23.302 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:45:23.303 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:45:23.313 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:45:23.314 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.359+0000 7f041cb94700 1 Processor -- start 2023-10-24T00:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.359+0000 7f041cb94700 1 -- start start 2023-10-24T00:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041cb94700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0418154400 0x7f04180c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041cb94700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04181547e0 0x7f04180a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041cb94700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04180c01c0 con 0x7f04180a82c0 2023-10-24T00:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041cb94700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04180aa960 con 0x7f0418154400 2023-10-24T00:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041cb94700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04180c66f0 con 0x7f04181547e0 2023-10-24T00:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0418154400 0x7f04180c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f0416d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f04180a82c0 0x7f04180c0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43780/0 (socket says 172.21.15.148:43780) 2023-10-24T00:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f0416d9d700 1 -- 172.21.15.148:0/3279051435 learned_addr learned my addr 172.21.15.148:0/3279051435 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f0415d9b700 1 --2- 172.21.15.148:0/3279051435 >> v2:172.21.15.150:3300/0 conn(0x7f04181547e0 0x7f04180a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 -- 172.21.15.148:0/3279051435 >> v2:172.21.15.150:3300/0 conn(0x7f04181547e0 msgr2=0x7f04180a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 --2- 172.21.15.148:0/3279051435 >> v2:172.21.15.150:3300/0 conn(0x7f04181547e0 0x7f04180a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 -- 172.21.15.148:0/3279051435 >> v1:172.21.15.148:6789/0 conn(0x7f04180a82c0 legacy=0x7f04180c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 -- 172.21.15.148:0/3279051435 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180c6150 con 0x7f0418154400 2023-10-24T00:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041559a700 1 -- 172.21.15.148:0/3279051435 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33759594 0 0) 0x7f04180c01c0 con 0x7f04180a82c0 2023-10-24T00:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041659c700 1 --2- 172.21.15.148:0/3279051435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f04180c8310 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f0418085bc0 tx=0x7f0410009060).ready entity=mon.0 client_cookie=7205a4a2d8e2bd52 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041559a700 1 -- 172.21.15.148:0/3279051435 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100090d0 con 0x7f0418154400 2023-10-24T00:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041559a700 1 -- 172.21.15.148:0/3279051435 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041000b580 con 0x7f0418154400 2023-10-24T00:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.360+0000 7f041559a700 1 -- 172.21.15.148:0/3279051435 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000b900 con 0x7f0418154400 2023-10-24T00:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 -- 172.21.15.148:0/3279051435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 msgr2=0x7f04180c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 --2- 172.21.15.148:0/3279051435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f04180c8310 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f0418085bc0 tx=0x7f0410009060).stop 2023-10-24T00:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 -- 172.21.15.148:0/3279051435 shutdown_connections 2023-10-24T00:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 --2- 172.21.15.148:0/3279051435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f04180c8310 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 --2- 172.21.15.148:0/3279051435 >> v2:172.21.15.150:3300/0 conn(0x7f04181547e0 0x7f04180a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 -- 172.21.15.148:0/3279051435 >> 172.21.15.148:0/3279051435 conn(0x7f04180946a0 msgr2=0x7f041806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 -- 172.21.15.148:0/3279051435 shutdown_connections 2023-10-24T00:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.361+0000 7f041cb94700 1 -- 172.21.15.148:0/3279051435 wait complete. 2023-10-24T00:45:23.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.362+0000 7f041cb94700 1 Processor -- start 2023-10-24T00:45:23.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.362+0000 7f041cb94700 1 -- start start 2023-10-24T00:45:23.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04180a82c0 0x7f04180ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04181547e0 0x7f0418152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418152b30 con 0x7f0418154400 2023-10-24T00:45:23.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418155f60 con 0x7f04181547e0 2023-10-24T00:45:23.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041cb94700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04181556a0 con 0x7f04180a82c0 2023-10-24T00:45:23.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55670/0 (socket says 172.21.15.148:55670) 2023-10-24T00:45:23.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 -- 172.21.15.148:0/1606368883 learned_addr learned my addr 172.21.15.148:0/1606368883 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:23.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0416d9d700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04181547e0 0x7f0418152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f041659c700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04180a82c0 0x7f04180ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 -- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04180a82c0 msgr2=0x7f04180ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04180a82c0 0x7f04180ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 -- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04181547e0 msgr2=0x7f0418152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:23.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04181547e0 0x7f0418152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:23.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 -- 172.21.15.148:0/1606368883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100092a0 con 0x7f0418154400 2023-10-24T00:45:23.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.363+0000 7f0415d9b700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f040c00d860 tx=0x7f040c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:23.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.364+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0104f0 con 0x7f0418154400 2023-10-24T00:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.364+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c010650 con 0x7f0418154400 2023-10-24T00:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.364+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0418155910 con 0x7f0418154400 2023-10-24T00:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.364+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0109d0 con 0x7f0418154400 2023-10-24T00:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.364+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0418155ca0 con 0x7f0418154400 2023-10-24T00:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.365+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0418156110 con 0x7f0418154400 2023-10-24T00:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.365+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f040c0123e0 con 0x7f0418154400 2023-10-24T00:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.365+0000 7f04067fc700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 0x7f03f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.365+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5828+0+0 (secure 0 0 0) 0x7f040c079c90 con 0x7f0418154400 2023-10-24T00:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.365+0000 7f041659c700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 0x7f03f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.366+0000 7f041659c700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 0x7f03f8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0410009fd0 tx=0x7f0410017000).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.369+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0418156110 con 0x7f0418154400 2023-10-24T00:45:23.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:23.550+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f04181560d0 con 0x7f0418154400 2023-10-24T00:45:24.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.428+0000 7f04067fc700 1 -- 172.21.15.148:0/1606368883 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7f040c04aea0 con 0x7f0418154400 2023-10-24T00:45:24.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 msgr2=0x7f03f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 0x7f03f8061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0410009fd0 tx=0x7f0410017000).stop 2023-10-24T00:45:24.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 msgr2=0x7f0418152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f040c00d860 tx=0x7f040c008040).stop 2023-10-24T00:45:24.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 shutdown_connections 2023-10-24T00:45:24.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04181547e0 0x7f0418152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04180a82c0 0x7f04180ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f03f805f270 0x7f03f8061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 --2- 172.21.15.148:0/1606368883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0418154400 0x7f0418152150 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 >> 172.21.15.148:0/1606368883 conn(0x7f04180946a0 msgr2=0x7f04180aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 shutdown_connections 2023-10-24T00:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.430+0000 7f041cb94700 1 -- 172.21.15.148:0/1606368883 wait complete. 2023-10-24T00:45:24.435 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:45:24.444 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:45:24.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.556+0000 7f541084b700 1 Processor -- start 2023-10-24T00:45:24.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.556+0000 7f541084b700 1 -- start start 2023-10-24T00:45:24.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.556+0000 7f541084b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 0x7f540c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.556+0000 7f541084b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f540c152460 0x7f540c062c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f541084b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c06b9e0 con 0x7f540c0ac6c0 2023-10-24T00:45:24.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f541084b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0699a0 con 0x7f540c152460 2023-10-24T00:45:24.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f541084b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c06b420 con 0x7f540c152080 2023-10-24T00:45:24.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f540c152460 0x7f540c062c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540ad9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 0x7f540c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540a59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f540c0ac6c0 0x7f540c065470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34474/0 (socket says 172.21.15.148:34474) 2023-10-24T00:45:24.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540a59c700 1 -- 172.21.15.148:0/1368460966 learned_addr learned my addr 172.21.15.148:0/1368460966 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:24.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 -- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 msgr2=0x7f540c0694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:24.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 0x7f540c0694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 -- 172.21.15.148:0/1368460966 >> v1:172.21.15.150:6789/0 conn(0x7f540c0ac6c0 legacy=0x7f540c065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f5409d9b700 1 -- 172.21.15.148:0/1368460966 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762490465 0 0) 0x7f540c06b9e0 con 0x7f540c0ac6c0 2023-10-24T00:45:24.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 -- 172.21.15.148:0/1368460966 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c06b700 con 0x7f540c152460 2023-10-24T00:45:24.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540ad9d700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 0x7f540c0694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:24.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.557+0000 7f540b59e700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c062c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5404009e60 tx=0x7f5404009780).ready entity=mon.1 client_cookie=46fabc4a52d59acb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f5409d9b700 1 -- 172.21.15.148:0/1368460966 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400e070 con 0x7f540c152460 2023-10-24T00:45:24.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f5409d9b700 1 -- 172.21.15.148:0/1368460966 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bb60 con 0x7f540c152460 2023-10-24T00:45:24.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f5409d9b700 1 -- 172.21.15.148:0/1368460966 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012410 con 0x7f540c152460 2023-10-24T00:45:24.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 -- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 msgr2=0x7f540c062c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c062c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5404009e60 tx=0x7f5404009780).stop 2023-10-24T00:45:24.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 -- 172.21.15.148:0/1368460966 shutdown_connections 2023-10-24T00:45:24.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c062c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 --2- 172.21.15.148:0/1368460966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c152080 0x7f540c0694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 -- 172.21.15.148:0/1368460966 >> 172.21.15.148:0/1368460966 conn(0x7f540c0c72d0 msgr2=0x7f540c0c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:24.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 -- 172.21.15.148:0/1368460966 shutdown_connections 2023-10-24T00:45:24.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.558+0000 7f541084b700 1 -- 172.21.15.148:0/1368460966 wait complete. 2023-10-24T00:45:24.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.559+0000 7f541084b700 1 Processor -- start 2023-10-24T00:45:24.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.559+0000 7f541084b700 1 -- start start 2023-10-24T00:45:24.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c0ac6c0 0x7f540c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0c61d0 con 0x7f540c152080 2023-10-24T00:45:24.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0bf910 con 0x7f540c152460 2023-10-24T00:45:24.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f541084b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0bed00 con 0x7f540c0ac6c0 2023-10-24T00:45:24.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f540a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f540a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55678/0 (socket says 172.21.15.148:55678) 2023-10-24T00:45:24.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f540a59c700 1 -- 172.21.15.148:0/1319726998 learned_addr learned my addr 172.21.15.148:0/1319726998 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:24.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f540b59e700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.560+0000 7f540ad9d700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c0ac6c0 0x7f540c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 -- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c0ac6c0 msgr2=0x7f540c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c0ac6c0 0x7f540c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 -- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 msgr2=0x7f540c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c0c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 -- 172.21.15.148:0/1319726998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0092a0 con 0x7f540c152080 2023-10-24T00:45:24.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f540a59c700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f5400001eb0 tx=0x7f5400007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000070d0 con 0x7f540c152080 2023-10-24T00:45:24.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400007230 con 0x7f540c152080 2023-10-24T00:45:24.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5404009a20 con 0x7f540c152080 2023-10-24T00:45:24.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54000075b0 con 0x7f540c152080 2023-10-24T00:45:24.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.561+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0bf2c0 con 0x7f540c152080 2023-10-24T00:45:24.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.562+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0640f0 con 0x7f540c152080 2023-10-24T00:45:24.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.562+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5400005bc0 con 0x7f540c152080 2023-10-24T00:45:24.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.563+0000 7f53f2ffd700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.563+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5400079990 con 0x7f540c152080 2023-10-24T00:45:24.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.563+0000 7f540ad9d700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.563+0000 7f540ad9d700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 0x7f53f8061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f53fc009dc0 tx=0x7f53fc009060).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.567+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f540004ae30 con 0x7f540c152080 2023-10-24T00:45:24.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.791+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f540c064c70 con 0x7f540c152080 2023-10-24T00:45:24.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.792+0000 7f53f2ffd700 1 -- 172.21.15.148:0/1319726998 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5400018030 con 0x7f540c152080 2023-10-24T00:45:24.794 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:24.795 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:45:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:45:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.795 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:45:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:45:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:45:24.796 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:45:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.797 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:45:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:45:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:45:24.798 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:45:24.799 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:45:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:45:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:45:24.800 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:45:24.801 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:45:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:45:24.802 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:45:24.803 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.806 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:45:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:45:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.807 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:45:24.808 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:45:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:45:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:45:24.810 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:45:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:45:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.812 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.813 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:45:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:45:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.814 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:45:24.815 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:45:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:45:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.817 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:45:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:45:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.818 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:45:24.819 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:45:24.820 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:45:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:45:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:45:24.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:45:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:45:24.822 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:45:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:45:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:45:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:45:24.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:45:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:45:24.824 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:45:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:45:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.826 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:45:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:45:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:24.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:45:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:45:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:45:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:45:24.828 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:45:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:45:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:24.829 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:45:24.829 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:45:24.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 msgr2=0x7f53f8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 0x7f53f8061730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f53fc009dc0 tx=0x7f53fc009060).stop 2023-10-24T00:45:24.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 msgr2=0x7f540c0c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f5400001eb0 tx=0x7f5400007bd0).stop 2023-10-24T00:45:24.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 shutdown_connections 2023-10-24T00:45:24.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f540c152460 0x7f540c0c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f540c0ac6c0 0x7f540c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53f805f270 0x7f53f8061730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 --2- 172.21.15.148:0/1319726998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f540c152080 0x7f540c0c57f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 >> 172.21.15.148:0/1319726998 conn(0x7f540c0c72d0 msgr2=0x7f540c14ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:24.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 shutdown_connections 2023-10-24T00:45:24.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.793+0000 7f541084b700 1 -- 172.21.15.148:0/1319726998 wait complete. 2023-10-24T00:45:24.834 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:24.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 Processor -- start 2023-10-24T00:45:24.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 -- start start 2023-10-24T00:45:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43201543a0 0x7f4320154800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4320069860 0x7f4320069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200693d0 con 0x7f4320150740 2023-10-24T00:45:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4320064bc0 con 0x7f4320069860 2023-10-24T00:45:24.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.947+0000 7f4325c97700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4320154cf0 con 0x7f43201543a0 2023-10-24T00:45:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4320069860 0x7f4320069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4320069860 0x7f4320069cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55680/0 (socket says 172.21.15.148:55680) 2023-10-24T00:45:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 -- 172.21.15.148:0/2361946910 learned_addr learned my addr 172.21.15.148:0/2361946910 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431effd700 1 --2- 172.21.15.148:0/2361946910 >> v2:172.21.15.150:3300/0 conn(0x7f43201543a0 0x7f4320154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 -- 172.21.15.148:0/2361946910 >> v2:172.21.15.150:3300/0 conn(0x7f43201543a0 msgr2=0x7f4320154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 --2- 172.21.15.148:0/2361946910 >> v2:172.21.15.150:3300/0 conn(0x7f43201543a0 0x7f4320154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 -- 172.21.15.148:0/2361946910 >> v1:172.21.15.150:6789/0 conn(0x7f4320150740 legacy=0x7f43200644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 -- 172.21.15.148:0/2361946910 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200c6760 con 0x7f4320069860 2023-10-24T00:45:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431ffff700 1 --2- 172.21.15.148:0/2361946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320069860 0x7f4320069cb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f43200c3600 tx=0x7f43180090f0).ready entity=mon.0 client_cookie=b1a1722d761b0d0c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431e7fc700 1 -- 172.21.15.148:0/2361946910 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800b630 con 0x7f4320069860 2023-10-24T00:45:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431e7fc700 1 -- 172.21.15.148:0/2361946910 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800b790 con 0x7f4320069860 2023-10-24T00:45:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.948+0000 7f431e7fc700 1 -- 172.21.15.148:0/2361946910 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800bb10 con 0x7f4320069860 2023-10-24T00:45:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 -- 172.21.15.148:0/2361946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320069860 msgr2=0x7f4320069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 --2- 172.21.15.148:0/2361946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320069860 0x7f4320069cb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f43200c3600 tx=0x7f43180090f0).stop 2023-10-24T00:45:24.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 -- 172.21.15.148:0/2361946910 shutdown_connections 2023-10-24T00:45:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 --2- 172.21.15.148:0/2361946910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320069860 0x7f4320069cb0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 --2- 172.21.15.148:0/2361946910 >> v2:172.21.15.150:3300/0 conn(0x7f43201543a0 0x7f4320154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 -- 172.21.15.148:0/2361946910 >> 172.21.15.148:0/2361946910 conn(0x7f4320063120 msgr2=0x7f43200c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 -- 172.21.15.148:0/2361946910 shutdown_connections 2023-10-24T00:45:24.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.949+0000 7f4325c97700 1 -- 172.21.15.148:0/2361946910 wait complete. 2023-10-24T00:45:24.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.950+0000 7f4325c97700 1 Processor -- start 2023-10-24T00:45:24.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.950+0000 7f4325c97700 1 -- start start 2023-10-24T00:45:24.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 0x7f43200bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43201543a0 0x7f4320162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200a0430 con 0x7f4320150740 2023-10-24T00:45:24.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4320150b20 con 0x7f43201543a0 2023-10-24T00:45:24.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4320151380 con 0x7f4320069860 2023-10-24T00:45:24.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55696/0 (socket says 172.21.15.148:55696) 2023-10-24T00:45:24.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 -- 172.21.15.148:0/868616809 learned_addr learned my addr 172.21.15.148:0/868616809 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:24.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431f7fe700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 0x7f43200bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 -- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 msgr2=0x7f43200bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 0x7f43200bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:24.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 -- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43201543a0 msgr2=0x7f4320162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43201543a0 0x7f4320162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 -- 172.21.15.148:0/868616809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318009370 con 0x7f4320150740 2023-10-24T00:45:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431f7fe700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 0x7f43200bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f431effd700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f431400d860 tx=0x7f4314008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140125f0 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314012750 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43200c0330 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314012ad0 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.951+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4320151010 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.953+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320151530 con 0x7f4320150740 2023-10-24T00:45:24.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.953+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4314013480 con 0x7f4320150740 2023-10-24T00:45:24.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.953+0000 7f43077fe700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 0x7f430c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:24.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.953+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4314079e70 con 0x7f4320150740 2023-10-24T00:45:24.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.953+0000 7f431f7fe700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 0x7f430c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:24.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.954+0000 7f431f7fe700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 0x7f430c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4310007fd0 tx=0x7f4310009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:24.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:24.957+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4320151530 con 0x7f4320150740 2023-10-24T00:45:25.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.121+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43201514f0 con 0x7f4320150740 2023-10-24T00:45:25.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.122+0000 7f43077fe700 1 -- 172.21.15.148:0/868616809 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+13763 (secure 0 0 0) 0x7f431404b2b0 con 0x7f4320150740 2023-10-24T00:45:25.124 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:25.125 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":107,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:24.418930+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:25.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 msgr2=0x7f430c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 0x7f430c061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4310007fd0 tx=0x7f4310009040).stop 2023-10-24T00:45:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 msgr2=0x7f4320151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f431400d860 tx=0x7f4314008040).stop 2023-10-24T00:45:25.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 shutdown_connections 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43201543a0 0x7f4320162ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4320069860 0x7f43200bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f430c05f270 0x7f430c061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 --2- 172.21.15.148:0/868616809 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4320150740 0x7f4320151810 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 >> 172.21.15.148:0/868616809 conn(0x7f4320063120 msgr2=0x7f43200c5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 shutdown_connections 2023-10-24T00:45:25.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.124+0000 7f4325c97700 1 -- 172.21.15.148:0/868616809 wait complete. 2023-10-24T00:45:25.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:45:25.139 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:45:25.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.253+0000 7f04a7a09700 1 Processor -- start 2023-10-24T00:45:25.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.253+0000 7f04a7a09700 1 -- start start 2023-10-24T00:45:25.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a7a09700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04a0154430 0x7f04a0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a7a09700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04a00bffd0 0x7f04a00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a7a09700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a00c71d0 con 0x7f04a0098bd0 2023-10-24T00:45:25.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a7a09700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00c6a10 con 0x7f04a00bffd0 2023-10-24T00:45:25.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a7a09700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00c9410 con 0x7f04a0154430 2023-10-24T00:45:25.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a5fa6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04a00bffd0 0x7f04a00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a5fa6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04a00bffd0 0x7f04a00c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55700/0 (socket says 172.21.15.148:55700) 2023-10-24T00:45:25.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.254+0000 7f04a5fa6700 1 -- 172.21.15.148:0/3802802906 learned_addr learned my addr 172.21.15.148:0/3802802906 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:25.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a57a5700 1 --2- 172.21.15.148:0/3802802906 >> v2:172.21.15.150:3300/0 conn(0x7f04a0154430 0x7f04a0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a5fa6700 1 -- 172.21.15.148:0/3802802906 >> v2:172.21.15.150:3300/0 conn(0x7f04a0154430 msgr2=0x7f04a0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a5fa6700 1 --2- 172.21.15.148:0/3802802906 >> v2:172.21.15.150:3300/0 conn(0x7f04a0154430 0x7f04a0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a5fa6700 1 -- 172.21.15.148:0/3802802906 >> v1:172.21.15.150:6789/0 conn(0x7f04a0098bd0 legacy=0x7f04a00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a5fa6700 1 -- 172.21.15.148:0/3802802906 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00c0950 con 0x7f04a00bffd0 2023-10-24T00:45:25.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a5fa6700 1 --2- 172.21.15.148:0/3802802906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a00bffd0 0x7f04a00c0460 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f04a005ff70 tx=0x7f04980090f0).ready entity=mon.0 client_cookie=c14ba44594f0635a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f0497fff700 1 -- 172.21.15.148:0/3802802906 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800b5a0 con 0x7f04a00bffd0 2023-10-24T00:45:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f0497fff700 1 -- 172.21.15.148:0/3802802906 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800b700 con 0x7f04a00bffd0 2023-10-24T00:45:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f0497fff700 1 -- 172.21.15.148:0/3802802906 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800ba80 con 0x7f04a00bffd0 2023-10-24T00:45:25.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 -- 172.21.15.148:0/3802802906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a00bffd0 msgr2=0x7f04a00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 --2- 172.21.15.148:0/3802802906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a00bffd0 0x7f04a00c0460 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f04a005ff70 tx=0x7f04980090f0).stop 2023-10-24T00:45:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 -- 172.21.15.148:0/3802802906 shutdown_connections 2023-10-24T00:45:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 --2- 172.21.15.148:0/3802802906 >> v2:172.21.15.150:3300/0 conn(0x7f04a0154430 0x7f04a0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 --2- 172.21.15.148:0/3802802906 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a00bffd0 0x7f04a00c0460 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.255+0000 7f04a7a09700 1 -- 172.21.15.148:0/3802802906 >> 172.21.15.148:0/3802802906 conn(0x7f04a00cb070 msgr2=0x7f04a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.256+0000 7f04a7a09700 1 -- 172.21.15.148:0/3802802906 shutdown_connections 2023-10-24T00:45:25.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.256+0000 7f04a7a09700 1 -- 172.21.15.148:0/3802802906 wait complete. 2023-10-24T00:45:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.257+0000 7f04a7a09700 1 Processor -- start 2023-10-24T00:45:25.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.257+0000 7f04a7a09700 1 -- start start 2023-10-24T00:45:25.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04a0098bd0 0x7f04a0151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04a00bffd0 0x7f04a0152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a01538a0 con 0x7f04a0154430 2023-10-24T00:45:25.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00c3260 con 0x7f04a00bffd0 2023-10-24T00:45:25.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00c3540 con 0x7f04a0098bd0 2023-10-24T00:45:25.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55704/0 (socket says 172.21.15.148:55704) 2023-10-24T00:45:25.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 -- 172.21.15.148:0/1643947461 learned_addr learned my addr 172.21.15.148:0/1643947461 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:25.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a57a5700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04a0098bd0 0x7f04a0151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a4fa4700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04a00bffd0 0x7f04a0152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 -- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04a0098bd0 msgr2=0x7f04a0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04a0098bd0 0x7f04a0151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 -- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04a00bffd0 msgr2=0x7f04a0152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04a00bffd0 0x7f04a0152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 -- 172.21.15.148:0/1643947461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498009370 con 0x7f04a0154430 2023-10-24T00:45:25.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a5fa6700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f0498009130 tx=0x7f0498015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800b870 con 0x7f04a0154430 2023-10-24T00:45:25.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800b9d0 con 0x7f04a0154430 2023-10-24T00:45:25.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a00c3820 con 0x7f04a0154430 2023-10-24T00:45:25.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049801c670 con 0x7f04a0154430 2023-10-24T00:45:25.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.258+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a00c3de0 con 0x7f04a0154430 2023-10-24T00:45:25.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.259+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a006c6b0 con 0x7f04a0154430 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.260+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f049801ca20 con 0x7f04a0154430 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.260+0000 7f04957fa700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 0x7f0484061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.260+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f049807be30 con 0x7f04a0154430 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.260+0000 7f04a57a5700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 0x7f0484061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.261+0000 7f04a57a5700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 0x7f0484061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f049c0075a0 tx=0x7f049c0097b0).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.264+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f049804d2d0 con 0x7f04a0154430 2023-10-24T00:45:25.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.428+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04a00612f0 con 0x7f04a0154430 2023-10-24T00:45:25.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.428+0000 7f04957fa700 1 -- 172.21.15.148:0/1643947461 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v107) v1 ==== 110+0+10 (secure 0 0 0) 0x7f049802a070 con 0x7f04a0154430 2023-10-24T00:45:25.431 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:45:25.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.430+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 msgr2=0x7f0484061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.430+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 0x7f0484061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f049c0075a0 tx=0x7f049c0097b0).stop 2023-10-24T00:45:25.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.430+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 msgr2=0x7f04a01533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.430+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f0498009130 tx=0x7f0498015000).stop 2023-10-24T00:45:25.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 shutdown_connections 2023-10-24T00:45:25.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f048405f270 0x7f0484061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04a0154430 0x7f04a01533b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04a0098bd0 0x7f04a0151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 --2- 172.21.15.148:0/1643947461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04a00bffd0 0x7f04a0152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 >> 172.21.15.148:0/1643947461 conn(0x7f04a00cb070 msgr2=0x7f04a00aa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 shutdown_connections 2023-10-24T00:45:25.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.431+0000 7f04a7a09700 1 -- 172.21.15.148:0/1643947461 wait complete. 2023-10-24T00:45:25.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:45:25.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.559+0000 7fed7610c700 1 Processor -- start 2023-10-24T00:45:25.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.559+0000 7fed7610c700 1 -- start start 2023-10-24T00:45:25.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed7610c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed70098bd0 0x7fed70154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed7610c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed700bffd0 0x7fed700c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed7610c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed700c71d0 con 0x7fed70154430 2023-10-24T00:45:25.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed7610c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed700c6a10 con 0x7fed700bffd0 2023-10-24T00:45:25.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed7610c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed700c9410 con 0x7fed70098bd0 2023-10-24T00:45:25.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed700bffd0 0x7fed700c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fed70154430 0x7fed700c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43792/0 (socket says 172.21.15.148:43792) 2023-10-24T00:45:25.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6f7fe700 1 -- 172.21.15.148:0/3524083170 learned_addr learned my addr 172.21.15.148:0/3524083170 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:25.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6effd700 1 --2- 172.21.15.148:0/3524083170 >> v2:172.21.15.150:3300/0 conn(0x7fed70098bd0 0x7fed70154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6ffff700 1 -- 172.21.15.148:0/3524083170 >> v2:172.21.15.150:3300/0 conn(0x7fed70098bd0 msgr2=0x7fed70154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.560+0000 7fed6ffff700 1 --2- 172.21.15.148:0/3524083170 >> v2:172.21.15.150:3300/0 conn(0x7fed70098bd0 0x7fed70154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6ffff700 1 -- 172.21.15.148:0/3524083170 >> v1:172.21.15.148:6789/0 conn(0x7fed70154430 legacy=0x7fed700c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6ffff700 1 -- 172.21.15.148:0/3524083170 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700c0950 con 0x7fed700bffd0 2023-10-24T00:45:25.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6e7fc700 1 -- 172.21.15.148:0/3524083170 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838158051 0 0) 0x7fed700c71d0 con 0x7fed70154430 2023-10-24T00:45:25.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6ffff700 1 --2- 172.21.15.148:0/3524083170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed700bffd0 0x7fed700c0460 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fed700c23b0 tx=0x7fed68009060).ready entity=mon.0 client_cookie=c1f5133ff9b4a7f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6e7fc700 1 -- 172.21.15.148:0/3524083170 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800f510 con 0x7fed700bffd0 2023-10-24T00:45:25.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6e7fc700 1 -- 172.21.15.148:0/3524083170 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6800f670 con 0x7fed700bffd0 2023-10-24T00:45:25.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed6e7fc700 1 -- 172.21.15.148:0/3524083170 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800f9f0 con 0x7fed700bffd0 2023-10-24T00:45:25.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 -- 172.21.15.148:0/3524083170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed700bffd0 msgr2=0x7fed700c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 --2- 172.21.15.148:0/3524083170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed700bffd0 0x7fed700c0460 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fed700c23b0 tx=0x7fed68009060).stop 2023-10-24T00:45:25.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 -- 172.21.15.148:0/3524083170 shutdown_connections 2023-10-24T00:45:25.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 --2- 172.21.15.148:0/3524083170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed700bffd0 0x7fed700c0460 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 --2- 172.21.15.148:0/3524083170 >> v2:172.21.15.150:3300/0 conn(0x7fed70098bd0 0x7fed70154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 -- 172.21.15.148:0/3524083170 >> 172.21.15.148:0/3524083170 conn(0x7fed700cb070 msgr2=0x7fed700cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 -- 172.21.15.148:0/3524083170 shutdown_connections 2023-10-24T00:45:25.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.561+0000 7fed7610c700 1 -- 172.21.15.148:0/3524083170 wait complete. 2023-10-24T00:45:25.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 Processor -- start 2023-10-24T00:45:25.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 -- start start 2023-10-24T00:45:25.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed700bffd0 0x7fed700a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed70154430 0x7fed700a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700a8810 con 0x7fed70098bd0 2023-10-24T00:45:25.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700ab500 con 0x7fed70154430 2023-10-24T00:45:25.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed7610c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700aabf0 con 0x7fed700bffd0 2023-10-24T00:45:25.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed6f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55722/0 (socket says 172.21.15.148:55722) 2023-10-24T00:45:25.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.563+0000 7fed6f7fe700 1 -- 172.21.15.148:0/1810603781 learned_addr learned my addr 172.21.15.148:0/1810603781 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:25.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6effd700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed700bffd0 0x7fed700a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6ffff700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed70154430 0x7fed700a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 -- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed700bffd0 msgr2=0x7fed700a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed700bffd0 0x7fed700a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 -- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed70154430 msgr2=0x7fed700a8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed70154430 0x7fed700a8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 -- 172.21.15.148:0/1810603781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680092a0 con 0x7fed70098bd0 2023-10-24T00:45:25.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed6f7fe700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fed6000c840 tx=0x7fed60001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60005d30 con 0x7fed70098bd0 2023-10-24T00:45:25.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60005e90 con 0x7fed70098bd0 2023-10-24T00:45:25.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60007320 con 0x7fed70098bd0 2023-10-24T00:45:25.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed700aaeb0 con 0x7fed70098bd0 2023-10-24T00:45:25.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.564+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed70168a40 con 0x7fed70098bd0 2023-10-24T00:45:25.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.565+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7006c6b0 con 0x7fed70098bd0 2023-10-24T00:45:25.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.565+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fed60007750 con 0x7fed70098bd0 2023-10-24T00:45:25.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.566+0000 7fed577fe700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 0x7fed5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.566+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fed6007a0d0 con 0x7fed70098bd0 2023-10-24T00:45:25.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.566+0000 7fed6effd700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 0x7fed5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.566+0000 7fed6effd700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 0x7fed5c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fed70150b70 tx=0x7fed64008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.570+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed6004b570 con 0x7fed70098bd0 2023-10-24T00:45:25.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.730+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed700612f0 con 0x7fed70098bd0 2023-10-24T00:45:25.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.730+0000 7fed577fe700 1 -- 172.21.15.148:0/1810603781 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed600016b0 con 0x7fed70098bd0 2023-10-24T00:45:25.733 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:45:25.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 msgr2=0x7fed5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 0x7fed5c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fed70150b70 tx=0x7fed64008040).stop 2023-10-24T00:45:25.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 msgr2=0x7fed7014dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fed6000c840 tx=0x7fed60001570).stop 2023-10-24T00:45:25.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 shutdown_connections 2023-10-24T00:45:25.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed70154430 0x7fed700a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed5c05f270 0x7fed5c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed70098bd0 0x7fed7014dd10 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 --2- 172.21.15.148:0/1810603781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed700bffd0 0x7fed700a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 >> 172.21.15.148:0/1810603781 conn(0x7fed700cb070 msgr2=0x7fed700649e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 shutdown_connections 2023-10-24T00:45:25.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.732+0000 7fed7610c700 1 -- 172.21.15.148:0/1810603781 wait complete. 2023-10-24T00:45:25.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:45:25.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.859+0000 7f35e73a8700 1 Processor -- start 2023-10-24T00:45:25.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.860+0000 7f35e73a8700 1 -- start start 2023-10-24T00:45:25.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.860+0000 7f35e73a8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e00bfa50 0x7f35e0095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.860+0000 7f35e73a8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e00bf5c0 con 0x7f35e0154780 2023-10-24T00:45:25.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e73a8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e00a86d0 con 0x7f35e01543a0 2023-10-24T00:45:25.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e73a8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00be9b0 con 0x7f35e00bfa50 2023-10-24T00:45:25.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e5945700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f35e0154780 0x7f35e00a5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43796/0 (socket says 172.21.15.148:43796) 2023-10-24T00:45:25.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e5945700 1 -- 172.21.15.148:0/1474151153 learned_addr learned my addr 172.21.15.148:0/1474151153 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:25.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e4943700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e00bfa50 0x7f35e0095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222293184 0 0) 0x7f35e00bf5c0 con 0x7f35e0154780 2023-10-24T00:45:25.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35cc0033f0 con 0x7f35e0154780 2023-10-24T00:45:25.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90534528 0 0) 0x7f35e00a86d0 con 0x7f35e01543a0 2023-10-24T00:45:25.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e00bf5c0 con 0x7f35e01543a0 2023-10-24T00:45:25.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1348360766 0 0) 0x7f35cc0033f0 con 0x7f35e0154780 2023-10-24T00:45:25.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e00bfa50 msgr2=0x7f35e0095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e00bfa50 0x7f35e0095de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 >> v1:172.21.15.150:6789/0 conn(0x7f35e01543a0 legacy=0x7f35e00a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00bec90 con 0x7f35e0154780 2023-10-24T00:45:25.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f35d8001470 con 0x7f35e0154780 2023-10-24T00:45:25.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 >> v1:172.21.15.148:6789/0 conn(0x7f35e0154780 legacy=0x7f35e00a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc004690 0x7f35cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35cc005000 0x7f35cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00be9b0 con 0x7f35cc003aa0 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc00bdd0 con 0x7f35cc005000 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc00bf90 con 0x7f35cc004690 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e4943700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e00bfa50 0x7f35e0095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:25.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.861+0000 7f35e5144700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5945700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35cc005000 0x7f35cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e4943700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc004690 0x7f35cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 -- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc004690 msgr2=0x7f35cc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35cc004690 0x7f35cc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 -- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35cc005000 msgr2=0x7f35cc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:25.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35cc005000 0x7f35cc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 -- 172.21.15.148:0/1474151153 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0033f0 con 0x7f35cc003aa0 2023-10-24T00:45:25.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5144700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35cc003ea0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f35dc001fa0 tx=0x7f35dc007ef0).ready entity=mon.0 client_cookie=a808eb2ca2ee79ea server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc002100 con 0x7f35cc003aa0 2023-10-24T00:45:25.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc00c8b0 con 0x7f35cc003aa0 2023-10-24T00:45:25.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35d7fff700 1 -- 172.21.15.148:0/1474151153 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00cc50 con 0x7f35cc003aa0 2023-10-24T00:45:25.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e73a8700 1 -- 172.21.15.148:0/1474151153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 msgr2=0x7f35cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e73a8700 1 --2- 172.21.15.148:0/1474151153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35cc003ea0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f35dc001fa0 tx=0x7f35dc007ef0).stop 2023-10-24T00:45:25.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e5945700 1 -- 172.21.15.148:0/1474151153 reap_dead start 2023-10-24T00:45:25.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e73a8700 1 -- 172.21.15.148:0/1474151153 shutdown_connections 2023-10-24T00:45:25.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.862+0000 7f35e73a8700 1 -- 172.21.15.148:0/1474151153 >> 172.21.15.148:0/1474151153 conn(0x7f35e00630f0 msgr2=0x7f35e00c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:25.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.863+0000 7f35e73a8700 1 -- 172.21.15.148:0/1474151153 shutdown_connections 2023-10-24T00:45:25.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.863+0000 7f35e73a8700 1 -- 172.21.15.148:0/1474151153 wait complete. 2023-10-24T00:45:25.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.864+0000 7f35e73a8700 1 Processor -- start 2023-10-24T00:45:25.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.864+0000 7f35e73a8700 1 -- start start 2023-10-24T00:45:25.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.864+0000 7f35e73a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00ab030 0x7f35e00abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e01514c0 0x7f35e0167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00ab7a0 con 0x7f35cc003aa0 2023-10-24T00:45:25.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00a6cf0 con 0x7f35e00ab030 2023-10-24T00:45:25.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00ab4c0 con 0x7f35e01514c0 2023-10-24T00:45:25.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55740/0 (socket says 172.21.15.148:55740) 2023-10-24T00:45:25.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 -- 172.21.15.148:0/3039836299 learned_addr learned my addr 172.21.15.148:0/3039836299 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:25.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e4943700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00ab030 0x7f35e00abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5945700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e01514c0 0x7f35e0167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 -- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e01514c0 msgr2=0x7f35e0167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e01514c0 0x7f35e0167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 -- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00ab030 msgr2=0x7f35e00abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:25.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00ab030 0x7f35e00abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:25.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 -- 172.21.15.148:0/3039836299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00a66a0 con 0x7f35cc003aa0 2023-10-24T00:45:25.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e5144700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f35dc00c6a0 tx=0x7f35dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00cc30 con 0x7f35cc003aa0 2023-10-24T00:45:25.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc01c410 con 0x7f35cc003aa0 2023-10-24T00:45:25.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e00a6980 con 0x7f35cc003aa0 2023-10-24T00:45:25.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc01c790 con 0x7f35cc003aa0 2023-10-24T00:45:25.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.865+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e0151920 con 0x7f35cc003aa0 2023-10-24T00:45:25.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.866+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e00a6fd0 con 0x7f35cc003aa0 2023-10-24T00:45:25.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.867+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f35dc01cb80 con 0x7f35cc003aa0 2023-10-24T00:45:25.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.867+0000 7f35d57fa700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:25.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.867+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f35dc07b5b0 con 0x7f35cc003aa0 2023-10-24T00:45:25.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.867+0000 7f35e4943700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:25.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.867+0000 7f35e4943700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 0x7f35c4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f35e0167f10 tx=0x7f35d0008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:25.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:25.871+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f35dc04ca50 con 0x7f35cc003aa0 2023-10-24T00:45:26.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.035+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f35e006c6b0 con 0x7f35cc003aa0 2023-10-24T00:45:26.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.035+0000 7f35d57fa700 1 -- 172.21.15.148:0/3039836299 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+143 (secure 0 0 0) 0x7f35dc004020 con 0x7f35cc003aa0 2023-10-24T00:45:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:26.078 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:45:26.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:45:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:45:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:45:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:26.079 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:45:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:45:26.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:26.080 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:45:26.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 msgr2=0x7f35c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 0x7f35c4061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f35e0167f10 tx=0x7f35d0008040).stop 2023-10-24T00:45:26.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 msgr2=0x7f35e00a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f35dc00c6a0 tx=0x7f35dc017000).stop 2023-10-24T00:45:26.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 shutdown_connections 2023-10-24T00:45:26.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e01514c0 0x7f35e0167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f35c405f270 0x7f35c4061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35cc003aa0 0x7f35e00a7180 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 --2- 172.21.15.148:0/3039836299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e00ab030 0x7f35e00abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 >> 172.21.15.148:0/3039836299 conn(0x7f35e00630f0 msgr2=0x7f35e0153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:26.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 shutdown_connections 2023-10-24T00:45:26.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.037+0000 7f35e73a8700 1 -- 172.21.15.148:0/3039836299 wait complete. 2023-10-24T00:45:26.086 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:45:26.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:45:26.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.202+0000 7f64712da700 1 Processor -- start 2023-10-24T00:45:26.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.202+0000 7f64712da700 1 -- start start 2023-10-24T00:45:26.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64712da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f646c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64712da700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c0c6270 con 0x7f646c0a7d00 2023-10-24T00:45:26.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64712da700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c0c0c80 con 0x7f646c1544b0 2023-10-24T00:45:26.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64712da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c60e0 con 0x7f646c0aa640 2023-10-24T00:45:26.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64627fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f646c0a7d00 0x7f646c0a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43808/0 (socket says 172.21.15.148:43808) 2023-10-24T00:45:26.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f64627fc700 1 -- 172.21.15.148:0/556070205 learned_addr learned my addr 172.21.15.148:0/556070205 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:26.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646b7fe700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f646c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542493737 0 0) 0x7f646c0c6270 con 0x7f646c0a7d00 2023-10-24T00:45:26.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64580033f0 con 0x7f646c0a7d00 2023-10-24T00:45:26.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639349390 0 0) 0x7f64580033f0 con 0x7f646c0a7d00 2023-10-24T00:45:26.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 msgr2=0x7f646c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:26.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f646c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 >> v1:172.21.15.150:6789/0 conn(0x7f646c1544b0 legacy=0x7f646c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0c0f40 con 0x7f646c0a7d00 2023-10-24T00:45:26.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6454001470 con 0x7f646c0a7d00 2023-10-24T00:45:26.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.203+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 >> v1:172.21.15.148:6789/0 conn(0x7f646c0a7d00 legacy=0x7f646c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458003910 0x7f6458003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f6458004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6458004b80 0x7f6458005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c60e0 con 0x7f6458003910 2023-10-24T00:45:26.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645800b910 con 0x7f6458004b80 2023-10-24T00:45:26.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645800bad0 con 0x7f646c0aa640 2023-10-24T00:45:26.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458003910 0x7f6458003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646b7fe700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6458004b80 0x7f6458005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f64627fc700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f6458004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 -- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 msgr2=0x7f6458004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:26.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f646c0aa640 0x7f6458004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 -- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6458004b80 msgr2=0x7f6458005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:26.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6458004b80 0x7f6458005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 -- 172.21.15.148:0/556070205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580033f0 con 0x7f6458003910 2023-10-24T00:45:26.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646affd700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458003910 0x7f6458003d30 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f645c001730 tx=0x7f645c007bb0).ready entity=mon.0 client_cookie=31f37ad6083e3dc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:26.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c007020 con 0x7f6458003910 2023-10-24T00:45:26.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c007180 con 0x7f6458003910 2023-10-24T00:45:26.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.204+0000 7f646a7fc700 1 -- 172.21.15.148:0/556070205 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c007500 con 0x7f6458003910 2023-10-24T00:45:26.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 -- 172.21.15.148:0/556070205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458003910 msgr2=0x7f6458003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 --2- 172.21.15.148:0/556070205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6458003910 0x7f6458003d30 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f645c001730 tx=0x7f645c007bb0).stop 2023-10-24T00:45:26.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f646b7fe700 1 -- 172.21.15.148:0/556070205 reap_dead start 2023-10-24T00:45:26.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 -- 172.21.15.148:0/556070205 shutdown_connections 2023-10-24T00:45:26.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 -- 172.21.15.148:0/556070205 >> 172.21.15.148:0/556070205 conn(0x7f646c0945d0 msgr2=0x7f646c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:26.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 -- 172.21.15.148:0/556070205 shutdown_connections 2023-10-24T00:45:26.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.205+0000 7f64712da700 1 -- 172.21.15.148:0/556070205 wait complete. 2023-10-24T00:45:26.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.206+0000 7f64712da700 1 Processor -- start 2023-10-24T00:45:26.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.206+0000 7f64712da700 1 -- start start 2023-10-24T00:45:26.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6458003910 0x7f646c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f646c165380 0x7f646c14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c157400 con 0x7f646c0c41c0 2023-10-24T00:45:26.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c155260 con 0x7f646c165380 2023-10-24T00:45:26.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0c4b30 con 0x7f6458003910 2023-10-24T00:45:26.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55764/0 (socket says 172.21.15.148:55764) 2023-10-24T00:45:26.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 -- 172.21.15.148:0/3509109764 learned_addr learned my addr 172.21.15.148:0/3509109764 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:26.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646affd700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6458003910 0x7f646c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64627fc700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f646c165380 0x7f646c14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 -- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6458003910 msgr2=0x7f646c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6458003910 0x7f646c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 -- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f646c165380 msgr2=0x7f646c14e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f646c165380 0x7f646c14e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 -- 172.21.15.148:0/3509109764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c154930 con 0x7f646c0c41c0 2023-10-24T00:45:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f646b7fe700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f64640094d0 tx=0x7f646400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:26.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400e040 con 0x7f646c0c41c0 2023-10-24T00:45:26.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646400f040 con 0x7f646c0c41c0 2023-10-24T00:45:26.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c154c10 con 0x7f646c0c41c0 2023-10-24T00:45:26.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646400fe20 con 0x7f646c0c41c0 2023-10-24T00:45:26.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.207+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c14ee60 con 0x7f646c0c41c0 2023-10-24T00:45:26.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.208+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c06c6b0 con 0x7f646c0c41c0 2023-10-24T00:45:26.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.209+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6464015660 con 0x7f646c0c41c0 2023-10-24T00:45:26.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.209+0000 7f64637fe700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 0x7f644c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.209+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f646407aac0 con 0x7f646c0c41c0 2023-10-24T00:45:26.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.209+0000 7f646affd700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 0x7f644c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.210+0000 7f646affd700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 0x7f644c061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f645c001010 tx=0x7f645c015000).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:26.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.213+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f646404bf60 con 0x7f646c0c41c0 2023-10-24T00:45:26.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.377+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f646c0c1220 con 0x7f646c0c41c0 2023-10-24T00:45:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.851+0000 7f64637fe700 1 -- 172.21.15.148:0/3509109764 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6464009e60 con 0x7f646c0c41c0 2023-10-24T00:45:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.853+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 msgr2=0x7f644c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.853+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 0x7f644c061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f645c001010 tx=0x7f645c015000).stop 2023-10-24T00:45:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.853+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 msgr2=0x7f646c0c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.853+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f64640094d0 tx=0x7f646400b040).stop 2023-10-24T00:45:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 shutdown_connections 2023-10-24T00:45:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f644c05f270 0x7f644c061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f646c0c41c0 0x7f646c0c4640 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6458003910 0x7f646c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 --2- 172.21.15.148:0/3509109764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f646c165380 0x7f646c14e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 >> 172.21.15.148:0/3509109764 conn(0x7f646c0945d0 msgr2=0x7f646c0c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:26.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.854+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 shutdown_connections 2023-10-24T00:45:26.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.855+0000 7f64712da700 1 -- 172.21.15.148:0/3509109764 wait complete. 2023-10-24T00:45:26.860 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:45:26.873 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:45:26.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.990+0000 7f0c1f785700 1 Processor -- start 2023-10-24T00:45:26.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.990+0000 7f0c1f785700 1 -- start start 2023-10-24T00:45:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1f785700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c180c06e0 0x7f0c18154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:26.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1f785700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180c71d0 con 0x7f0c18154430 2023-10-24T00:45:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1f785700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180c9410 con 0x7f0c18098bd0 2023-10-24T00:45:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1f785700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180c6a10 con 0x7f0c180c06e0 2023-10-24T00:45:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1d521700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0c18154430 0x7f0c180c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43822/0 (socket says 172.21.15.148:43822) 2023-10-24T00:45:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1d521700 1 -- 172.21.15.148:0/2231684016 learned_addr learned my addr 172.21.15.148:0/2231684016 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:26.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078766115 0 0) 0x7f0c180c71d0 con 0x7f0c18154430 2023-10-24T00:45:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c040033f0 con 0x7f0c18154430 2023-10-24T00:45:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/2231684016 >> v2:172.21.15.150:3300/0 conn(0x7f0c180c06e0 0x7f0c18154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113059557 0 0) 0x7f0c040033f0 con 0x7f0c18154430 2023-10-24T00:45:26.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 >> v2:172.21.15.150:3300/0 conn(0x7f0c180c06e0 msgr2=0x7f0c18154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 --2- 172.21.15.148:0/2231684016 >> v2:172.21.15.150:3300/0 conn(0x7f0c180c06e0 0x7f0c18154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 >> v1:172.21.15.150:6789/0 conn(0x7f0c18098bd0 legacy=0x7f0c180bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180ca8b0 con 0x7f0c18154430 2023-10-24T00:45:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.991+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f0c14001470 con 0x7f0c18154430 2023-10-24T00:45:26.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 >> v1:172.21.15.148:6789/0 conn(0x7f0c18154430 legacy=0x7f0c180c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c040038e0 0x7f0c04003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 0x7f0c04004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04005000 0x7f0c0400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c6a10 con 0x7f0c04004690 2023-10-24T00:45:27.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0400bf60 con 0x7f0c040038e0 2023-10-24T00:45:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0400c0f0 con 0x7f0c04005000 2023-10-24T00:45:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 0x7f0c04004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1d521700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c040038e0 0x7f0c04003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04005000 0x7f0c0400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 -- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04005000 msgr2=0x7f0c0400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:27.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04005000 0x7f0c0400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 -- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c040038e0 msgr2=0x7f0c04003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:27.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c040038e0 0x7f0c04003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 -- 172.21.15.148:0/2231684016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040033f0 con 0x7f0c04004690 2023-10-24T00:45:27.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04005000 0x7f0c0400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:27.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1dd22700 1 -- 172.21.15.148:0/2231684016 reap_dead start 2023-10-24T00:45:27.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c1cd20700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 0x7f0c04004b10 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f0c08001730 tx=0x7f0c08007bb0).ready entity=mon.0 client_cookie=6d5c46db54f0865f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:27.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08007020 con 0x7f0c04004690 2023-10-24T00:45:27.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08007180 con 0x7f0c04004690 2023-10-24T00:45:27.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.992+0000 7f0c0ffff700 1 -- 172.21.15.148:0/2231684016 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08007520 con 0x7f0c04004690 2023-10-24T00:45:27.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 -- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 msgr2=0x7f0c04004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 0x7f0c04004b10 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f0c08001730 tx=0x7f0c08007bb0).stop 2023-10-24T00:45:27.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 -- 172.21.15.148:0/2231684016 shutdown_connections 2023-10-24T00:45:27.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 --2- 172.21.15.148:0/2231684016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c04004690 0x7f0c04004b10 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 -- 172.21.15.148:0/2231684016 >> 172.21.15.148:0/2231684016 conn(0x7f0c180cb070 msgr2=0x7f0c180cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:27.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 -- 172.21.15.148:0/2231684016 shutdown_connections 2023-10-24T00:45:27.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.993+0000 7f0c1f785700 1 -- 172.21.15.148:0/2231684016 wait complete. 2023-10-24T00:45:27.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.994+0000 7f0c1f785700 1 Processor -- start 2023-10-24T00:45:27.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.994+0000 7f0c1f785700 1 -- start start 2023-10-24T00:45:27.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04004690 0x7f0c180c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c180aab50 0x7f0c180aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180af230 con 0x7f0c180ac830 2023-10-24T00:45:27.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180ae620 con 0x7f0c04004690 2023-10-24T00:45:27.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180ae900 con 0x7f0c180aab50 2023-10-24T00:45:27.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55780/0 (socket says 172.21.15.148:55780) 2023-10-24T00:45:27.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 -- 172.21.15.148:0/839950584 learned_addr learned my addr 172.21.15.148:0/839950584 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:27.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1d521700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04004690 0x7f0c180c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1cd20700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c180aab50 0x7f0c180aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 -- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c180aab50 msgr2=0x7f0c180aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c180aab50 0x7f0c180aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 -- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04004690 msgr2=0x7f0c180c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04004690 0x7f0c180c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 -- 172.21.15.148:0/839950584 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180aebe0 con 0x7f0c180ac830 2023-10-24T00:45:27.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1dd22700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f0c180c0e20 tx=0x7f0c1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:27.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000e030 con 0x7f0c180ac830 2023-10-24T00:45:27.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000f040 con 0x7f0c180ac830 2023-10-24T00:45:27.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180aeec0 con 0x7f0c180ac830 2023-10-24T00:45:27.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.995+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10010d20 con 0x7f0c180ac830 2023-10-24T00:45:27.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.996+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180ad640 con 0x7f0c180ac830 2023-10-24T00:45:27.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.996+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180c5490 con 0x7f0c180ac830 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.997+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0c10015690 con 0x7f0c180ac830 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.997+0000 7f0c0d7fa700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 0x7f0bfc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.997+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0c1007a970 con 0x7f0c180ac830 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.998+0000 7f0c1d521700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 0x7f0bfc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:26.998+0000 7f0c1d521700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 0x7f0bfc061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0c14001200 tx=0x7f0c180caa40).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:27.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.002+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c1004bca0 con 0x7f0c180ac830 2023-10-24T00:45:27.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.164+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0c1806c6b0 con 0x7f0c180ac830 2023-10-24T00:45:27.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.857+0000 7f0c0d7fa700 1 -- 172.21.15.148:0/839950584 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0c1004f2c0 con 0x7f0c180ac830 2023-10-24T00:45:27.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.864+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 msgr2=0x7f0bfc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.864+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 0x7f0bfc061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0c14001200 tx=0x7f0c180caa40).stop 2023-10-24T00:45:27.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.864+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 msgr2=0x7f0c180accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:27.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.864+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f0c180c0e20 tx=0x7f0c1000b040).stop 2023-10-24T00:45:27.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 shutdown_connections 2023-10-24T00:45:27.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0bfc05f270 0x7f0bfc061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c180ac830 0x7f0c180accb0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04004690 0x7f0c180c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 --2- 172.21.15.148:0/839950584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c180aab50 0x7f0c180aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:27.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 >> 172.21.15.148:0/839950584 conn(0x7f0c180cb070 msgr2=0x7f0c180a8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:27.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.866+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 shutdown_connections 2023-10-24T00:45:27.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:27.867+0000 7f0c1f785700 1 -- 172.21.15.148:0/839950584 wait complete. 2023-10-24T00:45:27.874 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:45:27.892 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:45:28.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.007+0000 7f8be1afe700 1 Processor -- start 2023-10-24T00:45:28.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.007+0000 7f8be1afe700 1 -- start start 2023-10-24T00:45:28.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8be1afe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bdc157780 0x7f8bdc0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8be1afe700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0c6770 con 0x7f8bdc0c0960 2023-10-24T00:45:28.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8be1afe700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0c1120 con 0x7f8bdc0a9e60 2023-10-24T00:45:28.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8be1afe700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc0c1400 con 0x7f8bdc157780 2023-10-24T00:45:28.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdbfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8bdc0c0960 0x7f8bdc0a7c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43834/0 (socket says 172.21.15.148:43834) 2023-10-24T00:45:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdbfff700 1 -- 172.21.15.148:0/1621461523 learned_addr learned my addr 172.21.15.148:0/1621461523 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8be0afc700 1 --2- 172.21.15.148:0/1621461523 >> v2:172.21.15.150:3300/0 conn(0x7f8bdc157780 0x7f8bdc0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823477565 0 0) 0x7f8bdc0c6770 con 0x7f8bdc0c0960 2023-10-24T00:45:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc80033f0 con 0x7f8bdc0c0960 2023-10-24T00:45:28.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321497816 0 0) 0x7f8bdc0c1120 con 0x7f8bdc0a9e60 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bdc0c6770 con 0x7f8bdc0a9e60 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779072383 0 0) 0x7f8bc80033f0 con 0x7f8bdc0c0960 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 >> v2:172.21.15.150:3300/0 conn(0x7f8bdc157780 msgr2=0x7f8bdc0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 --2- 172.21.15.148:0/1621461523 >> v2:172.21.15.150:3300/0 conn(0x7f8bdc157780 0x7f8bdc0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 >> v1:172.21.15.150:6789/0 conn(0x7f8bdc0a9e60 legacy=0x7f8bdc0aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0c6120 con 0x7f8bdc0c0960 2023-10-24T00:45:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.008+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f8bcc0017f0 con 0x7f8bdc0c0960 2023-10-24T00:45:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8be0afc700 1 --2- 172.21.15.148:0/1621461523 >> v2:172.21.15.150:3300/0 conn(0x7f8bdc157780 0x7f8bdc0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 >> v1:172.21.15.148:6789/0 conn(0x7f8bdc0c0960 legacy=0x7f8bdc0a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8003a70 0x7f8bc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 0x7f8bc8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bc8005050 0x7f8bc800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0c1400 con 0x7f8bc8004690 2023-10-24T00:45:28.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc800bfc0 con 0x7f8bc8003a70 2023-10-24T00:45:28.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc800c180 con 0x7f8bc8005050 2023-10-24T00:45:28.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 0x7f8bc8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8be0afc700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8003a70 0x7f8bc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8be12fd700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bc8005050 0x7f8bc800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 -- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bc8005050 msgr2=0x7f8bc800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bc8005050 0x7f8bc800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 -- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8003a70 msgr2=0x7f8bc8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8003a70 0x7f8bc8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 -- 172.21.15.148:0/1621461523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80033f0 con 0x7f8bc8004690 2023-10-24T00:45:28.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8be12fd700 1 -- 172.21.15.148:0/1621461523 reap_dead start 2023-10-24T00:45:28.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdbfff700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 0x7f8bc8004b10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8bcc00c5c0 tx=0x7f8bcc007f40).ready entity=mon.0 client_cookie=bec6e9f76f3c18ec server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00cdc0 con 0x7f8bc8004690 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc005b20 con 0x7f8bc8004690 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.009+0000 7f8bdb7fe700 1 -- 172.21.15.148:0/1621461523 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0070d0 con 0x7f8bc8004690 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 -- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 msgr2=0x7f8bc8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 0x7f8bc8004b10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f8bcc00c5c0 tx=0x7f8bcc007f40).stop 2023-10-24T00:45:28.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 -- 172.21.15.148:0/1621461523 shutdown_connections 2023-10-24T00:45:28.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 --2- 172.21.15.148:0/1621461523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bc8004690 0x7f8bc8004b10 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 -- 172.21.15.148:0/1621461523 >> 172.21.15.148:0/1621461523 conn(0x7f8bdc094570 msgr2=0x7f8bdc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 -- 172.21.15.148:0/1621461523 shutdown_connections 2023-10-24T00:45:28.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.010+0000 7f8be1afe700 1 -- 172.21.15.148:0/1621461523 wait complete. 2023-10-24T00:45:28.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.011+0000 7f8be1afe700 1 Processor -- start 2023-10-24T00:45:28.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.011+0000 7f8be1afe700 1 -- start start 2023-10-24T00:45:28.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8004690 0x7f8bdc14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bdc0b0cf0 0x7f8bdc0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc150340 con 0x7f8bdc0aec60 2023-10-24T00:45:28.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b0860 con 0x7f8bc8004690 2023-10-24T00:45:28.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b0530 con 0x7f8bdc0b0cf0 2023-10-24T00:45:28.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55794/0 (socket says 172.21.15.148:55794) 2023-10-24T00:45:28.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 -- 172.21.15.148:0/2628578024 learned_addr learned my addr 172.21.15.148:0/2628578024 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be0afc700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8004690 0x7f8bdc14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8bdbfff700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bdc0b0cf0 0x7f8bdc0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 -- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bdc0b0cf0 msgr2=0x7f8bdc0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bdc0b0cf0 0x7f8bdc0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 -- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8004690 msgr2=0x7f8bdc14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8004690 0x7f8bdc14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 -- 172.21.15.148:0/2628578024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0c4ee0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be12fd700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8bc40010e0 tx=0x7f8bc4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400ede0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc4014430 con 0x7f8bdc0aec60 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc0c51c0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.012+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40147f0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.013+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc0c4a70 con 0x7f8bdc0aec60 2023-10-24T00:45:28.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.013+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc0b0390 con 0x7f8bdc0aec60 2023-10-24T00:45:28.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.014+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8bc4014ba0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.014+0000 7f8bd8ff9700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 0x7f8bbc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.014+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f8bc4079bb0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.015+0000 7f8be0afc700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 0x7f8bbc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.015+0000 7f8be0afc700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 0x7f8bbc061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8bd4006fd0 tx=0x7f8bd4006f40).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.019+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8bc4049af0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.222+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8bdc0b09f0 con 0x7f8bdc0aec60 2023-10-24T00:45:28.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.229+0000 7f8bd8ff9700 1 -- 172.21.15.148:0/2628578024 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v35) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8bdc0b0390 con 0x7f8bdc0aec60 2023-10-24T00:45:28.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.232+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 msgr2=0x7f8bbc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.232+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 0x7f8bbc061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8bd4006fd0 tx=0x7f8bd4006f40).stop 2023-10-24T00:45:28.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.232+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 msgr2=0x7f8bdc1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.232+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8bc40010e0 tx=0x7f8bc4009040).stop 2023-10-24T00:45:28.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 shutdown_connections 2023-10-24T00:45:28.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8bbc05f270 0x7f8bbc061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bdc0aec60 0x7f8bdc1518e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bc8004690 0x7f8bdc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 --2- 172.21.15.148:0/2628578024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bdc0b0cf0 0x7f8bdc0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 >> 172.21.15.148:0/2628578024 conn(0x7f8bdc094570 msgr2=0x7f8bdc063e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 shutdown_connections 2023-10-24T00:45:28.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.238+0000 7f8be1afe700 1 -- 172.21.15.148:0/2628578024 wait complete. 2023-10-24T00:45:28.244 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 13 and data pool 14 2023-10-24T00:45:28.262 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.373+0000 7f425612a700 1 Processor -- start 2023-10-24T00:45:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.373+0000 7f425612a700 1 -- start start 2023-10-24T00:45:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f425612a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42500c6710 0x7f42500c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f425612a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f42500aa3f0 0x7f4250069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f425612a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500aa820 con 0x7f42500aa010 2023-10-24T00:45:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f425612a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500c0960 con 0x7f42500c6710 2023-10-24T00:45:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f425612a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500c0c40 con 0x7f42500aa3f0 2023-10-24T00:45:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f424effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42500c6710 0x7f42500c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f424effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f42500c6710 0x7f42500c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55796/0 (socket says 172.21.15.148:55796) 2023-10-24T00:45:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.374+0000 7f424effd700 1 -- 172.21.15.148:0/1119879606 learned_addr learned my addr 172.21.15.148:0/1119879606 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424ffff700 1 --2- 172.21.15.148:0/1119879606 >> v2:172.21.15.150:3300/0 conn(0x7f42500aa3f0 0x7f4250069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424effd700 1 -- 172.21.15.148:0/1119879606 >> v2:172.21.15.150:3300/0 conn(0x7f42500aa3f0 msgr2=0x7f4250069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424effd700 1 --2- 172.21.15.148:0/1119879606 >> v2:172.21.15.150:3300/0 conn(0x7f42500aa3f0 0x7f4250069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424effd700 1 -- 172.21.15.148:0/1119879606 >> v1:172.21.15.150:6789/0 conn(0x7f42500aa010 legacy=0x7f4250158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424effd700 1 -- 172.21.15.148:0/1119879606 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500c0f20 con 0x7f42500c6710 2023-10-24T00:45:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424effd700 1 --2- 172.21.15.148:0/1119879606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42500c1a00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f4250158e80 tx=0x7f42440090f0).ready entity=mon.0 client_cookie=4e0494cb65787bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424e7fc700 1 -- 172.21.15.148:0/1119879606 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424400b5a0 con 0x7f42500c6710 2023-10-24T00:45:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424e7fc700 1 -- 172.21.15.148:0/1119879606 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424400b700 con 0x7f42500c6710 2023-10-24T00:45:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f424e7fc700 1 -- 172.21.15.148:0/1119879606 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424400ba80 con 0x7f42500c6710 2023-10-24T00:45:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f425612a700 1 -- 172.21.15.148:0/1119879606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 msgr2=0x7f42500c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f425612a700 1 --2- 172.21.15.148:0/1119879606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42500c1a00 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f4250158e80 tx=0x7f42440090f0).stop 2023-10-24T00:45:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.375+0000 7f425612a700 1 -- 172.21.15.148:0/1119879606 shutdown_connections 2023-10-24T00:45:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.376+0000 7f425612a700 1 --2- 172.21.15.148:0/1119879606 >> v2:172.21.15.150:3300/0 conn(0x7f42500aa3f0 0x7f4250069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.376+0000 7f425612a700 1 --2- 172.21.15.148:0/1119879606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42500c1a00 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.376+0000 7f425612a700 1 -- 172.21.15.148:0/1119879606 >> 172.21.15.148:0/1119879606 conn(0x7f42500caf40 msgr2=0x7f42500cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.376+0000 7f425612a700 1 -- 172.21.15.148:0/1119879606 shutdown_connections 2023-10-24T00:45:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.376+0000 7f425612a700 1 -- 172.21.15.148:0/1119879606 wait complete. 2023-10-24T00:45:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.377+0000 7f425612a700 1 Processor -- start 2023-10-24T00:45:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.377+0000 7f425612a700 1 -- start start 2023-10-24T00:45:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42500aa010 0x7f42500b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42500aa3f0 0x7f42500c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4250154f70 con 0x7f42500c6710 2023-10-24T00:45:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500b0ca0 con 0x7f42500aa3f0 2023-10-24T00:45:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c4750 con 0x7f42500aa010 2023-10-24T00:45:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55800/0 (socket says 172.21.15.148:55800) 2023-10-24T00:45:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 -- 172.21.15.148:0/3722126585 learned_addr learned my addr 172.21.15.148:0/3722126585 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424effd700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42500aa3f0 0x7f42500c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424f7fe700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42500aa010 0x7f42500b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 -- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42500aa010 msgr2=0x7f42500b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42500aa010 0x7f42500b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 -- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42500aa3f0 msgr2=0x7f42500c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42500aa3f0 0x7f42500c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 -- 172.21.15.148:0/3722126585 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244009370 con 0x7f42500c6710 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f424ffff700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f424800ceb0 tx=0x7f4248007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424800ad90 con 0x7f42500c6710 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248016400 con 0x7f42500c6710 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248016780 con 0x7f42500c6710 2023-10-24T00:45:28.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42500aede0 con 0x7f42500c6710 2023-10-24T00:45:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.378+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42500af420 con 0x7f42500c6710 2023-10-24T00:45:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.379+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42500af7a0 con 0x7f42500c6710 2023-10-24T00:45:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.380+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4248009030 con 0x7f42500c6710 2023-10-24T00:45:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.380+0000 7f42377fe700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 0x7f423c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.380+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f424807ab30 con 0x7f42500c6710 2023-10-24T00:45:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.380+0000 7f424f7fe700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 0x7f423c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.381+0000 7f424f7fe700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 0x7f423c061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f424000b940 tx=0x7f4240006ee0).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.384+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f424804bbc0 con 0x7f42500c6710 2023-10-24T00:45:28.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.546+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42501550b0 con 0x7f42500c6710 2023-10-24T00:45:28.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.547+0000 7f42377fe700 1 -- 172.21.15.148:0/3722126585 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f424804f1e0 con 0x7f42500c6710 2023-10-24T00:45:28.550 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:28.550 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":110,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:28.224382+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 msgr2=0x7f423c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 0x7f423c061700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f424000b940 tx=0x7f4240006ee0).stop 2023-10-24T00:45:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 msgr2=0x7f42501516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f424800ceb0 tx=0x7f4248007870).stop 2023-10-24T00:45:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 shutdown_connections 2023-10-24T00:45:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f423c05f240 0x7f423c061700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500c6710 0x7f42501516a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42500aa010 0x7f42500b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 --2- 172.21.15.148:0/3722126585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42500aa3f0 0x7f42500c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 >> 172.21.15.148:0/3722126585 conn(0x7f42500caf40 msgr2=0x7f4250069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 shutdown_connections 2023-10-24T00:45:28.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.549+0000 7f425612a700 1 -- 172.21.15.148:0/3722126585 wait complete. 2023-10-24T00:45:28.564 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:28.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.677+0000 7fef657a2700 1 Processor -- start 2023-10-24T00:45:28.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.677+0000 7fef657a2700 1 -- start start 2023-10-24T00:45:28.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef657a2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef600c07e0 0x7fef600c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef657a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 0x7fef600c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef657a2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600c1180 con 0x7fef600aa140 2023-10-24T00:45:28.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef657a2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600c6410 con 0x7fef600c07e0 2023-10-24T00:45:28.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef657a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600ca6e0 con 0x7fef600c68a0 2023-10-24T00:45:28.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef64fa1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 0x7fef600c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef5f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef600c07e0 0x7fef600c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef5ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fef600aa140 0x7fef600c9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34570/0 (socket says 172.21.15.148:34570) 2023-10-24T00:45:28.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef5f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef600c07e0 0x7fef600c0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:60084/0 (socket says 172.21.15.148:60084) 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.678+0000 7fef5ffff700 1 -- 172.21.15.148:0/3475647432 learned_addr learned my addr 172.21.15.148:0/3475647432 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 msgr2=0x7fef600c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5f7fe700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 0x7fef600c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3475647432 >> v1:172.21.15.150:6789/0 conn(0x7fef600aa140 legacy=0x7fef600c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5effd700 1 -- 172.21.15.148:0/3475647432 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307060920 0 0) 0x7fef50001110 con 0x7fef600aa140 2023-10-24T00:45:28.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3475647432 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600ca9c0 con 0x7fef600c07e0 2023-10-24T00:45:28.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef64fa1700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 0x7fef600c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:28.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5f7fe700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c07e0 0x7fef600c0c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fef54009760 tx=0x7fef54009060).ready entity=mon.1 client_cookie=63d4fc81d8c8f094 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5effd700 1 -- 172.21.15.148:0/3475647432 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400f510 con 0x7fef600c07e0 2023-10-24T00:45:28.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5effd700 1 -- 172.21.15.148:0/3475647432 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400f670 con 0x7fef600c07e0 2023-10-24T00:45:28.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef5effd700 1 -- 172.21.15.148:0/3475647432 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400f9f0 con 0x7fef600c07e0 2023-10-24T00:45:28.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef657a2700 1 -- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c07e0 msgr2=0x7fef600c0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.679+0000 7fef657a2700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c07e0 0x7fef600c0c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fef54009760 tx=0x7fef54009060).stop 2023-10-24T00:45:28.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 -- 172.21.15.148:0/3475647432 shutdown_connections 2023-10-24T00:45:28.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600c68a0 0x7fef600c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 --2- 172.21.15.148:0/3475647432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c07e0 0x7fef600c0c90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 -- 172.21.15.148:0/3475647432 >> 172.21.15.148:0/3475647432 conn(0x7fef600944a0 msgr2=0x7fef6006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 -- 172.21.15.148:0/3475647432 shutdown_connections 2023-10-24T00:45:28.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.680+0000 7fef657a2700 1 -- 172.21.15.148:0/3475647432 wait complete. 2023-10-24T00:45:28.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.681+0000 7fef657a2700 1 Processor -- start 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.681+0000 7fef657a2700 1 -- start start 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 0x7fef6014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c68a0 0x7fef60148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef600abcc0 con 0x7fef600c07e0 2023-10-24T00:45:28.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6014c640 con 0x7fef600c68a0 2023-10-24T00:45:28.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600ab0b0 con 0x7fef600aa140 2023-10-24T00:45:28.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55802/0 (socket says 172.21.15.148:55802) 2023-10-24T00:45:28.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3442447836 learned_addr learned my addr 172.21.15.148:0/3442447836 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5ffff700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 0x7fef6014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef64fa1700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c68a0 0x7fef60148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 msgr2=0x7fef6014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 0x7fef6014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c68a0 msgr2=0x7fef60148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c68a0 0x7fef60148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 -- 172.21.15.148:0/3442447836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009a20 con 0x7fef600c07e0 2023-10-24T00:45:28.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5ffff700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 0x7fef6014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:28.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef5f7fe700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fef6005f860 tx=0x7fef54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400f7e0 con 0x7fef600c07e0 2023-10-24T00:45:28.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400f940 con 0x7fef600c07e0 2023-10-24T00:45:28.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540092a0 con 0x7fef600c07e0 2023-10-24T00:45:28.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5401b660 con 0x7fef600c07e0 2023-10-24T00:45:28.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.682+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef600ab670 con 0x7fef600c07e0 2023-10-24T00:45:28.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.683+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef600abe70 con 0x7fef600c07e0 2023-10-24T00:45:28.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.684+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef5401ba50 con 0x7fef600c07e0 2023-10-24T00:45:28.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.684+0000 7fef47fff700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 0x7fef4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.684+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fef5407bc90 con 0x7fef600c07e0 2023-10-24T00:45:28.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.684+0000 7fef5ffff700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 0x7fef4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.685+0000 7fef5ffff700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 0x7fef4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef50007fd0 tx=0x7fef50009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.688+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef600abe70 con 0x7fef600c07e0 2023-10-24T00:45:28.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.853+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef60047480 con 0x7fef600c07e0 2023-10-24T00:45:28.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.854+0000 7fef47fff700 1 -- 172.21.15.148:0/3442447836 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17004 (secure 0 0 0) 0x7fef5401f020 con 0x7fef600c07e0 2023-10-24T00:45:28.857 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:28.857 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":110,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:28.224382+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 msgr2=0x7fef4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 0x7fef4c061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fef50007fd0 tx=0x7fef50009040).stop 2023-10-24T00:45:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 msgr2=0x7fef6014c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fef6005f860 tx=0x7fef54017000).stop 2023-10-24T00:45:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 shutdown_connections 2023-10-24T00:45:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef600c68a0 0x7fef60148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef600aa140 0x7fef6014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef4c05f270 0x7fef4c061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 --2- 172.21.15.148:0/3442447836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef600c07e0 0x7fef6014c150 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 >> 172.21.15.148:0/3442447836 conn(0x7fef600944a0 msgr2=0x7fef600a8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 shutdown_connections 2023-10-24T00:45:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.856+0000 7fef657a2700 1 -- 172.21.15.148:0/3442447836 wait complete. 2023-10-24T00:45:28.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:45:28.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.984+0000 7fd9f8a05700 1 Processor -- start 2023-10-24T00:45:28.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.984+0000 7fd9f8a05700 1 -- start start 2023-10-24T00:45:28.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9f8a05700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9f4154430 0x7fd9f4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9f8a05700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9f4098bd0 0x7fd9f40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9f8a05700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f40c71d0 con 0x7fd9f40bffd0 2023-10-24T00:45:28.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9f8a05700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40c9410 con 0x7fd9f4098bd0 2023-10-24T00:45:28.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9f8a05700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40c6c10 con 0x7fd9f4154430 2023-10-24T00:45:28.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.985+0000 7fd9e9d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9f4098bd0 0x7fd9f40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd9f4098bd0 0x7fd9f40c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55818/0 (socket says 172.21.15.148:55818) 2023-10-24T00:45:28.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/2579038696 learned_addr learned my addr 172.21.15.148:0/2579038696 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9f259c700 1 --2- 172.21.15.148:0/2579038696 >> v2:172.21.15.150:3300/0 conn(0x7fd9f4154430 0x7fd9f4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/2579038696 >> v2:172.21.15.150:3300/0 conn(0x7fd9f4154430 msgr2=0x7fd9f4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:28.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 --2- 172.21.15.148:0/2579038696 >> v2:172.21.15.150:3300/0 conn(0x7fd9f4154430 0x7fd9f4154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/2579038696 >> v1:172.21.15.150:6789/0 conn(0x7fd9f40bffd0 legacy=0x7fd9f40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/2579038696 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40c6ef0 con 0x7fd9f4098bd0 2023-10-24T00:45:28.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9e9d9b700 1 --2- 172.21.15.148:0/2579038696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f4098bd0 0x7fd9f40c6300 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd9f405ff70 tx=0x7fd9dc0090f0).ready entity=mon.0 client_cookie=18e2dad1c78d11e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:28.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9f1d9b700 1 -- 172.21.15.148:0/2579038696 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00b520 con 0x7fd9f4098bd0 2023-10-24T00:45:28.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9f1d9b700 1 -- 172.21.15.148:0/2579038696 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b680 con 0x7fd9f4098bd0 2023-10-24T00:45:28.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.986+0000 7fd9f1d9b700 1 -- 172.21.15.148:0/2579038696 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00ba00 con 0x7fd9f4098bd0 2023-10-24T00:45:28.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 -- 172.21.15.148:0/2579038696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f4098bd0 msgr2=0x7fd9f40c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:28.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/2579038696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f4098bd0 0x7fd9f40c6300 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fd9f405ff70 tx=0x7fd9dc0090f0).stop 2023-10-24T00:45:28.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 -- 172.21.15.148:0/2579038696 shutdown_connections 2023-10-24T00:45:28.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/2579038696 >> v2:172.21.15.150:3300/0 conn(0x7fd9f4154430 0x7fd9f4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/2579038696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f4098bd0 0x7fd9f40c6300 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:28.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 -- 172.21.15.148:0/2579038696 >> 172.21.15.148:0/2579038696 conn(0x7fd9f40cb070 msgr2=0x7fd9f40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:28.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 -- 172.21.15.148:0/2579038696 shutdown_connections 2023-10-24T00:45:28.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.987+0000 7fd9f8a05700 1 -- 172.21.15.148:0/2579038696 wait complete. 2023-10-24T00:45:28.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.988+0000 7fd9f8a05700 1 Processor -- start 2023-10-24T00:45:28.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.988+0000 7fd9f8a05700 1 -- start start 2023-10-24T00:45:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9f4098bd0 0x7fd9f40aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9f4154430 0x7fd9f40ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40ae7c0 con 0x7fd9f40bffd0 2023-10-24T00:45:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f414cdb0 con 0x7fd9f4154430 2023-10-24T00:45:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40ae4f0 con 0x7fd9f4098bd0 2023-10-24T00:45:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55828/0 (socket says 172.21.15.148:55828) 2023-10-24T00:45:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/571367758 learned_addr learned my addr 172.21.15.148:0/571367758 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f259c700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9f4098bd0 0x7fd9f40aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f2d9d700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9f4154430 0x7fd9f40ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9f4098bd0 msgr2=0x7fd9f40aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9f4098bd0 0x7fd9f40aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9f4154430 msgr2=0x7fd9f40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9f4154430 0x7fd9f40ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 -- 172.21.15.148:0/571367758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009370 con 0x7fd9f40bffd0 2023-10-24T00:45:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9e9d9b700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7fd9dc009130 tx=0x7fd9dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc000bc0 con 0x7fd9f40bffd0 2023-10-24T00:45:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b7f0 con 0x7fd9f40bffd0 2023-10-24T00:45:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f4164e60 con 0x7fd9f40bffd0 2023-10-24T00:45:29.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc000d20 con 0x7fd9f40bffd0 2023-10-24T00:45:29.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.989+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f4165420 con 0x7fd9f40bffd0 2023-10-24T00:45:29.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.990+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f406c6b0 con 0x7fd9f40bffd0 2023-10-24T00:45:29.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.991+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd9dc01c860 con 0x7fd9f40bffd0 2023-10-24T00:45:29.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.991+0000 7fd9eaffd700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 0x7fd9d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.991+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd9dc07c020 con 0x7fd9f40bffd0 2023-10-24T00:45:29.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.991+0000 7fd9f259c700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 0x7fd9d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.992+0000 7fd9f259c700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 0x7fd9d4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd9e4009b90 tx=0x7fd9e4009060).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:29.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:28.995+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd9dc04d110 con 0x7fd9f40bffd0 2023-10-24T00:45:29.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.199+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9f4062c40 con 0x7fd9f40bffd0 2023-10-24T00:45:29.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.228+0000 7fd9eaffd700 1 -- 172.21.15.148:0/571367758 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9dc02a070 con 0x7fd9f40bffd0 2023-10-24T00:45:29.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 msgr2=0x7fd9d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 0x7fd9d4061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd9e4009b90 tx=0x7fd9e4009060).stop 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 msgr2=0x7fd9f414c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7fd9dc009130 tx=0x7fd9dc017000).stop 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 shutdown_connections 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9f4154430 0x7fd9f40ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9f4098bd0 0x7fd9f40aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd9d405f270 0x7fd9d4061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 --2- 172.21.15.148:0/571367758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9f40bffd0 0x7fd9f414c8c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 >> 172.21.15.148:0/571367758 conn(0x7fd9f40cb070 msgr2=0x7fd9f41576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:29.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.229+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 shutdown_connections 2023-10-24T00:45:29.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.230+0000 7fd9f8a05700 1 -- 172.21.15.148:0/571367758 wait complete. 2023-10-24T00:45:29.245 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:45:29.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:45:29.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.359+0000 7fc9f6b0f700 1 Processor -- start 2023-10-24T00:45:29.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.359+0000 7fc9f6b0f700 1 -- start start 2023-10-24T00:45:29.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f6b0f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c6950 0x7fc9f0155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f6b0f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9f00c1950 0x7fc9f015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f6b0f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f0155c00 con 0x7fc9f0152290 2023-10-24T00:45:29.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f6b0f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f00c8800 con 0x7fc9f00c1950 2023-10-24T00:45:29.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f6b0f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c7b80 con 0x7fc9f00c6950 2023-10-24T00:45:29.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f48ab700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc9f0152290 0x7fc9f00c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43846/0 (socket says 172.21.15.148:43846) 2023-10-24T00:45:29.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f50ac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc9f00c1950 0x7fc9f015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9f48ab700 1 -- 172.21.15.148:0/3666628214 learned_addr learned my addr 172.21.15.148:0/3666628214 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:29.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.360+0000 7fc9effff700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c6950 0x7fc9f0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f50ac700 1 -- 172.21.15.148:0/3666628214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c6950 msgr2=0x7fc9f0155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:29.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f50ac700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c6950 0x7fc9f0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f50ac700 1 -- 172.21.15.148:0/3666628214 >> v1:172.21.15.148:6789/0 conn(0x7fc9f0152290 legacy=0x7fc9f00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9ef7fe700 1 -- 172.21.15.148:0/3666628214 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554629132 0 0) 0x7fc9f0155c00 con 0x7fc9f0152290 2023-10-24T00:45:29.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f50ac700 1 -- 172.21.15.148:0/3666628214 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00c7e60 con 0x7fc9f00c1950 2023-10-24T00:45:29.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f50ac700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c1950 0x7fc9f015e290 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7fc9e8009e60 tx=0x7fc9e8009780).ready entity=mon.0 client_cookie=feda64b96cafe1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:29.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9ef7fe700 1 -- 172.21.15.148:0/3666628214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800e070 con 0x7fc9f00c1950 2023-10-24T00:45:29.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9ef7fe700 1 -- 172.21.15.148:0/3666628214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800bc30 con 0x7fc9f00c1950 2023-10-24T00:45:29.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9ef7fe700 1 -- 172.21.15.148:0/3666628214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8012410 con 0x7fc9f00c1950 2023-10-24T00:45:29.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3666628214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c1950 msgr2=0x7fc9f015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c1950 0x7fc9f015e290 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7fc9e8009e60 tx=0x7fc9e8009780).stop 2023-10-24T00:45:29.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3666628214 shutdown_connections 2023-10-24T00:45:29.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c1950 0x7fc9f015e290 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3666628214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c6950 0x7fc9f0155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3666628214 >> 172.21.15.148:0/3666628214 conn(0x7fc9f00946c0 msgr2=0x7fc9f006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:29.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3666628214 shutdown_connections 2023-10-24T00:45:29.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.361+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3666628214 wait complete. 2023-10-24T00:45:29.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.362+0000 7fc9f6b0f700 1 Processor -- start 2023-10-24T00:45:29.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 -- start start 2023-10-24T00:45:29.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c1950 0x7fc9f0164b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9f0152290 0x7fc9f014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0153680 con 0x7fc9f00c6950 2023-10-24T00:45:29.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c3850 con 0x7fc9f0152290 2023-10-24T00:45:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9f6b0f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0152b60 con 0x7fc9f00c1950 2023-10-24T00:45:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9effff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.363+0000 7fc9effff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55834/0 (socket says 172.21.15.148:55834) 2023-10-24T00:45:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 -- 172.21.15.148:0/3692881575 learned_addr learned my addr 172.21.15.148:0/3692881575 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9f50ac700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9f0152290 0x7fc9f014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9f48ab700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c1950 0x7fc9f0164b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 -- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c1950 msgr2=0x7fc9f0164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c1950 0x7fc9f0164b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 -- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9f0152290 msgr2=0x7fc9f014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9f0152290 0x7fc9f014dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 -- 172.21.15.148:0/3692881575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e8009a20 con 0x7fc9f00c6950 2023-10-24T00:45:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9effff700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fc9dc00c680 tx=0x7fc9dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:29.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc010580 con 0x7fc9f00c6950 2023-10-24T00:45:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0106e0 con 0x7fc9f00c6950 2023-10-24T00:45:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f0152de0 con 0x7fc9f00c6950 2023-10-24T00:45:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc010a60 con 0x7fc9f00c6950 2023-10-24T00:45:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.364+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f01533a0 con 0x7fc9f00c6950 2023-10-24T00:45:29.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.365+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f00c3620 con 0x7fc9f00c6950 2023-10-24T00:45:29.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.366+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc9dc01b460 con 0x7fc9f00c6950 2023-10-24T00:45:29.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.366+0000 7fc9ecff9700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 0x7fc9d4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:29.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.366+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc9dc07a2d0 con 0x7fc9f00c6950 2023-10-24T00:45:29.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.366+0000 7fc9f48ab700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 0x7fc9d4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:29.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.367+0000 7fc9f48ab700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 0x7fc9d4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc9e4007fd0 tx=0x7fc9e4009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:29.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.370+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc9f00c3620 con 0x7fc9f00c6950 2023-10-24T00:45:29.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:29.576+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc9f00c3620 con 0x7fc9f00c6950 2023-10-24T00:45:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.247+0000 7fc9ecff9700 1 -- 172.21.15.148:0/3692881575 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc9f00c3620 con 0x7fc9f00c6950 2023-10-24T00:45:30.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 msgr2=0x7fc9d4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 0x7fc9d4061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc9e4007fd0 tx=0x7fc9e4009040).stop 2023-10-24T00:45:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 msgr2=0x7fc9f0152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fc9dc00c680 tx=0x7fc9dc008040).stop 2023-10-24T00:45:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 shutdown_connections 2023-10-24T00:45:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc9f0152290 0x7fc9f014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9f00c1950 0x7fc9f0164b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc9d405f270 0x7fc9d4061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 --2- 172.21.15.148:0/3692881575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9f00c6950 0x7fc9f0152670 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 >> 172.21.15.148:0/3692881575 conn(0x7fc9f00946c0 msgr2=0x7fc9f00c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 shutdown_connections 2023-10-24T00:45:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.250+0000 7fc9f6b0f700 1 -- 172.21.15.148:0/3692881575 wait complete. 2023-10-24T00:45:30.265 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:45:30.266 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:30.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.379+0000 7fdada101700 1 Processor -- start 2023-10-24T00:45:30.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.379+0000 7fdada101700 1 -- start start 2023-10-24T00:45:30.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdada101700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdad40c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdada101700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40c6410 con 0x7fdad40c07e0 2023-10-24T00:45:30.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdada101700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40c1100 con 0x7fdad40aa140 2023-10-24T00:45:30.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdada101700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40ca6e0 con 0x7fdad40c0c90 2023-10-24T00:45:30.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad88fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdad40c07e0 0x7fdad40c68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43856/0 (socket says 172.21.15.148:43856) 2023-10-24T00:45:30.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad88fe700 1 -- 172.21.15.148:0/114864993 learned_addr learned my addr 172.21.15.148:0/114864993 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:30.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370115578 0 0) 0x7fdad40c6410 con 0x7fdad40c07e0 2023-10-24T00:45:30.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdabc0033f0 con 0x7fdad40c07e0 2023-10-24T00:45:30.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad9900700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdad40c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392443766 0 0) 0x7fdabc0033f0 con 0x7fdad40c07e0 2023-10-24T00:45:30.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 msgr2=0x7fdad40c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdad40c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 >> v1:172.21.15.150:6789/0 conn(0x7fdad40aa140 legacy=0x7fdad40c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40ca9c0 con 0x7fdad40c07e0 2023-10-24T00:45:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fdac8001470 con 0x7fdad40c07e0 2023-10-24T00:45:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 >> v1:172.21.15.148:6789/0 conn(0x7fdad40c07e0 legacy=0x7fdad40c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdabc003910 0x7fdabc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc004690 0x7fdabc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdabc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40ca6e0 con 0x7fdabc003910 2023-10-24T00:45:30.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc00b910 con 0x7fdabc004690 2023-10-24T00:45:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.380+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc00bad0 con 0x7fdad40c0c90 2023-10-24T00:45:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdabc003910 0x7fdabc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad9900700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdabc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad88fe700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc004690 0x7fdabc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 -- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 msgr2=0x7fdabc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad40c0c90 0x7fdabc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 -- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc004690 msgr2=0x7fdabc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc004690 0x7fdabc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 -- 172.21.15.148:0/114864993 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0033f0 con 0x7fdabc003910 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad88fe700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc004690 0x7fdabc004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad90ff700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdabc003910 0x7fdabc003d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fdacc001e30 tx=0x7fdacc007f30).ready entity=mon.0 client_cookie=95aa1bf44f7c973d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc006a20 con 0x7fdabc003910 2023-10-24T00:45:30.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc006b80 con 0x7fdabc003910 2023-10-24T00:45:30.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.381+0000 7fdad3fff700 1 -- 172.21.15.148:0/114864993 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00c5d0 con 0x7fdabc003910 2023-10-24T00:45:30.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 -- 172.21.15.148:0/114864993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdabc003910 msgr2=0x7fdabc003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 --2- 172.21.15.148:0/114864993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdabc003910 0x7fdabc003d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7fdacc001e30 tx=0x7fdacc007f30).stop 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdad9900700 1 -- 172.21.15.148:0/114864993 reap_dead start 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 -- 172.21.15.148:0/114864993 shutdown_connections 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 -- 172.21.15.148:0/114864993 >> 172.21.15.148:0/114864993 conn(0x7fdad40944a0 msgr2=0x7fdad406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 -- 172.21.15.148:0/114864993 shutdown_connections 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.382+0000 7fdada101700 1 -- 172.21.15.148:0/114864993 wait complete. 2023-10-24T00:45:30.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.383+0000 7fdada101700 1 Processor -- start 2023-10-24T00:45:30.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.383+0000 7fdada101700 1 -- start start 2023-10-24T00:45:30.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 0x7fdad40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 0x7fdad4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4151240 con 0x7fdad40c2510 2023-10-24T00:45:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40addb0 con 0x7fdabc003910 2023-10-24T00:45:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40aec10 con 0x7fdad4152130 2023-10-24T00:45:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55860/0 (socket says 172.21.15.148:55860) 2023-10-24T00:45:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 -- 172.21.15.148:0/620815864 learned_addr learned my addr 172.21.15.148:0/620815864 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad90ff700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 0x7fdad40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad9900700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 0x7fdad4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 -- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 msgr2=0x7fdad4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 0x7fdad4152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 -- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 msgr2=0x7fdad40c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 0x7fdad40c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 -- 172.21.15.148:0/620815864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40c2e80 con 0x7fdad40c2510 2023-10-24T00:45:30.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad90ff700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 0x7fdad40c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:30.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad9900700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 0x7fdad4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:30.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad88fe700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fdac800e7f0 tx=0x7fdac8001060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800c580 con 0x7fdad40c2510 2023-10-24T00:45:30.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800c700 con 0x7fdad40c2510 2023-10-24T00:45:30.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad4152a80 con 0x7fdad40c2510 2023-10-24T00:45:30.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800cac0 con 0x7fdad40c2510 2023-10-24T00:45:30.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.384+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40ae000 con 0x7fdad40c2510 2023-10-24T00:45:30.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.385+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad4047480 con 0x7fdad40c2510 2023-10-24T00:45:30.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.386+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdac8014430 con 0x7fdad40c2510 2023-10-24T00:45:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.386+0000 7fdad17fa700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 0x7fdac0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.386+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdac8079eb0 con 0x7fdad40c2510 2023-10-24T00:45:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.386+0000 7fdad90ff700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 0x7fdac0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.387+0000 7fdad90ff700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 0x7fdac0061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdacc001600 tx=0x7fdacc016000).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.390+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdac8049af0 con 0x7fdad40c2510 2023-10-24T00:45:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.592+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad40aed50 con 0x7fdad40c2510 2023-10-24T00:45:30.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.593+0000 7fdad17fa700 1 -- 172.21.15.148:0/620815864 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fdac804afa0 con 0x7fdad40c2510 2023-10-24T00:45:30.596 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:30.596 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:45:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.594+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 msgr2=0x7fdac0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.594+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 0x7fdac0061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdacc001600 tx=0x7fdacc016000).stop 2023-10-24T00:45:30.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.594+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 msgr2=0x7fdad40c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.594+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7fdac800e7f0 tx=0x7fdac8001060).stop 2023-10-24T00:45:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 shutdown_connections 2023-10-24T00:45:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad4152130 0x7fdad4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdabc003910 0x7fdad40c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdac005f270 0x7fdac0061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 --2- 172.21.15.148:0/620815864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad40c2510 0x7fdad40c2990 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 >> 172.21.15.148:0/620815864 conn(0x7fdad40944a0 msgr2=0x7fdad4151910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 shutdown_connections 2023-10-24T00:45:30.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.595+0000 7fdada101700 1 -- 172.21.15.148:0/620815864 wait complete. 2023-10-24T00:45:30.600 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:45:30.609 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:45:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.721+0000 7f15a8f4f700 1 Processor -- start 2023-10-24T00:45:30.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.721+0000 7f15a8f4f700 1 -- start start 2023-10-24T00:45:30.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a8f4f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15a406a490 0x7f15a40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a8f4f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40c0960 con 0x7f15a40aa010 2023-10-24T00:45:30.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a8f4f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a40c0c40 con 0x7f15a40c6710 2023-10-24T00:45:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a8f4f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a40c0f20 con 0x7f15a406a490 2023-10-24T00:45:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f15a406a490 0x7f15a40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a259c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f15a40aa010 0x7f15a4158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43864/0 (socket says 172.21.15.148:43864) 2023-10-24T00:45:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.722+0000 7f15a259c700 1 -- 172.21.15.148:0/3197207716 learned_addr learned my addr 172.21.15.148:0/3197207716 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:30.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a2d9d700 1 -- 172.21.15.148:0/3197207716 >> v1:172.21.15.150:6789/0 conn(0x7f15a40c6710 legacy=0x7f15a4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a2d9d700 1 -- 172.21.15.148:0/3197207716 >> v1:172.21.15.148:6789/0 conn(0x7f15a40aa010 legacy=0x7f15a4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a1d9b700 1 -- 172.21.15.148:0/3197207716 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139419744 0 0) 0x7f15a40c0960 con 0x7f15a40aa010 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a2d9d700 1 -- 172.21.15.148:0/3197207716 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40c1200 con 0x7f15a406a490 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a2d9d700 1 --2- 172.21.15.148:0/3197207716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a406a490 0x7f15a40c1a00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f159c009e60 tx=0x7f159c009780).ready entity=mon.0 client_cookie=f5d457c938514b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a1d9b700 1 -- 172.21.15.148:0/3197207716 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00e070 con 0x7f15a406a490 2023-10-24T00:45:30.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a1d9b700 1 -- 172.21.15.148:0/3197207716 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00bbf0 con 0x7f15a406a490 2023-10-24T00:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a1d9b700 1 -- 172.21.15.148:0/3197207716 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c012410 con 0x7f15a406a490 2023-10-24T00:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 -- 172.21.15.148:0/3197207716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a406a490 msgr2=0x7f15a40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/3197207716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a406a490 0x7f15a40c1a00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f159c009e60 tx=0x7f159c009780).stop 2023-10-24T00:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 -- 172.21.15.148:0/3197207716 shutdown_connections 2023-10-24T00:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/3197207716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a406a490 0x7f15a40c1a00 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 -- 172.21.15.148:0/3197207716 >> 172.21.15.148:0/3197207716 conn(0x7f15a40caf40 msgr2=0x7f15a40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:30.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 -- 172.21.15.148:0/3197207716 shutdown_connections 2023-10-24T00:45:30.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.723+0000 7f15a8f4f700 1 -- 172.21.15.148:0/3197207716 wait complete. 2023-10-24T00:45:30.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 Processor -- start 2023-10-24T00:45:30.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 -- start start 2023-10-24T00:45:30.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 0x7f15a4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 0x7f15a4167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40b0d60 con 0x7f15a40aa010 2023-10-24T00:45:30.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40ae3c0 con 0x7f15a406a490 2023-10-24T00:45:30.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f15a8f4f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a40ae980 con 0x7f15a40c6710 2023-10-24T00:45:30.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f1599d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f1599d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55874/0 (socket says 172.21.15.148:55874) 2023-10-24T00:45:30.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.725+0000 7f1599d9b700 1 -- 172.21.15.148:0/703910166 learned_addr learned my addr 172.21.15.148:0/703910166 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:30.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a259c700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 0x7f15a4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a2d9d700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 0x7f15a4167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 -- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 msgr2=0x7f15a4167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 0x7f15a4167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 -- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 msgr2=0x7f15a4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 0x7f15a4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 -- 172.21.15.148:0/703910166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009a20 con 0x7f15a40aa010 2023-10-24T00:45:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a259c700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 0x7f15a4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a2d9d700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 0x7f15a4167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f1599d9b700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f158c00b490 tx=0x7f158c006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c012450 con 0x7f15a40aa010 2023-10-24T00:45:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c0125f0 con 0x7f15a40aa010 2023-10-24T00:45:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4167ec0 con 0x7f15a40aa010 2023-10-24T00:45:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c0129b0 con 0x7f15a40aa010 2023-10-24T00:45:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.726+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a40ae610 con 0x7f15a40aa010 2023-10-24T00:45:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.727+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a40aeb30 con 0x7f15a40aa010 2023-10-24T00:45:30.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.727+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f158c012d20 con 0x7f15a40aa010 2023-10-24T00:45:30.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.728+0000 7f159affd700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 0x7f1584061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:30.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.728+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f158c079ad0 con 0x7f15a40aa010 2023-10-24T00:45:30.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.728+0000 7f15a259c700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 0x7f1584061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:30.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.728+0000 7f15a259c700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 0x7f1584061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1594001750 tx=0x7f1594009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:30.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.732+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f15a40aeb30 con 0x7f15a40aa010 2023-10-24T00:45:30.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.895+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15a40aeaf0 con 0x7f15a40aa010 2023-10-24T00:45:30.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.896+0000 7f159affd700 1 -- 172.21.15.148:0/703910166 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f158c04ac20 con 0x7f15a40aa010 2023-10-24T00:45:30.899 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:30.899 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":111,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:45:29.226492+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:45:30.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 msgr2=0x7f1584061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 0x7f1584061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1594001750 tx=0x7f1594009040).stop 2023-10-24T00:45:30.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 msgr2=0x7f15a41418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:30.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f158c00b490 tx=0x7f158c006f00).stop 2023-10-24T00:45:30.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 shutdown_connections 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15a40c6710 0x7f15a4167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15a406a490 0x7f15a4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f158405f270 0x7f1584061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 --2- 172.21.15.148:0/703910166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a40aa010 0x7f15a41418b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 >> 172.21.15.148:0/703910166 conn(0x7f15a40caf40 msgr2=0x7f15a40cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:30.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 shutdown_connections 2023-10-24T00:45:30.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:30.898+0000 7f15a8f4f700 1 -- 172.21.15.148:0/703910166 wait complete. 2023-10-24T00:45:30.913 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:45:30.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:31.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.023+0000 7fdd152ff700 1 Processor -- start 2023-10-24T00:45:31.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 -- start start 2023-10-24T00:45:31.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd100aacd0 0x7fdd1013a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1013ac90 con 0x7fdd1013a7e0 2023-10-24T00:45:31.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100c57b0 con 0x7fdd100aacd0 2023-10-24T00:45:31.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.024+0000 7fdd152ff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100c5a90 con 0x7fdd100695f0 2023-10-24T00:45:31.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd100aacd0 0x7fdd1013a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:36260/0 (socket says 172.21.15.148:36260) 2023-10-24T00:45:31.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0effd700 1 -- 172.21.15.148:0/1674947725 learned_addr learned my addr 172.21.15.148:0/1674947725 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0f7fe700 1 --1- 172.21.15.148:0/1674947725 >> v1:172.21.15.150:6789/0 conn(0x7fdd1013a7e0 0x7fdd10065fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34598/0 (socket says 172.21.15.148:34598) 2023-10-24T00:45:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0e7fc700 1 -- 172.21.15.148:0/1674947725 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701263901 0 0) 0x7fdd1013ac90 con 0x7fdd1013a7e0 2023-10-24T00:45:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0e7fc700 1 -- 172.21.15.148:0/1674947725 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcfc0033f0 con 0x7fdd1013a7e0 2023-10-24T00:45:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 -- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 msgr2=0x7fdd100699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 -- 172.21.15.148:0/1674947725 >> v1:172.21.15.150:6789/0 conn(0x7fdd1013a7e0 legacy=0x7fdd10065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 -- 172.21.15.148:0/1674947725 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100c5d70 con 0x7fdd100aacd0 2023-10-24T00:45:31.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0effd700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:31.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd067fc700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd1013a2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fdcf8009790 tx=0x7fdcf8009060).ready entity=mon.1 client_cookie=12b8cf177b653826 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0e7fc700 1 -- 172.21.15.148:0/1674947725 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800d4a0 con 0x7fdd100aacd0 2023-10-24T00:45:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0e7fc700 1 -- 172.21.15.148:0/1674947725 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf800d600 con 0x7fdd100aacd0 2023-10-24T00:45:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.025+0000 7fdd0e7fc700 1 -- 172.21.15.148:0/1674947725 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800d980 con 0x7fdd100aacd0 2023-10-24T00:45:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 -- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 msgr2=0x7fdd1013a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd1013a2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fdcf8009790 tx=0x7fdcf8009060).stop 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 -- 172.21.15.148:0/1674947725 shutdown_connections 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd100695f0 0x7fdd100699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 --2- 172.21.15.148:0/1674947725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd1013a2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 -- 172.21.15.148:0/1674947725 >> 172.21.15.148:0/1674947725 conn(0x7fdd100641f0 msgr2=0x7fdd100c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 -- 172.21.15.148:0/1674947725 shutdown_connections 2023-10-24T00:45:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.026+0000 7fdd152ff700 1 -- 172.21.15.148:0/1674947725 wait complete. 2023-10-24T00:45:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.027+0000 7fdd152ff700 1 Processor -- start 2023-10-24T00:45:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.027+0000 7fdd152ff700 1 -- start start 2023-10-24T00:45:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd10150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1013a7e0 0x7fdd100ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100a7e40 con 0x7fdd100695f0 2023-10-24T00:45:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100a7830 con 0x7fdd100aacd0 2023-10-24T00:45:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd152ff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100aa430 con 0x7fdd1013a7e0 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55878/0 (socket says 172.21.15.148:55878) 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 -- 172.21.15.148:0/2403518793 learned_addr learned my addr 172.21.15.148:0/2403518793 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0f7fe700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1013a7e0 0x7fdd100ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd067fc700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd10150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 -- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1013a7e0 msgr2=0x7fdd100ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1013a7e0 0x7fdd100ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 -- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 msgr2=0x7fdd10150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.028+0000 7fdd0effd700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd10150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd0effd700 1 -- 172.21.15.148:0/2403518793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009370 con 0x7fdd100695f0 2023-10-24T00:45:31.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd0effd700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fdd0000ea20 tx=0x7fdd000090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000ee60 con 0x7fdd100695f0 2023-10-24T00:45:31.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0000c850 con 0x7fdd100695f0 2023-10-24T00:45:31.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000cbd0 con 0x7fdd100695f0 2023-10-24T00:45:31.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80092a0 con 0x7fdd100695f0 2023-10-24T00:45:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.029+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd100aa710 con 0x7fdd100695f0 2023-10-24T00:45:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.030+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1006c6b0 con 0x7fdd100695f0 2023-10-24T00:45:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.030+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdd0001b400 con 0x7fdd100695f0 2023-10-24T00:45:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.031+0000 7fdd077fe700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 0x7fdcf0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.031+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd0007a8e0 con 0x7fdd100695f0 2023-10-24T00:45:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.031+0000 7fdd067fc700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 0x7fdcf0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.031+0000 7fdd067fc700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 0x7fdcf0061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdcf8009790 tx=0x7fdcf8016000).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.035+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd0004ba80 con 0x7fdd100695f0 2023-10-24T00:45:31.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.195+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd100a7f80 con 0x7fdcf005f270 2023-10-24T00:45:31.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.205+0000 7fdd077fe700 1 -- 172.21.15.148:0/2403518793 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350223 (secure 0 0 0) 0x7fdcf800dd30 con 0x7fdcf005f270 2023-10-24T00:45:31.211 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:31.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 msgr2=0x7fdcf0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 0x7fdcf0061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdcf8009790 tx=0x7fdcf8016000).stop 2023-10-24T00:45:31.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 msgr2=0x7fdd10153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7fdd0000ea20 tx=0x7fdd000090f0).stop 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 shutdown_connections 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1013a7e0 0x7fdd100ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcf005f270 0x7fdcf0061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd100695f0 0x7fdd10153850 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 --2- 172.21.15.148:0/2403518793 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd100aacd0 0x7fdd10150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.208+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 >> 172.21.15.148:0/2403518793 conn(0x7fdd100641f0 msgr2=0x7fdd100bd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.209+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 shutdown_connections 2023-10-24T00:45:31.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.209+0000 7fdd152ff700 1 -- 172.21.15.148:0/2403518793 wait complete. 2023-10-24T00:45:31.218 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:31.223 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:45:29.402646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2419752,"kb_used_data":10216,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554968,"statfs":{"total":773094113280,"available":770616287232,"internally_reserved":0,"allocated":10461184,"data_stored":5225088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003788"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891839+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:45:23.891839+0000","last_peered":"2023-10-24T00:45:23.891839+0000","last_clean":"2023-10-24T00:45:23.891839+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:45:23.891839+0000","last_undegraded":"2023-10-24T00:45:23.891839+0000","last_fullsized":"2023-10-24T00:45:23.891839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892667+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:45:23.892667+0000","last_peered":"2023-10-24T00:45:23.892667+0000","last_clean":"2023-10-24T00:45:23.892667+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:45:23.892667+0000","last_undegraded":"2023-10-24T00:45:23.892667+0000","last_fullsized":"2023-10-24T00:45:23.892667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:45:23.337592+0000","last_peered":"2023-10-24T00:45:23.337592+0000","last_clean":"2023-10-24T00:45:23.337592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:45:23.337592+0000","last_undegraded":"2023-10-24T00:45:23.337592+0000","last_fullsized":"2023-10-24T00:45:23.337592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:45:23.337603+0000","last_peered":"2023-10-24T00:45:23.337603+0000","last_clean":"2023-10-24T00:45:23.337603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:45:23.337603+0000","last_undegraded":"2023-10-24T00:45:23.337603+0000","last_fullsized":"2023-10-24T00:45:23.337603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337611+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:45:23.337611+0000","last_peered":"2023-10-24T00:45:23.337611+0000","last_clean":"2023-10-24T00:45:23.337611+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:45:23.337611+0000","last_undegraded":"2023-10-24T00:45:23.337611+0000","last_fullsized":"2023-10-24T00:45:23.337611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891866+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:45:23.891866+0000","last_peered":"2023-10-24T00:45:23.891866+0000","last_clean":"2023-10-24T00:45:23.891866+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:45:23.891866+0000","last_undegraded":"2023-10-24T00:45:23.891866+0000","last_fullsized":"2023-10-24T00:45:23.891866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.893203+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:45:23.893203+0000","last_peered":"2023-10-24T00:45:23.893203+0000","last_clean":"2023-10-24T00:45:23.893203+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:45:23.893203+0000","last_undegraded":"2023-10-24T00:45:23.893203+0000","last_fullsized":"2023-10-24T00:45:23.893203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.83299999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81100000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.81399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84199999999999997,"5min":4.351,"15min":4.351},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.90000000000000002,"5min":1.054,"15min":1.054},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73199999999999998,"5min":1.573,"15min":1.573},"last":0.67800000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59399999999999997,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.625}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":14.597,"15min":14.597},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55700000000000005,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.5,"15min":0.495},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":0.82699999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.872},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.38300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.55700000000000005,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.498,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41799999999999998,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46400000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.371,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52500000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.51100000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.627}]},{"osd":4,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":1.143,"15min":1.1859999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":1.964},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.61699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.88200000000000001,"15min":1.121},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":1.109,"15min":1.5800000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.6919999999999999},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.28799999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.436},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.38600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.628},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.43099999999999999,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.67100000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.90300000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.874,"15min":0.92400000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60399999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34300000000000003,"15min":0.36199999999999999},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.434,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.62},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.248,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.63,"15min":0.65500000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.26200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.222},{"interface":"front","average":{"1min":0.375,"5min":0.39600000000000002,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.501,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.246}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":1.083,"15min":1.083},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.67300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.999},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25600000000000001},"max":{"1min":0.67600000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.28999999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.024},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.995},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.83099999999999996,"15min":1.042},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.121},"last":0.57799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":0.63800000000000001,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.432,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.432}]},{"osd":3,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41299999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.77400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.754},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55400000000000005},"min":{"1min":0.37,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68200000000000005,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":1.339},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.76400000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.772},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:31.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.376+0000 7fe468826700 1 Processor -- start 2023-10-24T00:45:31.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.376+0000 7fe468826700 1 -- start start 2023-10-24T00:45:31.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe468826700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4640a8480 0x7fe46415f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe468826700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4640a5bd0 con 0x7fe4640be650 2023-10-24T00:45:31.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe468826700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe464064ab0 con 0x7fe464154540 2023-10-24T00:45:31.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe468826700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe464064d90 con 0x7fe4640a8480 2023-10-24T00:45:31.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe459d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe4640be650 0x7fe4640a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43866/0 (socket says 172.21.15.148:43866) 2023-10-24T00:45:31.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe459d9b700 1 -- 172.21.15.148:0/819823032 learned_addr learned my addr 172.21.15.148:0/819823032 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:31.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.377+0000 7fe462d9d700 1 --2- 172.21.15.148:0/819823032 >> v2:172.21.15.150:3300/0 conn(0x7fe4640a8480 0x7fe46415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976656038 0 0) 0x7fe4640a5bd0 con 0x7fe4640be650 2023-10-24T00:45:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4500033f0 con 0x7fe4640be650 2023-10-24T00:45:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525352124 0 0) 0x7fe464064ab0 con 0x7fe464154540 2023-10-24T00:45:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4640a5bd0 con 0x7fe464154540 2023-10-24T00:45:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe462d9d700 1 -- 172.21.15.148:0/819823032 >> v1:172.21.15.150:6789/0 conn(0x7fe464154540 legacy=0x7fe4640640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe462d9d700 1 -- 172.21.15.148:0/819823032 >> v1:172.21.15.148:6789/0 conn(0x7fe4640be650 legacy=0x7fe4640a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe462d9d700 1 -- 172.21.15.148:0/819823032 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464065070 con 0x7fe4640a8480 2023-10-24T00:45:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe462d9d700 1 --2- 172.21.15.148:0/819823032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640a8480 0x7fe46415f130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fe45c009e60 tx=0x7fe45c009780).ready entity=mon.1 client_cookie=1fce6a0fd1f13ae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00e070 con 0x7fe4640a8480 2023-10-24T00:45:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c00bab0 con 0x7fe4640a8480 2023-10-24T00:45:31.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.378+0000 7fe461d9b700 1 -- 172.21.15.148:0/819823032 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00be30 con 0x7fe4640a8480 2023-10-24T00:45:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 -- 172.21.15.148:0/819823032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640a8480 msgr2=0x7fe46415f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 --2- 172.21.15.148:0/819823032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640a8480 0x7fe46415f130 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fe45c009e60 tx=0x7fe45c009780).stop 2023-10-24T00:45:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 -- 172.21.15.148:0/819823032 shutdown_connections 2023-10-24T00:45:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 --2- 172.21.15.148:0/819823032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4640a8480 0x7fe46415f130 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 -- 172.21.15.148:0/819823032 >> 172.21.15.148:0/819823032 conn(0x7fe464092480 msgr2=0x7fe464062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 -- 172.21.15.148:0/819823032 shutdown_connections 2023-10-24T00:45:31.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.379+0000 7fe468826700 1 -- 172.21.15.148:0/819823032 wait complete. 2023-10-24T00:45:31.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.380+0000 7fe468826700 1 Processor -- start 2023-10-24T00:45:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.380+0000 7fe468826700 1 -- start start 2023-10-24T00:45:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4640a8480 0x7fe46414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe464154540 0x7fe464066690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe464150270 con 0x7fe4640be650 2023-10-24T00:45:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640c5260 con 0x7fe464154540 2023-10-24T00:45:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe468826700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640c43f0 con 0x7fe4640a8480 2023-10-24T00:45:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55884/0 (socket says 172.21.15.148:55884) 2023-10-24T00:45:31.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 -- 172.21.15.148:0/3431326755 learned_addr learned my addr 172.21.15.148:0/3431326755 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:31.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe462d9d700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe464154540 0x7fe464066690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe46259c700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4640a8480 0x7fe46414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 -- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4640a8480 msgr2=0x7fe46414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4640a8480 0x7fe46414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 -- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe464154540 msgr2=0x7fe464066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe464154540 0x7fe464066690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 -- 172.21.15.148:0/3431326755 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c009a20 con 0x7fe4640be650 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.381+0000 7fe459d9b700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fe44c00c590 tx=0x7fe44c007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00ce40 con 0x7fe4640be650 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0072e0 con 0x7fe4640be650 2023-10-24T00:45:31.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4640c4930 con 0x7fe4640be650 2023-10-24T00:45:31.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c007660 con 0x7fe4640be650 2023-10-24T00:45:31.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4640c4ef0 con 0x7fe4640be650 2023-10-24T00:45:31.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.382+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46406c6b0 con 0x7fe4640be650 2023-10-24T00:45:31.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.383+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe44c0059b0 con 0x7fe4640be650 2023-10-24T00:45:31.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.383+0000 7fe45affd700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 0x7fe444061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.383+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe44c079930 con 0x7fe4640be650 2023-10-24T00:45:31.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.384+0000 7fe46259c700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 0x7fe444061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.384+0000 7fe46259c700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 0x7fe444061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe4540038c0 tx=0x7fe454007bc0).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.387+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe44c04aa80 con 0x7fe4640be650 2023-10-24T00:45:31.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.548+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe464065350 con 0x7fe44405f270 2023-10-24T00:45:31.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.558+0000 7fe45affd700 1 -- 172.21.15.148:0/3431326755 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350223 (secure 0 0 0) 0x7fe464065350 con 0x7fe44405f270 2023-10-24T00:45:31.564 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:31.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 msgr2=0x7fe444061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 0x7fe444061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe4540038c0 tx=0x7fe454007bc0).stop 2023-10-24T00:45:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 msgr2=0x7fe4641658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fe44c00c590 tx=0x7fe44c007cc0).stop 2023-10-24T00:45:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 shutdown_connections 2023-10-24T00:45:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe464154540 0x7fe464066690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4640a8480 0x7fe46414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe44405f270 0x7fe444061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 --2- 172.21.15.148:0/3431326755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4640be650 0x7fe4641658e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 >> 172.21.15.148:0/3431326755 conn(0x7fe464092480 msgr2=0x7fe4640a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 shutdown_connections 2023-10-24T00:45:31.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.561+0000 7fe468826700 1 -- 172.21.15.148:0/3431326755 wait complete. 2023-10-24T00:45:31.570 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:31.575 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:45:31.403121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2419752,"kb_used_data":10216,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554968,"statfs":{"total":773094113280,"available":770616287232,"internally_reserved":0,"allocated":10461184,"data_stored":5225088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003788"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891839+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:45:23.891839+0000","last_peered":"2023-10-24T00:45:23.891839+0000","last_clean":"2023-10-24T00:45:23.891839+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:45:23.891839+0000","last_undegraded":"2023-10-24T00:45:23.891839+0000","last_fullsized":"2023-10-24T00:45:23.891839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892667+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:45:23.892667+0000","last_peered":"2023-10-24T00:45:23.892667+0000","last_clean":"2023-10-24T00:45:23.892667+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:45:23.892667+0000","last_undegraded":"2023-10-24T00:45:23.892667+0000","last_fullsized":"2023-10-24T00:45:23.892667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:45:23.337592+0000","last_peered":"2023-10-24T00:45:23.337592+0000","last_clean":"2023-10-24T00:45:23.337592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:45:23.337592+0000","last_undegraded":"2023-10-24T00:45:23.337592+0000","last_fullsized":"2023-10-24T00:45:23.337592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:45:23.337603+0000","last_peered":"2023-10-24T00:45:23.337603+0000","last_clean":"2023-10-24T00:45:23.337603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:45:23.337603+0000","last_undegraded":"2023-10-24T00:45:23.337603+0000","last_fullsized":"2023-10-24T00:45:23.337603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337611+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:45:23.337611+0000","last_peered":"2023-10-24T00:45:23.337611+0000","last_clean":"2023-10-24T00:45:23.337611+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:45:23.337611+0000","last_undegraded":"2023-10-24T00:45:23.337611+0000","last_fullsized":"2023-10-24T00:45:23.337611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891866+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:45:23.891866+0000","last_peered":"2023-10-24T00:45:23.891866+0000","last_clean":"2023-10-24T00:45:23.891866+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:45:23.891866+0000","last_undegraded":"2023-10-24T00:45:23.891866+0000","last_fullsized":"2023-10-24T00:45:23.891866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.893203+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:45:23.893203+0000","last_peered":"2023-10-24T00:45:23.893203+0000","last_clean":"2023-10-24T00:45:23.893203+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:45:23.893203+0000","last_undegraded":"2023-10-24T00:45:23.893203+0000","last_fullsized":"2023-10-24T00:45:23.893203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.83299999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81100000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.81399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84199999999999997,"5min":4.351,"15min":4.351},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.90000000000000002,"5min":1.054,"15min":1.054},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73199999999999998,"5min":1.573,"15min":1.573},"last":0.67800000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59399999999999997,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.625}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":14.597,"15min":14.597},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55700000000000005,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.5,"15min":0.495},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":0.82699999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.872},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.38300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.55700000000000005,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.498,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41799999999999998,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46400000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.371,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52500000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.51100000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.627}]},{"osd":4,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":1.143,"15min":1.1859999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":1.964},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.61699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.88200000000000001,"15min":1.121},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":1.109,"15min":1.5800000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.6919999999999999},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.28799999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.436},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.38600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.628},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.43099999999999999,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.67100000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.90300000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.874,"15min":0.92400000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60399999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34300000000000003,"15min":0.36199999999999999},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.434,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.62},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.248,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.63,"15min":0.65500000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.26200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.222},{"interface":"front","average":{"1min":0.375,"5min":0.39600000000000002,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.501,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.246}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":1.083,"15min":1.083},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.67300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.999},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25600000000000001},"max":{"1min":0.67600000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.28999999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.024},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.995},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.83099999999999996,"15min":1.042},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.121},"last":0.57799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":0.63800000000000001,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.432,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.432}]},{"osd":3,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41299999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.77400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.754},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55400000000000005},"min":{"1min":0.37,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68200000000000005,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":1.339},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.76400000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.772},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:31.582 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:31.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.727+0000 7f6389db5700 1 Processor -- start 2023-10-24T00:45:31.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.727+0000 7f6389db5700 1 -- start start 2023-10-24T00:45:31.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6389db5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6384063360 0x7f63840694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6389db5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638406b9e0 con 0x7f6384152080 2023-10-24T00:45:31.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6389db5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638406b420 con 0x7f63840ac6c0 2023-10-24T00:45:31.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6389db5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840699a0 con 0x7f6384063360 2023-10-24T00:45:31.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6388db3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6384152080 0x7f6384065470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43870/0 (socket says 172.21.15.148:43870) 2023-10-24T00:45:31.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f6388db3700 1 -- 172.21.15.148:0/1010481481 learned_addr learned my addr 172.21.15.148:0/1010481481 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:31.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f63895b4700 1 --2- 172.21.15.148:0/1010481481 >> v2:172.21.15.148:3300/0 conn(0x7f6384063360 0x7f63840694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f63895b4700 1 -- 172.21.15.148:0/1010481481 >> v1:172.21.15.150:6789/0 conn(0x7f63840ac6c0 legacy=0x7f6384062c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f63895b4700 1 -- 172.21.15.148:0/1010481481 >> v1:172.21.15.148:6789/0 conn(0x7f6384152080 legacy=0x7f6384065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f63837fe700 1 -- 172.21.15.148:0/1010481481 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240479497 0 0) 0x7f638406b9e0 con 0x7f6384152080 2023-10-24T00:45:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.728+0000 7f63895b4700 1 -- 172.21.15.148:0/1010481481 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638406b700 con 0x7f6384063360 2023-10-24T00:45:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f63895b4700 1 --2- 172.21.15.148:0/1010481481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63840694b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f6374009760 tx=0x7f6374009060).ready entity=mon.0 client_cookie=8d2be8c2c6cf2c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f63837fe700 1 -- 172.21.15.148:0/1010481481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374009120 con 0x7f6384063360 2023-10-24T00:45:31.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f63837fe700 1 -- 172.21.15.148:0/1010481481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400b580 con 0x7f6384063360 2023-10-24T00:45:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f63837fe700 1 -- 172.21.15.148:0/1010481481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400b900 con 0x7f6384063360 2023-10-24T00:45:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 -- 172.21.15.148:0/1010481481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 msgr2=0x7f63840694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 --2- 172.21.15.148:0/1010481481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63840694b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f6374009760 tx=0x7f6374009060).stop 2023-10-24T00:45:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 -- 172.21.15.148:0/1010481481 shutdown_connections 2023-10-24T00:45:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 --2- 172.21.15.148:0/1010481481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63840694b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 -- 172.21.15.148:0/1010481481 >> 172.21.15.148:0/1010481481 conn(0x7f63840c72d0 msgr2=0x7f63840c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 -- 172.21.15.148:0/1010481481 shutdown_connections 2023-10-24T00:45:31.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.729+0000 7f6389db5700 1 -- 172.21.15.148:0/1010481481 wait complete. 2023-10-24T00:45:31.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.730+0000 7f6389db5700 1 Processor -- start 2023-10-24T00:45:31.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 -- start start 2023-10-24T00:45:31.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 0x7f638414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6384152080 0x7f63841661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384165d20 con 0x7f6384063360 2023-10-24T00:45:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384162c70 con 0x7f6384152080 2023-10-24T00:45:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6389db5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6384162f50 con 0x7f63840ac6c0 2023-10-24T00:45:31.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6388db3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6388db3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55890/0 (socket says 172.21.15.148:55890) 2023-10-24T00:45:31.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f6388db3700 1 -- 172.21.15.148:0/478183296 learned_addr learned my addr 172.21.15.148:0/478183296 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:31.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.731+0000 7f63895b4700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6384152080 0x7f63841661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6383fff700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 0x7f638414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 -- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 msgr2=0x7f638414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 0x7f638414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 -- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6384152080 msgr2=0x7f63841661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6384152080 0x7f63841661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 -- 172.21.15.148:0/478183296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740092a0 con 0x7f6384063360 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6383fff700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 0x7f638414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6388db3700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f637c00c760 tx=0x7f637c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c005d30 con 0x7f6384063360 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005e90 con 0x7f6384063360 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384163230 con 0x7f6384063360 2023-10-24T00:45:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c007340 con 0x7f6384063360 2023-10-24T00:45:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.732+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638414e2c0 con 0x7f6384063360 2023-10-24T00:45:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.733+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63840640f0 con 0x7f6384063360 2023-10-24T00:45:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.733+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f637c007770 con 0x7f6384063360 2023-10-24T00:45:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.734+0000 7f6380ff9700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 0x7f6370061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.734+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f637c07a360 con 0x7f6384063360 2023-10-24T00:45:31.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.734+0000 7f6383fff700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 0x7f6370061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:31.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.734+0000 7f6383fff700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 0x7f6370061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6384155de0 tx=0x7f6378009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:31.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.738+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f637c04b4b0 con 0x7f6384063360 2023-10-24T00:45:31.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.900+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6384165e60 con 0x7f637005f270 2023-10-24T00:45:31.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.910+0000 7f6380ff9700 1 -- 172.21.15.148:0/478183296 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350223 (secure 0 0 0) 0x7f6378001360 con 0x7f637005f270 2023-10-24T00:45:31.916 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:31.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 msgr2=0x7f6370061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 0x7f6370061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6384155de0 tx=0x7f6378009040).stop 2023-10-24T00:45:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 msgr2=0x7f63841625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f637c00c760 tx=0x7f637c001520).stop 2023-10-24T00:45:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 shutdown_connections 2023-10-24T00:45:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6384152080 0x7f63841661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f637005f270 0x7f6370061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6384063360 0x7f63841625e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 --2- 172.21.15.148:0/478183296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63840ac6c0 0x7f638414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 >> 172.21.15.148:0/478183296 conn(0x7f63840c72d0 msgr2=0x7f638405e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 shutdown_connections 2023-10-24T00:45:31.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:31.913+0000 7f6389db5700 1 -- 172.21.15.148:0/478183296 wait complete. 2023-10-24T00:45:31.921 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:31.927 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:45:31.403121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2419752,"kb_used_data":10216,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554968,"statfs":{"total":773094113280,"available":770616287232,"internally_reserved":0,"allocated":10461184,"data_stored":5225088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003788"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891839+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:45:23.891839+0000","last_peered":"2023-10-24T00:45:23.891839+0000","last_clean":"2023-10-24T00:45:23.891839+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:45:23.891839+0000","last_undegraded":"2023-10-24T00:45:23.891839+0000","last_fullsized":"2023-10-24T00:45:23.891839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892667+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:45:23.892667+0000","last_peered":"2023-10-24T00:45:23.892667+0000","last_clean":"2023-10-24T00:45:23.892667+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:45:23.892667+0000","last_undegraded":"2023-10-24T00:45:23.892667+0000","last_fullsized":"2023-10-24T00:45:23.892667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:45:23.337592+0000","last_peered":"2023-10-24T00:45:23.337592+0000","last_clean":"2023-10-24T00:45:23.337592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:45:23.337592+0000","last_undegraded":"2023-10-24T00:45:23.337592+0000","last_fullsized":"2023-10-24T00:45:23.337592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:45:23.337603+0000","last_peered":"2023-10-24T00:45:23.337603+0000","last_clean":"2023-10-24T00:45:23.337603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:45:23.337603+0000","last_undegraded":"2023-10-24T00:45:23.337603+0000","last_fullsized":"2023-10-24T00:45:23.337603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337611+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:45:23.337611+0000","last_peered":"2023-10-24T00:45:23.337611+0000","last_clean":"2023-10-24T00:45:23.337611+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:45:23.337611+0000","last_undegraded":"2023-10-24T00:45:23.337611+0000","last_fullsized":"2023-10-24T00:45:23.337611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891866+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:45:23.891866+0000","last_peered":"2023-10-24T00:45:23.891866+0000","last_clean":"2023-10-24T00:45:23.891866+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:45:23.891866+0000","last_undegraded":"2023-10-24T00:45:23.891866+0000","last_fullsized":"2023-10-24T00:45:23.891866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.893203+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:45:23.893203+0000","last_peered":"2023-10-24T00:45:23.893203+0000","last_clean":"2023-10-24T00:45:23.893203+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:45:23.893203+0000","last_undegraded":"2023-10-24T00:45:23.893203+0000","last_fullsized":"2023-10-24T00:45:23.893203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.83299999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81100000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.81399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84199999999999997,"5min":4.351,"15min":4.351},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.90000000000000002,"5min":1.054,"15min":1.054},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73199999999999998,"5min":1.573,"15min":1.573},"last":0.67800000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59399999999999997,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.625}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":14.597,"15min":14.597},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55700000000000005,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.5,"15min":0.495},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":0.82699999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.872},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.38300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.55700000000000005,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.498,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41799999999999998,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46400000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.371,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52500000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.51100000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.627}]},{"osd":4,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":1.143,"15min":1.1859999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":1.964},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.61699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.88200000000000001,"15min":1.121},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":1.109,"15min":1.5800000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.6919999999999999},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.28799999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.436},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.38600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.628},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.43099999999999999,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.67100000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.90300000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.874,"15min":0.92400000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60399999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34300000000000003,"15min":0.36199999999999999},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.434,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.62},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.248,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.63,"15min":0.65500000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.26200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.222},{"interface":"front","average":{"1min":0.375,"5min":0.39600000000000002,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.501,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.246}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":1.083,"15min":1.083},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.67300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.999},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25600000000000001},"max":{"1min":0.67600000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.28999999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.024},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.995},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.83099999999999996,"15min":1.042},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.121},"last":0.57799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":0.63800000000000001,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.432,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.432}]},{"osd":3,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41299999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.77400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.754},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55400000000000005},"min":{"1min":0.37,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68200000000000005,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":1.339},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.76400000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.772},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:31.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-10-24T00:45:31.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-24T00:45:31.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-10-24T00:45:31.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-24T00:45:31.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-10-24T00:45:31.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-24T00:45:31.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-10-24T00:45:31.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-10-24T00:45:31.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-10-24T00:45:31.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-24T00:45:31.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-10-24T00:45:31.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-24T00:45:31.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-10-24T00:45:31.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-10-24T00:45:31.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-10-24T00:45:31.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-24T00:45:31.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-10-24T00:45:31.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-24T00:45:31.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-10-24T00:45:31.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-24T00:45:31.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-10-24T00:45:31.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-24T00:45:31.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-10-24T00:45:31.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-24T00:45:31.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-10-24T00:45:31.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-24T00:45:31.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-10-24T00:45:31.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-10-24T00:45:31.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-10-24T00:45:31.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-24T00:45:31.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-10-24T00:45:31.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-24T00:45:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-10-24T00:45:31.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-24T00:45:31.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-10-24T00:45:31.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-10-24T00:45:31.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-10-24T00:45:31.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-24T00:45:31.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-10-24T00:45:31.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-10-24T00:45:31.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-10-24T00:45:31.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-10-24T00:45:31.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-10-24T00:45:31.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-24T00:45:31.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-10-24T00:45:31.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-24T00:45:31.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-10-24T00:45:31.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-10-24T00:45:31.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-10-24T00:45:31.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-24T00:45:31.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-10-24T00:45:31.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-24T00:45:31.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-10-24T00:45:31.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-24T00:45:31.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-10-24T00:45:31.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-24T00:45:31.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-10-24T00:45:31.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-24T00:45:31.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-10-24T00:45:31.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-24T00:45:31.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-10-24T00:45:31.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-24T00:45:31.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-10-24T00:45:31.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-24T00:45:31.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-10-24T00:45:31.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-24T00:45:31.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-10-24T00:45:31.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-24T00:45:31.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-10-24T00:45:31.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-24T00:45:31.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-10-24T00:45:31.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-24T00:45:31.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-10-24T00:45:31.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-24T00:45:31.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-10-24T00:45:31.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-24T00:45:31.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-10-24T00:45:31.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-24T00:45:31.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-10-24T00:45:31.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-24T00:45:31.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-10-24T00:45:31.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-24T00:45:31.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:31.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-10-24T00:45:31.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-24T00:45:32.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-10-24T00:45:32.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-24T00:45:32.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-10-24T00:45:32.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-24T00:45:32.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-10-24T00:45:32.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-24T00:45:32.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-10-24T00:45:32.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-24T00:45:32.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-10-24T00:45:32.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-24T00:45:32.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-10-24T00:45:32.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-24T00:45:32.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-10-24T00:45:32.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-24T00:45:32.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-10-24T00:45:32.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-24T00:45:32.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-10-24T00:45:32.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-24T00:45:32.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-10-24T00:45:32.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-24T00:45:32.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-10-24T00:45:32.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-24T00:45:32.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-10-24T00:45:32.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-24T00:45:32.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-10-24T00:45:32.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-24T00:45:32.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-10-24T00:45:32.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-24T00:45:32.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-10-24T00:45:32.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-24T00:45:32.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-10-24T00:45:32.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-24T00:45:32.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-10-24T00:45:32.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-24T00:45:32.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-10-24T00:45:32.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-24T00:45:32.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-10-24T00:45:32.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-24T00:45:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-10-24T00:45:32.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-10-24T00:45:32.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-10-24T00:45:32.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-24T00:45:32.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-10-24T00:45:32.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:27.851231+0000', 'last_change': '2023-10-24T00:45:27.851231+0000', 'last_active': '2023-10-24T00:45:27.851231+0000', 'last_peered': '2023-10-24T00:45:27.851231+0000', 'last_clean': '2023-10-24T00:45:27.851231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:27.851231+0000', 'last_undegraded': '2023-10-24T00:45:27.851231+0000', 'last_fullsized': '2023-10-24T00:45:27.851231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:27.851231+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-10-24T00:45:32.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:45:26.848077+0000', 'last_change': '2023-10-24T00:45:26.848077+0000', 'last_active': '2023-10-24T00:45:26.848077+0000', 'last_peered': '2023-10-24T00:45:26.848077+0000', 'last_clean': '2023-10-24T00:45:26.848077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:45:26.848077+0000', 'last_undegraded': '2023-10-24T00:45:26.848077+0000', 'last_fullsized': '2023-10-24T00:45:26.848077+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'last_clean_scrub_stamp': '2023-10-24T00:45:26.848077+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:45:32.034 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:45:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.144+0000 7fc993771700 1 Processor -- start 2023-10-24T00:45:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 -- start start 2023-10-24T00:45:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c0aa2f0 0x7fc98c064820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc98c064d10 0x7fc98c0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c157fa0 con 0x7fc98c0c6430 2023-10-24T00:45:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c065170 con 0x7fc98c064d10 2023-10-24T00:45:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.145+0000 7fc993771700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c68b0 con 0x7fc98c0aa2f0 2023-10-24T00:45:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc98c064d10 0x7fc98c0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc98c064d10 0x7fc98c0c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55900/0 (socket says 172.21.15.148:55900) 2023-10-24T00:45:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 -- 172.21.15.148:0/3119519376 learned_addr learned my addr 172.21.15.148:0/3119519376 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc99150d700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c0aa2f0 0x7fc98c064820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 -- 172.21.15.148:0/3119519376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c0aa2f0 msgr2=0x7fc98c064820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c0aa2f0 0x7fc98c064820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 -- 172.21.15.148:0/3119519376 >> v1:172.21.15.150:6789/0 conn(0x7fc98c0c6430 legacy=0x7fc98c0632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 -- 172.21.15.148:0/3119519376 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c1581f0 con 0x7fc98c064d10 2023-10-24T00:45:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc990d0c700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c064d10 0x7fc98c0c5f40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fc97c006fd0 tx=0x7fc97c0090f0).ready entity=mon.0 client_cookie=e38447fd7517434a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc983fff700 1 -- 172.21.15.148:0/3119519376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00b580 con 0x7fc98c064d10 2023-10-24T00:45:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc983fff700 1 -- 172.21.15.148:0/3119519376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00b6e0 con 0x7fc98c064d10 2023-10-24T00:45:32.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.146+0000 7fc983fff700 1 -- 172.21.15.148:0/3119519376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00ba60 con 0x7fc98c064d10 2023-10-24T00:45:32.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 -- 172.21.15.148:0/3119519376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c064d10 msgr2=0x7fc98c0c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c064d10 0x7fc98c0c5f40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fc97c006fd0 tx=0x7fc97c0090f0).stop 2023-10-24T00:45:32.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 -- 172.21.15.148:0/3119519376 shutdown_connections 2023-10-24T00:45:32.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c0aa2f0 0x7fc98c064820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 --2- 172.21.15.148:0/3119519376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c064d10 0x7fc98c0c5f40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 -- 172.21.15.148:0/3119519376 >> 172.21.15.148:0/3119519376 conn(0x7fc98c0caf90 msgr2=0x7fc98c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:32.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 -- 172.21.15.148:0/3119519376 shutdown_connections 2023-10-24T00:45:32.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.147+0000 7fc993771700 1 -- 172.21.15.148:0/3119519376 wait complete. 2023-10-24T00:45:32.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.148+0000 7fc993771700 1 Processor -- start 2023-10-24T00:45:32.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.148+0000 7fc993771700 1 -- start start 2023-10-24T00:45:32.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c064d10 0x7fc98c1376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0aa2f0 0x7fc98c14e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c14bda0 con 0x7fc98c0c6430 2023-10-24T00:45:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c3280 con 0x7fc98c0aa2f0 2023-10-24T00:45:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c2670 con 0x7fc98c064d10 2023-10-24T00:45:32.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55910/0 (socket says 172.21.15.148:55910) 2023-10-24T00:45:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 -- 172.21.15.148:0/3570185273 learned_addr learned my addr 172.21.15.148:0/3570185273 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc990d0c700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0aa2f0 0x7fc98c14e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc99150d700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c064d10 0x7fc98c1376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 -- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c064d10 msgr2=0x7fc98c1376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c064d10 0x7fc98c1376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 -- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0aa2f0 msgr2=0x7fc98c14e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0aa2f0 0x7fc98c14e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 -- 172.21.15.148:0/3570185273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009370 con 0x7fc98c0c6430 2023-10-24T00:45:32.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc991d0e700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fc98400c440 tx=0x7fc984007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840123f0 con 0x7fc98c0c6430 2023-10-24T00:45:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984012550 con 0x7fc98c0c6430 2023-10-24T00:45:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c0c2950 con 0x7fc98c0c6430 2023-10-24T00:45:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.149+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840128d0 con 0x7fc98c0c6430 2023-10-24T00:45:32.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.150+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c0c2f10 con 0x7fc98c0c6430 2023-10-24T00:45:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.151+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c0c3430 con 0x7fc98c0c6430 2023-10-24T00:45:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.151+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc984012c80 con 0x7fc98c0c6430 2023-10-24T00:45:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.151+0000 7fc9817fa700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 0x7fc970061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.151+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc984079810 con 0x7fc98c0c6430 2023-10-24T00:45:32.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.151+0000 7fc99150d700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 0x7fc970061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.152+0000 7fc99150d700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 0x7fc970061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc98800f550 tx=0x7fc98800b040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.155+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc984047af0 con 0x7fc98c0c6430 2023-10-24T00:45:32.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.382+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc98c0c7090 con 0x7fc98c0c6430 2023-10-24T00:45:32.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.382+0000 7fc9817fa700 1 -- 172.21.15.148:0/3570185273 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7fc98c0c3430 con 0x7fc98c0c6430 2023-10-24T00:45:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:32.386 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1016,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2477826048,"bytes_avail":770616287232,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":37,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7212}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-24T00:43:09.408742+0000","services":{}},"progress_events":{}} 2023-10-24T00:45:32.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.384+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 msgr2=0x7fc970061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.384+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 0x7fc970061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc98800f550 tx=0x7fc98800b040).stop 2023-10-24T00:45:32.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 msgr2=0x7fc98c156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fc98400c440 tx=0x7fc984007dd0).stop 2023-10-24T00:45:32.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 shutdown_connections 2023-10-24T00:45:32.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc97005f270 0x7fc970061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc98c0c6430 0x7fc98c156d10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c064d10 0x7fc98c1376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 --2- 172.21.15.148:0/3570185273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0aa2f0 0x7fc98c14e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 >> 172.21.15.148:0/3570185273 conn(0x7fc98c0caf90 msgr2=0x7fc98c0c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:32.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 shutdown_connections 2023-10-24T00:45:32.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.385+0000 7fc993771700 1 -- 172.21.15.148:0/3570185273 wait complete. 2023-10-24T00:45:32.395 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:45:32.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:45:32.399 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:45:32.400 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:32.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.551+0000 7ff23c63a700 1 Processor -- start 2023-10-24T00:45:32.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.551+0000 7ff23c63a700 1 -- start start 2023-10-24T00:45:32.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23c63a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff234154120 0x7ff234154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23c63a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff234158000 con 0x7ff23406a490 2023-10-24T00:45:32.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23c63a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff234158e60 con 0x7ff2340a9f90 2023-10-24T00:45:32.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23c63a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff234158250 con 0x7ff234154120 2023-10-24T00:45:32.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23a3d6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff234154120 0x7ff234154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23abd7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff23406a490 0x7ff2340c06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:43884/0 (socket says 172.21.15.148:43884) 2023-10-24T00:45:32.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23abd7700 1 -- 172.21.15.148:0/762531030 learned_addr learned my addr 172.21.15.148:0/762531030 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:32.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.552+0000 7ff23a3d6700 1 -- 172.21.15.148:0/762531030 >> v1:172.21.15.150:6789/0 conn(0x7ff2340a9f90 legacy=0x7ff234069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:32.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23a3d6700 1 -- 172.21.15.148:0/762531030 >> v1:172.21.15.148:6789/0 conn(0x7ff23406a490 legacy=0x7ff2340c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff2393d4700 1 -- 172.21.15.148:0/762531030 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599895750 0 0) 0x7ff234158000 con 0x7ff23406a490 2023-10-24T00:45:32.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23a3d6700 1 -- 172.21.15.148:0/762531030 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234158530 con 0x7ff234154120 2023-10-24T00:45:32.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23a3d6700 1 --2- 172.21.15.148:0/762531030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff234154120 0x7ff234154500 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7ff224009e60 tx=0x7ff224009780).ready entity=mon.0 client_cookie=d3b808e95fc579a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff2393d4700 1 -- 172.21.15.148:0/762531030 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400e070 con 0x7ff234154120 2023-10-24T00:45:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff2393d4700 1 -- 172.21.15.148:0/762531030 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400bbf0 con 0x7ff234154120 2023-10-24T00:45:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff2393d4700 1 -- 172.21.15.148:0/762531030 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224012410 con 0x7ff234154120 2023-10-24T00:45:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 -- 172.21.15.148:0/762531030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff234154120 msgr2=0x7ff234154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 --2- 172.21.15.148:0/762531030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff234154120 0x7ff234154500 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7ff224009e60 tx=0x7ff224009780).stop 2023-10-24T00:45:32.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 -- 172.21.15.148:0/762531030 shutdown_connections 2023-10-24T00:45:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 --2- 172.21.15.148:0/762531030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff234154120 0x7ff234154500 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 -- 172.21.15.148:0/762531030 >> 172.21.15.148:0/762531030 conn(0x7ff2340cba30 msgr2=0x7ff234063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 -- 172.21.15.148:0/762531030 shutdown_connections 2023-10-24T00:45:32.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.553+0000 7ff23c63a700 1 -- 172.21.15.148:0/762531030 wait complete. 2023-10-24T00:45:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.554+0000 7ff23c63a700 1 Processor -- start 2023-10-24T00:45:32.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.554+0000 7ff23c63a700 1 -- start start 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff23406a490 0x7ff2340c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 0x7ff234164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234165090 con 0x7ff2340a9f90 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c2890 con 0x7ff234154120 2023-10-24T00:45:32.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23c63a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c2b70 con 0x7ff23406a490 2023-10-24T00:45:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff239bd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff239bd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55938/0 (socket says 172.21.15.148:55938) 2023-10-24T00:45:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff239bd5700 1 -- 172.21.15.148:0/205406608 learned_addr learned my addr 172.21.15.148:0/205406608 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23abd7700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 0x7ff234164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.555+0000 7ff23a3d6700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff23406a490 0x7ff2340c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 -- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff23406a490 msgr2=0x7ff2340c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff23406a490 0x7ff2340c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 -- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 msgr2=0x7ff234164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 0x7ff234164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 -- 172.21.15.148:0/205406608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009a20 con 0x7ff2340a9f90 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff23abd7700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 0x7ff234164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff239bd5700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff22800c440 tx=0x7ff228007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800f470 con 0x7ff2340a9f90 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22800f5f0 con 0x7ff2340a9f90 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2340c2e50 con 0x7ff2340a9f90 2023-10-24T00:45:32.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800f9b0 con 0x7ff2340a9f90 2023-10-24T00:45:32.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.556+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2340c3d80 con 0x7ff2340a9f90 2023-10-24T00:45:32.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.557+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2340c3040 con 0x7ff2340a9f90 2023-10-24T00:45:32.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.557+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff228012400 con 0x7ff2340a9f90 2023-10-24T00:45:32.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.558+0000 7ff2327fc700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 0x7ff220061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:32.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.558+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff228079870 con 0x7ff2340a9f90 2023-10-24T00:45:32.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.558+0000 7ff23a3d6700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 0x7ff220061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:32.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.558+0000 7ff23a3d6700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 0x7ff220061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff224009870 tx=0x7ff224009780).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:32.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.562+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff228048af0 con 0x7ff2340a9f90 2023-10-24T00:45:32.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.720+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff23406c6b0 con 0x7ff22005f270 2023-10-24T00:45:32.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.730+0000 7ff2327fc700 1 -- 172.21.15.148:0/205406608 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350223 (secure 0 0 0) 0x7ff23406c6b0 con 0x7ff22005f270 2023-10-24T00:45:32.736 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:32.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 msgr2=0x7ff220061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 0x7ff220061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff224009870 tx=0x7ff224009780).stop 2023-10-24T00:45:32.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 msgr2=0x7ff234164580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:32.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff22800c440 tx=0x7ff228007de0).stop 2023-10-24T00:45:32.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 shutdown_connections 2023-10-24T00:45:32.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff234154120 0x7ff234164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff23406a490 0x7ff2340c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff22005f270 0x7ff220061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 --2- 172.21.15.148:0/205406608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff2340a9f90 0x7ff234164580 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:32.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 >> 172.21.15.148:0/205406608 conn(0x7ff2340cba30 msgr2=0x7ff2340c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:32.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 shutdown_connections 2023-10-24T00:45:32.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:32.733+0000 7ff23c63a700 1 -- 172.21.15.148:0/205406608 wait complete. 2023-10-24T00:45:32.741 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:32.747 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:45:31.403121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2419752,"kb_used_data":10216,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554968,"statfs":{"total":773094113280,"available":770616287232,"internally_reserved":0,"allocated":10461184,"data_stored":5225088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003788"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891839+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:45:23.891839+0000","last_peered":"2023-10-24T00:45:23.891839+0000","last_clean":"2023-10-24T00:45:23.891839+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:45:23.891839+0000","last_undegraded":"2023-10-24T00:45:23.891839+0000","last_fullsized":"2023-10-24T00:45:23.891839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892667+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:45:23.892667+0000","last_peered":"2023-10-24T00:45:23.892667+0000","last_clean":"2023-10-24T00:45:23.892667+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:45:23.892667+0000","last_undegraded":"2023-10-24T00:45:23.892667+0000","last_fullsized":"2023-10-24T00:45:23.892667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.892628+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:45:23.892628+0000","last_peered":"2023-10-24T00:45:23.892628+0000","last_clean":"2023-10-24T00:45:23.892628+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:45:23.892628+0000","last_undegraded":"2023-10-24T00:45:23.892628+0000","last_fullsized":"2023-10-24T00:45:23.892628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:45:23.337592+0000","last_peered":"2023-10-24T00:45:23.337592+0000","last_clean":"2023-10-24T00:45:23.337592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:45:23.337592+0000","last_undegraded":"2023-10-24T00:45:23.337592+0000","last_fullsized":"2023-10-24T00:45:23.337592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:45:23.337603+0000","last_peered":"2023-10-24T00:45:23.337603+0000","last_clean":"2023-10-24T00:45:23.337603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:45:23.337603+0000","last_undegraded":"2023-10-24T00:45:23.337603+0000","last_fullsized":"2023-10-24T00:45:23.337603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.337611+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:45:23.337611+0000","last_peered":"2023-10-24T00:45:23.337611+0000","last_clean":"2023-10-24T00:45:23.337611+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:45:23.337611+0000","last_undegraded":"2023-10-24T00:45:23.337611+0000","last_fullsized":"2023-10-24T00:45:23.337611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.891866+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:45:23.891866+0000","last_peered":"2023-10-24T00:45:23.891866+0000","last_clean":"2023-10-24T00:45:23.891866+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:45:23.891866+0000","last_undegraded":"2023-10-24T00:45:23.891866+0000","last_fullsized":"2023-10-24T00:45:23.891866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:27.851231+0000","last_change":"2023-10-24T00:45:27.851231+0000","last_active":"2023-10-24T00:45:27.851231+0000","last_peered":"2023-10-24T00:45:27.851231+0000","last_clean":"2023-10-24T00:45:27.851231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:27.851231+0000","last_undegraded":"2023-10-24T00:45:27.851231+0000","last_fullsized":"2023-10-24T00:45:27.851231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:45:26.848077+0000","last_change":"2023-10-24T00:45:26.848077+0000","last_active":"2023-10-24T00:45:26.848077+0000","last_peered":"2023-10-24T00:45:26.848077+0000","last_clean":"2023-10-24T00:45:26.848077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:45:26.848077+0000","last_undegraded":"2023-10-24T00:45:26.848077+0000","last_fullsized":"2023-10-24T00:45:26.848077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-10-24T00:45:23.893203+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:45:23.893203+0000","last_peered":"2023-10-24T00:45:23.893203+0000","last_clean":"2023-10-24T00:45:23.893203+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:45:23.893203+0000","last_undegraded":"2023-10-24T00:45:23.893203+0000","last_fullsized":"2023-10-24T00:45:23.893203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.83299999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81100000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.81399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84199999999999997,"5min":4.351,"15min":4.351},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.90000000000000002,"5min":1.054,"15min":1.054},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73199999999999998,"5min":1.573,"15min":1.573},"last":0.67800000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59399999999999997,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.625}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":14.597,"15min":14.597},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55700000000000005,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.5,"15min":0.495},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":0.82699999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.78600000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.872},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.38300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.55700000000000005,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.498,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41799999999999998,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46400000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.371,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52500000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.51100000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.627}]},{"osd":4,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":1.143,"15min":1.1859999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":1.964},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.61699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.88200000000000001,"15min":1.121},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":1.109,"15min":1.5800000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.6919999999999999},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.28799999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.436},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.38600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.628},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.43099999999999999,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.67100000000000004},"last":0.45900000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.90300000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.874,"15min":0.92400000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60399999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.504},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34300000000000003,"15min":0.36199999999999999},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.434,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.62},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.248,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.63,"15min":0.65500000000000003},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.26200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.222},{"interface":"front","average":{"1min":0.375,"5min":0.39600000000000002,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.501,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.246}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":1.083,"15min":1.083},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.67300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.999},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":1298432,"data_stored":648699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.34100000000000003}]},{"osd":1,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25600000000000001},"max":{"1min":0.67600000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.28999999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.024},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.995},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.83099999999999996,"15min":1.042},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.503},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.121},"last":0.57799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":0.63800000000000001,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.432,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.432}]},{"osd":3,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.41299999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1310720,"data_stored":654615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.77400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.754},"last":0.52600000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55400000000000005},"min":{"1min":0.37,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68200000000000005,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":1.339},"last":0.42299999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.76400000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.772},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:33.735 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:45:33.733+0000 7f4cef2ad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:45:35.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:45:35.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.884+0000 7fc7df59e700 1 Processor -- start 2023-10-24T00:45:35.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.884+0000 7fc7df59e700 1 -- start start 2023-10-24T00:45:35.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7df59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7e0062810 0x7fc7e0062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e00a6f70 0x7fc7e0151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7df59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e006a160 con 0x7fc7e01554c0 2023-10-24T00:45:35.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7df59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00650f0 con 0x7fc7e0062810 2023-10-24T00:45:35.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7df59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0069550 con 0x7fc7e00a6f70 2023-10-24T00:45:35.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7e0062810 0x7fc7e0062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc7e0062810 0x7fc7e0062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54012/0 (socket says 172.21.15.148:54012) 2023-10-24T00:45:35.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 -- 172.21.15.148:0/548788651 learned_addr learned my addr 172.21.15.148:0/548788651 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:35.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7ded9d700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e00a6f70 0x7fc7e0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 -- 172.21.15.148:0/548788651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e00a6f70 msgr2=0x7fc7e0151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:35.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e00a6f70 0x7fc7e0151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:35.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 -- 172.21.15.148:0/548788651 >> v1:172.21.15.150:6789/0 conn(0x7fc7e01554c0 legacy=0x7fc7e00a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:35.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.885+0000 7fc7de59c700 1 -- 172.21.15.148:0/548788651 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0069830 con 0x7fc7e0062810 2023-10-24T00:45:35.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7de59c700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e0062810 0x7fc7e0062bf0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fc7d0006fd0 tx=0x7fc7d00090f0).ready entity=mon.0 client_cookie=a0b44e42b82d58c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:35.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7dd59a700 1 -- 172.21.15.148:0/548788651 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000b580 con 0x7fc7e0062810 2023-10-24T00:45:35.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7dd59a700 1 -- 172.21.15.148:0/548788651 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000b6e0 con 0x7fc7e0062810 2023-10-24T00:45:35.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7dd59a700 1 -- 172.21.15.148:0/548788651 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000ba60 con 0x7fc7e0062810 2023-10-24T00:45:35.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 -- 172.21.15.148:0/548788651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e0062810 msgr2=0x7fc7e0062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e0062810 0x7fc7e0062bf0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7fc7d0006fd0 tx=0x7fc7d00090f0).stop 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 -- 172.21.15.148:0/548788651 shutdown_connections 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e00a6f70 0x7fc7e0151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 --2- 172.21.15.148:0/548788651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e0062810 0x7fc7e0062bf0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 -- 172.21.15.148:0/548788651 >> 172.21.15.148:0/548788651 conn(0x7fc7e00c7ad0 msgr2=0x7fc7e00c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:35.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 -- 172.21.15.148:0/548788651 shutdown_connections 2023-10-24T00:45:35.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.886+0000 7fc7df59e700 1 -- 172.21.15.148:0/548788651 wait complete. 2023-10-24T00:45:35.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.887+0000 7fc7df59e700 1 Processor -- start 2023-10-24T00:45:35.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.887+0000 7fc7df59e700 1 -- start start 2023-10-24T00:45:35.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e0062810 0x7fc7e00c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e01554c0 0x7fc7e0167b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00a9ce0 con 0x7fc7e00a6f70 2023-10-24T00:45:35.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c3bc0 con 0x7fc7e01554c0 2023-10-24T00:45:35.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7df59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c2fb0 con 0x7fc7e0062810 2023-10-24T00:45:35.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7ddd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7ddd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54020/0 (socket says 172.21.15.148:54020) 2023-10-24T00:45:35.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7ddd9b700 1 -- 172.21.15.148:0/2649860581 learned_addr learned my addr 172.21.15.148:0/2649860581 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:35.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7de59c700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e0062810 0x7fc7e00c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.888+0000 7fc7ded9d700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e01554c0 0x7fc7e0167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 -- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e0062810 msgr2=0x7fc7e00c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:35.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e0062810 0x7fc7e00c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:35.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 -- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e01554c0 msgr2=0x7fc7e0167b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:35.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e01554c0 0x7fc7e0167b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 -- 172.21.15.148:0/2649860581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009370 con 0x7fc7e00a6f70 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ddd9b700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fc7d400c440 tx=0x7fc7d4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4007020 con 0x7fc7e00a6f70 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4007180 con 0x7fc7e00a6f70 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e00c3290 con 0x7fc7e00a6f70 2023-10-24T00:45:35.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4007520 con 0x7fc7e00a6f70 2023-10-24T00:45:35.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.889+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00c3850 con 0x7fc7e00a6f70 2023-10-24T00:45:35.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.890+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0047480 con 0x7fc7e00a6f70 2023-10-24T00:45:35.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.890+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc7d40068b0 con 0x7fc7e00a6f70 2023-10-24T00:45:35.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.891+0000 7fc7ce7fc700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 0x7fc7c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:35.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.891+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc7d4079580 con 0x7fc7e00a6f70 2023-10-24T00:45:35.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.891+0000 7fc7de59c700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 0x7fc7c0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:35.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.891+0000 7fc7de59c700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 0x7fc7c0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc7d0009fd0 tx=0x7fc7d0017000).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:35.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:35.895+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc7d4047af0 con 0x7fc7e00a6f70 2023-10-24T00:45:36.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.055+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e0069b10 con 0x7fc7c005f270 2023-10-24T00:45:36.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.066+0000 7fc7ce7fc700 1 -- 172.21.15.148:0/2649860581 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362032 (secure 0 0 0) 0x7fc7e0069b10 con 0x7fc7c005f270 2023-10-24T00:45:36.072 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:36.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 msgr2=0x7fc7c0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 0x7fc7c0061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc7d0009fd0 tx=0x7fc7d0017000).stop 2023-10-24T00:45:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 msgr2=0x7fc7e00a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fc7d400c440 tx=0x7fc7d4007e00).stop 2023-10-24T00:45:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 shutdown_connections 2023-10-24T00:45:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7e01554c0 0x7fc7e0167b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7e0062810 0x7fc7e00c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc7c005f270 0x7fc7c0061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 --2- 172.21.15.148:0/2649860581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7e00a6f70 0x7fc7e00a7fc0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 >> 172.21.15.148:0/2649860581 conn(0x7fc7e00c7ad0 msgr2=0x7fc7e01561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:36.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 shutdown_connections 2023-10-24T00:45:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.069+0000 7fc7df59e700 1 -- 172.21.15.148:0/2649860581 wait complete. 2023-10-24T00:45:36.078 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:45:36.084 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-24T00:45:35.404461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2420200,"kb_used_data":10664,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554520,"statfs":{"total":773094113280,"available":770615828480,"internally_reserved":0,"allocated":10919936,"data_stored":5442388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5548,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004592"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255046+0000","last_change":"2023-10-24T00:45:28.250176+0000","last_active":"2023-10-24T00:45:28.255046+0000","last_peered":"2023-10-24T00:45:28.255046+0000","last_clean":"2023-10-24T00:45:28.255046+0000","last_became_active":"2023-10-24T00:45:28.249942+0000","last_became_peered":"2023-10-24T00:45:28.249942+0000","last_unstale":"2023-10-24T00:45:28.255046+0000","last_undegraded":"2023-10-24T00:45:28.255046+0000","last_fullsized":"2023-10-24T00:45:28.255046+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252923+0000","last_change":"2023-10-24T00:45:27.876295+0000","last_active":"2023-10-24T00:45:28.252923+0000","last_peered":"2023-10-24T00:45:28.252923+0000","last_clean":"2023-10-24T00:45:28.252923+0000","last_became_active":"2023-10-24T00:45:27.876011+0000","last_became_peered":"2023-10-24T00:45:27.876011+0000","last_unstale":"2023-10-24T00:45:28.252923+0000","last_undegraded":"2023-10-24T00:45:28.252923+0000","last_fullsized":"2023-10-24T00:45:28.252923+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.247965+0000","last_change":"2023-10-24T00:45:28.242129+0000","last_active":"2023-10-24T00:45:28.247965+0000","last_peered":"2023-10-24T00:45:28.247965+0000","last_clean":"2023-10-24T00:45:28.247965+0000","last_became_active":"2023-10-24T00:45:28.241888+0000","last_became_peered":"2023-10-24T00:45:28.241888+0000","last_unstale":"2023-10-24T00:45:28.247965+0000","last_undegraded":"2023-10-24T00:45:28.247965+0000","last_fullsized":"2023-10-24T00:45:28.247965+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.235778+0000","last_change":"2023-10-24T00:45:27.878717+0000","last_active":"2023-10-24T00:45:28.235778+0000","last_peered":"2023-10-24T00:45:28.235778+0000","last_clean":"2023-10-24T00:45:28.235778+0000","last_became_active":"2023-10-24T00:45:27.878444+0000","last_became_peered":"2023-10-24T00:45:27.878444+0000","last_unstale":"2023-10-24T00:45:28.235778+0000","last_undegraded":"2023-10-24T00:45:28.235778+0000","last_fullsized":"2023-10-24T00:45:28.235778+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251942+0000","last_change":"2023-10-24T00:45:28.250928+0000","last_active":"2023-10-24T00:45:28.251942+0000","last_peered":"2023-10-24T00:45:28.251942+0000","last_clean":"2023-10-24T00:45:28.251942+0000","last_became_active":"2023-10-24T00:45:28.250552+0000","last_became_peered":"2023-10-24T00:45:28.250552+0000","last_unstale":"2023-10-24T00:45:28.251942+0000","last_undegraded":"2023-10-24T00:45:28.251942+0000","last_fullsized":"2023-10-24T00:45:28.251942+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231713+0000","last_change":"2023-10-24T00:45:27.879754+0000","last_active":"2023-10-24T00:45:28.231713+0000","last_peered":"2023-10-24T00:45:28.231713+0000","last_clean":"2023-10-24T00:45:28.231713+0000","last_became_active":"2023-10-24T00:45:27.878480+0000","last_became_peered":"2023-10-24T00:45:27.878480+0000","last_unstale":"2023-10-24T00:45:28.231713+0000","last_undegraded":"2023-10-24T00:45:28.231713+0000","last_fullsized":"2023-10-24T00:45:28.231713+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.258945+0000","last_change":"2023-10-24T00:45:28.258023+0000","last_active":"2023-10-24T00:45:28.258945+0000","last_peered":"2023-10-24T00:45:28.258945+0000","last_clean":"2023-10-24T00:45:28.258945+0000","last_became_active":"2023-10-24T00:45:28.257766+0000","last_became_peered":"2023-10-24T00:45:28.257766+0000","last_unstale":"2023-10-24T00:45:28.258945+0000","last_undegraded":"2023-10-24T00:45:28.258945+0000","last_fullsized":"2023-10-24T00:45:28.258945+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"110'2","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254996+0000","last_change":"2023-10-24T00:45:27.880263+0000","last_active":"2023-10-24T00:45:28.254996+0000","last_peered":"2023-10-24T00:45:28.254996+0000","last_clean":"2023-10-24T00:45:28.254996+0000","last_became_active":"2023-10-24T00:45:27.879973+0000","last_became_peered":"2023-10-24T00:45:27.879973+0000","last_unstale":"2023-10-24T00:45:28.254996+0000","last_undegraded":"2023-10-24T00:45:28.254996+0000","last_fullsized":"2023-10-24T00:45:28.254996+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255384+0000","last_change":"2023-10-24T00:45:28.253108+0000","last_active":"2023-10-24T00:45:28.255384+0000","last_peered":"2023-10-24T00:45:28.255384+0000","last_clean":"2023-10-24T00:45:28.255384+0000","last_became_active":"2023-10-24T00:45:28.252823+0000","last_became_peered":"2023-10-24T00:45:28.252823+0000","last_unstale":"2023-10-24T00:45:28.255384+0000","last_undegraded":"2023-10-24T00:45:28.255384+0000","last_fullsized":"2023-10-24T00:45:28.255384+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.245362+0000","last_change":"2023-10-24T00:45:27.879446+0000","last_active":"2023-10-24T00:45:28.245362+0000","last_peered":"2023-10-24T00:45:28.245362+0000","last_clean":"2023-10-24T00:45:28.245362+0000","last_became_active":"2023-10-24T00:45:27.879143+0000","last_became_peered":"2023-10-24T00:45:27.879143+0000","last_unstale":"2023-10-24T00:45:28.245362+0000","last_undegraded":"2023-10-24T00:45:28.245362+0000","last_fullsized":"2023-10-24T00:45:28.245362+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.249878+0000","last_change":"2023-10-24T00:45:28.244053+0000","last_active":"2023-10-24T00:45:28.249878+0000","last_peered":"2023-10-24T00:45:28.249878+0000","last_clean":"2023-10-24T00:45:28.249878+0000","last_became_active":"2023-10-24T00:45:28.243763+0000","last_became_peered":"2023-10-24T00:45:28.243763+0000","last_unstale":"2023-10-24T00:45:28.249878+0000","last_undegraded":"2023-10-24T00:45:28.249878+0000","last_fullsized":"2023-10-24T00:45:28.249878+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.248680+0000","last_change":"2023-10-24T00:45:27.882011+0000","last_active":"2023-10-24T00:45:28.248680+0000","last_peered":"2023-10-24T00:45:28.248680+0000","last_clean":"2023-10-24T00:45:28.248680+0000","last_became_active":"2023-10-24T00:45:27.881764+0000","last_became_peered":"2023-10-24T00:45:27.881764+0000","last_unstale":"2023-10-24T00:45:28.248680+0000","last_undegraded":"2023-10-24T00:45:28.248680+0000","last_fullsized":"2023-10-24T00:45:28.248680+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.257233+0000","last_change":"2023-10-24T00:45:28.256455+0000","last_active":"2023-10-24T00:45:28.257233+0000","last_peered":"2023-10-24T00:45:28.257233+0000","last_clean":"2023-10-24T00:45:28.257233+0000","last_became_active":"2023-10-24T00:45:28.256048+0000","last_became_peered":"2023-10-24T00:45:28.256048+0000","last_unstale":"2023-10-24T00:45:28.257233+0000","last_undegraded":"2023-10-24T00:45:28.257233+0000","last_fullsized":"2023-10-24T00:45:28.257233+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.881034+0000","last_change":"2023-10-24T00:45:27.870631+0000","last_active":"2023-10-24T00:45:27.881034+0000","last_peered":"2023-10-24T00:45:27.881034+0000","last_clean":"2023-10-24T00:45:27.881034+0000","last_became_active":"2023-10-24T00:45:27.870372+0000","last_became_peered":"2023-10-24T00:45:27.870372+0000","last_unstale":"2023-10-24T00:45:27.881034+0000","last_undegraded":"2023-10-24T00:45:27.881034+0000","last_fullsized":"2023-10-24T00:45:27.881034+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252032+0000","last_change":"2023-10-24T00:45:28.246085+0000","last_active":"2023-10-24T00:45:28.252032+0000","last_peered":"2023-10-24T00:45:28.252032+0000","last_clean":"2023-10-24T00:45:28.252032+0000","last_became_active":"2023-10-24T00:45:28.245626+0000","last_became_peered":"2023-10-24T00:45:28.245626+0000","last_unstale":"2023-10-24T00:45:28.252032+0000","last_undegraded":"2023-10-24T00:45:28.252032+0000","last_fullsized":"2023-10-24T00:45:28.252032+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.234702+0000","last_change":"2023-10-24T00:45:27.877203+0000","last_active":"2023-10-24T00:45:28.234702+0000","last_peered":"2023-10-24T00:45:28.234702+0000","last_clean":"2023-10-24T00:45:28.234702+0000","last_became_active":"2023-10-24T00:45:27.876865+0000","last_became_peered":"2023-10-24T00:45:27.876865+0000","last_unstale":"2023-10-24T00:45:28.234702+0000","last_undegraded":"2023-10-24T00:45:28.234702+0000","last_fullsized":"2023-10-24T00:45:28.234702+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.243513+0000","last_change":"2023-10-24T00:45:28.243513+0000","last_active":"2023-10-24T00:45:28.243513+0000","last_peered":"2023-10-24T00:45:28.243513+0000","last_clean":"2023-10-24T00:45:28.243513+0000","last_became_active":"2023-10-24T00:45:28.242973+0000","last_became_peered":"2023-10-24T00:45:28.242973+0000","last_unstale":"2023-10-24T00:45:28.243513+0000","last_undegraded":"2023-10-24T00:45:28.243513+0000","last_fullsized":"2023-10-24T00:45:28.243513+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.236290+0000","last_change":"2023-10-24T00:45:27.885891+0000","last_active":"2023-10-24T00:45:28.236290+0000","last_peered":"2023-10-24T00:45:28.236290+0000","last_clean":"2023-10-24T00:45:28.236290+0000","last_became_active":"2023-10-24T00:45:27.885592+0000","last_became_peered":"2023-10-24T00:45:27.885592+0000","last_unstale":"2023-10-24T00:45:28.236290+0000","last_undegraded":"2023-10-24T00:45:28.236290+0000","last_fullsized":"2023-10-24T00:45:28.236290+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.256498+0000","last_change":"2023-10-24T00:45:28.254017+0000","last_active":"2023-10-24T00:45:28.256498+0000","last_peered":"2023-10-24T00:45:28.256498+0000","last_clean":"2023-10-24T00:45:28.256498+0000","last_became_active":"2023-10-24T00:45:28.253805+0000","last_became_peered":"2023-10-24T00:45:28.253805+0000","last_unstale":"2023-10-24T00:45:28.256498+0000","last_undegraded":"2023-10-24T00:45:28.256498+0000","last_fullsized":"2023-10-24T00:45:28.256498+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.240401+0000","last_change":"2023-10-24T00:45:27.871192+0000","last_active":"2023-10-24T00:45:28.240401+0000","last_peered":"2023-10-24T00:45:28.240401+0000","last_clean":"2023-10-24T00:45:28.240401+0000","last_became_active":"2023-10-24T00:45:27.870826+0000","last_became_peered":"2023-10-24T00:45:27.870826+0000","last_unstale":"2023-10-24T00:45:28.240401+0000","last_undegraded":"2023-10-24T00:45:28.240401+0000","last_fullsized":"2023-10-24T00:45:28.240401+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.243015+0000","last_change":"2023-10-24T00:45:28.243015+0000","last_active":"2023-10-24T00:45:28.243015+0000","last_peered":"2023-10-24T00:45:28.243015+0000","last_clean":"2023-10-24T00:45:28.243015+0000","last_became_active":"2023-10-24T00:45:28.242689+0000","last_became_peered":"2023-10-24T00:45:28.242689+0000","last_unstale":"2023-10-24T00:45:28.243015+0000","last_undegraded":"2023-10-24T00:45:28.243015+0000","last_fullsized":"2023-10-24T00:45:28.243015+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.234822+0000","last_change":"2023-10-24T00:45:27.875017+0000","last_active":"2023-10-24T00:45:28.234822+0000","last_peered":"2023-10-24T00:45:28.234822+0000","last_clean":"2023-10-24T00:45:28.234822+0000","last_became_active":"2023-10-24T00:45:27.874737+0000","last_became_peered":"2023-10-24T00:45:27.874737+0000","last_unstale":"2023-10-24T00:45:28.234822+0000","last_undegraded":"2023-10-24T00:45:28.234822+0000","last_fullsized":"2023-10-24T00:45:28.234822+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254546+0000","last_change":"2023-10-24T00:45:28.252419+0000","last_active":"2023-10-24T00:45:28.254546+0000","last_peered":"2023-10-24T00:45:28.254546+0000","last_clean":"2023-10-24T00:45:28.254546+0000","last_became_active":"2023-10-24T00:45:28.251995+0000","last_became_peered":"2023-10-24T00:45:28.251995+0000","last_unstale":"2023-10-24T00:45:28.254546+0000","last_undegraded":"2023-10-24T00:45:28.254546+0000","last_fullsized":"2023-10-24T00:45:28.254546+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.258722+0000","last_change":"2023-10-24T00:45:27.869800+0000","last_active":"2023-10-24T00:45:28.258722+0000","last_peered":"2023-10-24T00:45:28.258722+0000","last_clean":"2023-10-24T00:45:28.258722+0000","last_became_active":"2023-10-24T00:45:27.869474+0000","last_became_peered":"2023-10-24T00:45:27.869474+0000","last_unstale":"2023-10-24T00:45:28.258722+0000","last_undegraded":"2023-10-24T00:45:28.258722+0000","last_fullsized":"2023-10-24T00:45:28.258722+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253816+0000","last_change":"2023-10-24T00:45:28.251822+0000","last_active":"2023-10-24T00:45:28.253816+0000","last_peered":"2023-10-24T00:45:28.253816+0000","last_clean":"2023-10-24T00:45:28.253816+0000","last_became_active":"2023-10-24T00:45:28.251366+0000","last_became_peered":"2023-10-24T00:45:28.251366+0000","last_unstale":"2023-10-24T00:45:28.253816+0000","last_undegraded":"2023-10-24T00:45:28.253816+0000","last_fullsized":"2023-10-24T00:45:28.253816+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.248391+0000","last_change":"2023-10-24T00:45:27.877344+0000","last_active":"2023-10-24T00:45:28.248391+0000","last_peered":"2023-10-24T00:45:28.248391+0000","last_clean":"2023-10-24T00:45:28.248391+0000","last_became_active":"2023-10-24T00:45:27.877023+0000","last_became_peered":"2023-10-24T00:45:27.877023+0000","last_unstale":"2023-10-24T00:45:28.248391+0000","last_undegraded":"2023-10-24T00:45:28.248391+0000","last_fullsized":"2023-10-24T00:45:28.248391+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254875+0000","last_change":"2023-10-24T00:45:28.247374+0000","last_active":"2023-10-24T00:45:28.254875+0000","last_peered":"2023-10-24T00:45:28.254875+0000","last_clean":"2023-10-24T00:45:28.254875+0000","last_became_active":"2023-10-24T00:45:28.247131+0000","last_became_peered":"2023-10-24T00:45:28.247131+0000","last_unstale":"2023-10-24T00:45:28.254875+0000","last_undegraded":"2023-10-24T00:45:28.254875+0000","last_fullsized":"2023-10-24T00:45:28.254875+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.883928+0000","last_change":"2023-10-24T00:45:27.880220+0000","last_active":"2023-10-24T00:45:27.883928+0000","last_peered":"2023-10-24T00:45:27.883928+0000","last_clean":"2023-10-24T00:45:27.883928+0000","last_became_active":"2023-10-24T00:45:27.879955+0000","last_became_peered":"2023-10-24T00:45:27.879955+0000","last_unstale":"2023-10-24T00:45:27.883928+0000","last_undegraded":"2023-10-24T00:45:27.883928+0000","last_fullsized":"2023-10-24T00:45:27.883928+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252304+0000","last_change":"2023-10-24T00:45:28.246658+0000","last_active":"2023-10-24T00:45:28.252304+0000","last_peered":"2023-10-24T00:45:28.252304+0000","last_clean":"2023-10-24T00:45:28.252304+0000","last_became_active":"2023-10-24T00:45:28.246405+0000","last_became_peered":"2023-10-24T00:45:28.246405+0000","last_unstale":"2023-10-24T00:45:28.252304+0000","last_undegraded":"2023-10-24T00:45:28.252304+0000","last_fullsized":"2023-10-24T00:45:28.252304+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.233481+0000","last_change":"2023-10-24T00:45:27.874885+0000","last_active":"2023-10-24T00:45:28.233481+0000","last_peered":"2023-10-24T00:45:28.233481+0000","last_clean":"2023-10-24T00:45:28.233481+0000","last_became_active":"2023-10-24T00:45:27.874602+0000","last_became_peered":"2023-10-24T00:45:27.874602+0000","last_unstale":"2023-10-24T00:45:28.233481+0000","last_undegraded":"2023-10-24T00:45:28.233481+0000","last_fullsized":"2023-10-24T00:45:28.233481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255069+0000","last_change":"2023-10-24T00:45:28.241509+0000","last_active":"2023-10-24T00:45:28.255069+0000","last_peered":"2023-10-24T00:45:28.255069+0000","last_clean":"2023-10-24T00:45:28.255069+0000","last_became_active":"2023-10-24T00:45:28.241236+0000","last_became_peered":"2023-10-24T00:45:28.241236+0000","last_unstale":"2023-10-24T00:45:28.255069+0000","last_undegraded":"2023-10-24T00:45:28.255069+0000","last_fullsized":"2023-10-24T00:45:28.255069+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.243261+0000","last_change":"2023-10-24T00:45:27.873194+0000","last_active":"2023-10-24T00:45:28.243261+0000","last_peered":"2023-10-24T00:45:28.243261+0000","last_clean":"2023-10-24T00:45:28.243261+0000","last_became_active":"2023-10-24T00:45:27.872898+0000","last_became_peered":"2023-10-24T00:45:27.872898+0000","last_unstale":"2023-10-24T00:45:28.243261+0000","last_undegraded":"2023-10-24T00:45:28.243261+0000","last_fullsized":"2023-10-24T00:45:28.243261+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255034+0000","last_change":"2023-10-24T00:45:28.250019+0000","last_active":"2023-10-24T00:45:28.255034+0000","last_peered":"2023-10-24T00:45:28.255034+0000","last_clean":"2023-10-24T00:45:28.255034+0000","last_became_active":"2023-10-24T00:45:28.249650+0000","last_became_peered":"2023-10-24T00:45:28.249650+0000","last_unstale":"2023-10-24T00:45:28.255034+0000","last_undegraded":"2023-10-24T00:45:28.255034+0000","last_fullsized":"2023-10-24T00:45:28.255034+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.232627+0000","last_change":"2023-10-24T00:45:27.882264+0000","last_active":"2023-10-24T00:45:28.232627+0000","last_peered":"2023-10-24T00:45:28.232627+0000","last_clean":"2023-10-24T00:45:28.232627+0000","last_became_active":"2023-10-24T00:45:27.881959+0000","last_became_peered":"2023-10-24T00:45:27.881959+0000","last_unstale":"2023-10-24T00:45:28.232627+0000","last_undegraded":"2023-10-24T00:45:28.232627+0000","last_fullsized":"2023-10-24T00:45:28.232627+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.249987+0000","last_change":"2023-10-24T00:45:28.243023+0000","last_active":"2023-10-24T00:45:28.249987+0000","last_peered":"2023-10-24T00:45:28.249987+0000","last_clean":"2023-10-24T00:45:28.249987+0000","last_became_active":"2023-10-24T00:45:28.242702+0000","last_became_peered":"2023-10-24T00:45:28.242702+0000","last_unstale":"2023-10-24T00:45:28.249987+0000","last_undegraded":"2023-10-24T00:45:28.249987+0000","last_fullsized":"2023-10-24T00:45:28.249987+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.886767+0000","last_change":"2023-10-24T00:45:27.880745+0000","last_active":"2023-10-24T00:45:27.886767+0000","last_peered":"2023-10-24T00:45:27.886767+0000","last_clean":"2023-10-24T00:45:27.886767+0000","last_became_active":"2023-10-24T00:45:27.873553+0000","last_became_peered":"2023-10-24T00:45:27.873553+0000","last_unstale":"2023-10-24T00:45:27.886767+0000","last_undegraded":"2023-10-24T00:45:27.886767+0000","last_fullsized":"2023-10-24T00:45:27.886767+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252466+0000","last_change":"2023-10-24T00:45:28.249175+0000","last_active":"2023-10-24T00:45:28.252466+0000","last_peered":"2023-10-24T00:45:28.252466+0000","last_clean":"2023-10-24T00:45:28.252466+0000","last_became_active":"2023-10-24T00:45:28.248869+0000","last_became_peered":"2023-10-24T00:45:28.248869+0000","last_unstale":"2023-10-24T00:45:28.252466+0000","last_undegraded":"2023-10-24T00:45:28.252466+0000","last_fullsized":"2023-10-24T00:45:28.252466+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.258115+0000","last_change":"2023-10-24T00:45:27.883146+0000","last_active":"2023-10-24T00:45:28.258115+0000","last_peered":"2023-10-24T00:45:28.258115+0000","last_clean":"2023-10-24T00:45:28.258115+0000","last_became_active":"2023-10-24T00:45:27.878214+0000","last_became_peered":"2023-10-24T00:45:27.878214+0000","last_unstale":"2023-10-24T00:45:28.258115+0000","last_undegraded":"2023-10-24T00:45:28.258115+0000","last_fullsized":"2023-10-24T00:45:28.258115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255834+0000","last_change":"2023-10-24T00:45:28.253250+0000","last_active":"2023-10-24T00:45:28.255834+0000","last_peered":"2023-10-24T00:45:28.255834+0000","last_clean":"2023-10-24T00:45:28.255834+0000","last_became_active":"2023-10-24T00:45:28.253023+0000","last_became_peered":"2023-10-24T00:45:28.253023+0000","last_unstale":"2023-10-24T00:45:28.255834+0000","last_undegraded":"2023-10-24T00:45:28.255834+0000","last_fullsized":"2023-10-24T00:45:28.255834+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.881206+0000","last_change":"2023-10-24T00:45:27.872513+0000","last_active":"2023-10-24T00:45:27.881206+0000","last_peered":"2023-10-24T00:45:27.881206+0000","last_clean":"2023-10-24T00:45:27.881206+0000","last_became_active":"2023-10-24T00:45:27.872241+0000","last_became_peered":"2023-10-24T00:45:27.872241+0000","last_unstale":"2023-10-24T00:45:27.881206+0000","last_undegraded":"2023-10-24T00:45:27.881206+0000","last_fullsized":"2023-10-24T00:45:27.881206+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.243883+0000","last_change":"2023-10-24T00:45:28.240460+0000","last_active":"2023-10-24T00:45:28.243883+0000","last_peered":"2023-10-24T00:45:28.243883+0000","last_clean":"2023-10-24T00:45:28.243883+0000","last_became_active":"2023-10-24T00:45:28.240177+0000","last_became_peered":"2023-10-24T00:45:28.240177+0000","last_unstale":"2023-10-24T00:45:28.243883+0000","last_undegraded":"2023-10-24T00:45:28.243883+0000","last_fullsized":"2023-10-24T00:45:28.243883+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"110'1","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.229183+0000","last_change":"2023-10-24T00:45:27.884553+0000","last_active":"2023-10-24T00:45:28.229183+0000","last_peered":"2023-10-24T00:45:28.229183+0000","last_clean":"2023-10-24T00:45:28.229183+0000","last_became_active":"2023-10-24T00:45:27.884283+0000","last_became_peered":"2023-10-24T00:45:27.884283+0000","last_unstale":"2023-10-24T00:45:28.229183+0000","last_undegraded":"2023-10-24T00:45:28.229183+0000","last_fullsized":"2023-10-24T00:45:28.229183+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.256752+0000","last_change":"2023-10-24T00:45:28.255213+0000","last_active":"2023-10-24T00:45:28.256752+0000","last_peered":"2023-10-24T00:45:28.256752+0000","last_clean":"2023-10-24T00:45:28.256752+0000","last_became_active":"2023-10-24T00:45:28.254858+0000","last_became_peered":"2023-10-24T00:45:28.254858+0000","last_unstale":"2023-10-24T00:45:28.256752+0000","last_undegraded":"2023-10-24T00:45:28.256752+0000","last_fullsized":"2023-10-24T00:45:28.256752+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.237147+0000","last_change":"2023-10-24T00:45:27.885726+0000","last_active":"2023-10-24T00:45:28.237147+0000","last_peered":"2023-10-24T00:45:28.237147+0000","last_clean":"2023-10-24T00:45:28.237147+0000","last_became_active":"2023-10-24T00:45:27.885444+0000","last_became_peered":"2023-10-24T00:45:27.885444+0000","last_unstale":"2023-10-24T00:45:28.237147+0000","last_undegraded":"2023-10-24T00:45:28.237147+0000","last_fullsized":"2023-10-24T00:45:28.237147+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252285+0000","last_change":"2023-10-24T00:45:28.246639+0000","last_active":"2023-10-24T00:45:28.252285+0000","last_peered":"2023-10-24T00:45:28.252285+0000","last_clean":"2023-10-24T00:45:28.252285+0000","last_became_active":"2023-10-24T00:45:28.246359+0000","last_became_peered":"2023-10-24T00:45:28.246359+0000","last_unstale":"2023-10-24T00:45:28.252285+0000","last_undegraded":"2023-10-24T00:45:28.252285+0000","last_fullsized":"2023-10-24T00:45:28.252285+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.239313+0000","last_change":"2023-10-24T00:45:27.875053+0000","last_active":"2023-10-24T00:45:28.239313+0000","last_peered":"2023-10-24T00:45:28.239313+0000","last_clean":"2023-10-24T00:45:28.239313+0000","last_became_active":"2023-10-24T00:45:27.874774+0000","last_became_peered":"2023-10-24T00:45:27.874774+0000","last_unstale":"2023-10-24T00:45:28.239313+0000","last_undegraded":"2023-10-24T00:45:28.239313+0000","last_fullsized":"2023-10-24T00:45:28.239313+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250017+0000","last_change":"2023-10-24T00:45:28.241533+0000","last_active":"2023-10-24T00:45:28.250017+0000","last_peered":"2023-10-24T00:45:28.250017+0000","last_clean":"2023-10-24T00:45:28.250017+0000","last_became_active":"2023-10-24T00:45:28.241264+0000","last_became_peered":"2023-10-24T00:45:28.241264+0000","last_unstale":"2023-10-24T00:45:28.250017+0000","last_undegraded":"2023-10-24T00:45:28.250017+0000","last_fullsized":"2023-10-24T00:45:28.250017+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.881228+0000","last_change":"2023-10-24T00:45:27.872534+0000","last_active":"2023-10-24T00:45:27.881228+0000","last_peered":"2023-10-24T00:45:27.881228+0000","last_clean":"2023-10-24T00:45:27.881228+0000","last_became_active":"2023-10-24T00:45:27.872272+0000","last_became_peered":"2023-10-24T00:45:27.872272+0000","last_unstale":"2023-10-24T00:45:27.881228+0000","last_undegraded":"2023-10-24T00:45:27.881228+0000","last_fullsized":"2023-10-24T00:45:27.881228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255018+0000","last_change":"2023-10-24T00:45:28.244359+0000","last_active":"2023-10-24T00:45:28.255018+0000","last_peered":"2023-10-24T00:45:28.255018+0000","last_clean":"2023-10-24T00:45:28.255018+0000","last_became_active":"2023-10-24T00:45:28.244089+0000","last_became_peered":"2023-10-24T00:45:28.244089+0000","last_unstale":"2023-10-24T00:45:28.255018+0000","last_undegraded":"2023-10-24T00:45:28.255018+0000","last_fullsized":"2023-10-24T00:45:28.255018+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.234086+0000","last_change":"2023-10-24T00:45:27.878672+0000","last_active":"2023-10-24T00:45:28.234086+0000","last_peered":"2023-10-24T00:45:28.234086+0000","last_clean":"2023-10-24T00:45:28.234086+0000","last_became_active":"2023-10-24T00:45:27.878391+0000","last_became_peered":"2023-10-24T00:45:27.878391+0000","last_unstale":"2023-10-24T00:45:28.234086+0000","last_undegraded":"2023-10-24T00:45:28.234086+0000","last_fullsized":"2023-10-24T00:45:28.234086+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.246503+0000","last_change":"2023-10-24T00:45:28.246503+0000","last_active":"2023-10-24T00:45:28.246503+0000","last_peered":"2023-10-24T00:45:28.246503+0000","last_clean":"2023-10-24T00:45:28.246503+0000","last_became_active":"2023-10-24T00:45:28.246196+0000","last_became_peered":"2023-10-24T00:45:28.246196+0000","last_unstale":"2023-10-24T00:45:28.246503+0000","last_undegraded":"2023-10-24T00:45:28.246503+0000","last_fullsized":"2023-10-24T00:45:28.246503+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231715+0000","last_change":"2023-10-24T00:45:27.878971+0000","last_active":"2023-10-24T00:45:28.231715+0000","last_peered":"2023-10-24T00:45:28.231715+0000","last_clean":"2023-10-24T00:45:28.231715+0000","last_became_active":"2023-10-24T00:45:27.878653+0000","last_became_peered":"2023-10-24T00:45:27.878653+0000","last_unstale":"2023-10-24T00:45:28.231715+0000","last_undegraded":"2023-10-24T00:45:28.231715+0000","last_fullsized":"2023-10-24T00:45:28.231715+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250032+0000","last_change":"2023-10-24T00:45:28.243024+0000","last_active":"2023-10-24T00:45:28.250032+0000","last_peered":"2023-10-24T00:45:28.250032+0000","last_clean":"2023-10-24T00:45:28.250032+0000","last_became_active":"2023-10-24T00:45:28.242731+0000","last_became_peered":"2023-10-24T00:45:28.242731+0000","last_unstale":"2023-10-24T00:45:28.250032+0000","last_undegraded":"2023-10-24T00:45:28.250032+0000","last_fullsized":"2023-10-24T00:45:28.250032+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231351+0000","last_change":"2023-10-24T00:45:27.873119+0000","last_active":"2023-10-24T00:45:28.231351+0000","last_peered":"2023-10-24T00:45:28.231351+0000","last_clean":"2023-10-24T00:45:28.231351+0000","last_became_active":"2023-10-24T00:45:27.872823+0000","last_became_peered":"2023-10-24T00:45:27.872823+0000","last_unstale":"2023-10-24T00:45:28.231351+0000","last_undegraded":"2023-10-24T00:45:28.231351+0000","last_fullsized":"2023-10-24T00:45:28.231351+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252158+0000","last_change":"2023-10-24T00:45:28.249415+0000","last_active":"2023-10-24T00:45:28.252158+0000","last_peered":"2023-10-24T00:45:28.252158+0000","last_clean":"2023-10-24T00:45:28.252158+0000","last_became_active":"2023-10-24T00:45:28.249028+0000","last_became_peered":"2023-10-24T00:45:28.249028+0000","last_unstale":"2023-10-24T00:45:28.252158+0000","last_undegraded":"2023-10-24T00:45:28.252158+0000","last_fullsized":"2023-10-24T00:45:28.252158+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.241268+0000","last_change":"2023-10-24T00:45:27.878031+0000","last_active":"2023-10-24T00:45:28.241268+0000","last_peered":"2023-10-24T00:45:28.241268+0000","last_clean":"2023-10-24T00:45:28.241268+0000","last_became_active":"2023-10-24T00:45:27.877646+0000","last_became_peered":"2023-10-24T00:45:27.877646+0000","last_unstale":"2023-10-24T00:45:28.241268+0000","last_undegraded":"2023-10-24T00:45:28.241268+0000","last_fullsized":"2023-10-24T00:45:28.241268+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.256661+0000","last_change":"2023-10-24T00:45:28.253926+0000","last_active":"2023-10-24T00:45:28.256661+0000","last_peered":"2023-10-24T00:45:28.256661+0000","last_clean":"2023-10-24T00:45:28.256661+0000","last_became_active":"2023-10-24T00:45:28.253647+0000","last_became_peered":"2023-10-24T00:45:28.253647+0000","last_unstale":"2023-10-24T00:45:28.256661+0000","last_undegraded":"2023-10-24T00:45:28.256661+0000","last_fullsized":"2023-10-24T00:45:28.256661+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.236260+0000","last_change":"2023-10-24T00:45:27.871435+0000","last_active":"2023-10-24T00:45:28.236260+0000","last_peered":"2023-10-24T00:45:28.236260+0000","last_clean":"2023-10-24T00:45:28.236260+0000","last_became_active":"2023-10-24T00:45:27.868052+0000","last_became_peered":"2023-10-24T00:45:27.868052+0000","last_unstale":"2023-10-24T00:45:28.236260+0000","last_undegraded":"2023-10-24T00:45:28.236260+0000","last_fullsized":"2023-10-24T00:45:28.236260+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251728+0000","last_change":"2023-10-24T00:45:28.249324+0000","last_active":"2023-10-24T00:45:28.251728+0000","last_peered":"2023-10-24T00:45:28.251728+0000","last_clean":"2023-10-24T00:45:28.251728+0000","last_became_active":"2023-10-24T00:45:28.248868+0000","last_became_peered":"2023-10-24T00:45:28.248868+0000","last_unstale":"2023-10-24T00:45:28.251728+0000","last_undegraded":"2023-10-24T00:45:28.251728+0000","last_fullsized":"2023-10-24T00:45:28.251728+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.237260+0000","last_change":"2023-10-24T00:45:27.882584+0000","last_active":"2023-10-24T00:45:28.237260+0000","last_peered":"2023-10-24T00:45:28.237260+0000","last_clean":"2023-10-24T00:45:28.237260+0000","last_became_active":"2023-10-24T00:45:27.882337+0000","last_became_peered":"2023-10-24T00:45:27.882337+0000","last_unstale":"2023-10-24T00:45:28.237260+0000","last_undegraded":"2023-10-24T00:45:28.237260+0000","last_fullsized":"2023-10-24T00:45:28.237260+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252315+0000","last_change":"2023-10-24T00:45:28.249411+0000","last_active":"2023-10-24T00:45:28.252315+0000","last_peered":"2023-10-24T00:45:28.252315+0000","last_clean":"2023-10-24T00:45:28.252315+0000","last_became_active":"2023-10-24T00:45:28.249121+0000","last_became_peered":"2023-10-24T00:45:28.249121+0000","last_unstale":"2023-10-24T00:45:28.252315+0000","last_undegraded":"2023-10-24T00:45:28.252315+0000","last_fullsized":"2023-10-24T00:45:28.252315+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.230332+0000","last_change":"2023-10-24T00:45:27.885869+0000","last_active":"2023-10-24T00:45:28.230332+0000","last_peered":"2023-10-24T00:45:28.230332+0000","last_clean":"2023-10-24T00:45:28.230332+0000","last_became_active":"2023-10-24T00:45:27.885540+0000","last_became_peered":"2023-10-24T00:45:27.885540+0000","last_unstale":"2023-10-24T00:45:28.230332+0000","last_undegraded":"2023-10-24T00:45:28.230332+0000","last_fullsized":"2023-10-24T00:45:28.230332+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.249895+0000","last_change":"2023-10-24T00:45:28.243596+0000","last_active":"2023-10-24T00:45:28.249895+0000","last_peered":"2023-10-24T00:45:28.249895+0000","last_clean":"2023-10-24T00:45:28.249895+0000","last_became_active":"2023-10-24T00:45:28.243161+0000","last_became_peered":"2023-10-24T00:45:28.243161+0000","last_unstale":"2023-10-24T00:45:28.249895+0000","last_undegraded":"2023-10-24T00:45:28.249895+0000","last_fullsized":"2023-10-24T00:45:28.249895+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.238927+0000","last_change":"2023-10-24T00:45:27.876405+0000","last_active":"2023-10-24T00:45:28.238927+0000","last_peered":"2023-10-24T00:45:28.238927+0000","last_clean":"2023-10-24T00:45:28.238927+0000","last_became_active":"2023-10-24T00:45:27.876110+0000","last_became_peered":"2023-10-24T00:45:27.876110+0000","last_unstale":"2023-10-24T00:45:28.238927+0000","last_undegraded":"2023-10-24T00:45:28.238927+0000","last_fullsized":"2023-10-24T00:45:28.238927+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252607+0000","last_change":"2023-10-24T00:45:28.248854+0000","last_active":"2023-10-24T00:45:28.252607+0000","last_peered":"2023-10-24T00:45:28.252607+0000","last_clean":"2023-10-24T00:45:28.252607+0000","last_became_active":"2023-10-24T00:45:28.248565+0000","last_became_peered":"2023-10-24T00:45:28.248565+0000","last_unstale":"2023-10-24T00:45:28.252607+0000","last_undegraded":"2023-10-24T00:45:28.252607+0000","last_fullsized":"2023-10-24T00:45:28.252607+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251898+0000","last_change":"2023-10-24T00:45:27.886446+0000","last_active":"2023-10-24T00:45:28.251898+0000","last_peered":"2023-10-24T00:45:28.251898+0000","last_clean":"2023-10-24T00:45:28.251898+0000","last_became_active":"2023-10-24T00:45:27.886109+0000","last_became_peered":"2023-10-24T00:45:27.886109+0000","last_unstale":"2023-10-24T00:45:28.251898+0000","last_undegraded":"2023-10-24T00:45:28.251898+0000","last_fullsized":"2023-10-24T00:45:28.251898+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254112+0000","last_change":"2023-10-24T00:45:28.249262+0000","last_active":"2023-10-24T00:45:28.254112+0000","last_peered":"2023-10-24T00:45:28.254112+0000","last_clean":"2023-10-24T00:45:28.254112+0000","last_became_active":"2023-10-24T00:45:28.248791+0000","last_became_peered":"2023-10-24T00:45:28.248791+0000","last_unstale":"2023-10-24T00:45:28.254112+0000","last_undegraded":"2023-10-24T00:45:28.254112+0000","last_fullsized":"2023-10-24T00:45:28.254112+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.240909+0000","last_change":"2023-10-24T00:45:27.876419+0000","last_active":"2023-10-24T00:45:28.240909+0000","last_peered":"2023-10-24T00:45:28.240909+0000","last_clean":"2023-10-24T00:45:28.240909+0000","last_became_active":"2023-10-24T00:45:27.876156+0000","last_became_peered":"2023-10-24T00:45:27.876156+0000","last_unstale":"2023-10-24T00:45:28.240909+0000","last_undegraded":"2023-10-24T00:45:28.240909+0000","last_fullsized":"2023-10-24T00:45:28.240909+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.249672+0000","last_change":"2023-10-24T00:45:28.240350+0000","last_active":"2023-10-24T00:45:28.249672+0000","last_peered":"2023-10-24T00:45:28.249672+0000","last_clean":"2023-10-24T00:45:28.249672+0000","last_became_active":"2023-10-24T00:45:28.240061+0000","last_became_peered":"2023-10-24T00:45:28.240061+0000","last_unstale":"2023-10-24T00:45:28.249672+0000","last_undegraded":"2023-10-24T00:45:28.249672+0000","last_fullsized":"2023-10-24T00:45:28.249672+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251211+0000","last_change":"2023-10-24T00:45:27.881592+0000","last_active":"2023-10-24T00:45:28.251211+0000","last_peered":"2023-10-24T00:45:28.251211+0000","last_clean":"2023-10-24T00:45:28.251211+0000","last_became_active":"2023-10-24T00:45:27.881299+0000","last_became_peered":"2023-10-24T00:45:27.881299+0000","last_unstale":"2023-10-24T00:45:28.251211+0000","last_undegraded":"2023-10-24T00:45:28.251211+0000","last_fullsized":"2023-10-24T00:45:28.251211+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254385+0000","last_change":"2023-10-24T00:45:28.252562+0000","last_active":"2023-10-24T00:45:28.254385+0000","last_peered":"2023-10-24T00:45:28.254385+0000","last_clean":"2023-10-24T00:45:28.254385+0000","last_became_active":"2023-10-24T00:45:28.250787+0000","last_became_peered":"2023-10-24T00:45:28.250787+0000","last_unstale":"2023-10-24T00:45:28.254385+0000","last_undegraded":"2023-10-24T00:45:28.254385+0000","last_fullsized":"2023-10-24T00:45:28.254385+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.241155+0000","last_change":"2023-10-24T00:45:27.879009+0000","last_active":"2023-10-24T00:45:28.241155+0000","last_peered":"2023-10-24T00:45:28.241155+0000","last_clean":"2023-10-24T00:45:28.241155+0000","last_became_active":"2023-10-24T00:45:27.878701+0000","last_became_peered":"2023-10-24T00:45:27.878701+0000","last_unstale":"2023-10-24T00:45:28.241155+0000","last_undegraded":"2023-10-24T00:45:28.241155+0000","last_fullsized":"2023-10-24T00:45:28.241155+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255347+0000","last_change":"2023-10-24T00:45:28.251150+0000","last_active":"2023-10-24T00:45:28.255347+0000","last_peered":"2023-10-24T00:45:28.255347+0000","last_clean":"2023-10-24T00:45:28.255347+0000","last_became_active":"2023-10-24T00:45:28.250490+0000","last_became_peered":"2023-10-24T00:45:28.250490+0000","last_unstale":"2023-10-24T00:45:28.255347+0000","last_undegraded":"2023-10-24T00:45:28.255347+0000","last_fullsized":"2023-10-24T00:45:28.255347+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231958+0000","last_change":"2023-10-24T00:45:27.881610+0000","last_active":"2023-10-24T00:45:28.231958+0000","last_peered":"2023-10-24T00:45:28.231958+0000","last_clean":"2023-10-24T00:45:28.231958+0000","last_became_active":"2023-10-24T00:45:27.881295+0000","last_became_peered":"2023-10-24T00:45:27.881295+0000","last_unstale":"2023-10-24T00:45:28.231958+0000","last_undegraded":"2023-10-24T00:45:28.231958+0000","last_fullsized":"2023-10-24T00:45:28.231958+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252630+0000","last_change":"2023-10-24T00:45:28.248888+0000","last_active":"2023-10-24T00:45:28.252630+0000","last_peered":"2023-10-24T00:45:28.252630+0000","last_clean":"2023-10-24T00:45:28.252630+0000","last_became_active":"2023-10-24T00:45:28.248592+0000","last_became_peered":"2023-10-24T00:45:28.248592+0000","last_unstale":"2023-10-24T00:45:28.252630+0000","last_undegraded":"2023-10-24T00:45:28.252630+0000","last_fullsized":"2023-10-24T00:45:28.252630+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.237356+0000","last_change":"2023-10-24T00:45:27.872238+0000","last_active":"2023-10-24T00:45:28.237356+0000","last_peered":"2023-10-24T00:45:28.237356+0000","last_clean":"2023-10-24T00:45:28.237356+0000","last_became_active":"2023-10-24T00:45:27.871978+0000","last_became_peered":"2023-10-24T00:45:27.871978+0000","last_unstale":"2023-10-24T00:45:28.237356+0000","last_undegraded":"2023-10-24T00:45:28.237356+0000","last_fullsized":"2023-10-24T00:45:28.237356+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252538+0000","last_change":"2023-10-24T00:45:28.247002+0000","last_active":"2023-10-24T00:45:28.252538+0000","last_peered":"2023-10-24T00:45:28.252538+0000","last_clean":"2023-10-24T00:45:28.252538+0000","last_became_active":"2023-10-24T00:45:28.246748+0000","last_became_peered":"2023-10-24T00:45:28.246748+0000","last_unstale":"2023-10-24T00:45:28.252538+0000","last_undegraded":"2023-10-24T00:45:28.252538+0000","last_fullsized":"2023-10-24T00:45:28.252538+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.233585+0000","last_change":"2023-10-24T00:45:27.873528+0000","last_active":"2023-10-24T00:45:28.233585+0000","last_peered":"2023-10-24T00:45:28.233585+0000","last_clean":"2023-10-24T00:45:28.233585+0000","last_became_active":"2023-10-24T00:45:27.873168+0000","last_became_peered":"2023-10-24T00:45:27.873168+0000","last_unstale":"2023-10-24T00:45:28.233585+0000","last_undegraded":"2023-10-24T00:45:28.233585+0000","last_fullsized":"2023-10-24T00:45:28.233585+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255087+0000","last_change":"2023-10-24T00:45:28.249680+0000","last_active":"2023-10-24T00:45:28.255087+0000","last_peered":"2023-10-24T00:45:28.255087+0000","last_clean":"2023-10-24T00:45:28.255087+0000","last_became_active":"2023-10-24T00:45:28.249402+0000","last_became_peered":"2023-10-24T00:45:28.249402+0000","last_unstale":"2023-10-24T00:45:28.255087+0000","last_undegraded":"2023-10-24T00:45:28.255087+0000","last_fullsized":"2023-10-24T00:45:28.255087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.229500+0000","last_change":"2023-10-24T00:45:27.885991+0000","last_active":"2023-10-24T00:45:28.229500+0000","last_peered":"2023-10-24T00:45:28.229500+0000","last_clean":"2023-10-24T00:45:28.229500+0000","last_became_active":"2023-10-24T00:45:27.885659+0000","last_became_peered":"2023-10-24T00:45:27.885659+0000","last_unstale":"2023-10-24T00:45:28.229500+0000","last_undegraded":"2023-10-24T00:45:28.229500+0000","last_fullsized":"2023-10-24T00:45:28.229500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250283+0000","last_change":"2023-10-24T00:45:28.244231+0000","last_active":"2023-10-24T00:45:28.250283+0000","last_peered":"2023-10-24T00:45:28.250283+0000","last_clean":"2023-10-24T00:45:28.250283+0000","last_became_active":"2023-10-24T00:45:28.243979+0000","last_became_peered":"2023-10-24T00:45:28.243979+0000","last_unstale":"2023-10-24T00:45:28.250283+0000","last_undegraded":"2023-10-24T00:45:28.250283+0000","last_fullsized":"2023-10-24T00:45:28.250283+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.236390+0000","last_change":"2023-10-24T00:45:27.881884+0000","last_active":"2023-10-24T00:45:28.236390+0000","last_peered":"2023-10-24T00:45:28.236390+0000","last_clean":"2023-10-24T00:45:28.236390+0000","last_became_active":"2023-10-24T00:45:27.881658+0000","last_became_peered":"2023-10-24T00:45:27.881658+0000","last_unstale":"2023-10-24T00:45:28.236390+0000","last_undegraded":"2023-10-24T00:45:28.236390+0000","last_fullsized":"2023-10-24T00:45:28.236390+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.240554+0000","last_change":"2023-10-24T00:45:28.237054+0000","last_active":"2023-10-24T00:45:28.240554+0000","last_peered":"2023-10-24T00:45:28.240554+0000","last_clean":"2023-10-24T00:45:28.240554+0000","last_became_active":"2023-10-24T00:45:28.236776+0000","last_became_peered":"2023-10-24T00:45:28.236776+0000","last_unstale":"2023-10-24T00:45:28.240554+0000","last_undegraded":"2023-10-24T00:45:28.240554+0000","last_fullsized":"2023-10-24T00:45:28.240554+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.234176+0000","last_change":"2023-10-24T00:45:27.876950+0000","last_active":"2023-10-24T00:45:28.234176+0000","last_peered":"2023-10-24T00:45:28.234176+0000","last_clean":"2023-10-24T00:45:28.234176+0000","last_became_active":"2023-10-24T00:45:27.876689+0000","last_became_peered":"2023-10-24T00:45:27.876689+0000","last_unstale":"2023-10-24T00:45:28.234176+0000","last_undegraded":"2023-10-24T00:45:28.234176+0000","last_fullsized":"2023-10-24T00:45:28.234176+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252488+0000","last_change":"2023-10-24T00:45:28.249560+0000","last_active":"2023-10-24T00:45:28.252488+0000","last_peered":"2023-10-24T00:45:28.252488+0000","last_clean":"2023-10-24T00:45:28.252488+0000","last_became_active":"2023-10-24T00:45:28.249278+0000","last_became_peered":"2023-10-24T00:45:28.249278+0000","last_unstale":"2023-10-24T00:45:28.252488+0000","last_undegraded":"2023-10-24T00:45:28.252488+0000","last_fullsized":"2023-10-24T00:45:28.252488+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253567+0000","last_change":"2023-10-24T00:45:27.884528+0000","last_active":"2023-10-24T00:45:28.253567+0000","last_peered":"2023-10-24T00:45:28.253567+0000","last_clean":"2023-10-24T00:45:28.253567+0000","last_became_active":"2023-10-24T00:45:27.884275+0000","last_became_peered":"2023-10-24T00:45:27.884275+0000","last_unstale":"2023-10-24T00:45:28.253567+0000","last_undegraded":"2023-10-24T00:45:28.253567+0000","last_fullsized":"2023-10-24T00:45:28.253567+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255271+0000","last_change":"2023-10-24T00:45:28.250976+0000","last_active":"2023-10-24T00:45:28.255271+0000","last_peered":"2023-10-24T00:45:28.255271+0000","last_clean":"2023-10-24T00:45:28.255271+0000","last_became_active":"2023-10-24T00:45:28.250750+0000","last_became_peered":"2023-10-24T00:45:28.250750+0000","last_unstale":"2023-10-24T00:45:28.255271+0000","last_undegraded":"2023-10-24T00:45:28.255271+0000","last_fullsized":"2023-10-24T00:45:28.255271+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253646+0000","last_change":"2023-10-24T00:45:27.882858+0000","last_active":"2023-10-24T00:45:28.253646+0000","last_peered":"2023-10-24T00:45:28.253646+0000","last_clean":"2023-10-24T00:45:28.253646+0000","last_became_active":"2023-10-24T00:45:27.882489+0000","last_became_peered":"2023-10-24T00:45:27.882489+0000","last_unstale":"2023-10-24T00:45:28.253646+0000","last_undegraded":"2023-10-24T00:45:28.253646+0000","last_fullsized":"2023-10-24T00:45:28.253646+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.255366+0000","last_change":"2023-10-24T00:45:28.251313+0000","last_active":"2023-10-24T00:45:28.255366+0000","last_peered":"2023-10-24T00:45:28.255366+0000","last_clean":"2023-10-24T00:45:28.255366+0000","last_became_active":"2023-10-24T00:45:28.250828+0000","last_became_peered":"2023-10-24T00:45:28.250828+0000","last_unstale":"2023-10-24T00:45:28.255366+0000","last_undegraded":"2023-10-24T00:45:28.255366+0000","last_fullsized":"2023-10-24T00:45:28.255366+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254186+0000","last_change":"2023-10-24T00:45:27.885895+0000","last_active":"2023-10-24T00:45:28.254186+0000","last_peered":"2023-10-24T00:45:28.254186+0000","last_clean":"2023-10-24T00:45:28.254186+0000","last_became_active":"2023-10-24T00:45:27.885597+0000","last_became_peered":"2023-10-24T00:45:27.885597+0000","last_unstale":"2023-10-24T00:45:28.254186+0000","last_undegraded":"2023-10-24T00:45:28.254186+0000","last_fullsized":"2023-10-24T00:45:28.254186+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251778+0000","last_change":"2023-10-24T00:45:28.245974+0000","last_active":"2023-10-24T00:45:28.251778+0000","last_peered":"2023-10-24T00:45:28.251778+0000","last_clean":"2023-10-24T00:45:28.251778+0000","last_became_active":"2023-10-24T00:45:28.245662+0000","last_became_peered":"2023-10-24T00:45:28.245662+0000","last_unstale":"2023-10-24T00:45:28.251778+0000","last_undegraded":"2023-10-24T00:45:28.251778+0000","last_fullsized":"2023-10-24T00:45:28.251778+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.243726+0000","last_change":"2023-10-24T00:45:27.877167+0000","last_active":"2023-10-24T00:45:28.243726+0000","last_peered":"2023-10-24T00:45:28.243726+0000","last_clean":"2023-10-24T00:45:28.243726+0000","last_became_active":"2023-10-24T00:45:27.876623+0000","last_became_peered":"2023-10-24T00:45:27.876623+0000","last_unstale":"2023-10-24T00:45:28.243726+0000","last_undegraded":"2023-10-24T00:45:28.243726+0000","last_fullsized":"2023-10-24T00:45:28.243726+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.246276+0000","last_change":"2023-10-24T00:45:28.246276+0000","last_active":"2023-10-24T00:45:28.246276+0000","last_peered":"2023-10-24T00:45:28.246276+0000","last_clean":"2023-10-24T00:45:28.246276+0000","last_became_active":"2023-10-24T00:45:28.245780+0000","last_became_peered":"2023-10-24T00:45:28.245780+0000","last_unstale":"2023-10-24T00:45:28.246276+0000","last_undegraded":"2023-10-24T00:45:28.246276+0000","last_fullsized":"2023-10-24T00:45:28.246276+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.233646+0000","last_change":"2023-10-24T00:45:27.882167+0000","last_active":"2023-10-24T00:45:28.233646+0000","last_peered":"2023-10-24T00:45:28.233646+0000","last_clean":"2023-10-24T00:45:28.233646+0000","last_became_active":"2023-10-24T00:45:27.881877+0000","last_became_peered":"2023-10-24T00:45:27.881877+0000","last_unstale":"2023-10-24T00:45:28.233646+0000","last_undegraded":"2023-10-24T00:45:28.233646+0000","last_fullsized":"2023-10-24T00:45:28.233646+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.242659+0000","last_change":"2023-10-24T00:45:28.242659+0000","last_active":"2023-10-24T00:45:28.242659+0000","last_peered":"2023-10-24T00:45:28.242659+0000","last_clean":"2023-10-24T00:45:28.242659+0000","last_became_active":"2023-10-24T00:45:28.242285+0000","last_became_peered":"2023-10-24T00:45:28.242285+0000","last_unstale":"2023-10-24T00:45:28.242659+0000","last_undegraded":"2023-10-24T00:45:28.242659+0000","last_fullsized":"2023-10-24T00:45:28.242659+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"110'4","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253320+0000","last_change":"2023-10-24T00:45:27.882131+0000","last_active":"2023-10-24T00:45:28.253320+0000","last_peered":"2023-10-24T00:45:28.253320+0000","last_clean":"2023-10-24T00:45:28.253320+0000","last_became_active":"2023-10-24T00:45:27.881846+0000","last_became_peered":"2023-10-24T00:45:27.881846+0000","last_unstale":"2023-10-24T00:45:28.253320+0000","last_undegraded":"2023-10-24T00:45:28.253320+0000","last_fullsized":"2023-10-24T00:45:28.253320+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252636+0000","last_change":"2023-10-24T00:45:28.250059+0000","last_active":"2023-10-24T00:45:28.252636+0000","last_peered":"2023-10-24T00:45:28.252636+0000","last_clean":"2023-10-24T00:45:28.252636+0000","last_became_active":"2023-10-24T00:45:28.249812+0000","last_became_peered":"2023-10-24T00:45:28.249812+0000","last_unstale":"2023-10-24T00:45:28.252636+0000","last_undegraded":"2023-10-24T00:45:28.252636+0000","last_fullsized":"2023-10-24T00:45:28.252636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250554+0000","last_change":"2023-10-24T00:45:27.874766+0000","last_active":"2023-10-24T00:45:28.250554+0000","last_peered":"2023-10-24T00:45:28.250554+0000","last_clean":"2023-10-24T00:45:28.250554+0000","last_became_active":"2023-10-24T00:45:27.874419+0000","last_became_peered":"2023-10-24T00:45:27.874419+0000","last_unstale":"2023-10-24T00:45:28.250554+0000","last_undegraded":"2023-10-24T00:45:28.250554+0000","last_fullsized":"2023-10-24T00:45:28.250554+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254101+0000","last_change":"2023-10-24T00:45:28.249100+0000","last_active":"2023-10-24T00:45:28.254101+0000","last_peered":"2023-10-24T00:45:28.254101+0000","last_clean":"2023-10-24T00:45:28.254101+0000","last_became_active":"2023-10-24T00:45:28.248510+0000","last_became_peered":"2023-10-24T00:45:28.248510+0000","last_unstale":"2023-10-24T00:45:28.254101+0000","last_undegraded":"2023-10-24T00:45:28.254101+0000","last_fullsized":"2023-10-24T00:45:28.254101+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231804+0000","last_change":"2023-10-24T00:45:27.874746+0000","last_active":"2023-10-24T00:45:28.231804+0000","last_peered":"2023-10-24T00:45:28.231804+0000","last_clean":"2023-10-24T00:45:28.231804+0000","last_became_active":"2023-10-24T00:45:27.874486+0000","last_became_peered":"2023-10-24T00:45:27.874486+0000","last_unstale":"2023-10-24T00:45:28.231804+0000","last_undegraded":"2023-10-24T00:45:28.231804+0000","last_fullsized":"2023-10-24T00:45:28.231804+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252470+0000","last_change":"2023-10-24T00:45:28.246505+0000","last_active":"2023-10-24T00:45:28.252470+0000","last_peered":"2023-10-24T00:45:28.252470+0000","last_clean":"2023-10-24T00:45:28.252470+0000","last_became_active":"2023-10-24T00:45:28.246185+0000","last_became_peered":"2023-10-24T00:45:28.246185+0000","last_unstale":"2023-10-24T00:45:28.252470+0000","last_undegraded":"2023-10-24T00:45:28.252470+0000","last_fullsized":"2023-10-24T00:45:28.252470+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.231350+0000","last_change":"2023-10-24T00:45:27.885900+0000","last_active":"2023-10-24T00:45:28.231350+0000","last_peered":"2023-10-24T00:45:28.231350+0000","last_clean":"2023-10-24T00:45:28.231350+0000","last_became_active":"2023-10-24T00:45:27.885587+0000","last_became_peered":"2023-10-24T00:45:27.885587+0000","last_unstale":"2023-10-24T00:45:28.231350+0000","last_undegraded":"2023-10-24T00:45:28.231350+0000","last_fullsized":"2023-10-24T00:45:28.231350+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250208+0000","last_change":"2023-10-24T00:45:28.244083+0000","last_active":"2023-10-24T00:45:28.250208+0000","last_peered":"2023-10-24T00:45:28.250208+0000","last_clean":"2023-10-24T00:45:28.250208+0000","last_became_active":"2023-10-24T00:45:28.243427+0000","last_became_peered":"2023-10-24T00:45:28.243427+0000","last_unstale":"2023-10-24T00:45:28.250208+0000","last_undegraded":"2023-10-24T00:45:28.250208+0000","last_fullsized":"2023-10-24T00:45:28.250208+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.241063+0000","last_change":"2023-10-24T00:45:27.872407+0000","last_active":"2023-10-24T00:45:28.241063+0000","last_peered":"2023-10-24T00:45:28.241063+0000","last_clean":"2023-10-24T00:45:28.241063+0000","last_became_active":"2023-10-24T00:45:27.872068+0000","last_became_peered":"2023-10-24T00:45:27.872068+0000","last_unstale":"2023-10-24T00:45:28.241063+0000","last_undegraded":"2023-10-24T00:45:28.241063+0000","last_fullsized":"2023-10-24T00:45:28.241063+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254014+0000","last_change":"2023-10-24T00:45:28.254014+0000","last_active":"2023-10-24T00:45:28.254014+0000","last_peered":"2023-10-24T00:45:28.254014+0000","last_clean":"2023-10-24T00:45:28.254014+0000","last_became_active":"2023-10-24T00:45:28.253705+0000","last_became_peered":"2023-10-24T00:45:28.253705+0000","last_unstale":"2023-10-24T00:45:28.254014+0000","last_undegraded":"2023-10-24T00:45:28.254014+0000","last_fullsized":"2023-10-24T00:45:28.254014+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.240925+0000","last_change":"2023-10-24T00:45:27.882390+0000","last_active":"2023-10-24T00:45:28.240925+0000","last_peered":"2023-10-24T00:45:28.240925+0000","last_clean":"2023-10-24T00:45:28.240925+0000","last_became_active":"2023-10-24T00:45:27.882040+0000","last_became_peered":"2023-10-24T00:45:27.882040+0000","last_unstale":"2023-10-24T00:45:28.240925+0000","last_undegraded":"2023-10-24T00:45:28.240925+0000","last_fullsized":"2023-10-24T00:45:28.240925+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.256679+0000","last_change":"2023-10-24T00:45:28.254932+0000","last_active":"2023-10-24T00:45:28.256679+0000","last_peered":"2023-10-24T00:45:28.256679+0000","last_clean":"2023-10-24T00:45:28.256679+0000","last_became_active":"2023-10-24T00:45:28.254674+0000","last_became_peered":"2023-10-24T00:45:28.254674+0000","last_unstale":"2023-10-24T00:45:28.256679+0000","last_undegraded":"2023-10-24T00:45:28.256679+0000","last_fullsized":"2023-10-24T00:45:28.256679+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.235624+0000","last_change":"2023-10-24T00:45:27.871151+0000","last_active":"2023-10-24T00:45:28.235624+0000","last_peered":"2023-10-24T00:45:28.235624+0000","last_clean":"2023-10-24T00:45:28.235624+0000","last_became_active":"2023-10-24T00:45:27.870635+0000","last_became_peered":"2023-10-24T00:45:27.870635+0000","last_unstale":"2023-10-24T00:45:28.235624+0000","last_undegraded":"2023-10-24T00:45:28.235624+0000","last_fullsized":"2023-10-24T00:45:28.235624+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.256722+0000","last_change":"2023-10-24T00:45:28.255005+0000","last_active":"2023-10-24T00:45:28.256722+0000","last_peered":"2023-10-24T00:45:28.256722+0000","last_clean":"2023-10-24T00:45:28.256722+0000","last_became_active":"2023-10-24T00:45:28.254771+0000","last_became_peered":"2023-10-24T00:45:28.254771+0000","last_unstale":"2023-10-24T00:45:28.256722+0000","last_undegraded":"2023-10-24T00:45:28.256722+0000","last_fullsized":"2023-10-24T00:45:28.256722+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.239419+0000","last_change":"2023-10-24T00:45:27.868722+0000","last_active":"2023-10-24T00:45:28.239419+0000","last_peered":"2023-10-24T00:45:28.239419+0000","last_clean":"2023-10-24T00:45:28.239419+0000","last_became_active":"2023-10-24T00:45:27.868376+0000","last_became_peered":"2023-10-24T00:45:27.868376+0000","last_unstale":"2023-10-24T00:45:28.239419+0000","last_undegraded":"2023-10-24T00:45:28.239419+0000","last_fullsized":"2023-10-24T00:45:28.239419+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253900+0000","last_change":"2023-10-24T00:45:28.247613+0000","last_active":"2023-10-24T00:45:28.253900+0000","last_peered":"2023-10-24T00:45:28.253900+0000","last_clean":"2023-10-24T00:45:28.253900+0000","last_became_active":"2023-10-24T00:45:28.247231+0000","last_became_peered":"2023-10-24T00:45:28.247231+0000","last_unstale":"2023-10-24T00:45:28.253900+0000","last_undegraded":"2023-10-24T00:45:28.253900+0000","last_fullsized":"2023-10-24T00:45:28.253900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.229631+0000","last_change":"2023-10-24T00:45:27.878810+0000","last_active":"2023-10-24T00:45:28.229631+0000","last_peered":"2023-10-24T00:45:28.229631+0000","last_clean":"2023-10-24T00:45:28.229631+0000","last_became_active":"2023-10-24T00:45:27.878459+0000","last_became_peered":"2023-10-24T00:45:27.878459+0000","last_unstale":"2023-10-24T00:45:28.229631+0000","last_undegraded":"2023-10-24T00:45:28.229631+0000","last_fullsized":"2023-10-24T00:45:28.229631+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.257226+0000","last_change":"2023-10-24T00:45:28.256345+0000","last_active":"2023-10-24T00:45:28.257226+0000","last_peered":"2023-10-24T00:45:28.257226+0000","last_clean":"2023-10-24T00:45:28.257226+0000","last_became_active":"2023-10-24T00:45:28.256116+0000","last_became_peered":"2023-10-24T00:45:28.256116+0000","last_unstale":"2023-10-24T00:45:28.257226+0000","last_undegraded":"2023-10-24T00:45:28.257226+0000","last_fullsized":"2023-10-24T00:45:28.257226+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.248317+0000","last_change":"2023-10-24T00:45:27.873201+0000","last_active":"2023-10-24T00:45:28.248317+0000","last_peered":"2023-10-24T00:45:28.248317+0000","last_clean":"2023-10-24T00:45:28.248317+0000","last_became_active":"2023-10-24T00:45:27.872892+0000","last_became_peered":"2023-10-24T00:45:27.872892+0000","last_unstale":"2023-10-24T00:45:28.248317+0000","last_undegraded":"2023-10-24T00:45:28.248317+0000","last_fullsized":"2023-10-24T00:45:28.248317+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.235837+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:45:28.235837+0000","last_peered":"2023-10-24T00:45:28.235837+0000","last_clean":"2023-10-24T00:45:28.235837+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:45:28.235837+0000","last_undegraded":"2023-10-24T00:45:28.235837+0000","last_fullsized":"2023-10-24T00:45:28.235837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250047+0000","last_change":"2023-10-24T00:45:28.243029+0000","last_active":"2023-10-24T00:45:28.250047+0000","last_peered":"2023-10-24T00:45:28.250047+0000","last_clean":"2023-10-24T00:45:28.250047+0000","last_became_active":"2023-10-24T00:45:28.242751+0000","last_became_peered":"2023-10-24T00:45:28.242751+0000","last_unstale":"2023-10-24T00:45:28.250047+0000","last_undegraded":"2023-10-24T00:45:28.250047+0000","last_fullsized":"2023-10-24T00:45:28.250047+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.230956+0000","last_change":"2023-10-24T00:45:27.878312+0000","last_active":"2023-10-24T00:45:28.230956+0000","last_peered":"2023-10-24T00:45:28.230956+0000","last_clean":"2023-10-24T00:45:28.230956+0000","last_became_active":"2023-10-24T00:45:27.878026+0000","last_became_peered":"2023-10-24T00:45:27.878026+0000","last_unstale":"2023-10-24T00:45:28.230956+0000","last_undegraded":"2023-10-24T00:45:28.230956+0000","last_fullsized":"2023-10-24T00:45:28.230956+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.235695+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:45:28.235695+0000","last_peered":"2023-10-24T00:45:28.235695+0000","last_clean":"2023-10-24T00:45:28.235695+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:45:28.235695+0000","last_undegraded":"2023-10-24T00:45:28.235695+0000","last_fullsized":"2023-10-24T00:45:28.235695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253418+0000","last_change":"2023-10-24T00:45:28.251259+0000","last_active":"2023-10-24T00:45:28.253418+0000","last_peered":"2023-10-24T00:45:28.253418+0000","last_clean":"2023-10-24T00:45:28.253418+0000","last_became_active":"2023-10-24T00:45:28.250924+0000","last_became_peered":"2023-10-24T00:45:28.250924+0000","last_unstale":"2023-10-24T00:45:28.253418+0000","last_undegraded":"2023-10-24T00:45:28.253418+0000","last_fullsized":"2023-10-24T00:45:28.253418+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.250967+0000","last_change":"2023-10-24T00:45:27.875804+0000","last_active":"2023-10-24T00:45:28.250967+0000","last_peered":"2023-10-24T00:45:28.250967+0000","last_clean":"2023-10-24T00:45:28.250967+0000","last_became_active":"2023-10-24T00:45:27.875500+0000","last_became_peered":"2023-10-24T00:45:27.875500+0000","last_unstale":"2023-10-24T00:45:28.250967+0000","last_undegraded":"2023-10-24T00:45:28.250967+0000","last_fullsized":"2023-10-24T00:45:28.250967+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.857761+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:45:27.857761+0000","last_peered":"2023-10-24T00:45:27.857761+0000","last_clean":"2023-10-24T00:45:27.857761+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:45:27.857761+0000","last_undegraded":"2023-10-24T00:45:27.857761+0000","last_fullsized":"2023-10-24T00:45:27.857761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.249868+0000","last_change":"2023-10-24T00:45:28.243954+0000","last_active":"2023-10-24T00:45:28.249868+0000","last_peered":"2023-10-24T00:45:28.249868+0000","last_clean":"2023-10-24T00:45:28.249868+0000","last_became_active":"2023-10-24T00:45:28.243676+0000","last_became_peered":"2023-10-24T00:45:28.243676+0000","last_unstale":"2023-10-24T00:45:28.249868+0000","last_undegraded":"2023-10-24T00:45:28.249868+0000","last_fullsized":"2023-10-24T00:45:28.249868+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.235746+0000","last_change":"2023-10-24T00:45:27.876735+0000","last_active":"2023-10-24T00:45:28.235746+0000","last_peered":"2023-10-24T00:45:28.235746+0000","last_clean":"2023-10-24T00:45:28.235746+0000","last_became_active":"2023-10-24T00:45:27.876453+0000","last_became_peered":"2023-10-24T00:45:27.876453+0000","last_unstale":"2023-10-24T00:45:28.235746+0000","last_undegraded":"2023-10-24T00:45:28.235746+0000","last_fullsized":"2023-10-24T00:45:28.235746+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.234835+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:45:28.234835+0000","last_peered":"2023-10-24T00:45:28.234835+0000","last_clean":"2023-10-24T00:45:28.234835+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:45:28.234835+0000","last_undegraded":"2023-10-24T00:45:28.234835+0000","last_fullsized":"2023-10-24T00:45:28.234835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":104,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.229753+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:45:28.229753+0000","last_peered":"2023-10-24T00:45:28.229753+0000","last_clean":"2023-10-24T00:45:28.229753+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:45:28.229753+0000","last_undegraded":"2023-10-24T00:45:28.229753+0000","last_fullsized":"2023-10-24T00:45:28.229753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.252586+0000","last_change":"2023-10-24T00:45:28.248364+0000","last_active":"2023-10-24T00:45:28.252586+0000","last_peered":"2023-10-24T00:45:28.252586+0000","last_clean":"2023-10-24T00:45:28.252586+0000","last_became_active":"2023-10-24T00:45:28.248118+0000","last_became_peered":"2023-10-24T00:45:28.248118+0000","last_unstale":"2023-10-24T00:45:28.252586+0000","last_undegraded":"2023-10-24T00:45:28.252586+0000","last_fullsized":"2023-10-24T00:45:28.252586+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251941+0000","last_change":"2023-10-24T00:45:27.873494+0000","last_active":"2023-10-24T00:45:28.251941+0000","last_peered":"2023-10-24T00:45:28.251941+0000","last_clean":"2023-10-24T00:45:28.251941+0000","last_became_active":"2023-10-24T00:45:27.873147+0000","last_became_peered":"2023-10-24T00:45:27.873147+0000","last_unstale":"2023-10-24T00:45:28.251941+0000","last_undegraded":"2023-10-24T00:45:28.251941+0000","last_fullsized":"2023-10-24T00:45:28.251941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.229844+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:45:28.229844+0000","last_peered":"2023-10-24T00:45:28.229844+0000","last_clean":"2023-10-24T00:45:28.229844+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:45:28.229844+0000","last_undegraded":"2023-10-24T00:45:28.229844+0000","last_fullsized":"2023-10-24T00:45:28.229844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.251708+0000","last_change":"2023-10-24T00:45:28.249146+0000","last_active":"2023-10-24T00:45:28.251708+0000","last_peered":"2023-10-24T00:45:28.251708+0000","last_clean":"2023-10-24T00:45:28.251708+0000","last_became_active":"2023-10-24T00:45:28.248547+0000","last_became_peered":"2023-10-24T00:45:28.248547+0000","last_unstale":"2023-10-24T00:45:28.251708+0000","last_undegraded":"2023-10-24T00:45:28.251708+0000","last_fullsized":"2023-10-24T00:45:28.251708+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.883907+0000","last_change":"2023-10-24T00:45:27.880095+0000","last_active":"2023-10-24T00:45:27.883907+0000","last_peered":"2023-10-24T00:45:27.883907+0000","last_clean":"2023-10-24T00:45:27.883907+0000","last_became_active":"2023-10-24T00:45:27.879854+0000","last_became_peered":"2023-10-24T00:45:27.879854+0000","last_unstale":"2023-10-24T00:45:27.883907+0000","last_undegraded":"2023-10-24T00:45:27.883907+0000","last_fullsized":"2023-10-24T00:45:27.883907+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.232213+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:45:28.232213+0000","last_peered":"2023-10-24T00:45:28.232213+0000","last_clean":"2023-10-24T00:45:28.232213+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:45:28.232213+0000","last_undegraded":"2023-10-24T00:45:28.232213+0000","last_fullsized":"2023-10-24T00:45:28.232213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.254830+0000","last_change":"2023-10-24T00:45:28.253464+0000","last_active":"2023-10-24T00:45:28.254830+0000","last_peered":"2023-10-24T00:45:28.254830+0000","last_clean":"2023-10-24T00:45:28.254830+0000","last_became_active":"2023-10-24T00:45:28.253161+0000","last_became_peered":"2023-10-24T00:45:28.253161+0000","last_unstale":"2023-10-24T00:45:28.254830+0000","last_undegraded":"2023-10-24T00:45:28.254830+0000","last_fullsized":"2023-10-24T00:45:28.254830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.236785+0000","last_change":"2023-10-24T00:45:27.885733+0000","last_active":"2023-10-24T00:45:28.236785+0000","last_peered":"2023-10-24T00:45:28.236785+0000","last_clean":"2023-10-24T00:45:28.236785+0000","last_became_active":"2023-10-24T00:45:27.885503+0000","last_became_peered":"2023-10-24T00:45:27.885503+0000","last_unstale":"2023-10-24T00:45:28.236785+0000","last_undegraded":"2023-10-24T00:45:28.236785+0000","last_fullsized":"2023-10-24T00:45:28.236785+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.236519+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:45:28.236519+0000","last_peered":"2023-10-24T00:45:28.236519+0000","last_clean":"2023-10-24T00:45:28.236519+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:45:28.236519+0000","last_undegraded":"2023-10-24T00:45:28.236519+0000","last_fullsized":"2023-10-24T00:45:28.236519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.253919+0000","last_change":"2023-10-24T00:45:28.247735+0000","last_active":"2023-10-24T00:45:28.253919+0000","last_peered":"2023-10-24T00:45:28.253919+0000","last_clean":"2023-10-24T00:45:28.253919+0000","last_became_active":"2023-10-24T00:45:28.247415+0000","last_became_peered":"2023-10-24T00:45:28.247415+0000","last_unstale":"2023-10-24T00:45:28.253919+0000","last_undegraded":"2023-10-24T00:45:28.253919+0000","last_fullsized":"2023-10-24T00:45:28.253919+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:27.851231+0000","last_clean_scrub_stamp":"2023-10-24T00:45:27.851231+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-24T00:45:27.886891+0000","last_change":"2023-10-24T00:45:27.881105+0000","last_active":"2023-10-24T00:45:27.886891+0000","last_peered":"2023-10-24T00:45:27.886891+0000","last_clean":"2023-10-24T00:45:27.886891+0000","last_became_active":"2023-10-24T00:45:27.880740+0000","last_became_peered":"2023-10-24T00:45:27.880740+0000","last_unstale":"2023-10-24T00:45:27.886891+0000","last_undegraded":"2023-10-24T00:45:27.886891+0000","last_fullsized":"2023-10-24T00:45:27.886891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:45:26.848077+0000","last_clean_scrub_stamp":"2023-10-24T00:45:26.848077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-24T00:45:28.240487+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:45:28.240487+0000","last_peered":"2023-10-24T00:45:28.240487+0000","last_clean":"2023-10-24T00:45:28.240487+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:45:28.240487+0000","last_undegraded":"2023-10-24T00:45:28.240487+0000","last_fullsized":"2023-10-24T00:45:28.240487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542345,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302528,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069312,"statfs":{"total":96636764160,"available":96326975488,"internally_reserved":0,"allocated":1368064,"data_stored":681454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.22700000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51800000000000002,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.83299999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.38400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.81100000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54300000000000004,"15min":0.55800000000000005},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.75800000000000001,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.38400000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.81399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.32600000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70699999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.51600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.84199999999999997,"5min":4.351,"15min":4.351},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Oct 24 00:45:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.90000000000000002,"5min":1.054,"15min":1.054},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302540,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069300,"statfs":{"total":96636764160,"available":96326963200,"internally_reserved":0,"allocated":1380352,"data_stored":683510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.29799999999999999},"max":{"1min":0.83799999999999997,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.503},{"interface":"front","average":{"1min":0.497,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.40400000000000003,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73199999999999998,"5min":1.573,"15min":1.573},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.59399999999999997,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.81200000000000006,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.37,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.66900000000000004,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":14.597,"15min":14.597},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55700000000000005,"15min":0.504},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.71199999999999997,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.5,"15min":0.495},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80800000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35299999999999998},"max":{"1min":0.82699999999999996,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.42399999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85199999999999998,"5min":0.872,"15min":0.872},"last":0.627},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61099999999999999,"15min":0.56899999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":681398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39000000000000001,"15min":0.38300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.55700000000000005,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.498,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.34200000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41799999999999998,"15min":0.39200000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46400000000000002,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.52500000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30199999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.51100000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":1.143,"15min":1.1859999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59799999999999998,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":1.964},"last":0.48699999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.1040000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.628,"15min":0.61699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78300000000000003,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.45900000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.80300000000000005,"5min":0.88200000000000001,"15min":1.121},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80600000000000005,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79500000000000004,"5min":1.109,"15min":1.5800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.44400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":1.6919999999999999},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302540,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069300,"statfs":{"total":96636764160,"available":96326963200,"internally_reserved":0,"allocated":1380352,"data_stored":682236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45900000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.30499999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.28799999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.375,"15min":0.38600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.628},"last":0.374},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.43099999999999999,"15min":0.45000000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.67100000000000004},"last":0.38500000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.90300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.874,"15min":0.92400000000000004},"last":0.65900000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.61299999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.86699999999999999,"15min":0.95799999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.60499999999999998},"min":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60399999999999998,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.60499999999999998,"15min":0.61699999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.92700000000000005,"15min":0.92800000000000005},"last":0.55600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":674694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34300000000000003,"15min":0.36199999999999999},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.20499999999999999},"max":{"1min":0.434,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.39000000000000001},"min":{"1min":0.255,"5min":0.23599999999999999,"15min":0.22600000000000001},"max":{"1min":0.50600000000000001,"5min":0.61899999999999999,"15min":0.62},"last":0.315}]},{"osd":1,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.248,"5min":0.22,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.63,"15min":0.65500000000000003},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.26200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44800000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.23400000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41399999999999998,"15min":0.436},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57899999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.39600000000000002,"15min":0.41699999999999998},"min":{"1min":0.309,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.501,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.59699999999999998},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60699999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59999999999999998,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80600000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.63900000000000001},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79200000000000004,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 00:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":1.083,"15min":1.083},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.67300000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.91600000000000004,"15min":0.999},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302528,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069312,"statfs":{"total":96636764160,"available":96326975488,"internally_reserved":0,"allocated":1368064,"data_stored":682360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.223},{"interface":"front","average":{"1min":0.373,"5min":0.40300000000000002,"15min":0.41099999999999998},"min":{"1min":0.221,"5min":0.219,"15min":0.219},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.27700000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.375,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68799999999999994,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25600000000000001},"max":{"1min":0.67600000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39800000000000002,"15min":0.40500000000000003},"min":{"1min":0.28999999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51800000000000002,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44400000000000001,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.83199999999999996,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.313}]},{"osd":4,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.024},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.89600000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60099999999999998,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.995},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:45:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72899999999999998,"5min":0.83099999999999996,"15min":1.042},"last":0.77400000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64700000000000002,"15min":0.66100000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.121},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302528,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069312,"statfs":{"total":96636764160,"available":96326975488,"internally_reserved":0,"allocated":1368064,"data_stored":682042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":0.63800000000000001,"5min":0.72499999999999998,"15min":0.76900000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52800000000000002,"15min":0.54200000000000004},"min":{"1min":0.41299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.626,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66800000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.432,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.377,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.52800000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.47299999999999998,"5min":0.39500000000000002,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.65000000000000002,"5min":0.76700000000000002,"15min":0.78100000000000003},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.308},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.749}]},{"osd":6,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.36499999999999999,"5min":0.33200000000000002,"15min":0.32500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.78500000000000003}]},{"osd":7,"last update":"Tue Oct 24 00:45:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.77400000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542345,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":674694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71099999999999997,"5min":0.72099999999999997,"15min":0.77400000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.754},"last":0.58299999999999996}]},{"osd":1,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.54600000000000004,"15min":0.55400000000000005},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":1.1479999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.55400000000000005},"min":{"1min":0.37,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.69899999999999995,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.32800000000000001},"max":{"1min":0.68600000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68200000000000005,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.73599999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.71099999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46100000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":1.339},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":0.73499999999999999,"5min":0.80900000000000005,"15min":1.1120000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.53100000000000003},"min":{"1min":0.39100000000000001,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.76400000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Oct 24 00:45:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.772},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:45:36.091 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:45:36.092 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:45:36.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.243+0000 7fe67eccd700 1 Processor -- start 2023-10-24T00:45:36.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.243+0000 7fe67eccd700 1 -- start start 2023-10-24T00:45:36.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67eccd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6780c4030 0x7fe6780679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67eccd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe67813a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67eccd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780c54e0 con 0x7fe6780c3c50 2023-10-24T00:45:36.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67eccd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe678066bf0 con 0x7fe6780c4030 2023-10-24T00:45:36.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67eccd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe678066ed0 con 0x7fe67813a4d0 2023-10-24T00:45:36.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67d4ca700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6780c4030 0x7fe6780679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67dccb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe6780c3c50 0x7fe6780c4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52608/0 (socket says 172.21.15.148:52608) 2023-10-24T00:45:36.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67d4ca700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6780c4030 0x7fe6780679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54022/0 (socket says 172.21.15.148:54022) 2023-10-24T00:45:36.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67dccb700 1 -- 172.21.15.148:0/1641816202 learned_addr learned my addr 172.21.15.148:0/1641816202 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:36.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.244+0000 7fe67e4cc700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe67813a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67d4ca700 1 -- 172.21.15.148:0/1641816202 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 msgr2=0x7fe67813a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:36.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67d4ca700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe67813a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67d4ca700 1 -- 172.21.15.148:0/1641816202 >> v1:172.21.15.148:6789/0 conn(0x7fe6780c3c50 legacy=0x7fe6780c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67ccc9700 1 -- 172.21.15.148:0/1641816202 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137739707 0 0) 0x7fe674001110 con 0x7fe6780c3c50 2023-10-24T00:45:36.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67d4ca700 1 -- 172.21.15.148:0/1641816202 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780671b0 con 0x7fe6780c4030 2023-10-24T00:45:36.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67d4ca700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780679b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fe668009760 tx=0x7fe668009060).ready entity=mon.0 client_cookie=321c9e6b21594fe server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67ccc9700 1 -- 172.21.15.148:0/1641816202 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680090d0 con 0x7fe6780c4030 2023-10-24T00:45:36.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67ccc9700 1 -- 172.21.15.148:0/1641816202 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800b580 con 0x7fe6780c4030 2023-10-24T00:45:36.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.245+0000 7fe67ccc9700 1 -- 172.21.15.148:0/1641816202 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800b900 con 0x7fe6780c4030 2023-10-24T00:45:36.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 -- 172.21.15.148:0/1641816202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 msgr2=0x7fe6780679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780679b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fe668009760 tx=0x7fe668009060).stop 2023-10-24T00:45:36.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 -- 172.21.15.148:0/1641816202 shutdown_connections 2023-10-24T00:45:36.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe67813a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 --2- 172.21.15.148:0/1641816202 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780679b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 -- 172.21.15.148:0/1641816202 >> 172.21.15.148:0/1641816202 conn(0x7fe6780c86e0 msgr2=0x7fe6780c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:36.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 -- 172.21.15.148:0/1641816202 shutdown_connections 2023-10-24T00:45:36.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.246+0000 7fe67eccd700 1 -- 172.21.15.148:0/1641816202 wait complete. 2023-10-24T00:45:36.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.247+0000 7fe67eccd700 1 Processor -- start 2023-10-24T00:45:36.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.247+0000 7fe67eccd700 1 -- start start 2023-10-24T00:45:36.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6780c3c50 0x7fe6780a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe6780c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c7120 con 0x7fe6780c4030 2023-10-24T00:45:36.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe678151790 con 0x7fe6780c3c50 2023-10-24T00:45:36.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67eccd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe678151a50 con 0x7fe67813a4d0 2023-10-24T00:45:36.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67d4ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67d4ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54034/0 (socket says 172.21.15.148:54034) 2023-10-24T00:45:36.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67d4ca700 1 -- 172.21.15.148:0/3739161030 learned_addr learned my addr 172.21.15.148:0/3739161030 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:36.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67dccb700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6780c3c50 0x7fe6780a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.248+0000 7fe67e4cc700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe6780c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 -- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 msgr2=0x7fe6780c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe6780c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 -- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6780c3c50 msgr2=0x7fe6780a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6780c3c50 0x7fe6780a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 -- 172.21.15.148:0/3739161030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680092a0 con 0x7fe6780c4030 2023-10-24T00:45:36.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67d4ca700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fe668009eb0 tx=0x7fe668017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800b900 con 0x7fe6780c4030 2023-10-24T00:45:36.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668000c90 con 0x7fe6780c4030 2023-10-24T00:45:36.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe678151d30 con 0x7fe6780c4030 2023-10-24T00:45:36.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66801b440 con 0x7fe6780c4030 2023-10-24T00:45:36.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.249+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6780aa2e0 con 0x7fe6780c4030 2023-10-24T00:45:36.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.250+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678152380 con 0x7fe6780c4030 2023-10-24T00:45:36.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.250+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe66801b870 con 0x7fe6780c4030 2023-10-24T00:45:36.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.251+0000 7fe66dffb700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 0x7fe65c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.251+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe66807ba40 con 0x7fe6780c4030 2023-10-24T00:45:36.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.251+0000 7fe67dccb700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 0x7fe65c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.251+0000 7fe67dccb700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 0x7fe65c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe674007fd0 tx=0x7fe674007dd0).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.255+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe66804cb90 con 0x7fe6780c4030 2023-10-24T00:45:36.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.485+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe678047480 con 0x7fe6780c4030 2023-10-24T00:45:36.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.490+0000 7fe66dffb700 1 -- 172.21.15.148:0/3739161030 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe6680501b0 con 0x7fe6780c4030 2023-10-24T00:45:36.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.492+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 msgr2=0x7fe65c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 0x7fe65c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe674007fd0 tx=0x7fe674007dd0).stop 2023-10-24T00:45:36.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 msgr2=0x7fe6780c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fe668009eb0 tx=0x7fe668017000).stop 2023-10-24T00:45:36.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 shutdown_connections 2023-10-24T00:45:36.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe67813a4d0 0x7fe6780c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6780c3c50 0x7fe6780a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe65c05f270 0x7fe65c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 --2- 172.21.15.148:0/3739161030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6780c4030 0x7fe6780c6740 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 >> 172.21.15.148:0/3739161030 conn(0x7fe6780c86e0 msgr2=0x7fe678138af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 shutdown_connections 2023-10-24T00:45:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.493+0000 7fe67eccd700 1 -- 172.21.15.148:0/3739161030 wait complete. 2023-10-24T00:45:36.498 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:45:36.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:45:36.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.618+0000 7f066c8ca700 1 Processor -- start 2023-10-24T00:45:36.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.618+0000 7f066c8ca700 1 -- start start 2023-10-24T00:45:36.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066c8ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f06680c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066c8ca700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06680c6410 con 0x7f06680c68a0 2023-10-24T00:45:36.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066c8ca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06680c1150 con 0x7f06680aa140 2023-10-24T00:45:36.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066c8ca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680ca6e0 con 0x7f06680c07e0 2023-10-24T00:45:36.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066759e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f06680c68a0 0x7f06680c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52614/0 (socket says 172.21.15.148:52614) 2023-10-24T00:45:36.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066759e700 1 -- 172.21.15.148:0/1136521337 learned_addr learned my addr 172.21.15.148:0/1136521337 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f066659c700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f06680c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689903406 0 0) 0x7f06680c6410 con 0x7f06680c68a0 2023-10-24T00:45:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06500033f0 con 0x7f06680c68a0 2023-10-24T00:45:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713010046 0 0) 0x7f06680c1150 con 0x7f06680aa140 2023-10-24T00:45:36.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06680c6410 con 0x7f06680aa140 2023-10-24T00:45:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138959631 0 0) 0x7f06500033f0 con 0x7f06680c68a0 2023-10-24T00:45:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 msgr2=0x7f06680c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f06680c0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 >> v1:172.21.15.150:6789/0 conn(0x7f06680aa140 legacy=0x7f06680c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680ca9c0 con 0x7f06680c68a0 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f06600017f0 con 0x7f06680c68a0 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 >> v1:172.21.15.148:6789/0 conn(0x7f06680c68a0 legacy=0x7f06680c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0650003aa0 0x7f0650003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0650004690 0x7f0650004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.619+0000 7f0665d9b700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f0650005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680ca6e0 con 0x7f0650004690 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065000b930 con 0x7f0650003aa0 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065000baf0 con 0x7f06680c07e0 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0650004690 0x7f0650004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0666d9d700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0650003aa0 0x7f0650003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066759e700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f0650005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 -- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 msgr2=0x7f0650005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f06680c07e0 0x7f0650005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 -- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0650003aa0 msgr2=0x7f0650003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0650003aa0 0x7f0650003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 -- 172.21.15.148:0/1136521337 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500033f0 con 0x7f0650004690 2023-10-24T00:45:36.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f066659c700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0650004690 0x7f0650004b10 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f065c009a80 tx=0x7f065c009060).ready entity=mon.0 client_cookie=bd45fee707aeb31c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c009430 con 0x7f0650004690 2023-10-24T00:45:36.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c00e640 con 0x7f0650004690 2023-10-24T00:45:36.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.620+0000 7f0665d9b700 1 -- 172.21.15.148:0/1136521337 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c00e9c0 con 0x7f0650004690 2023-10-24T00:45:36.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 -- 172.21.15.148:0/1136521337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0650004690 msgr2=0x7f0650004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 --2- 172.21.15.148:0/1136521337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0650004690 0x7f0650004b10 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f065c009a80 tx=0x7f065c009060).stop 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066759e700 1 -- 172.21.15.148:0/1136521337 reap_dead start 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 -- 172.21.15.148:0/1136521337 shutdown_connections 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 -- 172.21.15.148:0/1136521337 >> 172.21.15.148:0/1136521337 conn(0x7f06680944a0 msgr2=0x7f066806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 -- 172.21.15.148:0/1136521337 shutdown_connections 2023-10-24T00:45:36.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.621+0000 7f066c8ca700 1 -- 172.21.15.148:0/1136521337 wait complete. 2023-10-24T00:45:36.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.622+0000 7f066c8ca700 1 Processor -- start 2023-10-24T00:45:36.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.622+0000 7f066c8ca700 1 -- start start 2023-10-24T00:45:36.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0650004690 0x7f06680abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0668098410 0x7f0668151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668168630 con 0x7f0668151f50 2023-10-24T00:45:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681541e0 con 0x7f0668098410 2023-10-24T00:45:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668098920 con 0x7f0650004690 2023-10-24T00:45:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54046/0 (socket says 172.21.15.148:54046) 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 -- 172.21.15.148:0/242741617 learned_addr learned my addr 172.21.15.148:0/242741617 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f0666d9d700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0650004690 0x7f06680abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066659c700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0668098410 0x7f0668151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 -- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0650004690 msgr2=0x7f06680abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0650004690 0x7f06680abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 -- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0668098410 msgr2=0x7f0668151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0668098410 0x7f0668151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 -- 172.21.15.148:0/242741617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0668167d00 con 0x7f0668151f50 2023-10-24T00:45:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066759e700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f0660000f80 tx=0x7f0660007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000f9d0 con 0x7f0668151f50 2023-10-24T00:45:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000fb30 con 0x7f0668151f50 2023-10-24T00:45:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668167fe0 con 0x7f0668151f50 2023-10-24T00:45:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000feb0 con 0x7f0668151f50 2023-10-24T00:45:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.623+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06680ac470 con 0x7f0668151f50 2023-10-24T00:45:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.624+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06681687a0 con 0x7f0668151f50 2023-10-24T00:45:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.625+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0660012560 con 0x7f0668151f50 2023-10-24T00:45:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.625+0000 7f064effd700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 0x7f0654061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.625+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f066007a0e0 con 0x7f0668151f50 2023-10-24T00:45:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.625+0000 7f0666d9d700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 0x7f0654061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.626+0000 7f0666d9d700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 0x7f0654061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0658000f60 tx=0x7f0658009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.629+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f066004aaf0 con 0x7f0668151f50 2023-10-24T00:45:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.833+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0668047480 con 0x7f0668151f50 2023-10-24T00:45:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.834+0000 7f064effd700 1 -- 172.21.15.148:0/242741617 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f066004b280 con 0x7f0668151f50 2023-10-24T00:45:36.837 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:36.837 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:45:36.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 msgr2=0x7f0654061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 0x7f0654061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0658000f60 tx=0x7f0658009040).stop 2023-10-24T00:45:36.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 msgr2=0x7f06680638a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:36.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f0660000f80 tx=0x7f0660007f20).stop 2023-10-24T00:45:36.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 shutdown_connections 2023-10-24T00:45:36.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f065405f270 0x7f0654061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0668151f50 0x7f06680638a0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0650004690 0x7f06680abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 --2- 172.21.15.148:0/242741617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0668098410 0x7f0668151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:36.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.835+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 >> 172.21.15.148:0/242741617 conn(0x7f06680944a0 msgr2=0x7f06681529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:36.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.836+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 shutdown_connections 2023-10-24T00:45:36.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:36.836+0000 7f066c8ca700 1 -- 172.21.15.148:0/242741617 wait complete. 2023-10-24T00:45:36.841 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:45:37.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:45:28.224722+0000', 'modified': '2023-10-24T00:45:30.241324+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7212}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7212': {'gid': 7212, 'name': 'c', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/321137386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 321137386}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 321137386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:45:37.253 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:45:37.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-24T00:45:37.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.366+0000 7f16a8946700 1 Processor -- start 2023-10-24T00:45:37.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.366+0000 7f16a8946700 1 -- start start 2023-10-24T00:45:37.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a8946700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 0x7f16a4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a8946700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a8946700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a406a860 con 0x7f16a4154e70 2023-10-24T00:45:37.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a8946700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a40c9d90 con 0x7f16a4154a90 2023-10-24T00:45:37.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a8946700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40c9180 con 0x7f16a40c0f20 2023-10-24T00:45:37.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a2d9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 0x7f16a4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:51502/0 (socket says 172.21.15.148:51502) 2023-10-24T00:45:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a259c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f16a4154e70 0x7f16a40c0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49182/0 (socket says 172.21.15.148:49182) 2023-10-24T00:45:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 -- 172.21.15.148:0/1156041228 learned_addr learned my addr 172.21.15.148:0/1156041228 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 -- 172.21.15.148:0/1156041228 >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 msgr2=0x7f16a4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 --2- 172.21.15.148:0/1156041228 >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 0x7f16a4155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.367+0000 7f16a359e700 1 -- 172.21.15.148:0/1156041228 >> v1:172.21.15.150:6789/0 conn(0x7f16a4154e70 legacy=0x7f16a40c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a1d9b700 1 -- 172.21.15.148:0/1156041228 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793796699 0 0) 0x7f16a406a860 con 0x7f16a4154e70 2023-10-24T00:45:37.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a359e700 1 -- 172.21.15.148:0/1156041228 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a40c9460 con 0x7f16a40c0f20 2023-10-24T00:45:37.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/1156041228 >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 0x7f16a4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:37.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a359e700 1 --2- 172.21.15.148:0/1156041228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f169c009f20 tx=0x7f169c009840).ready entity=mon.2 client_cookie=2fe729812312ca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a1d9b700 1 -- 172.21.15.148:0/1156041228 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00e070 con 0x7f16a40c0f20 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a1d9b700 1 -- 172.21.15.148:0/1156041228 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00b9d0 con 0x7f16a40c0f20 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a1d9b700 1 -- 172.21.15.148:0/1156041228 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00bd50 con 0x7f16a40c0f20 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 -- 172.21.15.148:0/1156041228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 msgr2=0x7f16a41552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 --2- 172.21.15.148:0/1156041228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f169c009f20 tx=0x7f169c009840).stop 2023-10-24T00:45:37.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 -- 172.21.15.148:0/1156041228 shutdown_connections 2023-10-24T00:45:37.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 --2- 172.21.15.148:0/1156041228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a41552f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 --2- 172.21.15.148:0/1156041228 >> v2:172.21.15.150:3300/0 conn(0x7f16a4154a90 0x7f16a4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 -- 172.21.15.148:0/1156041228 >> 172.21.15.148:0/1156041228 conn(0x7f16a4084c20 msgr2=0x7f16a4094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 -- 172.21.15.148:0/1156041228 shutdown_connections 2023-10-24T00:45:37.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.368+0000 7f16a8946700 1 -- 172.21.15.148:0/1156041228 wait complete. 2023-10-24T00:45:37.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 Processor -- start 2023-10-24T00:45:37.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 -- start start 2023-10-24T00:45:37.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a4151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a4154a90 0x7f16a40b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4157d00 con 0x7f16a4154e70 2023-10-24T00:45:37.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4151f50 con 0x7f16a4154a90 2023-10-24T00:45:37.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a8946700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a40ae6d0 con 0x7f16a40c0f20 2023-10-24T00:45:37.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54056/0 (socket says 172.21.15.148:54056) 2023-10-24T00:45:37.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a359e700 1 -- 172.21.15.148:0/2190540563 learned_addr learned my addr 172.21.15.148:0/2190540563 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.370+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a4151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a259c700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a4154a90 0x7f16a40b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 -- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 msgr2=0x7f16a4151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a4151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 -- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a4154a90 msgr2=0x7f16a40b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a4154a90 0x7f16a40b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 -- 172.21.15.148:0/2190540563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940092a0 con 0x7f16a4154e70 2023-10-24T00:45:37.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a359e700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f16a40c92c0 tx=0x7f16a40c9d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f168affd700 1 -- 172.21.15.148:0/2190540563 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00b640 con 0x7f16a4154e70 2023-10-24T00:45:37.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f168affd700 1 -- 172.21.15.148:0/2190540563 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c0092e0 con 0x7f16a4154e70 2023-10-24T00:45:37.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c009ae0 con 0x7f16a4154e70 2023-10-24T00:45:37.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f168affd700 1 -- 172.21.15.148:0/2190540563 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c01e6a0 con 0x7f16a4154e70 2023-10-24T00:45:37.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.371+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4158190 con 0x7f16a4154e70 2023-10-24T00:45:37.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.372+0000 7f168affd700 1 -- 172.21.15.148:0/2190540563 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f169c003040 con 0x7f16a4154e70 2023-10-24T00:45:37.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.373+0000 7f168affd700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 0x7f1690061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.373+0000 7f168affd700 1 -- 172.21.15.148:0/2190540563 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f169c07b840 con 0x7f16a4154e70 2023-10-24T00:45:37.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.373+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 0x7f1690061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.373+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 0x7f1690061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1694009da0 tx=0x7f1694009060).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.375+0000 7f16baadfb80 1 Processor -- start 2023-10-24T00:45:37.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.375+0000 7f16baadfb80 1 -- start start 2023-10-24T00:45:37.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bfc590 0x5632a4bb1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 0x5632a4bad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4b291b0 con 0x5632a4bb17e0 2023-10-24T00:45:37.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4aeecb0 con 0x5632a4bb4ff0 2023-10-24T00:45:37.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5632a4b03c90 con 0x5632a4bfc590 2023-10-24T00:45:37.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54064/0 (socket says 172.21.15.148:54064) 2023-10-24T00:45:37.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 -- 172.21.15.148:0/4162992393 learned_addr learned my addr 172.21.15.148:0/4162992393 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a359e700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 0x5632a4bad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a259c700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bfc590 0x5632a4bb1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 -- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bfc590 msgr2=0x5632a4bb1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bfc590 0x5632a4bb1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 -- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 msgr2=0x5632a4bad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 0x5632a4bad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 -- 172.21.15.148:0/4162992393 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632a4afce70 con 0x5632a4bb17e0 2023-10-24T00:45:37.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a359e700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 0x5632a4bad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:37.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f1694011ea0 tx=0x7f1694017000).ready entity=mon.0 client_cookie=9060b72fb9b4a1de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f1683fff700 1 -- 172.21.15.148:0/4162992393 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694014d30 con 0x5632a4bb17e0 2023-10-24T00:45:37.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f1683fff700 1 -- 172.21.15.148:0/4162992393 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694014e90 con 0x5632a4bb17e0 2023-10-24T00:45:37.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.376+0000 7f1683fff700 1 -- 172.21.15.148:0/4162992393 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169401e600 con 0x5632a4bb17e0 2023-10-24T00:45:37.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 -- 172.21.15.148:0/4162992393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 msgr2=0x5632a4bdabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f1694011ea0 tx=0x7f1694017000).stop 2023-10-24T00:45:37.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 -- 172.21.15.148:0/4162992393 shutdown_connections 2023-10-24T00:45:37.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb4ff0 0x5632a4bad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdabd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 --2- 172.21.15.148:0/4162992393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bfc590 0x5632a4bb1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 -- 172.21.15.148:0/4162992393 >> 172.21.15.148:0/4162992393 conn(0x5632a496ee40 msgr2=0x5632a4bfb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 -- 172.21.15.148:0/4162992393 shutdown_connections 2023-10-24T00:45:37.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.377+0000 7f16baadfb80 1 -- 172.21.15.148:0/4162992393 wait complete. 2023-10-24T00:45:37.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.378+0000 7f16baadfb80 1 -- start start 2023-10-24T00:45:37.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.378+0000 7f16baadfb80 1 Processor -- start 2023-10-24T00:45:37.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4bd1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 0x5632a4bd9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4b03dd0 con 0x5632a4bb17e0 2023-10-24T00:45:37.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4b04050 con 0x5632a4bfc590 2023-10-24T00:45:37.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5632a4acf8d0 con 0x5632a4bb4ff0 2023-10-24T00:45:37.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 10 client.0 ll_register_callbacks cb 0x5632a4b72210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:45:37.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54078/0 (socket says 172.21.15.148:54078) 2023-10-24T00:45:37.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2831569364 learned_addr learned my addr 172.21.15.148:0/2831569364 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a359e700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 0x5632a4bd9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a259c700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4bd1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 msgr2=0x5632a4bd1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4bd1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 msgr2=0x5632a4bd9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 0x5632a4bd9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2831569364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1694011af0 con 0x5632a4bb17e0 2023-10-24T00:45:37.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a359e700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 0x5632a4bd9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:37.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x5632a4aefca0 tx=0x7f1694024000).ready entity=mon.0 client_cookie=b08e2fdbcb9a2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:45:37.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169401e640 con 0x5632a4bb17e0 2023-10-24T00:45:37.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632a4baa860 con 0x5632a4bb17e0 2023-10-24T00:45:37.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f169401ec40 con 0x5632a4bb17e0 2023-10-24T00:45:37.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f169401ee00 con 0x5632a4bb17e0 2023-10-24T00:45:37.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 10 client.7383 fetch_fsmap learned FSMap version 37 2023-10-24T00:45:37.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5632a4af8480 con 0x5632a4bb17e0 2023-10-24T00:45:37.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5632a4baa860 con 0x5632a4bb17e0 2023-10-24T00:45:37.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1694027450 con 0x5632a4bb17e0 2023-10-24T00:45:37.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 10 client.7383 fetch_fsmap finished waiting for FSMap version 37 2023-10-24T00:45:37.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 10 client.7383 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:45:37.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 20 client.7383 populate_metadata read hostname 'smithi148' 2023-10-24T00:45:37.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bd62b0 0x5632a4bd6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 4 client.7383 mds_command: new command op to 7212 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:45:37.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 --> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632a4b7c4b0 con 0x5632a4bd62b0 2023-10-24T00:45:37.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a259c700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bd62b0 0x5632a4bd6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16817fa700 10 client.7383 ms_handle_connect on v2:172.21.15.148:6834/321137386 2023-10-24T00:45:37.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.380+0000 7f16a259c700 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bd62b0 0x5632a4bd6690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bda2a4748b2e3888 server_cookie=d42bc7f7bbff1fd0 in_seq=0 out_seq=0 2023-10-24T00:45:37.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16817fa700 1 -- 172.21.15.148:0/2831569364 <== mds.0 v2:172.21.15.148:6834/321137386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5632a4b7c4b0 con 0x5632a4bd62b0 2023-10-24T00:45:37.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16817fa700 10 client.7383 handle_command_reply: tid=0 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 client.7383 shutdown 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 msgr2=0x5632a4bdfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x5632a4aefca0 tx=0x7f1694024000).stop 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 shutdown_connections 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bd62b0 0x5632a4bd6690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bfc590 0x5632a4bd9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16817fa700 0 client.7383 ms_handle_reset on v2:172.21.15.148:6834/321137386 2023-10-24T00:45:37.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bdfd00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2831569364 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4bd1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 >> 172.21.15.148:0/2831569364 conn(0x5632a496ee40 msgr2=0x5632a4bfb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 shutdown_connections 2023-10-24T00:45:37.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 1 -- 172.21.15.148:0/2831569364 wait complete. 2023-10-24T00:45:37.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.381+0000 7f16baadfb80 20 client.7383 trim_cache size 0 max 16384 2023-10-24T00:45:37.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.398+0000 7f16baadfb80 1 Processor -- start 2023-10-24T00:45:37.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.398+0000 7f16baadfb80 1 -- start start 2023-10-24T00:45:37.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4be0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bd62b0 0x5632a4bd1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bb4770 con 0x5632a4bb17e0 2023-10-24T00:45:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bf92a0 con 0x5632a4bd62b0 2023-10-24T00:45:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bb4dd0 con 0x5632a4bb4ff0 2023-10-24T00:45:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54088/0 (socket says 172.21.15.148:54088) 2023-10-24T00:45:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2871346937 learned_addr learned my addr 172.21.15.148:0/2871346937 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a359e700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bd62b0 0x5632a4bd1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a259c700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4be0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 msgr2=0x5632a4be0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4be0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bd62b0 msgr2=0x5632a4bd1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bd62b0 0x5632a4bd1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 -- 172.21.15.148:0/2871346937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632a4af81d0 con 0x5632a4bb17e0 2023-10-24T00:45:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a259c700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4be0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f1694003060 tx=0x7f169402c040).ready entity=mon.0 client_cookie=8c9c2b5a0f55f1ca server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f1688bcf700 1 -- 172.21.15.148:0/2871346937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694014b60 con 0x5632a4bb17e0 2023-10-24T00:45:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f1688bcf700 1 -- 172.21.15.148:0/2871346937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169401e640 con 0x5632a4bb17e0 2023-10-24T00:45:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.399+0000 7f1688bcf700 1 -- 172.21.15.148:0/2871346937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169401ec40 con 0x5632a4bb17e0 2023-10-24T00:45:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- 172.21.15.148:0/2871346937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 msgr2=0x5632a4bd9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f1694003060 tx=0x7f169402c040).stop 2023-10-24T00:45:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- 172.21.15.148:0/2871346937 shutdown_connections 2023-10-24T00:45:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bd62b0 0x5632a4bd1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb17e0 0x5632a4bd9950 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2871346937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bb4ff0 0x5632a4be0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- 172.21.15.148:0/2871346937 >> 172.21.15.148:0/2871346937 conn(0x5632a496ee40 msgr2=0x5632a4c110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- 172.21.15.148:0/2871346937 shutdown_connections 2023-10-24T00:45:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- 172.21.15.148:0/2871346937 wait complete. 2023-10-24T00:45:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 -- start start 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.400+0000 7f16baadfb80 1 Processor -- start 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 0x5632a4c5bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 0x5632a4bfb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bde1f0 con 0x5632a4bb4ff0 2023-10-24T00:45:37.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bd0620 con 0x5632a4bb17e0 2023-10-24T00:45:37.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5632a4bf8c50 con 0x5632a4bd62b0 2023-10-24T00:45:37.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16baadfb80 10 client.0 ll_register_callbacks cb 0x5632a4b72210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:45:37.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16a259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16a259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54094/0 (socket says 172.21.15.148:54094) 2023-10-24T00:45:37.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16a259c700 1 -- 172.21.15.148:0/2478084958 learned_addr learned my addr 172.21.15.148:0/2478084958 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.401+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 0x5632a4c5bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a359e700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 0x5632a4bfb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 -- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 msgr2=0x5632a4bfb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 0x5632a4bfb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 -- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 msgr2=0x5632a4c5bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 0x5632a4c5bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 -- 172.21.15.148:0/2478084958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632a4af8480 con 0x5632a4bb4ff0 2023-10-24T00:45:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a359e700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 0x5632a4bfb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 0x5632a4c5bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a259c700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f1698007fd0 tx=0x7f1698009040).ready entity=mon.0 client_cookie=677b44407d906e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:45:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169801f030 con 0x5632a4bb4ff0 2023-10-24T00:45:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1698020070 con 0x5632a4bb4ff0 2023-10-24T00:45:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1694014e90 con 0x5632a4bb4ff0 2023-10-24T00:45:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1698018b40 con 0x5632a4bb4ff0 2023-10-24T00:45:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 10 client.7389 fetch_fsmap learned FSMap version 37 2023-10-24T00:45:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5632a496ff80 con 0x5632a4bb4ff0 2023-10-24T00:45:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694014e90 con 0x5632a4bb4ff0 2023-10-24T00:45:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1698012070 con 0x5632a4bb4ff0 2023-10-24T00:45:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 10 client.7389 fetch_fsmap finished waiting for FSMap version 37 2023-10-24T00:45:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 10 client.7389 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-24T00:45:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 20 client.7389 populate_metadata read hostname 'smithi148' 2023-10-24T00:45:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bfc590 0x5632a4bcf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 4 client.7389 mds_command: new command op to 7212 tid=0[{"prefix": "status"}] 2023-10-24T00:45:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 --> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5632a496aca0 con 0x5632a4bfc590 2023-10-24T00:45:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.402+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bfc590 0x5632a4bcf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16817fa700 10 client.7389 ms_handle_connect on v2:172.21.15.148:6834/321137386 2023-10-24T00:45:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16a2d9d700 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bfc590 0x5632a4bcf730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d798f9e81a1d62b3 server_cookie=39a6cc8d04e40631 in_seq=0 out_seq=0 2023-10-24T00:45:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16817fa700 1 -- 172.21.15.148:0/2478084958 <== mds.0 v2:172.21.15.148:6834/321137386 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5632a496aca0 con 0x5632a4bfc590 2023-10-24T00:45:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16817fa700 10 client.7389 handle_command_reply: tid=0 2023-10-24T00:45:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 client.7389 shutdown 2023-10-24T00:45:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 msgr2=0x5632a4bddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f1698007fd0 tx=0x7f1698009040).stop 2023-10-24T00:45:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 shutdown_connections 2023-10-24T00:45:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:6834/321137386,v1:172.21.15.148:6835/321137386] conn(0x5632a4bfc590 0x5632a4bcf730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5632a4bd62b0 0x5632a4bfb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16817fa700 0 client.7389 ms_handle_reset on v2:172.21.15.148:6834/321137386 2023-10-24T00:45:37.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5632a4bb17e0 0x5632a4c5bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 --2- 172.21.15.148:0/2478084958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5632a4bb4ff0 0x5632a4bddd00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 >> 172.21.15.148:0/2478084958 conn(0x5632a496ee40 msgr2=0x5632a4ba6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 shutdown_connections 2023-10-24T00:45:37.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 1 -- 172.21.15.148:0/2478084958 wait complete. 2023-10-24T00:45:37.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.403+0000 7f16baadfb80 20 client.7389 trim_cache size 0 max 16384 2023-10-24T00:45:37.431 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:45:37.432 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:45:37.432 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:45:37.432 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 7212, 2023-10-24T00:45:37.432 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:45:37.433 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:45:37.433 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:45:37.433 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.1782914980000001, 2023-10-24T00:45:37.433 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 37, 2023-10-24T00:45:37.434 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 111, 2023-10-24T00:45:37.434 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 111, 2023-10-24T00:45:37.434 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 14.100094110000001 2023-10-24T00:45:37.434 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:45:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 msgr2=0x7f1690061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 0x7f1690061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1694009da0 tx=0x7f1694009060).stop 2023-10-24T00:45:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 msgr2=0x7f16a40ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f16a40c92c0 tx=0x7f16a40c9d00).stop 2023-10-24T00:45:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 shutdown_connections 2023-10-24T00:45:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f169005f270 0x7f1690061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16a4154e70 0x7f16a40ae900 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a40c0f20 0x7f16a4151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 --2- 172.21.15.148:0/2190540563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a4154a90 0x7f16a40b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 >> 172.21.15.148:0/2190540563 conn(0x7f16a4084c20 msgr2=0x7f16a4152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 shutdown_connections 2023-10-24T00:45:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.404+0000 7f16a8946700 1 -- 172.21.15.148:0/2190540563 wait complete. 2023-10-24T00:45:37.438 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:45:37.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.537+0000 7fe83f8b8700 1 Processor -- start 2023-10-24T00:45:37.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.537+0000 7fe83f8b8700 1 -- start start 2023-10-24T00:45:37.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83f8b8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe838154180 0x7fe8380c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83f8b8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8380c4e40 0x7fe838157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83f8b8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8380c2700 con 0x7fe8380c52c0 2023-10-24T00:45:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83f8b8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8380a86a0 con 0x7fe8380c4e40 2023-10-24T00:45:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83f8b8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8380a80e0 con 0x7fe838154180 2023-10-24T00:45:37.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83ce53700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8380c4e40 0x7fe838157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83ce53700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8380c4e40 0x7fe838157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54098/0 (socket says 172.21.15.148:54098) 2023-10-24T00:45:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.538+0000 7fe83ce53700 1 -- 172.21.15.148:0/2035564239 learned_addr learned my addr 172.21.15.148:0/2035564239 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83d654700 1 --2- 172.21.15.148:0/2035564239 >> v2:172.21.15.150:3300/0 conn(0x7fe838154180 0x7fe8380c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83ce53700 1 -- 172.21.15.148:0/2035564239 >> v2:172.21.15.150:3300/0 conn(0x7fe838154180 msgr2=0x7fe8380c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83ce53700 1 --2- 172.21.15.148:0/2035564239 >> v2:172.21.15.150:3300/0 conn(0x7fe838154180 0x7fe8380c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83ce53700 1 -- 172.21.15.148:0/2035564239 >> v1:172.21.15.150:6789/0 conn(0x7fe8380c52c0 legacy=0x7fe8380c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83ce53700 1 -- 172.21.15.148:0/2035564239 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380a83c0 con 0x7fe8380c4e40 2023-10-24T00:45:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83ce53700 1 --2- 172.21.15.148:0/2035564239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8380c4e40 0x7fe838157fa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fe838065b30 tx=0x7fe8280090f0).ready entity=mon.0 client_cookie=d9497324e52aa711 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe82ffff700 1 -- 172.21.15.148:0/2035564239 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800b5a0 con 0x7fe8380c4e40 2023-10-24T00:45:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe82ffff700 1 -- 172.21.15.148:0/2035564239 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82800b700 con 0x7fe8380c4e40 2023-10-24T00:45:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe82ffff700 1 -- 172.21.15.148:0/2035564239 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800ba80 con 0x7fe8380c4e40 2023-10-24T00:45:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 -- 172.21.15.148:0/2035564239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8380c4e40 msgr2=0x7fe838157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/2035564239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8380c4e40 0x7fe838157fa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fe838065b30 tx=0x7fe8280090f0).stop 2023-10-24T00:45:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 -- 172.21.15.148:0/2035564239 shutdown_connections 2023-10-24T00:45:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/2035564239 >> v2:172.21.15.150:3300/0 conn(0x7fe838154180 0x7fe8380c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/2035564239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8380c4e40 0x7fe838157fa0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.539+0000 7fe83f8b8700 1 -- 172.21.15.148:0/2035564239 >> 172.21.15.148:0/2035564239 conn(0x7fe838092340 msgr2=0x7fe838062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.540+0000 7fe83f8b8700 1 -- 172.21.15.148:0/2035564239 shutdown_connections 2023-10-24T00:45:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.540+0000 7fe83f8b8700 1 -- 172.21.15.148:0/2035564239 wait complete. 2023-10-24T00:45:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.541+0000 7fe83f8b8700 1 Processor -- start 2023-10-24T00:45:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.541+0000 7fe83f8b8700 1 -- start start 2023-10-24T00:45:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8380c4e40 0x7fe8380aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380c52c0 0x7fe8381653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838150f30 con 0x7fe838154180 2023-10-24T00:45:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381644a0 con 0x7fe8380c4e40 2023-10-24T00:45:37.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe838150350 con 0x7fe8380c52c0 2023-10-24T00:45:37.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54114/0 (socket says 172.21.15.148:54114) 2023-10-24T00:45:37.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 -- 172.21.15.148:0/840668252 learned_addr learned my addr 172.21.15.148:0/840668252 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:37.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83d654700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8380c4e40 0x7fe8380aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83ce53700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380c52c0 0x7fe8381653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 -- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380c52c0 msgr2=0x7fe8381653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380c52c0 0x7fe8381653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 -- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8380c4e40 msgr2=0x7fe8380aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8380c4e40 0x7fe8380aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 -- 172.21.15.148:0/840668252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009370 con 0x7fe838154180 2023-10-24T00:45:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83de55700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe83000c810 tx=0x7fe830002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830010510 con 0x7fe838154180 2023-10-24T00:45:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830010690 con 0x7fe838154180 2023-10-24T00:45:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe838150630 con 0x7fe838154180 2023-10-24T00:45:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830010a50 con 0x7fe838154180 2023-10-24T00:45:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.542+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8380ab110 con 0x7fe838154180 2023-10-24T00:45:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.543+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8381645e0 con 0x7fe838154180 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.543+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe830012440 con 0x7fe838154180 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.544+0000 7fe82d7fa700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 0x7fe81c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.544+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe830079d60 con 0x7fe838154180 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.544+0000 7fe83d654700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 0x7fe81c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.545+0000 7fe83d654700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 0x7fe81c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe83814ffe0 tx=0x7fe834008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.548+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe830048af0 con 0x7fe838154180 2023-10-24T00:45:37.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.754+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe838047480 con 0x7fe838154180 2023-10-24T00:45:37.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.754+0000 7fe82d7fa700 1 -- 172.21.15.148:0/840668252 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe83004e930 con 0x7fe838154180 2023-10-24T00:45:37.757 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:45:37.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 msgr2=0x7fe81c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 0x7fe81c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe83814ffe0 tx=0x7fe834008040).stop 2023-10-24T00:45:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 msgr2=0x7fe838165890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe83000c810 tx=0x7fe830002530).stop 2023-10-24T00:45:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 shutdown_connections 2023-10-24T00:45:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe81c05f270 0x7fe81c061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe838154180 0x7fe838165890 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8380c4e40 0x7fe8380aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 --2- 172.21.15.148:0/840668252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8380c52c0 0x7fe8381653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.756+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 >> 172.21.15.148:0/840668252 conn(0x7fe838092340 msgr2=0x7fe8380c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.757+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 shutdown_connections 2023-10-24T00:45:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:37.757+0000 7fe83f8b8700 1 -- 172.21.15.148:0/840668252 wait complete. 2023-10-24T00:45:37.769 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:45:37.770 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:45:37.771 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:45:37.771 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:45:37.771 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:37.772 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:45:37.772 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:45:37.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:45:37.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:45:37.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:37.774 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:45:37.789 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:45:37.790 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:45:37.790 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:45:37.790 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.790 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:45:37.790 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.791 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:37.791 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:37.791 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:45:37.791 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:37.792 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:37.792 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:45:37.792 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:45:37.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:37.793 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:45:37.793 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:37.793 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:45:37.793 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41391sec preferred_lft 41391sec 2023-10-24T00:45:37.794 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:45:37.794 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.794 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:45:37.794 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:45:37.795 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:45:37.795 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.795 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:45:37.795 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.795 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:45:37.796 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:45:37.796 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:45:37.796 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.796 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:45:37.796 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:45:37.797 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:45:37.797 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:45:37.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:37.798 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:45:37.853 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:45:37.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:37.855 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:45:37.911 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:45:37.911 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:45:37.911 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:45:37.911 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:45:37.912 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:45:37.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:37.912 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:45:37.913 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:45:37.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:45:37.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:45:37.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:45:37.915 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:45:38.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:38.012 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:45:38.027 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:45:38.027 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:45:38.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:45:38.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:38.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:45:38.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:38.092 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:38.147 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:45:38.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:45:38.250 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:45:38.250 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:45:38.252 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:45:38.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:45:38.253 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:45:38.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:45:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.470+0000 7f6555207700 1 Processor -- start 2023-10-24T00:45:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.470+0000 7f6555207700 1 -- start start 2023-10-24T00:45:38.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f6555207700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6550064a50 0x7f65500c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f6555207700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500bfcf0 con 0x7f65500c6420 2023-10-24T00:45:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f6555207700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500c6800 con 0x7f65500c4680 2023-10-24T00:45:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f6555207700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500c4aa0 con 0x7f6550064a50 2023-10-24T00:45:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f654659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6550064a50 0x7f65500c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f654ed9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f65500c6420 0x7f65500be600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52616/0 (socket says 172.21.15.148:52616) 2023-10-24T00:45:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.471+0000 7f654ed9d700 1 -- 172.21.15.148:0/3955789249 learned_addr learned my addr 172.21.15.148:0/3955789249 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654659c700 1 -- 172.21.15.148:0/3955789249 >> v1:172.21.15.150:6789/0 conn(0x7f65500c4680 legacy=0x7f655015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654659c700 1 -- 172.21.15.148:0/3955789249 >> v1:172.21.15.148:6789/0 conn(0x7f65500c6420 legacy=0x7f65500be600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654659c700 1 -- 172.21.15.148:0/3955789249 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500bf0e0 con 0x7f6550064a50 2023-10-24T00:45:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654e59c700 1 -- 172.21.15.148:0/3955789249 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504602058 0 0) 0x7f65500bfcf0 con 0x7f65500c6420 2023-10-24T00:45:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654659c700 1 --2- 172.21.15.148:0/3955789249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6550064a50 0x7f65500c4190 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f6538009760 tx=0x7f6538009060).ready entity=mon.0 client_cookie=b22552d91831c1a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654e59c700 1 -- 172.21.15.148:0/3955789249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800b520 con 0x7f6550064a50 2023-10-24T00:45:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654e59c700 1 -- 172.21.15.148:0/3955789249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653800b680 con 0x7f6550064a50 2023-10-24T00:45:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f654e59c700 1 -- 172.21.15.148:0/3955789249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653800ba00 con 0x7f6550064a50 2023-10-24T00:45:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 -- 172.21.15.148:0/3955789249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6550064a50 msgr2=0x7f65500c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 --2- 172.21.15.148:0/3955789249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6550064a50 0x7f65500c4190 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f6538009760 tx=0x7f6538009060).stop 2023-10-24T00:45:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 -- 172.21.15.148:0/3955789249 shutdown_connections 2023-10-24T00:45:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 --2- 172.21.15.148:0/3955789249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6550064a50 0x7f65500c4190 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 -- 172.21.15.148:0/3955789249 >> 172.21.15.148:0/3955789249 conn(0x7f6550092510 msgr2=0x7f6550062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.472+0000 7f6555207700 1 -- 172.21.15.148:0/3955789249 shutdown_connections 2023-10-24T00:45:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.473+0000 7f6555207700 1 -- 172.21.15.148:0/3955789249 wait complete. 2023-10-24T00:45:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 Processor -- start 2023-10-24T00:45:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 -- start start 2023-10-24T00:45:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6550064a50 0x7f65500ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 0x7f65500c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6550149870 con 0x7f65500c6420 2023-10-24T00:45:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500aedd0 con 0x7f6550064a50 2023-10-24T00:45:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.474+0000 7f6555207700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500ac860 con 0x7f65500c4680 2023-10-24T00:45:38.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54132/0 (socket says 172.21.15.148:54132) 2023-10-24T00:45:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 -- 172.21.15.148:0/1534666941 learned_addr learned my addr 172.21.15.148:0/1534666941 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654ed9d700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6550064a50 0x7f65500ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654659c700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 0x7f65500c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 -- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 msgr2=0x7f65500c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 0x7f65500c0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 -- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6550064a50 msgr2=0x7f65500ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6550064a50 0x7f65500ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 -- 172.21.15.148:0/1534666941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380092a0 con 0x7f65500c6420 2023-10-24T00:45:38.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654659c700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 0x7f65500c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f654f59e700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f654800c810 tx=0x7f6548002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548010510 con 0x7f65500c6420 2023-10-24T00:45:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548010670 con 0x7f65500c6420 2023-10-24T00:45:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65500c1a90 con 0x7f65500c6420 2023-10-24T00:45:38.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548010a30 con 0x7f65500c6420 2023-10-24T00:45:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.475+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65500c2050 con 0x7f65500c6420 2023-10-24T00:45:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.476+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655006c6b0 con 0x7f65500c6420 2023-10-24T00:45:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.477+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6548012440 con 0x7f65500c6420 2023-10-24T00:45:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.477+0000 7f65477fe700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 0x7f6530061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.477+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6548079de0 con 0x7f65500c6420 2023-10-24T00:45:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.477+0000 7f654ed9d700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 0x7f6530061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.478+0000 7f654ed9d700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 0x7f6530061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6540002840 tx=0x7f6540009040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.481+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6548048af0 con 0x7f65500c6420 2023-10-24T00:45:38.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.669+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6550065f60 con 0x7f653005f270 2023-10-24T00:45:38.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.671+0000 7f65477fe700 1 -- 172.21.15.148:0/1534666941 <== mgr.6538 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6550065f60 con 0x7f653005f270 2023-10-24T00:45:38.672 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:45:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:45:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:45:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:45:38.673 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:45:38.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 msgr2=0x7f6530061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 0x7f6530061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6540002840 tx=0x7f6540009040).stop 2023-10-24T00:45:38.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 msgr2=0x7f65500c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f654800c810 tx=0x7f6548002560).stop 2023-10-24T00:45:38.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 shutdown_connections 2023-10-24T00:45:38.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f653005f270 0x7f6530061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f65500c6420 0x7f65500c1410 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6550064a50 0x7f65500ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 --2- 172.21.15.148:0/1534666941 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65500c4680 0x7f65500c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 >> 172.21.15.148:0/1534666941 conn(0x7f6550092510 msgr2=0x7f65500be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:38.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 shutdown_connections 2023-10-24T00:45:38.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.673+0000 7f6555207700 1 -- 172.21.15.148:0/1534666941 wait complete. 2023-10-24T00:45:38.686 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:45:38.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.800+0000 7fac13f4f700 1 Processor -- start 2023-10-24T00:45:38.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.800+0000 7fac13f4f700 1 -- start start 2023-10-24T00:45:38.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac0c154430 0x7fac0c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 0x7fac0c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 0x7fac0c0c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0c0970 con 0x7fac0c154430 2023-10-24T00:45:38.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0c71d0 con 0x7fac0c0bffd0 2023-10-24T00:45:38.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac13f4f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0c9410 con 0x7fac0c098bd0 2023-10-24T00:45:38.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac11ceb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac0c154430 0x7fac0c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac11ceb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fac0c154430 0x7fac0c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54136/0 (socket says 172.21.15.148:54136) 2023-10-24T00:45:38.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac11ceb700 1 -- 172.21.15.148:0/2368951833 learned_addr learned my addr 172.21.15.148:0/2368951833 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:38.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.801+0000 7fac114ea700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 0x7fac0c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac124ec700 1 --2- 172.21.15.148:0/2368951833 >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 0x7fac0c0c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 -- 172.21.15.148:0/2368951833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 msgr2=0x7fac0c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:38.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 0x7fac0c0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 -- 172.21.15.148:0/2368951833 >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 msgr2=0x7fac0c0c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:38.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 --2- 172.21.15.148:0/2368951833 >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 0x7fac0c0c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 -- 172.21.15.148:0/2368951833 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0c6c10 con 0x7fac0c154430 2023-10-24T00:45:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac114ea700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 0x7fac0c0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac124ec700 1 --2- 172.21.15.148:0/2368951833 >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 0x7fac0c0c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:45:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac11ceb700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c154430 0x7fac0c154810 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fac08009f20 tx=0x7fac08009840).ready entity=mon.0 client_cookie=40ff80490881b95f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac10ce9700 1 -- 172.21.15.148:0/2368951833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800e070 con 0x7fac0c154430 2023-10-24T00:45:38.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac10ce9700 1 -- 172.21.15.148:0/2368951833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800ba40 con 0x7fac0c154430 2023-10-24T00:45:38.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac10ce9700 1 -- 172.21.15.148:0/2368951833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800bdc0 con 0x7fac0c154430 2023-10-24T00:45:38.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 -- 172.21.15.148:0/2368951833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c154430 msgr2=0x7fac0c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c154430 0x7fac0c154810 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fac08009f20 tx=0x7fac08009840).stop 2023-10-24T00:45:38.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 -- 172.21.15.148:0/2368951833 shutdown_connections 2023-10-24T00:45:38.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c154430 0x7fac0c154810 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 --2- 172.21.15.148:0/2368951833 >> v2:172.21.15.150:3300/0 conn(0x7fac0c0bffd0 0x7fac0c0c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 --2- 172.21.15.148:0/2368951833 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c098bd0 0x7fac0c0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 -- 172.21.15.148:0/2368951833 >> 172.21.15.148:0/2368951833 conn(0x7fac0c0cb070 msgr2=0x7fac0c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:38.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.802+0000 7fac13f4f700 1 -- 172.21.15.148:0/2368951833 shutdown_connections 2023-10-24T00:45:38.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.803+0000 7fac13f4f700 1 -- 172.21.15.148:0/2368951833 wait complete. 2023-10-24T00:45:38.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 Processor -- start 2023-10-24T00:45:38.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 -- start start 2023-10-24T00:45:38.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c0bffd0 0x7fac0c14cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 0x7fac0c0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0af060 con 0x7fac0c098bd0 2023-10-24T00:45:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0af340 con 0x7fac0c154430 2023-10-24T00:45:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac13f4f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0af620 con 0x7fac0c0bffd0 2023-10-24T00:45:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac11ceb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac11ceb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54150/0 (socket says 172.21.15.148:54150) 2023-10-24T00:45:38.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.804+0000 7fac11ceb700 1 -- 172.21.15.148:0/3804618582 learned_addr learned my addr 172.21.15.148:0/3804618582 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:38.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac114ea700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c0bffd0 0x7fac0c14cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac124ec700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 0x7fac0c0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 -- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c0bffd0 msgr2=0x7fac0c14cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c0bffd0 0x7fac0c14cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 -- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 msgr2=0x7fac0c0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:38.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 0x7fac0c0c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:38.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 -- 172.21.15.148:0/3804618582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009ae0 con 0x7fac0c098bd0 2023-10-24T00:45:38.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac124ec700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 0x7fac0c0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:38.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac11ceb700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fac0800b6c0 tx=0x7fac08009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800bbb0 con 0x7fac0c098bd0 2023-10-24T00:45:38.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800bd10 con 0x7fac0c098bd0 2023-10-24T00:45:38.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0af900 con 0x7fac0c098bd0 2023-10-24T00:45:38.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0801d670 con 0x7fac0c098bd0 2023-10-24T00:45:38.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.805+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c156090 con 0x7fac0c098bd0 2023-10-24T00:45:38.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.806+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c06c6b0 con 0x7fac0c098bd0 2023-10-24T00:45:38.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.806+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 38) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fac08003040 con 0x7fac0c098bd0 2023-10-24T00:45:38.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.807+0000 7fac01ffb700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 0x7fabf0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:38.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.807+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fac0807b560 con 0x7fac0c098bd0 2023-10-24T00:45:38.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.807+0000 7fac114ea700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 0x7fabf0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:38.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.807+0000 7fac114ea700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 0x7fabf0061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fac0c0aef90 tx=0x7fabfc008040).ready entity=mgr.6538 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:38.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:38.811+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fac0804c760 con 0x7fac0c098bd0 2023-10-24T00:45:39.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.017+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fac0c0c6ef0 con 0x7fac0c098bd0 2023-10-24T00:45:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.897+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 39) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fac080791b0 con 0x7fac0c098bd0 2023-10-24T00:45:39.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.899+0000 7fac01ffb700 1 -- 172.21.15.148:0/3804618582 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fac08041da0 con 0x7fac0c098bd0 2023-10-24T00:45:39.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 msgr2=0x7fabf0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:39.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 0x7fabf0061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fac0c0aef90 tx=0x7fabfc008040).stop 2023-10-24T00:45:39.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 msgr2=0x7fac0c0aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:39.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fac0800b6c0 tx=0x7fac08009840).stop 2023-10-24T00:45:39.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 shutdown_connections 2023-10-24T00:45:39.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac0c154430 0x7fac0c0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:39.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fabf005f270 0x7fabf0061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:39.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac0c098bd0 0x7fac0c0aeaa0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:39.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 --2- 172.21.15.148:0/3804618582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fac0c0bffd0 0x7fac0c14cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:39.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 >> 172.21.15.148:0/3804618582 conn(0x7fac0c0cb070 msgr2=0x7fac0c0a8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:39.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 shutdown_connections 2023-10-24T00:45:39.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:39.901+0000 7fac13f4f700 1 -- 172.21.15.148:0/3804618582 wait complete. 2023-10-24T00:45:39.917 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:45:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.038+0000 7feab6cfb700 1 Processor -- start 2023-10-24T00:45:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 -- start start 2023-10-24T00:45:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab00ab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feab00a9480 0x7feab00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab006ba70 con 0x7feab006b590 2023-10-24T00:45:40.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00a9de0 con 0x7feab00a9480 2023-10-24T00:45:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.039+0000 7feab6cfb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00655d0 con 0x7feab00ac520 2023-10-24T00:45:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feab006b590 0x7feab0064ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52624/0 (socket says 172.21.15.148:52624) 2023-10-24T00:45:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaffff700 1 -- 172.21.15.148:0/2056178732 learned_addr learned my addr 172.21.15.148:0/2056178732 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:40.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 --2- 172.21.15.148:0/2056178732 >> v2:172.21.15.150:3300/0 conn(0x7feab00a9480 0x7feab00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab4a97700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab00ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaf7fe700 1 -- 172.21.15.148:0/2056178732 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510584540 0 0) 0x7fea9c001110 con 0x7feab006b590 2023-10-24T00:45:40.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaf7fe700 1 -- 172.21.15.148:0/2056178732 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa00033f0 con 0x7feab006b590 2023-10-24T00:45:40.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 -- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 msgr2=0x7feab00ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:40.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab00ab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 -- 172.21.15.148:0/2056178732 >> v1:172.21.15.148:6789/0 conn(0x7feab006b590 legacy=0x7feab0064ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 -- 172.21.15.148:0/2056178732 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00ad0f0 con 0x7feab00a9480 2023-10-24T00:45:40.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab4a97700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab00ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:45:40.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feab5298700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a98f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7feaa8009e60 tx=0x7feaa8009780).ready entity=mon.1 client_cookie=77933f5a69fd628f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:40.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaf7fe700 1 -- 172.21.15.148:0/2056178732 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800e070 con 0x7feab00a9480 2023-10-24T00:45:40.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaf7fe700 1 -- 172.21.15.148:0/2056178732 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800bab0 con 0x7feab00a9480 2023-10-24T00:45:40.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.040+0000 7feaaf7fe700 1 -- 172.21.15.148:0/2056178732 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800be30 con 0x7feab00a9480 2023-10-24T00:45:40.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 -- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 msgr2=0x7feab00a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a98f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7feaa8009e60 tx=0x7feaa8009780).stop 2023-10-24T00:45:40.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 -- 172.21.15.148:0/2056178732 shutdown_connections 2023-10-24T00:45:40.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a98f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 --2- 172.21.15.148:0/2056178732 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab00ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 -- 172.21.15.148:0/2056178732 >> 172.21.15.148:0/2056178732 conn(0x7feab00c3f60 msgr2=0x7feab00c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:40.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 -- 172.21.15.148:0/2056178732 shutdown_connections 2023-10-24T00:45:40.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.041+0000 7feab6cfb700 1 -- 172.21.15.148:0/2056178732 wait complete. 2023-10-24T00:45:40.049 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:40.047+0000 7f2c80608680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:40.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.042+0000 7feab6cfb700 1 Processor -- start 2023-10-24T00:45:40.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.042+0000 7feab6cfb700 1 -- start start 2023-10-24T00:45:40.050 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:40.042+0000 7f8fcaa85680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:45:40.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0165680 con 0x7feab006b590 2023-10-24T00:45:40.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab014aab0 con 0x7feab00a9480 2023-10-24T00:45:40.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab6cfb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab0164a70 con 0x7feab00ac520 2023-10-24T00:45:40.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54192/0 (socket says 172.21.15.148:54192) 2023-10-24T00:45:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 -- 172.21.15.148:0/1314944110 learned_addr learned my addr 172.21.15.148:0/1314944110 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feaaffff700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab5298700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 -- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 msgr2=0x7feab014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 -- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 msgr2=0x7feab00a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.043+0000 7feab4a97700 1 -- 172.21.15.148:0/1314944110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40092a0 con 0x7feab006b590 2023-10-24T00:45:40.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feab4a97700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7feaa400e980 tx=0x7feaa4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:40.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4012600 con 0x7feab006b590 2023-10-24T00:45:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa4012760 con 0x7feab006b590 2023-10-24T00:45:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa8009a20 con 0x7feab006b590 2023-10-24T00:45:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4012ae0 con 0x7feab006b590 2023-10-24T00:45:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.044+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab0165030 con 0x7feab006b590 2023-10-24T00:45:40.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.045+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab0150410 con 0x7feab006b590 2023-10-24T00:45:40.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.046+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 75565+0+0 (secure 0 0 0) 0x7feaa401b400 con 0x7feab006b590 2023-10-24T00:45:40.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.046+0000 7feaacff9700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 0x7fea94061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.046+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feaa407a880 con 0x7feab006b590 2023-10-24T00:45:40.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.046+0000 7feaaffff700 1 -- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 msgr2=0x7fea94061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:40.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.046+0000 7feaaffff700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 0x7fea94061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:40.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.050+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feaa404b970 con 0x7feab006b590 2023-10-24T00:45:40.111 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:40.109+0000 7f8fcaa85680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:40.115 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:40.114+0000 7f2c80608680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:45:40.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.223+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7feab006c6b0 con 0x7feab006b590 2023-10-24T00:45:40.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.226+0000 7feaacff9700 1 -- 172.21.15.148:0/1314944110 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7feaa404ef90 con 0x7feab006b590 2023-10-24T00:45:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 msgr2=0x7fea94061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 0x7fea94061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 msgr2=0x7feab014a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7feaa400e980 tx=0x7feaa4009060).stop 2023-10-24T00:45:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 shutdown_connections 2023-10-24T00:45:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feab00ac520 0x7feab014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea9405f2c0 0x7fea94061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:40.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feab006b590 0x7feab014a5c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 --2- 172.21.15.148:0/1314944110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feab00a9480 0x7feab00a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 >> 172.21.15.148:0/1314944110 conn(0x7feab00c3f60 msgr2=0x7feab014b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 shutdown_connections 2023-10-24T00:45:40.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.228+0000 7feab6cfb700 1 -- 172.21.15.148:0/1314944110 wait complete. 2023-10-24T00:45:40.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-10-24T00:45:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.362+0000 7f8b954f7700 1 Processor -- start 2023-10-24T00:45:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 -- start start 2023-10-24T00:45:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8b900c81e0 0x7f8b90153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b900c7770 con 0x7f8b900aa320 2023-10-24T00:45:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b900c8690 con 0x7f8b900c81e0 2023-10-24T00:45:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.363+0000 7f8b954f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900c1070 con 0x7f8b900a9f40 2023-10-24T00:45:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8b900c81e0 0x7f8b90153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8b900aa320 0x7f8b900c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52634/0 (socket says 172.21.15.148:52634) 2023-10-24T00:45:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8f7fe700 1 -- 172.21.15.148:0/954616797 learned_addr learned my addr 172.21.15.148:0/954616797 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:45:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8effd700 1 -- 172.21.15.148:0/954616797 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432150122 0 0) 0x7f8b900c7770 con 0x7f8b900aa320 2023-10-24T00:45:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8effd700 1 -- 172.21.15.148:0/954616797 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b780033f0 con 0x7f8b900aa320 2023-10-24T00:45:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 -- 172.21.15.148:0/954616797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 msgr2=0x7f8b90155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:40.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 -- 172.21.15.148:0/954616797 >> v1:172.21.15.148:6789/0 conn(0x7f8b900aa320 legacy=0x7f8b900c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 -- 172.21.15.148:0/954616797 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900c79e0 con 0x7f8b900c81e0 2023-10-24T00:45:40.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b94cf6700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b90153b60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f8b88009e60 tx=0x7f8b88009780).ready entity=mon.0 client_cookie=ee37dbc0f19d0f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:40.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8effd700 1 -- 172.21.15.148:0/954616797 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800e070 con 0x7f8b900c81e0 2023-10-24T00:45:40.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8effd700 1 -- 172.21.15.148:0/954616797 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800bab0 con 0x7f8b900c81e0 2023-10-24T00:45:40.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.364+0000 7f8b8effd700 1 -- 172.21.15.148:0/954616797 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800be30 con 0x7f8b900c81e0 2023-10-24T00:45:40.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 -- 172.21.15.148:0/954616797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 msgr2=0x7f8b90153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b90153b60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f8b88009e60 tx=0x7f8b88009780).stop 2023-10-24T00:45:40.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 -- 172.21.15.148:0/954616797 shutdown_connections 2023-10-24T00:45:40.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b90153b60 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 --2- 172.21.15.148:0/954616797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 -- 172.21.15.148:0/954616797 >> 172.21.15.148:0/954616797 conn(0x7f8b90094420 msgr2=0x7f8b9006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:40.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 -- 172.21.15.148:0/954616797 shutdown_connections 2023-10-24T00:45:40.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.365+0000 7f8b954f7700 1 -- 172.21.15.148:0/954616797 wait complete. 2023-10-24T00:45:40.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.366+0000 7f8b954f7700 1 Processor -- start 2023-10-24T00:45:40.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.366+0000 7f8b954f7700 1 -- start start 2023-10-24T00:45:40.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 0x7f8b900add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9013d3a0 con 0x7f8b900c81e0 2023-10-24T00:45:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b90157980 con 0x7f8b900aa320 2023-10-24T00:45:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b954f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900b0a50 con 0x7f8b900a9f40 2023-10-24T00:45:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54216/0 (socket says 172.21.15.148:54216) 2023-10-24T00:45:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 -- 172.21.15.148:0/2058932139 learned_addr learned my addr 172.21.15.148:0/2058932139 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b8f7fe700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 0x7f8b900add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 msgr2=0x7f8b90157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 msgr2=0x7f8b900add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 0x7f8b900add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:40.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009a20 con 0x7f8b900c81e0 2023-10-24T00:45:40.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b8f7fe700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 0x7f8b900add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:40.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.367+0000 7f8b94cf6700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8b8800b610 tx=0x7f8b88009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:40.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.368+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801d630 con 0x7f8b900c81e0 2023-10-24T00:45:40.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.368+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8801d790 con 0x7f8b900c81e0 2023-10-24T00:45:40.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.368+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b900b0d30 con 0x7f8b900c81e0 2023-10-24T00:45:40.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.368+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8801db30 con 0x7f8b900c81e0 2023-10-24T00:45:40.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.368+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b900ab2f0 con 0x7f8b900c81e0 2023-10-24T00:45:40.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b90047480 con 0x7f8b900c81e0 2023-10-24T00:45:40.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8b88003040 con 0x7f8b900c81e0 2023-10-24T00:45:40.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b77fff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:40.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b8807c2b0 con 0x7f8b900c81e0 2023-10-24T00:45:40.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b8ffff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:40.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.369+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:45:40.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.373+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8b8804d400 con 0x7f8b900c81e0 2023-10-24T00:45:40.399 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:40.397+0000 7f8fcaa85680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:40.404 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:40.403+0000 7f2c80608680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:45:40.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.570+0000 7f8b8ffff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:40.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.570+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:45:40.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.570+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b900851d0 con 0x7f8b7c05f2c0 2023-10-24T00:45:40.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.971+0000 7f8b8ffff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:40.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:40.971+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:45:41.021 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.019+0000 7f8fcaa85680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:41.042 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:41.041+0000 7f2c80608680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:45:41.093 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.091+0000 7f8fcaa85680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:41.118 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:41.117+0000 7f2c80608680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:45:41.279 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.278+0000 7f8fcaa85680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:41.313 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:41.311+0000 7f2c80608680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:45:41.698 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.697+0000 7f8fcaa85680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:41.751 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:41.749+0000 7f2c80608680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:45:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:41.772+0000 7f8b8ffff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:41.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:41.772+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:45:41.803 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.802+0000 7f8fcaa85680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:41.859 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:41.858+0000 7f2c80608680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:41.955 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:41.954+0000 7f8fcaa85680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:42.016 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:42.015+0000 7f2c80608680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:42.030 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:42.028+0000 7f8fcaa85680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:42.095 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:42.094+0000 7f2c80608680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:45:42.097 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:42.095+0000 7f8fcaa85680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:42.166 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:42.165+0000 7f2c80608680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:45:42.355 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:42.354+0000 7f8fcaa85680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:42.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:42.434+0000 7f2c80608680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:45:42.538 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:42.537+0000 7f8fcaa85680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:42.623 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:42.621+0000 7f2c80608680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:45:43.189 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.187+0000 7f8fcaa85680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:43.257 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.256+0000 7f8fcaa85680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:43.301 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.299+0000 7f2c80608680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:45:43.334 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.333+0000 7f8fcaa85680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:43.374 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.373+0000 7f2c80608680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:45:43.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:43.373+0000 7f8b8ffff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:45:43.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:43.374+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:45:43.453 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.451+0000 7f2c80608680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:45:43.481 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.479+0000 7f8fcaa85680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:43.551 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.550+0000 7f8fcaa85680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:43.606 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.605+0000 7f2c80608680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:45:43.666 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.664+0000 7f8fcaa85680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:43.680 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.679+0000 7f2c80608680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:45:43.775 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:43.773+0000 7f8fcaa85680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:43.800 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.799+0000 7f2c80608680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:45:43.916 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:43.915+0000 7f2c80608680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:45:44.066 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:44.065+0000 7f8fcaa85680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:44.138 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:45:44.137+0000 7f8fcaa85680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:44.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:44.209+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 40) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f8b88079f00 con 0x7f8b900c81e0 2023-10-24T00:45:44.217 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.216+0000 7f2c80608680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:45:44.295 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.294+0000 7f2c80608680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:45:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:44.316+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 41) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f8b8807a280 con 0x7f8b900c81e0 2023-10-24T00:45:44.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:44.317+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:45:44.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:44.317+0000 7f8b77fff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:45:44.377 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf4d8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.378 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf4d8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.378 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf4d8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.378 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf4d8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf4d8f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf7d95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf7d95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf7d95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf7d95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:44.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:45:44.376+0000 7f2bf7d95700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:45:45.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.320+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mon.0 v2:172.21.15.148:3300/0 9 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8b880760d0 con 0x7f8b900c81e0 2023-10-24T00:45:45.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.320+0000 7f8b77fff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.320+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b900851d0 con 0x7f8b7c05f2c0 2023-10-24T00:45:45.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.323+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.335+0000 7f8b8ffff700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061700 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8b84006fd0 tx=0x7f8b84006f40).ready entity=mgr.6883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.341+0000 7f8b77fff700 1 -- 172.21.15.148:0/2058932139 <== mgr.6883 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f8b900851d0 con 0x7f8b7c05f2c0 2023-10-24T00:45:45.342 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /bad-path 2023-10-24T00:45:45.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 msgr2=0x7f8b7c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061700 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8b84006fd0 tx=0x7f8b84006f40).stop 2023-10-24T00:45:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 msgr2=0x7f8b900afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8b8800b610 tx=0x7f8b88009780).stop 2023-10-24T00:45:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 shutdown_connections 2023-10-24T00:45:45.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8b7c05f2c0 0x7f8b7c061700 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b900c81e0 0x7f8b900afa50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b900a9f40 0x7f8b90157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 --2- 172.21.15.148:0/2058932139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b900aa320 0x7f8b900add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 >> 172.21.15.148:0/2058932139 conn(0x7f8b90094420 msgr2=0x7f8b90153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:45.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 shutdown_connections 2023-10-24T00:45:45.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.343+0000 7f8b954f7700 1 -- 172.21.15.148:0/2058932139 wait complete. 2023-10-24T00:45:45.358 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-10-24T00:45:45.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-24T00:45:45.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.475+0000 7f8e880db700 1 Processor -- start 2023-10-24T00:45:45.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.475+0000 7f8e880db700 1 -- start start 2023-10-24T00:45:45.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e880db700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e80155810 0x7f8e80065430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e880db700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80065920 0x7f8e800c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e880db700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e80065d80 con 0x7f8e80133f20 2023-10-24T00:45:45.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e880db700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800bdad0 con 0x7f8e80155810 2023-10-24T00:45:45.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e880db700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800bca30 con 0x7f8e80065920 2023-10-24T00:45:45.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e80155810 0x7f8e80065430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8e80155810 0x7f8e80065430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38896/0 (socket says 172.21.15.148:38896) 2023-10-24T00:45:45.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 -- 172.21.15.148:0/3666249991 learned_addr learned my addr 172.21.15.148:0/3666249991 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:45.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85e77700 1 --1- 172.21.15.148:0/3666249991 >> v1:172.21.15.148:6789/0 conn(0x7f8e80133f20 0x7f8e80151ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:40252/0 (socket says 172.21.15.148:40252) 2023-10-24T00:45:45.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e86678700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80065920 0x7f8e800c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 -- 172.21.15.148:0/3666249991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80065920 msgr2=0x7f8e800c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:45:45.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80065920 0x7f8e800c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 -- 172.21.15.148:0/3666249991 >> v1:172.21.15.148:6789/0 conn(0x7f8e80133f20 legacy=0x7f8e80151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e84e75700 1 -- 172.21.15.148:0/3666249991 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368762 0 0) 0x7f8e80065d80 con 0x7f8e80133f20 2023-10-24T00:45:45.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 -- 172.21.15.148:0/3666249991 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800bcd10 con 0x7f8e80155810 2023-10-24T00:45:45.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.476+0000 7f8e85676700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e80065430 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f8e74006fd0 tx=0x7f8e740090f0).ready entity=mon.0 client_cookie=bc97aee22259439d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:45.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e84e75700 1 -- 172.21.15.148:0/3666249991 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400b600 con 0x7f8e80155810 2023-10-24T00:45:45.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e84e75700 1 -- 172.21.15.148:0/3666249991 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400b760 con 0x7f8e80155810 2023-10-24T00:45:45.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e84e75700 1 -- 172.21.15.148:0/3666249991 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400bae0 con 0x7f8e80155810 2023-10-24T00:45:45.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 -- 172.21.15.148:0/3666249991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 msgr2=0x7f8e80065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e80065430 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f8e74006fd0 tx=0x7f8e740090f0).stop 2023-10-24T00:45:45.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 -- 172.21.15.148:0/3666249991 shutdown_connections 2023-10-24T00:45:45.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80065920 0x7f8e800c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 --2- 172.21.15.148:0/3666249991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e80065430 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 -- 172.21.15.148:0/3666249991 >> 172.21.15.148:0/3666249991 conn(0x7f8e800c3670 msgr2=0x7f8e800c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:45.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 -- 172.21.15.148:0/3666249991 shutdown_connections 2023-10-24T00:45:45.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.477+0000 7f8e880db700 1 -- 172.21.15.148:0/3666249991 wait complete. 2023-10-24T00:45:45.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.478+0000 7f8e880db700 1 Processor -- start 2023-10-24T00:45:45.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.478+0000 7f8e880db700 1 -- start start 2023-10-24T00:45:45.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 0x7f8e8014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80133f20 0x7f8e800a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800c5640 con 0x7f8e80155810 2023-10-24T00:45:45.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8014a630 con 0x7f8e80065920 2023-10-24T00:45:45.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e880db700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800c4d10 con 0x7f8e80133f20 2023-10-24T00:45:45.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38898/0 (socket says 172.21.15.148:38898) 2023-10-24T00:45:45.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 -- 172.21.15.148:0/1352547061 learned_addr learned my addr 172.21.15.148:0/1352547061 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:45:45.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e85676700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80133f20 0x7f8e800a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e85e77700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 0x7f8e8014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 -- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80133f20 msgr2=0x7f8e800a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80133f20 0x7f8e800a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 -- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 msgr2=0x7f8e8014a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 0x7f8e8014a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 -- 172.21.15.148:0/1352547061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e74009370 con 0x7f8e80155810 2023-10-24T00:45:45.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e85e77700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 0x7f8e8014a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:45:45.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.479+0000 7f8e86678700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f8e7000bfd0 tx=0x7f8e70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:45.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.480+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011590 con 0x7f8e80155810 2023-10-24T00:45:45.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.480+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e700116f0 con 0x7f8e80155810 2023-10-24T00:45:45.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.480+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e800c4ff0 con 0x7f8e80155810 2023-10-24T00:45:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.480+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011a70 con 0x7f8e80155810 2023-10-24T00:45:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.480+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e800a68b0 con 0x7f8e80155810 2023-10-24T00:45:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.481+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e800c57f0 con 0x7f8e80155810 2023-10-24T00:45:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.481+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8e7001c460 con 0x7f8e80155810 2023-10-24T00:45:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.481+0000 7f8e7dffb700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 0x7f8e6c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:45:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.482+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6379+0+0 (secure 0 0 0) 0x7f8e70079da0 con 0x7f8e80155810 2023-10-24T00:45:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.482+0000 7f8e85e77700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 0x7f8e6c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:45:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.482+0000 7f8e85e77700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 0x7f8e6c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e80168590 tx=0x7f8e78007eb0).ready entity=mgr.6883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:45:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.486+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e800c57f0 con 0x7f8e80155810 2023-10-24T00:45:45.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.671+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e800c4e80 con 0x7f8e6c05f080 2023-10-24T00:45:45.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.674+0000 7f8e7dffb700 1 -- 172.21.15.148:0/1352547061 <== mgr.6883 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f8e800c4e80 con 0x7f8e6c05f080 2023-10-24T00:45:45.675 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:45:45.676 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:45:45", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-24T00:45:45.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 msgr2=0x7f8e6c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 0x7f8e6c061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8e80168590 tx=0x7f8e78007eb0).stop 2023-10-24T00:45:45.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 msgr2=0x7f8e800a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:45:45.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f8e7000bfd0 tx=0x7f8e70008040).stop 2023-10-24T00:45:45.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 shutdown_connections 2023-10-24T00:45:45.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8e6c05f080 0x7f8e6c061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e80155810 0x7f8e800a90f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e80065920 0x7f8e8014a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 --2- 172.21.15.148:0/1352547061 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e80133f20 0x7f8e800a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:45:45.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 >> 172.21.15.148:0/1352547061 conn(0x7f8e800c3670 msgr2=0x7f8e80153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:45:45.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 shutdown_connections 2023-10-24T00:45:45.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:45:45.676+0000 7f8e880db700 1 -- 172.21.15.148:0/1352547061 wait complete. 2023-10-24T00:45:45.689 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:45:45", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-24T00:46:00.347 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:00.344+0000 7f2be7574700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:00.347 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:00.344+0000 7f2be7574700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:00.348 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:00.344+0000 7f2be7574700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:00.348 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:00.344+0000 7f2be7574700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:00.349 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:00.344+0000 7f2be7574700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:02.463 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:46:02.466 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:46:32.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:46:32.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:46:45.691 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-24T00:46:45.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.819+0000 7f7edf017700 1 Processor -- start 2023-10-24T00:46:45.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.819+0000 7f7edf017700 1 -- start start 2023-10-24T00:46:45.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edf017700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 0x7f7ed80a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edf017700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ed80c8290 0x7f7ed80a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edf017700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80c6270 con 0x7f7ed80aa420 2023-10-24T00:46:45.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edf017700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80c60e0 con 0x7f7ed80c8290 2023-10-24T00:46:45.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edf017700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80aa8b0 con 0x7f7ed81544b0 2023-10-24T00:46:45.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7ecffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ed80c8290 0x7f7ed80a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7ecffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ed80c8290 0x7f7ed80a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36390/0 (socket says 172.21.15.148:36390) 2023-10-24T00:46:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7ecffff700 1 -- 172.21.15.148:0/3408391932 learned_addr learned my addr 172.21.15.148:0/3408391932 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edd5b4700 1 --1- 172.21.15.148:0/3408391932 >> v1:172.21.15.148:6789/0 conn(0x7f7ed80aa420 0x7f7ed80c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44162/0 (socket says 172.21.15.148:44162) 2023-10-24T00:46:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.820+0000 7f7edcdb3700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 0x7f7ed80a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecffff700 1 -- 172.21.15.148:0/3408391932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 msgr2=0x7f7ed80a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:45.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecffff700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 0x7f7ed80a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:45.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecffff700 1 -- 172.21.15.148:0/3408391932 >> v1:172.21.15.148:6789/0 conn(0x7f7ed80aa420 legacy=0x7f7ed80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:45.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecf7fe700 1 -- 172.21.15.148:0/3408391932 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995445863 0 0) 0x7f7ed80c6270 con 0x7f7ed80aa420 2023-10-24T00:46:45.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecffff700 1 -- 172.21.15.148:0/3408391932 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80c0c80 con 0x7f7ed80c8290 2023-10-24T00:46:45.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edcdb3700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 0x7f7ed80a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:45.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecffff700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed80c8290 0x7f7ed80a9f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f7ec8006fd0 tx=0x7f7ec80090f0).ready entity=mon.0 client_cookie=60ccf9685ee1fb99 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecf7fe700 1 -- 172.21.15.148:0/3408391932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800b600 con 0x7f7ed80c8290 2023-10-24T00:46:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecf7fe700 1 -- 172.21.15.148:0/3408391932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec800b760 con 0x7f7ed80c8290 2023-10-24T00:46:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7ecf7fe700 1 -- 172.21.15.148:0/3408391932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800bae0 con 0x7f7ed80c8290 2023-10-24T00:46:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 -- 172.21.15.148:0/3408391932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed80c8290 msgr2=0x7f7ed80a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:45.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed80c8290 0x7f7ed80a9f30 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f7ec8006fd0 tx=0x7f7ec80090f0).stop 2023-10-24T00:46:45.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 -- 172.21.15.148:0/3408391932 shutdown_connections 2023-10-24T00:46:45.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed81544b0 0x7f7ed80a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:45.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 --2- 172.21.15.148:0/3408391932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed80c8290 0x7f7ed80a9f30 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:45.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 -- 172.21.15.148:0/3408391932 >> 172.21.15.148:0/3408391932 conn(0x7f7ed80945d0 msgr2=0x7f7ed806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:45.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 -- 172.21.15.148:0/3408391932 shutdown_connections 2023-10-24T00:46:45.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.821+0000 7f7edf017700 1 -- 172.21.15.148:0/3408391932 wait complete. 2023-10-24T00:46:45.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.823+0000 7f7edf017700 1 Processor -- start 2023-10-24T00:46:45.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.823+0000 7f7edf017700 1 -- start start 2023-10-24T00:46:45.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ed80aa420 0x7f7ed80aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed80c8290 0x7f7ed8165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8165940 con 0x7f7ed81544b0 2023-10-24T00:46:45.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80ab010 con 0x7f7ed80aa420 2023-10-24T00:46:45.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80ab2f0 con 0x7f7ed80c8290 2023-10-24T00:46:45.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36394/0 (socket says 172.21.15.148:36394) 2023-10-24T00:46:45.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 -- 172.21.15.148:0/1361833718 learned_addr learned my addr 172.21.15.148:0/1361833718 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:45.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edcdb3700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ed80aa420 0x7f7ed80aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7ecffff700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed80c8290 0x7f7ed8165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 -- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed80c8290 msgr2=0x7f7ed8165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:45.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed80c8290 0x7f7ed8165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:45.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 -- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ed80aa420 msgr2=0x7f7ed80aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ed80aa420 0x7f7ed80aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 -- 172.21.15.148:0/1361833718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8009370 con 0x7f7ed81544b0 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edd5b4700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f7ed000c730 tx=0x7f7ed0001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0005c70 con 0x7f7ed81544b0 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0005dd0 con 0x7f7ed81544b0 2023-10-24T00:46:45.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed80ab5d0 con 0x7f7ed81544b0 2023-10-24T00:46:45.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0007300 con 0x7f7ed81544b0 2023-10-24T00:46:45.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.824+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed80abb90 con 0x7f7ed81544b0 2023-10-24T00:46:45.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.825+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed80abd80 con 0x7f7ed81544b0 2023-10-24T00:46:45.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.826+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f7ed00076b0 con 0x7f7ed81544b0 2023-10-24T00:46:45.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.826+0000 7f7eccff9700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 0x7f7ec40618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:45.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.826+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f7ed007a220 con 0x7f7ed81544b0 2023-10-24T00:46:45.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.826+0000 7f7edcdb3700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 0x7f7ec40618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:45.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.827+0000 7f7edcdb3700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 0x7f7ec40618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7ed4006d80 tx=0x7f7ed4008040).ready entity=mgr.6883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:45.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:45.830+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ed004b060 con 0x7f7ed81544b0 2023-10-24T00:46:46.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.021+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ed806c6b0 con 0x7f7ec405f3e0 2023-10-24T00:46:46.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.024+0000 7f7eccff9700 1 -- 172.21.15.148:0/1361833718 <== mgr.6883 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f7ed806c6b0 con 0x7f7ec405f3e0 2023-10-24T00:46:46.026 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:46.026 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:45:45", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-24T00:46:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 msgr2=0x7f7ec40618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 0x7f7ec40618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7ed4006d80 tx=0x7f7ed4008040).stop 2023-10-24T00:46:46.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 msgr2=0x7f7ed80afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f7ed000c730 tx=0x7f7ed0001520).stop 2023-10-24T00:46:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 shutdown_connections 2023-10-24T00:46:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ec405f3e0 0x7f7ec40618a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ed81544b0 0x7f7ed80afab0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ed80aa420 0x7f7ed80aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 --2- 172.21.15.148:0/1361833718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ed80c8290 0x7f7ed8165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.025+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 >> 172.21.15.148:0/1361833718 conn(0x7f7ed80945d0 msgr2=0x7f7ed8063480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.026+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 shutdown_connections 2023-10-24T00:46:46.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.026+0000 7f7edf017700 1 -- 172.21.15.148:0/1361833718 wait complete. 2023-10-24T00:46:46.040 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:45:45", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-24T00:46:46.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-10-24T00:46:46.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.155+0000 7f77867e5700 1 Processor -- start 2023-10-24T00:46:46.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.155+0000 7f77867e5700 1 -- start start 2023-10-24T00:46:46.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f77867e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 0x7f77800a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f77867e5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77800c8290 0x7f77800a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f77867e5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800c6270 con 0x7f77800aa420 2023-10-24T00:46:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f77867e5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800c60e0 con 0x7f77800c8290 2023-10-24T00:46:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f77867e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800aa8b0 con 0x7f77801544b0 2023-10-24T00:46:46.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f7784d82700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f77800aa420 0x7f77800c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44172/0 (socket says 172.21.15.148:44172) 2023-10-24T00:46:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f7784d82700 1 -- 172.21.15.148:0/37046933 learned_addr learned my addr 172.21.15.148:0/37046933 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f777f7fe700 1 --2- 172.21.15.148:0/37046933 >> v2:172.21.15.150:3300/0 conn(0x7f77800c8290 0x7f77800a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f777ffff700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 0x7f77800a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.156+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401279068 0 0) 0x7f77800c6270 con 0x7f77800aa420 2023-10-24T00:46:46.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77680033f0 con 0x7f77800aa420 2023-10-24T00:46:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777f7fe700 1 -- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 msgr2=0x7f77800a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777f7fe700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 0x7f77800a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506225084 0 0) 0x7f77680033f0 con 0x7f77800aa420 2023-10-24T00:46:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777f7fe700 1 -- 172.21.15.148:0/37046933 >> v1:172.21.15.148:6789/0 conn(0x7f77800aa420 legacy=0x7f77800c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777f7fe700 1 -- 172.21.15.148:0/37046933 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800c0c80 con 0x7f77800c8290 2023-10-24T00:46:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777ffff700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 0x7f77800a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777f7fe700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800c8290 0x7f77800a9f30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f7774009760 tx=0x7f7774009060).ready entity=mon.1 client_cookie=d0bdb9b76ce3fc26 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780017f0 con 0x7f77800c8290 2023-10-24T00:46:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774011400 con 0x7f77800c8290 2023-10-24T00:46:46.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f777effd700 1 -- 172.21.15.148:0/37046933 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774011780 con 0x7f77800c8290 2023-10-24T00:46:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 -- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800c8290 msgr2=0x7f77800a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800c8290 0x7f77800a9f30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f7774009760 tx=0x7f7774009060).stop 2023-10-24T00:46:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 -- 172.21.15.148:0/37046933 shutdown_connections 2023-10-24T00:46:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77801544b0 0x7f77800a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 --2- 172.21.15.148:0/37046933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800c8290 0x7f77800a9f30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.157+0000 7f77867e5700 1 -- 172.21.15.148:0/37046933 >> 172.21.15.148:0/37046933 conn(0x7f77800945d0 msgr2=0x7f778006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:46.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.158+0000 7f77867e5700 1 -- 172.21.15.148:0/37046933 shutdown_connections 2023-10-24T00:46:46.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.158+0000 7f77867e5700 1 -- 172.21.15.148:0/37046933 wait complete. 2023-10-24T00:46:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 Processor -- start 2023-10-24T00:46:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 -- start start 2023-10-24T00:46:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800aa420 0x7f77800ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77800c8290 0x7f7780148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800aefe0 con 0x7f77801544b0 2023-10-24T00:46:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800ab950 con 0x7f77800aa420 2023-10-24T00:46:46.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.159+0000 7f77867e5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7780151070 con 0x7f77800c8290 2023-10-24T00:46:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36410/0 (socket says 172.21.15.148:36410) 2023-10-24T00:46:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 -- 172.21.15.148:0/3330107233 learned_addr learned my addr 172.21.15.148:0/3330107233 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f777f7fe700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77800c8290 0x7f7780148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f777ffff700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800aa420 0x7f77800ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 -- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77800c8290 msgr2=0x7f7780148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77800c8290 0x7f7780148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 -- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800aa420 msgr2=0x7f77800ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800aa420 0x7f77800ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 -- 172.21.15.148:0/3330107233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700092a0 con 0x7f77801544b0 2023-10-24T00:46:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7784d82700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f777800cb70 tx=0x7f7778001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778004c40 con 0x7f77801544b0 2023-10-24T00:46:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778004da0 con 0x7f77801544b0 2023-10-24T00:46:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77740092a0 con 0x7f77801544b0 2023-10-24T00:46:46.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778007380 con 0x7f77801544b0 2023-10-24T00:46:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.160+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77800ae740 con 0x7f77801544b0 2023-10-24T00:46:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.161+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7780151200 con 0x7f77801544b0 2023-10-24T00:46:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.161+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f7778007770 con 0x7f77801544b0 2023-10-24T00:46:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.162+0000 7f7767fff700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 0x7f776c0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.162+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f777807a660 con 0x7f77801544b0 2023-10-24T00:46:46.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.162+0000 7f777ffff700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 0x7f776c0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.163+0000 7f777ffff700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 0x7f776c0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7770009d20 tx=0x7f7770009060).ready entity=mgr.6883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.166+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7780151200 con 0x7f77801544b0 2023-10-24T00:46:46.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.357+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f77800ad870 con 0x7f776c05f3e0 2023-10-24T00:46:46.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.362+0000 7f7767fff700 1 -- 172.21.15.148:0/3330107233 <== mgr.6883 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f77800ad870 con 0x7f776c05f3e0 2023-10-24T00:46:46.364 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /bad-path 2023-10-24T00:46:46.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 msgr2=0x7f776c0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 0x7f776c0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7770009d20 tx=0x7f7770009060).stop 2023-10-24T00:46:46.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 msgr2=0x7f77800a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f777800cb70 tx=0x7f7778001e20).stop 2023-10-24T00:46:46.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 shutdown_connections 2023-10-24T00:46:46.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f776c05f3e0 0x7f776c0618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77801544b0 0x7f77800a9560 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77800aa420 0x7f77800ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 --2- 172.21.15.148:0/3330107233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77800c8290 0x7f7780148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 >> 172.21.15.148:0/3330107233 conn(0x7f77800945d0 msgr2=0x7f77800c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:46.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 shutdown_connections 2023-10-24T00:46:46.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.364+0000 7f77867e5700 1 -- 172.21.15.148:0/3330107233 wait complete. 2023-10-24T00:46:46.378 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-10-24T00:46:46.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:46:46.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.492+0000 7f2424e97700 1 Processor -- start 2023-10-24T00:46:46.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.492+0000 7f2424e97700 1 -- start start 2023-10-24T00:46:46.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f2424e97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2420154150 0x7f24200a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f2424e97700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24200aa390 0x7f24200c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f2424e97700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24200c12e0 con 0x7f24200c0e30 2023-10-24T00:46:46.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f2424e97700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200a9830 con 0x7f24200aa390 2023-10-24T00:46:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f2424e97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200a8c20 con 0x7f2420154150 2023-10-24T00:46:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24200aa390 0x7f24200c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f24200aa390 0x7f24200c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36420/0 (socket says 172.21.15.148:36420) 2023-10-24T00:46:46.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 -- 172.21.15.148:0/2927386259 learned_addr learned my addr 172.21.15.148:0/2927386259 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241f7fe700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2420154150 0x7f24200a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 -- 172.21.15.148:0/2927386259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2420154150 msgr2=0x7f24200a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2420154150 0x7f24200a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 -- 172.21.15.148:0/2927386259 >> v1:172.21.15.150:6789/0 conn(0x7f24200c0e30 legacy=0x7f24200c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 -- 172.21.15.148:0/2927386259 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200a8f00 con 0x7f24200aa390 2023-10-24T00:46:46.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.493+0000 7f241effd700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f24200c0940 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f2414006fd0 tx=0x7f24140090f0).ready entity=mon.0 client_cookie=127ca49aa042f8c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f241e7fc700 1 -- 172.21.15.148:0/2927386259 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400b580 con 0x7f24200aa390 2023-10-24T00:46:46.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f241e7fc700 1 -- 172.21.15.148:0/2927386259 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400b6e0 con 0x7f24200aa390 2023-10-24T00:46:46.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f241e7fc700 1 -- 172.21.15.148:0/2927386259 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400ba60 con 0x7f24200aa390 2023-10-24T00:46:46.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 -- 172.21.15.148:0/2927386259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 msgr2=0x7f24200c0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f24200c0940 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f2414006fd0 tx=0x7f24140090f0).stop 2023-10-24T00:46:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 -- 172.21.15.148:0/2927386259 shutdown_connections 2023-10-24T00:46:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2420154150 0x7f24200a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 --2- 172.21.15.148:0/2927386259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f24200c0940 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 -- 172.21.15.148:0/2927386259 >> 172.21.15.148:0/2927386259 conn(0x7f2420094500 msgr2=0x7f242006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:46.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 -- 172.21.15.148:0/2927386259 shutdown_connections 2023-10-24T00:46:46.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.494+0000 7f2424e97700 1 -- 172.21.15.148:0/2927386259 wait complete. 2023-10-24T00:46:46.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.495+0000 7f2424e97700 1 Processor -- start 2023-10-24T00:46:46.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.495+0000 7f2424e97700 1 -- start start 2023-10-24T00:46:46.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 0x7f24201644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420154150 0x7f24201649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420164ed0 con 0x7f24200aa390 2023-10-24T00:46:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200c4c90 con 0x7f2420154150 2023-10-24T00:46:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f2424e97700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24201653b0 con 0x7f24200c0e30 2023-10-24T00:46:46.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f241f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f241f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36430/0 (socket says 172.21.15.148:36430) 2023-10-24T00:46:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f241f7fe700 1 -- 172.21.15.148:0/234826150 learned_addr learned my addr 172.21.15.148:0/234826150 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f241effd700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 0x7f24201644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.496+0000 7f241ffff700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420154150 0x7f24201649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 -- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 msgr2=0x7f24201644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 0x7f24201644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 -- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420154150 msgr2=0x7f24201649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420154150 0x7f24201649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 -- 172.21.15.148:0/234826150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414009370 con 0x7f24200aa390 2023-10-24T00:46:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241effd700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 0x7f24201644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f241f7fe700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f241000e900 tx=0x7f2410006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000ee40 con 0x7f24200aa390 2023-10-24T00:46:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000c850 con 0x7f24200aa390 2023-10-24T00:46:46.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24201650d0 con 0x7f24200aa390 2023-10-24T00:46:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000cbd0 con 0x7f24200aa390 2023-10-24T00:46:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.497+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2420167e40 con 0x7f24200aa390 2023-10-24T00:46:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.498+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420047480 con 0x7f24200aa390 2023-10-24T00:46:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.498+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f241001b400 con 0x7f24200aa390 2023-10-24T00:46:46.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.499+0000 7f24077fe700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 0x7f240c0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.499+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f241007ac70 con 0x7f24200aa390 2023-10-24T00:46:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.499+0000 7f241effd700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 0x7f240c0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:46.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.499+0000 7f241effd700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 0x7f240c0618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2414006fd0 tx=0x7f2414017000).ready entity=mgr.6883 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:46.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.503+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f241004ba50 con 0x7f24200aa390 2023-10-24T00:46:46.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.707+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f24200a91e0 con 0x7f24200aa390 2023-10-24T00:46:46.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.959+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f241007a020 con 0x7f24200aa390 2023-10-24T00:46:46.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.960+0000 7f24077fe700 1 -- 172.21.15.148:0/234826150 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v45) v1 ==== 93+0+0 (secure 0 0 0) 0x7f24100713f0 con 0x7f24200aa390 2023-10-24T00:46:46.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 msgr2=0x7f240c0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 0x7f240c0618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2414006fd0 tx=0x7f2414017000).stop 2023-10-24T00:46:46.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 msgr2=0x7f242014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:46.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f241000e900 tx=0x7f2410006f40).stop 2023-10-24T00:46:46.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 shutdown_connections 2023-10-24T00:46:46.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2420154150 0x7f24201649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f240c05f3e0 0x7f240c0618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f24200aa390 0x7f242014a900 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.962+0000 7f2424e97700 1 --2- 172.21.15.148:0/234826150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24200c0e30 0x7f24201644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:46.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.963+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 >> 172.21.15.148:0/234826150 conn(0x7f2420094500 msgr2=0x7f24200cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:46.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.963+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 shutdown_connections 2023-10-24T00:46:46.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:46.963+0000 7f2424e97700 1 -- 172.21.15.148:0/234826150 wait complete. 2023-10-24T00:46:46.977 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:46:46.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:46:47.021 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:46:47.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:46:47.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:46:47.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:46:47.062 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:46:47.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:46:47.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:46:47.103 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:46:47.104 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:47.101+0000 7f91a0a97680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:46:47.113 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:47.111+0000 7f03adf52680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:46:47.118 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:46:47.169 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:47.167+0000 7f91a0a97680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:46:47.176 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:47.174+0000 7f03adf52680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:46:47.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.273+0000 7fccc51ef700 1 Processor -- start 2023-10-24T00:46:47.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.273+0000 7fccc51ef700 1 -- start start 2023-10-24T00:46:47.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccc51ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fccc00aa5a0 0x7fccc01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccc51ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00c8e80 0x7fccc0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccc51ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00c93b0 con 0x7fccc0156140 2023-10-24T00:46:47.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccc51ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc006a890 con 0x7fccc00aa5a0 2023-10-24T00:46:47.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccc51ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c9690 con 0x7fccc00c8e80 2023-10-24T00:46:47.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccbed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fccc00aa5a0 0x7fccc01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccbed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fccc00aa5a0 0x7fccc01552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36452/0 (socket says 172.21.15.148:36452) 2023-10-24T00:46:47.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccbf59e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fccc0156140 0x7fccc00ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44188/0 (socket says 172.21.15.148:44188) 2023-10-24T00:46:47.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccbed9d700 1 -- 172.21.15.148:0/2932281397 learned_addr learned my addr 172.21.15.148:0/2932281397 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:47.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.274+0000 7fccbe59c700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00c8e80 0x7fccc0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbed9d700 1 -- 172.21.15.148:0/2932281397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00c8e80 msgr2=0x7fccc0155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbed9d700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00c8e80 0x7fccc0155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbed9d700 1 -- 172.21.15.148:0/2932281397 >> v1:172.21.15.148:6789/0 conn(0x7fccc0156140 legacy=0x7fccc00ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbdd9b700 1 -- 172.21.15.148:0/2932281397 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613640654 0 0) 0x7fccc00c93b0 con 0x7fccc0156140 2023-10-24T00:46:47.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbed9d700 1 -- 172.21.15.148:0/2932281397 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00c9970 con 0x7fccc00aa5a0 2023-10-24T00:46:47.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbed9d700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00aa5a0 0x7fccc01552b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fccb4006fd0 tx=0x7fccb40090f0).ready entity=mon.0 client_cookie=2392b5705b416a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:47.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbdd9b700 1 -- 172.21.15.148:0/2932281397 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400b580 con 0x7fccc00aa5a0 2023-10-24T00:46:47.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbdd9b700 1 -- 172.21.15.148:0/2932281397 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400b6e0 con 0x7fccc00aa5a0 2023-10-24T00:46:47.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccbdd9b700 1 -- 172.21.15.148:0/2932281397 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400ba60 con 0x7fccc00aa5a0 2023-10-24T00:46:47.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 -- 172.21.15.148:0/2932281397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00aa5a0 msgr2=0x7fccc01552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00aa5a0 0x7fccc01552b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fccb4006fd0 tx=0x7fccb40090f0).stop 2023-10-24T00:46:47.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 -- 172.21.15.148:0/2932281397 shutdown_connections 2023-10-24T00:46:47.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00aa5a0 0x7fccc01552b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 --2- 172.21.15.148:0/2932281397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00c8e80 0x7fccc0155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 -- 172.21.15.148:0/2932281397 >> 172.21.15.148:0/2932281397 conn(0x7fccc0084ce0 msgr2=0x7fccc0094600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.275+0000 7fccc51ef700 1 -- 172.21.15.148:0/2932281397 shutdown_connections 2023-10-24T00:46:47.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.276+0000 7fccc51ef700 1 -- 172.21.15.148:0/2932281397 wait complete. 2023-10-24T00:46:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.277+0000 7fccc51ef700 1 Processor -- start 2023-10-24T00:46:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.277+0000 7fccc51ef700 1 -- start start 2023-10-24T00:46:47.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00aa5a0 0x7fccc00aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc0156140 0x7fccc00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c2020 con 0x7fccc00c8e80 2023-10-24T00:46:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00abe20 con 0x7fccc0156140 2023-10-24T00:46:47.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00aafd0 con 0x7fccc00aa5a0 2023-10-24T00:46:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36464/0 (socket says 172.21.15.148:36464) 2023-10-24T00:46:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 -- 172.21.15.148:0/3728128043 learned_addr learned my addr 172.21.15.148:0/3728128043 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:47.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbed9d700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00aa5a0 0x7fccc00aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbf59e700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc0156140 0x7fccc00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00aa5a0 msgr2=0x7fccc00aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00aa5a0 0x7fccc00aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc0156140 msgr2=0x7fccc00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc0156140 0x7fccc00b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 -- 172.21.15.148:0/3728128043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4009370 con 0x7fccc00c8e80 2023-10-24T00:46:47.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccbe59c700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fccb000e900 tx=0x7fccb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:47.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0012600 con 0x7fccc00c8e80 2023-10-24T00:46:47.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0012760 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00ab2b0 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0012ae0 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.278+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc00ab870 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.279+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00adb40 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.280+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fccb001b400 con 0x7fccc00c8e80 2023-10-24T00:46:47.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.280+0000 7fcca6ffd700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 0x7fccac061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.280+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7fccb007ab50 con 0x7fccc00c8e80 2023-10-24T00:46:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.280+0000 7fccbed9d700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 msgr2=0x7fccac061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.280+0000 7fccbed9d700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 0x7fccac061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:47.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.284+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fccb004b930 con 0x7fccc00c8e80 2023-10-24T00:46:47.453 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:47.451+0000 7f03adf52680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:46:47.457 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:47.455+0000 7f91a0a97680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:46:47.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.481+0000 7fccbed9d700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 msgr2=0x7fccac061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:47.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.481+0000 7fccbed9d700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 0x7fccac061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:47.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.498+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc006c6b0 con 0x7fccc00c8e80 2023-10-24T00:46:47.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.498+0000 7fcca6ffd700 1 -- 172.21.15.148:0/3728128043 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fccb0016030 con 0x7fccc00c8e80 2023-10-24T00:46:47.501 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:47.501 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:46:47.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 msgr2=0x7fccac061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:47.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 0x7fccac061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:47.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 msgr2=0x7fccc0147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fccb000e900 tx=0x7fccb0009060).stop 2023-10-24T00:46:47.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 shutdown_connections 2023-10-24T00:46:47.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccc0156140 0x7fccc00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccc00aa5a0 0x7fccc00aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fccac05f360 0x7fccac061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:47.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 --2- 172.21.15.148:0/3728128043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccc00c8e80 0x7fccc0147c50 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 >> 172.21.15.148:0/3728128043 conn(0x7fccc0084ce0 msgr2=0x7fccc0154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:47.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 shutdown_connections 2023-10-24T00:46:47.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.500+0000 7fccc51ef700 1 -- 172.21.15.148:0/3728128043 wait complete. 2023-10-24T00:46:47.506 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:46:47.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:46:47.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.670+0000 7f9e31776700 1 Processor -- start 2023-10-24T00:46:47.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.670+0000 7f9e31776700 1 -- start start 2023-10-24T00:46:47.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e31776700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e2c062810 0x7f9e2c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e31776700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e2c0a6f70 0x7f9e2c151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e31776700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c06a160 con 0x7f9e2c1554c0 2023-10-24T00:46:47.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e31776700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0650f0 con 0x7f9e2c062810 2023-10-24T00:46:47.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e31776700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c069550 con 0x7f9e2c0a6f70 2023-10-24T00:46:47.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e2c062810 0x7f9e2c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9e2c1554c0 0x7f9e2c0a6860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44204/0 (socket says 172.21.15.148:44204) 2023-10-24T00:46:47.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2b7fe700 1 -- 172.21.15.148:0/3748129694 learned_addr learned my addr 172.21.15.148:0/3748129694 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:47.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e30f75700 1 --2- 172.21.15.148:0/3748129694 >> v2:172.21.15.150:3300/0 conn(0x7f9e2c0a6f70 0x7f9e2c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3748129694 >> v2:172.21.15.150:3300/0 conn(0x7f9e2c0a6f70 msgr2=0x7f9e2c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:47.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2bfff700 1 --2- 172.21.15.148:0/3748129694 >> v2:172.21.15.150:3300/0 conn(0x7f9e2c0a6f70 0x7f9e2c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3748129694 >> v1:172.21.15.148:6789/0 conn(0x7f9e2c1554c0 legacy=0x7f9e2c0a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.671+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3748129694 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c069830 con 0x7f9e2c062810 2023-10-24T00:46:47.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e2bfff700 1 --2- 172.21.15.148:0/3748129694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c062bf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f9e2c063710 tx=0x7f9e14009060).ready entity=mon.0 client_cookie=21f650ed5c9d51a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:47.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e2affd700 1 -- 172.21.15.148:0/3748129694 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400b580 con 0x7f9e2c062810 2023-10-24T00:46:47.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e2affd700 1 -- 172.21.15.148:0/3748129694 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400b6e0 con 0x7f9e2c062810 2023-10-24T00:46:47.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e2affd700 1 -- 172.21.15.148:0/3748129694 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400ba60 con 0x7f9e2c062810 2023-10-24T00:46:47.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 -- 172.21.15.148:0/3748129694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 msgr2=0x7f9e2c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 --2- 172.21.15.148:0/3748129694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c062bf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f9e2c063710 tx=0x7f9e14009060).stop 2023-10-24T00:46:47.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 -- 172.21.15.148:0/3748129694 shutdown_connections 2023-10-24T00:46:47.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 --2- 172.21.15.148:0/3748129694 >> v2:172.21.15.150:3300/0 conn(0x7f9e2c0a6f70 0x7f9e2c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 --2- 172.21.15.148:0/3748129694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c062bf0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 -- 172.21.15.148:0/3748129694 >> 172.21.15.148:0/3748129694 conn(0x7f9e2c0c7ad0 msgr2=0x7f9e2c0c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:47.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 -- 172.21.15.148:0/3748129694 shutdown_connections 2023-10-24T00:46:47.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.672+0000 7f9e31776700 1 -- 172.21.15.148:0/3748129694 wait complete. 2023-10-24T00:46:47.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.673+0000 7f9e31776700 1 Processor -- start 2023-10-24T00:46:47.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 -- start start 2023-10-24T00:46:47.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 0x7f9e2c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e2c1554c0 0x7f9e2c0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0c2070 con 0x7f9e2c062810 2023-10-24T00:46:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0c28d0 con 0x7f9e2c1554c0 2023-10-24T00:46:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e31776700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0c4ce0 con 0x7f9e2c0a6f70 2023-10-24T00:46:47.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.674+0000 7f9e2bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36488/0 (socket says 172.21.15.148:36488) 2023-10-24T00:46:47.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3333819445 learned_addr learned my addr 172.21.15.148:0/3333819445 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:47.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e30f75700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e2c1554c0 0x7f9e2c0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2b7fe700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 0x7f9e2c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 msgr2=0x7f9e2c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 0x7f9e2c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e2c1554c0 msgr2=0x7f9e2c0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e2c1554c0 0x7f9e2c0c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 -- 172.21.15.148:0/3333819445 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140092a0 con 0x7f9e2c062810 2023-10-24T00:46:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2b7fe700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 0x7f9e2c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e2bfff700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f9e14009fd0 tx=0x7f9e14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400b850 con 0x7f9e2c062810 2023-10-24T00:46:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400b9b0 con 0x7f9e2c062810 2023-10-24T00:46:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c0c2280 con 0x7f9e2c062810 2023-10-24T00:46:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1401b660 con 0x7f9e2c062810 2023-10-24T00:46:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.675+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c0c4890 con 0x7f9e2c062810 2023-10-24T00:46:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.676+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c0c2bb0 con 0x7f9e2c062810 2023-10-24T00:46:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.676+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9e1401ba90 con 0x7f9e2c062810 2023-10-24T00:46:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.677+0000 7f9e23fff700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 0x7f9e0c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.677+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f9e1407c390 con 0x7f9e2c062810 2023-10-24T00:46:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.677+0000 7f9e2b7fe700 1 -- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 msgr2=0x7f9e0c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.677+0000 7f9e2b7fe700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 0x7f9e0c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.681+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9e1404d1d0 con 0x7f9e2c062810 2023-10-24T00:46:47.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.851+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e2c065890 con 0x7f9e2c062810 2023-10-24T00:46:47.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.852+0000 7f9e23fff700 1 -- 172.21.15.148:0/3333819445 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17604 (secure 0 0 0) 0x7f9e1401f090 con 0x7f9e2c062810 2023-10-24T00:46:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:47.855 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":114,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:46:45.951416+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.0","mappings":[{"from":1,"to":3}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1030073262":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1926917274":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1462183038":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/213814605":"2023-10-25T00:45:44.308567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:46:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 msgr2=0x7f9e0c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:47.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 0x7f9e0c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 msgr2=0x7f9e2c153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f9e14009fd0 tx=0x7f9e14017000).stop 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 shutdown_connections 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e2c1554c0 0x7f9e2c0c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9e0c05f390 0x7f9e0c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:47.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e2c062810 0x7f9e2c153940 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 --2- 172.21.15.148:0/3333819445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e2c0a6f70 0x7f9e2c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 >> 172.21.15.148:0/3333819445 conn(0x7f9e2c0c7ad0 msgr2=0x7f9e2c0bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 shutdown_connections 2023-10-24T00:46:47.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.854+0000 7f9e31776700 1 -- 172.21.15.148:0/3333819445 wait complete. 2023-10-24T00:46:47.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:45:26.401463+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:45:27.190495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:46:47.870 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:46:47.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.990+0000 7fbe33eb0700 1 Processor -- start 2023-10-24T00:46:47.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.990+0000 7fbe33eb0700 1 -- start start 2023-10-24T00:46:47.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe33eb0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 0x7fbe2c069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:47.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe33eb0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c069b10 con 0x7fbe2c062650 2023-10-24T00:46:47.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe33eb0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c066d80 con 0x7fbe2c14c850 2023-10-24T00:46:47.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe33eb0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c14cc30 con 0x7fbe2c1533e0 2023-10-24T00:46:47.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe3244d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbe2c062650 0x7fbe2c0c2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44216/0 (socket says 172.21.15.148:44216) 2023-10-24T00:46:47.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe3244d700 1 -- 172.21.15.148:0/510336066 learned_addr learned my addr 172.21.15.148:0/510336066 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:47.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.991+0000 7fbe3144b700 1 --2- 172.21.15.148:0/510336066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 0x7fbe2c069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:47.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022528277 0 0) 0x7fbe2c069b10 con 0x7fbe2c062650 2023-10-24T00:46:47.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe180033f0 con 0x7fbe2c062650 2023-10-24T00:46:47.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002148847 0 0) 0x7fbe2c066d80 con 0x7fbe2c14c850 2023-10-24T00:46:47.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe2c069b10 con 0x7fbe2c14c850 2023-10-24T00:46:47.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe3144b700 1 -- 172.21.15.148:0/510336066 >> v1:172.21.15.150:6789/0 conn(0x7fbe2c14c850 legacy=0x7fbe2c066330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe3144b700 1 -- 172.21.15.148:0/510336066 >> v1:172.21.15.148:6789/0 conn(0x7fbe2c062650 legacy=0x7fbe2c0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe3144b700 1 -- 172.21.15.148:0/510336066 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c0694c0 con 0x7fbe2c1533e0 2023-10-24T00:46:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe3144b700 1 --2- 172.21.15.148:0/510336066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 0x7fbe2c069fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbe28009790 tx=0x7fbe28009060).ready entity=mon.2 client_cookie=72e3d4d14bc47727 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280090d0 con 0x7fbe2c1533e0 2023-10-24T00:46:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2800f510 con 0x7fbe2c1533e0 2023-10-24T00:46:47.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.992+0000 7fbe30c4a700 1 -- 172.21.15.148:0/510336066 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800f890 con 0x7fbe2c1533e0 2023-10-24T00:46:47.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 -- 172.21.15.148:0/510336066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 msgr2=0x7fbe2c069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:47.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/510336066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 0x7fbe2c069fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fbe28009790 tx=0x7fbe28009060).stop 2023-10-24T00:46:47.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 -- 172.21.15.148:0/510336066 shutdown_connections 2023-10-24T00:46:47.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/510336066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c1533e0 0x7fbe2c069fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 -- 172.21.15.148:0/510336066 >> 172.21.15.148:0/510336066 conn(0x7fbe2c0c7d80 msgr2=0x7fbe2c0c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 -- 172.21.15.148:0/510336066 shutdown_connections 2023-10-24T00:46:48.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.993+0000 7fbe33eb0700 1 -- 172.21.15.148:0/510336066 wait complete. 2023-10-24T00:46:48.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.994+0000 7fbe33eb0700 1 Processor -- start 2023-10-24T00:46:48.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.994+0000 7fbe33eb0700 1 -- start start 2023-10-24T00:46:48.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe2c14c850 0x7fbe2c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c152210 con 0x7fbe2c1533e0 2023-10-24T00:46:48.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c1513b0 con 0x7fbe2c14c850 2023-10-24T00:46:48.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c150b10 con 0x7fbe2c062650 2023-10-24T00:46:48.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe3244d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:57804/0 (socket says 172.21.15.148:57804) 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe3244d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36504/0 (socket says 172.21.15.148:36504) 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 -- 172.21.15.148:0/46434014 learned_addr learned my addr 172.21.15.148:0/46434014 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe3144b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe2c14c850 0x7fbe2c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe2c14c850 msgr2=0x7fbe2c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe2c14c850 0x7fbe2c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 msgr2=0x7fbe2c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 -- 172.21.15.148:0/46434014 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280092a0 con 0x7fbe2c062650 2023-10-24T00:46:48.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe3244d700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:48.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe31c4c700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fbe1c00c470 tx=0x7fbe1c007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c012400 con 0x7fbe2c062650 2023-10-24T00:46:48.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c012560 con 0x7fbe2c062650 2023-10-24T00:46:48.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c150df0 con 0x7fbe2c062650 2023-10-24T00:46:48.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.995+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c012920 con 0x7fbe2c062650 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.996+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c0a4eb0 con 0x7fbe2c062650 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c0a4d10 con 0x7fbe2c062650 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fbe1c01b3b0 con 0x7fbe2c062650 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe21ffb700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 0x7fbe10061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7fbe1c079f10 con 0x7fbe2c062650 2023-10-24T00:46:48.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe3144b700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 msgr2=0x7fbe10061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:48.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:47.997+0000 7fbe3144b700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 0x7fbe10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:48.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.002+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbe2c0a4d10 con 0x7fbe2c062650 2023-10-24T00:46:48.069 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:48.067+0000 7f03adf52680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:46:48.111 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:48.100+0000 7f91a0a97680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:46:48.141 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:48.139+0000 7f03adf52680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:46:48.175 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:48.173+0000 7f91a0a97680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:46:48.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.198+0000 7fbe3144b700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 msgr2=0x7fbe10061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:48.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.198+0000 7fbe3144b700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 0x7fbe10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:48.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.205+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbe2c0a4d10 con 0x7fbe2c062650 2023-10-24T00:46:48.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.206+0000 7fbe21ffb700 1 -- 172.21.15.148:0/46434014 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbe2c0a4d10 con 0x7fbe2c062650 2023-10-24T00:46:48.208 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:46:48.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 msgr2=0x7fbe10061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:48.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 0x7fbe10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 msgr2=0x7fbe2c149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fbe1c00c470 tx=0x7fbe1c007c90).stop 2023-10-24T00:46:48.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 shutdown_connections 2023-10-24T00:46:48.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbe1005f390 0x7fbe10061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe2c1533e0 0x7fbe2c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2c062650 0x7fbe2c149a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 --2- 172.21.15.148:0/46434014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe2c14c850 0x7fbe2c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 >> 172.21.15.148:0/46434014 conn(0x7fbe2c0c7d80 msgr2=0x7fbe2c0c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 shutdown_connections 2023-10-24T00:46:48.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.208+0000 7fbe33eb0700 1 -- 172.21.15.148:0/46434014 wait complete. 2023-10-24T00:46:48.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:46:48.332 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:48.330+0000 7f03adf52680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:46:48.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.344+0000 7f7dddae0700 1 Processor -- start 2023-10-24T00:46:48.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.344+0000 7f7dddae0700 1 -- start start 2023-10-24T00:46:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dddae0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 0x7f7dd8063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dddae0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7dd80bec40 0x7f7dd80c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dddae0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd8065740 con 0x7f7dd80644d0 2023-10-24T00:46:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dddae0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd8064950 con 0x7f7dd80bec40 2023-10-24T00:46:48.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dddae0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8064b30 con 0x7f7dd80c62b0 2023-10-24T00:46:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7dd80bec40 0x7f7dd80c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7dd80bec40 0x7f7dd80c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36508/0 (socket says 172.21.15.148:36508) 2023-10-24T00:46:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 -- 172.21.15.148:0/2454081194 learned_addr learned my addr 172.21.15.148:0/2454081194 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddcade700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 0x7f7dd8063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7dd77fe700 1 -- 172.21.15.148:0/2454081194 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132515323 0 0) 0x7f7dd8065740 con 0x7f7dd80644d0 2023-10-24T00:46:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 -- 172.21.15.148:0/2454081194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 msgr2=0x7f7dd8063fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 0x7f7dd8063fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 -- 172.21.15.148:0/2454081194 >> v1:172.21.15.150:6789/0 conn(0x7f7dd80644d0 legacy=0x7f7dd80be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 -- 172.21.15.148:0/2454081194 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8064e10 con 0x7f7dd80bec40 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddcade700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 0x7f7dd8063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.345+0000 7f7ddd2df700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80bec40 0x7f7dd80c3650 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f7dd0009f20 tx=0x7f7dd0009840).ready entity=mon.0 client_cookie=18fe914dfdf145d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dd77fe700 1 -- 172.21.15.148:0/2454081194 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000e070 con 0x7f7dd80bec40 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dd77fe700 1 -- 172.21.15.148:0/2454081194 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b9d0 con 0x7f7dd80bec40 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dd77fe700 1 -- 172.21.15.148:0/2454081194 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bd50 con 0x7f7dd80bec40 2023-10-24T00:46:48.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 -- 172.21.15.148:0/2454081194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80bec40 msgr2=0x7f7dd80c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80bec40 0x7f7dd80c3650 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f7dd0009f20 tx=0x7f7dd0009840).stop 2023-10-24T00:46:48.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 -- 172.21.15.148:0/2454081194 shutdown_connections 2023-10-24T00:46:48.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80c62b0 0x7f7dd8063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 --2- 172.21.15.148:0/2454081194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80bec40 0x7f7dd80c3650 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 -- 172.21.15.148:0/2454081194 >> 172.21.15.148:0/2454081194 conn(0x7f7dd80923c0 msgr2=0x7f7dd8062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 -- 172.21.15.148:0/2454081194 shutdown_connections 2023-10-24T00:46:48.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.346+0000 7f7dddae0700 1 -- 172.21.15.148:0/2454081194 wait complete. 2023-10-24T00:46:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.347+0000 7f7dddae0700 1 Processor -- start 2023-10-24T00:46:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 -- start start 2023-10-24T00:46:48.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 0x7f7dd8151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dd80bec40 0x7f7dd80acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 0x7f7dd80c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80aca30 con 0x7f7dd80c62b0 2023-10-24T00:46:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80abe20 con 0x7f7dd80bec40 2023-10-24T00:46:48.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dddae0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80ac100 con 0x7f7dd80644d0 2023-10-24T00:46:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7ddd2df700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 0x7f7dd80c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7ddcade700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 0x7f7dd8151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7ddd2df700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 0x7f7dd80c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36520/0 (socket says 172.21.15.148:36520) 2023-10-24T00:46:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7ddd2df700 1 -- 172.21.15.148:0/3713189545 learned_addr learned my addr 172.21.15.148:0/3713189545 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.348+0000 7f7dd7fff700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dd80bec40 0x7f7dd80acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 -- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dd80bec40 msgr2=0x7f7dd80acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dd80bec40 0x7f7dd80acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 -- 172.21.15.148:0/3713189545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 msgr2=0x7f7dd80c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 0x7f7dd80c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 -- 172.21.15.148:0/3713189545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0092a0 con 0x7f7dd80644d0 2023-10-24T00:46:48.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7ddcade700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 0x7f7dd8151a50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7dcc00e880 tx=0x7f7dcc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc012600 con 0x7f7dd80644d0 2023-10-24T00:46:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc012760 con 0x7f7dd80644d0 2023-10-24T00:46:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd0009ae0 con 0x7f7dd80644d0 2023-10-24T00:46:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc012ae0 con 0x7f7dd80644d0 2023-10-24T00:46:48.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.349+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80ac6c0 con 0x7f7dd80644d0 2023-10-24T00:46:48.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.350+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd8047480 con 0x7f7dd80644d0 2023-10-24T00:46:48.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.350+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7dcc01b400 con 0x7f7dd80644d0 2023-10-24T00:46:48.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.351+0000 7f7dd4ff9700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 0x7f7dbc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.351+0000 7f7dd7fff700 1 -- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 msgr2=0x7f7dbc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:48.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.351+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f7dcc07ab00 con 0x7f7dd80644d0 2023-10-24T00:46:48.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.351+0000 7f7dd7fff700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 0x7f7dbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:48.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.355+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7dcc04b8e0 con 0x7f7dd80644d0 2023-10-24T00:46:48.373 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:48.371+0000 7f91a0a97680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:46:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.526+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7dd80650f0 con 0x7f7dd80644d0 2023-10-24T00:46:48.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.527+0000 7f7dd4ff9700 1 -- 172.21.15.148:0/3713189545 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7dcc016070 con 0x7f7dd80644d0 2023-10-24T00:46:48.530 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:46:48.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 msgr2=0x7f7dbc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:48.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 0x7f7dbc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 msgr2=0x7f7dd8151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 0x7f7dd8151a50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7dcc00e880 tx=0x7f7dcc009060).stop 2023-10-24T00:46:48.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 shutdown_connections 2023-10-24T00:46:48.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7dbc05f390 0x7f7dbc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7dd80c62b0 0x7f7dd80c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7dd80644d0 0x7f7dd8151a50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 --2- 172.21.15.148:0/3713189545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7dd80bec40 0x7f7dd80acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 >> 172.21.15.148:0/3713189545 conn(0x7f7dd80923c0 msgr2=0x7f7dd81536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 shutdown_connections 2023-10-24T00:46:48.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.529+0000 7f7dddae0700 1 -- 172.21.15.148:0/3713189545 wait complete. 2023-10-24T00:46:48.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:46:48.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.663+0000 7faa2493e700 1 Processor -- start 2023-10-24T00:46:48.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.664+0000 7faa2493e700 1 -- start start 2023-10-24T00:46:48.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.664+0000 7faa2493e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa201583e0 0x7faa20062d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa2493e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa200659b0 con 0x7faa200a6b10 2023-10-24T00:46:48.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa2493e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa20065e40 con 0x7faa20157f80 2023-10-24T00:46:48.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa2493e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa20064da0 con 0x7faa201583e0 2023-10-24T00:46:48.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faa200a6b10 0x7faa200a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44232/0 (socket says 172.21.15.148:44232) 2023-10-24T00:46:48.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1e59c700 1 -- 172.21.15.148:0/3190532382 learned_addr learned my addr 172.21.15.148:0/3190532382 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:48.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1ed9d700 1 --2- 172.21.15.148:0/3190532382 >> v2:172.21.15.150:3300/0 conn(0x7faa201583e0 0x7faa20062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103879298 0 0) 0x7faa200659b0 con 0x7faa200a6b10 2023-10-24T00:46:48.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa080033f0 con 0x7faa200a6b10 2023-10-24T00:46:48.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274447651 0 0) 0x7faa20065e40 con 0x7faa20157f80 2023-10-24T00:46:48.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa200659b0 con 0x7faa20157f80 2023-10-24T00:46:48.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1ed9d700 1 -- 172.21.15.148:0/3190532382 >> v1:172.21.15.150:6789/0 conn(0x7faa20157f80 legacy=0x7faa20062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1ed9d700 1 -- 172.21.15.148:0/3190532382 >> v1:172.21.15.148:6789/0 conn(0x7faa200a6b10 legacy=0x7faa200a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1ed9d700 1 -- 172.21.15.148:0/3190532382 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20065080 con 0x7faa201583e0 2023-10-24T00:46:48.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1ed9d700 1 --2- 172.21.15.148:0/3190532382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa20062d60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7faa18009e60 tx=0x7faa18009780).ready entity=mon.1 client_cookie=dbced79de2239fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800e070 con 0x7faa201583e0 2023-10-24T00:46:48.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1800bab0 con 0x7faa201583e0 2023-10-24T00:46:48.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.665+0000 7faa1d59a700 1 -- 172.21.15.148:0/3190532382 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800be30 con 0x7faa201583e0 2023-10-24T00:46:48.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 -- 172.21.15.148:0/3190532382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 msgr2=0x7faa20062d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 --2- 172.21.15.148:0/3190532382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa20062d60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7faa18009e60 tx=0x7faa18009780).stop 2023-10-24T00:46:48.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 -- 172.21.15.148:0/3190532382 shutdown_connections 2023-10-24T00:46:48.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 --2- 172.21.15.148:0/3190532382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa20062d60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 -- 172.21.15.148:0/3190532382 >> 172.21.15.148:0/3190532382 conn(0x7faa200c3f60 msgr2=0x7faa200c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 -- 172.21.15.148:0/3190532382 shutdown_connections 2023-10-24T00:46:48.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.666+0000 7faa2493e700 1 -- 172.21.15.148:0/3190532382 wait complete. 2023-10-24T00:46:48.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.667+0000 7faa2493e700 1 Processor -- start 2023-10-24T00:46:48.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.667+0000 7faa2493e700 1 -- start start 2023-10-24T00:46:48.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa200a6b10 0x7faa20152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa200a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201543b0 con 0x7faa20157f80 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201537a0 con 0x7faa201583e0 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa2493e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa20153a80 con 0x7faa200a6b10 2023-10-24T00:46:48.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa1dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa1dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36532/0 (socket says 172.21.15.148:36532) 2023-10-24T00:46:48.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa1dd9b700 1 -- 172.21.15.148:0/3070803391 learned_addr learned my addr 172.21.15.148:0/3070803391 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa1ed9d700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa200a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.668+0000 7faa1e59c700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa200a6b10 0x7faa20152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 -- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa200a6b10 msgr2=0x7faa20152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa200a6b10 0x7faa20152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 -- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 msgr2=0x7faa200a82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa200a82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 -- 172.21.15.148:0/3070803391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18009a20 con 0x7faa20157f80 2023-10-24T00:46:48.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1ed9d700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa200a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa1dd9b700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7faa1000c490 tx=0x7faa10007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000ce40 con 0x7faa20157f80 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1000f470 con 0x7faa20157f80 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa20153d60 con 0x7faa20157f80 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000f810 con 0x7faa20157f80 2023-10-24T00:46:48.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.669+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa20153460 con 0x7faa20157f80 2023-10-24T00:46:48.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.670+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7faa1000fbc0 con 0x7faa20157f80 2023-10-24T00:46:48.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.670+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa200a5060 con 0x7faa20157f80 2023-10-24T00:46:48.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.671+0000 7faa0e7fc700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 0x7faa00061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.671+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7faa10079c60 con 0x7faa20157f80 2023-10-24T00:46:48.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.671+0000 7faa1e59c700 1 -- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 msgr2=0x7faa00061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:48.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.671+0000 7faa1e59c700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 0x7faa00061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:48.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.675+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faa1004aaa0 con 0x7faa20157f80 2023-10-24T00:46:48.759 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:48.757+0000 7f03adf52680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:46:48.813 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:48.811+0000 7f91a0a97680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:46:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.843+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa20065360 con 0x7faa20157f80 2023-10-24T00:46:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.843+0000 7faa0e7fc700 1 -- 172.21.15.148:0/3070803391 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa1004e0c0 con 0x7faa20157f80 2023-10-24T00:46:48.846 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:46:48.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 msgr2=0x7faa00061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:48.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 0x7faa00061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 msgr2=0x7faa20149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7faa1000c490 tx=0x7faa10007c90).stop 2023-10-24T00:46:48.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 shutdown_connections 2023-10-24T00:46:48.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa201583e0 0x7faa200a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa200a6b10 0x7faa20152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa0005f390 0x7faa00061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 --2- 172.21.15.148:0/3070803391 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa20157f80 0x7faa20149ad0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 >> 172.21.15.148:0/3070803391 conn(0x7faa200c3f60 msgr2=0x7faa2014a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 shutdown_connections 2023-10-24T00:46:48.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.845+0000 7faa2493e700 1 -- 172.21.15.148:0/3070803391 wait complete. 2023-10-24T00:46:48.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:46:48.863 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:48.861+0000 7f03adf52680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:46:48.924 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:48.921+0000 7f91a0a97680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:46:48.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.978+0000 7f6acab88700 1 Processor -- start 2023-10-24T00:46:48.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.978+0000 7f6acab88700 1 -- start start 2023-10-24T00:46:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6acab88700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 0x7f6ac40a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6acab88700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ac40c9e00 0x7f6ac415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6acab88700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac40a9830 con 0x7f6ac4154150 2023-10-24T00:46:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6acab88700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac40a8c20 con 0x7f6ac40c9e00 2023-10-24T00:46:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6acab88700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac40a8f00 con 0x7f6ac40c1050 2023-10-24T00:46:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ac40c9e00 0x7f6ac415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6ac40c9e00 0x7f6ac415dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36546/0 (socket says 172.21.15.148:36546) 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 -- 172.21.15.148:0/4004800425 learned_addr learned my addr 172.21.15.148:0/4004800425 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6ac9385700 1 --2- 172.21.15.148:0/4004800425 >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 0x7f6ac40a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 -- 172.21.15.148:0/4004800425 >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 msgr2=0x7f6ac40a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 --2- 172.21.15.148:0/4004800425 >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 0x7f6ac40a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 -- 172.21.15.148:0/4004800425 >> v1:172.21.15.150:6789/0 conn(0x7f6ac4154150 legacy=0x7f6ac40c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6aca387700 1 -- 172.21.15.148:0/4004800425 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40a91e0 con 0x7f6ac40c9e00 2023-10-24T00:46:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.979+0000 7f6ac9385700 1 --2- 172.21.15.148:0/4004800425 >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 0x7f6ac40a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6aca387700 1 --2- 172.21.15.148:0/4004800425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c9e00 0x7f6ac415dd20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f6ac4083af0 tx=0x7f6abc009840).ready entity=mon.0 client_cookie=a042f5da172c5098 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6ac8b84700 1 -- 172.21.15.148:0/4004800425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00e070 con 0x7f6ac40c9e00 2023-10-24T00:46:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6ac8b84700 1 -- 172.21.15.148:0/4004800425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc00ba50 con 0x7f6ac40c9e00 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6ac8b84700 1 -- 172.21.15.148:0/4004800425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00bdd0 con 0x7f6ac40c9e00 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 -- 172.21.15.148:0/4004800425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c9e00 msgr2=0x7f6ac415dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 --2- 172.21.15.148:0/4004800425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c9e00 0x7f6ac415dd20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f6ac4083af0 tx=0x7f6abc009840).stop 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 -- 172.21.15.148:0/4004800425 shutdown_connections 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 --2- 172.21.15.148:0/4004800425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c9e00 0x7f6ac415dd20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 --2- 172.21.15.148:0/4004800425 >> v2:172.21.15.150:3300/0 conn(0x7f6ac40c1050 0x7f6ac40a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 -- 172.21.15.148:0/4004800425 >> 172.21.15.148:0/4004800425 conn(0x7f6ac4094500 msgr2=0x7f6ac406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:48.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 -- 172.21.15.148:0/4004800425 shutdown_connections 2023-10-24T00:46:48.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.980+0000 7f6acab88700 1 -- 172.21.15.148:0/4004800425 wait complete. 2023-10-24T00:46:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 Processor -- start 2023-10-24T00:46:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 -- start start 2023-10-24T00:46:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ac40c9e00 0x7f6ac40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ac4154150 0x7f6ac40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40ae630 con 0x7f6ac40c1050 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40ae910 con 0x7f6ac40c9e00 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6acab88700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac40aebf0 con 0x7f6ac4154150 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6ac9b86700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6ac9b86700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36560/0 (socket says 172.21.15.148:36560) 2023-10-24T00:46:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.982+0000 7f6ac9b86700 1 -- 172.21.15.148:0/2560047552 learned_addr learned my addr 172.21.15.148:0/2560047552 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9385700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ac40c9e00 0x7f6ac40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6aca387700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ac4154150 0x7f6ac40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 -- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ac4154150 msgr2=0x7f6ac40c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ac4154150 0x7f6ac40c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 -- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ac40c9e00 msgr2=0x7f6ac40c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ac40c9e00 0x7f6ac40c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 -- 172.21.15.148:0/2560047552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc009ae0 con 0x7f6ac40c1050 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ac9b86700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f6ab400c440 tx=0x7f6ab4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4007020 con 0x7f6ac40c1050 2023-10-24T00:46:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4007180 con 0x7f6ac40c1050 2023-10-24T00:46:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac40aeed0 con 0x7f6ac40c1050 2023-10-24T00:46:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4007520 con 0x7f6ac40c1050 2023-10-24T00:46:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.983+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac414cf90 con 0x7f6ac40c1050 2023-10-24T00:46:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.984+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac40ca790 con 0x7f6ac40c1050 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.984+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f6ab4006900 con 0x7f6ac40c1050 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.985+0000 7f6ab9ffb700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 0x7f6aa8061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.985+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f6ab4079a00 con 0x7f6ac40c1050 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.985+0000 7f6ac9385700 1 -- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 msgr2=0x7f6aa8061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.985+0000 7f6ac9385700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 0x7f6aa8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:48.989+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ab4047af0 con 0x7f6ac40c1050 2023-10-24T00:46:49.018 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:49.016+0000 7f03adf52680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:46:49.086 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:49.084+0000 7f91a0a97680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:46:49.093 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:49.091+0000 7f03adf52680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:46:49.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:49.159+0000 7f03adf52680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:46:49.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.160+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ac4047480 con 0x7f6ac40c1050 2023-10-24T00:46:49.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.160+0000 7f6ab9ffb700 1 -- 172.21.15.148:0/2560047552 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ab404a840 con 0x7f6ac40c1050 2023-10-24T00:46:49.163 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:46:49.164 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:49.161+0000 7f91a0a97680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:46:49.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 msgr2=0x7f6aa8061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:49.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 0x7f6aa8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 msgr2=0x7f6ac414caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f6ab400c440 tx=0x7f6ab4007e50).stop 2023-10-24T00:46:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 shutdown_connections 2023-10-24T00:46:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ac4154150 0x7f6ac40c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6aa805f360 0x7f6aa8061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ac40c1050 0x7f6ac414caa0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 --2- 172.21.15.148:0/2560047552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ac40c9e00 0x7f6ac40c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 >> 172.21.15.148:0/2560047552 conn(0x7f6ac4094500 msgr2=0x7f6ac415a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 shutdown_connections 2023-10-24T00:46:49.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.163+0000 7f6acab88700 1 -- 172.21.15.148:0/2560047552 wait complete. 2023-10-24T00:46:49.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:46:49.235 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:49.233+0000 7f91a0a97680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:46:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.293+0000 7f463f33b700 1 Processor -- start 2023-10-24T00:46:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.293+0000 7f463f33b700 1 -- start start 2023-10-24T00:46:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463f33b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4638154530 0x7f4638063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463f33b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46380bcb30 0x7f4638064ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463f33b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4638063400 con 0x7f463806b410 2023-10-24T00:46:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463f33b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4638063100 con 0x7f46380bcb30 2023-10-24T00:46:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463f33b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c1ea0 con 0x7f4638154530 2023-10-24T00:46:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f46380bcb30 0x7f4638064ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463c8d6700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f463806b410 0x7f46380bc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44240/0 (socket says 172.21.15.148:44240) 2023-10-24T00:46:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463c8d6700 1 -- 172.21.15.148:0/2846108226 learned_addr learned my addr 172.21.15.148:0/2846108226 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d0d7700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4638154530 0x7f4638063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 -- 172.21.15.148:0/2846108226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4638154530 msgr2=0x7f4638063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4638154530 0x7f4638063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 -- 172.21.15.148:0/2846108226 >> v1:172.21.15.148:6789/0 conn(0x7f463806b410 legacy=0x7f46380bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f462ffff700 1 -- 172.21.15.148:0/2846108226 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230090743 0 0) 0x7f4638063400 con 0x7f463806b410 2023-10-24T00:46:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 -- 172.21.15.148:0/2846108226 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380c2180 con 0x7f46380bcb30 2023-10-24T00:46:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f463d8d8700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46380bcb30 0x7f4638064ce0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f4630009e60 tx=0x7f4630009780).ready entity=mon.0 client_cookie=c420185a9dc0b353 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f462ffff700 1 -- 172.21.15.148:0/2846108226 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000e070 con 0x7f46380bcb30 2023-10-24T00:46:49.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f462ffff700 1 -- 172.21.15.148:0/2846108226 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000bb60 con 0x7f46380bcb30 2023-10-24T00:46:49.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.294+0000 7f462ffff700 1 -- 172.21.15.148:0/2846108226 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630012410 con 0x7f46380bcb30 2023-10-24T00:46:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 -- 172.21.15.148:0/2846108226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46380bcb30 msgr2=0x7f4638064ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46380bcb30 0x7f4638064ce0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f4630009e60 tx=0x7f4630009780).stop 2023-10-24T00:46:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 -- 172.21.15.148:0/2846108226 shutdown_connections 2023-10-24T00:46:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46380bcb30 0x7f4638064ce0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 --2- 172.21.15.148:0/2846108226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4638154530 0x7f4638063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 -- 172.21.15.148:0/2846108226 >> 172.21.15.148:0/2846108226 conn(0x7f46380c3f00 msgr2=0x7f46380c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 -- 172.21.15.148:0/2846108226 shutdown_connections 2023-10-24T00:46:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.295+0000 7f463f33b700 1 -- 172.21.15.148:0/2846108226 wait complete. 2023-10-24T00:46:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.296+0000 7f463f33b700 1 Processor -- start 2023-10-24T00:46:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.296+0000 7f463f33b700 1 -- start start 2023-10-24T00:46:49.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46380bcb30 0x7f46380beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4638154530 0x7f4638147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380bf3c0 con 0x7f463806b410 2023-10-24T00:46:49.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380bf610 con 0x7f4638154530 2023-10-24T00:46:49.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463f33b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380bf8f0 con 0x7f46380bcb30 2023-10-24T00:46:49.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463d0d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463d0d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36590/0 (socket says 172.21.15.148:36590) 2023-10-24T00:46:49.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463d0d7700 1 -- 172.21.15.148:0/1759706502 learned_addr learned my addr 172.21.15.148:0/1759706502 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:49.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463c8d6700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46380bcb30 0x7f46380beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.297+0000 7f463d8d8700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4638154530 0x7f4638147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46380bcb30 msgr2=0x7f46380beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46380bcb30 0x7f46380beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4638154530 msgr2=0x7f4638147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4638154530 0x7f4638147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 -- 172.21.15.148:0/1759706502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009a20 con 0x7f463806b410 2023-10-24T00:46:49.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463d0d7700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f462800e950 tx=0x7f4628009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628012600 con 0x7f463806b410 2023-10-24T00:46:49.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4628012760 con 0x7f463806b410 2023-10-24T00:46:49.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380bfbd0 con 0x7f463806b410 2023-10-24T00:46:49.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628012ae0 con 0x7f463806b410 2023-10-24T00:46:49.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.298+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4638157070 con 0x7f463806b410 2023-10-24T00:46:49.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.299+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4638157290 con 0x7f463806b410 2023-10-24T00:46:49.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.299+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f462801b400 con 0x7f463806b410 2023-10-24T00:46:49.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.299+0000 7f462d7fa700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 0x7f461c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.300+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f462807abf0 con 0x7f463806b410 2023-10-24T00:46:49.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.300+0000 7f463c8d6700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 msgr2=0x7f461c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:49.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.300+0000 7f463c8d6700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 0x7f461c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:49.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.304+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4628081080 con 0x7f463806b410 2023-10-24T00:46:49.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:49.420+0000 7f03adf52680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:46:49.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.501+0000 7f463c8d6700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 msgr2=0x7f461c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:49.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.501+0000 7f463c8d6700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 0x7f461c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:49.505 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:49.503+0000 7f91a0a97680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:46:49.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.517+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4638154910 con 0x7f463806b410 2023-10-24T00:46:49.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.518+0000 7f462d7fa700 1 -- 172.21.15.148:0/1759706502 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f4628016020 con 0x7f463806b410 2023-10-24T00:46:49.520 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:49.521 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:46:49.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 msgr2=0x7f461c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:49.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 0x7f461c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 msgr2=0x7f4638159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f462800e950 tx=0x7f4628009060).stop 2023-10-24T00:46:49.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 shutdown_connections 2023-10-24T00:46:49.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4638154530 0x7f4638147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f461c05f390 0x7f461c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f463806b410 0x7f4638159710 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 --2- 172.21.15.148:0/1759706502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46380bcb30 0x7f46380beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 >> 172.21.15.148:0/1759706502 conn(0x7f46380c3f00 msgr2=0x7f4638062820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 shutdown_connections 2023-10-24T00:46:49.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.520+0000 7f463f33b700 1 -- 172.21.15.148:0/1759706502 wait complete. 2023-10-24T00:46:49.525 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:46:49.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:46:49.607 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:49.604+0000 7f03adf52680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:46:49.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 Processor -- start 2023-10-24T00:46:49.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 -- start start 2023-10-24T00:46:49.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efca81543a0 0x7efca80a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80a84b0 0x7efca8095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efca80bfa50 0x7efca80962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80967c0 con 0x7efca81543a0 2023-10-24T00:46:49.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80bf5c0 con 0x7efca80bfa50 2023-10-24T00:46:49.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.653+0000 7efcaee7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80be9b0 con 0x7efca80a84b0 2023-10-24T00:46:49.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efca81543a0 0x7efca80a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efca81543a0 0x7efca80a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36600/0 (socket says 172.21.15.148:36600) 2023-10-24T00:46:49.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 -- 172.21.15.148:0/1773203485 learned_addr learned my addr 172.21.15.148:0/1773203485 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:49.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcad41c700 1 --2- 172.21.15.148:0/1773203485 >> v2:172.21.15.150:3300/0 conn(0x7efca80bfa50 0x7efca80962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efca7fff700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80a84b0 0x7efca8095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 -- 172.21.15.148:0/1773203485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80a84b0 msgr2=0x7efca8095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:49.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80a84b0 0x7efca8095de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 -- 172.21.15.148:0/1773203485 >> v2:172.21.15.150:3300/0 conn(0x7efca80bfa50 msgr2=0x7efca80962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:49.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 --2- 172.21.15.148:0/1773203485 >> v2:172.21.15.150:3300/0 conn(0x7efca80bfa50 0x7efca80962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 -- 172.21.15.148:0/1773203485 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80bec90 con 0x7efca81543a0 2023-10-24T00:46:49.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efcacc1b700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca81543a0 0x7efca80a7fc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7efca80a7ce0 tx=0x7efc9c0090f0).ready entity=mon.0 client_cookie=827c1956b8d8e7e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efca77fe700 1 -- 172.21.15.148:0/1773203485 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00f510 con 0x7efca81543a0 2023-10-24T00:46:49.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efca77fe700 1 -- 172.21.15.148:0/1773203485 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00f670 con 0x7efca81543a0 2023-10-24T00:46:49.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.654+0000 7efca77fe700 1 -- 172.21.15.148:0/1773203485 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00f9f0 con 0x7efca81543a0 2023-10-24T00:46:49.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 -- 172.21.15.148:0/1773203485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca81543a0 msgr2=0x7efca80a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca81543a0 0x7efca80a7fc0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7efca80a7ce0 tx=0x7efc9c0090f0).stop 2023-10-24T00:46:49.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 -- 172.21.15.148:0/1773203485 shutdown_connections 2023-10-24T00:46:49.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca81543a0 0x7efca80a7fc0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 --2- 172.21.15.148:0/1773203485 >> v2:172.21.15.150:3300/0 conn(0x7efca80bfa50 0x7efca80962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 --2- 172.21.15.148:0/1773203485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80a84b0 0x7efca8095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 -- 172.21.15.148:0/1773203485 >> 172.21.15.148:0/1773203485 conn(0x7efca80630f0 msgr2=0x7efca80c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 -- 172.21.15.148:0/1773203485 shutdown_connections 2023-10-24T00:46:49.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.655+0000 7efcaee7f700 1 -- 172.21.15.148:0/1773203485 wait complete. 2023-10-24T00:46:49.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.656+0000 7efcaee7f700 1 Processor -- start 2023-10-24T00:46:49.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.656+0000 7efcaee7f700 1 -- start start 2023-10-24T00:46:49.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 0x7efca8148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 0x7efca8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80a94d0 con 0x7efca80a84b0 2023-10-24T00:46:49.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80a9d30 con 0x7efca81543a0 2023-10-24T00:46:49.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcaee7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca81691d0 con 0x7efca80bfa50 2023-10-24T00:46:49.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcacc1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcacc1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36614/0 (socket says 172.21.15.148:36614) 2023-10-24T00:46:49.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcacc1b700 1 -- 172.21.15.148:0/2339834033 learned_addr learned my addr 172.21.15.148:0/2339834033 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:49.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efca7fff700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 0x7efca8148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcad41c700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 0x7efca8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.657+0000 7efcacc1b700 1 -- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 msgr2=0x7efca8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcacc1b700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 0x7efca8148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcacc1b700 1 -- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 msgr2=0x7efca8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcacc1b700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 0x7efca8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcacc1b700 1 -- 172.21.15.148:0/2339834033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009370 con 0x7efca80a84b0 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcad41c700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 0x7efca8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efca7fff700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 0x7efca8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcacc1b700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7efca80c6940 tx=0x7efc9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c00f7e0 con 0x7efca80a84b0 2023-10-24T00:46:49.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c00f940 con 0x7efca80a84b0 2023-10-24T00:46:49.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca80a96e0 con 0x7efca80a84b0 2023-10-24T00:46:49.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c01b660 con 0x7efca80a84b0 2023-10-24T00:46:49.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.658+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca8148f20 con 0x7efca80a84b0 2023-10-24T00:46:49.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.659+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca806c6b0 con 0x7efca80a84b0 2023-10-24T00:46:49.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.660+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7efc9c01ba50 con 0x7efca80a84b0 2023-10-24T00:46:49.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.660+0000 7efca4ff9700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 0x7efc8c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.660+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7efc9c07bd80 con 0x7efca80a84b0 2023-10-24T00:46:49.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.660+0000 7efca7fff700 1 -- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 msgr2=0x7efc8c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:49.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.660+0000 7efca7fff700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 0x7efc8c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:49.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.664+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efc9c04cbc0 con 0x7efca80a84b0 2023-10-24T00:46:49.701 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:49.699+0000 7f91a0a97680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:46:49.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.833+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca80bef70 con 0x7efca80a84b0 2023-10-24T00:46:49.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.834+0000 7efca4ff9700 1 -- 172.21.15.148:0/2339834033 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17604 (secure 0 0 0) 0x7efc9c0501e0 con 0x7efca80a84b0 2023-10-24T00:46:49.836 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:49.837 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":114,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:46:45.951416+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.0","mappings":[{"from":1,"to":3}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1030073262":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1926917274":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1462183038":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/213814605":"2023-10-25T00:45:44.308567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:46:49.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 msgr2=0x7efc8c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:49.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 0x7efc8c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 msgr2=0x7efca80ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7efca80c6940 tx=0x7efc9c017000).stop 2023-10-24T00:46:49.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 shutdown_connections 2023-10-24T00:46:49.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efca81543a0 0x7efca8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efc8c05f390 0x7efc8c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efca80a84b0 0x7efca80ac7d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 --2- 172.21.15.148:0/2339834033 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efca80bfa50 0x7efca8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 >> 172.21.15.148:0/2339834033 conn(0x7efca80630f0 msgr2=0x7efca80c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 shutdown_connections 2023-10-24T00:46:49.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.836+0000 7efcaee7f700 1 -- 172.21.15.148:0/2339834033 wait complete. 2023-10-24T00:46:49.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:46:49.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:46:49.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.968+0000 7f82136a4700 1 Processor -- start 2023-10-24T00:46:49.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.969+0000 7f82136a4700 1 -- start start 2023-10-24T00:46:49.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f82136a4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f820c0695f0 0x7f820c0699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f82136a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f82136a4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0c57b0 con 0x7f820c0aacd0 2023-10-24T00:46:49.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f82136a4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c0c5a90 con 0x7f820c0695f0 2023-10-24T00:46:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f82136a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c5d70 con 0x7f820c13aa00 2023-10-24T00:46:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f820c0695f0 0x7f820c0699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f820c0695f0 0x7f820c0699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36616/0 (socket says 172.21.15.148:36616) 2023-10-24T00:46:49.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8210c3f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f820c0aacd0 0x7f820c13a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44252/0 (socket says 172.21.15.148:44252) 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 -- 172.21.15.148:0/1936205749 learned_addr learned my addr 172.21.15.148:0/1936205749 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211c41700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 -- 172.21.15.148:0/1936205749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 msgr2=0x7f820c065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 -- 172.21.15.148:0/1936205749 >> v1:172.21.15.148:6789/0 conn(0x7f820c0aacd0 legacy=0x7f820c13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f81fffff700 1 -- 172.21.15.148:0/1936205749 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170294371 0 0) 0x7f820c0c57b0 con 0x7f820c0aacd0 2023-10-24T00:46:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 -- 172.21.15.148:0/1936205749 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0c6050 con 0x7f820c0695f0 2023-10-24T00:46:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f8211440700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0695f0 0x7f820c0699d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f8200006fd0 tx=0x7f82000090f0).ready entity=mon.0 client_cookie=cf9a659704a10816 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f81fffff700 1 -- 172.21.15.148:0/1936205749 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000b580 con 0x7f820c0695f0 2023-10-24T00:46:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f81fffff700 1 -- 172.21.15.148:0/1936205749 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820000b6e0 con 0x7f820c0695f0 2023-10-24T00:46:49.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.970+0000 7f81fffff700 1 -- 172.21.15.148:0/1936205749 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000ba60 con 0x7f820c0695f0 2023-10-24T00:46:49.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 -- 172.21.15.148:0/1936205749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0695f0 msgr2=0x7f820c0699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0695f0 0x7f820c0699d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f8200006fd0 tx=0x7f82000090f0).stop 2023-10-24T00:46:49.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 -- 172.21.15.148:0/1936205749 shutdown_connections 2023-10-24T00:46:49.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 --2- 172.21.15.148:0/1936205749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0695f0 0x7f820c0699d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 -- 172.21.15.148:0/1936205749 >> 172.21.15.148:0/1936205749 conn(0x7f820c0641f0 msgr2=0x7f820c0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:49.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 -- 172.21.15.148:0/1936205749 shutdown_connections 2023-10-24T00:46:49.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.971+0000 7f82136a4700 1 -- 172.21.15.148:0/1936205749 wait complete. 2023-10-24T00:46:49.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.972+0000 7f82136a4700 1 Processor -- start 2023-10-24T00:46:49.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.972+0000 7f82136a4700 1 -- start start 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0695f0 0x7f820c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c062b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0aa1a0 con 0x7f820c0aacd0 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c063030 con 0x7f820c0695f0 2023-10-24T00:46:49.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f82136a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0ad110 con 0x7f820c13aa00 2023-10-24T00:46:49.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f8210c3f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f8210c3f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36618/0 (socket says 172.21.15.148:36618) 2023-10-24T00:46:49.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f8210c3f700 1 -- 172.21.15.148:0/2787025744 learned_addr learned my addr 172.21.15.148:0/2787025744 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:49.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f8211c41700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.973+0000 7f8211440700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0695f0 0x7f820c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:49.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 msgr2=0x7f820c062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0695f0 msgr2=0x7f820c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0695f0 0x7f820c151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 -- 172.21.15.148:0/2787025744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200009370 con 0x7f820c0aacd0 2023-10-24T00:46:49.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f8210c3f700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f820800c590 tx=0x7f8208007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800cea0 con 0x7f820c0aacd0 2023-10-24T00:46:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080072e0 con 0x7f820c0aacd0 2023-10-24T00:46:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c151d70 con 0x7f820c0aacd0 2023-10-24T00:46:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080056e0 con 0x7f820c0aacd0 2023-10-24T00:46:49.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.974+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0ac630 con 0x7f820c0aacd0 2023-10-24T00:46:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c06c6b0 con 0x7f820c0aacd0 2023-10-24T00:46:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f8208005ad0 con 0x7f820c0aacd0 2023-10-24T00:46:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f81fd7fa700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 0x7f81f0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f8208079d50 con 0x7f820c0aacd0 2023-10-24T00:46:49.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f8211440700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 msgr2=0x7f81f0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.975+0000 7f8211440700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 0x7f81f0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:49.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:49.979+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f820804ab90 con 0x7f820c0aacd0 2023-10-24T00:46:50.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.177+0000 7f8211440700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 msgr2=0x7f81f0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:50.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.177+0000 7f8211440700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 0x7f81f0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:50.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.193+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f820c151d70 con 0x7f820c0aacd0 2023-10-24T00:46:50.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.194+0000 7f81fd7fa700 1 -- 172.21.15.148:0/2787025744 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f820c151d70 con 0x7f820c0aacd0 2023-10-24T00:46:50.196 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:50.197 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:46:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 msgr2=0x7f81f0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 0x7f81f0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 msgr2=0x7f820c062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f820800c590 tx=0x7f8208007c90).stop 2023-10-24T00:46:50.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 shutdown_connections 2023-10-24T00:46:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f820c13aa00 0x7f820c062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f820c0695f0 0x7f820c151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f81f005f390 0x7f81f0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 --2- 172.21.15.148:0/2787025744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f820c0aacd0 0x7f820c062650 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 >> 172.21.15.148:0/2787025744 conn(0x7f820c0641f0 msgr2=0x7f820c0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:50.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 shutdown_connections 2023-10-24T00:46:50.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.196+0000 7f82136a4700 1 -- 172.21.15.148:0/2787025744 wait complete. 2023-10-24T00:46:50.201 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:46:50.212 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:46:50.263 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.261+0000 7f03adf52680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:46:50.331 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.329+0000 7f03adf52680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:46:50.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.330+0000 7f183d34c700 1 Processor -- start 2023-10-24T00:46:50.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.330+0000 7f183d34c700 1 -- start start 2023-10-24T00:46:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f183d34c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 0x7f183806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f183d34c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f1838153060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f183d34c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838152bd0 con 0x7f1838151f40 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f183d34c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183806b870 con 0x7f1838065490 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f183d34c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838065920 con 0x7f18380acdd0 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f18377fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f1838153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f18367fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 0x7f183806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f1836ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1838151f40 0x7f18380ac6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:51310/0 (socket says 172.21.15.148:51310) 2023-10-24T00:46:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f1836ffd700 1 -- 172.21.15.148:0/2201543276 learned_addr learned my addr 172.21.15.148:0/2201543276 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.331+0000 7f1835ffb700 1 -- 172.21.15.148:0/2201543276 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085589634 0 0) 0x7f1838152bd0 con 0x7f1838151f40 2023-10-24T00:46:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f1835ffb700 1 -- 172.21.15.148:0/2201543276 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18200033f0 con 0x7f1838151f40 2023-10-24T00:46:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18377fe700 1 -- 172.21.15.148:0/2201543276 >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 msgr2=0x7f183806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:50.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18377fe700 1 --2- 172.21.15.148:0/2201543276 >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 0x7f183806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18377fe700 1 -- 172.21.15.148:0/2201543276 >> v1:172.21.15.150:6789/0 conn(0x7f1838151f40 legacy=0x7f18380ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18377fe700 1 -- 172.21.15.148:0/2201543276 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838065c00 con 0x7f18380acdd0 2023-10-24T00:46:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18367fc700 1 --2- 172.21.15.148:0/2201543276 >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 0x7f183806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:50.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f18377fe700 1 --2- 172.21.15.148:0/2201543276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f1838153060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1830009e60 tx=0x7f1830009780).ready entity=mon.2 client_cookie=ff0bc309be3856a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f1835ffb700 1 -- 172.21.15.148:0/2201543276 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000e070 con 0x7f18380acdd0 2023-10-24T00:46:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f1835ffb700 1 -- 172.21.15.148:0/2201543276 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000bab0 con 0x7f18380acdd0 2023-10-24T00:46:50.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f1835ffb700 1 -- 172.21.15.148:0/2201543276 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000be30 con 0x7f18380acdd0 2023-10-24T00:46:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 -- 172.21.15.148:0/2201543276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 msgr2=0x7f1838153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 --2- 172.21.15.148:0/2201543276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f1838153060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1830009e60 tx=0x7f1830009780).stop 2023-10-24T00:46:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 -- 172.21.15.148:0/2201543276 shutdown_connections 2023-10-24T00:46:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 --2- 172.21.15.148:0/2201543276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f1838153060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 --2- 172.21.15.148:0/2201543276 >> v2:172.21.15.150:3300/0 conn(0x7f1838065490 0x7f183806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 -- 172.21.15.148:0/2201543276 >> 172.21.15.148:0/2201543276 conn(0x7f18380c7d60 msgr2=0x7f18380c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 -- 172.21.15.148:0/2201543276 shutdown_connections 2023-10-24T00:46:50.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.332+0000 7f183d34c700 1 -- 172.21.15.148:0/2201543276 wait complete. 2023-10-24T00:46:50.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 Processor -- start 2023-10-24T00:46:50.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 -- start start 2023-10-24T00:46:50.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f18380a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 0x7f1838164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380a1170 con 0x7f18381456d0 2023-10-24T00:46:50.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380a0560 con 0x7f1838151f40 2023-10-24T00:46:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.334+0000 7f183d34c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18380a0840 con 0x7f18380acdd0 2023-10-24T00:46:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f1836ffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f18380a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18367fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 0x7f1838164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36620/0 (socket says 172.21.15.148:36620) 2023-10-24T00:46:50.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 -- 172.21.15.148:0/212711921 learned_addr learned my addr 172.21.15.148:0/212711921 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 msgr2=0x7f18380a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f18380a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 msgr2=0x7f1838164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 0x7f1838164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 -- 172.21.15.148:0/212711921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009250 con 0x7f18381456d0 2023-10-24T00:46:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f1836ffd700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f18380a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18367fc700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 0x7f1838164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:50.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f18377fe700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f1838065a60 tx=0x7f1830009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830013e40 con 0x7f18381456d0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183001d630 con 0x7f18381456d0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830009a20 con 0x7f18381456d0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183001d9f0 con 0x7f18381456d0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.335+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18380a0e00 con 0x7f18381456d0 2023-10-24T00:46:50.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.336+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18380a12e0 con 0x7f18381456d0 2023-10-24T00:46:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.337+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f1830003040 con 0x7f18381456d0 2023-10-24T00:46:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.337+0000 7f181effd700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 0x7f1824061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.337+0000 7f1836ffd700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 msgr2=0x7f1824061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.337+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7f183007c590 con 0x7f18381456d0 2023-10-24T00:46:50.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.337+0000 7f1836ffd700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 0x7f1824061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:50.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.341+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f183004d2c0 con 0x7f18381456d0 2023-10-24T00:46:50.388 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.385+0000 7f91a0a97680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:46:50.409 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.406+0000 7f03adf52680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:46:50.459 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.457+0000 7f91a0a97680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:46:50.537 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.534+0000 7f91a0a97680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:46:50.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.538+0000 7f1836ffd700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 msgr2=0x7f1824061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:50.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.538+0000 7f1836ffd700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 0x7f1824061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:50.557 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.554+0000 7f03adf52680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:46:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.555+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1838047480 con 0x7f18381456d0 2023-10-24T00:46:50.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.555+0000 7f181effd700 1 -- 172.21.15.148:0/212711921 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f18300508e0 con 0x7f18381456d0 2023-10-24T00:46:50.558 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:50.559 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":37,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:45:28.224722+0000","modified":"2023-10-24T00:45:30.241324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7212},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7212":{"gid":7212,"name":"c","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/321137386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":321137386},{"type":"v1","addr":"172.21.15.148:6835","nonce":321137386}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-24T00:46:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.557+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 msgr2=0x7f1824061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:50.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.557+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 0x7f1824061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 msgr2=0x7f1838165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f1838065a60 tx=0x7f1830009780).stop 2023-10-24T00:46:50.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 shutdown_connections 2023-10-24T00:46:50.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f182405f390 0x7f1824061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18381456d0 0x7f1838165370 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18380acdd0 0x7f18380a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 --2- 172.21.15.148:0/212711921 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838151f40 0x7f1838164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 >> 172.21.15.148:0/212711921 conn(0x7f18380c7d60 msgr2=0x7f18380bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:50.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 shutdown_connections 2023-10-24T00:46:50.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.558+0000 7f183d34c700 1 -- 172.21.15.148:0/212711921 wait complete. 2023-10-24T00:46:50.563 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 37 2023-10-24T00:46:50.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:46:50.627 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.624+0000 7f03adf52680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:46:50.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.688+0000 7fc62df85700 1 Processor -- start 2023-10-24T00:46:50.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.688+0000 7fc62df85700 1 -- start start 2023-10-24T00:46:50.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc62df85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62815f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc62df85700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6280bf5c0 con 0x7fc6280bfa50 2023-10-24T00:46:50.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc62df85700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6280a86d0 con 0x7fc6281543a0 2023-10-24T00:46:50.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc62df85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280be9b0 con 0x7fc6280964f0 2023-10-24T00:46:50.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc61effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc6280bfa50 0x7fc628095de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44258/0 (socket says 172.21.15.148:44258) 2023-10-24T00:46:50.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.689+0000 7fc61effd700 1 -- 172.21.15.148:0/4239479290 learned_addr learned my addr 172.21.15.148:0/4239479290 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:50.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc627fff700 1 --2- 172.21.15.148:0/4239479290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62815f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490483124 0 0) 0x7fc6280bf5c0 con 0x7fc6280bfa50 2023-10-24T00:46:50.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6140033f0 con 0x7fc6280bfa50 2023-10-24T00:46:50.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363638292 0 0) 0x7fc6280a86d0 con 0x7fc6281543a0 2023-10-24T00:46:50.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6280bf5c0 con 0x7fc6281543a0 2023-10-24T00:46:50.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170983219 0 0) 0x7fc6140033f0 con 0x7fc6280bfa50 2023-10-24T00:46:50.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc627fff700 1 -- 172.21.15.148:0/4239479290 >> v1:172.21.15.150:6789/0 conn(0x7fc6281543a0 legacy=0x7fc6280a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc627fff700 1 -- 172.21.15.148:0/4239479290 >> v1:172.21.15.148:6789/0 conn(0x7fc6280bfa50 legacy=0x7fc628095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc627fff700 1 -- 172.21.15.148:0/4239479290 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280bec90 con 0x7fc6280964f0 2023-10-24T00:46:50.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc627fff700 1 --2- 172.21.15.148:0/4239479290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62815f4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fc620009e90 tx=0x7fc620009780).ready entity=mon.2 client_cookie=3c287c559b54b3de server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:50.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62000e070 con 0x7fc6280964f0 2023-10-24T00:46:50.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62000b830 con 0x7fc6280964f0 2023-10-24T00:46:50.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.690+0000 7fc626ffd700 1 -- 172.21.15.148:0/4239479290 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610001470 con 0x7fc6280964f0 2023-10-24T00:46:50.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 -- 172.21.15.148:0/4239479290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 msgr2=0x7fc62815f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 --2- 172.21.15.148:0/4239479290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62815f4f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fc620009e90 tx=0x7fc620009780).stop 2023-10-24T00:46:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 -- 172.21.15.148:0/4239479290 shutdown_connections 2023-10-24T00:46:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 --2- 172.21.15.148:0/4239479290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62815f4f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 -- 172.21.15.148:0/4239479290 >> 172.21.15.148:0/4239479290 conn(0x7fc6280630f0 msgr2=0x7fc6280c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 -- 172.21.15.148:0/4239479290 shutdown_connections 2023-10-24T00:46:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.691+0000 7fc62df85700 1 -- 172.21.15.148:0/4239479290 wait complete. 2023-10-24T00:46:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.692+0000 7fc62df85700 1 Processor -- start 2023-10-24T00:46:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.692+0000 7fc62df85700 1 -- start start 2023-10-24T00:46:50.707 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.693+0000 7f91a0a97680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:46:50.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6281543a0 0x7fc62814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62814f130 con 0x7fc6280bfa50 2023-10-24T00:46:50.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280a90b0 con 0x7fc6281543a0 2023-10-24T00:46:50.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc62df85700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc628168980 con 0x7fc6280964f0 2023-10-24T00:46:50.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36624/0 (socket says 172.21.15.148:36624) 2023-10-24T00:46:50.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 -- 172.21.15.148:0/1749722716 learned_addr learned my addr 172.21.15.148:0/1749722716 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:50.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc6277fe700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc627fff700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6281543a0 0x7fc62814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:50.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 -- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 msgr2=0x7fc62814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 -- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6281543a0 msgr2=0x7fc62814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6281543a0 0x7fc62814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.693+0000 7fc61effd700 1 -- 172.21.15.148:0/1749722716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620009a20 con 0x7fc6280bfa50 2023-10-24T00:46:50.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc61effd700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fc61000c810 tx=0x7fc610001620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:50.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100072e0 con 0x7fc6280bfa50 2023-10-24T00:46:50.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610007440 con 0x7fc6280bfa50 2023-10-24T00:46:50.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6280a8a60 con 0x7fc6280bfa50 2023-10-24T00:46:50.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100057a0 con 0x7fc6280bfa50 2023-10-24T00:46:50.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.694+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62814d1d0 con 0x7fc6280bfa50 2023-10-24T00:46:50.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.695+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6280a88c0 con 0x7fc6280bfa50 2023-10-24T00:46:50.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.696+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fc610005b50 con 0x7fc6280bfa50 2023-10-24T00:46:50.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.696+0000 7fc61ffff700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 0x7fc608061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:50.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.696+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7fc61007a120 con 0x7fc6280bfa50 2023-10-24T00:46:50.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.696+0000 7fc6277fe700 1 -- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 msgr2=0x7fc608061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:50.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.696+0000 7fc6277fe700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 0x7fc608061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:50.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.700+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc6280a88c0 con 0x7fc6280bfa50 2023-10-24T00:46:50.743 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.740+0000 7f03adf52680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:46:50.770 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.768+0000 7f91a0a97680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:46:50.852 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:50.850+0000 7f03adf52680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:46:50.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.872+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6280a8890 con 0x7fc6280bfa50 2023-10-24T00:46:50.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.873+0000 7fc61ffff700 1 -- 172.21.15.148:0/1749722716 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17604 (secure 0 0 0) 0x7fc610018020 con 0x7fc6280bfa50 2023-10-24T00:46:50.876 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:50.876 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":114,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:46:45.951416+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:45:26.401463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-24T00:45:27.190495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.0","mappings":[{"from":1,"to":3}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:6832/87479":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1030073262":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1926917274":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/1462183038":"2023-10-25T00:45:44.308567+0000","172.21.15.150:0/213814605":"2023-10-25T00:45:44.308567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:46:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 msgr2=0x7fc608061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 0x7fc608061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 msgr2=0x7fc62814e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:50.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fc61000c810 tx=0x7fc610001620).stop 2023-10-24T00:46:50.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 shutdown_connections 2023-10-24T00:46:50.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6281543a0 0x7fc62814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6280964f0 0x7fc62814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc60805f360 0x7fc608061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:50.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 --2- 172.21.15.148:0/1749722716 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6280bfa50 0x7fc62814e750 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:50.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 >> 172.21.15.148:0/1749722716 conn(0x7fc6280630f0 msgr2=0x7fc628066830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:50.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 shutdown_connections 2023-10-24T00:46:50.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:50.875+0000 7fc62df85700 1 -- 172.21.15.148:0/1749722716 wait complete. 2023-10-24T00:46:50.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:46:50.891 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:50.889+0000 7f91a0a97680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:46:51.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.006+0000 7fef2d148700 1 Processor -- start 2023-10-24T00:46:51.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.006+0000 7fef2d148700 1 -- start start 2023-10-24T00:46:51.009 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:51.007+0000 7f91a0a97680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:46:51.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2d148700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef280a6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2d148700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef280a8330 0x7fef280c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2d148700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280a75f0 con 0x7fef280beb30 2023-10-24T00:46:51.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2d148700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef28152570 con 0x7fef280a8330 2023-10-24T00:46:51.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2d148700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280a69e0 con 0x7fef280c8650 2023-10-24T00:46:51.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef277fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fef280beb30 0x7fef280a7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44274/0 (socket says 172.21.15.148:44274) 2023-10-24T00:46:51.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef277fe700 1 -- 172.21.15.148:0/2249261978 learned_addr learned my addr 172.21.15.148:0/2249261978 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:51.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef27fff700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef280a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:51.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef2c947700 1 --2- 172.21.15.148:0/2249261978 >> v2:172.21.15.150:3300/0 conn(0x7fef280a8330 0x7fef280c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:51.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.007+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896161555 0 0) 0x7fef280a75f0 con 0x7fef280beb30 2023-10-24T00:46:51.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef100033f0 con 0x7fef280beb30 2023-10-24T00:46:51.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef2c947700 1 -- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 msgr2=0x7fef280a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:51.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef2c947700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef280a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:51.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355080726 0 0) 0x7fef100033f0 con 0x7fef280beb30 2023-10-24T00:46:51.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef2c947700 1 -- 172.21.15.148:0/2249261978 >> v1:172.21.15.148:6789/0 conn(0x7fef280beb30 legacy=0x7fef280a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:51.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef2c947700 1 -- 172.21.15.148:0/2249261978 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280a6cc0 con 0x7fef280a8330 2023-10-24T00:46:51.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef27fff700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef280a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:51.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef2c947700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280a8330 0x7fef280c6c30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fef20009e60 tx=0x7fef20009780).ready entity=mon.1 client_cookie=190b3646fa0460dd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:51.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2000e070 con 0x7fef280a8330 2023-10-24T00:46:51.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2000b7a0 con 0x7fef280a8330 2023-10-24T00:46:51.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.008+0000 7fef26ffd700 1 -- 172.21.15.148:0/2249261978 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18001470 con 0x7fef280a8330 2023-10-24T00:46:51.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 -- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280a8330 msgr2=0x7fef280c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:51.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280a8330 0x7fef280c6c30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fef20009e60 tx=0x7fef20009780).stop 2023-10-24T00:46:51.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 -- 172.21.15.148:0/2249261978 shutdown_connections 2023-10-24T00:46:51.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280a8330 0x7fef280c6c30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:51.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 --2- 172.21.15.148:0/2249261978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef280a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:51.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 -- 172.21.15.148:0/2249261978 >> 172.21.15.148:0/2249261978 conn(0x7fef28092330 msgr2=0x7fef28062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:51.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 -- 172.21.15.148:0/2249261978 shutdown_connections 2023-10-24T00:46:51.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.009+0000 7fef2d148700 1 -- 172.21.15.148:0/2249261978 wait complete. 2023-10-24T00:46:51.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.010+0000 7fef2d148700 1 Processor -- start 2023-10-24T00:46:51.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.010+0000 7fef2d148700 1 -- start start 2023-10-24T00:46:51.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280beb30 0x7fef280bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef28140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c2ff0 con 0x7fef280a8330 2023-10-24T00:46:51.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28063760 con 0x7fef280beb30 2023-10-24T00:46:51.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c0050 con 0x7fef280c8650 2023-10-24T00:46:51.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:51.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36640/0 (socket says 172.21.15.148:36640) 2023-10-24T00:46:51.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 -- 172.21.15.148:0/2263653511 learned_addr learned my addr 172.21.15.148:0/2263653511 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:51.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef277fe700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280beb30 0x7fef280bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:51.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2c947700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef28140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:51.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 msgr2=0x7fef28140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:51.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef28140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:51.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280beb30 msgr2=0x7fef280bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280beb30 0x7fef280bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 -- 172.21.15.148:0/2263653511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0092a0 con 0x7fef280a8330 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef27fff700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fef1c00ea20 tx=0x7fef1c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00ee60 con 0x7fef280a8330 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c009600 con 0x7fef280a8330 2023-10-24T00:46:51.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef20009a20 con 0x7fef280a8330 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00ca60 con 0x7fef280a8330 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.011+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef280c02b0 con 0x7fef280a8330 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fef1c01b400 con 0x7fef280a8330 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef280c3190 con 0x7fef280a8330 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef0ffff700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 0x7fef14061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:51.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6524+0+0 (secure 0 0 0) 0x7fef1c07ab30 con 0x7fef280a8330 2023-10-24T00:46:51.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef277fe700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 msgr2=0x7fef14061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:51.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.013+0000 7fef277fe700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 0x7fef14061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:46:51.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.017+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef1c04f340 con 0x7fef280a8330 2023-10-24T00:46:51.147 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.144+0000 7f03adf52680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:46:51.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.214+0000 7fef277fe700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 msgr2=0x7fef14061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:46:51.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.214+0000 7fef277fe700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 0x7fef14061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:46:51.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.217+0000 7f03adf52680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:46:51.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.232+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef280a6fa0 con 0x7fef280a8330 2023-10-24T00:46:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.238+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 46) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fef1c078470 con 0x7fef280a8330 2023-10-24T00:46:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.238+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 msgr2=0x7fef14061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:46:51.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:51.238+0000 7fef0ffff700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 0x7fef14061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:51.298 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f032b6eb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.298 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f032b6eb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.298 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f032b6eb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f032b6eb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f032b6eb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f03286e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f03286e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f03286e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f03286e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.300 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:46:51.295+0000 7f03286e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:46:51.300 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:46:51.300 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:46:51.301 INFO:tasks.ceph.mds.c.smithi148.stderr:2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:46:51.305 INFO:tasks.ceph.mds.c.smithi148.stderr: -5871> 2023-10-24T00:45:33.733+0000 7f4cef2ad700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:46:51.311 INFO:tasks.ceph.mds.c.smithi148.stderr: -4> 2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:46:51.311 INFO:tasks.ceph.mds.c.smithi148.stderr: -3> 2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:46:51.311 INFO:tasks.ceph.mds.c.smithi148.stderr: -1> 2023-10-24T00:46:51.298+0000 7f4cebaa6700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:46:51.321 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:51.319+0000 7f91a0a97680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:46:51.330 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:46:51.396 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:46:51.394+0000 7f91a0a97680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:46:52.235 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:46:52.233+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:46:52.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.235+0000 7fef0ffff700 1 -- 172.21.15.148:0/2263653511 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef1c06de60 con 0x7fef280a8330 2023-10-24T00:46:52.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 msgr2=0x7fef280c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:52.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fef1c00ea20 tx=0x7fef1c009060).stop 2023-10-24T00:46:52.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 shutdown_connections 2023-10-24T00:46:52.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef280c8650 0x7fef28140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef1405f390 0x7fef14061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:52.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef280a8330 0x7fef280c2b00 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 --2- 172.21.15.148:0/2263653511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef280beb30 0x7fef280bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 >> 172.21.15.148:0/2263653511 conn(0x7fef28092330 msgr2=0x7fef28067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:52.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 shutdown_connections 2023-10-24T00:46:52.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.238+0000 7fef2d148700 1 -- 172.21.15.148:0/2263653511 wait complete. 2023-10-24T00:46:52.243 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:46:52.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:46:52.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.372+0000 7fbdc7750700 1 Processor -- start 2023-10-24T00:46:52.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.372+0000 7fbdc7750700 1 -- start start 2023-10-24T00:46:52.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc7750700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 0x7fbdc0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc7750700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbdc00bffd0 0x7fbdc00c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc7750700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00c0970 con 0x7fbdc0154430 2023-10-24T00:46:52.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc7750700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00c6a10 con 0x7fbdc00bffd0 2023-10-24T00:46:52.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc7750700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c71d0 con 0x7fbdc0098bd0 2023-10-24T00:46:52.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc5ced700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbdc00bffd0 0x7fbdc00c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc54ec700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbdc0154430 0x7fbdc00c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44282/0 (socket says 172.21.15.148:44282) 2023-10-24T00:46:52.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.373+0000 7fbdc54ec700 1 -- 172.21.15.148:0/3808916997 learned_addr learned my addr 172.21.15.148:0/3808916997 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:52.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc5ced700 1 -- 172.21.15.148:0/3808916997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 msgr2=0x7fbdc0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:52.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc4ceb700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 0x7fbdc0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc5ced700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 0x7fbdc0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc5ced700 1 -- 172.21.15.148:0/3808916997 >> v1:172.21.15.148:6789/0 conn(0x7fbdc0154430 legacy=0x7fbdc00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:52.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdbffff700 1 -- 172.21.15.148:0/3808916997 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778028662 0 0) 0x7fbdb0001490 con 0x7fbdc0154430 2023-10-24T00:46:52.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc5ced700 1 -- 172.21.15.148:0/3808916997 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00c9410 con 0x7fbdc00bffd0 2023-10-24T00:46:52.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc4ceb700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 0x7fbdc0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:46:52.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc5ced700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00c0480 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fbdb8009790 tx=0x7fbdb8009060).ready entity=mon.0 client_cookie=41edb447b1f7fd64 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:52.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdbffff700 1 -- 172.21.15.148:0/3808916997 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800b580 con 0x7fbdc00bffd0 2023-10-24T00:46:52.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdbffff700 1 -- 172.21.15.148:0/3808916997 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800b6e0 con 0x7fbdc00bffd0 2023-10-24T00:46:52.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdbffff700 1 -- 172.21.15.148:0/3808916997 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800ba60 con 0x7fbdc00bffd0 2023-10-24T00:46:52.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 -- 172.21.15.148:0/3808916997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 msgr2=0x7fbdc00c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:52.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00c0480 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fbdb8009790 tx=0x7fbdb8009060).stop 2023-10-24T00:46:52.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 -- 172.21.15.148:0/3808916997 shutdown_connections 2023-10-24T00:46:52.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00c0480 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 --2- 172.21.15.148:0/3808916997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0098bd0 0x7fbdc0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.374+0000 7fbdc7750700 1 -- 172.21.15.148:0/3808916997 >> 172.21.15.148:0/3808916997 conn(0x7fbdc00cb070 msgr2=0x7fbdc00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:52.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.375+0000 7fbdc7750700 1 -- 172.21.15.148:0/3808916997 shutdown_connections 2023-10-24T00:46:52.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.375+0000 7fbdc7750700 1 -- 172.21.15.148:0/3808916997 wait complete. 2023-10-24T00:46:52.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 Processor -- start 2023-10-24T00:46:52.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 -- start start 2023-10-24T00:46:52.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 0x7fbdc00ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0154430 0x7fbdc013a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00aab00 con 0x7fbdc00bffd0 2023-10-24T00:46:52.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00b0e90 con 0x7fbdc0098bd0 2023-10-24T00:46:52.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.376+0000 7fbdc7750700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00aad10 con 0x7fbdc0154430 2023-10-24T00:46:52.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36658/0 (socket says 172.21.15.148:36658) 2023-10-24T00:46:52.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 -- 172.21.15.148:0/351126526 learned_addr learned my addr 172.21.15.148:0/351126526 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:52.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc54ec700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 0x7fbdc00ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc5ced700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0154430 0x7fbdc013a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 -- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0154430 msgr2=0x7fbdc013a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:52.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0154430 0x7fbdc013a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 -- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 msgr2=0x7fbdc00ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 0x7fbdc00ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 -- 172.21.15.148:0/351126526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80092a0 con 0x7fbdc00bffd0 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc54ec700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 0x7fbdc00ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc4ceb700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fbdb400c880 tx=0x7fbdb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4010580 con 0x7fbdc00bffd0 2023-10-24T00:46:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb40106e0 con 0x7fbdc00bffd0 2023-10-24T00:46:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc00aaff0 con 0x7fbdc00bffd0 2023-10-24T00:46:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4010a60 con 0x7fbdc00bffd0 2023-10-24T00:46:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.377+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc00ae800 con 0x7fbdc00bffd0 2023-10-24T00:46:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.378+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc00ab510 con 0x7fbdc00bffd0 2023-10-24T00:46:52.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.378+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fbdb401b460 con 0x7fbdc00bffd0 2023-10-24T00:46:52.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.379+0000 7fbdbd7fa700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 0x7fbdac061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:52.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.379+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6868+0+0 (secure 0 0 0) 0x7fbdb407a2a0 con 0x7fbdc00bffd0 2023-10-24T00:46:52.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.379+0000 7fbdc54ec700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 0x7fbdac061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:52.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.379+0000 7fbdc54ec700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 0x7fbdac061520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbdb0001e10 tx=0x7fbdb0009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:52.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.383+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbdc00ab510 con 0x7fbdc00bffd0 2023-10-24T00:46:52.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:52.586+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbdc00ab510 con 0x7fbdc00bffd0 2023-10-24T00:46:53.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.249+0000 7fbdbd7fa700 1 -- 172.21.15.148:0/351126526 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbdc00ab510 con 0x7fbdc00bffd0 2023-10-24T00:46:53.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 msgr2=0x7fbdac061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 0x7fbdac061520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbdb0001e10 tx=0x7fbdb0009040).stop 2023-10-24T00:46:53.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 msgr2=0x7fbdc00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7fbdb400c880 tx=0x7fbdb4008040).stop 2023-10-24T00:46:53.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 shutdown_connections 2023-10-24T00:46:53.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdc0154430 0x7fbdc013a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdc0098bd0 0x7fbdc00ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbdac05f060 0x7fbdac061520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 --2- 172.21.15.148:0/351126526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdc00bffd0 0x7fbdc00b0630 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 >> 172.21.15.148:0/351126526 conn(0x7fbdc00cb070 msgr2=0x7fbdc014fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:53.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 shutdown_connections 2023-10-24T00:46:53.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.251+0000 7fbdc7750700 1 -- 172.21.15.148:0/351126526 wait complete. 2023-10-24T00:46:53.266 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:46:53.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.383+0000 7fe0ecf2e700 1 Processor -- start 2023-10-24T00:46:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.383+0000 7fe0ecf2e700 1 -- start start 2023-10-24T00:46:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ecf2e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0e81526a0 0x7fe0e8063080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ecf2e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 0x7fe0e80a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ecf2e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8152eb0 con 0x7fe0e81522c0 2023-10-24T00:46:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ecf2e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e8153790 con 0x7fe0e81526a0 2023-10-24T00:46:53.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ecf2e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80c5eb0 con 0x7fe0e8153340 2023-10-24T00:46:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe0e81522c0 0x7fe0e80c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49712/0 (socket says 172.21.15.148:49712) 2023-10-24T00:46:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ddd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0e81526a0 0x7fe0e8063080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e659c700 1 -- 172.21.15.148:0/1567213101 learned_addr learned my addr 172.21.15.148:0/1567213101 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e5d9b700 1 -- 172.21.15.148:0/1567213101 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920076681 0 0) 0x7fe0e8152eb0 con 0x7fe0e81522c0 2023-10-24T00:46:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e5d9b700 1 -- 172.21.15.148:0/1567213101 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d40033f0 con 0x7fe0e81522c0 2023-10-24T00:46:53.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e6d9d700 1 --2- 172.21.15.148:0/1567213101 >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 0x7fe0e80a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/1567213101 >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 msgr2=0x7fe0e80a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:53.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ddd9b700 1 --2- 172.21.15.148:0/1567213101 >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 0x7fe0e80a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/1567213101 >> v1:172.21.15.148:6789/0 conn(0x7fe0e81522c0 legacy=0x7fe0e80c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/1567213101 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80c6190 con 0x7fe0e81526a0 2023-10-24T00:46:53.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.384+0000 7fe0e6d9d700 1 --2- 172.21.15.148:0/1567213101 >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 0x7fe0e80a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:46:53.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ddd9b700 1 --2- 172.21.15.148:0/1567213101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e8063080 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fe0e806a4c0 tx=0x7fe0d0009060).ready entity=mon.0 client_cookie=420781296d449b2d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:53.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0e5d9b700 1 -- 172.21.15.148:0/1567213101 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000f510 con 0x7fe0e81526a0 2023-10-24T00:46:53.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0e5d9b700 1 -- 172.21.15.148:0/1567213101 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000f670 con 0x7fe0e81526a0 2023-10-24T00:46:53.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0e5d9b700 1 -- 172.21.15.148:0/1567213101 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000f9f0 con 0x7fe0e81526a0 2023-10-24T00:46:53.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/1567213101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 msgr2=0x7fe0e8063080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/1567213101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e8063080 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fe0e806a4c0 tx=0x7fe0d0009060).stop 2023-10-24T00:46:53.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/1567213101 shutdown_connections 2023-10-24T00:46:53.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/1567213101 >> v2:172.21.15.150:3300/0 conn(0x7fe0e8153340 0x7fe0e80a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/1567213101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e8063080 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/1567213101 >> 172.21.15.148:0/1567213101 conn(0x7fe0e8082f60 msgr2=0x7fe0e8092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:53.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/1567213101 shutdown_connections 2023-10-24T00:46:53.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.385+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/1567213101 wait complete. 2023-10-24T00:46:53.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.386+0000 7fe0ecf2e700 1 Processor -- start 2023-10-24T00:46:53.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 -- start start 2023-10-24T00:46:53.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0e81522c0 0x7fe0e8092d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0e8153340 0x7fe0e80ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8095570 con 0x7fe0e81526a0 2023-10-24T00:46:53.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8095850 con 0x7fe0e8153340 2023-10-24T00:46:53.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ecf2e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8095b30 con 0x7fe0e81522c0 2023-10-24T00:46:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ddd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ddd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35776/0 (socket says 172.21.15.148:35776) 2023-10-24T00:46:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.387+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/567838440 learned_addr learned my addr 172.21.15.148:0/567838440 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0e6d9d700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0e8153340 0x7fe0e80ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0e659c700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0e81522c0 0x7fe0e8092d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0e81522c0 msgr2=0x7fe0e8092d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0e81522c0 0x7fe0e8092d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0e8153340 msgr2=0x7fe0e80ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0e8153340 0x7fe0e80ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 -- 172.21.15.148:0/567838440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d00092a0 con 0x7fe0e81526a0 2023-10-24T00:46:53.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ddd9b700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fe0d0009dd0 tx=0x7fe0d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000f9f0 con 0x7fe0e81526a0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0000c90 con 0x7fe0e81526a0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e814fcb0 con 0x7fe0e81526a0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001b660 con 0x7fe0e81526a0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.388+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e8096210 con 0x7fe0e81526a0 2023-10-24T00:46:53.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.389+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e81501d0 con 0x7fe0e81526a0 2023-10-24T00:46:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.389+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fe0d001b9d0 con 0x7fe0e81526a0 2023-10-24T00:46:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.390+0000 7fe0deffd700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 0x7fe0c8061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.390+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6868+0+0 (secure 0 0 0) 0x7fe0d007bae0 con 0x7fe0e81526a0 2023-10-24T00:46:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.390+0000 7fe0e659c700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 0x7fe0c8061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:53.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.390+0000 7fe0e659c700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 0x7fe0c8061520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe0d8005750 tx=0x7fe0d8009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:53.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.394+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0e81501d0 con 0x7fe0e81526a0 2023-10-24T00:46:53.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.560+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0e81501d0 con 0x7fe0e81526a0 2023-10-24T00:46:53.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:53.969+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe0d0079790 con 0x7fe0e81526a0 2023-10-24T00:46:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.255+0000 7fe0deffd700 1 -- 172.21.15.148:0/567838440 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe0d00429d0 con 0x7fe0e81526a0 2023-10-24T00:46:54.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.259+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 msgr2=0x7fe0c8061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.259+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 0x7fe0c8061520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe0d8005750 tx=0x7fe0d8009040).stop 2023-10-24T00:46:54.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.259+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 msgr2=0x7fe0e814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.259+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fe0d0009dd0 tx=0x7fe0d0017000).stop 2023-10-24T00:46:54.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 shutdown_connections 2023-10-24T00:46:54.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0e8153340 0x7fe0e80ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0e81522c0 0x7fe0e8092d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0c805f060 0x7fe0c8061520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 --2- 172.21.15.148:0/567838440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0e81526a0 0x7fe0e814dbb0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 >> 172.21.15.148:0/567838440 conn(0x7fe0e8082f60 msgr2=0x7fe0e80c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:54.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 shutdown_connections 2023-10-24T00:46:54.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.260+0000 7fe0ecf2e700 1 -- 172.21.15.148:0/567838440 wait complete. 2023-10-24T00:46:54.265 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:46:54.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:46:54.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.394+0000 7f02eef5b700 1 Processor -- start 2023-10-24T00:46:54.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.394+0000 7f02eef5b700 1 -- start start 2023-10-24T00:46:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eef5b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02e80aa640 0x7f02e80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eef5b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80c6270 con 0x7f02e81544b0 2023-10-24T00:46:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eef5b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80c0c80 con 0x7f02e80a7d00 2023-10-24T00:46:54.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eef5b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80c60e0 con 0x7f02e80aa640 2023-10-24T00:46:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eccf7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f02e81544b0 0x7f02e80c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49728/0 (socket says 172.21.15.148:49728) 2023-10-24T00:46:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02eccf7700 1 -- 172.21.15.148:0/1351378074 learned_addr learned my addr 172.21.15.148:0/1351378074 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> v2:172.21.15.150:3300/0 conn(0x7f02e80aa640 0x7f02e80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322340654 0 0) 0x7f02e80c6270 con 0x7f02e81544b0 2023-10-24T00:46:54.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.395+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d00033f0 con 0x7f02e81544b0 2023-10-24T00:46:54.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070497501 0 0) 0x7f02d00033f0 con 0x7f02e81544b0 2023-10-24T00:46:54.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 >> v2:172.21.15.150:3300/0 conn(0x7f02e80aa640 msgr2=0x7f02e80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:54.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 --2- 172.21.15.148:0/1351378074 >> v2:172.21.15.150:3300/0 conn(0x7f02e80aa640 0x7f02e80c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 >> v1:172.21.15.150:6789/0 conn(0x7f02e80a7d00 legacy=0x7f02e80a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80c0f40 con 0x7f02e81544b0 2023-10-24T00:46:54.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f02e4001470 con 0x7f02e81544b0 2023-10-24T00:46:54.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> v2:172.21.15.150:3300/0 conn(0x7f02e80aa640 0x7f02e80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:54.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 >> v1:172.21.15.148:6789/0 conn(0x7f02e81544b0 legacy=0x7f02e80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d00038e0 0x7f02d0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02d0004690 0x7f02d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 0x7f02d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c60e0 con 0x7f02d0005000 2023-10-24T00:46:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d000beb0 con 0x7f02d0004690 2023-10-24T00:46:54.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d000c070 con 0x7f02d00038e0 2023-10-24T00:46:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 0x7f02d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02dffff700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02d0004690 0x7f02d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02eccf7700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d00038e0 0x7f02d0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 -- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d00038e0 msgr2=0x7f02d0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:54.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d00038e0 0x7f02d0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 -- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02d0004690 msgr2=0x7f02d0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02d0004690 0x7f02d0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 -- 172.21.15.148:0/1351378074 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00033f0 con 0x7f02d0005000 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 -- 172.21.15.148:0/1351378074 reap_dead start 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 0x7f02d000b8e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f02e000e3c0 tx=0x7f02e000b040).ready entity=mon.0 client_cookie=b60f517b77228823 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:54.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0017070 con 0x7f02d0005000 2023-10-24T00:46:54.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000f040 con 0x7f02d0005000 2023-10-24T00:46:54.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.396+0000 7f02df7fe700 1 -- 172.21.15.148:0/1351378074 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000eea0 con 0x7f02d0005000 2023-10-24T00:46:54.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 -- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 msgr2=0x7f02d000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 0x7f02d000b8e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f02e000e3c0 tx=0x7f02e000b040).stop 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 -- 172.21.15.148:0/1351378074 shutdown_connections 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 --2- 172.21.15.148:0/1351378074 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02d0005000 0x7f02d000b8e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 -- 172.21.15.148:0/1351378074 >> 172.21.15.148:0/1351378074 conn(0x7f02e80945d0 msgr2=0x7f02e806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 -- 172.21.15.148:0/1351378074 shutdown_connections 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.397+0000 7f02eef5b700 1 -- 172.21.15.148:0/1351378074 wait complete. 2023-10-24T00:46:54.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.398+0000 7f02eef5b700 1 Processor -- start 2023-10-24T00:46:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.398+0000 7f02eef5b700 1 -- start start 2023-10-24T00:46:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d0005000 0x7f02e8153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e814f120 0x7f02e80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80ae4b0 con 0x7f02e80adf80 2023-10-24T00:46:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80ae790 con 0x7f02e814f120 2023-10-24T00:46:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eef5b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80aea70 con 0x7f02d0005000 2023-10-24T00:46:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35786/0 (socket says 172.21.15.148:35786) 2023-10-24T00:46:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 -- 172.21.15.148:0/406313081 learned_addr learned my addr 172.21.15.148:0/406313081 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02ed4f8700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e814f120 0x7f02e80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02eccf7700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d0005000 0x7f02e8153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 -- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d0005000 msgr2=0x7f02e8153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d0005000 0x7f02e8153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 -- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e814f120 msgr2=0x7f02e80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e814f120 0x7f02e80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.399+0000 7f02dffff700 1 -- 172.21.15.148:0/406313081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80aed50 con 0x7f02e80adf80 2023-10-24T00:46:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02dffff700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f02d8003f10 tx=0x7f02d8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80114c0 con 0x7f02e80adf80 2023-10-24T00:46:54.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8011620 con 0x7f02e80adf80 2023-10-24T00:46:54.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e8153c40 con 0x7f02e80adf80 2023-10-24T00:46:54.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80119a0 con 0x7f02e80adf80 2023-10-24T00:46:54.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.400+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80afff0 con 0x7f02e80adf80 2023-10-24T00:46:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.401+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e806c6b0 con 0x7f02e80adf80 2023-10-24T00:46:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.401+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f02d8011d50 con 0x7f02e80adf80 2023-10-24T00:46:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.401+0000 7f02dcff9700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 0x7f02d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.402+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f02d8079b80 con 0x7f02e80adf80 2023-10-24T00:46:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.402+0000 7f02eccf7700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 0x7f02d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.402+0000 7f02eccf7700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 0x7f02d4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02e4001ed0 tx=0x7f02e8085380).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.406+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f02d8049af0 con 0x7f02e80adf80 2023-10-24T00:46:54.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:54.568+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02e80c1220 con 0x7f02e80adf80 2023-10-24T00:46:55.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.262+0000 7f02dcff9700 1 -- 172.21.15.148:0/406313081 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02d804e810 con 0x7f02e80adf80 2023-10-24T00:46:55.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 msgr2=0x7f02d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 0x7f02d4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f02e4001ed0 tx=0x7f02e8085380).stop 2023-10-24T00:46:55.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 msgr2=0x7f02e814ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f02d8003f10 tx=0x7f02d8007bb0).stop 2023-10-24T00:46:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 shutdown_connections 2023-10-24T00:46:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02e814f120 0x7f02e80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02d0005000 0x7f02e8153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f02d405f150 0x7f02d4061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 --2- 172.21.15.148:0/406313081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02e80adf80 0x7f02e814ec30 secure :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0x7f02d8003f10 tx=0x7f02d8007bb0).stop 2023-10-24T00:46:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 >> 172.21.15.148:0/406313081 conn(0x7f02e80945d0 msgr2=0x7f02e80c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 shutdown_connections 2023-10-24T00:46:55.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.265+0000 7f02eef5b700 1 -- 172.21.15.148:0/406313081 wait complete. 2023-10-24T00:46:55.271 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:46:55.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:46:55.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.398+0000 7f82be69d700 1 Processor -- start 2023-10-24T00:46:55.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.398+0000 7f82be69d700 1 -- start start 2023-10-24T00:46:55.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82be69d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82b8154430 0x7f82b8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82be69d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80c71d0 con 0x7f82b80bffd0 2023-10-24T00:46:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82be69d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80c9410 con 0x7f82b8098bd0 2023-10-24T00:46:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82be69d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b80c6a10 con 0x7f82b8154430 2023-10-24T00:46:55.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82bcc3a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f82b80bffd0 0x7f82b815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49738/0 (socket says 172.21.15.148:49738) 2023-10-24T00:46:55.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82bcc3a700 1 -- 172.21.15.148:0/2323867938 learned_addr learned my addr 172.21.15.148:0/2323867938 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:55.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82b7fff700 1 --2- 172.21.15.148:0/2323867938 >> v2:172.21.15.150:3300/0 conn(0x7f82b8154430 0x7f82b8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.399+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209840625 0 0) 0x7f82b80c71d0 con 0x7f82b80bffd0 2023-10-24T00:46:55.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a00033f0 con 0x7f82b80bffd0 2023-10-24T00:46:55.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810329010 0 0) 0x7f82b80c9410 con 0x7f82b8098bd0 2023-10-24T00:46:55.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b80c71d0 con 0x7f82b8098bd0 2023-10-24T00:46:55.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3711024470 0 0) 0x7f82a00033f0 con 0x7f82b80bffd0 2023-10-24T00:46:55.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b7fff700 1 -- 172.21.15.148:0/2323867938 >> v1:172.21.15.150:6789/0 conn(0x7f82b8098bd0 legacy=0x7f82b80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b7fff700 1 -- 172.21.15.148:0/2323867938 >> v1:172.21.15.148:6789/0 conn(0x7f82b80bffd0 legacy=0x7f82b815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b7fff700 1 -- 172.21.15.148:0/2323867938 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80ca8b0 con 0x7f82b8154430 2023-10-24T00:46:55.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b7fff700 1 --2- 172.21.15.148:0/2323867938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8154430 0x7f82b8154810 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f82a8009760 tx=0x7f82a8009060).ready entity=mon.1 client_cookie=dd12b08477be470e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b00017f0 con 0x7f82b8154430 2023-10-24T00:46:55.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8011400 con 0x7f82b8154430 2023-10-24T00:46:55.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.400+0000 7f82b6ffd700 1 -- 172.21.15.148:0/2323867938 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011780 con 0x7f82b8154430 2023-10-24T00:46:55.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 -- 172.21.15.148:0/2323867938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8154430 msgr2=0x7f82b8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 --2- 172.21.15.148:0/2323867938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8154430 0x7f82b8154810 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f82a8009760 tx=0x7f82a8009060).stop 2023-10-24T00:46:55.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 -- 172.21.15.148:0/2323867938 shutdown_connections 2023-10-24T00:46:55.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 --2- 172.21.15.148:0/2323867938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8154430 0x7f82b8154810 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 -- 172.21.15.148:0/2323867938 >> 172.21.15.148:0/2323867938 conn(0x7f82b80cb070 msgr2=0x7f82b80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:55.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 -- 172.21.15.148:0/2323867938 shutdown_connections 2023-10-24T00:46:55.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.401+0000 7f82be69d700 1 -- 172.21.15.148:0/2323867938 wait complete. 2023-10-24T00:46:55.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.402+0000 7f82be69d700 1 Processor -- start 2023-10-24T00:46:55.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.402+0000 7f82be69d700 1 -- start start 2023-10-24T00:46:55.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8098bd0 0x7f82b80b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 0x7f82b8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80ae410 con 0x7f82b80bffd0 2023-10-24T00:46:55.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80b0850 con 0x7f82b8098bd0 2023-10-24T00:46:55.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82be69d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80b0b30 con 0x7f82b8154430 2023-10-24T00:46:55.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35788/0 (socket says 172.21.15.148:35788) 2023-10-24T00:46:55.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 -- 172.21.15.148:0/18846779 learned_addr learned my addr 172.21.15.148:0/18846779 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:55.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b7fff700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8098bd0 0x7f82b80b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82bcc3a700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 0x7f82b8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 -- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 msgr2=0x7f82b8150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 0x7f82b8150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 -- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8098bd0 msgr2=0x7f82b80b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8098bd0 0x7f82b80b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 -- 172.21.15.148:0/18846779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80092a0 con 0x7f82b80bffd0 2023-10-24T00:46:55.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82bcc3a700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 0x7f82b8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:55.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f82b77fe700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f82ac00c490 tx=0x7f82ac007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.403+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00f470 con 0x7f82b80bffd0 2023-10-24T00:46:55.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.404+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac00f5d0 con 0x7f82b80bffd0 2023-10-24T00:46:55.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.404+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b80b0e10 con 0x7f82b80bffd0 2023-10-24T00:46:55.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.404+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00f970 con 0x7f82b80bffd0 2023-10-24T00:46:55.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.404+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b8151140 con 0x7f82b80bffd0 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.405+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b806c6b0 con 0x7f82b80bffd0 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.405+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f82ac00fd20 con 0x7f82b80bffd0 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.405+0000 7f829ffff700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 0x7f82a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.405+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7f82ac079710 con 0x7f82b80bffd0 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.406+0000 7f82b7fff700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 0x7f82a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.406+0000 7f82b7fff700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 0x7f82a4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f82a8009760 tx=0x7f82a8016000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.409+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f82ac04aae0 con 0x7f82b80bffd0 2023-10-24T00:46:55.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.574+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f82b80c6c10 con 0x7f82b80bffd0 2023-10-24T00:46:55.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.577+0000 7f829ffff700 1 -- 172.21.15.148:0/18846779 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f82ac04e100 con 0x7f82b80bffd0 2023-10-24T00:46:55.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 msgr2=0x7f82a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 0x7f82a4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f82a8009760 tx=0x7f82a8016000).stop 2023-10-24T00:46:55.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 msgr2=0x7f82b80ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f82ac00c490 tx=0x7f82ac007c90).stop 2023-10-24T00:46:55.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 shutdown_connections 2023-10-24T00:46:55.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b8154430 0x7f82b8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b8098bd0 0x7f82b80b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f82a405f150 0x7f82a4061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 --2- 172.21.15.148:0/18846779 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b80bffd0 0x7f82b80ae8a0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 >> 172.21.15.148:0/18846779 conn(0x7f82b80cb070 msgr2=0x7f82b8063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:55.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 shutdown_connections 2023-10-24T00:46:55.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.579+0000 7f82be69d700 1 -- 172.21.15.148:0/18846779 wait complete. 2023-10-24T00:46:55.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:46:55.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.707+0000 7f96e59bc700 1 Processor -- start 2023-10-24T00:46:55.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.707+0000 7f96e59bc700 1 -- start start 2023-10-24T00:46:55.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.708+0000 7f96e59bc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96e00c6210 0x7f96e00c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.708+0000 7f96e59bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e00c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.708+0000 7f96e59bc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e0063760 con 0x7f96e00be570 2023-10-24T00:46:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.708+0000 7f96e59bc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0154b50 con 0x7f96e00c6210 2023-10-24T00:46:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.708+0000 7f96e59bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00c4be0 con 0x7f96e00c65f0 2023-10-24T00:46:55.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96e00c6210 0x7f96e00c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96d67fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e00c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96e00c6210 0x7f96e00c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:42880/0 (socket says 172.21.15.148:42880) 2023-10-24T00:46:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 -- 172.21.15.148:0/3614737102 learned_addr learned my addr 172.21.15.148:0/3614737102 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:55.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96df7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f96e00be570 0x7f96e00bea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56474/0 (socket says 172.21.15.148:56474) 2023-10-24T00:46:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96de7fc700 1 -- 172.21.15.148:0/3614737102 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841951616 0 0) 0x7f96e0063760 con 0x7f96e00be570 2023-10-24T00:46:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96de7fc700 1 -- 172.21.15.148:0/3614737102 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96cc0033f0 con 0x7f96e00be570 2023-10-24T00:46:55.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 -- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 msgr2=0x7f96e00c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e00c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 -- 172.21.15.148:0/3614737102 >> v1:172.21.15.150:6789/0 conn(0x7f96e00be570 legacy=0x7f96e00bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 -- 172.21.15.148:0/3614737102 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00bf2f0 con 0x7f96e00c6210 2023-10-24T00:46:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96d67fc700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e00c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:46:55.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96deffd700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e00c4200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f96d0006fd0 tx=0x7f96d00090f0).ready entity=mon.1 client_cookie=b0d9f9e4a9e4ec25 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96de7fc700 1 -- 172.21.15.148:0/3614737102 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f510 con 0x7f96e00c6210 2023-10-24T00:46:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96de7fc700 1 -- 172.21.15.148:0/3614737102 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000f670 con 0x7f96e00c6210 2023-10-24T00:46:55.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.709+0000 7f96de7fc700 1 -- 172.21.15.148:0/3614737102 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000f9f0 con 0x7f96e00c6210 2023-10-24T00:46:55.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 -- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 msgr2=0x7f96e00c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e00c4200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f96d0006fd0 tx=0x7f96d00090f0).stop 2023-10-24T00:46:55.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 -- 172.21.15.148:0/3614737102 shutdown_connections 2023-10-24T00:46:55.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e00c4200 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 --2- 172.21.15.148:0/3614737102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e00c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 -- 172.21.15.148:0/3614737102 >> 172.21.15.148:0/3614737102 conn(0x7f96e0092510 msgr2=0x7f96e0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:55.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 -- 172.21.15.148:0/3614737102 shutdown_connections 2023-10-24T00:46:55.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.710+0000 7f96e59bc700 1 -- 172.21.15.148:0/3614737102 wait complete. 2023-10-24T00:46:55.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.711+0000 7f96e59bc700 1 Processor -- start 2023-10-24T00:46:55.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.711+0000 7f96e59bc700 1 -- start start 2023-10-24T00:46:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e0159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e0149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00c69f0 con 0x7f96e00be570 2023-10-24T00:46:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015a280 con 0x7f96e00c6210 2023-10-24T00:46:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96e59bc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015a560 con 0x7f96e00c65f0 2023-10-24T00:46:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35796/0 (socket says 172.21.15.148:35796) 2023-10-24T00:46:55.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 -- 172.21.15.148:0/1207332726 learned_addr learned my addr 172.21.15.148:0/1207332726 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96d67fc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e0159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96df7fe700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e0149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 -- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 msgr2=0x7f96e0149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e0149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 -- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 msgr2=0x7f96e0159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e0159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 -- 172.21.15.148:0/1207332726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80092a0 con 0x7f96e00be570 2023-10-24T00:46:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96df7fe700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e0149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:46:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.712+0000 7f96deffd700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f96e0069d60 tx=0x7f96d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.713+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0006a40 con 0x7f96e00be570 2023-10-24T00:46:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.713+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000f7e0 con 0x7f96e00be570 2023-10-24T00:46:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.713+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d0009370 con 0x7f96e00be570 2023-10-24T00:46:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.713+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d001c670 con 0x7f96e00be570 2023-10-24T00:46:55.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.713+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e00c6c00 con 0x7f96e00be570 2023-10-24T00:46:55.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.714+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e006c6b0 con 0x7f96e00be570 2023-10-24T00:46:55.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.714+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f96d001ca20 con 0x7f96e00be570 2023-10-24T00:46:55.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.714+0000 7f96d77fe700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 0x7f96c0061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:55.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.714+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7f96d007be70 con 0x7f96e00be570 2023-10-24T00:46:55.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.714+0000 7f96d67fc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 0x7f96c0061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.715+0000 7f96d67fc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 0x7f96c0061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f96c8009270 tx=0x7f96c8008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:55.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.718+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f96d004d2f0 con 0x7f96e00be570 2023-10-24T00:46:55.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.886+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f96e00aee90 con 0x7f96e00be570 2023-10-24T00:46:55.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.891+0000 7f96d77fe700 1 -- 172.21.15.148:0/1207332726 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96d0020070 con 0x7f96e00be570 2023-10-24T00:46:55.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.892+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 msgr2=0x7f96c0061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.892+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 0x7f96c0061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f96c8009270 tx=0x7f96c8008040).stop 2023-10-24T00:46:55.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 msgr2=0x7f96e014af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:55.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f96e0069d60 tx=0x7f96d0017000).stop 2023-10-24T00:46:55.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 shutdown_connections 2023-10-24T00:46:55.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96e00c65f0 0x7f96e0149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f96c005f180 0x7f96c0061640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96e00be570 0x7f96e014af10 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 --2- 172.21.15.148:0/1207332726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96e00c6210 0x7f96e0159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:55.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 >> 172.21.15.148:0/1207332726 conn(0x7f96e0092510 msgr2=0x7f96e0153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:55.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 shutdown_connections 2023-10-24T00:46:55.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:55.893+0000 7f96e59bc700 1 -- 172.21.15.148:0/1207332726 wait complete. 2023-10-24T00:46:55.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-24T00:46:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.019+0000 7feca7259700 1 Processor -- start 2023-10-24T00:46:56.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7feca7259700 1 -- start start 2023-10-24T00:46:56.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7feca7259700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feca01543a0 0x7feca00a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7feca7259700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00bf5c0 con 0x7feca00a84b0 2023-10-24T00:46:56.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7feca7259700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00be9b0 con 0x7feca00964f0 2023-10-24T00:46:56.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7feca7259700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00bec90 con 0x7feca01543a0 2023-10-24T00:46:56.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.020+0000 7fec97fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feca00a84b0 0x7feca0095de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49752/0 (socket says 172.21.15.148:49752) 2023-10-24T00:46:56.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec97fff700 1 -- 172.21.15.148:0/344933416 learned_addr learned my addr 172.21.15.148:0/344933416 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:56.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7feca4ff5700 1 --2- 172.21.15.148:0/344933416 >> v2:172.21.15.150:3300/0 conn(0x7feca01543a0 0x7feca00a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707261072 0 0) 0x7feca00bf5c0 con 0x7feca00a84b0 2023-10-24T00:46:56.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec880033f0 con 0x7feca00a84b0 2023-10-24T00:46:56.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3681031656 0 0) 0x7fec880033f0 con 0x7feca00a84b0 2023-10-24T00:46:56.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 >> v2:172.21.15.150:3300/0 conn(0x7feca01543a0 msgr2=0x7feca00a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:56.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 --2- 172.21.15.148:0/344933416 >> v2:172.21.15.150:3300/0 conn(0x7feca01543a0 0x7feca00a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 >> v1:172.21.15.150:6789/0 conn(0x7feca00964f0 legacy=0x7feca00a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:56.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00bef70 con 0x7feca00a84b0 2023-10-24T00:46:56.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fec90001470 con 0x7feca00a84b0 2023-10-24T00:46:56.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 >> v1:172.21.15.148:6789/0 conn(0x7feca00a84b0 legacy=0x7feca0095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:56.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec880038e0 0x7fec88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec88004690 0x7fec88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7fec8800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00bec90 con 0x7fec88005000 2023-10-24T00:46:56.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800beb0 con 0x7fec88004690 2023-10-24T00:46:56.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800c070 con 0x7fec880038e0 2023-10-24T00:46:56.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7feca57f6700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7fec8800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7fec97fff700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec88004690 0x7fec88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7feca4ff5700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec880038e0 0x7fec88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7feca57f6700 1 -- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec880038e0 msgr2=0x7fec88003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:56.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.021+0000 7feca57f6700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec880038e0 0x7fec88003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca57f6700 1 -- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec88004690 msgr2=0x7fec88004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:56.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca57f6700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec88004690 0x7fec88004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca57f6700 1 -- 172.21.15.148:0/344933416 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880033f0 con 0x7fec88005000 2023-10-24T00:46:56.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca57f6700 1 -- 172.21.15.148:0/344933416 reap_dead start 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca57f6700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7fec8800b8e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fec98001700 tx=0x7fec98007bb0).ready entity=mon.0 client_cookie=acbaade074f2e2c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98007020 con 0x7fec88005000 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98007180 con 0x7fec88005000 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7fec977fe700 1 -- 172.21.15.148:0/344933416 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98007520 con 0x7fec88005000 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 -- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 msgr2=0x7fec8800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:56.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7fec8800b8e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7fec98001700 tx=0x7fec98007bb0).stop 2023-10-24T00:46:56.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 -- 172.21.15.148:0/344933416 shutdown_connections 2023-10-24T00:46:56.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 --2- 172.21.15.148:0/344933416 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7fec8800b8e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 -- 172.21.15.148:0/344933416 >> 172.21.15.148:0/344933416 conn(0x7feca00630f0 msgr2=0x7feca00c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:56.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 -- 172.21.15.148:0/344933416 shutdown_connections 2023-10-24T00:46:56.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.022+0000 7feca7259700 1 -- 172.21.15.148:0/344933416 wait complete. 2023-10-24T00:46:56.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.023+0000 7feca7259700 1 Processor -- start 2023-10-24T00:46:56.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 -- start start 2023-10-24T00:46:56.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 0x7feca01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 0x7feca00ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00aa650 con 0x7fec88005000 2023-10-24T00:46:56.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca00c3ee0 con 0x7feca00ae0f0 2023-10-24T00:46:56.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca7259700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca00a8890 con 0x7feca00c3a60 2023-10-24T00:46:56.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca4ff5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca4ff5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35812/0 (socket says 172.21.15.148:35812) 2023-10-24T00:46:56.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.024+0000 7feca4ff5700 1 -- 172.21.15.148:0/1285126375 learned_addr learned my addr 172.21.15.148:0/1285126375 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:56.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7fec97fff700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 0x7feca01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca57f6700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 0x7feca00ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 -- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 msgr2=0x7feca01507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:56.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 0x7feca01507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 -- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 msgr2=0x7feca00ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:56.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 0x7feca00ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:56.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 -- 172.21.15.148:0/1285126375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0165340 con 0x7fec88005000 2023-10-24T00:46:56.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7fec97fff700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 0x7feca01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:56.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca57f6700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 0x7feca00ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:56.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca4ff5700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fec9c011e80 tx=0x7fec9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:56.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00e040 con 0x7fec88005000 2023-10-24T00:46:56.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00f040 con 0x7fec88005000 2023-10-24T00:46:56.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca0165620 con 0x7fec88005000 2023-10-24T00:46:56.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c015450 con 0x7fec88005000 2023-10-24T00:46:56.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.025+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca0165be0 con 0x7fec88005000 2023-10-24T00:46:56.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.026+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca00a8ab0 con 0x7fec88005000 2023-10-24T00:46:56.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.026+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fec9c015840 con 0x7fec88005000 2023-10-24T00:46:56.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.027+0000 7fec94ff9700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 0x7fec8c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:56.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.027+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7fec9c07b030 con 0x7fec88005000 2023-10-24T00:46:56.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.027+0000 7fec97fff700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 0x7fec8c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:56.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.027+0000 7fec97fff700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 0x7fec8c061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7feca0068560 tx=0x7fec90009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:56.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.031+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feca00a8ab0 con 0x7fec88005000 2023-10-24T00:46:56.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:56.259+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7feca00a8a50 con 0x7fec88005000 2023-10-24T00:46:57.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.269+0000 7fec94ff9700 1 -- 172.21.15.148:0/1285126375 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v663) v1 ==== 183+0+0 (secure 0 0 0) 0x7fec9c019070 con 0x7fec88005000 2023-10-24T00:46:57.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 msgr2=0x7fec8c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 0x7fec8c061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7feca0068560 tx=0x7fec90009040).stop 2023-10-24T00:46:57.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 msgr2=0x7feca0164da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fec9c011e80 tx=0x7fec9c00b040).stop 2023-10-24T00:46:57.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 shutdown_connections 2023-10-24T00:46:57.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feca00ae0f0 0x7feca00ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec8c05f180 0x7fec8c061640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec88005000 0x7feca0164da0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 --2- 172.21.15.148:0/1285126375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feca00c3a60 0x7feca01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 >> 172.21.15.148:0/1285126375 conn(0x7feca00630f0 msgr2=0x7feca0064e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:57.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 shutdown_connections 2023-10-24T00:46:57.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.271+0000 7feca7259700 1 -- 172.21.15.148:0/1285126375 wait complete. 2023-10-24T00:46:57.286 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-10-24T00:46:57.287 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-10-24T00:46:57.287 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:46:57.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-24T00:46:57.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.404+0000 7fd5c7680700 1 Processor -- start 2023-10-24T00:46:57.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.405+0000 7fd5c7680700 1 -- start start 2023-10-24T00:46:57.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.405+0000 7fd5c7680700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5c00640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.405+0000 7fd5c7680700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00a5bd0 con 0x7fd5c00a8480 2023-10-24T00:46:57.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.405+0000 7fd5c7680700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c0064ab0 con 0x7fd5c00645a0 2023-10-24T00:46:57.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.405+0000 7fd5c7680700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0064d90 con 0x7fd5c0154540 2023-10-24T00:46:57.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c5c1d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd5c00a8480 0x7fd5c00a6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49762/0 (socket says 172.21.15.148:49762) 2023-10-24T00:46:57.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c5c1d700 1 -- 172.21.15.148:0/4009250402 learned_addr learned my addr 172.21.15.148:0/4009250402 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:57.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c541c700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5c00640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066998887 0 0) 0x7fd5c00a5bd0 con 0x7fd5c00a8480 2023-10-24T00:46:57.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5ac0033f0 con 0x7fd5c00a8480 2023-10-24T00:46:57.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264895817 0 0) 0x7fd5ac0033f0 con 0x7fd5c00a8480 2023-10-24T00:46:57.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 msgr2=0x7fd5c00640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:57.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5c00640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 >> v1:172.21.15.150:6789/0 conn(0x7fd5c00645a0 legacy=0x7fd5c00a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0065070 con 0x7fd5c00a8480 2023-10-24T00:46:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fd5b8001470 con 0x7fd5c00a8480 2023-10-24T00:46:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 >> v1:172.21.15.148:6789/0 conn(0x7fd5c00a8480 legacy=0x7fd5c00a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5ac003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5ac003e00 0x7fd5ac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5ac004b80 0x7fd5ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0064d90 con 0x7fd5ac004b80 2023-10-24T00:46:57.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac00b8e0 con 0x7fd5ac003e00 2023-10-24T00:46:57.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac00baa0 con 0x7fd5c0154540 2023-10-24T00:46:57.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5ac004b80 0x7fd5ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c541c700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5ac003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.406+0000 7fd5c4c1b700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5ac003e00 0x7fd5ac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 -- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 msgr2=0x7fd5ac003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:57.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c0154540 0x7fd5ac003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 -- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5ac003e00 msgr2=0x7fd5ac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:57.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5ac003e00 0x7fd5ac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 -- 172.21.15.148:0/4009250402 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0033f0 con 0x7fd5ac004b80 2023-10-24T00:46:57.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5ac004b80 0x7fd5ac005000 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fd5c0063ea0 tx=0x7fd5b8001e70).ready entity=mon.0 client_cookie=a5e6c3970acd8603 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:57.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007a40 con 0x7fd5ac004b80 2023-10-24T00:46:57.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800ca60 con 0x7fd5ac004b80 2023-10-24T00:46:57.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5b7fff700 1 -- 172.21.15.148:0/4009250402 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800cde0 con 0x7fd5ac004b80 2023-10-24T00:46:57.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 -- 172.21.15.148:0/4009250402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5ac004b80 msgr2=0x7fd5ac005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 --2- 172.21.15.148:0/4009250402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5ac004b80 0x7fd5ac005000 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fd5c0063ea0 tx=0x7fd5b8001e70).stop 2023-10-24T00:46:57.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c5c1d700 1 -- 172.21.15.148:0/4009250402 reap_dead start 2023-10-24T00:46:57.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 -- 172.21.15.148:0/4009250402 shutdown_connections 2023-10-24T00:46:57.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 -- 172.21.15.148:0/4009250402 >> 172.21.15.148:0/4009250402 conn(0x7fd5c0092480 msgr2=0x7fd5c0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:57.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 -- 172.21.15.148:0/4009250402 shutdown_connections 2023-10-24T00:46:57.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.407+0000 7fd5c7680700 1 -- 172.21.15.148:0/4009250402 wait complete. 2023-10-24T00:46:57.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 Processor -- start 2023-10-24T00:46:57.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 -- start start 2023-10-24T00:46:57.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c00be1f0 0x7fd5c0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 0x7fd5c014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.409+0000 7fd5c7680700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0167690 con 0x7fd5c00be5d0 2023-10-24T00:46:57.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c7680700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c01678e0 con 0x7fd5c014dc70 2023-10-24T00:46:57.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c7680700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0167bc0 con 0x7fd5c00be1f0 2023-10-24T00:46:57.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35834/0 (socket says 172.21.15.148:35834) 2023-10-24T00:46:57.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 -- 172.21.15.148:0/1665717867 learned_addr learned my addr 172.21.15.148:0/1665717867 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:57.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 0x7fd5c014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 -- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c00be1f0 msgr2=0x7fd5c0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c00be1f0 0x7fd5c0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:57.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 -- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 msgr2=0x7fd5c014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:57.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 0x7fd5c014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:57.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 -- 172.21.15.148:0/1665717867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0167ea0 con 0x7fd5c00be5d0 2023-10-24T00:46:57.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c5c1d700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 0x7fd5c014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:46:57.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c4c1b700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd5b00027f0 tx=0x7fd5b0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:57.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0007240 con 0x7fd5c00be5d0 2023-10-24T00:46:57.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00073a0 con 0x7fd5c00be5d0 2023-10-24T00:46:57.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c0168180 con 0x7fd5c00be5d0 2023-10-24T00:46:57.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00066a0 con 0x7fd5c00be5d0 2023-10-24T00:46:57.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.410+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c00c60e0 con 0x7fd5c00be5d0 2023-10-24T00:46:57.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.411+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c0164110 con 0x7fd5c00be5d0 2023-10-24T00:46:57.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.411+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd5b0006a10 con 0x7fd5c00be5d0 2023-10-24T00:46:57.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.412+0000 7fd5b57fa700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 0x7fd5a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:57.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.412+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7fd5b0079c30 con 0x7fd5c00be5d0 2023-10-24T00:46:57.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.412+0000 7fd5c541c700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 0x7fd5a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:57.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.412+0000 7fd5c541c700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 0x7fd5a4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd5bc0094a0 tx=0x7fd5bc00b040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:57.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.416+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5b004afa0 con 0x7fd5c00be5d0 2023-10-24T00:46:57.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:57.644+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fd5c006c6b0 con 0x7fd5c00be5d0 2023-10-24T00:46:58.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.271+0000 7fd5b57fa700 1 -- 172.21.15.148:0/1665717867 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v664) v1 ==== 151+0+0 (secure 0 0 0) 0x7fd5b004e5c0 con 0x7fd5c00be5d0 2023-10-24T00:46:58.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 msgr2=0x7fd5a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 0x7fd5a4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd5bc0094a0 tx=0x7fd5bc00b040).stop 2023-10-24T00:46:58.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 msgr2=0x7fd5c0151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7fd5b00027f0 tx=0x7fd5b0007bb0).stop 2023-10-24T00:46:58.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 shutdown_connections 2023-10-24T00:46:58.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c014dc70 0x7fd5c014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c00be1f0 0x7fd5c0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:58.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd5a405f150 0x7fd5a4061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 --2- 172.21.15.148:0/1665717867 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5c00be5d0 0x7fd5c0151fc0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 >> 172.21.15.148:0/1665717867 conn(0x7fd5c0092480 msgr2=0x7fd5c00c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:58.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 shutdown_connections 2023-10-24T00:46:58.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.273+0000 7fd5c7680700 1 -- 172.21.15.148:0/1665717867 wait complete. 2023-10-24T00:46:58.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:46:58.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.402+0000 7f2e5b120700 1 Processor -- start 2023-10-24T00:46:58.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.402+0000 7f2e5b120700 1 -- start start 2023-10-24T00:46:58.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e5b120700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e5414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e5b120700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e54064e20 con 0x7f2e54153300 2023-10-24T00:46:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e5b120700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e54064210 con 0x7f2e5414fbb0 2023-10-24T00:46:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e5b120700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540644f0 con 0x7f2e540a9100 2023-10-24T00:46:58.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e596bd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2e54153300 0x7f2e540652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49764/0 (socket says 172.21.15.148:49764) 2023-10-24T00:46:58.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e596bd700 1 -- 172.21.15.148:0/91335313 learned_addr learned my addr 172.21.15.148:0/91335313 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:58.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4bfff700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e5414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408555642 0 0) 0x7f2e54064e20 con 0x7f2e54153300 2023-10-24T00:46:58.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0033f0 con 0x7f2e54153300 2023-10-24T00:46:58.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840826674 0 0) 0x7f2e54064210 con 0x7f2e5414fbb0 2023-10-24T00:46:58.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e54064e20 con 0x7f2e5414fbb0 2023-10-24T00:46:58.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776516828 0 0) 0x7f2e3c0033f0 con 0x7f2e54153300 2023-10-24T00:46:58.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 msgr2=0x7f2e5414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:58.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e5414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 >> v1:172.21.15.150:6789/0 conn(0x7f2e5414fbb0 legacy=0x7f2e540bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540647d0 con 0x7f2e54153300 2023-10-24T00:46:58.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f2e4c001470 con 0x7f2e54153300 2023-10-24T00:46:58.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 >> v1:172.21.15.148:6789/0 conn(0x7f2e54153300 legacy=0x7f2e540652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3c003aa0 0x7f2e3c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e3c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e3c004b80 0x7f2e3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540644f0 con 0x7f2e3c003aa0 2023-10-24T00:46:58.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c00b990 con 0x7f2e3c004b80 2023-10-24T00:46:58.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.403+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c00bb50 con 0x7f2e540a9100 2023-10-24T00:46:58.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3c003aa0 0x7f2e3c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e4bfff700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e3c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e596bd700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e3c004b80 0x7f2e3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 -- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 msgr2=0x7f2e3c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:58.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e540a9100 0x7f2e3c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 -- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e3c004b80 msgr2=0x7f2e3c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:58.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e3c004b80 0x7f2e3c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 -- 172.21.15.148:0/91335313 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0033f0 con 0x7f2e3c003aa0 2023-10-24T00:46:58.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3c003aa0 0x7f2e3c003ea0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f2e50001f90 tx=0x7f2e50007f30).ready entity=mon.0 client_cookie=ba787a860d88c932 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500020f0 con 0x7f2e3c003aa0 2023-10-24T00:46:58.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50006a20 con 0x7f2e3c003aa0 2023-10-24T00:46:58.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.404+0000 7f2e4b7fe700 1 -- 172.21.15.148:0/91335313 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50006dc0 con 0x7f2e3c003aa0 2023-10-24T00:46:58.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 -- 172.21.15.148:0/91335313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3c003aa0 msgr2=0x7f2e3c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 --2- 172.21.15.148:0/91335313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e3c003aa0 0x7f2e3c003ea0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f2e50001f90 tx=0x7f2e50007f30).stop 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e596bd700 1 -- 172.21.15.148:0/91335313 reap_dead start 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 -- 172.21.15.148:0/91335313 shutdown_connections 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 -- 172.21.15.148:0/91335313 >> 172.21.15.148:0/91335313 conn(0x7f2e540c6bf0 msgr2=0x7f2e540c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 -- 172.21.15.148:0/91335313 shutdown_connections 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.405+0000 7f2e5b120700 1 -- 172.21.15.148:0/91335313 wait complete. 2023-10-24T00:46:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.406+0000 7f2e5b120700 1 Processor -- start 2023-10-24T00:46:58.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.406+0000 7f2e5b120700 1 -- start start 2023-10-24T00:46:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e3c003aa0 0x7f2e541491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e540a7890 0x7f2e540a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540bf290 con 0x7f2e540abef0 2023-10-24T00:46:58.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540be680 con 0x7f2e540a7890 2023-10-24T00:46:58.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540be960 con 0x7f2e3c003aa0 2023-10-24T00:46:58.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35840/0 (socket says 172.21.15.148:35840) 2023-10-24T00:46:58.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 -- 172.21.15.148:0/3879861520 learned_addr learned my addr 172.21.15.148:0/3879861520 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:58.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e3c003aa0 0x7f2e541491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 -- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e3c003aa0 msgr2=0x7f2e541491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e3c003aa0 0x7f2e541491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 -- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e540a7890 msgr2=0x7f2e540a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e540a7890 0x7f2e540a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:58.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 -- 172.21.15.148:0/3879861520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540bec40 con 0x7f2e540abef0 2023-10-24T00:46:58.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e4bfff700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f2e44011a40 tx=0x7f2e44009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400f8e0 con 0x7f2e540abef0 2023-10-24T00:46:58.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4400fa40 con 0x7f2e540abef0 2023-10-24T00:46:58.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400fdc0 con 0x7f2e540abef0 2023-10-24T00:46:58.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.407+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540bef20 con 0x7f2e540abef0 2023-10-24T00:46:58.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.408+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e540a81e0 con 0x7f2e540abef0 2023-10-24T00:46:58.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.409+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e540bf440 con 0x7f2e540abef0 2023-10-24T00:46:58.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.409+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2e44014650 con 0x7f2e540abef0 2023-10-24T00:46:58.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.409+0000 7f2e48ff9700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.409+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7f2e4407ad70 con 0x7f2e540abef0 2023-10-24T00:46:58.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.410+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.410+0000 7f2e58ebc700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 0x7f2e40061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2e540a87b0 tx=0x7f2e50016000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.413+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2e540bf440 con 0x7f2e540abef0 2023-10-24T00:46:58.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.578+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2e5406c6b0 con 0x7f2e540abef0 2023-10-24T00:46:58.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.582+0000 7f2e48ff9700 1 -- 172.21.15.148:0/3879861520 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e44018070 con 0x7f2e540abef0 2023-10-24T00:46:58.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 msgr2=0x7f2e40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 0x7f2e40061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f2e540a87b0 tx=0x7f2e50016000).stop 2023-10-24T00:46:58.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 msgr2=0x7f2e540ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f2e44011a40 tx=0x7f2e44009060).stop 2023-10-24T00:46:58.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 shutdown_connections 2023-10-24T00:46:58.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e540a7890 0x7f2e540a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:46:58.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2e3c003aa0 0x7f2e541491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 --2- 172.21.15.148:0/3879861520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2e540abef0 0x7f2e540ac370 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 >> 172.21.15.148:0/3879861520 conn(0x7f2e540c6bf0 msgr2=0x7f2e540c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:58.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 shutdown_connections 2023-10-24T00:46:58.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.584+0000 7f2e5b120700 1 -- 172.21.15.148:0/3879861520 wait complete. 2023-10-24T00:46:58.598 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:46:58.599 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:46:58.648 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:46:58.692 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:46:58.692 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:46:58.693 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:46:58.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.805+0000 7f04f56ac700 1 Processor -- start 2023-10-24T00:46:58.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.805+0000 7f04f56ac700 1 -- start start 2023-10-24T00:46:58.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04f00aa010 0x7f04f00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 0x7f04f00aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00aa8e0 con 0x7f04f00aa010 2023-10-24T00:46:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00c0960 con 0x7f04f00c6710 2023-10-24T00:46:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04f56ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00c0c40 con 0x7f04f0158770 2023-10-24T00:46:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04eeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04f00aa010 0x7f04f00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04eeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04f00aa010 0x7f04f00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35854/0 (socket says 172.21.15.148:35854) 2023-10-24T00:46:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.806+0000 7f04eeffd700 1 -- 172.21.15.148:0/4270658998 learned_addr learned my addr 172.21.15.148:0/4270658998 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04e67fc700 1 --2- 172.21.15.148:0/4270658998 >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 0x7f04f00aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04ef7fe700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 -- 172.21.15.148:0/4270658998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 msgr2=0x7f04f0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:58.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 -- 172.21.15.148:0/4270658998 >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 msgr2=0x7f04f00aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:58.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 --2- 172.21.15.148:0/4270658998 >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 0x7f04f00aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 -- 172.21.15.148:0/4270658998 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00c0f20 con 0x7f04f00aa010 2023-10-24T00:46:58.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04e67fc700 1 --2- 172.21.15.148:0/4270658998 >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 0x7f04f00aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:46:58.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04eeffd700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f00c1a00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f04f0157d00 tx=0x7f04e00090f0).ready entity=mon.0 client_cookie=5fab9d90797610 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04ee7fc700 1 -- 172.21.15.148:0/4270658998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000b600 con 0x7f04f00aa010 2023-10-24T00:46:58.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04ee7fc700 1 -- 172.21.15.148:0/4270658998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000b760 con 0x7f04f00aa010 2023-10-24T00:46:58.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.807+0000 7f04ee7fc700 1 -- 172.21.15.148:0/4270658998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000bae0 con 0x7f04f00aa010 2023-10-24T00:46:58.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 -- 172.21.15.148:0/4270658998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 msgr2=0x7f04f00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f00c1a00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f04f0157d00 tx=0x7f04e00090f0).stop 2023-10-24T00:46:58.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 -- 172.21.15.148:0/4270658998 shutdown_connections 2023-10-24T00:46:58.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f00c1a00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 --2- 172.21.15.148:0/4270658998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 --2- 172.21.15.148:0/4270658998 >> v2:172.21.15.150:3300/0 conn(0x7f04f00c6710 0x7f04f00aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 -- 172.21.15.148:0/4270658998 >> 172.21.15.148:0/4270658998 conn(0x7f04f00caf40 msgr2=0x7f04f00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:58.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 -- 172.21.15.148:0/4270658998 shutdown_connections 2023-10-24T00:46:58.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.808+0000 7f04f56ac700 1 -- 172.21.15.148:0/4270658998 wait complete. 2023-10-24T00:46:58.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.809+0000 7f04f56ac700 1 Processor -- start 2023-10-24T00:46:58.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.809+0000 7f04f56ac700 1 -- start start 2023-10-24T00:46:58.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04f00c6710 0x7f04f0151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0157bc0 con 0x7f04f00aa010 2023-10-24T00:46:58.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0145300 con 0x7f04f00c6710 2023-10-24T00:46:58.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01446f0 con 0x7f04f0158770 2023-10-24T00:46:58.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35858/0 (socket says 172.21.15.148:35858) 2023-10-24T00:46:58.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 -- 172.21.15.148:0/2413911606 learned_addr learned my addr 172.21.15.148:0/2413911606 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:58.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04e67fc700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04f00c6710 0x7f04f0151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04ef7fe700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 -- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 msgr2=0x7f04f0155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 -- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04f00c6710 msgr2=0x7f04f0151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04f00c6710 0x7f04f0151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 -- 172.21.15.148:0/2413911606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009370 con 0x7f04f00aa010 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04eeffd700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f04e0006fd0 tx=0x7f04e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000bea0 con 0x7f04f00aa010 2023-10-24T00:46:58.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000b8d0 con 0x7f04f00aa010 2023-10-24T00:46:58.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e001b660 con 0x7f04f00aa010 2023-10-24T00:46:58.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f01449d0 con 0x7f04f00aa010 2023-10-24T00:46:58.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.810+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f0144f90 con 0x7f04f00aa010 2023-10-24T00:46:58.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.811+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f006c6b0 con 0x7f04f00aa010 2023-10-24T00:46:58.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.812+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f04e001b9d0 con 0x7f04f00aa010 2023-10-24T00:46:58.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.812+0000 7f04e77fe700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 0x7f04d00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:58.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.812+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5871+0+0 (secure 0 0 0) 0x7f04e007b980 con 0x7f04f00aa010 2023-10-24T00:46:58.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.812+0000 7f04e67fc700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 0x7f04d00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:58.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.813+0000 7f04e67fc700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 0x7f04d00615e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f04f0147450 tx=0x7f04d8008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:58.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:58.816+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f04e004cd50 con 0x7f04f00aa010 2023-10-24T00:46:59.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.019+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f00c1200 con 0x7f04f00aa010 2023-10-24T00:46:59.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.019+0000 7f04e77fe700 1 -- 172.21.15.148:0/2413911606 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f04e001f070 con 0x7f04f00aa010 2023-10-24T00:46:59.022 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:46:59.023 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/1772024682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1772024682},{"type":"v1","addr":"172.21.15.150:6836","nonce":1772024682}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6706,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3149283907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3149283907},{"type":"v1","addr":"172.21.15.150:6837","nonce":3149283907}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7209,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/2278735912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2278735912},{"type":"v1","addr":"172.21.15.148:6833","nonce":2278735912}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":7623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2989605599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":2989605599},{"type":"v1","addr":"172.21.15.148:6835","nonce":2989605599}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-10-24T00:46:59.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 msgr2=0x7f04d00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 0x7f04d00615e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f04f0147450 tx=0x7f04d8008040).stop 2023-10-24T00:46:59.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 msgr2=0x7f04f01439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f04e0006fd0 tx=0x7f04e0017000).stop 2023-10-24T00:46:59.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 shutdown_connections 2023-10-24T00:46:59.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04f0158770 0x7f04f0155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f04d005f120 0x7f04d00615e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04f00aa010 0x7f04f01439c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 --2- 172.21.15.148:0/2413911606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04f00c6710 0x7f04f0151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.021+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 >> 172.21.15.148:0/2413911606 conn(0x7f04f00caf40 msgr2=0x7f04f0069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:59.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.022+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 shutdown_connections 2023-10-24T00:46:59.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.022+0000 7f04f56ac700 1 -- 172.21.15.148:0/2413911606 wait complete. 2023-10-24T00:46:59.027 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 39 2023-10-24T00:46:59.036 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:46:59.036 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:46:59.037 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:46:59.037 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:46:59.037 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:46:59.037 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:46:59.038 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:46:59.038 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:46:59.038 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:46:59.038 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:46:59.039 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:46:59.039 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:46:59.039 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:46:59.040 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:46:59.040 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:46:59.040 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:46:59.045 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:46:59.046 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:46:59.047 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:46:59.047 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:46:59.050 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:46:59.050 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:46:59.051 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:46:59.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:46:59.089 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:46:59.090 DEBUG:teuthology.parallel:result is None 2023-10-24T00:46:59.091 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:46:59.091 DEBUG:teuthology.parallel:result is None 2023-10-24T00:46:59.093 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:46:59.094 DEBUG:teuthology.parallel:result is None 2023-10-24T00:46:59.094 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:46:59.095 DEBUG:teuthology.parallel:result is None 2023-10-24T00:46:59.095 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:46:59.162 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:46:59.162 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:46:59.176 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:46:59.176 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:46:59.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.217+0000 7fd896e12700 1 Processor -- start 2023-10-24T00:46:59.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.217+0000 7fd896e12700 1 -- start start 2023-10-24T00:46:59.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd896e12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd896e12700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd890066aa0 0x7fd8900c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd896e12700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd890066f00 con 0x7fd890154240 2023-10-24T00:46:59.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd896e12700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8900bd280 con 0x7fd890066aa0 2023-10-24T00:46:59.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd896e12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900bcfa0 con 0x7fd89006a0a0 2023-10-24T00:46:59.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd8953af700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd890066aa0 0x7fd8900c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd894bae700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd890154240 0x7fd890065bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49788/0 (socket says 172.21.15.148:49788) 2023-10-24T00:46:59.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd894bae700 1 -- 172.21.15.148:0/2243001445 learned_addr learned my addr 172.21.15.148:0/2243001445 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:46:59.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.218+0000 7fd887fff700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8953af700 1 -- 172.21.15.148:0/2243001445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 msgr2=0x7fd8900665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:46:59.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8953af700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8953af700 1 -- 172.21.15.148:0/2243001445 >> v1:172.21.15.148:6789/0 conn(0x7fd890154240 legacy=0x7fd890065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8877fe700 1 -- 172.21.15.148:0/2243001445 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754519027 0 0) 0x7fd890066f00 con 0x7fd890154240 2023-10-24T00:46:59.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8953af700 1 -- 172.21.15.148:0/2243001445 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900695c0 con 0x7fd890066aa0 2023-10-24T00:46:59.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8953af700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900c2310 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fd888009e60 tx=0x7fd888009780).ready entity=mon.0 client_cookie=572f4ec568fd359e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:59.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8877fe700 1 -- 172.21.15.148:0/2243001445 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88800e070 con 0x7fd890066aa0 2023-10-24T00:46:59.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8877fe700 1 -- 172.21.15.148:0/2243001445 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88800bc30 con 0x7fd890066aa0 2023-10-24T00:46:59.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd8877fe700 1 -- 172.21.15.148:0/2243001445 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888012410 con 0x7fd890066aa0 2023-10-24T00:46:59.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 -- 172.21.15.148:0/2243001445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 msgr2=0x7fd8900c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900c2310 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fd888009e60 tx=0x7fd888009780).stop 2023-10-24T00:46:59.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 -- 172.21.15.148:0/2243001445 shutdown_connections 2023-10-24T00:46:59.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900c2310 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 --2- 172.21.15.148:0/2243001445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 -- 172.21.15.148:0/2243001445 >> 172.21.15.148:0/2243001445 conn(0x7fd8900c7d10 msgr2=0x7fd8900c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:46:59.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 -- 172.21.15.148:0/2243001445 shutdown_connections 2023-10-24T00:46:59.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.219+0000 7fd896e12700 1 -- 172.21.15.148:0/2243001445 wait complete. 2023-10-24T00:46:59.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.220+0000 7fd896e12700 1 Processor -- start 2023-10-24T00:46:59.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 -- start start 2023-10-24T00:46:59.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd890154240 0x7fd8900ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901460d0 con 0x7fd890066aa0 2023-10-24T00:46:59.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900a8760 con 0x7fd890154240 2023-10-24T00:46:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd896e12700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900a6650 con 0x7fd89006a0a0 2023-10-24T00:46:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.221+0000 7fd894bae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35922/0 (socket says 172.21.15.148:35922) 2023-10-24T00:46:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 -- 172.21.15.148:0/2225826546 learned_addr learned my addr 172.21.15.148:0/2225826546 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:46:59.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd887fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd8953af700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd890154240 0x7fd8900ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 -- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 msgr2=0x7fd8900a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 -- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd890154240 msgr2=0x7fd8900ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:46:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd890154240 0x7fd8900ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:46:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 -- 172.21.15.148:0/2225826546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009a20 con 0x7fd890066aa0 2023-10-24T00:46:59.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd894bae700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fd88c001eb0 tx=0x7fd88c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:59.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0070d0 con 0x7fd890066aa0 2023-10-24T00:46:59.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c007230 con 0x7fd890066aa0 2023-10-24T00:46:59.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8900a7b50 con 0x7fd890066aa0 2023-10-24T00:46:59.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0075d0 con 0x7fd890066aa0 2023-10-24T00:46:59.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.222+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8900a8110 con 0x7fd890066aa0 2023-10-24T00:46:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.223+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89006c6b0 con 0x7fd890066aa0 2023-10-24T00:46:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.223+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd88c005bc0 con 0x7fd890066aa0 2023-10-24T00:46:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.224+0000 7fd884ff9700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 0x7fd87c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:46:59.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.224+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5871+0+0 (secure 0 0 0) 0x7fd88c079920 con 0x7fd890066aa0 2023-10-24T00:46:59.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.224+0000 7fd887fff700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 0x7fd87c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:46:59.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.224+0000 7fd887fff700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 0x7fd87c0615e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd89014baa0 tx=0x7fd880008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:46:59.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.228+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd88c04acf0 con 0x7fd890066aa0 2023-10-24T00:46:59.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:46:59.405+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd8900adc10 con 0x7fd890066aa0 2023-10-24T00:47:00.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.279+0000 7fd884ff9700 1 -- 172.21.15.148:0/2225826546 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd88c04e310 con 0x7fd890066aa0 2023-10-24T00:47:00.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 msgr2=0x7fd87c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 0x7fd87c0615e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd89014baa0 tx=0x7fd880008040).stop 2023-10-24T00:47:00.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 msgr2=0x7fd8900a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fd88c001eb0 tx=0x7fd88c007e90).stop 2023-10-24T00:47:00.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 shutdown_connections 2023-10-24T00:47:00.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd890154240 0x7fd8900ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd87c05f120 0x7fd87c0615e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd890066aa0 0x7fd8900a6160 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 --2- 172.21.15.148:0/2225826546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd89006a0a0 0x7fd8900a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 >> 172.21.15.148:0/2225826546 conn(0x7fd8900c7d10 msgr2=0x7fd890153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:00.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 shutdown_connections 2023-10-24T00:47:00.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.281+0000 7fd896e12700 1 -- 172.21.15.148:0/2225826546 wait complete. 2023-10-24T00:47:00.287 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:47:00.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:47:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 Processor -- start 2023-10-24T00:47:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 -- start start 2023-10-24T00:47:00.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff5b4152340 0x7ff5b4062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff5b4152720 0x7ff5b4062b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b41534f0 con 0x7ff5b40c2280 2023-10-24T00:47:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4063030 con 0x7ff5b4152720 2023-10-24T00:47:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5bb0e1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b4152bc0 con 0x7ff5b4152340 2023-10-24T00:47:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5abfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff5b4152720 0x7ff5b4062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.413+0000 7ff5b967e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff5b40c2280 0x7ff5b40c2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49800/0 (socket says 172.21.15.148:49800) 2023-10-24T00:47:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5b967e700 1 -- 172.21.15.148:0/3494722420 learned_addr learned my addr 172.21.15.148:0/3494722420 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5b8e7d700 1 --2- 172.21.15.148:0/3494722420 >> v2:172.21.15.150:3300/0 conn(0x7ff5b4152340 0x7ff5b4062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5abfff700 1 -- 172.21.15.148:0/3494722420 >> v2:172.21.15.150:3300/0 conn(0x7ff5b4152340 msgr2=0x7ff5b4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:00.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5abfff700 1 --2- 172.21.15.148:0/3494722420 >> v2:172.21.15.150:3300/0 conn(0x7ff5b4152340 0x7ff5b4062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5ab7fe700 1 -- 172.21.15.148:0/3494722420 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233447406 0 0) 0x7ff5b41534f0 con 0x7ff5b40c2280 2023-10-24T00:47:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5abfff700 1 -- 172.21.15.148:0/3494722420 >> v1:172.21.15.148:6789/0 conn(0x7ff5b40c2280 legacy=0x7ff5b40c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5abfff700 1 -- 172.21.15.148:0/3494722420 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4152ea0 con 0x7ff5b4152720 2023-10-24T00:47:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5abfff700 1 --2- 172.21.15.148:0/3494722420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b4152720 0x7ff5b4062b40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7ff5b4047660 tx=0x7ff5a4009060).ready entity=mon.0 client_cookie=bd4ab242f0d29fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5ab7fe700 1 -- 172.21.15.148:0/3494722420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400b580 con 0x7ff5b4152720 2023-10-24T00:47:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5ab7fe700 1 -- 172.21.15.148:0/3494722420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400b6e0 con 0x7ff5b4152720 2023-10-24T00:47:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5ab7fe700 1 -- 172.21.15.148:0/3494722420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400ba60 con 0x7ff5b4152720 2023-10-24T00:47:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/3494722420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b4152720 msgr2=0x7ff5b4062b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.414+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/3494722420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b4152720 0x7ff5b4062b40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7ff5b4047660 tx=0x7ff5a4009060).stop 2023-10-24T00:47:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/3494722420 shutdown_connections 2023-10-24T00:47:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/3494722420 >> v2:172.21.15.150:3300/0 conn(0x7ff5b4152340 0x7ff5b4062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/3494722420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b4152720 0x7ff5b4062b40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/3494722420 >> 172.21.15.148:0/3494722420 conn(0x7ff5b4064230 msgr2=0x7ff5b40c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:00.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/3494722420 shutdown_connections 2023-10-24T00:47:00.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.415+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/3494722420 wait complete. 2023-10-24T00:47:00.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.416+0000 7ff5bb0e1700 1 Processor -- start 2023-10-24T00:47:00.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.416+0000 7ff5bb0e1700 1 -- start start 2023-10-24T00:47:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b4152340 0x7ff5b4167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b4152720 0x7ff5b4167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4168100 con 0x7ff5b40c2280 2023-10-24T00:47:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c10e0 con 0x7ff5b4152340 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40c04d0 con 0x7ff5b4152720 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35938/0 (socket says 172.21.15.148:35938) 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 -- 172.21.15.148:0/1315708048 learned_addr learned my addr 172.21.15.148:0/1315708048 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 -- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b4152720 msgr2=0x7ff5b4167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b4152720 0x7ff5b4167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:00.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 -- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b4152340 msgr2=0x7ff5b4167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b4152340 0x7ff5b4167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:00.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 -- 172.21.15.148:0/1315708048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40092a0 con 0x7ff5b40c2280 2023-10-24T00:47:00.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5b8e7d700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7ff5b000cfc0 tx=0x7ff5b00078b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0016400 con 0x7ff5b40c2280 2023-10-24T00:47:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b0016560 con 0x7ff5b40c2280 2023-10-24T00:47:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00168e0 con 0x7ff5b40c2280 2023-10-24T00:47:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b40c07b0 con 0x7ff5b40c2280 2023-10-24T00:47:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b40c0d70 con 0x7ff5b40c2280 2023-10-24T00:47:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.418+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b406c6b0 con 0x7ff5b40c2280 2023-10-24T00:47:00.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.419+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5b0009030 con 0x7ff5b40c2280 2023-10-24T00:47:00.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.419+0000 7ff5a8ff9700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 0x7ff5a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.419+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff5b007a850 con 0x7ff5b40c2280 2023-10-24T00:47:00.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.419+0000 7ff5abfff700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 0x7ff5a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.420+0000 7ff5abfff700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 0x7ff5a0061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff5a400b340 tx=0x7ff5a4017000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.423+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff5b004be70 con 0x7ff5b40c2280 2023-10-24T00:47:00.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.647+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff5b4153180 con 0x7ff5b40c2280 2023-10-24T00:47:00.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.647+0000 7ff5a8ff9700 1 -- 172.21.15.148:0/1315708048 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff5b004f490 con 0x7ff5b40c2280 2023-10-24T00:47:00.649 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:00.649 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:47:00.649 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:47:00.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.650 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:47:00.650 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:47:00.650 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.650 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.651 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:47:00.651 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:47:00.651 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.652 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:47:00.653 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:47:00.653 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.653 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.654 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:47:00.654 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:47:00.654 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.654 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.654 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.655 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:47:00.656 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:47:00.656 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.656 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.656 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:47:00.656 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:47:00.657 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:47:00.658 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.658 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.658 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.658 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:47:00.659 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.661 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:47:00.661 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:47:00.661 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.661 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.662 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.662 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.663 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:47:00.664 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.665 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.665 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.665 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.665 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.666 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.667 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.667 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.668 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.669 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:47:00.669 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:47:00.669 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:47:00.671 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:47:00.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.672 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:47:00.672 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:47:00.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.674 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:47:00.674 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:47:00.674 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:47:00.676 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:47:00.677 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:47:00.677 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:47:00.677 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:47:00.678 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:47:00.679 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:47:00.679 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.680 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:47:00.680 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:47:00.680 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.680 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:47:00.680 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:47:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:00.681 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:47:00.682 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.683 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:00.683 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:47:00.683 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:47:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 msgr2=0x7ff5a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 0x7ff5a0061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff5a400b340 tx=0x7ff5a4017000).stop 2023-10-24T00:47:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 msgr2=0x7ff5b40bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7ff5b000cfc0 tx=0x7ff5b00078b0).stop 2023-10-24T00:47:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 shutdown_connections 2023-10-24T00:47:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff5b4152720 0x7ff5b4167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff5a005f150 0x7ff5a0061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5b40c2280 0x7ff5b40bfcf0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 --2- 172.21.15.148:0/1315708048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b4152340 0x7ff5b4167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:00.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 >> 172.21.15.148:0/1315708048 conn(0x7ff5b4064230 msgr2=0x7ff5b40c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:00.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 shutdown_connections 2023-10-24T00:47:00.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.649+0000 7ff5bb0e1700 1 -- 172.21.15.148:0/1315708048 wait complete. 2023-10-24T00:47:00.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:47:00.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.799+0000 7f04b708a700 1 Processor -- start 2023-10-24T00:47:00.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.799+0000 7f04b708a700 1 -- start start 2023-10-24T00:47:00.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04b708a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b01511a0 0x7f04b0151580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04b708a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04b00be000 0x7f04b00c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04b708a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00a9fa0 con 0x7f04b00c2ea0 2023-10-24T00:47:00.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04b708a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00c3320 con 0x7f04b00be000 2023-10-24T00:47:00.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04b708a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00bd240 con 0x7f04b01511a0 2023-10-24T00:47:00.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04a7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04b00be000 0x7f04b00c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04a7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f04b00be000 0x7f04b00c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35948/0 (socket says 172.21.15.148:35948) 2023-10-24T00:47:00.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.800+0000 7f04a7fff700 1 -- 172.21.15.148:0/2614840861 learned_addr learned my addr 172.21.15.148:0/2614840861 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:00.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04b4e26700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b01511a0 0x7f04b0151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a7fff700 1 -- 172.21.15.148:0/2614840861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b01511a0 msgr2=0x7f04b0151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a7fff700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b01511a0 0x7f04b0151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a7fff700 1 -- 172.21.15.148:0/2614840861 >> v1:172.21.15.150:6789/0 conn(0x7f04b00c2ea0 legacy=0x7f04b0063760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:00.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a7fff700 1 -- 172.21.15.148:0/2614840861 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00bd520 con 0x7f04b00be000 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a7fff700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00be000 0x7f04b00c29b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f04a0006fd0 tx=0x7f04a000b3b0).ready entity=mon.0 client_cookie=28cf22294a5b8802 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a77fe700 1 -- 172.21.15.148:0/2614840861 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000db00 con 0x7f04b00be000 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a77fe700 1 -- 172.21.15.148:0/2614840861 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000dc60 con 0x7f04b00be000 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04a77fe700 1 -- 172.21.15.148:0/2614840861 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0010470 con 0x7f04b00be000 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04b708a700 1 -- 172.21.15.148:0/2614840861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00be000 msgr2=0x7f04b00c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.801+0000 7f04b708a700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00be000 0x7f04b00c29b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f04a0006fd0 tx=0x7f04a000b3b0).stop 2023-10-24T00:47:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 -- 172.21.15.148:0/2614840861 shutdown_connections 2023-10-24T00:47:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b01511a0 0x7f04b0151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 --2- 172.21.15.148:0/2614840861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00be000 0x7f04b00c29b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 -- 172.21.15.148:0/2614840861 >> 172.21.15.148:0/2614840861 conn(0x7f04b00c3f00 msgr2=0x7f04b00c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:00.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 -- 172.21.15.148:0/2614840861 shutdown_connections 2023-10-24T00:47:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.802+0000 7f04b708a700 1 -- 172.21.15.148:0/2614840861 wait complete. 2023-10-24T00:47:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.803+0000 7f04b708a700 1 Processor -- start 2023-10-24T00:47:00.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.803+0000 7f04b708a700 1 -- start start 2023-10-24T00:47:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b00be000 0x7f04b0153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 0x7f04b00ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b013ae10 con 0x7f04b00c2ea0 2023-10-24T00:47:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0153f60 con 0x7f04b01511a0 2023-10-24T00:47:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0154240 con 0x7f04b00be000 2023-10-24T00:47:00.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35956/0 (socket says 172.21.15.148:35956) 2023-10-24T00:47:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 -- 172.21.15.148:0/3669168816 learned_addr learned my addr 172.21.15.148:0/3669168816 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b4e26700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b00be000 0x7f04b0153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b5627700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 0x7f04b00ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 -- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b00be000 msgr2=0x7f04b0153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b00be000 0x7f04b0153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 -- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 msgr2=0x7f04b00ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 0x7f04b00ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 -- 172.21.15.148:0/3669168816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a000b610 con 0x7f04b00c2ea0 2023-10-24T00:47:00.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b5627700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 0x7f04b00ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:00.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a7fff700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f04b006c360 tx=0x7f04a000b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0020070 con 0x7f04b00c2ea0 2023-10-24T00:47:00.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0019660 con 0x7f04b00c2ea0 2023-10-24T00:47:00.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0154520 con 0x7f04b00c2ea0 2023-10-24T00:47:00.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0019a20 con 0x7f04b00c2ea0 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.804+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00aa570 con 0x7f04b00c2ea0 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.805+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0066750 con 0x7f04b00c2ea0 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.806+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f04a000f3d0 con 0x7f04b00c2ea0 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.806+0000 7f04a4ff9700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 0x7f049c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.806+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f04a007dcb0 con 0x7f04b00c2ea0 2023-10-24T00:47:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.807+0000 7f04b4e26700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 0x7f049c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.807+0000 7f04b4e26700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 0x7f049c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f04ac00aae0 tx=0x7f04ac006f90).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.810+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f04a004f270 con 0x7f04b00c2ea0 2023-10-24T00:47:00.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.979+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04b00bd800 con 0x7f04b00c2ea0 2023-10-24T00:47:00.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.980+0000 7f04a4ff9700 1 -- 172.21.15.148:0/3669168816 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f04a002a070 con 0x7f04b00c2ea0 2023-10-24T00:47:00.982 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:00.982 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":123,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:47:00.272501+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:47:00.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 msgr2=0x7f049c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 0x7f049c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f04ac00aae0 tx=0x7f04ac006f90).stop 2023-10-24T00:47:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 msgr2=0x7f04b014d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f04b006c360 tx=0x7f04a000b3b0).stop 2023-10-24T00:47:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 shutdown_connections 2023-10-24T00:47:00.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b01511a0 0x7f04b00ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04b00be000 0x7f04b0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f049c05f150 0x7f049c061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 --2- 172.21.15.148:0/3669168816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04b00c2ea0 0x7f04b014d4d0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:00.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 >> 172.21.15.148:0/3669168816 conn(0x7f04b00c3f00 msgr2=0x7f04b0062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:00.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 shutdown_connections 2023-10-24T00:47:00.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:00.982+0000 7f04b708a700 1 -- 172.21.15.148:0/3669168816 wait complete. 2023-10-24T00:47:00.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:47:00.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:47:01.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.112+0000 7f6a1014d700 1 Processor -- start 2023-10-24T00:47:01.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.112+0000 7f6a1014d700 1 -- start start 2023-10-24T00:47:01.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a1014d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a080c1950 0x7f6a08155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a1014d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a08155c00 con 0x7f6a08152290 2023-10-24T00:47:01.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a1014d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080c7b80 con 0x7f6a080c6950 2023-10-24T00:47:01.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a1014d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a080c8800 con 0x7f6a080c1950 2023-10-24T00:47:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a0dee9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a08152290 0x7f6a080c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49814/0 (socket says 172.21.15.148:49814) 2023-10-24T00:47:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.113+0000 7f6a0dee9700 1 -- 172.21.15.148:0/2060988799 learned_addr learned my addr 172.21.15.148:0/2060988799 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799011550 0 0) 0x7f6a08155c00 con 0x7f6a08152290 2023-10-24T00:47:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f40033f0 con 0x7f6a08152290 2023-10-24T00:47:01.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/2060988799 >> v2:172.21.15.150:3300/0 conn(0x7f6a080c1950 0x7f6a08155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057572849 0 0) 0x7f69f40033f0 con 0x7f6a08152290 2023-10-24T00:47:01.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 >> v2:172.21.15.150:3300/0 conn(0x7f6a080c1950 msgr2=0x7f6a08155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:01.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 --2- 172.21.15.148:0/2060988799 >> v2:172.21.15.150:3300/0 conn(0x7f6a080c1950 0x7f6a08155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 >> v1:172.21.15.150:6789/0 conn(0x7f6a080c6950 legacy=0x7f6a0815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080c7e60 con 0x7f6a08152290 2023-10-24T00:47:01.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6a04001470 con 0x7f6a08152290 2023-10-24T00:47:01.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 >> v1:172.21.15.148:6789/0 conn(0x7f6a08152290 legacy=0x7f6a080c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f40038e0 0x7f69f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4004690 0x7f69f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 0x7f69f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c8800 con 0x7f69f4005050 2023-10-24T00:47:01.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400bfe0 con 0x7f69f40038e0 2023-10-24T00:47:01.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f400c1a0 con 0x7f69f4004690 2023-10-24T00:47:01.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 0x7f69f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0dee9700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f40038e0 0x7f69f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0d6e8700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4004690 0x7f69f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 -- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4004690 msgr2=0x7f69f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:01.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4004690 0x7f69f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 -- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f40038e0 msgr2=0x7f69f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:01.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f40038e0 0x7f69f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 -- 172.21.15.148:0/2060988799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40033f0 con 0x7f69f4005050 2023-10-24T00:47:01.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0d6e8700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4004690 0x7f69f4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:01.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 -- 172.21.15.148:0/2060988799 reap_dead start 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.114+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 0x7f69f400b8e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f6a000094d0 tx=0x7f6a0000b040).ready entity=mon.0 client_cookie=7ad7a99bde23a158 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ea30 con 0x7f69f4005050 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000f040 con 0x7f69f4005050 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a0cee7700 1 -- 172.21.15.148:0/2060988799 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000edc0 con 0x7f69f4005050 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 -- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 msgr2=0x7f69f400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 0x7f69f400b8e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f6a000094d0 tx=0x7f6a0000b040).stop 2023-10-24T00:47:01.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 -- 172.21.15.148:0/2060988799 shutdown_connections 2023-10-24T00:47:01.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 --2- 172.21.15.148:0/2060988799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69f4005050 0x7f69f400b8e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 -- 172.21.15.148:0/2060988799 >> 172.21.15.148:0/2060988799 conn(0x7f6a080946c0 msgr2=0x7f6a0806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 -- 172.21.15.148:0/2060988799 shutdown_connections 2023-10-24T00:47:01.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.115+0000 7f6a1014d700 1 -- 172.21.15.148:0/2060988799 wait complete. 2023-10-24T00:47:01.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.116+0000 7f6a1014d700 1 Processor -- start 2023-10-24T00:47:01.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.116+0000 7f6a1014d700 1 -- start start 2023-10-24T00:47:01.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 0x7f6a0814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 0x7f6a0814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08167d20 con 0x7f6a0814d690 2023-10-24T00:47:01.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c5470 con 0x7f6a0814e610 2023-10-24T00:47:01.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a1014d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0814ef60 con 0x7f69f4005050 2023-10-24T00:47:01.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35974/0 (socket says 172.21.15.148:35974) 2023-10-24T00:47:01.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 -- 172.21.15.148:0/1997750494 learned_addr learned my addr 172.21.15.148:0/1997750494 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:01.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 0x7f6a0814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0dee9700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 0x7f6a0814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 -- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 msgr2=0x7f6a0814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 0x7f6a0814dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 -- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 msgr2=0x7f6a0814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 0x7f6a0814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0d6e8700 1 -- 172.21.15.148:0/1997750494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08165680 con 0x7f6a0814d690 2023-10-24T00:47:01.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0e6ea700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 0x7f6a0814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:01.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.117+0000 7f6a0dee9700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 0x7f6a0814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:01.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f6a0d6e8700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f69f800e3e0 tx=0x7f69f8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800ee70 con 0x7f6a0814d690 2023-10-24T00:47:01.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f8010040 con 0x7f6a0814d690 2023-10-24T00:47:01.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8015650 con 0x7f6a0814d690 2023-10-24T00:47:01.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08167f00 con 0x7f6a0814d690 2023-10-24T00:47:01.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.118+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a081684c0 con 0x7f6a0814d690 2023-10-24T00:47:01.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.119+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a08168b10 con 0x7f6a0814d690 2023-10-24T00:47:01.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.119+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f69f801f3f0 con 0x7f6a0814d690 2023-10-24T00:47:01.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.119+0000 7f69fdffb700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 0x7f69ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.119+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f69f8079590 con 0x7f6a0814d690 2023-10-24T00:47:01.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.120+0000 7f6a0dee9700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 0x7f69ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.120+0000 7f6a0dee9700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 0x7f69ec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6a040015a0 tx=0x7f6a04009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.123+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f69f804ab50 con 0x7f6a0814d690 2023-10-24T00:47:01.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.286+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6a080c71f0 con 0x7f6a0814d690 2023-10-24T00:47:01.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.287+0000 7f69fdffb700 1 -- 172.21.15.148:0/1997750494 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v123) v1 ==== 110+0+10 (secure 0 0 0) 0x7f69f804e170 con 0x7f6a0814d690 2023-10-24T00:47:01.288 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:47:01.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 msgr2=0x7f69ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 0x7f69ec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6a040015a0 tx=0x7f6a04009040).stop 2023-10-24T00:47:01.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 msgr2=0x7f6a08165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f69f800e3e0 tx=0x7f69f8009040).stop 2023-10-24T00:47:01.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 shutdown_connections 2023-10-24T00:47:01.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a0814e610 0x7f6a0814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f4005050 0x7f6a0814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f69ec05f150 0x7f69ec061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 --2- 172.21.15.148:0/1997750494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a0814d690 0x7f6a08165190 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 >> 172.21.15.148:0/1997750494 conn(0x7f6a080946c0 msgr2=0x7f6a080c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 shutdown_connections 2023-10-24T00:47:01.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.289+0000 7f6a1014d700 1 -- 172.21.15.148:0/1997750494 wait complete. 2023-10-24T00:47:01.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:47:01.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.417+0000 7fe1e71a4700 1 Processor -- start 2023-10-24T00:47:01.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.417+0000 7fe1e71a4700 1 -- start start 2023-10-24T00:47:01.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.417+0000 7fe1e71a4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1e0157780 0x7fe1e00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e71a4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1e00c0960 0x7fe1e00a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e71a4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00c6770 con 0x7fe1e00a8120 2023-10-24T00:47:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e71a4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e00c1120 con 0x7fe1e0157780 2023-10-24T00:47:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e71a4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e00c1400 con 0x7fe1e00c0960 2023-10-24T00:47:01.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1e0157780 0x7fe1e00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e69a3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe1e00a8120 0x7fe1e00a9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49822/0 (socket says 172.21.15.148:49822) 2023-10-24T00:47:01.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e69a3700 1 -- 172.21.15.148:0/182202135 learned_addr learned my addr 172.21.15.148:0/182202135 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:01.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e59a1700 1 --2- 172.21.15.148:0/182202135 >> v2:172.21.15.150:3300/0 conn(0x7fe1e00c0960 0x7fe1e00a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 -- 172.21.15.148:0/182202135 >> v2:172.21.15.150:3300/0 conn(0x7fe1e00c0960 msgr2=0x7fe1e00a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:01.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 --2- 172.21.15.148:0/182202135 >> v2:172.21.15.150:3300/0 conn(0x7fe1e00c0960 0x7fe1e00a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 -- 172.21.15.148:0/182202135 >> v1:172.21.15.148:6789/0 conn(0x7fe1e00a8120 legacy=0x7fe1e00a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 -- 172.21.15.148:0/182202135 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00c6120 con 0x7fe1e0157780 2023-10-24T00:47:01.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e51a0700 1 -- 172.21.15.148:0/182202135 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478987058 0 0) 0x7fe1e00c6770 con 0x7fe1e00a8120 2023-10-24T00:47:01.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e61a2700 1 --2- 172.21.15.148:0/182202135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e0157780 0x7fe1e00c8530 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fe1e00846a0 tx=0x7fe1dc009780).ready entity=mon.0 client_cookie=3e5811541654032d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e51a0700 1 -- 172.21.15.148:0/182202135 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00e070 con 0x7fe1e0157780 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e51a0700 1 -- 172.21.15.148:0/182202135 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00bb60 con 0x7fe1e0157780 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.418+0000 7fe1e51a0700 1 -- 172.21.15.148:0/182202135 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc012410 con 0x7fe1e0157780 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 -- 172.21.15.148:0/182202135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e0157780 msgr2=0x7fe1e00c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/182202135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e0157780 0x7fe1e00c8530 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fe1e00846a0 tx=0x7fe1dc009780).stop 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 -- 172.21.15.148:0/182202135 shutdown_connections 2023-10-24T00:47:01.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/182202135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e0157780 0x7fe1e00c8530 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/182202135 >> v2:172.21.15.150:3300/0 conn(0x7fe1e00c0960 0x7fe1e00a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 -- 172.21.15.148:0/182202135 >> 172.21.15.148:0/182202135 conn(0x7fe1e0094570 msgr2=0x7fe1e006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 -- 172.21.15.148:0/182202135 shutdown_connections 2023-10-24T00:47:01.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.419+0000 7fe1e71a4700 1 -- 172.21.15.148:0/182202135 wait complete. 2023-10-24T00:47:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.420+0000 7fe1e71a4700 1 Processor -- start 2023-10-24T00:47:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.420+0000 7fe1e71a4700 1 -- start start 2023-10-24T00:47:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 0x7fe1e00c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 0x7fe1e00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c4d40 con 0x7fe1e00a8120 2023-10-24T00:47:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c35f0 con 0x7fe1e00c0960 2023-10-24T00:47:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c29e0 con 0x7fe1e0157780 2023-10-24T00:47:01.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35992/0 (socket says 172.21.15.148:35992) 2023-10-24T00:47:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 -- 172.21.15.148:0/967898626 learned_addr learned my addr 172.21.15.148:0/967898626 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e69a3700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 0x7fe1e00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e59a1700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 0x7fe1e00c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 -- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 msgr2=0x7fe1e00c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 0x7fe1e00c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 -- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 msgr2=0x7fe1e00c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 0x7fe1e00c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 -- 172.21.15.148:0/967898626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009a20 con 0x7fe1e00a8120 2023-10-24T00:47:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e69a3700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 0x7fe1e00c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e59a1700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 0x7fe1e00c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e61a2700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fe1e005f980 tx=0x7fe1dc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc021070 con 0x7fe1e00a8120 2023-10-24T00:47:01.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc01d420 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00c2cc0 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc01d7c0 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.421+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e00c3280 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.423+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e00c3410 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.423+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe1dc003040 con 0x7fe1e00a8120 2023-10-24T00:47:01.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.423+0000 7fe1d67fc700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 0x7fe1c40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.423+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe1dc07bc50 con 0x7fe1e00a8120 2023-10-24T00:47:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.423+0000 7fe1e59a1700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 0x7fe1c40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.424+0000 7fe1e59a1700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 0x7fe1c40615e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1e0064170 tx=0x7fe1d0008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.427+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe1dc04d270 con 0x7fe1e00a8120 2023-10-24T00:47:01.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.592+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1e00c6400 con 0x7fe1e00a8120 2023-10-24T00:47:01.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.592+0000 7fe1d67fc700 1 -- 172.21.15.148:0/967898626 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1dc050890 con 0x7fe1e00a8120 2023-10-24T00:47:01.594 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:47:01.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 msgr2=0x7fe1c40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 0x7fe1c40615e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1e0064170 tx=0x7fe1d0008040).stop 2023-10-24T00:47:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 msgr2=0x7fe1e00c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fe1e005f980 tx=0x7fe1dc009780).stop 2023-10-24T00:47:01.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 shutdown_connections 2023-10-24T00:47:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1e0157780 0x7fe1e00c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe1c405f120 0x7fe1c40615e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1e00a8120 0x7fe1e00c2020 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 --2- 172.21.15.148:0/967898626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e00c0960 0x7fe1e00c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 >> 172.21.15.148:0/967898626 conn(0x7fe1e0094570 msgr2=0x7fe1e0063260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.594+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 shutdown_connections 2023-10-24T00:47:01.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.595+0000 7fe1e71a4700 1 -- 172.21.15.148:0/967898626 wait complete. 2023-10-24T00:47:01.609 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:47:01.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.721+0000 7f25a5c64700 1 Processor -- start 2023-10-24T00:47:01.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.721+0000 7f25a5c64700 1 -- start start 2023-10-24T00:47:01.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f25a5c64700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25a00aa010 0x7f25a00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f25a5c64700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00aa820 con 0x7f25a00c6710 2023-10-24T00:47:01.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f25a5c64700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00c0960 con 0x7f25a00aa3f0 2023-10-24T00:47:01.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f25a5c64700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a00c0c40 con 0x7f25a00aa010 2023-10-24T00:47:01.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f259f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f25a00aa010 0x7f25a00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f259effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f25a00c6710 0x7f25a0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49834/0 (socket says 172.21.15.148:49834) 2023-10-24T00:47:01.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.722+0000 7f259effd700 1 -- 172.21.15.148:0/4268828681 learned_addr learned my addr 172.21.15.148:0/4268828681 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259f7fe700 1 -- 172.21.15.148:0/4268828681 >> v1:172.21.15.150:6789/0 conn(0x7f25a00aa3f0 legacy=0x7f25a0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259f7fe700 1 -- 172.21.15.148:0/4268828681 >> v1:172.21.15.148:6789/0 conn(0x7f25a00c6710 legacy=0x7f25a0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259f7fe700 1 -- 172.21.15.148:0/4268828681 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a00c0f20 con 0x7f25a00aa010 2023-10-24T00:47:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259e7fc700 1 -- 172.21.15.148:0/4268828681 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350109974 0 0) 0x7f25a00aa820 con 0x7f25a00c6710 2023-10-24T00:47:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259f7fe700 1 --2- 172.21.15.148:0/4268828681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00aa010 0x7f25a00c1a00 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f2590009e60 tx=0x7f2590009780).ready entity=mon.0 client_cookie=e474c52a4aa9389d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259e7fc700 1 -- 172.21.15.148:0/4268828681 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000e070 con 0x7f25a00aa010 2023-10-24T00:47:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259e7fc700 1 -- 172.21.15.148:0/4268828681 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000bc30 con 0x7f25a00aa010 2023-10-24T00:47:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f259e7fc700 1 -- 172.21.15.148:0/4268828681 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590012410 con 0x7f25a00aa010 2023-10-24T00:47:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 -- 172.21.15.148:0/4268828681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00aa010 msgr2=0x7f25a00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 --2- 172.21.15.148:0/4268828681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00aa010 0x7f25a00c1a00 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f2590009e60 tx=0x7f2590009780).stop 2023-10-24T00:47:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 -- 172.21.15.148:0/4268828681 shutdown_connections 2023-10-24T00:47:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 --2- 172.21.15.148:0/4268828681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00aa010 0x7f25a00c1a00 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 -- 172.21.15.148:0/4268828681 >> 172.21.15.148:0/4268828681 conn(0x7f25a00caf40 msgr2=0x7f25a00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 -- 172.21.15.148:0/4268828681 shutdown_connections 2023-10-24T00:47:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.723+0000 7f25a5c64700 1 -- 172.21.15.148:0/4268828681 wait complete. 2023-10-24T00:47:01.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 Processor -- start 2023-10-24T00:47:01.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 -- start start 2023-10-24T00:47:01.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25a00aa010 0x7f25a0143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 0x7f25a0154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0168a30 con 0x7f25a00c6710 2023-10-24T00:47:01.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01578f0 con 0x7f25a00aa3f0 2023-10-24T00:47:01.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.725+0000 7f25a5c64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0167b40 con 0x7f25a00aa010 2023-10-24T00:47:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36006/0 (socket says 172.21.15.148:36006) 2023-10-24T00:47:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 -- 172.21.15.148:0/3854427269 learned_addr learned my addr 172.21.15.148:0/3854427269 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259effd700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 0x7f25a0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259f7fe700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25a00aa010 0x7f25a0143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 -- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25a00aa010 msgr2=0x7f25a0143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25a00aa010 0x7f25a0143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 -- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 msgr2=0x7f25a0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 0x7f25a0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 -- 172.21.15.148:0/3854427269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590009a20 con 0x7f25a00c6710 2023-10-24T00:47:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259effd700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 0x7f25a0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f259ffff700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f259800c440 tx=0x7f2598007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800f470 con 0x7f25a00c6710 2023-10-24T00:47:01.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598001e90 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a0167e20 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800f7e0 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.726+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a01683e0 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.727+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a006c6b0 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.728+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f259800fbd0 con 0x7f25a00c6710 2023-10-24T00:47:01.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.728+0000 7f25877fe700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 0x7f258c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.728+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2598079280 con 0x7f25a00c6710 2023-10-24T00:47:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.728+0000 7f259f7fe700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 0x7f258c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:01.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.728+0000 7f259f7fe700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 0x7f258c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2590009e60 tx=0x7f2590009780).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:01.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.732+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2598047af0 con 0x7f25a00c6710 2023-10-24T00:47:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.898+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25a00c1200 con 0x7f25a00c6710 2023-10-24T00:47:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.898+0000 7f25877fe700 1 -- 172.21.15.148:0/3854427269 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v123) v1 ==== 84+0+143 (secure 0 0 0) 0x7f259804a8a0 con 0x7f25a00c6710 2023-10-24T00:47:01.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:01.901 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:47:01.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:01.902 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:47:01.902 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:47:01.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:47:01.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:01.903 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:47:01.903 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:47:01.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:01.903 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:47:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 msgr2=0x7f258c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 0x7f258c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2590009e60 tx=0x7f2590009780).stop 2023-10-24T00:47:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 msgr2=0x7f25a00c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f259800c440 tx=0x7f2598007d70).stop 2023-10-24T00:47:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 shutdown_connections 2023-10-24T00:47:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f258c05f150 0x7f258c061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25a00c6710 0x7f25a00c9c90 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f25a00aa010 0x7f25a0143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 --2- 172.21.15.148:0/3854427269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25a00aa3f0 0x7f25a0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 >> 172.21.15.148:0/3854427269 conn(0x7f25a00caf40 msgr2=0x7f25a00c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 shutdown_connections 2023-10-24T00:47:01.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:01.900+0000 7f25a5c64700 1 -- 172.21.15.148:0/3854427269 wait complete. 2023-10-24T00:47:01.914 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:47:01.914 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:47:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.032+0000 7f3d02014700 1 Processor -- start 2023-10-24T00:47:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.032+0000 7f3d02014700 1 -- start start 2023-10-24T00:47:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3d02014700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3d02014700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cfc064c10 0x7f3cfc065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3d02014700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc065540 con 0x7f3cfc0be780 2023-10-24T00:47:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3d02014700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc0c7a20 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3d02014700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc0c6330 con 0x7f3cfc064c10 2023-10-24T00:47:02.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3cfb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3cfb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36012/0 (socket says 172.21.15.148:36012) 2023-10-24T00:47:02.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3cfb7fe700 1 -- 172.21.15.148:0/2589729741 learned_addr learned my addr 172.21.15.148:0/2589729741 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.033+0000 7f3cf3fff700 1 --2- 172.21.15.148:0/2589729741 >> v2:172.21.15.150:3300/0 conn(0x7f3cfc064c10 0x7f3cfc065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfb7fe700 1 -- 172.21.15.148:0/2589729741 >> v2:172.21.15.150:3300/0 conn(0x7f3cfc064c10 msgr2=0x7f3cfc065050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2589729741 >> v2:172.21.15.150:3300/0 conn(0x7f3cfc064c10 0x7f3cfc065050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfb7fe700 1 -- 172.21.15.148:0/2589729741 >> v1:172.21.15.150:6789/0 conn(0x7f3cfc0be780 legacy=0x7f3cfc0bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfb7fe700 1 -- 172.21.15.148:0/2589729741 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc0633f0 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2589729741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f3cfc0bfeb0 tx=0x7f3cec0090f0).ready entity=mon.0 client_cookie=566136c8b724104e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfaffd700 1 -- 172.21.15.148:0/2589729741 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00b520 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfaffd700 1 -- 172.21.15.148:0/2589729741 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec00b680 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3cfaffd700 1 -- 172.21.15.148:0/2589729741 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00ba00 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 -- 172.21.15.148:0/2589729741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0c5f50 msgr2=0x7f3cfc0a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 --2- 172.21.15.148:0/2589729741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f3cfc0bfeb0 tx=0x7f3cec0090f0).stop 2023-10-24T00:47:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 -- 172.21.15.148:0/2589729741 shutdown_connections 2023-10-24T00:47:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 --2- 172.21.15.148:0/2589729741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc0a5ba0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 --2- 172.21.15.148:0/2589729741 >> v2:172.21.15.150:3300/0 conn(0x7f3cfc064c10 0x7f3cfc065050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 -- 172.21.15.148:0/2589729741 >> 172.21.15.148:0/2589729741 conn(0x7f3cfc082f60 msgr2=0x7f3cfc092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 -- 172.21.15.148:0/2589729741 shutdown_connections 2023-10-24T00:47:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.034+0000 7f3d02014700 1 -- 172.21.15.148:0/2589729741 wait complete. 2023-10-24T00:47:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 Processor -- start 2023-10-24T00:47:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 -- start start 2023-10-24T00:47:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 0x7f3cfc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc094950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0944c0 con 0x7f3cfc0be780 2023-10-24T00:47:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc1545e0 con 0x7f3cfc0c5f50 2023-10-24T00:47:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3d02014700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc092d10 con 0x7f3cfc064c10 2023-10-24T00:47:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36020/0 (socket says 172.21.15.148:36020) 2023-10-24T00:47:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.036+0000 7f3cf3fff700 1 -- 172.21.15.148:0/2270164446 learned_addr learned my addr 172.21.15.148:0/2270164446 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 0x7f3cfc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cfbfff700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc094950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 -- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 msgr2=0x7f3cfc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 0x7f3cfc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 -- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 msgr2=0x7f3cfc094950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc094950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 -- 172.21.15.148:0/2270164446 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009370 con 0x7f3cfc0be780 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cfbfff700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc094950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 0x7f3cfc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf3fff700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f3ce400e950 tx=0x7f3ce4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400c850 con 0x7f3cfc0be780 2023-10-24T00:47:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400c9b0 con 0x7f3cfc0be780 2023-10-24T00:47:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc092ff0 con 0x7f3cfc0be780 2023-10-24T00:47:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400cd30 con 0x7f3cfc0be780 2023-10-24T00:47:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.037+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc0932d0 con 0x7f3cfc0be780 2023-10-24T00:47:02.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.038+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc094670 con 0x7f3cfc0be780 2023-10-24T00:47:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.038+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3ce4012600 con 0x7f3cfc0be780 2023-10-24T00:47:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.039+0000 7f3cf37fe700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 0x7f3cdc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.039+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3ce407a440 con 0x7f3cfc0be780 2023-10-24T00:47:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.039+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 0x7f3cdc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.039+0000 7f3cfb7fe700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 0x7f3cdc061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3cec009130 tx=0x7f3cec017000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.043+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3cfc094670 con 0x7f3cfc0be780 2023-10-24T00:47:02.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.208+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3cfc06c6b0 con 0x7f3cfc0be780 2023-10-24T00:47:02.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:47:02.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:47:02.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.873+0000 7f3cf37fe700 1 -- 172.21.15.148:0/2270164446 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v124) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3ce40160c0 con 0x7f3cfc0be780 2023-10-24T00:47:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.876+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 msgr2=0x7f3cdc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.876+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 0x7f3cdc061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3cec009130 tx=0x7f3cec017000).stop 2023-10-24T00:47:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.876+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 msgr2=0x7f3cfc092410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.876+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f3ce400e950 tx=0x7f3ce4009060).stop 2023-10-24T00:47:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 shutdown_connections 2023-10-24T00:47:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cfc0c5f50 0x7f3cfc094950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cfc064c10 0x7f3cfc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3cdc05f150 0x7f3cdc061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 --2- 172.21.15.148:0/2270164446 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cfc0be780 0x7f3cfc092410 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.877+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 >> 172.21.15.148:0/2270164446 conn(0x7f3cfc082f60 msgr2=0x7f3cfc0ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.878+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 shutdown_connections 2023-10-24T00:47:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:02.878+0000 7f3d02014700 1 -- 172.21.15.148:0/2270164446 wait complete. 2023-10-24T00:47:02.884 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:47:02.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:47:03.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.014+0000 7f2ca55a3700 1 Processor -- start 2023-10-24T00:47:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.014+0000 7f2ca55a3700 1 -- start start 2023-10-24T00:47:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2ca55a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 0x7f2ca0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2ca55a3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ca00bffd0 0x7f2ca00c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2ca55a3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00c0970 con 0x7f2ca0154430 2023-10-24T00:47:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2ca55a3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca00c6a10 con 0x7f2ca00bffd0 2023-10-24T00:47:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2ca55a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00c71d0 con 0x7f2ca0098bd0 2023-10-24T00:47:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ca00bffd0 0x7f2ca00c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ca00bffd0 0x7f2ca00c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36022/0 (socket says 172.21.15.148:36022) 2023-10-24T00:47:03.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/809695979 learned_addr learned my addr 172.21.15.148:0/809695979 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9e7fc700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 0x7f2ca0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/809695979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 msgr2=0x7f2ca0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 0x7f2ca0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/809695979 >> v1:172.21.15.150:6789/0 conn(0x7f2ca0154430 legacy=0x7f2ca00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/809695979 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00c9410 con 0x7f2ca00bffd0 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9e7fc700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 0x7f2ca0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9f7fe700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca00bffd0 0x7f2ca00c0480 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f2c98009f50 tx=0x7f2c98009840).ready entity=mon.0 client_cookie=cdac9da7c895ac60 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9dffb700 1 -- 172.21.15.148:0/809695979 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800e070 con 0x7f2ca00bffd0 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9dffb700 1 -- 172.21.15.148:0/809695979 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800ba70 con 0x7f2ca00bffd0 2023-10-24T00:47:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.015+0000 7f2c9dffb700 1 -- 172.21.15.148:0/809695979 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800bdf0 con 0x7f2ca00bffd0 2023-10-24T00:47:03.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 -- 172.21.15.148:0/809695979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca00bffd0 msgr2=0x7f2ca00c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca00bffd0 0x7f2ca00c0480 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f2c98009f50 tx=0x7f2c98009840).stop 2023-10-24T00:47:03.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 -- 172.21.15.148:0/809695979 shutdown_connections 2023-10-24T00:47:03.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca00bffd0 0x7f2ca00c0480 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/809695979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca0098bd0 0x7f2ca0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 -- 172.21.15.148:0/809695979 >> 172.21.15.148:0/809695979 conn(0x7f2ca00cb070 msgr2=0x7f2ca00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 -- 172.21.15.148:0/809695979 shutdown_connections 2023-10-24T00:47:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.016+0000 7f2ca55a3700 1 -- 172.21.15.148:0/809695979 wait complete. 2023-10-24T00:47:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.017+0000 7f2ca55a3700 1 Processor -- start 2023-10-24T00:47:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.017+0000 7f2ca55a3700 1 -- start start 2023-10-24T00:47:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0098bd0 0x7f2ca0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 0x7f2ca0151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0151b10 con 0x7f2ca0154430 2023-10-24T00:47:03.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00c4e60 con 0x7f2ca0098bd0 2023-10-24T00:47:03.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2ca55a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0151f70 con 0x7f2ca00bffd0 2023-10-24T00:47:03.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36024/0 (socket says 172.21.15.148:36024) 2023-10-24T00:47:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/3299103185 learned_addr learned my addr 172.21.15.148:0/3299103185 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9effd700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0098bd0 0x7f2ca0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9e7fc700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 0x7f2ca0151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 msgr2=0x7f2ca0151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 0x7f2ca0151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0098bd0 msgr2=0x7f2ca0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0098bd0 0x7f2ca0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9f7fe700 1 -- 172.21.15.148:0/3299103185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009ae0 con 0x7f2ca0154430 2023-10-24T00:47:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.018+0000 7f2c9e7fc700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 0x7f2ca0151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:03.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2c9f7fe700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f2ca00c5910 tx=0x7f2c98009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:03.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980032f0 con 0x7f2ca0154430 2023-10-24T00:47:03.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980092e0 con 0x7f2ca0154430 2023-10-24T00:47:03.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca00c45c0 con 0x7f2ca0154430 2023-10-24T00:47:03.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9801e6a0 con 0x7f2ca0154430 2023-10-24T00:47:03.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.019+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00c4b80 con 0x7f2ca0154430 2023-10-24T00:47:03.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.020+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca006c6b0 con 0x7f2ca0154430 2023-10-24T00:47:03.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.020+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2c98003040 con 0x7f2ca0154430 2023-10-24T00:47:03.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.021+0000 7f2c86ffd700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 0x7f2c8c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:03.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.021+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f2c9807b520 con 0x7f2ca0154430 2023-10-24T00:47:03.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.021+0000 7f2c9effd700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 0x7f2c8c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:03.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.021+0000 7f2c9effd700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 0x7f2c8c061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2c90003860 tx=0x7f2c90007d40).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:03.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.025+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c9804ca80 con 0x7f2ca0154430 2023-10-24T00:47:03.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.191+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ca00612f0 con 0x7f2ca0154430 2023-10-24T00:47:03.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.879+0000 7f2c86ffd700 1 -- 172.21.15.148:0/3299103185 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v125) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2c98023070 con 0x7f2ca0154430 2023-10-24T00:47:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 msgr2=0x7f2c8c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 0x7f2c8c061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2c90003860 tx=0x7f2c90007d40).stop 2023-10-24T00:47:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 msgr2=0x7f2ca0151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f2ca00c5910 tx=0x7f2c98009840).stop 2023-10-24T00:47:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 shutdown_connections 2023-10-24T00:47:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c8c05f180 0x7f2c8c061640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ca0154430 0x7f2ca0151620 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ca0098bd0 0x7f2ca0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 --2- 172.21.15.148:0/3299103185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ca00bffd0 0x7f2ca0151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.895+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 >> 172.21.15.148:0/3299103185 conn(0x7f2ca00cb070 msgr2=0x7f2ca00ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:03.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.898+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 shutdown_connections 2023-10-24T00:47:03.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:03.898+0000 7f2ca55a3700 1 -- 172.21.15.148:0/3299103185 wait complete. 2023-10-24T00:47:03.905 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:47:03.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:47:04.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.031+0000 7f6ba976d700 1 Processor -- start 2023-10-24T00:47:04.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 -- start start 2023-10-24T00:47:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ba4154430 0x7f6ba4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6ba40c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40c71d0 con 0x7f6ba4098bd0 2023-10-24T00:47:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40c6a10 con 0x7f6ba4154430 2023-10-24T00:47:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6ba976d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c9410 con 0x7f6ba40bffd0 2023-10-24T00:47:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.032+0000 7f6b9a7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6ba4098bd0 0x7f6ba40c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52418/0 (socket says 172.21.15.148:52418) 2023-10-24T00:47:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6b9a7fc700 1 -- 172.21.15.148:0/1201581369 learned_addr learned my addr 172.21.15.148:0/1201581369 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba2ffd700 1 --2- 172.21.15.148:0/1201581369 >> v2:172.21.15.150:3300/0 conn(0x7f6ba4154430 0x7f6ba4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6ba40c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595603283 0 0) 0x7f6ba40c71d0 con 0x7f6ba4098bd0 2023-10-24T00:47:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b900033f0 con 0x7f6ba4098bd0 2023-10-24T00:47:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1465354980 0 0) 0x7f6b900033f0 con 0x7f6ba4098bd0 2023-10-24T00:47:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 msgr2=0x7f6ba40c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6ba40c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 >> v2:172.21.15.150:3300/0 conn(0x7f6ba4154430 msgr2=0x7f6ba4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 --2- 172.21.15.148:0/1201581369 >> v2:172.21.15.150:3300/0 conn(0x7f6ba4154430 0x7f6ba4154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40c0950 con 0x7f6ba4098bd0 2023-10-24T00:47:04.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6b8c001470 con 0x7f6ba4098bd0 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 >> v1:172.21.15.148:6789/0 conn(0x7f6ba4098bd0 legacy=0x7f6ba40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6b900038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90003e10 0x7f6b90004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90004b80 0x7f6b90005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c6a10 con 0x7f6b90004b80 2023-10-24T00:47:04.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c9410 con 0x7f6b90003e10 2023-10-24T00:47:04.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000b8e0 con 0x7f6ba40bffd0 2023-10-24T00:47:04.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6b9a7fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90003e10 0x7f6b90004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90004b80 0x7f6b90005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.033+0000 7f6ba2ffd700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6b900038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 -- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 msgr2=0x7f6b900038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40bffd0 0x7f6b900038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 -- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90003e10 msgr2=0x7f6b90004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90003e10 0x7f6b90004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 -- 172.21.15.148:0/1201581369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900033f0 con 0x7f6b90004b80 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6b9a7fc700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90003e10 0x7f6b90004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90004b80 0x7f6b90005000 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f6b9c00e240 tx=0x7f6b9c00b040).ready entity=mon.0 client_cookie=6b11569b52560fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c009ac0 con 0x7f6b90004b80 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c00f040 con 0x7f6b90004b80 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba27fc700 1 -- 172.21.15.148:0/1201581369 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00ed00 con 0x7f6b90004b80 2023-10-24T00:47:04.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 -- 172.21.15.148:0/1201581369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90004b80 msgr2=0x7f6b90005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 --2- 172.21.15.148:0/1201581369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b90004b80 0x7f6b90005000 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f6b9c00e240 tx=0x7f6b9c00b040).stop 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba37fe700 1 -- 172.21.15.148:0/1201581369 reap_dead start 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 -- 172.21.15.148:0/1201581369 shutdown_connections 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 -- 172.21.15.148:0/1201581369 >> 172.21.15.148:0/1201581369 conn(0x7f6ba40cb070 msgr2=0x7f6ba40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 -- 172.21.15.148:0/1201581369 shutdown_connections 2023-10-24T00:47:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.034+0000 7f6ba976d700 1 -- 172.21.15.148:0/1201581369 wait complete. 2023-10-24T00:47:04.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 Processor -- start 2023-10-24T00:47:04.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 -- start start 2023-10-24T00:47:04.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90004b80 0x7f6ba4142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40b0910 0x7f6ba40c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40aea10 con 0x7f6ba4142ff0 2023-10-24T00:47:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40b0d50 con 0x7f6b90004b80 2023-10-24T00:47:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.036+0000 7f6ba976d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40aec60 con 0x7f6ba40b0910 2023-10-24T00:47:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34948/0 (socket says 172.21.15.148:34948) 2023-10-24T00:47:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 -- 172.21.15.148:0/4199583521 learned_addr learned my addr 172.21.15.148:0/4199583521 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6ba2ffd700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90004b80 0x7f6ba4142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6ba37fe700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40b0910 0x7f6ba40c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 -- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40b0910 msgr2=0x7f6ba40c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40b0910 0x7f6ba40c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 -- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90004b80 msgr2=0x7f6ba4142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90004b80 0x7f6ba4142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 -- 172.21.15.148:0/4199583521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40aef40 con 0x7f6ba4142ff0 2023-10-24T00:47:04.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9a7fc700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f6b8c007860 tx=0x7f6ba4154d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00f840 con 0x7f6ba4142ff0 2023-10-24T00:47:04.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00f9a0 con 0x7f6ba4142ff0 2023-10-24T00:47:04.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40af220 con 0x7f6ba4142ff0 2023-10-24T00:47:04.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00fd20 con 0x7f6ba4142ff0 2023-10-24T00:47:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.037+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba40af7e0 con 0x7f6ba4142ff0 2023-10-24T00:47:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.038+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba406c6b0 con 0x7f6ba4142ff0 2023-10-24T00:47:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.038+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6b8c012560 con 0x7f6ba4142ff0 2023-10-24T00:47:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.039+0000 7f6b9b7fe700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 0x7f6b84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.039+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f6b8c079c80 con 0x7f6ba4142ff0 2023-10-24T00:47:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.039+0000 7f6ba2ffd700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 0x7f6b84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.039+0000 7f6ba2ffd700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 0x7f6b84061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b94006d80 tx=0x7f6b94009060).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.043+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b8c04b060 con 0x7f6ba4142ff0 2023-10-24T00:47:04.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.248+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ba40612f0 con 0x7f6ba4142ff0 2023-10-24T00:47:04.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.253+0000 7f6b9b7fe700 1 -- 172.21.15.148:0/4199583521 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6b8c019030 con 0x7f6ba4142ff0 2023-10-24T00:47:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 msgr2=0x7f6b84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 0x7f6b84061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b94006d80 tx=0x7f6b94009060).stop 2023-10-24T00:47:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 msgr2=0x7f6ba40b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f6b8c007860 tx=0x7f6ba4154d00).stop 2023-10-24T00:47:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 shutdown_connections 2023-10-24T00:47:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ba40b0910 0x7f6ba40c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b90004b80 0x7f6ba4142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6b8405f150 0x7f6b84061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 --2- 172.21.15.148:0/4199583521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6ba4142ff0 0x7f6ba40b0420 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.260+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 >> 172.21.15.148:0/4199583521 conn(0x7f6ba40cb070 msgr2=0x7f6ba40acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.262+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 shutdown_connections 2023-10-24T00:47:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.263+0000 7f6ba976d700 1 -- 172.21.15.148:0/4199583521 wait complete. 2023-10-24T00:47:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 15 and data pool 16 2023-10-24T00:47:04.285 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:47:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.397+0000 7f207f1d4700 1 Processor -- start 2023-10-24T00:47:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.397+0000 7f207f1d4700 1 -- start start 2023-10-24T00:47:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2078154100 0x7f20780667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f20780c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f20780c5ca0 0x7f20780a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780c6150 con 0x7f2078154100 2023-10-24T00:47:04.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2078066320 con 0x7f20780c5ca0 2023-10-24T00:47:04.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207f1d4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2078065710 con 0x7f20780c8360 2023-10-24T00:47:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207cf70700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2078154100 0x7f20780667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207cf70700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2078154100 0x7f20780667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34958/0 (socket says 172.21.15.148:34958) 2023-10-24T00:47:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.398+0000 7f207cf70700 1 -- 172.21.15.148:0/513560400 learned_addr learned my addr 172.21.15.148:0/513560400 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207d771700 1 --2- 172.21.15.148:0/513560400 >> v2:172.21.15.150:3300/0 conn(0x7f20780c5ca0 0x7f20780a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f206ffff700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f20780c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 -- 172.21.15.148:0/513560400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 msgr2=0x7f20780c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f20780c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 -- 172.21.15.148:0/513560400 >> v2:172.21.15.150:3300/0 conn(0x7f20780c5ca0 msgr2=0x7f20780a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 --2- 172.21.15.148:0/513560400 >> v2:172.21.15.150:3300/0 conn(0x7f20780c5ca0 0x7f20780a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 -- 172.21.15.148:0/513560400 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780659f0 con 0x7f2078154100 2023-10-24T00:47:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f206ffff700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f20780c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207cf70700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2078154100 0x7f20780667b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f2078069310 tx=0x7f2074009840).ready entity=mon.0 client_cookie=5b740d3dd253f254 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f206f7fe700 1 -- 172.21.15.148:0/513560400 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400e070 con 0x7f2078154100 2023-10-24T00:47:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f206f7fe700 1 -- 172.21.15.148:0/513560400 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207400ba20 con 0x7f2078154100 2023-10-24T00:47:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f206f7fe700 1 -- 172.21.15.148:0/513560400 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400bda0 con 0x7f2078154100 2023-10-24T00:47:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207f1d4700 1 -- 172.21.15.148:0/513560400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2078154100 msgr2=0x7f20780667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.399+0000 7f207f1d4700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2078154100 0x7f20780667b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f2078069310 tx=0x7f2074009840).stop 2023-10-24T00:47:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 -- 172.21.15.148:0/513560400 shutdown_connections 2023-10-24T00:47:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2078154100 0x7f20780667b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 --2- 172.21.15.148:0/513560400 >> v2:172.21.15.150:3300/0 conn(0x7f20780c5ca0 0x7f20780a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 --2- 172.21.15.148:0/513560400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f20780c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 -- 172.21.15.148:0/513560400 >> 172.21.15.148:0/513560400 conn(0x7f20780641f0 msgr2=0x7f20780c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 -- 172.21.15.148:0/513560400 shutdown_connections 2023-10-24T00:47:04.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.400+0000 7f207f1d4700 1 -- 172.21.15.148:0/513560400 wait complete. 2023-10-24T00:47:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.401+0000 7f207f1d4700 1 Processor -- start 2023-10-24T00:47:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.401+0000 7f207f1d4700 1 -- start start 2023-10-24T00:47:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f207814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2078154100 0x7f20780ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780abca0 con 0x7f20780c5ca0 2023-10-24T00:47:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780ab090 con 0x7f2078154100 2023-10-24T00:47:04.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20780ab370 con 0x7f20780c8360 2023-10-24T00:47:04.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34964/0 (socket says 172.21.15.148:34964) 2023-10-24T00:47:04.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 -- 172.21.15.148:0/2141899125 learned_addr learned my addr 172.21.15.148:0/2141899125 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:04.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f206ffff700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f207814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207d771700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2078154100 0x7f20780ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 -- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 msgr2=0x7f207814faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f207814faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 -- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2078154100 msgr2=0x7f20780ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2078154100 0x7f20780ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 -- 172.21.15.148:0/2141899125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074009ae0 con 0x7f20780c5ca0 2023-10-24T00:47:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207cf70700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f207400b6c0 tx=0x7f2074009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740032f0 con 0x7f20780c5ca0 2023-10-24T00:47:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20740092e0 con 0x7f20780c5ca0 2023-10-24T00:47:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20780ab650 con 0x7f20780c5ca0 2023-10-24T00:47:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400bdc0 con 0x7f20780c5ca0 2023-10-24T00:47:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.402+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20780aac00 con 0x7f20780c5ca0 2023-10-24T00:47:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.403+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20780abf80 con 0x7f20780c5ca0 2023-10-24T00:47:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.404+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2074003040 con 0x7f20780c5ca0 2023-10-24T00:47:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.404+0000 7f206cff9700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 0x7f20640615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.404+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f207407b3d0 con 0x7f20780c5ca0 2023-10-24T00:47:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.404+0000 7f206ffff700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 0x7f20640615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.405+0000 7f206ffff700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 0x7f20640615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2078156db0 tx=0x7f2068008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.408+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f207404c750 con 0x7f20780c5ca0 2023-10-24T00:47:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.572+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f207806c6b0 con 0x7f20780c5ca0 2023-10-24T00:47:04.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.573+0000 7f206cff9700 1 -- 172.21.15.148:0/2141899125 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f2074023070 con 0x7f20780c5ca0 2023-10-24T00:47:04.575 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:04.575 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":126,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:47:04.249876+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:47:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 msgr2=0x7f20640615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 0x7f20640615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2078156db0 tx=0x7f2068008040).stop 2023-10-24T00:47:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 msgr2=0x7f20780a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f207400b6c0 tx=0x7f2074009840).stop 2023-10-24T00:47:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 shutdown_connections 2023-10-24T00:47:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2078154100 0x7f20780ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f206405f120 0x7f20640615e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20780c5ca0 0x7f20780a9ba0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 --2- 172.21.15.148:0/2141899125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20780c8360 0x7f207814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.575+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 >> 172.21.15.148:0/2141899125 conn(0x7f20780641f0 msgr2=0x7f2078062a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.576+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 shutdown_connections 2023-10-24T00:47:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.576+0000 7f207f1d4700 1 -- 172.21.15.148:0/2141899125 wait complete. 2023-10-24T00:47:04.589 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:47:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 Processor -- start 2023-10-24T00:47:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 -- start start 2023-10-24T00:47:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780aa010 0x7f00780c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00780c6710 0x7f00780aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00780c0960 con 0x7f0078158770 2023-10-24T00:47:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00780aa8e0 con 0x7f00780c6710 2023-10-24T00:47:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.702+0000 7f007ce2c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00780c0c40 con 0x7f00780aa010 2023-10-24T00:47:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00780c6710 0x7f00780aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0076d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0078158770 0x7f0078069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52422/0 (socket says 172.21.15.148:52422) 2023-10-24T00:47:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0076d9d700 1 -- 172.21.15.148:0/2034836923 learned_addr learned my addr 172.21.15.148:0/2034836923 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f007659c700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780aa010 0x7f00780c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 -- 172.21.15.148:0/2034836923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780aa010 msgr2=0x7f00780c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780aa010 0x7f00780c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 -- 172.21.15.148:0/2034836923 >> v1:172.21.15.148:6789/0 conn(0x7f0078158770 legacy=0x7f0078069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0075d9b700 1 -- 172.21.15.148:0/2034836923 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463470443 0 0) 0x7f00780c0960 con 0x7f0078158770 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 -- 172.21.15.148:0/2034836923 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780c0f20 con 0x7f00780c6710 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f006dd9b700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00780c6710 0x7f00780aa3f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f0060009760 tx=0x7f0060009060).ready entity=mon.0 client_cookie=8cd543b4d74d8d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0075d9b700 1 -- 172.21.15.148:0/2034836923 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000f510 con 0x7f00780c6710 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0075d9b700 1 -- 172.21.15.148:0/2034836923 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006000f670 con 0x7f00780c6710 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.703+0000 7f0075d9b700 1 -- 172.21.15.148:0/2034836923 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000f9f0 con 0x7f00780c6710 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 -- 172.21.15.148:0/2034836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00780c6710 msgr2=0x7f00780aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00780c6710 0x7f00780aa3f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f0060009760 tx=0x7f0060009060).stop 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 -- 172.21.15.148:0/2034836923 shutdown_connections 2023-10-24T00:47:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780aa010 0x7f00780c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 --2- 172.21.15.148:0/2034836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00780c6710 0x7f00780aa3f0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 -- 172.21.15.148:0/2034836923 >> 172.21.15.148:0/2034836923 conn(0x7f00780caf40 msgr2=0x7f00780cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 -- 172.21.15.148:0/2034836923 shutdown_connections 2023-10-24T00:47:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.704+0000 7f007ce2c700 1 -- 172.21.15.148:0/2034836923 wait complete. 2023-10-24T00:47:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.705+0000 7f007ce2c700 1 Processor -- start 2023-10-24T00:47:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.705+0000 7f007ce2c700 1 -- start start 2023-10-24T00:47:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 0x7f0078157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780c6710 0x7f00780cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780cbd00 con 0x7f0078158770 2023-10-24T00:47:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078168780 con 0x7f00780aa010 2023-10-24T00:47:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007ce2c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078167b70 con 0x7f00780c6710 2023-10-24T00:47:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34974/0 (socket says 172.21.15.148:34974) 2023-10-24T00:47:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 -- 172.21.15.148:0/4263730913 learned_addr learned my addr 172.21.15.148:0/4263730913 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007659c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 0x7f0078157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f006dd9b700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780c6710 0x7f00780cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 -- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780c6710 msgr2=0x7f00780cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780c6710 0x7f00780cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 -- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 msgr2=0x7f0078157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 0x7f0078157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f0076d9d700 1 -- 172.21.15.148:0/4263730913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600092a0 con 0x7f0078158770 2023-10-24T00:47:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.706+0000 7f007659c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 0x7f0078157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:47:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f0076d9d700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f007000c460 tx=0x7f0070007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700070d0 con 0x7f0078158770 2023-10-24T00:47:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070007230 con 0x7f0078158770 2023-10-24T00:47:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078167e50 con 0x7f0078158770 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700075f0 con 0x7f0078158770 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.707+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0078168410 con 0x7f0078158770 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.708+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078168930 con 0x7f0078158770 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.708+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f00700059b0 con 0x7f0078158770 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.708+0000 7f006effd700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:04.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.709+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0070079800 con 0x7f0078158770 2023-10-24T00:47:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.709+0000 7f007659c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.709+0000 7f007659c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 0x7f0058061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f006800e950 tx=0x7f006800b040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.712+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0078168930 con 0x7f0078158770 2023-10-24T00:47:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.877+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0078168930 con 0x7f0078158770 2023-10-24T00:47:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.878+0000 7f006effd700 1 -- 172.21.15.148:0/4263730913 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f0078168930 con 0x7f0078158770 2023-10-24T00:47:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:04.880 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":126,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:47:04.249876+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:47:04.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 msgr2=0x7f0058061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 0x7f0058061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f006800e950 tx=0x7f006800b040).stop 2023-10-24T00:47:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 msgr2=0x7f00780cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f007000c460 tx=0x7f0070007e10).stop 2023-10-24T00:47:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 shutdown_connections 2023-10-24T00:47:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0078158770 0x7f00780cb810 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00780aa010 0x7f0078157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 --2- 172.21.15.148:0/4263730913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00780c6710 0x7f00780cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 >> 172.21.15.148:0/4263730913 conn(0x7f00780caf40 msgr2=0x7f00780c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 shutdown_connections 2023-10-24T00:47:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:04.880+0000 7f007ce2c700 1 -- 172.21.15.148:0/4263730913 wait complete. 2023-10-24T00:47:04.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:47:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.009+0000 7f39214f4700 1 Processor -- start 2023-10-24T00:47:05.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.009+0000 7f39214f4700 1 -- start start 2023-10-24T00:47:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f39214f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c066a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f39214f4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f391c066f60 0x7f391c0a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f39214f4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c0677f0 con 0x7f391c0a81b0 2023-10-24T00:47:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f39214f4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0a8660 con 0x7f391c066f60 2023-10-24T00:47:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f39214f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0a6260 con 0x7f391c14fcb0 2023-10-24T00:47:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f391c066f60 0x7f391c0a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f3920cf3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f391c0a81b0 0x7f391c0a66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52428/0 (socket says 172.21.15.148:52428) 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f3920cf3700 1 -- 172.21.15.148:0/4024273183 learned_addr learned my addr 172.21.15.148:0/4024273183 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391bfff700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 -- 172.21.15.148:0/4024273183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 msgr2=0x7f391c066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 -- 172.21.15.148:0/4024273183 >> v1:172.21.15.148:6789/0 conn(0x7f391c0a81b0 legacy=0x7f391c0a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 -- 172.21.15.148:0/4024273183 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c1536d0 con 0x7f391c066f60 2023-10-24T00:47:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391affd700 1 -- 172.21.15.148:0/4024273183 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661329952 0 0) 0x7f3914001490 con 0x7f391c0a81b0 2023-10-24T00:47:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391b7fe700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c066f60 0x7f391c0a7cc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f3910009760 tx=0x7f3910009060).ready entity=mon.0 client_cookie=492dd01298b8ee82 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391affd700 1 -- 172.21.15.148:0/4024273183 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100090d0 con 0x7f391c066f60 2023-10-24T00:47:05.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391affd700 1 -- 172.21.15.148:0/4024273183 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391000b580 con 0x7f391c066f60 2023-10-24T00:47:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.010+0000 7f391affd700 1 -- 172.21.15.148:0/4024273183 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391000b900 con 0x7f391c066f60 2023-10-24T00:47:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 -- 172.21.15.148:0/4024273183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c066f60 msgr2=0x7f391c0a7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c066f60 0x7f391c0a7cc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f3910009760 tx=0x7f3910009060).stop 2023-10-24T00:47:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 -- 172.21.15.148:0/4024273183 shutdown_connections 2023-10-24T00:47:05.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c066a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 --2- 172.21.15.148:0/4024273183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c066f60 0x7f391c0a7cc0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 -- 172.21.15.148:0/4024273183 >> 172.21.15.148:0/4024273183 conn(0x7f391c0923d0 msgr2=0x7f391c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 -- 172.21.15.148:0/4024273183 shutdown_connections 2023-10-24T00:47:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.011+0000 7f39214f4700 1 -- 172.21.15.148:0/4024273183 wait complete. 2023-10-24T00:47:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.012+0000 7f39214f4700 1 Processor -- start 2023-10-24T00:47:05.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.012+0000 7f39214f4700 1 -- start start 2023-10-24T00:47:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 0x7f391c0637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c064540 con 0x7f391c1645f0 2023-10-24T00:47:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c064820 con 0x7f391c0a81b0 2023-10-24T00:47:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f39214f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c064b00 con 0x7f391c14fcb0 2023-10-24T00:47:05.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34996/0 (socket says 172.21.15.148:34996) 2023-10-24T00:47:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 -- 172.21.15.148:0/1615572700 learned_addr learned my addr 172.21.15.148:0/1615572700 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f391b7fe700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f391bfff700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 0x7f391c0637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 -- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 msgr2=0x7f391c063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c063cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 -- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 msgr2=0x7f391c0637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 0x7f391c0637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 -- 172.21.15.148:0/1615572700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100092a0 con 0x7f391c1645f0 2023-10-24T00:47:05.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f391bfff700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 0x7f391c0637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f391b7fe700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c063cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.013+0000 7f3920cf3700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f391400c7e0 tx=0x7f3914007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.014+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914005d30 con 0x7f391c1645f0 2023-10-24T00:47:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.014+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3914005e90 con 0x7f391c1645f0 2023-10-24T00:47:05.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.014+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c064de0 con 0x7f391c1645f0 2023-10-24T00:47:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.014+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914007320 con 0x7f391c1645f0 2023-10-24T00:47:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.014+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0641b0 con 0x7f391c1645f0 2023-10-24T00:47:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.015+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c047480 con 0x7f391c1645f0 2023-10-24T00:47:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.015+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f39140076d0 con 0x7f391c1645f0 2023-10-24T00:47:05.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.015+0000 7f3903fff700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 0x7f3908061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.015+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f391407a0c0 con 0x7f391c1645f0 2023-10-24T00:47:05.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.016+0000 7f391bfff700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 0x7f3908061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.016+0000 7f391bfff700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 0x7f3908061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f390c006920 tx=0x7f390c008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.019+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f391404b390 con 0x7f391c1645f0 2023-10-24T00:47:05.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.227+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f391c0677f0 con 0x7f391c1645f0 2023-10-24T00:47:05.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.253+0000 7f3903fff700 1 -- 172.21.15.148:0/1615572700 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f391c0677f0 con 0x7f391c1645f0 2023-10-24T00:47:05.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 msgr2=0x7f3908061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 0x7f3908061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f390c006920 tx=0x7f390c008040).stop 2023-10-24T00:47:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 msgr2=0x7f391c0c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f391400c7e0 tx=0x7f3914007dd0).stop 2023-10-24T00:47:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 shutdown_connections 2023-10-24T00:47:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f390805f150 0x7f3908061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f391c1645f0 0x7f391c0c1c30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f391c0a81b0 0x7f391c0637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 --2- 172.21.15.148:0/1615572700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f391c14fcb0 0x7f391c063cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.255+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 >> 172.21.15.148:0/1615572700 conn(0x7f391c0923d0 msgr2=0x7f391c14ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:05.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.256+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 shutdown_connections 2023-10-24T00:47:05.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.256+0000 7f39214f4700 1 -- 172.21.15.148:0/1615572700 wait complete. 2023-10-24T00:47:05.270 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:47:05.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:47:05.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.386+0000 7f6323a38700 1 Processor -- start 2023-10-24T00:47:05.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.386+0000 7f6323a38700 1 -- start start 2023-10-24T00:47:05.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6323a38700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f631c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6323a38700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0c71d0 con 0x7f631c0bffd0 2023-10-24T00:47:05.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6323a38700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0c9410 con 0x7f631c098bd0 2023-10-24T00:47:05.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6323a38700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0c6a10 con 0x7f631c154430 2023-10-24T00:47:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6321fd5700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f631c0bffd0 0x7f631c15e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52440/0 (socket says 172.21.15.148:52440) 2023-10-24T00:47:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f6321fd5700 1 -- 172.21.15.148:0/668609099 learned_addr learned my addr 172.21.15.148:0/668609099 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.387+0000 7f63217d4700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f631c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386231598 0 0) 0x7f631c0c71d0 con 0x7f631c0bffd0 2023-10-24T00:47:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63080033f0 con 0x7f631c0bffd0 2023-10-24T00:47:05.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018193376 0 0) 0x7f631c0c9410 con 0x7f631c098bd0 2023-10-24T00:47:05.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f631c0c71d0 con 0x7f631c098bd0 2023-10-24T00:47:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 143340805 0 0) 0x7f63080033f0 con 0x7f631c0bffd0 2023-10-24T00:47:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 msgr2=0x7f631c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f631c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 >> v1:172.21.15.150:6789/0 conn(0x7f631c098bd0 legacy=0x7f631c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0ca8b0 con 0x7f631c0bffd0 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f63140017f0 con 0x7f631c0bffd0 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 >> v1:172.21.15.148:6789/0 conn(0x7f631c0bffd0 legacy=0x7f631c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f6308003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6308004000 0x7f6308004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6308004b80 0x7f6308005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0c6a10 con 0x7f6308004b80 2023-10-24T00:47:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630800b9c0 con 0x7f6308004000 2023-10-24T00:47:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630800bb80 con 0x7f631c154430 2023-10-24T00:47:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6308004b80 0x7f6308005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f63217d4700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f6308003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6320fd3700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6308004000 0x7f6308004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 -- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 msgr2=0x7f6308003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:05.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c154430 0x7f6308003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 -- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6308004000 msgr2=0x7f6308004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:05.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6308004000 0x7f6308004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 -- 172.21.15.148:0/668609099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080033f0 con 0x7f6308004b80 2023-10-24T00:47:05.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.388+0000 7f6321fd5700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6308004b80 0x7f6308005000 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f6314002020 tx=0x7f631c0caa40).ready entity=mon.0 client_cookie=6948feb6497276d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400ccb0 con 0x7f6308004b80 2023-10-24T00:47:05.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400ce10 con 0x7f6308004b80 2023-10-24T00:47:05.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6313fff700 1 -- 172.21.15.148:0/668609099 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314005d70 con 0x7f6308004b80 2023-10-24T00:47:05.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 -- 172.21.15.148:0/668609099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6308004b80 msgr2=0x7f6308005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 --2- 172.21.15.148:0/668609099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6308004b80 0x7f6308005000 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f6314002020 tx=0x7f631c0caa40).stop 2023-10-24T00:47:05.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6321fd5700 1 -- 172.21.15.148:0/668609099 reap_dead start 2023-10-24T00:47:05.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 -- 172.21.15.148:0/668609099 shutdown_connections 2023-10-24T00:47:05.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 -- 172.21.15.148:0/668609099 >> 172.21.15.148:0/668609099 conn(0x7f631c0cb070 msgr2=0x7f631c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:05.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 -- 172.21.15.148:0/668609099 shutdown_connections 2023-10-24T00:47:05.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.389+0000 7f6323a38700 1 -- 172.21.15.148:0/668609099 wait complete. 2023-10-24T00:47:05.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.390+0000 7f6323a38700 1 Processor -- start 2023-10-24T00:47:05.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.390+0000 7f6323a38700 1 -- start start 2023-10-24T00:47:05.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631c13ebb0 0x7f631c0a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 0x7f631c0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0c4e10 con 0x7f631c0aa080 2023-10-24T00:47:05.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0c2290 con 0x7f631c13ebb0 2023-10-24T00:47:05.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6323a38700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0aa5a0 con 0x7f631c13ef90 2023-10-24T00:47:05.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6321fd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6321fd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35012/0 (socket says 172.21.15.148:35012) 2023-10-24T00:47:05.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.391+0000 7f6321fd5700 1 -- 172.21.15.148:0/3980358572 learned_addr learned my addr 172.21.15.148:0/3980358572 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:05.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f63217d4700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631c13ebb0 0x7f631c0a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6320fd3700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 0x7f631c0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 -- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 msgr2=0x7f631c0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 0x7f631c0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 -- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631c13ebb0 msgr2=0x7f631c0a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:05.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631c13ebb0 0x7f631c0a9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:05.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 -- 172.21.15.148:0/3980358572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0aa880 con 0x7f631c0aa080 2023-10-24T00:47:05.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6320fd3700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 0x7f631c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:05.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6321fd5700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f6314008fd0 tx=0x7f631401b000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314007d80 con 0x7f631c0aa080 2023-10-24T00:47:05.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63140070d0 con 0x7f631c0aa080 2023-10-24T00:47:05.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c0aab60 con 0x7f631c0aa080 2023-10-24T00:47:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314007490 con 0x7f631c0aa080 2023-10-24T00:47:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.392+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c0c2790 con 0x7f631c0aa080 2023-10-24T00:47:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.393+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c0c20f0 con 0x7f631c0aa080 2023-10-24T00:47:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.393+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6314005d50 con 0x7f631c0aa080 2023-10-24T00:47:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.394+0000 7f63117fa700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 0x7f6300061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.394+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6314083020 con 0x7f631c0aa080 2023-10-24T00:47:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.394+0000 7f63217d4700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 0x7f6300061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.394+0000 7f63217d4700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 0x7f6300061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6318006d50 tx=0x7f6318008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.398+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f631c0c20f0 con 0x7f631c0aa080 2023-10-24T00:47:05.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:05.605+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f631c0c20f0 con 0x7f631c0aa080 2023-10-24T00:47:06.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.260+0000 7f63117fa700 1 -- 172.21.15.148:0/3980358572 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f631c0c20f0 con 0x7f631c0aa080 2023-10-24T00:47:06.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 msgr2=0x7f6300061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 0x7f6300061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6318006d50 tx=0x7f6318008040).stop 2023-10-24T00:47:06.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 msgr2=0x7f631c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f6314008fd0 tx=0x7f631401b000).stop 2023-10-24T00:47:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 shutdown_connections 2023-10-24T00:47:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f630005f150 0x7f6300061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f631c0aa080 0x7f631c0c4920 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f631c13ebb0 0x7f631c0a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 --2- 172.21.15.148:0/3980358572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f631c13ef90 0x7f631c0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 >> 172.21.15.148:0/3980358572 conn(0x7f631c0cb070 msgr2=0x7f631c14dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 shutdown_connections 2023-10-24T00:47:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.262+0000 7f6323a38700 1 -- 172.21.15.148:0/3980358572 wait complete. 2023-10-24T00:47:06.276 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:47:06.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:47:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 Processor -- start 2023-10-24T00:47:06.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 -- start start 2023-10-24T00:47:06.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81300a8480 0x7f813015f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300a5bd0 con 0x7f81300be650 2023-10-24T00:47:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8130064ab0 con 0x7f8130154540 2023-10-24T00:47:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.390+0000 7f8136ae0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8130064d90 con 0x7f81300a8480 2023-10-24T00:47:06.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f813507d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f81300a8480 0x7f813015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f8127fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f81300be650 0x7f81300a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52444/0 (socket says 172.21.15.148:52444) 2023-10-24T00:47:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f8127fff700 1 -- 172.21.15.148:0/3720808493 learned_addr learned my addr 172.21.15.148:0/3720808493 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f813507d700 1 -- 172.21.15.148:0/3720808493 >> v1:172.21.15.150:6789/0 conn(0x7f8130154540 legacy=0x7f81300640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f813507d700 1 -- 172.21.15.148:0/3720808493 >> v1:172.21.15.148:6789/0 conn(0x7f81300be650 legacy=0x7f81300a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f813507d700 1 -- 172.21.15.148:0/3720808493 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130065070 con 0x7f81300a8480 2023-10-24T00:47:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f813507d700 1 --2- 172.21.15.148:0/3720808493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f813015f130 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f8128009760 tx=0x7f8128009060).ready entity=mon.0 client_cookie=a6db962419508ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f81277fe700 1 -- 172.21.15.148:0/3720808493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800f510 con 0x7f81300a8480 2023-10-24T00:47:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f81277fe700 1 -- 172.21.15.148:0/3720808493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800f670 con 0x7f81300a8480 2023-10-24T00:47:06.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.391+0000 7f81277fe700 1 -- 172.21.15.148:0/3720808493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800f9f0 con 0x7f81300a8480 2023-10-24T00:47:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 -- 172.21.15.148:0/3720808493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 msgr2=0x7f813015f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 --2- 172.21.15.148:0/3720808493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f813015f130 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f8128009760 tx=0x7f8128009060).stop 2023-10-24T00:47:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 -- 172.21.15.148:0/3720808493 shutdown_connections 2023-10-24T00:47:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 --2- 172.21.15.148:0/3720808493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f813015f130 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 -- 172.21.15.148:0/3720808493 >> 172.21.15.148:0/3720808493 conn(0x7f8130092480 msgr2=0x7f8130062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 -- 172.21.15.148:0/3720808493 shutdown_connections 2023-10-24T00:47:06.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.392+0000 7f8136ae0700 1 -- 172.21.15.148:0/3720808493 wait complete. 2023-10-24T00:47:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.393+0000 7f8136ae0700 1 Processor -- start 2023-10-24T00:47:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.393+0000 7f8136ae0700 1 -- start start 2023-10-24T00:47:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81300be650 0x7f81300aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 0x7f81301656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300aab40 con 0x7f81300a8480 2023-10-24T00:47:06.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300a9ec0 con 0x7f8130154540 2023-10-24T00:47:06.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8136ae0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300aa1a0 con 0x7f81300be650 2023-10-24T00:47:06.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35024/0 (socket says 172.21.15.148:35024) 2023-10-24T00:47:06.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 -- 172.21.15.148:0/4106987465 learned_addr learned my addr 172.21.15.148:0/4106987465 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:06.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813507d700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 0x7f81301656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8127fff700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81300be650 0x7f81300aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 -- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81300be650 msgr2=0x7f81300aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81300be650 0x7f81300aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 -- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 msgr2=0x7f81301656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 0x7f81301656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 -- 172.21.15.148:0/4106987465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280092a0 con 0x7f81300a8480 2023-10-24T00:47:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813507d700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 0x7f81301656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:06.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f813487c700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f812c00c740 tx=0x7f812c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c006a70 con 0x7f81300a8480 2023-10-24T00:47:06.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.394+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c006bd0 con 0x7f81300a8480 2023-10-24T00:47:06.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.395+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81300aa480 con 0x7f81300a8480 2023-10-24T00:47:06.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.395+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c007020 con 0x7f81300a8480 2023-10-24T00:47:06.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.395+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81301652c0 con 0x7f81300a8480 2023-10-24T00:47:06.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.396+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81300aadb0 con 0x7f81300a8480 2023-10-24T00:47:06.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.396+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f812c0073d0 con 0x7f81300a8480 2023-10-24T00:47:06.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.396+0000 7f8124ff9700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 0x7f811c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.396+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f812c0797e0 con 0x7f81300a8480 2023-10-24T00:47:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.396+0000 7f8127fff700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 0x7f811c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.397+0000 7f8127fff700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 0x7f811c0615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8130150c80 tx=0x7f8120009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.400+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f812c048af0 con 0x7f81300a8480 2023-10-24T00:47:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.606+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8130069dc0 con 0x7f81300a8480 2023-10-24T00:47:06.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.607+0000 7f8124ff9700 1 -- 172.21.15.148:0/4106987465 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f812c04aab0 con 0x7f81300a8480 2023-10-24T00:47:06.608 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:06.609 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:47:06.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 msgr2=0x7f811c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 0x7f811c0615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8130150c80 tx=0x7f8120009040).stop 2023-10-24T00:47:06.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 msgr2=0x7f8130164dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f812c00c740 tx=0x7f812c0015e0).stop 2023-10-24T00:47:06.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 shutdown_connections 2023-10-24T00:47:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8130154540 0x7f81301656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f811c05f120 0x7f811c0615e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81300a8480 0x7f8130164dd0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 --2- 172.21.15.148:0/4106987465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81300be650 0x7f81300aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 >> 172.21.15.148:0/4106987465 conn(0x7f8130092480 msgr2=0x7f81300a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 shutdown_connections 2023-10-24T00:47:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.609+0000 7f8136ae0700 1 -- 172.21.15.148:0/4106987465 wait complete. 2023-10-24T00:47:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:47:06.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:47:06.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.735+0000 7ff79f915700 1 Processor -- start 2023-10-24T00:47:06.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.735+0000 7ff79f915700 1 -- start start 2023-10-24T00:47:06.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.736+0000 7ff79f915700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7980c86c0 0x7ff7980bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.736+0000 7ff79f915700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980a6a50 con 0x7ff7980a6550 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.736+0000 7ff79f915700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980a6d30 con 0x7ff7980a8480 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.736+0000 7ff79f915700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980a7010 con 0x7ff7980c86c0 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79d6b1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff7980c86c0 0x7ff7980bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79ceb0700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff7980a6550 0x7ff7980a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52446/0 (socket says 172.21.15.148:52446) 2023-10-24T00:47:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79ceb0700 1 -- 172.21.15.148:0/141059271 learned_addr learned my addr 172.21.15.148:0/141059271 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:06.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79d6b1700 1 -- 172.21.15.148:0/141059271 >> v1:172.21.15.150:6789/0 conn(0x7ff7980a8480 legacy=0x7ff79815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:06.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79d6b1700 1 -- 172.21.15.148:0/141059271 >> v1:172.21.15.148:6789/0 conn(0x7ff7980a6550 legacy=0x7ff7980a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff78ffff700 1 -- 172.21.15.148:0/141059271 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097815245 0 0) 0x7ff7980a6a50 con 0x7ff7980a6550 2023-10-24T00:47:06.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79d6b1700 1 -- 172.21.15.148:0/141059271 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980a72f0 con 0x7ff7980c86c0 2023-10-24T00:47:06.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff79d6b1700 1 --2- 172.21.15.148:0/141059271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980c86c0 0x7ff7980bec40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7ff794006fd0 tx=0x7ff794006f40).ready entity=mon.0 client_cookie=5718106dfd5e69bb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff78ffff700 1 -- 172.21.15.148:0/141059271 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794005880 con 0x7ff7980c86c0 2023-10-24T00:47:06.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff78ffff700 1 -- 172.21.15.148:0/141059271 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7940059e0 con 0x7ff7980c86c0 2023-10-24T00:47:06.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.737+0000 7ff78ffff700 1 -- 172.21.15.148:0/141059271 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794005d60 con 0x7ff7980c86c0 2023-10-24T00:47:06.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 -- 172.21.15.148:0/141059271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980c86c0 msgr2=0x7ff7980bec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 --2- 172.21.15.148:0/141059271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980c86c0 0x7ff7980bec40 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7ff794006fd0 tx=0x7ff794006f40).stop 2023-10-24T00:47:06.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 -- 172.21.15.148:0/141059271 shutdown_connections 2023-10-24T00:47:06.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 --2- 172.21.15.148:0/141059271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980c86c0 0x7ff7980bec40 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 -- 172.21.15.148:0/141059271 >> 172.21.15.148:0/141059271 conn(0x7ff798092480 msgr2=0x7ff798062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:06.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 -- 172.21.15.148:0/141059271 shutdown_connections 2023-10-24T00:47:06.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.738+0000 7ff79f915700 1 -- 172.21.15.148:0/141059271 wait complete. 2023-10-24T00:47:06.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.739+0000 7ff79f915700 1 Processor -- start 2023-10-24T00:47:06.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.739+0000 7ff79f915700 1 -- start start 2023-10-24T00:47:06.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 0x7ff798063ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7980c86c0 0x7ff7980ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798065140 con 0x7ff7980a8480 2023-10-24T00:47:06.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980643d0 con 0x7ff7980a6550 2023-10-24T00:47:06.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980645c0 con 0x7ff7980c86c0 2023-10-24T00:47:06.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35048/0 (socket says 172.21.15.148:35048) 2023-10-24T00:47:06.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 -- 172.21.15.148:0/2864908549 learned_addr learned my addr 172.21.15.148:0/2864908549 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:06.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79d6b1700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 0x7ff798063ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 -- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7980c86c0 msgr2=0x7ff7980ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7980c86c0 0x7ff7980ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:06.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 -- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 msgr2=0x7ff798063ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 0x7ff798063ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 -- 172.21.15.148:0/2864908549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009250 con 0x7ff7980a8480 2023-10-24T00:47:06.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79d6b1700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 0x7ff798063ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:06.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79ceb0700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7ff78800c4c0 tx=0x7ff788007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880072e0 con 0x7ff7980a8480 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788007440 con 0x7ff7980a8480 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980648a0 con 0x7ff7980a8480 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.740+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880057a0 con 0x7ff7980a8480 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.741+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff798064e60 con 0x7ff7980a8480 2023-10-24T00:47:06.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.741+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79806c6b0 con 0x7ff7980a8480 2023-10-24T00:47:06.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.742+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff788005b90 con 0x7ff7980a8480 2023-10-24T00:47:06.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.742+0000 7ff78d7fa700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 0x7ff77c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:06.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.742+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff788079a20 con 0x7ff7980a8480 2023-10-24T00:47:06.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.742+0000 7ff79d6b1700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 0x7ff77c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:06.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.743+0000 7ff79d6b1700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 0x7ff77c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff794006fa0 tx=0x7ff794016000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:06.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.746+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff78804acf0 con 0x7ff7980a8480 2023-10-24T00:47:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.911+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7980a75d0 con 0x7ff7980a8480 2023-10-24T00:47:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.912+0000 7ff78d7fa700 1 -- 172.21.15.148:0/2864908549 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16991 (secure 0 0 0) 0x7ff78804e310 con 0x7ff7980a8480 2023-10-24T00:47:06.914 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:06.914 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":127,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:47:05.251589+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:47:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 msgr2=0x7ff77c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 0x7ff77c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff794006fa0 tx=0x7ff794016000).stop 2023-10-24T00:47:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 msgr2=0x7ff7980abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7ff78800c4c0 tx=0x7ff788007c10).stop 2023-10-24T00:47:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 shutdown_connections 2023-10-24T00:47:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7980c86c0 0x7ff7980ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7980a6550 0x7ff798063ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff77c05f150 0x7ff77c061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 --2- 172.21.15.148:0/2864908549 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7980a8480 0x7ff7980abe30 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 >> 172.21.15.148:0/2864908549 conn(0x7ff798092480 msgr2=0x7ff7980c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 shutdown_connections 2023-10-24T00:47:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:06.914+0000 7ff79f915700 1 -- 172.21.15.148:0/2864908549 wait complete. 2023-10-24T00:47:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:47:06.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:47:07.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.040+0000 7fe3bdc6d700 1 Processor -- start 2023-10-24T00:47:07.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.040+0000 7fe3bdc6d700 1 -- start start 2023-10-24T00:47:07.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3bdc6d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe3b80c6710 0x7fe3b80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3bdc6d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80aa820 con 0x7fe3b80aa010 2023-10-24T00:47:07.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3bdc6d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b80c0960 con 0x7fe3b80aa3f0 2023-10-24T00:47:07.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3bdc6d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b80c0c40 con 0x7fe3b80c6710 2023-10-24T00:47:07.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3b6ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe3b80c6710 0x7fe3b80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3b77fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe3b80aa010 0x7fe3b8158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52448/0 (socket says 172.21.15.148:52448) 2023-10-24T00:47:07.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.041+0000 7fe3b77fe700 1 -- 172.21.15.148:0/3988496552 learned_addr learned my addr 172.21.15.148:0/3988496552 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:07.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b6ffd700 1 -- 172.21.15.148:0/3988496552 >> v1:172.21.15.150:6789/0 conn(0x7fe3b80aa3f0 legacy=0x7fe3b8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b6ffd700 1 -- 172.21.15.148:0/3988496552 >> v1:172.21.15.148:6789/0 conn(0x7fe3b80aa010 legacy=0x7fe3b8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b6ffd700 1 -- 172.21.15.148:0/3988496552 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80c0f20 con 0x7fe3b80c6710 2023-10-24T00:47:07.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b67fc700 1 -- 172.21.15.148:0/3988496552 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704112243 0 0) 0x7fe3b80aa820 con 0x7fe3b80aa010 2023-10-24T00:47:07.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b6ffd700 1 --2- 172.21.15.148:0/3988496552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80c6710 0x7fe3b80c1a00 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fe3ac009760 tx=0x7fe3ac009060).ready entity=mon.0 client_cookie=59ecb8aca0ef4bd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b67fc700 1 -- 172.21.15.148:0/3988496552 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00b580 con 0x7fe3b80c6710 2023-10-24T00:47:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b67fc700 1 -- 172.21.15.148:0/3988496552 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00b6e0 con 0x7fe3b80c6710 2023-10-24T00:47:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3b67fc700 1 -- 172.21.15.148:0/3988496552 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00ba60 con 0x7fe3b80c6710 2023-10-24T00:47:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/3988496552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80c6710 msgr2=0x7fe3b80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/3988496552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80c6710 0x7fe3b80c1a00 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fe3ac009760 tx=0x7fe3ac009060).stop 2023-10-24T00:47:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/3988496552 shutdown_connections 2023-10-24T00:47:07.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/3988496552 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80c6710 0x7fe3b80c1a00 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/3988496552 >> 172.21.15.148:0/3988496552 conn(0x7fe3b80caf40 msgr2=0x7fe3b80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/3988496552 shutdown_connections 2023-10-24T00:47:07.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.042+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/3988496552 wait complete. 2023-10-24T00:47:07.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 Processor -- start 2023-10-24T00:47:07.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 -- start start 2023-10-24T00:47:07.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80aa3f0 0x7fe3b80ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80c6710 0x7fe3b80acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b814c570 con 0x7fe3b80aa010 2023-10-24T00:47:07.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80ad030 con 0x7fe3b80aa3f0 2023-10-24T00:47:07.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.044+0000 7fe3bdc6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8167580 con 0x7fe3b80c6710 2023-10-24T00:47:07.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35068/0 (socket says 172.21.15.148:35068) 2023-10-24T00:47:07.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 -- 172.21.15.148:0/2058367048 learned_addr learned my addr 172.21.15.148:0/2058367048 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:07.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b6ffd700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80aa3f0 0x7fe3b80ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b7fff700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80c6710 0x7fe3b80acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 -- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80c6710 msgr2=0x7fe3b80acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80c6710 0x7fe3b80acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 -- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80aa3f0 msgr2=0x7fe3b80ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80aa3f0 0x7fe3b80ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 -- 172.21.15.148:0/2058367048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac0092a0 con 0x7fe3b80aa010 2023-10-24T00:47:07.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3b77fe700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fe3a800c840 tx=0x7fe3a8001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8005d30 con 0x7fe3b80aa010 2023-10-24T00:47:07.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8005e90 con 0x7fe3b80aa010 2023-10-24T00:47:07.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b81677d0 con 0x7fe3b80aa010 2023-10-24T00:47:07.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8007320 con 0x7fe3b80aa010 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.045+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b8167d90 con 0x7fe3b80aa010 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.046+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b806c6b0 con 0x7fe3b80aa010 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.047+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe3a80077d0 con 0x7fe3b80aa010 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.047+0000 7fe39f7fe700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 0x7fe3a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.047+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3a8079c00 con 0x7fe3b80aa010 2023-10-24T00:47:07.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.047+0000 7fe3b6ffd700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 0x7fe3a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.048+0000 7fe3b6ffd700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 0x7fe3a4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe3ac00b340 tx=0x7fe3ac017000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.051+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe3a807f020 con 0x7fe3b80aa010 2023-10-24T00:47:07.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.210+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3b80c1200 con 0x7fe3a405f150 2023-10-24T00:47:07.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.221+0000 7fe39f7fe700 1 -- 172.21.15.148:0/2058367048 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350124 (secure 0 0 0) 0x7fe3b80c1200 con 0x7fe3a405f150 2023-10-24T00:47:07.227 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:07.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 msgr2=0x7fe3a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 0x7fe3a4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe3ac00b340 tx=0x7fe3ac017000).stop 2023-10-24T00:47:07.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 msgr2=0x7fe3b815a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fe3a800c840 tx=0x7fe3a8001540).stop 2023-10-24T00:47:07.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 shutdown_connections 2023-10-24T00:47:07.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80c6710 0x7fe3b80acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe3a405f150 0x7fe3a4061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3b80aa010 0x7fe3b815a020 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 --2- 172.21.15.148:0/2058367048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80aa3f0 0x7fe3b80ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 >> 172.21.15.148:0/2058367048 conn(0x7fe3b80caf40 msgr2=0x7fe3b80cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 shutdown_connections 2023-10-24T00:47:07.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.224+0000 7fe3bdc6d700 1 -- 172.21.15.148:0/2058367048 wait complete. 2023-10-24T00:47:07.233 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:47:07.238 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T00:47:05.261971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421328,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553392,"statfs":{"total":773094113280,"available":770614673408,"internally_reserved":0,"allocated":12075008,"data_stored":6063044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6012,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002763"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206144+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:46:59.206144+0000","last_peered":"2023-10-24T00:46:59.206144+0000","last_clean":"2023-10-24T00:46:59.206144+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:46:59.206144+0000","last_undegraded":"2023-10-24T00:46:59.206144+0000","last_fullsized":"2023-10-24T00:46:59.206144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205238+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:46:59.205238+0000","last_peered":"2023-10-24T00:46:59.205238+0000","last_clean":"2023-10-24T00:46:59.205238+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:46:59.205238+0000","last_undegraded":"2023-10-24T00:46:59.205238+0000","last_fullsized":"2023-10-24T00:46:59.205238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:47:01.068469+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:47:01.068469+0000","last_peered":"2023-10-24T00:47:01.068469+0000","last_clean":"2023-10-24T00:47:01.068469+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:47:01.068469+0000","last_undegraded":"2023-10-24T00:47:01.068469+0000","last_fullsized":"2023-10-24T00:47:01.068469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205233+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:46:59.205233+0000","last_peered":"2023-10-24T00:46:59.205233+0000","last_clean":"2023-10-24T00:46:59.205233+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:46:59.205233+0000","last_undegraded":"2023-10-24T00:46:59.205233+0000","last_fullsized":"2023-10-24T00:46:59.205233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":116,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:46:59.208592+0000","last_peered":"2023-10-24T00:46:59.208592+0000","last_clean":"2023-10-24T00:46:59.208592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:46:59.208592+0000","last_undegraded":"2023-10-24T00:46:59.208592+0000","last_fullsized":"2023-10-24T00:46:59.208592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:46:59.208603+0000","last_peered":"2023-10-24T00:46:59.208603+0000","last_clean":"2023-10-24T00:46:59.208603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:46:59.208603+0000","last_undegraded":"2023-10-24T00:46:59.208603+0000","last_fullsized":"2023-10-24T00:46:59.208603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208609+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:46:59.208609+0000","last_peered":"2023-10-24T00:46:59.208609+0000","last_clean":"2023-10-24T00:46:59.208609+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:46:59.208609+0000","last_undegraded":"2023-10-24T00:46:59.208609+0000","last_fullsized":"2023-10-24T00:46:59.208609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206170+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:46:59.206170+0000","last_peered":"2023-10-24T00:46:59.206170+0000","last_clean":"2023-10-24T00:46:59.206170+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:46:59.206170+0000","last_undegraded":"2023-10-24T00:46:59.206170+0000","last_fullsized":"2023-10-24T00:46:59.206170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.211402+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:46:59.211402+0000","last_peered":"2023-10-24T00:46:59.211402+0000","last_clean":"2023-10-24T00:46:59.211402+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:46:59.211402+0000","last_undegraded":"2023-10-24T00:46:59.211402+0000","last_fullsized":"2023-10-24T00:46:59.211402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542362,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.83299999999999996},"last":0.51300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79900000000000004},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.81399999999999995},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67900000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61899999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55900000000000005,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":4.351,"15min":4.351},"last":0.62},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67800000000000005,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72299999999999998,"5min":1.054,"15min":1.054},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51100000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.217,"15min":0.217},"max":{"1min":0.629,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.629}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":1.573},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.67500000000000004,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67500000000000004,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":14.597,"15min":14.597},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55400000000000005,"15min":0.503},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.83399999999999996,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":0.58599999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.623,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.255}]},{"osd":3,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.377},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65200000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58499999999999996,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":1.143,"15min":1.143},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.109,"15min":1.109},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.378,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.505,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40999999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.41299999999999998},"min":{"1min":0.31,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.628},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.67100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.92400000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.877,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.876},"last":0.501}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.36199999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.22700000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.63,"15min":0.65500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.379}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.623,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.625},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.083,"15min":1.083},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.67200000000000004},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.999},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38800000000000001,"15min":0.40699999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56699999999999995,"5min":1.099,"15min":1.099},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45500000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.40300000000000002},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.434,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.36199999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":1.024},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.437},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.93999999999999995,"15min":0.995},"last":0.41499999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86099999999999999,"5min":1.337,"15min":1.337},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":1.042},"last":0.497}]},{"osd":7,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":1.121},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.495,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.749,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.497,"15min":0.503},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]}]},{"osd":5,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1490944,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.503}]},{"osd":1,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.75600000000000001,"5min":0.79000000000000004,"15min":0.81799999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.748,"15min":1.1479999999999999},"last":0.621}]},{"osd":2,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0209999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":1.339},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.745,"15min":0.76400000000000001},"last":0.629}]},{"osd":7,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":1.772},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:47:07.247 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:47:07.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.391+0000 7f3f357a0700 1 Processor -- start 2023-10-24T00:47:07.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 -- start start 2023-10-24T00:47:07.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f300a7ef0 0x7f3f300be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f300c8140 0x7f3f300bea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300c42a0 con 0x7f3f300a82d0 2023-10-24T00:47:07.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300bef30 con 0x7f3f300c8140 2023-10-24T00:47:07.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.392+0000 7f3f357a0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f30152300 con 0x7f3f300a7ef0 2023-10-24T00:47:07.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f300c8140 0x7f3f300bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3f300a82d0 0x7f3f300c7a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52452/0 (socket says 172.21.15.148:52452) 2023-10-24T00:47:07.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f300c8140 0x7f3f300bea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35070/0 (socket says 172.21.15.148:35070) 2023-10-24T00:47:07.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2f7fe700 1 -- 172.21.15.148:0/1533591699 learned_addr learned my addr 172.21.15.148:0/1533591699 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:07.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/1533591699 >> v2:172.21.15.150:3300/0 conn(0x7f3f300a7ef0 0x7f3f300be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 -- 172.21.15.148:0/1533591699 >> v2:172.21.15.150:3300/0 conn(0x7f3f300a7ef0 msgr2=0x7f3f300be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:07.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 --2- 172.21.15.148:0/1533591699 >> v2:172.21.15.150:3300/0 conn(0x7f3f300a7ef0 0x7f3f300be550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 -- 172.21.15.148:0/1533591699 >> v1:172.21.15.148:6789/0 conn(0x7f3f300a82d0 legacy=0x7f3f300c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 -- 172.21.15.148:0/1533591699 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300c3cc0 con 0x7f3f300c8140 2023-10-24T00:47:07.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2effd700 1 -- 172.21.15.148:0/1533591699 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195056311 0 0) 0x7f3f300c42a0 con 0x7f3f300a82d0 2023-10-24T00:47:07.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f34f9f700 1 --2- 172.21.15.148:0/1533591699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300c8140 0x7f3f300bea40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f3f30069650 tx=0x7f3f28009780).ready entity=mon.0 client_cookie=246b2ba0de4e668c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2effd700 1 -- 172.21.15.148:0/1533591699 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800e070 con 0x7f3f300c8140 2023-10-24T00:47:07.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2effd700 1 -- 172.21.15.148:0/1533591699 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800bb20 con 0x7f3f300c8140 2023-10-24T00:47:07.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.393+0000 7f3f2effd700 1 -- 172.21.15.148:0/1533591699 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800bea0 con 0x7f3f300c8140 2023-10-24T00:47:07.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 -- 172.21.15.148:0/1533591699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300c8140 msgr2=0x7f3f300bea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 --2- 172.21.15.148:0/1533591699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300c8140 0x7f3f300bea40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f3f30069650 tx=0x7f3f28009780).stop 2023-10-24T00:47:07.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 -- 172.21.15.148:0/1533591699 shutdown_connections 2023-10-24T00:47:07.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 --2- 172.21.15.148:0/1533591699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300c8140 0x7f3f300bea40 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 --2- 172.21.15.148:0/1533591699 >> v2:172.21.15.150:3300/0 conn(0x7f3f300a7ef0 0x7f3f300be550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 -- 172.21.15.148:0/1533591699 >> 172.21.15.148:0/1533591699 conn(0x7f3f300922e0 msgr2=0x7f3f30062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 -- 172.21.15.148:0/1533591699 shutdown_connections 2023-10-24T00:47:07.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.394+0000 7f3f357a0700 1 -- 172.21.15.148:0/1533591699 wait complete. 2023-10-24T00:47:07.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.395+0000 7f3f357a0700 1 Processor -- start 2023-10-24T00:47:07.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.395+0000 7f3f357a0700 1 -- start start 2023-10-24T00:47:07.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300a82d0 0x7f3f300a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c8140 0x7f3f300a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300a9b80 con 0x7f3f300a7ef0 2023-10-24T00:47:07.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300a9e60 con 0x7f3f300a82d0 2023-10-24T00:47:07.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300aa140 con 0x7f3f300c8140 2023-10-24T00:47:07.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35084/0 (socket says 172.21.15.148:35084) 2023-10-24T00:47:07.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 -- 172.21.15.148:0/606600133 learned_addr learned my addr 172.21.15.148:0/606600133 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:07.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300a82d0 0x7f3f300a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f34f9f700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c8140 0x7f3f300a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 -- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c8140 msgr2=0x7f3f300a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c8140 0x7f3f300a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 -- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300a82d0 msgr2=0x7f3f300a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300a82d0 0x7f3f300a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 -- 172.21.15.148:0/606600133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009a20 con 0x7f3f300a7ef0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f3f2000e950 tx=0x7f3f20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000c850 con 0x7f3f300a7ef0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2000c9b0 con 0x7f3f300a7ef0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f300aa420 con 0x7f3f300a7ef0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000cd30 con 0x7f3f300a7ef0 2023-10-24T00:47:07.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.396+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300ac910 con 0x7f3f300a7ef0 2023-10-24T00:47:07.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.397+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f30155100 con 0x7f3f300a7ef0 2023-10-24T00:47:07.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.398+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3f20012600 con 0x7f3f300a7ef0 2023-10-24T00:47:07.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.398+0000 7f3f17fff700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 0x7f3f1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.398+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f2007a800 con 0x7f3f300a7ef0 2023-10-24T00:47:07.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.398+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 0x7f3f1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.399+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 0x7f3f1c061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3f300ab330 tx=0x7f3f24009040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.402+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3f30155100 con 0x7f3f300a7ef0 2023-10-24T00:47:07.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.561+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f30155100 con 0x7f3f1c05f150 2023-10-24T00:47:07.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.570+0000 7f3f17fff700 1 -- 172.21.15.148:0/606600133 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350124 (secure 0 0 0) 0x7f3f30155100 con 0x7f3f1c05f150 2023-10-24T00:47:07.576 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:07.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 msgr2=0x7f3f1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 0x7f3f1c061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3f300ab330 tx=0x7f3f24009040).stop 2023-10-24T00:47:07.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 msgr2=0x7f3f30156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f3f2000e950 tx=0x7f3f20009060).stop 2023-10-24T00:47:07.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 shutdown_connections 2023-10-24T00:47:07.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c8140 0x7f3f300a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1c05f150 0x7f3f1c061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f300a7ef0 0x7f3f30156f90 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 --2- 172.21.15.148:0/606600133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300a82d0 0x7f3f300a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 >> 172.21.15.148:0/606600133 conn(0x7f3f300922e0 msgr2=0x7f3f30067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 shutdown_connections 2023-10-24T00:47:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.574+0000 7f3f357a0700 1 -- 172.21.15.148:0/606600133 wait complete. 2023-10-24T00:47:07.582 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:47:07.587 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:47:07.251336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421328,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553392,"statfs":{"total":773094113280,"available":770614673408,"internally_reserved":0,"allocated":12075008,"data_stored":6063044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6012,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002763"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206144+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:46:59.206144+0000","last_peered":"2023-10-24T00:46:59.206144+0000","last_clean":"2023-10-24T00:46:59.206144+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:46:59.206144+0000","last_undegraded":"2023-10-24T00:46:59.206144+0000","last_fullsized":"2023-10-24T00:46:59.206144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205238+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:46:59.205238+0000","last_peered":"2023-10-24T00:46:59.205238+0000","last_clean":"2023-10-24T00:46:59.205238+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:46:59.205238+0000","last_undegraded":"2023-10-24T00:46:59.205238+0000","last_fullsized":"2023-10-24T00:46:59.205238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:47:01.068469+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:47:01.068469+0000","last_peered":"2023-10-24T00:47:01.068469+0000","last_clean":"2023-10-24T00:47:01.068469+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:47:01.068469+0000","last_undegraded":"2023-10-24T00:47:01.068469+0000","last_fullsized":"2023-10-24T00:47:01.068469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205233+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:46:59.205233+0000","last_peered":"2023-10-24T00:46:59.205233+0000","last_clean":"2023-10-24T00:46:59.205233+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:46:59.205233+0000","last_undegraded":"2023-10-24T00:46:59.205233+0000","last_fullsized":"2023-10-24T00:46:59.205233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":116,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:46:59.208592+0000","last_peered":"2023-10-24T00:46:59.208592+0000","last_clean":"2023-10-24T00:46:59.208592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:46:59.208592+0000","last_undegraded":"2023-10-24T00:46:59.208592+0000","last_fullsized":"2023-10-24T00:46:59.208592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:46:59.208603+0000","last_peered":"2023-10-24T00:46:59.208603+0000","last_clean":"2023-10-24T00:46:59.208603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:46:59.208603+0000","last_undegraded":"2023-10-24T00:46:59.208603+0000","last_fullsized":"2023-10-24T00:46:59.208603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208609+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:46:59.208609+0000","last_peered":"2023-10-24T00:46:59.208609+0000","last_clean":"2023-10-24T00:46:59.208609+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:46:59.208609+0000","last_undegraded":"2023-10-24T00:46:59.208609+0000","last_fullsized":"2023-10-24T00:46:59.208609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206170+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:46:59.206170+0000","last_peered":"2023-10-24T00:46:59.206170+0000","last_clean":"2023-10-24T00:46:59.206170+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:46:59.206170+0000","last_undegraded":"2023-10-24T00:46:59.206170+0000","last_fullsized":"2023-10-24T00:46:59.206170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.211402+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:46:59.211402+0000","last_peered":"2023-10-24T00:46:59.211402+0000","last_clean":"2023-10-24T00:46:59.211402+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:46:59.211402+0000","last_undegraded":"2023-10-24T00:46:59.211402+0000","last_fullsized":"2023-10-24T00:46:59.211402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542362,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.83299999999999996},"last":0.51300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79900000000000004},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.81399999999999995},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67900000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61899999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55900000000000005,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":4.351,"15min":4.351},"last":0.62},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67800000000000005,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72299999999999998,"5min":1.054,"15min":1.054},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51100000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.217,"15min":0.217},"max":{"1min":0.629,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.629}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":1.573},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.67500000000000004,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67500000000000004,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":14.597,"15min":14.597},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55400000000000005,"15min":0.503},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.83399999999999996,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":0.58599999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.623,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.255}]},{"osd":3,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.377},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65200000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58499999999999996,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":1.143,"15min":1.143},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.109,"15min":1.109},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.378,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.505,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40999999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.41299999999999998},"min":{"1min":0.31,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.628},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.67100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.92400000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.877,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.876},"last":0.501}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.36199999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.22700000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.63,"15min":0.65500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.379}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.623,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.625},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.083,"15min":1.083},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.67200000000000004},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.999},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38800000000000001,"15min":0.40699999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56699999999999995,"5min":1.099,"15min":1.099},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45500000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.40300000000000002},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.434,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.36199999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":1.024},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.437},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.93999999999999995,"15min":0.995},"last":0.41499999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86099999999999999,"5min":1.337,"15min":1.337},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":1.042},"last":0.497}]},{"osd":7,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":1.121},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.495,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.749,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.497,"15min":0.503},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]}]},{"osd":5,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1490944,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.503}]},{"osd":1,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.75600000000000001,"5min":0.79000000000000004,"15min":0.81799999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.748,"15min":1.1479999999999999},"last":0.621}]},{"osd":2,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0209999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":1.339},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.745,"15min":0.76400000000000001},"last":0.629}]},{"osd":7,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":1.772},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:47:07.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:47:07.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.739+0000 7fdb1e680700 1 Processor -- start 2023-10-24T00:47:07.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.739+0000 7fdb1e680700 1 -- start start 2023-10-24T00:47:07.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.740+0000 7fdb1e680700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb180aa010 0x7fdb180c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.740+0000 7fdb1e680700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb180aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.740+0000 7fdb1e680700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb180c0960 con 0x7fdb18158770 2023-10-24T00:47:07.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.740+0000 7fdb1e680700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb180aa8e0 con 0x7fdb180aa010 2023-10-24T00:47:07.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.740+0000 7fdb1e680700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180c0c40 con 0x7fdb180c6710 2023-10-24T00:47:07.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdb180aa010 0x7fdb180c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb1cc1d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdb18158770 0x7fdb18069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52454/0 (socket says 172.21.15.148:52454) 2023-10-24T00:47:07.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb1cc1d700 1 -- 172.21.15.148:0/3838758177 learned_addr learned my addr 172.21.15.148:0/3838758177 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:07.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb177fe700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb180aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 -- 172.21.15.148:0/3838758177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 msgr2=0x7fdb180aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:07.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb180aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 -- 172.21.15.148:0/3838758177 >> v1:172.21.15.148:6789/0 conn(0x7fdb18158770 legacy=0x7fdb18069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 -- 172.21.15.148:0/3838758177 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180c0f20 con 0x7fdb180aa010 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb16ffd700 1 -- 172.21.15.148:0/3838758177 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700524283 0 0) 0x7fdb180c0960 con 0x7fdb18158770 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb17fff700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb180c1a00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fdb08009760 tx=0x7fdb08009060).ready entity=mon.0 client_cookie=2d41b1083294f608 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb16ffd700 1 -- 172.21.15.148:0/3838758177 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800b580 con 0x7fdb180aa010 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb16ffd700 1 -- 172.21.15.148:0/3838758177 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800b6e0 con 0x7fdb180aa010 2023-10-24T00:47:07.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.741+0000 7fdb16ffd700 1 -- 172.21.15.148:0/3838758177 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800ba60 con 0x7fdb180aa010 2023-10-24T00:47:07.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 -- 172.21.15.148:0/3838758177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 msgr2=0x7fdb180c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb180c1a00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fdb08009760 tx=0x7fdb08009060).stop 2023-10-24T00:47:07.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 -- 172.21.15.148:0/3838758177 shutdown_connections 2023-10-24T00:47:07.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb180c1a00 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 --2- 172.21.15.148:0/3838758177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb180aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 -- 172.21.15.148:0/3838758177 >> 172.21.15.148:0/3838758177 conn(0x7fdb180caf40 msgr2=0x7fdb180cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 -- 172.21.15.148:0/3838758177 shutdown_connections 2023-10-24T00:47:07.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.742+0000 7fdb1e680700 1 -- 172.21.15.148:0/3838758177 wait complete. 2023-10-24T00:47:07.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.743+0000 7fdb1e680700 1 Processor -- start 2023-10-24T00:47:07.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.743+0000 7fdb1e680700 1 -- start start 2023-10-24T00:47:07.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb18141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb18158770 0x7fdb180c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181578e0 con 0x7fdb180aa010 2023-10-24T00:47:07.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181556e0 con 0x7fdb18158770 2023-10-24T00:47:07.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1e680700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18154db0 con 0x7fdb180c6710 2023-10-24T00:47:07.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35108/0 (socket says 172.21.15.148:35108) 2023-10-24T00:47:07.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 -- 172.21.15.148:0/4019372419 learned_addr learned my addr 172.21.15.148:0/4019372419 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:07.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb177fe700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb18141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb1cc1d700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb18158770 0x7fdb180c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 -- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 msgr2=0x7fdb18141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb18141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 -- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb18158770 msgr2=0x7fdb180c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb18158770 0x7fdb180c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 -- 172.21.15.148:0/4019372419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb080092a0 con 0x7fdb180aa010 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb177fe700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb18141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.744+0000 7fdb17fff700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fdb18084230 tx=0x7fdb08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.745+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800b850 con 0x7fdb180aa010 2023-10-24T00:47:07.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.745+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800b9b0 con 0x7fdb180aa010 2023-10-24T00:47:07.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.745+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb18155090 con 0x7fdb180aa010 2023-10-24T00:47:07.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.745+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0801b660 con 0x7fdb180aa010 2023-10-24T00:47:07.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.745+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb18141e70 con 0x7fdb180aa010 2023-10-24T00:47:07.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.746+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1806c6b0 con 0x7fdb180aa010 2023-10-24T00:47:07.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.746+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb0801ba90 con 0x7fdb180aa010 2023-10-24T00:47:07.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.746+0000 7fdafffff700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 0x7fdb04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:07.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.746+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb0807bc60 con 0x7fdb180aa010 2023-10-24T00:47:07.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.746+0000 7fdb177fe700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 0x7fdb04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:07.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.747+0000 7fdb177fe700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 0x7fdb04061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdb18148450 tx=0x7fdb0c008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:07.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.750+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb0804cf30 con 0x7fdb180aa010 2023-10-24T00:47:07.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.910+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb180c1200 con 0x7fdb0405f150 2023-10-24T00:47:07.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.920+0000 7fdafffff700 1 -- 172.21.15.148:0/4019372419 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350124 (secure 0 0 0) 0x7fdb180c1200 con 0x7fdb0405f150 2023-10-24T00:47:07.926 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 msgr2=0x7fdb04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 0x7fdb04061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdb18148450 tx=0x7fdb0c008040).stop 2023-10-24T00:47:07.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 msgr2=0x7fdb18141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fdb18084230 tx=0x7fdb08017000).stop 2023-10-24T00:47:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 shutdown_connections 2023-10-24T00:47:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb18158770 0x7fdb180c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb0405f150 0x7fdb04061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb180aa010 0x7fdb18141320 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 --2- 172.21.15.148:0/4019372419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb180c6710 0x7fdb18141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 >> 172.21.15.148:0/4019372419 conn(0x7fdb180caf40 msgr2=0x7fdb180b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 shutdown_connections 2023-10-24T00:47:07.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:07.923+0000 7fdb1e680700 1 -- 172.21.15.148:0/4019372419 wait complete. 2023-10-24T00:47:07.932 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:47:07.937 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:47:07.251336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421328,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553392,"statfs":{"total":773094113280,"available":770614673408,"internally_reserved":0,"allocated":12075008,"data_stored":6063044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6012,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002763"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206144+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:46:59.206144+0000","last_peered":"2023-10-24T00:46:59.206144+0000","last_clean":"2023-10-24T00:46:59.206144+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:46:59.206144+0000","last_undegraded":"2023-10-24T00:46:59.206144+0000","last_fullsized":"2023-10-24T00:46:59.206144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205238+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:46:59.205238+0000","last_peered":"2023-10-24T00:46:59.205238+0000","last_clean":"2023-10-24T00:46:59.205238+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:46:59.205238+0000","last_undegraded":"2023-10-24T00:46:59.205238+0000","last_fullsized":"2023-10-24T00:46:59.205238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:47:01.068469+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:47:01.068469+0000","last_peered":"2023-10-24T00:47:01.068469+0000","last_clean":"2023-10-24T00:47:01.068469+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:47:01.068469+0000","last_undegraded":"2023-10-24T00:47:01.068469+0000","last_fullsized":"2023-10-24T00:47:01.068469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205233+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:46:59.205233+0000","last_peered":"2023-10-24T00:46:59.205233+0000","last_clean":"2023-10-24T00:46:59.205233+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:46:59.205233+0000","last_undegraded":"2023-10-24T00:46:59.205233+0000","last_fullsized":"2023-10-24T00:46:59.205233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":116,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:46:59.208592+0000","last_peered":"2023-10-24T00:46:59.208592+0000","last_clean":"2023-10-24T00:46:59.208592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:46:59.208592+0000","last_undegraded":"2023-10-24T00:46:59.208592+0000","last_fullsized":"2023-10-24T00:46:59.208592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:46:59.208603+0000","last_peered":"2023-10-24T00:46:59.208603+0000","last_clean":"2023-10-24T00:46:59.208603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:46:59.208603+0000","last_undegraded":"2023-10-24T00:46:59.208603+0000","last_fullsized":"2023-10-24T00:46:59.208603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208609+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:46:59.208609+0000","last_peered":"2023-10-24T00:46:59.208609+0000","last_clean":"2023-10-24T00:46:59.208609+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:46:59.208609+0000","last_undegraded":"2023-10-24T00:46:59.208609+0000","last_fullsized":"2023-10-24T00:46:59.208609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206170+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:46:59.206170+0000","last_peered":"2023-10-24T00:46:59.206170+0000","last_clean":"2023-10-24T00:46:59.206170+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:46:59.206170+0000","last_undegraded":"2023-10-24T00:46:59.206170+0000","last_fullsized":"2023-10-24T00:46:59.206170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.211402+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:46:59.211402+0000","last_peered":"2023-10-24T00:46:59.211402+0000","last_clean":"2023-10-24T00:46:59.211402+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:46:59.211402+0000","last_undegraded":"2023-10-24T00:46:59.211402+0000","last_fullsized":"2023-10-24T00:46:59.211402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542362,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.83299999999999996},"last":0.51300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79900000000000004},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.81399999999999995},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67900000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61899999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55900000000000005,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":4.351,"15min":4.351},"last":0.62},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67800000000000005,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72299999999999998,"5min":1.054,"15min":1.054},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51100000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.217,"15min":0.217},"max":{"1min":0.629,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.629}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":1.573},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.67500000000000004,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67500000000000004,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":14.597,"15min":14.597},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55400000000000005,"15min":0.503},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.83399999999999996,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":0.58599999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.623,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.255}]},{"osd":3,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.377},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65200000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58499999999999996,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":1.143,"15min":1.143},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.109,"15min":1.109},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.378,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.505,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40999999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.41299999999999998},"min":{"1min":0.31,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.628},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.67100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.92400000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.877,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.876},"last":0.501}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.36199999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.22700000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.63,"15min":0.65500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.379}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.623,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.625},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.083,"15min":1.083},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.67200000000000004},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.999},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38800000000000001,"15min":0.40699999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56699999999999995,"5min":1.099,"15min":1.099},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45500000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.40300000000000002},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.434,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.36199999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":1.024},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.437},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.93999999999999995,"15min":0.995},"last":0.41499999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86099999999999999,"5min":1.337,"15min":1.337},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":1.042},"last":0.497}]},{"osd":7,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":1.121},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.495,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.749,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.497,"15min":0.503},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]}]},{"osd":5,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1490944,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.503}]},{"osd":1,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.75600000000000001,"5min":0.79000000000000004,"15min":0.81799999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.748,"15min":1.1479999999999999},"last":0.621}]},{"osd":2,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0209999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":1.339},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.745,"15min":0.76400000000000001},"last":0.629}]},{"osd":7,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":1.772},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:47:07.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-10-24T00:47:07.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-24T00:47:07.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-10-24T00:47:07.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-24T00:47:07.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-10-24T00:47:07.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-24T00:47:07.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-10-24T00:47:07.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-24T00:47:07.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-10-24T00:47:07.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-24T00:47:07.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-10-24T00:47:07.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-24T00:47:07.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-10-24T00:47:07.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-24T00:47:07.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-10-24T00:47:07.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-24T00:47:07.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-10-24T00:47:07.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-24T00:47:07.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-10-24T00:47:07.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-24T00:47:07.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-10-24T00:47:07.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-24T00:47:07.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-10-24T00:47:07.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-24T00:47:07.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-10-24T00:47:07.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-24T00:47:07.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-10-24T00:47:07.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-24T00:47:07.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-10-24T00:47:07.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-24T00:47:07.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-10-24T00:47:07.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-24T00:47:07.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-10-24T00:47:07.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-24T00:47:07.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-10-24T00:47:07.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-24T00:47:07.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-10-24T00:47:07.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-24T00:47:07.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-10-24T00:47:07.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-24T00:47:07.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-10-24T00:47:07.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-24T00:47:07.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-10-24T00:47:07.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-24T00:47:07.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-10-24T00:47:07.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-24T00:47:07.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-10-24T00:47:07.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-24T00:47:07.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-10-24T00:47:07.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-24T00:47:07.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-10-24T00:47:07.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-24T00:47:07.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-10-24T00:47:07.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-24T00:47:07.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-10-24T00:47:07.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-24T00:47:07.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-10-24T00:47:07.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-24T00:47:07.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-10-24T00:47:07.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-24T00:47:07.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-10-24T00:47:07.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-24T00:47:07.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-10-24T00:47:07.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-24T00:47:07.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-10-24T00:47:07.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-24T00:47:07.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-10-24T00:47:07.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-24T00:47:07.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-10-24T00:47:07.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-24T00:47:07.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-10-24T00:47:07.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:07.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-24T00:47:07.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-10-24T00:47:08.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-24T00:47:08.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-10-24T00:47:08.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-24T00:47:08.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-10-24T00:47:08.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-24T00:47:08.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-10-24T00:47:08.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-24T00:47:08.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-10-24T00:47:08.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-24T00:47:08.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-10-24T00:47:08.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-24T00:47:08.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-10-24T00:47:08.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-24T00:47:08.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-10-24T00:47:08.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-24T00:47:08.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-10-24T00:47:08.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-24T00:47:08.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-10-24T00:47:08.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-24T00:47:08.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-10-24T00:47:08.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-24T00:47:08.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-10-24T00:47:08.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-24T00:47:08.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-10-24T00:47:08.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-24T00:47:08.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-10-24T00:47:08.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-24T00:47:08.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-10-24T00:47:08.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-24T00:47:08.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-10-24T00:47:08.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-24T00:47:08.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-10-24T00:47:08.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-24T00:47:08.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-10-24T00:47:08.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-24T00:47:08.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-10-24T00:47:08.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-24T00:47:08.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-10-24T00:47:08.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-24T00:47:08.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-10-24T00:47:08.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-24T00:47:08.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-10-24T00:47:08.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-24T00:47:08.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-10-24T00:47:08.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-24T00:47:08.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-10-24T00:47:08.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-24T00:47:08.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-10-24T00:47:08.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-24T00:47:08.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-10-24T00:47:08.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-24T00:47:08.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-10-24T00:47:08.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-24T00:47:08.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-10-24T00:47:08.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:03.871843+0000', 'last_change': '2023-10-24T00:47:03.871843+0000', 'last_active': '2023-10-24T00:47:03.871843+0000', 'last_peered': '2023-10-24T00:47:03.871843+0000', 'last_clean': '2023-10-24T00:47:03.871843+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:03.871843+0000', 'last_undegraded': '2023-10-24T00:47:03.871843+0000', 'last_fullsized': '2023-10-24T00:47:03.871843+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:03.871843+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-24T00:47:08.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T00:47:02.869683+0000', 'last_change': '2023-10-24T00:47:02.869683+0000', 'last_active': '2023-10-24T00:47:02.869683+0000', 'last_peered': '2023-10-24T00:47:02.869683+0000', 'last_clean': '2023-10-24T00:47:02.869683+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:47:02.869683+0000', 'last_undegraded': '2023-10-24T00:47:02.869683+0000', 'last_fullsized': '2023-10-24T00:47:02.869683+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'last_clean_scrub_stamp': '2023-10-24T00:47:02.869683+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T00:47:08.047 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:47:08.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.159+0000 7f43335b1700 1 Processor -- start 2023-10-24T00:47:08.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.159+0000 7f43335b1700 1 -- start start 2023-10-24T00:47:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f43335b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f432c158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f43335b1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0c0350 con 0x7f432c154650 2023-10-24T00:47:08.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f43335b1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c158670 con 0x7f432c154270 2023-10-24T00:47:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f43335b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c158950 con 0x7f432c064f90 2023-10-24T00:47:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f4330b4c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f432c154650 0x7f432c064880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52468/0 (socket says 172.21.15.148:52468) 2023-10-24T00:47:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f4330b4c700 1 -- 172.21.15.148:0/3587653560 learned_addr learned my addr 172.21.15.148:0/3587653560 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:08.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.160+0000 7f4331b4e700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f432c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137457625 0 0) 0x7f432c0c0350 con 0x7f432c154650 2023-10-24T00:47:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43180033f0 con 0x7f432c154650 2023-10-24T00:47:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043948919 0 0) 0x7f432c158670 con 0x7f432c154270 2023-10-24T00:47:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c0c0350 con 0x7f432c154270 2023-10-24T00:47:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134958332 0 0) 0x7f43180033f0 con 0x7f432c154650 2023-10-24T00:47:08.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 msgr2=0x7f432c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:08.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f432c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 >> v1:172.21.15.150:6789/0 conn(0x7f432c154270 legacy=0x7f432c0aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c158c30 con 0x7f432c154650 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f431c001470 con 0x7f432c154650 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 >> v1:172.21.15.148:6789/0 conn(0x7f432c154650 legacy=0x7f432c064880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4318003aa0 0x7f4318003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318004690 0x7f4318004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f4318005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c158950 con 0x7f4318003aa0 2023-10-24T00:47:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431800b910 con 0x7f4318004690 2023-10-24T00:47:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431800bad0 con 0x7f432c064f90 2023-10-24T00:47:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4318003aa0 0x7f4318003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4330b4c700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318004690 0x7f4318004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4331b4e700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f4318005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 -- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 msgr2=0x7f4318005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c064f90 0x7f4318005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 -- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318004690 msgr2=0x7f4318004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:08.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318004690 0x7f4318004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 -- 172.21.15.148:0/3587653560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43180033f0 con 0x7f4318003aa0 2023-10-24T00:47:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f4330b4c700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318004690 0x7f4318004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.161+0000 7f433134d700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4318003aa0 0x7f4318003ea0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4328001890 tx=0x7f4328007bb0).ready entity=mon.0 client_cookie=5b3c60fac515ddbd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328007020 con 0x7f4318003aa0 2023-10-24T00:47:08.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328007180 con 0x7f4318003aa0 2023-10-24T00:47:08.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f4323fff700 1 -- 172.21.15.148:0/3587653560 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328007500 con 0x7f4318003aa0 2023-10-24T00:47:08.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 -- 172.21.15.148:0/3587653560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4318003aa0 msgr2=0x7f4318003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 --2- 172.21.15.148:0/3587653560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4318003aa0 0x7f4318003ea0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f4328001890 tx=0x7f4328007bb0).stop 2023-10-24T00:47:08.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f4331b4e700 1 -- 172.21.15.148:0/3587653560 reap_dead start 2023-10-24T00:47:08.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 -- 172.21.15.148:0/3587653560 shutdown_connections 2023-10-24T00:47:08.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 -- 172.21.15.148:0/3587653560 >> 172.21.15.148:0/3587653560 conn(0x7f432c06a850 msgr2=0x7f432c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:08.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 -- 172.21.15.148:0/3587653560 shutdown_connections 2023-10-24T00:47:08.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.162+0000 7f43335b1700 1 -- 172.21.15.148:0/3587653560 wait complete. 2023-10-24T00:47:08.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.163+0000 7f43335b1700 1 Processor -- start 2023-10-24T00:47:08.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.163+0000 7f43335b1700 1 -- start start 2023-10-24T00:47:08.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 0x7f432c0c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c14d0f0 0x7f432c156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0aed10 con 0x7f432c0ca210 2023-10-24T00:47:08.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0c4030 con 0x7f4318003aa0 2023-10-24T00:47:08.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f43335b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0c4310 con 0x7f432c14d0f0 2023-10-24T00:47:08.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f4330b4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f4330b4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35132/0 (socket says 172.21.15.148:35132) 2023-10-24T00:47:08.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f4330b4c700 1 -- 172.21.15.148:0/3948622678 learned_addr learned my addr 172.21.15.148:0/3948622678 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:08.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f433134d700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 0x7f432c0c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.164+0000 7f4331b4e700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c14d0f0 0x7f432c156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 -- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c14d0f0 msgr2=0x7f432c156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c14d0f0 0x7f432c156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 -- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 msgr2=0x7f432c0c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 0x7f432c0c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 -- 172.21.15.148:0/3948622678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0c45f0 con 0x7f432c0ca210 2023-10-24T00:47:08.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f433134d700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 0x7f432c0c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f4330b4c700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f431c000fd0 tx=0x7f432c0c02c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c010520 con 0x7f432c0ca210 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c010680 con 0x7f432c0ca210 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c010a00 con 0x7f432c0ca210 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c0c48d0 con 0x7f432c0ca210 2023-10-24T00:47:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.165+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c156930 con 0x7f432c0ca210 2023-10-24T00:47:08.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.166+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c0aeae0 con 0x7f432c0ca210 2023-10-24T00:47:08.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.166+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f431c014430 con 0x7f432c0ca210 2023-10-24T00:47:08.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.166+0000 7f43217fa700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 0x7f4310061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.167+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f431c07a220 con 0x7f432c0ca210 2023-10-24T00:47:08.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.167+0000 7f433134d700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 0x7f4310061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.167+0000 7f433134d700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 0x7f4310061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4328001670 tx=0x7f4328016000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.171+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f432c0aeae0 con 0x7f432c0ca210 2023-10-24T00:47:08.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.397+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f432c0aeae0 con 0x7f432c0ca210 2023-10-24T00:47:08.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.397+0000 7f43217fa700 1 -- 172.21.15.148:0/3948622678 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7f432c0aeae0 con 0x7f432c0ca210 2023-10-24T00:47:08.399 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:08.399 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1112,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2479439872,"bytes_avail":770614673408,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":43,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":7710}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-24T00:46:46.340067+0000","services":{}},"progress_events":{}} 2023-10-24T00:47:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 msgr2=0x7f4310061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 0x7f4310061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4328001670 tx=0x7f4328016000).stop 2023-10-24T00:47:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 msgr2=0x7f432c14cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7f431c000fd0 tx=0x7f432c0c02c0).stop 2023-10-24T00:47:08.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 shutdown_connections 2023-10-24T00:47:08.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f432c14d0f0 0x7f432c156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4318003aa0 0x7f432c0c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f431005f150 0x7f4310061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 --2- 172.21.15.148:0/3948622678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f432c0ca210 0x7f432c14cc00 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 >> 172.21.15.148:0/3948622678 conn(0x7f432c06a850 msgr2=0x7f432c063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:08.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 shutdown_connections 2023-10-24T00:47:08.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.399+0000 7f43335b1700 1 -- 172.21.15.148:0/3948622678 wait complete. 2023-10-24T00:47:08.412 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:47:08.413 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:47:08.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.525+0000 7f6381903700 1 Processor -- start 2023-10-24T00:47:08.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.525+0000 7f6381903700 1 -- start start 2023-10-24T00:47:08.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0aa010 0x7f637c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 0x7f637c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0aa8e0 con 0x7f637c0aa010 2023-10-24T00:47:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0c0960 con 0x7f637c158770 2023-10-24T00:47:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6381903700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0c0c40 con 0x7f637c0c6710 2023-10-24T00:47:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0aa010 0x7f637c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f637c0aa010 0x7f637c0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35136/0 (socket says 172.21.15.148:35136) 2023-10-24T00:47:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 -- 172.21.15.148:0/1885700469 learned_addr learned my addr 172.21.15.148:0/1885700469 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:08.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637a7fc700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637b7fe700 1 --2- 172.21.15.148:0/1885700469 >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 0x7f637c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 -- 172.21.15.148:0/1885700469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 msgr2=0x7f637c0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:08.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c0aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 -- 172.21.15.148:0/1885700469 >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 msgr2=0x7f637c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:08.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 --2- 172.21.15.148:0/1885700469 >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 0x7f637c069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 -- 172.21.15.148:0/1885700469 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0c0f20 con 0x7f637c0aa010 2023-10-24T00:47:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637b7fe700 1 --2- 172.21.15.148:0/1885700469 >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 0x7f637c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f637affd700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c0c1a00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f637c0c6b90 tx=0x7f6374009840).ready entity=mon.0 client_cookie=d63139139a72e655 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6379ffb700 1 -- 172.21.15.148:0/1885700469 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400e070 con 0x7f637c0aa010 2023-10-24T00:47:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6379ffb700 1 -- 172.21.15.148:0/1885700469 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400ba50 con 0x7f637c0aa010 2023-10-24T00:47:08.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.526+0000 7f6379ffb700 1 -- 172.21.15.148:0/1885700469 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400bdd0 con 0x7f637c0aa010 2023-10-24T00:47:08.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 -- 172.21.15.148:0/1885700469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 msgr2=0x7f637c0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c0c1a00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f637c0c6b90 tx=0x7f6374009840).stop 2023-10-24T00:47:08.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 -- 172.21.15.148:0/1885700469 shutdown_connections 2023-10-24T00:47:08.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c0c1a00 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 --2- 172.21.15.148:0/1885700469 >> v2:172.21.15.150:3300/0 conn(0x7f637c158770 0x7f637c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 --2- 172.21.15.148:0/1885700469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 -- 172.21.15.148:0/1885700469 >> 172.21.15.148:0/1885700469 conn(0x7f637c0caf40 msgr2=0x7f637c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:08.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 -- 172.21.15.148:0/1885700469 shutdown_connections 2023-10-24T00:47:08.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.527+0000 7f6381903700 1 -- 172.21.15.148:0/1885700469 wait complete. 2023-10-24T00:47:08.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.528+0000 7f6381903700 1 Processor -- start 2023-10-24T00:47:08.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.528+0000 7f6381903700 1 -- start start 2023-10-24T00:47:08.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c158770 0x7f637c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1576c0 con 0x7f637c0aa010 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c167f70 con 0x7f637c158770 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f6381903700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1573e0 con 0x7f637c0c6710 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35138/0 (socket says 172.21.15.148:35138) 2023-10-24T00:47:08.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 -- 172.21.15.148:0/1999005818 learned_addr learned my addr 172.21.15.148:0/1999005818 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:08.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637a7fc700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637b7fe700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c158770 0x7f637c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 -- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 msgr2=0x7f637c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 -- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c158770 msgr2=0x7f637c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c158770 0x7f637c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 -- 172.21.15.148:0/1999005818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374009ae0 con 0x7f637c0aa010 2023-10-24T00:47:08.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.529+0000 7f637affd700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f6374009fd0 tx=0x7f6374009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.530+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374009500 con 0x7f637c0aa010 2023-10-24T00:47:08.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.530+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400bc90 con 0x7f637c0aa010 2023-10-24T00:47:08.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.530+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c167920 con 0x7f637c0aa010 2023-10-24T00:47:08.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.530+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637401e680 con 0x7f637c0aa010 2023-10-24T00:47:08.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.530+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c143de0 con 0x7f637c0aa010 2023-10-24T00:47:08.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.531+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c06c6b0 con 0x7f637c0aa010 2023-10-24T00:47:08.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.531+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6374003040 con 0x7f637c0aa010 2023-10-24T00:47:08.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.531+0000 7f6372ffd700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 0x7f635c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:08.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.531+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f637407b6b0 con 0x7f637c0aa010 2023-10-24T00:47:08.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.532+0000 7f637a7fc700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 0x7f635c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:08.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.532+0000 7f637a7fc700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 0x7f635c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f637c0c9d90 tx=0x7f6364008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:08.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.535+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f637404ca30 con 0x7f637c0aa010 2023-10-24T00:47:08.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.697+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f637c0c1200 con 0x7f635c05f150 2023-10-24T00:47:08.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.706+0000 7f6372ffd700 1 -- 172.21.15.148:0/1999005818 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350124 (secure 0 0 0) 0x7f637c0c1200 con 0x7f635c05f150 2023-10-24T00:47:08.711 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 msgr2=0x7f635c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 0x7f635c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f637c0c9d90 tx=0x7f6364008040).stop 2023-10-24T00:47:08.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 msgr2=0x7f637c1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:08.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f6374009fd0 tx=0x7f6374009840).stop 2023-10-24T00:47:08.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 shutdown_connections 2023-10-24T00:47:08.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c158770 0x7f637c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f635c05f150 0x7f635c061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f637c0aa010 0x7f637c1438f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 --2- 172.21.15.148:0/1999005818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0c6710 0x7f637c156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 >> 172.21.15.148:0/1999005818 conn(0x7f637c0caf40 msgr2=0x7f637c152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 shutdown_connections 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:08.710+0000 7f6381903700 1 -- 172.21.15.148:0/1999005818 wait complete. 2023-10-24T00:47:08.716 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:47:08.723 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T00:47:07.251336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2421328,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553392,"statfs":{"total":773094113280,"available":770614673408,"internally_reserved":0,"allocated":12075008,"data_stored":6063044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6012,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.002763"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206144+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:46:59.206144+0000","last_peered":"2023-10-24T00:46:59.206144+0000","last_clean":"2023-10-24T00:46:59.206144+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:46:59.206144+0000","last_undegraded":"2023-10-24T00:46:59.206144+0000","last_fullsized":"2023-10-24T00:46:59.206144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205238+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:46:59.205238+0000","last_peered":"2023-10-24T00:46:59.205238+0000","last_clean":"2023-10-24T00:46:59.205238+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:46:59.205238+0000","last_undegraded":"2023-10-24T00:46:59.205238+0000","last_fullsized":"2023-10-24T00:46:59.205238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:47:01.068469+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:47:01.068469+0000","last_peered":"2023-10-24T00:47:01.068469+0000","last_clean":"2023-10-24T00:47:01.068469+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:47:01.068469+0000","last_undegraded":"2023-10-24T00:47:01.068469+0000","last_fullsized":"2023-10-24T00:47:01.068469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.205233+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:46:59.205233+0000","last_peered":"2023-10-24T00:46:59.205233+0000","last_clean":"2023-10-24T00:46:59.205233+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:46:59.205233+0000","last_undegraded":"2023-10-24T00:46:59.205233+0000","last_fullsized":"2023-10-24T00:46:59.205233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":116,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208592+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:46:59.208592+0000","last_peered":"2023-10-24T00:46:59.208592+0000","last_clean":"2023-10-24T00:46:59.208592+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:46:59.208592+0000","last_undegraded":"2023-10-24T00:46:59.208592+0000","last_fullsized":"2023-10-24T00:46:59.208592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208603+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:46:59.208603+0000","last_peered":"2023-10-24T00:46:59.208603+0000","last_clean":"2023-10-24T00:46:59.208603+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:46:59.208603+0000","last_undegraded":"2023-10-24T00:46:59.208603+0000","last_fullsized":"2023-10-24T00:46:59.208603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.208609+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:46:59.208609+0000","last_peered":"2023-10-24T00:46:59.208609+0000","last_clean":"2023-10-24T00:46:59.208609+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:46:59.208609+0000","last_undegraded":"2023-10-24T00:46:59.208609+0000","last_fullsized":"2023-10-24T00:46:59.208609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.206170+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:46:59.206170+0000","last_peered":"2023-10-24T00:46:59.206170+0000","last_clean":"2023-10-24T00:46:59.206170+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:46:59.206170+0000","last_undegraded":"2023-10-24T00:46:59.206170+0000","last_fullsized":"2023-10-24T00:46:59.206170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:03.871843+0000","last_change":"2023-10-24T00:47:03.871843+0000","last_active":"2023-10-24T00:47:03.871843+0000","last_peered":"2023-10-24T00:47:03.871843+0000","last_clean":"2023-10-24T00:47:03.871843+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:03.871843+0000","last_undegraded":"2023-10-24T00:47:03.871843+0000","last_fullsized":"2023-10-24T00:47:03.871843+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T00:47:02.869683+0000","last_change":"2023-10-24T00:47:02.869683+0000","last_active":"2023-10-24T00:47:02.869683+0000","last_peered":"2023-10-24T00:47:02.869683+0000","last_clean":"2023-10-24T00:47:02.869683+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:47:02.869683+0000","last_undegraded":"2023-10-24T00:47:02.869683+0000","last_fullsized":"2023-10-24T00:47:02.869683+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-24T00:46:59.211402+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:46:59.211402+0000","last_peered":"2023-10-24T00:46:59.211402+0000","last_clean":"2023-10-24T00:46:59.211402+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:46:59.211402+0000","last_undegraded":"2023-10-24T00:46:59.211402+0000","last_fullsized":"2023-10-24T00:46:59.211402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542362,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.83299999999999996},"last":0.51300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79900000000000004},"last":0.41499999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.81399999999999995},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67900000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61899999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55900000000000005,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":4.351,"15min":4.351},"last":0.62},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67800000000000005,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72299999999999998,"5min":1.054,"15min":1.054},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51100000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.217,"15min":0.217},"max":{"1min":0.629,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.629}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":1.573},"last":0.41399999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.67500000000000004,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67500000000000004,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":14.597,"15min":14.597},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55400000000000005,"15min":0.503},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.83399999999999996,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575067,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":0.58599999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.623,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.255}]},{"osd":3,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.377},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65200000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.30599999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58499999999999996,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":1.143,"15min":1.143},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.504}]},{"osd":7,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.109,"15min":1.109},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.378,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.505,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40999999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.41299999999999998},"min":{"1min":0.31,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.628},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.67100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.92400000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.877,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.876},"last":0.501}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.36199999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.22700000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.63,"15min":0.65500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.379}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.623,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.78000000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.625},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.74099999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.083,"15min":1.083},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.67200000000000004},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.999},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1503232,"data_stored":754919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38800000000000001,"15min":0.40699999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56699999999999995,"5min":1.099,"15min":1.099},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45500000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.40300000000000002},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.434,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.36199999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":1.024},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.44800000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.437},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.93999999999999995,"15min":0.995},"last":0.41499999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86099999999999999,"5min":1.337,"15min":1.337},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":1.042},"last":0.497}]},{"osd":7,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":1.121},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302672,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069168,"statfs":{"total":96636764160,"available":96326828032,"internally_reserved":0,"allocated":1515520,"data_stored":760870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.371},{"interface":"front","average":{"1min":0.495,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.501},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.749,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.44400000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.497,"15min":0.503},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46899999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.88,"15min":0.88},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.436}]}]},{"osd":5,"up_from":14,"seq":60129542362,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1490944,"data_stored":748856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.503}]},{"osd":1,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.75600000000000001,"5min":0.79000000000000004,"15min":0.81799999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.748,"15min":1.1479999999999999},"last":0.621}]},{"osd":2,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0209999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.53700000000000003}]},{"osd":3,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":1.339},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.745,"15min":0.76400000000000001},"last":0.629}]},{"osd":7,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":1.772},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:47:09.590 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:47:09.589+0000 7f7a4bbfc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:47:11.732 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:47:11.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.857+0000 7fa2858a9700 1 Processor -- start 2023-10-24T00:47:11.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.857+0000 7fa2858a9700 1 -- start start 2023-10-24T00:47:11.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2858a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 0x7fa2800c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2858a9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2800c0ef0 0x7fa2800c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2858a9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2800c6410 con 0x7fa2800ca110 2023-10-24T00:47:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2858a9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800ca6e0 con 0x7fa2800c0ef0 2023-10-24T00:47:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2858a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800ca9c0 con 0x7fa2800aa140 2023-10-24T00:47:11.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2800c0ef0 0x7fa2800c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2800c0ef0 0x7fa2800c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35154/0 (socket says 172.21.15.148:35154) 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 -- 172.21.15.148:0/2361873839 learned_addr learned my addr 172.21.15.148:0/2361873839 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2848a7700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 0x7fa2800c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 -- 172.21.15.148:0/2361873839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 msgr2=0x7fa2800c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 0x7fa2800c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 -- 172.21.15.148:0/2361873839 >> v1:172.21.15.150:6789/0 conn(0x7fa2800ca110 legacy=0x7fa2800c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 -- 172.21.15.148:0/2361873839 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800c60a0 con 0x7fa2800c0ef0 2023-10-24T00:47:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2848a7700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 0x7fa2800c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.858+0000 7fa2850a8700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800c0ef0 0x7fa2800c68a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fa268006fd0 tx=0x7fa2680090f0).ready entity=mon.0 client_cookie=34814505d3b0bee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa27f7fe700 1 -- 172.21.15.148:0/2361873839 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800b600 con 0x7fa2800c0ef0 2023-10-24T00:47:11.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa27f7fe700 1 -- 172.21.15.148:0/2361873839 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800b760 con 0x7fa2800c0ef0 2023-10-24T00:47:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa27f7fe700 1 -- 172.21.15.148:0/2361873839 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800bb00 con 0x7fa2800c0ef0 2023-10-24T00:47:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 -- 172.21.15.148:0/2361873839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800c0ef0 msgr2=0x7fa2800c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800c0ef0 0x7fa2800c68a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fa268006fd0 tx=0x7fa2680090f0).stop 2023-10-24T00:47:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 -- 172.21.15.148:0/2361873839 shutdown_connections 2023-10-24T00:47:11.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800aa140 0x7fa2800c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 --2- 172.21.15.148:0/2361873839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800c0ef0 0x7fa2800c68a0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 -- 172.21.15.148:0/2361873839 >> 172.21.15.148:0/2361873839 conn(0x7fa2800944a0 msgr2=0x7fa28006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 -- 172.21.15.148:0/2361873839 shutdown_connections 2023-10-24T00:47:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.859+0000 7fa2858a9700 1 -- 172.21.15.148:0/2361873839 wait complete. 2023-10-24T00:47:11.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.860+0000 7fa2858a9700 1 Processor -- start 2023-10-24T00:47:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 -- start start 2023-10-24T00:47:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 0x7fa2801507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 0x7fa2800c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800c50d0 con 0x7fa2800ca110 2023-10-24T00:47:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800c4510 con 0x7fa2800aa140 2023-10-24T00:47:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2858a9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800c47a0 con 0x7fa2800c0ef0 2023-10-24T00:47:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2850a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2850a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35166/0 (socket says 172.21.15.148:35166) 2023-10-24T00:47:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.861+0000 7fa2850a8700 1 -- 172.21.15.148:0/1267883781 learned_addr learned my addr 172.21.15.148:0/1267883781 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2848a7700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 0x7fa2801507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa27ffff700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 0x7fa2800c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 -- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 msgr2=0x7fa2800c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 0x7fa2800c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 -- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 msgr2=0x7fa2801507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 0x7fa2801507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 -- 172.21.15.148:0/1267883781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268009370 con 0x7fa2800ca110 2023-10-24T00:47:11.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2848a7700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 0x7fa2801507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa27ffff700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 0x7fa2800c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2850a8700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fa28005f860 tx=0x7fa268017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800bec0 con 0x7fa2800ca110 2023-10-24T00:47:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800bae0 con 0x7fa2800ca110 2023-10-24T00:47:11.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2800c4a80 con 0x7fa2800ca110 2023-10-24T00:47:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268024680 con 0x7fa2800ca110 2023-10-24T00:47:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.862+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2800c2390 con 0x7fa2800ca110 2023-10-24T00:47:11.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.863+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2800c5240 con 0x7fa2800ca110 2023-10-24T00:47:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.863+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa268021070 con 0x7fa2800ca110 2023-10-24T00:47:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.864+0000 7fa27cff9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 0x7fa260061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.864+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa26807c030 con 0x7fa2800ca110 2023-10-24T00:47:11.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.864+0000 7fa2848a7700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 0x7fa260061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.864+0000 7fa2848a7700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 0x7fa260061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa278008990 tx=0x7fa278008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:11.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:11.868+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa26804d340 con 0x7fa2800ca110 2023-10-24T00:47:12.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.029+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa280047480 con 0x7fa26005f150 2023-10-24T00:47:12.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.040+0000 7fa27cff9700 1 -- 172.21.15.148:0/1267883781 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361954 (secure 0 0 0) 0x7fa280047480 con 0x7fa26005f150 2023-10-24T00:47:12.045 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:12.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 msgr2=0x7fa260061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 0x7fa260061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa278008990 tx=0x7fa278008040).stop 2023-10-24T00:47:12.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 msgr2=0x7fa280167750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fa28005f860 tx=0x7fa268017000).stop 2023-10-24T00:47:12.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 shutdown_connections 2023-10-24T00:47:12.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa26005f150 0x7fa260061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2800ca110 0x7fa280167750 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2800aa140 0x7fa2801507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 --2- 172.21.15.148:0/1267883781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2800c0ef0 0x7fa2800c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 >> 172.21.15.148:0/1267883781 conn(0x7fa2800944a0 msgr2=0x7fa2800a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 shutdown_connections 2023-10-24T00:47:12.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.043+0000 7fa2858a9700 1 -- 172.21.15.148:0/1267883781 wait complete. 2023-10-24T00:47:12.051 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:47:12.056 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-24T00:47:11.252655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":261,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421812,"kb_used_data":12276,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752552908,"statfs":{"total":773094113280,"available":770614177792,"internally_reserved":0,"allocated":12570624,"data_stored":6299132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6012,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.003579"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277299+0000","last_change":"2023-10-24T00:47:04.270781+0000","last_active":"2023-10-24T00:47:04.277299+0000","last_peered":"2023-10-24T00:47:04.277299+0000","last_clean":"2023-10-24T00:47:04.277299+0000","last_became_active":"2023-10-24T00:47:04.270513+0000","last_became_peered":"2023-10-24T00:47:04.270513+0000","last_unstale":"2023-10-24T00:47:04.277299+0000","last_undegraded":"2023-10-24T00:47:04.277299+0000","last_fullsized":"2023-10-24T00:47:04.277299+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"126'3","reported_seq":13,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281304+0000","last_change":"2023-10-24T00:47:03.895770+0000","last_active":"2023-10-24T00:47:04.281304+0000","last_peered":"2023-10-24T00:47:04.281304+0000","last_clean":"2023-10-24T00:47:04.281304+0000","last_became_active":"2023-10-24T00:47:03.895496+0000","last_became_peered":"2023-10-24T00:47:03.895496+0000","last_unstale":"2023-10-24T00:47:04.281304+0000","last_undegraded":"2023-10-24T00:47:04.281304+0000","last_fullsized":"2023-10-24T00:47:04.281304+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.274475+0000","last_change":"2023-10-24T00:47:04.272574+0000","last_active":"2023-10-24T00:47:04.274475+0000","last_peered":"2023-10-24T00:47:04.274475+0000","last_clean":"2023-10-24T00:47:04.274475+0000","last_became_active":"2023-10-24T00:47:04.272367+0000","last_became_peered":"2023-10-24T00:47:04.272367+0000","last_unstale":"2023-10-24T00:47:04.274475+0000","last_undegraded":"2023-10-24T00:47:04.274475+0000","last_fullsized":"2023-10-24T00:47:04.274475+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263100+0000","last_change":"2023-10-24T00:47:03.899549+0000","last_active":"2023-10-24T00:47:04.263100+0000","last_peered":"2023-10-24T00:47:04.263100+0000","last_clean":"2023-10-24T00:47:04.263100+0000","last_became_active":"2023-10-24T00:47:03.899263+0000","last_became_peered":"2023-10-24T00:47:03.899263+0000","last_unstale":"2023-10-24T00:47:04.263100+0000","last_undegraded":"2023-10-24T00:47:04.263100+0000","last_fullsized":"2023-10-24T00:47:04.263100+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279593+0000","last_change":"2023-10-24T00:47:04.274299+0000","last_active":"2023-10-24T00:47:04.279593+0000","last_peered":"2023-10-24T00:47:04.279593+0000","last_clean":"2023-10-24T00:47:04.279593+0000","last_became_active":"2023-10-24T00:47:04.269738+0000","last_became_peered":"2023-10-24T00:47:04.269738+0000","last_unstale":"2023-10-24T00:47:04.279593+0000","last_undegraded":"2023-10-24T00:47:04.279593+0000","last_fullsized":"2023-10-24T00:47:04.279593+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.257556+0000","last_change":"2023-10-24T00:47:03.895699+0000","last_active":"2023-10-24T00:47:04.257556+0000","last_peered":"2023-10-24T00:47:04.257556+0000","last_clean":"2023-10-24T00:47:04.257556+0000","last_became_active":"2023-10-24T00:47:03.895445+0000","last_became_peered":"2023-10-24T00:47:03.895445+0000","last_unstale":"2023-10-24T00:47:04.257556+0000","last_undegraded":"2023-10-24T00:47:04.257556+0000","last_fullsized":"2023-10-24T00:47:04.257556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267868+0000","last_change":"2023-10-24T00:47:04.265056+0000","last_active":"2023-10-24T00:47:04.267868+0000","last_peered":"2023-10-24T00:47:04.267868+0000","last_clean":"2023-10-24T00:47:04.267868+0000","last_became_active":"2023-10-24T00:47:04.263596+0000","last_became_peered":"2023-10-24T00:47:04.263596+0000","last_unstale":"2023-10-24T00:47:04.267868+0000","last_undegraded":"2023-10-24T00:47:04.267868+0000","last_fullsized":"2023-10-24T00:47:04.267868+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"126'2","reported_seq":12,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.278011+0000","last_change":"2023-10-24T00:47:03.893570+0000","last_active":"2023-10-24T00:47:04.278011+0000","last_peered":"2023-10-24T00:47:04.278011+0000","last_clean":"2023-10-24T00:47:04.278011+0000","last_became_active":"2023-10-24T00:47:03.892195+0000","last_became_peered":"2023-10-24T00:47:03.892195+0000","last_unstale":"2023-10-24T00:47:04.278011+0000","last_undegraded":"2023-10-24T00:47:04.278011+0000","last_fullsized":"2023-10-24T00:47:04.278011+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279958+0000","last_change":"2023-10-24T00:47:04.276130+0000","last_active":"2023-10-24T00:47:04.279958+0000","last_peered":"2023-10-24T00:47:04.279958+0000","last_clean":"2023-10-24T00:47:04.279958+0000","last_became_active":"2023-10-24T00:47:04.275462+0000","last_became_peered":"2023-10-24T00:47:04.275462+0000","last_unstale":"2023-10-24T00:47:04.279958+0000","last_undegraded":"2023-10-24T00:47:04.279958+0000","last_fullsized":"2023-10-24T00:47:04.279958+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.275138+0000","last_change":"2023-10-24T00:47:03.899737+0000","last_active":"2023-10-24T00:47:04.275138+0000","last_peered":"2023-10-24T00:47:04.275138+0000","last_clean":"2023-10-24T00:47:04.275138+0000","last_became_active":"2023-10-24T00:47:03.899476+0000","last_became_peered":"2023-10-24T00:47:03.899476+0000","last_unstale":"2023-10-24T00:47:04.275138+0000","last_undegraded":"2023-10-24T00:47:04.275138+0000","last_fullsized":"2023-10-24T00:47:04.275138+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267248+0000","last_change":"2023-10-24T00:47:04.266279+0000","last_active":"2023-10-24T00:47:04.267248+0000","last_peered":"2023-10-24T00:47:04.267248+0000","last_clean":"2023-10-24T00:47:04.267248+0000","last_became_active":"2023-10-24T00:47:04.265901+0000","last_became_peered":"2023-10-24T00:47:04.265901+0000","last_unstale":"2023-10-24T00:47:04.267248+0000","last_undegraded":"2023-10-24T00:47:04.267248+0000","last_fullsized":"2023-10-24T00:47:04.267248+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263984+0000","last_change":"2023-10-24T00:47:03.896971+0000","last_active":"2023-10-24T00:47:04.263984+0000","last_peered":"2023-10-24T00:47:04.263984+0000","last_clean":"2023-10-24T00:47:04.263984+0000","last_became_active":"2023-10-24T00:47:03.896709+0000","last_became_peered":"2023-10-24T00:47:03.896709+0000","last_unstale":"2023-10-24T00:47:04.263984+0000","last_undegraded":"2023-10-24T00:47:04.263984+0000","last_fullsized":"2023-10-24T00:47:04.263984+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.286642+0000","last_change":"2023-10-24T00:47:04.281087+0000","last_active":"2023-10-24T00:47:04.286642+0000","last_peered":"2023-10-24T00:47:04.286642+0000","last_clean":"2023-10-24T00:47:04.286642+0000","last_became_active":"2023-10-24T00:47:04.280821+0000","last_became_peered":"2023-10-24T00:47:04.280821+0000","last_unstale":"2023-10-24T00:47:04.286642+0000","last_undegraded":"2023-10-24T00:47:04.286642+0000","last_fullsized":"2023-10-24T00:47:04.286642+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255123+0000","last_change":"2023-10-24T00:47:03.896378+0000","last_active":"2023-10-24T00:47:04.255123+0000","last_peered":"2023-10-24T00:47:04.255123+0000","last_clean":"2023-10-24T00:47:04.255123+0000","last_became_active":"2023-10-24T00:47:03.896103+0000","last_became_peered":"2023-10-24T00:47:03.896103+0000","last_unstale":"2023-10-24T00:47:04.255123+0000","last_undegraded":"2023-10-24T00:47:04.255123+0000","last_fullsized":"2023-10-24T00:47:04.255123+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279630+0000","last_change":"2023-10-24T00:47:04.275024+0000","last_active":"2023-10-24T00:47:04.279630+0000","last_peered":"2023-10-24T00:47:04.279630+0000","last_clean":"2023-10-24T00:47:04.279630+0000","last_became_active":"2023-10-24T00:47:04.274709+0000","last_became_peered":"2023-10-24T00:47:04.274709+0000","last_unstale":"2023-10-24T00:47:04.279630+0000","last_undegraded":"2023-10-24T00:47:04.279630+0000","last_fullsized":"2023-10-24T00:47:04.279630+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.261503+0000","last_change":"2023-10-24T00:47:03.898227+0000","last_active":"2023-10-24T00:47:04.261503+0000","last_peered":"2023-10-24T00:47:04.261503+0000","last_clean":"2023-10-24T00:47:04.261503+0000","last_became_active":"2023-10-24T00:47:03.896642+0000","last_became_peered":"2023-10-24T00:47:03.896642+0000","last_unstale":"2023-10-24T00:47:04.261503+0000","last_undegraded":"2023-10-24T00:47:04.261503+0000","last_fullsized":"2023-10-24T00:47:04.261503+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276485+0000","last_change":"2023-10-24T00:47:04.270118+0000","last_active":"2023-10-24T00:47:04.276485+0000","last_peered":"2023-10-24T00:47:04.276485+0000","last_clean":"2023-10-24T00:47:04.276485+0000","last_became_active":"2023-10-24T00:47:04.269845+0000","last_became_peered":"2023-10-24T00:47:04.269845+0000","last_unstale":"2023-10-24T00:47:04.276485+0000","last_undegraded":"2023-10-24T00:47:04.276485+0000","last_fullsized":"2023-10-24T00:47:04.276485+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267974+0000","last_change":"2023-10-24T00:47:03.894154+0000","last_active":"2023-10-24T00:47:04.267974+0000","last_peered":"2023-10-24T00:47:04.267974+0000","last_clean":"2023-10-24T00:47:04.267974+0000","last_became_active":"2023-10-24T00:47:03.893162+0000","last_became_peered":"2023-10-24T00:47:03.893162+0000","last_unstale":"2023-10-24T00:47:04.267974+0000","last_undegraded":"2023-10-24T00:47:04.267974+0000","last_fullsized":"2023-10-24T00:47:04.267974+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.271613+0000","last_change":"2023-10-24T00:47:04.267986+0000","last_active":"2023-10-24T00:47:04.271613+0000","last_peered":"2023-10-24T00:47:04.271613+0000","last_clean":"2023-10-24T00:47:04.271613+0000","last_became_active":"2023-10-24T00:47:04.267724+0000","last_became_peered":"2023-10-24T00:47:04.267724+0000","last_unstale":"2023-10-24T00:47:04.271613+0000","last_undegraded":"2023-10-24T00:47:04.271613+0000","last_fullsized":"2023-10-24T00:47:04.271613+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.269233+0000","last_change":"2023-10-24T00:47:03.901532+0000","last_active":"2023-10-24T00:47:04.269233+0000","last_peered":"2023-10-24T00:47:04.269233+0000","last_clean":"2023-10-24T00:47:04.269233+0000","last_became_active":"2023-10-24T00:47:03.901261+0000","last_became_peered":"2023-10-24T00:47:03.901261+0000","last_unstale":"2023-10-24T00:47:04.269233+0000","last_undegraded":"2023-10-24T00:47:04.269233+0000","last_fullsized":"2023-10-24T00:47:04.269233+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276027+0000","last_change":"2023-10-24T00:47:04.267498+0000","last_active":"2023-10-24T00:47:04.276027+0000","last_peered":"2023-10-24T00:47:04.276027+0000","last_clean":"2023-10-24T00:47:04.276027+0000","last_became_active":"2023-10-24T00:47:04.267188+0000","last_became_peered":"2023-10-24T00:47:04.267188+0000","last_unstale":"2023-10-24T00:47:04.276027+0000","last_undegraded":"2023-10-24T00:47:04.276027+0000","last_fullsized":"2023-10-24T00:47:04.276027+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255588+0000","last_change":"2023-10-24T00:47:03.895540+0000","last_active":"2023-10-24T00:47:04.255588+0000","last_peered":"2023-10-24T00:47:04.255588+0000","last_clean":"2023-10-24T00:47:04.255588+0000","last_became_active":"2023-10-24T00:47:03.894900+0000","last_became_peered":"2023-10-24T00:47:03.894900+0000","last_unstale":"2023-10-24T00:47:04.255588+0000","last_undegraded":"2023-10-24T00:47:04.255588+0000","last_fullsized":"2023-10-24T00:47:04.255588+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277402+0000","last_change":"2023-10-24T00:47:04.268868+0000","last_active":"2023-10-24T00:47:04.277402+0000","last_peered":"2023-10-24T00:47:04.277402+0000","last_clean":"2023-10-24T00:47:04.277402+0000","last_became_active":"2023-10-24T00:47:04.268617+0000","last_became_peered":"2023-10-24T00:47:04.268617+0000","last_unstale":"2023-10-24T00:47:04.277402+0000","last_undegraded":"2023-10-24T00:47:04.277402+0000","last_fullsized":"2023-10-24T00:47:04.277402+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"126'4","reported_seq":14,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.286647+0000","last_change":"2023-10-24T00:47:03.893979+0000","last_active":"2023-10-24T00:47:04.286647+0000","last_peered":"2023-10-24T00:47:04.286647+0000","last_clean":"2023-10-24T00:47:04.286647+0000","last_became_active":"2023-10-24T00:47:03.893685+0000","last_became_peered":"2023-10-24T00:47:03.893685+0000","last_unstale":"2023-10-24T00:47:04.286647+0000","last_undegraded":"2023-10-24T00:47:04.286647+0000","last_fullsized":"2023-10-24T00:47:04.286647+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.283703+0000","last_change":"2023-10-24T00:47:04.277057+0000","last_active":"2023-10-24T00:47:04.283703+0000","last_peered":"2023-10-24T00:47:04.283703+0000","last_clean":"2023-10-24T00:47:04.283703+0000","last_became_active":"2023-10-24T00:47:04.276038+0000","last_became_peered":"2023-10-24T00:47:04.276038+0000","last_unstale":"2023-10-24T00:47:04.283703+0000","last_undegraded":"2023-10-24T00:47:04.283703+0000","last_fullsized":"2023-10-24T00:47:04.283703+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.274549+0000","last_change":"2023-10-24T00:47:03.893363+0000","last_active":"2023-10-24T00:47:04.274549+0000","last_peered":"2023-10-24T00:47:04.274549+0000","last_clean":"2023-10-24T00:47:04.274549+0000","last_became_active":"2023-10-24T00:47:03.893062+0000","last_became_peered":"2023-10-24T00:47:03.893062+0000","last_unstale":"2023-10-24T00:47:04.274549+0000","last_undegraded":"2023-10-24T00:47:04.274549+0000","last_fullsized":"2023-10-24T00:47:04.274549+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280826+0000","last_change":"2023-10-24T00:47:04.276060+0000","last_active":"2023-10-24T00:47:04.280826+0000","last_peered":"2023-10-24T00:47:04.280826+0000","last_clean":"2023-10-24T00:47:04.280826+0000","last_became_active":"2023-10-24T00:47:04.275802+0000","last_became_peered":"2023-10-24T00:47:04.275802+0000","last_unstale":"2023-10-24T00:47:04.280826+0000","last_undegraded":"2023-10-24T00:47:04.280826+0000","last_fullsized":"2023-10-24T00:47:04.280826+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254019+0000","last_change":"2023-10-24T00:47:03.891927+0000","last_active":"2023-10-24T00:47:04.254019+0000","last_peered":"2023-10-24T00:47:04.254019+0000","last_clean":"2023-10-24T00:47:04.254019+0000","last_became_active":"2023-10-24T00:47:03.891627+0000","last_became_peered":"2023-10-24T00:47:03.891627+0000","last_unstale":"2023-10-24T00:47:04.254019+0000","last_undegraded":"2023-10-24T00:47:04.254019+0000","last_fullsized":"2023-10-24T00:47:04.254019+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281527+0000","last_change":"2023-10-24T00:47:04.277702+0000","last_active":"2023-10-24T00:47:04.281527+0000","last_peered":"2023-10-24T00:47:04.281527+0000","last_clean":"2023-10-24T00:47:04.281527+0000","last_became_active":"2023-10-24T00:47:04.277362+0000","last_became_peered":"2023-10-24T00:47:04.277362+0000","last_unstale":"2023-10-24T00:47:04.281527+0000","last_undegraded":"2023-10-24T00:47:04.281527+0000","last_fullsized":"2023-10-24T00:47:04.281527+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.260967+0000","last_change":"2023-10-24T00:47:03.892740+0000","last_active":"2023-10-24T00:47:04.260967+0000","last_peered":"2023-10-24T00:47:04.260967+0000","last_clean":"2023-10-24T00:47:04.260967+0000","last_became_active":"2023-10-24T00:47:03.892085+0000","last_became_peered":"2023-10-24T00:47:03.892085+0000","last_unstale":"2023-10-24T00:47:04.260967+0000","last_undegraded":"2023-10-24T00:47:04.260967+0000","last_fullsized":"2023-10-24T00:47:04.260967+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280636+0000","last_change":"2023-10-24T00:47:04.274054+0000","last_active":"2023-10-24T00:47:04.280636+0000","last_peered":"2023-10-24T00:47:04.280636+0000","last_clean":"2023-10-24T00:47:04.280636+0000","last_became_active":"2023-10-24T00:47:04.273793+0000","last_became_peered":"2023-10-24T00:47:04.273793+0000","last_unstale":"2023-10-24T00:47:04.280636+0000","last_undegraded":"2023-10-24T00:47:04.280636+0000","last_fullsized":"2023-10-24T00:47:04.280636+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"126'4","reported_seq":14,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.270556+0000","last_change":"2023-10-24T00:47:03.895275+0000","last_active":"2023-10-24T00:47:04.270556+0000","last_peered":"2023-10-24T00:47:04.270556+0000","last_clean":"2023-10-24T00:47:04.270556+0000","last_became_active":"2023-10-24T00:47:03.894659+0000","last_became_peered":"2023-10-24T00:47:03.894659+0000","last_unstale":"2023-10-24T00:47:04.270556+0000","last_undegraded":"2023-10-24T00:47:04.270556+0000","last_fullsized":"2023-10-24T00:47:04.270556+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279198+0000","last_change":"2023-10-24T00:47:04.272253+0000","last_active":"2023-10-24T00:47:04.279198+0000","last_peered":"2023-10-24T00:47:04.279198+0000","last_clean":"2023-10-24T00:47:04.279198+0000","last_became_active":"2023-10-24T00:47:04.271978+0000","last_became_peered":"2023-10-24T00:47:04.271978+0000","last_unstale":"2023-10-24T00:47:04.279198+0000","last_undegraded":"2023-10-24T00:47:04.279198+0000","last_fullsized":"2023-10-24T00:47:04.279198+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.264026+0000","last_change":"2023-10-24T00:47:03.898553+0000","last_active":"2023-10-24T00:47:04.264026+0000","last_peered":"2023-10-24T00:47:04.264026+0000","last_clean":"2023-10-24T00:47:04.264026+0000","last_became_active":"2023-10-24T00:47:03.897511+0000","last_became_peered":"2023-10-24T00:47:03.897511+0000","last_unstale":"2023-10-24T00:47:04.264026+0000","last_undegraded":"2023-10-24T00:47:04.264026+0000","last_fullsized":"2023-10-24T00:47:04.264026+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277848+0000","last_change":"2023-10-24T00:47:04.267948+0000","last_active":"2023-10-24T00:47:04.277848+0000","last_peered":"2023-10-24T00:47:04.277848+0000","last_clean":"2023-10-24T00:47:04.277848+0000","last_became_active":"2023-10-24T00:47:04.267684+0000","last_became_peered":"2023-10-24T00:47:04.267684+0000","last_unstale":"2023-10-24T00:47:04.277848+0000","last_undegraded":"2023-10-24T00:47:04.277848+0000","last_fullsized":"2023-10-24T00:47:04.277848+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.260192+0000","last_change":"2023-10-24T00:47:03.897111+0000","last_active":"2023-10-24T00:47:04.260192+0000","last_peered":"2023-10-24T00:47:04.260192+0000","last_clean":"2023-10-24T00:47:04.260192+0000","last_became_active":"2023-10-24T00:47:03.896856+0000","last_became_peered":"2023-10-24T00:47:03.896856+0000","last_unstale":"2023-10-24T00:47:04.260192+0000","last_undegraded":"2023-10-24T00:47:04.260192+0000","last_fullsized":"2023-10-24T00:47:04.260192+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267032+0000","last_change":"2023-10-24T00:47:04.265409+0000","last_active":"2023-10-24T00:47:04.267032+0000","last_peered":"2023-10-24T00:47:04.267032+0000","last_clean":"2023-10-24T00:47:04.267032+0000","last_became_active":"2023-10-24T00:47:04.265031+0000","last_became_peered":"2023-10-24T00:47:04.265031+0000","last_unstale":"2023-10-24T00:47:04.267032+0000","last_undegraded":"2023-10-24T00:47:04.267032+0000","last_fullsized":"2023-10-24T00:47:04.267032+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.270348+0000","last_change":"2023-10-24T00:47:03.892915+0000","last_active":"2023-10-24T00:47:04.270348+0000","last_peered":"2023-10-24T00:47:04.270348+0000","last_clean":"2023-10-24T00:47:04.270348+0000","last_became_active":"2023-10-24T00:47:03.892331+0000","last_became_peered":"2023-10-24T00:47:03.892331+0000","last_unstale":"2023-10-24T00:47:04.270348+0000","last_undegraded":"2023-10-24T00:47:04.270348+0000","last_fullsized":"2023-10-24T00:47:04.270348+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.275046+0000","last_change":"2023-10-24T00:47:04.270878+0000","last_active":"2023-10-24T00:47:04.275046+0000","last_peered":"2023-10-24T00:47:04.275046+0000","last_clean":"2023-10-24T00:47:04.275046+0000","last_became_active":"2023-10-24T00:47:04.270584+0000","last_became_peered":"2023-10-24T00:47:04.270584+0000","last_unstale":"2023-10-24T00:47:04.275046+0000","last_undegraded":"2023-10-24T00:47:04.275046+0000","last_fullsized":"2023-10-24T00:47:04.275046+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.265378+0000","last_change":"2023-10-24T00:47:03.894973+0000","last_active":"2023-10-24T00:47:04.265378+0000","last_peered":"2023-10-24T00:47:04.265378+0000","last_clean":"2023-10-24T00:47:04.265378+0000","last_became_active":"2023-10-24T00:47:03.894684+0000","last_became_peered":"2023-10-24T00:47:03.894684+0000","last_unstale":"2023-10-24T00:47:04.265378+0000","last_undegraded":"2023-10-24T00:47:04.265378+0000","last_fullsized":"2023-10-24T00:47:04.265378+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.283674+0000","last_change":"2023-10-24T00:47:04.276802+0000","last_active":"2023-10-24T00:47:04.283674+0000","last_peered":"2023-10-24T00:47:04.283674+0000","last_clean":"2023-10-24T00:47:04.283674+0000","last_became_active":"2023-10-24T00:47:04.276482+0000","last_became_peered":"2023-10-24T00:47:04.276482+0000","last_unstale":"2023-10-24T00:47:04.283674+0000","last_undegraded":"2023-10-24T00:47:04.283674+0000","last_fullsized":"2023-10-24T00:47:04.283674+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.268979+0000","last_change":"2023-10-24T00:47:03.898629+0000","last_active":"2023-10-24T00:47:04.268979+0000","last_peered":"2023-10-24T00:47:04.268979+0000","last_clean":"2023-10-24T00:47:04.268979+0000","last_became_active":"2023-10-24T00:47:03.898366+0000","last_became_peered":"2023-10-24T00:47:03.898366+0000","last_unstale":"2023-10-24T00:47:04.268979+0000","last_undegraded":"2023-10-24T00:47:04.268979+0000","last_fullsized":"2023-10-24T00:47:04.268979+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281678+0000","last_change":"2023-10-24T00:47:04.276089+0000","last_active":"2023-10-24T00:47:04.281678+0000","last_peered":"2023-10-24T00:47:04.281678+0000","last_clean":"2023-10-24T00:47:04.281678+0000","last_became_active":"2023-10-24T00:47:04.275342+0000","last_became_peered":"2023-10-24T00:47:04.275342+0000","last_unstale":"2023-10-24T00:47:04.281678+0000","last_undegraded":"2023-10-24T00:47:04.281678+0000","last_fullsized":"2023-10-24T00:47:04.281678+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.262911+0000","last_change":"2023-10-24T00:47:03.897896+0000","last_active":"2023-10-24T00:47:04.262911+0000","last_peered":"2023-10-24T00:47:04.262911+0000","last_clean":"2023-10-24T00:47:04.262911+0000","last_became_active":"2023-10-24T00:47:03.897564+0000","last_became_peered":"2023-10-24T00:47:03.897564+0000","last_unstale":"2023-10-24T00:47:04.262911+0000","last_undegraded":"2023-10-24T00:47:04.262911+0000","last_fullsized":"2023-10-24T00:47:04.262911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279511+0000","last_change":"2023-10-24T00:47:04.275423+0000","last_active":"2023-10-24T00:47:04.279511+0000","last_peered":"2023-10-24T00:47:04.279511+0000","last_clean":"2023-10-24T00:47:04.279511+0000","last_became_active":"2023-10-24T00:47:04.275164+0000","last_became_peered":"2023-10-24T00:47:04.275164+0000","last_unstale":"2023-10-24T00:47:04.279511+0000","last_undegraded":"2023-10-24T00:47:04.279511+0000","last_fullsized":"2023-10-24T00:47:04.279511+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.262117+0000","last_change":"2023-10-24T00:47:03.898214+0000","last_active":"2023-10-24T00:47:04.262117+0000","last_peered":"2023-10-24T00:47:04.262117+0000","last_clean":"2023-10-24T00:47:04.262117+0000","last_became_active":"2023-10-24T00:47:03.897946+0000","last_became_peered":"2023-10-24T00:47:03.897946+0000","last_unstale":"2023-10-24T00:47:04.262117+0000","last_undegraded":"2023-10-24T00:47:04.262117+0000","last_fullsized":"2023-10-24T00:47:04.262117+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279973+0000","last_change":"2023-10-24T00:47:04.275597+0000","last_active":"2023-10-24T00:47:04.279973+0000","last_peered":"2023-10-24T00:47:04.279973+0000","last_clean":"2023-10-24T00:47:04.279973+0000","last_became_active":"2023-10-24T00:47:04.275302+0000","last_became_peered":"2023-10-24T00:47:04.275302+0000","last_unstale":"2023-10-24T00:47:04.279973+0000","last_undegraded":"2023-10-24T00:47:04.279973+0000","last_fullsized":"2023-10-24T00:47:04.279973+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254861+0000","last_change":"2023-10-24T00:47:03.892022+0000","last_active":"2023-10-24T00:47:04.254861+0000","last_peered":"2023-10-24T00:47:04.254861+0000","last_clean":"2023-10-24T00:47:04.254861+0000","last_became_active":"2023-10-24T00:47:03.891742+0000","last_became_peered":"2023-10-24T00:47:03.891742+0000","last_unstale":"2023-10-24T00:47:04.254861+0000","last_undegraded":"2023-10-24T00:47:04.254861+0000","last_fullsized":"2023-10-24T00:47:04.254861+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.274919+0000","last_change":"2023-10-24T00:47:04.266638+0000","last_active":"2023-10-24T00:47:04.274919+0000","last_peered":"2023-10-24T00:47:04.274919+0000","last_clean":"2023-10-24T00:47:04.274919+0000","last_became_active":"2023-10-24T00:47:04.265239+0000","last_became_peered":"2023-10-24T00:47:04.265239+0000","last_unstale":"2023-10-24T00:47:04.274919+0000","last_undegraded":"2023-10-24T00:47:04.274919+0000","last_fullsized":"2023-10-24T00:47:04.274919+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258051+0000","last_change":"2023-10-24T00:47:03.901458+0000","last_active":"2023-10-24T00:47:04.258051+0000","last_peered":"2023-10-24T00:47:04.258051+0000","last_clean":"2023-10-24T00:47:04.258051+0000","last_became_active":"2023-10-24T00:47:03.900872+0000","last_became_peered":"2023-10-24T00:47:03.900872+0000","last_unstale":"2023-10-24T00:47:04.258051+0000","last_undegraded":"2023-10-24T00:47:04.258051+0000","last_fullsized":"2023-10-24T00:47:04.258051+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281512+0000","last_change":"2023-10-24T00:47:04.277736+0000","last_active":"2023-10-24T00:47:04.281512+0000","last_peered":"2023-10-24T00:47:04.281512+0000","last_clean":"2023-10-24T00:47:04.281512+0000","last_became_active":"2023-10-24T00:47:04.277398+0000","last_became_peered":"2023-10-24T00:47:04.277398+0000","last_unstale":"2023-10-24T00:47:04.281512+0000","last_undegraded":"2023-10-24T00:47:04.281512+0000","last_fullsized":"2023-10-24T00:47:04.281512+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263187+0000","last_change":"2023-10-24T00:47:03.900054+0000","last_active":"2023-10-24T00:47:04.263187+0000","last_peered":"2023-10-24T00:47:04.263187+0000","last_clean":"2023-10-24T00:47:04.263187+0000","last_became_active":"2023-10-24T00:47:03.899798+0000","last_became_peered":"2023-10-24T00:47:03.899798+0000","last_unstale":"2023-10-24T00:47:04.263187+0000","last_undegraded":"2023-10-24T00:47:04.263187+0000","last_fullsized":"2023-10-24T00:47:04.263187+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.283839+0000","last_change":"2023-10-24T00:47:04.278418+0000","last_active":"2023-10-24T00:47:04.283839+0000","last_peered":"2023-10-24T00:47:04.283839+0000","last_clean":"2023-10-24T00:47:04.283839+0000","last_became_active":"2023-10-24T00:47:04.278057+0000","last_became_peered":"2023-10-24T00:47:04.278057+0000","last_unstale":"2023-10-24T00:47:04.283839+0000","last_undegraded":"2023-10-24T00:47:04.283839+0000","last_fullsized":"2023-10-24T00:47:04.283839+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255310+0000","last_change":"2023-10-24T00:47:03.892093+0000","last_active":"2023-10-24T00:47:04.255310+0000","last_peered":"2023-10-24T00:47:04.255310+0000","last_clean":"2023-10-24T00:47:04.255310+0000","last_became_active":"2023-10-24T00:47:03.891813+0000","last_became_peered":"2023-10-24T00:47:03.891813+0000","last_unstale":"2023-10-24T00:47:04.255310+0000","last_undegraded":"2023-10-24T00:47:04.255310+0000","last_fullsized":"2023-10-24T00:47:04.255310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276451+0000","last_change":"2023-10-24T00:47:04.269490+0000","last_active":"2023-10-24T00:47:04.276451+0000","last_peered":"2023-10-24T00:47:04.276451+0000","last_clean":"2023-10-24T00:47:04.276451+0000","last_became_active":"2023-10-24T00:47:04.269132+0000","last_became_peered":"2023-10-24T00:47:04.269132+0000","last_unstale":"2023-10-24T00:47:04.276451+0000","last_undegraded":"2023-10-24T00:47:04.276451+0000","last_fullsized":"2023-10-24T00:47:04.276451+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258188+0000","last_change":"2023-10-24T00:47:03.902545+0000","last_active":"2023-10-24T00:47:04.258188+0000","last_peered":"2023-10-24T00:47:04.258188+0000","last_clean":"2023-10-24T00:47:04.258188+0000","last_became_active":"2023-10-24T00:47:03.902301+0000","last_became_peered":"2023-10-24T00:47:03.902301+0000","last_unstale":"2023-10-24T00:47:04.258188+0000","last_undegraded":"2023-10-24T00:47:04.258188+0000","last_fullsized":"2023-10-24T00:47:04.258188+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.282603+0000","last_change":"2023-10-24T00:47:04.278775+0000","last_active":"2023-10-24T00:47:04.282603+0000","last_peered":"2023-10-24T00:47:04.282603+0000","last_clean":"2023-10-24T00:47:04.282603+0000","last_became_active":"2023-10-24T00:47:04.278502+0000","last_became_peered":"2023-10-24T00:47:04.278502+0000","last_unstale":"2023-10-24T00:47:04.282603+0000","last_undegraded":"2023-10-24T00:47:04.282603+0000","last_fullsized":"2023-10-24T00:47:04.282603+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263030+0000","last_change":"2023-10-24T00:47:03.902017+0000","last_active":"2023-10-24T00:47:04.263030+0000","last_peered":"2023-10-24T00:47:04.263030+0000","last_clean":"2023-10-24T00:47:04.263030+0000","last_became_active":"2023-10-24T00:47:03.901774+0000","last_became_peered":"2023-10-24T00:47:03.901774+0000","last_unstale":"2023-10-24T00:47:04.263030+0000","last_undegraded":"2023-10-24T00:47:04.263030+0000","last_fullsized":"2023-10-24T00:47:04.263030+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.273228+0000","last_change":"2023-10-24T00:47:04.268640+0000","last_active":"2023-10-24T00:47:04.273228+0000","last_peered":"2023-10-24T00:47:04.273228+0000","last_clean":"2023-10-24T00:47:04.273228+0000","last_became_active":"2023-10-24T00:47:04.268374+0000","last_became_peered":"2023-10-24T00:47:04.268374+0000","last_unstale":"2023-10-24T00:47:04.273228+0000","last_undegraded":"2023-10-24T00:47:04.273228+0000","last_fullsized":"2023-10-24T00:47:04.273228+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.253575+0000","last_change":"2023-10-24T00:47:03.894764+0000","last_active":"2023-10-24T00:47:04.253575+0000","last_peered":"2023-10-24T00:47:04.253575+0000","last_clean":"2023-10-24T00:47:04.253575+0000","last_became_active":"2023-10-24T00:47:03.894489+0000","last_became_peered":"2023-10-24T00:47:03.894489+0000","last_unstale":"2023-10-24T00:47:04.253575+0000","last_undegraded":"2023-10-24T00:47:04.253575+0000","last_fullsized":"2023-10-24T00:47:04.253575+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.283879+0000","last_change":"2023-10-24T00:47:04.280343+0000","last_active":"2023-10-24T00:47:04.283879+0000","last_peered":"2023-10-24T00:47:04.283879+0000","last_clean":"2023-10-24T00:47:04.283879+0000","last_became_active":"2023-10-24T00:47:04.279870+0000","last_became_peered":"2023-10-24T00:47:04.279870+0000","last_unstale":"2023-10-24T00:47:04.283879+0000","last_undegraded":"2023-10-24T00:47:04.283879+0000","last_fullsized":"2023-10-24T00:47:04.283879+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.261102+0000","last_change":"2023-10-24T00:47:03.898431+0000","last_active":"2023-10-24T00:47:04.261102+0000","last_peered":"2023-10-24T00:47:04.261102+0000","last_clean":"2023-10-24T00:47:04.261102+0000","last_became_active":"2023-10-24T00:47:03.898140+0000","last_became_peered":"2023-10-24T00:47:03.898140+0000","last_unstale":"2023-10-24T00:47:04.261102+0000","last_undegraded":"2023-10-24T00:47:04.261102+0000","last_fullsized":"2023-10-24T00:47:04.261102+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279811+0000","last_change":"2023-10-24T00:47:04.273297+0000","last_active":"2023-10-24T00:47:04.279811+0000","last_peered":"2023-10-24T00:47:04.279811+0000","last_clean":"2023-10-24T00:47:04.279811+0000","last_became_active":"2023-10-24T00:47:04.273084+0000","last_became_peered":"2023-10-24T00:47:04.273084+0000","last_unstale":"2023-10-24T00:47:04.279811+0000","last_undegraded":"2023-10-24T00:47:04.279811+0000","last_fullsized":"2023-10-24T00:47:04.279811+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258436+0000","last_change":"2023-10-24T00:47:03.894308+0000","last_active":"2023-10-24T00:47:04.258436+0000","last_peered":"2023-10-24T00:47:04.258436+0000","last_clean":"2023-10-24T00:47:04.258436+0000","last_became_active":"2023-10-24T00:47:03.894044+0000","last_became_peered":"2023-10-24T00:47:03.894044+0000","last_unstale":"2023-10-24T00:47:04.258436+0000","last_undegraded":"2023-10-24T00:47:04.258436+0000","last_fullsized":"2023-10-24T00:47:04.258436+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280809+0000","last_change":"2023-10-24T00:47:04.276165+0000","last_active":"2023-10-24T00:47:04.280809+0000","last_peered":"2023-10-24T00:47:04.280809+0000","last_clean":"2023-10-24T00:47:04.280809+0000","last_became_active":"2023-10-24T00:47:04.275822+0000","last_became_peered":"2023-10-24T00:47:04.275822+0000","last_unstale":"2023-10-24T00:47:04.280809+0000","last_undegraded":"2023-10-24T00:47:04.280809+0000","last_fullsized":"2023-10-24T00:47:04.280809+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276671+0000","last_change":"2023-10-24T00:47:03.898696+0000","last_active":"2023-10-24T00:47:04.276671+0000","last_peered":"2023-10-24T00:47:04.276671+0000","last_clean":"2023-10-24T00:47:04.276671+0000","last_became_active":"2023-10-24T00:47:03.898294+0000","last_became_peered":"2023-10-24T00:47:03.898294+0000","last_unstale":"2023-10-24T00:47:04.276671+0000","last_undegraded":"2023-10-24T00:47:04.276671+0000","last_fullsized":"2023-10-24T00:47:04.276671+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277549+0000","last_change":"2023-10-24T00:47:04.267571+0000","last_active":"2023-10-24T00:47:04.277549+0000","last_peered":"2023-10-24T00:47:04.277549+0000","last_clean":"2023-10-24T00:47:04.277549+0000","last_became_active":"2023-10-24T00:47:04.267284+0000","last_became_peered":"2023-10-24T00:47:04.267284+0000","last_unstale":"2023-10-24T00:47:04.277549+0000","last_undegraded":"2023-10-24T00:47:04.277549+0000","last_fullsized":"2023-10-24T00:47:04.277549+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267641+0000","last_change":"2023-10-24T00:47:03.890785+0000","last_active":"2023-10-24T00:47:04.267641+0000","last_peered":"2023-10-24T00:47:04.267641+0000","last_clean":"2023-10-24T00:47:04.267641+0000","last_became_active":"2023-10-24T00:47:03.890491+0000","last_became_peered":"2023-10-24T00:47:03.890491+0000","last_unstale":"2023-10-24T00:47:04.267641+0000","last_undegraded":"2023-10-24T00:47:04.267641+0000","last_fullsized":"2023-10-24T00:47:04.267641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279207+0000","last_change":"2023-10-24T00:47:04.269403+0000","last_active":"2023-10-24T00:47:04.279207+0000","last_peered":"2023-10-24T00:47:04.279207+0000","last_clean":"2023-10-24T00:47:04.279207+0000","last_became_active":"2023-10-24T00:47:04.269135+0000","last_became_peered":"2023-10-24T00:47:04.269135+0000","last_unstale":"2023-10-24T00:47:04.279207+0000","last_undegraded":"2023-10-24T00:47:04.279207+0000","last_fullsized":"2023-10-24T00:47:04.279207+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"126'2","reported_seq":12,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276522+0000","last_change":"2023-10-24T00:47:03.898349+0000","last_active":"2023-10-24T00:47:04.276522+0000","last_peered":"2023-10-24T00:47:04.276522+0000","last_clean":"2023-10-24T00:47:04.276522+0000","last_became_active":"2023-10-24T00:47:03.897433+0000","last_became_peered":"2023-10-24T00:47:03.897433+0000","last_unstale":"2023-10-24T00:47:04.276522+0000","last_undegraded":"2023-10-24T00:47:04.276522+0000","last_fullsized":"2023-10-24T00:47:04.276522+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281075+0000","last_change":"2023-10-24T00:47:04.272163+0000","last_active":"2023-10-24T00:47:04.281075+0000","last_peered":"2023-10-24T00:47:04.281075+0000","last_clean":"2023-10-24T00:47:04.281075+0000","last_became_active":"2023-10-24T00:47:04.271887+0000","last_became_peered":"2023-10-24T00:47:04.271887+0000","last_unstale":"2023-10-24T00:47:04.281075+0000","last_undegraded":"2023-10-24T00:47:04.281075+0000","last_fullsized":"2023-10-24T00:47:04.281075+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.257989+0000","last_change":"2023-10-24T00:47:03.890459+0000","last_active":"2023-10-24T00:47:04.257989+0000","last_peered":"2023-10-24T00:47:04.257989+0000","last_clean":"2023-10-24T00:47:04.257989+0000","last_became_active":"2023-10-24T00:47:03.890167+0000","last_became_peered":"2023-10-24T00:47:03.890167+0000","last_unstale":"2023-10-24T00:47:04.257989+0000","last_undegraded":"2023-10-24T00:47:04.257989+0000","last_fullsized":"2023-10-24T00:47:04.257989+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.275830+0000","last_change":"2023-10-24T00:47:04.272332+0000","last_active":"2023-10-24T00:47:04.275830+0000","last_peered":"2023-10-24T00:47:04.275830+0000","last_clean":"2023-10-24T00:47:04.275830+0000","last_became_active":"2023-10-24T00:47:04.272050+0000","last_became_peered":"2023-10-24T00:47:04.272050+0000","last_unstale":"2023-10-24T00:47:04.275830+0000","last_undegraded":"2023-10-24T00:47:04.275830+0000","last_fullsized":"2023-10-24T00:47:04.275830+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255101+0000","last_change":"2023-10-24T00:47:03.897987+0000","last_active":"2023-10-24T00:47:04.255101+0000","last_peered":"2023-10-24T00:47:04.255101+0000","last_clean":"2023-10-24T00:47:04.255101+0000","last_became_active":"2023-10-24T00:47:03.897701+0000","last_became_peered":"2023-10-24T00:47:03.897701+0000","last_unstale":"2023-10-24T00:47:04.255101+0000","last_undegraded":"2023-10-24T00:47:04.255101+0000","last_fullsized":"2023-10-24T00:47:04.255101+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280845+0000","last_change":"2023-10-24T00:47:04.276363+0000","last_active":"2023-10-24T00:47:04.280845+0000","last_peered":"2023-10-24T00:47:04.280845+0000","last_clean":"2023-10-24T00:47:04.280845+0000","last_became_active":"2023-10-24T00:47:04.275562+0000","last_became_peered":"2023-10-24T00:47:04.275562+0000","last_unstale":"2023-10-24T00:47:04.280845+0000","last_undegraded":"2023-10-24T00:47:04.280845+0000","last_fullsized":"2023-10-24T00:47:04.280845+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.266790+0000","last_change":"2023-10-24T00:47:03.898459+0000","last_active":"2023-10-24T00:47:04.266790+0000","last_peered":"2023-10-24T00:47:04.266790+0000","last_clean":"2023-10-24T00:47:04.266790+0000","last_became_active":"2023-10-24T00:47:03.898189+0000","last_became_peered":"2023-10-24T00:47:03.898189+0000","last_unstale":"2023-10-24T00:47:04.266790+0000","last_undegraded":"2023-10-24T00:47:04.266790+0000","last_fullsized":"2023-10-24T00:47:04.266790+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280466+0000","last_change":"2023-10-24T00:47:04.275289+0000","last_active":"2023-10-24T00:47:04.280466+0000","last_peered":"2023-10-24T00:47:04.280466+0000","last_clean":"2023-10-24T00:47:04.280466+0000","last_became_active":"2023-10-24T00:47:04.275017+0000","last_became_peered":"2023-10-24T00:47:04.275017+0000","last_unstale":"2023-10-24T00:47:04.280466+0000","last_undegraded":"2023-10-24T00:47:04.280466+0000","last_fullsized":"2023-10-24T00:47:04.280466+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.264784+0000","last_change":"2023-10-24T00:47:03.897983+0000","last_active":"2023-10-24T00:47:04.264784+0000","last_peered":"2023-10-24T00:47:04.264784+0000","last_clean":"2023-10-24T00:47:04.264784+0000","last_became_active":"2023-10-24T00:47:03.897709+0000","last_became_peered":"2023-10-24T00:47:03.897709+0000","last_unstale":"2023-10-24T00:47:04.264784+0000","last_undegraded":"2023-10-24T00:47:04.264784+0000","last_fullsized":"2023-10-24T00:47:04.264784+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.275734+0000","last_change":"2023-10-24T00:47:04.272365+0000","last_active":"2023-10-24T00:47:04.275734+0000","last_peered":"2023-10-24T00:47:04.275734+0000","last_clean":"2023-10-24T00:47:04.275734+0000","last_became_active":"2023-10-24T00:47:04.272066+0000","last_became_peered":"2023-10-24T00:47:04.272066+0000","last_unstale":"2023-10-24T00:47:04.275734+0000","last_undegraded":"2023-10-24T00:47:04.275734+0000","last_fullsized":"2023-10-24T00:47:04.275734+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258749+0000","last_change":"2023-10-24T00:47:03.892258+0000","last_active":"2023-10-24T00:47:04.258749+0000","last_peered":"2023-10-24T00:47:04.258749+0000","last_clean":"2023-10-24T00:47:04.258749+0000","last_became_active":"2023-10-24T00:47:03.891854+0000","last_became_peered":"2023-10-24T00:47:03.891854+0000","last_unstale":"2023-10-24T00:47:04.258749+0000","last_undegraded":"2023-10-24T00:47:04.258749+0000","last_fullsized":"2023-10-24T00:47:04.258749+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280788+0000","last_change":"2023-10-24T00:47:04.276013+0000","last_active":"2023-10-24T00:47:04.280788+0000","last_peered":"2023-10-24T00:47:04.280788+0000","last_clean":"2023-10-24T00:47:04.280788+0000","last_became_active":"2023-10-24T00:47:04.275502+0000","last_became_peered":"2023-10-24T00:47:04.275502+0000","last_unstale":"2023-10-24T00:47:04.280788+0000","last_undegraded":"2023-10-24T00:47:04.280788+0000","last_fullsized":"2023-10-24T00:47:04.280788+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.268070+0000","last_change":"2023-10-24T00:47:03.898517+0000","last_active":"2023-10-24T00:47:04.268070+0000","last_peered":"2023-10-24T00:47:04.268070+0000","last_clean":"2023-10-24T00:47:04.268070+0000","last_became_active":"2023-10-24T00:47:03.898198+0000","last_became_peered":"2023-10-24T00:47:03.898198+0000","last_unstale":"2023-10-24T00:47:04.268070+0000","last_undegraded":"2023-10-24T00:47:04.268070+0000","last_fullsized":"2023-10-24T00:47:04.268070+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276774+0000","last_change":"2023-10-24T00:47:04.271090+0000","last_active":"2023-10-24T00:47:04.276774+0000","last_peered":"2023-10-24T00:47:04.276774+0000","last_clean":"2023-10-24T00:47:04.276774+0000","last_became_active":"2023-10-24T00:47:04.270822+0000","last_became_peered":"2023-10-24T00:47:04.270822+0000","last_unstale":"2023-10-24T00:47:04.276774+0000","last_undegraded":"2023-10-24T00:47:04.276774+0000","last_fullsized":"2023-10-24T00:47:04.276774+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263281+0000","last_change":"2023-10-24T00:47:03.895682+0000","last_active":"2023-10-24T00:47:04.263281+0000","last_peered":"2023-10-24T00:47:04.263281+0000","last_clean":"2023-10-24T00:47:04.263281+0000","last_became_active":"2023-10-24T00:47:03.895411+0000","last_became_peered":"2023-10-24T00:47:03.895411+0000","last_unstale":"2023-10-24T00:47:04.263281+0000","last_undegraded":"2023-10-24T00:47:04.263281+0000","last_fullsized":"2023-10-24T00:47:04.263281+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267744+0000","last_change":"2023-10-24T00:47:04.264969+0000","last_active":"2023-10-24T00:47:04.267744+0000","last_peered":"2023-10-24T00:47:04.267744+0000","last_clean":"2023-10-24T00:47:04.267744+0000","last_became_active":"2023-10-24T00:47:04.264695+0000","last_became_peered":"2023-10-24T00:47:04.264695+0000","last_unstale":"2023-10-24T00:47:04.267744+0000","last_undegraded":"2023-10-24T00:47:04.267744+0000","last_fullsized":"2023-10-24T00:47:04.267744+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"126'3","reported_seq":13,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267752+0000","last_change":"2023-10-24T00:47:03.895191+0000","last_active":"2023-10-24T00:47:04.267752+0000","last_peered":"2023-10-24T00:47:04.267752+0000","last_clean":"2023-10-24T00:47:04.267752+0000","last_became_active":"2023-10-24T00:47:03.894133+0000","last_became_peered":"2023-10-24T00:47:03.894133+0000","last_unstale":"2023-10-24T00:47:04.267752+0000","last_undegraded":"2023-10-24T00:47:04.267752+0000","last_fullsized":"2023-10-24T00:47:04.267752+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276766+0000","last_change":"2023-10-24T00:47:04.270971+0000","last_active":"2023-10-24T00:47:04.276766+0000","last_peered":"2023-10-24T00:47:04.276766+0000","last_clean":"2023-10-24T00:47:04.276766+0000","last_became_active":"2023-10-24T00:47:04.270711+0000","last_became_peered":"2023-10-24T00:47:04.270711+0000","last_unstale":"2023-10-24T00:47:04.276766+0000","last_undegraded":"2023-10-24T00:47:04.276766+0000","last_fullsized":"2023-10-24T00:47:04.276766+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"126'2","reported_seq":12,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281013+0000","last_change":"2023-10-24T00:47:03.902058+0000","last_active":"2023-10-24T00:47:04.281013+0000","last_peered":"2023-10-24T00:47:04.281013+0000","last_clean":"2023-10-24T00:47:04.281013+0000","last_became_active":"2023-10-24T00:47:03.901791+0000","last_became_peered":"2023-10-24T00:47:03.901791+0000","last_unstale":"2023-10-24T00:47:04.281013+0000","last_undegraded":"2023-10-24T00:47:04.281013+0000","last_fullsized":"2023-10-24T00:47:04.281013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.274295+0000","last_change":"2023-10-24T00:47:04.270972+0000","last_active":"2023-10-24T00:47:04.274295+0000","last_peered":"2023-10-24T00:47:04.274295+0000","last_clean":"2023-10-24T00:47:04.274295+0000","last_became_active":"2023-10-24T00:47:04.270337+0000","last_became_peered":"2023-10-24T00:47:04.270337+0000","last_unstale":"2023-10-24T00:47:04.274295+0000","last_undegraded":"2023-10-24T00:47:04.274295+0000","last_fullsized":"2023-10-24T00:47:04.274295+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.275286+0000","last_change":"2023-10-24T00:47:03.891726+0000","last_active":"2023-10-24T00:47:04.275286+0000","last_peered":"2023-10-24T00:47:04.275286+0000","last_clean":"2023-10-24T00:47:04.275286+0000","last_became_active":"2023-10-24T00:47:03.891481+0000","last_became_peered":"2023-10-24T00:47:03.891481+0000","last_unstale":"2023-10-24T00:47:04.275286+0000","last_undegraded":"2023-10-24T00:47:04.275286+0000","last_fullsized":"2023-10-24T00:47:04.275286+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279987+0000","last_change":"2023-10-24T00:47:04.275916+0000","last_active":"2023-10-24T00:47:04.279987+0000","last_peered":"2023-10-24T00:47:04.279987+0000","last_clean":"2023-10-24T00:47:04.279987+0000","last_became_active":"2023-10-24T00:47:04.275210+0000","last_became_peered":"2023-10-24T00:47:04.275210+0000","last_unstale":"2023-10-24T00:47:04.279987+0000","last_undegraded":"2023-10-24T00:47:04.279987+0000","last_fullsized":"2023-10-24T00:47:04.279987+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.262730+0000","last_change":"2023-10-24T00:47:03.890056+0000","last_active":"2023-10-24T00:47:04.262730+0000","last_peered":"2023-10-24T00:47:04.262730+0000","last_clean":"2023-10-24T00:47:04.262730+0000","last_became_active":"2023-10-24T00:47:03.889795+0000","last_became_peered":"2023-10-24T00:47:03.889795+0000","last_unstale":"2023-10-24T00:47:04.262730+0000","last_undegraded":"2023-10-24T00:47:04.262730+0000","last_fullsized":"2023-10-24T00:47:04.262730+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279932+0000","last_change":"2023-10-24T00:47:04.274317+0000","last_active":"2023-10-24T00:47:04.279932+0000","last_peered":"2023-10-24T00:47:04.279932+0000","last_clean":"2023-10-24T00:47:04.279932+0000","last_became_active":"2023-10-24T00:47:04.274045+0000","last_became_peered":"2023-10-24T00:47:04.274045+0000","last_unstale":"2023-10-24T00:47:04.279932+0000","last_undegraded":"2023-10-24T00:47:04.279932+0000","last_fullsized":"2023-10-24T00:47:04.279932+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.253511+0000","last_change":"2023-10-24T00:47:03.887381+0000","last_active":"2023-10-24T00:47:04.253511+0000","last_peered":"2023-10-24T00:47:04.253511+0000","last_clean":"2023-10-24T00:47:04.253511+0000","last_became_active":"2023-10-24T00:47:03.886979+0000","last_became_peered":"2023-10-24T00:47:03.886979+0000","last_unstale":"2023-10-24T00:47:04.253511+0000","last_undegraded":"2023-10-24T00:47:04.253511+0000","last_fullsized":"2023-10-24T00:47:04.253511+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280653+0000","last_change":"2023-10-24T00:47:04.274057+0000","last_active":"2023-10-24T00:47:04.280653+0000","last_peered":"2023-10-24T00:47:04.280653+0000","last_clean":"2023-10-24T00:47:04.280653+0000","last_became_active":"2023-10-24T00:47:04.273818+0000","last_became_peered":"2023-10-24T00:47:04.273818+0000","last_unstale":"2023-10-24T00:47:04.280653+0000","last_undegraded":"2023-10-24T00:47:04.280653+0000","last_fullsized":"2023-10-24T00:47:04.280653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"126'4","reported_seq":14,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.276532+0000","last_change":"2023-10-24T00:47:03.892803+0000","last_active":"2023-10-24T00:47:04.276532+0000","last_peered":"2023-10-24T00:47:04.276532+0000","last_clean":"2023-10-24T00:47:04.276532+0000","last_became_active":"2023-10-24T00:47:03.892504+0000","last_became_peered":"2023-10-24T00:47:03.892504+0000","last_unstale":"2023-10-24T00:47:04.276532+0000","last_undegraded":"2023-10-24T00:47:04.276532+0000","last_fullsized":"2023-10-24T00:47:04.276532+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279760+0000","last_change":"2023-10-24T00:47:04.273078+0000","last_active":"2023-10-24T00:47:04.279760+0000","last_peered":"2023-10-24T00:47:04.279760+0000","last_clean":"2023-10-24T00:47:04.279760+0000","last_became_active":"2023-10-24T00:47:04.272790+0000","last_became_peered":"2023-10-24T00:47:04.272790+0000","last_unstale":"2023-10-24T00:47:04.279760+0000","last_undegraded":"2023-10-24T00:47:04.279760+0000","last_fullsized":"2023-10-24T00:47:04.279760+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"126'2","reported_seq":12,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.274915+0000","last_change":"2023-10-24T00:47:03.892087+0000","last_active":"2023-10-24T00:47:04.274915+0000","last_peered":"2023-10-24T00:47:04.274915+0000","last_clean":"2023-10-24T00:47:04.274915+0000","last_became_active":"2023-10-24T00:47:03.891906+0000","last_became_peered":"2023-10-24T00:47:03.891906+0000","last_unstale":"2023-10-24T00:47:04.274915+0000","last_undegraded":"2023-10-24T00:47:04.274915+0000","last_fullsized":"2023-10-24T00:47:04.274915+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279365+0000","last_change":"2023-10-24T00:47:04.273254+0000","last_active":"2023-10-24T00:47:04.279365+0000","last_peered":"2023-10-24T00:47:04.279365+0000","last_clean":"2023-10-24T00:47:04.279365+0000","last_became_active":"2023-10-24T00:47:04.272841+0000","last_became_peered":"2023-10-24T00:47:04.272841+0000","last_unstale":"2023-10-24T00:47:04.279365+0000","last_undegraded":"2023-10-24T00:47:04.279365+0000","last_fullsized":"2023-10-24T00:47:04.279365+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.263372+0000","last_change":"2023-10-24T00:47:03.900916+0000","last_active":"2023-10-24T00:47:04.263372+0000","last_peered":"2023-10-24T00:47:04.263372+0000","last_clean":"2023-10-24T00:47:04.263372+0000","last_became_active":"2023-10-24T00:47:03.899212+0000","last_became_peered":"2023-10-24T00:47:03.899212+0000","last_unstale":"2023-10-24T00:47:04.263372+0000","last_undegraded":"2023-10-24T00:47:04.263372+0000","last_fullsized":"2023-10-24T00:47:04.263372+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.282855+0000","last_change":"2023-10-24T00:47:04.280441+0000","last_active":"2023-10-24T00:47:04.282855+0000","last_peered":"2023-10-24T00:47:04.282855+0000","last_clean":"2023-10-24T00:47:04.282855+0000","last_became_active":"2023-10-24T00:47:04.280186+0000","last_became_peered":"2023-10-24T00:47:04.280186+0000","last_unstale":"2023-10-24T00:47:04.282855+0000","last_undegraded":"2023-10-24T00:47:04.282855+0000","last_fullsized":"2023-10-24T00:47:04.282855+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258885+0000","last_change":"2023-10-24T00:47:03.899197+0000","last_active":"2023-10-24T00:47:04.258885+0000","last_peered":"2023-10-24T00:47:04.258885+0000","last_clean":"2023-10-24T00:47:04.258885+0000","last_became_active":"2023-10-24T00:47:03.898928+0000","last_became_peered":"2023-10-24T00:47:03.898928+0000","last_unstale":"2023-10-24T00:47:04.258885+0000","last_undegraded":"2023-10-24T00:47:04.258885+0000","last_fullsized":"2023-10-24T00:47:04.258885+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281785+0000","last_change":"2023-10-24T00:47:04.279297+0000","last_active":"2023-10-24T00:47:04.281785+0000","last_peered":"2023-10-24T00:47:04.281785+0000","last_clean":"2023-10-24T00:47:04.281785+0000","last_became_active":"2023-10-24T00:47:04.278935+0000","last_became_peered":"2023-10-24T00:47:04.278935+0000","last_unstale":"2023-10-24T00:47:04.281785+0000","last_undegraded":"2023-10-24T00:47:04.281785+0000","last_fullsized":"2023-10-24T00:47:04.281785+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258088+0000","last_change":"2023-10-24T00:47:03.899239+0000","last_active":"2023-10-24T00:47:04.258088+0000","last_peered":"2023-10-24T00:47:04.258088+0000","last_clean":"2023-10-24T00:47:04.258088+0000","last_became_active":"2023-10-24T00:47:03.898808+0000","last_became_peered":"2023-10-24T00:47:03.898808+0000","last_unstale":"2023-10-24T00:47:04.258088+0000","last_undegraded":"2023-10-24T00:47:04.258088+0000","last_fullsized":"2023-10-24T00:47:04.258088+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.267807+0000","last_change":"2023-10-24T00:47:04.265663+0000","last_active":"2023-10-24T00:47:04.267807+0000","last_peered":"2023-10-24T00:47:04.267807+0000","last_clean":"2023-10-24T00:47:04.267807+0000","last_became_active":"2023-10-24T00:47:04.265317+0000","last_became_peered":"2023-10-24T00:47:04.265317+0000","last_unstale":"2023-10-24T00:47:04.267807+0000","last_undegraded":"2023-10-24T00:47:04.267807+0000","last_fullsized":"2023-10-24T00:47:04.267807+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.265202+0000","last_change":"2023-10-24T00:47:03.899811+0000","last_active":"2023-10-24T00:47:04.265202+0000","last_peered":"2023-10-24T00:47:04.265202+0000","last_clean":"2023-10-24T00:47:04.265202+0000","last_became_active":"2023-10-24T00:47:03.899509+0000","last_became_peered":"2023-10-24T00:47:03.899509+0000","last_unstale":"2023-10-24T00:47:04.265202+0000","last_undegraded":"2023-10-24T00:47:04.265202+0000","last_fullsized":"2023-10-24T00:47:04.265202+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277372+0000","last_change":"2023-10-24T00:47:04.270195+0000","last_active":"2023-10-24T00:47:04.277372+0000","last_peered":"2023-10-24T00:47:04.277372+0000","last_clean":"2023-10-24T00:47:04.277372+0000","last_became_active":"2023-10-24T00:47:04.269950+0000","last_became_peered":"2023-10-24T00:47:04.269950+0000","last_unstale":"2023-10-24T00:47:04.277372+0000","last_undegraded":"2023-10-24T00:47:04.277372+0000","last_fullsized":"2023-10-24T00:47:04.277372+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254620+0000","last_change":"2023-10-24T00:47:03.897881+0000","last_active":"2023-10-24T00:47:04.254620+0000","last_peered":"2023-10-24T00:47:04.254620+0000","last_clean":"2023-10-24T00:47:04.254620+0000","last_became_active":"2023-10-24T00:47:03.897444+0000","last_became_peered":"2023-10-24T00:47:03.897444+0000","last_unstale":"2023-10-24T00:47:04.254620+0000","last_undegraded":"2023-10-24T00:47:04.254620+0000","last_fullsized":"2023-10-24T00:47:04.254620+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277584+0000","last_change":"2023-10-24T00:47:04.270001+0000","last_active":"2023-10-24T00:47:04.277584+0000","last_peered":"2023-10-24T00:47:04.277584+0000","last_clean":"2023-10-24T00:47:04.277584+0000","last_became_active":"2023-10-24T00:47:04.267244+0000","last_became_peered":"2023-10-24T00:47:04.267244+0000","last_unstale":"2023-10-24T00:47:04.277584+0000","last_undegraded":"2023-10-24T00:47:04.277584+0000","last_fullsized":"2023-10-24T00:47:04.277584+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.259724+0000","last_change":"2023-10-24T00:47:03.902455+0000","last_active":"2023-10-24T00:47:04.259724+0000","last_peered":"2023-10-24T00:47:04.259724+0000","last_clean":"2023-10-24T00:47:04.259724+0000","last_became_active":"2023-10-24T00:47:03.902190+0000","last_became_peered":"2023-10-24T00:47:03.902190+0000","last_unstale":"2023-10-24T00:47:04.259724+0000","last_undegraded":"2023-10-24T00:47:04.259724+0000","last_fullsized":"2023-10-24T00:47:04.259724+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.281752+0000","last_change":"2023-10-24T00:47:04.278258+0000","last_active":"2023-10-24T00:47:04.281752+0000","last_peered":"2023-10-24T00:47:04.281752+0000","last_clean":"2023-10-24T00:47:04.281752+0000","last_became_active":"2023-10-24T00:47:04.277991+0000","last_became_peered":"2023-10-24T00:47:04.277991+0000","last_unstale":"2023-10-24T00:47:04.281752+0000","last_undegraded":"2023-10-24T00:47:04.281752+0000","last_fullsized":"2023-10-24T00:47:04.281752+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.256019+0000","last_change":"2023-10-24T00:47:03.891425+0000","last_active":"2023-10-24T00:47:04.256019+0000","last_peered":"2023-10-24T00:47:04.256019+0000","last_clean":"2023-10-24T00:47:04.256019+0000","last_became_active":"2023-10-24T00:47:03.891078+0000","last_became_peered":"2023-10-24T00:47:03.891078+0000","last_unstale":"2023-10-24T00:47:04.256019+0000","last_undegraded":"2023-10-24T00:47:04.256019+0000","last_fullsized":"2023-10-24T00:47:04.256019+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.282866+0000","last_change":"2023-10-24T00:47:04.281033+0000","last_active":"2023-10-24T00:47:04.282866+0000","last_peered":"2023-10-24T00:47:04.282866+0000","last_clean":"2023-10-24T00:47:04.282866+0000","last_became_active":"2023-10-24T00:47:04.280748+0000","last_became_peered":"2023-10-24T00:47:04.280748+0000","last_unstale":"2023-10-24T00:47:04.282866+0000","last_undegraded":"2023-10-24T00:47:04.282866+0000","last_fullsized":"2023-10-24T00:47:04.282866+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.259564+0000","last_change":"2023-10-24T00:47:03.901755+0000","last_active":"2023-10-24T00:47:04.259564+0000","last_peered":"2023-10-24T00:47:04.259564+0000","last_clean":"2023-10-24T00:47:04.259564+0000","last_became_active":"2023-10-24T00:47:03.901390+0000","last_became_peered":"2023-10-24T00:47:03.901390+0000","last_unstale":"2023-10-24T00:47:04.259564+0000","last_undegraded":"2023-10-24T00:47:04.259564+0000","last_fullsized":"2023-10-24T00:47:04.259564+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258162+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:47:04.258162+0000","last_peered":"2023-10-24T00:47:04.258162+0000","last_clean":"2023-10-24T00:47:04.258162+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:47:04.258162+0000","last_undegraded":"2023-10-24T00:47:04.258162+0000","last_fullsized":"2023-10-24T00:47:04.258162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277277+0000","last_change":"2023-10-24T00:47:04.270247+0000","last_active":"2023-10-24T00:47:04.277277+0000","last_peered":"2023-10-24T00:47:04.277277+0000","last_clean":"2023-10-24T00:47:04.277277+0000","last_became_active":"2023-10-24T00:47:04.264890+0000","last_became_peered":"2023-10-24T00:47:04.264890+0000","last_unstale":"2023-10-24T00:47:04.277277+0000","last_undegraded":"2023-10-24T00:47:04.277277+0000","last_fullsized":"2023-10-24T00:47:04.277277+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279900+0000","last_change":"2023-10-24T00:47:03.897032+0000","last_active":"2023-10-24T00:47:04.279900+0000","last_peered":"2023-10-24T00:47:04.279900+0000","last_clean":"2023-10-24T00:47:04.279900+0000","last_became_active":"2023-10-24T00:47:03.896696+0000","last_became_peered":"2023-10-24T00:47:03.896696+0000","last_unstale":"2023-10-24T00:47:04.279900+0000","last_undegraded":"2023-10-24T00:47:04.279900+0000","last_fullsized":"2023-10-24T00:47:04.279900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.266872+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:47:04.266872+0000","last_peered":"2023-10-24T00:47:04.266872+0000","last_clean":"2023-10-24T00:47:04.266872+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:47:04.266872+0000","last_undegraded":"2023-10-24T00:47:04.266872+0000","last_fullsized":"2023-10-24T00:47:04.266872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.268923+0000","last_change":"2023-10-24T00:47:04.263754+0000","last_active":"2023-10-24T00:47:04.268923+0000","last_peered":"2023-10-24T00:47:04.268923+0000","last_clean":"2023-10-24T00:47:04.268923+0000","last_became_active":"2023-10-24T00:47:04.263449+0000","last_became_peered":"2023-10-24T00:47:04.263449+0000","last_unstale":"2023-10-24T00:47:04.268923+0000","last_undegraded":"2023-10-24T00:47:04.268923+0000","last_fullsized":"2023-10-24T00:47:04.268923+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.266274+0000","last_change":"2023-10-24T00:47:03.897911+0000","last_active":"2023-10-24T00:47:04.266274+0000","last_peered":"2023-10-24T00:47:04.266274+0000","last_clean":"2023-10-24T00:47:04.266274+0000","last_became_active":"2023-10-24T00:47:03.897645+0000","last_became_peered":"2023-10-24T00:47:03.897645+0000","last_unstale":"2023-10-24T00:47:04.266274+0000","last_undegraded":"2023-10-24T00:47:04.266274+0000","last_fullsized":"2023-10-24T00:47:04.266274+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.253639+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:47:04.253639+0000","last_peered":"2023-10-24T00:47:04.253639+0000","last_clean":"2023-10-24T00:47:04.253639+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:47:04.253639+0000","last_undegraded":"2023-10-24T00:47:04.253639+0000","last_fullsized":"2023-10-24T00:47:04.253639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280978+0000","last_change":"2023-10-24T00:47:04.271735+0000","last_active":"2023-10-24T00:47:04.280978+0000","last_peered":"2023-10-24T00:47:04.280978+0000","last_clean":"2023-10-24T00:47:04.280978+0000","last_became_active":"2023-10-24T00:47:04.269563+0000","last_became_peered":"2023-10-24T00:47:04.269563+0000","last_unstale":"2023-10-24T00:47:04.280978+0000","last_undegraded":"2023-10-24T00:47:04.280978+0000","last_fullsized":"2023-10-24T00:47:04.280978+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"126'2","reported_seq":12,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.272652+0000","last_change":"2023-10-24T00:47:03.895282+0000","last_active":"2023-10-24T00:47:04.272652+0000","last_peered":"2023-10-24T00:47:04.272652+0000","last_clean":"2023-10-24T00:47:04.272652+0000","last_became_active":"2023-10-24T00:47:03.895019+0000","last_became_peered":"2023-10-24T00:47:03.895019+0000","last_unstale":"2023-10-24T00:47:04.272652+0000","last_undegraded":"2023-10-24T00:47:04.272652+0000","last_fullsized":"2023-10-24T00:47:04.272652+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":100,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.266870+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:47:04.266870+0000","last_peered":"2023-10-24T00:47:04.266870+0000","last_clean":"2023-10-24T00:47:04.266870+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:47:04.266870+0000","last_undegraded":"2023-10-24T00:47:04.266870+0000","last_fullsized":"2023-10-24T00:47:04.266870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":120,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254941+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:47:04.254941+0000","last_peered":"2023-10-24T00:47:04.254941+0000","last_clean":"2023-10-24T00:47:04.254941+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:47:04.254941+0000","last_undegraded":"2023-10-24T00:47:04.254941+0000","last_fullsized":"2023-10-24T00:47:04.254941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.279848+0000","last_change":"2023-10-24T00:47:04.273715+0000","last_active":"2023-10-24T00:47:04.279848+0000","last_peered":"2023-10-24T00:47:04.279848+0000","last_clean":"2023-10-24T00:47:04.279848+0000","last_became_active":"2023-10-24T00:47:04.272969+0000","last_became_peered":"2023-10-24T00:47:04.272969+0000","last_unstale":"2023-10-24T00:47:04.279848+0000","last_undegraded":"2023-10-24T00:47:04.279848+0000","last_fullsized":"2023-10-24T00:47:04.279848+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255499+0000","last_change":"2023-10-24T00:47:03.895367+0000","last_active":"2023-10-24T00:47:04.255499+0000","last_peered":"2023-10-24T00:47:04.255499+0000","last_clean":"2023-10-24T00:47:04.255499+0000","last_became_active":"2023-10-24T00:47:03.894499+0000","last_became_peered":"2023-10-24T00:47:03.894499+0000","last_unstale":"2023-10-24T00:47:04.255499+0000","last_undegraded":"2023-10-24T00:47:04.255499+0000","last_fullsized":"2023-10-24T00:47:04.255499+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.256078+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:47:04.256078+0000","last_peered":"2023-10-24T00:47:04.256078+0000","last_clean":"2023-10-24T00:47:04.256078+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:47:04.256078+0000","last_undegraded":"2023-10-24T00:47:04.256078+0000","last_fullsized":"2023-10-24T00:47:04.256078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.277344+0000","last_change":"2023-10-24T00:47:04.267760+0000","last_active":"2023-10-24T00:47:04.277344+0000","last_peered":"2023-10-24T00:47:04.277344+0000","last_clean":"2023-10-24T00:47:04.277344+0000","last_became_active":"2023-10-24T00:47:04.267247+0000","last_became_peered":"2023-10-24T00:47:04.267247+0000","last_unstale":"2023-10-24T00:47:04.277344+0000","last_undegraded":"2023-10-24T00:47:04.277344+0000","last_fullsized":"2023-10-24T00:47:04.277344+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254154+0000","last_change":"2023-10-24T00:47:03.896795+0000","last_active":"2023-10-24T00:47:04.254154+0000","last_peered":"2023-10-24T00:47:04.254154+0000","last_clean":"2023-10-24T00:47:04.254154+0000","last_became_active":"2023-10-24T00:47:03.896441+0000","last_became_peered":"2023-10-24T00:47:03.896441+0000","last_unstale":"2023-10-24T00:47:04.254154+0000","last_undegraded":"2023-10-24T00:47:04.254154+0000","last_fullsized":"2023-10-24T00:47:04.254154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.255675+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:47:04.255675+0000","last_peered":"2023-10-24T00:47:04.255675+0000","last_clean":"2023-10-24T00:47:04.255675+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:47:04.255675+0000","last_undegraded":"2023-10-24T00:47:04.255675+0000","last_fullsized":"2023-10-24T00:47:04.255675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.280669+0000","last_change":"2023-10-24T00:47:04.274088+0000","last_active":"2023-10-24T00:47:04.280669+0000","last_peered":"2023-10-24T00:47:04.280669+0000","last_clean":"2023-10-24T00:47:04.280669+0000","last_became_active":"2023-10-24T00:47:04.273729+0000","last_became_peered":"2023-10-24T00:47:04.273729+0000","last_unstale":"2023-10-24T00:47:04.280669+0000","last_undegraded":"2023-10-24T00:47:04.280669+0000","last_fullsized":"2023-10-24T00:47:04.280669+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"126'1","reported_seq":11,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.269587+0000","last_change":"2023-10-24T00:47:03.895036+0000","last_active":"2023-10-24T00:47:04.269587+0000","last_peered":"2023-10-24T00:47:04.269587+0000","last_clean":"2023-10-24T00:47:04.269587+0000","last_became_active":"2023-10-24T00:47:03.894771+0000","last_became_peered":"2023-10-24T00:47:03.894771+0000","last_unstale":"2023-10-24T00:47:04.269587+0000","last_undegraded":"2023-10-24T00:47:04.269587+0000","last_fullsized":"2023-10-24T00:47:04.269587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.257263+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:47:04.257263+0000","last_peered":"2023-10-24T00:47:04.257263+0000","last_clean":"2023-10-24T00:47:04.257263+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:47:04.257263+0000","last_undegraded":"2023-10-24T00:47:04.257263+0000","last_fullsized":"2023-10-24T00:47:04.257263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.273205+0000","last_change":"2023-10-24T00:47:04.268360+0000","last_active":"2023-10-24T00:47:04.273205+0000","last_peered":"2023-10-24T00:47:04.273205+0000","last_clean":"2023-10-24T00:47:04.273205+0000","last_became_active":"2023-10-24T00:47:04.268106+0000","last_became_peered":"2023-10-24T00:47:04.268106+0000","last_unstale":"2023-10-24T00:47:04.273205+0000","last_undegraded":"2023-10-24T00:47:04.273205+0000","last_fullsized":"2023-10-24T00:47:04.273205+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:03.871843+0000","last_clean_scrub_stamp":"2023-10-24T00:47:03.871843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.254500+0000","last_change":"2023-10-24T00:47:03.897714+0000","last_active":"2023-10-24T00:47:04.254500+0000","last_peered":"2023-10-24T00:47:04.254500+0000","last_clean":"2023-10-24T00:47:04.254500+0000","last_became_active":"2023-10-24T00:47:03.897118+0000","last_became_peered":"2023-10-24T00:47:03.897118+0000","last_unstale":"2023-10-24T00:47:04.254500+0000","last_undegraded":"2023-10-24T00:47:04.254500+0000","last_fullsized":"2023-10-24T00:47:04.254500+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:47:02.869683+0000","last_clean_scrub_stamp":"2023-10-24T00:47:02.869683+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":104,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-24T00:47:04.258262+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:47:04.258262+0000","last_peered":"2023-10-24T00:47:04.258262+0000","last_clean":"2023-10-24T00:47:04.258262+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:47:04.258262+0000","last_undegraded":"2023-10-24T00:47:04.258262+0000","last_fullsized":"2023-10-24T00:47:04.258262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542363,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":787743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.53800000000000003},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67400000000000004,"5min":0.69399999999999995,"15min":0.83299999999999996},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79900000000000004},"last":0.47699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.82499999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.81399999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":0.754,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.67900000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.52900000000000003,"15min":0.496},"min":{"1min":0.33100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.61899999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.78600000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.55900000000000005,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":4.351,"15min":4.351},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67800000000000005,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Oct 24 00:46:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72299999999999998,"5min":1.054,"15min":1.054},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069108,"statfs":{"total":96636764160,"available":96326766592,"internally_reserved":0,"allocated":1576960,"data_stored":788319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51100000000000001,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.217,"15min":0.217},"max":{"1min":0.629,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.46899999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.66000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72799999999999998,"5min":1.573,"15min":1.573},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.67500000000000004,"5min":7.7969999999999997,"15min":7.7969999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76700000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.377}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67500000000000004,"15min":0.59399999999999997},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":14.597,"15min":14.597},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.503}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.72199999999999998,"5min":0.78000000000000003,"15min":0.81000000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55400000000000005,"15min":0.503},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.83399999999999996,"5min":7.8559999999999999,"15min":7.8559999999999999},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.30399999999999999},"max":{"1min":0.748,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84599999999999997},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":7.8929999999999998,"15min":7.8929999999999998},"last":0.495}]}]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302736,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069104,"statfs":{"total":96636764160,"available":96326762496,"internally_reserved":0,"allocated":1581056,"data_stored":789203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.38200000000000001},"min":{"1min":0.249,"5min":0.219,"15min":0.219},"max":{"1min":0.58599999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.40999999999999998},"min":{"1min":0.30299999999999999,"5min":0.27100000000000002,"15min":0.26600000000000001},"max":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.36899999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.23499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56999999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.41099999999999998,"15min":0.41699999999999998},"min":{"1min":0.253,"5min":0.25,"15min":0.25},"max":{"1min":0.623,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.313}]},{"osd":3,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.45400000000000001,"15min":0.434},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":3.2269999999999999,"15min":3.2269999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.44700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65200000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58499999999999996,"15min":0.59699999999999998},"min":{"1min":0.42399999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82099999999999995,"5min":1.143,"15min":1.143},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":3.1190000000000002,"15min":3.1190000000000002},"last":0.623}]},{"osd":6,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63700000000000001,"15min":0.63},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:46:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.109,"15min":1.109},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61399999999999999,"15min":0.63},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575068,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069108,"statfs":{"total":96636764160,"available":96326766592,"internally_reserved":0,"allocated":1576960,"data_stored":788387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.48999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.38},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.378,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.505,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.39100000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.41299999999999998},"min":{"1min":0.31,"5min":0.215,"15min":0.215},"max":{"1min":0.56999999999999995,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.372,"15min":0.38800000000000001},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.27800000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39400000000000002,"15min":0.40799999999999997},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.628},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.61399999999999999,"5min":0.622,"15min":0.67100000000000004},"last":0.36399999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.33200000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.92400000000000004},"last":0.67300000000000004}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.35699999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.64600000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59899999999999998,"15min":0.62},"min":{"1min":0.40600000000000003,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.877,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.61799999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.876},"last":0.84599999999999997}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.628},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.35499999999999998},"max":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.85599999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542363,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":787757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.36199999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.53700000000000003,"15min":0.57199999999999995},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.22700000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.22500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.50800000000000001,"5min":0.63,"15min":0.65500000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.41799999999999998},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.29299999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41299999999999998,"15min":0.436},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.41599999999999998},"min":{"1min":0.246,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.623,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.621},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.86299999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.625},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.95399999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.59899999999999998,"15min":0.63900000000000001},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:46:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61399999999999999,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.083,"15min":1.083},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.67200000000000004},"min":{"1min":0.46999999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":0.91600000000000004,"15min":0.999},"last":0.752}]}]},{"osd":3,"up_from":13,"seq":55834575068,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1552384,"data_stored":780949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48499999999999999,"5min":0.85599999999999998,"15min":0.90400000000000003},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.38800000000000001,"15min":0.40699999999999997},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56699999999999995,"5min":1.099,"15min":1.099},"last":0.316}]},{"osd":1,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45500000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.41499999999999998,"15min":0.42699999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.53100000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38600000000000001,"15min":0.40300000000000002},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.50700000000000001,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.379},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.434,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.84099999999999997,"15min":0.85099999999999998},"last":0.37}]},{"osd":4,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81000000000000005,"5min":0.91900000000000004,"15min":1.024},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.60799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.90100000000000002,"15min":1.0269999999999999},"last":0.45300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.61699999999999999},"min":{"1min":0.45000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.751,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.624},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.93999999999999995,"15min":0.995},"last":0.41199999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86099999999999999,"5min":1.337,"15min":1.337},"last":0.438},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":1.042},"last":0.41999999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:46:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.66200000000000003},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":1.121},"last":0.443}]}]},{"osd":4,"up_from":13,"seq":55834575068,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302728,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069112,"statfs":{"total":96636764160,"available":96326770688,"internally_reserved":0,"allocated":1572864,"data_stored":788567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.52100000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.79100000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.496}]},{"osd":2,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70399999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":0.76000000000000001,"15min":0.78200000000000003},"last":0.62}]},{"osd":3,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.745,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.29999999999999999,"15min":0.29799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.749,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.497,"15min":0.503},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.79400000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48599999999999999,"15min":0.48699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78500000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65000000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.88,"15min":0.88},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542363,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1568768,"data_stored":788207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.754},"last":0.57099999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.55500000000000005},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.249},"max":{"1min":0.75600000000000001,"5min":0.79000000000000004,"15min":0.81799999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.72899999999999998,"5min":0.748,"15min":1.1479999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":1.0209999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":0.67800000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.56299999999999994},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.94199999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73599999999999999,"5min":0.84099999999999997,"15min":1.0669999999999999},"last":0.505}]},{"osd":4,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":1.339},"last":0.45500000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.36599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.36799999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.70799999999999996,"5min":0.745,"15min":0.76400000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:46:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":1.421},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.34499999999999997,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":1.772},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:47:12.064 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:47:12.064 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:47:12.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.214+0000 7f14443fd700 1 Processor -- start 2023-10-24T00:47:12.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.215+0000 7f14443fd700 1 -- start start 2023-10-24T00:47:12.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f14443fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f143c154430 0x7f143c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f14443fd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 0x7f143c0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f14443fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c0c71d0 con 0x7f143c098bd0 2023-10-24T00:47:12.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f14443fd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c0c6a10 con 0x7f143c154430 2023-10-24T00:47:12.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f14443fd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c0c9410 con 0x7f143c0bffd0 2023-10-24T00:47:12.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f143c154430 0x7f143c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f143c154430 0x7f143c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35170/0 (socket says 172.21.15.148:35170) 2023-10-24T00:47:12.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 -- 172.21.15.148:0/2469776396 learned_addr learned my addr 172.21.15.148:0/2469776396 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:12.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f144299a700 1 --2- 172.21.15.148:0/2469776396 >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 0x7f143c0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 -- 172.21.15.148:0/2469776396 >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 msgr2=0x7f143c0c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:12.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 --2- 172.21.15.148:0/2469776396 >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 0x7f143c0c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 -- 172.21.15.148:0/2469776396 >> v1:172.21.15.150:6789/0 conn(0x7f143c098bd0 legacy=0x7f143c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:12.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 -- 172.21.15.148:0/2469776396 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0c0950 con 0x7f143c154430 2023-10-24T00:47:12.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f144299a700 1 --2- 172.21.15.148:0/2469776396 >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 0x7f143c0c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1442199700 1 --2- 172.21.15.148:0/2469776396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c154430 0x7f143c154810 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f143c0aab20 tx=0x7f14380090f0).ready entity=mon.0 client_cookie=4440600babc2f26e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1441197700 1 -- 172.21.15.148:0/2469776396 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800b600 con 0x7f143c154430 2023-10-24T00:47:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1441197700 1 -- 172.21.15.148:0/2469776396 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800b760 con 0x7f143c154430 2023-10-24T00:47:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.216+0000 7f1441197700 1 -- 172.21.15.148:0/2469776396 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800bae0 con 0x7f143c154430 2023-10-24T00:47:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 -- 172.21.15.148:0/2469776396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c154430 msgr2=0x7f143c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 --2- 172.21.15.148:0/2469776396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c154430 0x7f143c154810 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f143c0aab20 tx=0x7f14380090f0).stop 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 -- 172.21.15.148:0/2469776396 shutdown_connections 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 --2- 172.21.15.148:0/2469776396 >> v2:172.21.15.150:3300/0 conn(0x7f143c0bffd0 0x7f143c0c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 --2- 172.21.15.148:0/2469776396 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c154430 0x7f143c154810 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 -- 172.21.15.148:0/2469776396 >> 172.21.15.148:0/2469776396 conn(0x7f143c0cb070 msgr2=0x7f143c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:12.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 -- 172.21.15.148:0/2469776396 shutdown_connections 2023-10-24T00:47:12.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.217+0000 7f14443fd700 1 -- 172.21.15.148:0/2469776396 wait complete. 2023-10-24T00:47:12.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.218+0000 7f14443fd700 1 Processor -- start 2023-10-24T00:47:12.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.218+0000 7f14443fd700 1 -- start start 2023-10-24T00:47:12.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 0x7f143c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 0x7f143c149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0b10d0 con 0x7f143c0bffd0 2023-10-24T00:47:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0afb40 con 0x7f143c154430 2023-10-24T00:47:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f14443fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0afe20 con 0x7f143c098bd0 2023-10-24T00:47:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35178/0 (socket says 172.21.15.148:35178) 2023-10-24T00:47:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 -- 172.21.15.148:0/2539296351 learned_addr learned my addr 172.21.15.148:0/2539296351 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f144299a700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 0x7f143c149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1442199700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 0x7f143c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 -- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 msgr2=0x7f143c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 0x7f143c0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 -- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 msgr2=0x7f143c149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 0x7f143c149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1441998700 1 -- 172.21.15.148:0/2539296351 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009370 con 0x7f143c0bffd0 2023-10-24T00:47:12.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f1442199700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 0x7f143c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:12.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.219+0000 7f144299a700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 0x7f143c149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:12.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f1441998700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f142c00c4c0 tx=0x7f142c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c007020 con 0x7f143c0bffd0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c001e90 con 0x7f143c0bffd0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c0b0100 con 0x7f143c0bffd0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0073b0 con 0x7f143c0bffd0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.220+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c0b06c0 con 0x7f143c0bffd0 2023-10-24T00:47:12.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.221+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c06c6b0 con 0x7f143c0bffd0 2023-10-24T00:47:12.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.221+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f142c0068b0 con 0x7f143c0bffd0 2023-10-24T00:47:12.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.221+0000 7f14327fc700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 0x7f1420061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.221+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f142c079be0 con 0x7f143c0bffd0 2023-10-24T00:47:12.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.222+0000 7f1442199700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 0x7f1420061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.222+0000 7f1442199700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 0x7f1420061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1438009130 tx=0x7f1438017000).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.225+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f142c04aeb0 con 0x7f143c0bffd0 2023-10-24T00:47:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.459+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f143c062c40 con 0x7f143c0bffd0 2023-10-24T00:47:12.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.463+0000 7f14327fc700 1 -- 172.21.15.148:0/2539296351 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f142c04e4d0 con 0x7f143c0bffd0 2023-10-24T00:47:12.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 msgr2=0x7f1420061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 0x7f1420061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1438009130 tx=0x7f1438017000).stop 2023-10-24T00:47:12.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 msgr2=0x7f143c0abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f142c00c4c0 tx=0x7f142c007e00).stop 2023-10-24T00:47:12.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 shutdown_connections 2023-10-24T00:47:12.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f143c154430 0x7f143c149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f143c098bd0 0x7f143c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f142005f150 0x7f1420061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 --2- 172.21.15.148:0/2539296351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f143c0bffd0 0x7f143c0abc50 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 >> 172.21.15.148:0/2539296351 conn(0x7f143c0cb070 msgr2=0x7f143c0a8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 shutdown_connections 2023-10-24T00:47:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.465+0000 7f14443fd700 1 -- 172.21.15.148:0/2539296351 wait complete. 2023-10-24T00:47:12.469 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:47:12.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:47:12.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.589+0000 7f39d944a700 1 Processor -- start 2023-10-24T00:47:12.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.589+0000 7f39d944a700 1 -- start start 2023-10-24T00:47:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39d944a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f39d40c6710 0x7f39d40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39d944a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f39d40aa3f0 0x7f39d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39d944a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40aa820 con 0x7f39d40aa010 2023-10-24T00:47:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39d944a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d40c0960 con 0x7f39d40c6710 2023-10-24T00:47:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39d944a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d40c0c40 con 0x7f39d40aa3f0 2023-10-24T00:47:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.590+0000 7f39ca7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f39d40c6710 0x7f39d40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f39d40c6710 0x7f39d40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35194/0 (socket says 172.21.15.148:35194) 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 -- 172.21.15.148:0/2428767044 learned_addr learned my addr 172.21.15.148:0/2428767044 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d37fe700 1 --2- 172.21.15.148:0/2428767044 >> v2:172.21.15.150:3300/0 conn(0x7f39d40aa3f0 0x7f39d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 -- 172.21.15.148:0/2428767044 >> v2:172.21.15.150:3300/0 conn(0x7f39d40aa3f0 msgr2=0x7f39d4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 --2- 172.21.15.148:0/2428767044 >> v2:172.21.15.150:3300/0 conn(0x7f39d40aa3f0 0x7f39d4069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 -- 172.21.15.148:0/2428767044 >> v1:172.21.15.150:6789/0 conn(0x7f39d40aa010 legacy=0x7f39d4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 -- 172.21.15.148:0/2428767044 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40c0f20 con 0x7f39d40c6710 2023-10-24T00:47:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39ca7fc700 1 --2- 172.21.15.148:0/2428767044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40c1a00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f39d4158e80 tx=0x7f39bc0090f0).ready entity=mon.0 client_cookie=53a0fe270e98c8a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d27fc700 1 -- 172.21.15.148:0/2428767044 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00b5a0 con 0x7f39d40c6710 2023-10-24T00:47:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d27fc700 1 -- 172.21.15.148:0/2428767044 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00b700 con 0x7f39d40c6710 2023-10-24T00:47:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d27fc700 1 -- 172.21.15.148:0/2428767044 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00ba80 con 0x7f39d40c6710 2023-10-24T00:47:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d944a700 1 -- 172.21.15.148:0/2428767044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 msgr2=0x7f39d40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.591+0000 7f39d944a700 1 --2- 172.21.15.148:0/2428767044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40c1a00 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f39d4158e80 tx=0x7f39bc0090f0).stop 2023-10-24T00:47:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 -- 172.21.15.148:0/2428767044 shutdown_connections 2023-10-24T00:47:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 --2- 172.21.15.148:0/2428767044 >> v2:172.21.15.150:3300/0 conn(0x7f39d40aa3f0 0x7f39d4069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 --2- 172.21.15.148:0/2428767044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40c1a00 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 -- 172.21.15.148:0/2428767044 >> 172.21.15.148:0/2428767044 conn(0x7f39d40caf40 msgr2=0x7f39d40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:12.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 -- 172.21.15.148:0/2428767044 shutdown_connections 2023-10-24T00:47:12.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.592+0000 7f39d944a700 1 -- 172.21.15.148:0/2428767044 wait complete. 2023-10-24T00:47:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.593+0000 7f39d944a700 1 Processor -- start 2023-10-24T00:47:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.593+0000 7f39d944a700 1 -- start start 2023-10-24T00:47:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d40aa010 0x7f39d40c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d40aa3f0 0x7f39d4146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40aff00 con 0x7f39d40c6710 2023-10-24T00:47:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4151dc0 con 0x7f39d40aa3f0 2023-10-24T00:47:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d41520a0 con 0x7f39d40aa010 2023-10-24T00:47:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:35200/0 (socket says 172.21.15.148:35200) 2023-10-24T00:47:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 -- 172.21.15.148:0/610027037 learned_addr learned my addr 172.21.15.148:0/610027037 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39ca7fc700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d40aa3f0 0x7f39d4146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d2ffd700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d40aa010 0x7f39d40c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 -- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d40aa010 msgr2=0x7f39d40c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d40aa010 0x7f39d40c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 -- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d40aa3f0 msgr2=0x7f39d4146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d40aa3f0 0x7f39d4146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 -- 172.21.15.148:0/610027037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc009370 con 0x7f39d40c6710 2023-10-24T00:47:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d37fe700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f39cc009fa0 tx=0x7f39cc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00ebc0 con 0x7f39d40c6710 2023-10-24T00:47:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc00ed20 con 0x7f39d40c6710 2023-10-24T00:47:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d40b01c0 con 0x7f39d40c6710 2023-10-24T00:47:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc014610 con 0x7f39d40c6710 2023-10-24T00:47:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.594+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4146d80 con 0x7f39d40c6710 2023-10-24T00:47:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.596+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d406c6b0 con 0x7f39d40c6710 2023-10-24T00:47:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.596+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f39cc01d3b0 con 0x7f39d40c6710 2023-10-24T00:47:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.596+0000 7f39cb7fe700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 0x7f39b40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.596+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f39cc07a670 con 0x7f39d40c6710 2023-10-24T00:47:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.596+0000 7f39d2ffd700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 0x7f39b40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:12.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.597+0000 7f39d2ffd700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 0x7f39b40615e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39c40038b0 tx=0x7f39c4007d20).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:12.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.600+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f39cc04b8e0 con 0x7f39d40c6710 2023-10-24T00:47:12.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.805+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39d40c1200 con 0x7f39d40c6710 2023-10-24T00:47:12.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.805+0000 7f39cb7fe700 1 -- 172.21.15.148:0/610027037 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f39cc04ef00 con 0x7f39d40c6710 2023-10-24T00:47:12.807 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:12.807 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:47:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.807+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 msgr2=0x7f39b40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.807+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 0x7f39b40615e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39c40038b0 tx=0x7f39c4007d20).stop 2023-10-24T00:47:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.807+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 msgr2=0x7f39d40b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.807+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f39cc009fa0 tx=0x7f39cc009900).stop 2023-10-24T00:47:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 shutdown_connections 2023-10-24T00:47:12.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f39b405f120 0x7f39b40615e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39d40c6710 0x7f39d40b06e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f39d40aa010 0x7f39d40c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 --2- 172.21.15.148:0/610027037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f39d40aa3f0 0x7f39d4146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 >> 172.21.15.148:0/610027037 conn(0x7f39d40caf40 msgr2=0x7f39d40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:12.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 shutdown_connections 2023-10-24T00:47:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:12.808+0000 7f39d944a700 1 -- 172.21.15.148:0/610027037 wait complete. 2023-10-24T00:47:12.812 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:47:13.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:47:04.250197+0000', 'modified': '2023-10-24T00:47:06.258450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7710}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7710': {'gid': 7710, 'name': 'd', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6837/2431879212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6835', 'nonce': 2431879212}, {'type': 'v1', 'addr': '172.21.15.150:6837', 'nonce': 2431879212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:47:13.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:47:13.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-24T00:47:13.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.339+0000 7faafbbc6700 1 Processor -- start 2023-10-24T00:47:13.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.339+0000 7faafbbc6700 1 -- start start 2023-10-24T00:47:13.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafbbc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 0x7faaf40c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafbbc6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faaf40c0b30 0x7faaf40c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafbbc6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40c01c0 con 0x7faaf41547e0 2023-10-24T00:47:13.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafbbc6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40aa960 con 0x7faaf40c0b30 2023-10-24T00:47:13.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafbbc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40c66f0 con 0x7faaf4154400 2023-10-24T00:47:13.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faafa163700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faaf40c0b30 0x7faaf40c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faaf9161700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faaf41547e0 0x7faaf40a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39188/0 (socket says 172.21.15.148:39188) 2023-10-24T00:47:13.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.340+0000 7faaf9161700 1 -- 172.21.15.148:0/795671688 learned_addr learned my addr 172.21.15.148:0/795671688 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:13.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf9962700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 0x7faaf40c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faafa163700 1 -- 172.21.15.148:0/795671688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 msgr2=0x7faaf40c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faafa163700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 0x7faaf40c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faafa163700 1 -- 172.21.15.148:0/795671688 >> v1:172.21.15.148:6789/0 conn(0x7faaf41547e0 legacy=0x7faaf40a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faafa163700 1 -- 172.21.15.148:0/795671688 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40c6150 con 0x7faaf40c0b30 2023-10-24T00:47:13.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf8960700 1 -- 172.21.15.148:0/795671688 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679039432 0 0) 0x7faaf40c01c0 con 0x7faaf41547e0 2023-10-24T00:47:13.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf9962700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 0x7faaf40c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:13.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faafa163700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf40c0b30 0x7faaf40c0f60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7faaec009e60 tx=0x7faaec009780).ready entity=mon.0 client_cookie=ad66b6e7af4c1479 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf8960700 1 -- 172.21.15.148:0/795671688 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00e070 con 0x7faaf40c0b30 2023-10-24T00:47:13.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf8960700 1 -- 172.21.15.148:0/795671688 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00bc30 con 0x7faaf40c0b30 2023-10-24T00:47:13.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.341+0000 7faaf8960700 1 -- 172.21.15.148:0/795671688 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec012410 con 0x7faaf40c0b30 2023-10-24T00:47:13.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 -- 172.21.15.148:0/795671688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf40c0b30 msgr2=0x7faaf40c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf40c0b30 0x7faaf40c0f60 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7faaec009e60 tx=0x7faaec009780).stop 2023-10-24T00:47:13.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 -- 172.21.15.148:0/795671688 shutdown_connections 2023-10-24T00:47:13.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf40c0b30 0x7faaf40c0f60 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 --2- 172.21.15.148:0/795671688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf4154400 0x7faaf40c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 -- 172.21.15.148:0/795671688 >> 172.21.15.148:0/795671688 conn(0x7faaf40946a0 msgr2=0x7faaf406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 -- 172.21.15.148:0/795671688 shutdown_connections 2023-10-24T00:47:13.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.342+0000 7faafbbc6700 1 -- 172.21.15.148:0/795671688 wait complete. 2023-10-24T00:47:13.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.343+0000 7faafbbc6700 1 Processor -- start 2023-10-24T00:47:13.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.343+0000 7faafbbc6700 1 -- start start 2023-10-24T00:47:13.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 0x7faaf40ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 0x7faaf41652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40abd60 con 0x7faaf41547e0 2023-10-24T00:47:13.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4155be0 con 0x7faaf4154400 2023-10-24T00:47:13.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4156440 con 0x7faaf40c0b30 2023-10-24T00:47:13.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50270/0 (socket says 172.21.15.148:50270) 2023-10-24T00:47:13.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 -- 172.21.15.148:0/4093606374 learned_addr learned my addr 172.21.15.148:0/4093606374 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faaf9962700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 0x7faaf40ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faaf9161700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 0x7faaf41652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 -- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 msgr2=0x7faaf40ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 0x7faaf40ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 -- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 msgr2=0x7faaf41652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 0x7faaf41652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 -- 172.21.15.148:0/4093606374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec009a20 con 0x7faaf41547e0 2023-10-24T00:47:13.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faaf9161700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 0x7faaf41652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:13.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faaf9962700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 0x7faaf40ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:13.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafa163700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7faaf4084250 tx=0x7faaf40c6660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faae9ffb700 1 -- 172.21.15.148:0/4093606374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec012410 con 0x7faaf41547e0 2023-10-24T00:47:13.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faae9ffb700 1 -- 172.21.15.148:0/4093606374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec007000 con 0x7faaf41547e0 2023-10-24T00:47:13.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf41657e0 con 0x7faaf41547e0 2023-10-24T00:47:13.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.344+0000 7faae9ffb700 1 -- 172.21.15.148:0/4093606374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011de0 con 0x7faaf41547e0 2023-10-24T00:47:13.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.345+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf41560d0 con 0x7faaf41547e0 2023-10-24T00:47:13.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.346+0000 7faae9ffb700 1 -- 172.21.15.148:0/4093606374 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faaec003040 con 0x7faaf41547e0 2023-10-24T00:47:13.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.346+0000 7faae9ffb700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 0x7faad8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.346+0000 7faae9ffb700 1 -- 172.21.15.148:0/4093606374 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faaec07c100 con 0x7faaf41547e0 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.347+0000 7faaf9962700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 0x7faad8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.347+0000 7faaf9962700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 0x7faad8061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7faaf4150850 tx=0x7faaf0008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.348+0000 7fab0d55eb80 1 Processor -- start 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.348+0000 7fab0d55eb80 1 -- start start 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fd54f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd50e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fccc1b0 con 0x55781fd7e190 2023-10-24T00:47:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fc91cb0 con 0x55781fd57980 2023-10-24T00:47:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55781fca6c90 con 0x55781fd54b20 2023-10-24T00:47:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7faaf9161700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7faaf9161700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50278/0 (socket says 172.21.15.148:50278) 2023-10-24T00:47:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7faaf9161700 1 -- 172.21.15.148:0/1806250868 learned_addr learned my addr 172.21.15.148:0/1806250868 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7faaf9962700 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fd54f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.349+0000 7faafa163700 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 -- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 msgr2=0x55781fd54f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fd54f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 -- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 msgr2=0x55781fd50e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd50e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 -- 172.21.15.148:0/1806250868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55781fc9fe70 con 0x55781fd7e190 2023-10-24T00:47:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faaf9161700 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7faae4001520 tx=0x7faae4009040).ready entity=mon.0 client_cookie=8e6ca866c5977ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faadeffd700 1 -- 172.21.15.148:0/1806250868 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40070d0 con 0x55781fd7e190 2023-10-24T00:47:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faadeffd700 1 -- 172.21.15.148:0/1806250868 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4007230 con 0x55781fd7e190 2023-10-24T00:47:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7faadeffd700 1 -- 172.21.15.148:0/1806250868 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40075d0 con 0x55781fd7e190 2023-10-24T00:47:13.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1806250868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 msgr2=0x55781fd509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7faae4001520 tx=0x7faae4009040).stop 2023-10-24T00:47:13.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1806250868 shutdown_connections 2023-10-24T00:47:13.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd50e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fd54f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1806250868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd509a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1806250868 >> 172.21.15.148:0/1806250868 conn(0x55781fb11e40 msgr2=0x55781fd9eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1806250868 shutdown_connections 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.350+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1806250868 wait complete. 2023-10-24T00:47:13.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.351+0000 7fab0d55eb80 1 -- start start 2023-10-24T00:47:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.351+0000 7fab0d55eb80 1 Processor -- start 2023-10-24T00:47:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fda2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fda0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fca6dd0 con 0x55781fd7e190 2023-10-24T00:47:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fca7050 con 0x55781fd57980 2023-10-24T00:47:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55781fc728d0 con 0x55781fd54b20 2023-10-24T00:47:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7fab0d55eb80 10 client.0 ll_register_callbacks cb 0x55781fd15030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:47:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50280/0 (socket says 172.21.15.148:50280) 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 -- 172.21.15.148:0/3273076928 learned_addr learned my addr 172.21.15.148:0/3273076928 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faaf9962700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fda2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faaf9161700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fda0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 -- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 msgr2=0x55781fda2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fda2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 -- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 msgr2=0x55781fda0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fda0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.352+0000 7faafa163700 1 -- 172.21.15.148:0/3273076928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae400f040 con 0x55781fd7e190 2023-10-24T00:47:13.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faafa163700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7faaec04d590 tx=0x7faaec029040).ready entity=mon.0 client_cookie=3fd55e3822e4ea9c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:47:13.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00b6c0 con 0x55781fd7e190 2023-10-24T00:47:13.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faaec051030 con 0x55781fd7e190 2023-10-24T00:47:13.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55781fd494e0 con 0x55781fd7e190 2023-10-24T00:47:13.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaec013e00 con 0x55781fd7e190 2023-10-24T00:47:13.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 10 client.7896 fetch_fsmap learned FSMap version 43 2023-10-24T00:47:13.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55781fc9b480 con 0x55781fd7e190 2023-10-24T00:47:13.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55781fd494e0 con 0x55781fd7e190 2023-10-24T00:47:13.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faaec050580 con 0x55781fd7e190 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 10 client.7896 fetch_fsmap finished waiting for FSMap version 43 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 10 client.7896 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 20 client.7896 populate_metadata read hostname 'smithi148' 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd76b60 0x55781fd76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 4 client.7896 mds_command: new command op to 7710 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:47:13.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 --> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55781fd1f4b0 con 0x55781fd76b60 2023-10-24T00:47:13.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.353+0000 7faaf9962700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd76b60 0x55781fd76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.354+0000 7faad3fff700 10 client.7896 ms_handle_connect on v2:172.21.15.150:6835/2431879212 2023-10-24T00:47:13.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.354+0000 7faaf9962700 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd76b60 0x55781fd76f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c78cb98831a1967d server_cookie=97f2ddaab3a4fbd6 in_seq=0 out_seq=0 2023-10-24T00:47:13.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.354+0000 7faad3fff700 1 -- 172.21.15.148:0/3273076928 <== mds.0 v2:172.21.15.150:6835/2431879212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55781fd1f4b0 con 0x55781fd76b60 2023-10-24T00:47:13.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.354+0000 7faad3fff700 10 client.7896 handle_command_reply: tid=0 2023-10-24T00:47:13.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 client.7896 shutdown 2023-10-24T00:47:13.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 msgr2=0x55781fda0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7faaec04d590 tx=0x7faaec029040).stop 2023-10-24T00:47:13.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 shutdown_connections 2023-10-24T00:47:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fda0500 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fda2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd76b60 0x55781fd76f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/3273076928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fda0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7faad3fff700 0 client.7896 ms_handle_reset on v2:172.21.15.150:6835/2431879212 2023-10-24T00:47:13.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 >> 172.21.15.148:0/3273076928 conn(0x55781fb11e40 msgr2=0x55781fd9b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 shutdown_connections 2023-10-24T00:47:13.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 1 -- 172.21.15.148:0/3273076928 wait complete. 2023-10-24T00:47:13.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.355+0000 7fab0d55eb80 20 client.7896 trim_cache size 0 max 16384 2023-10-24T00:47:13.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.371+0000 7fab0d55eb80 1 Processor -- start 2023-10-24T00:47:13.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.371+0000 7fab0d55eb80 1 -- start start 2023-10-24T00:47:13.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fdad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fd9a320 con 0x55781fd7e190 2023-10-24T00:47:13.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fda3640 con 0x55781fd57980 2023-10-24T00:47:13.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55781fda1af0 con 0x55781fd54b20 2023-10-24T00:47:13.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50290/0 (socket says 172.21.15.148:50290) 2023-10-24T00:47:13.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 -- 172.21.15.148:0/369571343 learned_addr learned my addr 172.21.15.148:0/369571343 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faaf9161700 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faaf9962700 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fdad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 -- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 msgr2=0x55781fdad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fdad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 -- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 msgr2=0x55781fd7a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd7a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.372+0000 7faafa163700 1 -- 172.21.15.148:0/369571343 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55781fc9b1d0 con 0x55781fd7e190 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7faafa163700 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7faaec009e30 tx=0x7faaec039000).ready entity=mon.0 client_cookie=9e41ab9f59d0a87b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7faadf7fe700 1 -- 172.21.15.148:0/369571343 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec051030 con 0x55781fd7e190 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7faadf7fe700 1 -- 172.21.15.148:0/369571343 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec013e00 con 0x55781fd7e190 2023-10-24T00:47:13.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7faadf7fe700 1 -- 172.21.15.148:0/369571343 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec04ce80 con 0x55781fd7e190 2023-10-24T00:47:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 -- 172.21.15.148:0/369571343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 msgr2=0x55781fd54f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7faaec009e30 tx=0x7faaec039000).stop 2023-10-24T00:47:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 -- 172.21.15.148:0/369571343 shutdown_connections 2023-10-24T00:47:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fd54f00 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd54b20 0x55781fdad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/369571343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd57980 0x55781fd7a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 -- 172.21.15.148:0/369571343 >> 172.21.15.148:0/369571343 conn(0x55781fb11e40 msgr2=0x55781fd51b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 -- 172.21.15.148:0/369571343 shutdown_connections 2023-10-24T00:47:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.373+0000 7fab0d55eb80 1 -- 172.21.15.148:0/369571343 wait complete. 2023-10-24T00:47:13.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.374+0000 7fab0d55eb80 1 -- start start 2023-10-24T00:47:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.374+0000 7fab0d55eb80 1 Processor -- start 2023-10-24T00:47:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd54b20 0x55781fd9e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd57980 0x55781fe00880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fd9e7e0 con 0x55781fd7e190 2023-10-24T00:47:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55781fdfa420 con 0x55781fd54b20 2023-10-24T00:47:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55781fd7d050 con 0x55781fd57980 2023-10-24T00:47:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7fab0d55eb80 10 client.0 ll_register_callbacks cb 0x55781fd52d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:47:13.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50300/0 (socket says 172.21.15.148:50300) 2023-10-24T00:47:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 -- 172.21.15.148:0/1886987336 learned_addr learned my addr 172.21.15.148:0/1886987336 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faaf9161700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd57980 0x55781fe00880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faaf9962700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd54b20 0x55781fd9e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 -- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd57980 msgr2=0x55781fe00880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd57980 0x55781fe00880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 -- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd54b20 msgr2=0x55781fd9e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd54b20 0x55781fd9e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 -- 172.21.15.148:0/1886987336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55781fc9b480 con 0x55781fd7e190 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faafa163700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7faaec050d90 tx=0x7faaec029040).ready entity=mon.0 client_cookie=befbc76a0bd6ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.375+0000 7faad3fff700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:47:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec04ce80 con 0x55781fd7e190 2023-10-24T00:47:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faaec051030 con 0x55781fd7e190 2023-10-24T00:47:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faae4007230 con 0x55781fd7e190 2023-10-24T00:47:13.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaec04fff0 con 0x55781fd7e190 2023-10-24T00:47:13.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 10 client.7902 fetch_fsmap learned FSMap version 43 2023-10-24T00:47:13.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55781fb12f80 con 0x55781fd7e190 2023-10-24T00:47:13.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec05a070 con 0x55781fd7e190 2023-10-24T00:47:13.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faaec050150 con 0x55781fd7e190 2023-10-24T00:47:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 10 client.7902 fetch_fsmap finished waiting for FSMap version 43 2023-10-24T00:47:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 10 client.7902 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T00:47:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 20 client.7902 populate_metadata read hostname 'smithi148' 2023-10-24T00:47:13.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd54f00 0x55781fd552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 4 client.7902 mds_command: new command op to 7710 tid=0[{"prefix": "status"}] 2023-10-24T00:47:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 --> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55781fb0dca0 con 0x55781fd54f00 2023-10-24T00:47:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.376+0000 7faaf9962700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd54f00 0x55781fd552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7faad3fff700 10 client.7902 ms_handle_connect on v2:172.21.15.150:6835/2431879212 2023-10-24T00:47:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7faaf9962700 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd54f00 0x55781fd552e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6cf2806815d00e0f server_cookie=945cd7926528ab93 in_seq=0 out_seq=0 2023-10-24T00:47:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7faad3fff700 1 -- 172.21.15.148:0/1886987336 <== mds.0 v2:172.21.15.150:6835/2431879212 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55781fb0dca0 con 0x55781fd54f00 2023-10-24T00:47:13.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7faad3fff700 10 client.7902 handle_command_reply: tid=0 2023-10-24T00:47:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 client.7902 shutdown 2023-10-24T00:47:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 msgr2=0x55781fe03540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7faaec050d90 tx=0x7faaec029040).stop 2023-10-24T00:47:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 shutdown_connections 2023-10-24T00:47:13.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55781fd7e190 0x55781fe03540 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:6835/2431879212,v1:172.21.15.150:6837/2431879212] conn(0x55781fd54f00 0x55781fd552e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55781fd54b20 0x55781fd9e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7faad3fff700 0 client.7902 ms_handle_reset on v2:172.21.15.150:6835/2431879212 2023-10-24T00:47:13.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 --2- 172.21.15.148:0/1886987336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55781fd57980 0x55781fe00880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 >> 172.21.15.148:0/1886987336 conn(0x55781fb11e40 msgr2=0x55781fd79de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 shutdown_connections 2023-10-24T00:47:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 1 -- 172.21.15.148:0/1886987336 wait complete. 2023-10-24T00:47:13.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.377+0000 7fab0d55eb80 20 client.7902 trim_cache size 0 max 16384 2023-10-24T00:47:13.414 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:47:13.414 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:47:13.415 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:47:13.415 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 7710, 2023-10-24T00:47:13.415 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:47:13.415 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:47:13.415 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:47:13.416 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.1259602760000007, 2023-10-24T00:47:13.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 43, 2023-10-24T00:47:13.416 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 127, 2023-10-24T00:47:13.416 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 127, 2023-10-24T00:47:13.416 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 14.201148042 2023-10-24T00:47:13.417 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:47:13.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 msgr2=0x7faad8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 0x7faad8061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7faaf4150850 tx=0x7faaf0008040).stop 2023-10-24T00:47:13.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 msgr2=0x7faaf4164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7faaf4084250 tx=0x7faaf40c6660).stop 2023-10-24T00:47:13.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 shutdown_connections 2023-10-24T00:47:13.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faad805f150 0x7faad8061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faaf41547e0 0x7faaf4164b60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faaf40c0b30 0x7faaf40ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 --2- 172.21.15.148:0/4093606374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faaf4154400 0x7faaf41652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 >> 172.21.15.148:0/4093606374 conn(0x7faaf40946a0 msgr2=0x7faaf4064b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 shutdown_connections 2023-10-24T00:47:13.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.378+0000 7faafbbc6700 1 -- 172.21.15.148:0/4093606374 wait complete. 2023-10-24T00:47:13.421 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:47:13.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.522+0000 7f76c28e2700 1 Processor -- start 2023-10-24T00:47:13.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.522+0000 7f76c28e2700 1 -- start start 2023-10-24T00:47:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f76bc1575e0 0x7f76bc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1579c0 0x7f76bc0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76bc0aaae0 0x7f76bc0aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0cae10 con 0x7f76bc0aaae0 2023-10-24T00:47:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0c94c0 con 0x7f76bc1575e0 2023-10-24T00:47:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c28e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0ae140 con 0x7f76bc1579c0 2023-10-24T00:47:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c0e7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76bc0aaae0 0x7f76bc0aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c0e7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f76bc0aaae0 0x7f76bc0aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50304/0 (socket says 172.21.15.148:50304) 2023-10-24T00:47:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.523+0000 7f76c0e7f700 1 -- 172.21.15.148:0/1907830841 learned_addr learned my addr 172.21.15.148:0/1907830841 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76bbfff700 1 --2- 172.21.15.148:0/1907830841 >> v2:172.21.15.150:3300/0 conn(0x7f76bc1575e0 0x7f76bc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76bb7fe700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1579c0 0x7f76bc0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 -- 172.21.15.148:0/1907830841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1579c0 msgr2=0x7f76bc0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1579c0 0x7f76bc0ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 -- 172.21.15.148:0/1907830841 >> v2:172.21.15.150:3300/0 conn(0x7f76bc1575e0 msgr2=0x7f76bc0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 --2- 172.21.15.148:0/1907830841 >> v2:172.21.15.150:3300/0 conn(0x7f76bc1575e0 0x7f76bc0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 -- 172.21.15.148:0/1907830841 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0ae6c0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c0e7f700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc0aaf30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f76bc083690 tx=0x7f76b4009840).ready entity=mon.0 client_cookie=2904d0b8d2336c34 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76baffd700 1 -- 172.21.15.148:0/1907830841 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400e070 con 0x7f76bc0aaae0 2023-10-24T00:47:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76baffd700 1 -- 172.21.15.148:0/1907830841 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b400ba50 con 0x7f76bc0aaae0 2023-10-24T00:47:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76baffd700 1 -- 172.21.15.148:0/1907830841 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400bdd0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 -- 172.21.15.148:0/1907830841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 msgr2=0x7f76bc0aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc0aaf30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f76bc083690 tx=0x7f76b4009840).stop 2023-10-24T00:47:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 -- 172.21.15.148:0/1907830841 shutdown_connections 2023-10-24T00:47:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc0aaf30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 --2- 172.21.15.148:0/1907830841 >> v2:172.21.15.150:3300/0 conn(0x7f76bc1575e0 0x7f76bc0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 --2- 172.21.15.148:0/1907830841 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1579c0 0x7f76bc0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 -- 172.21.15.148:0/1907830841 >> 172.21.15.148:0/1907830841 conn(0x7f76bc094520 msgr2=0x7f76bc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 -- 172.21.15.148:0/1907830841 shutdown_connections 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.524+0000 7f76c28e2700 1 -- 172.21.15.148:0/1907830841 wait complete. 2023-10-24T00:47:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.525+0000 7f76c28e2700 1 Processor -- start 2023-10-24T00:47:13.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 -- start start 2023-10-24T00:47:13.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1575e0 0x7f76bc0991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76bc1579c0 0x7f76bc099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc151730 con 0x7f76bc0aaae0 2023-10-24T00:47:13.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc154120 con 0x7f76bc1579c0 2023-10-24T00:47:13.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.526+0000 7f76c28e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc153590 con 0x7f76bc1575e0 2023-10-24T00:47:13.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50310/0 (socket says 172.21.15.148:50310) 2023-10-24T00:47:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 -- 172.21.15.148:0/3857343551 learned_addr learned my addr 172.21.15.148:0/3857343551 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bb7fe700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1575e0 0x7f76bc0991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76c0e7f700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76bc1579c0 0x7f76bc099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 -- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1575e0 msgr2=0x7f76bc0991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1575e0 0x7f76bc0991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 -- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76bc1579c0 msgr2=0x7f76bc099b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76bc1579c0 0x7f76bc099b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 -- 172.21.15.148:0/3857343551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009ae0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76bbfff700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f76ac00d860 tx=0x7f76ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac011590 con 0x7f76bc0aaae0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac0116f0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc1537f0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac011a70 con 0x7f76bc0aaae0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.527+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc153db0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.528+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc0ab360 con 0x7f76bc0aaae0 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.528+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f76ac01c460 con 0x7f76bc0aaae0 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.529+0000 7f76a3fff700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 0x7f76a8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.529+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f76ac07a160 con 0x7f76bc0aaae0 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.529+0000 7f76bb7fe700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 0x7f76a8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.529+0000 7f76bb7fe700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 0x7f76a8061640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76bc1511b0 tx=0x7f76b0008040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:13.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.533+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76ac04b3d0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.738+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76bc047480 con 0x7f76bc0aaae0 2023-10-24T00:47:13.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.739+0000 7f76a3fff700 1 -- 172.21.15.148:0/3857343551 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76ac04e9f0 con 0x7f76bc0aaae0 2023-10-24T00:47:13.740 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:47:13.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 msgr2=0x7f76a8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 0x7f76a8061640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f76bc1511b0 tx=0x7f76b0008040).stop 2023-10-24T00:47:13.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 msgr2=0x7f76bc14d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:13.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f76ac00d860 tx=0x7f76ac008040).stop 2023-10-24T00:47:13.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 shutdown_connections 2023-10-24T00:47:13.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76bc1579c0 0x7f76bc099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f76a805f180 0x7f76a8061640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76bc0aaae0 0x7f76bc14d540 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 --2- 172.21.15.148:0/3857343551 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76bc1575e0 0x7f76bc0991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:13.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 >> 172.21.15.148:0/3857343551 conn(0x7f76bc094520 msgr2=0x7f76bc0abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:13.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 shutdown_connections 2023-10-24T00:47:13.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:13.741+0000 7f76c28e2700 1 -- 172.21.15.148:0/3857343551 wait complete. 2023-10-24T00:47:13.753 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:47:13.753 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:47:13.753 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:47:13.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:47:13.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:47:13.757 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:47:13.758 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:47:13.758 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:47:13.759 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:47:13.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:13.760 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:47:13.775 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:47:13.775 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:47:13.775 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:47:13.776 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.776 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:47:13.776 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.776 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:47:13.777 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:47:13.777 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:47:13.777 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:47:13.777 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:47:13.777 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:47:13.778 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:47:13.778 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:47:13.778 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:47:13.778 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:47:13.778 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:47:13.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41295sec preferred_lft 41295sec 2023-10-24T00:47:13.779 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:47:13.779 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.779 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:47:13.779 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:47:13.780 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:47:13.780 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.780 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:47:13.780 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.780 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:47:13.781 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:47:13.781 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:47:13.781 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.781 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:47:13.781 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:47:13.782 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:47:13.782 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:47:13.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:13.783 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:47:13.838 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:47:13.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:13.840 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:47:13.896 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:47:13.896 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:47:13.897 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:47:13.897 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:47:13.897 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:47:13.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:13.898 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:47:13.898 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:47:13.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:47:13.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:47:13.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:47:13.901 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:47:13.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:13.997 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:47:14.012 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:47:14.012 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:47:14.013 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:47:14.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:14.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:47:14.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:14.077 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:47:14.131 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:47:14.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:47:14.212 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:47:14.212 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:47:14.238 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:47:14.238 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:47:14.240 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:47:14.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:47:14.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:47:14.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:47:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.459+0000 7fe82b59e700 1 Processor -- start 2023-10-24T00:47:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.459+0000 7fe82b59e700 1 -- start start 2023-10-24T00:47:14.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe82c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0a7de0 con 0x7fe82c1541a0 2023-10-24T00:47:14.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0c1050 con 0x7fe82c0c0bc0 2023-10-24T00:47:14.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0aa7c0 con 0x7fe82c154580 2023-10-24T00:47:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe82c1541a0 0x7fe82c0c6940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39202/0 (socket says 172.21.15.148:39202) 2023-10-24T00:47:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82a59c700 1 -- 172.21.15.148:0/1808757874 learned_addr learned my addr 172.21.15.148:0/1808757874 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe829d9b700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe82c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695835598 0 0) 0x7fe82c0a7de0 con 0x7fe82c1541a0 2023-10-24T00:47:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8140033f0 con 0x7fe82c1541a0 2023-10-24T00:47:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794446884 0 0) 0x7fe8140033f0 con 0x7fe82c1541a0 2023-10-24T00:47:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 msgr2=0x7fe82c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe82c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 >> v1:172.21.15.150:6789/0 conn(0x7fe82c0c0bc0 legacy=0x7fe82c0a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0c8840 con 0x7fe82c1541a0 2023-10-24T00:47:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.460+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe81c001470 con 0x7fe82c1541a0 2023-10-24T00:47:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 >> v1:172.21.15.148:6789/0 conn(0x7fe82c1541a0 legacy=0x7fe82c0c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe814003910 0x7fe814003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe814004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe814004b80 0x7fe814005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0aa7c0 con 0x7fe814004b80 2023-10-24T00:47:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81400b8e0 con 0x7fe814003910 2023-10-24T00:47:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81400ba70 con 0x7fe82c154580 2023-10-24T00:47:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe814004b80 0x7fe814005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82a59c700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe814003910 0x7fe814003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe829d9b700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe814004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 -- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 msgr2=0x7fe814004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe82c154580 0x7fe814004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 -- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe814003910 msgr2=0x7fe814003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe814003910 0x7fe814003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 -- 172.21.15.148:0/1808757874 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140033f0 con 0x7fe814004b80 2023-10-24T00:47:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe814004b80 0x7fe814005000 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe824001f50 tx=0x7fe824007f10).ready entity=mon.0 client_cookie=cdb552d1bfce888d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240017e0 con 0x7fe814004b80 2023-10-24T00:47:14.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82400c6c0 con 0x7fe814004b80 2023-10-24T00:47:14.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.461+0000 7fe82959a700 1 -- 172.21.15.148:0/1808757874 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400ca40 con 0x7fe814004b80 2023-10-24T00:47:14.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 -- 172.21.15.148:0/1808757874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe814004b80 msgr2=0x7fe814005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 --2- 172.21.15.148:0/1808757874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe814004b80 0x7fe814005000 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fe824001f50 tx=0x7fe824007f10).stop 2023-10-24T00:47:14.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82ad9d700 1 -- 172.21.15.148:0/1808757874 reap_dead start 2023-10-24T00:47:14.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 -- 172.21.15.148:0/1808757874 shutdown_connections 2023-10-24T00:47:14.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 -- 172.21.15.148:0/1808757874 >> 172.21.15.148:0/1808757874 conn(0x7fe82c0944f0 msgr2=0x7fe82c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:14.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 -- 172.21.15.148:0/1808757874 shutdown_connections 2023-10-24T00:47:14.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.462+0000 7fe82b59e700 1 -- 172.21.15.148:0/1808757874 wait complete. 2023-10-24T00:47:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.463+0000 7fe82b59e700 1 Processor -- start 2023-10-24T00:47:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.463+0000 7fe82b59e700 1 -- start start 2023-10-24T00:47:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814004b80 0x7fe82c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 0x7fe82c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0c4a00 con 0x7fe82c14d7e0 2023-10-24T00:47:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c15a900 con 0x7fe82c159f90 2023-10-24T00:47:14.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c151490 con 0x7fe814004b80 2023-10-24T00:47:14.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50336/0 (socket says 172.21.15.148:50336) 2023-10-24T00:47:14.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 -- 172.21.15.148:0/3485240090 learned_addr learned my addr 172.21.15.148:0/3485240090 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:14.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82a59c700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814004b80 0x7fe82c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 0x7fe82c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 -- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814004b80 msgr2=0x7fe82c150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814004b80 0x7fe82c150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 -- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 msgr2=0x7fe82c15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 0x7fe82c15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 -- 172.21.15.148:0/3485240090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0c43b0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe82ad9d700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 0x7fe82c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:47:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe829d9b700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe8200119c0 tx=0x7fe820009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.464+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011eb0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.465+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82000f8e0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.465+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000fca0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.465+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c0c4690 con 0x7fe82c14d7e0 2023-10-24T00:47:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.465+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c0c3ff0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.466+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c0c4b70 con 0x7fe82c14d7e0 2023-10-24T00:47:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.466+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe820014650 con 0x7fe82c14d7e0 2023-10-24T00:47:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.466+0000 7fe81a7fc700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 0x7fe80c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.466+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe82007ae00 con 0x7fe82c14d7e0 2023-10-24T00:47:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.466+0000 7fe82a59c700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 0x7fe80c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.467+0000 7fe82a59c700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 0x7fe80c061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe81c0010e0 tx=0x7fe81c001e70).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.470+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe82004c0d0 con 0x7fe82c14d7e0 2023-10-24T00:47:14.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.658+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe82c047480 con 0x7fe80c05f150 2023-10-24T00:47:14.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.660+0000 7fe81a7fc700 1 -- 172.21.15.148:0/3485240090 <== mgr.6958 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe82c047480 con 0x7fe80c05f150 2023-10-24T00:47:14.662 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:47:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:47:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:47:14.662 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:47:14.662 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:47:14.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 msgr2=0x7fe80c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 0x7fe80c061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe81c0010e0 tx=0x7fe81c001e70).stop 2023-10-24T00:47:14.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 msgr2=0x7fe82c14cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fe8200119c0 tx=0x7fe820009060).stop 2023-10-24T00:47:14.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 shutdown_connections 2023-10-24T00:47:14.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe82c159f90 0x7fe82c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe814004b80 0x7fe82c150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe80c05f150 0x7fe80c061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 --2- 172.21.15.148:0/3485240090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe82c14d7e0 0x7fe82c14cf60 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 >> 172.21.15.148:0/3485240090 conn(0x7fe82c0944f0 msgr2=0x7fe82c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 shutdown_connections 2023-10-24T00:47:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.662+0000 7fe82b59e700 1 -- 172.21.15.148:0/3485240090 wait complete. 2023-10-24T00:47:14.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:47:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.789+0000 7fa774ab0700 1 Processor -- start 2023-10-24T00:47:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.789+0000 7fa774ab0700 1 -- start start 2023-10-24T00:47:14.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa774ab0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770154300 0x7fa7700a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa774ab0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7701546e0 0x7fa7700c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa774ab0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700c6880 con 0x7fa7700a8280 2023-10-24T00:47:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa774ab0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7700c1550 con 0x7fa7701546e0 2023-10-24T00:47:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa774ab0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700c1270 con 0x7fa770154300 2023-10-24T00:47:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76dd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7701546e0 0x7fa7700c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76ed9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa7700a8280 0x7fa7700c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39216/0 (socket says 172.21.15.148:39216) 2023-10-24T00:47:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76dd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7701546e0 0x7fa7700c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50340/0 (socket says 172.21.15.148:50340) 2023-10-24T00:47:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76ed9d700 1 -- 172.21.15.148:0/1903711696 learned_addr learned my addr 172.21.15.148:0/1903711696 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76e59c700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770154300 0x7fa7700a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76dd9b700 1 -- 172.21.15.148:0/1903711696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770154300 msgr2=0x7fa7700a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:14.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76dd9b700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770154300 0x7fa7700a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.790+0000 7fa76dd9b700 1 -- 172.21.15.148:0/1903711696 >> v1:172.21.15.148:6789/0 conn(0x7fa7700a8280 legacy=0x7fa7700c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76dd9b700 1 -- 172.21.15.148:0/1903711696 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700c6230 con 0x7fa7701546e0 2023-10-24T00:47:14.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76d59a700 1 -- 172.21.15.148:0/1903711696 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426236040 0 0) 0x7fa7700c6880 con 0x7fa7700a8280 2023-10-24T00:47:14.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76dd9b700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7701546e0 0x7fa7700c07b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fa764009760 tx=0x7fa764009060).ready entity=mon.0 client_cookie=75162b46308f563a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76d59a700 1 -- 172.21.15.148:0/1903711696 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640090d0 con 0x7fa7701546e0 2023-10-24T00:47:14.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76d59a700 1 -- 172.21.15.148:0/1903711696 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400b580 con 0x7fa7701546e0 2023-10-24T00:47:14.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa76d59a700 1 -- 172.21.15.148:0/1903711696 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400b900 con 0x7fa7701546e0 2023-10-24T00:47:14.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 -- 172.21.15.148:0/1903711696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7701546e0 msgr2=0x7fa7700c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7701546e0 0x7fa7700c07b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fa764009760 tx=0x7fa764009060).stop 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 -- 172.21.15.148:0/1903711696 shutdown_connections 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa770154300 0x7fa7700a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 --2- 172.21.15.148:0/1903711696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7701546e0 0x7fa7700c07b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 -- 172.21.15.148:0/1903711696 >> 172.21.15.148:0/1903711696 conn(0x7fa770084ce0 msgr2=0x7fa770094600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 -- 172.21.15.148:0/1903711696 shutdown_connections 2023-10-24T00:47:14.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.791+0000 7fa774ab0700 1 -- 172.21.15.148:0/1903711696 wait complete. 2023-10-24T00:47:14.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.792+0000 7fa774ab0700 1 Processor -- start 2023-10-24T00:47:14.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 -- start start 2023-10-24T00:47:14.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700a8280 0x7fa770150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 0x7fa7700c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700afa20 con 0x7fa770154300 2023-10-24T00:47:14.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700c8260 con 0x7fa7701546e0 2023-10-24T00:47:14.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa774ab0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa770150670 con 0x7fa7700a8280 2023-10-24T00:47:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa76dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa76dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50346/0 (socket says 172.21.15.148:50346) 2023-10-24T00:47:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.793+0000 7fa76dd9b700 1 -- 172.21.15.148:0/3380972672 learned_addr learned my addr 172.21.15.148:0/3380972672 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76e59c700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700a8280 0x7fa770150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76ed9d700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 0x7fa7700c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 -- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700a8280 msgr2=0x7fa770150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700a8280 0x7fa770150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 -- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 msgr2=0x7fa7700c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 0x7fa7700c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 -- 172.21.15.148:0/3380972672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640092a0 con 0x7fa770154300 2023-10-24T00:47:14.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76ed9d700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 0x7fa7700c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:47:14.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa76dd9b700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa764011000 tx=0x7fa764017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764006970 con 0x7fa770154300 2023-10-24T00:47:14.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400bcc0 con 0x7fa770154300 2023-10-24T00:47:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700aeda0 con 0x7fa770154300 2023-10-24T00:47:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400b900 con 0x7fa770154300 2023-10-24T00:47:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.794+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7700af360 con 0x7fa770154300 2023-10-24T00:47:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.795+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77006c6b0 con 0x7fa770154300 2023-10-24T00:47:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.795+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa76401b620 con 0x7fa770154300 2023-10-24T00:47:14.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.796+0000 7fa75e7fc700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 0x7fa750061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.796+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa76407bb30 con 0x7fa770154300 2023-10-24T00:47:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.796+0000 7fa76e59c700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 0x7fa750061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.796+0000 7fa76e59c700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 0x7fa750061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa760009fd0 tx=0x7fa76000b040).ready entity=mgr.6958 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:14.800+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa76404cda0 con 0x7fa770154300 2023-10-24T00:47:15.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.008+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa7700c6510 con 0x7fa770154300 2023-10-24T00:47:15.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.928+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fa764079900 con 0x7fa770154300 2023-10-24T00:47:15.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.930+0000 7fa75e7fc700 1 -- 172.21.15.148:0/3380972672 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v49) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa764043120 con 0x7fa770154300 2023-10-24T00:47:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 msgr2=0x7fa750061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 0x7fa750061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa760009fd0 tx=0x7fa76000b040).stop 2023-10-24T00:47:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 msgr2=0x7fa7700c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa764011000 tx=0x7fa764017000).stop 2023-10-24T00:47:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 shutdown_connections 2023-10-24T00:47:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7701546e0 0x7fa7700c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7700a8280 0x7fa770150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa75005f150 0x7fa750061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 --2- 172.21.15.148:0/3380972672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa770154300 0x7fa7700c7880 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 >> 172.21.15.148:0/3380972672 conn(0x7fa770084ce0 msgr2=0x7fa7700c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:15.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 shutdown_connections 2023-10-24T00:47:15.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:15.933+0000 7fa774ab0700 1 -- 172.21.15.148:0/3380972672 wait complete. 2023-10-24T00:47:15.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:47:16.072 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:16.070+0000 7f8d1bb82680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:47:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.073+0000 7f53bd9e8700 1 Processor -- start 2023-10-24T00:47:16.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.073+0000 7f53bd9e8700 1 -- start start 2023-10-24T00:47:16.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53bd9e8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53b80c6950 0x7f53b8155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53bd9e8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b8155c00 con 0x7f53b8152290 2023-10-24T00:47:16.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53bd9e8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80c7b80 con 0x7f53b80c1950 2023-10-24T00:47:16.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53bd9e8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80c8800 con 0x7f53b80c6950 2023-10-24T00:47:16.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53b6ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f53b8152290 0x7f53b80c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39234/0 (socket says 172.21.15.148:39234) 2023-10-24T00:47:16.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53b6ffd700 1 -- 172.21.15.148:0/4003951041 learned_addr learned my addr 172.21.15.148:0/4003951041 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:47:16.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53b67fc700 1 --2- 172.21.15.148:0/4003951041 >> v2:172.21.15.150:3300/0 conn(0x7f53b80c6950 0x7f53b8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53b5ffb700 1 -- 172.21.15.148:0/4003951041 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603333153 0 0) 0x7f53b8155c00 con 0x7f53b8152290 2023-10-24T00:47:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.074+0000 7f53b5ffb700 1 -- 172.21.15.148:0/4003951041 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a00033f0 con 0x7f53b8152290 2023-10-24T00:47:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b67fc700 1 -- 172.21.15.148:0/4003951041 >> v1:172.21.15.150:6789/0 conn(0x7f53b80c1950 legacy=0x7f53b815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b67fc700 1 -- 172.21.15.148:0/4003951041 >> v1:172.21.15.148:6789/0 conn(0x7f53b8152290 legacy=0x7f53b80c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b67fc700 1 -- 172.21.15.148:0/4003951041 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80c7e60 con 0x7f53b80c6950 2023-10-24T00:47:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b67fc700 1 --2- 172.21.15.148:0/4003951041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c6950 0x7f53b8155710 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f53a8009760 tx=0x7f53a8009060).ready entity=mon.1 client_cookie=f3b5dacc818bb0bc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b5ffb700 1 -- 172.21.15.148:0/4003951041 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80090d0 con 0x7f53b80c6950 2023-10-24T00:47:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b5ffb700 1 -- 172.21.15.148:0/4003951041 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a800f510 con 0x7f53b80c6950 2023-10-24T00:47:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53b5ffb700 1 -- 172.21.15.148:0/4003951041 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a800f890 con 0x7f53b80c6950 2023-10-24T00:47:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53bd9e8700 1 -- 172.21.15.148:0/4003951041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c6950 msgr2=0x7f53b8155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/4003951041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c6950 0x7f53b8155710 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f53a8009760 tx=0x7f53a8009060).stop 2023-10-24T00:47:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53bd9e8700 1 -- 172.21.15.148:0/4003951041 shutdown_connections 2023-10-24T00:47:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/4003951041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c6950 0x7f53b8155710 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.075+0000 7f53bd9e8700 1 -- 172.21.15.148:0/4003951041 >> 172.21.15.148:0/4003951041 conn(0x7f53b80946c0 msgr2=0x7f53b806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.076+0000 7f53bd9e8700 1 -- 172.21.15.148:0/4003951041 shutdown_connections 2023-10-24T00:47:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.076+0000 7f53bd9e8700 1 -- 172.21.15.148:0/4003951041 wait complete. 2023-10-24T00:47:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.077+0000 7f53bd9e8700 1 Processor -- start 2023-10-24T00:47:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.077+0000 7f53bd9e8700 1 -- start start 2023-10-24T00:47:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.077+0000 7f53bd9e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c1950 0x7f53b80b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.077+0000 7f53bd9e8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53b80c6950 0x7f53b81591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.077+0000 7f53bd9e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53bd9e8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8159ba0 con 0x7f53b8152290 2023-10-24T00:47:16.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53bd9e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80c2f60 con 0x7f53b80c1950 2023-10-24T00:47:16.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53bd9e8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b814c3a0 con 0x7f53b80c6950 2023-10-24T00:47:16.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50386/0 (socket says 172.21.15.148:50386) 2023-10-24T00:47:16.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 -- 172.21.15.148:0/2407603469 learned_addr learned my addr 172.21.15.148:0/2407603469 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:16.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b6ffd700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c1950 0x7f53b80b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b67fc700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53b80c6950 0x7f53b81591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 -- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53b80c6950 msgr2=0x7f53b81591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53b80c6950 0x7f53b81591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 -- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c1950 msgr2=0x7f53b80b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c1950 0x7f53b80b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 -- 172.21.15.148:0/2407603469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80092a0 con 0x7f53b8152290 2023-10-24T00:47:16.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53b77fe700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f53b000c710 tx=0x7f53b0001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:16.087 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:16.078+0000 7fc8ff0eb680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:47:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b000e4a0 con 0x7f53b8152290 2023-10-24T00:47:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b000e600 con 0x7f53b8152290 2023-10-24T00:47:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b000e980 con 0x7f53b8152290 2023-10-24T00:47:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b814c680 con 0x7f53b8152290 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.078+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b80c34e0 con 0x7f53b8152290 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.079+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f53b0012400 con 0x7f53b8152290 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.080+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b80c36d0 con 0x7f53b8152290 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.080+0000 7f539effd700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 0x7f53a4061630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.080+0000 7f53b6ffd700 1 -- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 msgr2=0x7f53a4061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:16.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.080+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f53b0079840 con 0x7f53b8152290 2023-10-24T00:47:16.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.080+0000 7f53b6ffd700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 0x7f53a4061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:47:16.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.084+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f53b0048af0 con 0x7f53b8152290 2023-10-24T00:47:16.136 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:16.135+0000 7f8d1bb82680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:47:16.156 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:16.154+0000 7fc8ff0eb680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:47:16.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.269+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f53b80c8140 con 0x7f53b8152290 2023-10-24T00:47:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.273+0000 7f539effd700 1 -- 172.21.15.148:0/2407603469 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f53b0017070 con 0x7f53b8152290 2023-10-24T00:47:16.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 msgr2=0x7f53a4061630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:47:16.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 0x7f53a4061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 msgr2=0x7f53b81596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f53b000c710 tx=0x7f53b0001540).stop 2023-10-24T00:47:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 shutdown_connections 2023-10-24T00:47:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f53a405f170 0x7f53a4061630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:16.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.275+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53b8152290 0x7f53b81596b0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.276+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b80c1950 0x7f53b80b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.276+0000 7f53bd9e8700 1 --2- 172.21.15.148:0/2407603469 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53b80c6950 0x7f53b81591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.276+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 >> 172.21.15.148:0/2407603469 conn(0x7f53b80946c0 msgr2=0x7f53b80cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.276+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 shutdown_connections 2023-10-24T00:47:16.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.276+0000 7f53bd9e8700 1 -- 172.21.15.148:0/2407603469 wait complete. 2023-10-24T00:47:16.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:16.290 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T00:47:16.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-24T00:47:16.415 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:16.413+0000 7f8d1bb82680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:47:16.441 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:16.440+0000 7fc8ff0eb680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:47:16.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.473+0000 7f79c1532700 1 Processor -- start 2023-10-24T00:47:16.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.473+0000 7f79c1532700 1 -- start start 2023-10-24T00:47:16.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79c1532700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79c1532700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79bc0acd30 0x7f79bc155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79c1532700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0c2f60 con 0x7f79bc155a10 2023-10-24T00:47:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79c1532700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc063d60 con 0x7f79bc0acd30 2023-10-24T00:47:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79c1532700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0c2910 con 0x7f79bc068b00 2023-10-24T00:47:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79bc0acd30 0x7f79bc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79baffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79bc0acd30 0x7f79bc155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51364/0 (socket says 172.21.15.148:51364) 2023-10-24T00:47:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 -- 172.21.15.148:0/539862125 learned_addr learned my addr 172.21.15.148:0/539862125 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79baffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:51386/0 (socket says 172.21.15.148:51386) 2023-10-24T00:47:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 -- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 msgr2=0x7f79bc068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 -- 172.21.15.148:0/539862125 >> v1:172.21.15.150:6789/0 conn(0x7f79bc155a10 legacy=0x7f79bc0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 -- 172.21.15.148:0/539862125 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0c2bf0 con 0x7f79bc0acd30 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79baffd700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79b9ffb700 1 -- 172.21.15.148:0/539862125 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920212232 0 0) 0x7f79bc0c2f60 con 0x7f79bc155a10 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.475+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc155520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f79ac006fd0 tx=0x7f79ac0090f0).ready entity=mon.1 client_cookie=ae254f05ee3ba98e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79b9ffb700 1 -- 172.21.15.148:0/539862125 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00b580 con 0x7f79bc0acd30 2023-10-24T00:47:16.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79b9ffb700 1 -- 172.21.15.148:0/539862125 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00b6e0 con 0x7f79bc0acd30 2023-10-24T00:47:16.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79b9ffb700 1 -- 172.21.15.148:0/539862125 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00ba60 con 0x7f79bc0acd30 2023-10-24T00:47:16.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 -- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 msgr2=0x7f79bc155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc155520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f79ac006fd0 tx=0x7f79ac0090f0).stop 2023-10-24T00:47:16.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 -- 172.21.15.148:0/539862125 shutdown_connections 2023-10-24T00:47:16.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc068b00 0x7f79bc068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 --2- 172.21.15.148:0/539862125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc155520 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 -- 172.21.15.148:0/539862125 >> 172.21.15.148:0/539862125 conn(0x7f79bc0c72a0 msgr2=0x7f79bc0c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 -- 172.21.15.148:0/539862125 shutdown_connections 2023-10-24T00:47:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.476+0000 7f79c1532700 1 -- 172.21.15.148:0/539862125 wait complete. 2023-10-24T00:47:16.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 Processor -- start 2023-10-24T00:47:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 -- start start 2023-10-24T00:47:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc155a10 0x7f79bc0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0c5b80 con 0x7f79bc068b00 2023-10-24T00:47:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0bae30 con 0x7f79bc0acd30 2023-10-24T00:47:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79c1532700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14e670 con 0x7f79bc155a10 2023-10-24T00:47:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.478+0000 7f79baffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50396/0 (socket says 172.21.15.148:50396) 2023-10-24T00:47:16.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 -- 172.21.15.148:0/2889368556 learned_addr learned my addr 172.21.15.148:0/2889368556 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79bb7fe700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc155a10 0x7f79bc0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc155a10 msgr2=0x7f79bc0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc155a10 0x7f79bc0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 msgr2=0x7f79bc0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00092a0 con 0x7f79bc068b00 2023-10-24T00:47:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79baffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f79b000e980 tx=0x7f79b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0012600 con 0x7f79bc068b00 2023-10-24T00:47:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0012760 con 0x7f79bc068b00 2023-10-24T00:47:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac009370 con 0x7f79bc068b00 2023-10-24T00:47:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0012ae0 con 0x7f79bc068b00 2023-10-24T00:47:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.479+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc14ec30 con 0x7f79bc068b00 2023-10-24T00:47:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.480+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc047480 con 0x7f79bc068b00 2023-10-24T00:47:16.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.481+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f79b001b400 con 0x7f79bc068b00 2023-10-24T00:47:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.481+0000 7f79a2ffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.481+0000 7f79ba7fc700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.481+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f79b007a6b0 con 0x7f79bc068b00 2023-10-24T00:47:16.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.481+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:47:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.485+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f79b004b920 con 0x7f79bc068b00 2023-10-24T00:47:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.681+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc0baff0 con 0x7f79a805f1d0 2023-10-24T00:47:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.682+0000 7f79ba7fc700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:16.682+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:47:17.030 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.029+0000 7f8d1bb82680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:47:17.059 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.057+0000 7fc8ff0eb680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:47:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:17.083+0000 7f79ba7fc700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:17.083+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:47:17.102 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.101+0000 7f8d1bb82680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:47:17.131 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.130+0000 7fc8ff0eb680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:47:17.291 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.289+0000 7f8d1bb82680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:47:17.315 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.314+0000 7fc8ff0eb680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:47:17.710 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.709+0000 7f8d1bb82680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:47:17.735 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.734+0000 7fc8ff0eb680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:47:17.813 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.812+0000 7f8d1bb82680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:47:17.838 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.837+0000 7fc8ff0eb680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:47:17.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:17.884+0000 7f79ba7fc700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:17.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:17.884+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:47:17.967 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:17.965+0000 7f8d1bb82680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:47:17.990 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:17.989+0000 7fc8ff0eb680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:47:18.042 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:18.041+0000 7f8d1bb82680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:47:18.064 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:18.063+0000 7fc8ff0eb680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:47:18.110 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:18.108+0000 7f8d1bb82680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:47:18.132 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:18.131+0000 7fc8ff0eb680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:47:18.369 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:18.368+0000 7f8d1bb82680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:47:18.388 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:18.387+0000 7fc8ff0eb680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:47:18.557 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:18.556+0000 7f8d1bb82680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:47:18.571 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:18.570+0000 7fc8ff0eb680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:47:19.210 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.208+0000 7f8d1bb82680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:47:19.219 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.218+0000 7fc8ff0eb680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:47:19.279 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.278+0000 7f8d1bb82680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:47:19.288 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.287+0000 7fc8ff0eb680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:47:19.353 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.352+0000 7f8d1bb82680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:47:19.364 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.363+0000 7fc8ff0eb680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:47:19.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:19.486+0000 7f79ba7fc700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:47:19.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:19.486+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:47:19.499 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.498+0000 7f8d1bb82680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:47:19.512 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.511+0000 7fc8ff0eb680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:47:19.570 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.569+0000 7f8d1bb82680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:47:19.583 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.581+0000 7fc8ff0eb680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:47:19.686 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.684+0000 7f8d1bb82680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:47:19.697 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.695+0000 7fc8ff0eb680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:47:19.795 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:19.793+0000 7f8d1bb82680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:47:19.806 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:19.804+0000 7fc8ff0eb680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:47:20.088 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.087+0000 7f8d1bb82680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:47:20.098 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:20.096+0000 7fc8ff0eb680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:47:20.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.159+0000 7f8d1bb82680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:47:20.169 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:47:20.167+0000 7fc8ff0eb680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:47:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:20.180+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 50) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f79b0078480 con 0x7f79bc068b00 2023-10-24T00:47:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:20.181+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:47:20.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:20.181+0000 7f79a2ffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:47:20.252 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c9330f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.252 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c9330f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.252 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c9330f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c90309700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c9330f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c90309700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c9330f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c90309700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.254 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c90309700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:20.254 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:47:20.250+0000 7f8c90309700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:47:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.183+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 51) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f79b0078800 con 0x7f79bc068b00 2023-10-24T00:47:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.183+0000 7f79a2ffd700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.183+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79bc0baff0 con 0x7f79a805f1d0 2023-10-24T00:47:21.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.184+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.185+0000 7f79ba7fc700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f79ac006fd0 tx=0x7f79ac017000).ready entity=mgr.6560 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:21.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.203+0000 7f79a2ffd700 1 -- 172.21.15.148:0/2889368556 <== mgr.6560 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79bc0baff0 con 0x7f79a805f1d0 2023-10-24T00:47:21.204 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T00:47:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 msgr2=0x7f79a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f79ac006fd0 tx=0x7f79ac017000).stop 2023-10-24T00:47:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 msgr2=0x7f79bc1486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f79b000e980 tx=0x7f79b0009060).stop 2023-10-24T00:47:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 shutdown_connections 2023-10-24T00:47:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79bc155a10 0x7f79bc0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f79a805f1d0 0x7f79a8061610 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79bc068b00 0x7f79bc1486f0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 --2- 172.21.15.148:0/2889368556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79bc0acd30 0x7f79bc0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 >> 172.21.15.148:0/2889368556 conn(0x7f79bc0c72a0 msgr2=0x7f79bc0a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 shutdown_connections 2023-10-24T00:47:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.205+0000 7f79c1532700 1 -- 172.21.15.148:0/2889368556 wait complete. 2023-10-24T00:47:21.221 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T00:47:21.221 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-24-00_48_00 in ~39s... 2023-10-24T00:47:21.222 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-24T00:47:21.222 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-24T00:47:21.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.342+0000 7f096f59e700 1 Processor -- start 2023-10-24T00:47:21.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.342+0000 7f096f59e700 1 -- start start 2023-10-24T00:47:21.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700a9f40 0x7f0970155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096f59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09700aa320 0x7f09700c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09700c7770 con 0x7f09700c0820 2023-10-24T00:47:21.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096f59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09700c86d0 con 0x7f09700aa320 2023-10-24T00:47:21.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c1070 con 0x7f09700a9f40 2023-10-24T00:47:21.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09700aa320 0x7f09700c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f09700aa320 0x7f09700c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50410/0 (socket says 172.21.15.148:50410) 2023-10-24T00:47:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 -- 172.21.15.148:0/3626712302 learned_addr learned my addr 172.21.15.148:0/3626712302 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096e59c700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700a9f40 0x7f0970155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 -- 172.21.15.148:0/3626712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700a9f40 msgr2=0x7f0970155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:21.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700a9f40 0x7f0970155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 -- 172.21.15.148:0/3626712302 >> v1:172.21.15.150:6789/0 conn(0x7f09700c0820 legacy=0x7f0970153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:47:21.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 -- 172.21.15.148:0/3626712302 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700c79e0 con 0x7f09700aa320 2023-10-24T00:47:21.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f0967fff700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700aa320 0x7f09700c81e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f0958006fd0 tx=0x7f09580090f0).ready entity=mon.0 client_cookie=60b30fc814d7933f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:21.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096dd9b700 1 -- 172.21.15.148:0/3626712302 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800b600 con 0x7f09700aa320 2023-10-24T00:47:21.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096dd9b700 1 -- 172.21.15.148:0/3626712302 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800b760 con 0x7f09700aa320 2023-10-24T00:47:21.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.343+0000 7f096dd9b700 1 -- 172.21.15.148:0/3626712302 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800bae0 con 0x7f09700aa320 2023-10-24T00:47:21.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 -- 172.21.15.148:0/3626712302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700aa320 msgr2=0x7f09700c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700aa320 0x7f09700c81e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f0958006fd0 tx=0x7f09580090f0).stop 2023-10-24T00:47:21.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 -- 172.21.15.148:0/3626712302 shutdown_connections 2023-10-24T00:47:21.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700a9f40 0x7f0970155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 --2- 172.21.15.148:0/3626712302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700aa320 0x7f09700c81e0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 -- 172.21.15.148:0/3626712302 >> 172.21.15.148:0/3626712302 conn(0x7f0970094420 msgr2=0x7f097006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 -- 172.21.15.148:0/3626712302 shutdown_connections 2023-10-24T00:47:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.344+0000 7f096f59e700 1 -- 172.21.15.148:0/3626712302 wait complete. 2023-10-24T00:47:21.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.345+0000 7f096f59e700 1 Processor -- start 2023-10-24T00:47:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.345+0000 7f096f59e700 1 -- start start 2023-10-24T00:47:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700aa320 0x7f0970157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700c0820 0x7f09700acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097014d6e0 con 0x7f09700a9f40 2023-10-24T00:47:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c2a60 con 0x7f09700c0820 2023-10-24T00:47:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c2cf0 con 0x7f09700aa320 2023-10-24T00:47:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50422/0 (socket says 172.21.15.148:50422) 2023-10-24T00:47:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 -- 172.21.15.148:0/2993885948 learned_addr learned my addr 172.21.15.148:0/2993885948 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:47:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f0967fff700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700aa320 0x7f0970157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 -- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700aa320 msgr2=0x7f0970157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700aa320 0x7f0970157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096ed9d700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700c0820 0x7f09700acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 -- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700c0820 msgr2=0x7f09700acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700c0820 0x7f09700acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 -- 172.21.15.148:0/2993885948 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009370 con 0x7f09700a9f40 2023-10-24T00:47:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.346+0000 7f096e59c700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f096000c650 tx=0x7f0960008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.347+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960010580 con 0x7f09700a9f40 2023-10-24T00:47:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.347+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600106e0 con 0x7f09700a9f40 2023-10-24T00:47:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.347+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700c2fd0 con 0x7f09700a9f40 2023-10-24T00:47:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.347+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960010a60 con 0x7f09700a9f40 2023-10-24T00:47:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.347+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700c4c90 con 0x7f09700a9f40 2023-10-24T00:47:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.348+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0970047480 con 0x7f09700a9f40 2023-10-24T00:47:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.348+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 51) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f096001b460 con 0x7f09700a9f40 2023-10-24T00:47:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.348+0000 7f09667fc700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 0x7f0950061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:47:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.348+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0960079f50 con 0x7f09700a9f40 2023-10-24T00:47:21.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.348+0000 7f0967fff700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 0x7f0950061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:47:21.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.349+0000 7f0967fff700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 0x7f0950061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0958006fd0 tx=0x7f0958017000).ready entity=mgr.6560 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:47:21.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.353+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f09600a8af0 con 0x7f09700a9f40 2023-10-24T00:47:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.538+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f097014d820 con 0x7f095005f080 2023-10-24T00:47:21.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.541+0000 7f09667fc700 1 -- 172.21.15.148:0/2993885948 <== mgr.6560 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f095800b8d0 con 0x7f095005f080 2023-10-24T00:47:21.543 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:47:21.543 INFO:teuthology.orchestra.run.smithi148.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-24T00:47:21.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 msgr2=0x7f0950061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 0x7f0950061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0958006fd0 tx=0x7f0958017000).stop 2023-10-24T00:47:21.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 msgr2=0x7f09700c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:47:21.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f096000c650 tx=0x7f0960008040).stop 2023-10-24T00:47:21.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 shutdown_connections 2023-10-24T00:47:21.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09700c0820 0x7f09700acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f095005f080 0x7f0950061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09700a9f40 0x7f09700c47a0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 --2- 172.21.15.148:0/2993885948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09700aa320 0x7f0970157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:47:21.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 >> 172.21.15.148:0/2993885948 conn(0x7f0970094420 msgr2=0x7f09700c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:47:21.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 shutdown_connections 2023-10-24T00:47:21.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:47:21.543+0000 7f096f59e700 1 -- 172.21.15.148:0/2993885948 wait complete. 2023-10-24T00:47:21.557 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-24T00:47:21.557 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-10-24T00:47:21.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:21.558 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:22.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:22.576 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:23.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:23.595 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:24.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:24.619 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:25.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:25.640 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:26.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:26.660 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:27.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:27.682 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:28.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:28.704 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:29.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:29.726 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:30.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:30.747 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:31.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:31.767 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:32.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:47:32.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:47:32.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:32.788 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:33.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:33.808 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:34.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:34.829 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:35.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:35.851 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:36.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:36.872 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:37.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:37.892 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:38.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:38.914 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:39.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:39.934 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:40.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:40.955 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:41.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:41.976 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:42.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:42.997 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:44.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:44.017 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:45.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:45.040 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:46.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:46.061 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:47.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:47.082 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:48.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:48.103 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:49.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:49.124 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:50.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:50.144 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:51.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:51.166 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:52.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:52.186 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:53.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:53.207 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:54.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:54.229 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:55.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:55.250 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:56.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:56.271 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:57.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:57.292 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:58.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:58.315 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:47:59.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:47:59.337 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:48:00.208 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:00.207+0000 7f8c82aee700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:00.209 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:00.207+0000 7f8c82aee700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:00.209 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:00.207+0000 7f8c82aee700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:00.209 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:00.207+0000 7f8c82aee700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:00.209 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:00.207+0000 7f8c82aee700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:00.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:00.357 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:48:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_48_00_UTC 2023-10-24T00:48:00.378 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-24-00_48_00_UTC'] 2023-10-24T00:48:00.378 DEBUG:tasks.cephfs.test_snap_schedules:exec=1698108441.2217557, now = 1698108480.3785129, timo = 39 2023-10-24T00:48:01.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-24T00:48:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.508+0000 7ff44e6fd700 1 Processor -- start 2023-10-24T00:48:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.508+0000 7ff44e6fd700 1 -- start start 2023-10-24T00:48:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44e6fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff448155350 0x7ff4480aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44e6fd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480c7770 con 0x7ff4480a9f40 2023-10-24T00:48:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44e6fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480c1070 con 0x7ff4480c81e0 2023-10-24T00:48:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44e6fd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480c79e0 con 0x7ff448155350 2023-10-24T00:48:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44cefa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff448155350 0x7ff4480aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44d6fb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff4480a9f40 0x7ff4480c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49440/0 (socket says 172.21.15.148:49440) 2023-10-24T00:48:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44d6fb700 1 -- 172.21.15.148:0/3315187969 learned_addr learned my addr 172.21.15.148:0/3315187969 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44cefa700 1 -- 172.21.15.148:0/3315187969 >> v1:172.21.15.150:6789/0 conn(0x7ff4480c81e0 legacy=0x7ff448153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44cefa700 1 -- 172.21.15.148:0/3315187969 >> v1:172.21.15.148:6789/0 conn(0x7ff4480a9f40 legacy=0x7ff4480c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff447fff700 1 -- 172.21.15.148:0/3315187969 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268257033 0 0) 0x7ff4480c7770 con 0x7ff4480a9f40 2023-10-24T00:48:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44cefa700 1 -- 172.21.15.148:0/3315187969 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480c7cc0 con 0x7ff448155350 2023-10-24T00:48:01.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff44cefa700 1 --2- 172.21.15.148:0/3315187969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff448155350 0x7ff4480aa320 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7ff43c009760 tx=0x7ff43c009060).ready entity=mon.0 client_cookie=9749370532541ed1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.509+0000 7ff447fff700 1 -- 172.21.15.148:0/3315187969 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00b520 con 0x7ff448155350 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff447fff700 1 -- 172.21.15.148:0/3315187969 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00b680 con 0x7ff448155350 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff447fff700 1 -- 172.21.15.148:0/3315187969 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00ba00 con 0x7ff448155350 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 -- 172.21.15.148:0/3315187969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff448155350 msgr2=0x7ff4480aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/3315187969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff448155350 0x7ff4480aa320 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7ff43c009760 tx=0x7ff43c009060).stop 2023-10-24T00:48:01.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 -- 172.21.15.148:0/3315187969 shutdown_connections 2023-10-24T00:48:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/3315187969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff448155350 0x7ff4480aa320 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 -- 172.21.15.148:0/3315187969 >> 172.21.15.148:0/3315187969 conn(0x7ff448094420 msgr2=0x7ff44806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 -- 172.21.15.148:0/3315187969 shutdown_connections 2023-10-24T00:48:01.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.510+0000 7ff44e6fd700 1 -- 172.21.15.148:0/3315187969 wait complete. 2023-10-24T00:48:01.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.511+0000 7ff44e6fd700 1 Processor -- start 2023-10-24T00:48:01.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.511+0000 7ff44e6fd700 1 -- start start 2023-10-24T00:48:01.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:01.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 0x7ff448064260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:01.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 0x7ff44814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480c37e0 con 0x7ff4480a9f40 2023-10-24T00:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480ac630 con 0x7ff448155350 2023-10-24T00:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44e6fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480ac910 con 0x7ff4480c81e0 2023-10-24T00:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44d6fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44d6fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54806/0 (socket says 172.21.15.148:54806) 2023-10-24T00:48:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.512+0000 7ff44d6fb700 1 -- 172.21.15.148:0/4049618328 learned_addr learned my addr 172.21.15.148:0/4049618328 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44cefa700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 0x7ff448064260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44defc700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 0x7ff44814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 -- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 msgr2=0x7ff448064260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 0x7ff448064260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 -- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 msgr2=0x7ff44814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 0x7ff44814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 -- 172.21.15.148:0/4049618328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c0092a0 con 0x7ff4480a9f40 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44defc700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 0x7ff44814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44cefa700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 0x7ff448064260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44d6fb700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7ff44000c810 tx=0x7ff440001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440005c00 con 0x7ff4480a9f40 2023-10-24T00:48:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff440005d60 con 0x7ff4480a9f40 2023-10-24T00:48:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480acbf0 con 0x7ff4480a9f40 2023-10-24T00:48:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440007340 con 0x7ff4480a9f40 2023-10-24T00:48:01.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.513+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480ac140 con 0x7ff4480a9f40 2023-10-24T00:48:01.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.514+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4480ac390 con 0x7ff4480a9f40 2023-10-24T00:48:01.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.514+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 53) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ff440007730 con 0x7ff4480a9f40 2023-10-24T00:48:01.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.515+0000 7ff4457fa700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 0x7ff4340618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:01.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.515+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff44007a7f0 con 0x7ff4480a9f40 2023-10-24T00:48:01.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.515+0000 7ff44cefa700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 0x7ff4340618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:01.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.515+0000 7ff44cefa700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 0x7ff4340618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff4480a84b0 tx=0x7ff43c017000).ready entity=mgr.6560 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:01.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.519+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff44004b710 con 0x7ff4480a9f40 2023-10-24T00:48:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.706+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4480c8600 con 0x7ff43405f3e0 2023-10-24T00:48:01.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.711+0000 7ff4457fa700 1 -- 172.21.15.148:0/4049618328 <== mgr.6560 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff4480c8600 con 0x7ff43405f3e0 2023-10-24T00:48:01.713 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path snap_test_dir1 2023-10-24T00:48:01.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 msgr2=0x7ff4340618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 0x7ff4340618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff4480a84b0 tx=0x7ff43c017000).stop 2023-10-24T00:48:01.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 msgr2=0x7ff4480abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:01.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7ff44000c810 tx=0x7ff440001570).stop 2023-10-24T00:48:01.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 shutdown_connections 2023-10-24T00:48:01.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff448155350 0x7ff44814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff43405f3e0 0x7ff4340618a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4480a9f40 0x7ff4480abc50 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 --2- 172.21.15.148:0/4049618328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4480c81e0 0x7ff448064260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:01.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 >> 172.21.15.148:0/4049618328 conn(0x7ff448094420 msgr2=0x7ff44814f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:01.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 shutdown_connections 2023-10-24T00:48:01.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:01.713+0000 7ff44e6fd700 1 -- 172.21.15.148:0/4049618328 wait complete. 2023-10-24T00:48:01.726 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-24T00:48:01.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:01.727 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T00:48:01.744 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_48_00_UTC 2023-10-24T00:48:01.744 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_48_00_UTC 2023-10-24T00:48:01.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:01.746 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_48_00_UTC) 2023-10-24T00:48:01.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:01.805 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T00:48:01.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T00:48:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.016+0000 7fa09ccd9700 1 Processor -- start 2023-10-24T00:48:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.016+0000 7fa09ccd9700 1 -- start start 2023-10-24T00:48:02.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09ccd9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa098098bd0 0x7fa098154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:02.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09ccd9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980c71d0 con 0x7fa098154430 2023-10-24T00:48:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09ccd9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980c9410 con 0x7fa0980bffd0 2023-10-24T00:48:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09ccd9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0980c6a10 con 0x7fa098098bd0 2023-10-24T00:48:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa08dd9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa098098bd0 0x7fa098154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa098154430 0x7fa0980c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49442/0 (socket says 172.21.15.148:49442) 2023-10-24T00:48:02.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.017+0000 7fa09659c700 1 -- 172.21.15.148:0/4271106949 learned_addr learned my addr 172.21.15.148:0/4271106949 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa08dd9b700 1 -- 172.21.15.148:0/4271106949 >> v1:172.21.15.150:6789/0 conn(0x7fa0980bffd0 legacy=0x7fa09815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa08dd9b700 1 -- 172.21.15.148:0/4271106949 >> v1:172.21.15.148:6789/0 conn(0x7fa098154430 legacy=0x7fa0980c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa08dd9b700 1 -- 172.21.15.148:0/4271106949 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0980ca8b0 con 0x7fa098098bd0 2023-10-24T00:48:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa095d9b700 1 -- 172.21.15.148:0/4271106949 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298895528 0 0) 0x7fa0980c71d0 con 0x7fa098154430 2023-10-24T00:48:02.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa08dd9b700 1 --2- 172.21.15.148:0/4271106949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098098bd0 0x7fa098154810 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fa080009760 tx=0x7fa080009060).ready entity=mon.0 client_cookie=bf32acc7b3131b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa095d9b700 1 -- 172.21.15.148:0/4271106949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000b520 con 0x7fa098098bd0 2023-10-24T00:48:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa095d9b700 1 -- 172.21.15.148:0/4271106949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000b680 con 0x7fa098098bd0 2023-10-24T00:48:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa095d9b700 1 -- 172.21.15.148:0/4271106949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000ba00 con 0x7fa098098bd0 2023-10-24T00:48:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 -- 172.21.15.148:0/4271106949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098098bd0 msgr2=0x7fa098154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/4271106949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098098bd0 0x7fa098154810 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fa080009760 tx=0x7fa080009060).stop 2023-10-24T00:48:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 -- 172.21.15.148:0/4271106949 shutdown_connections 2023-10-24T00:48:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/4271106949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098098bd0 0x7fa098154810 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 -- 172.21.15.148:0/4271106949 >> 172.21.15.148:0/4271106949 conn(0x7fa0980cb070 msgr2=0x7fa0980cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 -- 172.21.15.148:0/4271106949 shutdown_connections 2023-10-24T00:48:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.018+0000 7fa09ccd9700 1 -- 172.21.15.148:0/4271106949 wait complete. 2023-10-24T00:48:02.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 Processor -- start 2023-10-24T00:48:02.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 -- start start 2023-10-24T00:48:02.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa098098bd0 0x7fa0980aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:02.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0980bffd0 0x7fa098063370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:02.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:02.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980ac460 con 0x7fa098154430 2023-10-24T00:48:02.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098064ad0 con 0x7fa0980bffd0 2023-10-24T00:48:02.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa09ccd9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa098168e10 con 0x7fa098098bd0 2023-10-24T00:48:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.020+0000 7fa096d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54820/0 (socket says 172.21.15.148:54820) 2023-10-24T00:48:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 -- 172.21.15.148:0/2183844429 learned_addr learned my addr 172.21.15.148:0/2183844429 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa08dd9b700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0980bffd0 0x7fa098063370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa09659c700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa098098bd0 0x7fa0980aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 -- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa098098bd0 msgr2=0x7fa0980aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa098098bd0 0x7fa0980aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 -- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0980bffd0 msgr2=0x7fa098063370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0980bffd0 0x7fa098063370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 -- 172.21.15.148:0/2183844429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800092a0 con 0x7fa098154430 2023-10-24T00:48:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa096d9d700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fa09000c840 tx=0x7fa090002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090010510 con 0x7fa098154430 2023-10-24T00:48:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090010690 con 0x7fa098154430 2023-10-24T00:48:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090010a50 con 0x7fa098154430 2023-10-24T00:48:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa098063ec0 con 0x7fa098154430 2023-10-24T00:48:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.021+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa098064250 con 0x7fa098154430 2023-10-24T00:48:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.022+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa098064c60 con 0x7fa098154430 2023-10-24T00:48:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.022+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 53) v1 ==== 75679+0+0 (secure 0 0 0) 0x7fa090012440 con 0x7fa098154430 2023-10-24T00:48:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.023+0000 7fa08effd700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 0x7fa0780618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.023+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa09007a090 con 0x7fa098154430 2023-10-24T00:48:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.023+0000 7fa09659c700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 0x7fa0780618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.023+0000 7fa09659c700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 0x7fa0780618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa08800c7d0 tx=0x7fa088009040).ready entity=mgr.6560 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.027+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa090048af0 con 0x7fa098154430 2023-10-24T00:48:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.232+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa098064820 con 0x7fa098154430 2023-10-24T00:48:02.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:48:02.741 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:48:02.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.944+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fa090077ab0 con 0x7fa098154430 2023-10-24T00:48:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.946+0000 7fa08effd700 1 -- 172.21.15.148:0/2183844429 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v54) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa0900741f0 con 0x7fa098154430 2023-10-24T00:48:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 msgr2=0x7fa0780618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 0x7fa0780618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa08800c7d0 tx=0x7fa088009040).stop 2023-10-24T00:48:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 msgr2=0x7fa098063860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fa09000c840 tx=0x7fa090002560).stop 2023-10-24T00:48:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 shutdown_connections 2023-10-24T00:48:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa07805f3e0 0x7fa0780618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa098154430 0x7fa098063860 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa098098bd0 0x7fa0980aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 --2- 172.21.15.148:0/2183844429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0980bffd0 0x7fa098063370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 >> 172.21.15.148:0/2183844429 conn(0x7fa0980cb070 msgr2=0x7fa0980a8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 shutdown_connections 2023-10-24T00:48:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:02.948+0000 7fa09ccd9700 1 -- 172.21.15.148:0/2183844429 wait complete. 2023-10-24T00:48:02.964 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:48:02.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:48:03.006 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:48:03.050 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:48:03.050 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T00:48:03.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:03.051 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T00:48:03.092 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:03.091+0000 7fc5540b6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:48:03.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T00:48:03.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:03.095 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T00:48:03.098 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:03.096+0000 7ff1b00d6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:48:03.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:03.157 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:03.156+0000 7fc5540b6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:48:03.161 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:03.159+0000 7ff1b00d6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:48:03.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.272+0000 7fe4f4619700 1 Processor -- start 2023-10-24T00:48:03.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.272+0000 7fe4f4619700 1 -- start start 2023-10-24T00:48:03.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f4619700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4ec06a490 0x7fe4ec0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f4619700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0c0960 con 0x7fe4ec0c6710 2023-10-24T00:48:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f4619700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0c0c40 con 0x7fe4ec0aa010 2023-10-24T00:48:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f4619700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c0f20 con 0x7fe4ec06a490 2023-10-24T00:48:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f2bb6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe4ec06a490 0x7fe4ec0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f1bb4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe4ec0c6710 0x7fe4ec069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49452/0 (socket says 172.21.15.148:49452) 2023-10-24T00:48:03.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.273+0000 7fe4f1bb4700 1 -- 172.21.15.148:0/3502588276 learned_addr learned my addr 172.21.15.148:0/3502588276 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:03.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f13b3700 1 -- 172.21.15.148:0/3502588276 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494613058 0 0) 0x7fe4ec0c0960 con 0x7fe4ec0c6710 2023-10-24T00:48:03.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f13b3700 1 -- 172.21.15.148:0/3502588276 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d80033f0 con 0x7fe4ec0c6710 2023-10-24T00:48:03.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f2bb6700 1 -- 172.21.15.148:0/3502588276 >> v1:172.21.15.150:6789/0 conn(0x7fe4ec0aa010 legacy=0x7fe4ec158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f2bb6700 1 -- 172.21.15.148:0/3502588276 >> v1:172.21.15.148:6789/0 conn(0x7fe4ec0c6710 legacy=0x7fe4ec069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f2bb6700 1 -- 172.21.15.148:0/3502588276 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0c1200 con 0x7fe4ec06a490 2023-10-24T00:48:03.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f2bb6700 1 --2- 172.21.15.148:0/3502588276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0c1a00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fe4e4009e60 tx=0x7fe4e4009780).ready entity=mon.0 client_cookie=b54996318f2385f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f13b3700 1 -- 172.21.15.148:0/3502588276 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400e070 con 0x7fe4ec06a490 2023-10-24T00:48:03.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f13b3700 1 -- 172.21.15.148:0/3502588276 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400bb60 con 0x7fe4ec06a490 2023-10-24T00:48:03.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.274+0000 7fe4f13b3700 1 -- 172.21.15.148:0/3502588276 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4012410 con 0x7fe4ec06a490 2023-10-24T00:48:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 -- 172.21.15.148:0/3502588276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec06a490 msgr2=0x7fe4ec0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 --2- 172.21.15.148:0/3502588276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0c1a00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fe4e4009e60 tx=0x7fe4e4009780).stop 2023-10-24T00:48:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 -- 172.21.15.148:0/3502588276 shutdown_connections 2023-10-24T00:48:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 --2- 172.21.15.148:0/3502588276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0c1a00 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 -- 172.21.15.148:0/3502588276 >> 172.21.15.148:0/3502588276 conn(0x7fe4ec0caf40 msgr2=0x7fe4ec0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 -- 172.21.15.148:0/3502588276 shutdown_connections 2023-10-24T00:48:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.275+0000 7fe4f4619700 1 -- 172.21.15.148:0/3502588276 wait complete. 2023-10-24T00:48:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.276+0000 7fe4f4619700 1 Processor -- start 2023-10-24T00:48:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.276+0000 7fe4f4619700 1 -- start start 2023-10-24T00:48:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ec0c6710 0x7fe4ec1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0afe20 con 0x7fe4ec0aa010 2023-10-24T00:48:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec164ac0 con 0x7fe4ec06a490 2023-10-24T00:48:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec155020 con 0x7fe4ec0c6710 2023-10-24T00:48:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54846/0 (socket says 172.21.15.148:54846) 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 -- 172.21.15.148:0/1056277249 learned_addr learned my addr 172.21.15.148:0/1056277249 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f23b5700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f2bb6700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ec0c6710 0x7fe4ec1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ec0c6710 msgr2=0x7fe4ec1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ec0c6710 0x7fe4ec1439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ec06a490 msgr2=0x7fe4ec0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 -- 172.21.15.148:0/1056277249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009a20 con 0x7fe4ec0aa010 2023-10-24T00:48:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f1bb4700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fe4e800c420 tx=0x7fe4e8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80070d0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8007230 con 0x7fe4ec0aa010 2023-10-24T00:48:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.277+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec1641d0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.278+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80075b0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.278+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec164470 con 0x7fe4ec0aa010 2023-10-24T00:48:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.279+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec164c30 con 0x7fe4ec0aa010 2023-10-24T00:48:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.279+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe4e80059b0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.280+0000 7fe4e27fc700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 0x7fe4d0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.280+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe4e8079dd0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.280+0000 7fe4f23b5700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 msgr2=0x7fe4d0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.280+0000 7fe4f23b5700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 0x7fe4d0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.284+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe4e804acf0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.436 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:03.435+0000 7ff1b00d6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:48:03.448 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:03.447+0000 7fc5540b6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:48:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.481+0000 7fe4f23b5700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 msgr2=0x7fe4d0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.481+0000 7fe4f23b5700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 0x7fe4d0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:03.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.497+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4ec06c6b0 con 0x7fe4ec0aa010 2023-10-24T00:48:03.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.497+0000 7fe4e27fc700 1 -- 172.21.15.148:0/1056277249 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fe4e804e310 con 0x7fe4ec0aa010 2023-10-24T00:48:03.499 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:03.500 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:48:03.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 msgr2=0x7fe4d0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:03.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 0x7fe4d0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:03.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 msgr2=0x7fe4ec154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fe4e800c420 tx=0x7fe4e8007c80).stop 2023-10-24T00:48:03.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 shutdown_connections 2023-10-24T00:48:03.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4ec0c6710 0x7fe4ec1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4ec06a490 0x7fe4ec0af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe4d005f390 0x7fe4d0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 --2- 172.21.15.148:0/1056277249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4ec0aa010 0x7fe4ec154840 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 >> 172.21.15.148:0/1056277249 conn(0x7fe4ec0caf40 msgr2=0x7fe4ec0c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.499+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 shutdown_connections 2023-10-24T00:48:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.500+0000 7fe4f4619700 1 -- 172.21.15.148:0/1056277249 wait complete. 2023-10-24T00:48:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:48:03.513 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.629+0000 7f7ce3f74700 1 Processor -- start 2023-10-24T00:48:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.629+0000 7f7ce3f74700 1 -- start start 2023-10-24T00:48:03.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce3f74700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7cdc062d60 0x7f7cdc15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce3f74700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc06a040 con 0x7f7cdc153f40 2023-10-24T00:48:03.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce3f74700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc069430 con 0x7f7cdc154320 2023-10-24T00:48:03.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce3f74700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc0c88e0 con 0x7f7cdc062d60 2023-10-24T00:48:03.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce1d10700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7cdc153f40 0x7f7cdc062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44758/0 (socket says 172.21.15.148:44758) 2023-10-24T00:48:03.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce1d10700 1 -- 172.21.15.148:0/1098050936 learned_addr learned my addr 172.21.15.148:0/1098050936 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:03.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce2511700 1 --2- 172.21.15.148:0/1098050936 >> v2:172.21.15.150:3300/0 conn(0x7f7cdc062d60 0x7f7cdc15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874021427 0 0) 0x7f7cdc06a040 con 0x7f7cdc153f40 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.630+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc80033f0 con 0x7f7cdc153f40 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784521636 0 0) 0x7f7cc80033f0 con 0x7f7cdc153f40 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce2511700 1 -- 172.21.15.148:0/1098050936 >> v1:172.21.15.150:6789/0 conn(0x7f7cdc154320 legacy=0x7f7cdc0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce2511700 1 -- 172.21.15.148:0/1098050936 >> v1:172.21.15.148:6789/0 conn(0x7f7cdc153f40 legacy=0x7f7cdc062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce2511700 1 -- 172.21.15.148:0/1098050936 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc069710 con 0x7f7cdc062d60 2023-10-24T00:48:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce2511700 1 --2- 172.21.15.148:0/1098050936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc062d60 0x7f7cdc15ed50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f7cd4009e60 tx=0x7f7cd4009780).ready entity=mon.1 client_cookie=6407b300dad4ae7e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400e070 con 0x7f7cdc062d60 2023-10-24T00:48:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd400b850 con 0x7f7cdc062d60 2023-10-24T00:48:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce0d0e700 1 -- 172.21.15.148:0/1098050936 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8001470 con 0x7f7cdc062d60 2023-10-24T00:48:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 -- 172.21.15.148:0/1098050936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc062d60 msgr2=0x7f7cdc15ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/1098050936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc062d60 0x7f7cdc15ed50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f7cd4009e60 tx=0x7f7cd4009780).stop 2023-10-24T00:48:03.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 -- 172.21.15.148:0/1098050936 shutdown_connections 2023-10-24T00:48:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/1098050936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc062d60 0x7f7cdc15ed50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 -- 172.21.15.148:0/1098050936 >> 172.21.15.148:0/1098050936 conn(0x7f7cdc064200 msgr2=0x7f7cdc0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.631+0000 7f7ce3f74700 1 -- 172.21.15.148:0/1098050936 shutdown_connections 2023-10-24T00:48:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.632+0000 7f7ce3f74700 1 -- 172.21.15.148:0/1098050936 wait complete. 2023-10-24T00:48:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 Processor -- start 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 -- start start 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc062d60 0x7f7cdc1396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc153f40 0x7f7cdc0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0aaf00 con 0x7f7cdc154320 2023-10-24T00:48:03.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0a8f50 con 0x7f7cdc153f40 2023-10-24T00:48:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.633+0000 7f7ce3f74700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc139ba0 con 0x7f7cdc062d60 2023-10-24T00:48:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51482/0 (socket says 172.21.15.148:51482) 2023-10-24T00:48:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 -- 172.21.15.148:0/3756391019 learned_addr learned my addr 172.21.15.148:0/3756391019 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce1d10700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc062d60 0x7f7cdc1396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce150f700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc153f40 0x7f7cdc0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 -- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc062d60 msgr2=0x7f7cdc1396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc062d60 0x7f7cdc1396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 -- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc153f40 msgr2=0x7f7cdc0ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc153f40 0x7f7cdc0ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 -- 172.21.15.148:0/3756391019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009a20 con 0x7f7cdc154320 2023-10-24T00:48:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce2511700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f7cd400b6c0 tx=0x7f7cdc0c72a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd401d440 con 0x7f7cdc154320 2023-10-24T00:48:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc0a8340 con 0x7f7cdc154320 2023-10-24T00:48:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0a8900 con 0x7f7cdc154320 2023-10-24T00:48:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd401d7b0 con 0x7f7cdc154320 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.634+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd401d920 con 0x7f7cdc154320 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.635+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc005120 con 0x7f7cdc154320 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.636+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7cd401dd10 con 0x7f7cdc154320 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.636+0000 7f7cd1ffb700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 0x7f7cc0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.636+0000 7f7ce1d10700 1 -- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 msgr2=0x7f7cc0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:03.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.636+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f7cd407c680 con 0x7f7cdc154320 2023-10-24T00:48:03.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.636+0000 7f7ce1d10700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 0x7f7cc0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:03.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.640+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7cd404d420 con 0x7f7cdc154320 2023-10-24T00:48:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.810+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cbc005ac0 con 0x7f7cdc154320 2023-10-24T00:48:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.811+0000 7f7cd1ffb700 1 -- 172.21.15.148:0/3756391019 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+17238 (secure 0 0 0) 0x7f7cd4050a40 con 0x7f7cdc154320 2023-10-24T00:48:03.814 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:03.814 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":128,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:47:20.174234+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:6832/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/2035443629":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/4137302598":"2023-10-25T00:47:20.174197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 msgr2=0x7f7cc0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 0x7f7cc0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 msgr2=0x7f7cdc0bdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f7cd400b6c0 tx=0x7f7cdc0c72a0).stop 2023-10-24T00:48:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 shutdown_connections 2023-10-24T00:48:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7cc005f390 0x7f7cc0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7cdc154320 0x7f7cdc0bdce0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc062d60 0x7f7cdc1396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 --2- 172.21.15.148:0/3756391019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc153f40 0x7f7cdc0ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 >> 172.21.15.148:0/3756391019 conn(0x7f7cdc064200 msgr2=0x7f7cdc0bcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 shutdown_connections 2023-10-24T00:48:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.813+0000 7f7ce3f74700 1 -- 172.21.15.148:0/3756391019 wait complete. 2023-10-24T00:48:03.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:47:02.232202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:47:03.214931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T00:48:03.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:48:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.948+0000 7ff6e6298700 1 Processor -- start 2023-10-24T00:48:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.948+0000 7ff6e6298700 1 -- start start 2023-10-24T00:48:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e6298700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff6e01505b0 0x7ff6e0069230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e6298700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00bd070 con 0x7ff6e00bdef0 2023-10-24T00:48:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e6298700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e0069ba0 con 0x7ff6e0069720 2023-10-24T00:48:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e6298700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e00bc460 con 0x7ff6e01505b0 2023-10-24T00:48:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff6e01505b0 0x7ff6e0069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5a97700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff6e00bdef0 0x7ff6e0065720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44766/0 (socket says 172.21.15.148:44766) 2023-10-24T00:48:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5a97700 1 -- 172.21.15.148:0/841397703 learned_addr learned my addr 172.21.15.148:0/841397703 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff6e01505b0 0x7ff6e0069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51486/0 (socket says 172.21.15.148:51486) 2023-10-24T00:48:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 -- 172.21.15.148:0/841397703 >> v1:172.21.15.150:6789/0 conn(0x7ff6e0069720 legacy=0x7ff6e00bd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 -- 172.21.15.148:0/841397703 >> v1:172.21.15.148:6789/0 conn(0x7ff6e00bdef0 legacy=0x7ff6e0065720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6d7fff700 1 -- 172.21.15.148:0/841397703 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460991419 0 0) 0x7ff6e00bd070 con 0x7ff6e00bdef0 2023-10-24T00:48:03.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 -- 172.21.15.148:0/841397703 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00bc740 con 0x7ff6e01505b0 2023-10-24T00:48:03.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6e5296700 1 --2- 172.21.15.148:0/841397703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e01505b0 0x7ff6e0069230 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7ff6dc00a900 tx=0x7ff6dc00a200).ready entity=mon.0 client_cookie=59e07e49db85c22e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6d7fff700 1 -- 172.21.15.148:0/841397703 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00a270 con 0x7ff6e01505b0 2023-10-24T00:48:03.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6d7fff700 1 -- 172.21.15.148:0/841397703 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc00c970 con 0x7ff6e01505b0 2023-10-24T00:48:03.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.949+0000 7ff6d7fff700 1 -- 172.21.15.148:0/841397703 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00ccf0 con 0x7ff6e01505b0 2023-10-24T00:48:03.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 -- 172.21.15.148:0/841397703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e01505b0 msgr2=0x7ff6e0069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 --2- 172.21.15.148:0/841397703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e01505b0 0x7ff6e0069230 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7ff6dc00a900 tx=0x7ff6dc00a200).stop 2023-10-24T00:48:03.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 -- 172.21.15.148:0/841397703 shutdown_connections 2023-10-24T00:48:03.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 --2- 172.21.15.148:0/841397703 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e01505b0 0x7ff6e0069230 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 -- 172.21.15.148:0/841397703 >> 172.21.15.148:0/841397703 conn(0x7ff6e00c48a0 msgr2=0x7ff6e0068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:03.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 -- 172.21.15.148:0/841397703 shutdown_connections 2023-10-24T00:48:03.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.950+0000 7ff6e6298700 1 -- 172.21.15.148:0/841397703 wait complete. 2023-10-24T00:48:03.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.952+0000 7ff6e6298700 1 Processor -- start 2023-10-24T00:48:03.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.952+0000 7ff6e6298700 1 -- start start 2023-10-24T00:48:03.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6e00bdef0 0x7ff6e0144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6e01505b0 0x7ff6e00be400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00bfac0 con 0x7ff6e0069720 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0145390 con 0x7ff6e00bdef0 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00bebe0 con 0x7ff6e01505b0 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51496/0 (socket says 172.21.15.148:51496) 2023-10-24T00:48:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 -- 172.21.15.148:0/4289275855 learned_addr learned my addr 172.21.15.148:0/4289275855 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5a97700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6e01505b0 0x7ff6e00be400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e4a95700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6e00bdef0 0x7ff6e0144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6e01505b0 msgr2=0x7ff6e00be400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6e01505b0 0x7ff6e00be400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6e00bdef0 msgr2=0x7ff6e0144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6e00bdef0 0x7ff6e0144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 -- 172.21.15.148:0/4289275855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc00a440 con 0x7ff6e0069720 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e5296700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7ff6dc00c4d0 tx=0x7ff6dc00a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc010e30 con 0x7ff6e0069720 2023-10-24T00:48:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc019420 con 0x7ff6e0069720 2023-10-24T00:48:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0197e0 con 0x7ff6e0069720 2023-10-24T00:48:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00beec0 con 0x7ff6e0069720 2023-10-24T00:48:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.953+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e00be8f0 con 0x7ff6e0069720 2023-10-24T00:48:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.954+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e00bf3e0 con 0x7ff6e0069720 2023-10-24T00:48:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.955+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff6dc019b90 con 0x7ff6e0069720 2023-10-24T00:48:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.955+0000 7ff6d57fa700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 0x7ff6c4061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.955+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff6dc07bab0 con 0x7ff6e0069720 2023-10-24T00:48:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.955+0000 7ff6e4a95700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 msgr2=0x7ff6c4061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.955+0000 7ff6e4a95700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 0x7ff6c4061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:03.960+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff6e00bf3e0 con 0x7ff6e0069720 2023-10-24T00:48:04.049 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.048+0000 7ff1b00d6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:48:04.096 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:04.093+0000 7fc5540b6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:48:04.122 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.121+0000 7ff1b00d6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:48:04.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.156+0000 7ff6e4a95700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 msgr2=0x7ff6c4061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.156+0000 7ff6e4a95700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 0x7ff6c4061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:04.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.166+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff6e00bf890 con 0x7ff6e0069720 2023-10-24T00:48:04.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.166+0000 7ff6d57fa700 1 -- 172.21.15.148:0/4289275855 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v128) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff6dc028020 con 0x7ff6e0069720 2023-10-24T00:48:04.169 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:48:04.170 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:04.167+0000 7fc5540b6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:48:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 msgr2=0x7ff6c4061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 0x7ff6c4061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 msgr2=0x7ff6e014f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7ff6dc00c4d0 tx=0x7ff6dc00a200).stop 2023-10-24T00:48:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 shutdown_connections 2023-10-24T00:48:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6e01505b0 0x7ff6e00be400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff6c405f360 0x7ff6c4061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6e0069720 0x7ff6e014f260 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 --2- 172.21.15.148:0/4289275855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6e00bdef0 0x7ff6e0144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 >> 172.21.15.148:0/4289275855 conn(0x7ff6e00c48a0 msgr2=0x7ff6e00c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.168+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 shutdown_connections 2023-10-24T00:48:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.169+0000 7ff6e6298700 1 -- 172.21.15.148:0/4289275855 wait complete. 2023-10-24T00:48:04.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:48:04.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.308+0000 7ff1b00d6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:48:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.309+0000 7fa46b59e700 1 Processor -- start 2023-10-24T00:48:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.309+0000 7fa46b59e700 1 -- start start 2023-10-24T00:48:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.310+0000 7fa46b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 0x7fa46c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.310+0000 7fa46b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 0x7fa46c0a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.310+0000 7fa46b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0aa3e0 con 0x7fa46c1574f0 2023-10-24T00:48:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.310+0000 7fa46b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0c5700 con 0x7fa46c0a9e60 2023-10-24T00:48:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.310+0000 7fa46b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0aa680 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa46c1574f0 0x7fa46c0c8180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44778/0 (socket says 172.21.15.148:44778) 2023-10-24T00:48:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46a59c700 1 -- 172.21.15.148:0/2986565044 learned_addr learned my addr 172.21.15.148:0/2986565044 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa469d9b700 1 --2- 172.21.15.148:0/2986565044 >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 0x7fa46c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 --2- 172.21.15.148:0/2986565044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 0x7fa46c0a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46959a700 1 -- 172.21.15.148:0/2986565044 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002219668 0 0) 0x7fa46c0aa3e0 con 0x7fa46c1574f0 2023-10-24T00:48:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46959a700 1 -- 172.21.15.148:0/2986565044 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4540033f0 con 0x7fa46c1574f0 2023-10-24T00:48:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 -- 172.21.15.148:0/2986565044 >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 msgr2=0x7fa46c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 --2- 172.21.15.148:0/2986565044 >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 0x7fa46c0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 -- 172.21.15.148:0/2986565044 >> v1:172.21.15.148:6789/0 conn(0x7fa46c1574f0 legacy=0x7fa46c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 -- 172.21.15.148:0/2986565044 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0c62c0 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa469d9b700 1 --2- 172.21.15.148:0/2986565044 >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 0x7fa46c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46ad9d700 1 --2- 172.21.15.148:0/2986565044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 0x7fa46c0a7c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa464009e60 tx=0x7fa464009780).ready entity=mon.2 client_cookie=9506f98aa5b865f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46959a700 1 -- 172.21.15.148:0/2986565044 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400e070 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46959a700 1 -- 172.21.15.148:0/2986565044 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400bab0 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.311+0000 7fa46959a700 1 -- 172.21.15.148:0/2986565044 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400be30 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 -- 172.21.15.148:0/2986565044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 msgr2=0x7fa46c0a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2986565044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 0x7fa46c0a7c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa464009e60 tx=0x7fa464009780).stop 2023-10-24T00:48:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 -- 172.21.15.148:0/2986565044 shutdown_connections 2023-10-24T00:48:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2986565044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c0c6fb0 0x7fa46c0a7c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2986565044 >> v2:172.21.15.150:3300/0 conn(0x7fa46c0a9e60 0x7fa46c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 -- 172.21.15.148:0/2986565044 >> 172.21.15.148:0/2986565044 conn(0x7fa46c094500 msgr2=0x7fa46c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 -- 172.21.15.148:0/2986565044 shutdown_connections 2023-10-24T00:48:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.312+0000 7fa46b59e700 1 -- 172.21.15.148:0/2986565044 wait complete. 2023-10-24T00:48:04.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.313+0000 7fa46b59e700 1 Processor -- start 2023-10-24T00:48:04.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.313+0000 7fa46b59e700 1 -- start start 2023-10-24T00:48:04.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa46c0c6fb0 0x7fa46c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c1574f0 0x7fa46c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c152fa0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c152500 con 0x7fa46c0c6fb0 2023-10-24T00:48:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1583a0 con 0x7fa46c1574f0 2023-10-24T00:48:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51502/0 (socket says 172.21.15.148:51502) 2023-10-24T00:48:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 -- 172.21.15.148:0/2182670264 learned_addr learned my addr 172.21.15.148:0/2182670264 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46ad9d700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c1574f0 0x7fa46c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa469d9b700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa46c0c6fb0 0x7fa46c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 -- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c1574f0 msgr2=0x7fa46c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c1574f0 0x7fa46c0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 -- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa46c0c6fb0 msgr2=0x7fa46c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa46c0c6fb0 0x7fa46c0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 -- 172.21.15.148:0/2182670264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600092a0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.314+0000 7fa46a59c700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fa45c00c5c0 tx=0x7fa45c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.315+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0072e0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.315+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c007440 con 0x7fa46c0a9e60 2023-10-24T00:48:04.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.315+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464009a20 con 0x7fa46c0a9e60 2023-10-24T00:48:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.315+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0057a0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.315+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c157a70 con 0x7fa46c0a9e60 2023-10-24T00:48:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.316+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c0614e0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.316+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fa45c005bd0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.317+0000 7fa45a7fc700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 0x7fa44c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.317+0000 7fa469d9b700 1 -- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 msgr2=0x7fa44c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.317+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa45c079cf0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.317+0000 7fa469d9b700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 0x7fa44c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.320+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa45c04acd0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.375 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:04.372+0000 7fc5540b6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:48:04.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.490+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa46c0614e0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.490+0000 7fa45a7fc700 1 -- 172.21.15.148:0/2182670264 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa46c0614e0 con 0x7fa46c0a9e60 2023-10-24T00:48:04.493 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:48:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 msgr2=0x7fa44c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 0x7fa44c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 msgr2=0x7fa46c0cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fa45c00c5c0 tx=0x7fa45c007c80).stop 2023-10-24T00:48:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 shutdown_connections 2023-10-24T00:48:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa46c1574f0 0x7fa46c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa44c05f390 0x7fa44c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa46c0a9e60 0x7fa46c0cb850 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 --2- 172.21.15.148:0/2182670264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa46c0c6fb0 0x7fa46c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 >> 172.21.15.148:0/2182670264 conn(0x7fa46c094500 msgr2=0x7fa46c0ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 shutdown_connections 2023-10-24T00:48:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.492+0000 7fa46b59e700 1 -- 172.21.15.148:0/2182670264 wait complete. 2023-10-24T00:48:04.508 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T00:48:04.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.628+0000 7f9ebd721700 1 Processor -- start 2023-10-24T00:48:04.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.628+0000 7f9ebd721700 1 -- start start 2023-10-24T00:48:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.628+0000 7f9ebd721700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9eb8152290 0x7f9eb8155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9ebd721700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9eb80c6240 0x7f9eb80c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9ebd721700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9ebd721700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80c8800 con 0x7f9eb80c6240 2023-10-24T00:48:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9ebd721700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb80c6bb0 con 0x7f9eb8152290 2023-10-24T00:48:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9ebd721700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8155c00 con 0x7f9eb80c0940 2023-10-24T00:48:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9eb80c6240 0x7f9eb80c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9eb80c6240 0x7f9eb80c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51506/0 (socket says 172.21.15.148:51506) 2023-10-24T00:48:04.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 -- 172.21.15.148:0/1533429200 learned_addr learned my addr 172.21.15.148:0/1533429200 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:04.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb77fe700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb6ffd700 1 --2- 172.21.15.148:0/1533429200 >> v2:172.21.15.150:3300/0 conn(0x7f9eb8152290 0x7f9eb8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 -- 172.21.15.148:0/1533429200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 msgr2=0x7f9eb80c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:04.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 -- 172.21.15.148:0/1533429200 >> v2:172.21.15.150:3300/0 conn(0x7f9eb8152290 msgr2=0x7f9eb8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 --2- 172.21.15.148:0/1533429200 >> v2:172.21.15.150:3300/0 conn(0x7f9eb8152290 0x7f9eb8155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 -- 172.21.15.148:0/1533429200 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80c7b80 con 0x7f9eb80c6240 2023-10-24T00:48:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb67fc700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb80c6240 0x7f9eb80c66c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f9eb8083820 tx=0x7f9eac0090f0).ready entity=mon.0 client_cookie=e6c5bf52e61485d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb5ffb700 1 -- 172.21.15.148:0/1533429200 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00f510 con 0x7f9eb80c6240 2023-10-24T00:48:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb5ffb700 1 -- 172.21.15.148:0/1533429200 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac00f670 con 0x7f9eb80c6240 2023-10-24T00:48:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.629+0000 7f9eb5ffb700 1 -- 172.21.15.148:0/1533429200 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00fa10 con 0x7f9eb80c6240 2023-10-24T00:48:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 -- 172.21.15.148:0/1533429200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb80c6240 msgr2=0x7f9eb80c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb80c6240 0x7f9eb80c66c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f9eb8083820 tx=0x7f9eac0090f0).stop 2023-10-24T00:48:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 -- 172.21.15.148:0/1533429200 shutdown_connections 2023-10-24T00:48:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 --2- 172.21.15.148:0/1533429200 >> v2:172.21.15.150:3300/0 conn(0x7f9eb8152290 0x7f9eb8155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 --2- 172.21.15.148:0/1533429200 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb80c6240 0x7f9eb80c66c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 -- 172.21.15.148:0/1533429200 >> 172.21.15.148:0/1533429200 conn(0x7f9eb80946c0 msgr2=0x7f9eb806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 -- 172.21.15.148:0/1533429200 shutdown_connections 2023-10-24T00:48:04.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.630+0000 7f9ebd721700 1 -- 172.21.15.148:0/1533429200 wait complete. 2023-10-24T00:48:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.631+0000 7f9ebd721700 1 Processor -- start 2023-10-24T00:48:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.631+0000 7f9ebd721700 1 -- start start 2023-10-24T00:48:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 0x7f9eb80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8164770 con 0x7f9eb8152290 2023-10-24T00:48:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8164a50 con 0x7f9eb80c6240 2023-10-24T00:48:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9ebd721700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb8164d30 con 0x7f9eb80c0940 2023-10-24T00:48:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9eb77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9eb77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51512/0 (socket says 172.21.15.148:51512) 2023-10-24T00:48:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9eb77fe700 1 -- 172.21.15.148:0/694668758 learned_addr learned my addr 172.21.15.148:0/694668758 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9eb67fc700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 0x7f9eb80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.632+0000 7f9eb6ffd700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 -- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 msgr2=0x7f9eb80c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 -- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 msgr2=0x7f9eb80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 0x7f9eb80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 -- 172.21.15.148:0/694668758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac009370 con 0x7f9eb8152290 2023-10-24T00:48:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb67fc700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 0x7f9eb80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9eb77fe700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f9eb0009df0 tx=0x7f9eb000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000caa0 con 0x7f9eb8152290 2023-10-24T00:48:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb000f040 con 0x7f9eb8152290 2023-10-24T00:48:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000ce10 con 0x7f9eb8152290 2023-10-24T00:48:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb8165010 con 0x7f9eb8152290 2023-10-24T00:48:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.633+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb8164390 con 0x7f9eb8152290 2023-10-24T00:48:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.634+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb806c6b0 con 0x7f9eb8152290 2023-10-24T00:48:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.635+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9eb0013610 con 0x7f9eb8152290 2023-10-24T00:48:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.635+0000 7f9e9effd700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 0x7f9ea4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.635+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9eb007ae80 con 0x7f9eb8152290 2023-10-24T00:48:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.635+0000 7f9eb6ffd700 1 -- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 msgr2=0x7f9ea4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.635+0000 7f9eb6ffd700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 0x7f9ea4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.639+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9eb004bc90 con 0x7f9eb8152290 2023-10-24T00:48:04.734 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.733+0000 7ff1b00d6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:48:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.809+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eb80c7e60 con 0x7f9eb8152290 2023-10-24T00:48:04.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.809+0000 7f9e9effd700 1 -- 172.21.15.148:0/694668758 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9eb004f2b0 con 0x7f9eb8152290 2023-10-24T00:48:04.812 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:48:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 msgr2=0x7f9ea4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 0x7f9ea4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 msgr2=0x7f9eb80c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f9eb0009df0 tx=0x7f9eb000b040).stop 2023-10-24T00:48:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 shutdown_connections 2023-10-24T00:48:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9ea405f390 0x7f9ea4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9eb8152290 0x7f9eb80c4240 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb80c0940 0x7f9eb80c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 --2- 172.21.15.148:0/694668758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb80c6240 0x7f9eb80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.811+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 >> 172.21.15.148:0/694668758 conn(0x7f9eb80946c0 msgr2=0x7f9eb814e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.812+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 shutdown_connections 2023-10-24T00:48:04.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.812+0000 7f9ebd721700 1 -- 172.21.15.148:0/694668758 wait complete. 2023-10-24T00:48:04.818 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:04.816+0000 7fc5540b6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:48:04.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T00:48:04.837 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.835+0000 7ff1b00d6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:04.930 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:04.927+0000 7fc5540b6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.943+0000 7f5ce4562700 1 Processor -- start 2023-10-24T00:48:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.943+0000 7f5ce4562700 1 -- start start 2023-10-24T00:48:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.944+0000 7f5ce4562700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.944+0000 7f5ce4562700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0bfdb0 con 0x7f5cdc156c30 2023-10-24T00:48:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce4562700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0c41a0 con 0x7f5cdc1560a0 2023-10-24T00:48:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce4562700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0bfbc0 con 0x7f5cdc0a8230 2023-10-24T00:48:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce2aff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5cdc156c30 0x7f5cdc152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44792/0 (socket says 172.21.15.148:44792) 2023-10-24T00:48:04.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51526/0 (socket says 172.21.15.148:51526) 2023-10-24T00:48:04.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce2aff700 1 -- 172.21.15.148:0/657055995 learned_addr learned my addr 172.21.15.148:0/657055995 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:04.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 -- 172.21.15.148:0/657055995 >> v1:172.21.15.150:6789/0 conn(0x7f5cdc1560a0 legacy=0x7f5cdc156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 -- 172.21.15.148:0/657055995 >> v1:172.21.15.148:6789/0 conn(0x7f5cdc156c30 legacy=0x7f5cdc152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 -- 172.21.15.148:0/657055995 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0c98b0 con 0x7f5cdc0a8230 2023-10-24T00:48:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce22fe700 1 --2- 172.21.15.148:0/657055995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f5ccc009760 tx=0x7f5ccc009060).ready entity=mon.0 client_cookie=954b939ad463607d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce12fc700 1 -- 172.21.15.148:0/657055995 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00b580 con 0x7f5cdc0a8230 2023-10-24T00:48:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce12fc700 1 -- 172.21.15.148:0/657055995 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00b6e0 con 0x7f5cdc0a8230 2023-10-24T00:48:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.945+0000 7f5ce12fc700 1 -- 172.21.15.148:0/657055995 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00ba60 con 0x7f5cdc0a8230 2023-10-24T00:48:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 -- 172.21.15.148:0/657055995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc0a8230 msgr2=0x7f5cdc0bf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 --2- 172.21.15.148:0/657055995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f5ccc009760 tx=0x7f5ccc009060).stop 2023-10-24T00:48:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 -- 172.21.15.148:0/657055995 shutdown_connections 2023-10-24T00:48:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 --2- 172.21.15.148:0/657055995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc0bf6d0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 -- 172.21.15.148:0/657055995 >> 172.21.15.148:0/657055995 conn(0x7f5cdc0630d0 msgr2=0x7f5cdc0c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 -- 172.21.15.148:0/657055995 shutdown_connections 2023-10-24T00:48:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.946+0000 7f5ce4562700 1 -- 172.21.15.148:0/657055995 wait complete. 2023-10-24T00:48:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.947+0000 7f5ce4562700 1 Processor -- start 2023-10-24T00:48:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.947+0000 7f5ce4562700 1 -- start start 2023-10-24T00:48:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cdc1560a0 0x7f5cdc13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc152440 con 0x7f5cdc156c30 2023-10-24T00:48:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc13afe0 con 0x7f5cdc0a8230 2023-10-24T00:48:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce4562700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0c1990 con 0x7f5cdc1560a0 2023-10-24T00:48:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51540/0 (socket says 172.21.15.148:51540) 2023-10-24T00:48:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 -- 172.21.15.148:0/622223760 learned_addr learned my addr 172.21.15.148:0/622223760 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce1afd700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cdc1560a0 0x7f5cdc13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce22fe700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 -- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cdc1560a0 msgr2=0x7f5cdc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cdc1560a0 0x7f5cdc13a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 -- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cdc0a8230 msgr2=0x7f5cdc151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.948+0000 7f5ce2aff700 1 -- 172.21.15.148:0/622223760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0092a0 con 0x7f5cdc156c30 2023-10-24T00:48:04.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5ce2aff700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f5cd400c7c0 tx=0x7f5cd4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:04.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4005d30 con 0x7f5cdc156c30 2023-10-24T00:48:04.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd4005e90 con 0x7f5cdc156c30 2023-10-24T00:48:04.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc139390 con 0x7f5cdc156c30 2023-10-24T00:48:04.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40072e0 con 0x7f5cdc156c30 2023-10-24T00:48:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.949+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc139950 con 0x7f5cdc156c30 2023-10-24T00:48:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.950+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc06c6b0 con 0x7f5cdc156c30 2023-10-24T00:48:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.950+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5cd4007710 con 0x7f5cdc156c30 2023-10-24T00:48:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.950+0000 7f5cd27fc700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 0x7f5cc0061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.951+0000 7f5ce22fe700 1 -- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 msgr2=0x7f5cc0061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.951+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5cd407a070 con 0x7f5cdc156c30 2023-10-24T00:48:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.951+0000 7f5ce22fe700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 0x7f5cc0061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:04.955+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5cd404af90 con 0x7f5cdc156c30 2023-10-24T00:48:04.994 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:04.992+0000 7ff1b00d6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:05.073 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:05.072+0000 7ff1b00d6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:48:05.097 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:05.095+0000 7fc5540b6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.133+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cdc0c6ad0 con 0x7f5cdc156c30 2023-10-24T00:48:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.134+0000 7f5cd27fc700 1 -- 172.21.15.148:0/622223760 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cd40180a0 con 0x7f5cdc156c30 2023-10-24T00:48:05.137 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T00:48:05.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 msgr2=0x7f5cc0061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:05.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 0x7f5cc0061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 msgr2=0x7f5cdc13a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f5cd400c7c0 tx=0x7f5cd4001510).stop 2023-10-24T00:48:05.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 shutdown_connections 2023-10-24T00:48:05.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5cc005f360 0x7f5cc0061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cdc156c30 0x7f5cdc13a960 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cdc0a8230 0x7f5cdc151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 --2- 172.21.15.148:0/622223760 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cdc1560a0 0x7f5cdc13a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 >> 172.21.15.148:0/622223760 conn(0x7f5cdc0630d0 msgr2=0x7f5cdc137d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 shutdown_connections 2023-10-24T00:48:05.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.136+0000 7f5ce4562700 1 -- 172.21.15.148:0/622223760 wait complete. 2023-10-24T00:48:05.141 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:05.140+0000 7ff1b00d6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:48:05.150 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:05.177 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:05.175+0000 7fc5540b6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:48:05.249 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:05.247+0000 7fc5540b6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:48:05.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.264+0000 7f6561578700 1 Processor -- start 2023-10-24T00:48:05.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.264+0000 7f6561578700 1 -- start start 2023-10-24T00:48:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.265+0000 7f6561578700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f655c0695f0 0x7f655c0699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.265+0000 7f6561578700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 0x7f655c13a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.265+0000 7f6561578700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c13ac70 con 0x7f655c13a7e0 2023-10-24T00:48:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.265+0000 7f6561578700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0c57b0 con 0x7f655c0695f0 2023-10-24T00:48:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.265+0000 7f6561578700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0c5a90 con 0x7f655c0aacd0 2023-10-24T00:48:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f655c0695f0 0x7f655c0699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f655c0695f0 0x7f655c0699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51552/0 (socket says 172.21.15.148:51552) 2023-10-24T00:48:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 -- 172.21.15.148:0/1526735144 learned_addr learned my addr 172.21.15.148:0/1526735144 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655a7fc700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 0x7f655c13a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 -- 172.21.15.148:0/1526735144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 msgr2=0x7f655c13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 0x7f655c13a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 -- 172.21.15.148:0/1526735144 >> v1:172.21.15.150:6789/0 conn(0x7f655c13a7e0 legacy=0x7f655c065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 -- 172.21.15.148:0/1526735144 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0c5d70 con 0x7f655c0695f0 2023-10-24T00:48:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655a7fc700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 0x7f655c13a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f655affd700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c0699d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f6550009830 tx=0x7f65500090f0).ready entity=mon.0 client_cookie=ebb14394d6d68bf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f6559ffb700 1 -- 172.21.15.148:0/1526735144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000b600 con 0x7f655c0695f0 2023-10-24T00:48:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f6559ffb700 1 -- 172.21.15.148:0/1526735144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000b760 con 0x7f655c0695f0 2023-10-24T00:48:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.266+0000 7f6559ffb700 1 -- 172.21.15.148:0/1526735144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000bae0 con 0x7f655c0695f0 2023-10-24T00:48:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 -- 172.21.15.148:0/1526735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 msgr2=0x7f655c0699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c0699d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f6550009830 tx=0x7f65500090f0).stop 2023-10-24T00:48:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 -- 172.21.15.148:0/1526735144 shutdown_connections 2023-10-24T00:48:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c0699d0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 --2- 172.21.15.148:0/1526735144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c0aacd0 0x7f655c13a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 -- 172.21.15.148:0/1526735144 >> 172.21.15.148:0/1526735144 conn(0x7f655c0641f0 msgr2=0x7f655c0c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 -- 172.21.15.148:0/1526735144 shutdown_connections 2023-10-24T00:48:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.267+0000 7f6561578700 1 -- 172.21.15.148:0/1526735144 wait complete. 2023-10-24T00:48:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.269+0000 7f6561578700 1 Processor -- start 2023-10-24T00:48:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.269+0000 7f6561578700 1 -- start start 2023-10-24T00:48:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c0aacd0 0x7f655c0c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c13a7e0 0x7f655c0c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1529f0 con 0x7f655c0695f0 2023-10-24T00:48:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c151de0 con 0x7f655c0aacd0 2023-10-24T00:48:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f6561578700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1520c0 con 0x7f655c13a7e0 2023-10-24T00:48:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51566/0 (socket says 172.21.15.148:51566) 2023-10-24T00:48:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 -- 172.21.15.148:0/2409013845 learned_addr learned my addr 172.21.15.148:0/2409013845 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655b7fe700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c13a7e0 0x7f655c0c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655a7fc700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c0aacd0 0x7f655c0c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c13a7e0 msgr2=0x7f655c0c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c13a7e0 0x7f655c0c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c0aacd0 msgr2=0x7f655c0c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c0aacd0 0x7f655c0c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.270+0000 7f655affd700 1 -- 172.21.15.148:0/2409013845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009370 con 0x7f655c0695f0 2023-10-24T00:48:05.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f655affd700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f655c068c60 tx=0x7f6550017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000b8d0 con 0x7f655c0695f0 2023-10-24T00:48:05.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000ba30 con 0x7f655c0695f0 2023-10-24T00:48:05.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c1523a0 con 0x7f655c0695f0 2023-10-24T00:48:05.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655001b660 con 0x7f655c0695f0 2023-10-24T00:48:05.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.271+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c151a80 con 0x7f655c0695f0 2023-10-24T00:48:05.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.272+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c06c6b0 con 0x7f655c0695f0 2023-10-24T00:48:05.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.272+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f655001b9d0 con 0x7f655c0695f0 2023-10-24T00:48:05.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.273+0000 7f6542ffd700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 0x7f6548061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.273+0000 7f655a7fc700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 msgr2=0x7f6548061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:05.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.273+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f655007c040 con 0x7f655c0695f0 2023-10-24T00:48:05.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.273+0000 7f655a7fc700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 0x7f6548061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:05.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.277+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f655004cf30 con 0x7f655c0695f0 2023-10-24T00:48:05.402 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:05.401+0000 7ff1b00d6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:48:05.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.474+0000 7f655a7fc700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 msgr2=0x7f6548061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:05.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.474+0000 7f655a7fc700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 0x7f6548061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:05.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.487+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f655c0c6050 con 0x7f655c0695f0 2023-10-24T00:48:05.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.488+0000 7f6542ffd700 1 -- 172.21.15.148:0/2409013845 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f6550028020 con 0x7f655c0695f0 2023-10-24T00:48:05.491 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:05.491 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:48:05.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 msgr2=0x7f6548061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:05.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 0x7f6548061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 msgr2=0x7f655c151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f655c068c60 tx=0x7f6550017000).stop 2023-10-24T00:48:05.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 shutdown_connections 2023-10-24T00:48:05.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f655c13a7e0 0x7f655c0c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f654805f360 0x7f6548061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f655c0695f0 0x7f655c151590 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 --2- 172.21.15.148:0/2409013845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f655c0aacd0 0x7f655c0c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 >> 172.21.15.148:0/2409013845 conn(0x7f655c0641f0 msgr2=0x7f655c0ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 shutdown_connections 2023-10-24T00:48:05.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.490+0000 7f6561578700 1 -- 172.21.15.148:0/2409013845 wait complete. 2023-10-24T00:48:05.495 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:48:05.505 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:05.522 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:05.520+0000 7fc5540b6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:48:05.586 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:05.584+0000 7ff1b00d6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 Processor -- start 2023-10-24T00:48:05.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 -- start start 2023-10-24T00:48:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efccc0aa880 con 0x7efccc0aa010 2023-10-24T00:48:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efccc0c0960 con 0x7efccc0aa3f0 2023-10-24T00:48:05.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.639+0000 7efcd2259700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c0c40 con 0x7efccc0c6710 2023-10-24T00:48:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:40420/0 (socket says 172.21.15.148:40420) 2023-10-24T00:48:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:35452/0 (socket says 172.21.15.148:35452) 2023-10-24T00:48:05.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccbfff700 1 -- 172.21.15.148:0/395121110 learned_addr learned my addr 172.21.15.148:0/395121110 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 -- 172.21.15.148:0/395121110 >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 msgr2=0x7efccc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 --2- 172.21.15.148:0/395121110 >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 -- 172.21.15.148:0/395121110 >> v1:172.21.15.150:6789/0 conn(0x7efccc0aa010 legacy=0x7efccc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 -- 172.21.15.148:0/395121110 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0c0f20 con 0x7efccc0c6710 2023-10-24T00:48:05.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccbfff700 1 --2- 172.21.15.148:0/395121110 >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efccaffd700 1 --2- 172.21.15.148:0/395121110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efcc0009760 tx=0x7efcc0009060).ready entity=mon.2 client_cookie=4862a2bde5cb95c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efcca7fc700 1 -- 172.21.15.148:0/395121110 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000f510 con 0x7efccc0c6710 2023-10-24T00:48:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efcca7fc700 1 -- 172.21.15.148:0/395121110 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000f670 con 0x7efccc0c6710 2023-10-24T00:48:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.640+0000 7efcca7fc700 1 -- 172.21.15.148:0/395121110 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000f9f0 con 0x7efccc0c6710 2023-10-24T00:48:05.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 -- 172.21.15.148:0/395121110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 msgr2=0x7efccc0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 --2- 172.21.15.148:0/395121110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efcc0009760 tx=0x7efcc0009060).stop 2023-10-24T00:48:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 -- 172.21.15.148:0/395121110 shutdown_connections 2023-10-24T00:48:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 --2- 172.21.15.148:0/395121110 >> v2:172.21.15.150:3300/0 conn(0x7efccc0aa3f0 0x7efccc069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 --2- 172.21.15.148:0/395121110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0c6710 0x7efccc0c1a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 -- 172.21.15.148:0/395121110 >> 172.21.15.148:0/395121110 conn(0x7efccc0caf40 msgr2=0x7efccc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 -- 172.21.15.148:0/395121110 shutdown_connections 2023-10-24T00:48:05.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.641+0000 7efcd2259700 1 -- 172.21.15.148:0/395121110 wait complete. 2023-10-24T00:48:05.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.642+0000 7efcd2259700 1 Processor -- start 2023-10-24T00:48:05.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 -- start start 2023-10-24T00:48:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0aa010 0x7efccc151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efccc0c6710 0x7efccc0ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc154840 con 0x7efccc0aa3f0 2023-10-24T00:48:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc154ae0 con 0x7efccc0c6710 2023-10-24T00:48:05.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efcd2259700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0c48b0 con 0x7efccc0aa010 2023-10-24T00:48:05.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efccaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efccaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51574/0 (socket says 172.21.15.148:51574) 2023-10-24T00:48:05.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efccaffd700 1 -- 172.21.15.148:0/2349298231 learned_addr learned my addr 172.21.15.148:0/2349298231 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:05.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efccbfff700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efccc0c6710 0x7efccc0ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.643+0000 7efccb7fe700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0aa010 0x7efccc151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 -- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0aa010 msgr2=0x7efccc151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0aa010 0x7efccc151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 -- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efccc0c6710 msgr2=0x7efccc0ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efccc0c6710 0x7efccc0ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 -- 172.21.15.148:0/2349298231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009ae0 con 0x7efccc0aa3f0 2023-10-24T00:48:05.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efccaffd700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7efcc0011e50 tx=0x7efcc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000f510 con 0x7efccc0aa3f0 2023-10-24T00:48:05.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000f7e0 con 0x7efccc0aa3f0 2023-10-24T00:48:05.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00092a0 con 0x7efccc0aa3f0 2023-10-24T00:48:05.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc001b410 con 0x7efccc0aa3f0 2023-10-24T00:48:05.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.644+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc0c4e70 con 0x7efccc0aa3f0 2023-10-24T00:48:05.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.645+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc154c70 con 0x7efccc0aa3f0 2023-10-24T00:48:05.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.646+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7efcc001b780 con 0x7efccc0aa3f0 2023-10-24T00:48:05.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.646+0000 7efcb37fe700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 0x7efcb8061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.646+0000 7efccb7fe700 1 -- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 msgr2=0x7efcb8061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:05.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.646+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7efcc007be60 con 0x7efccc0aa3f0 2023-10-24T00:48:05.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.646+0000 7efccb7fe700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 0x7efcb8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:05.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.653+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efcc004cd50 con 0x7efccc0aa3f0 2023-10-24T00:48:05.721 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:05.719+0000 7fc5540b6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:05.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.823+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efccc06c6b0 con 0x7efccc0aa3f0 2023-10-24T00:48:05.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.824+0000 7efcb37fe700 1 -- 172.21.15.148:0/2349298231 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17349 (secure 0 0 0) 0x7efcc001f020 con 0x7efccc0aa3f0 2023-10-24T00:48:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:05.827 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":129,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:04.956890+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":129,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:6832/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/2035443629":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/4137302598":"2023-10-25T00:47:20.174197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 msgr2=0x7efcb8061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 0x7efcb8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 msgr2=0x7efccc0c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7efcc0011e50 tx=0x7efcc0017000).stop 2023-10-24T00:48:05.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 shutdown_connections 2023-10-24T00:48:05.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efccc0c6710 0x7efccc0ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efccc0aa010 0x7efccc151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efcb805f360 0x7efcb8061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:05.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 --2- 172.21.15.148:0/2349298231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efccc0aa3f0 0x7efccc0c3f40 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 >> 172.21.15.148:0/2349298231 conn(0x7efccc0caf40 msgr2=0x7efccc152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 shutdown_connections 2023-10-24T00:48:05.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.826+0000 7efcd2259700 1 -- 172.21.15.148:0/2349298231 wait complete. 2023-10-24T00:48:05.841 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T00:48:05.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.957+0000 7f474dd2e700 1 Processor -- start 2023-10-24T00:48:05.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.957+0000 7f474dd2e700 1 -- start start 2023-10-24T00:48:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f474dd2e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4748150530 0x7f47480c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f474dd2e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4748150910 0x7f47480c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f474dd2e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47480c30f0 con 0x7f47480638c0 2023-10-24T00:48:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f474dd2e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47480c24e0 con 0x7f4748150910 2023-10-24T00:48:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f474dd2e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47480c27c0 con 0x7f4748150530 2023-10-24T00:48:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4748150910 0x7f47480c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4747fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f47480638c0 0x7f47480bcb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44802/0 (socket says 172.21.15.148:44802) 2023-10-24T00:48:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4747fff700 1 -- 172.21.15.148:0/1107145712 learned_addr learned my addr 172.21.15.148:0/1107145712 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f47477fe700 1 --2- 172.21.15.148:0/1107145712 >> v2:172.21.15.150:3300/0 conn(0x7f4748150530 0x7f47480c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4746ffd700 1 -- 172.21.15.148:0/1107145712 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350285865 0 0) 0x7f47480c30f0 con 0x7f47480638c0 2023-10-24T00:48:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4746ffd700 1 -- 172.21.15.148:0/1107145712 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47340033f0 con 0x7f47480638c0 2023-10-24T00:48:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 -- 172.21.15.148:0/1107145712 >> v2:172.21.15.150:3300/0 conn(0x7f4748150530 msgr2=0x7f47480c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 --2- 172.21.15.148:0/1107145712 >> v2:172.21.15.150:3300/0 conn(0x7f4748150530 0x7f47480c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 -- 172.21.15.148:0/1107145712 >> v1:172.21.15.148:6789/0 conn(0x7f47480638c0 legacy=0x7f47480bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 -- 172.21.15.148:0/1107145712 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480c2aa0 con 0x7f4748150910 2023-10-24T00:48:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f473ffff700 1 --2- 172.21.15.148:0/1107145712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4748150910 0x7f47480c3580 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f47480641a0 tx=0x7f4730009060).ready entity=mon.0 client_cookie=fb72476c2998feec server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4746ffd700 1 -- 172.21.15.148:0/1107145712 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000d4a0 con 0x7f4748150910 2023-10-24T00:48:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4746ffd700 1 -- 172.21.15.148:0/1107145712 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473000d600 con 0x7f4748150910 2023-10-24T00:48:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.958+0000 7f4746ffd700 1 -- 172.21.15.148:0/1107145712 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000d980 con 0x7f4748150910 2023-10-24T00:48:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 -- 172.21.15.148:0/1107145712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4748150910 msgr2=0x7f47480c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 --2- 172.21.15.148:0/1107145712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4748150910 0x7f47480c3580 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f47480641a0 tx=0x7f4730009060).stop 2023-10-24T00:48:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 -- 172.21.15.148:0/1107145712 shutdown_connections 2023-10-24T00:48:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 --2- 172.21.15.148:0/1107145712 >> v2:172.21.15.150:3300/0 conn(0x7f4748150530 0x7f47480c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 --2- 172.21.15.148:0/1107145712 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4748150910 0x7f47480c3580 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 -- 172.21.15.148:0/1107145712 >> 172.21.15.148:0/1107145712 conn(0x7f47480c7ee0 msgr2=0x7f47480c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 -- 172.21.15.148:0/1107145712 shutdown_connections 2023-10-24T00:48:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.959+0000 7f474dd2e700 1 -- 172.21.15.148:0/1107145712 wait complete. 2023-10-24T00:48:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.960+0000 7f474dd2e700 1 Processor -- start 2023-10-24T00:48:05.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.960+0000 7f474dd2e700 1 -- start start 2023-10-24T00:48:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4748150530 0x7f4748146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 0x7f47480c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47480aca00 con 0x7f47480638c0 2023-10-24T00:48:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47480acce0 con 0x7f4748150910 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f474dd2e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47480acfc0 con 0x7f4748150530 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f47477fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f47477fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51604/0 (socket says 172.21.15.148:51604) 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f47477fe700 1 -- 172.21.15.148:0/2573470766 learned_addr learned my addr 172.21.15.148:0/2573470766 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 0x7f47480c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f473ffff700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4748150530 0x7f4748146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4748150530 msgr2=0x7f4748146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4748150530 0x7f4748146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 msgr2=0x7f474813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f4747fff700 1 -- 172.21.15.148:0/2573470766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300092a0 con 0x7f4748150910 2023-10-24T00:48:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.961+0000 7f47477fe700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.962+0000 7f4747fff700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 0x7f47480c09f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f474000c790 tx=0x7f4740007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.965+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740005d30 con 0x7f4748150910 2023-10-24T00:48:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.966+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740005e90 con 0x7f4748150910 2023-10-24T00:48:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.966+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47480ad2a0 con 0x7f4748150910 2023-10-24T00:48:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.966+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400072e0 con 0x7f4748150910 2023-10-24T00:48:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.966+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4748140490 con 0x7f4748150910 2023-10-24T00:48:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4740007710 con 0x7f4748150910 2023-10-24T00:48:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f473f7fe700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 0x7f4728061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47480ace20 con 0x7f4748150910 2023-10-24T00:48:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f4740079ec0 con 0x7f4748150910 2023-10-24T00:48:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f47477fe700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 msgr2=0x7f4728061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.967+0000 7f47477fe700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 0x7f4728061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:05.972+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f47480ace20 con 0x7f4748150910 2023-10-24T00:48:06.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.168+0000 7f47477fe700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 msgr2=0x7f4728061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:06.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.168+0000 7f47477fe700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 0x7f4728061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:06.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.189+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47480ace20 con 0x7f4748150910 2023-10-24T00:48:06.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.189+0000 7f473f7fe700 1 -- 172.21.15.148:0/2573470766 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f47480ace20 con 0x7f4748150910 2023-10-24T00:48:06.192 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:06.192 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:48:06.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.191+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 msgr2=0x7f4728061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:06.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.191+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 0x7f4728061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 msgr2=0x7f47480c09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 0x7f47480c09f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f474000c790 tx=0x7f4740007f10).stop 2023-10-24T00:48:06.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 shutdown_connections 2023-10-24T00:48:06.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4748150910 0x7f47480c09f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f472805f390 0x7f4728061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47480638c0 0x7f474813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 --2- 172.21.15.148:0/2573470766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4748150530 0x7f4748146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 >> 172.21.15.148:0/2573470766 conn(0x7f47480c7ee0 msgr2=0x7f47480c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:06.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 shutdown_connections 2023-10-24T00:48:06.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.192+0000 7f474dd2e700 1 -- 172.21.15.148:0/2573470766 wait complete. 2023-10-24T00:48:06.197 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:48:06.207 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:06.245 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.244+0000 7ff1b00d6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:48:06.314 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.313+0000 7ff1b00d6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:48:06.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.326+0000 7fdcf18fc700 1 Processor -- start 2023-10-24T00:48:06.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.326+0000 7fdcf18fc700 1 -- start start 2023-10-24T00:48:06.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdcf18fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdcec0a8480 0x7fdcec15f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdcf18fc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec0a5bd0 con 0x7fdcec154540 2023-10-24T00:48:06.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdcf18fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec064ab0 con 0x7fdcec0be650 2023-10-24T00:48:06.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdcf18fc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec064d90 con 0x7fdcec0a8480 2023-10-24T00:48:06.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdceb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdcec0a8480 0x7fdcec15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdceaffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdcec154540 0x7fdcec0640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44818/0 (socket says 172.21.15.148:44818) 2023-10-24T00:48:06.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdceb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdcec0a8480 0x7fdcec15f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51608/0 (socket says 172.21.15.148:51608) 2023-10-24T00:48:06.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.327+0000 7fdceaffd700 1 -- 172.21.15.148:0/113082048 learned_addr learned my addr 172.21.15.148:0/113082048 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:06.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdceb7fe700 1 -- 172.21.15.148:0/113082048 >> v1:172.21.15.150:6789/0 conn(0x7fdcec0be650 legacy=0x7fdcec0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdceb7fe700 1 -- 172.21.15.148:0/113082048 >> v1:172.21.15.148:6789/0 conn(0x7fdcec154540 legacy=0x7fdcec0640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdceb7fe700 1 -- 172.21.15.148:0/113082048 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec065070 con 0x7fdcec0a8480 2023-10-24T00:48:06.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdce9ffb700 1 -- 172.21.15.148:0/113082048 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045837211 0 0) 0x7fdcec0a5bd0 con 0x7fdcec154540 2023-10-24T00:48:06.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdceb7fe700 1 --2- 172.21.15.148:0/113082048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0a8480 0x7fdcec15f130 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fdce4009e60 tx=0x7fdce4009780).ready entity=mon.0 client_cookie=8da3b3653620e706 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:06.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdce9ffb700 1 -- 172.21.15.148:0/113082048 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400e070 con 0x7fdcec0a8480 2023-10-24T00:48:06.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdce9ffb700 1 -- 172.21.15.148:0/113082048 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400bc30 con 0x7fdcec0a8480 2023-10-24T00:48:06.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.328+0000 7fdce9ffb700 1 -- 172.21.15.148:0/113082048 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4012410 con 0x7fdcec0a8480 2023-10-24T00:48:06.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 -- 172.21.15.148:0/113082048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0a8480 msgr2=0x7fdcec15f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/113082048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0a8480 0x7fdcec15f130 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fdce4009e60 tx=0x7fdce4009780).stop 2023-10-24T00:48:06.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 -- 172.21.15.148:0/113082048 shutdown_connections 2023-10-24T00:48:06.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/113082048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec0a8480 0x7fdcec15f130 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 -- 172.21.15.148:0/113082048 >> 172.21.15.148:0/113082048 conn(0x7fdcec092480 msgr2=0x7fdcec062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:06.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 -- 172.21.15.148:0/113082048 shutdown_connections 2023-10-24T00:48:06.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.329+0000 7fdcf18fc700 1 -- 172.21.15.148:0/113082048 wait complete. 2023-10-24T00:48:06.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.330+0000 7fdcf18fc700 1 Processor -- start 2023-10-24T00:48:06.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.330+0000 7fdcf18fc700 1 -- start start 2023-10-24T00:48:06.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcec0a8480 0x7fdcec0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcec0be650 0x7fdcec0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec148e60 con 0x7fdcec154540 2023-10-24T00:48:06.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec149140 con 0x7fdcec0be650 2023-10-24T00:48:06.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcf18fc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec149420 con 0x7fdcec0a8480 2023-10-24T00:48:06.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51612/0 (socket says 172.21.15.148:51612) 2023-10-24T00:48:06.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 -- 172.21.15.148:0/1198100226 learned_addr learned my addr 172.21.15.148:0/1198100226 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:06.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdcea7fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcec0be650 0x7fdcec0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceaffd700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcec0a8480 0x7fdcec0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcec0a8480 msgr2=0x7fdcec0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcec0a8480 0x7fdcec0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcec0be650 msgr2=0x7fdcec0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcec0be650 0x7fdcec0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 -- 172.21.15.148:0/1198100226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4009a20 con 0x7fdcec154540 2023-10-24T00:48:06.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.331+0000 7fdceb7fe700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fdcec05f5d0 tx=0x7fdce4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:06.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.332+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4006320 con 0x7fdcec154540 2023-10-24T00:48:06.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.332+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4006480 con 0x7fdcec154540 2023-10-24T00:48:06.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.332+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcec149700 con 0x7fdcec154540 2023-10-24T00:48:06.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.332+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4006820 con 0x7fdcec154540 2023-10-24T00:48:06.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.332+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcec0c6250 con 0x7fdcec154540 2023-10-24T00:48:06.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.333+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec149c20 con 0x7fdcec154540 2023-10-24T00:48:06.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.333+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fdce4027460 con 0x7fdcec154540 2023-10-24T00:48:06.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.334+0000 7fdcd2ffd700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 0x7fdcd8061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.334+0000 7fdceaffd700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 msgr2=0x7fdcd8061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:06.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.334+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fdce407cb90 con 0x7fdcec154540 2023-10-24T00:48:06.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.334+0000 7fdceaffd700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 0x7fdcd8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:06.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.338+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdce404d910 con 0x7fdcec154540 2023-10-24T00:48:06.391 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.390+0000 7ff1b00d6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:48:06.414 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.412+0000 7fc5540b6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:48:06.486 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.484+0000 7fc5540b6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:48:06.537 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.535+0000 7ff1b00d6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:48:06.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.535+0000 7fdceaffd700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 msgr2=0x7fdcd8061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:06.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.535+0000 7fdceaffd700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 0x7fdcd8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:06.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.550+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcec06c6b0 con 0x7fdcec154540 2023-10-24T00:48:06.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.551+0000 7fdcd2ffd700 1 -- 172.21.15.148:0/1198100226 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fdce4050f30 con 0x7fdcec154540 2023-10-24T00:48:06.554 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:06.554 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:47:04.250197+0000","modified":"2023-10-24T00:47:06.258450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6837/2431879212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":2431879212},{"type":"v1","addr":"172.21.15.150:6837","nonce":2431879212}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-24T00:48:06.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 msgr2=0x7fdcd8061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:06.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 0x7fdcd8061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 msgr2=0x7fdcec0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7fdcec05f5d0 tx=0x7fdce4009780).stop 2023-10-24T00:48:06.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 shutdown_connections 2023-10-24T00:48:06.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdcd805f360 0x7fdcd8061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdcec154540 0x7fdcec0a8da0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdcec0a8480 0x7fdcec0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 --2- 172.21.15.148:0/1198100226 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcec0be650 0x7fdcec0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 >> 172.21.15.148:0/1198100226 conn(0x7fdcec092480 msgr2=0x7fdcec14a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:06.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 shutdown_connections 2023-10-24T00:48:06.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.553+0000 7fdcf18fc700 1 -- 172.21.15.148:0/1198100226 wait complete. 2023-10-24T00:48:06.558 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 43 2023-10-24T00:48:06.566 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.564+0000 7fc5540b6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:48:06.568 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:06.607 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.606+0000 7ff1b00d6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:48:06.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.682+0000 7f75d2571700 1 Processor -- start 2023-10-24T00:48:06.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.682+0000 7f75d2571700 1 -- start start 2023-10-24T00:48:06.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d2571700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0bcf30 0x7f75cc068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d2571700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f75cc0c20f0 0x7f75cc064470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d2571700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0697a0 con 0x7f75cc151740 2023-10-24T00:48:06.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d2571700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc14b240 con 0x7f75cc0c20f0 2023-10-24T00:48:06.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d2571700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0c1280 con 0x7f75cc0bcf30 2023-10-24T00:48:06.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d0d6e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f75cc151740 0x7f75cc0c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44824/0 (socket says 172.21.15.148:44824) 2023-10-24T00:48:06.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d0d6e700 1 -- 172.21.15.148:0/457462451 learned_addr learned my addr 172.21.15.148:0/457462451 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:06.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 --2- 172.21.15.148:0/457462451 >> v2:172.21.15.148:3300/0 conn(0x7f75cc0c20f0 0x7f75cc064470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d156f700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0bcf30 0x7f75cc068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75c3fff700 1 -- 172.21.15.148:0/457462451 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653121931 0 0) 0x7f75cc0697a0 con 0x7f75cc151740 2023-10-24T00:48:06.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75c3fff700 1 -- 172.21.15.148:0/457462451 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b80033f0 con 0x7f75cc151740 2023-10-24T00:48:06.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 -- 172.21.15.148:0/457462451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0bcf30 msgr2=0x7f75cc068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:06.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0bcf30 0x7f75cc068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 -- 172.21.15.148:0/457462451 >> v1:172.21.15.148:6789/0 conn(0x7f75cc151740 legacy=0x7f75cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 -- 172.21.15.148:0/457462451 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc068b90 con 0x7f75cc0c20f0 2023-10-24T00:48:06.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.683+0000 7f75d1d70700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc0c20f0 0x7f75cc064470 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f75c4009e60 tx=0x7f75c4009780).ready entity=mon.0 client_cookie=31715dcf4dc7027f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:06.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75c3fff700 1 -- 172.21.15.148:0/457462451 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e070 con 0x7f75cc0c20f0 2023-10-24T00:48:06.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75c3fff700 1 -- 172.21.15.148:0/457462451 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400bab0 con 0x7f75cc0c20f0 2023-10-24T00:48:06.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75c3fff700 1 -- 172.21.15.148:0/457462451 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400be30 con 0x7f75cc0c20f0 2023-10-24T00:48:06.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 -- 172.21.15.148:0/457462451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc0c20f0 msgr2=0x7f75cc064470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc0c20f0 0x7f75cc064470 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f75c4009e60 tx=0x7f75c4009780).stop 2023-10-24T00:48:06.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 -- 172.21.15.148:0/457462451 shutdown_connections 2023-10-24T00:48:06.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc0c20f0 0x7f75cc064470 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 --2- 172.21.15.148:0/457462451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0bcf30 0x7f75cc068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 -- 172.21.15.148:0/457462451 >> 172.21.15.148:0/457462451 conn(0x7f75cc063110 msgr2=0x7f75cc0c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:06.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 -- 172.21.15.148:0/457462451 shutdown_connections 2023-10-24T00:48:06.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.684+0000 7f75d2571700 1 -- 172.21.15.148:0/457462451 wait complete. 2023-10-24T00:48:06.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.685+0000 7f75d2571700 1 Processor -- start 2023-10-24T00:48:06.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.685+0000 7f75d2571700 1 -- start start 2023-10-24T00:48:06.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc0bcf30 0x7f75cc0be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0c20f0 0x7f75cc148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc15dc20 con 0x7f75cc151740 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0bea90 con 0x7f75cc0bcf30 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d2571700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0bed70 con 0x7f75cc0c20f0 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d1d70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d1d70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51620/0 (socket says 172.21.15.148:51620) 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.686+0000 7f75d1d70700 1 -- 172.21.15.148:0/362439320 learned_addr learned my addr 172.21.15.148:0/362439320 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:06.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d156f700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc0bcf30 0x7f75cc0be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d0d6e700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0c20f0 0x7f75cc148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:06.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 -- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0c20f0 msgr2=0x7f75cc148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0c20f0 0x7f75cc148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 -- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc0bcf30 msgr2=0x7f75cc0be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc0bcf30 0x7f75cc0be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 -- 172.21.15.148:0/362439320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009a20 con 0x7f75cc151740 2023-10-24T00:48:06.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d1d70700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f75c4009460 tx=0x7f75cc069710).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:06.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4013e40 con 0x7f75cc151740 2023-10-24T00:48:06.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c401d630 con 0x7f75cc151740 2023-10-24T00:48:06.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c401d9d0 con 0x7f75cc151740 2023-10-24T00:48:06.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0bf050 con 0x7f75cc151740 2023-10-24T00:48:06.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.687+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0bf610 con 0x7f75cc151740 2023-10-24T00:48:06.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.688+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f75c4003040 con 0x7f75cc151740 2023-10-24T00:48:06.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.688+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc0bf980 con 0x7f75cc151740 2023-10-24T00:48:06.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.689+0000 7f75c17fa700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 0x7f75b0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:06.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.689+0000 7f75d156f700 1 -- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 msgr2=0x7f75b0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:06.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.689+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f75c407c4f0 con 0x7f75cc151740 2023-10-24T00:48:06.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.689+0000 7f75d156f700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 0x7f75b0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:06.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.693+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75c404d2d0 con 0x7f75cc151740 2023-10-24T00:48:06.724 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.723+0000 7ff1b00d6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:48:06.736 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.734+0000 7fc5540b6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:48:06.810 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.807+0000 7fc5540b6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:48:06.832 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:06.831+0000 7ff1b00d6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:06.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.876+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75cc0c28b0 con 0x7f75cc151740 2023-10-24T00:48:06.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.877+0000 7f75c17fa700 1 -- 172.21.15.148:0/362439320 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+17349 (secure 0 0 0) 0x7f75c40508f0 con 0x7f75cc151740 2023-10-24T00:48:06.880 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:06.880 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":129,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:04.956890+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:47:02.232202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-24T00:47:03.214931+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":129,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:6832/87479":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/2035443629":"2023-10-25T00:47:20.174197+0000","172.21.15.150:0/4137302598":"2023-10-25T00:47:20.174197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 msgr2=0x7f75b0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 0x7f75b0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 msgr2=0x7f75cc163720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f75c4009460 tx=0x7f75cc069710).stop 2023-10-24T00:48:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 shutdown_connections 2023-10-24T00:48:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.879+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f75b005f390 0x7f75b0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75cc151740 0x7f75cc163720 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75cc0bcf30 0x7f75cc0be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 --2- 172.21.15.148:0/362439320 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75cc0c20f0 0x7f75cc148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 >> 172.21.15.148:0/362439320 conn(0x7f75cc063110 msgr2=0x7f75cc152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 shutdown_connections 2023-10-24T00:48:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:06.880+0000 7f75d2571700 1 -- 172.21.15.148:0/362439320 wait complete. 2023-10-24T00:48:06.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T00:48:06.931 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:06.928+0000 7fc5540b6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:48:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.013+0000 7fe0bd2eb700 1 Processor -- start 2023-10-24T00:48:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.013+0000 7fe0bd2eb700 1 -- start start 2023-10-24T00:48:07.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0bd2eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0b8137520 0x7fe0b8069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0bd2eb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0b8137900 0x7fe0b80bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0bd2eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b806a4f0 con 0x7fe0b80c11f0 2023-10-24T00:48:07.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0bd2eb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b8065d60 con 0x7fe0b8137900 2023-10-24T00:48:07.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0bd2eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b806a2e0 con 0x7fe0b8137520 2023-10-24T00:48:07.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0b67fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe0b8137900 0x7fe0b80bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:07.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0b77fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe0b80c11f0 0x7fe0b80bcca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44836/0 (socket says 172.21.15.148:44836) 2023-10-24T00:48:07.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.014+0000 7fe0b77fe700 1 -- 172.21.15.148:0/3925907517 learned_addr learned my addr 172.21.15.148:0/3925907517 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:07.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b6ffd700 1 --2- 172.21.15.148:0/3925907517 >> v2:172.21.15.150:3300/0 conn(0x7fe0b8137520 0x7fe0b8069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:07.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b67fc700 1 -- 172.21.15.148:0/3925907517 >> v2:172.21.15.150:3300/0 conn(0x7fe0b8137520 msgr2=0x7fe0b8069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:07.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b67fc700 1 --2- 172.21.15.148:0/3925907517 >> v2:172.21.15.150:3300/0 conn(0x7fe0b8137520 0x7fe0b8069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:07.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b67fc700 1 -- 172.21.15.148:0/3925907517 >> v1:172.21.15.148:6789/0 conn(0x7fe0b80c11f0 legacy=0x7fe0b80bcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:07.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b5ffb700 1 -- 172.21.15.148:0/3925907517 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211808155 0 0) 0x7fe0b806a4f0 con 0x7fe0b80c11f0 2023-10-24T00:48:07.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b67fc700 1 -- 172.21.15.148:0/3925907517 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b80bbcd0 con 0x7fe0b8137900 2023-10-24T00:48:07.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b67fc700 1 --2- 172.21.15.148:0/3925907517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b80bc7b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fe0b80c6b00 tx=0x7fe0ac009060).ready entity=mon.0 client_cookie=a83f37b7fbcbfcf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:07.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b5ffb700 1 -- 172.21.15.148:0/3925907517 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0090d0 con 0x7fe0b8137900 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b5ffb700 1 -- 172.21.15.148:0/3925907517 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00f510 con 0x7fe0b8137900 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.015+0000 7fe0b5ffb700 1 -- 172.21.15.148:0/3925907517 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00f890 con 0x7fe0b8137900 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3925907517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 msgr2=0x7fe0b80bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3925907517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b80bc7b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fe0b80c6b00 tx=0x7fe0ac009060).stop 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3925907517 shutdown_connections 2023-10-24T00:48:07.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3925907517 >> v2:172.21.15.150:3300/0 conn(0x7fe0b8137520 0x7fe0b8069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3925907517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b80bc7b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3925907517 >> 172.21.15.148:0/3925907517 conn(0x7fe0b80c6bf0 msgr2=0x7fe0b80c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3925907517 shutdown_connections 2023-10-24T00:48:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.016+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3925907517 wait complete. 2023-10-24T00:48:07.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.017+0000 7fe0bd2eb700 1 Processor -- start 2023-10-24T00:48:07.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.017+0000 7fe0bd2eb700 1 -- start start 2023-10-24T00:48:07.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0b80c11f0 0x7fe0b8151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b8137520 0x7fe0b8166080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b814d280 con 0x7fe0b8137900 2023-10-24T00:48:07.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80bddc0 con 0x7fe0b8137520 2023-10-24T00:48:07.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0bd2eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8166570 con 0x7fe0b80c11f0 2023-10-24T00:48:07.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:07.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51636/0 (socket says 172.21.15.148:51636) 2023-10-24T00:48:07.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 -- 172.21.15.148:0/3725099586 learned_addr learned my addr 172.21.15.148:0/3725099586 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:07.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b6ffd700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0b80c11f0 0x7fe0b8151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:07.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b67fc700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b8137520 0x7fe0b8166080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:07.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0b80c11f0 msgr2=0x7fe0b8151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:07.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0b80c11f0 0x7fe0b8151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:07.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b8137520 msgr2=0x7fe0b8166080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:07.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b8137520 0x7fe0b8166080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:07.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 -- 172.21.15.148:0/3725099586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0092a0 con 0x7fe0b8137900 2023-10-24T00:48:07.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe0b77fe700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fe0a800c490 tx=0x7fe0a8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:07.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800ce00 con 0x7fe0b8137900 2023-10-24T00:48:07.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a80072e0 con 0x7fe0b8137900 2023-10-24T00:48:07.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.018+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8007660 con 0x7fe0b8137900 2023-10-24T00:48:07.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.019+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b8151100 con 0x7fe0b8137900 2023-10-24T00:48:07.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.019+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b8151e60 con 0x7fe0b8137900 2023-10-24T00:48:07.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.019+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b806c6b0 con 0x7fe0b8137900 2023-10-24T00:48:07.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.020+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 54) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe0a80059b0 con 0x7fe0b8137900 2023-10-24T00:48:07.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.020+0000 7fe09effd700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 0x7fe0a4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:07.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.020+0000 7fe0b6ffd700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 msgr2=0x7fe0a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:07.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.020+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fe0a8079ca0 con 0x7fe0b8137900 2023-10-24T00:48:07.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.020+0000 7fe0b6ffd700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 0x7fe0a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:07.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.024+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe0a804ab90 con 0x7fe0b8137900 2023-10-24T00:48:07.050 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:07.048+0000 7fc5540b6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:07.142 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.141+0000 7ff1b00d6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:48:07.214 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.213+0000 7ff1b00d6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:48:07.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.222+0000 7fe0b6ffd700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 msgr2=0x7fe0a4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:07.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.222+0000 7fe0b6ffd700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 0x7fe0a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:07.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.233+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 55) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fe0a8077690 con 0x7fe0b8137900 2023-10-24T00:48:07.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.233+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 msgr2=0x7fe0a4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:07.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.233+0000 7fe09effd700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 0x7fe0a4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:07.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:07.243+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0b80bdf50 con 0x7fe0b8137900 2023-10-24T00:48:07.291 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.289+0000 7ff12a869700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12a869700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12a869700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12a869700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12a869700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.292 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12c06c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12c06c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12c06c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12c06c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.293 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:07.290+0000 7ff12c06c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:07.294 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:48:07.294 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:48:07.294 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:48:07.299 INFO:tasks.ceph.mds.d.smithi150.stderr: -7546> 2023-10-24T00:47:09.589+0000 7f7a4bbfc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:48:07.306 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T00:48:07.307 INFO:tasks.ceph.mds.d.smithi150.stderr: -3> 2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T00:48:07.307 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-10-24T00:48:07.292+0000 7f7a483f5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T00:48:07.325 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:48:07.359 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:07.357+0000 7fc5540b6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:48:07.430 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:07.428+0000 7fc5540b6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:48:08.230 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T00:48:08.228+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T00:48:08.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.233+0000 7fe09effd700 1 -- 172.21.15.148:0/3725099586 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0b80bdf50 con 0x7fe0b8137900 2023-10-24T00:48:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 msgr2=0x7fe0b8150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fe0a800c490 tx=0x7fe0a8007c10).stop 2023-10-24T00:48:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 shutdown_connections 2023-10-24T00:48:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe0a405f390 0x7fe0a4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:08.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0b8137900 0x7fe0b8150c10 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0b80c11f0 0x7fe0b8151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 --2- 172.21.15.148:0/3725099586 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0b8137520 0x7fe0b8166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 >> 172.21.15.148:0/3725099586 conn(0x7fe0b80c6bf0 msgr2=0x7fe0b80c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 shutdown_connections 2023-10-24T00:48:08.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.235+0000 7fe0bd2eb700 1 -- 172.21.15.148:0/3725099586 wait complete. 2023-10-24T00:48:08.240 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T00:48:08.251 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T00:48:08.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.405+0000 7fda58fc9700 1 Processor -- start 2023-10-24T00:48:08.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.405+0000 7fda58fc9700 1 -- start start 2023-10-24T00:48:08.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 0x7fda54154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 0x7fda540c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda540bffd0 0x7fda540c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540c0970 con 0x7fda540bffd0 2023-10-24T00:48:08.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540c71d0 con 0x7fda54098bd0 2023-10-24T00:48:08.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda58fc9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c9410 con 0x7fda54154430 2023-10-24T00:48:08.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda540bffd0 0x7fda540c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda540bffd0 0x7fda540c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51652/0 (socket says 172.21.15.148:51652) 2023-10-24T00:48:08.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 -- 172.21.15.148:0/3319329029 learned_addr learned my addr 172.21.15.148:0/3319329029 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda5259c700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 0x7fda54154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda49d9b700 1 --2- 172.21.15.148:0/3319329029 >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 0x7fda540c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 -- 172.21.15.148:0/3319329029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 msgr2=0x7fda54154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 0x7fda54154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 -- 172.21.15.148:0/3319329029 >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 msgr2=0x7fda540c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:08.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 --2- 172.21.15.148:0/3319329029 >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 0x7fda540c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda52d9d700 1 -- 172.21.15.148:0/3319329029 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540c6c10 con 0x7fda540bffd0 2023-10-24T00:48:08.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda5259c700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 0x7fda54154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:08.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.406+0000 7fda49d9b700 1 --2- 172.21.15.148:0/3319329029 >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 0x7fda540c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:08.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda52d9d700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda540bffd0 0x7fda540c0480 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fda4c009f20 tx=0x7fda4c009840).ready entity=mon.0 client_cookie=8b8f65b63881e34e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:08.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda51d9b700 1 -- 172.21.15.148:0/3319329029 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00e070 con 0x7fda540bffd0 2023-10-24T00:48:08.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda51d9b700 1 -- 172.21.15.148:0/3319329029 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c00ba40 con 0x7fda540bffd0 2023-10-24T00:48:08.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda51d9b700 1 -- 172.21.15.148:0/3319329029 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00bdc0 con 0x7fda540bffd0 2023-10-24T00:48:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 -- 172.21.15.148:0/3319329029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda540bffd0 msgr2=0x7fda540c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda540bffd0 0x7fda540c0480 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fda4c009f20 tx=0x7fda4c009840).stop 2023-10-24T00:48:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 -- 172.21.15.148:0/3319329029 shutdown_connections 2023-10-24T00:48:08.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda540bffd0 0x7fda540c0480 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 --2- 172.21.15.148:0/3319329029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda54154430 0x7fda54154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 --2- 172.21.15.148:0/3319329029 >> v2:172.21.15.150:3300/0 conn(0x7fda54098bd0 0x7fda540c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 -- 172.21.15.148:0/3319329029 >> 172.21.15.148:0/3319329029 conn(0x7fda540cb070 msgr2=0x7fda540cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 -- 172.21.15.148:0/3319329029 shutdown_connections 2023-10-24T00:48:08.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.407+0000 7fda58fc9700 1 -- 172.21.15.148:0/3319329029 wait complete. 2023-10-24T00:48:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.408+0000 7fda58fc9700 1 Processor -- start 2023-10-24T00:48:08.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.408+0000 7fda58fc9700 1 -- start start 2023-10-24T00:48:08.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda54098bd0 0x7fda540acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda540bffd0 0x7fda540ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540ad780 con 0x7fda54154430 2023-10-24T00:48:08.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c2290 con 0x7fda54098bd0 2023-10-24T00:48:08.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda58fc9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c2570 con 0x7fda540bffd0 2023-10-24T00:48:08.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda52d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda52d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51656/0 (socket says 172.21.15.148:51656) 2023-10-24T00:48:08.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.409+0000 7fda52d9d700 1 -- 172.21.15.148:0/776547110 learned_addr learned my addr 172.21.15.148:0/776547110 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:08.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda49d9b700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda540bffd0 0x7fda540ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda5259c700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda54098bd0 0x7fda540acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 -- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda540bffd0 msgr2=0x7fda540ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:08.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda540bffd0 0x7fda540ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 -- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda54098bd0 msgr2=0x7fda540acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:08.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda54098bd0 0x7fda540acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:08.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 -- 172.21.15.148:0/776547110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c009ae0 con 0x7fda54154430 2023-10-24T00:48:08.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda52d9d700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fda540c5910 tx=0x7fda4c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:08.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0032f0 con 0x7fda54154430 2023-10-24T00:48:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540c2850 con 0x7fda54154430 2023-10-24T00:48:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0092e0 con 0x7fda54154430 2023-10-24T00:48:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c01e6a0 con 0x7fda54154430 2023-10-24T00:48:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.410+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda540c2e10 con 0x7fda54154430 2023-10-24T00:48:08.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.411+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda540c2fa0 con 0x7fda54154430 2023-10-24T00:48:08.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.411+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 56) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fda4c003040 con 0x7fda54154430 2023-10-24T00:48:08.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.411+0000 7fda4affd700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 0x7fda340614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:08.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.412+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6665+0+0 (secure 0 0 0) 0x7fda4c07b850 con 0x7fda54154430 2023-10-24T00:48:08.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.412+0000 7fda5259c700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 0x7fda340614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:08.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.412+0000 7fda5259c700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 0x7fda340614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fda44006fd0 tx=0x7fda44008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:08.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.416+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fda4c04cb60 con 0x7fda54154430 2023-10-24T00:48:08.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:08.620+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda540c6ef0 con 0x7fda54154430 2023-10-24T00:48:09.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.253+0000 7fda4affd700 1 -- 172.21.15.148:0/776547110 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda4c023020 con 0x7fda54154430 2023-10-24T00:48:09.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 msgr2=0x7fda340614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 0x7fda340614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fda44006fd0 tx=0x7fda44008040).stop 2023-10-24T00:48:09.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 msgr2=0x7fda540aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fda540c5910 tx=0x7fda4c009840).stop 2023-10-24T00:48:09.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 shutdown_connections 2023-10-24T00:48:09.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fda3405f030 0x7fda340614f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda54154430 0x7fda540aefd0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda54098bd0 0x7fda540acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 --2- 172.21.15.148:0/776547110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda540bffd0 0x7fda540ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.255+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 >> 172.21.15.148:0/776547110 conn(0x7fda540cb070 msgr2=0x7fda540a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:09.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.256+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 shutdown_connections 2023-10-24T00:48:09.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.256+0000 7fda58fc9700 1 -- 172.21.15.148:0/776547110 wait complete. 2023-10-24T00:48:09.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T00:48:09.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.386+0000 7fb1750cc700 1 Processor -- start 2023-10-24T00:48:09.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.386+0000 7fb1750cc700 1 -- start start 2023-10-24T00:48:09.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb1750cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb1701521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb1750cc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb1700be800 0x7fb1700a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb1750cc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700bdef0 con 0x7fb1700be380 2023-10-24T00:48:09.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb1750cc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700bd000 con 0x7fb1700be800 2023-10-24T00:48:09.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb1750cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700bd2e0 con 0x7fb170151e10 2023-10-24T00:48:09.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb167fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb1700be380 0x7fb170065e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44844/0 (socket says 172.21.15.148:44844) 2023-10-24T00:48:09.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.387+0000 7fb167fff700 1 -- 172.21.15.148:0/762838294 learned_addr learned my addr 172.21.15.148:0/762838294 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:09.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16f59e700 1 --2- 172.21.15.148:0/762838294 >> v2:172.21.15.150:3300/0 conn(0x7fb1700be800 0x7fb1700a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb1701521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877906514 0 0) 0x7fb1700bdef0 con 0x7fb1700be380 2023-10-24T00:48:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15c0033f0 con 0x7fb1700be380 2023-10-24T00:48:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853664221 0 0) 0x7fb15c0033f0 con 0x7fb1700be380 2023-10-24T00:48:09.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 msgr2=0x7fb1701521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb1701521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 >> v2:172.21.15.150:3300/0 conn(0x7fb1700be800 msgr2=0x7fb1700a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 --2- 172.21.15.148:0/762838294 >> v2:172.21.15.150:3300/0 conn(0x7fb1700be800 0x7fb1700a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700bd5c0 con 0x7fb1700be380 2023-10-24T00:48:09.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fb158001470 con 0x7fb1700be380 2023-10-24T00:48:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb1701521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16f59e700 1 --2- 172.21.15.148:0/762838294 >> v2:172.21.15.150:3300/0 conn(0x7fb1700be800 0x7fb1700a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 >> v1:172.21.15.148:6789/0 conn(0x7fb1700be380 legacy=0x7fb170065e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb15c0038e0 0x7fb15c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb15c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb15c004b80 0x7fb15c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700bd000 con 0x7fb15c0038e0 2023-10-24T00:48:09.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700bd2e0 con 0x7fb15c004b80 2023-10-24T00:48:09.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c004500 con 0x7fb170151e10 2023-10-24T00:48:09.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb15c0038e0 0x7fb15c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb167fff700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb15c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16f59e700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb15c004b80 0x7fb15c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 -- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 msgr2=0x7fb15c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:09.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb170151e10 0x7fb15c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 -- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb15c004b80 msgr2=0x7fb15c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:09.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb15c004b80 0x7fb15c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 -- 172.21.15.148:0/762838294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600092a0 con 0x7fb15c0038e0 2023-10-24T00:48:09.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.388+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb15c0038e0 0x7fb15c003d00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fb160009c70 tx=0x7fb160009060).ready entity=mon.0 client_cookie=b4c6b724f12ba651 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:09.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600095c0 con 0x7fb15c0038e0 2023-10-24T00:48:09.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000e690 con 0x7fb15c0038e0 2023-10-24T00:48:09.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb16e59c700 1 -- 172.21.15.148:0/762838294 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000ea10 con 0x7fb15c0038e0 2023-10-24T00:48:09.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 -- 172.21.15.148:0/762838294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb15c0038e0 msgr2=0x7fb15c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 --2- 172.21.15.148:0/762838294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb15c0038e0 0x7fb15c003d00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fb160009c70 tx=0x7fb160009060).stop 2023-10-24T00:48:09.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb16f59e700 1 -- 172.21.15.148:0/762838294 reap_dead start 2023-10-24T00:48:09.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 -- 172.21.15.148:0/762838294 shutdown_connections 2023-10-24T00:48:09.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 -- 172.21.15.148:0/762838294 >> 172.21.15.148:0/762838294 conn(0x7fb1700c7ce0 msgr2=0x7fb1700c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:09.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 -- 172.21.15.148:0/762838294 shutdown_connections 2023-10-24T00:48:09.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.389+0000 7fb1750cc700 1 -- 172.21.15.148:0/762838294 wait complete. 2023-10-24T00:48:09.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.390+0000 7fb1750cc700 1 Processor -- start 2023-10-24T00:48:09.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.390+0000 7fb1750cc700 1 -- start start 2023-10-24T00:48:09.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 0x7fb170148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 0x7fb1700a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700a5f70 con 0x7fb1700a9030 2023-10-24T00:48:09.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700a6dd0 con 0x7fb1700a5210 2023-10-24T00:48:09.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb1750cc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700a99a0 con 0x7fb15c0038e0 2023-10-24T00:48:09.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51676/0 (socket says 172.21.15.148:51676) 2023-10-24T00:48:09.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 -- 172.21.15.148:0/306129962 learned_addr learned my addr 172.21.15.148:0/306129962 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:09.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 0x7fb170148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb16f59e700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 0x7fb1700a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 -- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 msgr2=0x7fb170148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 0x7fb170148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 -- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 msgr2=0x7fb1700a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 0x7fb1700a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb167fff700 1 -- 172.21.15.148:0/306129962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700a5b80 con 0x7fb1700a9030 2023-10-24T00:48:09.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 0x7fb170148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:09.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.391+0000 7fb16f59e700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 0x7fb1700a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:09.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb167fff700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fb15800e860 tx=0x7fb170065820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:09.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158010520 con 0x7fb1700a9030 2023-10-24T00:48:09.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158010680 con 0x7fb1700a9030 2023-10-24T00:48:09.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158010a20 con 0x7fb1700a9030 2023-10-24T00:48:09.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700a7260 con 0x7fb1700a9030 2023-10-24T00:48:09.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.392+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1700a64a0 con 0x7fb1700a9030 2023-10-24T00:48:09.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.393+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17006c6b0 con 0x7fb1700a9030 2023-10-24T00:48:09.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.393+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 56) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fb158014430 con 0x7fb1700a9030 2023-10-24T00:48:09.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.393+0000 7fb166ffd700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 0x7fb1500614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:09.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.393+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6665+0+0 (secure 0 0 0) 0x7fb158079c30 con 0x7fb1700a9030 2023-10-24T00:48:09.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.393+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 0x7fb1500614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:09.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.394+0000 7fb16ed9d700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 0x7fb1500614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb160006d50 tx=0x7fb16001a000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:09.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.397+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb158049af0 con 0x7fb1700a9030 2023-10-24T00:48:09.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.562+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1700a6f10 con 0x7fb1700a9030 2023-10-24T00:48:09.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:09.976+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb1580779b0 con 0x7fb1700a9030 2023-10-24T00:48:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.259+0000 7fb166ffd700 1 -- 172.21.15.148:0/306129962 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb158073000 con 0x7fb1700a9030 2023-10-24T00:48:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 msgr2=0x7fb1500614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 0x7fb1500614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb160006d50 tx=0x7fb16001a000).stop 2023-10-24T00:48:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 msgr2=0x7fb1700a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fb15800e860 tx=0x7fb170065820).stop 2023-10-24T00:48:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 shutdown_connections 2023-10-24T00:48:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1700a5210 0x7fb1700a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb15c0038e0 0x7fb170148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb15005f030 0x7fb1500614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 --2- 172.21.15.148:0/306129962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1700a9030 0x7fb1700a94b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.262+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 >> 172.21.15.148:0/306129962 conn(0x7fb1700c7ce0 msgr2=0x7fb170062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.263+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 shutdown_connections 2023-10-24T00:48:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.263+0000 7fb1750cc700 1 -- 172.21.15.148:0/306129962 wait complete. 2023-10-24T00:48:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T00:48:10.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T00:48:10.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.397+0000 7f384743a700 1 Processor -- start 2023-10-24T00:48:10.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.397+0000 7f384743a700 1 -- start start 2023-10-24T00:48:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f384743a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f38400a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f384743a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38400aa420 0x7f38400c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f384743a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400c6270 con 0x7f38401544b0 2023-10-24T00:48:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f384743a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400c60e0 con 0x7f38400aa420 2023-10-24T00:48:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f384743a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400aa890 con 0x7f38400a7d00 2023-10-24T00:48:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f38459d7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38400aa420 0x7f38400c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f38459d7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f38400aa420 0x7f38400c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51684/0 (socket says 172.21.15.148:51684) 2023-10-24T00:48:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.398+0000 7f38459d7700 1 -- 172.21.15.148:0/1720945170 learned_addr learned my addr 172.21.15.148:0/1720945170 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38449d5700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f38400a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38459d7700 1 -- 172.21.15.148:0/1720945170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 msgr2=0x7f38400a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38459d7700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f38400a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38459d7700 1 -- 172.21.15.148:0/1720945170 >> v1:172.21.15.150:6789/0 conn(0x7f38401544b0 legacy=0x7f38400c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38459d7700 1 -- 172.21.15.148:0/1720945170 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400c0c80 con 0x7f38400aa420 2023-10-24T00:48:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f38459d7700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c6700 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3838009f20 tx=0x7f3838009840).ready entity=mon.0 client_cookie=6763dae3fbe1a434 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f3837fff700 1 -- 172.21.15.148:0/1720945170 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800e070 con 0x7f38400aa420 2023-10-24T00:48:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f3837fff700 1 -- 172.21.15.148:0/1720945170 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383800ba40 con 0x7f38400aa420 2023-10-24T00:48:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f3837fff700 1 -- 172.21.15.148:0/1720945170 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800bdc0 con 0x7f38400aa420 2023-10-24T00:48:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 -- 172.21.15.148:0/1720945170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 msgr2=0x7f38400c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c6700 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3838009f20 tx=0x7f3838009840).stop 2023-10-24T00:48:10.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 -- 172.21.15.148:0/1720945170 shutdown_connections 2023-10-24T00:48:10.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c6700 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 --2- 172.21.15.148:0/1720945170 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f38400a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 -- 172.21.15.148:0/1720945170 >> 172.21.15.148:0/1720945170 conn(0x7f38400945d0 msgr2=0x7f384006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 -- 172.21.15.148:0/1720945170 shutdown_connections 2023-10-24T00:48:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.399+0000 7f384743a700 1 -- 172.21.15.148:0/1720945170 wait complete. 2023-10-24T00:48:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 Processor -- start 2023-10-24T00:48:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 -- start start 2023-10-24T00:48:10.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f384014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38401544b0 0x7f38400c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400acc90 con 0x7f38400aa420 2023-10-24T00:48:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400ad120 con 0x7f38401544b0 2023-10-24T00:48:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.401+0000 7f384743a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400ac080 con 0x7f38400a7d00 2023-10-24T00:48:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51692/0 (socket says 172.21.15.148:51692) 2023-10-24T00:48:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 -- 172.21.15.148:0/4224545640 learned_addr learned my addr 172.21.15.148:0/4224545640 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38459d7700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38401544b0 0x7f38400c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38451d6700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f384014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 -- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 msgr2=0x7f384014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f384014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 -- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38401544b0 msgr2=0x7f38400c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38401544b0 0x7f38400c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 -- 172.21.15.148:0/4224545640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838009ae0 con 0x7f38400aa420 2023-10-24T00:48:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38449d5700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f383000c880 tx=0x7f3830008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830010580 con 0x7f38400aa420 2023-10-24T00:48:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38300106e0 con 0x7f38400aa420 2023-10-24T00:48:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38400ac360 con 0x7f38400aa420 2023-10-24T00:48:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830010a60 con 0x7f38400aa420 2023-10-24T00:48:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.402+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400ac920 con 0x7f38400aa420 2023-10-24T00:48:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.403+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38400c8be0 con 0x7f38400aa420 2023-10-24T00:48:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.404+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f383001b460 con 0x7f38400aa420 2023-10-24T00:48:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.404+0000 7f38357fa700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 0x7f3824061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.404+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6227+0+0 (secure 0 0 0) 0x7f383007a1e0 con 0x7f38400aa420 2023-10-24T00:48:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.404+0000 7f38451d6700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 0x7f3824061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.404+0000 7f38451d6700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 0x7f3824061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f383c00b7f0 tx=0x7f383c008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.408+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f383004b3e0 con 0x7f38400aa420 2023-10-24T00:48:10.574 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.571+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f384006c6b0 con 0x7f38400aa420 2023-10-24T00:48:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.885+0000 7f38357fa700 1 -- 172.21.15.148:0/4224545640 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 169+0+0 (secure 0 0 0) 0x7f383004ea00 con 0x7f38400aa420 2023-10-24T00:48:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.888+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 msgr2=0x7f3824061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.888+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 0x7f3824061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f383c00b7f0 tx=0x7f383c008040).stop 2023-10-24T00:48:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.888+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 msgr2=0x7f38400c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.888+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f383000c880 tx=0x7f3830008040).stop 2023-10-24T00:48:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 shutdown_connections 2023-10-24T00:48:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38401544b0 0x7f38400c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38400a7d00 0x7f384014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f382405f150 0x7f3824061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 --2- 172.21.15.148:0/4224545640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38400aa420 0x7f38400c2ab0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:10.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 >> 172.21.15.148:0/4224545640 conn(0x7f38400945d0 msgr2=0x7f38400c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:10.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 shutdown_connections 2023-10-24T00:48:10.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:10.889+0000 7f384743a700 1 -- 172.21.15.148:0/4224545640 wait complete. 2023-10-24T00:48:10.894 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T00:48:10.904 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T00:48:11.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.022+0000 7f732d5d5700 1 Processor -- start 2023-10-24T00:48:11.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.022+0000 7f732d5d5700 1 -- start start 2023-10-24T00:48:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f732d5d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 0x7f7328155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f732d5d5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280c80d0 con 0x7f7328153fb0 2023-10-24T00:48:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f732d5d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280aa6f0 con 0x7f7328154390 2023-10-24T00:48:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f732d5d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c77a0 con 0x7f73280c0ee0 2023-10-24T00:48:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7326ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7328153fb0 0x7f73280a9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44848/0 (socket says 172.21.15.148:44848) 2023-10-24T00:48:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7326ffd700 1 -- 172.21.15.148:0/3158678566 learned_addr learned my addr 172.21.15.148:0/3158678566 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:11.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f73277fe700 1 --2- 172.21.15.148:0/3158678566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 0x7f7328155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887119290 0 0) 0x7f73280c80d0 con 0x7f7328153fb0 2023-10-24T00:48:11.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73100033f0 con 0x7f7328153fb0 2023-10-24T00:48:11.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932557577 0 0) 0x7f73280aa6f0 con 0x7f7328154390 2023-10-24T00:48:11.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73280c80d0 con 0x7f7328154390 2023-10-24T00:48:11.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f73277fe700 1 -- 172.21.15.148:0/3158678566 >> v1:172.21.15.150:6789/0 conn(0x7f7328154390 legacy=0x7f73280c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f73277fe700 1 -- 172.21.15.148:0/3158678566 >> v1:172.21.15.148:6789/0 conn(0x7f7328153fb0 legacy=0x7f73280a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.023+0000 7f73277fe700 1 -- 172.21.15.148:0/3158678566 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280c7a80 con 0x7f73280c0ee0 2023-10-24T00:48:11.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f73277fe700 1 --2- 172.21.15.148:0/3158678566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 0x7f7328155290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7320009e90 tx=0x7f7320009780).ready entity=mon.2 client_cookie=253ec790e4454ac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000e070 con 0x7f73280c0ee0 2023-10-24T00:48:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000bab0 con 0x7f73280c0ee0 2023-10-24T00:48:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f7325ffb700 1 -- 172.21.15.148:0/3158678566 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000be30 con 0x7f73280c0ee0 2023-10-24T00:48:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 -- 172.21.15.148:0/3158678566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 msgr2=0x7f7328155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3158678566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 0x7f7328155290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f7320009e90 tx=0x7f7320009780).stop 2023-10-24T00:48:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 -- 172.21.15.148:0/3158678566 shutdown_connections 2023-10-24T00:48:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3158678566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73280c0ee0 0x7f7328155290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 -- 172.21.15.148:0/3158678566 >> 172.21.15.148:0/3158678566 conn(0x7f7328094540 msgr2=0x7f732806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 -- 172.21.15.148:0/3158678566 shutdown_connections 2023-10-24T00:48:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.024+0000 7f732d5d5700 1 -- 172.21.15.148:0/3158678566 wait complete. 2023-10-24T00:48:11.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 Processor -- start 2023-10-24T00:48:11.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 -- start start 2023-10-24T00:48:11.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73280c0ee0 0x7f7328164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7328153fb0 0x7f73280af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328164470 con 0x7f7328154390 2023-10-24T00:48:11.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280c4c00 con 0x7f73280c0ee0 2023-10-24T00:48:11.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.026+0000 7f732d5d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73281649f0 con 0x7f7328153fb0 2023-10-24T00:48:11.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51702/0 (socket says 172.21.15.148:51702) 2023-10-24T00:48:11.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 -- 172.21.15.148:0/3281640525 learned_addr learned my addr 172.21.15.148:0/3281640525 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:11.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f7326ffd700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73280c0ee0 0x7f7328164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73267fc700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7328153fb0 0x7f73280af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 -- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7328153fb0 msgr2=0x7f73280af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7328153fb0 0x7f73280af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 -- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73280c0ee0 msgr2=0x7f7328164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73280c0ee0 0x7f7328164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 -- 172.21.15.148:0/3281640525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009a20 con 0x7f7328154390 2023-10-24T00:48:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f73277fe700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7328062e70 tx=0x7f7320009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320021070 con 0x7f7328154390 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320013e60 con 0x7f7328154390 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328155810 con 0x7f7328154390 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732001d880 con 0x7f7328154390 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.027+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7328155d90 con 0x7f7328154390 2023-10-24T00:48:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.028+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7328155f80 con 0x7f7328154390 2023-10-24T00:48:11.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.029+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7320003040 con 0x7f7328154390 2023-10-24T00:48:11.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.029+0000 7f730effd700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 0x7f7314061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.029+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f732007bcb0 con 0x7f7328154390 2023-10-24T00:48:11.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.029+0000 7f7326ffd700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 0x7f7314061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.030+0000 7f7326ffd700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 0x7f7314061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7328158880 tx=0x7f7318009040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.033+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f732004d0b0 con 0x7f7328154390 2023-10-24T00:48:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.199+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7328047480 con 0x7f7328154390 2023-10-24T00:48:11.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.205+0000 7f730effd700 1 -- 172.21.15.148:0/3281640525 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v24) v1 ==== 120+0+0 (secure 0 0 0) 0x7f73200506d0 con 0x7f7328154390 2023-10-24T00:48:11.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 msgr2=0x7f7314061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 0x7f7314061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7328158880 tx=0x7f7318009040).stop 2023-10-24T00:48:11.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 msgr2=0x7f7328167a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f7328062e70 tx=0x7f7320009780).stop 2023-10-24T00:48:11.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 shutdown_connections 2023-10-24T00:48:11.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f731405f150 0x7f7314061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7328154390 0x7f7328167a20 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73280c0ee0 0x7f7328164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 --2- 172.21.15.148:0/3281640525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7328153fb0 0x7f73280af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 >> 172.21.15.148:0/3281640525 conn(0x7f7328094540 msgr2=0x7f73280a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 shutdown_connections 2023-10-24T00:48:11.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.207+0000 7f732d5d5700 1 -- 172.21.15.148:0/3281640525 wait complete. 2023-10-24T00:48:11.222 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T00:48:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.335+0000 7fdb5ba8a700 1 Processor -- start 2023-10-24T00:48:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.335+0000 7fdb5ba8a700 1 -- start start 2023-10-24T00:48:11.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.336+0000 7fdb5ba8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.336+0000 7fdb5ba8a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 0x7fdb540c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.336+0000 7fdb5ba8a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540c0970 con 0x7fdb54098bd0 2023-10-24T00:48:11.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.336+0000 7fdb5ba8a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb540c6a10 con 0x7fdb540bffd0 2023-10-24T00:48:11.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.336+0000 7fdb5ba8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540c71d0 con 0x7fdb54154430 2023-10-24T00:48:11.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb5a027700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 0x7fdb540c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:35588/0 (socket says 172.21.15.148:35588) 2023-10-24T00:48:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59025700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdb54098bd0 0x7fdb540c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:35566/0 (socket says 172.21.15.148:35566) 2023-10-24T00:48:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 -- 172.21.15.148:0/2092323219 learned_addr learned my addr 172.21.15.148:0/2092323219 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 -- 172.21.15.148:0/2092323219 >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 msgr2=0x7fdb540c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 --2- 172.21.15.148:0/2092323219 >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 0x7fdb540c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 -- 172.21.15.148:0/2092323219 >> v1:172.21.15.150:6789/0 conn(0x7fdb54098bd0 legacy=0x7fdb540c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 -- 172.21.15.148:0/2092323219 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540c9410 con 0x7fdb54154430 2023-10-24T00:48:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb58824700 1 -- 172.21.15.148:0/2092323219 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480164446 0 0) 0x7fdb44001110 con 0x7fdb54098bd0 2023-10-24T00:48:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb5a027700 1 --2- 172.21.15.148:0/2092323219 >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 0x7fdb540c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb59826700 1 --2- 172.21.15.148:0/2092323219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fdb50009830 tx=0x7fdb500090f0).ready entity=mon.2 client_cookie=fc9d682b11d23455 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb58824700 1 -- 172.21.15.148:0/2092323219 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000b580 con 0x7fdb54154430 2023-10-24T00:48:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb58824700 1 -- 172.21.15.148:0/2092323219 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000b6e0 con 0x7fdb54154430 2023-10-24T00:48:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.337+0000 7fdb58824700 1 -- 172.21.15.148:0/2092323219 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000ba60 con 0x7fdb54154430 2023-10-24T00:48:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/2092323219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 msgr2=0x7fdb54154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/2092323219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fdb50009830 tx=0x7fdb500090f0).stop 2023-10-24T00:48:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/2092323219 shutdown_connections 2023-10-24T00:48:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/2092323219 >> v2:172.21.15.150:3300/0 conn(0x7fdb540bffd0 0x7fdb540c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/2092323219 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54154430 0x7fdb54154810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/2092323219 >> 172.21.15.148:0/2092323219 conn(0x7fdb540cb070 msgr2=0x7fdb540cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/2092323219 shutdown_connections 2023-10-24T00:48:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.338+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/2092323219 wait complete. 2023-10-24T00:48:11.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.339+0000 7fdb5ba8a700 1 Processor -- start 2023-10-24T00:48:11.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.339+0000 7fdb5ba8a700 1 -- start start 2023-10-24T00:48:11.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54098bd0 0x7fdb540ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb540bffd0 0x7fdb540c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540af780 con 0x7fdb54154430 2023-10-24T00:48:11.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540aeb70 con 0x7fdb540bffd0 2023-10-24T00:48:11.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5ba8a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540aee50 con 0x7fdb54098bd0 2023-10-24T00:48:11.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51706/0 (socket says 172.21.15.148:51706) 2023-10-24T00:48:11.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 -- 172.21.15.148:0/1587864048 learned_addr learned my addr 172.21.15.148:0/1587864048 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:11.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb59826700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54098bd0 0x7fdb540ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb59025700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb540bffd0 0x7fdb540c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 -- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54098bd0 msgr2=0x7fdb540ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54098bd0 0x7fdb540ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 -- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb540bffd0 msgr2=0x7fdb540c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb540bffd0 0x7fdb540c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 -- 172.21.15.148:0/1587864048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009a20 con 0x7fdb54154430 2023-10-24T00:48:11.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb5a027700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fdb4c009fc0 tx=0x7fdb4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.340+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00cbd0 con 0x7fdb54154430 2023-10-24T00:48:11.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.341+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00f040 con 0x7fdb54154430 2023-10-24T00:48:11.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.341+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb50009370 con 0x7fdb54154430 2023-10-24T00:48:11.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.341+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c013400 con 0x7fdb54154430 2023-10-24T00:48:11.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.341+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb540af410 con 0x7fdb54154430 2023-10-24T00:48:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.342+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb540af930 con 0x7fdb54154430 2023-10-24T00:48:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.342+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb4c0137f0 con 0x7fdb54154430 2023-10-24T00:48:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.342+0000 7fdb49ffb700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 0x7fdb38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.342+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fdb4c07aa10 con 0x7fdb54154430 2023-10-24T00:48:11.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.343+0000 7fdb59826700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 0x7fdb38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.343+0000 7fdb59826700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 0x7fdb38061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb5000b340 tx=0x7fdb50017000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.346+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb540af930 con 0x7fdb54154430 2023-10-24T00:48:11.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.520+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdb5406c6b0 con 0x7fdb54154430 2023-10-24T00:48:11.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.524+0000 7fdb49ffb700 1 -- 172.21.15.148:0/1587864048 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb4c04be10 con 0x7fdb54154430 2023-10-24T00:48:11.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.525+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 msgr2=0x7fdb38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.525+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 0x7fdb38061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb5000b340 tx=0x7fdb50017000).stop 2023-10-24T00:48:11.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.525+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 msgr2=0x7fdb540c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.525+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fdb4c009fc0 tx=0x7fdb4c00b040).stop 2023-10-24T00:48:11.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 shutdown_connections 2023-10-24T00:48:11.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdb3805f150 0x7fdb38061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb54154430 0x7fdb540c2ac0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdb54098bd0 0x7fdb540ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 --2- 172.21.15.148:0/1587864048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb540bffd0 0x7fdb540c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 >> 172.21.15.148:0/1587864048 conn(0x7fdb540cb070 msgr2=0x7fdb540a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 shutdown_connections 2023-10-24T00:48:11.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.526+0000 7fdb5ba8a700 1 -- 172.21.15.148:0/1587864048 wait complete. 2023-10-24T00:48:11.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-24T00:48:11.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.652+0000 7f3e415a3700 1 Processor -- start 2023-10-24T00:48:11.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.652+0000 7f3e415a3700 1 -- start start 2023-10-24T00:48:11.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e415a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e3c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e415a3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0aa880 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e415a3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0c0960 con 0x7f3e3c0aa010 2023-10-24T00:48:11.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e415a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c0c40 con 0x7f3e3c0c6710 2023-10-24T00:48:11.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e3b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3e3c0aa3f0 0x7f3e3c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44860/0 (socket says 172.21.15.148:44860) 2023-10-24T00:48:11.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e3b7fe700 1 -- 172.21.15.148:0/2395042128 learned_addr learned my addr 172.21.15.148:0/2395042128 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:11.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e3a7fc700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e3c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217014171 0 0) 0x7f3e2c001490 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e280033f0 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413020616 0 0) 0x7f3e280033f0 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 msgr2=0x7f3e3c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:11.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e3c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 >> v1:172.21.15.150:6789/0 conn(0x7f3e3c0aa010 legacy=0x7f3e3c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0c0f20 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f3e2c001980 con 0x7f3e3c0aa3f0 2023-10-24T00:48:11.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 >> v1:172.21.15.148:6789/0 conn(0x7f3e3c0aa3f0 legacy=0x7f3e3c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e28003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.653+0000 7f3e39ffb700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e28003e00 0x7f3e28004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e28004b80 0x7f3e28005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c0c40 con 0x7f3e28004b80 2023-10-24T00:48:11.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2800b8e0 con 0x7f3e28003e00 2023-10-24T00:48:11.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2800baa0 con 0x7f3e3c0c6710 2023-10-24T00:48:11.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e28004b80 0x7f3e28005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3a7fc700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e28003e00 0x7f3e28004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3affd700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e28003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 -- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 msgr2=0x7f3e28003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:11.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c0c6710 0x7f3e28003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 -- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e28003e00 msgr2=0x7f3e28004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:11.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e28003e00 0x7f3e28004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 -- 172.21.15.148:0/2395042128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280033f0 con 0x7f3e28004b80 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e3b7fe700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e28004b80 0x7f3e28005000 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f3e2c00c600 tx=0x7f3e3c0c6390).ready entity=mon.0 client_cookie=2518432da3645d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c005b20 con 0x7f3e28004b80 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c005c80 con 0x7f3e28004b80 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.654+0000 7f3e39ffb700 1 -- 172.21.15.148:0/2395042128 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0070d0 con 0x7f3e28004b80 2023-10-24T00:48:11.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 -- 172.21.15.148:0/2395042128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e28004b80 msgr2=0x7f3e28005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 --2- 172.21.15.148:0/2395042128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e28004b80 0x7f3e28005000 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f3e2c00c600 tx=0x7f3e3c0c6390).stop 2023-10-24T00:48:11.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e3b7fe700 1 -- 172.21.15.148:0/2395042128 reap_dead start 2023-10-24T00:48:11.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 -- 172.21.15.148:0/2395042128 shutdown_connections 2023-10-24T00:48:11.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 -- 172.21.15.148:0/2395042128 >> 172.21.15.148:0/2395042128 conn(0x7f3e3c0caf40 msgr2=0x7f3e3c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 -- 172.21.15.148:0/2395042128 shutdown_connections 2023-10-24T00:48:11.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.655+0000 7f3e415a3700 1 -- 172.21.15.148:0/2395042128 wait complete. 2023-10-24T00:48:11.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.656+0000 7f3e415a3700 1 Processor -- start 2023-10-24T00:48:11.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.656+0000 7f3e415a3700 1 -- start start 2023-10-24T00:48:11.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c149720 0x7f3e3c0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c0c9d80 0x7f3e3c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0ca1e0 con 0x7f3e3c147b10 2023-10-24T00:48:11.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1587b0 con 0x7f3e3c0c9d80 2023-10-24T00:48:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c158a90 con 0x7f3e3c149720 2023-10-24T00:48:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51724/0 (socket says 172.21.15.148:51724) 2023-10-24T00:48:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 -- 172.21.15.148:0/3240296764 learned_addr learned my addr 172.21.15.148:0/3240296764 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:11.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3a7fc700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c149720 0x7f3e3c0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3b7fe700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c0c9d80 0x7f3e3c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 -- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c149720 msgr2=0x7f3e3c0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c149720 0x7f3e3c0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 -- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c0c9d80 msgr2=0x7f3e3c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c0c9d80 0x7f3e3c148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 -- 172.21.15.148:0/3240296764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c158d70 con 0x7f3e3c147b10 2023-10-24T00:48:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e3affd700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f3e340011a0 tx=0x7f3e34007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400f8d0 con 0x7f3e3c147b10 2023-10-24T00:48:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400fa30 con 0x7f3e3c147b10 2023-10-24T00:48:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c159050 con 0x7f3e3c147b10 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400fdd0 con 0x7f3e3c147b10 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.657+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c147ef0 con 0x7f3e3c147b10 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.658+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c06c6b0 con 0x7f3e3c147b10 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.659+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3e3401d3b0 con 0x7f3e3c147b10 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.659+0000 7f3e32ffd700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 0x7f3e1c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:11.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.659+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7f3e3407a1b0 con 0x7f3e3c147b10 2023-10-24T00:48:11.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.659+0000 7f3e3a7fc700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 0x7f3e1c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:11.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.660+0000 7f3e3a7fc700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 0x7f3e1c0615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3e24006d50 tx=0x7f3e24008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:11.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.663+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3e3404b550 con 0x7f3e3c147b10 2023-10-24T00:48:11.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.893+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f3e3c0c1200 con 0x7f3e3c147b10 2023-10-24T00:48:11.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.984+0000 7f3e32ffd700 1 -- 172.21.15.148:0/3240296764 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v714) v1 ==== 148+0+0 (secure 0 0 0) 0x7f3e3404eb70 con 0x7f3e3c147b10 2023-10-24T00:48:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 msgr2=0x7f3e1c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 0x7f3e1c0615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3e24006d50 tx=0x7f3e24008040).stop 2023-10-24T00:48:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 msgr2=0x7f3e3c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f3e340011a0 tx=0x7f3e34007bb0).stop 2023-10-24T00:48:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 shutdown_connections 2023-10-24T00:48:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e3c0c9d80 0x7f3e3c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3e1c05f120 0x7f3e1c0615e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e3c147b10 0x7f3e3c157e60 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 --2- 172.21.15.148:0/3240296764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e3c149720 0x7f3e3c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 >> 172.21.15.148:0/3240296764 conn(0x7f3e3c0caf40 msgr2=0x7f3e3c14cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 shutdown_connections 2023-10-24T00:48:11.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:11.986+0000 7f3e415a3700 1 -- 172.21.15.148:0/3240296764 wait complete. 2023-10-24T00:48:12.001 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-10-24T00:48:12.001 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-10-24T00:48:12.001 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T00:48:12.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-24T00:48:12.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.114+0000 7fe6f8445700 1 Processor -- start 2023-10-24T00:48:12.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.114+0000 7fe6f8445700 1 -- start start 2023-10-24T00:48:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f8445700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6f00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f8445700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00aa880 con 0x7fe6f00aa010 2023-10-24T00:48:12.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f8445700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00c0960 con 0x7fe6f00aa3f0 2023-10-24T00:48:12.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f8445700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00c0c40 con 0x7fe6f00c6710 2023-10-24T00:48:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f61e1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe6f00aa010 0x7fe6f0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44862/0 (socket says 172.21.15.148:44862) 2023-10-24T00:48:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f61e1700 1 -- 172.21.15.148:0/1782730010 learned_addr learned my addr 172.21.15.148:0/1782730010 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6f00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804195610 0 0) 0x7fe6ec001110 con 0x7fe6f00aa010 2023-10-24T00:48:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.115+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6dc0033f0 con 0x7fe6f00aa010 2023-10-24T00:48:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696395508 0 0) 0x7fe6dc0033f0 con 0x7fe6f00aa010 2023-10-24T00:48:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 msgr2=0x7fe6f00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6f00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 >> v1:172.21.15.150:6789/0 conn(0x7fe6f00aa3f0 legacy=0x7fe6f0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00c0f20 con 0x7fe6f00aa010 2023-10-24T00:48:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe6ec001600 con 0x7fe6f00aa010 2023-10-24T00:48:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 >> v1:172.21.15.148:6789/0 conn(0x7fe6f00aa010 legacy=0x7fe6f0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6dc003910 0x7fe6dc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6dc004690 0x7fe6dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00c0c40 con 0x7fe6dc004690 2023-10-24T00:48:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc014120 con 0x7fe6dc003910 2023-10-24T00:48:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0142e0 con 0x7fe6f00c6710 2023-10-24T00:48:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6dc004690 0x7fe6dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f61e1700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6dc003910 0x7fe6dc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f69e2700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 -- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 msgr2=0x7fe6dc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:12.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6dc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 -- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6dc003910 msgr2=0x7fe6dc003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:12.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6dc003910 0x7fe6dc003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 -- 172.21.15.148:0/1782730010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0033f0 con 0x7fe6dc004690 2023-10-24T00:48:12.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f69e2700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6f00c6710 0x7fe6dc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:12.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6dc004690 0x7fe6dc004b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fe6e0009a60 tx=0x7fe6e0009060).ready entity=mon.0 client_cookie=f4768b9dd3ba0291 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:12.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0009ea0 con 0x7fe6dc004690 2023-10-24T00:48:12.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0009430 con 0x7fe6dc004690 2023-10-24T00:48:12.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.116+0000 7fe6f51df700 1 -- 172.21.15.148:0/1782730010 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000e870 con 0x7fe6dc004690 2023-10-24T00:48:12.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 -- 172.21.15.148:0/1782730010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6dc004690 msgr2=0x7fe6dc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 --2- 172.21.15.148:0/1782730010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6dc004690 0x7fe6dc004b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fe6e0009a60 tx=0x7fe6e0009060).stop 2023-10-24T00:48:12.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f69e2700 1 -- 172.21.15.148:0/1782730010 reap_dead start 2023-10-24T00:48:12.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 -- 172.21.15.148:0/1782730010 shutdown_connections 2023-10-24T00:48:12.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 -- 172.21.15.148:0/1782730010 >> 172.21.15.148:0/1782730010 conn(0x7fe6f00caf40 msgr2=0x7fe6f00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:12.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 -- 172.21.15.148:0/1782730010 shutdown_connections 2023-10-24T00:48:12.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.117+0000 7fe6f8445700 1 -- 172.21.15.148:0/1782730010 wait complete. 2023-10-24T00:48:12.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.118+0000 7fe6f8445700 1 Processor -- start 2023-10-24T00:48:12.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.118+0000 7fe6f8445700 1 -- start start 2023-10-24T00:48:12.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 0x7fe6f0148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 0x7fe6f0153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f014e690 con 0x7fe6f0155a70 2023-10-24T00:48:12.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f014e970 con 0x7fe6f014de60 2023-10-24T00:48:12.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0150350 con 0x7fe6dc004690 2023-10-24T00:48:12.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51750/0 (socket says 172.21.15.148:51750) 2023-10-24T00:48:12.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 -- 172.21.15.148:0/175222136 learned_addr learned my addr 172.21.15.148:0/175222136 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:12.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f61e1700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 0x7fe6f0148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f69e2700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 0x7fe6f0153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 -- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 msgr2=0x7fe6f0148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 0x7fe6f0148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 -- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 msgr2=0x7fe6f0153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 0x7fe6f0153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 -- 172.21.15.148:0/175222136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0150630 con 0x7fe6f0155a70 2023-10-24T00:48:12.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f61e1700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 0x7fe6f0148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:12.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f69e2700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 0x7fe6f0153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:12.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f59e0700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fe6e000e4b0 tx=0x7fe6e001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:12.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0020070 con 0x7fe6f0155a70 2023-10-24T00:48:12.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e001bb10 con 0x7fe6f0155a70 2023-10-24T00:48:12.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.119+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f014e2e0 con 0x7fe6f0155a70 2023-10-24T00:48:12.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.120+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0024410 con 0x7fe6f0155a70 2023-10-24T00:48:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.120+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0153910 con 0x7fe6f0155a70 2023-10-24T00:48:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.120+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f01509a0 con 0x7fe6f0155a70 2023-10-24T00:48:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.121+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe6e00123f0 con 0x7fe6f0155a70 2023-10-24T00:48:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.121+0000 7fe6e67fc700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 0x7fe6d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:12.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.121+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fe6e007b5d0 con 0x7fe6f0155a70 2023-10-24T00:48:12.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.122+0000 7fe6f61e1700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 0x7fe6d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:12.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.122+0000 7fe6f61e1700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 0x7fe6d4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe6ec0012b0 tx=0x7fe6ec009040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:12.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.125+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe6e004c970 con 0x7fe6f0155a70 2023-10-24T00:48:12.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.357+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fe6f01507c0 con 0x7fe6f0155a70 2023-10-24T00:48:12.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.985+0000 7fe6e67fc700 1 -- 172.21.15.148:0/175222136 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v715) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe6e0029020 con 0x7fe6f0155a70 2023-10-24T00:48:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 msgr2=0x7fe6d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 0x7fe6d4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe6ec0012b0 tx=0x7fe6ec009040).stop 2023-10-24T00:48:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 msgr2=0x7fe6f0150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fe6e000e4b0 tx=0x7fe6e001a000).stop 2023-10-24T00:48:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 shutdown_connections 2023-10-24T00:48:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6f014de60 0x7fe6f0153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6dc004690 0x7fe6f0148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe6d405f150 0x7fe6d4061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 --2- 172.21.15.148:0/175222136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6f0155a70 0x7fe6f0150b50 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:12.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 >> 172.21.15.148:0/175222136 conn(0x7fe6f00caf40 msgr2=0x7fe6f00c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:12.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 shutdown_connections 2023-10-24T00:48:12.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:12.987+0000 7fe6f8445700 1 -- 172.21.15.148:0/175222136 wait complete. 2023-10-24T00:48:13.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T00:48:13.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.116+0000 7fba83e89700 1 Processor -- start 2023-10-24T00:48:13.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.116+0000 7fba83e89700 1 -- start start 2023-10-24T00:48:13.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba83e89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba7c155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba83e89700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba7c0c1950 0x7fba7c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba83e89700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c155c00 con 0x7fba7c152290 2023-10-24T00:48:13.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba83e89700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0c8800 con 0x7fba7c0c1950 2023-10-24T00:48:13.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba83e89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c7b80 con 0x7fba7c0c6950 2023-10-24T00:48:13.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba81c25700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fba7c152290 0x7fba7c0c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44876/0 (socket says 172.21.15.148:44876) 2023-10-24T00:48:13.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba81c25700 1 -- 172.21.15.148:0/3616957654 learned_addr learned my addr 172.21.15.148:0/3616957654 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:13.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467035018 0 0) 0x7fba7c155c00 con 0x7fba7c152290 2023-10-24T00:48:13.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba680033f0 con 0x7fba7c152290 2023-10-24T00:48:13.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba81424700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba7c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.117+0000 7fba82426700 1 --2- 172.21.15.148:0/3616957654 >> v2:172.21.15.150:3300/0 conn(0x7fba7c0c1950 0x7fba7c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486478711 0 0) 0x7fba680033f0 con 0x7fba7c152290 2023-10-24T00:48:13.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 msgr2=0x7fba7c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba7c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 >> v2:172.21.15.150:3300/0 conn(0x7fba7c0c1950 msgr2=0x7fba7c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 --2- 172.21.15.148:0/3616957654 >> v2:172.21.15.150:3300/0 conn(0x7fba7c0c1950 0x7fba7c15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0c7e60 con 0x7fba7c152290 2023-10-24T00:48:13.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fba78001470 con 0x7fba7c152290 2023-10-24T00:48:13.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba82426700 1 --2- 172.21.15.148:0/3616957654 >> v2:172.21.15.150:3300/0 conn(0x7fba7c0c1950 0x7fba7c15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:13.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 >> v1:172.21.15.148:6789/0 conn(0x7fba7c152290 legacy=0x7fba7c0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba680038e0 0x7fba68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba68004690 0x7fba68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba68005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c8800 con 0x7fba680038e0 2023-10-24T00:48:13.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c7b80 con 0x7fba68004690 2023-10-24T00:48:13.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6800b9e0 con 0x7fba7c0c6950 2023-10-24T00:48:13.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba680038e0 0x7fba68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81424700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba68004690 0x7fba68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba82426700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba68005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 -- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 msgr2=0x7fba68005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba7c0c6950 0x7fba68005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 -- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba68004690 msgr2=0x7fba68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba68004690 0x7fba68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 -- 172.21.15.148:0/3616957654 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680033f0 con 0x7fba680038e0 2023-10-24T00:48:13.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba81c25700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba680038e0 0x7fba68003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fba7800c240 tx=0x7fba78001e90).ready entity=mon.0 client_cookie=c780d9f59acafe98 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78007a60 con 0x7fba680038e0 2023-10-24T00:48:13.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800cad0 con 0x7fba680038e0 2023-10-24T00:48:13.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.118+0000 7fba80c23700 1 -- 172.21.15.148:0/3616957654 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800ce70 con 0x7fba680038e0 2023-10-24T00:48:13.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 -- 172.21.15.148:0/3616957654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba680038e0 msgr2=0x7fba68003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 --2- 172.21.15.148:0/3616957654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba680038e0 0x7fba68003d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fba7800c240 tx=0x7fba78001e90).stop 2023-10-24T00:48:13.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba82426700 1 -- 172.21.15.148:0/3616957654 reap_dead start 2023-10-24T00:48:13.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 -- 172.21.15.148:0/3616957654 shutdown_connections 2023-10-24T00:48:13.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 -- 172.21.15.148:0/3616957654 >> 172.21.15.148:0/3616957654 conn(0x7fba7c0946c0 msgr2=0x7fba7c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:13.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 -- 172.21.15.148:0/3616957654 shutdown_connections 2023-10-24T00:48:13.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.119+0000 7fba83e89700 1 -- 172.21.15.148:0/3616957654 wait complete. 2023-10-24T00:48:13.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.120+0000 7fba83e89700 1 Processor -- start 2023-10-24T00:48:13.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.120+0000 7fba83e89700 1 -- start start 2023-10-24T00:48:13.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba680038e0 0x7fba7c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 0x7fba7c14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0ae340 con 0x7fba7c0cb000 2023-10-24T00:48:13.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0b0ff0 con 0x7fba7c0b0b70 2023-10-24T00:48:13.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba83e89700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0cb950 con 0x7fba680038e0 2023-10-24T00:48:13.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51766/0 (socket says 172.21.15.148:51766) 2023-10-24T00:48:13.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 -- 172.21.15.148:0/2683593388 learned_addr learned my addr 172.21.15.148:0/2683593388 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:13.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba81424700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 0x7fba7c14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba81c25700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba680038e0 0x7fba7c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 -- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba680038e0 msgr2=0x7fba7c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba680038e0 0x7fba7c0c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 -- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 msgr2=0x7fba7c14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 0x7fba7c14dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 -- 172.21.15.148:0/2683593388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c14e550 con 0x7fba7c0cb000 2023-10-24T00:48:13.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba81424700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 0x7fba7c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:13.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.121+0000 7fba82426700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fba7c06ad60 tx=0x7fba740097d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.122+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74010c90 con 0x7fba7c0cb000 2023-10-24T00:48:13.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.122+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74010df0 con 0x7fba7c0cb000 2023-10-24T00:48:13.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.122+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74015650 con 0x7fba7c0cb000 2023-10-24T00:48:13.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.122+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0c2ee0 con 0x7fba7c0cb000 2023-10-24T00:48:13.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.122+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0c34a0 con 0x7fba7c0cb000 2023-10-24T00:48:13.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.123+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c0c5ae0 con 0x7fba7c0cb000 2023-10-24T00:48:13.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.123+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fba740159c0 con 0x7fba7c0cb000 2023-10-24T00:48:13.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.123+0000 7fba71ffb700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 0x7fba60061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.123+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fba7407a8b0 con 0x7fba7c0cb000 2023-10-24T00:48:13.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.123+0000 7fba81c25700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 0x7fba60061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.124+0000 7fba81c25700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 0x7fba60061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fba7800c1e0 tx=0x7fba78015000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.127+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fba7404bcb0 con 0x7fba7c0cb000 2023-10-24T00:48:13.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.293+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fba7c06c6b0 con 0x7fba7c0cb000 2023-10-24T00:48:13.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.300+0000 7fba71ffb700 1 -- 172.21.15.148:0/2683593388 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba7404f2d0 con 0x7fba7c0cb000 2023-10-24T00:48:13.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 msgr2=0x7fba60061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 0x7fba60061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fba7800c1e0 tx=0x7fba78015000).stop 2023-10-24T00:48:13.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 msgr2=0x7fba7c0cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fba7c06ad60 tx=0x7fba740097d0).stop 2023-10-24T00:48:13.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 shutdown_connections 2023-10-24T00:48:13.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fba6005f150 0x7fba60061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba7c0cb000 0x7fba7c0cb460 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba680038e0 0x7fba7c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 --2- 172.21.15.148:0/2683593388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba7c0b0b70 0x7fba7c14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 >> 172.21.15.148:0/2683593388 conn(0x7fba7c0946c0 msgr2=0x7fba7c064530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:13.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 shutdown_connections 2023-10-24T00:48:13.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.302+0000 7fba83e89700 1 -- 172.21.15.148:0/2683593388 wait complete. 2023-10-24T00:48:13.316 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T00:48:13.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:48:13.355 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T00:48:13.400 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T00:48:13.400 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T00:48:13.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.512+0000 7fa4ff125700 1 Processor -- start 2023-10-24T00:48:13.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.512+0000 7fa4ff125700 1 -- start start 2023-10-24T00:48:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4ff125700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4f80aa010 0x7fa4f80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4ff125700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa3f0 0x7fa4f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4ff125700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80aa860 con 0x7fa4f80c6710 2023-10-24T00:48:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4ff125700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80c0960 con 0x7fa4f80aa010 2023-10-24T00:48:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4ff125700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c0c40 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4fcec1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4f80aa010 0x7fa4f80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4f7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa4f80c6710 0x7fa4f8158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47402/0 (socket says 172.21.15.148:47402) 2023-10-24T00:48:13.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4f7fff700 1 -- 172.21.15.148:0/3846215939 learned_addr learned my addr 172.21.15.148:0/3846215939 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:13.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.513+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/3846215939 >> v2:172.21.15.148:3300/0 conn(0x7fa4f80aa010 0x7fa4f80c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37300/0 (socket says 172.21.15.148:37300) 2023-10-24T00:48:13.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fcec1700 1 -- 172.21.15.148:0/3846215939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa3f0 msgr2=0x7fa4f8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fd6c2700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa3f0 0x7fa4f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa3f0 0x7fa4f8069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4f77fe700 1 -- 172.21.15.148:0/3846215939 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668101190 0 0) 0x7fa4f80aa860 con 0x7fa4f80c6710 2023-10-24T00:48:13.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fcec1700 1 -- 172.21.15.148:0/3846215939 >> v1:172.21.15.148:6789/0 conn(0x7fa4f80c6710 legacy=0x7fa4f8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fcec1700 1 -- 172.21.15.148:0/3846215939 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80c0f20 con 0x7fa4f80aa010 2023-10-24T00:48:13.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa010 0x7fa4f80c1a00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fa4f0009e60 tx=0x7fa4f0009780).ready entity=mon.0 client_cookie=4585dd2c18e0c0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4f77fe700 1 -- 172.21.15.148:0/3846215939 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000e070 con 0x7fa4f80aa010 2023-10-24T00:48:13.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4f77fe700 1 -- 172.21.15.148:0/3846215939 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f000bc30 con 0x7fa4f80aa010 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4f77fe700 1 -- 172.21.15.148:0/3846215939 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0012410 con 0x7fa4f80aa010 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 -- 172.21.15.148:0/3846215939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa010 msgr2=0x7fa4f80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa010 0x7fa4f80c1a00 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fa4f0009e60 tx=0x7fa4f0009780).stop 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 -- 172.21.15.148:0/3846215939 shutdown_connections 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa3f0 0x7fa4f8069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 --2- 172.21.15.148:0/3846215939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa010 0x7fa4f80c1a00 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 -- 172.21.15.148:0/3846215939 >> 172.21.15.148:0/3846215939 conn(0x7fa4f80caf40 msgr2=0x7fa4f80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:13.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 -- 172.21.15.148:0/3846215939 shutdown_connections 2023-10-24T00:48:13.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.514+0000 7fa4ff125700 1 -- 172.21.15.148:0/3846215939 wait complete. 2023-10-24T00:48:13.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.515+0000 7fa4ff125700 1 Processor -- start 2023-10-24T00:48:13.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 -- start start 2023-10-24T00:48:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80aa010 0x7fa4f81574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80c6710 0x7fa4f80ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c52a0 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81579d0 con 0x7fa4f80aa010 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4ff125700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80c4a00 con 0x7fa4f80c6710 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.516+0000 7fa4f7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37316/0 (socket says 172.21.15.148:37316) 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 -- 172.21.15.148:0/1664138101 learned_addr learned my addr 172.21.15.148:0/1664138101 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4fd6c2700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80c6710 0x7fa4f80ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80aa010 0x7fa4f81574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 -- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80c6710 msgr2=0x7fa4f80ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80c6710 0x7fa4f80ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 -- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80aa010 msgr2=0x7fa4f81574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80aa010 0x7fa4f81574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 -- 172.21.15.148:0/1664138101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f0009a20 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f7fff700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fa4e800c4c0 tx=0x7fa4e8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80072e0 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8007440 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f80c4ce0 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80057a0 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.517+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f8154e10 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.518+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f806c6b0 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.518+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa4e8005b90 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.519+0000 7fa4f4ff9700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 0x7fa4d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.519+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5813+0+0 (secure 0 0 0) 0x7fa4e8079970 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.519+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 0x7fa4d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.519+0000 7fa4fcec1700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 0x7fa4d8061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa4f00097c0 tx=0x7fa4f80c6390).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.523+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa4e804ad70 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.728+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4f80c1200 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.728+0000 7fa4f4ff9700 1 -- 172.21.15.148:0/1664138101 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fa4e8018030 con 0x7fa4f80aa3f0 2023-10-24T00:48:13.731 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:13.731 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6440,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/2562147266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2562147266},{"type":"v1","addr":"172.21.15.150:6836","nonce":2562147266}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1892112753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":1892112753},{"type":"v1","addr":"172.21.15.150:6837","nonce":1892112753}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/304008141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":304008141},{"type":"v1","addr":"172.21.15.148:6834","nonce":304008141}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7698,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/1766177811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1766177811},{"type":"v1","addr":"172.21.15.148:6835","nonce":1766177811}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2023-10-24T00:48:13.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 msgr2=0x7fa4d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 0x7fa4d8061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa4f00097c0 tx=0x7fa4f80c6390).stop 2023-10-24T00:48:13.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 msgr2=0x7fa4f81456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fa4e800c4c0 tx=0x7fa4e8007c10).stop 2023-10-24T00:48:13.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 shutdown_connections 2023-10-24T00:48:13.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80c6710 0x7fa4f80ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80aa010 0x7fa4f81574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa4d805f150 0x7fa4d8061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 --2- 172.21.15.148:0/1664138101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa3f0 0x7fa4f81456c0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 >> 172.21.15.148:0/1664138101 conn(0x7fa4f80caf40 msgr2=0x7fa4f8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:13.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 shutdown_connections 2023-10-24T00:48:13.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.730+0000 7fa4ff125700 1 -- 172.21.15.148:0/1664138101 wait complete. 2023-10-24T00:48:13.735 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 45 2023-10-24T00:48:13.745 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T00:48:13.745 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T00:48:13.746 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T00:48:13.746 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:48:13.747 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T00:48:13.747 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T00:48:13.747 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T00:48:13.747 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:48:13.748 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T00:48:13.748 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T00:48:13.748 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T00:48:13.749 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:48:13.749 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T00:48:13.749 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T00:48:13.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T00:48:13.750 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T00:48:13.755 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T00:48:13.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T00:48:13.756 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T00:48:13.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T00:48:13.759 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T00:48:13.759 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T00:48:13.761 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T00:48:13.761 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T00:48:13.799 INFO:tasks.ceph.mds.a:Started 2023-10-24T00:48:13.800 DEBUG:teuthology.parallel:result is None 2023-10-24T00:48:13.801 INFO:tasks.ceph.mds.c:Started 2023-10-24T00:48:13.801 DEBUG:teuthology.parallel:result is None 2023-10-24T00:48:13.802 INFO:tasks.ceph.mds.b:Started 2023-10-24T00:48:13.802 DEBUG:teuthology.parallel:result is None 2023-10-24T00:48:13.803 INFO:tasks.ceph.mds.d:Started 2023-10-24T00:48:13.803 DEBUG:teuthology.parallel:result is None 2023-10-24T00:48:13.804 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T00:48:13.871 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T00:48:13.872 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T00:48:13.885 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T00:48:13.886 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T00:48:13.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.930+0000 7f7acb59e700 1 Processor -- start 2023-10-24T00:48:13.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.930+0000 7f7acb59e700 1 -- start start 2023-10-24T00:48:13.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 0x7f7acc066530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7acc1589f0 0x7f7acc063760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acb59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc155170 con 0x7f7acc063c50 2023-10-24T00:48:13.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0bec60 con 0x7f7acc1589f0 2023-10-24T00:48:13.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc154860 con 0x7f7acc0bf5d0 2023-10-24T00:48:13.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7aca59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 0x7f7acc066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7ac1d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7acc1589f0 0x7f7acc063760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acad9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7acc063c50 0x7f7acc067a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:57992/0 (socket says 172.21.15.148:57992) 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7acad9d700 1 -- 172.21.15.148:0/1104296299 learned_addr learned my addr 172.21.15.148:0/1104296299 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.931+0000 7f7ac1d9b700 1 -- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 msgr2=0x7f7acc066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac1d9b700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 0x7f7acc066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac1d9b700 1 -- 172.21.15.148:0/1104296299 >> v1:172.21.15.150:6789/0 conn(0x7f7acc063c50 legacy=0x7f7acc067a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac9d9b700 1 -- 172.21.15.148:0/1104296299 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488077969 0 0) 0x7f7acc155170 con 0x7f7acc063c50 2023-10-24T00:48:13.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac1d9b700 1 -- 172.21.15.148:0/1104296299 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc066e10 con 0x7f7acc1589f0 2023-10-24T00:48:13.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7aca59c700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 0x7f7acc066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:13.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac1d9b700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc1589f0 0x7f7acc063760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f7ab4009760 tx=0x7f7ab4009060).ready entity=mon.1 client_cookie=62a01369ec364667 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac9d9b700 1 -- 172.21.15.148:0/1104296299 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400f510 con 0x7f7acc1589f0 2023-10-24T00:48:13.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac9d9b700 1 -- 172.21.15.148:0/1104296299 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab400f670 con 0x7f7acc1589f0 2023-10-24T00:48:13.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7ac9d9b700 1 -- 172.21.15.148:0/1104296299 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400f9f0 con 0x7f7acc1589f0 2023-10-24T00:48:13.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 -- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc1589f0 msgr2=0x7f7acc063760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc1589f0 0x7f7acc063760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f7ab4009760 tx=0x7f7ab4009060).stop 2023-10-24T00:48:13.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 -- 172.21.15.148:0/1104296299 shutdown_connections 2023-10-24T00:48:13.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc0bf5d0 0x7f7acc066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 --2- 172.21.15.148:0/1104296299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc1589f0 0x7f7acc063760 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 -- 172.21.15.148:0/1104296299 >> 172.21.15.148:0/1104296299 conn(0x7f7acc0c8cf0 msgr2=0x7f7acc0c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:13.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 -- 172.21.15.148:0/1104296299 shutdown_connections 2023-10-24T00:48:13.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.932+0000 7f7acb59e700 1 -- 172.21.15.148:0/1104296299 wait complete. 2023-10-24T00:48:13.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 Processor -- start 2023-10-24T00:48:13.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 -- start start 2023-10-24T00:48:13.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc0bf5d0 0x7f7acc0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc1589f0 0x7f7acc0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0ad1e0 con 0x7f7acc063c50 2023-10-24T00:48:13.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0aa230 con 0x7f7acc0bf5d0 2023-10-24T00:48:13.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7acb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1521a0 con 0x7f7acc1589f0 2023-10-24T00:48:13.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7aca59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7aca59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37374/0 (socket says 172.21.15.148:37374) 2023-10-24T00:48:13.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.934+0000 7f7aca59c700 1 -- 172.21.15.148:0/582066462 learned_addr learned my addr 172.21.15.148:0/582066462 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:13.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7acad9d700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc1589f0 0x7f7acc0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7ac1d9b700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc0bf5d0 0x7f7acc0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 -- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc1589f0 msgr2=0x7f7acc0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc1589f0 0x7f7acc0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 -- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc0bf5d0 msgr2=0x7f7acc0a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:13.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc0bf5d0 0x7f7acc0a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:13.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 -- 172.21.15.148:0/582066462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0092a0 con 0x7f7acc063c50 2023-10-24T00:48:13.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7aca59c700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f7abc00ea50 tx=0x7f7abc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00ee90 con 0x7f7acc063c50 2023-10-24T00:48:13.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc00c850 con 0x7f7acc063c50 2023-10-24T00:48:13.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40092a0 con 0x7f7acc063c50 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00cbd0 con 0x7f7acc063c50 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.935+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc0be440 con 0x7f7acc063c50 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.936+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc0aa510 con 0x7f7acc063c50 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.936+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7abc01b400 con 0x7f7acc063c50 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.937+0000 7f7ac2ffd700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 0x7f7aac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.937+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5785+0+0 (secure 0 0 0) 0x7f7abc07a5c0 con 0x7f7acc063c50 2023-10-24T00:48:13.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.937+0000 7f7ac1d9b700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 0x7f7aac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:13.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.937+0000 7f7ac1d9b700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 0x7f7aac061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7ab4009760 tx=0x7f7ab4017000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:13.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:13.941+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7abc04b980 con 0x7f7acc063c50 2023-10-24T00:48:14.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.121+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7acc0acf80 con 0x7f7acc063c50 2023-10-24T00:48:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.995+0000 7f7ac2ffd700 1 -- 172.21.15.148:0/582066462 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7abc04efa0 con 0x7f7acc063c50 2023-10-24T00:48:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 msgr2=0x7f7aac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 0x7f7aac061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7ab4009760 tx=0x7f7ab4017000).stop 2023-10-24T00:48:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 msgr2=0x7f7acc151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f7abc00ea50 tx=0x7f7abc009060).stop 2023-10-24T00:48:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 shutdown_connections 2023-10-24T00:48:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7acc1589f0 0x7f7acc0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7aac05f150 0x7f7aac061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7acc063c50 0x7f7acc151cb0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 --2- 172.21.15.148:0/582066462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7acc0bf5d0 0x7f7acc0a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 >> 172.21.15.148:0/582066462 conn(0x7f7acc0c8cf0 msgr2=0x7f7acc13a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 shutdown_connections 2023-10-24T00:48:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:14.997+0000 7f7acb59e700 1 -- 172.21.15.148:0/582066462 wait complete. 2023-10-24T00:48:15.004 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T00:48:15.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T00:48:15.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.127+0000 7f1e1a540700 1 Processor -- start 2023-10-24T00:48:15.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.127+0000 7f1e1a540700 1 -- start start 2023-10-24T00:48:15.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e1a540700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1e140c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e1a540700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e140aa3f0 0x7f1e14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e1a540700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140aa880 con 0x7f1e140aa010 2023-10-24T00:48:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e1a540700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140c0960 con 0x7f1e140aa3f0 2023-10-24T00:48:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e1a540700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140c0c40 con 0x7f1e140c6710 2023-10-24T00:48:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e13fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1e140aa010 0x7f1e14158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47410/0 (socket says 172.21.15.148:47410) 2023-10-24T00:48:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e13fff700 1 -- 172.21.15.148:0/1624787936 learned_addr learned my addr 172.21.15.148:0/1624787936 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e18add700 1 --2- 172.21.15.148:0/1624787936 >> v2:172.21.15.150:3300/0 conn(0x7f1e140aa3f0 0x7f1e14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e137fe700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1e140c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157307419 0 0) 0x7f1e04001110 con 0x7f1e140aa010 2023-10-24T00:48:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.128+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc0033f0 con 0x7f1e140aa010 2023-10-24T00:48:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2613463453 0 0) 0x7f1dfc0033f0 con 0x7f1e140aa010 2023-10-24T00:48:15.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 msgr2=0x7f1e140c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1e140c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 >> v2:172.21.15.150:3300/0 conn(0x7f1e140aa3f0 msgr2=0x7f1e14069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 --2- 172.21.15.148:0/1624787936 >> v2:172.21.15.150:3300/0 conn(0x7f1e140aa3f0 0x7f1e14069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140c0f20 con 0x7f1e140aa010 2023-10-24T00:48:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f1e04001600 con 0x7f1e140aa010 2023-10-24T00:48:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 >> v1:172.21.15.148:6789/0 conn(0x7f1e140aa010 legacy=0x7f1e14158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1dfc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dfc003e10 0x7f1dfc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dfc004b80 0x7f1dfc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140c0960 con 0x7f1dfc004b80 2023-10-24T00:48:15.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140c0c40 con 0x7f1dfc003e10 2023-10-24T00:48:15.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc00b8e0 con 0x7f1e140c6710 2023-10-24T00:48:15.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dfc004b80 0x7f1dfc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e13fff700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1dfc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e137fe700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dfc003e10 0x7f1dfc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 -- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 msgr2=0x7f1dfc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e140c6710 0x7f1dfc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 -- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dfc003e10 msgr2=0x7f1dfc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dfc003e10 0x7f1dfc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 -- 172.21.15.148:0/1624787936 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0033f0 con 0x7f1dfc004b80 2023-10-24T00:48:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e18add700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dfc004b80 0x7f1dfc005000 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f1e0c00e240 tx=0x7f1e0c00b040).ready entity=mon.0 client_cookie=2a0174f3e34558eb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c009ac0 con 0x7f1dfc004b80 2023-10-24T00:48:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00f040 con 0x7f1dfc004b80 2023-10-24T00:48:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.129+0000 7f1e12ffd700 1 -- 172.21.15.148:0/1624787936 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00ed00 con 0x7f1dfc004b80 2023-10-24T00:48:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 -- 172.21.15.148:0/1624787936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dfc004b80 msgr2=0x7f1dfc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 --2- 172.21.15.148:0/1624787936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1dfc004b80 0x7f1dfc005000 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f1e0c00e240 tx=0x7f1e0c00b040).stop 2023-10-24T00:48:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e18add700 1 -- 172.21.15.148:0/1624787936 reap_dead start 2023-10-24T00:48:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 -- 172.21.15.148:0/1624787936 shutdown_connections 2023-10-24T00:48:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 -- 172.21.15.148:0/1624787936 >> 172.21.15.148:0/1624787936 conn(0x7f1e140caf40 msgr2=0x7f1e140cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 -- 172.21.15.148:0/1624787936 shutdown_connections 2023-10-24T00:48:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.130+0000 7f1e1a540700 1 -- 172.21.15.148:0/1624787936 wait complete. 2023-10-24T00:48:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.131+0000 7f1e1a540700 1 Processor -- start 2023-10-24T00:48:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.131+0000 7f1e1a540700 1 -- start start 2023-10-24T00:48:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e14155810 0x7f1e14148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 0x7f1e140c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14156c30 con 0x7f1e141487e0 2023-10-24T00:48:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14156020 con 0x7f1e14155810 2023-10-24T00:48:15.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e1a540700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14156300 con 0x7f1e141490b0 2023-10-24T00:48:15.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37390/0 (socket says 172.21.15.148:37390) 2023-10-24T00:48:15.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 -- 172.21.15.148:0/2842902869 learned_addr learned my addr 172.21.15.148:0/2842902869 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:15.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e18add700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 0x7f1e140c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e137fe700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e14155810 0x7f1e14148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 -- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 msgr2=0x7f1e140c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 0x7f1e140c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 -- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e14155810 msgr2=0x7f1e14148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e14155810 0x7f1e14148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e13fff700 1 -- 172.21.15.148:0/2842902869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e141565e0 con 0x7f1e141487e0 2023-10-24T00:48:15.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.132+0000 7f1e18add700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 0x7f1e140c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:15.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1e13fff700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1e04000df0 tx=0x7f1e140c6390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400f5f0 con 0x7f1e141487e0 2023-10-24T00:48:15.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0400f750 con 0x7f1e141487e0 2023-10-24T00:48:15.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e141568c0 con 0x7f1e141487e0 2023-10-24T00:48:15.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400fad0 con 0x7f1e141487e0 2023-10-24T00:48:15.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.133+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e14155c90 con 0x7f1e141487e0 2023-10-24T00:48:15.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.134+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e14156f10 con 0x7f1e141487e0 2023-10-24T00:48:15.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.134+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e0401d3b0 con 0x7f1e141487e0 2023-10-24T00:48:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.134+0000 7f1dfbfff700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 0x7f1e00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.134+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1e04079630 con 0x7f1e141487e0 2023-10-24T00:48:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.134+0000 7f1e137fe700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 0x7f1e00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.135+0000 7f1e137fe700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 0x7f1e00061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1e1414fec0 tx=0x7f1e08008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.138+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e0404aca0 con 0x7f1e141487e0 2023-10-24T00:48:15.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.365+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1e140aa880 con 0x7f1e141487e0 2023-10-24T00:48:15.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.366+0000 7f1dfbfff700 1 -- 172.21.15.148:0/2842902869 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1e140aa880 con 0x7f1e141487e0 2023-10-24T00:48:15.368 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:15.369 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:48:15.369 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T00:48:15.369 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.369 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T00:48:15.370 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T00:48:15.370 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.370 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.370 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:48:15.370 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:48:15.371 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.371 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.371 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.371 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T00:48:15.372 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T00:48:15.372 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:48:15.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:48:15.373 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.373 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.373 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T00:48:15.374 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T00:48:15.374 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:48:15.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:48:15.375 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.375 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.375 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T00:48:15.376 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T00:48:15.376 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:48:15.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:48:15.377 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.377 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.377 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.377 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T00:48:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T00:48:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.378 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.379 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.379 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.379 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T00:48:15.379 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T00:48:15.380 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.380 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.380 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.380 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.380 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.381 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.381 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T00:48:15.381 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T00:48:15.381 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.382 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.382 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.382 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.382 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.383 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T00:48:15.383 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T00:48:15.383 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.384 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.384 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.384 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.384 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.385 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T00:48:15.385 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T00:48:15.385 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.385 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.386 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.386 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.386 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.386 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.387 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T00:48:15.387 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T00:48:15.387 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.387 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.387 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T00:48:15.388 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T00:48:15.389 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.389 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.390 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.390 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T00:48:15.390 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T00:48:15.390 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.391 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T00:48:15.391 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T00:48:15.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.391 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.391 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.392 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T00:48:15.392 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T00:48:15.392 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.392 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.393 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T00:48:15.393 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T00:48:15.393 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.393 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.394 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T00:48:15.394 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T00:48:15.394 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:48:15.395 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:48:15.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:48:15.395 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.395 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:48:15.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:48:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:48:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.397 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T00:48:15.398 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T00:48:15.398 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T00:48:15.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T00:48:15.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T00:48:15.399 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T00:48:15.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.399 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.399 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T00:48:15.400 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T00:48:15.400 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.400 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:48:15.400 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T00:48:15.400 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T00:48:15.401 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.401 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.401 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T00:48:15.402 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T00:48:15.402 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:48:15.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:48:15.402 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T00:48:15.403 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T00:48:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T00:48:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T00:48:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T00:48:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:15.405 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T00:48:15.405 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:48:15.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 msgr2=0x7f1e00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 0x7f1e00061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1e1414fec0 tx=0x7f1e08008040).stop 2023-10-24T00:48:15.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 msgr2=0x7f1e141570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1e04000df0 tx=0x7f1e140c6390).stop 2023-10-24T00:48:15.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 shutdown_connections 2023-10-24T00:48:15.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e141490b0 0x7f1e140c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1e0005f150 0x7f1e00061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e141487e0 0x7f1e141570c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 --2- 172.21.15.148:0/2842902869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e14155810 0x7f1e14148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 >> 172.21.15.148:0/2842902869 conn(0x7f1e140caf40 msgr2=0x7f1e140c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 shutdown_connections 2023-10-24T00:48:15.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.367+0000 7f1e1a540700 1 -- 172.21.15.148:0/2842902869 wait complete. 2023-10-24T00:48:15.410 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:15.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.521+0000 7f9b6359e700 1 Processor -- start 2023-10-24T00:48:15.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.521+0000 7f9b6359e700 1 -- start start 2023-10-24T00:48:15.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.522+0000 7f9b6359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b640aa140 0x7f9b640c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.522+0000 7f9b6359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 0x7f9b640c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.522+0000 7f9b6359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640c6410 con 0x7f9b640ca110 2023-10-24T00:48:15.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.522+0000 7f9b6359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640ca6e0 con 0x7f9b640aa140 2023-10-24T00:48:15.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.522+0000 7f9b6359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640ca9c0 con 0x7f9b640c0ef0 2023-10-24T00:48:15.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b640aa140 0x7f9b640c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b62d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 0x7f9b640c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b640aa140 0x7f9b640c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:33468/0 (socket says 172.21.15.148:33468) 2023-10-24T00:48:15.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b62d9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 0x7f9b640c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:48554/0 (socket says 172.21.15.148:48554) 2023-10-24T00:48:15.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 -- 172.21.15.148:0/1441464460 learned_addr learned my addr 172.21.15.148:0/1441464460 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:15.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b61d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9b640ca110 0x7f9b640c07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:57996/0 (socket says 172.21.15.148:57996) 2023-10-24T00:48:15.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 -- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 msgr2=0x7f9b640c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 --2- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 0x7f9b640c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 -- 172.21.15.148:0/1441464460 >> v1:172.21.15.150:6789/0 conn(0x7f9b640ca110 legacy=0x7f9b640c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 -- 172.21.15.148:0/1441464460 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640c60a0 con 0x7f9b640aa140 2023-10-24T00:48:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6159a700 1 -- 172.21.15.148:0/1441464460 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929940706 0 0) 0x7f9b640c6410 con 0x7f9b640ca110 2023-10-24T00:48:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6259c700 1 --2- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640aa140 0x7f9b640c9c20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9b54006fd0 tx=0x7f9b540090f0).ready entity=mon.1 client_cookie=92a4917d1a076718 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6159a700 1 -- 172.21.15.148:0/1441464460 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400b580 con 0x7f9b640aa140 2023-10-24T00:48:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6159a700 1 -- 172.21.15.148:0/1441464460 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400b6e0 con 0x7f9b640aa140 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.523+0000 7f9b6159a700 1 -- 172.21.15.148:0/1441464460 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400ba60 con 0x7f9b640aa140 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 -- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640aa140 msgr2=0x7f9b640c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 --2- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640aa140 0x7f9b640c9c20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9b54006fd0 tx=0x7f9b540090f0).stop 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 -- 172.21.15.148:0/1441464460 shutdown_connections 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 --2- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640c0ef0 0x7f9b640c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 --2- 172.21.15.148:0/1441464460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640aa140 0x7f9b640c9c20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 -- 172.21.15.148:0/1441464460 >> 172.21.15.148:0/1441464460 conn(0x7f9b640944a0 msgr2=0x7f9b6406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 -- 172.21.15.148:0/1441464460 shutdown_connections 2023-10-24T00:48:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.524+0000 7f9b6359e700 1 -- 172.21.15.148:0/1441464460 wait complete. 2023-10-24T00:48:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.525+0000 7f9b6359e700 1 Processor -- start 2023-10-24T00:48:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.525+0000 7f9b6359e700 1 -- start start 2023-10-24T00:48:15.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640aa140 0x7f9b64165090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640c0ef0 0x7f9b640b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6414ae10 con 0x7f9b640ca110 2023-10-24T00:48:15.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640b0c00 con 0x7f9b640c0ef0 2023-10-24T00:48:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6414a520 con 0x7f9b640aa140 2023-10-24T00:48:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37398/0 (socket says 172.21.15.148:37398) 2023-10-24T00:48:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 -- 172.21.15.148:0/948655916 learned_addr learned my addr 172.21.15.148:0/948655916 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6259c700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640aa140 0x7f9b64165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b61d9b700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640c0ef0 0x7f9b640b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 -- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640aa140 msgr2=0x7f9b64165090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640aa140 0x7f9b64165090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 -- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640c0ef0 msgr2=0x7f9b640b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640c0ef0 0x7f9b640b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 -- 172.21.15.148:0/948655916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009370 con 0x7f9b640ca110 2023-10-24T00:48:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b62d9d700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f9b5c009ef0 tx=0x7f9b5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c009c50 con 0x7f9b640ca110 2023-10-24T00:48:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c00f040 con 0x7f9b640ca110 2023-10-24T00:48:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6414a7c0 con 0x7f9b640ca110 2023-10-24T00:48:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00cda0 con 0x7f9b640ca110 2023-10-24T00:48:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.526+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b640b0e60 con 0x7f9b640ca110 2023-10-24T00:48:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.527+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64047480 con 0x7f9b640ca110 2023-10-24T00:48:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.528+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b5c013610 con 0x7f9b640ca110 2023-10-24T00:48:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.528+0000 7f9b527fc700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 0x7f9b44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.528+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9b5c07a600 con 0x7f9b640ca110 2023-10-24T00:48:15.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.528+0000 7f9b6259c700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 0x7f9b44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.529+0000 7f9b6259c700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 0x7f9b44061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b54009fd0 tx=0x7f9b54017000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.532+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b5c04bc20 con 0x7f9b640ca110 2023-10-24T00:48:15.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.695+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b640c5d50 con 0x7f9b640ca110 2023-10-24T00:48:15.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.696+0000 7f9b527fc700 1 -- 172.21.15.148:0/948655916 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+13771 (secure 0 0 0) 0x7f9b5c04f240 con 0x7f9b640ca110 2023-10-24T00:48:15.699 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:15.699 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":138,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:14.990797+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:15.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.697+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 msgr2=0x7f9b44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.697+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 0x7f9b44061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9b54009fd0 tx=0x7f9b54017000).stop 2023-10-24T00:48:15.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 msgr2=0x7f9b640addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f9b5c009ef0 tx=0x7f9b5c00b040).stop 2023-10-24T00:48:15.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 shutdown_connections 2023-10-24T00:48:15.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9b4405f150 0x7f9b44061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b640ca110 0x7f9b640addb0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b640aa140 0x7f9b64165090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 --2- 172.21.15.148:0/948655916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b640c0ef0 0x7f9b640b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 >> 172.21.15.148:0/948655916 conn(0x7f9b640944a0 msgr2=0x7f9b640a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 shutdown_connections 2023-10-24T00:48:15.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.698+0000 7f9b6359e700 1 -- 172.21.15.148:0/948655916 wait complete. 2023-10-24T00:48:15.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T00:48:15.713 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T00:48:15.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.827+0000 7f59912ef700 1 Processor -- start 2023-10-24T00:48:15.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.827+0000 7f59912ef700 1 -- start start 2023-10-24T00:48:15.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.827+0000 7f59912ef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f598c154430 0x7f598c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.827+0000 7f59912ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f598c098bd0 0x7f598c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.827+0000 7f59912ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0c71d0 con 0x7f598c0bffd0 2023-10-24T00:48:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f59912ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c0c9410 con 0x7f598c098bd0 2023-10-24T00:48:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f59912ef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c0c6c10 con 0x7f598c154430 2023-10-24T00:48:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f598c098bd0 0x7f598c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f598c0bffd0 0x7f598c0c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47422/0 (socket says 172.21.15.148:47422) 2023-10-24T00:48:15.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598b7fe700 1 -- 172.21.15.148:0/1271900505 learned_addr learned my addr 172.21.15.148:0/1271900505 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:15.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598affd700 1 --2- 172.21.15.148:0/1271900505 >> v2:172.21.15.150:3300/0 conn(0x7f598c154430 0x7f598c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 -- 172.21.15.148:0/1271900505 >> v2:172.21.15.150:3300/0 conn(0x7f598c154430 msgr2=0x7f598c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:15.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 --2- 172.21.15.148:0/1271900505 >> v2:172.21.15.150:3300/0 conn(0x7f598c154430 0x7f598c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 -- 172.21.15.148:0/1271900505 >> v1:172.21.15.148:6789/0 conn(0x7f598c0bffd0 legacy=0x7f598c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f5989ffb700 1 -- 172.21.15.148:0/1271900505 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022226057 0 0) 0x7f598c0c71d0 con 0x7f598c0bffd0 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 -- 172.21.15.148:0/1271900505 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0c6ef0 con 0x7f598c098bd0 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f598a7fc700 1 --2- 172.21.15.148:0/1271900505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c098bd0 0x7f598c0c6300 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f598c05ff70 tx=0x7f5974009060).ready entity=mon.0 client_cookie=e63f92c4167e76f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f5989ffb700 1 -- 172.21.15.148:0/1271900505 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400f510 con 0x7f598c098bd0 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f5989ffb700 1 -- 172.21.15.148:0/1271900505 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400f670 con 0x7f598c098bd0 2023-10-24T00:48:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.828+0000 7f5989ffb700 1 -- 172.21.15.148:0/1271900505 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400f9f0 con 0x7f598c098bd0 2023-10-24T00:48:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 -- 172.21.15.148:0/1271900505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c098bd0 msgr2=0x7f598c0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 --2- 172.21.15.148:0/1271900505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c098bd0 0x7f598c0c6300 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f598c05ff70 tx=0x7f5974009060).stop 2023-10-24T00:48:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 -- 172.21.15.148:0/1271900505 shutdown_connections 2023-10-24T00:48:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 --2- 172.21.15.148:0/1271900505 >> v2:172.21.15.150:3300/0 conn(0x7f598c154430 0x7f598c154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 --2- 172.21.15.148:0/1271900505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c098bd0 0x7f598c0c6300 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 -- 172.21.15.148:0/1271900505 >> 172.21.15.148:0/1271900505 conn(0x7f598c0cb070 msgr2=0x7f598c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 -- 172.21.15.148:0/1271900505 shutdown_connections 2023-10-24T00:48:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.829+0000 7f59912ef700 1 -- 172.21.15.148:0/1271900505 wait complete. 2023-10-24T00:48:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.830+0000 7f59912ef700 1 Processor -- start 2023-10-24T00:48:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.830+0000 7f59912ef700 1 -- start start 2023-10-24T00:48:15.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598c098bd0 0x7f598c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598c154430 0x7f598c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0acd70 con 0x7f598c0bffd0 2023-10-24T00:48:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0afd70 con 0x7f598c154430 2023-10-24T00:48:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f59912ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c14c370 con 0x7f598c098bd0 2023-10-24T00:48:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37422/0 (socket says 172.21.15.148:37422) 2023-10-24T00:48:15.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 -- 172.21.15.148:0/793151245 learned_addr learned my addr 172.21.15.148:0/793151245 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:15.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598b7fe700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598c154430 0x7f598c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598affd700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598c098bd0 0x7f598c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 -- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598c098bd0 msgr2=0x7f598c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598c098bd0 0x7f598c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 -- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598c154430 msgr2=0x7f598c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:15.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598c154430 0x7f598c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:15.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 -- 172.21.15.148:0/793151245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740092a0 con 0x7f598c0bffd0 2023-10-24T00:48:15.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f598a7fc700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f5974009dd0 tx=0x7f5974017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.831+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400f7e0 con 0x7f598c0bffd0 2023-10-24T00:48:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.832+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400f940 con 0x7f598c0bffd0 2023-10-24T00:48:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.832+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c0ac7b0 con 0x7f598c0bffd0 2023-10-24T00:48:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.832+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597401b660 con 0x7f598c0bffd0 2023-10-24T00:48:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.832+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c0afa00 con 0x7f598c0bffd0 2023-10-24T00:48:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.832+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c0af860 con 0x7f598c0bffd0 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.833+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f597401ba10 con 0x7f598c0bffd0 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.834+0000 7f5982ffd700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 0x7f596c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.834+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f597407b840 con 0x7f598c0bffd0 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.834+0000 7f598affd700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 0x7f596c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.834+0000 7f598affd700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 0x7f596c0615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5984009fd0 tx=0x7f598400b040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:15.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:15.837+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f597404cf00 con 0x7f598c0bffd0 2023-10-24T00:48:16.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.004+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f598c0aff00 con 0x7f598c0bffd0 2023-10-24T00:48:16.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.004+0000 7f5982ffd700 1 -- 172.21.15.148:0/793151245 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v138) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5974029020 con 0x7f598c0bffd0 2023-10-24T00:48:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T00:48:16.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 msgr2=0x7f596c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 0x7f596c0615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5984009fd0 tx=0x7f598400b040).stop 2023-10-24T00:48:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 msgr2=0x7f598c0b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f5974009dd0 tx=0x7f5974017000).stop 2023-10-24T00:48:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 shutdown_connections 2023-10-24T00:48:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f598c154430 0x7f598c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f598c098bd0 0x7f598c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f596c05f120 0x7f596c0615e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 --2- 172.21.15.148:0/793151245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f598c0bffd0 0x7f598c0b0200 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.006+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 >> 172.21.15.148:0/793151245 conn(0x7f598c0cb070 msgr2=0x7f598c14fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.007+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 shutdown_connections 2023-10-24T00:48:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.007+0000 7f59912ef700 1 -- 172.21.15.148:0/793151245 wait complete. 2023-10-24T00:48:16.022 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T00:48:16.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.136+0000 7f33df5f1700 1 Processor -- start 2023-10-24T00:48:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.136+0000 7f33df5f1700 1 -- start start 2023-10-24T00:48:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f33d8154430 0x7f33d8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33d8098bd0 0x7f33d80c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d80c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80c71d0 con 0x7f33d8154430 2023-10-24T00:48:16.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80c9410 con 0x7f33d8098bd0 2023-10-24T00:48:16.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33df5f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80c0950 con 0x7f33d80bffd0 2023-10-24T00:48:16.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33dd38d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f33d8154430 0x7f33d8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33dd38d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f33d8154430 0x7f33d8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37436/0 (socket says 172.21.15.148:37436) 2023-10-24T00:48:16.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33dd38d700 1 -- 172.21.15.148:0/3703840920 learned_addr learned my addr 172.21.15.148:0/3703840920 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:16.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33ddb8e700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d80c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.137+0000 7f33dcb8c700 1 --2- 172.21.15.148:0/3703840920 >> v2:172.21.15.150:3300/0 conn(0x7f33d8098bd0 0x7f33d80c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 -- 172.21.15.148:0/3703840920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 msgr2=0x7f33d80c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:16.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d80c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 -- 172.21.15.148:0/3703840920 >> v2:172.21.15.150:3300/0 conn(0x7f33d8098bd0 msgr2=0x7f33d80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3703840920 >> v2:172.21.15.150:3300/0 conn(0x7f33d8098bd0 0x7f33d80c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 -- 172.21.15.148:0/3703840920 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80c6c10 con 0x7f33d8154430 2023-10-24T00:48:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8154430 0x7f33d8154810 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f33d80c23b0 tx=0x7f33c8009840).ready entity=mon.0 client_cookie=dea0b82998b62efe server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33d7fff700 1 -- 172.21.15.148:0/3703840920 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800e070 con 0x7f33d8154430 2023-10-24T00:48:16.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33d7fff700 1 -- 172.21.15.148:0/3703840920 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c800b970 con 0x7f33d8154430 2023-10-24T00:48:16.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33d7fff700 1 -- 172.21.15.148:0/3703840920 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800bcf0 con 0x7f33d8154430 2023-10-24T00:48:16.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 -- 172.21.15.148:0/3703840920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8154430 msgr2=0x7f33d8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8154430 0x7f33d8154810 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f33d80c23b0 tx=0x7f33c8009840).stop 2023-10-24T00:48:16.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 -- 172.21.15.148:0/3703840920 shutdown_connections 2023-10-24T00:48:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8154430 0x7f33d8154810 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3703840920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d80c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3703840920 >> v2:172.21.15.150:3300/0 conn(0x7f33d8098bd0 0x7f33d80c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.138+0000 7f33df5f1700 1 -- 172.21.15.148:0/3703840920 >> 172.21.15.148:0/3703840920 conn(0x7f33d80cb070 msgr2=0x7f33d80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.139+0000 7f33df5f1700 1 -- 172.21.15.148:0/3703840920 shutdown_connections 2023-10-24T00:48:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.139+0000 7f33df5f1700 1 -- 172.21.15.148:0/3703840920 wait complete. 2023-10-24T00:48:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.140+0000 7f33df5f1700 1 Processor -- start 2023-10-24T00:48:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.140+0000 7f33df5f1700 1 -- start start 2023-10-24T00:48:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d8154430 0x7f33d80af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81517a0 con 0x7f33d8098bd0 2023-10-24T00:48:16.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80ac290 con 0x7f33d8154430 2023-10-24T00:48:16.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8150c20 con 0x7f33d80bffd0 2023-10-24T00:48:16.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37448/0 (socket says 172.21.15.148:37448) 2023-10-24T00:48:16.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 -- 172.21.15.148:0/3015259765 learned_addr learned my addr 172.21.15.148:0/3015259765 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:16.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dcb8c700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33ddb8e700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d8154430 0x7f33d80af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 -- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 msgr2=0x7f33d814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 -- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d8154430 msgr2=0x7f33d80af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d8154430 0x7f33d80af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 -- 172.21.15.148:0/3015259765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009ae0 con 0x7f33d8098bd0 2023-10-24T00:48:16.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33dd38d700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f33c800b610 tx=0x7f33c8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800bcf0 con 0x7f33d8098bd0 2023-10-24T00:48:16.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c80092e0 con 0x7f33d8098bd0 2023-10-24T00:48:16.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d8150f00 con 0x7f33d8098bd0 2023-10-24T00:48:16.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c801e680 con 0x7f33d8098bd0 2023-10-24T00:48:16.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.141+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d81514c0 con 0x7f33d8098bd0 2023-10-24T00:48:16.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.142+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d806c6b0 con 0x7f33d8098bd0 2023-10-24T00:48:16.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.143+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f33c8003040 con 0x7f33d8098bd0 2023-10-24T00:48:16.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.143+0000 7f33d57fa700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 0x7f33c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.143+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f33c807b670 con 0x7f33d8098bd0 2023-10-24T00:48:16.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.143+0000 7f33dcb8c700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 0x7f33c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.144+0000 7f33dcb8c700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 0x7f33c4061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33d80b11c0 tx=0x7f33cc008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.147+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f33c804cc80 con 0x7f33d8098bd0 2023-10-24T00:48:16.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.310+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33d8062c40 con 0x7f33d8098bd0 2023-10-24T00:48:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.310+0000 7f33d57fa700 1 -- 172.21.15.148:0/3015259765 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33c80230a0 con 0x7f33d8098bd0 2023-10-24T00:48:16.313 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T00:48:16.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 msgr2=0x7f33c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 0x7f33c4061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33d80b11c0 tx=0x7f33cc008040).stop 2023-10-24T00:48:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 msgr2=0x7f33d81652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f33c800b610 tx=0x7f33c8009840).stop 2023-10-24T00:48:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 shutdown_connections 2023-10-24T00:48:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d8154430 0x7f33d80af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f33c405f150 0x7f33c4061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f33d8098bd0 0x7f33d81652e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 --2- 172.21.15.148:0/3015259765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d80bffd0 0x7f33d814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 >> 172.21.15.148:0/3015259765 conn(0x7f33d80cb070 msgr2=0x7f33d80a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 shutdown_connections 2023-10-24T00:48:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.312+0000 7f33df5f1700 1 -- 172.21.15.148:0/3015259765 wait complete. 2023-10-24T00:48:16.327 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T00:48:16.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.439+0000 7f0a6a406700 1 Processor -- start 2023-10-24T00:48:16.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.439+0000 7f0a6a406700 1 -- start start 2023-10-24T00:48:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.439+0000 7f0a6a406700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a641543a0 0x7f0a640a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a6a406700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640bf5c0 con 0x7f0a640964f0 2023-10-24T00:48:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a6a406700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640be9b0 con 0x7f0a640a84b0 2023-10-24T00:48:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a6a406700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a640bec90 con 0x7f0a641543a0 2023-10-24T00:48:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a689a3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0a640964f0 0x7f0a640a5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47432/0 (socket says 172.21.15.148:47432) 2023-10-24T00:48:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a689a3700 1 -- 172.21.15.148:0/637899603 learned_addr learned my addr 172.21.15.148:0/637899603 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a63fff700 1 --2- 172.21.15.148:0/637899603 >> v2:172.21.15.150:3300/0 conn(0x7f0a641543a0 0x7f0a640a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a637fe700 1 -- 172.21.15.148:0/637899603 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931698113 0 0) 0x7f0a640bf5c0 con 0x7f0a640964f0 2023-10-24T00:48:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a637fe700 1 -- 172.21.15.148:0/637899603 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a500033f0 con 0x7f0a640964f0 2023-10-24T00:48:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a63fff700 1 -- 172.21.15.148:0/637899603 >> v1:172.21.15.150:6789/0 conn(0x7f0a640a84b0 legacy=0x7f0a64095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a63fff700 1 -- 172.21.15.148:0/637899603 >> v1:172.21.15.148:6789/0 conn(0x7f0a640964f0 legacy=0x7f0a640a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a63fff700 1 -- 172.21.15.148:0/637899603 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640bef70 con 0x7f0a641543a0 2023-10-24T00:48:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a63fff700 1 --2- 172.21.15.148:0/637899603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a641543a0 0x7f0a640a7fc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0a54009760 tx=0x7f0a54009060).ready entity=mon.1 client_cookie=a8ad4ef47182aa63 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.440+0000 7f0a637fe700 1 -- 172.21.15.148:0/637899603 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400b590 con 0x7f0a641543a0 2023-10-24T00:48:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a637fe700 1 -- 172.21.15.148:0/637899603 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5400b6f0 con 0x7f0a641543a0 2023-10-24T00:48:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a637fe700 1 -- 172.21.15.148:0/637899603 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400ba70 con 0x7f0a641543a0 2023-10-24T00:48:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 -- 172.21.15.148:0/637899603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a641543a0 msgr2=0x7f0a640a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 --2- 172.21.15.148:0/637899603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a641543a0 0x7f0a640a7fc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0a54009760 tx=0x7f0a54009060).stop 2023-10-24T00:48:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 -- 172.21.15.148:0/637899603 shutdown_connections 2023-10-24T00:48:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 --2- 172.21.15.148:0/637899603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a641543a0 0x7f0a640a7fc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 -- 172.21.15.148:0/637899603 >> 172.21.15.148:0/637899603 conn(0x7f0a640630f0 msgr2=0x7f0a640c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 -- 172.21.15.148:0/637899603 shutdown_connections 2023-10-24T00:48:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.441+0000 7f0a6a406700 1 -- 172.21.15.148:0/637899603 wait complete. 2023-10-24T00:48:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.442+0000 7f0a6a406700 1 Processor -- start 2023-10-24T00:48:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.442+0000 7f0a6a406700 1 -- start start 2023-10-24T00:48:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 0x7f0a640aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a641543a0 0x7f0a6414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640aaad0 con 0x7f0a640964f0 2023-10-24T00:48:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640a9ec0 con 0x7f0a640a84b0 2023-10-24T00:48:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640aa1a0 con 0x7f0a641543a0 2023-10-24T00:48:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37454/0 (socket says 172.21.15.148:37454) 2023-10-24T00:48:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 -- 172.21.15.148:0/3262600721 learned_addr learned my addr 172.21.15.148:0/3262600721 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a5bfff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 0x7f0a640aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a689a3700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a641543a0 0x7f0a6414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 -- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a641543a0 msgr2=0x7f0a6414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a641543a0 0x7f0a6414f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 -- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 msgr2=0x7f0a640aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 0x7f0a640aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 -- 172.21.15.148:0/3262600721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540092a0 con 0x7f0a640964f0 2023-10-24T00:48:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a5bfff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 0x7f0a640aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a63fff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f0a640c6940 tx=0x7f0a54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400b860 con 0x7f0a640964f0 2023-10-24T00:48:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5400b9c0 con 0x7f0a640964f0 2023-10-24T00:48:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.443+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640aa480 con 0x7f0a640964f0 2023-10-24T00:48:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.444+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401b690 con 0x7f0a640964f0 2023-10-24T00:48:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.444+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640c3670 con 0x7f0a640964f0 2023-10-24T00:48:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.444+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6406c6b0 con 0x7f0a640964f0 2023-10-24T00:48:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.445+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0a5401ba40 con 0x7f0a640964f0 2023-10-24T00:48:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.445+0000 7f0a60ff9700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 0x7f0a44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.445+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0a5407b8b0 con 0x7f0a640964f0 2023-10-24T00:48:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.446+0000 7f0a5bfff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 0x7f0a44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.446+0000 7f0a5bfff700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 0x7f0a44061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0a64168190 tx=0x7f0a4c009040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.449+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0a5404ce10 con 0x7f0a640964f0 2023-10-24T00:48:16.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.613+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a640bf250 con 0x7f0a640964f0 2023-10-24T00:48:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.613+0000 7f0a60ff9700 1 -- 172.21.15.148:0/3262600721 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0a54050430 con 0x7f0a640964f0 2023-10-24T00:48:16.616 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:48:16.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:16.617 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T00:48:16.617 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T00:48:16.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T00:48:16.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:16.618 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T00:48:16.618 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T00:48:16.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:16.618 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:48:16.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 msgr2=0x7f0a44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 0x7f0a44061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0a64168190 tx=0x7f0a4c009040).stop 2023-10-24T00:48:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 msgr2=0x7f0a64168c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f0a640c6940 tx=0x7f0a54017000).stop 2023-10-24T00:48:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 shutdown_connections 2023-10-24T00:48:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a641543a0 0x7f0a6414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a4405f150 0x7f0a44061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a640964f0 0x7f0a64168c00 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 --2- 172.21.15.148:0/3262600721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a640a84b0 0x7f0a640aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 >> 172.21.15.148:0/3262600721 conn(0x7f0a640630f0 msgr2=0x7f0a64067e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 shutdown_connections 2023-10-24T00:48:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.615+0000 7f0a6a406700 1 -- 172.21.15.148:0/3262600721 wait complete. 2023-10-24T00:48:16.630 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T00:48:16.630 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T00:48:16.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.746+0000 7f37e464f700 1 Processor -- start 2023-10-24T00:48:16.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.746+0000 7f37e464f700 1 -- start start 2023-10-24T00:48:16.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e464f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e464f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37dc0aa640 0x7f37dc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e464f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0c6270 con 0x7f37dc0c8290 2023-10-24T00:48:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e464f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0c60e0 con 0x7f37dc0aa640 2023-10-24T00:48:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e464f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c0c80 con 0x7f37dc1544b0 2023-10-24T00:48:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e2bec700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37dc0aa640 0x7f37dc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e1bea700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f37dc0c8290 0x7f37dc0a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47438/0 (socket says 172.21.15.148:47438) 2023-10-24T00:48:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e1bea700 1 -- 172.21.15.148:0/956916457 learned_addr learned my addr 172.21.15.148:0/956916457 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e23eb700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e2bec700 1 -- 172.21.15.148:0/956916457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 msgr2=0x7f37dc0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e2bec700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e2bec700 1 -- 172.21.15.148:0/956916457 >> v1:172.21.15.148:6789/0 conn(0x7f37dc0c8290 legacy=0x7f37dc0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e2bec700 1 -- 172.21.15.148:0/956916457 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0c0f40 con 0x7f37dc0aa640 2023-10-24T00:48:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.747+0000 7f37e13e9700 1 -- 172.21.15.148:0/956916457 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569182043 0 0) 0x7f37dc0c6270 con 0x7f37dc0c8290 2023-10-24T00:48:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e2bec700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc0c6700 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f37d4009760 tx=0x7f37d4009060).ready entity=mon.0 client_cookie=1b8d4a94c4022bfc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e13e9700 1 -- 172.21.15.148:0/956916457 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400b580 con 0x7f37dc0aa640 2023-10-24T00:48:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e13e9700 1 -- 172.21.15.148:0/956916457 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d400b6e0 con 0x7f37dc0aa640 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e13e9700 1 -- 172.21.15.148:0/956916457 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d400ba60 con 0x7f37dc0aa640 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 -- 172.21.15.148:0/956916457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 msgr2=0x7f37dc0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc0c6700 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f37d4009760 tx=0x7f37d4009060).stop 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 -- 172.21.15.148:0/956916457 shutdown_connections 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc0c6700 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 --2- 172.21.15.148:0/956916457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 -- 172.21.15.148:0/956916457 >> 172.21.15.148:0/956916457 conn(0x7f37dc0945d0 msgr2=0x7f37dc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 -- 172.21.15.148:0/956916457 shutdown_connections 2023-10-24T00:48:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.748+0000 7f37e464f700 1 -- 172.21.15.148:0/956916457 wait complete. 2023-10-24T00:48:16.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.749+0000 7f37e464f700 1 Processor -- start 2023-10-24T00:48:16.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.749+0000 7f37e464f700 1 -- start start 2023-10-24T00:48:16.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0c8290 0x7f37dc0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0ca2f0 con 0x7f37dc0aa640 2023-10-24T00:48:16.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c3020 con 0x7f37dc0c8290 2023-10-24T00:48:16.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e464f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c32f0 con 0x7f37dc1544b0 2023-10-24T00:48:16.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e23eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e23eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37484/0 (socket says 172.21.15.148:37484) 2023-10-24T00:48:16.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e23eb700 1 -- 172.21.15.148:0/535070124 learned_addr learned my addr 172.21.15.148:0/535070124 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:16.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e1bea700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0c8290 0x7f37dc0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.750+0000 7f37e2bec700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 -- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 msgr2=0x7f37dc1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 -- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0c8290 msgr2=0x7f37dc0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:16.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0c8290 0x7f37dc0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:16.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 -- 172.21.15.148:0/535070124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40092a0 con 0x7f37dc0aa640 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e2bec700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e23eb700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f37cc007f60 tx=0x7f37cc009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00ec40 con 0x7f37dc0aa640 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00eda0 con 0x7f37dc0aa640 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0c35d0 con 0x7f37dc0aa640 2023-10-24T00:48:16.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc014610 con 0x7f37dc0aa640 2023-10-24T00:48:16.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.751+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0aede0 con 0x7f37dc0aa640 2023-10-24T00:48:16.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.752+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0c3af0 con 0x7f37dc0aa640 2023-10-24T00:48:16.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.752+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f37cc0149c0 con 0x7f37dc0aa640 2023-10-24T00:48:16.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.752+0000 7f37da7fc700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 0x7f37c80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:16.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.752+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f37cc07a390 con 0x7f37dc0aa640 2023-10-24T00:48:16.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.753+0000 7f37e1bea700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 0x7f37c80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:16.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.753+0000 7f37e1bea700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 0x7f37c80615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f37dc0b09c0 tx=0x7f37d0007bb0).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:16.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.756+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f37dc0c3af0 con 0x7f37dc0aa640 2023-10-24T00:48:16.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:16.921+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f37dc0c3af0 con 0x7f37dc0aa640 2023-10-24T00:48:17.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.009+0000 7f37da7fc700 1 -- 172.21.15.148:0/535070124 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) v1 ==== 152+0+0 (secure 0 0 0) 0x7f37dc0c3af0 con 0x7f37dc0aa640 2023-10-24T00:48:17.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 msgr2=0x7f37c80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 0x7f37c80615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f37dc0b09c0 tx=0x7f37d0007bb0).stop 2023-10-24T00:48:17.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 msgr2=0x7f37dc1675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f37cc007f60 tx=0x7f37cc009860).stop 2023-10-24T00:48:17.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 shutdown_connections 2023-10-24T00:48:17.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37dc1544b0 0x7f37dc1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f37c805f120 0x7f37c80615e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37dc0aa640 0x7f37dc1675f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 --2- 172.21.15.148:0/535070124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37dc0c8290 0x7f37dc0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.012+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 >> 172.21.15.148:0/535070124 conn(0x7f37dc0945d0 msgr2=0x7f37dc0bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:17.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.014+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 shutdown_connections 2023-10-24T00:48:17.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.014+0000 7f37e464f700 1 -- 172.21.15.148:0/535070124 wait complete. 2023-10-24T00:48:17.020 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T00:48:17.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T00:48:17.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.149+0000 7f4d92898700 1 Processor -- start 2023-10-24T00:48:17.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.149+0000 7f4d92898700 1 -- start start 2023-10-24T00:48:17.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d92898700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 0x7f4d8c155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d92898700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d92898700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c155c00 con 0x7f4d8c0c6240 2023-10-24T00:48:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d92898700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c8800 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d92898700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c7b80 con 0x7f4d8c152290 2023-10-24T00:48:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d90e35700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d8b7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4d8c0c6240 0x7f4d8c0c0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47440/0 (socket says 172.21.15.148:47440) 2023-10-24T00:48:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d90e35700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37498/0 (socket says 172.21.15.148:37498) 2023-10-24T00:48:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.150+0000 7f4d8b7fe700 1 -- 172.21.15.148:0/2901280839 learned_addr learned my addr 172.21.15.148:0/2901280839 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d8bfff700 1 --2- 172.21.15.148:0/2901280839 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 0x7f4d8c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d90e35700 1 -- 172.21.15.148:0/2901280839 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 msgr2=0x7f4d8c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d90e35700 1 --2- 172.21.15.148:0/2901280839 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 0x7f4d8c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d90e35700 1 -- 172.21.15.148:0/2901280839 >> v1:172.21.15.148:6789/0 conn(0x7f4d8c0c6240 legacy=0x7f4d8c0c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d90e35700 1 -- 172.21.15.148:0/2901280839 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0c7e60 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d8bfff700 1 --2- 172.21.15.148:0/2901280839 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 0x7f4d8c155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:17.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d90e35700 1 --2- 172.21.15.148:0/2901280839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f4d8c083820 tx=0x7f4d84009780).ready entity=mon.0 client_cookie=970271f1e7062c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:17.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d8affd700 1 -- 172.21.15.148:0/2901280839 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400e070 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d8affd700 1 -- 172.21.15.148:0/2901280839 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400bc30 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d8affd700 1 -- 172.21.15.148:0/2901280839 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84012410 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d92898700 1 -- 172.21.15.148:0/2901280839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c0c66c0 msgr2=0x7f4d8c0c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d92898700 1 --2- 172.21.15.148:0/2901280839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f4d8c083820 tx=0x7f4d84009780).stop 2023-10-24T00:48:17.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d92898700 1 -- 172.21.15.148:0/2901280839 shutdown_connections 2023-10-24T00:48:17.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d92898700 1 --2- 172.21.15.148:0/2901280839 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c0c66c0 0x7f4d8c0c1050 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.151+0000 7f4d92898700 1 --2- 172.21.15.148:0/2901280839 >> v2:172.21.15.150:3300/0 conn(0x7f4d8c152290 0x7f4d8c155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.152+0000 7f4d92898700 1 -- 172.21.15.148:0/2901280839 >> 172.21.15.148:0/2901280839 conn(0x7f4d8c0946c0 msgr2=0x7f4d8c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.152+0000 7f4d92898700 1 -- 172.21.15.148:0/2901280839 shutdown_connections 2023-10-24T00:48:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.152+0000 7f4d92898700 1 -- 172.21.15.148:0/2901280839 wait complete. 2023-10-24T00:48:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.153+0000 7f4d92898700 1 Processor -- start 2023-10-24T00:48:17.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.153+0000 7f4d92898700 1 -- start start 2023-10-24T00:48:17.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.153+0000 7f4d92898700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d8c0c6240 0x7f4d8c0a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0c66c0 0x7f4d8c164d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1651f0 con 0x7f4d8c152290 2023-10-24T00:48:17.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c154630 con 0x7f4d8c0c6240 2023-10-24T00:48:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c154910 con 0x7f4d8c0c66c0 2023-10-24T00:48:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37504/0 (socket says 172.21.15.148:37504) 2023-10-24T00:48:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 -- 172.21.15.148:0/2380378336 learned_addr learned my addr 172.21.15.148:0/2380378336 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d8bfff700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d8c0c6240 0x7f4d8c0a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d8b7fe700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0c66c0 0x7f4d8c164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 -- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0c66c0 msgr2=0x7f4d8c164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0c66c0 0x7f4d8c164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 -- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d8c0c6240 msgr2=0x7f4d8c0a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d8c0c6240 0x7f4d8c0a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:17.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 -- 172.21.15.148:0/2380378336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009a20 con 0x7f4d8c152290 2023-10-24T00:48:17.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d90e35700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f4d8c084550 tx=0x7f4d84009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:17.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8401d630 con 0x7f4d8c152290 2023-10-24T00:48:17.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c0aa1e0 con 0x7f4d8c152290 2023-10-24T00:48:17.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8401d790 con 0x7f4d8c152290 2023-10-24T00:48:17.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8401db30 con 0x7f4d8c152290 2023-10-24T00:48:17.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.154+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c0a8920 con 0x7f4d8c152290 2023-10-24T00:48:17.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.155+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c0aa040 con 0x7f4d8c152290 2023-10-24T00:48:17.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.156+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4d84003040 con 0x7f4d8c152290 2023-10-24T00:48:17.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.156+0000 7f4d73fff700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 0x7f4d78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:17.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.156+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f4d8407bde0 con 0x7f4d8c152290 2023-10-24T00:48:17.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.156+0000 7f4d8bfff700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 0x7f4d78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:17.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.157+0000 7f4d8bfff700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 0x7f4d78061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4d7c00abd0 tx=0x7f4d7c008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:17.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.160+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d8c0aa040 con 0x7f4d8c152290 2023-10-24T00:48:17.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:17.323+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4d8c0aa040 con 0x7f4d8c152290 2023-10-24T00:48:18.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.017+0000 7f4d73fff700 1 -- 172.21.15.148:0/2380378336 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4d8c0aa040 con 0x7f4d8c152290 2023-10-24T00:48:18.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 msgr2=0x7f4d78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 0x7f4d78061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f4d7c00abd0 tx=0x7f4d7c008040).stop 2023-10-24T00:48:18.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 msgr2=0x7f4d8c0a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f4d8c084550 tx=0x7f4d84009780).stop 2023-10-24T00:48:18.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 shutdown_connections 2023-10-24T00:48:18.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d7805f150 0x7f4d78061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d8c152290 0x7f4d8c0a8430 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d8c0c6240 0x7f4d8c0a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 --2- 172.21.15.148:0/2380378336 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d8c0c66c0 0x7f4d8c164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 >> 172.21.15.148:0/2380378336 conn(0x7f4d8c0946c0 msgr2=0x7f4d8c0c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 shutdown_connections 2023-10-24T00:48:18.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.021+0000 7f4d92898700 1 -- 172.21.15.148:0/2380378336 wait complete. 2023-10-24T00:48:18.030 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T00:48:18.048 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T00:48:18.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.162+0000 7f2d0e21e700 1 Processor -- start 2023-10-24T00:48:18.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.162+0000 7f2d0e21e700 1 -- start start 2023-10-24T00:48:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d0e21e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 0x7f2d08154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d0e21e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d08098bd0 0x7f2d080c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d0e21e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d080c71d0 con 0x7f2d080bffd0 2023-10-24T00:48:18.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d0e21e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080c9410 con 0x7f2d08098bd0 2023-10-24T00:48:18.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d0e21e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080c6c10 con 0x7f2d08154430 2023-10-24T00:48:18.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d08098bd0 0x7f2d080c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d08098bd0 0x7f2d080c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37508/0 (socket says 172.21.15.148:37508) 2023-10-24T00:48:18.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3143575903 learned_addr learned my addr 172.21.15.148:0/3143575903 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:18.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d077fe700 1 --2- 172.21.15.148:0/3143575903 >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 0x7f2d08154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3143575903 >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 msgr2=0x7f2d08154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 --2- 172.21.15.148:0/3143575903 >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 0x7f2d08154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3143575903 >> v1:172.21.15.150:6789/0 conn(0x7f2d080bffd0 legacy=0x7f2d080c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3143575903 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080c6ef0 con 0x7f2d08098bd0 2023-10-24T00:48:18.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.163+0000 7f2d077fe700 1 --2- 172.21.15.148:0/3143575903 >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 0x7f2d08154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:18.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d06ffd700 1 --2- 172.21.15.148:0/3143575903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d08098bd0 0x7f2d080c6300 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f2d0805ff70 tx=0x7f2cfc0090f0).ready entity=mon.0 client_cookie=44cd90a614720f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d067fc700 1 -- 172.21.15.148:0/3143575903 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00b600 con 0x7f2d08098bd0 2023-10-24T00:48:18.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d067fc700 1 -- 172.21.15.148:0/3143575903 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc00b760 con 0x7f2d08098bd0 2023-10-24T00:48:18.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d067fc700 1 -- 172.21.15.148:0/3143575903 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00bae0 con 0x7f2d08098bd0 2023-10-24T00:48:18.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3143575903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d08098bd0 msgr2=0x7f2d080c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3143575903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d08098bd0 0x7f2d080c6300 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f2d0805ff70 tx=0x7f2cfc0090f0).stop 2023-10-24T00:48:18.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3143575903 shutdown_connections 2023-10-24T00:48:18.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3143575903 >> v2:172.21.15.150:3300/0 conn(0x7f2d08154430 0x7f2d08154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3143575903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d08098bd0 0x7f2d080c6300 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3143575903 >> 172.21.15.148:0/3143575903 conn(0x7f2d080cb070 msgr2=0x7f2d080cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3143575903 shutdown_connections 2023-10-24T00:48:18.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.164+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3143575903 wait complete. 2023-10-24T00:48:18.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.165+0000 7f2d0e21e700 1 Processor -- start 2023-10-24T00:48:18.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 -- start start 2023-10-24T00:48:18.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d08098bd0 0x7f2d080b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d08154430 0x7f2d080ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080b0e40 con 0x7f2d080bffd0 2023-10-24T00:48:18.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080ad930 con 0x7f2d08154430 2023-10-24T00:48:18.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d0e21e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080acd20 con 0x7f2d08098bd0 2023-10-24T00:48:18.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d06ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37510/0 (socket says 172.21.15.148:37510) 2023-10-24T00:48:18.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3788250398 learned_addr learned my addr 172.21.15.148:0/3788250398 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:18.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d077fe700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d08098bd0 0x7f2d080b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.166+0000 7f2d07fff700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d08154430 0x7f2d080ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d08098bd0 msgr2=0x7f2d080b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d08098bd0 0x7f2d080b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d08154430 msgr2=0x7f2d080ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d08154430 0x7f2d080ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 -- 172.21.15.148:0/3788250398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009370 con 0x7f2d080bffd0 2023-10-24T00:48:18.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d06ffd700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f2cfc009fd0 tx=0x7f2cfc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00b8d0 con 0x7f2d080bffd0 2023-10-24T00:48:18.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc00ba30 con 0x7f2d080bffd0 2023-10-24T00:48:18.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d080ad000 con 0x7f2d080bffd0 2023-10-24T00:48:18.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc01b660 con 0x7f2d080bffd0 2023-10-24T00:48:18.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.167+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d080ad5c0 con 0x7f2d080bffd0 2023-10-24T00:48:18.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.168+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0806c6b0 con 0x7f2d080bffd0 2023-10-24T00:48:18.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.168+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2cfc01ba10 con 0x7f2d080bffd0 2023-10-24T00:48:18.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.169+0000 7f2cef7fe700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 0x7f2cf4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.169+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f2cfc07bb40 con 0x7f2d080bffd0 2023-10-24T00:48:18.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.169+0000 7f2d077fe700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 0x7f2cf4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.169+0000 7f2d077fe700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 0x7f2cf4061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2d080a8a30 tx=0x7f2cf8009930).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.173+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2cfc04cdb0 con 0x7f2d080bffd0 2023-10-24T00:48:18.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.377+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2d080989b0 con 0x7f2d080bffd0 2023-10-24T00:48:18.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.387+0000 7f2cef7fe700 1 -- 172.21.15.148:0/3788250398 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2cfc01f020 con 0x7f2d080bffd0 2023-10-24T00:48:18.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 msgr2=0x7f2cf4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 0x7f2cf4061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2d080a8a30 tx=0x7f2cf8009930).stop 2023-10-24T00:48:18.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 msgr2=0x7f2d08148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f2cfc009fd0 tx=0x7f2cfc017000).stop 2023-10-24T00:48:18.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 shutdown_connections 2023-10-24T00:48:18.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d08154430 0x7f2d080ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d08098bd0 0x7f2d080b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2cf405f150 0x7f2cf4061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 --2- 172.21.15.148:0/3788250398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d080bffd0 0x7f2d08148b80 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.393+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 >> 172.21.15.148:0/3788250398 conn(0x7f2d080cb070 msgr2=0x7f2d080c7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.395+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 shutdown_connections 2023-10-24T00:48:18.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.395+0000 7f2d0e21e700 1 -- 172.21.15.148:0/3788250398 wait complete. 2023-10-24T00:48:18.399 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 17 and data pool 18 2023-10-24T00:48:18.417 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.528+0000 7fca31d67700 1 Processor -- start 2023-10-24T00:48:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.528+0000 7fca31d67700 1 -- start start 2023-10-24T00:48:18.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca31d67700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fca2c150530 0x7fca2c0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca31d67700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca2c0bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca31d67700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0c30f0 con 0x7fca2c150910 2023-10-24T00:48:18.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca31d67700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0c3c90 con 0x7fca2c150530 2023-10-24T00:48:18.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca31d67700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c24e0 con 0x7fca2c0638c0 2023-10-24T00:48:18.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca2affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fca2c150910 0x7fca2c0c3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47446/0 (socket says 172.21.15.148:47446) 2023-10-24T00:48:18.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca2affd700 1 -- 172.21.15.148:0/3202180663 learned_addr learned my addr 172.21.15.148:0/3202180663 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:18.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca2c0bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.529+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/3202180663 >> v2:172.21.15.150:3300/0 conn(0x7fca2c150530 0x7fca2c0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419193910 0 0) 0x7fca2c0c30f0 con 0x7fca2c150910 2023-10-24T00:48:18.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca180033f0 con 0x7fca2c150910 2023-10-24T00:48:18.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619924517 0 0) 0x7fca180033f0 con 0x7fca2c150910 2023-10-24T00:48:18.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 msgr2=0x7fca2c0bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca2c0bcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 >> v2:172.21.15.150:3300/0 conn(0x7fca2c150530 msgr2=0x7fca2c0c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 --2- 172.21.15.148:0/3202180663 >> v2:172.21.15.150:3300/0 conn(0x7fca2c150530 0x7fca2c0c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0c27c0 con 0x7fca2c150910 2023-10-24T00:48:18.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fca14001470 con 0x7fca2c150910 2023-10-24T00:48:18.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca2c0bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:18.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 >> v1:172.21.15.148:6789/0 conn(0x7fca2c150910 legacy=0x7fca2c0c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180038e0 0x7fca18003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca18004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca18005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c3c90 con 0x7fca18004b80 2023-10-24T00:48:18.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c24e0 con 0x7fca180038e0 2023-10-24T00:48:18.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800b8e0 con 0x7fca2c0638c0 2023-10-24T00:48:18.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/3202180663 >> v2:172.21.15.150:3300/0 conn(0x7fca2c150530 0x7fca2c0c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:18.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca18005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2affd700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca18004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180038e0 0x7fca18003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 -- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 msgr2=0x7fca18004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c0638c0 0x7fca18004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 -- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180038e0 msgr2=0x7fca18003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180038e0 0x7fca18003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2bfff700 1 -- 172.21.15.148:0/3202180663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240092a0 con 0x7fca18004b80 2023-10-24T00:48:18.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.530+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca180038e0 0x7fca18003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:18.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca2bfff700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca18005000 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fca24009c70 tx=0x7fca24009060).ready entity=mon.0 client_cookie=5a80f7de281fe540 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240095c0 con 0x7fca18004b80 2023-10-24T00:48:18.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400e690 con 0x7fca18004b80 2023-10-24T00:48:18.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca2a7fc700 1 -- 172.21.15.148:0/3202180663 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400ea10 con 0x7fca18004b80 2023-10-24T00:48:18.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 -- 172.21.15.148:0/3202180663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 msgr2=0x7fca18005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 --2- 172.21.15.148:0/3202180663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca18005000 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fca24009c70 tx=0x7fca24009060).stop 2023-10-24T00:48:18.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca2bfff700 1 -- 172.21.15.148:0/3202180663 reap_dead start 2023-10-24T00:48:18.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 -- 172.21.15.148:0/3202180663 shutdown_connections 2023-10-24T00:48:18.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 -- 172.21.15.148:0/3202180663 >> 172.21.15.148:0/3202180663 conn(0x7fca2c0c7ee0 msgr2=0x7fca2c0c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 -- 172.21.15.148:0/3202180663 shutdown_connections 2023-10-24T00:48:18.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.531+0000 7fca31d67700 1 -- 172.21.15.148:0/3202180663 wait complete. 2023-10-24T00:48:18.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.532+0000 7fca31d67700 1 Processor -- start 2023-10-24T00:48:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 -- start start 2023-10-24T00:48:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c0c0b80 0x7fca2c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c1424b0 0x7fca2c0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c143270 con 0x7fca18004b80 2023-10-24T00:48:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c0810 con 0x7fca2c0c0b80 2023-10-24T00:48:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca31d67700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c142940 con 0x7fca2c1424b0 2023-10-24T00:48:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca2b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca2b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37528/0 (socket says 172.21.15.148:37528) 2023-10-24T00:48:18.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.533+0000 7fca2b7fe700 1 -- 172.21.15.148:0/603789881 learned_addr learned my addr 172.21.15.148:0/603789881 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2affd700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c0c0b80 0x7fca2c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2bfff700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c1424b0 0x7fca2c0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 -- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c1424b0 msgr2=0x7fca2c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c1424b0 0x7fca2c0ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 -- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c0c0b80 msgr2=0x7fca2c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c0c0b80 0x7fca2c141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 -- 172.21.15.148:0/603789881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c142c20 con 0x7fca18004b80 2023-10-24T00:48:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca2b7fe700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fca1c011550 tx=0x7fca1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00e030 con 0x7fca18004b80 2023-10-24T00:48:18.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c0153f0 con 0x7fca18004b80 2023-10-24T00:48:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c142f00 con 0x7fca18004b80 2023-10-24T00:48:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c015770 con 0x7fca18004b80 2023-10-24T00:48:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.534+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c0acac0 con 0x7fca18004b80 2023-10-24T00:48:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.535+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c143550 con 0x7fca18004b80 2023-10-24T00:48:18.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.535+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fca1c01f460 con 0x7fca18004b80 2023-10-24T00:48:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.536+0000 7fca237fe700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 0x7fca0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.536+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca1c00f070 con 0x7fca18004b80 2023-10-24T00:48:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.536+0000 7fca2affd700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 0x7fca0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.536+0000 7fca2affd700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 0x7fca0c061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fca2c14fe40 tx=0x7fca14001e90).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.540+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fca1c04c380 con 0x7fca18004b80 2023-10-24T00:48:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.703+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca2c06c6b0 con 0x7fca18004b80 2023-10-24T00:48:18.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.704+0000 7fca237fe700 1 -- 172.21.15.148:0/603789881 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+17004 (secure 0 0 0) 0x7fca1c04f9a0 con 0x7fca18004b80 2023-10-24T00:48:18.707 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:18.707 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":141,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:18.379529+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:18.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 msgr2=0x7fca0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 0x7fca0c061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fca2c14fe40 tx=0x7fca14001e90).stop 2023-10-24T00:48:18.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 msgr2=0x7fca2c0bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fca1c011550 tx=0x7fca1c00b040).stop 2023-10-24T00:48:18.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 shutdown_connections 2023-10-24T00:48:18.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca2c1424b0 0x7fca2c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca0c05f150 0x7fca0c061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca18004b80 0x7fca2c0bff10 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 --2- 172.21.15.148:0/603789881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca2c0c0b80 0x7fca2c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 >> 172.21.15.148:0/603789881 conn(0x7fca2c0c7ee0 msgr2=0x7fca2c062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 shutdown_connections 2023-10-24T00:48:18.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.706+0000 7fca31d67700 1 -- 172.21.15.148:0/603789881 wait complete. 2023-10-24T00:48:18.721 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:18.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.832+0000 7f5e5ed19700 1 Processor -- start 2023-10-24T00:48:18.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.832+0000 7f5e5ed19700 1 -- start start 2023-10-24T00:48:18.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5ed19700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e580aa010 0x7f5e580c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5ed19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e580aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5ed19700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580c0960 con 0x7f5e58158770 2023-10-24T00:48:18.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5ed19700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580aa8e0 con 0x7f5e580aa010 2023-10-24T00:48:18.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5ed19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c0c40 con 0x7f5e580c6710 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5cab5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e580aa010 0x7f5e580c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5d2b6700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5e58158770 0x7f5e58069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47452/0 (socket says 172.21.15.148:47452) 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5d2b6700 1 -- 172.21.15.148:0/542183407 learned_addr learned my addr 172.21.15.148:0/542183407 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e4ffff700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e580aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5cab5700 1 -- 172.21.15.148:0/542183407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 msgr2=0x7f5e580aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:18.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5cab5700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e580aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5cab5700 1 -- 172.21.15.148:0/542183407 >> v1:172.21.15.148:6789/0 conn(0x7f5e58158770 legacy=0x7f5e58069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e5cab5700 1 -- 172.21.15.148:0/542183407 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580c0f20 con 0x7f5e580aa010 2023-10-24T00:48:18.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.833+0000 7f5e4f7fe700 1 -- 172.21.15.148:0/542183407 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667314733 0 0) 0x7f5e580c0960 con 0x7f5e58158770 2023-10-24T00:48:18.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5cab5700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c1a00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f5e54009760 tx=0x7f5e54009060).ready entity=mon.0 client_cookie=7cbf6e3c84c09b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e4f7fe700 1 -- 172.21.15.148:0/542183407 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400b580 con 0x7f5e580aa010 2023-10-24T00:48:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e4f7fe700 1 -- 172.21.15.148:0/542183407 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400b6e0 con 0x7f5e580aa010 2023-10-24T00:48:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e4f7fe700 1 -- 172.21.15.148:0/542183407 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400ba60 con 0x7f5e580aa010 2023-10-24T00:48:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 -- 172.21.15.148:0/542183407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 msgr2=0x7f5e580c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c1a00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f5e54009760 tx=0x7f5e54009060).stop 2023-10-24T00:48:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 -- 172.21.15.148:0/542183407 shutdown_connections 2023-10-24T00:48:18.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c1a00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/542183407 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e580aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 -- 172.21.15.148:0/542183407 >> 172.21.15.148:0/542183407 conn(0x7f5e580caf40 msgr2=0x7f5e580cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:18.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 -- 172.21.15.148:0/542183407 shutdown_connections 2023-10-24T00:48:18.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.834+0000 7f5e5ed19700 1 -- 172.21.15.148:0/542183407 wait complete. 2023-10-24T00:48:18.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.835+0000 7f5e5ed19700 1 Processor -- start 2023-10-24T00:48:18.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 -- start start 2023-10-24T00:48:18.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e581650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e58158770 0x7f5e580c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c4110 con 0x7f5e580aa010 2023-10-24T00:48:18.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c3590 con 0x7f5e58158770 2023-10-24T00:48:18.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5ed19700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c3870 con 0x7f5e580c6710 2023-10-24T00:48:18.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5cab5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5cab5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37536/0 (socket says 172.21.15.148:37536) 2023-10-24T00:48:18.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.836+0000 7f5e5cab5700 1 -- 172.21.15.148:0/3486176193 learned_addr learned my addr 172.21.15.148:0/3486176193 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:18.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5d2b6700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e58158770 0x7f5e580c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e4ffff700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e581650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 -- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 msgr2=0x7f5e581650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e581650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 -- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e58158770 msgr2=0x7f5e580c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:18.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e58158770 0x7f5e580c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:18.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 -- 172.21.15.148:0/3486176193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540092a0 con 0x7f5e580aa010 2023-10-24T00:48:18.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5cab5700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f5e58084230 tx=0x7f5e54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5400b850 con 0x7f5e580aa010 2023-10-24T00:48:18.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400b9b0 con 0x7f5e580aa010 2023-10-24T00:48:18.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5401b660 con 0x7f5e580aa010 2023-10-24T00:48:18.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580c3b50 con 0x7f5e580aa010 2023-10-24T00:48:18.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.837+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e581655b0 con 0x7f5e580aa010 2023-10-24T00:48:18.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.838+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5806c6b0 con 0x7f5e580aa010 2023-10-24T00:48:18.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.838+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e5401ba90 con 0x7f5e580aa010 2023-10-24T00:48:18.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.839+0000 7f5e4cff9700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 0x7f5e44061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:18.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.839+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5e5407bcb0 con 0x7f5e580aa010 2023-10-24T00:48:18.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.839+0000 7f5e4ffff700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 0x7f5e44061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:18.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.839+0000 7f5e4ffff700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 0x7f5e44061640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5e580a9c50 tx=0x7f5e48008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:18.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:18.843+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e5404cf80 con 0x7f5e580aa010 2023-10-24T00:48:19.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.006+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e580c1200 con 0x7f5e580aa010 2023-10-24T00:48:19.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.007+0000 7f5e4cff9700 1 -- 172.21.15.148:0/3486176193 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+17004 (secure 0 0 0) 0x7f5e5401f020 con 0x7f5e580aa010 2023-10-24T00:48:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:19.010 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":141,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:18.379529+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:19.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 msgr2=0x7f5e44061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 0x7f5e44061640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5e580a9c50 tx=0x7f5e48008040).stop 2023-10-24T00:48:19.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 msgr2=0x7f5e580c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f5e58084230 tx=0x7f5e54017000).stop 2023-10-24T00:48:19.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 shutdown_connections 2023-10-24T00:48:19.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e58158770 0x7f5e580c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5e4405f180 0x7f5e44061640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e580aa010 0x7f5e580c2fb0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 --2- 172.21.15.148:0/3486176193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e580c6710 0x7f5e581650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 >> 172.21.15.148:0/3486176193 conn(0x7f5e580caf40 msgr2=0x7f5e58153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:19.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 shutdown_connections 2023-10-24T00:48:19.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.009+0000 7f5e5ed19700 1 -- 172.21.15.148:0/3486176193 wait complete. 2023-10-24T00:48:19.024 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T00:48:19.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.138+0000 7fdf34a0b700 1 Processor -- start 2023-10-24T00:48:19.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.138+0000 7fdf34a0b700 1 -- start start 2023-10-24T00:48:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.139+0000 7fdf34a0b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf30098bd0 0x7fdf30154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.139+0000 7fdf34a0b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf300bffd0 0x7fdf300c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.139+0000 7fdf34a0b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300c0970 con 0x7fdf30154430 2023-10-24T00:48:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.139+0000 7fdf34a0b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300c6a10 con 0x7fdf300bffd0 2023-10-24T00:48:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.139+0000 7fdf34a0b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300c71d0 con 0x7fdf30098bd0 2023-10-24T00:48:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf300bffd0 0x7fdf300c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf300bffd0 0x7fdf300c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37546/0 (socket says 172.21.15.148:37546) 2023-10-24T00:48:19.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 -- 172.21.15.148:0/3660662466 learned_addr learned my addr 172.21.15.148:0/3660662466 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:19.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2dd9b700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf30098bd0 0x7fdf30154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 -- 172.21.15.148:0/3660662466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf30098bd0 msgr2=0x7fdf30154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:19.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf30098bd0 0x7fdf30154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 -- 172.21.15.148:0/3660662466 >> v1:172.21.15.150:6789/0 conn(0x7fdf30154430 legacy=0x7fdf300c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:19.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 -- 172.21.15.148:0/3660662466 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300c9410 con 0x7fdf300bffd0 2023-10-24T00:48:19.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2ed9d700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf300bffd0 0x7fdf300c0480 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fdf28009830 tx=0x7fdf280090f0).ready entity=mon.0 client_cookie=3b09e541a12dcaf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2d59a700 1 -- 172.21.15.148:0/3660662466 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800b600 con 0x7fdf300bffd0 2023-10-24T00:48:19.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2d59a700 1 -- 172.21.15.148:0/3660662466 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800b760 con 0x7fdf300bffd0 2023-10-24T00:48:19.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.140+0000 7fdf2d59a700 1 -- 172.21.15.148:0/3660662466 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800bae0 con 0x7fdf300bffd0 2023-10-24T00:48:19.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 -- 172.21.15.148:0/3660662466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf300bffd0 msgr2=0x7fdf300c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf300bffd0 0x7fdf300c0480 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fdf28009830 tx=0x7fdf280090f0).stop 2023-10-24T00:48:19.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 -- 172.21.15.148:0/3660662466 shutdown_connections 2023-10-24T00:48:19.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf300bffd0 0x7fdf300c0480 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/3660662466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf30098bd0 0x7fdf30154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 -- 172.21.15.148:0/3660662466 >> 172.21.15.148:0/3660662466 conn(0x7fdf300cb070 msgr2=0x7fdf300cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:19.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 -- 172.21.15.148:0/3660662466 shutdown_connections 2023-10-24T00:48:19.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.141+0000 7fdf34a0b700 1 -- 172.21.15.148:0/3660662466 wait complete. 2023-10-24T00:48:19.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.142+0000 7fdf34a0b700 1 Processor -- start 2023-10-24T00:48:19.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.142+0000 7fdf34a0b700 1 -- start start 2023-10-24T00:48:19.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf300bffd0 0x7fdf30147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf30154430 0x7fdf30148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300b04a0 con 0x7fdf30098bd0 2023-10-24T00:48:19.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30148640 con 0x7fdf30154430 2023-10-24T00:48:19.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300c3730 con 0x7fdf300bffd0 2023-10-24T00:48:19.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37548/0 (socket says 172.21.15.148:37548) 2023-10-24T00:48:19.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 -- 172.21.15.148:0/52296144 learned_addr learned my addr 172.21.15.148:0/52296144 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:19.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2dd9b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf300bffd0 0x7fdf30147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2ed9d700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf30154430 0x7fdf30148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 -- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf300bffd0 msgr2=0x7fdf30147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf300bffd0 0x7fdf30147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 -- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf30154430 msgr2=0x7fdf30148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf30154430 0x7fdf30148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 -- 172.21.15.148:0/52296144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009370 con 0x7fdf30098bd0 2023-10-24T00:48:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf2e59c700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fdf2000c7c0 tx=0x7fdf200015c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20006a20 con 0x7fdf30098bd0 2023-10-24T00:48:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20006b80 con 0x7fdf30098bd0 2023-10-24T00:48:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300c3a10 con 0x7fdf30098bd0 2023-10-24T00:48:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20007020 con 0x7fdf30098bd0 2023-10-24T00:48:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.143+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf300c42b0 con 0x7fdf30098bd0 2023-10-24T00:48:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.144+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf300c44d0 con 0x7fdf30098bd0 2023-10-24T00:48:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.145+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdf20007390 con 0x7fdf30098bd0 2023-10-24T00:48:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.145+0000 7fdf267fc700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 0x7fdf10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.145+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf200795c0 con 0x7fdf30098bd0 2023-10-24T00:48:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.145+0000 7fdf2dd9b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 0x7fdf10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.145+0000 7fdf2dd9b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 0x7fdf10061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdf30099050 tx=0x7fdf18008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.149+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdf20047af0 con 0x7fdf30098bd0 2023-10-24T00:48:19.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.357+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf300c0970 con 0x7fdf30098bd0 2023-10-24T00:48:19.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.382+0000 7fdf267fc700 1 -- 172.21.15.148:0/52296144 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf300c0970 con 0x7fdf30098bd0 2023-10-24T00:48:19.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 msgr2=0x7fdf10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 0x7fdf10061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdf30099050 tx=0x7fdf18008040).stop 2023-10-24T00:48:19.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 msgr2=0x7fdf30163680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fdf2000c7c0 tx=0x7fdf200015c0).stop 2023-10-24T00:48:19.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 shutdown_connections 2023-10-24T00:48:19.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf30154430 0x7fdf30148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdf1005f150 0x7fdf10061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf30098bd0 0x7fdf30163680 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 --2- 172.21.15.148:0/52296144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf300bffd0 0x7fdf30147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 >> 172.21.15.148:0/52296144 conn(0x7fdf300cb070 msgr2=0x7fdf300a9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:19.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 shutdown_connections 2023-10-24T00:48:19.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.384+0000 7fdf34a0b700 1 -- 172.21.15.148:0/52296144 wait complete. 2023-10-24T00:48:19.400 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T00:48:19.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T00:48:19.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.514+0000 7f60346e0700 1 Processor -- start 2023-10-24T00:48:19.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.514+0000 7f60346e0700 1 -- start start 2023-10-24T00:48:19.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.515+0000 7f60346e0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602c064b30 0x7f602c064f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.515+0000 7f60346e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 0x7f602c068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.515+0000 7f60346e0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c069de0 con 0x7f602c154cf0 2023-10-24T00:48:19.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.515+0000 7f60346e0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c068fe0 con 0x7f602c064b30 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.515+0000 7f60346e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0691d0 con 0x7f602c06a270 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f602c064b30 0x7f602c064f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f6031c7b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 0x7f602c068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f6032c7d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f602c154cf0 0x7f602c150080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:58026/0 (socket says 172.21.15.148:58026) 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f6032c7d700 1 -- 172.21.15.148:0/1580360928 learned_addr learned my addr 172.21.15.148:0/1580360928 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:19.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603147a700 1 -- 172.21.15.148:0/1580360928 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324492450 0 0) 0x7f602c069de0 con 0x7f602c154cf0 2023-10-24T00:48:19.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603147a700 1 -- 172.21.15.148:0/1580360928 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60180033f0 con 0x7f602c154cf0 2023-10-24T00:48:19.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 -- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 msgr2=0x7f602c068af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:19.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 0x7f602c068af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 -- 172.21.15.148:0/1580360928 >> v1:172.21.15.150:6789/0 conn(0x7f602c154cf0 legacy=0x7f602c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 -- 172.21.15.148:0/1580360928 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0694b0 con 0x7f602c064b30 2023-10-24T00:48:19.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f6031c7b700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 0x7f602c068af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:19.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603247c700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c064f10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6028009760 tx=0x7f6028009060).ready entity=mon.1 client_cookie=e49ff615712ddf5d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603147a700 1 -- 172.21.15.148:0/1580360928 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800d4a0 con 0x7f602c064b30 2023-10-24T00:48:19.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603147a700 1 -- 172.21.15.148:0/1580360928 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800d600 con 0x7f602c064b30 2023-10-24T00:48:19.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.516+0000 7f603147a700 1 -- 172.21.15.148:0/1580360928 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800d980 con 0x7f602c064b30 2023-10-24T00:48:19.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 -- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 msgr2=0x7f602c064f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c064f10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6028009760 tx=0x7f6028009060).stop 2023-10-24T00:48:19.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 -- 172.21.15.148:0/1580360928 shutdown_connections 2023-10-24T00:48:19.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c064f10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 --2- 172.21.15.148:0/1580360928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c06a270 0x7f602c068af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 -- 172.21.15.148:0/1580360928 >> 172.21.15.148:0/1580360928 conn(0x7f602c0c6bf0 msgr2=0x7f602c0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:19.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 -- 172.21.15.148:0/1580360928 shutdown_connections 2023-10-24T00:48:19.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.517+0000 7f60346e0700 1 -- 172.21.15.148:0/1580360928 wait complete. 2023-10-24T00:48:19.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.518+0000 7f60346e0700 1 Processor -- start 2023-10-24T00:48:19.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.518+0000 7f60346e0700 1 -- start start 2023-10-24T00:48:19.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c160410 0x7f602c0a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c14bd30 con 0x7f602c154cf0 2023-10-24T00:48:19.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c163520 con 0x7f602c064b30 2023-10-24T00:48:19.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f60346e0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c163ae0 con 0x7f602c160410 2023-10-24T00:48:19.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37562/0 (socket says 172.21.15.148:37562) 2023-10-24T00:48:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 -- 172.21.15.148:0/4073012949 learned_addr learned my addr 172.21.15.148:0/4073012949 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f603247c700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6032c7d700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c160410 0x7f602c0a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 -- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c160410 msgr2=0x7f602c0a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c160410 0x7f602c0a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 -- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 msgr2=0x7f602c14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:19.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.519+0000 7f6031c7b700 1 -- 172.21.15.148:0/4073012949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c00a440 con 0x7f602c154cf0 2023-10-24T00:48:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f6031c7b700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f601c00fb60 tx=0x7f601c00a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00d960 con 0x7f602c154cf0 2023-10-24T00:48:19.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00dac0 con 0x7f602c154cf0 2023-10-24T00:48:19.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60280092a0 con 0x7f602c154cf0 2023-10-24T00:48:19.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00de40 con 0x7f602c154cf0 2023-10-24T00:48:19.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.520+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c160cf0 con 0x7f602c154cf0 2023-10-24T00:48:19.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.521+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c067f40 con 0x7f602c154cf0 2023-10-24T00:48:19.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.521+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f601c012670 con 0x7f602c154cf0 2023-10-24T00:48:19.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.521+0000 7f60227fc700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 0x7f6010061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:19.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.521+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f601c07b830 con 0x7f602c154cf0 2023-10-24T00:48:19.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.522+0000 7f603247c700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 0x7f6010061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:19.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.522+0000 7f603247c700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 0x7f6010061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f602800d260 tx=0x7f6028016000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:19.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.526+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f601c04cb00 con 0x7f602c154cf0 2023-10-24T00:48:19.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:19.732+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f602c06c6b0 con 0x7f602c154cf0 2023-10-24T00:48:20.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.391+0000 7f60227fc700 1 -- 172.21.15.148:0/4073012949 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f601c020020 con 0x7f602c154cf0 2023-10-24T00:48:20.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 msgr2=0x7f6010061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 0x7f6010061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f602800d260 tx=0x7f6028016000).stop 2023-10-24T00:48:20.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 msgr2=0x7f602c15ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f601c00fb60 tx=0x7f601c00a200).stop 2023-10-24T00:48:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 shutdown_connections 2023-10-24T00:48:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f602c160410 0x7f602c0a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f602c064b30 0x7f602c14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f601005f150 0x7f6010061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 --2- 172.21.15.148:0/4073012949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f602c154cf0 0x7f602c15ff20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 >> 172.21.15.148:0/4073012949 conn(0x7f602c0c6bf0 msgr2=0x7f602c0a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:20.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.393+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 shutdown_connections 2023-10-24T00:48:20.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.394+0000 7f60346e0700 1 -- 172.21.15.148:0/4073012949 wait complete. 2023-10-24T00:48:20.409 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T00:48:20.409 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.522+0000 7f6fb0544700 1 Processor -- start 2023-10-24T00:48:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.522+0000 7f6fb0544700 1 -- start start 2023-10-24T00:48:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fb0544700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6fa80c6710 0x7f6fa80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fb0544700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80aa820 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fb0544700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80c0960 con 0x7f6fa80aa010 2023-10-24T00:48:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fb0544700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa80c0c40 con 0x7f6fa80c6710 2023-10-24T00:48:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6faeae1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6fa80aa3f0 0x7f6fa8069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47456/0 (socket says 172.21.15.148:47456) 2023-10-24T00:48:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6faeae1700 1 -- 172.21.15.148:0/261712243 learned_addr learned my addr 172.21.15.148:0/261712243 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443365264 0 0) 0x7f6fa80aa820 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f940033f0 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fadadf700 1 --2- 172.21.15.148:0/261712243 >> v2:172.21.15.150:3300/0 conn(0x7f6fa80c6710 0x7f6fa80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934393617 0 0) 0x7f6f940033f0 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 >> v2:172.21.15.150:3300/0 conn(0x7f6fa80c6710 msgr2=0x7f6fa80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 --2- 172.21.15.148:0/261712243 >> v2:172.21.15.150:3300/0 conn(0x7f6fa80c6710 0x7f6fa80c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 >> v1:172.21.15.150:6789/0 conn(0x7f6fa80aa010 legacy=0x7f6fa8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.523+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80c0f20 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6fa00017f0 con 0x7f6fa80aa3f0 2023-10-24T00:48:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 >> v1:172.21.15.148:6789/0 conn(0x7f6fa80aa3f0 legacy=0x7f6fa8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94003930 0x7f6f94003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 0x7f6f94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f94005000 0x7f6f9400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80c0c40 con 0x7f6f94004690 2023-10-24T00:48:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400bfe0 con 0x7f6f94005000 2023-10-24T00:48:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400c1a0 con 0x7f6f94003930 2023-10-24T00:48:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 0x7f6f94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fae2e0700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94003930 0x7f6f94003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6faeae1700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f94005000 0x7f6f9400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 -- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94003930 msgr2=0x7f6f94003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94003930 0x7f6f94003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 -- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f94005000 msgr2=0x7f6f9400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f94005000 0x7f6f9400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 -- 172.21.15.148:0/261712243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940033f0 con 0x7f6f94004690 2023-10-24T00:48:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6faeae1700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f94005000 0x7f6f9400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6faeae1700 1 -- 172.21.15.148:0/261712243 reap_dead start 2023-10-24T00:48:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fadadf700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 0x7f6f94004b10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f6f98009a80 tx=0x7f6f98009060).ready entity=mon.0 client_cookie=afce04f23e180579 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98009430 con 0x7f6f94004690 2023-10-24T00:48:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800e640 con 0x7f6f94004690 2023-10-24T00:48:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.524+0000 7f6fad2de700 1 -- 172.21.15.148:0/261712243 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800e9c0 con 0x7f6f94004690 2023-10-24T00:48:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 -- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 msgr2=0x7f6f94004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 0x7f6f94004b10 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f6f98009a80 tx=0x7f6f98009060).stop 2023-10-24T00:48:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 -- 172.21.15.148:0/261712243 shutdown_connections 2023-10-24T00:48:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 --2- 172.21.15.148:0/261712243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f94004690 0x7f6f94004b10 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 -- 172.21.15.148:0/261712243 >> 172.21.15.148:0/261712243 conn(0x7f6fa80caf40 msgr2=0x7f6fa80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 -- 172.21.15.148:0/261712243 shutdown_connections 2023-10-24T00:48:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.525+0000 7f6fb0544700 1 -- 172.21.15.148:0/261712243 wait complete. 2023-10-24T00:48:20.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.526+0000 7f6fb0544700 1 Processor -- start 2023-10-24T00:48:20.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.526+0000 7f6fb0544700 1 -- start start 2023-10-24T00:48:20.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94004690 0x7f6fa80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fa80af8b0 0x7f6fa814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80b0c10 con 0x7f6fa8152df0 2023-10-24T00:48:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8153740 con 0x7f6fa80af8b0 2023-10-24T00:48:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80afd30 con 0x7f6f94004690 2023-10-24T00:48:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37578/0 (socket says 172.21.15.148:37578) 2023-10-24T00:48:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 -- 172.21.15.148:0/2444580734 learned_addr learned my addr 172.21.15.148:0/2444580734 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fadadf700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fa80af8b0 0x7f6fa814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fae2e0700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94004690 0x7f6fa80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 -- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94004690 msgr2=0x7f6fa80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94004690 0x7f6fa80aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 -- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fa80af8b0 msgr2=0x7f6fa814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fa80af8b0 0x7f6fa814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 -- 172.21.15.148:0/2444580734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80b0000 con 0x7f6fa8152df0 2023-10-24T00:48:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6faeae1700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f6fa80c54d0 tx=0x7f6fa0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00079e0 con 0x7f6fa8152df0 2023-10-24T00:48:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000e830 con 0x7f6fa8152df0 2023-10-24T00:48:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa80b02e0 con 0x7f6fa8152df0 2023-10-24T00:48:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000ebd0 con 0x7f6fa8152df0 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.527+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa80b08a0 con 0x7f6fa8152df0 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.529+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa80b0dc0 con 0x7f6fa8152df0 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.529+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6fa0014430 con 0x7f6fa8152df0 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.529+0000 7f6f9e7fc700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 0x7f6f8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.529+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6fa007a070 con 0x7f6fa8152df0 2023-10-24T00:48:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.529+0000 7f6fae2e0700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 0x7f6f8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.530+0000 7f6fae2e0700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 0x7f6f8c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6fa4000c00 tx=0x7f6fa4009040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.533+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6fa0049af0 con 0x7f6fa8152df0 2023-10-24T00:48:20.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.736+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fa8155d10 con 0x7f6fa8152df0 2023-10-24T00:48:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.737+0000 7f6f9e7fc700 1 -- 172.21.15.148:0/2444580734 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f6fa80b0dc0 con 0x7f6fa8152df0 2023-10-24T00:48:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:20.740 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T00:48:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 msgr2=0x7f6f8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 0x7f6f8c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6fa4000c00 tx=0x7f6fa4009040).stop 2023-10-24T00:48:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 msgr2=0x7f6fa8153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f6fa80c54d0 tx=0x7f6fa0007ef0).stop 2023-10-24T00:48:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 shutdown_connections 2023-10-24T00:48:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6f8c05f150 0x7f6f8c061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fa8152df0 0x7f6fa8153250 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6f94004690 0x7f6fa80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 --2- 172.21.15.148:0/2444580734 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6fa80af8b0 0x7f6fa814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.738+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 >> 172.21.15.148:0/2444580734 conn(0x7f6fa80caf40 msgr2=0x7f6fa80ac5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.739+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 shutdown_connections 2023-10-24T00:48:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.739+0000 7f6fb0544700 1 -- 172.21.15.148:0/2444580734 wait complete. 2023-10-24T00:48:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T00:48:20.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T00:48:20.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.864+0000 7f0b3d209700 1 Processor -- start 2023-10-24T00:48:20.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.864+0000 7f0b3d209700 1 -- start start 2023-10-24T00:48:20.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b3d209700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0b380aa010 0x7f0b380c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b3d209700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380aa820 con 0x7f0b380c6710 2023-10-24T00:48:20.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b3d209700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380c0960 con 0x7f0b380aa3f0 2023-10-24T00:48:20.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b3d209700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380c0c40 con 0x7f0b380aa010 2023-10-24T00:48:20.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b36d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0b380aa010 0x7f0b380c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b2e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0b380c6710 0x7f0b38158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47468/0 (socket says 172.21.15.148:47468) 2023-10-24T00:48:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b2e59c700 1 -- 172.21.15.148:0/3542469641 learned_addr learned my addr 172.21.15.148:0/3542469641 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b36d9d700 1 -- 172.21.15.148:0/3542469641 >> v1:172.21.15.150:6789/0 conn(0x7f0b380aa3f0 legacy=0x7f0b38069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b36d9d700 1 -- 172.21.15.148:0/3542469641 >> v1:172.21.15.148:6789/0 conn(0x7f0b380c6710 legacy=0x7f0b38158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b3659c700 1 -- 172.21.15.148:0/3542469641 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567260974 0 0) 0x7f0b380aa820 con 0x7f0b380c6710 2023-10-24T00:48:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.865+0000 7f0b36d9d700 1 -- 172.21.15.148:0/3542469641 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380c0f20 con 0x7f0b380aa010 2023-10-24T00:48:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b36d9d700 1 --2- 172.21.15.148:0/3542469641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa010 0x7f0b380c1a00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0b28009760 tx=0x7f0b28009060).ready entity=mon.0 client_cookie=4410df404f22a8c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3659c700 1 -- 172.21.15.148:0/3542469641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800b520 con 0x7f0b380aa010 2023-10-24T00:48:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3659c700 1 -- 172.21.15.148:0/3542469641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2800b680 con 0x7f0b380aa010 2023-10-24T00:48:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3659c700 1 -- 172.21.15.148:0/3542469641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800ba00 con 0x7f0b380aa010 2023-10-24T00:48:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 -- 172.21.15.148:0/3542469641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa010 msgr2=0x7f0b380c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 --2- 172.21.15.148:0/3542469641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa010 0x7f0b380c1a00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f0b28009760 tx=0x7f0b28009060).stop 2023-10-24T00:48:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 -- 172.21.15.148:0/3542469641 shutdown_connections 2023-10-24T00:48:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 --2- 172.21.15.148:0/3542469641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa010 0x7f0b380c1a00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 -- 172.21.15.148:0/3542469641 >> 172.21.15.148:0/3542469641 conn(0x7f0b380caf40 msgr2=0x7f0b380cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 -- 172.21.15.148:0/3542469641 shutdown_connections 2023-10-24T00:48:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.866+0000 7f0b3d209700 1 -- 172.21.15.148:0/3542469641 wait complete. 2023-10-24T00:48:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.867+0000 7f0b3d209700 1 Processor -- start 2023-10-24T00:48:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.867+0000 7f0b3d209700 1 -- start start 2023-10-24T00:48:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 0x7f0b380b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b380c6710 0x7f0b381534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380b04d0 con 0x7f0b380aa3f0 2023-10-24T00:48:20.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380af8c0 con 0x7f0b380aa010 2023-10-24T00:48:20.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3d209700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380afba0 con 0x7f0b380c6710 2023-10-24T00:48:20.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b2e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b2e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37606/0 (socket says 172.21.15.148:37606) 2023-10-24T00:48:20.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b2e59c700 1 -- 172.21.15.148:0/2453006461 learned_addr learned my addr 172.21.15.148:0/2453006461 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:20.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b36d9d700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 0x7f0b380b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.868+0000 7f0b3759e700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b380c6710 0x7f0b381534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 -- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b380c6710 msgr2=0x7f0b381534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b380c6710 0x7f0b381534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 -- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 msgr2=0x7f0b380b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 0x7f0b380b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 -- 172.21.15.148:0/2453006461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b280092a0 con 0x7f0b380aa3f0 2023-10-24T00:48:20.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b36d9d700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 0x7f0b380b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2e59c700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f0b20001eb0 tx=0x7f0b20007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200072e0 con 0x7f0b380aa3f0 2023-10-24T00:48:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20007440 con 0x7f0b380aa3f0 2023-10-24T00:48:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380afe80 con 0x7f0b380aa3f0 2023-10-24T00:48:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200057a0 con 0x7f0b380aa3f0 2023-10-24T00:48:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.869+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b380b0e50 con 0x7f0b380aa3f0 2023-10-24T00:48:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.870+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b380b0680 con 0x7f0b380aa3f0 2023-10-24T00:48:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.870+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0b20005b90 con 0x7f0b380aa3f0 2023-10-24T00:48:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.870+0000 7f0b2f7fe700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 0x7f0b180615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.871+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b20079960 con 0x7f0b380aa3f0 2023-10-24T00:48:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.871+0000 7f0b36d9d700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 0x7f0b180615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.871+0000 7f0b36d9d700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 0x7f0b180615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0b2800b2e0 tx=0x7f0b28017000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:20.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:20.875+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0b380b0680 con 0x7f0b380aa3f0 2023-10-24T00:48:21.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.038+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b3806c6b0 con 0x7f0b380aa3f0 2023-10-24T00:48:21.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.039+0000 7f0b2f7fe700 1 -- 172.21.15.148:0/2453006461 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f0b2004ac30 con 0x7f0b380aa3f0 2023-10-24T00:48:21.042 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:21.042 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":142,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T00:48:19.381471+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T00:48:21.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.040+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 msgr2=0x7f0b180615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 0x7f0b180615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0b2800b2e0 tx=0x7f0b28017000).stop 2023-10-24T00:48:21.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 msgr2=0x7f0b38151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f0b20001eb0 tx=0x7f0b20007e90).stop 2023-10-24T00:48:21.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 shutdown_connections 2023-10-24T00:48:21.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b380c6710 0x7f0b381534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b380aa010 0x7f0b380b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b1805f120 0x7f0b180615e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 --2- 172.21.15.148:0/2453006461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b380aa3f0 0x7f0b38151b10 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 >> 172.21.15.148:0/2453006461 conn(0x7f0b380caf40 msgr2=0x7f0b381529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 shutdown_connections 2023-10-24T00:48:21.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.041+0000 7f0b3d209700 1 -- 172.21.15.148:0/2453006461 wait complete. 2023-10-24T00:48:21.056 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T00:48:21.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:48:21.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.168+0000 7f2bb7fae700 1 Processor -- start 2023-10-24T00:48:21.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.168+0000 7f2bb7fae700 1 -- start start 2023-10-24T00:48:21.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb7fae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00aa010 0x7f2bb00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb7fae700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2bb00c6710 0x7f2bb00aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb7fae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb00c0960 con 0x7f2bb0158770 2023-10-24T00:48:21.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb7fae700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb00aa8e0 con 0x7f2bb00c6710 2023-10-24T00:48:21.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb7fae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c0c40 con 0x7f2bb00aa010 2023-10-24T00:48:21.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb5549700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2bb00c6710 0x7f2bb00aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb5549700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2bb00c6710 0x7f2bb00aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37620/0 (socket says 172.21.15.148:37620) 2023-10-24T00:48:21.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb5549700 1 -- 172.21.15.148:0/1790699443 learned_addr learned my addr 172.21.15.148:0/1790699443 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:21.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.169+0000 7f2bb5d4a700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00aa010 0x7f2bb00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb5549700 1 -- 172.21.15.148:0/1790699443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00aa010 msgr2=0x7f2bb00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb5549700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00aa010 0x7f2bb00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb5549700 1 -- 172.21.15.148:0/1790699443 >> v1:172.21.15.150:6789/0 conn(0x7f2bb0158770 legacy=0x7f2bb0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb5549700 1 -- 172.21.15.148:0/1790699443 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00c0f20 con 0x7f2bb00c6710 2023-10-24T00:48:21.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb5549700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb00c6710 0x7f2bb00aa3f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f2ba0006fd0 tx=0x7f2ba00090f0).ready entity=mon.0 client_cookie=844ba87075129544 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb4d48700 1 -- 172.21.15.148:0/1790699443 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000b600 con 0x7f2bb00c6710 2023-10-24T00:48:21.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb4d48700 1 -- 172.21.15.148:0/1790699443 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000b760 con 0x7f2bb00c6710 2023-10-24T00:48:21.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb4d48700 1 -- 172.21.15.148:0/1790699443 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000bae0 con 0x7f2bb00c6710 2023-10-24T00:48:21.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 -- 172.21.15.148:0/1790699443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb00c6710 msgr2=0x7f2bb00aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb00c6710 0x7f2bb00aa3f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f2ba0006fd0 tx=0x7f2ba00090f0).stop 2023-10-24T00:48:21.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 -- 172.21.15.148:0/1790699443 shutdown_connections 2023-10-24T00:48:21.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00aa010 0x7f2bb00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/1790699443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb00c6710 0x7f2bb00aa3f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 -- 172.21.15.148:0/1790699443 >> 172.21.15.148:0/1790699443 conn(0x7f2bb00caf40 msgr2=0x7f2bb00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 -- 172.21.15.148:0/1790699443 shutdown_connections 2023-10-24T00:48:21.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.170+0000 7f2bb7fae700 1 -- 172.21.15.148:0/1790699443 wait complete. 2023-10-24T00:48:21.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.171+0000 7f2bb7fae700 1 Processor -- start 2023-10-24T00:48:21.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 -- start start 2023-10-24T00:48:21.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb00aa010 0x7f2bb01652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00c6710 0x7f2bb00c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c2a80 con 0x7f2bb0158770 2023-10-24T00:48:21.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c2d60 con 0x7f2bb00aa010 2023-10-24T00:48:21.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb7fae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb00c3040 con 0x7f2bb00c6710 2023-10-24T00:48:21.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb654b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb654b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37632/0 (socket says 172.21.15.148:37632) 2023-10-24T00:48:21.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb654b700 1 -- 172.21.15.148:0/8605038 learned_addr learned my addr 172.21.15.148:0/8605038 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:21.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.172+0000 7f2bb5d4a700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb00aa010 0x7f2bb01652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb5549700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00c6710 0x7f2bb00c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 -- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00c6710 msgr2=0x7f2bb00c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00c6710 0x7f2bb00c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 -- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb00aa010 msgr2=0x7f2bb01652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb00aa010 0x7f2bb01652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 -- 172.21.15.148:0/8605038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009370 con 0x7f2bb0158770 2023-10-24T00:48:21.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb654b700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f2ba800c440 tx=0x7f2ba8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80123f0 con 0x7f2bb0158770 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8012550 con 0x7f2bb0158770 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb00c3320 con 0x7f2bb0158770 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80128d0 con 0x7f2bb0158770 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.173+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb0164c80 con 0x7f2bb0158770 2023-10-24T00:48:21.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.174+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb006c6b0 con 0x7f2bb0158770 2023-10-24T00:48:21.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.175+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2ba8012cc0 con 0x7f2bb0158770 2023-10-24T00:48:21.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.175+0000 7f2ba5ffb700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 0x7f2b94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.175+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2ba80795a0 con 0x7f2bb0158770 2023-10-24T00:48:21.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.175+0000 7f2bb5d4a700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 0x7f2b94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.176+0000 7f2bb5d4a700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 0x7f2b94061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2bac009fd0 tx=0x7f2bac009880).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.179+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ba8047af0 con 0x7f2bb0158770 2023-10-24T00:48:21.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.336+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bb00c1200 con 0x7f2b9405f150 2023-10-24T00:48:21.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.348+0000 7f2ba5ffb700 1 -- 172.21.15.148:0/8605038 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358739 (secure 0 0 0) 0x7f2bb00c1200 con 0x7f2b9405f150 2023-10-24T00:48:21.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 msgr2=0x7f2b94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 0x7f2b94061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2bac009fd0 tx=0x7f2bac009880).stop 2023-10-24T00:48:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 msgr2=0x7f2bb00c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f2ba800c440 tx=0x7f2ba8007dd0).stop 2023-10-24T00:48:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 shutdown_connections 2023-10-24T00:48:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2b9405f150 0x7f2b94061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.350+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2bb0158770 0x7f2bb00c24d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.351+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2bb00aa010 0x7f2bb01652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.351+0000 7f2bb7fae700 1 --2- 172.21.15.148:0/8605038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2bb00c6710 0x7f2bb00c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.351+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 >> 172.21.15.148:0/8605038 conn(0x7f2bb00caf40 msgr2=0x7f2bb00c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.351+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 shutdown_connections 2023-10-24T00:48:21.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.351+0000 7f2bb7fae700 1 -- 172.21.15.148:0/8605038 wait complete. 2023-10-24T00:48:21.361 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:48:21.365 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T00:48:21.244016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423012,"kb_used_data":13476,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551708,"statfs":{"total":773094113280,"available":770612948992,"internally_reserved":0,"allocated":13799424,"data_stored":6940365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20022,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-70,"num_write_kb":-46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999602"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023996+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041844+0000","last_change":"2023-10-24T00:48:18.041844+0000","last_active":"2023-10-24T00:48:18.041844+0000","last_peered":"2023-10-24T00:48:18.041844+0000","last_clean":"2023-10-24T00:48:18.041844+0000","last_became_active":"2023-10-24T00:48:18.041589+0000","last_became_peered":"2023-10-24T00:48:18.041589+0000","last_unstale":"2023-10-24T00:48:18.041844+0000","last_undegraded":"2023-10-24T00:48:18.041844+0000","last_fullsized":"2023-10-24T00:48:18.041844+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027068+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.030820+0000","last_change":"2023-10-24T00:48:18.030820+0000","last_active":"2023-10-24T00:48:18.030820+0000","last_peered":"2023-10-24T00:48:18.030820+0000","last_clean":"2023-10-24T00:48:18.030820+0000","last_became_active":"2023-10-24T00:48:18.030482+0000","last_became_peered":"2023-10-24T00:48:18.030482+0000","last_unstale":"2023-10-24T00:48:18.030820+0000","last_undegraded":"2023-10-24T00:48:18.030820+0000","last_fullsized":"2023-10-24T00:48:18.030820+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035546+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039392+0000","last_change":"2023-10-24T00:48:18.039392+0000","last_active":"2023-10-24T00:48:18.039392+0000","last_peered":"2023-10-24T00:48:18.039392+0000","last_clean":"2023-10-24T00:48:18.039392+0000","last_became_active":"2023-10-24T00:48:18.039118+0000","last_became_peered":"2023-10-24T00:48:18.039118+0000","last_unstale":"2023-10-24T00:48:18.039392+0000","last_undegraded":"2023-10-24T00:48:18.039392+0000","last_fullsized":"2023-10-24T00:48:18.039392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024705+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040907+0000","last_change":"2023-10-24T00:48:18.040907+0000","last_active":"2023-10-24T00:48:18.040907+0000","last_peered":"2023-10-24T00:48:18.040907+0000","last_clean":"2023-10-24T00:48:18.040907+0000","last_became_active":"2023-10-24T00:48:18.038648+0000","last_became_peered":"2023-10-24T00:48:18.038648+0000","last_unstale":"2023-10-24T00:48:18.040907+0000","last_undegraded":"2023-10-24T00:48:18.040907+0000","last_fullsized":"2023-10-24T00:48:18.040907+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.036571+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042252+0000","last_change":"2023-10-24T00:48:18.042252+0000","last_active":"2023-10-24T00:48:18.042252+0000","last_peered":"2023-10-24T00:48:18.042252+0000","last_clean":"2023-10-24T00:48:18.042252+0000","last_became_active":"2023-10-24T00:48:18.041992+0000","last_became_peered":"2023-10-24T00:48:18.041992+0000","last_unstale":"2023-10-24T00:48:18.042252+0000","last_undegraded":"2023-10-24T00:48:18.042252+0000","last_fullsized":"2023-10-24T00:48:18.042252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030656+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045400+0000","last_change":"2023-10-24T00:48:18.045400+0000","last_active":"2023-10-24T00:48:18.045400+0000","last_peered":"2023-10-24T00:48:18.045400+0000","last_clean":"2023-10-24T00:48:18.045400+0000","last_became_active":"2023-10-24T00:48:18.045129+0000","last_became_peered":"2023-10-24T00:48:18.045129+0000","last_unstale":"2023-10-24T00:48:18.045400+0000","last_undegraded":"2023-10-24T00:48:18.045400+0000","last_fullsized":"2023-10-24T00:48:18.045400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027408+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043011+0000","last_change":"2023-10-24T00:48:18.043011+0000","last_active":"2023-10-24T00:48:18.043011+0000","last_peered":"2023-10-24T00:48:18.043011+0000","last_clean":"2023-10-24T00:48:18.043011+0000","last_became_active":"2023-10-24T00:48:18.042525+0000","last_became_peered":"2023-10-24T00:48:18.042525+0000","last_unstale":"2023-10-24T00:48:18.043011+0000","last_undegraded":"2023-10-24T00:48:18.043011+0000","last_fullsized":"2023-10-24T00:48:18.043011+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027413+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.032792+0000","last_change":"2023-10-24T00:48:18.032792+0000","last_active":"2023-10-24T00:48:18.032792+0000","last_peered":"2023-10-24T00:48:18.032792+0000","last_clean":"2023-10-24T00:48:18.032792+0000","last_became_active":"2023-10-24T00:48:18.032439+0000","last_became_peered":"2023-10-24T00:48:18.032439+0000","last_unstale":"2023-10-24T00:48:18.032792+0000","last_undegraded":"2023-10-24T00:48:18.032792+0000","last_fullsized":"2023-10-24T00:48:18.032792+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027200+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044386+0000","last_change":"2023-10-24T00:48:18.044386+0000","last_active":"2023-10-24T00:48:18.044386+0000","last_peered":"2023-10-24T00:48:18.044386+0000","last_clean":"2023-10-24T00:48:18.044386+0000","last_became_active":"2023-10-24T00:48:18.044107+0000","last_became_peered":"2023-10-24T00:48:18.044107+0000","last_unstale":"2023-10-24T00:48:18.044386+0000","last_undegraded":"2023-10-24T00:48:18.044386+0000","last_fullsized":"2023-10-24T00:48:18.044386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026459+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048765+0000","last_change":"2023-10-24T00:48:18.048765+0000","last_active":"2023-10-24T00:48:18.048765+0000","last_peered":"2023-10-24T00:48:18.048765+0000","last_clean":"2023-10-24T00:48:18.048765+0000","last_became_active":"2023-10-24T00:48:18.048505+0000","last_became_peered":"2023-10-24T00:48:18.048505+0000","last_unstale":"2023-10-24T00:48:18.048765+0000","last_undegraded":"2023-10-24T00:48:18.048765+0000","last_fullsized":"2023-10-24T00:48:18.048765+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021924+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044999+0000","last_change":"2023-10-24T00:48:18.044999+0000","last_active":"2023-10-24T00:48:18.044999+0000","last_peered":"2023-10-24T00:48:18.044999+0000","last_clean":"2023-10-24T00:48:18.044999+0000","last_became_active":"2023-10-24T00:48:18.044678+0000","last_became_peered":"2023-10-24T00:48:18.044678+0000","last_unstale":"2023-10-24T00:48:18.044999+0000","last_undegraded":"2023-10-24T00:48:18.044999+0000","last_fullsized":"2023-10-24T00:48:18.044999+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025598+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048832+0000","last_change":"2023-10-24T00:48:18.048832+0000","last_active":"2023-10-24T00:48:18.048832+0000","last_peered":"2023-10-24T00:48:18.048832+0000","last_clean":"2023-10-24T00:48:18.048832+0000","last_became_active":"2023-10-24T00:48:18.048558+0000","last_became_peered":"2023-10-24T00:48:18.048558+0000","last_unstale":"2023-10-24T00:48:18.048832+0000","last_undegraded":"2023-10-24T00:48:18.048832+0000","last_fullsized":"2023-10-24T00:48:18.048832+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032346+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036392+0000","last_change":"2023-10-24T00:48:18.036392+0000","last_active":"2023-10-24T00:48:18.036392+0000","last_peered":"2023-10-24T00:48:18.036392+0000","last_clean":"2023-10-24T00:48:18.036392+0000","last_became_active":"2023-10-24T00:48:18.035885+0000","last_became_peered":"2023-10-24T00:48:18.035885+0000","last_unstale":"2023-10-24T00:48:18.036392+0000","last_undegraded":"2023-10-24T00:48:18.036392+0000","last_fullsized":"2023-10-24T00:48:18.036392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041432+0000","last_change":"2023-10-24T00:48:18.041432+0000","last_active":"2023-10-24T00:48:18.041432+0000","last_peered":"2023-10-24T00:48:18.041432+0000","last_clean":"2023-10-24T00:48:18.041432+0000","last_became_active":"2023-10-24T00:48:18.041156+0000","last_became_peered":"2023-10-24T00:48:18.041156+0000","last_unstale":"2023-10-24T00:48:18.041432+0000","last_undegraded":"2023-10-24T00:48:18.041432+0000","last_fullsized":"2023-10-24T00:48:18.041432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.037009+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045461+0000","last_change":"2023-10-24T00:48:18.045461+0000","last_active":"2023-10-24T00:48:18.045461+0000","last_peered":"2023-10-24T00:48:18.045461+0000","last_clean":"2023-10-24T00:48:18.045461+0000","last_became_active":"2023-10-24T00:48:18.045197+0000","last_became_peered":"2023-10-24T00:48:18.045197+0000","last_unstale":"2023-10-24T00:48:18.045461+0000","last_undegraded":"2023-10-24T00:48:18.045461+0000","last_fullsized":"2023-10-24T00:48:18.045461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.022057+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042527+0000","last_change":"2023-10-24T00:48:18.042527+0000","last_active":"2023-10-24T00:48:18.042527+0000","last_peered":"2023-10-24T00:48:18.042527+0000","last_clean":"2023-10-24T00:48:18.042527+0000","last_became_active":"2023-10-24T00:48:18.042217+0000","last_became_peered":"2023-10-24T00:48:18.042217+0000","last_unstale":"2023-10-24T00:48:18.042527+0000","last_undegraded":"2023-10-24T00:48:18.042527+0000","last_fullsized":"2023-10-24T00:48:18.042527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024549+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043145+0000","last_change":"2023-10-24T00:48:18.043145+0000","last_active":"2023-10-24T00:48:18.043145+0000","last_peered":"2023-10-24T00:48:18.043145+0000","last_clean":"2023-10-24T00:48:18.043145+0000","last_became_active":"2023-10-24T00:48:18.042714+0000","last_became_peered":"2023-10-24T00:48:18.042714+0000","last_unstale":"2023-10-24T00:48:18.043145+0000","last_undegraded":"2023-10-24T00:48:18.043145+0000","last_fullsized":"2023-10-24T00:48:18.043145+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.033056+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044605+0000","last_change":"2023-10-24T00:48:18.044605+0000","last_active":"2023-10-24T00:48:18.044605+0000","last_peered":"2023-10-24T00:48:18.044605+0000","last_clean":"2023-10-24T00:48:18.044605+0000","last_became_active":"2023-10-24T00:48:18.044344+0000","last_became_peered":"2023-10-24T00:48:18.044344+0000","last_unstale":"2023-10-24T00:48:18.044605+0000","last_undegraded":"2023-10-24T00:48:18.044605+0000","last_fullsized":"2023-10-24T00:48:18.044605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035160+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045569+0000","last_change":"2023-10-24T00:48:18.045569+0000","last_active":"2023-10-24T00:48:18.045569+0000","last_peered":"2023-10-24T00:48:18.045569+0000","last_clean":"2023-10-24T00:48:18.045569+0000","last_became_active":"2023-10-24T00:48:18.045238+0000","last_became_peered":"2023-10-24T00:48:18.045238+0000","last_unstale":"2023-10-24T00:48:18.045569+0000","last_undegraded":"2023-10-24T00:48:18.045569+0000","last_fullsized":"2023-10-24T00:48:18.045569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037574+0000","last_change":"2023-10-24T00:48:18.037574+0000","last_active":"2023-10-24T00:48:18.037574+0000","last_peered":"2023-10-24T00:48:18.037574+0000","last_clean":"2023-10-24T00:48:18.037574+0000","last_became_active":"2023-10-24T00:48:18.037198+0000","last_became_peered":"2023-10-24T00:48:18.037198+0000","last_unstale":"2023-10-24T00:48:18.037574+0000","last_undegraded":"2023-10-24T00:48:18.037574+0000","last_fullsized":"2023-10-24T00:48:18.037574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039664+0000","last_change":"2023-10-24T00:48:18.039664+0000","last_active":"2023-10-24T00:48:18.039664+0000","last_peered":"2023-10-24T00:48:18.039664+0000","last_clean":"2023-10-24T00:48:18.039664+0000","last_became_active":"2023-10-24T00:48:18.039386+0000","last_became_peered":"2023-10-24T00:48:18.039386+0000","last_unstale":"2023-10-24T00:48:18.039664+0000","last_undegraded":"2023-10-24T00:48:18.039664+0000","last_fullsized":"2023-10-24T00:48:18.039664+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024967+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046440+0000","last_change":"2023-10-24T00:48:18.046440+0000","last_active":"2023-10-24T00:48:18.046440+0000","last_peered":"2023-10-24T00:48:18.046440+0000","last_clean":"2023-10-24T00:48:18.046440+0000","last_became_active":"2023-10-24T00:48:18.046183+0000","last_became_peered":"2023-10-24T00:48:18.046183+0000","last_unstale":"2023-10-24T00:48:18.046440+0000","last_undegraded":"2023-10-24T00:48:18.046440+0000","last_fullsized":"2023-10-24T00:48:18.046440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025410+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036065+0000","last_change":"2023-10-24T00:48:18.036065+0000","last_active":"2023-10-24T00:48:18.036065+0000","last_peered":"2023-10-24T00:48:18.036065+0000","last_clean":"2023-10-24T00:48:18.036065+0000","last_became_active":"2023-10-24T00:48:18.035802+0000","last_became_peered":"2023-10-24T00:48:18.035802+0000","last_unstale":"2023-10-24T00:48:18.036065+0000","last_undegraded":"2023-10-24T00:48:18.036065+0000","last_fullsized":"2023-10-24T00:48:18.036065+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026827+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045033+0000","last_change":"2023-10-24T00:48:18.045033+0000","last_active":"2023-10-24T00:48:18.045033+0000","last_peered":"2023-10-24T00:48:18.045033+0000","last_clean":"2023-10-24T00:48:18.045033+0000","last_became_active":"2023-10-24T00:48:18.044768+0000","last_became_peered":"2023-10-24T00:48:18.044768+0000","last_unstale":"2023-10-24T00:48:18.045033+0000","last_undegraded":"2023-10-24T00:48:18.045033+0000","last_fullsized":"2023-10-24T00:48:18.045033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027881+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044606+0000","last_change":"2023-10-24T00:48:18.044606+0000","last_active":"2023-10-24T00:48:18.044606+0000","last_peered":"2023-10-24T00:48:18.044606+0000","last_clean":"2023-10-24T00:48:18.044606+0000","last_became_active":"2023-10-24T00:48:18.044308+0000","last_became_peered":"2023-10-24T00:48:18.044308+0000","last_unstale":"2023-10-24T00:48:18.044606+0000","last_undegraded":"2023-10-24T00:48:18.044606+0000","last_fullsized":"2023-10-24T00:48:18.044606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032260+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037373+0000","last_change":"2023-10-24T00:48:18.037373+0000","last_active":"2023-10-24T00:48:18.037373+0000","last_peered":"2023-10-24T00:48:18.037373+0000","last_clean":"2023-10-24T00:48:18.037373+0000","last_became_active":"2023-10-24T00:48:18.037110+0000","last_became_peered":"2023-10-24T00:48:18.037110+0000","last_unstale":"2023-10-24T00:48:18.037373+0000","last_undegraded":"2023-10-24T00:48:18.037373+0000","last_fullsized":"2023-10-24T00:48:18.037373+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024906+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036294+0000","last_change":"2023-10-24T00:48:18.036294+0000","last_active":"2023-10-24T00:48:18.036294+0000","last_peered":"2023-10-24T00:48:18.036294+0000","last_clean":"2023-10-24T00:48:18.036294+0000","last_became_active":"2023-10-24T00:48:18.036007+0000","last_became_peered":"2023-10-24T00:48:18.036007+0000","last_unstale":"2023-10-24T00:48:18.036294+0000","last_undegraded":"2023-10-24T00:48:18.036294+0000","last_fullsized":"2023-10-24T00:48:18.036294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028545+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042339+0000","last_change":"2023-10-24T00:48:18.042339+0000","last_active":"2023-10-24T00:48:18.042339+0000","last_peered":"2023-10-24T00:48:18.042339+0000","last_clean":"2023-10-24T00:48:18.042339+0000","last_became_active":"2023-10-24T00:48:18.042104+0000","last_became_peered":"2023-10-24T00:48:18.042104+0000","last_unstale":"2023-10-24T00:48:18.042339+0000","last_undegraded":"2023-10-24T00:48:18.042339+0000","last_fullsized":"2023-10-24T00:48:18.042339+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026821+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039118+0000","last_change":"2023-10-24T00:48:18.039118+0000","last_active":"2023-10-24T00:48:18.039118+0000","last_peered":"2023-10-24T00:48:18.039118+0000","last_clean":"2023-10-24T00:48:18.039118+0000","last_became_active":"2023-10-24T00:48:18.037254+0000","last_became_peered":"2023-10-24T00:48:18.037254+0000","last_unstale":"2023-10-24T00:48:18.039118+0000","last_undegraded":"2023-10-24T00:48:18.039118+0000","last_fullsized":"2023-10-24T00:48:18.039118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028509+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044312+0000","last_change":"2023-10-24T00:48:18.044312+0000","last_active":"2023-10-24T00:48:18.044312+0000","last_peered":"2023-10-24T00:48:18.044312+0000","last_clean":"2023-10-24T00:48:18.044312+0000","last_became_active":"2023-10-24T00:48:18.044028+0000","last_became_peered":"2023-10-24T00:48:18.044028+0000","last_unstale":"2023-10-24T00:48:18.044312+0000","last_undegraded":"2023-10-24T00:48:18.044312+0000","last_fullsized":"2023-10-24T00:48:18.044312+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031588+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037085+0000","last_change":"2023-10-24T00:48:18.037085+0000","last_active":"2023-10-24T00:48:18.037085+0000","last_peered":"2023-10-24T00:48:18.037085+0000","last_clean":"2023-10-24T00:48:18.037085+0000","last_became_active":"2023-10-24T00:48:18.036799+0000","last_became_peered":"2023-10-24T00:48:18.036799+0000","last_unstale":"2023-10-24T00:48:18.037085+0000","last_undegraded":"2023-10-24T00:48:18.037085+0000","last_fullsized":"2023-10-24T00:48:18.037085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025344+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046236+0000","last_change":"2023-10-24T00:48:18.046236+0000","last_active":"2023-10-24T00:48:18.046236+0000","last_peered":"2023-10-24T00:48:18.046236+0000","last_clean":"2023-10-24T00:48:18.046236+0000","last_became_active":"2023-10-24T00:48:18.045972+0000","last_became_peered":"2023-10-24T00:48:18.045972+0000","last_unstale":"2023-10-24T00:48:18.046236+0000","last_undegraded":"2023-10-24T00:48:18.046236+0000","last_fullsized":"2023-10-24T00:48:18.046236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021489+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041889+0000","last_change":"2023-10-24T00:48:18.041889+0000","last_active":"2023-10-24T00:48:18.041889+0000","last_peered":"2023-10-24T00:48:18.041889+0000","last_clean":"2023-10-24T00:48:18.041889+0000","last_became_active":"2023-10-24T00:48:18.041453+0000","last_became_peered":"2023-10-24T00:48:18.041453+0000","last_unstale":"2023-10-24T00:48:18.041889+0000","last_undegraded":"2023-10-24T00:48:18.041889+0000","last_fullsized":"2023-10-24T00:48:18.041889+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025407+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.028828+0000","last_change":"2023-10-24T00:48:18.028828+0000","last_active":"2023-10-24T00:48:18.028828+0000","last_peered":"2023-10-24T00:48:18.028828+0000","last_clean":"2023-10-24T00:48:18.028828+0000","last_became_active":"2023-10-24T00:48:18.028538+0000","last_became_peered":"2023-10-24T00:48:18.028538+0000","last_unstale":"2023-10-24T00:48:18.028828+0000","last_undegraded":"2023-10-24T00:48:18.028828+0000","last_fullsized":"2023-10-24T00:48:18.028828+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028610+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036207+0000","last_change":"2023-10-24T00:48:18.036207+0000","last_active":"2023-10-24T00:48:18.036207+0000","last_peered":"2023-10-24T00:48:18.036207+0000","last_clean":"2023-10-24T00:48:18.036207+0000","last_became_active":"2023-10-24T00:48:18.035820+0000","last_became_peered":"2023-10-24T00:48:18.035820+0000","last_unstale":"2023-10-24T00:48:18.036207+0000","last_undegraded":"2023-10-24T00:48:18.036207+0000","last_fullsized":"2023-10-24T00:48:18.036207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025206+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044718+0000","last_change":"2023-10-24T00:48:18.044718+0000","last_active":"2023-10-24T00:48:18.044718+0000","last_peered":"2023-10-24T00:48:18.044718+0000","last_clean":"2023-10-24T00:48:18.044718+0000","last_became_active":"2023-10-24T00:48:18.044354+0000","last_became_peered":"2023-10-24T00:48:18.044354+0000","last_unstale":"2023-10-24T00:48:18.044718+0000","last_undegraded":"2023-10-24T00:48:18.044718+0000","last_fullsized":"2023-10-24T00:48:18.044718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020925+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044944+0000","last_change":"2023-10-24T00:48:18.044944+0000","last_active":"2023-10-24T00:48:18.044944+0000","last_peered":"2023-10-24T00:48:18.044944+0000","last_clean":"2023-10-24T00:48:18.044944+0000","last_became_active":"2023-10-24T00:48:18.044562+0000","last_became_peered":"2023-10-24T00:48:18.044562+0000","last_unstale":"2023-10-24T00:48:18.044944+0000","last_undegraded":"2023-10-24T00:48:18.044944+0000","last_fullsized":"2023-10-24T00:48:18.044944+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023998+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044302+0000","last_change":"2023-10-24T00:48:18.044302+0000","last_active":"2023-10-24T00:48:18.044302+0000","last_peered":"2023-10-24T00:48:18.044302+0000","last_clean":"2023-10-24T00:48:18.044302+0000","last_became_active":"2023-10-24T00:48:18.044039+0000","last_became_peered":"2023-10-24T00:48:18.044039+0000","last_unstale":"2023-10-24T00:48:18.044302+0000","last_undegraded":"2023-10-24T00:48:18.044302+0000","last_fullsized":"2023-10-24T00:48:18.044302+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030326+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042819+0000","last_change":"2023-10-24T00:48:18.042819+0000","last_active":"2023-10-24T00:48:18.042819+0000","last_peered":"2023-10-24T00:48:18.042819+0000","last_clean":"2023-10-24T00:48:18.042819+0000","last_became_active":"2023-10-24T00:48:18.042239+0000","last_became_peered":"2023-10-24T00:48:18.042239+0000","last_unstale":"2023-10-24T00:48:18.042819+0000","last_undegraded":"2023-10-24T00:48:18.042819+0000","last_fullsized":"2023-10-24T00:48:18.042819+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021457+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038256+0000","last_change":"2023-10-24T00:48:18.038256+0000","last_active":"2023-10-24T00:48:18.038256+0000","last_peered":"2023-10-24T00:48:18.038256+0000","last_clean":"2023-10-24T00:48:18.038256+0000","last_became_active":"2023-10-24T00:48:18.037986+0000","last_became_peered":"2023-10-24T00:48:18.037986+0000","last_unstale":"2023-10-24T00:48:18.038256+0000","last_undegraded":"2023-10-24T00:48:18.038256+0000","last_fullsized":"2023-10-24T00:48:18.038256+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024950+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034708+0000","last_change":"2023-10-24T00:48:18.034708+0000","last_active":"2023-10-24T00:48:18.034708+0000","last_peered":"2023-10-24T00:48:18.034708+0000","last_clean":"2023-10-24T00:48:18.034708+0000","last_became_active":"2023-10-24T00:48:18.034432+0000","last_became_peered":"2023-10-24T00:48:18.034432+0000","last_unstale":"2023-10-24T00:48:18.034708+0000","last_undegraded":"2023-10-24T00:48:18.034708+0000","last_fullsized":"2023-10-24T00:48:18.034708+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026010+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034651+0000","last_change":"2023-10-24T00:48:18.034651+0000","last_active":"2023-10-24T00:48:18.034651+0000","last_peered":"2023-10-24T00:48:18.034651+0000","last_clean":"2023-10-24T00:48:18.034651+0000","last_became_active":"2023-10-24T00:48:18.034361+0000","last_became_peered":"2023-10-24T00:48:18.034361+0000","last_unstale":"2023-10-24T00:48:18.034651+0000","last_undegraded":"2023-10-24T00:48:18.034651+0000","last_fullsized":"2023-10-24T00:48:18.034651+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028433+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038205+0000","last_change":"2023-10-24T00:48:18.038205+0000","last_active":"2023-10-24T00:48:18.038205+0000","last_peered":"2023-10-24T00:48:18.038205+0000","last_clean":"2023-10-24T00:48:18.038205+0000","last_became_active":"2023-10-24T00:48:18.037941+0000","last_became_peered":"2023-10-24T00:48:18.037941+0000","last_unstale":"2023-10-24T00:48:18.038205+0000","last_undegraded":"2023-10-24T00:48:18.038205+0000","last_fullsized":"2023-10-24T00:48:18.038205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025819+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037758+0000","last_change":"2023-10-24T00:48:18.037758+0000","last_active":"2023-10-24T00:48:18.037758+0000","last_peered":"2023-10-24T00:48:18.037758+0000","last_clean":"2023-10-24T00:48:18.037758+0000","last_became_active":"2023-10-24T00:48:18.037479+0000","last_became_peered":"2023-10-24T00:48:18.037479+0000","last_unstale":"2023-10-24T00:48:18.037758+0000","last_undegraded":"2023-10-24T00:48:18.037758+0000","last_fullsized":"2023-10-24T00:48:18.037758+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042438+0000","last_change":"2023-10-24T00:48:18.042438+0000","last_active":"2023-10-24T00:48:18.042438+0000","last_peered":"2023-10-24T00:48:18.042438+0000","last_clean":"2023-10-24T00:48:18.042438+0000","last_became_active":"2023-10-24T00:48:18.042158+0000","last_became_peered":"2023-10-24T00:48:18.042158+0000","last_unstale":"2023-10-24T00:48:18.042438+0000","last_undegraded":"2023-10-24T00:48:18.042438+0000","last_fullsized":"2023-10-24T00:48:18.042438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035675+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039929+0000","last_change":"2023-10-24T00:48:18.039929+0000","last_active":"2023-10-24T00:48:18.039929+0000","last_peered":"2023-10-24T00:48:18.039929+0000","last_clean":"2023-10-24T00:48:18.039929+0000","last_became_active":"2023-10-24T00:48:18.039663+0000","last_became_peered":"2023-10-24T00:48:18.039663+0000","last_unstale":"2023-10-24T00:48:18.039929+0000","last_undegraded":"2023-10-24T00:48:18.039929+0000","last_fullsized":"2023-10-24T00:48:18.039929+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031216+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041939+0000","last_change":"2023-10-24T00:48:18.041939+0000","last_active":"2023-10-24T00:48:18.041939+0000","last_peered":"2023-10-24T00:48:18.041939+0000","last_clean":"2023-10-24T00:48:18.041939+0000","last_became_active":"2023-10-24T00:48:18.041656+0000","last_became_peered":"2023-10-24T00:48:18.041656+0000","last_unstale":"2023-10-24T00:48:18.041939+0000","last_undegraded":"2023-10-24T00:48:18.041939+0000","last_fullsized":"2023-10-24T00:48:18.041939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028088+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.033645+0000","last_change":"2023-10-24T00:48:18.033645+0000","last_active":"2023-10-24T00:48:18.033645+0000","last_peered":"2023-10-24T00:48:18.033645+0000","last_clean":"2023-10-24T00:48:18.033645+0000","last_became_active":"2023-10-24T00:48:18.033340+0000","last_became_peered":"2023-10-24T00:48:18.033340+0000","last_unstale":"2023-10-24T00:48:18.033645+0000","last_undegraded":"2023-10-24T00:48:18.033645+0000","last_fullsized":"2023-10-24T00:48:18.033645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028611+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038704+0000","last_change":"2023-10-24T00:48:18.038704+0000","last_active":"2023-10-24T00:48:18.038704+0000","last_peered":"2023-10-24T00:48:18.038704+0000","last_clean":"2023-10-24T00:48:18.038704+0000","last_became_active":"2023-10-24T00:48:18.038444+0000","last_became_peered":"2023-10-24T00:48:18.038444+0000","last_unstale":"2023-10-24T00:48:18.038704+0000","last_undegraded":"2023-10-24T00:48:18.038704+0000","last_fullsized":"2023-10-24T00:48:18.038704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020858+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043878+0000","last_change":"2023-10-24T00:48:18.043878+0000","last_active":"2023-10-24T00:48:18.043878+0000","last_peered":"2023-10-24T00:48:18.043878+0000","last_clean":"2023-10-24T00:48:18.043878+0000","last_became_active":"2023-10-24T00:48:18.043592+0000","last_became_peered":"2023-10-24T00:48:18.043592+0000","last_unstale":"2023-10-24T00:48:18.043878+0000","last_undegraded":"2023-10-24T00:48:18.043878+0000","last_fullsized":"2023-10-24T00:48:18.043878+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024515+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042080+0000","last_change":"2023-10-24T00:48:18.042080+0000","last_active":"2023-10-24T00:48:18.042080+0000","last_peered":"2023-10-24T00:48:18.042080+0000","last_clean":"2023-10-24T00:48:18.042080+0000","last_became_active":"2023-10-24T00:48:18.040827+0000","last_became_peered":"2023-10-24T00:48:18.040827+0000","last_unstale":"2023-10-24T00:48:18.042080+0000","last_undegraded":"2023-10-24T00:48:18.042080+0000","last_fullsized":"2023-10-24T00:48:18.042080+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025043+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039363+0000","last_change":"2023-10-24T00:48:18.039363+0000","last_active":"2023-10-24T00:48:18.039363+0000","last_peered":"2023-10-24T00:48:18.039363+0000","last_clean":"2023-10-24T00:48:18.039363+0000","last_became_active":"2023-10-24T00:48:18.038320+0000","last_became_peered":"2023-10-24T00:48:18.038320+0000","last_unstale":"2023-10-24T00:48:18.039363+0000","last_undegraded":"2023-10-24T00:48:18.039363+0000","last_fullsized":"2023-10-24T00:48:18.039363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024620+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036842+0000","last_change":"2023-10-24T00:48:18.036842+0000","last_active":"2023-10-24T00:48:18.036842+0000","last_peered":"2023-10-24T00:48:18.036842+0000","last_clean":"2023-10-24T00:48:18.036842+0000","last_became_active":"2023-10-24T00:48:18.035634+0000","last_became_peered":"2023-10-24T00:48:18.035634+0000","last_unstale":"2023-10-24T00:48:18.036842+0000","last_undegraded":"2023-10-24T00:48:18.036842+0000","last_fullsized":"2023-10-24T00:48:18.036842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035307+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038277+0000","last_change":"2023-10-24T00:48:18.038277+0000","last_active":"2023-10-24T00:48:18.038277+0000","last_peered":"2023-10-24T00:48:18.038277+0000","last_clean":"2023-10-24T00:48:18.038277+0000","last_became_active":"2023-10-24T00:48:18.037812+0000","last_became_peered":"2023-10-24T00:48:18.037812+0000","last_unstale":"2023-10-24T00:48:18.038277+0000","last_undegraded":"2023-10-24T00:48:18.038277+0000","last_fullsized":"2023-10-24T00:48:18.038277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025964+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038024+0000","last_change":"2023-10-24T00:48:18.038024+0000","last_active":"2023-10-24T00:48:18.038024+0000","last_peered":"2023-10-24T00:48:18.038024+0000","last_clean":"2023-10-24T00:48:18.038024+0000","last_became_active":"2023-10-24T00:48:18.037740+0000","last_became_peered":"2023-10-24T00:48:18.037740+0000","last_unstale":"2023-10-24T00:48:18.038024+0000","last_undegraded":"2023-10-24T00:48:18.038024+0000","last_fullsized":"2023-10-24T00:48:18.038024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020902+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044227+0000","last_change":"2023-10-24T00:48:18.044227+0000","last_active":"2023-10-24T00:48:18.044227+0000","last_peered":"2023-10-24T00:48:18.044227+0000","last_clean":"2023-10-24T00:48:18.044227+0000","last_became_active":"2023-10-24T00:48:18.043885+0000","last_became_peered":"2023-10-24T00:48:18.043885+0000","last_unstale":"2023-10-24T00:48:18.044227+0000","last_undegraded":"2023-10-24T00:48:18.044227+0000","last_fullsized":"2023-10-24T00:48:18.044227+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031800+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041439+0000","last_change":"2023-10-24T00:48:18.041439+0000","last_active":"2023-10-24T00:48:18.041439+0000","last_peered":"2023-10-24T00:48:18.041439+0000","last_clean":"2023-10-24T00:48:18.041439+0000","last_became_active":"2023-10-24T00:48:18.041068+0000","last_became_peered":"2023-10-24T00:48:18.041068+0000","last_unstale":"2023-10-24T00:48:18.041439+0000","last_undegraded":"2023-10-24T00:48:18.041439+0000","last_fullsized":"2023-10-24T00:48:18.041439+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023794+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:48:17.023794+0000","last_peered":"2023-10-24T00:48:17.023794+0000","last_clean":"2023-10-24T00:48:17.023794+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:48:17.023794+0000","last_undegraded":"2023-10-24T00:48:17.023794+0000","last_fullsized":"2023-10-24T00:48:17.023794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024627+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.047097+0000","last_change":"2023-10-24T00:48:18.047097+0000","last_active":"2023-10-24T00:48:18.047097+0000","last_peered":"2023-10-24T00:48:18.047097+0000","last_clean":"2023-10-24T00:48:18.047097+0000","last_became_active":"2023-10-24T00:48:18.046725+0000","last_became_peered":"2023-10-24T00:48:18.046725+0000","last_unstale":"2023-10-24T00:48:18.047097+0000","last_undegraded":"2023-10-24T00:48:18.047097+0000","last_fullsized":"2023-10-24T00:48:18.047097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013593+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:48:17.013593+0000","last_peered":"2023-10-24T00:48:17.013593+0000","last_clean":"2023-10-24T00:48:17.013593+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:48:17.013593+0000","last_undegraded":"2023-10-24T00:48:17.013593+0000","last_fullsized":"2023-10-24T00:48:17.013593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021006+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040254+0000","last_change":"2023-10-24T00:48:18.040254+0000","last_active":"2023-10-24T00:48:18.040254+0000","last_peered":"2023-10-24T00:48:18.040254+0000","last_clean":"2023-10-24T00:48:18.040254+0000","last_became_active":"2023-10-24T00:48:18.039228+0000","last_became_peered":"2023-10-24T00:48:18.039228+0000","last_unstale":"2023-10-24T00:48:18.040254+0000","last_undegraded":"2023-10-24T00:48:18.040254+0000","last_fullsized":"2023-10-24T00:48:18.040254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.017969+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:48:17.017969+0000","last_peered":"2023-10-24T00:48:17.017969+0000","last_clean":"2023-10-24T00:48:17.017969+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:48:17.017969+0000","last_undegraded":"2023-10-24T00:48:17.017969+0000","last_fullsized":"2023-10-24T00:48:17.017969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026411+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045000+0000","last_change":"2023-10-24T00:48:18.045000+0000","last_active":"2023-10-24T00:48:18.045000+0000","last_peered":"2023-10-24T00:48:18.045000+0000","last_clean":"2023-10-24T00:48:18.045000+0000","last_became_active":"2023-10-24T00:48:18.044728+0000","last_became_peered":"2023-10-24T00:48:18.044728+0000","last_unstale":"2023-10-24T00:48:18.045000+0000","last_undegraded":"2023-10-24T00:48:18.045000+0000","last_fullsized":"2023-10-24T00:48:18.045000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013828+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:48:17.013828+0000","last_peered":"2023-10-24T00:48:17.013828+0000","last_clean":"2023-10-24T00:48:17.013828+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:48:17.013828+0000","last_undegraded":"2023-10-24T00:48:17.013828+0000","last_fullsized":"2023-10-24T00:48:17.013828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015663+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:48:17.015663+0000","last_peered":"2023-10-24T00:48:17.015663+0000","last_clean":"2023-10-24T00:48:17.015663+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:48:17.015663+0000","last_undegraded":"2023-10-24T00:48:17.015663+0000","last_fullsized":"2023-10-24T00:48:17.015663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035409+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045594+0000","last_change":"2023-10-24T00:48:18.045594+0000","last_active":"2023-10-24T00:48:18.045594+0000","last_peered":"2023-10-24T00:48:18.045594+0000","last_clean":"2023-10-24T00:48:18.045594+0000","last_became_active":"2023-10-24T00:48:18.045329+0000","last_became_peered":"2023-10-24T00:48:18.045329+0000","last_unstale":"2023-10-24T00:48:18.045594+0000","last_undegraded":"2023-10-24T00:48:18.045594+0000","last_fullsized":"2023-10-24T00:48:18.045594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015755+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:48:17.015755+0000","last_peered":"2023-10-24T00:48:17.015755+0000","last_clean":"2023-10-24T00:48:17.015755+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:48:17.015755+0000","last_undegraded":"2023-10-24T00:48:17.015755+0000","last_fullsized":"2023-10-24T00:48:17.015755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025941+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045608+0000","last_change":"2023-10-24T00:48:18.045608+0000","last_active":"2023-10-24T00:48:18.045608+0000","last_peered":"2023-10-24T00:48:18.045608+0000","last_clean":"2023-10-24T00:48:18.045608+0000","last_became_active":"2023-10-24T00:48:18.045257+0000","last_became_peered":"2023-10-24T00:48:18.045257+0000","last_unstale":"2023-10-24T00:48:18.045608+0000","last_undegraded":"2023-10-24T00:48:18.045608+0000","last_fullsized":"2023-10-24T00:48:18.045608+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016864+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:48:17.016864+0000","last_peered":"2023-10-24T00:48:17.016864+0000","last_clean":"2023-10-24T00:48:17.016864+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:48:17.016864+0000","last_undegraded":"2023-10-24T00:48:17.016864+0000","last_fullsized":"2023-10-24T00:48:17.016864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027129+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038309+0000","last_change":"2023-10-24T00:48:18.038309+0000","last_active":"2023-10-24T00:48:18.038309+0000","last_peered":"2023-10-24T00:48:18.038309+0000","last_clean":"2023-10-24T00:48:18.038309+0000","last_became_active":"2023-10-24T00:48:18.037990+0000","last_became_peered":"2023-10-24T00:48:18.037990+0000","last_unstale":"2023-10-24T00:48:18.038309+0000","last_undegraded":"2023-10-24T00:48:18.038309+0000","last_fullsized":"2023-10-24T00:48:18.038309+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023810+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:48:17.023810+0000","last_peered":"2023-10-24T00:48:17.023810+0000","last_clean":"2023-10-24T00:48:17.023810+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:48:17.023810+0000","last_undegraded":"2023-10-24T00:48:17.023810+0000","last_fullsized":"2023-10-24T00:48:17.023810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026180+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044172+0000","last_change":"2023-10-24T00:48:18.044172+0000","last_active":"2023-10-24T00:48:18.044172+0000","last_peered":"2023-10-24T00:48:18.044172+0000","last_clean":"2023-10-24T00:48:18.044172+0000","last_became_active":"2023-10-24T00:48:18.043858+0000","last_became_peered":"2023-10-24T00:48:18.043858+0000","last_unstale":"2023-10-24T00:48:18.044172+0000","last_undegraded":"2023-10-24T00:48:18.044172+0000","last_fullsized":"2023-10-24T00:48:18.044172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016971+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:48:17.016971+0000","last_peered":"2023-10-24T00:48:17.016971+0000","last_clean":"2023-10-24T00:48:17.016971+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:48:17.016971+0000","last_undegraded":"2023-10-24T00:48:17.016971+0000","last_fullsized":"2023-10-24T00:48:17.016971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542376,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.59899999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.444,"5min":5.444,"15min":5.444},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.34899999999999998},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.372,"5min":0.27400000000000002,"15min":0.246},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":4.0759999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":4.351},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":1.4239999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.70899999999999996,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":11.211,"5min":11.211,"15min":11.211},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.69599999999999995,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.116,"5min":11.116,"15min":11.116},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.217},"max":{"1min":0.68700000000000006,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.83799999999999997,"15min":1.3839999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":1.573},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.81299999999999994,"15min":7.7969999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.88,"15min":1.5029999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.53200000000000003,"15min":0.59299999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":14.597},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.85899999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47299999999999998,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83399999999999996,"15min":7.8559999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":0.80800000000000005,"15min":1.4530000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77500000000000002,"5min":0.82699999999999996,"15min":0.84599999999999997},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.56799999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":7.8929999999999998},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":1.5029999999999999},"last":0.31},{"interface":"front","average":{"1min":0.379,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":3.2519999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.25,"15min":0.25},"max":{"1min":0.55400000000000005,"5min":0.66500000000000004,"15min":1.1890000000000001},"last":0.248}]},{"osd":3,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.43099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":3.2269999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":1.1659999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":1.143},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.89100000000000001,"15min":3.1190000000000002},"last":0.498}]},{"osd":6,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":0.91700000000000004,"15min":3.2010000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.90500000000000003,"15min":1.109},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.628},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.42099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575081,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":0.41399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.215},"max":{"1min":0.504,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.48799999999999999,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.26100000000000001,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.622,"15min":0.67100000000000004},"last":0.378}]},{"osd":4,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.91500000000000004},"last":0.55700000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.876},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.82399999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.35999999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.57199999999999995},"last":0.439},{"interface":"front","average":{"1min":0.37,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.52400000000000002,"5min":0.63,"15min":0.65500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.60099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.747}]},{"osd":5,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.63800000000000001},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":1.083,"15min":1.083},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51000000000000001,"5min":0.59299999999999997,"15min":0.90400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56799999999999995,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.373},"min":{"1min":0.27700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.68799999999999994,"15min":0.79900000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.67600000000000005,"15min":0.86599999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71099999999999997,"5min":0.91900000000000004,"15min":1.024},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":1.0269999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.36399999999999999},"max":{"1min":0.89500000000000002,"5min":0.93999999999999995,"15min":0.995},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":0.996,"15min":1.042},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.121},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.68200000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.74299999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.80700000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.88},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.249},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.627,"5min":0.748,"15min":1.1479999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.23899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0209999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.25800000000000001},"max":{"1min":0.64100000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.26400000000000001},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":1.339},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63400000000000001,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.76400000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.421},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":1.772},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:48:21.373 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:48:21.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.516+0000 7fcaeab70700 1 Processor -- start 2023-10-24T00:48:21.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.516+0000 7fcaeab70700 1 -- start start 2023-10-24T00:48:21.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaeab70700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcae40aa140 0x7fcae40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaeab70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcae40c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaeab70700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae40c6410 con 0x7fcae40c0cd0 2023-10-24T00:48:21.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaeab70700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae40c1140 con 0x7fcae40aa140 2023-10-24T00:48:21.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaeab70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40ca6e0 con 0x7fcae40ca110 2023-10-24T00:48:21.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaea36f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcae40c0cd0 0x7fcae4157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47470/0 (socket says 172.21.15.148:47470) 2023-10-24T00:48:21.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.517+0000 7fcaea36f700 1 -- 172.21.15.148:0/3965180800 learned_addr learned my addr 172.21.15.148:0/3965180800 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:21.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae936d700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcae40c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> v2:172.21.15.150:3300/0 conn(0x7fcae40aa140 0x7fcae40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293100063 0 0) 0x7fcae40c6410 con 0x7fcae40c0cd0 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad00033f0 con 0x7fcae40c0cd0 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2745627843 0 0) 0x7fcad00033f0 con 0x7fcae40c0cd0 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 msgr2=0x7fcae40c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcae40c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 >> v2:172.21.15.150:3300/0 conn(0x7fcae40aa140 msgr2=0x7fcae40c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 --2- 172.21.15.148:0/3965180800 >> v2:172.21.15.150:3300/0 conn(0x7fcae40aa140 0x7fcae40c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40ca9c0 con 0x7fcae40c0cd0 2023-10-24T00:48:21.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fcadc001470 con 0x7fcae40c0cd0 2023-10-24T00:48:21.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae936d700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcae40c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:21.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> v2:172.21.15.150:3300/0 conn(0x7fcae40aa140 0x7fcae40c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:21.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 >> v1:172.21.15.148:6789/0 conn(0x7fcae40c0cd0 legacy=0x7fcae4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad00038e0 0x7fcad0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcad0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad0004b80 0x7fcad0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40c1140 con 0x7fcad00038e0 2023-10-24T00:48:21.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40ca6e0 con 0x7fcad0004b80 2023-10-24T00:48:21.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad000b8e0 con 0x7fcae40ca110 2023-10-24T00:48:21.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad00038e0 0x7fcad0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae936d700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcad0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcaea36f700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad0004b80 0x7fcad0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae9b6e700 1 -- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 msgr2=0x7fcad0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.518+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40ca110 0x7fcad0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae9b6e700 1 -- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad0004b80 msgr2=0x7fcad0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad0004b80 0x7fcad0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae9b6e700 1 -- 172.21.15.148:0/3965180800 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40092a0 con 0x7fcad00038e0 2023-10-24T00:48:21.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad00038e0 0x7fcad0003d00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fcae000e3c0 tx=0x7fcae000b040).ready entity=mon.0 client_cookie=21b4a5f6af25c2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0009c50 con 0x7fcad00038e0 2023-10-24T00:48:21.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000f040 con 0x7fcad00038e0 2023-10-24T00:48:21.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcae8b6c700 1 -- 172.21.15.148:0/3965180800 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000ee80 con 0x7fcad00038e0 2023-10-24T00:48:21.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 -- 172.21.15.148:0/3965180800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad00038e0 msgr2=0x7fcad0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 --2- 172.21.15.148:0/3965180800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcad00038e0 0x7fcad0003d00 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fcae000e3c0 tx=0x7fcae000b040).stop 2023-10-24T00:48:21.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaea36f700 1 -- 172.21.15.148:0/3965180800 reap_dead start 2023-10-24T00:48:21.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 -- 172.21.15.148:0/3965180800 shutdown_connections 2023-10-24T00:48:21.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 -- 172.21.15.148:0/3965180800 >> 172.21.15.148:0/3965180800 conn(0x7fcae40944a0 msgr2=0x7fcae406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 -- 172.21.15.148:0/3965180800 shutdown_connections 2023-10-24T00:48:21.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.519+0000 7fcaeab70700 1 -- 172.21.15.148:0/3965180800 wait complete. 2023-10-24T00:48:21.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.520+0000 7fcaeab70700 1 Processor -- start 2023-10-24T00:48:21.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.520+0000 7fcaeab70700 1 -- start start 2023-10-24T00:48:21.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad00038e0 0x7fcae40ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40c28b0 0x7fcae4150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4158360 con 0x7fcae41529c0 2023-10-24T00:48:21.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40c2d30 con 0x7fcad00038e0 2023-10-24T00:48:21.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaeab70700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4153310 con 0x7fcae40c28b0 2023-10-24T00:48:21.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaea36f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaea36f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37644/0 (socket says 172.21.15.148:37644) 2023-10-24T00:48:21.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcaea36f700 1 -- 172.21.15.148:0/1886125744 learned_addr learned my addr 172.21.15.148:0/1886125744 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:21.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.521+0000 7fcae936d700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40c28b0 0x7fcae4150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 -- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40c28b0 msgr2=0x7fcae4150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40c28b0 0x7fcae4150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad00038e0 0x7fcae40ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 -- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad00038e0 msgr2=0x7fcae40ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad00038e0 0x7fcae40ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 -- 172.21.15.148:0/1886125744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40c2f40 con 0x7fcae41529c0 2023-10-24T00:48:21.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaea36f700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fcae4085440 tx=0x7fcadc001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc011590 con 0x7fcae41529c0 2023-10-24T00:48:21.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc0116f0 con 0x7fcae41529c0 2023-10-24T00:48:21.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae4167b30 con 0x7fcae41529c0 2023-10-24T00:48:21.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc011a70 con 0x7fcae41529c0 2023-10-24T00:48:21.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.522+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae41680f0 con 0x7fcae41529c0 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.523+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae4047480 con 0x7fcae41529c0 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.523+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcadc01d3b0 con 0x7fcae41529c0 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.524+0000 7fcad9ffb700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 0x7fcac8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.524+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcadc079a40 con 0x7fcae41529c0 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.524+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 0x7fcac8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.524+0000 7fcae9b6e700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 0x7fcac8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcae4157cc0 tx=0x7fcae001a000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.528+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcadc07be60 con 0x7fcae41529c0 2023-10-24T00:48:21.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.688+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcae40c60a0 con 0x7fcac805f150 2023-10-24T00:48:21.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.698+0000 7fcad9ffb700 1 -- 172.21.15.148:0/1886125744 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358739 (secure 0 0 0) 0x7fcae40c60a0 con 0x7fcac805f150 2023-10-24T00:48:21.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 msgr2=0x7fcac8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 0x7fcac8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcae4157cc0 tx=0x7fcae001a000).stop 2023-10-24T00:48:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 msgr2=0x7fcae4152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7fcae4085440 tx=0x7fcadc001e90).stop 2023-10-24T00:48:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 shutdown_connections 2023-10-24T00:48:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcac805f150 0x7fcac8061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcae41529c0 0x7fcae4152e20 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcad00038e0 0x7fcae40ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 --2- 172.21.15.148:0/1886125744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcae40c28b0 0x7fcae4150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 >> 172.21.15.148:0/1886125744 conn(0x7fcae40944a0 msgr2=0x7fcae4063ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 shutdown_connections 2023-10-24T00:48:21.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.701+0000 7fcaeab70700 1 -- 172.21.15.148:0/1886125744 wait complete. 2023-10-24T00:48:21.710 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:48:21.715 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T00:48:21.244016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423012,"kb_used_data":13476,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551708,"statfs":{"total":773094113280,"available":770612948992,"internally_reserved":0,"allocated":13799424,"data_stored":6940365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20022,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-70,"num_write_kb":-46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999602"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023996+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041844+0000","last_change":"2023-10-24T00:48:18.041844+0000","last_active":"2023-10-24T00:48:18.041844+0000","last_peered":"2023-10-24T00:48:18.041844+0000","last_clean":"2023-10-24T00:48:18.041844+0000","last_became_active":"2023-10-24T00:48:18.041589+0000","last_became_peered":"2023-10-24T00:48:18.041589+0000","last_unstale":"2023-10-24T00:48:18.041844+0000","last_undegraded":"2023-10-24T00:48:18.041844+0000","last_fullsized":"2023-10-24T00:48:18.041844+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027068+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.030820+0000","last_change":"2023-10-24T00:48:18.030820+0000","last_active":"2023-10-24T00:48:18.030820+0000","last_peered":"2023-10-24T00:48:18.030820+0000","last_clean":"2023-10-24T00:48:18.030820+0000","last_became_active":"2023-10-24T00:48:18.030482+0000","last_became_peered":"2023-10-24T00:48:18.030482+0000","last_unstale":"2023-10-24T00:48:18.030820+0000","last_undegraded":"2023-10-24T00:48:18.030820+0000","last_fullsized":"2023-10-24T00:48:18.030820+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035546+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039392+0000","last_change":"2023-10-24T00:48:18.039392+0000","last_active":"2023-10-24T00:48:18.039392+0000","last_peered":"2023-10-24T00:48:18.039392+0000","last_clean":"2023-10-24T00:48:18.039392+0000","last_became_active":"2023-10-24T00:48:18.039118+0000","last_became_peered":"2023-10-24T00:48:18.039118+0000","last_unstale":"2023-10-24T00:48:18.039392+0000","last_undegraded":"2023-10-24T00:48:18.039392+0000","last_fullsized":"2023-10-24T00:48:18.039392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024705+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040907+0000","last_change":"2023-10-24T00:48:18.040907+0000","last_active":"2023-10-24T00:48:18.040907+0000","last_peered":"2023-10-24T00:48:18.040907+0000","last_clean":"2023-10-24T00:48:18.040907+0000","last_became_active":"2023-10-24T00:48:18.038648+0000","last_became_peered":"2023-10-24T00:48:18.038648+0000","last_unstale":"2023-10-24T00:48:18.040907+0000","last_undegraded":"2023-10-24T00:48:18.040907+0000","last_fullsized":"2023-10-24T00:48:18.040907+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.036571+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042252+0000","last_change":"2023-10-24T00:48:18.042252+0000","last_active":"2023-10-24T00:48:18.042252+0000","last_peered":"2023-10-24T00:48:18.042252+0000","last_clean":"2023-10-24T00:48:18.042252+0000","last_became_active":"2023-10-24T00:48:18.041992+0000","last_became_peered":"2023-10-24T00:48:18.041992+0000","last_unstale":"2023-10-24T00:48:18.042252+0000","last_undegraded":"2023-10-24T00:48:18.042252+0000","last_fullsized":"2023-10-24T00:48:18.042252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030656+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045400+0000","last_change":"2023-10-24T00:48:18.045400+0000","last_active":"2023-10-24T00:48:18.045400+0000","last_peered":"2023-10-24T00:48:18.045400+0000","last_clean":"2023-10-24T00:48:18.045400+0000","last_became_active":"2023-10-24T00:48:18.045129+0000","last_became_peered":"2023-10-24T00:48:18.045129+0000","last_unstale":"2023-10-24T00:48:18.045400+0000","last_undegraded":"2023-10-24T00:48:18.045400+0000","last_fullsized":"2023-10-24T00:48:18.045400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027408+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043011+0000","last_change":"2023-10-24T00:48:18.043011+0000","last_active":"2023-10-24T00:48:18.043011+0000","last_peered":"2023-10-24T00:48:18.043011+0000","last_clean":"2023-10-24T00:48:18.043011+0000","last_became_active":"2023-10-24T00:48:18.042525+0000","last_became_peered":"2023-10-24T00:48:18.042525+0000","last_unstale":"2023-10-24T00:48:18.043011+0000","last_undegraded":"2023-10-24T00:48:18.043011+0000","last_fullsized":"2023-10-24T00:48:18.043011+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027413+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.032792+0000","last_change":"2023-10-24T00:48:18.032792+0000","last_active":"2023-10-24T00:48:18.032792+0000","last_peered":"2023-10-24T00:48:18.032792+0000","last_clean":"2023-10-24T00:48:18.032792+0000","last_became_active":"2023-10-24T00:48:18.032439+0000","last_became_peered":"2023-10-24T00:48:18.032439+0000","last_unstale":"2023-10-24T00:48:18.032792+0000","last_undegraded":"2023-10-24T00:48:18.032792+0000","last_fullsized":"2023-10-24T00:48:18.032792+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027200+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044386+0000","last_change":"2023-10-24T00:48:18.044386+0000","last_active":"2023-10-24T00:48:18.044386+0000","last_peered":"2023-10-24T00:48:18.044386+0000","last_clean":"2023-10-24T00:48:18.044386+0000","last_became_active":"2023-10-24T00:48:18.044107+0000","last_became_peered":"2023-10-24T00:48:18.044107+0000","last_unstale":"2023-10-24T00:48:18.044386+0000","last_undegraded":"2023-10-24T00:48:18.044386+0000","last_fullsized":"2023-10-24T00:48:18.044386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026459+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048765+0000","last_change":"2023-10-24T00:48:18.048765+0000","last_active":"2023-10-24T00:48:18.048765+0000","last_peered":"2023-10-24T00:48:18.048765+0000","last_clean":"2023-10-24T00:48:18.048765+0000","last_became_active":"2023-10-24T00:48:18.048505+0000","last_became_peered":"2023-10-24T00:48:18.048505+0000","last_unstale":"2023-10-24T00:48:18.048765+0000","last_undegraded":"2023-10-24T00:48:18.048765+0000","last_fullsized":"2023-10-24T00:48:18.048765+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021924+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044999+0000","last_change":"2023-10-24T00:48:18.044999+0000","last_active":"2023-10-24T00:48:18.044999+0000","last_peered":"2023-10-24T00:48:18.044999+0000","last_clean":"2023-10-24T00:48:18.044999+0000","last_became_active":"2023-10-24T00:48:18.044678+0000","last_became_peered":"2023-10-24T00:48:18.044678+0000","last_unstale":"2023-10-24T00:48:18.044999+0000","last_undegraded":"2023-10-24T00:48:18.044999+0000","last_fullsized":"2023-10-24T00:48:18.044999+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025598+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048832+0000","last_change":"2023-10-24T00:48:18.048832+0000","last_active":"2023-10-24T00:48:18.048832+0000","last_peered":"2023-10-24T00:48:18.048832+0000","last_clean":"2023-10-24T00:48:18.048832+0000","last_became_active":"2023-10-24T00:48:18.048558+0000","last_became_peered":"2023-10-24T00:48:18.048558+0000","last_unstale":"2023-10-24T00:48:18.048832+0000","last_undegraded":"2023-10-24T00:48:18.048832+0000","last_fullsized":"2023-10-24T00:48:18.048832+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032346+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036392+0000","last_change":"2023-10-24T00:48:18.036392+0000","last_active":"2023-10-24T00:48:18.036392+0000","last_peered":"2023-10-24T00:48:18.036392+0000","last_clean":"2023-10-24T00:48:18.036392+0000","last_became_active":"2023-10-24T00:48:18.035885+0000","last_became_peered":"2023-10-24T00:48:18.035885+0000","last_unstale":"2023-10-24T00:48:18.036392+0000","last_undegraded":"2023-10-24T00:48:18.036392+0000","last_fullsized":"2023-10-24T00:48:18.036392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041432+0000","last_change":"2023-10-24T00:48:18.041432+0000","last_active":"2023-10-24T00:48:18.041432+0000","last_peered":"2023-10-24T00:48:18.041432+0000","last_clean":"2023-10-24T00:48:18.041432+0000","last_became_active":"2023-10-24T00:48:18.041156+0000","last_became_peered":"2023-10-24T00:48:18.041156+0000","last_unstale":"2023-10-24T00:48:18.041432+0000","last_undegraded":"2023-10-24T00:48:18.041432+0000","last_fullsized":"2023-10-24T00:48:18.041432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.037009+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045461+0000","last_change":"2023-10-24T00:48:18.045461+0000","last_active":"2023-10-24T00:48:18.045461+0000","last_peered":"2023-10-24T00:48:18.045461+0000","last_clean":"2023-10-24T00:48:18.045461+0000","last_became_active":"2023-10-24T00:48:18.045197+0000","last_became_peered":"2023-10-24T00:48:18.045197+0000","last_unstale":"2023-10-24T00:48:18.045461+0000","last_undegraded":"2023-10-24T00:48:18.045461+0000","last_fullsized":"2023-10-24T00:48:18.045461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.022057+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042527+0000","last_change":"2023-10-24T00:48:18.042527+0000","last_active":"2023-10-24T00:48:18.042527+0000","last_peered":"2023-10-24T00:48:18.042527+0000","last_clean":"2023-10-24T00:48:18.042527+0000","last_became_active":"2023-10-24T00:48:18.042217+0000","last_became_peered":"2023-10-24T00:48:18.042217+0000","last_unstale":"2023-10-24T00:48:18.042527+0000","last_undegraded":"2023-10-24T00:48:18.042527+0000","last_fullsized":"2023-10-24T00:48:18.042527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024549+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043145+0000","last_change":"2023-10-24T00:48:18.043145+0000","last_active":"2023-10-24T00:48:18.043145+0000","last_peered":"2023-10-24T00:48:18.043145+0000","last_clean":"2023-10-24T00:48:18.043145+0000","last_became_active":"2023-10-24T00:48:18.042714+0000","last_became_peered":"2023-10-24T00:48:18.042714+0000","last_unstale":"2023-10-24T00:48:18.043145+0000","last_undegraded":"2023-10-24T00:48:18.043145+0000","last_fullsized":"2023-10-24T00:48:18.043145+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.033056+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044605+0000","last_change":"2023-10-24T00:48:18.044605+0000","last_active":"2023-10-24T00:48:18.044605+0000","last_peered":"2023-10-24T00:48:18.044605+0000","last_clean":"2023-10-24T00:48:18.044605+0000","last_became_active":"2023-10-24T00:48:18.044344+0000","last_became_peered":"2023-10-24T00:48:18.044344+0000","last_unstale":"2023-10-24T00:48:18.044605+0000","last_undegraded":"2023-10-24T00:48:18.044605+0000","last_fullsized":"2023-10-24T00:48:18.044605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035160+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045569+0000","last_change":"2023-10-24T00:48:18.045569+0000","last_active":"2023-10-24T00:48:18.045569+0000","last_peered":"2023-10-24T00:48:18.045569+0000","last_clean":"2023-10-24T00:48:18.045569+0000","last_became_active":"2023-10-24T00:48:18.045238+0000","last_became_peered":"2023-10-24T00:48:18.045238+0000","last_unstale":"2023-10-24T00:48:18.045569+0000","last_undegraded":"2023-10-24T00:48:18.045569+0000","last_fullsized":"2023-10-24T00:48:18.045569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037574+0000","last_change":"2023-10-24T00:48:18.037574+0000","last_active":"2023-10-24T00:48:18.037574+0000","last_peered":"2023-10-24T00:48:18.037574+0000","last_clean":"2023-10-24T00:48:18.037574+0000","last_became_active":"2023-10-24T00:48:18.037198+0000","last_became_peered":"2023-10-24T00:48:18.037198+0000","last_unstale":"2023-10-24T00:48:18.037574+0000","last_undegraded":"2023-10-24T00:48:18.037574+0000","last_fullsized":"2023-10-24T00:48:18.037574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039664+0000","last_change":"2023-10-24T00:48:18.039664+0000","last_active":"2023-10-24T00:48:18.039664+0000","last_peered":"2023-10-24T00:48:18.039664+0000","last_clean":"2023-10-24T00:48:18.039664+0000","last_became_active":"2023-10-24T00:48:18.039386+0000","last_became_peered":"2023-10-24T00:48:18.039386+0000","last_unstale":"2023-10-24T00:48:18.039664+0000","last_undegraded":"2023-10-24T00:48:18.039664+0000","last_fullsized":"2023-10-24T00:48:18.039664+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024967+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046440+0000","last_change":"2023-10-24T00:48:18.046440+0000","last_active":"2023-10-24T00:48:18.046440+0000","last_peered":"2023-10-24T00:48:18.046440+0000","last_clean":"2023-10-24T00:48:18.046440+0000","last_became_active":"2023-10-24T00:48:18.046183+0000","last_became_peered":"2023-10-24T00:48:18.046183+0000","last_unstale":"2023-10-24T00:48:18.046440+0000","last_undegraded":"2023-10-24T00:48:18.046440+0000","last_fullsized":"2023-10-24T00:48:18.046440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025410+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036065+0000","last_change":"2023-10-24T00:48:18.036065+0000","last_active":"2023-10-24T00:48:18.036065+0000","last_peered":"2023-10-24T00:48:18.036065+0000","last_clean":"2023-10-24T00:48:18.036065+0000","last_became_active":"2023-10-24T00:48:18.035802+0000","last_became_peered":"2023-10-24T00:48:18.035802+0000","last_unstale":"2023-10-24T00:48:18.036065+0000","last_undegraded":"2023-10-24T00:48:18.036065+0000","last_fullsized":"2023-10-24T00:48:18.036065+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026827+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045033+0000","last_change":"2023-10-24T00:48:18.045033+0000","last_active":"2023-10-24T00:48:18.045033+0000","last_peered":"2023-10-24T00:48:18.045033+0000","last_clean":"2023-10-24T00:48:18.045033+0000","last_became_active":"2023-10-24T00:48:18.044768+0000","last_became_peered":"2023-10-24T00:48:18.044768+0000","last_unstale":"2023-10-24T00:48:18.045033+0000","last_undegraded":"2023-10-24T00:48:18.045033+0000","last_fullsized":"2023-10-24T00:48:18.045033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027881+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044606+0000","last_change":"2023-10-24T00:48:18.044606+0000","last_active":"2023-10-24T00:48:18.044606+0000","last_peered":"2023-10-24T00:48:18.044606+0000","last_clean":"2023-10-24T00:48:18.044606+0000","last_became_active":"2023-10-24T00:48:18.044308+0000","last_became_peered":"2023-10-24T00:48:18.044308+0000","last_unstale":"2023-10-24T00:48:18.044606+0000","last_undegraded":"2023-10-24T00:48:18.044606+0000","last_fullsized":"2023-10-24T00:48:18.044606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032260+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037373+0000","last_change":"2023-10-24T00:48:18.037373+0000","last_active":"2023-10-24T00:48:18.037373+0000","last_peered":"2023-10-24T00:48:18.037373+0000","last_clean":"2023-10-24T00:48:18.037373+0000","last_became_active":"2023-10-24T00:48:18.037110+0000","last_became_peered":"2023-10-24T00:48:18.037110+0000","last_unstale":"2023-10-24T00:48:18.037373+0000","last_undegraded":"2023-10-24T00:48:18.037373+0000","last_fullsized":"2023-10-24T00:48:18.037373+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024906+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036294+0000","last_change":"2023-10-24T00:48:18.036294+0000","last_active":"2023-10-24T00:48:18.036294+0000","last_peered":"2023-10-24T00:48:18.036294+0000","last_clean":"2023-10-24T00:48:18.036294+0000","last_became_active":"2023-10-24T00:48:18.036007+0000","last_became_peered":"2023-10-24T00:48:18.036007+0000","last_unstale":"2023-10-24T00:48:18.036294+0000","last_undegraded":"2023-10-24T00:48:18.036294+0000","last_fullsized":"2023-10-24T00:48:18.036294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028545+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042339+0000","last_change":"2023-10-24T00:48:18.042339+0000","last_active":"2023-10-24T00:48:18.042339+0000","last_peered":"2023-10-24T00:48:18.042339+0000","last_clean":"2023-10-24T00:48:18.042339+0000","last_became_active":"2023-10-24T00:48:18.042104+0000","last_became_peered":"2023-10-24T00:48:18.042104+0000","last_unstale":"2023-10-24T00:48:18.042339+0000","last_undegraded":"2023-10-24T00:48:18.042339+0000","last_fullsized":"2023-10-24T00:48:18.042339+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026821+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039118+0000","last_change":"2023-10-24T00:48:18.039118+0000","last_active":"2023-10-24T00:48:18.039118+0000","last_peered":"2023-10-24T00:48:18.039118+0000","last_clean":"2023-10-24T00:48:18.039118+0000","last_became_active":"2023-10-24T00:48:18.037254+0000","last_became_peered":"2023-10-24T00:48:18.037254+0000","last_unstale":"2023-10-24T00:48:18.039118+0000","last_undegraded":"2023-10-24T00:48:18.039118+0000","last_fullsized":"2023-10-24T00:48:18.039118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028509+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044312+0000","last_change":"2023-10-24T00:48:18.044312+0000","last_active":"2023-10-24T00:48:18.044312+0000","last_peered":"2023-10-24T00:48:18.044312+0000","last_clean":"2023-10-24T00:48:18.044312+0000","last_became_active":"2023-10-24T00:48:18.044028+0000","last_became_peered":"2023-10-24T00:48:18.044028+0000","last_unstale":"2023-10-24T00:48:18.044312+0000","last_undegraded":"2023-10-24T00:48:18.044312+0000","last_fullsized":"2023-10-24T00:48:18.044312+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031588+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037085+0000","last_change":"2023-10-24T00:48:18.037085+0000","last_active":"2023-10-24T00:48:18.037085+0000","last_peered":"2023-10-24T00:48:18.037085+0000","last_clean":"2023-10-24T00:48:18.037085+0000","last_became_active":"2023-10-24T00:48:18.036799+0000","last_became_peered":"2023-10-24T00:48:18.036799+0000","last_unstale":"2023-10-24T00:48:18.037085+0000","last_undegraded":"2023-10-24T00:48:18.037085+0000","last_fullsized":"2023-10-24T00:48:18.037085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025344+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046236+0000","last_change":"2023-10-24T00:48:18.046236+0000","last_active":"2023-10-24T00:48:18.046236+0000","last_peered":"2023-10-24T00:48:18.046236+0000","last_clean":"2023-10-24T00:48:18.046236+0000","last_became_active":"2023-10-24T00:48:18.045972+0000","last_became_peered":"2023-10-24T00:48:18.045972+0000","last_unstale":"2023-10-24T00:48:18.046236+0000","last_undegraded":"2023-10-24T00:48:18.046236+0000","last_fullsized":"2023-10-24T00:48:18.046236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021489+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041889+0000","last_change":"2023-10-24T00:48:18.041889+0000","last_active":"2023-10-24T00:48:18.041889+0000","last_peered":"2023-10-24T00:48:18.041889+0000","last_clean":"2023-10-24T00:48:18.041889+0000","last_became_active":"2023-10-24T00:48:18.041453+0000","last_became_peered":"2023-10-24T00:48:18.041453+0000","last_unstale":"2023-10-24T00:48:18.041889+0000","last_undegraded":"2023-10-24T00:48:18.041889+0000","last_fullsized":"2023-10-24T00:48:18.041889+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025407+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.028828+0000","last_change":"2023-10-24T00:48:18.028828+0000","last_active":"2023-10-24T00:48:18.028828+0000","last_peered":"2023-10-24T00:48:18.028828+0000","last_clean":"2023-10-24T00:48:18.028828+0000","last_became_active":"2023-10-24T00:48:18.028538+0000","last_became_peered":"2023-10-24T00:48:18.028538+0000","last_unstale":"2023-10-24T00:48:18.028828+0000","last_undegraded":"2023-10-24T00:48:18.028828+0000","last_fullsized":"2023-10-24T00:48:18.028828+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028610+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036207+0000","last_change":"2023-10-24T00:48:18.036207+0000","last_active":"2023-10-24T00:48:18.036207+0000","last_peered":"2023-10-24T00:48:18.036207+0000","last_clean":"2023-10-24T00:48:18.036207+0000","last_became_active":"2023-10-24T00:48:18.035820+0000","last_became_peered":"2023-10-24T00:48:18.035820+0000","last_unstale":"2023-10-24T00:48:18.036207+0000","last_undegraded":"2023-10-24T00:48:18.036207+0000","last_fullsized":"2023-10-24T00:48:18.036207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025206+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044718+0000","last_change":"2023-10-24T00:48:18.044718+0000","last_active":"2023-10-24T00:48:18.044718+0000","last_peered":"2023-10-24T00:48:18.044718+0000","last_clean":"2023-10-24T00:48:18.044718+0000","last_became_active":"2023-10-24T00:48:18.044354+0000","last_became_peered":"2023-10-24T00:48:18.044354+0000","last_unstale":"2023-10-24T00:48:18.044718+0000","last_undegraded":"2023-10-24T00:48:18.044718+0000","last_fullsized":"2023-10-24T00:48:18.044718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020925+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044944+0000","last_change":"2023-10-24T00:48:18.044944+0000","last_active":"2023-10-24T00:48:18.044944+0000","last_peered":"2023-10-24T00:48:18.044944+0000","last_clean":"2023-10-24T00:48:18.044944+0000","last_became_active":"2023-10-24T00:48:18.044562+0000","last_became_peered":"2023-10-24T00:48:18.044562+0000","last_unstale":"2023-10-24T00:48:18.044944+0000","last_undegraded":"2023-10-24T00:48:18.044944+0000","last_fullsized":"2023-10-24T00:48:18.044944+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023998+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044302+0000","last_change":"2023-10-24T00:48:18.044302+0000","last_active":"2023-10-24T00:48:18.044302+0000","last_peered":"2023-10-24T00:48:18.044302+0000","last_clean":"2023-10-24T00:48:18.044302+0000","last_became_active":"2023-10-24T00:48:18.044039+0000","last_became_peered":"2023-10-24T00:48:18.044039+0000","last_unstale":"2023-10-24T00:48:18.044302+0000","last_undegraded":"2023-10-24T00:48:18.044302+0000","last_fullsized":"2023-10-24T00:48:18.044302+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030326+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042819+0000","last_change":"2023-10-24T00:48:18.042819+0000","last_active":"2023-10-24T00:48:18.042819+0000","last_peered":"2023-10-24T00:48:18.042819+0000","last_clean":"2023-10-24T00:48:18.042819+0000","last_became_active":"2023-10-24T00:48:18.042239+0000","last_became_peered":"2023-10-24T00:48:18.042239+0000","last_unstale":"2023-10-24T00:48:18.042819+0000","last_undegraded":"2023-10-24T00:48:18.042819+0000","last_fullsized":"2023-10-24T00:48:18.042819+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021457+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038256+0000","last_change":"2023-10-24T00:48:18.038256+0000","last_active":"2023-10-24T00:48:18.038256+0000","last_peered":"2023-10-24T00:48:18.038256+0000","last_clean":"2023-10-24T00:48:18.038256+0000","last_became_active":"2023-10-24T00:48:18.037986+0000","last_became_peered":"2023-10-24T00:48:18.037986+0000","last_unstale":"2023-10-24T00:48:18.038256+0000","last_undegraded":"2023-10-24T00:48:18.038256+0000","last_fullsized":"2023-10-24T00:48:18.038256+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024950+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034708+0000","last_change":"2023-10-24T00:48:18.034708+0000","last_active":"2023-10-24T00:48:18.034708+0000","last_peered":"2023-10-24T00:48:18.034708+0000","last_clean":"2023-10-24T00:48:18.034708+0000","last_became_active":"2023-10-24T00:48:18.034432+0000","last_became_peered":"2023-10-24T00:48:18.034432+0000","last_unstale":"2023-10-24T00:48:18.034708+0000","last_undegraded":"2023-10-24T00:48:18.034708+0000","last_fullsized":"2023-10-24T00:48:18.034708+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026010+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034651+0000","last_change":"2023-10-24T00:48:18.034651+0000","last_active":"2023-10-24T00:48:18.034651+0000","last_peered":"2023-10-24T00:48:18.034651+0000","last_clean":"2023-10-24T00:48:18.034651+0000","last_became_active":"2023-10-24T00:48:18.034361+0000","last_became_peered":"2023-10-24T00:48:18.034361+0000","last_unstale":"2023-10-24T00:48:18.034651+0000","last_undegraded":"2023-10-24T00:48:18.034651+0000","last_fullsized":"2023-10-24T00:48:18.034651+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028433+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038205+0000","last_change":"2023-10-24T00:48:18.038205+0000","last_active":"2023-10-24T00:48:18.038205+0000","last_peered":"2023-10-24T00:48:18.038205+0000","last_clean":"2023-10-24T00:48:18.038205+0000","last_became_active":"2023-10-24T00:48:18.037941+0000","last_became_peered":"2023-10-24T00:48:18.037941+0000","last_unstale":"2023-10-24T00:48:18.038205+0000","last_undegraded":"2023-10-24T00:48:18.038205+0000","last_fullsized":"2023-10-24T00:48:18.038205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025819+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037758+0000","last_change":"2023-10-24T00:48:18.037758+0000","last_active":"2023-10-24T00:48:18.037758+0000","last_peered":"2023-10-24T00:48:18.037758+0000","last_clean":"2023-10-24T00:48:18.037758+0000","last_became_active":"2023-10-24T00:48:18.037479+0000","last_became_peered":"2023-10-24T00:48:18.037479+0000","last_unstale":"2023-10-24T00:48:18.037758+0000","last_undegraded":"2023-10-24T00:48:18.037758+0000","last_fullsized":"2023-10-24T00:48:18.037758+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042438+0000","last_change":"2023-10-24T00:48:18.042438+0000","last_active":"2023-10-24T00:48:18.042438+0000","last_peered":"2023-10-24T00:48:18.042438+0000","last_clean":"2023-10-24T00:48:18.042438+0000","last_became_active":"2023-10-24T00:48:18.042158+0000","last_became_peered":"2023-10-24T00:48:18.042158+0000","last_unstale":"2023-10-24T00:48:18.042438+0000","last_undegraded":"2023-10-24T00:48:18.042438+0000","last_fullsized":"2023-10-24T00:48:18.042438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035675+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039929+0000","last_change":"2023-10-24T00:48:18.039929+0000","last_active":"2023-10-24T00:48:18.039929+0000","last_peered":"2023-10-24T00:48:18.039929+0000","last_clean":"2023-10-24T00:48:18.039929+0000","last_became_active":"2023-10-24T00:48:18.039663+0000","last_became_peered":"2023-10-24T00:48:18.039663+0000","last_unstale":"2023-10-24T00:48:18.039929+0000","last_undegraded":"2023-10-24T00:48:18.039929+0000","last_fullsized":"2023-10-24T00:48:18.039929+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031216+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041939+0000","last_change":"2023-10-24T00:48:18.041939+0000","last_active":"2023-10-24T00:48:18.041939+0000","last_peered":"2023-10-24T00:48:18.041939+0000","last_clean":"2023-10-24T00:48:18.041939+0000","last_became_active":"2023-10-24T00:48:18.041656+0000","last_became_peered":"2023-10-24T00:48:18.041656+0000","last_unstale":"2023-10-24T00:48:18.041939+0000","last_undegraded":"2023-10-24T00:48:18.041939+0000","last_fullsized":"2023-10-24T00:48:18.041939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028088+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.033645+0000","last_change":"2023-10-24T00:48:18.033645+0000","last_active":"2023-10-24T00:48:18.033645+0000","last_peered":"2023-10-24T00:48:18.033645+0000","last_clean":"2023-10-24T00:48:18.033645+0000","last_became_active":"2023-10-24T00:48:18.033340+0000","last_became_peered":"2023-10-24T00:48:18.033340+0000","last_unstale":"2023-10-24T00:48:18.033645+0000","last_undegraded":"2023-10-24T00:48:18.033645+0000","last_fullsized":"2023-10-24T00:48:18.033645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028611+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038704+0000","last_change":"2023-10-24T00:48:18.038704+0000","last_active":"2023-10-24T00:48:18.038704+0000","last_peered":"2023-10-24T00:48:18.038704+0000","last_clean":"2023-10-24T00:48:18.038704+0000","last_became_active":"2023-10-24T00:48:18.038444+0000","last_became_peered":"2023-10-24T00:48:18.038444+0000","last_unstale":"2023-10-24T00:48:18.038704+0000","last_undegraded":"2023-10-24T00:48:18.038704+0000","last_fullsized":"2023-10-24T00:48:18.038704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020858+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043878+0000","last_change":"2023-10-24T00:48:18.043878+0000","last_active":"2023-10-24T00:48:18.043878+0000","last_peered":"2023-10-24T00:48:18.043878+0000","last_clean":"2023-10-24T00:48:18.043878+0000","last_became_active":"2023-10-24T00:48:18.043592+0000","last_became_peered":"2023-10-24T00:48:18.043592+0000","last_unstale":"2023-10-24T00:48:18.043878+0000","last_undegraded":"2023-10-24T00:48:18.043878+0000","last_fullsized":"2023-10-24T00:48:18.043878+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024515+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042080+0000","last_change":"2023-10-24T00:48:18.042080+0000","last_active":"2023-10-24T00:48:18.042080+0000","last_peered":"2023-10-24T00:48:18.042080+0000","last_clean":"2023-10-24T00:48:18.042080+0000","last_became_active":"2023-10-24T00:48:18.040827+0000","last_became_peered":"2023-10-24T00:48:18.040827+0000","last_unstale":"2023-10-24T00:48:18.042080+0000","last_undegraded":"2023-10-24T00:48:18.042080+0000","last_fullsized":"2023-10-24T00:48:18.042080+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025043+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039363+0000","last_change":"2023-10-24T00:48:18.039363+0000","last_active":"2023-10-24T00:48:18.039363+0000","last_peered":"2023-10-24T00:48:18.039363+0000","last_clean":"2023-10-24T00:48:18.039363+0000","last_became_active":"2023-10-24T00:48:18.038320+0000","last_became_peered":"2023-10-24T00:48:18.038320+0000","last_unstale":"2023-10-24T00:48:18.039363+0000","last_undegraded":"2023-10-24T00:48:18.039363+0000","last_fullsized":"2023-10-24T00:48:18.039363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024620+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036842+0000","last_change":"2023-10-24T00:48:18.036842+0000","last_active":"2023-10-24T00:48:18.036842+0000","last_peered":"2023-10-24T00:48:18.036842+0000","last_clean":"2023-10-24T00:48:18.036842+0000","last_became_active":"2023-10-24T00:48:18.035634+0000","last_became_peered":"2023-10-24T00:48:18.035634+0000","last_unstale":"2023-10-24T00:48:18.036842+0000","last_undegraded":"2023-10-24T00:48:18.036842+0000","last_fullsized":"2023-10-24T00:48:18.036842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035307+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038277+0000","last_change":"2023-10-24T00:48:18.038277+0000","last_active":"2023-10-24T00:48:18.038277+0000","last_peered":"2023-10-24T00:48:18.038277+0000","last_clean":"2023-10-24T00:48:18.038277+0000","last_became_active":"2023-10-24T00:48:18.037812+0000","last_became_peered":"2023-10-24T00:48:18.037812+0000","last_unstale":"2023-10-24T00:48:18.038277+0000","last_undegraded":"2023-10-24T00:48:18.038277+0000","last_fullsized":"2023-10-24T00:48:18.038277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025964+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038024+0000","last_change":"2023-10-24T00:48:18.038024+0000","last_active":"2023-10-24T00:48:18.038024+0000","last_peered":"2023-10-24T00:48:18.038024+0000","last_clean":"2023-10-24T00:48:18.038024+0000","last_became_active":"2023-10-24T00:48:18.037740+0000","last_became_peered":"2023-10-24T00:48:18.037740+0000","last_unstale":"2023-10-24T00:48:18.038024+0000","last_undegraded":"2023-10-24T00:48:18.038024+0000","last_fullsized":"2023-10-24T00:48:18.038024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020902+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044227+0000","last_change":"2023-10-24T00:48:18.044227+0000","last_active":"2023-10-24T00:48:18.044227+0000","last_peered":"2023-10-24T00:48:18.044227+0000","last_clean":"2023-10-24T00:48:18.044227+0000","last_became_active":"2023-10-24T00:48:18.043885+0000","last_became_peered":"2023-10-24T00:48:18.043885+0000","last_unstale":"2023-10-24T00:48:18.044227+0000","last_undegraded":"2023-10-24T00:48:18.044227+0000","last_fullsized":"2023-10-24T00:48:18.044227+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031800+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041439+0000","last_change":"2023-10-24T00:48:18.041439+0000","last_active":"2023-10-24T00:48:18.041439+0000","last_peered":"2023-10-24T00:48:18.041439+0000","last_clean":"2023-10-24T00:48:18.041439+0000","last_became_active":"2023-10-24T00:48:18.041068+0000","last_became_peered":"2023-10-24T00:48:18.041068+0000","last_unstale":"2023-10-24T00:48:18.041439+0000","last_undegraded":"2023-10-24T00:48:18.041439+0000","last_fullsized":"2023-10-24T00:48:18.041439+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023794+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:48:17.023794+0000","last_peered":"2023-10-24T00:48:17.023794+0000","last_clean":"2023-10-24T00:48:17.023794+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:48:17.023794+0000","last_undegraded":"2023-10-24T00:48:17.023794+0000","last_fullsized":"2023-10-24T00:48:17.023794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024627+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.047097+0000","last_change":"2023-10-24T00:48:18.047097+0000","last_active":"2023-10-24T00:48:18.047097+0000","last_peered":"2023-10-24T00:48:18.047097+0000","last_clean":"2023-10-24T00:48:18.047097+0000","last_became_active":"2023-10-24T00:48:18.046725+0000","last_became_peered":"2023-10-24T00:48:18.046725+0000","last_unstale":"2023-10-24T00:48:18.047097+0000","last_undegraded":"2023-10-24T00:48:18.047097+0000","last_fullsized":"2023-10-24T00:48:18.047097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013593+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:48:17.013593+0000","last_peered":"2023-10-24T00:48:17.013593+0000","last_clean":"2023-10-24T00:48:17.013593+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:48:17.013593+0000","last_undegraded":"2023-10-24T00:48:17.013593+0000","last_fullsized":"2023-10-24T00:48:17.013593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021006+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040254+0000","last_change":"2023-10-24T00:48:18.040254+0000","last_active":"2023-10-24T00:48:18.040254+0000","last_peered":"2023-10-24T00:48:18.040254+0000","last_clean":"2023-10-24T00:48:18.040254+0000","last_became_active":"2023-10-24T00:48:18.039228+0000","last_became_peered":"2023-10-24T00:48:18.039228+0000","last_unstale":"2023-10-24T00:48:18.040254+0000","last_undegraded":"2023-10-24T00:48:18.040254+0000","last_fullsized":"2023-10-24T00:48:18.040254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.017969+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:48:17.017969+0000","last_peered":"2023-10-24T00:48:17.017969+0000","last_clean":"2023-10-24T00:48:17.017969+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:48:17.017969+0000","last_undegraded":"2023-10-24T00:48:17.017969+0000","last_fullsized":"2023-10-24T00:48:17.017969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026411+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045000+0000","last_change":"2023-10-24T00:48:18.045000+0000","last_active":"2023-10-24T00:48:18.045000+0000","last_peered":"2023-10-24T00:48:18.045000+0000","last_clean":"2023-10-24T00:48:18.045000+0000","last_became_active":"2023-10-24T00:48:18.044728+0000","last_became_peered":"2023-10-24T00:48:18.044728+0000","last_unstale":"2023-10-24T00:48:18.045000+0000","last_undegraded":"2023-10-24T00:48:18.045000+0000","last_fullsized":"2023-10-24T00:48:18.045000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013828+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:48:17.013828+0000","last_peered":"2023-10-24T00:48:17.013828+0000","last_clean":"2023-10-24T00:48:17.013828+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:48:17.013828+0000","last_undegraded":"2023-10-24T00:48:17.013828+0000","last_fullsized":"2023-10-24T00:48:17.013828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015663+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:48:17.015663+0000","last_peered":"2023-10-24T00:48:17.015663+0000","last_clean":"2023-10-24T00:48:17.015663+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:48:17.015663+0000","last_undegraded":"2023-10-24T00:48:17.015663+0000","last_fullsized":"2023-10-24T00:48:17.015663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035409+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045594+0000","last_change":"2023-10-24T00:48:18.045594+0000","last_active":"2023-10-24T00:48:18.045594+0000","last_peered":"2023-10-24T00:48:18.045594+0000","last_clean":"2023-10-24T00:48:18.045594+0000","last_became_active":"2023-10-24T00:48:18.045329+0000","last_became_peered":"2023-10-24T00:48:18.045329+0000","last_unstale":"2023-10-24T00:48:18.045594+0000","last_undegraded":"2023-10-24T00:48:18.045594+0000","last_fullsized":"2023-10-24T00:48:18.045594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015755+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:48:17.015755+0000","last_peered":"2023-10-24T00:48:17.015755+0000","last_clean":"2023-10-24T00:48:17.015755+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:48:17.015755+0000","last_undegraded":"2023-10-24T00:48:17.015755+0000","last_fullsized":"2023-10-24T00:48:17.015755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025941+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045608+0000","last_change":"2023-10-24T00:48:18.045608+0000","last_active":"2023-10-24T00:48:18.045608+0000","last_peered":"2023-10-24T00:48:18.045608+0000","last_clean":"2023-10-24T00:48:18.045608+0000","last_became_active":"2023-10-24T00:48:18.045257+0000","last_became_peered":"2023-10-24T00:48:18.045257+0000","last_unstale":"2023-10-24T00:48:18.045608+0000","last_undegraded":"2023-10-24T00:48:18.045608+0000","last_fullsized":"2023-10-24T00:48:18.045608+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016864+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:48:17.016864+0000","last_peered":"2023-10-24T00:48:17.016864+0000","last_clean":"2023-10-24T00:48:17.016864+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:48:17.016864+0000","last_undegraded":"2023-10-24T00:48:17.016864+0000","last_fullsized":"2023-10-24T00:48:17.016864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027129+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038309+0000","last_change":"2023-10-24T00:48:18.038309+0000","last_active":"2023-10-24T00:48:18.038309+0000","last_peered":"2023-10-24T00:48:18.038309+0000","last_clean":"2023-10-24T00:48:18.038309+0000","last_became_active":"2023-10-24T00:48:18.037990+0000","last_became_peered":"2023-10-24T00:48:18.037990+0000","last_unstale":"2023-10-24T00:48:18.038309+0000","last_undegraded":"2023-10-24T00:48:18.038309+0000","last_fullsized":"2023-10-24T00:48:18.038309+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023810+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:48:17.023810+0000","last_peered":"2023-10-24T00:48:17.023810+0000","last_clean":"2023-10-24T00:48:17.023810+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:48:17.023810+0000","last_undegraded":"2023-10-24T00:48:17.023810+0000","last_fullsized":"2023-10-24T00:48:17.023810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026180+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044172+0000","last_change":"2023-10-24T00:48:18.044172+0000","last_active":"2023-10-24T00:48:18.044172+0000","last_peered":"2023-10-24T00:48:18.044172+0000","last_clean":"2023-10-24T00:48:18.044172+0000","last_became_active":"2023-10-24T00:48:18.043858+0000","last_became_peered":"2023-10-24T00:48:18.043858+0000","last_unstale":"2023-10-24T00:48:18.044172+0000","last_undegraded":"2023-10-24T00:48:18.044172+0000","last_fullsized":"2023-10-24T00:48:18.044172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016971+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:48:17.016971+0000","last_peered":"2023-10-24T00:48:17.016971+0000","last_clean":"2023-10-24T00:48:17.016971+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:48:17.016971+0000","last_undegraded":"2023-10-24T00:48:17.016971+0000","last_fullsized":"2023-10-24T00:48:17.016971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542376,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.59899999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.444,"5min":5.444,"15min":5.444},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.34899999999999998},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.372,"5min":0.27400000000000002,"15min":0.246},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":4.0759999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":4.351},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":1.4239999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.70899999999999996,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":11.211,"5min":11.211,"15min":11.211},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.69599999999999995,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.116,"5min":11.116,"15min":11.116},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.217},"max":{"1min":0.68700000000000006,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.83799999999999997,"15min":1.3839999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":1.573},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.81299999999999994,"15min":7.7969999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.88,"15min":1.5029999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.53200000000000003,"15min":0.59299999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":14.597},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.85899999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47299999999999998,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83399999999999996,"15min":7.8559999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":0.80800000000000005,"15min":1.4530000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77500000000000002,"5min":0.82699999999999996,"15min":0.84599999999999997},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.56799999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":7.8929999999999998},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":1.5029999999999999},"last":0.31},{"interface":"front","average":{"1min":0.379,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":3.2519999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.25,"15min":0.25},"max":{"1min":0.55400000000000005,"5min":0.66500000000000004,"15min":1.1890000000000001},"last":0.248}]},{"osd":3,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.43099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":3.2269999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":1.1659999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":1.143},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.89100000000000001,"15min":3.1190000000000002},"last":0.498}]},{"osd":6,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":0.91700000000000004,"15min":3.2010000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.90500000000000003,"15min":1.109},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.628},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.42099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575081,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":0.41399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.215},"max":{"1min":0.504,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.48799999999999999,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.26100000000000001,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.622,"15min":0.67100000000000004},"last":0.378}]},{"osd":4,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.91500000000000004},"last":0.55700000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.876},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.82399999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.35999999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.57199999999999995},"last":0.439},{"interface":"front","average":{"1min":0.37,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.52400000000000002,"5min":0.63,"15min":0.65500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.60099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.747}]},{"osd":5,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.63800000000000001},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":1.083,"15min":1.083},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51000000000000001,"5min":0.59299999999999997,"15min":0.90400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56799999999999995,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.373},"min":{"1min":0.27700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.68799999999999994,"15min":0.79900000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.67600000000000005,"15min":0.86599999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71099999999999997,"5min":0.91900000000000004,"15min":1.024},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":1.0269999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.36399999999999999},"max":{"1min":0.89500000000000002,"5min":0.93999999999999995,"15min":0.995},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":0.996,"15min":1.042},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.121},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.68200000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.74299999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.80700000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.88},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.249},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.627,"5min":0.748,"15min":1.1479999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.23899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0209999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.25800000000000001},"max":{"1min":0.64100000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.26400000000000001},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":1.339},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63400000000000001,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.76400000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.421},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":1.772},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:48:21.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:48:21.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.867+0000 7f93d79de700 1 Processor -- start 2023-10-24T00:48:21.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.867+0000 7f93d79de700 1 -- start start 2023-10-24T00:48:21.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.868+0000 7f93d79de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d01543a0 0x7f93d00a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.868+0000 7f93d79de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93d00a84b0 0x7f93d0095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.868+0000 7f93d79de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d00bf5c0 con 0x7f93d00bfa50 2023-10-24T00:48:21.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.868+0000 7f93d79de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00be9b0 con 0x7f93d00a84b0 2023-10-24T00:48:21.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.868+0000 7f93d79de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00bec90 con 0x7f93d01543a0 2023-10-24T00:48:21.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d577a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d01543a0 0x7f93d00a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93d00a84b0 0x7f93d0095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d5f7b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f93d00bfa50 0x7f93d0158150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:58072/0 (socket says 172.21.15.148:58072) 2023-10-24T00:48:21.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d5f7b700 1 -- 172.21.15.148:0/3131632285 learned_addr learned my addr 172.21.15.148:0/3131632285 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:21.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 -- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d01543a0 msgr2=0x7f93d00a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:21.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 --2- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d01543a0 0x7f93d00a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 -- 172.21.15.148:0/3131632285 >> v1:172.21.15.150:6789/0 conn(0x7f93d00bfa50 legacy=0x7f93d0158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93c7fff700 1 -- 172.21.15.148:0/3131632285 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097828024 0 0) 0x7f93d00bf5c0 con 0x7f93d00bfa50 2023-10-24T00:48:21.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 -- 172.21.15.148:0/3131632285 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00bef70 con 0x7f93d00a84b0 2023-10-24T00:48:21.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93d4f79700 1 --2- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d00a84b0 0x7f93d0095de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f93c0009760 tx=0x7f93c0009060).ready entity=mon.1 client_cookie=e1427720202f8872 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93c7fff700 1 -- 172.21.15.148:0/3131632285 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000b590 con 0x7f93d00a84b0 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93c7fff700 1 -- 172.21.15.148:0/3131632285 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000b6f0 con 0x7f93d00a84b0 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.869+0000 7f93c7fff700 1 -- 172.21.15.148:0/3131632285 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000ba70 con 0x7f93d00a84b0 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 -- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d00a84b0 msgr2=0x7f93d0095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 --2- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d00a84b0 0x7f93d0095de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f93c0009760 tx=0x7f93c0009060).stop 2023-10-24T00:48:21.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 -- 172.21.15.148:0/3131632285 shutdown_connections 2023-10-24T00:48:21.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 --2- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d01543a0 0x7f93d00a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 --2- 172.21.15.148:0/3131632285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d00a84b0 0x7f93d0095de0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 -- 172.21.15.148:0/3131632285 >> 172.21.15.148:0/3131632285 conn(0x7f93d00630f0 msgr2=0x7f93d00c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:21.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 -- 172.21.15.148:0/3131632285 shutdown_connections 2023-10-24T00:48:21.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.870+0000 7f93d79de700 1 -- 172.21.15.148:0/3131632285 wait complete. 2023-10-24T00:48:21.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.871+0000 7f93d79de700 1 Processor -- start 2023-10-24T00:48:21.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.871+0000 7f93d79de700 1 -- start start 2023-10-24T00:48:21.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d00bfa50 0x7f93d0168030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d01543a0 0x7f93d00a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0165e30 con 0x7f93d00a84b0 2023-10-24T00:48:21.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01659d0 con 0x7f93d01543a0 2023-10-24T00:48:21.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d79de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0168520 con 0x7f93d00bfa50 2023-10-24T00:48:21.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37654/0 (socket says 172.21.15.148:37654) 2023-10-24T00:48:21.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 -- 172.21.15.148:0/3037735592 learned_addr learned my addr 172.21.15.148:0/3037735592 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:21.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d5f7b700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d01543a0 0x7f93d00a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d4f79700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d00bfa50 0x7f93d0168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 -- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d00bfa50 msgr2=0x7f93d0168030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d00bfa50 0x7f93d0168030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 -- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d01543a0 msgr2=0x7f93d00a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:21.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d01543a0 0x7f93d00a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:21.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 -- 172.21.15.148:0/3037735592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00092a0 con 0x7f93d00a84b0 2023-10-24T00:48:21.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.872+0000 7f93d577a700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f93cc00e900 tx=0x7f93cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.873+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc012600 con 0x7f93d00a84b0 2023-10-24T00:48:21.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.873+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc012760 con 0x7f93d00a84b0 2023-10-24T00:48:21.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.873+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d0168710 con 0x7f93d00a84b0 2023-10-24T00:48:21.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.873+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc012ae0 con 0x7f93d00a84b0 2023-10-24T00:48:21.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.873+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d0168cd0 con 0x7f93d00a84b0 2023-10-24T00:48:21.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.874+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0165b70 con 0x7f93d00a84b0 2023-10-24T00:48:21.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.874+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f93cc01b400 con 0x7f93d00a84b0 2023-10-24T00:48:21.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.874+0000 7f93c57fa700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 0x7f93b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:21.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.874+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f93cc07a480 con 0x7f93d00a84b0 2023-10-24T00:48:21.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.874+0000 7f93d4f79700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 0x7f93b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:21.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.875+0000 7f93d4f79700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 0x7f93b4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f93c0009760 tx=0x7f93c0017000).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:21.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:21.878+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f93cc04b750 con 0x7f93d00a84b0 2023-10-24T00:48:22.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.040+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93d006c6b0 con 0x7f93b405f150 2023-10-24T00:48:22.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.050+0000 7f93c57fa700 1 -- 172.21.15.148:0/3037735592 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358739 (secure 0 0 0) 0x7f93d006c6b0 con 0x7f93b405f150 2023-10-24T00:48:22.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:22.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 msgr2=0x7f93b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 0x7f93b4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f93c0009760 tx=0x7f93c0017000).stop 2023-10-24T00:48:22.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 msgr2=0x7f93d01654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f93cc00e900 tx=0x7f93cc009060).stop 2023-10-24T00:48:22.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 shutdown_connections 2023-10-24T00:48:22.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93d01543a0 0x7f93d00a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f93b405f150 0x7f93b4061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93d00a84b0 0x7f93d01654e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 --2- 172.21.15.148:0/3037735592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93d00bfa50 0x7f93d0168030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 >> 172.21.15.148:0/3037735592 conn(0x7f93d00630f0 msgr2=0x7f93d00a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:22.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 shutdown_connections 2023-10-24T00:48:22.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.053+0000 7f93d79de700 1 -- 172.21.15.148:0/3037735592 wait complete. 2023-10-24T00:48:22.063 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:48:22.068 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T00:48:21.244016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423012,"kb_used_data":13476,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551708,"statfs":{"total":773094113280,"available":770612948992,"internally_reserved":0,"allocated":13799424,"data_stored":6940365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20022,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-70,"num_write_kb":-46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999602"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023996+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041844+0000","last_change":"2023-10-24T00:48:18.041844+0000","last_active":"2023-10-24T00:48:18.041844+0000","last_peered":"2023-10-24T00:48:18.041844+0000","last_clean":"2023-10-24T00:48:18.041844+0000","last_became_active":"2023-10-24T00:48:18.041589+0000","last_became_peered":"2023-10-24T00:48:18.041589+0000","last_unstale":"2023-10-24T00:48:18.041844+0000","last_undegraded":"2023-10-24T00:48:18.041844+0000","last_fullsized":"2023-10-24T00:48:18.041844+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027068+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.030820+0000","last_change":"2023-10-24T00:48:18.030820+0000","last_active":"2023-10-24T00:48:18.030820+0000","last_peered":"2023-10-24T00:48:18.030820+0000","last_clean":"2023-10-24T00:48:18.030820+0000","last_became_active":"2023-10-24T00:48:18.030482+0000","last_became_peered":"2023-10-24T00:48:18.030482+0000","last_unstale":"2023-10-24T00:48:18.030820+0000","last_undegraded":"2023-10-24T00:48:18.030820+0000","last_fullsized":"2023-10-24T00:48:18.030820+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035546+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039392+0000","last_change":"2023-10-24T00:48:18.039392+0000","last_active":"2023-10-24T00:48:18.039392+0000","last_peered":"2023-10-24T00:48:18.039392+0000","last_clean":"2023-10-24T00:48:18.039392+0000","last_became_active":"2023-10-24T00:48:18.039118+0000","last_became_peered":"2023-10-24T00:48:18.039118+0000","last_unstale":"2023-10-24T00:48:18.039392+0000","last_undegraded":"2023-10-24T00:48:18.039392+0000","last_fullsized":"2023-10-24T00:48:18.039392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024705+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040907+0000","last_change":"2023-10-24T00:48:18.040907+0000","last_active":"2023-10-24T00:48:18.040907+0000","last_peered":"2023-10-24T00:48:18.040907+0000","last_clean":"2023-10-24T00:48:18.040907+0000","last_became_active":"2023-10-24T00:48:18.038648+0000","last_became_peered":"2023-10-24T00:48:18.038648+0000","last_unstale":"2023-10-24T00:48:18.040907+0000","last_undegraded":"2023-10-24T00:48:18.040907+0000","last_fullsized":"2023-10-24T00:48:18.040907+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.036571+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042252+0000","last_change":"2023-10-24T00:48:18.042252+0000","last_active":"2023-10-24T00:48:18.042252+0000","last_peered":"2023-10-24T00:48:18.042252+0000","last_clean":"2023-10-24T00:48:18.042252+0000","last_became_active":"2023-10-24T00:48:18.041992+0000","last_became_peered":"2023-10-24T00:48:18.041992+0000","last_unstale":"2023-10-24T00:48:18.042252+0000","last_undegraded":"2023-10-24T00:48:18.042252+0000","last_fullsized":"2023-10-24T00:48:18.042252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030656+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045400+0000","last_change":"2023-10-24T00:48:18.045400+0000","last_active":"2023-10-24T00:48:18.045400+0000","last_peered":"2023-10-24T00:48:18.045400+0000","last_clean":"2023-10-24T00:48:18.045400+0000","last_became_active":"2023-10-24T00:48:18.045129+0000","last_became_peered":"2023-10-24T00:48:18.045129+0000","last_unstale":"2023-10-24T00:48:18.045400+0000","last_undegraded":"2023-10-24T00:48:18.045400+0000","last_fullsized":"2023-10-24T00:48:18.045400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027408+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043011+0000","last_change":"2023-10-24T00:48:18.043011+0000","last_active":"2023-10-24T00:48:18.043011+0000","last_peered":"2023-10-24T00:48:18.043011+0000","last_clean":"2023-10-24T00:48:18.043011+0000","last_became_active":"2023-10-24T00:48:18.042525+0000","last_became_peered":"2023-10-24T00:48:18.042525+0000","last_unstale":"2023-10-24T00:48:18.043011+0000","last_undegraded":"2023-10-24T00:48:18.043011+0000","last_fullsized":"2023-10-24T00:48:18.043011+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027413+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.032792+0000","last_change":"2023-10-24T00:48:18.032792+0000","last_active":"2023-10-24T00:48:18.032792+0000","last_peered":"2023-10-24T00:48:18.032792+0000","last_clean":"2023-10-24T00:48:18.032792+0000","last_became_active":"2023-10-24T00:48:18.032439+0000","last_became_peered":"2023-10-24T00:48:18.032439+0000","last_unstale":"2023-10-24T00:48:18.032792+0000","last_undegraded":"2023-10-24T00:48:18.032792+0000","last_fullsized":"2023-10-24T00:48:18.032792+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027200+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044386+0000","last_change":"2023-10-24T00:48:18.044386+0000","last_active":"2023-10-24T00:48:18.044386+0000","last_peered":"2023-10-24T00:48:18.044386+0000","last_clean":"2023-10-24T00:48:18.044386+0000","last_became_active":"2023-10-24T00:48:18.044107+0000","last_became_peered":"2023-10-24T00:48:18.044107+0000","last_unstale":"2023-10-24T00:48:18.044386+0000","last_undegraded":"2023-10-24T00:48:18.044386+0000","last_fullsized":"2023-10-24T00:48:18.044386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026459+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048765+0000","last_change":"2023-10-24T00:48:18.048765+0000","last_active":"2023-10-24T00:48:18.048765+0000","last_peered":"2023-10-24T00:48:18.048765+0000","last_clean":"2023-10-24T00:48:18.048765+0000","last_became_active":"2023-10-24T00:48:18.048505+0000","last_became_peered":"2023-10-24T00:48:18.048505+0000","last_unstale":"2023-10-24T00:48:18.048765+0000","last_undegraded":"2023-10-24T00:48:18.048765+0000","last_fullsized":"2023-10-24T00:48:18.048765+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021924+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044999+0000","last_change":"2023-10-24T00:48:18.044999+0000","last_active":"2023-10-24T00:48:18.044999+0000","last_peered":"2023-10-24T00:48:18.044999+0000","last_clean":"2023-10-24T00:48:18.044999+0000","last_became_active":"2023-10-24T00:48:18.044678+0000","last_became_peered":"2023-10-24T00:48:18.044678+0000","last_unstale":"2023-10-24T00:48:18.044999+0000","last_undegraded":"2023-10-24T00:48:18.044999+0000","last_fullsized":"2023-10-24T00:48:18.044999+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025598+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048832+0000","last_change":"2023-10-24T00:48:18.048832+0000","last_active":"2023-10-24T00:48:18.048832+0000","last_peered":"2023-10-24T00:48:18.048832+0000","last_clean":"2023-10-24T00:48:18.048832+0000","last_became_active":"2023-10-24T00:48:18.048558+0000","last_became_peered":"2023-10-24T00:48:18.048558+0000","last_unstale":"2023-10-24T00:48:18.048832+0000","last_undegraded":"2023-10-24T00:48:18.048832+0000","last_fullsized":"2023-10-24T00:48:18.048832+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032346+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036392+0000","last_change":"2023-10-24T00:48:18.036392+0000","last_active":"2023-10-24T00:48:18.036392+0000","last_peered":"2023-10-24T00:48:18.036392+0000","last_clean":"2023-10-24T00:48:18.036392+0000","last_became_active":"2023-10-24T00:48:18.035885+0000","last_became_peered":"2023-10-24T00:48:18.035885+0000","last_unstale":"2023-10-24T00:48:18.036392+0000","last_undegraded":"2023-10-24T00:48:18.036392+0000","last_fullsized":"2023-10-24T00:48:18.036392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041432+0000","last_change":"2023-10-24T00:48:18.041432+0000","last_active":"2023-10-24T00:48:18.041432+0000","last_peered":"2023-10-24T00:48:18.041432+0000","last_clean":"2023-10-24T00:48:18.041432+0000","last_became_active":"2023-10-24T00:48:18.041156+0000","last_became_peered":"2023-10-24T00:48:18.041156+0000","last_unstale":"2023-10-24T00:48:18.041432+0000","last_undegraded":"2023-10-24T00:48:18.041432+0000","last_fullsized":"2023-10-24T00:48:18.041432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.037009+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045461+0000","last_change":"2023-10-24T00:48:18.045461+0000","last_active":"2023-10-24T00:48:18.045461+0000","last_peered":"2023-10-24T00:48:18.045461+0000","last_clean":"2023-10-24T00:48:18.045461+0000","last_became_active":"2023-10-24T00:48:18.045197+0000","last_became_peered":"2023-10-24T00:48:18.045197+0000","last_unstale":"2023-10-24T00:48:18.045461+0000","last_undegraded":"2023-10-24T00:48:18.045461+0000","last_fullsized":"2023-10-24T00:48:18.045461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.022057+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042527+0000","last_change":"2023-10-24T00:48:18.042527+0000","last_active":"2023-10-24T00:48:18.042527+0000","last_peered":"2023-10-24T00:48:18.042527+0000","last_clean":"2023-10-24T00:48:18.042527+0000","last_became_active":"2023-10-24T00:48:18.042217+0000","last_became_peered":"2023-10-24T00:48:18.042217+0000","last_unstale":"2023-10-24T00:48:18.042527+0000","last_undegraded":"2023-10-24T00:48:18.042527+0000","last_fullsized":"2023-10-24T00:48:18.042527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024549+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043145+0000","last_change":"2023-10-24T00:48:18.043145+0000","last_active":"2023-10-24T00:48:18.043145+0000","last_peered":"2023-10-24T00:48:18.043145+0000","last_clean":"2023-10-24T00:48:18.043145+0000","last_became_active":"2023-10-24T00:48:18.042714+0000","last_became_peered":"2023-10-24T00:48:18.042714+0000","last_unstale":"2023-10-24T00:48:18.043145+0000","last_undegraded":"2023-10-24T00:48:18.043145+0000","last_fullsized":"2023-10-24T00:48:18.043145+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.033056+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044605+0000","last_change":"2023-10-24T00:48:18.044605+0000","last_active":"2023-10-24T00:48:18.044605+0000","last_peered":"2023-10-24T00:48:18.044605+0000","last_clean":"2023-10-24T00:48:18.044605+0000","last_became_active":"2023-10-24T00:48:18.044344+0000","last_became_peered":"2023-10-24T00:48:18.044344+0000","last_unstale":"2023-10-24T00:48:18.044605+0000","last_undegraded":"2023-10-24T00:48:18.044605+0000","last_fullsized":"2023-10-24T00:48:18.044605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035160+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045569+0000","last_change":"2023-10-24T00:48:18.045569+0000","last_active":"2023-10-24T00:48:18.045569+0000","last_peered":"2023-10-24T00:48:18.045569+0000","last_clean":"2023-10-24T00:48:18.045569+0000","last_became_active":"2023-10-24T00:48:18.045238+0000","last_became_peered":"2023-10-24T00:48:18.045238+0000","last_unstale":"2023-10-24T00:48:18.045569+0000","last_undegraded":"2023-10-24T00:48:18.045569+0000","last_fullsized":"2023-10-24T00:48:18.045569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037574+0000","last_change":"2023-10-24T00:48:18.037574+0000","last_active":"2023-10-24T00:48:18.037574+0000","last_peered":"2023-10-24T00:48:18.037574+0000","last_clean":"2023-10-24T00:48:18.037574+0000","last_became_active":"2023-10-24T00:48:18.037198+0000","last_became_peered":"2023-10-24T00:48:18.037198+0000","last_unstale":"2023-10-24T00:48:18.037574+0000","last_undegraded":"2023-10-24T00:48:18.037574+0000","last_fullsized":"2023-10-24T00:48:18.037574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039664+0000","last_change":"2023-10-24T00:48:18.039664+0000","last_active":"2023-10-24T00:48:18.039664+0000","last_peered":"2023-10-24T00:48:18.039664+0000","last_clean":"2023-10-24T00:48:18.039664+0000","last_became_active":"2023-10-24T00:48:18.039386+0000","last_became_peered":"2023-10-24T00:48:18.039386+0000","last_unstale":"2023-10-24T00:48:18.039664+0000","last_undegraded":"2023-10-24T00:48:18.039664+0000","last_fullsized":"2023-10-24T00:48:18.039664+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024967+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046440+0000","last_change":"2023-10-24T00:48:18.046440+0000","last_active":"2023-10-24T00:48:18.046440+0000","last_peered":"2023-10-24T00:48:18.046440+0000","last_clean":"2023-10-24T00:48:18.046440+0000","last_became_active":"2023-10-24T00:48:18.046183+0000","last_became_peered":"2023-10-24T00:48:18.046183+0000","last_unstale":"2023-10-24T00:48:18.046440+0000","last_undegraded":"2023-10-24T00:48:18.046440+0000","last_fullsized":"2023-10-24T00:48:18.046440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025410+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036065+0000","last_change":"2023-10-24T00:48:18.036065+0000","last_active":"2023-10-24T00:48:18.036065+0000","last_peered":"2023-10-24T00:48:18.036065+0000","last_clean":"2023-10-24T00:48:18.036065+0000","last_became_active":"2023-10-24T00:48:18.035802+0000","last_became_peered":"2023-10-24T00:48:18.035802+0000","last_unstale":"2023-10-24T00:48:18.036065+0000","last_undegraded":"2023-10-24T00:48:18.036065+0000","last_fullsized":"2023-10-24T00:48:18.036065+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026827+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045033+0000","last_change":"2023-10-24T00:48:18.045033+0000","last_active":"2023-10-24T00:48:18.045033+0000","last_peered":"2023-10-24T00:48:18.045033+0000","last_clean":"2023-10-24T00:48:18.045033+0000","last_became_active":"2023-10-24T00:48:18.044768+0000","last_became_peered":"2023-10-24T00:48:18.044768+0000","last_unstale":"2023-10-24T00:48:18.045033+0000","last_undegraded":"2023-10-24T00:48:18.045033+0000","last_fullsized":"2023-10-24T00:48:18.045033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027881+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044606+0000","last_change":"2023-10-24T00:48:18.044606+0000","last_active":"2023-10-24T00:48:18.044606+0000","last_peered":"2023-10-24T00:48:18.044606+0000","last_clean":"2023-10-24T00:48:18.044606+0000","last_became_active":"2023-10-24T00:48:18.044308+0000","last_became_peered":"2023-10-24T00:48:18.044308+0000","last_unstale":"2023-10-24T00:48:18.044606+0000","last_undegraded":"2023-10-24T00:48:18.044606+0000","last_fullsized":"2023-10-24T00:48:18.044606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032260+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037373+0000","last_change":"2023-10-24T00:48:18.037373+0000","last_active":"2023-10-24T00:48:18.037373+0000","last_peered":"2023-10-24T00:48:18.037373+0000","last_clean":"2023-10-24T00:48:18.037373+0000","last_became_active":"2023-10-24T00:48:18.037110+0000","last_became_peered":"2023-10-24T00:48:18.037110+0000","last_unstale":"2023-10-24T00:48:18.037373+0000","last_undegraded":"2023-10-24T00:48:18.037373+0000","last_fullsized":"2023-10-24T00:48:18.037373+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024906+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036294+0000","last_change":"2023-10-24T00:48:18.036294+0000","last_active":"2023-10-24T00:48:18.036294+0000","last_peered":"2023-10-24T00:48:18.036294+0000","last_clean":"2023-10-24T00:48:18.036294+0000","last_became_active":"2023-10-24T00:48:18.036007+0000","last_became_peered":"2023-10-24T00:48:18.036007+0000","last_unstale":"2023-10-24T00:48:18.036294+0000","last_undegraded":"2023-10-24T00:48:18.036294+0000","last_fullsized":"2023-10-24T00:48:18.036294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028545+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042339+0000","last_change":"2023-10-24T00:48:18.042339+0000","last_active":"2023-10-24T00:48:18.042339+0000","last_peered":"2023-10-24T00:48:18.042339+0000","last_clean":"2023-10-24T00:48:18.042339+0000","last_became_active":"2023-10-24T00:48:18.042104+0000","last_became_peered":"2023-10-24T00:48:18.042104+0000","last_unstale":"2023-10-24T00:48:18.042339+0000","last_undegraded":"2023-10-24T00:48:18.042339+0000","last_fullsized":"2023-10-24T00:48:18.042339+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026821+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039118+0000","last_change":"2023-10-24T00:48:18.039118+0000","last_active":"2023-10-24T00:48:18.039118+0000","last_peered":"2023-10-24T00:48:18.039118+0000","last_clean":"2023-10-24T00:48:18.039118+0000","last_became_active":"2023-10-24T00:48:18.037254+0000","last_became_peered":"2023-10-24T00:48:18.037254+0000","last_unstale":"2023-10-24T00:48:18.039118+0000","last_undegraded":"2023-10-24T00:48:18.039118+0000","last_fullsized":"2023-10-24T00:48:18.039118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028509+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044312+0000","last_change":"2023-10-24T00:48:18.044312+0000","last_active":"2023-10-24T00:48:18.044312+0000","last_peered":"2023-10-24T00:48:18.044312+0000","last_clean":"2023-10-24T00:48:18.044312+0000","last_became_active":"2023-10-24T00:48:18.044028+0000","last_became_peered":"2023-10-24T00:48:18.044028+0000","last_unstale":"2023-10-24T00:48:18.044312+0000","last_undegraded":"2023-10-24T00:48:18.044312+0000","last_fullsized":"2023-10-24T00:48:18.044312+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031588+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037085+0000","last_change":"2023-10-24T00:48:18.037085+0000","last_active":"2023-10-24T00:48:18.037085+0000","last_peered":"2023-10-24T00:48:18.037085+0000","last_clean":"2023-10-24T00:48:18.037085+0000","last_became_active":"2023-10-24T00:48:18.036799+0000","last_became_peered":"2023-10-24T00:48:18.036799+0000","last_unstale":"2023-10-24T00:48:18.037085+0000","last_undegraded":"2023-10-24T00:48:18.037085+0000","last_fullsized":"2023-10-24T00:48:18.037085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025344+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046236+0000","last_change":"2023-10-24T00:48:18.046236+0000","last_active":"2023-10-24T00:48:18.046236+0000","last_peered":"2023-10-24T00:48:18.046236+0000","last_clean":"2023-10-24T00:48:18.046236+0000","last_became_active":"2023-10-24T00:48:18.045972+0000","last_became_peered":"2023-10-24T00:48:18.045972+0000","last_unstale":"2023-10-24T00:48:18.046236+0000","last_undegraded":"2023-10-24T00:48:18.046236+0000","last_fullsized":"2023-10-24T00:48:18.046236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021489+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041889+0000","last_change":"2023-10-24T00:48:18.041889+0000","last_active":"2023-10-24T00:48:18.041889+0000","last_peered":"2023-10-24T00:48:18.041889+0000","last_clean":"2023-10-24T00:48:18.041889+0000","last_became_active":"2023-10-24T00:48:18.041453+0000","last_became_peered":"2023-10-24T00:48:18.041453+0000","last_unstale":"2023-10-24T00:48:18.041889+0000","last_undegraded":"2023-10-24T00:48:18.041889+0000","last_fullsized":"2023-10-24T00:48:18.041889+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025407+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.028828+0000","last_change":"2023-10-24T00:48:18.028828+0000","last_active":"2023-10-24T00:48:18.028828+0000","last_peered":"2023-10-24T00:48:18.028828+0000","last_clean":"2023-10-24T00:48:18.028828+0000","last_became_active":"2023-10-24T00:48:18.028538+0000","last_became_peered":"2023-10-24T00:48:18.028538+0000","last_unstale":"2023-10-24T00:48:18.028828+0000","last_undegraded":"2023-10-24T00:48:18.028828+0000","last_fullsized":"2023-10-24T00:48:18.028828+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028610+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036207+0000","last_change":"2023-10-24T00:48:18.036207+0000","last_active":"2023-10-24T00:48:18.036207+0000","last_peered":"2023-10-24T00:48:18.036207+0000","last_clean":"2023-10-24T00:48:18.036207+0000","last_became_active":"2023-10-24T00:48:18.035820+0000","last_became_peered":"2023-10-24T00:48:18.035820+0000","last_unstale":"2023-10-24T00:48:18.036207+0000","last_undegraded":"2023-10-24T00:48:18.036207+0000","last_fullsized":"2023-10-24T00:48:18.036207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025206+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044718+0000","last_change":"2023-10-24T00:48:18.044718+0000","last_active":"2023-10-24T00:48:18.044718+0000","last_peered":"2023-10-24T00:48:18.044718+0000","last_clean":"2023-10-24T00:48:18.044718+0000","last_became_active":"2023-10-24T00:48:18.044354+0000","last_became_peered":"2023-10-24T00:48:18.044354+0000","last_unstale":"2023-10-24T00:48:18.044718+0000","last_undegraded":"2023-10-24T00:48:18.044718+0000","last_fullsized":"2023-10-24T00:48:18.044718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020925+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044944+0000","last_change":"2023-10-24T00:48:18.044944+0000","last_active":"2023-10-24T00:48:18.044944+0000","last_peered":"2023-10-24T00:48:18.044944+0000","last_clean":"2023-10-24T00:48:18.044944+0000","last_became_active":"2023-10-24T00:48:18.044562+0000","last_became_peered":"2023-10-24T00:48:18.044562+0000","last_unstale":"2023-10-24T00:48:18.044944+0000","last_undegraded":"2023-10-24T00:48:18.044944+0000","last_fullsized":"2023-10-24T00:48:18.044944+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023998+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044302+0000","last_change":"2023-10-24T00:48:18.044302+0000","last_active":"2023-10-24T00:48:18.044302+0000","last_peered":"2023-10-24T00:48:18.044302+0000","last_clean":"2023-10-24T00:48:18.044302+0000","last_became_active":"2023-10-24T00:48:18.044039+0000","last_became_peered":"2023-10-24T00:48:18.044039+0000","last_unstale":"2023-10-24T00:48:18.044302+0000","last_undegraded":"2023-10-24T00:48:18.044302+0000","last_fullsized":"2023-10-24T00:48:18.044302+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030326+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042819+0000","last_change":"2023-10-24T00:48:18.042819+0000","last_active":"2023-10-24T00:48:18.042819+0000","last_peered":"2023-10-24T00:48:18.042819+0000","last_clean":"2023-10-24T00:48:18.042819+0000","last_became_active":"2023-10-24T00:48:18.042239+0000","last_became_peered":"2023-10-24T00:48:18.042239+0000","last_unstale":"2023-10-24T00:48:18.042819+0000","last_undegraded":"2023-10-24T00:48:18.042819+0000","last_fullsized":"2023-10-24T00:48:18.042819+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021457+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038256+0000","last_change":"2023-10-24T00:48:18.038256+0000","last_active":"2023-10-24T00:48:18.038256+0000","last_peered":"2023-10-24T00:48:18.038256+0000","last_clean":"2023-10-24T00:48:18.038256+0000","last_became_active":"2023-10-24T00:48:18.037986+0000","last_became_peered":"2023-10-24T00:48:18.037986+0000","last_unstale":"2023-10-24T00:48:18.038256+0000","last_undegraded":"2023-10-24T00:48:18.038256+0000","last_fullsized":"2023-10-24T00:48:18.038256+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024950+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034708+0000","last_change":"2023-10-24T00:48:18.034708+0000","last_active":"2023-10-24T00:48:18.034708+0000","last_peered":"2023-10-24T00:48:18.034708+0000","last_clean":"2023-10-24T00:48:18.034708+0000","last_became_active":"2023-10-24T00:48:18.034432+0000","last_became_peered":"2023-10-24T00:48:18.034432+0000","last_unstale":"2023-10-24T00:48:18.034708+0000","last_undegraded":"2023-10-24T00:48:18.034708+0000","last_fullsized":"2023-10-24T00:48:18.034708+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026010+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034651+0000","last_change":"2023-10-24T00:48:18.034651+0000","last_active":"2023-10-24T00:48:18.034651+0000","last_peered":"2023-10-24T00:48:18.034651+0000","last_clean":"2023-10-24T00:48:18.034651+0000","last_became_active":"2023-10-24T00:48:18.034361+0000","last_became_peered":"2023-10-24T00:48:18.034361+0000","last_unstale":"2023-10-24T00:48:18.034651+0000","last_undegraded":"2023-10-24T00:48:18.034651+0000","last_fullsized":"2023-10-24T00:48:18.034651+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028433+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038205+0000","last_change":"2023-10-24T00:48:18.038205+0000","last_active":"2023-10-24T00:48:18.038205+0000","last_peered":"2023-10-24T00:48:18.038205+0000","last_clean":"2023-10-24T00:48:18.038205+0000","last_became_active":"2023-10-24T00:48:18.037941+0000","last_became_peered":"2023-10-24T00:48:18.037941+0000","last_unstale":"2023-10-24T00:48:18.038205+0000","last_undegraded":"2023-10-24T00:48:18.038205+0000","last_fullsized":"2023-10-24T00:48:18.038205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025819+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037758+0000","last_change":"2023-10-24T00:48:18.037758+0000","last_active":"2023-10-24T00:48:18.037758+0000","last_peered":"2023-10-24T00:48:18.037758+0000","last_clean":"2023-10-24T00:48:18.037758+0000","last_became_active":"2023-10-24T00:48:18.037479+0000","last_became_peered":"2023-10-24T00:48:18.037479+0000","last_unstale":"2023-10-24T00:48:18.037758+0000","last_undegraded":"2023-10-24T00:48:18.037758+0000","last_fullsized":"2023-10-24T00:48:18.037758+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042438+0000","last_change":"2023-10-24T00:48:18.042438+0000","last_active":"2023-10-24T00:48:18.042438+0000","last_peered":"2023-10-24T00:48:18.042438+0000","last_clean":"2023-10-24T00:48:18.042438+0000","last_became_active":"2023-10-24T00:48:18.042158+0000","last_became_peered":"2023-10-24T00:48:18.042158+0000","last_unstale":"2023-10-24T00:48:18.042438+0000","last_undegraded":"2023-10-24T00:48:18.042438+0000","last_fullsized":"2023-10-24T00:48:18.042438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035675+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039929+0000","last_change":"2023-10-24T00:48:18.039929+0000","last_active":"2023-10-24T00:48:18.039929+0000","last_peered":"2023-10-24T00:48:18.039929+0000","last_clean":"2023-10-24T00:48:18.039929+0000","last_became_active":"2023-10-24T00:48:18.039663+0000","last_became_peered":"2023-10-24T00:48:18.039663+0000","last_unstale":"2023-10-24T00:48:18.039929+0000","last_undegraded":"2023-10-24T00:48:18.039929+0000","last_fullsized":"2023-10-24T00:48:18.039929+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031216+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041939+0000","last_change":"2023-10-24T00:48:18.041939+0000","last_active":"2023-10-24T00:48:18.041939+0000","last_peered":"2023-10-24T00:48:18.041939+0000","last_clean":"2023-10-24T00:48:18.041939+0000","last_became_active":"2023-10-24T00:48:18.041656+0000","last_became_peered":"2023-10-24T00:48:18.041656+0000","last_unstale":"2023-10-24T00:48:18.041939+0000","last_undegraded":"2023-10-24T00:48:18.041939+0000","last_fullsized":"2023-10-24T00:48:18.041939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028088+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.033645+0000","last_change":"2023-10-24T00:48:18.033645+0000","last_active":"2023-10-24T00:48:18.033645+0000","last_peered":"2023-10-24T00:48:18.033645+0000","last_clean":"2023-10-24T00:48:18.033645+0000","last_became_active":"2023-10-24T00:48:18.033340+0000","last_became_peered":"2023-10-24T00:48:18.033340+0000","last_unstale":"2023-10-24T00:48:18.033645+0000","last_undegraded":"2023-10-24T00:48:18.033645+0000","last_fullsized":"2023-10-24T00:48:18.033645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028611+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038704+0000","last_change":"2023-10-24T00:48:18.038704+0000","last_active":"2023-10-24T00:48:18.038704+0000","last_peered":"2023-10-24T00:48:18.038704+0000","last_clean":"2023-10-24T00:48:18.038704+0000","last_became_active":"2023-10-24T00:48:18.038444+0000","last_became_peered":"2023-10-24T00:48:18.038444+0000","last_unstale":"2023-10-24T00:48:18.038704+0000","last_undegraded":"2023-10-24T00:48:18.038704+0000","last_fullsized":"2023-10-24T00:48:18.038704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020858+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043878+0000","last_change":"2023-10-24T00:48:18.043878+0000","last_active":"2023-10-24T00:48:18.043878+0000","last_peered":"2023-10-24T00:48:18.043878+0000","last_clean":"2023-10-24T00:48:18.043878+0000","last_became_active":"2023-10-24T00:48:18.043592+0000","last_became_peered":"2023-10-24T00:48:18.043592+0000","last_unstale":"2023-10-24T00:48:18.043878+0000","last_undegraded":"2023-10-24T00:48:18.043878+0000","last_fullsized":"2023-10-24T00:48:18.043878+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024515+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042080+0000","last_change":"2023-10-24T00:48:18.042080+0000","last_active":"2023-10-24T00:48:18.042080+0000","last_peered":"2023-10-24T00:48:18.042080+0000","last_clean":"2023-10-24T00:48:18.042080+0000","last_became_active":"2023-10-24T00:48:18.040827+0000","last_became_peered":"2023-10-24T00:48:18.040827+0000","last_unstale":"2023-10-24T00:48:18.042080+0000","last_undegraded":"2023-10-24T00:48:18.042080+0000","last_fullsized":"2023-10-24T00:48:18.042080+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025043+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039363+0000","last_change":"2023-10-24T00:48:18.039363+0000","last_active":"2023-10-24T00:48:18.039363+0000","last_peered":"2023-10-24T00:48:18.039363+0000","last_clean":"2023-10-24T00:48:18.039363+0000","last_became_active":"2023-10-24T00:48:18.038320+0000","last_became_peered":"2023-10-24T00:48:18.038320+0000","last_unstale":"2023-10-24T00:48:18.039363+0000","last_undegraded":"2023-10-24T00:48:18.039363+0000","last_fullsized":"2023-10-24T00:48:18.039363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024620+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036842+0000","last_change":"2023-10-24T00:48:18.036842+0000","last_active":"2023-10-24T00:48:18.036842+0000","last_peered":"2023-10-24T00:48:18.036842+0000","last_clean":"2023-10-24T00:48:18.036842+0000","last_became_active":"2023-10-24T00:48:18.035634+0000","last_became_peered":"2023-10-24T00:48:18.035634+0000","last_unstale":"2023-10-24T00:48:18.036842+0000","last_undegraded":"2023-10-24T00:48:18.036842+0000","last_fullsized":"2023-10-24T00:48:18.036842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035307+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038277+0000","last_change":"2023-10-24T00:48:18.038277+0000","last_active":"2023-10-24T00:48:18.038277+0000","last_peered":"2023-10-24T00:48:18.038277+0000","last_clean":"2023-10-24T00:48:18.038277+0000","last_became_active":"2023-10-24T00:48:18.037812+0000","last_became_peered":"2023-10-24T00:48:18.037812+0000","last_unstale":"2023-10-24T00:48:18.038277+0000","last_undegraded":"2023-10-24T00:48:18.038277+0000","last_fullsized":"2023-10-24T00:48:18.038277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025964+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038024+0000","last_change":"2023-10-24T00:48:18.038024+0000","last_active":"2023-10-24T00:48:18.038024+0000","last_peered":"2023-10-24T00:48:18.038024+0000","last_clean":"2023-10-24T00:48:18.038024+0000","last_became_active":"2023-10-24T00:48:18.037740+0000","last_became_peered":"2023-10-24T00:48:18.037740+0000","last_unstale":"2023-10-24T00:48:18.038024+0000","last_undegraded":"2023-10-24T00:48:18.038024+0000","last_fullsized":"2023-10-24T00:48:18.038024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020902+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044227+0000","last_change":"2023-10-24T00:48:18.044227+0000","last_active":"2023-10-24T00:48:18.044227+0000","last_peered":"2023-10-24T00:48:18.044227+0000","last_clean":"2023-10-24T00:48:18.044227+0000","last_became_active":"2023-10-24T00:48:18.043885+0000","last_became_peered":"2023-10-24T00:48:18.043885+0000","last_unstale":"2023-10-24T00:48:18.044227+0000","last_undegraded":"2023-10-24T00:48:18.044227+0000","last_fullsized":"2023-10-24T00:48:18.044227+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031800+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041439+0000","last_change":"2023-10-24T00:48:18.041439+0000","last_active":"2023-10-24T00:48:18.041439+0000","last_peered":"2023-10-24T00:48:18.041439+0000","last_clean":"2023-10-24T00:48:18.041439+0000","last_became_active":"2023-10-24T00:48:18.041068+0000","last_became_peered":"2023-10-24T00:48:18.041068+0000","last_unstale":"2023-10-24T00:48:18.041439+0000","last_undegraded":"2023-10-24T00:48:18.041439+0000","last_fullsized":"2023-10-24T00:48:18.041439+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023794+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:48:17.023794+0000","last_peered":"2023-10-24T00:48:17.023794+0000","last_clean":"2023-10-24T00:48:17.023794+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:48:17.023794+0000","last_undegraded":"2023-10-24T00:48:17.023794+0000","last_fullsized":"2023-10-24T00:48:17.023794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024627+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.047097+0000","last_change":"2023-10-24T00:48:18.047097+0000","last_active":"2023-10-24T00:48:18.047097+0000","last_peered":"2023-10-24T00:48:18.047097+0000","last_clean":"2023-10-24T00:48:18.047097+0000","last_became_active":"2023-10-24T00:48:18.046725+0000","last_became_peered":"2023-10-24T00:48:18.046725+0000","last_unstale":"2023-10-24T00:48:18.047097+0000","last_undegraded":"2023-10-24T00:48:18.047097+0000","last_fullsized":"2023-10-24T00:48:18.047097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013593+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:48:17.013593+0000","last_peered":"2023-10-24T00:48:17.013593+0000","last_clean":"2023-10-24T00:48:17.013593+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:48:17.013593+0000","last_undegraded":"2023-10-24T00:48:17.013593+0000","last_fullsized":"2023-10-24T00:48:17.013593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021006+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040254+0000","last_change":"2023-10-24T00:48:18.040254+0000","last_active":"2023-10-24T00:48:18.040254+0000","last_peered":"2023-10-24T00:48:18.040254+0000","last_clean":"2023-10-24T00:48:18.040254+0000","last_became_active":"2023-10-24T00:48:18.039228+0000","last_became_peered":"2023-10-24T00:48:18.039228+0000","last_unstale":"2023-10-24T00:48:18.040254+0000","last_undegraded":"2023-10-24T00:48:18.040254+0000","last_fullsized":"2023-10-24T00:48:18.040254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.017969+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:48:17.017969+0000","last_peered":"2023-10-24T00:48:17.017969+0000","last_clean":"2023-10-24T00:48:17.017969+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:48:17.017969+0000","last_undegraded":"2023-10-24T00:48:17.017969+0000","last_fullsized":"2023-10-24T00:48:17.017969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026411+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045000+0000","last_change":"2023-10-24T00:48:18.045000+0000","last_active":"2023-10-24T00:48:18.045000+0000","last_peered":"2023-10-24T00:48:18.045000+0000","last_clean":"2023-10-24T00:48:18.045000+0000","last_became_active":"2023-10-24T00:48:18.044728+0000","last_became_peered":"2023-10-24T00:48:18.044728+0000","last_unstale":"2023-10-24T00:48:18.045000+0000","last_undegraded":"2023-10-24T00:48:18.045000+0000","last_fullsized":"2023-10-24T00:48:18.045000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013828+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:48:17.013828+0000","last_peered":"2023-10-24T00:48:17.013828+0000","last_clean":"2023-10-24T00:48:17.013828+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:48:17.013828+0000","last_undegraded":"2023-10-24T00:48:17.013828+0000","last_fullsized":"2023-10-24T00:48:17.013828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015663+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:48:17.015663+0000","last_peered":"2023-10-24T00:48:17.015663+0000","last_clean":"2023-10-24T00:48:17.015663+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:48:17.015663+0000","last_undegraded":"2023-10-24T00:48:17.015663+0000","last_fullsized":"2023-10-24T00:48:17.015663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035409+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045594+0000","last_change":"2023-10-24T00:48:18.045594+0000","last_active":"2023-10-24T00:48:18.045594+0000","last_peered":"2023-10-24T00:48:18.045594+0000","last_clean":"2023-10-24T00:48:18.045594+0000","last_became_active":"2023-10-24T00:48:18.045329+0000","last_became_peered":"2023-10-24T00:48:18.045329+0000","last_unstale":"2023-10-24T00:48:18.045594+0000","last_undegraded":"2023-10-24T00:48:18.045594+0000","last_fullsized":"2023-10-24T00:48:18.045594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015755+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:48:17.015755+0000","last_peered":"2023-10-24T00:48:17.015755+0000","last_clean":"2023-10-24T00:48:17.015755+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:48:17.015755+0000","last_undegraded":"2023-10-24T00:48:17.015755+0000","last_fullsized":"2023-10-24T00:48:17.015755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025941+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045608+0000","last_change":"2023-10-24T00:48:18.045608+0000","last_active":"2023-10-24T00:48:18.045608+0000","last_peered":"2023-10-24T00:48:18.045608+0000","last_clean":"2023-10-24T00:48:18.045608+0000","last_became_active":"2023-10-24T00:48:18.045257+0000","last_became_peered":"2023-10-24T00:48:18.045257+0000","last_unstale":"2023-10-24T00:48:18.045608+0000","last_undegraded":"2023-10-24T00:48:18.045608+0000","last_fullsized":"2023-10-24T00:48:18.045608+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016864+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:48:17.016864+0000","last_peered":"2023-10-24T00:48:17.016864+0000","last_clean":"2023-10-24T00:48:17.016864+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:48:17.016864+0000","last_undegraded":"2023-10-24T00:48:17.016864+0000","last_fullsized":"2023-10-24T00:48:17.016864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027129+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038309+0000","last_change":"2023-10-24T00:48:18.038309+0000","last_active":"2023-10-24T00:48:18.038309+0000","last_peered":"2023-10-24T00:48:18.038309+0000","last_clean":"2023-10-24T00:48:18.038309+0000","last_became_active":"2023-10-24T00:48:18.037990+0000","last_became_peered":"2023-10-24T00:48:18.037990+0000","last_unstale":"2023-10-24T00:48:18.038309+0000","last_undegraded":"2023-10-24T00:48:18.038309+0000","last_fullsized":"2023-10-24T00:48:18.038309+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023810+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:48:17.023810+0000","last_peered":"2023-10-24T00:48:17.023810+0000","last_clean":"2023-10-24T00:48:17.023810+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:48:17.023810+0000","last_undegraded":"2023-10-24T00:48:17.023810+0000","last_fullsized":"2023-10-24T00:48:17.023810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026180+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044172+0000","last_change":"2023-10-24T00:48:18.044172+0000","last_active":"2023-10-24T00:48:18.044172+0000","last_peered":"2023-10-24T00:48:18.044172+0000","last_clean":"2023-10-24T00:48:18.044172+0000","last_became_active":"2023-10-24T00:48:18.043858+0000","last_became_peered":"2023-10-24T00:48:18.043858+0000","last_unstale":"2023-10-24T00:48:18.044172+0000","last_undegraded":"2023-10-24T00:48:18.044172+0000","last_fullsized":"2023-10-24T00:48:18.044172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016971+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:48:17.016971+0000","last_peered":"2023-10-24T00:48:17.016971+0000","last_clean":"2023-10-24T00:48:17.016971+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:48:17.016971+0000","last_undegraded":"2023-10-24T00:48:17.016971+0000","last_fullsized":"2023-10-24T00:48:17.016971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542376,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.59899999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.444,"5min":5.444,"15min":5.444},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.34899999999999998},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.372,"5min":0.27400000000000002,"15min":0.246},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":4.0759999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":4.351},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":1.4239999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.70899999999999996,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":11.211,"5min":11.211,"15min":11.211},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.69599999999999995,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.116,"5min":11.116,"15min":11.116},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.217},"max":{"1min":0.68700000000000006,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.83799999999999997,"15min":1.3839999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":1.573},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.81299999999999994,"15min":7.7969999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.88,"15min":1.5029999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.53200000000000003,"15min":0.59299999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":14.597},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.85899999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47299999999999998,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83399999999999996,"15min":7.8559999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":0.80800000000000005,"15min":1.4530000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77500000000000002,"5min":0.82699999999999996,"15min":0.84599999999999997},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.56799999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":7.8929999999999998},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":1.5029999999999999},"last":0.31},{"interface":"front","average":{"1min":0.379,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":3.2519999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.25,"15min":0.25},"max":{"1min":0.55400000000000005,"5min":0.66500000000000004,"15min":1.1890000000000001},"last":0.248}]},{"osd":3,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.43099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":3.2269999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":1.1659999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":1.143},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.89100000000000001,"15min":3.1190000000000002},"last":0.498}]},{"osd":6,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":0.91700000000000004,"15min":3.2010000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.90500000000000003,"15min":1.109},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.628},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.42099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575081,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":0.41399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.215},"max":{"1min":0.504,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.48799999999999999,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.26100000000000001,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.622,"15min":0.67100000000000004},"last":0.378}]},{"osd":4,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.91500000000000004},"last":0.55700000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.876},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.82399999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.35999999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.57199999999999995},"last":0.439},{"interface":"front","average":{"1min":0.37,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.52400000000000002,"5min":0.63,"15min":0.65500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.60099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.747}]},{"osd":5,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.63800000000000001},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":1.083,"15min":1.083},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51000000000000001,"5min":0.59299999999999997,"15min":0.90400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56799999999999995,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.373},"min":{"1min":0.27700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.68799999999999994,"15min":0.79900000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.67600000000000005,"15min":0.86599999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71099999999999997,"5min":0.91900000000000004,"15min":1.024},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":1.0269999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.36399999999999999},"max":{"1min":0.89500000000000002,"5min":0.93999999999999995,"15min":0.995},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":0.996,"15min":1.042},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.121},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.68200000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.74299999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.80700000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.88},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.249},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.627,"5min":0.748,"15min":1.1479999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.23899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0209999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.25800000000000001},"max":{"1min":0.64100000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.26400000000000001},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":1.339},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63400000000000001,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.76400000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.421},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":1.772},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:48:22.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-10-24T00:48:22.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.023996+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-10-24T00:48:22.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027068+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-10-24T00:48:22.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.035546+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-10-24T00:48:22.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024705+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-10-24T00:48:22.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.036571+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-10-24T00:48:22.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.030656+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-10-24T00:48:22.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027408+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-10-24T00:48:22.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027413+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-10-24T00:48:22.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027200+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-10-24T00:48:22.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026459+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-10-24T00:48:22.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.021924+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-10-24T00:48:22.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025598+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-10-24T00:48:22.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.032346+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-10-24T00:48:22.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024491+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-10-24T00:48:22.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.037009+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-10-24T00:48:22.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.022057+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-10-24T00:48:22.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024549+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:48:22.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-10-24T00:48:22.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.033056+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:48:22.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-10-24T00:48:22.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.035160+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-10-24T00:48:22.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.021491+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-10-24T00:48:22.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027248+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-10-24T00:48:22.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024967+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-10-24T00:48:22.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025410+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-10-24T00:48:22.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026827+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-10-24T00:48:22.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027881+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-10-24T00:48:22.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.032260+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:48:22.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-10-24T00:48:22.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024906+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:48:22.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-10-24T00:48:22.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028545+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-10-24T00:48:22.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026821+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-10-24T00:48:22.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028509+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-10-24T00:48:22.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.031588+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-10-24T00:48:22.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025344+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:48:22.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-10-24T00:48:22.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.021489+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-10-24T00:48:22.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025407+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-10-24T00:48:22.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028610+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-10-24T00:48:22.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025206+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-10-24T00:48:22.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.020925+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-10-24T00:48:22.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.023998+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-10-24T00:48:22.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.030326+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-10-24T00:48:22.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.021457+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-10-24T00:48:22.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024950+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-10-24T00:48:22.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026010+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T00:48:22.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-10-24T00:48:22.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028433+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-10-24T00:48:22.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025819+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-10-24T00:48:22.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026248+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-10-24T00:48:22.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.035675+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-10-24T00:48:22.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.031216+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-10-24T00:48:22.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028088+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-10-24T00:48:22.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.028611+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-10-24T00:48:22.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.020858+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-10-24T00:48:22.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024515+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-10-24T00:48:22.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025043+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:48:22.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-10-24T00:48:22.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024620+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T00:48:22.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-10-24T00:48:22.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.035307+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-10-24T00:48:22.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025964+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-10-24T00:48:22.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.020902+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-10-24T00:48:22.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.031800+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:48:22.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-10-24T00:48:22.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.024627+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T00:48:22.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-10-24T00:48:22.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.021006+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T00:48:22.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-10-24T00:48:22.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026411+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T00:48:22.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-10-24T00:48:22.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.035409+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T00:48:22.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-10-24T00:48:22.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.025941+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-10-24T00:48:22.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.027129+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T00:48:22.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-10-24T00:48:22.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T00:48:18.009713+0000', 'last_change': '2023-10-24T00:48:18.026180+0000', 'last_active': '2023-10-24T00:48:18.009713+0000', 'last_peered': '2023-10-24T00:48:18.009713+0000', 'last_clean': '2023-10-24T00:48:18.009713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T00:48:18.009713+0000', 'last_undegraded': '2023-10-24T00:48:18.009713+0000', 'last_fullsized': '2023-10-24T00:48:18.009713+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'last_clean_scrub_stamp': '2023-10-24T00:48:18.009713+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T00:48:22.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T00:48:22.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.238+0000 7fa925fd3700 1 Processor -- start 2023-10-24T00:48:22.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.238+0000 7fa925fd3700 1 -- start start 2023-10-24T00:48:22.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa925fd3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa9200c07e0 0x7fa9200c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa925fd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa9200c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa925fd3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9200c1180 con 0x7fa9200aa140 2023-10-24T00:48:22.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa925fd3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200c6410 con 0x7fa9200c07e0 2023-10-24T00:48:22.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa925fd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200ca6e0 con 0x7fa9200c68a0 2023-10-24T00:48:22.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa924fd1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9200aa140 0x7fa9200c9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47486/0 (socket says 172.21.15.148:47486) 2023-10-24T00:48:22.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa924fd1700 1 -- 172.21.15.148:0/954296520 learned_addr learned my addr 172.21.15.148:0/954296520 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:22.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa9257d2700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa9200c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa917fff700 1 --2- 172.21.15.148:0/954296520 >> v2:172.21.15.150:3300/0 conn(0x7fa9200c07e0 0x7fa9200c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357786845 0 0) 0x7fa91c001490 con 0x7fa9200aa140 2023-10-24T00:48:22.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.239+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9080033f0 con 0x7fa9200aa140 2023-10-24T00:48:22.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96778064 0 0) 0x7fa9080033f0 con 0x7fa9200aa140 2023-10-24T00:48:22.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 msgr2=0x7fa9200c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa9200c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 >> v2:172.21.15.150:3300/0 conn(0x7fa9200c07e0 msgr2=0x7fa9200c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 --2- 172.21.15.148:0/954296520 >> v2:172.21.15.150:3300/0 conn(0x7fa9200c07e0 0x7fa9200c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200ca9c0 con 0x7fa9200aa140 2023-10-24T00:48:22.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fa91c001980 con 0x7fa9200aa140 2023-10-24T00:48:22.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 >> v1:172.21.15.148:6789/0 conn(0x7fa9200aa140 legacy=0x7fa9200c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa908003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908004690 0x7fa908004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa908005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200c6410 con 0x7fa9080038e0 2023-10-24T00:48:22.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200ca6e0 con 0x7fa908004690 2023-10-24T00:48:22.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90800b8e0 con 0x7fa9200c68a0 2023-10-24T00:48:22.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa917fff700 1 --2- 172.21.15.148:0/954296520 >> v2:172.21.15.150:3300/0 conn(0x7fa9200c07e0 0x7fa9200c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:22.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa908003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9257d2700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa908005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa917fff700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908004690 0x7fa908004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 -- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 msgr2=0x7fa908005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9200c68a0 0x7fa908005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 -- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908004690 msgr2=0x7fa908004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa908004690 0x7fa908004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 -- 172.21.15.148:0/954296520 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080033f0 con 0x7fa9080038e0 2023-10-24T00:48:22.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa924fd1700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa908003d00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fa91c00c6d0 tx=0x7fa91c007c80).ready entity=mon.0 client_cookie=be7c9db4d4bc05e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c005b20 con 0x7fa9080038e0 2023-10-24T00:48:22.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c005c80 con 0x7fa9080038e0 2023-10-24T00:48:22.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.240+0000 7fa9177fe700 1 -- 172.21.15.148:0/954296520 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c007110 con 0x7fa9080038e0 2023-10-24T00:48:22.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 -- 172.21.15.148:0/954296520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 msgr2=0x7fa908003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 --2- 172.21.15.148:0/954296520 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa908003d00 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fa91c00c6d0 tx=0x7fa91c007c80).stop 2023-10-24T00:48:22.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa9257d2700 1 -- 172.21.15.148:0/954296520 reap_dead start 2023-10-24T00:48:22.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 -- 172.21.15.148:0/954296520 shutdown_connections 2023-10-24T00:48:22.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 -- 172.21.15.148:0/954296520 >> 172.21.15.148:0/954296520 conn(0x7fa9200944a0 msgr2=0x7fa92006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:22.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 -- 172.21.15.148:0/954296520 shutdown_connections 2023-10-24T00:48:22.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.241+0000 7fa925fd3700 1 -- 172.21.15.148:0/954296520 wait complete. 2023-10-24T00:48:22.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.242+0000 7fa925fd3700 1 Processor -- start 2023-10-24T00:48:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.242+0000 7fa925fd3700 1 -- start start 2023-10-24T00:48:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 0x7fa9200af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa920152260 0x7fa9201526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa920168b90 con 0x7fa9080038e0 2023-10-24T00:48:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa920152bb0 con 0x7fa9200aa600 2023-10-24T00:48:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa925fd3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa920167fc0 con 0x7fa920152260 2023-10-24T00:48:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37678/0 (socket says 172.21.15.148:37678) 2023-10-24T00:48:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 -- 172.21.15.148:0/1950228158 learned_addr learned my addr 172.21.15.148:0/1950228158 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa917fff700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 0x7fa9200af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa9257d2700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa920152260 0x7fa9201526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 -- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa920152260 msgr2=0x7fa9201526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa920152260 0x7fa9201526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 -- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 msgr2=0x7fa9200af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 0x7fa9200af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 -- 172.21.15.148:0/1950228158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200b0eb0 con 0x7fa9080038e0 2023-10-24T00:48:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa917fff700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 0x7fa9200af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.243+0000 7fa924fd1700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fa908004480 tx=0x7fa91c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.244+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0012d0 con 0x7fa9080038e0 2023-10-24T00:48:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.244+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c001430 con 0x7fa9080038e0 2023-10-24T00:48:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.244+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920168260 con 0x7fa9080038e0 2023-10-24T00:48:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.244+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c007710 con 0x7fa9080038e0 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.244+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa920168820 con 0x7fa9080038e0 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.245+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9201689b0 con 0x7fa9080038e0 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.245+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa91c022470 con 0x7fa9080038e0 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.245+0000 7fa914ff9700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 0x7fa90c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.246+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa91c01c040 con 0x7fa9080038e0 2023-10-24T00:48:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.246+0000 7fa917fff700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 0x7fa90c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.246+0000 7fa917fff700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 0x7fa90c061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa910009270 tx=0x7fa910008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.250+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa91c04cfb0 con 0x7fa9080038e0 2023-10-24T00:48:22.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.475+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa9200c1180 con 0x7fa9080038e0 2023-10-24T00:48:22.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.475+0000 7fa914ff9700 1 -- 172.21.15.148:0/1950228158 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1035 (secure 0 0 0) 0x7fa9200c1180 con 0x7fa9080038e0 2023-10-24T00:48:22.478 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:22.478 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1186,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2481164288,"bytes_avail":770612948992,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":49,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8199}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-24T00:46:46.340067+0000","services":{}},"progress_events":{}} 2023-10-24T00:48:22.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 msgr2=0x7fa90c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 0x7fa90c061640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa910009270 tx=0x7fa910008040).stop 2023-10-24T00:48:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 msgr2=0x7fa9200b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7fa908004480 tx=0x7fa91c015000).stop 2023-10-24T00:48:22.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 shutdown_connections 2023-10-24T00:48:22.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa920152260 0x7fa9201526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa90c05f180 0x7fa90c061640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9080038e0 0x7fa9200b09c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 --2- 172.21.15.148:0/1950228158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9200aa600 0x7fa9200af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 >> 172.21.15.148:0/1950228158 conn(0x7fa9200944a0 msgr2=0x7fa9200c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:22.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 shutdown_connections 2023-10-24T00:48:22.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.477+0000 7fa925fd3700 1 -- 172.21.15.148:0/1950228158 wait complete. 2023-10-24T00:48:22.491 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T00:48:22.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:48:22.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 Processor -- start 2023-10-24T00:48:22.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 -- start start 2023-10-24T00:48:22.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89280aa140 0x7f89280c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280ca110 0x7f89280c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89280c0cd0 0x7f8928157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280c6410 con 0x7f89280c0cd0 2023-10-24T00:48:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280c1140 con 0x7f89280aa140 2023-10-24T00:48:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f892ce47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89280ca6e0 con 0x7f89280ca110 2023-10-24T00:48:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f8927fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89280c0cd0 0x7f8928157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f8927fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89280c0cd0 0x7f8928157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37690/0 (socket says 172.21.15.148:37690) 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f8927fff700 1 -- 172.21.15.148:0/298601138 learned_addr learned my addr 172.21.15.148:0/298601138 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f891ffff700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280ca110 0x7f89280c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.604+0000 7f89277fe700 1 --2- 172.21.15.148:0/298601138 >> v2:172.21.15.150:3300/0 conn(0x7f89280aa140 0x7f89280c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 -- 172.21.15.148:0/298601138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280ca110 msgr2=0x7f89280c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280ca110 0x7f89280c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 -- 172.21.15.148:0/298601138 >> v2:172.21.15.150:3300/0 conn(0x7f89280aa140 msgr2=0x7f89280c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 --2- 172.21.15.148:0/298601138 >> v2:172.21.15.150:3300/0 conn(0x7f89280aa140 0x7f89280c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 -- 172.21.15.148:0/298601138 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280ca9c0 con 0x7f89280c0cd0 2023-10-24T00:48:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8927fff700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280c0cd0 0x7f8928157c00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f8928065670 tx=0x7f8920009840).ready entity=mon.0 client_cookie=9be1fd23b3df03d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8926ffd700 1 -- 172.21.15.148:0/298601138 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000e070 con 0x7f89280c0cd0 2023-10-24T00:48:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8926ffd700 1 -- 172.21.15.148:0/298601138 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000b970 con 0x7f89280c0cd0 2023-10-24T00:48:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f8926ffd700 1 -- 172.21.15.148:0/298601138 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000bcf0 con 0x7f89280c0cd0 2023-10-24T00:48:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 -- 172.21.15.148:0/298601138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280c0cd0 msgr2=0x7f8928157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280c0cd0 0x7f8928157c00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f8928065670 tx=0x7f8920009840).stop 2023-10-24T00:48:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 -- 172.21.15.148:0/298601138 shutdown_connections 2023-10-24T00:48:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280c0cd0 0x7f8928157c00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 --2- 172.21.15.148:0/298601138 >> v2:172.21.15.150:3300/0 conn(0x7f89280aa140 0x7f89280c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 --2- 172.21.15.148:0/298601138 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280ca110 0x7f89280c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 -- 172.21.15.148:0/298601138 >> 172.21.15.148:0/298601138 conn(0x7f89280944a0 msgr2=0x7f892806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 -- 172.21.15.148:0/298601138 shutdown_connections 2023-10-24T00:48:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.605+0000 7f892ce47700 1 -- 172.21.15.148:0/298601138 wait complete. 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.606+0000 7f892ce47700 1 Processor -- start 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 -- start start 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280c0cd0 0x7f89280b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89280ca110 0x7f892813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280ad8b0 con 0x7f89280aa140 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280b0ec0 con 0x7f89280ca110 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f892ce47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8928152ec0 con 0x7f89280c0cd0 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f89277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f89277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37704/0 (socket says 172.21.15.148:37704) 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f89277fe700 1 -- 172.21.15.148:0/2713183233 learned_addr learned my addr 172.21.15.148:0/2713183233 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.607+0000 7f891ffff700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280c0cd0 0x7f89280b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f8927fff700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89280ca110 0x7f892813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 -- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280c0cd0 msgr2=0x7f89280b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280c0cd0 0x7f89280b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 -- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89280ca110 msgr2=0x7f892813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89280ca110 0x7f892813eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 -- 172.21.15.148:0/2713183233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920009ae0 con 0x7f89280aa140 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f89277fe700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f891800e930 tx=0x7f8918009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918012600 con 0x7f89280aa140 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918012760 con 0x7f89280aa140 2023-10-24T00:48:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918012ae0 con 0x7f89280aa140 2023-10-24T00:48:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89280ad420 con 0x7f89280aa140 2023-10-24T00:48:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.608+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280acdd0 con 0x7f89280aa140 2023-10-24T00:48:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.609+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280ad700 con 0x7f89280aa140 2023-10-24T00:48:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.609+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f891801b400 con 0x7f89280aa140 2023-10-24T00:48:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.610+0000 7f891f7fe700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 0x7f8908061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.610+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f891807a6d0 con 0x7f89280aa140 2023-10-24T00:48:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.610+0000 7f891ffff700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 0x7f8908061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.610+0000 7f891ffff700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 0x7f8908061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f89280c4f00 tx=0x7f8910009060).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.614+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f891804b880 con 0x7f89280aa140 2023-10-24T00:48:22.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.771+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8928047480 con 0x7f890805f150 2023-10-24T00:48:22.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.782+0000 7f891f7fe700 1 -- 172.21.15.148:0/2713183233 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358739 (secure 0 0 0) 0x7f8928047480 con 0x7f890805f150 2023-10-24T00:48:22.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:22.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 msgr2=0x7f8908061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 0x7f8908061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f89280c4f00 tx=0x7f8910009060).stop 2023-10-24T00:48:22.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 msgr2=0x7f8928152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f891800e930 tx=0x7f8918009060).stop 2023-10-24T00:48:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 shutdown_connections 2023-10-24T00:48:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89280ca110 0x7f892813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f890805f150 0x7f8908061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89280aa140 0x7f8928152800 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 --2- 172.21.15.148:0/2713183233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89280c0cd0 0x7f89280b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 >> 172.21.15.148:0/2713183233 conn(0x7f89280944a0 msgr2=0x7f89280a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 shutdown_connections 2023-10-24T00:48:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:22.786+0000 7f892ce47700 1 -- 172.21.15.148:0/2713183233 wait complete. 2023-10-24T00:48:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:48:22.799 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T00:48:21.244016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423012,"kb_used_data":13476,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551708,"statfs":{"total":773094113280,"available":770612948992,"internally_reserved":0,"allocated":13799424,"data_stored":6940365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20022,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-70,"num_write_kb":-46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999602"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023996+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041844+0000","last_change":"2023-10-24T00:48:18.041844+0000","last_active":"2023-10-24T00:48:18.041844+0000","last_peered":"2023-10-24T00:48:18.041844+0000","last_clean":"2023-10-24T00:48:18.041844+0000","last_became_active":"2023-10-24T00:48:18.041589+0000","last_became_peered":"2023-10-24T00:48:18.041589+0000","last_unstale":"2023-10-24T00:48:18.041844+0000","last_undegraded":"2023-10-24T00:48:18.041844+0000","last_fullsized":"2023-10-24T00:48:18.041844+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027068+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.030820+0000","last_change":"2023-10-24T00:48:18.030820+0000","last_active":"2023-10-24T00:48:18.030820+0000","last_peered":"2023-10-24T00:48:18.030820+0000","last_clean":"2023-10-24T00:48:18.030820+0000","last_became_active":"2023-10-24T00:48:18.030482+0000","last_became_peered":"2023-10-24T00:48:18.030482+0000","last_unstale":"2023-10-24T00:48:18.030820+0000","last_undegraded":"2023-10-24T00:48:18.030820+0000","last_fullsized":"2023-10-24T00:48:18.030820+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035546+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039392+0000","last_change":"2023-10-24T00:48:18.039392+0000","last_active":"2023-10-24T00:48:18.039392+0000","last_peered":"2023-10-24T00:48:18.039392+0000","last_clean":"2023-10-24T00:48:18.039392+0000","last_became_active":"2023-10-24T00:48:18.039118+0000","last_became_peered":"2023-10-24T00:48:18.039118+0000","last_unstale":"2023-10-24T00:48:18.039392+0000","last_undegraded":"2023-10-24T00:48:18.039392+0000","last_fullsized":"2023-10-24T00:48:18.039392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024705+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040907+0000","last_change":"2023-10-24T00:48:18.040907+0000","last_active":"2023-10-24T00:48:18.040907+0000","last_peered":"2023-10-24T00:48:18.040907+0000","last_clean":"2023-10-24T00:48:18.040907+0000","last_became_active":"2023-10-24T00:48:18.038648+0000","last_became_peered":"2023-10-24T00:48:18.038648+0000","last_unstale":"2023-10-24T00:48:18.040907+0000","last_undegraded":"2023-10-24T00:48:18.040907+0000","last_fullsized":"2023-10-24T00:48:18.040907+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.036571+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042252+0000","last_change":"2023-10-24T00:48:18.042252+0000","last_active":"2023-10-24T00:48:18.042252+0000","last_peered":"2023-10-24T00:48:18.042252+0000","last_clean":"2023-10-24T00:48:18.042252+0000","last_became_active":"2023-10-24T00:48:18.041992+0000","last_became_peered":"2023-10-24T00:48:18.041992+0000","last_unstale":"2023-10-24T00:48:18.042252+0000","last_undegraded":"2023-10-24T00:48:18.042252+0000","last_fullsized":"2023-10-24T00:48:18.042252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030656+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045400+0000","last_change":"2023-10-24T00:48:18.045400+0000","last_active":"2023-10-24T00:48:18.045400+0000","last_peered":"2023-10-24T00:48:18.045400+0000","last_clean":"2023-10-24T00:48:18.045400+0000","last_became_active":"2023-10-24T00:48:18.045129+0000","last_became_peered":"2023-10-24T00:48:18.045129+0000","last_unstale":"2023-10-24T00:48:18.045400+0000","last_undegraded":"2023-10-24T00:48:18.045400+0000","last_fullsized":"2023-10-24T00:48:18.045400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027408+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043011+0000","last_change":"2023-10-24T00:48:18.043011+0000","last_active":"2023-10-24T00:48:18.043011+0000","last_peered":"2023-10-24T00:48:18.043011+0000","last_clean":"2023-10-24T00:48:18.043011+0000","last_became_active":"2023-10-24T00:48:18.042525+0000","last_became_peered":"2023-10-24T00:48:18.042525+0000","last_unstale":"2023-10-24T00:48:18.043011+0000","last_undegraded":"2023-10-24T00:48:18.043011+0000","last_fullsized":"2023-10-24T00:48:18.043011+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027413+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.032792+0000","last_change":"2023-10-24T00:48:18.032792+0000","last_active":"2023-10-24T00:48:18.032792+0000","last_peered":"2023-10-24T00:48:18.032792+0000","last_clean":"2023-10-24T00:48:18.032792+0000","last_became_active":"2023-10-24T00:48:18.032439+0000","last_became_peered":"2023-10-24T00:48:18.032439+0000","last_unstale":"2023-10-24T00:48:18.032792+0000","last_undegraded":"2023-10-24T00:48:18.032792+0000","last_fullsized":"2023-10-24T00:48:18.032792+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027200+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044386+0000","last_change":"2023-10-24T00:48:18.044386+0000","last_active":"2023-10-24T00:48:18.044386+0000","last_peered":"2023-10-24T00:48:18.044386+0000","last_clean":"2023-10-24T00:48:18.044386+0000","last_became_active":"2023-10-24T00:48:18.044107+0000","last_became_peered":"2023-10-24T00:48:18.044107+0000","last_unstale":"2023-10-24T00:48:18.044386+0000","last_undegraded":"2023-10-24T00:48:18.044386+0000","last_fullsized":"2023-10-24T00:48:18.044386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026459+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048765+0000","last_change":"2023-10-24T00:48:18.048765+0000","last_active":"2023-10-24T00:48:18.048765+0000","last_peered":"2023-10-24T00:48:18.048765+0000","last_clean":"2023-10-24T00:48:18.048765+0000","last_became_active":"2023-10-24T00:48:18.048505+0000","last_became_peered":"2023-10-24T00:48:18.048505+0000","last_unstale":"2023-10-24T00:48:18.048765+0000","last_undegraded":"2023-10-24T00:48:18.048765+0000","last_fullsized":"2023-10-24T00:48:18.048765+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021924+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044999+0000","last_change":"2023-10-24T00:48:18.044999+0000","last_active":"2023-10-24T00:48:18.044999+0000","last_peered":"2023-10-24T00:48:18.044999+0000","last_clean":"2023-10-24T00:48:18.044999+0000","last_became_active":"2023-10-24T00:48:18.044678+0000","last_became_peered":"2023-10-24T00:48:18.044678+0000","last_unstale":"2023-10-24T00:48:18.044999+0000","last_undegraded":"2023-10-24T00:48:18.044999+0000","last_fullsized":"2023-10-24T00:48:18.044999+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025598+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.048832+0000","last_change":"2023-10-24T00:48:18.048832+0000","last_active":"2023-10-24T00:48:18.048832+0000","last_peered":"2023-10-24T00:48:18.048832+0000","last_clean":"2023-10-24T00:48:18.048832+0000","last_became_active":"2023-10-24T00:48:18.048558+0000","last_became_peered":"2023-10-24T00:48:18.048558+0000","last_unstale":"2023-10-24T00:48:18.048832+0000","last_undegraded":"2023-10-24T00:48:18.048832+0000","last_fullsized":"2023-10-24T00:48:18.048832+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032346+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036392+0000","last_change":"2023-10-24T00:48:18.036392+0000","last_active":"2023-10-24T00:48:18.036392+0000","last_peered":"2023-10-24T00:48:18.036392+0000","last_clean":"2023-10-24T00:48:18.036392+0000","last_became_active":"2023-10-24T00:48:18.035885+0000","last_became_peered":"2023-10-24T00:48:18.035885+0000","last_unstale":"2023-10-24T00:48:18.036392+0000","last_undegraded":"2023-10-24T00:48:18.036392+0000","last_fullsized":"2023-10-24T00:48:18.036392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041432+0000","last_change":"2023-10-24T00:48:18.041432+0000","last_active":"2023-10-24T00:48:18.041432+0000","last_peered":"2023-10-24T00:48:18.041432+0000","last_clean":"2023-10-24T00:48:18.041432+0000","last_became_active":"2023-10-24T00:48:18.041156+0000","last_became_peered":"2023-10-24T00:48:18.041156+0000","last_unstale":"2023-10-24T00:48:18.041432+0000","last_undegraded":"2023-10-24T00:48:18.041432+0000","last_fullsized":"2023-10-24T00:48:18.041432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.037009+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045461+0000","last_change":"2023-10-24T00:48:18.045461+0000","last_active":"2023-10-24T00:48:18.045461+0000","last_peered":"2023-10-24T00:48:18.045461+0000","last_clean":"2023-10-24T00:48:18.045461+0000","last_became_active":"2023-10-24T00:48:18.045197+0000","last_became_peered":"2023-10-24T00:48:18.045197+0000","last_unstale":"2023-10-24T00:48:18.045461+0000","last_undegraded":"2023-10-24T00:48:18.045461+0000","last_fullsized":"2023-10-24T00:48:18.045461+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.022057+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042527+0000","last_change":"2023-10-24T00:48:18.042527+0000","last_active":"2023-10-24T00:48:18.042527+0000","last_peered":"2023-10-24T00:48:18.042527+0000","last_clean":"2023-10-24T00:48:18.042527+0000","last_became_active":"2023-10-24T00:48:18.042217+0000","last_became_peered":"2023-10-24T00:48:18.042217+0000","last_unstale":"2023-10-24T00:48:18.042527+0000","last_undegraded":"2023-10-24T00:48:18.042527+0000","last_fullsized":"2023-10-24T00:48:18.042527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024549+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043145+0000","last_change":"2023-10-24T00:48:18.043145+0000","last_active":"2023-10-24T00:48:18.043145+0000","last_peered":"2023-10-24T00:48:18.043145+0000","last_clean":"2023-10-24T00:48:18.043145+0000","last_became_active":"2023-10-24T00:48:18.042714+0000","last_became_peered":"2023-10-24T00:48:18.042714+0000","last_unstale":"2023-10-24T00:48:18.043145+0000","last_undegraded":"2023-10-24T00:48:18.043145+0000","last_fullsized":"2023-10-24T00:48:18.043145+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.033056+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044605+0000","last_change":"2023-10-24T00:48:18.044605+0000","last_active":"2023-10-24T00:48:18.044605+0000","last_peered":"2023-10-24T00:48:18.044605+0000","last_clean":"2023-10-24T00:48:18.044605+0000","last_became_active":"2023-10-24T00:48:18.044344+0000","last_became_peered":"2023-10-24T00:48:18.044344+0000","last_unstale":"2023-10-24T00:48:18.044605+0000","last_undegraded":"2023-10-24T00:48:18.044605+0000","last_fullsized":"2023-10-24T00:48:18.044605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035160+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045569+0000","last_change":"2023-10-24T00:48:18.045569+0000","last_active":"2023-10-24T00:48:18.045569+0000","last_peered":"2023-10-24T00:48:18.045569+0000","last_clean":"2023-10-24T00:48:18.045569+0000","last_became_active":"2023-10-24T00:48:18.045238+0000","last_became_peered":"2023-10-24T00:48:18.045238+0000","last_unstale":"2023-10-24T00:48:18.045569+0000","last_undegraded":"2023-10-24T00:48:18.045569+0000","last_fullsized":"2023-10-24T00:48:18.045569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021491+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037574+0000","last_change":"2023-10-24T00:48:18.037574+0000","last_active":"2023-10-24T00:48:18.037574+0000","last_peered":"2023-10-24T00:48:18.037574+0000","last_clean":"2023-10-24T00:48:18.037574+0000","last_became_active":"2023-10-24T00:48:18.037198+0000","last_became_peered":"2023-10-24T00:48:18.037198+0000","last_unstale":"2023-10-24T00:48:18.037574+0000","last_undegraded":"2023-10-24T00:48:18.037574+0000","last_fullsized":"2023-10-24T00:48:18.037574+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039664+0000","last_change":"2023-10-24T00:48:18.039664+0000","last_active":"2023-10-24T00:48:18.039664+0000","last_peered":"2023-10-24T00:48:18.039664+0000","last_clean":"2023-10-24T00:48:18.039664+0000","last_became_active":"2023-10-24T00:48:18.039386+0000","last_became_peered":"2023-10-24T00:48:18.039386+0000","last_unstale":"2023-10-24T00:48:18.039664+0000","last_undegraded":"2023-10-24T00:48:18.039664+0000","last_fullsized":"2023-10-24T00:48:18.039664+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024967+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046440+0000","last_change":"2023-10-24T00:48:18.046440+0000","last_active":"2023-10-24T00:48:18.046440+0000","last_peered":"2023-10-24T00:48:18.046440+0000","last_clean":"2023-10-24T00:48:18.046440+0000","last_became_active":"2023-10-24T00:48:18.046183+0000","last_became_peered":"2023-10-24T00:48:18.046183+0000","last_unstale":"2023-10-24T00:48:18.046440+0000","last_undegraded":"2023-10-24T00:48:18.046440+0000","last_fullsized":"2023-10-24T00:48:18.046440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025410+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036065+0000","last_change":"2023-10-24T00:48:18.036065+0000","last_active":"2023-10-24T00:48:18.036065+0000","last_peered":"2023-10-24T00:48:18.036065+0000","last_clean":"2023-10-24T00:48:18.036065+0000","last_became_active":"2023-10-24T00:48:18.035802+0000","last_became_peered":"2023-10-24T00:48:18.035802+0000","last_unstale":"2023-10-24T00:48:18.036065+0000","last_undegraded":"2023-10-24T00:48:18.036065+0000","last_fullsized":"2023-10-24T00:48:18.036065+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026827+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045033+0000","last_change":"2023-10-24T00:48:18.045033+0000","last_active":"2023-10-24T00:48:18.045033+0000","last_peered":"2023-10-24T00:48:18.045033+0000","last_clean":"2023-10-24T00:48:18.045033+0000","last_became_active":"2023-10-24T00:48:18.044768+0000","last_became_peered":"2023-10-24T00:48:18.044768+0000","last_unstale":"2023-10-24T00:48:18.045033+0000","last_undegraded":"2023-10-24T00:48:18.045033+0000","last_fullsized":"2023-10-24T00:48:18.045033+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027881+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044606+0000","last_change":"2023-10-24T00:48:18.044606+0000","last_active":"2023-10-24T00:48:18.044606+0000","last_peered":"2023-10-24T00:48:18.044606+0000","last_clean":"2023-10-24T00:48:18.044606+0000","last_became_active":"2023-10-24T00:48:18.044308+0000","last_became_peered":"2023-10-24T00:48:18.044308+0000","last_unstale":"2023-10-24T00:48:18.044606+0000","last_undegraded":"2023-10-24T00:48:18.044606+0000","last_fullsized":"2023-10-24T00:48:18.044606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.032260+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037373+0000","last_change":"2023-10-24T00:48:18.037373+0000","last_active":"2023-10-24T00:48:18.037373+0000","last_peered":"2023-10-24T00:48:18.037373+0000","last_clean":"2023-10-24T00:48:18.037373+0000","last_became_active":"2023-10-24T00:48:18.037110+0000","last_became_peered":"2023-10-24T00:48:18.037110+0000","last_unstale":"2023-10-24T00:48:18.037373+0000","last_undegraded":"2023-10-24T00:48:18.037373+0000","last_fullsized":"2023-10-24T00:48:18.037373+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024906+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036294+0000","last_change":"2023-10-24T00:48:18.036294+0000","last_active":"2023-10-24T00:48:18.036294+0000","last_peered":"2023-10-24T00:48:18.036294+0000","last_clean":"2023-10-24T00:48:18.036294+0000","last_became_active":"2023-10-24T00:48:18.036007+0000","last_became_peered":"2023-10-24T00:48:18.036007+0000","last_unstale":"2023-10-24T00:48:18.036294+0000","last_undegraded":"2023-10-24T00:48:18.036294+0000","last_fullsized":"2023-10-24T00:48:18.036294+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028545+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042339+0000","last_change":"2023-10-24T00:48:18.042339+0000","last_active":"2023-10-24T00:48:18.042339+0000","last_peered":"2023-10-24T00:48:18.042339+0000","last_clean":"2023-10-24T00:48:18.042339+0000","last_became_active":"2023-10-24T00:48:18.042104+0000","last_became_peered":"2023-10-24T00:48:18.042104+0000","last_unstale":"2023-10-24T00:48:18.042339+0000","last_undegraded":"2023-10-24T00:48:18.042339+0000","last_fullsized":"2023-10-24T00:48:18.042339+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026821+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039118+0000","last_change":"2023-10-24T00:48:18.039118+0000","last_active":"2023-10-24T00:48:18.039118+0000","last_peered":"2023-10-24T00:48:18.039118+0000","last_clean":"2023-10-24T00:48:18.039118+0000","last_became_active":"2023-10-24T00:48:18.037254+0000","last_became_peered":"2023-10-24T00:48:18.037254+0000","last_unstale":"2023-10-24T00:48:18.039118+0000","last_undegraded":"2023-10-24T00:48:18.039118+0000","last_fullsized":"2023-10-24T00:48:18.039118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028509+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044312+0000","last_change":"2023-10-24T00:48:18.044312+0000","last_active":"2023-10-24T00:48:18.044312+0000","last_peered":"2023-10-24T00:48:18.044312+0000","last_clean":"2023-10-24T00:48:18.044312+0000","last_became_active":"2023-10-24T00:48:18.044028+0000","last_became_peered":"2023-10-24T00:48:18.044028+0000","last_unstale":"2023-10-24T00:48:18.044312+0000","last_undegraded":"2023-10-24T00:48:18.044312+0000","last_fullsized":"2023-10-24T00:48:18.044312+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031588+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037085+0000","last_change":"2023-10-24T00:48:18.037085+0000","last_active":"2023-10-24T00:48:18.037085+0000","last_peered":"2023-10-24T00:48:18.037085+0000","last_clean":"2023-10-24T00:48:18.037085+0000","last_became_active":"2023-10-24T00:48:18.036799+0000","last_became_peered":"2023-10-24T00:48:18.036799+0000","last_unstale":"2023-10-24T00:48:18.037085+0000","last_undegraded":"2023-10-24T00:48:18.037085+0000","last_fullsized":"2023-10-24T00:48:18.037085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025344+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.046236+0000","last_change":"2023-10-24T00:48:18.046236+0000","last_active":"2023-10-24T00:48:18.046236+0000","last_peered":"2023-10-24T00:48:18.046236+0000","last_clean":"2023-10-24T00:48:18.046236+0000","last_became_active":"2023-10-24T00:48:18.045972+0000","last_became_peered":"2023-10-24T00:48:18.045972+0000","last_unstale":"2023-10-24T00:48:18.046236+0000","last_undegraded":"2023-10-24T00:48:18.046236+0000","last_fullsized":"2023-10-24T00:48:18.046236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021489+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041889+0000","last_change":"2023-10-24T00:48:18.041889+0000","last_active":"2023-10-24T00:48:18.041889+0000","last_peered":"2023-10-24T00:48:18.041889+0000","last_clean":"2023-10-24T00:48:18.041889+0000","last_became_active":"2023-10-24T00:48:18.041453+0000","last_became_peered":"2023-10-24T00:48:18.041453+0000","last_unstale":"2023-10-24T00:48:18.041889+0000","last_undegraded":"2023-10-24T00:48:18.041889+0000","last_fullsized":"2023-10-24T00:48:18.041889+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025407+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.028828+0000","last_change":"2023-10-24T00:48:18.028828+0000","last_active":"2023-10-24T00:48:18.028828+0000","last_peered":"2023-10-24T00:48:18.028828+0000","last_clean":"2023-10-24T00:48:18.028828+0000","last_became_active":"2023-10-24T00:48:18.028538+0000","last_became_peered":"2023-10-24T00:48:18.028538+0000","last_unstale":"2023-10-24T00:48:18.028828+0000","last_undegraded":"2023-10-24T00:48:18.028828+0000","last_fullsized":"2023-10-24T00:48:18.028828+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028610+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036207+0000","last_change":"2023-10-24T00:48:18.036207+0000","last_active":"2023-10-24T00:48:18.036207+0000","last_peered":"2023-10-24T00:48:18.036207+0000","last_clean":"2023-10-24T00:48:18.036207+0000","last_became_active":"2023-10-24T00:48:18.035820+0000","last_became_peered":"2023-10-24T00:48:18.035820+0000","last_unstale":"2023-10-24T00:48:18.036207+0000","last_undegraded":"2023-10-24T00:48:18.036207+0000","last_fullsized":"2023-10-24T00:48:18.036207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025206+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044718+0000","last_change":"2023-10-24T00:48:18.044718+0000","last_active":"2023-10-24T00:48:18.044718+0000","last_peered":"2023-10-24T00:48:18.044718+0000","last_clean":"2023-10-24T00:48:18.044718+0000","last_became_active":"2023-10-24T00:48:18.044354+0000","last_became_peered":"2023-10-24T00:48:18.044354+0000","last_unstale":"2023-10-24T00:48:18.044718+0000","last_undegraded":"2023-10-24T00:48:18.044718+0000","last_fullsized":"2023-10-24T00:48:18.044718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020925+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044944+0000","last_change":"2023-10-24T00:48:18.044944+0000","last_active":"2023-10-24T00:48:18.044944+0000","last_peered":"2023-10-24T00:48:18.044944+0000","last_clean":"2023-10-24T00:48:18.044944+0000","last_became_active":"2023-10-24T00:48:18.044562+0000","last_became_peered":"2023-10-24T00:48:18.044562+0000","last_unstale":"2023-10-24T00:48:18.044944+0000","last_undegraded":"2023-10-24T00:48:18.044944+0000","last_fullsized":"2023-10-24T00:48:18.044944+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.023998+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044302+0000","last_change":"2023-10-24T00:48:18.044302+0000","last_active":"2023-10-24T00:48:18.044302+0000","last_peered":"2023-10-24T00:48:18.044302+0000","last_clean":"2023-10-24T00:48:18.044302+0000","last_became_active":"2023-10-24T00:48:18.044039+0000","last_became_peered":"2023-10-24T00:48:18.044039+0000","last_unstale":"2023-10-24T00:48:18.044302+0000","last_undegraded":"2023-10-24T00:48:18.044302+0000","last_fullsized":"2023-10-24T00:48:18.044302+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.030326+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042819+0000","last_change":"2023-10-24T00:48:18.042819+0000","last_active":"2023-10-24T00:48:18.042819+0000","last_peered":"2023-10-24T00:48:18.042819+0000","last_clean":"2023-10-24T00:48:18.042819+0000","last_became_active":"2023-10-24T00:48:18.042239+0000","last_became_peered":"2023-10-24T00:48:18.042239+0000","last_unstale":"2023-10-24T00:48:18.042819+0000","last_undegraded":"2023-10-24T00:48:18.042819+0000","last_fullsized":"2023-10-24T00:48:18.042819+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021457+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038256+0000","last_change":"2023-10-24T00:48:18.038256+0000","last_active":"2023-10-24T00:48:18.038256+0000","last_peered":"2023-10-24T00:48:18.038256+0000","last_clean":"2023-10-24T00:48:18.038256+0000","last_became_active":"2023-10-24T00:48:18.037986+0000","last_became_peered":"2023-10-24T00:48:18.037986+0000","last_unstale":"2023-10-24T00:48:18.038256+0000","last_undegraded":"2023-10-24T00:48:18.038256+0000","last_fullsized":"2023-10-24T00:48:18.038256+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024950+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034708+0000","last_change":"2023-10-24T00:48:18.034708+0000","last_active":"2023-10-24T00:48:18.034708+0000","last_peered":"2023-10-24T00:48:18.034708+0000","last_clean":"2023-10-24T00:48:18.034708+0000","last_became_active":"2023-10-24T00:48:18.034432+0000","last_became_peered":"2023-10-24T00:48:18.034432+0000","last_unstale":"2023-10-24T00:48:18.034708+0000","last_undegraded":"2023-10-24T00:48:18.034708+0000","last_fullsized":"2023-10-24T00:48:18.034708+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026010+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.034651+0000","last_change":"2023-10-24T00:48:18.034651+0000","last_active":"2023-10-24T00:48:18.034651+0000","last_peered":"2023-10-24T00:48:18.034651+0000","last_clean":"2023-10-24T00:48:18.034651+0000","last_became_active":"2023-10-24T00:48:18.034361+0000","last_became_peered":"2023-10-24T00:48:18.034361+0000","last_unstale":"2023-10-24T00:48:18.034651+0000","last_undegraded":"2023-10-24T00:48:18.034651+0000","last_fullsized":"2023-10-24T00:48:18.034651+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028433+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038205+0000","last_change":"2023-10-24T00:48:18.038205+0000","last_active":"2023-10-24T00:48:18.038205+0000","last_peered":"2023-10-24T00:48:18.038205+0000","last_clean":"2023-10-24T00:48:18.038205+0000","last_became_active":"2023-10-24T00:48:18.037941+0000","last_became_peered":"2023-10-24T00:48:18.037941+0000","last_unstale":"2023-10-24T00:48:18.038205+0000","last_undegraded":"2023-10-24T00:48:18.038205+0000","last_fullsized":"2023-10-24T00:48:18.038205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025819+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.037758+0000","last_change":"2023-10-24T00:48:18.037758+0000","last_active":"2023-10-24T00:48:18.037758+0000","last_peered":"2023-10-24T00:48:18.037758+0000","last_clean":"2023-10-24T00:48:18.037758+0000","last_became_active":"2023-10-24T00:48:18.037479+0000","last_became_peered":"2023-10-24T00:48:18.037479+0000","last_unstale":"2023-10-24T00:48:18.037758+0000","last_undegraded":"2023-10-24T00:48:18.037758+0000","last_fullsized":"2023-10-24T00:48:18.037758+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026248+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042438+0000","last_change":"2023-10-24T00:48:18.042438+0000","last_active":"2023-10-24T00:48:18.042438+0000","last_peered":"2023-10-24T00:48:18.042438+0000","last_clean":"2023-10-24T00:48:18.042438+0000","last_became_active":"2023-10-24T00:48:18.042158+0000","last_became_peered":"2023-10-24T00:48:18.042158+0000","last_unstale":"2023-10-24T00:48:18.042438+0000","last_undegraded":"2023-10-24T00:48:18.042438+0000","last_fullsized":"2023-10-24T00:48:18.042438+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035675+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039929+0000","last_change":"2023-10-24T00:48:18.039929+0000","last_active":"2023-10-24T00:48:18.039929+0000","last_peered":"2023-10-24T00:48:18.039929+0000","last_clean":"2023-10-24T00:48:18.039929+0000","last_became_active":"2023-10-24T00:48:18.039663+0000","last_became_peered":"2023-10-24T00:48:18.039663+0000","last_unstale":"2023-10-24T00:48:18.039929+0000","last_undegraded":"2023-10-24T00:48:18.039929+0000","last_fullsized":"2023-10-24T00:48:18.039929+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031216+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041939+0000","last_change":"2023-10-24T00:48:18.041939+0000","last_active":"2023-10-24T00:48:18.041939+0000","last_peered":"2023-10-24T00:48:18.041939+0000","last_clean":"2023-10-24T00:48:18.041939+0000","last_became_active":"2023-10-24T00:48:18.041656+0000","last_became_peered":"2023-10-24T00:48:18.041656+0000","last_unstale":"2023-10-24T00:48:18.041939+0000","last_undegraded":"2023-10-24T00:48:18.041939+0000","last_fullsized":"2023-10-24T00:48:18.041939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028088+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.033645+0000","last_change":"2023-10-24T00:48:18.033645+0000","last_active":"2023-10-24T00:48:18.033645+0000","last_peered":"2023-10-24T00:48:18.033645+0000","last_clean":"2023-10-24T00:48:18.033645+0000","last_became_active":"2023-10-24T00:48:18.033340+0000","last_became_peered":"2023-10-24T00:48:18.033340+0000","last_unstale":"2023-10-24T00:48:18.033645+0000","last_undegraded":"2023-10-24T00:48:18.033645+0000","last_fullsized":"2023-10-24T00:48:18.033645+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.028611+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038704+0000","last_change":"2023-10-24T00:48:18.038704+0000","last_active":"2023-10-24T00:48:18.038704+0000","last_peered":"2023-10-24T00:48:18.038704+0000","last_clean":"2023-10-24T00:48:18.038704+0000","last_became_active":"2023-10-24T00:48:18.038444+0000","last_became_peered":"2023-10-24T00:48:18.038444+0000","last_unstale":"2023-10-24T00:48:18.038704+0000","last_undegraded":"2023-10-24T00:48:18.038704+0000","last_fullsized":"2023-10-24T00:48:18.038704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020858+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.043878+0000","last_change":"2023-10-24T00:48:18.043878+0000","last_active":"2023-10-24T00:48:18.043878+0000","last_peered":"2023-10-24T00:48:18.043878+0000","last_clean":"2023-10-24T00:48:18.043878+0000","last_became_active":"2023-10-24T00:48:18.043592+0000","last_became_peered":"2023-10-24T00:48:18.043592+0000","last_unstale":"2023-10-24T00:48:18.043878+0000","last_undegraded":"2023-10-24T00:48:18.043878+0000","last_fullsized":"2023-10-24T00:48:18.043878+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024515+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.042080+0000","last_change":"2023-10-24T00:48:18.042080+0000","last_active":"2023-10-24T00:48:18.042080+0000","last_peered":"2023-10-24T00:48:18.042080+0000","last_clean":"2023-10-24T00:48:18.042080+0000","last_became_active":"2023-10-24T00:48:18.040827+0000","last_became_peered":"2023-10-24T00:48:18.040827+0000","last_unstale":"2023-10-24T00:48:18.042080+0000","last_undegraded":"2023-10-24T00:48:18.042080+0000","last_fullsized":"2023-10-24T00:48:18.042080+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025043+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.039363+0000","last_change":"2023-10-24T00:48:18.039363+0000","last_active":"2023-10-24T00:48:18.039363+0000","last_peered":"2023-10-24T00:48:18.039363+0000","last_clean":"2023-10-24T00:48:18.039363+0000","last_became_active":"2023-10-24T00:48:18.038320+0000","last_became_peered":"2023-10-24T00:48:18.038320+0000","last_unstale":"2023-10-24T00:48:18.039363+0000","last_undegraded":"2023-10-24T00:48:18.039363+0000","last_fullsized":"2023-10-24T00:48:18.039363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024620+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.036842+0000","last_change":"2023-10-24T00:48:18.036842+0000","last_active":"2023-10-24T00:48:18.036842+0000","last_peered":"2023-10-24T00:48:18.036842+0000","last_clean":"2023-10-24T00:48:18.036842+0000","last_became_active":"2023-10-24T00:48:18.035634+0000","last_became_peered":"2023-10-24T00:48:18.035634+0000","last_unstale":"2023-10-24T00:48:18.036842+0000","last_undegraded":"2023-10-24T00:48:18.036842+0000","last_fullsized":"2023-10-24T00:48:18.036842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035307+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038277+0000","last_change":"2023-10-24T00:48:18.038277+0000","last_active":"2023-10-24T00:48:18.038277+0000","last_peered":"2023-10-24T00:48:18.038277+0000","last_clean":"2023-10-24T00:48:18.038277+0000","last_became_active":"2023-10-24T00:48:18.037812+0000","last_became_peered":"2023-10-24T00:48:18.037812+0000","last_unstale":"2023-10-24T00:48:18.038277+0000","last_undegraded":"2023-10-24T00:48:18.038277+0000","last_fullsized":"2023-10-24T00:48:18.038277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025964+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038024+0000","last_change":"2023-10-24T00:48:18.038024+0000","last_active":"2023-10-24T00:48:18.038024+0000","last_peered":"2023-10-24T00:48:18.038024+0000","last_clean":"2023-10-24T00:48:18.038024+0000","last_became_active":"2023-10-24T00:48:18.037740+0000","last_became_peered":"2023-10-24T00:48:18.037740+0000","last_unstale":"2023-10-24T00:48:18.038024+0000","last_undegraded":"2023-10-24T00:48:18.038024+0000","last_fullsized":"2023-10-24T00:48:18.038024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.020902+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044227+0000","last_change":"2023-10-24T00:48:18.044227+0000","last_active":"2023-10-24T00:48:18.044227+0000","last_peered":"2023-10-24T00:48:18.044227+0000","last_clean":"2023-10-24T00:48:18.044227+0000","last_became_active":"2023-10-24T00:48:18.043885+0000","last_became_peered":"2023-10-24T00:48:18.043885+0000","last_unstale":"2023-10-24T00:48:18.044227+0000","last_undegraded":"2023-10-24T00:48:18.044227+0000","last_fullsized":"2023-10-24T00:48:18.044227+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.031800+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.041439+0000","last_change":"2023-10-24T00:48:18.041439+0000","last_active":"2023-10-24T00:48:18.041439+0000","last_peered":"2023-10-24T00:48:18.041439+0000","last_clean":"2023-10-24T00:48:18.041439+0000","last_became_active":"2023-10-24T00:48:18.041068+0000","last_became_peered":"2023-10-24T00:48:18.041068+0000","last_unstale":"2023-10-24T00:48:18.041439+0000","last_undegraded":"2023-10-24T00:48:18.041439+0000","last_fullsized":"2023-10-24T00:48:18.041439+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023794+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:48:17.023794+0000","last_peered":"2023-10-24T00:48:17.023794+0000","last_clean":"2023-10-24T00:48:17.023794+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:48:17.023794+0000","last_undegraded":"2023-10-24T00:48:17.023794+0000","last_fullsized":"2023-10-24T00:48:17.023794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.024627+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.047097+0000","last_change":"2023-10-24T00:48:18.047097+0000","last_active":"2023-10-24T00:48:18.047097+0000","last_peered":"2023-10-24T00:48:18.047097+0000","last_clean":"2023-10-24T00:48:18.047097+0000","last_became_active":"2023-10-24T00:48:18.046725+0000","last_became_peered":"2023-10-24T00:48:18.046725+0000","last_unstale":"2023-10-24T00:48:18.047097+0000","last_undegraded":"2023-10-24T00:48:18.047097+0000","last_fullsized":"2023-10-24T00:48:18.047097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013593+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:48:17.013593+0000","last_peered":"2023-10-24T00:48:17.013593+0000","last_clean":"2023-10-24T00:48:17.013593+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:48:17.013593+0000","last_undegraded":"2023-10-24T00:48:17.013593+0000","last_fullsized":"2023-10-24T00:48:17.013593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.021006+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.040254+0000","last_change":"2023-10-24T00:48:18.040254+0000","last_active":"2023-10-24T00:48:18.040254+0000","last_peered":"2023-10-24T00:48:18.040254+0000","last_clean":"2023-10-24T00:48:18.040254+0000","last_became_active":"2023-10-24T00:48:18.039228+0000","last_became_peered":"2023-10-24T00:48:18.039228+0000","last_unstale":"2023-10-24T00:48:18.040254+0000","last_undegraded":"2023-10-24T00:48:18.040254+0000","last_fullsized":"2023-10-24T00:48:18.040254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.017969+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:48:17.017969+0000","last_peered":"2023-10-24T00:48:17.017969+0000","last_clean":"2023-10-24T00:48:17.017969+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:48:17.017969+0000","last_undegraded":"2023-10-24T00:48:17.017969+0000","last_fullsized":"2023-10-24T00:48:17.017969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026411+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045000+0000","last_change":"2023-10-24T00:48:18.045000+0000","last_active":"2023-10-24T00:48:18.045000+0000","last_peered":"2023-10-24T00:48:18.045000+0000","last_clean":"2023-10-24T00:48:18.045000+0000","last_became_active":"2023-10-24T00:48:18.044728+0000","last_became_peered":"2023-10-24T00:48:18.044728+0000","last_unstale":"2023-10-24T00:48:18.045000+0000","last_undegraded":"2023-10-24T00:48:18.045000+0000","last_fullsized":"2023-10-24T00:48:18.045000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.013828+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:48:17.013828+0000","last_peered":"2023-10-24T00:48:17.013828+0000","last_clean":"2023-10-24T00:48:17.013828+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:48:17.013828+0000","last_undegraded":"2023-10-24T00:48:17.013828+0000","last_fullsized":"2023-10-24T00:48:17.013828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015663+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:48:17.015663+0000","last_peered":"2023-10-24T00:48:17.015663+0000","last_clean":"2023-10-24T00:48:17.015663+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:48:17.015663+0000","last_undegraded":"2023-10-24T00:48:17.015663+0000","last_fullsized":"2023-10-24T00:48:17.015663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.035409+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045594+0000","last_change":"2023-10-24T00:48:18.045594+0000","last_active":"2023-10-24T00:48:18.045594+0000","last_peered":"2023-10-24T00:48:18.045594+0000","last_clean":"2023-10-24T00:48:18.045594+0000","last_became_active":"2023-10-24T00:48:18.045329+0000","last_became_peered":"2023-10-24T00:48:18.045329+0000","last_unstale":"2023-10-24T00:48:18.045594+0000","last_undegraded":"2023-10-24T00:48:18.045594+0000","last_fullsized":"2023-10-24T00:48:18.045594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.015755+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:48:17.015755+0000","last_peered":"2023-10-24T00:48:17.015755+0000","last_clean":"2023-10-24T00:48:17.015755+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:48:17.015755+0000","last_undegraded":"2023-10-24T00:48:17.015755+0000","last_fullsized":"2023-10-24T00:48:17.015755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.025941+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.045608+0000","last_change":"2023-10-24T00:48:18.045608+0000","last_active":"2023-10-24T00:48:18.045608+0000","last_peered":"2023-10-24T00:48:18.045608+0000","last_clean":"2023-10-24T00:48:18.045608+0000","last_became_active":"2023-10-24T00:48:18.045257+0000","last_became_peered":"2023-10-24T00:48:18.045257+0000","last_unstale":"2023-10-24T00:48:18.045608+0000","last_undegraded":"2023-10-24T00:48:18.045608+0000","last_fullsized":"2023-10-24T00:48:18.045608+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016864+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:48:17.016864+0000","last_peered":"2023-10-24T00:48:17.016864+0000","last_clean":"2023-10-24T00:48:17.016864+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:48:17.016864+0000","last_undegraded":"2023-10-24T00:48:17.016864+0000","last_fullsized":"2023-10-24T00:48:17.016864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.027129+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.038309+0000","last_change":"2023-10-24T00:48:18.038309+0000","last_active":"2023-10-24T00:48:18.038309+0000","last_peered":"2023-10-24T00:48:18.038309+0000","last_clean":"2023-10-24T00:48:18.038309+0000","last_became_active":"2023-10-24T00:48:18.037990+0000","last_became_peered":"2023-10-24T00:48:18.037990+0000","last_unstale":"2023-10-24T00:48:18.038309+0000","last_undegraded":"2023-10-24T00:48:18.038309+0000","last_fullsized":"2023-10-24T00:48:18.038309+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.023810+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:48:17.023810+0000","last_peered":"2023-10-24T00:48:17.023810+0000","last_clean":"2023-10-24T00:48:17.023810+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:48:17.023810+0000","last_undegraded":"2023-10-24T00:48:17.023810+0000","last_fullsized":"2023-10-24T00:48:17.023810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T00:48:18.009713+0000","last_change":"2023-10-24T00:48:18.026180+0000","last_active":"2023-10-24T00:48:18.009713+0000","last_peered":"2023-10-24T00:48:18.009713+0000","last_clean":"2023-10-24T00:48:18.009713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T00:48:18.009713+0000","last_undegraded":"2023-10-24T00:48:18.009713+0000","last_fullsized":"2023-10-24T00:48:18.009713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.044172+0000","last_change":"2023-10-24T00:48:18.044172+0000","last_active":"2023-10-24T00:48:18.044172+0000","last_peered":"2023-10-24T00:48:18.044172+0000","last_clean":"2023-10-24T00:48:18.044172+0000","last_became_active":"2023-10-24T00:48:18.043858+0000","last_became_peered":"2023-10-24T00:48:18.043858+0000","last_unstale":"2023-10-24T00:48:18.044172+0000","last_undegraded":"2023-10-24T00:48:18.044172+0000","last_fullsized":"2023-10-24T00:48:18.044172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-24T00:48:17.016971+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:48:17.016971+0000","last_peered":"2023-10-24T00:48:17.016971+0000","last_clean":"2023-10-24T00:48:17.016971+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:48:17.016971+0000","last_undegraded":"2023-10-24T00:48:17.016971+0000","last_fullsized":"2023-10-24T00:48:17.016971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542376,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.69699999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.59899999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.444,"5min":5.444,"15min":5.444},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.34899999999999998},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.372,"5min":0.27400000000000002,"15min":0.246},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":4.0759999999999996},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":4.351},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":1.4239999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.70899999999999996,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":11.211,"5min":11.211,"15min":11.211},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.69599999999999995,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.116,"5min":11.116,"15min":11.116},"last":0.77700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575080,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.28699999999999998,"15min":0.217},"max":{"1min":0.68700000000000006,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.72099999999999997,"5min":0.83799999999999997,"15min":1.3839999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30099999999999999},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.28299999999999997},"max":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":1.573},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.81299999999999994,"15min":7.7969999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.28899999999999998},"max":{"1min":0.73399999999999999,"5min":0.88,"15min":1.5029999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.53200000000000003,"15min":0.59299999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":0.65300000000000002,"5min":0.75900000000000001,"15min":14.597},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.71299999999999997,"5min":0.85899999999999999,"15min":2.2469999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47299999999999998,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.83399999999999996,"15min":7.8559999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":0.80800000000000005,"15min":1.4530000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52600000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.77500000000000002,"5min":0.82699999999999996,"15min":0.84599999999999997},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Oct 24 00:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.872},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.56799999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":7.8929999999999998},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575081,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":1.5029999999999999},"last":0.31},{"interface":"front","average":{"1min":0.379,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.28699999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":3.2519999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.25,"15min":0.25},"max":{"1min":0.55400000000000005,"5min":0.66500000000000004,"15min":1.1890000000000001},"last":0.248}]},{"osd":3,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.43099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":3.2269999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":1.1659999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":1.143},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.47699999999999998}]},{"osd":5,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.89100000000000001,"15min":3.1190000000000002},"last":0.498}]},{"osd":6,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":0.91700000000000004,"15min":3.2010000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.90500000000000003,"15min":1.109},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.628},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.42099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575081,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35899999999999999,"15min":0.35699999999999998},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":0.41399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.38100000000000001,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":0.45000000000000001,"5min":0.67000000000000004,"15min":0.70799999999999996},"last":0.40500000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.40300000000000002,"15min":0.40899999999999997},"min":{"1min":0.29599999999999999,"5min":0.28799999999999998,"15min":0.215},"max":{"1min":0.504,"5min":0.64200000000000002,"15min":0.68600000000000005},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.23599999999999999},"max":{"1min":0.48799999999999999,"5min":0.55300000000000005,"15min":0.63100000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.29099999999999998,"5min":0.26100000000000001,"15min":0.246},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.628},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.24299999999999999},"max":{"1min":0.58899999999999997,"5min":0.622,"15min":0.67100000000000004},"last":0.378}]},{"osd":4,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.47699999999999998,"5min":0.40799999999999997,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.52600000000000002,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.91500000000000004},"last":0.55700000000000005}]},{"osd":6,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.876},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.82399999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":871720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34599999999999997,"15min":0.35999999999999999},"min":{"1min":0.22700000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.57199999999999995},"last":0.439},{"interface":"front","average":{"1min":0.37,"5min":0.376,"15min":0.38900000000000001},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.22,"15min":0.22},"max":{"1min":0.52400000000000002,"5min":0.63,"15min":0.65500000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.41699999999999998},"min":{"1min":0.29299999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.60099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56899999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.41499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.63,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.33800000000000002},"max":{"1min":0.75,"5min":0.91100000000000003,"15min":0.93600000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.747}]},{"osd":5,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.38100000000000001},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.95299999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61099999999999999,"15min":0.63800000000000001},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.86099999999999999,"15min":0.97599999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Tue Oct 24 00:47:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":1.083,"15min":1.083},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.91600000000000004,"15min":0.999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51000000000000001,"5min":0.59299999999999997,"15min":0.90400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56799999999999995,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.373},"min":{"1min":0.27700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.68799999999999994,"15min":0.79900000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.67600000000000005,"15min":0.86599999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39200000000000002,"15min":0.39900000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.23699999999999999},"max":{"1min":0.58099999999999996,"5min":0.61299999999999999,"15min":0.67700000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71099999999999997,"5min":0.91900000000000004,"15min":1.024},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":1.0269999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59399999999999997,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":0.90900000000000003,"15min":1.0620000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.36399999999999999},"max":{"1min":0.89500000000000002,"5min":0.93999999999999995,"15min":0.995},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":0.996,"15min":1.042},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Oct 24 00:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63500000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.64400000000000002,"15min":0.65900000000000003},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.121},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.68200000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.74299999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.82599999999999996},"last":0.54900000000000004}]},{"osd":2,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.80700000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39400000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.88},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302872,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068968,"statfs":{"total":96636764160,"available":96326623232,"internally_reserved":0,"allocated":1720320,"data_stored":865041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.249},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.627,"5min":0.748,"15min":1.1479999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.23899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0209999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.25800000000000001},"max":{"1min":0.64100000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.26400000000000001},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":1.339},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63400000000000001,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.76400000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.421},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":1.772},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:48:24.308 INFO:tasks.ceph.mds.a.smithi148.stderr:2023-10-24T00:48:24.307+0000 7f0240510700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T00:48:25.807 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T00:48:25.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.936+0000 7fe9ac02c700 1 Processor -- start 2023-10-24T00:48:25.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.936+0000 7fe9ac02c700 1 -- start start 2023-10-24T00:48:25.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9ac02c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 0x7fe9a40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9ac02c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 0x7fe9a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9ac02c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a40aa860 con 0x7fe9a40c6710 2023-10-24T00:48:25.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9ac02c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a40c0960 con 0x7fe9a40aa010 2023-10-24T00:48:25.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9ac02c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a40c0c40 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a95c7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe9a40c6710 0x7fe9a4158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52926/0 (socket says 172.21.15.148:52926) 2023-10-24T00:48:25.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a95c7700 1 -- 172.21.15.148:0/4001617173 learned_addr learned my addr 172.21.15.148:0/4001617173 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:25.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9aa5c9700 1 --2- 172.21.15.148:0/4001617173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 0x7fe9a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/4001617173 >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 0x7fe9a40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043775465 0 0) 0x7fe9a40aa860 con 0x7fe9a40c6710 2023-10-24T00:48:25.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9900033f0 con 0x7fe9a40c6710 2023-10-24T00:48:25.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826317495 0 0) 0x7fe9900033f0 con 0x7fe9a40c6710 2023-10-24T00:48:25.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9aa5c9700 1 -- 172.21.15.148:0/4001617173 >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 msgr2=0x7fe9a40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:25.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9aa5c9700 1 --2- 172.21.15.148:0/4001617173 >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 0x7fe9a40c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:25.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9aa5c9700 1 -- 172.21.15.148:0/4001617173 >> v1:172.21.15.148:6789/0 conn(0x7fe9a40c6710 legacy=0x7fe9a4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:25.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9aa5c9700 1 -- 172.21.15.148:0/4001617173 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a40c0f20 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.937+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/4001617173 >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 0x7fe9a40c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9aa5c9700 1 --2- 172.21.15.148:0/4001617173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 0x7fe9a4069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe99c009e60 tx=0x7fe99c009780).ready entity=mon.2 client_cookie=680720ad37c9abf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00e070 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c00b7a0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9a8dc6700 1 -- 172.21.15.148:0/4001617173 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994001470 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 -- 172.21.15.148:0/4001617173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 msgr2=0x7fe9a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:25.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/4001617173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 0x7fe9a4069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe99c009e60 tx=0x7fe99c009780).stop 2023-10-24T00:48:25.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 -- 172.21.15.148:0/4001617173 shutdown_connections 2023-10-24T00:48:25.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/4001617173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40aa3f0 0x7fe9a4069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:25.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/4001617173 >> v2:172.21.15.150:3300/0 conn(0x7fe9a40aa010 0x7fe9a40c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:25.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 -- 172.21.15.148:0/4001617173 >> 172.21.15.148:0/4001617173 conn(0x7fe9a40caf40 msgr2=0x7fe9a40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:25.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 -- 172.21.15.148:0/4001617173 shutdown_connections 2023-10-24T00:48:25.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.938+0000 7fe9ac02c700 1 -- 172.21.15.148:0/4001617173 wait complete. 2023-10-24T00:48:25.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.939+0000 7fe9ac02c700 1 Processor -- start 2023-10-24T00:48:25.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 -- start start 2023-10-24T00:48:25.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 0x7fe9a41519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 0x7fe9a4167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41553d0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a41556b0 con 0x7fe9a40aa010 2023-10-24T00:48:25.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9ac02c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a4155990 con 0x7fe9a40c6710 2023-10-24T00:48:25.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9a95c7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9a95c7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48374/0 (socket says 172.21.15.148:48374) 2023-10-24T00:48:25.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.940+0000 7fe9a95c7700 1 -- 172.21.15.148:0/2183144260 learned_addr learned my addr 172.21.15.148:0/2183144260 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:25.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9aa5c9700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 0x7fe9a4167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 0x7fe9a41519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 -- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 msgr2=0x7fe9a4167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:25.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 0x7fe9a4167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:25.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 -- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 msgr2=0x7fe9a41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:25.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 0x7fe9a41519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:25.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 -- 172.21.15.148:0/2183144260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a00092a0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9aa5c9700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 0x7fe9a4167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:25.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 0x7fe9a41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:25.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9a95c7700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fe99400c810 tx=0x7fe994001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:25.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994001b30 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994007170 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c009a20 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994007530 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.941+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a4151ea0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.942+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a406c6b0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.943+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe994004ad0 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.943+0000 7fe999ffb700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 0x7fe988061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.943+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe99407a370 con 0x7fe9a40aa3f0 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.944+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 0x7fe988061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:25.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.944+0000 7fe9a9dc8700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 0x7fe988061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe9a0009270 tx=0x7fe9a0008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:25.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:25.947+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe99404b6e0 con 0x7fe9a40aa3f0 2023-10-24T00:48:26.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.109+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9a4155510 con 0x7fe98805f150 2023-10-24T00:48:26.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.119+0000 7fe999ffb700 1 -- 172.21.15.148:0/2183144260 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361707 (secure 0 0 0) 0x7fe9a4155510 con 0x7fe98805f150 2023-10-24T00:48:26.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:26.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 msgr2=0x7fe988061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 0x7fe988061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe9a0009270 tx=0x7fe9a0008040).stop 2023-10-24T00:48:26.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 msgr2=0x7fe9a4167730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fe99400c810 tx=0x7fe994001aa0).stop 2023-10-24T00:48:26.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 shutdown_connections 2023-10-24T00:48:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9a40c6710 0x7fe9a4167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9a40aa010 0x7fe9a41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe98805f150 0x7fe988061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.122+0000 7fe9ac02c700 1 --2- 172.21.15.148:0/2183144260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9a40aa3f0 0x7fe9a4167730 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.123+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 >> 172.21.15.148:0/2183144260 conn(0x7fe9a40caf40 msgr2=0x7fe9a4069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:26.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.123+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 shutdown_connections 2023-10-24T00:48:26.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.123+0000 7fe9ac02c700 1 -- 172.21.15.148:0/2183144260 wait complete. 2023-10-24T00:48:26.130 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T00:48:26.136 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T00:48:25.244850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423328,"kb_used_data":13792,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551392,"statfs":{"total":773094113280,"available":770612625408,"internally_reserved":0,"allocated":14123008,"data_stored":7089436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20022,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-70,"num_write_kb":-46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999602"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408569+0000","last_change":"2023-10-24T00:48:18.402153+0000","last_active":"2023-10-24T00:48:18.408569+0000","last_peered":"2023-10-24T00:48:18.408569+0000","last_clean":"2023-10-24T00:48:18.408569+0000","last_became_active":"2023-10-24T00:48:18.401727+0000","last_became_peered":"2023-10-24T00:48:18.401727+0000","last_unstale":"2023-10-24T00:48:18.408569+0000","last_undegraded":"2023-10-24T00:48:18.408569+0000","last_fullsized":"2023-10-24T00:48:18.408569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409067+0000","last_change":"2023-10-24T00:48:18.041844+0000","last_active":"2023-10-24T00:48:18.409067+0000","last_peered":"2023-10-24T00:48:18.409067+0000","last_clean":"2023-10-24T00:48:18.409067+0000","last_became_active":"2023-10-24T00:48:18.041589+0000","last_became_peered":"2023-10-24T00:48:18.041589+0000","last_unstale":"2023-10-24T00:48:18.409067+0000","last_undegraded":"2023-10-24T00:48:18.409067+0000","last_fullsized":"2023-10-24T00:48:18.409067+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407548+0000","last_change":"2023-10-24T00:48:18.402763+0000","last_active":"2023-10-24T00:48:18.407548+0000","last_peered":"2023-10-24T00:48:18.407548+0000","last_clean":"2023-10-24T00:48:18.407548+0000","last_became_active":"2023-10-24T00:48:18.402338+0000","last_became_peered":"2023-10-24T00:48:18.402338+0000","last_unstale":"2023-10-24T00:48:18.407548+0000","last_undegraded":"2023-10-24T00:48:18.407548+0000","last_fullsized":"2023-10-24T00:48:18.407548+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395120+0000","last_change":"2023-10-24T00:48:18.030820+0000","last_active":"2023-10-24T00:48:18.395120+0000","last_peered":"2023-10-24T00:48:18.395120+0000","last_clean":"2023-10-24T00:48:18.395120+0000","last_became_active":"2023-10-24T00:48:18.030482+0000","last_became_peered":"2023-10-24T00:48:18.030482+0000","last_unstale":"2023-10-24T00:48:18.395120+0000","last_undegraded":"2023-10-24T00:48:18.395120+0000","last_fullsized":"2023-10-24T00:48:18.395120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.397020+0000","last_change":"2023-10-24T00:48:18.396339+0000","last_active":"2023-10-24T00:48:18.397020+0000","last_peered":"2023-10-24T00:48:18.397020+0000","last_clean":"2023-10-24T00:48:18.397020+0000","last_became_active":"2023-10-24T00:48:18.396035+0000","last_became_peered":"2023-10-24T00:48:18.396035+0000","last_unstale":"2023-10-24T00:48:18.397020+0000","last_undegraded":"2023-10-24T00:48:18.397020+0000","last_fullsized":"2023-10-24T00:48:18.397020+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.388682+0000","last_change":"2023-10-24T00:48:18.039392+0000","last_active":"2023-10-24T00:48:18.388682+0000","last_peered":"2023-10-24T00:48:18.388682+0000","last_clean":"2023-10-24T00:48:18.388682+0000","last_became_active":"2023-10-24T00:48:18.039118+0000","last_became_peered":"2023-10-24T00:48:18.039118+0000","last_unstale":"2023-10-24T00:48:18.388682+0000","last_undegraded":"2023-10-24T00:48:18.388682+0000","last_fullsized":"2023-10-24T00:48:18.388682+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.414674+0000","last_change":"2023-10-24T00:48:18.411061+0000","last_active":"2023-10-24T00:48:18.414674+0000","last_peered":"2023-10-24T00:48:18.414674+0000","last_clean":"2023-10-24T00:48:18.414674+0000","last_became_active":"2023-10-24T00:48:18.410822+0000","last_became_peered":"2023-10-24T00:48:18.410822+0000","last_unstale":"2023-10-24T00:48:18.414674+0000","last_undegraded":"2023-10-24T00:48:18.414674+0000","last_fullsized":"2023-10-24T00:48:18.414674+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409536+0000","last_change":"2023-10-24T00:48:18.040907+0000","last_active":"2023-10-24T00:48:18.409536+0000","last_peered":"2023-10-24T00:48:18.409536+0000","last_clean":"2023-10-24T00:48:18.409536+0000","last_became_active":"2023-10-24T00:48:18.038648+0000","last_became_peered":"2023-10-24T00:48:18.038648+0000","last_unstale":"2023-10-24T00:48:18.409536+0000","last_undegraded":"2023-10-24T00:48:18.409536+0000","last_fullsized":"2023-10-24T00:48:18.409536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407730+0000","last_change":"2023-10-24T00:48:18.403560+0000","last_active":"2023-10-24T00:48:18.407730+0000","last_peered":"2023-10-24T00:48:18.407730+0000","last_clean":"2023-10-24T00:48:18.407730+0000","last_became_active":"2023-10-24T00:48:18.402450+0000","last_became_peered":"2023-10-24T00:48:18.402450+0000","last_unstale":"2023-10-24T00:48:18.407730+0000","last_undegraded":"2023-10-24T00:48:18.407730+0000","last_fullsized":"2023-10-24T00:48:18.407730+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407540+0000","last_change":"2023-10-24T00:48:18.042252+0000","last_active":"2023-10-24T00:48:18.407540+0000","last_peered":"2023-10-24T00:48:18.407540+0000","last_clean":"2023-10-24T00:48:18.407540+0000","last_became_active":"2023-10-24T00:48:18.041992+0000","last_became_peered":"2023-10-24T00:48:18.041992+0000","last_unstale":"2023-10-24T00:48:18.407540+0000","last_undegraded":"2023-10-24T00:48:18.407540+0000","last_fullsized":"2023-10-24T00:48:18.407540+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408102+0000","last_change":"2023-10-24T00:48:18.399283+0000","last_active":"2023-10-24T00:48:18.408102+0000","last_peered":"2023-10-24T00:48:18.408102+0000","last_clean":"2023-10-24T00:48:18.408102+0000","last_became_active":"2023-10-24T00:48:18.399018+0000","last_became_peered":"2023-10-24T00:48:18.399018+0000","last_unstale":"2023-10-24T00:48:18.408102+0000","last_undegraded":"2023-10-24T00:48:18.408102+0000","last_fullsized":"2023-10-24T00:48:18.408102+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410177+0000","last_change":"2023-10-24T00:48:18.045400+0000","last_active":"2023-10-24T00:48:18.410177+0000","last_peered":"2023-10-24T00:48:18.410177+0000","last_clean":"2023-10-24T00:48:18.410177+0000","last_became_active":"2023-10-24T00:48:18.045129+0000","last_became_peered":"2023-10-24T00:48:18.045129+0000","last_unstale":"2023-10-24T00:48:18.410177+0000","last_undegraded":"2023-10-24T00:48:18.410177+0000","last_fullsized":"2023-10-24T00:48:18.410177+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408365+0000","last_change":"2023-10-24T00:48:18.402745+0000","last_active":"2023-10-24T00:48:18.408365+0000","last_peered":"2023-10-24T00:48:18.408365+0000","last_clean":"2023-10-24T00:48:18.408365+0000","last_became_active":"2023-10-24T00:48:18.400589+0000","last_became_peered":"2023-10-24T00:48:18.400589+0000","last_unstale":"2023-10-24T00:48:18.408365+0000","last_undegraded":"2023-10-24T00:48:18.408365+0000","last_fullsized":"2023-10-24T00:48:18.408365+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386579+0000","last_change":"2023-10-24T00:48:18.043011+0000","last_active":"2023-10-24T00:48:18.386579+0000","last_peered":"2023-10-24T00:48:18.386579+0000","last_clean":"2023-10-24T00:48:18.386579+0000","last_became_active":"2023-10-24T00:48:18.042525+0000","last_became_peered":"2023-10-24T00:48:18.042525+0000","last_unstale":"2023-10-24T00:48:18.386579+0000","last_undegraded":"2023-10-24T00:48:18.386579+0000","last_fullsized":"2023-10-24T00:48:18.386579+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405571+0000","last_change":"2023-10-24T00:48:18.401112+0000","last_active":"2023-10-24T00:48:18.405571+0000","last_peered":"2023-10-24T00:48:18.405571+0000","last_clean":"2023-10-24T00:48:18.405571+0000","last_became_active":"2023-10-24T00:48:18.400863+0000","last_became_peered":"2023-10-24T00:48:18.400863+0000","last_unstale":"2023-10-24T00:48:18.405571+0000","last_undegraded":"2023-10-24T00:48:18.405571+0000","last_fullsized":"2023-10-24T00:48:18.405571+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.385627+0000","last_change":"2023-10-24T00:48:18.032792+0000","last_active":"2023-10-24T00:48:18.385627+0000","last_peered":"2023-10-24T00:48:18.385627+0000","last_clean":"2023-10-24T00:48:18.385627+0000","last_became_active":"2023-10-24T00:48:18.032439+0000","last_became_peered":"2023-10-24T00:48:18.032439+0000","last_unstale":"2023-10-24T00:48:18.385627+0000","last_undegraded":"2023-10-24T00:48:18.385627+0000","last_fullsized":"2023-10-24T00:48:18.385627+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409299+0000","last_change":"2023-10-24T00:48:18.404633+0000","last_active":"2023-10-24T00:48:18.409299+0000","last_peered":"2023-10-24T00:48:18.409299+0000","last_clean":"2023-10-24T00:48:18.409299+0000","last_became_active":"2023-10-24T00:48:18.404357+0000","last_became_peered":"2023-10-24T00:48:18.404357+0000","last_unstale":"2023-10-24T00:48:18.409299+0000","last_undegraded":"2023-10-24T00:48:18.409299+0000","last_fullsized":"2023-10-24T00:48:18.409299+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.400580+0000","last_change":"2023-10-24T00:48:18.044386+0000","last_active":"2023-10-24T00:48:18.400580+0000","last_peered":"2023-10-24T00:48:18.400580+0000","last_clean":"2023-10-24T00:48:18.400580+0000","last_became_active":"2023-10-24T00:48:18.044107+0000","last_became_peered":"2023-10-24T00:48:18.044107+0000","last_unstale":"2023-10-24T00:48:18.400580+0000","last_undegraded":"2023-10-24T00:48:18.400580+0000","last_fullsized":"2023-10-24T00:48:18.400580+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409599+0000","last_change":"2023-10-24T00:48:18.406464+0000","last_active":"2023-10-24T00:48:18.409599+0000","last_peered":"2023-10-24T00:48:18.409599+0000","last_clean":"2023-10-24T00:48:18.409599+0000","last_became_active":"2023-10-24T00:48:18.406211+0000","last_became_peered":"2023-10-24T00:48:18.406211+0000","last_unstale":"2023-10-24T00:48:18.409599+0000","last_undegraded":"2023-10-24T00:48:18.409599+0000","last_fullsized":"2023-10-24T00:48:18.409599+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.400583+0000","last_change":"2023-10-24T00:48:18.048765+0000","last_active":"2023-10-24T00:48:18.400583+0000","last_peered":"2023-10-24T00:48:18.400583+0000","last_clean":"2023-10-24T00:48:18.400583+0000","last_became_active":"2023-10-24T00:48:18.048505+0000","last_became_peered":"2023-10-24T00:48:18.048505+0000","last_unstale":"2023-10-24T00:48:18.400583+0000","last_undegraded":"2023-10-24T00:48:18.400583+0000","last_fullsized":"2023-10-24T00:48:18.400583+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410202+0000","last_change":"2023-10-24T00:48:18.409030+0000","last_active":"2023-10-24T00:48:18.410202+0000","last_peered":"2023-10-24T00:48:18.410202+0000","last_clean":"2023-10-24T00:48:18.410202+0000","last_became_active":"2023-10-24T00:48:18.408777+0000","last_became_peered":"2023-10-24T00:48:18.408777+0000","last_unstale":"2023-10-24T00:48:18.410202+0000","last_undegraded":"2023-10-24T00:48:18.410202+0000","last_fullsized":"2023-10-24T00:48:18.410202+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394852+0000","last_change":"2023-10-24T00:48:18.044999+0000","last_active":"2023-10-24T00:48:18.394852+0000","last_peered":"2023-10-24T00:48:18.394852+0000","last_clean":"2023-10-24T00:48:18.394852+0000","last_became_active":"2023-10-24T00:48:18.044678+0000","last_became_peered":"2023-10-24T00:48:18.044678+0000","last_unstale":"2023-10-24T00:48:18.394852+0000","last_undegraded":"2023-10-24T00:48:18.394852+0000","last_fullsized":"2023-10-24T00:48:18.394852+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408444+0000","last_change":"2023-10-24T00:48:18.396896+0000","last_active":"2023-10-24T00:48:18.408444+0000","last_peered":"2023-10-24T00:48:18.408444+0000","last_clean":"2023-10-24T00:48:18.408444+0000","last_became_active":"2023-10-24T00:48:18.396617+0000","last_became_peered":"2023-10-24T00:48:18.396617+0000","last_unstale":"2023-10-24T00:48:18.408444+0000","last_undegraded":"2023-10-24T00:48:18.408444+0000","last_fullsized":"2023-10-24T00:48:18.408444+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.413873+0000","last_change":"2023-10-24T00:48:18.048832+0000","last_active":"2023-10-24T00:48:18.413873+0000","last_peered":"2023-10-24T00:48:18.413873+0000","last_clean":"2023-10-24T00:48:18.413873+0000","last_became_active":"2023-10-24T00:48:18.048558+0000","last_became_peered":"2023-10-24T00:48:18.048558+0000","last_unstale":"2023-10-24T00:48:18.413873+0000","last_undegraded":"2023-10-24T00:48:18.413873+0000","last_fullsized":"2023-10-24T00:48:18.413873+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409634+0000","last_change":"2023-10-24T00:48:18.407311+0000","last_active":"2023-10-24T00:48:18.409634+0000","last_peered":"2023-10-24T00:48:18.409634+0000","last_clean":"2023-10-24T00:48:18.409634+0000","last_became_active":"2023-10-24T00:48:18.406841+0000","last_became_peered":"2023-10-24T00:48:18.406841+0000","last_unstale":"2023-10-24T00:48:18.409634+0000","last_undegraded":"2023-10-24T00:48:18.409634+0000","last_fullsized":"2023-10-24T00:48:18.409634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408381+0000","last_change":"2023-10-24T00:48:18.036392+0000","last_active":"2023-10-24T00:48:18.408381+0000","last_peered":"2023-10-24T00:48:18.408381+0000","last_clean":"2023-10-24T00:48:18.408381+0000","last_became_active":"2023-10-24T00:48:18.035885+0000","last_became_peered":"2023-10-24T00:48:18.035885+0000","last_unstale":"2023-10-24T00:48:18.408381+0000","last_undegraded":"2023-10-24T00:48:18.408381+0000","last_fullsized":"2023-10-24T00:48:18.408381+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405733+0000","last_change":"2023-10-24T00:48:18.402163+0000","last_active":"2023-10-24T00:48:18.405733+0000","last_peered":"2023-10-24T00:48:18.405733+0000","last_clean":"2023-10-24T00:48:18.405733+0000","last_became_active":"2023-10-24T00:48:18.401905+0000","last_became_peered":"2023-10-24T00:48:18.401905+0000","last_unstale":"2023-10-24T00:48:18.405733+0000","last_undegraded":"2023-10-24T00:48:18.405733+0000","last_fullsized":"2023-10-24T00:48:18.405733+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387061+0000","last_change":"2023-10-24T00:48:18.041432+0000","last_active":"2023-10-24T00:48:18.387061+0000","last_peered":"2023-10-24T00:48:18.387061+0000","last_clean":"2023-10-24T00:48:18.387061+0000","last_became_active":"2023-10-24T00:48:18.041156+0000","last_became_peered":"2023-10-24T00:48:18.041156+0000","last_unstale":"2023-10-24T00:48:18.387061+0000","last_undegraded":"2023-10-24T00:48:18.387061+0000","last_fullsized":"2023-10-24T00:48:18.387061+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407784+0000","last_change":"2023-10-24T00:48:18.403212+0000","last_active":"2023-10-24T00:48:18.407784+0000","last_peered":"2023-10-24T00:48:18.407784+0000","last_clean":"2023-10-24T00:48:18.407784+0000","last_became_active":"2023-10-24T00:48:18.402680+0000","last_became_peered":"2023-10-24T00:48:18.402680+0000","last_unstale":"2023-10-24T00:48:18.407784+0000","last_undegraded":"2023-10-24T00:48:18.407784+0000","last_fullsized":"2023-10-24T00:48:18.407784+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387353+0000","last_change":"2023-10-24T00:48:18.045461+0000","last_active":"2023-10-24T00:48:18.387353+0000","last_peered":"2023-10-24T00:48:18.387353+0000","last_clean":"2023-10-24T00:48:18.387353+0000","last_became_active":"2023-10-24T00:48:18.045197+0000","last_became_peered":"2023-10-24T00:48:18.045197+0000","last_unstale":"2023-10-24T00:48:18.387353+0000","last_undegraded":"2023-10-24T00:48:18.387353+0000","last_fullsized":"2023-10-24T00:48:18.387353+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410287+0000","last_change":"2023-10-24T00:48:18.391484+0000","last_active":"2023-10-24T00:48:18.410287+0000","last_peered":"2023-10-24T00:48:18.410287+0000","last_clean":"2023-10-24T00:48:18.410287+0000","last_became_active":"2023-10-24T00:48:18.391219+0000","last_became_peered":"2023-10-24T00:48:18.391219+0000","last_unstale":"2023-10-24T00:48:18.410287+0000","last_undegraded":"2023-10-24T00:48:18.410287+0000","last_fullsized":"2023-10-24T00:48:18.410287+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412766+0000","last_change":"2023-10-24T00:48:18.042527+0000","last_active":"2023-10-24T00:48:18.412766+0000","last_peered":"2023-10-24T00:48:18.412766+0000","last_clean":"2023-10-24T00:48:18.412766+0000","last_became_active":"2023-10-24T00:48:18.042217+0000","last_became_peered":"2023-10-24T00:48:18.042217+0000","last_unstale":"2023-10-24T00:48:18.412766+0000","last_undegraded":"2023-10-24T00:48:18.412766+0000","last_fullsized":"2023-10-24T00:48:18.412766+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.406456+0000","last_change":"2023-10-24T00:48:18.405287+0000","last_active":"2023-10-24T00:48:18.406456+0000","last_peered":"2023-10-24T00:48:18.406456+0000","last_clean":"2023-10-24T00:48:18.406456+0000","last_became_active":"2023-10-24T00:48:18.405000+0000","last_became_peered":"2023-10-24T00:48:18.405000+0000","last_unstale":"2023-10-24T00:48:18.406456+0000","last_undegraded":"2023-10-24T00:48:18.406456+0000","last_fullsized":"2023-10-24T00:48:18.406456+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395237+0000","last_change":"2023-10-24T00:48:18.043145+0000","last_active":"2023-10-24T00:48:18.395237+0000","last_peered":"2023-10-24T00:48:18.395237+0000","last_clean":"2023-10-24T00:48:18.395237+0000","last_became_active":"2023-10-24T00:48:18.042714+0000","last_became_peered":"2023-10-24T00:48:18.042714+0000","last_unstale":"2023-10-24T00:48:18.395237+0000","last_undegraded":"2023-10-24T00:48:18.395237+0000","last_fullsized":"2023-10-24T00:48:18.395237+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412126+0000","last_change":"2023-10-24T00:48:18.408962+0000","last_active":"2023-10-24T00:48:18.412126+0000","last_peered":"2023-10-24T00:48:18.412126+0000","last_clean":"2023-10-24T00:48:18.412126+0000","last_became_active":"2023-10-24T00:48:18.408695+0000","last_became_peered":"2023-10-24T00:48:18.408695+0000","last_unstale":"2023-10-24T00:48:18.412126+0000","last_undegraded":"2023-10-24T00:48:18.412126+0000","last_fullsized":"2023-10-24T00:48:18.412126+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.393233+0000","last_change":"2023-10-24T00:48:18.044605+0000","last_active":"2023-10-24T00:48:18.393233+0000","last_peered":"2023-10-24T00:48:18.393233+0000","last_clean":"2023-10-24T00:48:18.393233+0000","last_became_active":"2023-10-24T00:48:18.044344+0000","last_became_peered":"2023-10-24T00:48:18.044344+0000","last_unstale":"2023-10-24T00:48:18.393233+0000","last_undegraded":"2023-10-24T00:48:18.393233+0000","last_fullsized":"2023-10-24T00:48:18.393233+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.397033+0000","last_change":"2023-10-24T00:48:18.396453+0000","last_active":"2023-10-24T00:48:18.397033+0000","last_peered":"2023-10-24T00:48:18.397033+0000","last_clean":"2023-10-24T00:48:18.397033+0000","last_became_active":"2023-10-24T00:48:18.396168+0000","last_became_peered":"2023-10-24T00:48:18.396168+0000","last_unstale":"2023-10-24T00:48:18.397033+0000","last_undegraded":"2023-10-24T00:48:18.397033+0000","last_fullsized":"2023-10-24T00:48:18.397033+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409769+0000","last_change":"2023-10-24T00:48:18.045569+0000","last_active":"2023-10-24T00:48:18.409769+0000","last_peered":"2023-10-24T00:48:18.409769+0000","last_clean":"2023-10-24T00:48:18.409769+0000","last_became_active":"2023-10-24T00:48:18.045238+0000","last_became_peered":"2023-10-24T00:48:18.045238+0000","last_unstale":"2023-10-24T00:48:18.409769+0000","last_undegraded":"2023-10-24T00:48:18.409769+0000","last_fullsized":"2023-10-24T00:48:18.409769+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412822+0000","last_change":"2023-10-24T00:48:18.410494+0000","last_active":"2023-10-24T00:48:18.412822+0000","last_peered":"2023-10-24T00:48:18.412822+0000","last_clean":"2023-10-24T00:48:18.412822+0000","last_became_active":"2023-10-24T00:48:18.410032+0000","last_became_peered":"2023-10-24T00:48:18.410032+0000","last_unstale":"2023-10-24T00:48:18.412822+0000","last_undegraded":"2023-10-24T00:48:18.412822+0000","last_fullsized":"2023-10-24T00:48:18.412822+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394798+0000","last_change":"2023-10-24T00:48:18.037574+0000","last_active":"2023-10-24T00:48:18.394798+0000","last_peered":"2023-10-24T00:48:18.394798+0000","last_clean":"2023-10-24T00:48:18.394798+0000","last_became_active":"2023-10-24T00:48:18.037198+0000","last_became_peered":"2023-10-24T00:48:18.037198+0000","last_unstale":"2023-10-24T00:48:18.394798+0000","last_undegraded":"2023-10-24T00:48:18.394798+0000","last_fullsized":"2023-10-24T00:48:18.394798+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.406690+0000","last_change":"2023-10-24T00:48:18.401209+0000","last_active":"2023-10-24T00:48:18.406690+0000","last_peered":"2023-10-24T00:48:18.406690+0000","last_clean":"2023-10-24T00:48:18.406690+0000","last_became_active":"2023-10-24T00:48:18.400951+0000","last_became_peered":"2023-10-24T00:48:18.400951+0000","last_unstale":"2023-10-24T00:48:18.406690+0000","last_undegraded":"2023-10-24T00:48:18.406690+0000","last_fullsized":"2023-10-24T00:48:18.406690+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.403777+0000","last_change":"2023-10-24T00:48:18.039664+0000","last_active":"2023-10-24T00:48:18.403777+0000","last_peered":"2023-10-24T00:48:18.403777+0000","last_clean":"2023-10-24T00:48:18.403777+0000","last_became_active":"2023-10-24T00:48:18.039386+0000","last_became_peered":"2023-10-24T00:48:18.039386+0000","last_unstale":"2023-10-24T00:48:18.403777+0000","last_undegraded":"2023-10-24T00:48:18.403777+0000","last_fullsized":"2023-10-24T00:48:18.403777+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395417+0000","last_change":"2023-10-24T00:48:18.389451+0000","last_active":"2023-10-24T00:48:18.395417+0000","last_peered":"2023-10-24T00:48:18.395417+0000","last_clean":"2023-10-24T00:48:18.395417+0000","last_became_active":"2023-10-24T00:48:18.389179+0000","last_became_peered":"2023-10-24T00:48:18.389179+0000","last_unstale":"2023-10-24T00:48:18.395417+0000","last_undegraded":"2023-10-24T00:48:18.395417+0000","last_fullsized":"2023-10-24T00:48:18.395417+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.384822+0000","last_change":"2023-10-24T00:48:18.046440+0000","last_active":"2023-10-24T00:48:18.384822+0000","last_peered":"2023-10-24T00:48:18.384822+0000","last_clean":"2023-10-24T00:48:18.384822+0000","last_became_active":"2023-10-24T00:48:18.046183+0000","last_became_peered":"2023-10-24T00:48:18.046183+0000","last_unstale":"2023-10-24T00:48:18.384822+0000","last_undegraded":"2023-10-24T00:48:18.384822+0000","last_fullsized":"2023-10-24T00:48:18.384822+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.400094+0000","last_change":"2023-10-24T00:48:18.397083+0000","last_active":"2023-10-24T00:48:18.400094+0000","last_peered":"2023-10-24T00:48:18.400094+0000","last_clean":"2023-10-24T00:48:18.400094+0000","last_became_active":"2023-10-24T00:48:18.396775+0000","last_became_peered":"2023-10-24T00:48:18.396775+0000","last_unstale":"2023-10-24T00:48:18.400094+0000","last_undegraded":"2023-10-24T00:48:18.400094+0000","last_fullsized":"2023-10-24T00:48:18.400094+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394323+0000","last_change":"2023-10-24T00:48:18.036065+0000","last_active":"2023-10-24T00:48:18.394323+0000","last_peered":"2023-10-24T00:48:18.394323+0000","last_clean":"2023-10-24T00:48:18.394323+0000","last_became_active":"2023-10-24T00:48:18.035802+0000","last_became_peered":"2023-10-24T00:48:18.035802+0000","last_unstale":"2023-10-24T00:48:18.394323+0000","last_undegraded":"2023-10-24T00:48:18.394323+0000","last_fullsized":"2023-10-24T00:48:18.394323+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408822+0000","last_change":"2023-10-24T00:48:18.404409+0000","last_active":"2023-10-24T00:48:18.408822+0000","last_peered":"2023-10-24T00:48:18.408822+0000","last_clean":"2023-10-24T00:48:18.408822+0000","last_became_active":"2023-10-24T00:48:18.401801+0000","last_became_peered":"2023-10-24T00:48:18.401801+0000","last_unstale":"2023-10-24T00:48:18.408822+0000","last_undegraded":"2023-10-24T00:48:18.408822+0000","last_fullsized":"2023-10-24T00:48:18.408822+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.384197+0000","last_change":"2023-10-24T00:48:18.045033+0000","last_active":"2023-10-24T00:48:18.384197+0000","last_peered":"2023-10-24T00:48:18.384197+0000","last_clean":"2023-10-24T00:48:18.384197+0000","last_became_active":"2023-10-24T00:48:18.044768+0000","last_became_peered":"2023-10-24T00:48:18.044768+0000","last_unstale":"2023-10-24T00:48:18.384197+0000","last_undegraded":"2023-10-24T00:48:18.384197+0000","last_fullsized":"2023-10-24T00:48:18.384197+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409319+0000","last_change":"2023-10-24T00:48:18.407645+0000","last_active":"2023-10-24T00:48:18.409319+0000","last_peered":"2023-10-24T00:48:18.409319+0000","last_clean":"2023-10-24T00:48:18.409319+0000","last_became_active":"2023-10-24T00:48:18.407126+0000","last_became_peered":"2023-10-24T00:48:18.407126+0000","last_unstale":"2023-10-24T00:48:18.409319+0000","last_undegraded":"2023-10-24T00:48:18.409319+0000","last_fullsized":"2023-10-24T00:48:18.409319+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395136+0000","last_change":"2023-10-24T00:48:18.044606+0000","last_active":"2023-10-24T00:48:18.395136+0000","last_peered":"2023-10-24T00:48:18.395136+0000","last_clean":"2023-10-24T00:48:18.395136+0000","last_became_active":"2023-10-24T00:48:18.044308+0000","last_became_peered":"2023-10-24T00:48:18.044308+0000","last_unstale":"2023-10-24T00:48:18.395136+0000","last_undegraded":"2023-10-24T00:48:18.395136+0000","last_fullsized":"2023-10-24T00:48:18.395136+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412149+0000","last_change":"2023-10-24T00:48:18.409024+0000","last_active":"2023-10-24T00:48:18.412149+0000","last_peered":"2023-10-24T00:48:18.412149+0000","last_clean":"2023-10-24T00:48:18.412149+0000","last_became_active":"2023-10-24T00:48:18.408778+0000","last_became_peered":"2023-10-24T00:48:18.408778+0000","last_unstale":"2023-10-24T00:48:18.412149+0000","last_undegraded":"2023-10-24T00:48:18.412149+0000","last_fullsized":"2023-10-24T00:48:18.412149+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.400673+0000","last_change":"2023-10-24T00:48:18.037373+0000","last_active":"2023-10-24T00:48:18.400673+0000","last_peered":"2023-10-24T00:48:18.400673+0000","last_clean":"2023-10-24T00:48:18.400673+0000","last_became_active":"2023-10-24T00:48:18.037110+0000","last_became_peered":"2023-10-24T00:48:18.037110+0000","last_unstale":"2023-10-24T00:48:18.400673+0000","last_undegraded":"2023-10-24T00:48:18.400673+0000","last_fullsized":"2023-10-24T00:48:18.400673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412909+0000","last_change":"2023-10-24T00:48:18.410880+0000","last_active":"2023-10-24T00:48:18.412909+0000","last_peered":"2023-10-24T00:48:18.412909+0000","last_clean":"2023-10-24T00:48:18.412909+0000","last_became_active":"2023-10-24T00:48:18.410586+0000","last_became_peered":"2023-10-24T00:48:18.410586+0000","last_unstale":"2023-10-24T00:48:18.412909+0000","last_undegraded":"2023-10-24T00:48:18.412909+0000","last_fullsized":"2023-10-24T00:48:18.412909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386745+0000","last_change":"2023-10-24T00:48:18.036294+0000","last_active":"2023-10-24T00:48:18.386745+0000","last_peered":"2023-10-24T00:48:18.386745+0000","last_clean":"2023-10-24T00:48:18.386745+0000","last_became_active":"2023-10-24T00:48:18.036007+0000","last_became_peered":"2023-10-24T00:48:18.036007+0000","last_unstale":"2023-10-24T00:48:18.386745+0000","last_undegraded":"2023-10-24T00:48:18.386745+0000","last_fullsized":"2023-10-24T00:48:18.386745+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405745+0000","last_change":"2023-10-24T00:48:18.400220+0000","last_active":"2023-10-24T00:48:18.405745+0000","last_peered":"2023-10-24T00:48:18.405745+0000","last_clean":"2023-10-24T00:48:18.405745+0000","last_became_active":"2023-10-24T00:48:18.399874+0000","last_became_peered":"2023-10-24T00:48:18.399874+0000","last_unstale":"2023-10-24T00:48:18.405745+0000","last_undegraded":"2023-10-24T00:48:18.405745+0000","last_fullsized":"2023-10-24T00:48:18.405745+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.383559+0000","last_change":"2023-10-24T00:48:18.042339+0000","last_active":"2023-10-24T00:48:18.383559+0000","last_peered":"2023-10-24T00:48:18.383559+0000","last_clean":"2023-10-24T00:48:18.383559+0000","last_became_active":"2023-10-24T00:48:18.042104+0000","last_became_peered":"2023-10-24T00:48:18.042104+0000","last_unstale":"2023-10-24T00:48:18.383559+0000","last_undegraded":"2023-10-24T00:48:18.383559+0000","last_fullsized":"2023-10-24T00:48:18.383559+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.406668+0000","last_change":"2023-10-24T00:48:18.400977+0000","last_active":"2023-10-24T00:48:18.406668+0000","last_peered":"2023-10-24T00:48:18.406668+0000","last_clean":"2023-10-24T00:48:18.406668+0000","last_became_active":"2023-10-24T00:48:18.400633+0000","last_became_peered":"2023-10-24T00:48:18.400633+0000","last_unstale":"2023-10-24T00:48:18.406668+0000","last_undegraded":"2023-10-24T00:48:18.406668+0000","last_fullsized":"2023-10-24T00:48:18.406668+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395051+0000","last_change":"2023-10-24T00:48:18.039118+0000","last_active":"2023-10-24T00:48:18.395051+0000","last_peered":"2023-10-24T00:48:18.395051+0000","last_clean":"2023-10-24T00:48:18.395051+0000","last_became_active":"2023-10-24T00:48:18.037254+0000","last_became_peered":"2023-10-24T00:48:18.037254+0000","last_unstale":"2023-10-24T00:48:18.395051+0000","last_undegraded":"2023-10-24T00:48:18.395051+0000","last_fullsized":"2023-10-24T00:48:18.395051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405611+0000","last_change":"2023-10-24T00:48:18.396028+0000","last_active":"2023-10-24T00:48:18.405611+0000","last_peered":"2023-10-24T00:48:18.405611+0000","last_clean":"2023-10-24T00:48:18.405611+0000","last_became_active":"2023-10-24T00:48:18.395628+0000","last_became_peered":"2023-10-24T00:48:18.395628+0000","last_unstale":"2023-10-24T00:48:18.405611+0000","last_undegraded":"2023-10-24T00:48:18.405611+0000","last_fullsized":"2023-10-24T00:48:18.405611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386195+0000","last_change":"2023-10-24T00:48:18.044312+0000","last_active":"2023-10-24T00:48:18.386195+0000","last_peered":"2023-10-24T00:48:18.386195+0000","last_clean":"2023-10-24T00:48:18.386195+0000","last_became_active":"2023-10-24T00:48:18.044028+0000","last_became_peered":"2023-10-24T00:48:18.044028+0000","last_unstale":"2023-10-24T00:48:18.386195+0000","last_undegraded":"2023-10-24T00:48:18.386195+0000","last_fullsized":"2023-10-24T00:48:18.386195+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405597+0000","last_change":"2023-10-24T00:48:18.399820+0000","last_active":"2023-10-24T00:48:18.405597+0000","last_peered":"2023-10-24T00:48:18.405597+0000","last_clean":"2023-10-24T00:48:18.405597+0000","last_became_active":"2023-10-24T00:48:18.399643+0000","last_became_peered":"2023-10-24T00:48:18.399643+0000","last_unstale":"2023-10-24T00:48:18.405597+0000","last_undegraded":"2023-10-24T00:48:18.405597+0000","last_fullsized":"2023-10-24T00:48:18.405597+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.391923+0000","last_change":"2023-10-24T00:48:18.037085+0000","last_active":"2023-10-24T00:48:18.391923+0000","last_peered":"2023-10-24T00:48:18.391923+0000","last_clean":"2023-10-24T00:48:18.391923+0000","last_became_active":"2023-10-24T00:48:18.036799+0000","last_became_peered":"2023-10-24T00:48:18.036799+0000","last_unstale":"2023-10-24T00:48:18.391923+0000","last_undegraded":"2023-10-24T00:48:18.391923+0000","last_fullsized":"2023-10-24T00:48:18.391923+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.403745+0000","last_change":"2023-10-24T00:48:18.396947+0000","last_active":"2023-10-24T00:48:18.403745+0000","last_peered":"2023-10-24T00:48:18.403745+0000","last_clean":"2023-10-24T00:48:18.403745+0000","last_became_active":"2023-10-24T00:48:18.396744+0000","last_became_peered":"2023-10-24T00:48:18.396744+0000","last_unstale":"2023-10-24T00:48:18.403745+0000","last_undegraded":"2023-10-24T00:48:18.403745+0000","last_fullsized":"2023-10-24T00:48:18.403745+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386754+0000","last_change":"2023-10-24T00:48:18.046236+0000","last_active":"2023-10-24T00:48:18.386754+0000","last_peered":"2023-10-24T00:48:18.386754+0000","last_clean":"2023-10-24T00:48:18.386754+0000","last_became_active":"2023-10-24T00:48:18.045972+0000","last_became_peered":"2023-10-24T00:48:18.045972+0000","last_unstale":"2023-10-24T00:48:18.386754+0000","last_undegraded":"2023-10-24T00:48:18.386754+0000","last_fullsized":"2023-10-24T00:48:18.386754+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.413013+0000","last_change":"2023-10-24T00:48:18.410935+0000","last_active":"2023-10-24T00:48:18.413013+0000","last_peered":"2023-10-24T00:48:18.413013+0000","last_clean":"2023-10-24T00:48:18.413013+0000","last_became_active":"2023-10-24T00:48:18.410682+0000","last_became_peered":"2023-10-24T00:48:18.410682+0000","last_unstale":"2023-10-24T00:48:18.413013+0000","last_undegraded":"2023-10-24T00:48:18.413013+0000","last_fullsized":"2023-10-24T00:48:18.413013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409149+0000","last_change":"2023-10-24T00:48:18.041889+0000","last_active":"2023-10-24T00:48:18.409149+0000","last_peered":"2023-10-24T00:48:18.409149+0000","last_clean":"2023-10-24T00:48:18.409149+0000","last_became_active":"2023-10-24T00:48:18.041453+0000","last_became_peered":"2023-10-24T00:48:18.041453+0000","last_unstale":"2023-10-24T00:48:18.409149+0000","last_undegraded":"2023-10-24T00:48:18.409149+0000","last_fullsized":"2023-10-24T00:48:18.409149+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408313+0000","last_change":"2023-10-24T00:48:18.400640+0000","last_active":"2023-10-24T00:48:18.408313+0000","last_peered":"2023-10-24T00:48:18.408313+0000","last_clean":"2023-10-24T00:48:18.408313+0000","last_became_active":"2023-10-24T00:48:18.400349+0000","last_became_peered":"2023-10-24T00:48:18.400349+0000","last_unstale":"2023-10-24T00:48:18.408313+0000","last_undegraded":"2023-10-24T00:48:18.408313+0000","last_fullsized":"2023-10-24T00:48:18.408313+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410069+0000","last_change":"2023-10-24T00:48:18.028828+0000","last_active":"2023-10-24T00:48:18.410069+0000","last_peered":"2023-10-24T00:48:18.410069+0000","last_clean":"2023-10-24T00:48:18.410069+0000","last_became_active":"2023-10-24T00:48:18.028538+0000","last_became_peered":"2023-10-24T00:48:18.028538+0000","last_unstale":"2023-10-24T00:48:18.410069+0000","last_undegraded":"2023-10-24T00:48:18.410069+0000","last_fullsized":"2023-10-24T00:48:18.410069+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.406716+0000","last_change":"2023-10-24T00:48:18.402041+0000","last_active":"2023-10-24T00:48:18.406716+0000","last_peered":"2023-10-24T00:48:18.406716+0000","last_clean":"2023-10-24T00:48:18.406716+0000","last_became_active":"2023-10-24T00:48:18.401383+0000","last_became_peered":"2023-10-24T00:48:18.401383+0000","last_unstale":"2023-10-24T00:48:18.406716+0000","last_undegraded":"2023-10-24T00:48:18.406716+0000","last_fullsized":"2023-10-24T00:48:18.406716+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408849+0000","last_change":"2023-10-24T00:48:18.036207+0000","last_active":"2023-10-24T00:48:18.408849+0000","last_peered":"2023-10-24T00:48:18.408849+0000","last_clean":"2023-10-24T00:48:18.408849+0000","last_became_active":"2023-10-24T00:48:18.035820+0000","last_became_peered":"2023-10-24T00:48:18.035820+0000","last_unstale":"2023-10-24T00:48:18.408849+0000","last_undegraded":"2023-10-24T00:48:18.408849+0000","last_fullsized":"2023-10-24T00:48:18.408849+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408727+0000","last_change":"2023-10-24T00:48:18.402625+0000","last_active":"2023-10-24T00:48:18.408727+0000","last_peered":"2023-10-24T00:48:18.408727+0000","last_clean":"2023-10-24T00:48:18.408727+0000","last_became_active":"2023-10-24T00:48:18.401671+0000","last_became_peered":"2023-10-24T00:48:18.401671+0000","last_unstale":"2023-10-24T00:48:18.408727+0000","last_undegraded":"2023-10-24T00:48:18.408727+0000","last_fullsized":"2023-10-24T00:48:18.408727+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387860+0000","last_change":"2023-10-24T00:48:18.044718+0000","last_active":"2023-10-24T00:48:18.387860+0000","last_peered":"2023-10-24T00:48:18.387860+0000","last_clean":"2023-10-24T00:48:18.387860+0000","last_became_active":"2023-10-24T00:48:18.044354+0000","last_became_peered":"2023-10-24T00:48:18.044354+0000","last_unstale":"2023-10-24T00:48:18.387860+0000","last_undegraded":"2023-10-24T00:48:18.387860+0000","last_fullsized":"2023-10-24T00:48:18.387860+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.411117+0000","last_change":"2023-10-24T00:48:18.410368+0000","last_active":"2023-10-24T00:48:18.411117+0000","last_peered":"2023-10-24T00:48:18.411117+0000","last_clean":"2023-10-24T00:48:18.411117+0000","last_became_active":"2023-10-24T00:48:18.410075+0000","last_became_peered":"2023-10-24T00:48:18.410075+0000","last_unstale":"2023-10-24T00:48:18.411117+0000","last_undegraded":"2023-10-24T00:48:18.411117+0000","last_fullsized":"2023-10-24T00:48:18.411117+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395194+0000","last_change":"2023-10-24T00:48:18.044944+0000","last_active":"2023-10-24T00:48:18.395194+0000","last_peered":"2023-10-24T00:48:18.395194+0000","last_clean":"2023-10-24T00:48:18.395194+0000","last_became_active":"2023-10-24T00:48:18.044562+0000","last_became_peered":"2023-10-24T00:48:18.044562+0000","last_unstale":"2023-10-24T00:48:18.395194+0000","last_undegraded":"2023-10-24T00:48:18.395194+0000","last_fullsized":"2023-10-24T00:48:18.395194+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.399467+0000","last_change":"2023-10-24T00:48:18.396466+0000","last_active":"2023-10-24T00:48:18.399467+0000","last_peered":"2023-10-24T00:48:18.399467+0000","last_clean":"2023-10-24T00:48:18.399467+0000","last_became_active":"2023-10-24T00:48:18.396139+0000","last_became_peered":"2023-10-24T00:48:18.396139+0000","last_unstale":"2023-10-24T00:48:18.399467+0000","last_undegraded":"2023-10-24T00:48:18.399467+0000","last_fullsized":"2023-10-24T00:48:18.399467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.397801+0000","last_change":"2023-10-24T00:48:18.044302+0000","last_active":"2023-10-24T00:48:18.397801+0000","last_peered":"2023-10-24T00:48:18.397801+0000","last_clean":"2023-10-24T00:48:18.397801+0000","last_became_active":"2023-10-24T00:48:18.044039+0000","last_became_peered":"2023-10-24T00:48:18.044039+0000","last_unstale":"2023-10-24T00:48:18.397801+0000","last_undegraded":"2023-10-24T00:48:18.397801+0000","last_fullsized":"2023-10-24T00:48:18.397801+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.413325+0000","last_change":"2023-10-24T00:48:18.410899+0000","last_active":"2023-10-24T00:48:18.413325+0000","last_peered":"2023-10-24T00:48:18.413325+0000","last_clean":"2023-10-24T00:48:18.413325+0000","last_became_active":"2023-10-24T00:48:18.410635+0000","last_became_peered":"2023-10-24T00:48:18.410635+0000","last_unstale":"2023-10-24T00:48:18.413325+0000","last_undegraded":"2023-10-24T00:48:18.413325+0000","last_fullsized":"2023-10-24T00:48:18.413325+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386683+0000","last_change":"2023-10-24T00:48:18.042819+0000","last_active":"2023-10-24T00:48:18.386683+0000","last_peered":"2023-10-24T00:48:18.386683+0000","last_clean":"2023-10-24T00:48:18.386683+0000","last_became_active":"2023-10-24T00:48:18.042239+0000","last_became_peered":"2023-10-24T00:48:18.042239+0000","last_unstale":"2023-10-24T00:48:18.386683+0000","last_undegraded":"2023-10-24T00:48:18.386683+0000","last_fullsized":"2023-10-24T00:48:18.386683+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410265+0000","last_change":"2023-10-24T00:48:18.389674+0000","last_active":"2023-10-24T00:48:18.410265+0000","last_peered":"2023-10-24T00:48:18.410265+0000","last_clean":"2023-10-24T00:48:18.410265+0000","last_became_active":"2023-10-24T00:48:18.389417+0000","last_became_peered":"2023-10-24T00:48:18.389417+0000","last_unstale":"2023-10-24T00:48:18.410265+0000","last_undegraded":"2023-10-24T00:48:18.410265+0000","last_fullsized":"2023-10-24T00:48:18.410265+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.391881+0000","last_change":"2023-10-24T00:48:18.038256+0000","last_active":"2023-10-24T00:48:18.391881+0000","last_peered":"2023-10-24T00:48:18.391881+0000","last_clean":"2023-10-24T00:48:18.391881+0000","last_became_active":"2023-10-24T00:48:18.037986+0000","last_became_peered":"2023-10-24T00:48:18.037986+0000","last_unstale":"2023-10-24T00:48:18.391881+0000","last_undegraded":"2023-10-24T00:48:18.391881+0000","last_fullsized":"2023-10-24T00:48:18.391881+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409560+0000","last_change":"2023-10-24T00:48:18.406134+0000","last_active":"2023-10-24T00:48:18.409560+0000","last_peered":"2023-10-24T00:48:18.409560+0000","last_clean":"2023-10-24T00:48:18.409560+0000","last_became_active":"2023-10-24T00:48:18.405843+0000","last_became_peered":"2023-10-24T00:48:18.405843+0000","last_unstale":"2023-10-24T00:48:18.409560+0000","last_undegraded":"2023-10-24T00:48:18.409560+0000","last_fullsized":"2023-10-24T00:48:18.409560+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410285+0000","last_change":"2023-10-24T00:48:18.034708+0000","last_active":"2023-10-24T00:48:18.410285+0000","last_peered":"2023-10-24T00:48:18.410285+0000","last_clean":"2023-10-24T00:48:18.410285+0000","last_became_active":"2023-10-24T00:48:18.034432+0000","last_became_peered":"2023-10-24T00:48:18.034432+0000","last_unstale":"2023-10-24T00:48:18.410285+0000","last_undegraded":"2023-10-24T00:48:18.410285+0000","last_fullsized":"2023-10-24T00:48:18.410285+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.399526+0000","last_change":"2023-10-24T00:48:18.396704+0000","last_active":"2023-10-24T00:48:18.399526+0000","last_peered":"2023-10-24T00:48:18.399526+0000","last_clean":"2023-10-24T00:48:18.399526+0000","last_became_active":"2023-10-24T00:48:18.396374+0000","last_became_peered":"2023-10-24T00:48:18.396374+0000","last_unstale":"2023-10-24T00:48:18.399526+0000","last_undegraded":"2023-10-24T00:48:18.399526+0000","last_fullsized":"2023-10-24T00:48:18.399526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409323+0000","last_change":"2023-10-24T00:48:18.034651+0000","last_active":"2023-10-24T00:48:18.409323+0000","last_peered":"2023-10-24T00:48:18.409323+0000","last_clean":"2023-10-24T00:48:18.409323+0000","last_became_active":"2023-10-24T00:48:18.034361+0000","last_became_peered":"2023-10-24T00:48:18.034361+0000","last_unstale":"2023-10-24T00:48:18.409323+0000","last_undegraded":"2023-10-24T00:48:18.409323+0000","last_fullsized":"2023-10-24T00:48:18.409323+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409046+0000","last_change":"2023-10-24T00:48:18.404435+0000","last_active":"2023-10-24T00:48:18.409046+0000","last_peered":"2023-10-24T00:48:18.409046+0000","last_clean":"2023-10-24T00:48:18.409046+0000","last_became_active":"2023-10-24T00:48:18.400945+0000","last_became_peered":"2023-10-24T00:48:18.400945+0000","last_unstale":"2023-10-24T00:48:18.409046+0000","last_undegraded":"2023-10-24T00:48:18.409046+0000","last_fullsized":"2023-10-24T00:48:18.409046+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387653+0000","last_change":"2023-10-24T00:48:18.038205+0000","last_active":"2023-10-24T00:48:18.387653+0000","last_peered":"2023-10-24T00:48:18.387653+0000","last_clean":"2023-10-24T00:48:18.387653+0000","last_became_active":"2023-10-24T00:48:18.037941+0000","last_became_peered":"2023-10-24T00:48:18.037941+0000","last_unstale":"2023-10-24T00:48:18.387653+0000","last_undegraded":"2023-10-24T00:48:18.387653+0000","last_fullsized":"2023-10-24T00:48:18.387653+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405733+0000","last_change":"2023-10-24T00:48:18.397799+0000","last_active":"2023-10-24T00:48:18.405733+0000","last_peered":"2023-10-24T00:48:18.405733+0000","last_clean":"2023-10-24T00:48:18.405733+0000","last_became_active":"2023-10-24T00:48:18.397508+0000","last_became_peered":"2023-10-24T00:48:18.397508+0000","last_unstale":"2023-10-24T00:48:18.405733+0000","last_undegraded":"2023-10-24T00:48:18.405733+0000","last_fullsized":"2023-10-24T00:48:18.405733+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387484+0000","last_change":"2023-10-24T00:48:18.037758+0000","last_active":"2023-10-24T00:48:18.387484+0000","last_peered":"2023-10-24T00:48:18.387484+0000","last_clean":"2023-10-24T00:48:18.387484+0000","last_became_active":"2023-10-24T00:48:18.037479+0000","last_became_peered":"2023-10-24T00:48:18.037479+0000","last_unstale":"2023-10-24T00:48:18.387484+0000","last_undegraded":"2023-10-24T00:48:18.387484+0000","last_fullsized":"2023-10-24T00:48:18.387484+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409616+0000","last_change":"2023-10-24T00:48:18.407219+0000","last_active":"2023-10-24T00:48:18.409616+0000","last_peered":"2023-10-24T00:48:18.409616+0000","last_clean":"2023-10-24T00:48:18.409616+0000","last_became_active":"2023-10-24T00:48:18.406652+0000","last_became_peered":"2023-10-24T00:48:18.406652+0000","last_unstale":"2023-10-24T00:48:18.409616+0000","last_undegraded":"2023-10-24T00:48:18.409616+0000","last_fullsized":"2023-10-24T00:48:18.409616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409067+0000","last_change":"2023-10-24T00:48:18.042438+0000","last_active":"2023-10-24T00:48:18.409067+0000","last_peered":"2023-10-24T00:48:18.409067+0000","last_clean":"2023-10-24T00:48:18.409067+0000","last_became_active":"2023-10-24T00:48:18.042158+0000","last_became_peered":"2023-10-24T00:48:18.042158+0000","last_unstale":"2023-10-24T00:48:18.409067+0000","last_undegraded":"2023-10-24T00:48:18.409067+0000","last_fullsized":"2023-10-24T00:48:18.409067+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395015+0000","last_change":"2023-10-24T00:48:18.390925+0000","last_active":"2023-10-24T00:48:18.395015+0000","last_peered":"2023-10-24T00:48:18.395015+0000","last_clean":"2023-10-24T00:48:18.395015+0000","last_became_active":"2023-10-24T00:48:18.390655+0000","last_became_peered":"2023-10-24T00:48:18.390655+0000","last_unstale":"2023-10-24T00:48:18.395015+0000","last_undegraded":"2023-10-24T00:48:18.395015+0000","last_fullsized":"2023-10-24T00:48:18.395015+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.388616+0000","last_change":"2023-10-24T00:48:18.039929+0000","last_active":"2023-10-24T00:48:18.388616+0000","last_peered":"2023-10-24T00:48:18.388616+0000","last_clean":"2023-10-24T00:48:18.388616+0000","last_became_active":"2023-10-24T00:48:18.039663+0000","last_became_peered":"2023-10-24T00:48:18.039663+0000","last_unstale":"2023-10-24T00:48:18.388616+0000","last_undegraded":"2023-10-24T00:48:18.388616+0000","last_fullsized":"2023-10-24T00:48:18.388616+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407803+0000","last_change":"2023-10-24T00:48:18.403440+0000","last_active":"2023-10-24T00:48:18.407803+0000","last_peered":"2023-10-24T00:48:18.407803+0000","last_clean":"2023-10-24T00:48:18.407803+0000","last_became_active":"2023-10-24T00:48:18.402380+0000","last_became_peered":"2023-10-24T00:48:18.402380+0000","last_unstale":"2023-10-24T00:48:18.407803+0000","last_undegraded":"2023-10-24T00:48:18.407803+0000","last_fullsized":"2023-10-24T00:48:18.407803+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.383876+0000","last_change":"2023-10-24T00:48:18.041939+0000","last_active":"2023-10-24T00:48:18.383876+0000","last_peered":"2023-10-24T00:48:18.383876+0000","last_clean":"2023-10-24T00:48:18.383876+0000","last_became_active":"2023-10-24T00:48:18.041656+0000","last_became_peered":"2023-10-24T00:48:18.041656+0000","last_unstale":"2023-10-24T00:48:18.383876+0000","last_undegraded":"2023-10-24T00:48:18.383876+0000","last_fullsized":"2023-10-24T00:48:18.383876+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405629+0000","last_change":"2023-10-24T00:48:18.397088+0000","last_active":"2023-10-24T00:48:18.405629+0000","last_peered":"2023-10-24T00:48:18.405629+0000","last_clean":"2023-10-24T00:48:18.405629+0000","last_became_active":"2023-10-24T00:48:18.396777+0000","last_became_peered":"2023-10-24T00:48:18.396777+0000","last_unstale":"2023-10-24T00:48:18.405629+0000","last_undegraded":"2023-10-24T00:48:18.405629+0000","last_fullsized":"2023-10-24T00:48:18.405629+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.385748+0000","last_change":"2023-10-24T00:48:18.033645+0000","last_active":"2023-10-24T00:48:18.385748+0000","last_peered":"2023-10-24T00:48:18.385748+0000","last_clean":"2023-10-24T00:48:18.385748+0000","last_became_active":"2023-10-24T00:48:18.033340+0000","last_became_peered":"2023-10-24T00:48:18.033340+0000","last_unstale":"2023-10-24T00:48:18.385748+0000","last_undegraded":"2023-10-24T00:48:18.385748+0000","last_fullsized":"2023-10-24T00:48:18.385748+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.413771+0000","last_change":"2023-10-24T00:48:18.412732+0000","last_active":"2023-10-24T00:48:18.413771+0000","last_peered":"2023-10-24T00:48:18.413771+0000","last_clean":"2023-10-24T00:48:18.413771+0000","last_became_active":"2023-10-24T00:48:18.412305+0000","last_became_peered":"2023-10-24T00:48:18.412305+0000","last_unstale":"2023-10-24T00:48:18.413771+0000","last_undegraded":"2023-10-24T00:48:18.413771+0000","last_fullsized":"2023-10-24T00:48:18.413771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.412079+0000","last_change":"2023-10-24T00:48:18.038704+0000","last_active":"2023-10-24T00:48:18.412079+0000","last_peered":"2023-10-24T00:48:18.412079+0000","last_clean":"2023-10-24T00:48:18.412079+0000","last_became_active":"2023-10-24T00:48:18.038444+0000","last_became_peered":"2023-10-24T00:48:18.038444+0000","last_unstale":"2023-10-24T00:48:18.412079+0000","last_undegraded":"2023-10-24T00:48:18.412079+0000","last_fullsized":"2023-10-24T00:48:18.412079+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410143+0000","last_change":"2023-10-24T00:48:18.401374+0000","last_active":"2023-10-24T00:48:18.410143+0000","last_peered":"2023-10-24T00:48:18.410143+0000","last_clean":"2023-10-24T00:48:18.410143+0000","last_became_active":"2023-10-24T00:48:18.401081+0000","last_became_peered":"2023-10-24T00:48:18.401081+0000","last_unstale":"2023-10-24T00:48:18.410143+0000","last_undegraded":"2023-10-24T00:48:18.410143+0000","last_fullsized":"2023-10-24T00:48:18.410143+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.393130+0000","last_change":"2023-10-24T00:48:18.043878+0000","last_active":"2023-10-24T00:48:18.393130+0000","last_peered":"2023-10-24T00:48:18.393130+0000","last_clean":"2023-10-24T00:48:18.393130+0000","last_became_active":"2023-10-24T00:48:18.043592+0000","last_became_peered":"2023-10-24T00:48:18.043592+0000","last_unstale":"2023-10-24T00:48:18.393130+0000","last_undegraded":"2023-10-24T00:48:18.393130+0000","last_fullsized":"2023-10-24T00:48:18.393130+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408402+0000","last_change":"2023-10-24T00:48:18.397796+0000","last_active":"2023-10-24T00:48:18.408402+0000","last_peered":"2023-10-24T00:48:18.408402+0000","last_clean":"2023-10-24T00:48:18.408402+0000","last_became_active":"2023-10-24T00:48:18.397517+0000","last_became_peered":"2023-10-24T00:48:18.397517+0000","last_unstale":"2023-10-24T00:48:18.408402+0000","last_undegraded":"2023-10-24T00:48:18.408402+0000","last_fullsized":"2023-10-24T00:48:18.408402+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.392721+0000","last_change":"2023-10-24T00:48:18.042080+0000","last_active":"2023-10-24T00:48:18.392721+0000","last_peered":"2023-10-24T00:48:18.392721+0000","last_clean":"2023-10-24T00:48:18.392721+0000","last_became_active":"2023-10-24T00:48:18.040827+0000","last_became_peered":"2023-10-24T00:48:18.040827+0000","last_unstale":"2023-10-24T00:48:18.392721+0000","last_undegraded":"2023-10-24T00:48:18.392721+0000","last_fullsized":"2023-10-24T00:48:18.392721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408039+0000","last_change":"2023-10-24T00:48:18.406320+0000","last_active":"2023-10-24T00:48:18.408039+0000","last_peered":"2023-10-24T00:48:18.408039+0000","last_clean":"2023-10-24T00:48:18.408039+0000","last_became_active":"2023-10-24T00:48:18.406062+0000","last_became_peered":"2023-10-24T00:48:18.406062+0000","last_unstale":"2023-10-24T00:48:18.408039+0000","last_undegraded":"2023-10-24T00:48:18.408039+0000","last_fullsized":"2023-10-24T00:48:18.408039+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.399253+0000","last_change":"2023-10-24T00:48:18.039363+0000","last_active":"2023-10-24T00:48:18.399253+0000","last_peered":"2023-10-24T00:48:18.399253+0000","last_clean":"2023-10-24T00:48:18.399253+0000","last_became_active":"2023-10-24T00:48:18.038320+0000","last_became_peered":"2023-10-24T00:48:18.038320+0000","last_unstale":"2023-10-24T00:48:18.399253+0000","last_undegraded":"2023-10-24T00:48:18.399253+0000","last_fullsized":"2023-10-24T00:48:18.399253+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409598+0000","last_change":"2023-10-24T00:48:18.407055+0000","last_active":"2023-10-24T00:48:18.409598+0000","last_peered":"2023-10-24T00:48:18.409598+0000","last_clean":"2023-10-24T00:48:18.409598+0000","last_became_active":"2023-10-24T00:48:18.404965+0000","last_became_peered":"2023-10-24T00:48:18.404965+0000","last_unstale":"2023-10-24T00:48:18.409598+0000","last_undegraded":"2023-10-24T00:48:18.409598+0000","last_fullsized":"2023-10-24T00:48:18.409598+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395267+0000","last_change":"2023-10-24T00:48:18.036842+0000","last_active":"2023-10-24T00:48:18.395267+0000","last_peered":"2023-10-24T00:48:18.395267+0000","last_clean":"2023-10-24T00:48:18.395267+0000","last_became_active":"2023-10-24T00:48:18.035634+0000","last_became_peered":"2023-10-24T00:48:18.035634+0000","last_unstale":"2023-10-24T00:48:18.395267+0000","last_undegraded":"2023-10-24T00:48:18.395267+0000","last_fullsized":"2023-10-24T00:48:18.395267+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407709+0000","last_change":"2023-10-24T00:48:18.403236+0000","last_active":"2023-10-24T00:48:18.407709+0000","last_peered":"2023-10-24T00:48:18.407709+0000","last_clean":"2023-10-24T00:48:18.407709+0000","last_became_active":"2023-10-24T00:48:18.403000+0000","last_became_peered":"2023-10-24T00:48:18.403000+0000","last_unstale":"2023-10-24T00:48:18.407709+0000","last_undegraded":"2023-10-24T00:48:18.407709+0000","last_fullsized":"2023-10-24T00:48:18.407709+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394306+0000","last_change":"2023-10-24T00:48:18.038277+0000","last_active":"2023-10-24T00:48:18.394306+0000","last_peered":"2023-10-24T00:48:18.394306+0000","last_clean":"2023-10-24T00:48:18.394306+0000","last_became_active":"2023-10-24T00:48:18.037812+0000","last_became_peered":"2023-10-24T00:48:18.037812+0000","last_unstale":"2023-10-24T00:48:18.394306+0000","last_undegraded":"2023-10-24T00:48:18.394306+0000","last_fullsized":"2023-10-24T00:48:18.394306+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.409483+0000","last_change":"2023-10-24T00:48:18.405267+0000","last_active":"2023-10-24T00:48:18.409483+0000","last_peered":"2023-10-24T00:48:18.409483+0000","last_clean":"2023-10-24T00:48:18.409483+0000","last_became_active":"2023-10-24T00:48:18.404925+0000","last_became_peered":"2023-10-24T00:48:18.404925+0000","last_unstale":"2023-10-24T00:48:18.409483+0000","last_undegraded":"2023-10-24T00:48:18.409483+0000","last_fullsized":"2023-10-24T00:48:18.409483+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.392023+0000","last_change":"2023-10-24T00:48:18.038024+0000","last_active":"2023-10-24T00:48:18.392023+0000","last_peered":"2023-10-24T00:48:18.392023+0000","last_clean":"2023-10-24T00:48:18.392023+0000","last_became_active":"2023-10-24T00:48:18.037740+0000","last_became_peered":"2023-10-24T00:48:18.037740+0000","last_unstale":"2023-10-24T00:48:18.392023+0000","last_undegraded":"2023-10-24T00:48:18.392023+0000","last_fullsized":"2023-10-24T00:48:18.392023+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410307+0000","last_change":"2023-10-24T00:48:18.399831+0000","last_active":"2023-10-24T00:48:18.410307+0000","last_peered":"2023-10-24T00:48:18.410307+0000","last_clean":"2023-10-24T00:48:18.410307+0000","last_became_active":"2023-10-24T00:48:18.399561+0000","last_became_peered":"2023-10-24T00:48:18.399561+0000","last_unstale":"2023-10-24T00:48:18.410307+0000","last_undegraded":"2023-10-24T00:48:18.410307+0000","last_fullsized":"2023-10-24T00:48:18.410307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.385883+0000","last_change":"2023-10-24T00:48:18.044227+0000","last_active":"2023-10-24T00:48:18.385883+0000","last_peered":"2023-10-24T00:48:18.385883+0000","last_clean":"2023-10-24T00:48:18.385883+0000","last_became_active":"2023-10-24T00:48:18.043885+0000","last_became_peered":"2023-10-24T00:48:18.043885+0000","last_unstale":"2023-10-24T00:48:18.385883+0000","last_undegraded":"2023-10-24T00:48:18.385883+0000","last_fullsized":"2023-10-24T00:48:18.385883+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.400015+0000","last_change":"2023-10-24T00:48:18.399058+0000","last_active":"2023-10-24T00:48:18.400015+0000","last_peered":"2023-10-24T00:48:18.400015+0000","last_clean":"2023-10-24T00:48:18.400015+0000","last_became_active":"2023-10-24T00:48:18.398787+0000","last_became_peered":"2023-10-24T00:48:18.398787+0000","last_unstale":"2023-10-24T00:48:18.400015+0000","last_undegraded":"2023-10-24T00:48:18.400015+0000","last_fullsized":"2023-10-24T00:48:18.400015+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394295+0000","last_change":"2023-10-24T00:48:18.041439+0000","last_active":"2023-10-24T00:48:18.394295+0000","last_peered":"2023-10-24T00:48:18.394295+0000","last_clean":"2023-10-24T00:48:18.394295+0000","last_became_active":"2023-10-24T00:48:18.041068+0000","last_became_peered":"2023-10-24T00:48:18.041068+0000","last_unstale":"2023-10-24T00:48:18.394295+0000","last_undegraded":"2023-10-24T00:48:18.394295+0000","last_fullsized":"2023-10-24T00:48:18.394295+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387933+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T00:48:18.387933+0000","last_peered":"2023-10-24T00:48:18.387933+0000","last_clean":"2023-10-24T00:48:18.387933+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T00:48:18.387933+0000","last_undegraded":"2023-10-24T00:48:18.387933+0000","last_fullsized":"2023-10-24T00:48:18.387933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.403938+0000","last_change":"2023-10-24T00:48:18.399295+0000","last_active":"2023-10-24T00:48:18.403938+0000","last_peered":"2023-10-24T00:48:18.403938+0000","last_clean":"2023-10-24T00:48:18.403938+0000","last_became_active":"2023-10-24T00:48:18.399037+0000","last_became_peered":"2023-10-24T00:48:18.399037+0000","last_unstale":"2023-10-24T00:48:18.403938+0000","last_undegraded":"2023-10-24T00:48:18.403938+0000","last_fullsized":"2023-10-24T00:48:18.403938+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.383795+0000","last_change":"2023-10-24T00:48:18.047097+0000","last_active":"2023-10-24T00:48:18.383795+0000","last_peered":"2023-10-24T00:48:18.383795+0000","last_clean":"2023-10-24T00:48:18.383795+0000","last_became_active":"2023-10-24T00:48:18.046725+0000","last_became_peered":"2023-10-24T00:48:18.046725+0000","last_unstale":"2023-10-24T00:48:18.383795+0000","last_undegraded":"2023-10-24T00:48:18.383795+0000","last_fullsized":"2023-10-24T00:48:18.383795+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386094+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T00:48:18.386094+0000","last_peered":"2023-10-24T00:48:18.386094+0000","last_clean":"2023-10-24T00:48:18.386094+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T00:48:18.386094+0000","last_undegraded":"2023-10-24T00:48:18.386094+0000","last_fullsized":"2023-10-24T00:48:18.386094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410188+0000","last_change":"2023-10-24T00:48:18.399813+0000","last_active":"2023-10-24T00:48:18.410188+0000","last_peered":"2023-10-24T00:48:18.410188+0000","last_clean":"2023-10-24T00:48:18.410188+0000","last_became_active":"2023-10-24T00:48:18.399543+0000","last_became_peered":"2023-10-24T00:48:18.399543+0000","last_unstale":"2023-10-24T00:48:18.410188+0000","last_undegraded":"2023-10-24T00:48:18.410188+0000","last_fullsized":"2023-10-24T00:48:18.410188+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.384896+0000","last_change":"2023-10-24T00:48:18.040254+0000","last_active":"2023-10-24T00:48:18.384896+0000","last_peered":"2023-10-24T00:48:18.384896+0000","last_clean":"2023-10-24T00:48:18.384896+0000","last_became_active":"2023-10-24T00:48:18.039228+0000","last_became_peered":"2023-10-24T00:48:18.039228+0000","last_unstale":"2023-10-24T00:48:18.384896+0000","last_undegraded":"2023-10-24T00:48:18.384896+0000","last_fullsized":"2023-10-24T00:48:18.384896+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.391389+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T00:48:18.391389+0000","last_peered":"2023-10-24T00:48:18.391389+0000","last_clean":"2023-10-24T00:48:18.391389+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T00:48:18.391389+0000","last_undegraded":"2023-10-24T00:48:18.391389+0000","last_fullsized":"2023-10-24T00:48:18.391389+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408844+0000","last_change":"2023-10-24T00:48:18.404503+0000","last_active":"2023-10-24T00:48:18.408844+0000","last_peered":"2023-10-24T00:48:18.408844+0000","last_clean":"2023-10-24T00:48:18.408844+0000","last_became_active":"2023-10-24T00:48:18.402162+0000","last_became_peered":"2023-10-24T00:48:18.402162+0000","last_unstale":"2023-10-24T00:48:18.408844+0000","last_undegraded":"2023-10-24T00:48:18.408844+0000","last_fullsized":"2023-10-24T00:48:18.408844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408262+0000","last_change":"2023-10-24T00:48:18.045000+0000","last_active":"2023-10-24T00:48:18.408262+0000","last_peered":"2023-10-24T00:48:18.408262+0000","last_clean":"2023-10-24T00:48:18.408262+0000","last_became_active":"2023-10-24T00:48:18.044728+0000","last_became_peered":"2023-10-24T00:48:18.044728+0000","last_unstale":"2023-10-24T00:48:18.408262+0000","last_undegraded":"2023-10-24T00:48:18.408262+0000","last_fullsized":"2023-10-24T00:48:18.408262+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.385731+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T00:48:18.385731+0000","last_peered":"2023-10-24T00:48:18.385731+0000","last_clean":"2023-10-24T00:48:18.385731+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T00:48:18.385731+0000","last_undegraded":"2023-10-24T00:48:18.385731+0000","last_fullsized":"2023-10-24T00:48:18.385731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":135,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386071+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T00:48:18.386071+0000","last_peered":"2023-10-24T00:48:18.386071+0000","last_clean":"2023-10-24T00:48:18.386071+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T00:48:18.386071+0000","last_undegraded":"2023-10-24T00:48:18.386071+0000","last_fullsized":"2023-10-24T00:48:18.386071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405827+0000","last_change":"2023-10-24T00:48:18.399923+0000","last_active":"2023-10-24T00:48:18.405827+0000","last_peered":"2023-10-24T00:48:18.405827+0000","last_clean":"2023-10-24T00:48:18.405827+0000","last_became_active":"2023-10-24T00:48:18.399557+0000","last_became_peered":"2023-10-24T00:48:18.399557+0000","last_unstale":"2023-10-24T00:48:18.405827+0000","last_undegraded":"2023-10-24T00:48:18.405827+0000","last_fullsized":"2023-10-24T00:48:18.405827+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.408501+0000","last_change":"2023-10-24T00:48:18.045594+0000","last_active":"2023-10-24T00:48:18.408501+0000","last_peered":"2023-10-24T00:48:18.408501+0000","last_clean":"2023-10-24T00:48:18.408501+0000","last_became_active":"2023-10-24T00:48:18.045329+0000","last_became_peered":"2023-10-24T00:48:18.045329+0000","last_unstale":"2023-10-24T00:48:18.408501+0000","last_undegraded":"2023-10-24T00:48:18.408501+0000","last_fullsized":"2023-10-24T00:48:18.408501+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.386174+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T00:48:18.386174+0000","last_peered":"2023-10-24T00:48:18.386174+0000","last_clean":"2023-10-24T00:48:18.386174+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T00:48:18.386174+0000","last_undegraded":"2023-10-24T00:48:18.386174+0000","last_fullsized":"2023-10-24T00:48:18.386174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.395854+0000","last_change":"2023-10-24T00:48:18.390832+0000","last_active":"2023-10-24T00:48:18.395854+0000","last_peered":"2023-10-24T00:48:18.395854+0000","last_clean":"2023-10-24T00:48:18.395854+0000","last_became_active":"2023-10-24T00:48:18.390571+0000","last_became_peered":"2023-10-24T00:48:18.390571+0000","last_unstale":"2023-10-24T00:48:18.395854+0000","last_undegraded":"2023-10-24T00:48:18.395854+0000","last_fullsized":"2023-10-24T00:48:18.395854+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387203+0000","last_change":"2023-10-24T00:48:18.045608+0000","last_active":"2023-10-24T00:48:18.387203+0000","last_peered":"2023-10-24T00:48:18.387203+0000","last_clean":"2023-10-24T00:48:18.387203+0000","last_became_active":"2023-10-24T00:48:18.045257+0000","last_became_peered":"2023-10-24T00:48:18.045257+0000","last_unstale":"2023-10-24T00:48:18.387203+0000","last_undegraded":"2023-10-24T00:48:18.387203+0000","last_fullsized":"2023-10-24T00:48:18.387203+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.387847+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T00:48:18.387847+0000","last_peered":"2023-10-24T00:48:18.387847+0000","last_clean":"2023-10-24T00:48:18.387847+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T00:48:18.387847+0000","last_undegraded":"2023-10-24T00:48:18.387847+0000","last_fullsized":"2023-10-24T00:48:18.387847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.407543+0000","last_change":"2023-10-24T00:48:18.402763+0000","last_active":"2023-10-24T00:48:18.407543+0000","last_peered":"2023-10-24T00:48:18.407543+0000","last_clean":"2023-10-24T00:48:18.407543+0000","last_became_active":"2023-10-24T00:48:18.402027+0000","last_became_peered":"2023-10-24T00:48:18.402027+0000","last_unstale":"2023-10-24T00:48:18.407543+0000","last_undegraded":"2023-10-24T00:48:18.407543+0000","last_fullsized":"2023-10-24T00:48:18.407543+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.410127+0000","last_change":"2023-10-24T00:48:18.038309+0000","last_active":"2023-10-24T00:48:18.410127+0000","last_peered":"2023-10-24T00:48:18.410127+0000","last_clean":"2023-10-24T00:48:18.410127+0000","last_became_active":"2023-10-24T00:48:18.037990+0000","last_became_peered":"2023-10-24T00:48:18.037990+0000","last_unstale":"2023-10-24T00:48:18.410127+0000","last_undegraded":"2023-10-24T00:48:18.410127+0000","last_fullsized":"2023-10-24T00:48:18.410127+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.388567+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T00:48:18.388567+0000","last_peered":"2023-10-24T00:48:18.388567+0000","last_clean":"2023-10-24T00:48:18.388567+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T00:48:18.388567+0000","last_undegraded":"2023-10-24T00:48:18.388567+0000","last_fullsized":"2023-10-24T00:48:18.388567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.405719+0000","last_change":"2023-10-24T00:48:18.397594+0000","last_active":"2023-10-24T00:48:18.405719+0000","last_peered":"2023-10-24T00:48:18.405719+0000","last_clean":"2023-10-24T00:48:18.405719+0000","last_became_active":"2023-10-24T00:48:18.397309+0000","last_became_peered":"2023-10-24T00:48:18.397309+0000","last_unstale":"2023-10-24T00:48:18.405719+0000","last_undegraded":"2023-10-24T00:48:18.405719+0000","last_fullsized":"2023-10-24T00:48:18.405719+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:18.009713+0000","last_clean_scrub_stamp":"2023-10-24T00:48:18.009713+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.399120+0000","last_change":"2023-10-24T00:48:18.044172+0000","last_active":"2023-10-24T00:48:18.399120+0000","last_peered":"2023-10-24T00:48:18.399120+0000","last_clean":"2023-10-24T00:48:18.399120+0000","last_became_active":"2023-10-24T00:48:18.043858+0000","last_became_peered":"2023-10-24T00:48:18.043858+0000","last_unstale":"2023-10-24T00:48:18.399120+0000","last_undegraded":"2023-10-24T00:48:18.399120+0000","last_fullsized":"2023-10-24T00:48:18.399120+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:48:17.002454+0000","last_clean_scrub_stamp":"2023-10-24T00:48:17.002454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-24T00:48:18.394315+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T00:48:18.394315+0000","last_peered":"2023-10-24T00:48:18.394315+0000","last_clean":"2023-10-24T00:48:18.394315+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T00:48:18.394315+0000","last_undegraded":"2023-10-24T00:48:18.394315+0000","last_fullsized":"2023-10-24T00:48:18.394315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542377,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":885797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.78700000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.55400000000000005},"min":{"1min":0.45300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.318},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.41499999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.59899999999999998,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.444,"5min":5.444,"15min":5.444},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.502}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.34899999999999998},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.433},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.55000000000000004,"5min":0.39700000000000002,"15min":0.35099999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.372,"5min":0.27400000000000002,"15min":0.246},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":4.0759999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":4.351},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.56000000000000005,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":1.4239999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.70899999999999996,"15min":0.60799999999999998},"min":{"1min":0.43099999999999999,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":11.211,"5min":11.211,"15min":11.211},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.236,"5min":0.69599999999999995,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.116,"5min":11.116,"15min":11.116},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575081,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":886157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28699999999999998,"15min":0.217},"max":{"1min":0.76900000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.33200000000000002,"15min":0.29799999999999999},"max":{"1min":0.69799999999999995,"5min":0.83799999999999997,"15min":1.3839999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.30099999999999999},"max":{"1min":0.67400000000000004,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.28299999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.573},"last":0.53100000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.55600000000000005},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.64200000000000002,"5min":0.81299999999999994,"15min":7.7969999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.88,"15min":1.5029999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.58999999999999997},"min":{"1min":0.39900000000000002,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":14.597},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.56999999999999995},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.69999999999999996,"5min":0.85899999999999999,"15min":2.2469999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.33100000000000002,"5min":0.27300000000000002,"15min":0.26800000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.505},"min":{"1min":0.35899999999999999,"5min":0.29499999999999998,"15min":0.28399999999999997},"max":{"1min":0.66400000000000003,"5min":0.83399999999999996,"15min":7.8559999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47999999999999998,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.65200000000000002,"5min":0.80800000000000005,"15min":1.4530000000000001},"last":0.374},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.82699999999999996,"15min":0.84599999999999997},"last":0.497}]},{"osd":7,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.872},"last":0.436},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":7.8929999999999998},"last":0.38900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575082,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":885625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.36199999999999999,"15min":0.378},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":1.5029999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.40100000000000002,"15min":0.40899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.66800000000000004},"last":0.30599999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38900000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":3.2519999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.255,"5min":0.25,"15min":0.25},"max":{"1min":0.55400000000000005,"5min":0.66500000000000004,"15min":1.1890000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.41299999999999998,"15min":0.43099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57399999999999995,"5min":0.66600000000000004,"15min":3.2269999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.44400000000000001},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":1.1659999999999999},"last":0.40300000000000002}]},{"osd":4,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59299999999999997},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":1.143},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.92900000000000005},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.40200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86199999999999999,"5min":0.89100000000000001,"15min":0.91100000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.879,"5min":0.89100000000000001,"15min":3.1190000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.83899999999999997,"15min":0.90600000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.437,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88400000000000001,"5min":0.91700000000000004,"15min":3.2010000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:47:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.90500000000000003,"15min":1.109},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.628},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.90800000000000003,"15min":0.93899999999999995},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575082,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":887071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.20000000000000001},"max":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.377,"15min":0.39200000000000002},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.20699999999999999},"max":{"1min":0.52300000000000002,"5min":0.60799999999999998,"15min":0.70799999999999996},"last":0.34100000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.215},"max":{"1min":0.63400000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.374,"15min":0.38500000000000001},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.63100000000000001},"last":0.307}]},{"osd":3,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.40600000000000003},"min":{"1min":0.30099999999999999,"5min":0.26100000000000001,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.60299999999999998,"15min":0.628},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.432,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.24299999999999999},"max":{"1min":0.56100000000000005,"5min":0.622,"15min":0.67100000000000004},"last":0.374}]},{"osd":4,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.86099999999999999,"15min":0.90300000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.34399999999999997},"max":{"1min":0.82399999999999995,"5min":0.82899999999999996,"15min":0.92400000000000004},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.61099999999999999},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.35699999999999998},"max":{"1min":0.89400000000000002,"5min":0.93600000000000005,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.59999999999999998},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.38900000000000001},"max":{"1min":0.70199999999999996,"5min":0.84599999999999997,"15min":0.91500000000000004},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59899999999999998,"15min":0.61699999999999999},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.85699999999999998,"5min":0.877,"15min":0.94199999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.86299999999999999,"15min":0.876},"last":0.61099999999999999}]},{"osd":7,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.621,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.35499999999999998},"max":{"1min":0.878,"5min":0.89200000000000002,"15min":0.91700000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.495,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.621}]}]},{"osd":2,"up_from":14,"seq":60129542377,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":886565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34999999999999998,"15min":0.35899999999999999},"min":{"1min":0.28000000000000003,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.498,"5min":0.53900000000000003,"15min":0.57199999999999995},"last":0.442},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.38900000000000001},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.51600000000000001,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.377},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.65500000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.40500000000000003,"15min":0.41699999999999998},"min":{"1min":0.29599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.53100000000000003,"5min":0.71799999999999997,"15min":0.73699999999999999},"last":0.496}]},{"osd":3,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41299999999999998,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.54600000000000004,"5min":0.61199999999999999,"15min":0.76800000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40000000000000002,"15min":0.41499999999999998},"min":{"1min":0.25900000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.56399999999999995,"5min":0.63,"15min":0.84999999999999998},"last":0.51000000000000001}]},{"osd":4,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.83099999999999996,"15min":0.93600000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.82799999999999996,"5min":0.876,"15min":0.97699999999999998},"last":0.53500000000000003}]},{"osd":5,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.40200000000000002,"15min":0.38100000000000001},"max":{"1min":0.86299999999999999,"5min":0.89400000000000002,"15min":0.95299999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":1.0609999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.624},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39200000000000002},"max":{"1min":0.93200000000000005,"5min":0.95399999999999996,"15min":1.0229999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.38500000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.97599999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:48:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.91500000000000004,"15min":1.083},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90400000000000003,"5min":0.91600000000000004,"15min":0.999},"last":0.66000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575082,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":886281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51000000000000001,"5min":0.59299999999999997,"15min":0.90400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.378,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56799999999999995,"5min":1.099,"15min":1.099},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.373},"min":{"1min":0.27700000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.68799999999999994,"15min":0.79900000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.67600000000000005,"15min":0.86599999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.40000000000000002},"min":{"1min":0.26500000000000001,"5min":0.246,"15min":0.23699999999999999},"max":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.63700000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.44900000000000001},"min":{"1min":0.33700000000000002,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.63300000000000001,"5min":0.83199999999999996,"15min":0.85099999999999998},"last":0.505}]},{"osd":4,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71099999999999997,"5min":0.91900000000000004,"15min":1.024},"last":0.499},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82499999999999996,"5min":0.94299999999999995,"15min":1.0269999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.61099999999999999},"min":{"1min":0.44700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78000000000000003,"5min":0.874,"15min":1.0620000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.498,"5min":0.39900000000000002,"15min":0.36399999999999999},"max":{"1min":0.86399999999999999,"5min":0.93999999999999995,"15min":0.995},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 24 00:48:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":1.337,"15min":1.337},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.63200000000000001},"min":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.73799999999999999,"5min":0.996,"15min":1.042},"last":0.625}]},{"osd":7,"last update":"Tue Oct 24 00:48:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.629,"15min":0.64400000000000002},"min":{"1min":0.45500000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.84099999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63600000000000001,"15min":0.65800000000000003},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76500000000000001,"5min":0.96299999999999997,"15min":1.121},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575082,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":886247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.68200000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.505},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.74299999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.79100000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.82599999999999996},"last":0.44}]},{"osd":2,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54700000000000004},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.66400000000000003,"5min":0.73999999999999999,"15min":0.77400000000000002},"last":0.43099999999999999}]},{"osd":3,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.80700000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47099999999999997}]},{"osd":5,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58999999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.34200000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.379}]},{"osd":6,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55500000000000005}]},{"osd":7,"last update":"Tue Oct 24 00:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.88,"15min":0.88},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54400000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542377,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1761280,"data_stored":885693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.41299999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64600000000000002,"5min":0.71099999999999997,"15min":0.77400000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.377}]},{"osd":1,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.249},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.627,"5min":0.748,"15min":1.1479999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54400000000000004,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.32100000000000001,"15min":0.23899999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0209999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33100000000000002},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.50700000000000001}]},{"osd":3,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.41599999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.41799999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.25800000000000001},"max":{"1min":0.64100000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.26400000000000001},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":1.339},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49299999999999999,"15min":0.49399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63400000000000001,"5min":0.85899999999999999,"15min":1.1120000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.76400000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 24 00:47:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.421},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":0.82799999999999996,"15min":1.772},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T00:48:26.143 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T00:48:26.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T00:48:26.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.296+0000 7f14bee7f700 1 Processor -- start 2023-10-24T00:48:26.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.296+0000 7f14bee7f700 1 -- start start 2023-10-24T00:48:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bee7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bee7f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80c71d0 con 0x7f14b80bffd0 2023-10-24T00:48:26.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bee7f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80c9410 con 0x7f14b8154430 2023-10-24T00:48:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bee7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80c6a10 con 0x7f14b8098bd0 2023-10-24T00:48:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bd41c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f14b80bffd0 0x7f14b815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52938/0 (socket says 172.21.15.148:52938) 2023-10-24T00:48:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14bd41c700 1 -- 172.21.15.148:0/4105315710 learned_addr learned my addr 172.21.15.148:0/4105315710 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14b7fff700 1 --2- 172.21.15.148:0/4105315710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102112515 0 0) 0x7f14b80c71d0 con 0x7f14b80bffd0 2023-10-24T00:48:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a80033f0 con 0x7f14b80bffd0 2023-10-24T00:48:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.297+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929655674 0 0) 0x7f14b80c9410 con 0x7f14b8154430 2023-10-24T00:48:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b7fff700 1 -- 172.21.15.148:0/4105315710 >> v1:172.21.15.150:6789/0 conn(0x7f14b8154430 legacy=0x7f14b80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b7fff700 1 -- 172.21.15.148:0/4105315710 >> v1:172.21.15.148:6789/0 conn(0x7f14b80bffd0 legacy=0x7f14b815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b7fff700 1 -- 172.21.15.148:0/4105315710 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80ca8b0 con 0x7f14b8098bd0 2023-10-24T00:48:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b7fff700 1 --2- 172.21.15.148:0/4105315710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b8154810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f14a40097c0 tx=0x7f14a4009060).ready entity=mon.2 client_cookie=6e13d417f7455018 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400f510 con 0x7f14b8098bd0 2023-10-24T00:48:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400f670 con 0x7f14b8098bd0 2023-10-24T00:48:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14b77fe700 1 -- 172.21.15.148:0/4105315710 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400f9f0 con 0x7f14b8098bd0 2023-10-24T00:48:26.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 -- 172.21.15.148:0/4105315710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 msgr2=0x7f14b8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 --2- 172.21.15.148:0/4105315710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b8154810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f14a40097c0 tx=0x7f14a4009060).stop 2023-10-24T00:48:26.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 -- 172.21.15.148:0/4105315710 shutdown_connections 2023-10-24T00:48:26.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 --2- 172.21.15.148:0/4105315710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b8154810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 -- 172.21.15.148:0/4105315710 >> 172.21.15.148:0/4105315710 conn(0x7f14b80cb070 msgr2=0x7f14b80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:26.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 -- 172.21.15.148:0/4105315710 shutdown_connections 2023-10-24T00:48:26.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.298+0000 7f14bee7f700 1 -- 172.21.15.148:0/4105315710 wait complete. 2023-10-24T00:48:26.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.299+0000 7f14bee7f700 1 Processor -- start 2023-10-24T00:48:26.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 -- start start 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b81679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b8154430 0x7f14b8156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81681c0 con 0x7f14b80bffd0 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81684a0 con 0x7f14b8154430 2023-10-24T00:48:26.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.300+0000 7f14bee7f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8168780 con 0x7f14b8098bd0 2023-10-24T00:48:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48378/0 (socket says 172.21.15.148:48378) 2023-10-24T00:48:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 -- 172.21.15.148:0/1025733403 learned_addr learned my addr 172.21.15.148:0/1025733403 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14bcc1b700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b81679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14bd41c700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b8154430 0x7f14b8156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 -- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 msgr2=0x7f14b81679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b81679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 -- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b8154430 msgr2=0x7f14b8156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b8154430 0x7f14b8156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 -- 172.21.15.148:0/1025733403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40092a0 con 0x7f14b80bffd0 2023-10-24T00:48:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b7fff700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f14b80c5910 tx=0x7f14a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4000be0 con 0x7f14b80bffd0 2023-10-24T00:48:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8156a70 con 0x7f14b80bffd0 2023-10-24T00:48:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400f7e0 con 0x7f14b80bffd0 2023-10-24T00:48:26.311 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401b640 con 0x7f14b80bffd0 2023-10-24T00:48:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.301+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8156720 con 0x7f14b80bffd0 2023-10-24T00:48:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.302+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b8156c90 con 0x7f14b80bffd0 2023-10-24T00:48:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.302+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f14a401b9b0 con 0x7f14b80bffd0 2023-10-24T00:48:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.303+0000 7f14b4ff9700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 0x7f149c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.303+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f14a407b9c0 con 0x7f14b80bffd0 2023-10-24T00:48:26.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.303+0000 7f14bcc1b700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 0x7f149c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.303+0000 7f14bcc1b700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 0x7f149c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f14ac0038c0 tx=0x7f14ac007d40).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.307+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f14a404cc90 con 0x7f14b80bffd0 2023-10-24T00:48:26.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.538+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f14b806c6b0 con 0x7f14b80bffd0 2023-10-24T00:48:26.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.544+0000 7f14b4ff9700 1 -- 172.21.15.148:0/1025733403 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f14a401f020 con 0x7f14b80bffd0 2023-10-24T00:48:26.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 msgr2=0x7f149c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 0x7f149c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f14ac0038c0 tx=0x7f14ac007d40).stop 2023-10-24T00:48:26.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 msgr2=0x7f14b81580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f14b80c5910 tx=0x7f14a4017000).stop 2023-10-24T00:48:26.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 shutdown_connections 2023-10-24T00:48:26.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b8154430 0x7f14b8156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b8098bd0 0x7f14b81679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f149c05f150 0x7f149c061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 --2- 172.21.15.148:0/1025733403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b80bffd0 0x7f14b81580c0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.546+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 >> 172.21.15.148:0/1025733403 conn(0x7f14b80cb070 msgr2=0x7f14b80c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:26.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.547+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 shutdown_connections 2023-10-24T00:48:26.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.547+0000 7f14bee7f700 1 -- 172.21.15.148:0/1025733403 wait complete. 2023-10-24T00:48:26.551 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T00:48:26.560 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T00:48:26.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.671+0000 7f6a4b277700 1 Processor -- start 2023-10-24T00:48:26.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 -- start start 2023-10-24T00:48:26.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a440c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a440c6710 0x7f6a440aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440c0960 con 0x7f6a44158770 2023-10-24T00:48:26.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440aa8e0 con 0x7f6a440c6710 2023-10-24T00:48:26.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.672+0000 7f6a4b277700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440c0c40 con 0x7f6a440aa010 2023-10-24T00:48:26.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a49814700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6a44158770 0x7f6a44069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52942/0 (socket says 172.21.15.148:52942) 2023-10-24T00:48:26.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a49814700 1 -- 172.21.15.148:0/2254363532 learned_addr learned my addr 172.21.15.148:0/2254363532 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:26.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a48812700 1 --2- 172.21.15.148:0/2254363532 >> v2:172.21.15.150:3300/0 conn(0x7f6a440c6710 0x7f6a440aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a49013700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a440c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915874505 0 0) 0x7f6a440c0960 con 0x7f6a44158770 2023-10-24T00:48:26.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a300033f0 con 0x7f6a44158770 2023-10-24T00:48:26.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736330771 0 0) 0x7f6a300033f0 con 0x7f6a44158770 2023-10-24T00:48:26.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 msgr2=0x7f6a440c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:26.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a440c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 >> v2:172.21.15.150:3300/0 conn(0x7f6a440c6710 msgr2=0x7f6a440aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:26.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 --2- 172.21.15.148:0/2254363532 >> v2:172.21.15.150:3300/0 conn(0x7f6a440c6710 0x7f6a440aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440c0f20 con 0x7f6a44158770 2023-10-24T00:48:26.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6a3c0017f0 con 0x7f6a44158770 2023-10-24T00:48:26.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 >> v1:172.21.15.148:6789/0 conn(0x7f6a44158770 legacy=0x7f6a44069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a30004690 0x7f6a30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a30005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440aa8e0 con 0x7f6a300038e0 2023-10-24T00:48:26.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440c0c40 con 0x7f6a30004690 2023-10-24T00:48:26.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3000b8e0 con 0x7f6a440aa010 2023-10-24T00:48:26.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a49013700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a49814700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a30005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.673+0000 7f6a48812700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a30004690 0x7f6a30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 -- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 msgr2=0x7f6a30005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:26.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a30005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 -- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a30004690 msgr2=0x7f6a30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:26.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a30004690 0x7f6a30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 -- 172.21.15.148:0/2254363532 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300033f0 con 0x7f6a300038e0 2023-10-24T00:48:26.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49814700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440aa010 0x7f6a30005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:26.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a48812700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a30004690 0x7f6a30004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:26.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49013700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a30003d00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f6a40009a60 tx=0x7f6a40009060).ready entity=mon.0 client_cookie=a80df61db8fcf699 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40009ea0 con 0x7f6a300038e0 2023-10-24T00:48:26.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40009430 con 0x7f6a300038e0 2023-10-24T00:48:26.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a3bfff700 1 -- 172.21.15.148:0/2254363532 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000e870 con 0x7f6a300038e0 2023-10-24T00:48:26.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 -- 172.21.15.148:0/2254363532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 msgr2=0x7f6a30003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 --2- 172.21.15.148:0/2254363532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a30003d00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f6a40009a60 tx=0x7f6a40009060).stop 2023-10-24T00:48:26.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a49814700 1 -- 172.21.15.148:0/2254363532 reap_dead start 2023-10-24T00:48:26.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 -- 172.21.15.148:0/2254363532 shutdown_connections 2023-10-24T00:48:26.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 -- 172.21.15.148:0/2254363532 >> 172.21.15.148:0/2254363532 conn(0x7f6a440caf40 msgr2=0x7f6a440cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:26.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 -- 172.21.15.148:0/2254363532 shutdown_connections 2023-10-24T00:48:26.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.674+0000 7f6a4b277700 1 -- 172.21.15.148:0/2254363532 wait complete. 2023-10-24T00:48:26.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.675+0000 7f6a4b277700 1 Processor -- start 2023-10-24T00:48:26.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 -- start start 2023-10-24T00:48:26.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440c4da0 0x7f6a44157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 0x7f6a440b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44156e80 con 0x7f6a300038e0 2023-10-24T00:48:26.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44156270 con 0x7f6a44153a40 2023-10-24T00:48:26.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.676+0000 7f6a4b277700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44156550 con 0x7f6a440c4da0 2023-10-24T00:48:26.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48392/0 (socket says 172.21.15.148:48392) 2023-10-24T00:48:26.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 -- 172.21.15.148:0/1400923521 learned_addr learned my addr 172.21.15.148:0/1400923521 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:26.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49814700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 0x7f6a440b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a48812700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440c4da0 0x7f6a44157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 -- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440c4da0 msgr2=0x7f6a44157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440c4da0 0x7f6a44157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 -- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 msgr2=0x7f6a440b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 0x7f6a440b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 -- 172.21.15.148:0/1400923521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44156830 con 0x7f6a300038e0 2023-10-24T00:48:26.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49814700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 0x7f6a440b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:26.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a49013700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f6a30004480 tx=0x7f6a4001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40020070 con 0x7f6a300038e0 2023-10-24T00:48:26.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4001baa0 con 0x7f6a300038e0 2023-10-24T00:48:26.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a44156b10 con 0x7f6a300038e0 2023-10-24T00:48:26.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4001be60 con 0x7f6a300038e0 2023-10-24T00:48:26.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.677+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44157800 con 0x7f6a300038e0 2023-10-24T00:48:26.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.678+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44157160 con 0x7f6a300038e0 2023-10-24T00:48:26.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.678+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6a40012600 con 0x7f6a300038e0 2023-10-24T00:48:26.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.679+0000 7f6a397fa700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 0x7f6a28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:26.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.679+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a4007b290 con 0x7f6a300038e0 2023-10-24T00:48:26.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.679+0000 7f6a48812700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 0x7f6a28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:26.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.679+0000 7f6a48812700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 0x7f6a28061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a34006d80 tx=0x7f6a34008040).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:26.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.683+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a4004c560 con 0x7f6a300038e0 2023-10-24T00:48:26.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.888+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a4406c6b0 con 0x7f6a300038e0 2023-10-24T00:48:26.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.888+0000 7f6a397fa700 1 -- 172.21.15.148:0/1400923521 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f6a4002a020 con 0x7f6a300038e0 2023-10-24T00:48:26.890 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:26.891 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T00:48:26.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 msgr2=0x7f6a28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 0x7f6a28061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6a34006d80 tx=0x7f6a34008040).stop 2023-10-24T00:48:26.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 msgr2=0x7f6a44155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:26.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f6a30004480 tx=0x7f6a4001a000).stop 2023-10-24T00:48:26.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 shutdown_connections 2023-10-24T00:48:26.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a44153a40 0x7f6a440b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.890+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6a2805f150 0x7f6a28061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.891+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300038e0 0x7f6a44155bb0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.891+0000 7f6a4b277700 1 --2- 172.21.15.148:0/1400923521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a440c4da0 0x7f6a44157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:26.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.891+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 >> 172.21.15.148:0/1400923521 conn(0x7f6a440caf40 msgr2=0x7f6a44063100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:26.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.891+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 shutdown_connections 2023-10-24T00:48:26.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:26.891+0000 7f6a4b277700 1 -- 172.21.15.148:0/1400923521 wait complete. 2023-10-24T00:48:26.895 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T00:48:27.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T00:48:18.379861+0000', 'modified': '2023-10-24T00:48:20.387984+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8199': {'gid': 8199, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.148:6835/1479144223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6833', 'nonce': 1479144223}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 1479144223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T00:48:27.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T00:48:27.308 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-24T00:48:27.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.422+0000 7efe49f32700 1 Processor -- start 2023-10-24T00:48:27.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 -- start start 2023-10-24T00:48:27.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe440c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe441547e0 0x7efe440a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe440c01c0 con 0x7efe440a82c0 2023-10-24T00:48:27.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe440aa960 con 0x7efe441547e0 2023-10-24T00:48:27.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe49f32700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe440c66f0 con 0x7efe44154400 2023-10-24T00:48:27.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.423+0000 7efe43fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7efe440a82c0 0x7efe440c0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52944/0 (socket says 172.21.15.148:52944) 2023-10-24T00:48:27.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe43fff700 1 -- 172.21.15.148:0/3711388870 learned_addr learned my addr 172.21.15.148:0/3711388870 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:27.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe42ffd700 1 --2- 172.21.15.148:0/3711388870 >> v2:172.21.15.150:3300/0 conn(0x7efe441547e0 0x7efe440a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe437fe700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe440c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437527775 0 0) 0x7efe440c01c0 con 0x7efe440a82c0 2023-10-24T00:48:27.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe2c0033f0 con 0x7efe440a82c0 2023-10-24T00:48:27.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810106976 0 0) 0x7efe2c0033f0 con 0x7efe440a82c0 2023-10-24T00:48:27.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 msgr2=0x7efe440c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe440c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 >> v2:172.21.15.150:3300/0 conn(0x7efe441547e0 msgr2=0x7efe440a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 --2- 172.21.15.148:0/3711388870 >> v2:172.21.15.150:3300/0 conn(0x7efe441547e0 0x7efe440a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440c6150 con 0x7efe440a82c0 2023-10-24T00:48:27.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7efe3c0017f0 con 0x7efe440a82c0 2023-10-24T00:48:27.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 >> v1:172.21.15.148:6789/0 conn(0x7efe440a82c0 legacy=0x7efe440c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c0038e0 0x7efe2c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe2c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe2c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440aa960 con 0x7efe2c004b80 2023-10-24T00:48:27.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440c66f0 con 0x7efe2c0038e0 2023-10-24T00:48:27.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c00b8e0 con 0x7efe44154400 2023-10-24T00:48:27.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe43fff700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe2c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe42ffd700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe2c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe437fe700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c0038e0 0x7efe2c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe43fff700 1 -- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 msgr2=0x7efe2c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.424+0000 7efe43fff700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe44154400 0x7efe2c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe43fff700 1 -- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c0038e0 msgr2=0x7efe2c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe43fff700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe2c0038e0 0x7efe2c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe43fff700 1 -- 172.21.15.148:0/3711388870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0033f0 con 0x7efe2c004b80 2023-10-24T00:48:27.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe43fff700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe2c005000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7efe3c00c500 tx=0x7efe440c6660).ready entity=mon.0 client_cookie=8e6d34000d2f65a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c007de0 con 0x7efe2c004b80 2023-10-24T00:48:27.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c00ce30 con 0x7efe2c004b80 2023-10-24T00:48:27.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe427fc700 1 -- 172.21.15.148:0/3711388870 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c005d30 con 0x7efe2c004b80 2023-10-24T00:48:27.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 -- 172.21.15.148:0/3711388870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 msgr2=0x7efe2c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 --2- 172.21.15.148:0/3711388870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe2c005000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7efe3c00c500 tx=0x7efe440c6660).stop 2023-10-24T00:48:27.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe43fff700 1 -- 172.21.15.148:0/3711388870 reap_dead start 2023-10-24T00:48:27.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 -- 172.21.15.148:0/3711388870 shutdown_connections 2023-10-24T00:48:27.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 -- 172.21.15.148:0/3711388870 >> 172.21.15.148:0/3711388870 conn(0x7efe440946a0 msgr2=0x7efe4406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 -- 172.21.15.148:0/3711388870 shutdown_connections 2023-10-24T00:48:27.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.425+0000 7efe49f32700 1 -- 172.21.15.148:0/3711388870 wait complete. 2023-10-24T00:48:27.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.426+0000 7efe49f32700 1 Processor -- start 2023-10-24T00:48:27.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 -- start start 2023-10-24T00:48:27.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe440ad460 0x7efe440c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe440c48f0 0x7efe440c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe44164fb0 con 0x7efe2c004b80 2023-10-24T00:48:27.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe44165290 con 0x7efe440ad460 2023-10-24T00:48:27.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe49f32700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe44165570 con 0x7efe440c48f0 2023-10-24T00:48:27.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe437fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe437fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48404/0 (socket says 172.21.15.148:48404) 2023-10-24T00:48:27.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe437fe700 1 -- 172.21.15.148:0/4083329772 learned_addr learned my addr 172.21.15.148:0/4083329772 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe42ffd700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe440ad460 0x7efe440c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.427+0000 7efe43fff700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe440c48f0 0x7efe440c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 -- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe440c48f0 msgr2=0x7efe440c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe440c48f0 0x7efe440c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 -- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe440ad460 msgr2=0x7efe440c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe440ad460 0x7efe440c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 -- 172.21.15.148:0/4083329772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440af100 con 0x7efe2c004b80 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe437fe700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7efe34009fd0 tx=0x7efe34009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe2b7fe700 1 -- 172.21.15.148:0/4083329772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400f760 con 0x7efe2c004b80 2023-10-24T00:48:27.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe2b7fe700 1 -- 172.21.15.148:0/4083329772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400f8c0 con 0x7efe2c004b80 2023-10-24T00:48:27.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe440c3310 con 0x7efe2c004b80 2023-10-24T00:48:27.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe2b7fe700 1 -- 172.21.15.148:0/4083329772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400fc40 con 0x7efe2c004b80 2023-10-24T00:48:27.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.428+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe440ad8e0 con 0x7efe2c004b80 2023-10-24T00:48:27.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.429+0000 7efe2b7fe700 1 -- 172.21.15.148:0/4083329772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe34014650 con 0x7efe2c004b80 2023-10-24T00:48:27.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.430+0000 7efe2b7fe700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 0x7efe30061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.430+0000 7efe2b7fe700 1 -- 172.21.15.148:0/4083329772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efe3407acd0 con 0x7efe2c004b80 2023-10-24T00:48:27.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.430+0000 7efe42ffd700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 0x7efe30061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.430+0000 7efe42ffd700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 0x7efe30061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efe38006f70 tx=0x7efe38009060).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.432+0000 7efe5b8cab80 1 Processor -- start 2023-10-24T00:48:27.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.432+0000 7efe5b8cab80 1 -- start start 2023-10-24T00:48:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d1ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d1641b0 con 0x55ce3d216190 2023-10-24T00:48:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d129cb0 con 0x55ce3d1ef980 2023-10-24T00:48:27.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d13ec90 con 0x55ce3d1ecb20 2023-10-24T00:48:27.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48418/0 (socket says 172.21.15.148:48418) 2023-10-24T00:48:27.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 -- 172.21.15.148:0/608035619 learned_addr learned my addr 172.21.15.148:0/608035619 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe43fff700 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe437fe700 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d1ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 -- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 msgr2=0x55ce3d1ecf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d1ecf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 -- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ef980 msgr2=0x55ce3d1e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 -- 172.21.15.148:0/608035619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce3d137e70 con 0x55ce3d216190 2023-10-24T00:48:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe42ffd700 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7efe44154be0 tx=0x7efe3801a000).ready entity=mon.0 client_cookie=29a6d7f36abcb4e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe28ff9700 1 -- 172.21.15.148:0/608035619 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38015670 con 0x55ce3d216190 2023-10-24T00:48:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe28ff9700 1 -- 172.21.15.148:0/608035619 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38019070 con 0x55ce3d216190 2023-10-24T00:48:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.433+0000 7efe28ff9700 1 -- 172.21.15.148:0/608035619 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380159e0 con 0x55ce3d216190 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 -- 172.21.15.148:0/608035619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 msgr2=0x55ce3d1e89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7efe44154be0 tx=0x7efe3801a000).stop 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 -- 172.21.15.148:0/608035619 shutdown_connections 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d1ecf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/608035619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d1e89a0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 -- 172.21.15.148:0/608035619 >> 172.21.15.148:0/608035619 conn(0x55ce3cfa9e40 msgr2=0x55ce3d236ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 -- 172.21.15.148:0/608035619 shutdown_connections 2023-10-24T00:48:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.434+0000 7efe5b8cab80 1 -- 172.21.15.148:0/608035619 wait complete. 2023-10-24T00:48:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.435+0000 7efe5b8cab80 1 -- start start 2023-10-24T00:48:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.435+0000 7efe5b8cab80 1 Processor -- start 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d202030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d202520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d13edd0 con 0x55ce3d1ecb20 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d13f050 con 0x55ce3d216190 2023-10-24T00:48:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d10a8d0 con 0x55ce3d1ef980 2023-10-24T00:48:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 10 client.0 ll_register_callbacks cb 0x55ce3d1ad030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:48:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48432/0 (socket says 172.21.15.148:48432) 2023-10-24T00:48:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 -- 172.21.15.148:0/222410 learned_addr learned my addr 172.21.15.148:0/222410 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe42ffd700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d202030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe43fff700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d202520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 -- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 msgr2=0x55ce3d202030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d202030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 -- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 msgr2=0x55ce3d202520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d202520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 -- 172.21.15.148:0/222410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe38014780 con 0x55ce3d1ecb20 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe437fe700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7efe34079210 tx=0x7efe34014000).ready entity=mon.0 client_cookie=8395f439455415fe server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34054040 con 0x55ce3d1ecb20 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efe34055240 con 0x55ce3d1ecb20 2023-10-24T00:48:27.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce3d1e14e0 con 0x55ce3d1ecb20 2023-10-24T00:48:27.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe3404e0d0 con 0x55ce3d1ecb20 2023-10-24T00:48:27.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 10 client.8367 fetch_fsmap learned FSMap version 49 2023-10-24T00:48:27.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55ce3d133480 con 0x55ce3d1ecb20 2023-10-24T00:48:27.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.436+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce3d1e14e0 con 0x55ce3d1ecb20 2023-10-24T00:48:27.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efe3404ba50 con 0x55ce3d1ecb20 2023-10-24T00:48:27.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 10 client.8367 fetch_fsmap finished waiting for FSMap version 49 2023-10-24T00:48:27.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 10 client.8367 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-24T00:48:27.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 20 client.8367 populate_metadata read hostname 'smithi148' 2023-10-24T00:48:27.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d23b5e0 0x55ce3d211c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 4 client.8367 mds_command: new command op to 8199 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 --> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce3d1b74b0 con 0x55ce3d23b5e0 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe42ffd700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d23b5e0 0x55ce3d211c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe21ffb700 10 client.8367 ms_handle_connect on v2:172.21.15.148:6833/1479144223 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.437+0000 7efe42ffd700 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d23b5e0 0x55ce3d211c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3518a643763553c6 server_cookie=d0f92337650cfb63 in_seq=0 out_seq=0 2023-10-24T00:48:27.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe21ffb700 1 -- 172.21.15.148:0/222410 <== mds.0 v2:172.21.15.148:6833/1479144223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ce3d1b74b0 con 0x55ce3d23b5e0 2023-10-24T00:48:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe21ffb700 10 client.8367 handle_command_reply: tid=0 2023-10-24T00:48:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 client.8367 shutdown 2023-10-24T00:48:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 msgr2=0x55ce3d214f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7efe34079210 tx=0x7efe34014000).stop 2023-10-24T00:48:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 shutdown_connections 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d23b5e0 0x55ce3d211c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d202520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe21ffb700 0 client.8367 ms_handle_reset on v2:172.21.15.148:6833/1479144223 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ecb20 0x55ce3d214f30 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/222410 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d202030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 >> 172.21.15.148:0/222410 conn(0x55ce3cfa9e40 msgr2=0x55ce3d2367f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 shutdown_connections 2023-10-24T00:48:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 1 -- 172.21.15.148:0/222410 wait complete. 2023-10-24T00:48:27.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.438+0000 7efe5b8cab80 20 client.8367 trim_cache size 0 max 16384 2023-10-24T00:48:27.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.454+0000 7efe5b8cab80 1 Processor -- start 2023-10-24T00:48:27.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.454+0000 7efe5b8cab80 1 -- start start 2023-10-24T00:48:27.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 0x55ce3d20feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d2365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d216a90 con 0x55ce3d216190 2023-10-24T00:48:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d1ed7c0 con 0x55ce3d1ecb20 2023-10-24T00:48:27.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d202870 con 0x55ce3d1ef980 2023-10-24T00:48:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48446/0 (socket says 172.21.15.148:48446) 2023-10-24T00:48:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 -- 172.21.15.148:0/910756575 learned_addr learned my addr 172.21.15.148:0/910756575 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe437fe700 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 0x55ce3d20feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 -- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 msgr2=0x55ce3d2365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d2365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 -- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 msgr2=0x55ce3d20feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 0x55ce3d20feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 -- 172.21.15.148:0/910756575 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce3d1331d0 con 0x55ce3d216190 2023-10-24T00:48:27.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe437fe700 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 0x55ce3d20feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.455+0000 7efe43fff700 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7efe2c004570 tx=0x7efe3c015000).ready entity=mon.0 client_cookie=48a75dcda5629706 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe297fa700 1 -- 172.21.15.148:0/910756575 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0012d0 con 0x55ce3d216190 2023-10-24T00:48:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe297fa700 1 -- 172.21.15.148:0/910756575 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c018070 con 0x55ce3d216190 2023-10-24T00:48:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe297fa700 1 -- 172.21.15.148:0/910756575 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0016f0 con 0x55ce3d216190 2023-10-24T00:48:27.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 -- 172.21.15.148:0/910756575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 msgr2=0x55ce3d292930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7efe2c004570 tx=0x7efe3c015000).stop 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 -- 172.21.15.148:0/910756575 shutdown_connections 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d216190 0x55ce3d292930 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d1ecb20 0x55ce3d20feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/910756575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ef980 0x55ce3d2365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:27.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 -- 172.21.15.148:0/910756575 >> 172.21.15.148:0/910756575 conn(0x55ce3cfa9e40 msgr2=0x55ce3d2144c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 -- 172.21.15.148:0/910756575 shutdown_connections 2023-10-24T00:48:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.456+0000 7efe5b8cab80 1 -- 172.21.15.148:0/910756575 wait complete. 2023-10-24T00:48:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.457+0000 7efe5b8cab80 1 -- start start 2023-10-24T00:48:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.457+0000 7efe5b8cab80 1 Processor -- start 2023-10-24T00:48:27.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d281280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d1e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d219dc0 con 0x55ce3d1ef980 2023-10-24T00:48:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d1e90e0 con 0x55ce3d216190 2023-10-24T00:48:27.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce3d20f130 con 0x55ce3d1ecb20 2023-10-24T00:48:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 10 client.0 ll_register_callbacks cb 0x55ce3d1ad030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T00:48:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48450/0 (socket says 172.21.15.148:48450) 2023-10-24T00:48:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 -- 172.21.15.148:0/3207636300 learned_addr learned my addr 172.21.15.148:0/3207636300 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe43fff700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d1e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe437fe700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d281280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 -- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 msgr2=0x55ce3d281280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d281280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 -- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 msgr2=0x55ce3d1e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d1e8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 -- 172.21.15.148:0/3207636300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0033f0 con 0x55ce3d1ef980 2023-10-24T00:48:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe42ffd700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7efe440a9dc0 tx=0x7efe3801c000).ready entity=mon.0 client_cookie=6e9f726891a4456c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T00:48:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3802d070 con 0x55ce3d1ef980 2023-10-24T00:48:27.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efe380344d0 con 0x55ce3d1ef980 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe38019070 con 0x55ce3d1ef980 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe380348a0 con 0x55ce3d1ef980 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 10 client.8373 fetch_fsmap learned FSMap version 49 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55ce3cfaaf80 con 0x55ce3d1ef980 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.458+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38019070 con 0x55ce3d1ef980 2023-10-24T00:48:27.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efe3803b060 con 0x55ce3d1ef980 2023-10-24T00:48:27.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 10 client.8373 fetch_fsmap finished waiting for FSMap version 49 2023-10-24T00:48:27.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 10 client.8373 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-24T00:48:27.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 20 client.8373 populate_metadata read hostname 'smithi148' 2023-10-24T00:48:27.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d213440 0x55ce3d213820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 4 client.8373 mds_command: new command op to 8199 tid=0[{"prefix": "status"}] 2023-10-24T00:48:27.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 --> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce3cfa5ca0 con 0x55ce3d213440 2023-10-24T00:48:27.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe437fe700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d213440 0x55ce3d213820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe21ffb700 10 client.8373 ms_handle_connect on v2:172.21.15.148:6833/1479144223 2023-10-24T00:48:27.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe437fe700 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d213440 0x55ce3d213820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b35d2d9c874909e9 server_cookie=501bd18564437b9 in_seq=0 out_seq=0 2023-10-24T00:48:27.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe21ffb700 1 -- 172.21.15.148:0/3207636300 <== mds.0 v2:172.21.15.148:6833/1479144223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ce3cfa5ca0 con 0x55ce3d213440 2023-10-24T00:48:27.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe21ffb700 10 client.8373 handle_command_reply: tid=0 2023-10-24T00:48:27.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 client.8373 shutdown 2023-10-24T00:48:27.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 msgr2=0x55ce3d1e8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7efe440a9dc0 tx=0x7efe3801c000).stop 2023-10-24T00:48:27.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 shutdown_connections 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:6833/1479144223,v1:172.21.15.148:6835/1479144223] conn(0x55ce3d213440 0x55ce3d213820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ce3d216190 0x55ce3d1e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55ce3d1ecb20 0x55ce3d281280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 --2- 172.21.15.148:0/3207636300 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce3d1ef980 0x55ce3d1e8700 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe21ffb700 0 client.8373 ms_handle_reset on v2:172.21.15.148:6833/1479144223 2023-10-24T00:48:27.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 >> 172.21.15.148:0/3207636300 conn(0x55ce3cfa9e40 msgr2=0x55ce3d20feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 shutdown_connections 2023-10-24T00:48:27.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.459+0000 7efe5b8cab80 1 -- 172.21.15.148:0/3207636300 wait complete. 2023-10-24T00:48:27.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe5b8cab80 20 client.8373 trim_cache size 0 max 16384 2023-10-24T00:48:27.488 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T00:48:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T00:48:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T00:48:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 8199, 2023-10-24T00:48:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T00:48:27.489 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T00:48:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T00:48:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.0784996969999998, 2023-10-24T00:48:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 49, 2023-10-24T00:48:27.490 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 142, 2023-10-24T00:48:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 142, 2023-10-24T00:48:27.491 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 13.587568622999999 2023-10-24T00:48:27.491 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T00:48:27.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 msgr2=0x7efe30061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 0x7efe30061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efe38006f70 tx=0x7efe38009060).stop 2023-10-24T00:48:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 msgr2=0x7efe44164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7efe34009fd0 tx=0x7efe34009060).stop 2023-10-24T00:48:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 shutdown_connections 2023-10-24T00:48:27.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe440c48f0 0x7efe440c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efe3005f150 0x7efe30061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efe2c004b80 0x7efe44164960 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 --2- 172.21.15.148:0/4083329772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe440ad460 0x7efe440c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 >> 172.21.15.148:0/4083329772 conn(0x7efe440946a0 msgr2=0x7efe4414da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 shutdown_connections 2023-10-24T00:48:27.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.460+0000 7efe49f32700 1 -- 172.21.15.148:0/4083329772 wait complete. 2023-10-24T00:48:27.495 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T00:48:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.595+0000 7fe1589ed700 1 Processor -- start 2023-10-24T00:48:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.595+0000 7fe1589ed700 1 -- start start 2023-10-24T00:48:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe1589ed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe154154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe1589ed700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1540a8cd0 0x7fe1540a9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe1589ed700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe154062a20 con 0x7fe1540aab50 2023-10-24T00:48:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe1589ed700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1540a5880 con 0x7fe1540a8cd0 2023-10-24T00:48:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe1589ed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154154900 con 0x7fe154154030 2023-10-24T00:48:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe152d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe1540a8cd0 0x7fe1540a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe151d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe1540aab50 0x7fe1540a85c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52956/0 (socket says 172.21.15.148:52956) 2023-10-24T00:48:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.596+0000 7fe151d9b700 1 -- 172.21.15.148:0/3345989324 learned_addr learned my addr 172.21.15.148:0/3345989324 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe152d9d700 1 -- 172.21.15.148:0/3345989324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 msgr2=0x7fe154154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15259c700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe154154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15159a700 1 -- 172.21.15.148:0/3345989324 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147361031 0 0) 0x7fe154062a20 con 0x7fe1540aab50 2023-10-24T00:48:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe152d9d700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe154154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe152d9d700 1 -- 172.21.15.148:0/3345989324 >> v1:172.21.15.148:6789/0 conn(0x7fe1540aab50 legacy=0x7fe1540a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe152d9d700 1 -- 172.21.15.148:0/3345989324 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540626f0 con 0x7fe1540a8cd0 2023-10-24T00:48:27.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15259c700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe154154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T00:48:27.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe152d9d700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540a8cd0 0x7fe1540a9180 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fe14c009760 tx=0x7fe14c009060).ready entity=mon.0 client_cookie=30deca59a1f2ffcc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15159a700 1 -- 172.21.15.148:0/3345989324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00b580 con 0x7fe1540a8cd0 2023-10-24T00:48:27.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15159a700 1 -- 172.21.15.148:0/3345989324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00b6e0 con 0x7fe1540a8cd0 2023-10-24T00:48:27.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe15159a700 1 -- 172.21.15.148:0/3345989324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00ba60 con 0x7fe1540a8cd0 2023-10-24T00:48:27.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe1589ed700 1 -- 172.21.15.148:0/3345989324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540a8cd0 msgr2=0x7fe1540a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540a8cd0 0x7fe1540a9180 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fe14c009760 tx=0x7fe14c009060).stop 2023-10-24T00:48:27.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.597+0000 7fe1589ed700 1 -- 172.21.15.148:0/3345989324 shutdown_connections 2023-10-24T00:48:27.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.598+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540a8cd0 0x7fe1540a9180 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.598+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3345989324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe154154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.598+0000 7fe1589ed700 1 -- 172.21.15.148:0/3345989324 >> 172.21.15.148:0/3345989324 conn(0x7fe1540c7ea0 msgr2=0x7fe1540aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.598+0000 7fe1589ed700 1 -- 172.21.15.148:0/3345989324 shutdown_connections 2023-10-24T00:48:27.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.598+0000 7fe1589ed700 1 -- 172.21.15.148:0/3345989324 wait complete. 2023-10-24T00:48:27.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 Processor -- start 2023-10-24T00:48:27.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 -- start start 2023-10-24T00:48:27.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1540a8cd0 0x7fe154154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe1541434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154155d50 con 0x7fe1540aab50 2023-10-24T00:48:27.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15414c060 con 0x7fe1540a8cd0 2023-10-24T00:48:27.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.599+0000 7fe1589ed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154155140 con 0x7fe154154030 2023-10-24T00:48:27.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48480/0 (socket says 172.21.15.148:48480) 2023-10-24T00:48:27.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 -- 172.21.15.148:0/3144375677 learned_addr learned my addr 172.21.15.148:0/3144375677 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:27.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe15259c700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1540a8cd0 0x7fe154154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe152d9d700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe1541434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 -- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 msgr2=0x7fe1541434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe1541434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 -- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1540a8cd0 msgr2=0x7fe154154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1540a8cd0 0x7fe154154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 -- 172.21.15.148:0/3144375677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0092a0 con 0x7fe1540aab50 2023-10-24T00:48:27.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe151d9b700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fe14800c4a0 tx=0x7fe148007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800ce50 con 0x7fe1540aab50 2023-10-24T00:48:27.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1480072e0 con 0x7fe1540aab50 2023-10-24T00:48:27.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154155420 con 0x7fe1540aab50 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148007660 con 0x7fe1540aab50 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.600+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1541559e0 con 0x7fe1540aab50 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.601+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154154620 con 0x7fe1540aab50 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.601+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe1480059b0 con 0x7fe1540aab50 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.602+0000 7fe1427fc700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 0x7fe134061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:27.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.602+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe148079880 con 0x7fe1540aab50 2023-10-24T00:48:27.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.602+0000 7fe15259c700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 0x7fe134061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:27.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.602+0000 7fe15259c700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 0x7fe134061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe14400f600 tx=0x7fe1440077b0).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:27.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.606+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe14804ab50 con 0x7fe1540aab50 2023-10-24T00:48:27.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.810+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe154047480 con 0x7fe1540aab50 2023-10-24T00:48:27.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.810+0000 7fe1427fc700 1 -- 172.21.15.148:0/3144375677 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe14804e170 con 0x7fe1540aab50 2023-10-24T00:48:27.812 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T00:48:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 msgr2=0x7fe134061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 0x7fe134061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe14400f600 tx=0x7fe1440077b0).stop 2023-10-24T00:48:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 msgr2=0x7fe15414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:27.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fe14800c4a0 tx=0x7fe148007c30).stop 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 shutdown_connections 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe154154030 0x7fe1541434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1540a8cd0 0x7fe154154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe13405f150 0x7fe134061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 --2- 172.21.15.148:0/3144375677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1540aab50 0x7fe15414bb70 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:27.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 >> 172.21.15.148:0/3144375677 conn(0x7fe1540c7ea0 msgr2=0x7fe15414f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 shutdown_connections 2023-10-24T00:48:27.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:27.812+0000 7fe1589ed700 1 -- 172.21.15.148:0/3144375677 wait complete. 2023-10-24T00:48:27.824 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T00:48:27.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T00:48:27.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T00:48:27.825 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T00:48:27.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T00:48:27.826 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T00:48:27.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T00:48:27.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T00:48:27.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:48:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:27.828 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T00:48:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T00:48:27.843 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T00:48:27.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T00:48:27.844 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.844 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T00:48:27.844 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.844 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:48:27.845 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:48:27.845 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T00:48:27.845 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:48:27.845 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:48:27.845 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T00:48:27.846 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T00:48:27.846 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:48:27.846 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T00:48:27.846 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T00:48:27.846 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T00:48:27.847 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41221sec preferred_lft 41221sec 2023-10-24T00:48:27.847 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T00:48:27.847 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T00:48:27.847 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T00:48:27.848 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T00:48:27.848 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.848 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T00:48:27.848 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:48:27.849 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T00:48:27.849 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T00:48:27.849 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.849 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T00:48:27.849 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T00:48:27.850 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T00:48:27.850 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T00:48:27.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:27.851 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T00:48:27.907 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T00:48:27.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:27.908 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T00:48:27.964 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T00:48:27.964 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T00:48:27.965 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T00:48:27.965 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T00:48:27.965 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T00:48:27.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:27.966 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T00:48:27.966 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T00:48:27.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T00:48:27.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T00:48:27.967 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T00:48:27.968 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T00:48:28.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:28.065 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T00:48:28.080 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T00:48:28.080 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T00:48:28.080 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T00:48:28.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:28.081 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T00:48:28.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:28.145 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T00:48:28.200 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T00:48:28.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:48:28.279 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:48:28.280 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:48:28.304 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T00:48:28.304 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T00:48:28.306 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T00:48:28.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T00:48:28.307 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T00:48:28.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T00:48:28.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.525+0000 7f9d07096700 1 Processor -- start 2023-10-24T00:48:28.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.525+0000 7f9d07096700 1 -- start start 2023-10-24T00:48:28.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d07096700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d001547e0 0x7f9d000a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d07096700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d000a82c0 0x7f9d000c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d07096700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000c01c0 con 0x7f9d00154400 2023-10-24T00:48:28.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d07096700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000aa960 con 0x7f9d001547e0 2023-10-24T00:48:28.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d07096700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000c8a20 con 0x7f9d000a82c0 2023-10-24T00:48:28.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9cfffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d001547e0 0x7f9d000a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9cfffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9d001547e0 0x7f9d000a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48484/0 (socket says 172.21.15.148:48484) 2023-10-24T00:48:28.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9cfffff700 1 -- 172.21.15.148:0/4266200305 learned_addr learned my addr 172.21.15.148:0/4266200305 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:28.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d04e32700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9d00154400 0x7f9d000c8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:49678/0 (socket says 172.21.15.148:49678) 2023-10-24T00:48:28.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.526+0000 7f9d05633700 1 --2- 172.21.15.148:0/4266200305 >> v2:172.21.15.150:3300/0 conn(0x7f9d000a82c0 0x7f9d000c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cfffff700 1 -- 172.21.15.148:0/4266200305 >> v2:172.21.15.150:3300/0 conn(0x7f9d000a82c0 msgr2=0x7f9d000c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:28.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cfffff700 1 --2- 172.21.15.148:0/4266200305 >> v2:172.21.15.150:3300/0 conn(0x7f9d000a82c0 0x7f9d000c0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cfffff700 1 -- 172.21.15.148:0/4266200305 >> v1:172.21.15.150:6789/0 conn(0x7f9d00154400 legacy=0x7f9d000c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cff7fe700 1 -- 172.21.15.148:0/4266200305 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247625647 0 0) 0x7f9d000c01c0 con 0x7f9d00154400 2023-10-24T00:48:28.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cfffff700 1 -- 172.21.15.148:0/4266200305 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000c6150 con 0x7f9d001547e0 2023-10-24T00:48:28.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cfffff700 1 --2- 172.21.15.148:0/4266200305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000a7dd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f9d000c55d0 tx=0x7f9cf40090f0).ready entity=mon.0 client_cookie=f7430fe94a8ae5c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cff7fe700 1 -- 172.21.15.148:0/4266200305 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400b520 con 0x7f9d001547e0 2023-10-24T00:48:28.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cff7fe700 1 -- 172.21.15.148:0/4266200305 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400b680 con 0x7f9d001547e0 2023-10-24T00:48:28.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9cff7fe700 1 -- 172.21.15.148:0/4266200305 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ba20 con 0x7f9d001547e0 2023-10-24T00:48:28.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 -- 172.21.15.148:0/4266200305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 msgr2=0x7f9d000a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 --2- 172.21.15.148:0/4266200305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000a7dd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f9d000c55d0 tx=0x7f9cf40090f0).stop 2023-10-24T00:48:28.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 -- 172.21.15.148:0/4266200305 shutdown_connections 2023-10-24T00:48:28.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 --2- 172.21.15.148:0/4266200305 >> v2:172.21.15.150:3300/0 conn(0x7f9d000a82c0 0x7f9d000c0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 --2- 172.21.15.148:0/4266200305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000a7dd0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 -- 172.21.15.148:0/4266200305 >> 172.21.15.148:0/4266200305 conn(0x7f9d000946a0 msgr2=0x7f9d0006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:28.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 -- 172.21.15.148:0/4266200305 shutdown_connections 2023-10-24T00:48:28.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.527+0000 7f9d07096700 1 -- 172.21.15.148:0/4266200305 wait complete. 2023-10-24T00:48:28.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.528+0000 7f9d07096700 1 Processor -- start 2023-10-24T00:48:28.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 -- start start 2023-10-24T00:48:28.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 0x7f9d001651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d00154400 0x7f9d0014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000ac410 con 0x7f9d001547e0 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000ab370 con 0x7f9d00154400 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d07096700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000ab650 con 0x7f9d000a82c0 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d05633700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.529+0000 7f9d05633700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48488/0 (socket says 172.21.15.148:48488) 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 -- 172.21.15.148:0/1591839561 learned_addr learned my addr 172.21.15.148:0/1591839561 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:28.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9cfffff700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d00154400 0x7f9d0014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d04e32700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 0x7f9d001651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 -- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 msgr2=0x7f9d001651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 0x7f9d001651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 -- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d00154400 msgr2=0x7f9d0014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d00154400 0x7f9d0014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 -- 172.21.15.148:0/1591839561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009370 con 0x7f9d001547e0 2023-10-24T00:48:28.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d04e32700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 0x7f9d001651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:28.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d05633700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f9cf800e6f0 tx=0x7f9cf8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8012600 con 0x7f9d001547e0 2023-10-24T00:48:28.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8012760 con 0x7f9d001547e0 2023-10-24T00:48:28.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000ab930 con 0x7f9d001547e0 2023-10-24T00:48:28.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8012ae0 con 0x7f9d001547e0 2023-10-24T00:48:28.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.530+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d000abef0 con 0x7f9d001547e0 2023-10-24T00:48:28.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.531+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000ac0e0 con 0x7f9d001547e0 2023-10-24T00:48:28.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.531+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9cf801b400 con 0x7f9d001547e0 2023-10-24T00:48:28.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.532+0000 7f9cfcff9700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 0x7f9cec0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.532+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9cf807a4a0 con 0x7f9d001547e0 2023-10-24T00:48:28.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.532+0000 7f9d04e32700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 0x7f9cec0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.532+0000 7f9d04e32700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 0x7f9cec0615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9cf0000f80 tx=0x7f9cf0005ad0).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.536+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9cf804b710 con 0x7f9d001547e0 2023-10-24T00:48:28.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.724+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d000adb50 con 0x7f9cec05f120 2023-10-24T00:48:28.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.726+0000 7f9cfcff9700 1 -- 172.21.15.148:0/1591839561 <== mgr.6623 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9d000adb50 con 0x7f9cec05f120 2023-10-24T00:48:28.727 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T00:48:28.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T00:48:28.728 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T00:48:28.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T00:48:28.728 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T00:48:28.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 msgr2=0x7f9cec0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 0x7f9cec0615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9cf0000f80 tx=0x7f9cf0005ad0).stop 2023-10-24T00:48:28.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 msgr2=0x7f9d000aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f9cf800e6f0 tx=0x7f9cf8009060).stop 2023-10-24T00:48:28.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 shutdown_connections 2023-10-24T00:48:28.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f9cec05f120 0x7f9cec0615e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d001547e0 0x7f9d000aab20 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d000a82c0 0x7f9d001651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 --2- 172.21.15.148:0/1591839561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d00154400 0x7f9d0014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 >> 172.21.15.148:0/1591839561 conn(0x7f9d000946a0 msgr2=0x7f9d000c0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:28.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 shutdown_connections 2023-10-24T00:48:28.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.727+0000 7f9d07096700 1 -- 172.21.15.148:0/1591839561 wait complete. 2023-10-24T00:48:28.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T00:48:28.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.854+0000 7f2c7ad16700 1 Processor -- start 2023-10-24T00:48:28.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.854+0000 7f2c7ad16700 1 -- start start 2023-10-24T00:48:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c7ad16700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c741574a0 0x7f2c74157880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c7ad16700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c740c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c7ad16700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740c1680 con 0x7f2c740c32f0 2023-10-24T00:48:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c7ad16700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c740a6240 con 0x7f2c741574a0 2023-10-24T00:48:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c7ad16700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740c1f20 con 0x7f2c740c23b0 2023-10-24T00:48:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c78ab2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c741574a0 0x7f2c74157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c792b3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2c740c32f0 0x7f2c74065c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52958/0 (socket says 172.21.15.148:52958) 2023-10-24T00:48:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c78ab2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2c741574a0 0x7f2c74157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48498/0 (socket says 172.21.15.148:48498) 2023-10-24T00:48:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.855+0000 7f2c792b3700 1 -- 172.21.15.148:0/2863244196 learned_addr learned my addr 172.21.15.148:0/2863244196 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c6bfff700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c740c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c78ab2700 1 -- 172.21.15.148:0/2863244196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 msgr2=0x7f2c740c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c78ab2700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c740c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c78ab2700 1 -- 172.21.15.148:0/2863244196 >> v1:172.21.15.148:6789/0 conn(0x7f2c740c32f0 legacy=0x7f2c74065c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c78ab2700 1 -- 172.21.15.148:0/2863244196 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c740c3750 con 0x7f2c741574a0 2023-10-24T00:48:28.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c6b7fe700 1 -- 172.21.15.148:0/2863244196 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305586493 0 0) 0x7f2c740c1680 con 0x7f2c740c32f0 2023-10-24T00:48:28.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c78ab2700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c74157880 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f2c70009e60 tx=0x7f2c70009780).ready entity=mon.0 client_cookie=ce9aa93cdd559ae server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c6b7fe700 1 -- 172.21.15.148:0/2863244196 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000e070 con 0x7f2c741574a0 2023-10-24T00:48:28.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c6b7fe700 1 -- 172.21.15.148:0/2863244196 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000bc30 con 0x7f2c741574a0 2023-10-24T00:48:28.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c6b7fe700 1 -- 172.21.15.148:0/2863244196 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70012410 con 0x7f2c741574a0 2023-10-24T00:48:28.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2863244196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 msgr2=0x7f2c74157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c74157880 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f2c70009e60 tx=0x7f2c70009780).stop 2023-10-24T00:48:28.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2863244196 shutdown_connections 2023-10-24T00:48:28.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c74157880 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2863244196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c740c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.856+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2863244196 >> 172.21.15.148:0/2863244196 conn(0x7f2c740c45a0 msgr2=0x7f2c74062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:28.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.857+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2863244196 shutdown_connections 2023-10-24T00:48:28.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.857+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2863244196 wait complete. 2023-10-24T00:48:28.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.858+0000 7f2c7ad16700 1 Processor -- start 2023-10-24T00:48:28.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.858+0000 7f2c7ad16700 1 -- start start 2023-10-24T00:48:28.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c74069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c740c32f0 0x7f2c74068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74068c50 con 0x7f2c741574a0 2023-10-24T00:48:28.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74069a50 con 0x7f2c740c32f0 2023-10-24T00:48:28.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74068e40 con 0x7f2c740c23b0 2023-10-24T00:48:28.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48504/0 (socket says 172.21.15.148:48504) 2023-10-24T00:48:28.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 -- 172.21.15.148:0/2045266902 learned_addr learned my addr 172.21.15.148:0/2045266902 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:28.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c78ab2700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c74069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c6bfff700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c740c32f0 0x7f2c74068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 -- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 msgr2=0x7f2c74069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c74069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 -- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c740c32f0 msgr2=0x7f2c74068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:28.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c740c32f0 0x7f2c74068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:28.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 -- 172.21.15.148:0/2045266902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009a20 con 0x7f2c741574a0 2023-10-24T00:48:28.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c792b3700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f2c6c001eb0 tx=0x7f2c6c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0070d0 con 0x7f2c741574a0 2023-10-24T00:48:28.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c007230 con 0x7f2c741574a0 2023-10-24T00:48:28.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c74069120 con 0x7f2c741574a0 2023-10-24T00:48:28.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0075f0 con 0x7f2c741574a0 2023-10-24T00:48:28.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.859+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c740696e0 con 0x7f2c741574a0 2023-10-24T00:48:28.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.860+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74069c00 con 0x7f2c741574a0 2023-10-24T00:48:28.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.861+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 57) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2c6c0059b0 con 0x7f2c741574a0 2023-10-24T00:48:28.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.861+0000 7f2c68ff9700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 0x7f2c60061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:28.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.861+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c6c0797f0 con 0x7f2c741574a0 2023-10-24T00:48:28.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.861+0000 7f2c78ab2700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 0x7f2c60061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:28.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.861+0000 7f2c78ab2700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 0x7f2c60061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2c700097c0 tx=0x7f2c740c1e90).ready entity=mgr.6623 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:28.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:28.865+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c6c04aac0 con 0x7f2c741574a0 2023-10-24T00:48:29.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.071+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2c74066960 con 0x7f2c741574a0 2023-10-24T00:48:29.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.911+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 58) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f2c6c0775c0 con 0x7f2c741574a0 2023-10-24T00:48:29.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.912+0000 7f2c68ff9700 1 -- 172.21.15.148:0/2045266902 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v58) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2c6c073360 con 0x7f2c741574a0 2023-10-24T00:48:29.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 msgr2=0x7f2c60061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:29.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 0x7f2c60061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2c700097c0 tx=0x7f2c740c1e90).stop 2023-10-24T00:48:29.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 msgr2=0x7f2c7414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:29.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f2c6c001eb0 tx=0x7f2c6c007bb0).stop 2023-10-24T00:48:29.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 shutdown_connections 2023-10-24T00:48:29.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2c6005f150 0x7f2c60061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:29.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c741574a0 0x7f2c7414f830 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:29.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c740c23b0 0x7f2c74069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:29.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 --2- 172.21.15.148:0/2045266902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c740c32f0 0x7f2c74068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:29.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 >> 172.21.15.148:0/2045266902 conn(0x7f2c740c45a0 msgr2=0x7f2c74065c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:29.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 shutdown_connections 2023-10-24T00:48:29.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:29.915+0000 7f2c7ad16700 1 -- 172.21.15.148:0/2045266902 wait complete. 2023-10-24T00:48:29.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T00:48:30.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.048+0000 7f5b53a6d700 1 Processor -- start 2023-10-24T00:48:30.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.048+0000 7f5b53a6d700 1 -- start start 2023-10-24T00:48:30.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b53a6d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b4c0c65f0 0x7f5b4c0be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b53a6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c4910 0x7f5b4c0bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b53a6d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c063760 con 0x7f5b4c0c6210 2023-10-24T00:48:30.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b53a6d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c154b50 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b53a6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0bf2f0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b51809700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5b4c0c6210 0x7f5b4c0c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52962/0 (socket says 172.21.15.148:52962) 2023-10-24T00:48:30.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.049+0000 7f5b51809700 1 -- 172.21.15.148:0/3134983384 learned_addr learned my addr 172.21.15.148:0/3134983384 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:30.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 --2- 172.21.15.148:0/3134983384 >> v2:172.21.15.150:3300/0 conn(0x7f5b4c0c65f0 0x7f5b4c0be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b5200a700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c4910 0x7f5b4c0bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b50807700 1 -- 172.21.15.148:0/3134983384 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618567602 0 0) 0x7f5b4c063760 con 0x7f5b4c0c6210 2023-10-24T00:48:30.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b50807700 1 -- 172.21.15.148:0/3134983384 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b380033f0 con 0x7f5b4c0c6210 2023-10-24T00:48:30.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 -- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c4910 msgr2=0x7f5b4c0bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:30.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c4910 0x7f5b4c0bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 -- 172.21.15.148:0/3134983384 >> v1:172.21.15.148:6789/0 conn(0x7f5b4c0c6210 legacy=0x7f5b4c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 -- 172.21.15.148:0/3134983384 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0bf5d0 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b51008700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be570 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f5b48009760 tx=0x7f5b48009060).ready entity=mon.1 client_cookie=f8a816666410be53 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:30.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b50807700 1 -- 172.21.15.148:0/3134983384 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800d4a0 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b50807700 1 -- 172.21.15.148:0/3134983384 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800d600 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.050+0000 7f5b50807700 1 -- 172.21.15.148:0/3134983384 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800d980 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 -- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 msgr2=0x7f5b4c0be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be570 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f5b48009760 tx=0x7f5b48009060).stop 2023-10-24T00:48:30.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 -- 172.21.15.148:0/3134983384 shutdown_connections 2023-10-24T00:48:30.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c4910 0x7f5b4c0bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/3134983384 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be570 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 -- 172.21.15.148:0/3134983384 >> 172.21.15.148:0/3134983384 conn(0x7f5b4c092510 msgr2=0x7f5b4c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:30.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 -- 172.21.15.148:0/3134983384 shutdown_connections 2023-10-24T00:48:30.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.051+0000 7f5b53a6d700 1 -- 172.21.15.148:0/3134983384 wait complete. 2023-10-24T00:48:30.058 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:30.050+0000 7f33fc4dd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:48:30.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.052+0000 7f5b53a6d700 1 Processor -- start 2023-10-24T00:48:30.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.052+0000 7f5b53a6d700 1 -- start start 2023-10-24T00:48:30.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c6210 0x7f5b4c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c155c60 con 0x7f5b4c0c4910 2023-10-24T00:48:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c155050 con 0x7f5b4c0c65f0 2023-10-24T00:48:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b53a6d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c155330 con 0x7f5b4c0c6210 2023-10-24T00:48:30.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48516/0 (socket says 172.21.15.148:48516) 2023-10-24T00:48:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 -- 172.21.15.148:0/1929627881 learned_addr learned my addr 172.21.15.148:0/1929627881 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51008700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c6210 0x7f5b4c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b5200a700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 -- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c6210 msgr2=0x7f5b4c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c6210 0x7f5b4c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 -- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 msgr2=0x7f5b4c0be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 -- 172.21.15.148:0/1929627881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480092a0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.064 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:30.054+0000 7ff18c41c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T00:48:30.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.053+0000 7f5b51809700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f5b3c00c420 tx=0x7f5b3c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:30.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.054+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0070d0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.054+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c007230 con 0x7f5b4c0c4910 2023-10-24T00:48:30.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.054+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c155610 con 0x7f5b4c0c4910 2023-10-24T00:48:30.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.054+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0075b0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.054+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c1656f0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.055+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c06c6b0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.055+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 58) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f5b3c0059b0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.056+0000 7f5b41ffb700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 0x7f5b30061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.056+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5b3c0798c0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.056+0000 7f5b51008700 1 -- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 msgr2=0x7f5b30061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.056+0000 7f5b51008700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 0x7f5b30061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.064+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5b3c04ab90 con 0x7f5b4c0c4910 2023-10-24T00:48:30.116 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:30.113+0000 7f33fc4dd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:48:30.123 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:30.122+0000 7ff18c41c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T00:48:30.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.235+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5b4c0aee90 con 0x7f5b4c0c4910 2023-10-24T00:48:30.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.239+0000 7f5b41ffb700 1 -- 172.21.15.148:0/1929627881 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5b3c04e1b0 con 0x7f5b4c0c4910 2023-10-24T00:48:30.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 msgr2=0x7f5b30061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 0x7f5b30061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 msgr2=0x7f5b4c165200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f5b3c00c420 tx=0x7f5b3c007c80).stop 2023-10-24T00:48:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 shutdown_connections 2023-10-24T00:48:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b4c0c65f0 0x7f5b4c0be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5b3005f1a0 0x7f5b30061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b4c0c4910 0x7f5b4c165200 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 --2- 172.21.15.148:0/1929627881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b4c0c6210 0x7f5b4c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 >> 172.21.15.148:0/1929627881 conn(0x7f5b4c092510 msgr2=0x7f5b4c066ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 shutdown_connections 2023-10-24T00:48:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.241+0000 7f5b53a6d700 1 -- 172.21.15.148:0/1929627881 wait complete. 2023-10-24T00:48:30.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T00:48:30.255 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T00:48:30.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-10-24T00:48:30.391 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:30.389+0000 7f33fc4dd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:48:30.410 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:30.409+0000 7ff18c41c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T00:48:30.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.434+0000 7fd8c6469700 1 Processor -- start 2023-10-24T00:48:30.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.434+0000 7fd8c6469700 1 -- start start 2023-10-24T00:48:30.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c6469700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c00a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c6469700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8c0064c10 0x7fd8c0065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c6469700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c0065540 con 0x7fd8c00be780 2023-10-24T00:48:30.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c6469700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c00c7a20 con 0x7fd8c0064c10 2023-10-24T00:48:30.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c6469700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00c6330 con 0x7fd8c00c5f50 2023-10-24T00:48:30.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8c0064c10 0x7fd8c0065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8c0064c10 0x7fd8c0065050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48530/0 (socket says 172.21.15.148:48530) 2023-10-24T00:48:30.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/3402603196 learned_addr learned my addr 172.21.15.148:0/3402603196 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:30.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8c4a06700 1 --1- 172.21.15.148:0/3402603196 >> v1:172.21.15.148:6789/0 conn(0x7fd8c00be780 0x7fd8c00c7eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:52976/0 (socket says 172.21.15.148:52976) 2023-10-24T00:48:30.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bffff700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c00a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/3402603196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 msgr2=0x7fd8c00a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:30.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c00a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/3402603196 >> v1:172.21.15.148:6789/0 conn(0x7fd8c00be780 legacy=0x7fd8c00c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8beffd700 1 -- 172.21.15.148:0/3402603196 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427753017 0 0) 0x7fd8b8001490 con 0x7fd8c00be780 2023-10-24T00:48:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/3402603196 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00633f0 con 0x7fd8c0064c10 2023-10-24T00:48:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.435+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c0065050 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fd8b0006fd0 tx=0x7fd8b00090f0).ready entity=mon.0 client_cookie=963cb76c7f6bf09 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8beffd700 1 -- 172.21.15.148:0/3402603196 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000b580 con 0x7fd8c0064c10 2023-10-24T00:48:30.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8beffd700 1 -- 172.21.15.148:0/3402603196 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000b6e0 con 0x7fd8c0064c10 2023-10-24T00:48:30.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8beffd700 1 -- 172.21.15.148:0/3402603196 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000ba60 con 0x7fd8c0064c10 2023-10-24T00:48:30.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 -- 172.21.15.148:0/3402603196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 msgr2=0x7fd8c0065050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c0065050 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fd8b0006fd0 tx=0x7fd8b00090f0).stop 2023-10-24T00:48:30.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 -- 172.21.15.148:0/3402603196 shutdown_connections 2023-10-24T00:48:30.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c00a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 --2- 172.21.15.148:0/3402603196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c0065050 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 -- 172.21.15.148:0/3402603196 >> 172.21.15.148:0/3402603196 conn(0x7fd8c0082f60 msgr2=0x7fd8c0092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:30.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 -- 172.21.15.148:0/3402603196 shutdown_connections 2023-10-24T00:48:30.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.436+0000 7fd8c6469700 1 -- 172.21.15.148:0/3402603196 wait complete. 2023-10-24T00:48:30.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.437+0000 7fd8c6469700 1 Processor -- start 2023-10-24T00:48:30.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 -- start start 2023-10-24T00:48:30.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c00be780 0x7fd8c0096450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c0151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00abec0 con 0x7fd8c0064c10 2023-10-24T00:48:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c01655d0 con 0x7fd8c00be780 2023-10-24T00:48:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8c6469700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c00ac160 con 0x7fd8c00c5f50 2023-10-24T00:48:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48534/0 (socket says 172.21.15.148:48534) 2023-10-24T00:48:30.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.438+0000 7fd8bffff700 1 -- 172.21.15.148:0/4136466986 learned_addr learned my addr 172.21.15.148:0/4136466986 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:30.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8c4a06700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c0151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c00be780 0x7fd8c0096450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:30.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 msgr2=0x7fd8c0151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c0151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c00be780 msgr2=0x7fd8c0096450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c00be780 0x7fd8c0096450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009370 con 0x7fd8c0064c10 2023-10-24T00:48:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8bffff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd8b400e900 tx=0x7fd8b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:30.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4012600 con 0x7fd8c0064c10 2023-10-24T00:48:30.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4012760 con 0x7fd8c0064c10 2023-10-24T00:48:30.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c00ac440 con 0x7fd8c0064c10 2023-10-24T00:48:30.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4012ae0 con 0x7fd8c0064c10 2023-10-24T00:48:30.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.439+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c01658b0 con 0x7fd8c0064c10 2023-10-24T00:48:30.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.440+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 58) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fd8b401b400 con 0x7fd8c0064c10 2023-10-24T00:48:30.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.440+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c00ac7b0 con 0x7fd8c0064c10 2023-10-24T00:48:30.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.441+0000 7fd8a7fff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:30.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.441+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:30.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.441+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd8b407a500 con 0x7fd8c0064c10 2023-10-24T00:48:30.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.441+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T00:48:30.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.445+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd8b404b770 con 0x7fd8c0064c10 2023-10-24T00:48:30.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.640+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c006c6b0 con 0x7fd8ac05f1a0 2023-10-24T00:48:30.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.642+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:30.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:30.642+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T00:48:31.003 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.001+0000 7f33fc4dd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:48:31.035 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.033+0000 7ff18c41c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T00:48:31.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:31.052+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:31.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:31.052+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T00:48:31.074 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.072+0000 7f33fc4dd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:48:31.108 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.107+0000 7ff18c41c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T00:48:31.262 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.259+0000 7f33fc4dd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:48:31.295 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.294+0000 7ff18c41c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T00:48:31.683 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.681+0000 7f33fc4dd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:48:31.717 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.716+0000 7ff18c41c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T00:48:31.787 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.785+0000 7f33fc4dd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:31.819 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.818+0000 7ff18c41c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:31.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:31.853+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:31.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:31.853+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T00:48:31.941 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:31.938+0000 7f33fc4dd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:31.973 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:31.972+0000 7ff18c41c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:32.015 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:32.013+0000 7f33fc4dd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:48:32.048 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:32.047+0000 7ff18c41c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T00:48:32.081 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:32.079+0000 7f33fc4dd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:48:32.116 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:32.115+0000 7ff18c41c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T00:48:32.338 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:32.336+0000 7f33fc4dd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:48:32.374 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:32.373+0000 7ff18c41c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T00:48:32.526 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:32.524+0000 7f33fc4dd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:32.563 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:32.562+0000 7ff18c41c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T00:48:32.802 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:48:32.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:48:33.180 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.178+0000 7f33fc4dd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:48:33.225 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.224+0000 7ff18c41c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T00:48:33.249 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.246+0000 7f33fc4dd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:48:33.294 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.293+0000 7ff18c41c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T00:48:33.324 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.322+0000 7f33fc4dd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:48:33.371 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.370+0000 7ff18c41c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T00:48:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:33.454+0000 7fd8bf7fe700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T00:48:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:33.455+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T00:48:33.470 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.468+0000 7f33fc4dd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:48:33.520 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.518+0000 7ff18c41c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T00:48:33.540 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.538+0000 7f33fc4dd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:48:33.590 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.589+0000 7ff18c41c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T00:48:33.654 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.652+0000 7f33fc4dd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:48:33.704 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.703+0000 7ff18c41c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T00:48:33.764 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:33.761+0000 7f33fc4dd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:33.814 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:33.813+0000 7ff18c41c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T00:48:34.058 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.056+0000 7f33fc4dd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:48:34.108 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:34.107+0000 7ff18c41c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T00:48:34.131 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.129+0000 7f33fc4dd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:48:34.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:34.149+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 59) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fd8b40782d0 con 0x7fd8c0064c10 2023-10-24T00:48:34.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:34.150+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T00:48:34.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:34.150+0000 7fd8a7fff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:34.184 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T00:48:34.183+0000 7ff18c41c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T00:48:34.218 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3370c64700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.218 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3370c64700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.218 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3370c64700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3370c64700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3370c64700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3373c6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3373c6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.219 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3373c6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.220 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3373c6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:34.220 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:48:34.215+0000 7f3373c6a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:48:35.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.152+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fd8b4078650 con 0x7fd8c0064c10 2023-10-24T00:48:35.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.153+0000 7fd8a7fff700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.153+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c006c6b0 con 0x7fd8ac05f1a0 2023-10-24T00:48:35.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.153+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.154+0000 7fd8bf7fe700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac0615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd8b0006fd0 tx=0x7fd8b0017000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.173+0000 7fd8a7fff700 1 -- 172.21.15.148:0/4136466986 <== mgr.6914 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd8c006c6b0 con 0x7fd8ac05f1a0 2023-10-24T00:48:35.175 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1 2023-10-24T00:48:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 msgr2=0x7fd8ac0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac0615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd8b0006fd0 tx=0x7fd8b0017000).stop 2023-10-24T00:48:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 msgr2=0x7fd8c00ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fd8b400e900 tx=0x7fd8b4009060).stop 2023-10-24T00:48:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 shutdown_connections 2023-10-24T00:48:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8c00c5f50 0x7fd8c0151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd8ac05f1a0 0x7fd8ac0615e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8c0064c10 0x7fd8c00ac960 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 --2- 172.21.15.148:0/4136466986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8c00be780 0x7fd8c0096450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 >> 172.21.15.148:0/4136466986 conn(0x7fd8c0082f60 msgr2=0x7fd8c00665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 shutdown_connections 2023-10-24T00:48:35.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.176+0000 7fd8c6469700 1 -- 172.21.15.148:0/4136466986 wait complete. 2023-10-24T00:48:35.190 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-10-24T00:48:35.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-10-24T00:48:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.319+0000 7fef86206700 1 Processor -- start 2023-10-24T00:48:35.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.320+0000 7fef86206700 1 -- start start 2023-10-24T00:48:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.320+0000 7fef86206700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef800c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.320+0000 7fef86206700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800bce80 con 0x7fef80153f20 2023-10-24T00:48:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.320+0000 7fef86206700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800bd160 con 0x7fef80154300 2023-10-24T00:48:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.320+0000 7fef86206700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef80158560 con 0x7fef80062d60 2023-10-24T00:48:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef85204700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fef80153f20 0x7fef80157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:39000/0 (socket says 172.21.15.148:39000) 2023-10-24T00:48:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef85204700 1 -- 172.21.15.148:0/2109330649 learned_addr learned my addr 172.21.15.148:0/2109330649 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T00:48:35.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef85a05700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef800c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530771705 0 0) 0x7fef800bce80 con 0x7fef80153f20 2023-10-24T00:48:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c0033f0 con 0x7fef80153f20 2023-10-24T00:48:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31220373 0 0) 0x7fef800bd160 con 0x7fef80154300 2023-10-24T00:48:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef800bce80 con 0x7fef80154300 2023-10-24T00:48:35.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779257839 0 0) 0x7fef6c0033f0 con 0x7fef80153f20 2023-10-24T00:48:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 msgr2=0x7fef800c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef800c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 >> v1:172.21.15.150:6789/0 conn(0x7fef80154300 legacy=0x7fef80062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80158840 con 0x7fef80153f20 2023-10-24T00:48:35.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fef7c0017f0 con 0x7fef80153f20 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 >> v1:172.21.15.148:6789/0 conn(0x7fef80153f20 legacy=0x7fef80157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef6c003aa0 0x7fef6c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef6c004b80 0x7fef6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80158560 con 0x7fef6c003aa0 2023-10-24T00:48:35.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c00b9c0 con 0x7fef6c004b80 2023-10-24T00:48:35.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c00bb80 con 0x7fef80062d60 2023-10-24T00:48:35.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.321+0000 7fef85204700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef6c003aa0 0x7fef6c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef84a03700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85a05700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef6c004b80 0x7fef6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 -- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 msgr2=0x7fef6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:35.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef80062d60 0x7fef6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 -- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef6c004b80 msgr2=0x7fef6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:35.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef6c004b80 0x7fef6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 -- 172.21.15.148:0/2109330649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0033f0 con 0x7fef6c003aa0 2023-10-24T00:48:35.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85a05700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef6c004b80 0x7fef6c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:35.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef85204700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef6c003aa0 0x7fef6c003ea0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fef7c00c5c0 tx=0x7fef7c007f40).ready entity=mon.0 client_cookie=686d3c3f95699c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00cdc0 con 0x7fef6c003aa0 2023-10-24T00:48:35.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c005b20 con 0x7fef6c003aa0 2023-10-24T00:48:35.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.322+0000 7fef77fff700 1 -- 172.21.15.148:0/2109330649 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0070d0 con 0x7fef6c003aa0 2023-10-24T00:48:35.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 -- 172.21.15.148:0/2109330649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef6c003aa0 msgr2=0x7fef6c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 --2- 172.21.15.148:0/2109330649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef6c003aa0 0x7fef6c003ea0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fef7c00c5c0 tx=0x7fef7c007f40).stop 2023-10-24T00:48:35.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef85a05700 1 -- 172.21.15.148:0/2109330649 reap_dead start 2023-10-24T00:48:35.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 -- 172.21.15.148:0/2109330649 shutdown_connections 2023-10-24T00:48:35.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 -- 172.21.15.148:0/2109330649 >> 172.21.15.148:0/2109330649 conn(0x7fef80064230 msgr2=0x7fef800c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:35.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 -- 172.21.15.148:0/2109330649 shutdown_connections 2023-10-24T00:48:35.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.323+0000 7fef86206700 1 -- 172.21.15.148:0/2109330649 wait complete. 2023-10-24T00:48:35.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.324+0000 7fef86206700 1 Processor -- start 2023-10-24T00:48:35.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.324+0000 7fef86206700 1 -- start start 2023-10-24T00:48:35.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 0x7fef8014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 0x7fef800bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800ac610 con 0x7fef800c00d0 2023-10-24T00:48:35.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800bef50 con 0x7fef800c0f50 2023-10-24T00:48:35.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800abd70 con 0x7fef6c003aa0 2023-10-24T00:48:35.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45642/0 (socket says 172.21.15.148:45642) 2023-10-24T00:48:35.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 -- 172.21.15.148:0/2404905981 learned_addr learned my addr 172.21.15.148:0/2404905981 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:35.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef85204700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 0x7fef8014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef85a05700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 0x7fef800bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 -- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 msgr2=0x7fef8014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 0x7fef8014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 -- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 msgr2=0x7fef800bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 0x7fef800bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 -- 172.21.15.148:0/2404905981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800ac050 con 0x7fef800c00d0 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef85204700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 0x7fef8014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef85a05700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 0x7fef800bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T00:48:35.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef84a03700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fef70002a50 tx=0x7fef70007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000f870 con 0x7fef800c00d0 2023-10-24T00:48:35.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000f9d0 con 0x7fef800c00d0 2023-10-24T00:48:35.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800ac330 con 0x7fef800c00d0 2023-10-24T00:48:35.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000fd70 con 0x7fef800c00d0 2023-10-24T00:48:35.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.325+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800c0710 con 0x7fef800c00d0 2023-10-24T00:48:35.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.327+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef800c08d0 con 0x7fef800c00d0 2023-10-24T00:48:35.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.327+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fef7001d3b0 con 0x7fef800c00d0 2023-10-24T00:48:35.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.327+0000 7fef757fa700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 0x7fef64061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.327+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fef7007a080 con 0x7fef800c00d0 2023-10-24T00:48:35.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.327+0000 7fef85204700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 0x7fef64061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.328+0000 7fef85204700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 0x7fef64061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fef800aa9f0 tx=0x7fef7c015000).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.331+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef7004b410 con 0x7fef800c00d0 2023-10-24T00:48:35.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.521+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7fef800bed00 con 0x7fef6405f080 2023-10-24T00:48:35.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.526+0000 7fef757fa700 1 -- 172.21.15.148:0/2404905981 <== mgr.6914 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7fef800bed00 con 0x7fef6405f080 2023-10-24T00:48:35.527 INFO:teuthology.orchestra.run.smithi148.stdout:Retention added to path /snap_test_dir1 2023-10-24T00:48:35.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 msgr2=0x7fef64061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 0x7fef64061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fef800aa9f0 tx=0x7fef7c015000).stop 2023-10-24T00:48:35.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 msgr2=0x7fef800c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fef70002a50 tx=0x7fef70007bb0).stop 2023-10-24T00:48:35.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 shutdown_connections 2023-10-24T00:48:35.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef800c0f50 0x7fef800bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef6c003aa0 0x7fef8014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef6405f080 0x7fef64061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 --2- 172.21.15.148:0/2404905981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef800c00d0 0x7fef800c0a60 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 >> 172.21.15.148:0/2404905981 conn(0x7fef80064230 msgr2=0x7fef80067760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 shutdown_connections 2023-10-24T00:48:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.528+0000 7fef86206700 1 -- 172.21.15.148:0/2404905981 wait complete. 2023-10-24T00:48:35.541 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-10-24T00:48:35.542 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-24T00:48:35.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-10-24T00:48:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.658+0000 7efd2ba62700 1 Processor -- start 2023-10-24T00:48:35.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.658+0000 7efd2ba62700 1 -- start start 2023-10-24T00:48:35.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd2ba62700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd241544b0 0x7efd240a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd2ba62700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240aa640 0x7efd240c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd2ba62700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd240c6270 con 0x7efd240c8290 2023-10-24T00:48:35.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd2ba62700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd240c60e0 con 0x7efd241544b0 2023-10-24T00:48:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd2ba62700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd240c0c80 con 0x7efd240aa640 2023-10-24T00:48:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd297fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd241544b0 0x7efd240a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd297fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efd241544b0 0x7efd240a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45650/0 (socket says 172.21.15.148:45650) 2023-10-24T00:48:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.659+0000 7efd297fe700 1 -- 172.21.15.148:0/310697479 learned_addr learned my addr 172.21.15.148:0/310697479 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:35.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd297fe700 1 -- 172.21.15.148:0/310697479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240aa640 msgr2=0x7efd240c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd297fe700 1 --2- 172.21.15.148:0/310697479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240aa640 0x7efd240c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd297fe700 1 -- 172.21.15.148:0/310697479 >> v1:172.21.15.150:6789/0 conn(0x7efd240c8290 legacy=0x7efd240a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T00:48:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd297fe700 1 -- 172.21.15.148:0/310697479 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240c0f40 con 0x7efd241544b0 2023-10-24T00:48:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd297fe700 1 --2- 172.21.15.148:0/310697479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd241544b0 0x7efd240a7d00 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7efd14009f20 tx=0x7efd14009840).ready entity=mon.0 client_cookie=be8f3c70e1581c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd23fff700 1 -- 172.21.15.148:0/310697479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400e070 con 0x7efd241544b0 2023-10-24T00:48:35.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd23fff700 1 -- 172.21.15.148:0/310697479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1400ba40 con 0x7efd241544b0 2023-10-24T00:48:35.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd23fff700 1 -- 172.21.15.148:0/310697479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400bdc0 con 0x7efd241544b0 2023-10-24T00:48:35.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd2ba62700 1 -- 172.21.15.148:0/310697479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd241544b0 msgr2=0x7efd240a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.660+0000 7efd2ba62700 1 --2- 172.21.15.148:0/310697479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd241544b0 0x7efd240a7d00 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7efd14009f20 tx=0x7efd14009840).stop 2023-10-24T00:48:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 -- 172.21.15.148:0/310697479 shutdown_connections 2023-10-24T00:48:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 --2- 172.21.15.148:0/310697479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240aa640 0x7efd240c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T00:48:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 --2- 172.21.15.148:0/310697479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd241544b0 0x7efd240a7d00 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 -- 172.21.15.148:0/310697479 >> 172.21.15.148:0/310697479 conn(0x7efd240945d0 msgr2=0x7efd2406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:35.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 -- 172.21.15.148:0/310697479 shutdown_connections 2023-10-24T00:48:35.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.661+0000 7efd2ba62700 1 -- 172.21.15.148:0/310697479 wait complete. 2023-10-24T00:48:35.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.662+0000 7efd2ba62700 1 Processor -- start 2023-10-24T00:48:35.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.662+0000 7efd2ba62700 1 -- start start 2023-10-24T00:48:35.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240c8290 0x7efd240ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241544b0 0x7efd240ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24155460 con 0x7efd240aa640 2023-10-24T00:48:35.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24154890 con 0x7efd241544b0 2023-10-24T00:48:35.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd24154b30 con 0x7efd240c8290 2023-10-24T00:48:35.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45652/0 (socket says 172.21.15.148:45652) 2023-10-24T00:48:35.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 -- 172.21.15.148:0/4132900305 learned_addr learned my addr 172.21.15.148:0/4132900305 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T00:48:35.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 -- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240c8290 msgr2=0x7efd240ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd28ffd700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240c8290 0x7efd240ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd29fff700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241544b0 0x7efd240ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240c8290 0x7efd240ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 -- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241544b0 msgr2=0x7efd240ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241544b0 0x7efd240ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 -- 172.21.15.148:0/4132900305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14009ae0 con 0x7efd240aa640 2023-10-24T00:48:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd297fe700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7efd1400c010 tx=0x7efd14009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400bdc0 con 0x7efd240aa640 2023-10-24T00:48:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd24154e10 con 0x7efd240aa640 2023-10-24T00:48:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2414fbf0 con 0x7efd240aa640 2023-10-24T00:48:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14001010 con 0x7efd240aa640 2023-10-24T00:48:35.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.663+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1401c610 con 0x7efd240aa640 2023-10-24T00:48:35.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.664+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2406c6b0 con 0x7efd240aa640 2023-10-24T00:48:35.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.665+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 60) v1 ==== 75357+0+0 (secure 0 0 0) 0x7efd1401ca00 con 0x7efd240aa640 2023-10-24T00:48:35.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.665+0000 7efd217fa700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 0x7efd10061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T00:48:35.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.665+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6293+0+0 (secure 0 0 0) 0x7efd1407ba80 con 0x7efd240aa640 2023-10-24T00:48:35.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.665+0000 7efd28ffd700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 0x7efd10061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T00:48:35.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.666+0000 7efd28ffd700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 0x7efd10061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd18007fd0 tx=0x7efd18009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T00:48:35.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.669+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efd1404ce70 con 0x7efd240aa640 2023-10-24T00:48:35.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.855+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd241555a0 con 0x7efd1005f080 2023-10-24T00:48:35.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.858+0000 7efd217fa700 1 -- 172.21.15.148:0/4132900305 <== mgr.6914 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7efd18002210 con 0x7efd1005f080 2023-10-24T00:48:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T00:48:35.859 INFO:teuthology.orchestra.run.smithi148.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-24T00:48:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 msgr2=0x7efd10061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 0x7efd10061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd18007fd0 tx=0x7efd18009040).stop 2023-10-24T00:48:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 msgr2=0x7efd2414f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T00:48:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7efd1400c010 tx=0x7efd14009840).stop 2023-10-24T00:48:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 shutdown_connections 2023-10-24T00:48:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd241544b0 0x7efd240ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efd1005f080 0x7efd10061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd240aa640 0x7efd2414f700 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 --2- 172.21.15.148:0/4132900305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efd240c8290 0x7efd240ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T00:48:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 >> 172.21.15.148:0/4132900305 conn(0x7efd240945d0 msgr2=0x7efd24063e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T00:48:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 shutdown_connections 2023-10-24T00:48:35.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T00:48:35.859+0000 7efd2ba62700 1 -- 172.21.15.148:0/4132900305 wait complete. 2023-10-24T00:48:35.873 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-24T00:48:35.873 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-10-24T00:49:00.531 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:49:00.529+0000 7f3362c48700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:49:00.532 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:49:00.529+0000 7f3362c48700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:49:00.532 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:49:00.529+0000 7f3362c48700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:49:00.532 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:49:00.529+0000 7f3362c48700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:49:00.532 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T00:49:00.529+0000 7f3362c48700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T00:49:02.876 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:49:02.879 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:49:32.943 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:49:32.946 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:50:03.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:50:03.008 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:50:33.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:50:33.081 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:51:03.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:51:03.145 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:51:33.205 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:51:33.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:52:03.286 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:52:03.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:52:33.351 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:52:33.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:53:03.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:53:03.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:53:33.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:53:33.491 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:54:03.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:54:03.574 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:54:33.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:54:33.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:55:03.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:55:03.709 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:55:33.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:55:33.798 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:56:03.858 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:56:03.861 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:56:33.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:56:33.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:57:04.029 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:57:04.033 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:57:34.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:57:34.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:58:04.161 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:58:04.165 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:58:34.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:58:34.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:59:04.310 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:59:04.314 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:59:34.391 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T00:59:34.394 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:00:04.481 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:00:04.485 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:00:34.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:00:34.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:01:04.662 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:01:04.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:01:34.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:01:34.760 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:02:04.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:02:04.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:02:34.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:02:34.914 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:03:05.009 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:03:05.012 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:03:35.072 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:03:35.076 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:04:05.153 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:04:05.156 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:04:35.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:04:35.245 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:05:05.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:05:05.329 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:05:35.396 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:05:35.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:06:05.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:06:05.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:06:35.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:06:35.546 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:07:05.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:07:05.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:07:35.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:07:35.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:08:05.751 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:08:05.754 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:08:35.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:08:35.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:09:05.878 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:09:05.882 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:09:35.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:09:35.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:10:06.034 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:10:06.037 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:10:36.106 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:10:36.110 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:11:06.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:11:06.181 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:11:36.234 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:11:36.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:12:06.289 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:12:06.292 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:12:36.378 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:12:36.382 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:13:06.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:13:06.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:13:36.513 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:13:36.519 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:14:06.584 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:14:06.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:14:36.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:14:36.656 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:15:06.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:15:06.729 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:15:36.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:15:36.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:16:06.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:16:06.941 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:16:37.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:16:37.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:17:07.366 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:17:07.369 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:17:37.471 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:17:37.475 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:18:07.602 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:18:07.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:18:37.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:18:37.737 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:19:07.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:19:07.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:19:37.903 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:19:37.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:20:07.979 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:20:07.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:20:38.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:20:38.059 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:21:08.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:21:08.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:21:38.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:21:38.223 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:22:08.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:22:08.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:22:38.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:22:38.359 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:23:08.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:23:08.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:23:38.498 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:23:38.502 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:24:08.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:24:08.566 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:24:38.629 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:24:38.632 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:25:08.693 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:25:08.697 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:25:38.766 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:25:38.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:26:08.847 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:26:08.851 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:26:38.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:26:38.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:27:08.992 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:27:08.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:27:39.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:27:39.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:28:09.145 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:28:09.148 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:28:39.218 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:28:39.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:29:09.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:29:09.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:29:39.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:29:39.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:30:09.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:30:09.460 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:30:39.593 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:30:39.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:31:09.732 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:31:09.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:31:39.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:31:39.866 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:32:09.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:32:09.989 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:32:40.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:32:40.119 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:33:10.179 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:33:10.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:33:40.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:33:40.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:34:10.466 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:34:10.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:34:40.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:34:40.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:35:10.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:35:10.687 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:35:40.817 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:35:40.820 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:36:10.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:36:10.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:36:40.995 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:36:40.998 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:37:11.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:37:11.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:37:41.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:37:41.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:38:11.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:38:11.432 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:38:41.585 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:38:41.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:39:11.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:39:11.668 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:39:41.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:39:41.790 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:40:11.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:40:11.930 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:40:42.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:40:42.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:41:12.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:41:12.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:41:42.320 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:41:42.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:42:12.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:42:12.436 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:42:42.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:42:42.551 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:43:12.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:43:12.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:43:42.687 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:43:42.691 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:44:12.789 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:44:12.793 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:44:15.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:15.875 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T01:44:15.897 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_50_00_UTC 2023-10-24T01:44:15.898 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_51_00_UTC 2023-10-24T01:44:15.898 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_52_00_UTC 2023-10-24T01:44:15.898 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_53_00_UTC 2023-10-24T01:44:15.898 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_54_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_55_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_56_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_57_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_58_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_59_00_UTC 2023-10-24T01:44:15.899 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_00_00_UTC 2023-10-24T01:44:15.900 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_01_00_UTC 2023-10-24T01:44:15.900 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_02_00_UTC 2023-10-24T01:44:15.900 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_03_00_UTC 2023-10-24T01:44:15.900 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_04_00_UTC 2023-10-24T01:44:15.900 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_05_00_UTC 2023-10-24T01:44:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_06_00_UTC 2023-10-24T01:44:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_07_00_UTC 2023-10-24T01:44:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_08_00_UTC 2023-10-24T01:44:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_09_00_UTC 2023-10-24T01:44:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_10_00_UTC 2023-10-24T01:44:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_11_00_UTC 2023-10-24T01:44:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_12_00_UTC 2023-10-24T01:44:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_13_00_UTC 2023-10-24T01:44:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_14_00_UTC 2023-10-24T01:44:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_15_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_16_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_17_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_18_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_19_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_20_00_UTC 2023-10-24T01:44:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_21_00_UTC 2023-10-24T01:44:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_22_00_UTC 2023-10-24T01:44:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_23_00_UTC 2023-10-24T01:44:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_24_00_UTC 2023-10-24T01:44:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_25_00_UTC 2023-10-24T01:44:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_26_00_UTC 2023-10-24T01:44:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_27_00_UTC 2023-10-24T01:44:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_28_00_UTC 2023-10-24T01:44:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_29_00_UTC 2023-10-24T01:44:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_30_00_UTC 2023-10-24T01:44:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_31_00_UTC 2023-10-24T01:44:15.906 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_32_00_UTC 2023-10-24T01:44:15.906 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_33_00_UTC 2023-10-24T01:44:15.906 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_34_00_UTC 2023-10-24T01:44:15.906 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_35_00_UTC 2023-10-24T01:44:15.906 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_36_00_UTC 2023-10-24T01:44:15.907 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_37_00_UTC 2023-10-24T01:44:15.907 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_38_00_UTC 2023-10-24T01:44:15.907 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_39_00_UTC 2023-10-24T01:44:15.907 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_40_00_UTC 2023-10-24T01:44:15.907 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_41_00_UTC 2023-10-24T01:44:15.908 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_42_00_UTC 2023-10-24T01:44:15.908 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_43_00_UTC 2023-10-24T01:44:15.908 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_44_00_UTC 2023-10-24T01:44:15.908 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-00_50_00_UTC', 'scheduled-2023-10-24-00_51_00_UTC', 'scheduled-2023-10-24-00_52_00_UTC', 'scheduled-2023-10-24-00_53_00_UTC', 'scheduled-2023-10-24-00_54_00_UTC', 'scheduled-2023-10-24-00_55_00_UTC', 'scheduled-2023-10-24-00_56_00_UTC', 'scheduled-2023-10-24-00_57_00_UTC', 'scheduled-2023-10-24-00_58_00_UTC', 'scheduled-2023-10-24-00_59_00_UTC', 'scheduled-2023-10-24-01_00_00_UTC', 'scheduled-2023-10-24-01_01_00_UTC', 'scheduled-2023-10-24-01_02_00_UTC', 'scheduled-2023-10-24-01_03_00_UTC', 'scheduled-2023-10-24-01_04_00_UTC', 'scheduled-2023-10-24-01_05_00_UTC', 'scheduled-2023-10-24-01_06_00_UTC', 'scheduled-2023-10-24-01_07_00_UTC', 'scheduled-2023-10-24-01_08_00_UTC', 'scheduled-2023-10-24-01_09_00_UTC', 'scheduled-2023-10-24-01_10_00_UTC', 'scheduled-2023-10-24-01_11_00_UTC', 'scheduled-2023-10-24-01_12_00_UTC', 'scheduled-2023-10-24-01_13_00_UTC', 'scheduled-2023-10-24-01_14_00_UTC', 'scheduled-2023-10-24-01_15_00_UTC', 'scheduled-2023-10-24-01_16_00_UTC', 'scheduled-2023-10-24-01_17_00_UTC', 'scheduled-2023-10-24-01_18_00_UTC', 'scheduled-2023-10-24-01_19_00_UTC', 'scheduled-2023-10-24-01_20_00_UTC', 'scheduled-2023-10-24-01_21_00_UTC', 'scheduled-2023-10-24-01_22_00_UTC', 'scheduled-2023-10-24-01_23_00_UTC', 'scheduled-2023-10-24-01_24_00_UTC', 'scheduled-2023-10-24-01_25_00_UTC', 'scheduled-2023-10-24-01_26_00_UTC', 'scheduled-2023-10-24-01_27_00_UTC', 'scheduled-2023-10-24-01_28_00_UTC', 'scheduled-2023-10-24-01_29_00_UTC', 'scheduled-2023-10-24-01_30_00_UTC', 'scheduled-2023-10-24-01_31_00_UTC', 'scheduled-2023-10-24-01_32_00_UTC', 'scheduled-2023-10-24-01_33_00_UTC', 'scheduled-2023-10-24-01_34_00_UTC', 'scheduled-2023-10-24-01_35_00_UTC', 'scheduled-2023-10-24-01_36_00_UTC', 'scheduled-2023-10-24-01_37_00_UTC', 'scheduled-2023-10-24-01_38_00_UTC', 'scheduled-2023-10-24-01_39_00_UTC', 'scheduled-2023-10-24-01_40_00_UTC', 'scheduled-2023-10-24-01_41_00_UTC', 'scheduled-2023-10-24-01_42_00_UTC', 'scheduled-2023-10-24-01_43_00_UTC', 'scheduled-2023-10-24-01_44_00_UTC'] 2023-10-24T01:44:15.909 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-10-24T01:44:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.065+0000 7f45bc73d700 1 Processor -- start 2023-10-24T01:44:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.065+0000 7f45bc73d700 1 -- start start 2023-10-24T01:44:16.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45b4150870 0x7f45b40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4154240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45b4154730 0x7f45b4150c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b4154bc0 con 0x7f45b4154730 2023-10-24T01:44:16.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b4068f20 con 0x7f45b4150870 2023-10-24T01:44:16.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bc73d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40691e0 con 0x7f45b40c2090 2023-10-24T01:44:16.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.066+0000 7f45bacda700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45b4154730 0x7f45b4150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f45b4154730 0x7f45b4150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58754/0 (socket says 172.21.15.148:58754) 2023-10-24T01:44:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 -- 172.21.15.148:0/814142845 learned_addr learned my addr 172.21.15.148:0/814142845 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45ba4d9700 1 --2- 172.21.15.148:0/814142845 >> v2:172.21.15.150:3300/0 conn(0x7f45b4150870 0x7f45b40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45b9cd8700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 -- 172.21.15.148:0/814142845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 msgr2=0x7f45b4154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 -- 172.21.15.148:0/814142845 >> v2:172.21.15.150:3300/0 conn(0x7f45b4150870 msgr2=0x7f45b40688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 --2- 172.21.15.148:0/814142845 >> v2:172.21.15.150:3300/0 conn(0x7f45b4150870 0x7f45b40688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 -- 172.21.15.148:0/814142845 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40694c0 con 0x7f45b4154730 2023-10-24T01:44:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45bacda700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b4150c50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f45b4067fa0 tx=0x7f45ac009840).ready entity=mon.0 client_cookie=a9faa73566077183 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45b94d7700 1 -- 172.21.15.148:0/814142845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00e070 con 0x7f45b4154730 2023-10-24T01:44:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45b94d7700 1 -- 172.21.15.148:0/814142845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00b970 con 0x7f45b4154730 2023-10-24T01:44:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.067+0000 7f45b94d7700 1 -- 172.21.15.148:0/814142845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00bcf0 con 0x7f45b4154730 2023-10-24T01:44:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 -- 172.21.15.148:0/814142845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 msgr2=0x7f45b4150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b4150c50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f45b4067fa0 tx=0x7f45ac009840).stop 2023-10-24T01:44:16.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 -- 172.21.15.148:0/814142845 shutdown_connections 2023-10-24T01:44:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b4150c50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 --2- 172.21.15.148:0/814142845 >> v2:172.21.15.150:3300/0 conn(0x7f45b4150870 0x7f45b40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 --2- 172.21.15.148:0/814142845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 -- 172.21.15.148:0/814142845 >> 172.21.15.148:0/814142845 conn(0x7f45b40c3670 msgr2=0x7f45b40c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:16.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 -- 172.21.15.148:0/814142845 shutdown_connections 2023-10-24T01:44:16.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.068+0000 7f45bc73d700 1 -- 172.21.15.148:0/814142845 wait complete. 2023-10-24T01:44:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.069+0000 7f45bc73d700 1 Processor -- start 2023-10-24T01:44:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.069+0000 7f45bc73d700 1 -- start start 2023-10-24T01:44:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45b4150870 0x7f45b40bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4152170 con 0x7f45b4154730 2023-10-24T01:44:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4152300 con 0x7f45b4150870 2023-10-24T01:44:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bc73d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40bf620 con 0x7f45b40c2090 2023-10-24T01:44:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bacda700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bacda700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58760/0 (socket says 172.21.15.148:58760) 2023-10-24T01:44:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45bacda700 1 -- 172.21.15.148:0/1999263008 learned_addr learned my addr 172.21.15.148:0/1999263008 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45ba4d9700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.070+0000 7f45b9cd8700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45b4150870 0x7f45b40bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 -- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 msgr2=0x7f45b4149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 -- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45b4150870 msgr2=0x7f45b40bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45b4150870 0x7f45b40bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 -- 172.21.15.148:0/1999263008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009ae0 con 0x7f45b4154730 2023-10-24T01:44:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bacda700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f45ac00b610 tx=0x7f45ac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00bee0 con 0x7f45b4154730 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac013e60 con 0x7f45b4154730 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac007860 con 0x7f45b4154730 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b40bf900 con 0x7f45b4154730 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.071+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b40bfec0 con 0x7f45b4154730 2023-10-24T01:44:16.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.072+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4152470 con 0x7f45b4154730 2023-10-24T01:44:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.072+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f45ac003040 con 0x7f45b4154730 2023-10-24T01:44:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.073+0000 7f45aa7fc700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 0x7f4598061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.073+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6395+0+0 (secure 0 0 0) 0x7f45ac07bc20 con 0x7f45b4154730 2023-10-24T01:44:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.073+0000 7f45ba4d9700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 0x7f4598061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.073+0000 7f45ba4d9700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 0x7f4598061750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f45b0009c30 tx=0x7f45b0009060).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.077+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f45ac04cd10 con 0x7f45b4154730 2023-10-24T01:44:16.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.266+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45b40697a0 con 0x7f459805f290 2023-10-24T01:44:16.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.269+0000 7f45aa7fc700 1 -- 172.21.15.148:0/1999263008 <== mgr.6914 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f45b40697a0 con 0x7f459805f290 2023-10-24T01:44:16.270 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:16.270 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:48:35", "first": "2023-10-24T00:49:00", "last": "2023-10-24T01:44:00", "last_pruned": "2023-10-24T01:44:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-24T01:44:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 msgr2=0x7f4598061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 0x7f4598061750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f45b0009c30 tx=0x7f45b0009060).stop 2023-10-24T01:44:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 msgr2=0x7f45b414b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f45ac00b610 tx=0x7f45ac009840).stop 2023-10-24T01:44:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 shutdown_connections 2023-10-24T01:44:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f459805f290 0x7f4598061750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45b4154730 0x7f45b414b3a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45b40c2090 0x7f45b4149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 --2- 172.21.15.148:0/1999263008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45b4150870 0x7f45b40bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 >> 172.21.15.148:0/1999263008 conn(0x7f45b40c3670 msgr2=0x7f45b4062970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 shutdown_connections 2023-10-24T01:44:16.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.271+0000 7f45bc73d700 1 -- 172.21.15.148:0/1999263008 wait complete. 2023-10-24T01:44:16.283 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T00:48:35", "first": "2023-10-24T00:49:00", "last": "2023-10-24T01:44:00", "last_pruned": "2023-10-24T01:44:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-24T01:44:16.284 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T00:48:35', 'first': '2023-10-24T00:49:00', 'last': '2023-10-24T01:44:00', 'last_pruned': '2023-10-24T01:44:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-10-24T01:44:16.284 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-10-24T01:44:16.284 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-10-24T01:44:16.285 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-10-24T01:44:16.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.401+0000 7facde4b7700 1 Processor -- start 2023-10-24T01:44:16.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.401+0000 7facde4b7700 1 -- start start 2023-10-24T01:44:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facde4b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd80a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facde4b7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 0x7facd80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facde4b7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80c6270 con 0x7facd81544b0 2023-10-24T01:44:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facde4b7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd80c60e0 con 0x7facd80aa420 2023-10-24T01:44:16.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facde4b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd80aa890 con 0x7facd80a7d00 2023-10-24T01:44:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facd7fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7facd81544b0 0x7facd80c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50678/0 (socket says 172.21.15.148:50678) 2023-10-24T01:44:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facd7fff700 1 -- 172.21.15.148:0/1303616043 learned_addr learned my addr 172.21.15.148:0/1303616043 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facd77fe700 1 --2- 172.21.15.148:0/1303616043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd80a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.402+0000 7facdca54700 1 --2- 172.21.15.148:0/1303616043 >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 0x7facd80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd6ffd700 1 -- 172.21.15.148:0/1303616043 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831515904 0 0) 0x7facd80c6270 con 0x7facd81544b0 2023-10-24T01:44:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd6ffd700 1 -- 172.21.15.148:0/1303616043 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc00033f0 con 0x7facd81544b0 2023-10-24T01:44:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd77fe700 1 -- 172.21.15.148:0/1303616043 >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 msgr2=0x7facd80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd77fe700 1 --2- 172.21.15.148:0/1303616043 >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 0x7facd80c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd77fe700 1 -- 172.21.15.148:0/1303616043 >> v1:172.21.15.148:6789/0 conn(0x7facd81544b0 legacy=0x7facd80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd77fe700 1 -- 172.21.15.148:0/1303616043 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80c0c80 con 0x7facd80a7d00 2023-10-24T01:44:16.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facdca54700 1 --2- 172.21.15.148:0/1303616043 >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 0x7facd80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:16.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd77fe700 1 --2- 172.21.15.148:0/1303616043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd80a9f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7faccc009760 tx=0x7faccc009060).ready entity=mon.2 client_cookie=d394fa43e5248d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd6ffd700 1 -- 172.21.15.148:0/1303616043 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00d4a0 con 0x7facd80a7d00 2023-10-24T01:44:16.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd6ffd700 1 -- 172.21.15.148:0/1303616043 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00d600 con 0x7facd80a7d00 2023-10-24T01:44:16.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facd6ffd700 1 -- 172.21.15.148:0/1303616043 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00d980 con 0x7facd80a7d00 2023-10-24T01:44:16.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 -- 172.21.15.148:0/1303616043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 msgr2=0x7facd80a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 --2- 172.21.15.148:0/1303616043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd80a9f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7faccc009760 tx=0x7faccc009060).stop 2023-10-24T01:44:16.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 -- 172.21.15.148:0/1303616043 shutdown_connections 2023-10-24T01:44:16.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 --2- 172.21.15.148:0/1303616043 >> v2:172.21.15.150:3300/0 conn(0x7facd80aa420 0x7facd80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 --2- 172.21.15.148:0/1303616043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd80a9f30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.403+0000 7facde4b7700 1 -- 172.21.15.148:0/1303616043 >> 172.21.15.148:0/1303616043 conn(0x7facd80945d0 msgr2=0x7facd806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:16.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.404+0000 7facde4b7700 1 -- 172.21.15.148:0/1303616043 shutdown_connections 2023-10-24T01:44:16.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.404+0000 7facde4b7700 1 -- 172.21.15.148:0/1303616043 wait complete. 2023-10-24T01:44:16.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.405+0000 7facde4b7700 1 Processor -- start 2023-10-24T01:44:16.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.405+0000 7facde4b7700 1 -- start start 2023-10-24T01:44:16.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.405+0000 7facde4b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd8165b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facd80aa420 0x7facd80ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd80c2070 con 0x7facd81544b0 2023-10-24T01:44:16.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd80c2bf0 con 0x7facd80aa420 2023-10-24T01:44:16.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd80c22c0 con 0x7facd80a7d00 2023-10-24T01:44:16.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58768/0 (socket says 172.21.15.148:58768) 2023-10-24T01:44:16.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 -- 172.21.15.148:0/894539210 learned_addr learned my addr 172.21.15.148:0/894539210 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:16.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facd7fff700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd8165b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facd77fe700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facd80aa420 0x7facd80ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 -- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 msgr2=0x7facd8165b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd8165b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 -- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facd80aa420 msgr2=0x7facd80ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facd80aa420 0x7facd80ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 -- 172.21.15.148:0/894539210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0009a20 con 0x7facd81544b0 2023-10-24T01:44:16.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facdca54700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7facd000c0f0 tx=0x7facd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000cce0 con 0x7facd81544b0 2023-10-24T01:44:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000f040 con 0x7facd81544b0 2023-10-24T01:44:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0092a0 con 0x7facd81544b0 2023-10-24T01:44:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0013610 con 0x7facd81544b0 2023-10-24T01:44:16.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.406+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd80c2880 con 0x7facd81544b0 2023-10-24T01:44:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.407+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd806c6b0 con 0x7facd81544b0 2023-10-24T01:44:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.408+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7facd0013a00 con 0x7facd81544b0 2023-10-24T01:44:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.408+0000 7facbffff700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 0x7facc4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.408+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6395+0+0 (secure 0 0 0) 0x7facd007aed0 con 0x7facd81544b0 2023-10-24T01:44:16.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.408+0000 7facd7fff700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 0x7facc4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:16.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.408+0000 7facd7fff700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 0x7facc4061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7facc8007fd0 tx=0x7facc8009040).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:16.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.412+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7facd004bf10 con 0x7facd81544b0 2023-10-24T01:44:16.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.600+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7facd80c0f40 con 0x7facc405f2c0 2023-10-24T01:44:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.604+0000 7facbffff700 1 -- 172.21.15.148:0/894539210 <== mgr.6914 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7facd80c0f40 con 0x7facc405f2c0 2023-10-24T01:44:16.605 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1 2023-10-24T01:44:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 msgr2=0x7facc4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 0x7facc4061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7facc8007fd0 tx=0x7facc8009040).stop 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 msgr2=0x7facd80acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7facd000c0f0 tx=0x7facd000b040).stop 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 shutdown_connections 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7facc405f2c0 0x7facc4061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facd81544b0 0x7facd80acb50 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7facd80a7d00 0x7facd8165b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 --2- 172.21.15.148:0/894539210 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facd80aa420 0x7facd80ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 >> 172.21.15.148:0/894539210 conn(0x7facd80945d0 msgr2=0x7facd80a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 shutdown_connections 2023-10-24T01:44:16.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:16.606+0000 7facde4b7700 1 -- 172.21.15.148:0/894539210 wait complete. 2023-10-24T01:44:16.619 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-10-24T01:44:16.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.620 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T01:44:16.637 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_50_00_UTC 2023-10-24T01:44:16.637 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_51_00_UTC 2023-10-24T01:44:16.637 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_52_00_UTC 2023-10-24T01:44:16.637 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_53_00_UTC 2023-10-24T01:44:16.637 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_54_00_UTC 2023-10-24T01:44:16.638 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_55_00_UTC 2023-10-24T01:44:16.638 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_56_00_UTC 2023-10-24T01:44:16.638 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_57_00_UTC 2023-10-24T01:44:16.638 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_58_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-00_59_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_00_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_01_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_02_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_03_00_UTC 2023-10-24T01:44:16.639 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_04_00_UTC 2023-10-24T01:44:16.640 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_05_00_UTC 2023-10-24T01:44:16.640 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_06_00_UTC 2023-10-24T01:44:16.640 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_07_00_UTC 2023-10-24T01:44:16.640 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_08_00_UTC 2023-10-24T01:44:16.640 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_09_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_10_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_11_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_12_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_13_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_14_00_UTC 2023-10-24T01:44:16.641 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_15_00_UTC 2023-10-24T01:44:16.642 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_16_00_UTC 2023-10-24T01:44:16.642 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_17_00_UTC 2023-10-24T01:44:16.642 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_18_00_UTC 2023-10-24T01:44:16.642 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_19_00_UTC 2023-10-24T01:44:16.642 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_20_00_UTC 2023-10-24T01:44:16.643 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_21_00_UTC 2023-10-24T01:44:16.643 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_22_00_UTC 2023-10-24T01:44:16.643 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_23_00_UTC 2023-10-24T01:44:16.643 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_24_00_UTC 2023-10-24T01:44:16.643 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_25_00_UTC 2023-10-24T01:44:16.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_26_00_UTC 2023-10-24T01:44:16.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_27_00_UTC 2023-10-24T01:44:16.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_28_00_UTC 2023-10-24T01:44:16.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_29_00_UTC 2023-10-24T01:44:16.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_30_00_UTC 2023-10-24T01:44:16.645 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_31_00_UTC 2023-10-24T01:44:16.645 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_32_00_UTC 2023-10-24T01:44:16.645 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_33_00_UTC 2023-10-24T01:44:16.645 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_34_00_UTC 2023-10-24T01:44:16.645 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_35_00_UTC 2023-10-24T01:44:16.646 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_36_00_UTC 2023-10-24T01:44:16.646 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_37_00_UTC 2023-10-24T01:44:16.646 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_38_00_UTC 2023-10-24T01:44:16.646 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_39_00_UTC 2023-10-24T01:44:16.646 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_40_00_UTC 2023-10-24T01:44:16.647 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_41_00_UTC 2023-10-24T01:44:16.647 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_42_00_UTC 2023-10-24T01:44:16.647 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_43_00_UTC 2023-10-24T01:44:16.647 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_44_00_UTC 2023-10-24T01:44:16.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_50_00_UTC 2023-10-24T01:44:16.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.648 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_50_00_UTC) 2023-10-24T01:44:16.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_51_00_UTC 2023-10-24T01:44:16.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.698 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_51_00_UTC) 2023-10-24T01:44:16.758 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_52_00_UTC 2023-10-24T01:44:16.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.759 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_52_00_UTC) 2023-10-24T01:44:16.817 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_53_00_UTC 2023-10-24T01:44:16.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.818 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_53_00_UTC) 2023-10-24T01:44:16.878 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_54_00_UTC 2023-10-24T01:44:16.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.879 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_54_00_UTC) 2023-10-24T01:44:16.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_55_00_UTC 2023-10-24T01:44:16.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:16.946 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_55_00_UTC) 2023-10-24T01:44:17.011 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_56_00_UTC 2023-10-24T01:44:17.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.011 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_56_00_UTC) 2023-10-24T01:44:17.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_57_00_UTC 2023-10-24T01:44:17.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.071 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_57_00_UTC) 2023-10-24T01:44:17.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_58_00_UTC 2023-10-24T01:44:17.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.131 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_58_00_UTC) 2023-10-24T01:44:17.192 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-00_59_00_UTC 2023-10-24T01:44:17.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.193 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-00_59_00_UTC) 2023-10-24T01:44:17.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_00_00_UTC 2023-10-24T01:44:17.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.257 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_00_00_UTC) 2023-10-24T01:44:17.317 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_01_00_UTC 2023-10-24T01:44:17.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.318 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_01_00_UTC) 2023-10-24T01:44:17.377 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_02_00_UTC 2023-10-24T01:44:17.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.378 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_02_00_UTC) 2023-10-24T01:44:17.437 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_03_00_UTC 2023-10-24T01:44:17.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.438 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_03_00_UTC) 2023-10-24T01:44:17.497 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_04_00_UTC 2023-10-24T01:44:17.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.498 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_04_00_UTC) 2023-10-24T01:44:17.559 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_05_00_UTC 2023-10-24T01:44:17.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.560 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_05_00_UTC) 2023-10-24T01:44:17.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_06_00_UTC 2023-10-24T01:44:17.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.620 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_06_00_UTC) 2023-10-24T01:44:17.682 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_07_00_UTC 2023-10-24T01:44:17.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.683 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_07_00_UTC) 2023-10-24T01:44:17.742 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_08_00_UTC 2023-10-24T01:44:17.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.743 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_08_00_UTC) 2023-10-24T01:44:17.805 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_09_00_UTC 2023-10-24T01:44:17.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.806 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_09_00_UTC) 2023-10-24T01:44:17.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_10_00_UTC 2023-10-24T01:44:17.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.869 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_10_00_UTC) 2023-10-24T01:44:17.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_11_00_UTC 2023-10-24T01:44:17.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.930 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_11_00_UTC) 2023-10-24T01:44:17.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_12_00_UTC 2023-10-24T01:44:17.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:17.990 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_12_00_UTC) 2023-10-24T01:44:18.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_13_00_UTC 2023-10-24T01:44:18.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.050 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_13_00_UTC) 2023-10-24T01:44:18.109 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_14_00_UTC 2023-10-24T01:44:18.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.110 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_14_00_UTC) 2023-10-24T01:44:18.171 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_15_00_UTC 2023-10-24T01:44:18.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.172 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_15_00_UTC) 2023-10-24T01:44:18.231 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_16_00_UTC 2023-10-24T01:44:18.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.232 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_16_00_UTC) 2023-10-24T01:44:18.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_17_00_UTC 2023-10-24T01:44:18.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.292 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_17_00_UTC) 2023-10-24T01:44:18.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_18_00_UTC 2023-10-24T01:44:18.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.352 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_18_00_UTC) 2023-10-24T01:44:18.413 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_19_00_UTC 2023-10-24T01:44:18.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.414 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_19_00_UTC) 2023-10-24T01:44:18.474 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_20_00_UTC 2023-10-24T01:44:18.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.475 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_20_00_UTC) 2023-10-24T01:44:18.536 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_21_00_UTC 2023-10-24T01:44:18.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.537 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_21_00_UTC) 2023-10-24T01:44:18.597 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_22_00_UTC 2023-10-24T01:44:18.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.598 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_22_00_UTC) 2023-10-24T01:44:18.658 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_23_00_UTC 2023-10-24T01:44:18.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.659 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_23_00_UTC) 2023-10-24T01:44:18.717 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_24_00_UTC 2023-10-24T01:44:18.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.718 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_24_00_UTC) 2023-10-24T01:44:18.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_25_00_UTC 2023-10-24T01:44:18.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.780 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_25_00_UTC) 2023-10-24T01:44:18.838 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_26_00_UTC 2023-10-24T01:44:18.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.839 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_26_00_UTC) 2023-10-24T01:44:18.898 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_27_00_UTC 2023-10-24T01:44:18.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.899 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_27_00_UTC) 2023-10-24T01:44:18.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_28_00_UTC 2023-10-24T01:44:18.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:18.962 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_28_00_UTC) 2023-10-24T01:44:19.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_29_00_UTC 2023-10-24T01:44:19.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.023 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_29_00_UTC) 2023-10-24T01:44:19.083 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_30_00_UTC 2023-10-24T01:44:19.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.084 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_30_00_UTC) 2023-10-24T01:44:19.169 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_31_00_UTC 2023-10-24T01:44:19.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.170 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_31_00_UTC) 2023-10-24T01:44:19.209 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_32_00_UTC 2023-10-24T01:44:19.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.210 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_32_00_UTC) 2023-10-24T01:44:19.293 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_33_00_UTC 2023-10-24T01:44:19.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.294 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_33_00_UTC) 2023-10-24T01:44:19.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_34_00_UTC 2023-10-24T01:44:19.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.354 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_34_00_UTC) 2023-10-24T01:44:19.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_35_00_UTC 2023-10-24T01:44:19.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.413 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_35_00_UTC) 2023-10-24T01:44:19.486 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_36_00_UTC 2023-10-24T01:44:19.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.487 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_36_00_UTC) 2023-10-24T01:44:19.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_37_00_UTC 2023-10-24T01:44:19.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.547 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_37_00_UTC) 2023-10-24T01:44:19.616 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_38_00_UTC 2023-10-24T01:44:19.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.617 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_38_00_UTC) 2023-10-24T01:44:19.675 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_39_00_UTC 2023-10-24T01:44:19.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.676 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_39_00_UTC) 2023-10-24T01:44:19.736 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_40_00_UTC 2023-10-24T01:44:19.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.737 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_40_00_UTC) 2023-10-24T01:44:19.795 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_41_00_UTC 2023-10-24T01:44:19.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.796 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_41_00_UTC) 2023-10-24T01:44:19.855 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_42_00_UTC 2023-10-24T01:44:19.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.856 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_42_00_UTC) 2023-10-24T01:44:19.915 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_43_00_UTC 2023-10-24T01:44:19.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.916 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_43_00_UTC) 2023-10-24T01:44:19.975 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-01_44_00_UTC 2023-10-24T01:44:19.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:19.976 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-01_44_00_UTC) 2023-10-24T01:44:20.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:20.036 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T01:44:20.094 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T01:44:20.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.250+0000 7f920999e700 1 Processor -- start 2023-10-24T01:44:20.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.250+0000 7f920999e700 1 -- start start 2023-10-24T01:44:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f920999e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9204064b30 0x7f9204064f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f920999e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9204069de0 con 0x7f9204068af0 2023-10-24T01:44:20.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f920999e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9204068f80 con 0x7f920406a270 2023-10-24T01:44:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f920999e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92040691d0 con 0x7f9204064b30 2023-10-24T01:44:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f9202ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9204064b30 0x7f9204064f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.251+0000 7f92037fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9204068af0 0x7f9204150080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50690/0 (socket says 172.21.15.148:50690) 2023-10-24T01:44:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f92037fe700 1 -- 172.21.15.148:0/1497605290 learned_addr learned my addr 172.21.15.148:0/1497605290 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:20.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f9202ffd700 1 -- 172.21.15.148:0/1497605290 >> v1:172.21.15.150:6789/0 conn(0x7f920406a270 legacy=0x7f9204154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f9202ffd700 1 -- 172.21.15.148:0/1497605290 >> v1:172.21.15.148:6789/0 conn(0x7f9204068af0 legacy=0x7f9204150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f9202ffd700 1 -- 172.21.15.148:0/1497605290 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040694b0 con 0x7f9204064b30 2023-10-24T01:44:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f92027fc700 1 -- 172.21.15.148:0/1497605290 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947109464 0 0) 0x7f9204069de0 con 0x7f9204068af0 2023-10-24T01:44:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f9202ffd700 1 --2- 172.21.15.148:0/1497605290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204064b30 0x7f9204064f10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f91f400ba00 tx=0x7f91f400b300).ready entity=mon.0 client_cookie=76340f854eff8e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:20.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f92027fc700 1 -- 172.21.15.148:0/1497605290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400da30 con 0x7f9204064b30 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f92027fc700 1 -- 172.21.15.148:0/1497605290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400db90 con 0x7f9204064b30 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f92027fc700 1 -- 172.21.15.148:0/1497605290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4010470 con 0x7f9204064b30 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.252+0000 7f920999e700 1 -- 172.21.15.148:0/1497605290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204064b30 msgr2=0x7f9204064f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 --2- 172.21.15.148:0/1497605290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204064b30 0x7f9204064f10 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f91f400ba00 tx=0x7f91f400b300).stop 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 -- 172.21.15.148:0/1497605290 shutdown_connections 2023-10-24T01:44:20.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 --2- 172.21.15.148:0/1497605290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204064b30 0x7f9204064f10 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 -- 172.21.15.148:0/1497605290 >> 172.21.15.148:0/1497605290 conn(0x7f92040c6bf0 msgr2=0x7f92040c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 -- 172.21.15.148:0/1497605290 shutdown_connections 2023-10-24T01:44:20.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.253+0000 7f920999e700 1 -- 172.21.15.148:0/1497605290 wait complete. 2023-10-24T01:44:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.254+0000 7f920999e700 1 Processor -- start 2023-10-24T01:44:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.254+0000 7f920999e700 1 -- start start 2023-10-24T01:44:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204064b30 0x7f9204144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:20.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92040be570 0x7f9204149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920414a110 con 0x7f9204068af0 2023-10-24T01:44:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92041635a0 con 0x7f9204064b30 2023-10-24T01:44:20.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9204163810 con 0x7f92040be570 2023-10-24T01:44:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58798/0 (socket says 172.21.15.148:58798) 2023-10-24T01:44:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f9202ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204064b30 0x7f9204144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 -- 172.21.15.148:0/724467225 learned_addr learned my addr 172.21.15.148:0/724467225 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:20.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f92037fe700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92040be570 0x7f9204149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 -- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92040be570 msgr2=0x7f9204149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92040be570 0x7f9204149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 -- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204064b30 msgr2=0x7f9204144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204064b30 0x7f9204144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:20.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 -- 172.21.15.148:0/724467225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f400b540 con 0x7f9204068af0 2023-10-24T01:44:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fa7fc700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f91ec00b490 tx=0x7f91ec006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec012410 con 0x7f9204068af0 2023-10-24T01:44:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec012590 con 0x7f9204068af0 2023-10-24T01:44:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9204163af0 con 0x7f9204068af0 2023-10-24T01:44:20.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec012950 con 0x7f9204068af0 2023-10-24T01:44:20.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.255+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92041449f0 con 0x7f9204068af0 2023-10-24T01:44:20.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.256+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9204164100 con 0x7f9204068af0 2023-10-24T01:44:20.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.257+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 63) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f91ec012d00 con 0x7f9204068af0 2023-10-24T01:44:20.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.257+0000 7f91fb7fe700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 0x7f91e4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:20.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.257+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f91ec07a1c0 con 0x7f9204068af0 2023-10-24T01:44:20.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.257+0000 7f9202ffd700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 0x7f91e4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:20.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.258+0000 7f9202ffd700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 0x7f91e4061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f91f4006d30 tx=0x7f91f400b300).ready entity=mgr.6914 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:20.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.261+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f91ec04b1d0 con 0x7f9204068af0 2023-10-24T01:44:20.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:20.479+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f920406c6b0 con 0x7f9204068af0 2023-10-24T01:44:21.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.144+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f91ec077cd0 con 0x7f9204068af0 2023-10-24T01:44:21.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.145+0000 7f91fb7fe700 1 -- 172.21.15.148:0/724467225 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v64) v1 ==== 93+0+0 (secure 0 0 0) 0x7f91ec0723e0 con 0x7f9204068af0 2023-10-24T01:44:21.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.149+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 msgr2=0x7f91e4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.149+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 0x7f91e4061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f91f4006d30 tx=0x7f91f400b300).stop 2023-10-24T01:44:21.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.149+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 msgr2=0x7f9204149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.149+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f91ec00b490 tx=0x7f91ec006f20).stop 2023-10-24T01:44:21.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 shutdown_connections 2023-10-24T01:44:21.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92040be570 0x7f9204149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9204064b30 0x7f9204144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f91e405f2c0 0x7f91e4061780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 --2- 172.21.15.148:0/724467225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9204068af0 0x7f9204149730 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 >> 172.21.15.148:0/724467225 conn(0x7f92040c6bf0 msgr2=0x7f92040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:21.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.151+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 shutdown_connections 2023-10-24T01:44:21.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.152+0000 7f920999e700 1 -- 172.21.15.148:0/724467225 wait complete. 2023-10-24T01:44:21.173 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T01:44:21.174 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:21.216 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:21.257 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T01:44:21.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T01:44:21.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:21.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T01:44:21.310 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:21.309+0000 7f47a884e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:21.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T01:44:21.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:21.312 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T01:44:21.313 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:21.311+0000 7f8f1b8ff680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:21.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:21.379 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:21.379+0000 7f47a884e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:21.381 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:21.380+0000 7f8f1b8ff680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:21.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.494+0000 7fd83690d700 1 Processor -- start 2023-10-24T01:44:21.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.494+0000 7fd83690d700 1 -- start start 2023-10-24T01:44:21.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8301543a0 0x7fd8300a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8300a84b0 0x7fd830095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8300bfa50 0x7fd8300962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8300967c0 con 0x7fd8300a84b0 2023-10-24T01:44:21.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8300bf5c0 con 0x7fd8300bfa50 2023-10-24T01:44:21.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd83690d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300be9b0 con 0x7fd8301543a0 2023-10-24T01:44:21.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd82f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8300a84b0 0x7fd830095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd82f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8300a84b0 0x7fd830095de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58804/0 (socket says 172.21.15.148:58804) 2023-10-24T01:44:21.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.495+0000 7fd82f7fe700 1 -- 172.21.15.148:0/497109430 learned_addr learned my addr 172.21.15.148:0/497109430 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:21.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd834eaa700 1 --2- 172.21.15.148:0/497109430 >> v2:172.21.15.150:3300/0 conn(0x7fd8300bfa50 0x7fd8300962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82ffff700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8301543a0 0x7fd8300a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 -- 172.21.15.148:0/497109430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8301543a0 msgr2=0x7fd8300a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:21.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8301543a0 0x7fd8300a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 -- 172.21.15.148:0/497109430 >> v2:172.21.15.150:3300/0 conn(0x7fd8300bfa50 msgr2=0x7fd8300962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:21.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/497109430 >> v2:172.21.15.150:3300/0 conn(0x7fd8300bfa50 0x7fd8300962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 -- 172.21.15.148:0/497109430 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300bec90 con 0x7fd8300a84b0 2023-10-24T01:44:21.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300a84b0 0x7fd830095de0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd8300c3cd0 tx=0x7fd8200090f0).ready entity=mon.0 client_cookie=db0e7544b833a622 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:21.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82effd700 1 -- 172.21.15.148:0/497109430 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000f510 con 0x7fd8300a84b0 2023-10-24T01:44:21.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82effd700 1 -- 172.21.15.148:0/497109430 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000f670 con 0x7fd8300a84b0 2023-10-24T01:44:21.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.496+0000 7fd82effd700 1 -- 172.21.15.148:0/497109430 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000f9f0 con 0x7fd8300a84b0 2023-10-24T01:44:21.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 -- 172.21.15.148:0/497109430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300a84b0 msgr2=0x7fd830095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300a84b0 0x7fd830095de0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd8300c3cd0 tx=0x7fd8200090f0).stop 2023-10-24T01:44:21.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 -- 172.21.15.148:0/497109430 shutdown_connections 2023-10-24T01:44:21.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 --2- 172.21.15.148:0/497109430 >> v2:172.21.15.150:3300/0 conn(0x7fd8300bfa50 0x7fd8300962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8301543a0 0x7fd8300a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 --2- 172.21.15.148:0/497109430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300a84b0 0x7fd830095de0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 -- 172.21.15.148:0/497109430 >> 172.21.15.148:0/497109430 conn(0x7fd8300630f0 msgr2=0x7fd8300c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 -- 172.21.15.148:0/497109430 shutdown_connections 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.497+0000 7fd83690d700 1 -- 172.21.15.148:0/497109430 wait complete. 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.498+0000 7fd83690d700 1 Processor -- start 2023-10-24T01:44:21.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.498+0000 7fd83690d700 1 -- start start 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8300a84b0 0x7fd830153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8301543a0 0x7fd830150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c7770 con 0x7fd8300bfa50 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8301686d0 con 0x7fd8301543a0 2023-10-24T01:44:21.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300a9c60 con 0x7fd8300a84b0 2023-10-24T01:44:21.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58810/0 (socket says 172.21.15.148:58810) 2023-10-24T01:44:21.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 -- 172.21.15.148:0/3242976635 learned_addr learned my addr 172.21.15.148:0/3242976635 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:21.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd834eaa700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8301543a0 0x7fd830150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82ffff700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8300a84b0 0x7fd830153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8300a84b0 msgr2=0x7fd830153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8300a84b0 0x7fd830153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8301543a0 msgr2=0x7fd830150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8301543a0 0x7fd830150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 -- 172.21.15.148:0/3242976635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009370 con 0x7fd8300bfa50 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd82f7fe700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fd820011000 tx=0x7fd820017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000f7e0 con 0x7fd8300bfa50 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000f940 con 0x7fd8300bfa50 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd830168970 con 0x7fd8300bfa50 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.499+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82001c670 con 0x7fd8300bfa50 2023-10-24T01:44:21.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.500+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd830168f30 con 0x7fd8300bfa50 2023-10-24T01:44:21.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.500+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830169150 con 0x7fd8300bfa50 2023-10-24T01:44:21.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.501+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd82001ca60 con 0x7fd8300bfa50 2023-10-24T01:44:21.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.501+0000 7fd817fff700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 0x7fd81c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.501+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fd82007ba70 con 0x7fd8300bfa50 2023-10-24T01:44:21.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.501+0000 7fd82ffff700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 msgr2=0x7fd81c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:21.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.501+0000 7fd82ffff700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 0x7fd81c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:21.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.505+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd82004ca80 con 0x7fd8300bfa50 2023-10-24T01:44:21.678 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:21.677+0000 7f47a884e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:21.690 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:21.690+0000 7f8f1b8ff680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:21.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.702+0000 7fd82ffff700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 msgr2=0x7fd81c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:21.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.702+0000 7fd82ffff700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 0x7fd81c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:21.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.733+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd83006c6b0 con 0x7fd8300bfa50 2023-10-24T01:44:21.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.734+0000 7fd817fff700 1 -- 172.21.15.148:0/3242976635 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fd820020020 con 0x7fd8300bfa50 2023-10-24T01:44:21.736 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:21.736 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T01:44:21.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 msgr2=0x7fd81c061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 0x7fd81c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 msgr2=0x7fd8300c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fd820011000 tx=0x7fd820017000).stop 2023-10-24T01:44:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 shutdown_connections 2023-10-24T01:44:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8301543a0 0x7fd830150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8300a84b0 0x7fd830153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd81c05f240 0x7fd81c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:21.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 --2- 172.21.15.148:0/3242976635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8300bfa50 0x7fd8300c6d10 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.736+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 >> 172.21.15.148:0/3242976635 conn(0x7fd8300630f0 msgr2=0x7fd830063760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.737+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 shutdown_connections 2023-10-24T01:44:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.737+0000 7fd83690d700 1 -- 172.21.15.148:0/3242976635 wait complete. 2023-10-24T01:44:21.741 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T01:44:21.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:21.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.908+0000 7f7ada0d9700 1 Processor -- start 2023-10-24T01:44:21.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.908+0000 7f7ada0d9700 1 -- start start 2023-10-24T01:44:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ada0d9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ad40bdbf0 0x7f7ad4066830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ada0d9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad406a050 con 0x7f7ad4062d60 2023-10-24T01:44:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ada0d9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad4064e60 con 0x7f7ad413b6f0 2023-10-24T01:44:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ada0d9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad4069b40 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ad40bdbf0 0x7f7ad4066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7ad40bdbf0 0x7f7ad4066830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58818/0 (socket says 172.21.15.148:58818) 2023-10-24T01:44:21.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 -- 172.21.15.148:0/3545912536 learned_addr learned my addr 172.21.15.148:0/3545912536 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:21.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad88d6700 1 --1- 172.21.15.148:0/3545912536 >> v1:172.21.15.148:6789/0 conn(0x7f7ad4062d60 0x7f7ad4159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50696/0 (socket says 172.21.15.148:50696) 2023-10-24T01:44:21.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 -- 172.21.15.148:0/3545912536 >> v1:172.21.15.150:6789/0 conn(0x7f7ad413b6f0 legacy=0x7f7ad4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 -- 172.21.15.148:0/3545912536 >> v1:172.21.15.148:6789/0 conn(0x7f7ad4062d60 legacy=0x7f7ad4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 -- 172.21.15.148:0/3545912536 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4069d20 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.909+0000 7f7ad98d8700 1 --2- 172.21.15.148:0/3545912536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad4066830 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f7acc009f20 tx=0x7f7acc009840).ready entity=mon.0 client_cookie=ebb53fa5e1fa1be6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:21.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7acbfff700 1 -- 172.21.15.148:0/3545912536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e070 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7acbfff700 1 -- 172.21.15.148:0/3545912536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00ba80 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7acbfff700 1 -- 172.21.15.148:0/3545912536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00be00 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 -- 172.21.15.148:0/3545912536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 msgr2=0x7f7ad4066830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/3545912536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad4066830 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f7acc009f20 tx=0x7f7acc009840).stop 2023-10-24T01:44:21.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 -- 172.21.15.148:0/3545912536 shutdown_connections 2023-10-24T01:44:21.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/3545912536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad4066830 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 -- 172.21.15.148:0/3545912536 >> 172.21.15.148:0/3545912536 conn(0x7f7ad40c7ad0 msgr2=0x7f7ad40c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:21.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 -- 172.21.15.148:0/3545912536 shutdown_connections 2023-10-24T01:44:21.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.910+0000 7f7ada0d9700 1 -- 172.21.15.148:0/3545912536 wait complete. 2023-10-24T01:44:21.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.912+0000 7f7ada0d9700 1 Processor -- start 2023-10-24T01:44:21.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.912+0000 7f7ada0d9700 1 -- start start 2023-10-24T01:44:21.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ad4062d60 0x7f7ad4137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ad413b6f0 0x7f7ad40c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c4e30 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c2d70 con 0x7f7ad4062d60 2023-10-24T01:44:21.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c2760 con 0x7f7ad413b6f0 2023-10-24T01:44:21.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58830/0 (socket says 172.21.15.148:58830) 2023-10-24T01:44:21.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad90d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ad4062d60 0x7f7ad4137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 -- 172.21.15.148:0/4114168636 learned_addr learned my addr 172.21.15.148:0/4114168636 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:21.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad98d8700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ad413b6f0 0x7f7ad40c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:21.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ad413b6f0 msgr2=0x7f7ad40c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ad413b6f0 0x7f7ad40c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ad4062d60 msgr2=0x7f7ad4137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:21.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ad4062d60 0x7f7ad4137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:21.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 -- 172.21.15.148:0/4114168636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009ae0 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ad88d6700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f7ac400c4c0 tx=0x7f7ac4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:21.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400ce10 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40072e0 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.913+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad40a5d60 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.914+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40056e0 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.914+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad40a6040 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.914+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad4063420 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.915+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f7ac4005b10 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.915+0000 7f7ac97fa700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 0x7f7ab8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:21.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.915+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f7ac4079a20 con 0x7f7ad40bdbf0 2023-10-24T01:44:21.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.915+0000 7f7ad90d7700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 msgr2=0x7f7ab8061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:21.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.915+0000 7f7ad90d7700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 0x7f7ab8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:21.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:21.919+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ac404aa30 con 0x7f7ad40bdbf0 2023-10-24T01:44:22.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.114+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ad4047480 con 0x7f7ad40bdbf0 2023-10-24T01:44:22.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.115+0000 7f7ac97fa700 1 -- 172.21.15.148:0/4114168636 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+17501 (secure 0 0 0) 0x7f7ac4018030 con 0x7f7ad40bdbf0 2023-10-24T01:44:22.116 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:22.117 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":151,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:21.608144+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":150,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.36","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/968071362":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6833/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6832/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:0/3525147224":"2023-10-25T00:48:34.144037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":18},{"begin":95,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":18,"snaps":[{"begin":3,"length":36},{"begin":59,"length":36}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:22.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.116+0000 7f7ad90d7700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 msgr2=0x7f7ab8061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:22.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.116+0000 7f7ad90d7700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 0x7f7ab8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:22.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 msgr2=0x7f7ab8061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:22.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 0x7f7ab8061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 msgr2=0x7f7ad40c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f7ac400c4c0 tx=0x7f7ac4007dc0).stop 2023-10-24T01:44:22.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 shutdown_connections 2023-10-24T01:44:22.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ad413b6f0 0x7f7ad40c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ad4062d60 0x7f7ad4137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7ab805f240 0x7f7ab8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 --2- 172.21.15.148:0/4114168636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40bdbf0 0x7f7ad40c4450 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 >> 172.21.15.148:0/4114168636 conn(0x7f7ad40c7ad0 msgr2=0x7f7ad40c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 shutdown_connections 2023-10-24T01:44:22.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.117+0000 7f7ada0d9700 1 -- 172.21.15.148:0/4114168636 wait complete. 2023-10-24T01:44:22.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T00:48:16.946933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T00:48:17.347755+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 150, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T01:44:22.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T01:44:22.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.252+0000 7f5f4f10e700 1 Processor -- start 2023-10-24T01:44:22.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.252+0000 7f5f4f10e700 1 -- start start 2023-10-24T01:44:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4f10e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f480a6b10 0x7f5f480a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4f10e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f48157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4f10e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480659b0 con 0x7f5f48158470 2023-10-24T01:44:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4f10e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f48158900 con 0x7f5f480a6b10 2023-10-24T01:44:22.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4f10e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48065e40 con 0x7f5f480a4d30 2023-10-24T01:44:22.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4ceaa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f480a6b10 0x7f5f480a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4ceaa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f480a6b10 0x7f5f480a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58832/0 (socket says 172.21.15.148:58832) 2023-10-24T01:44:22.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/1379416439 learned_addr learned my addr 172.21.15.148:0/1379416439 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f4d6ab700 1 --1- 172.21.15.148:0/1379416439 >> v1:172.21.15.148:6789/0 conn(0x7f5f48158470 0x7f5f48154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50710/0 (socket says 172.21.15.148:50710) 2023-10-24T01:44:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.253+0000 7f5f47fff700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f48157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/1379416439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 msgr2=0x7f5f48157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f48157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/1379416439 >> v1:172.21.15.148:6789/0 conn(0x7f5f48158470 legacy=0x7f5f48154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/1379416439 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48064da0 con 0x7f5f480a6b10 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f480a4840 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f5f3c006fd0 tx=0x7f5f3c0090f0).ready entity=mon.0 client_cookie=9f35736cdf86935c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f477fe700 1 -- 172.21.15.148:0/1379416439 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00b580 con 0x7f5f480a6b10 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f477fe700 1 -- 172.21.15.148:0/1379416439 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00b6e0 con 0x7f5f480a6b10 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f477fe700 1 -- 172.21.15.148:0/1379416439 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00ba80 con 0x7f5f480a6b10 2023-10-24T01:44:22.260 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4f10e700 1 -- 172.21.15.148:0/1379416439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 msgr2=0x7f5f480a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.254+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f480a4840 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f5f3c006fd0 tx=0x7f5f3c0090f0).stop 2023-10-24T01:44:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 -- 172.21.15.148:0/1379416439 shutdown_connections 2023-10-24T01:44:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f480a4840 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/1379416439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f48157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 -- 172.21.15.148:0/1379416439 >> 172.21.15.148:0/1379416439 conn(0x7f5f480c3f60 msgr2=0x7f5f480c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 -- 172.21.15.148:0/1379416439 shutdown_connections 2023-10-24T01:44:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.255+0000 7f5f4f10e700 1 -- 172.21.15.148:0/1379416439 wait complete. 2023-10-24T01:44:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.256+0000 7f5f4f10e700 1 Processor -- start 2023-10-24T01:44:22.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.256+0000 7f5f4f10e700 1 -- start start 2023-10-24T01:44:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f481515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f48158470 0x7f5f48063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48165520 con 0x7f5f480a6b10 2023-10-24T01:44:22.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481400a0 con 0x7f5f48158470 2023-10-24T01:44:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480aa840 con 0x7f5f480a4d30 2023-10-24T01:44:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58844/0 (socket says 172.21.15.148:58844) 2023-10-24T01:44:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 -- 172.21.15.148:0/688289460 learned_addr learned my addr 172.21.15.148:0/688289460 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f481515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4d6ab700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f48158470 0x7f5f48063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 msgr2=0x7f5f481515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f481515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f48158470 msgr2=0x7f5f48063810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f48158470 0x7f5f48063810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 -- 172.21.15.148:0/688289460 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009370 con 0x7f5f480a6b10 2023-10-24T01:44:22.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f481515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:22.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f47fff700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f5f3400e900 tx=0x7f5f34009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34012600 con 0x7f5f480a6b10 2023-10-24T01:44:22.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34012760 con 0x7f5f480a6b10 2023-10-24T01:44:22.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f481656b0 con 0x7f5f480a6b10 2023-10-24T01:44:22.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34012ae0 con 0x7f5f480a6b10 2023-10-24T01:44:22.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.257+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f48164f60 con 0x7f5f480a6b10 2023-10-24T01:44:22.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f5f3401b400 con 0x7f5f480a6b10 2023-10-24T01:44:22.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f480aa610 con 0x7f5f480a6b10 2023-10-24T01:44:22.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f44ff9700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 0x7f5f2c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f5f3407a8b0 con 0x7f5f480a6b10 2023-10-24T01:44:22.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 msgr2=0x7f5f2c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:22.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.259+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 0x7f5f2c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:22.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.263+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f480aa610 con 0x7f5f480a6b10 2023-10-24T01:44:22.303 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:22.302+0000 7f47a884e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:22.358 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:22.357+0000 7f8f1b8ff680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:22.374 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:22.374+0000 7f47a884e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:22.432 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:22.431+0000 7f8f1b8ff680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:22.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.460+0000 7f5f4ceaa700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 msgr2=0x7f5f2c061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:22.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.460+0000 7f5f4ceaa700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 0x7f5f2c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:22.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.465+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5f4806c6b0 con 0x7f5f480a6b10 2023-10-24T01:44:22.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.466+0000 7f5f44ff9700 1 -- 172.21.15.148:0/688289460 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v151) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5f34016020 con 0x7f5f480a6b10 2023-10-24T01:44:22.467 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T01:44:22.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 msgr2=0x7f5f2c061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:22.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 0x7f5f2c061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 msgr2=0x7f5f48164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f5f3400e900 tx=0x7f5f34009060).stop 2023-10-24T01:44:22.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 shutdown_connections 2023-10-24T01:44:22.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f48158470 0x7f5f48063810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f480a4d30 0x7f5f481515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5f2c05f240 0x7f5f2c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 --2- 172.21.15.148:0/688289460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f480a6b10 0x7f5f48164480 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 >> 172.21.15.148:0/688289460 conn(0x7f5f480c3f60 msgr2=0x7f5f480c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 shutdown_connections 2023-10-24T01:44:22.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.468+0000 7f5f4f10e700 1 -- 172.21.15.148:0/688289460 wait complete. 2023-10-24T01:44:22.486 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T01:44:22.559 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:22.558+0000 7f47a884e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:44:22.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.606+0000 7f92ceeba700 1 Processor -- start 2023-10-24T01:44:22.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 -- start start 2023-10-24T01:44:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92c8098bd0 0x7f92c8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92c80bffd0 0x7f92c80c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80c71d0 con 0x7f92c8154430 2023-10-24T01:44:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80c6a10 con 0x7f92c8098bd0 2023-10-24T01:44:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.607+0000 7f92ceeba700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80c9410 con 0x7f92c80bffd0 2023-10-24T01:44:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92c8098bd0 0x7f92c8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92c8098bd0 0x7f92c8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58860/0 (socket says 172.21.15.148:58860) 2023-10-24T01:44:22.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 -- 172.21.15.148:0/4197723480 learned_addr learned my addr 172.21.15.148:0/4197723480 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92ccc56700 1 --1- 172.21.15.148:0/4197723480 >> v1:172.21.15.148:6789/0 conn(0x7f92c8154430 0x7f92c80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:50714/0 (socket says 172.21.15.148:50714) 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92cd457700 1 --2- 172.21.15.148:0/4197723480 >> v2:172.21.15.150:3300/0 conn(0x7f92c80bffd0 0x7f92c80c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 -- 172.21.15.148:0/4197723480 >> v2:172.21.15.150:3300/0 conn(0x7f92c80bffd0 msgr2=0x7f92c80c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 --2- 172.21.15.148:0/4197723480 >> v2:172.21.15.150:3300/0 conn(0x7f92c80bffd0 0x7f92c80c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 -- 172.21.15.148:0/4197723480 >> v1:172.21.15.148:6789/0 conn(0x7f92c8154430 legacy=0x7f92c80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c77fe700 1 -- 172.21.15.148:0/4197723480 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024079406 0 0) 0x7f92c80c71d0 con 0x7f92c8154430 2023-10-24T01:44:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 -- 172.21.15.148:0/4197723480 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80c0950 con 0x7f92c8098bd0 2023-10-24T01:44:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c7fff700 1 --2- 172.21.15.148:0/4197723480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c8098bd0 0x7f92c8154810 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f92c80aab20 tx=0x7f92b40090f0).ready entity=mon.0 client_cookie=e0776ba17e9c7991 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c77fe700 1 -- 172.21.15.148:0/4197723480 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400b520 con 0x7f92c8098bd0 2023-10-24T01:44:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c77fe700 1 -- 172.21.15.148:0/4197723480 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400b680 con 0x7f92c8098bd0 2023-10-24T01:44:22.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.608+0000 7f92c77fe700 1 -- 172.21.15.148:0/4197723480 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400ba00 con 0x7f92c8098bd0 2023-10-24T01:44:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 -- 172.21.15.148:0/4197723480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c8098bd0 msgr2=0x7f92c8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 --2- 172.21.15.148:0/4197723480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c8098bd0 0x7f92c8154810 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f92c80aab20 tx=0x7f92b40090f0).stop 2023-10-24T01:44:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 -- 172.21.15.148:0/4197723480 shutdown_connections 2023-10-24T01:44:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 --2- 172.21.15.148:0/4197723480 >> v2:172.21.15.150:3300/0 conn(0x7f92c80bffd0 0x7f92c80c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 --2- 172.21.15.148:0/4197723480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c8098bd0 0x7f92c8154810 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 -- 172.21.15.148:0/4197723480 >> 172.21.15.148:0/4197723480 conn(0x7f92c80cb070 msgr2=0x7f92c80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 -- 172.21.15.148:0/4197723480 shutdown_connections 2023-10-24T01:44:22.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.609+0000 7f92ceeba700 1 -- 172.21.15.148:0/4197723480 wait complete. 2023-10-24T01:44:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.610+0000 7f92ceeba700 1 Processor -- start 2023-10-24T01:44:22.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.610+0000 7f92ceeba700 1 -- start start 2023-10-24T01:44:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92c8098bd0 0x7f92c8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 0x7f92c80ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8155ee0 con 0x7f92c80bffd0 2023-10-24T01:44:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81552f0 con 0x7f92c8154430 2023-10-24T01:44:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ceeba700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81555b0 con 0x7f92c8098bd0 2023-10-24T01:44:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92c7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58864/0 (socket says 172.21.15.148:58864) 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92c7fff700 1 -- 172.21.15.148:0/1283463530 learned_addr learned my addr 172.21.15.148:0/1283463530 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.611+0000 7f92ccc56700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92c8098bd0 0x7f92c8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 -- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92c8098bd0 msgr2=0x7f92c8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92c8098bd0 0x7f92c8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92cd457700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 0x7f92c80ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 -- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 msgr2=0x7f92c80ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 0x7f92c80ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 -- 172.21.15.148:0/1283463530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4009370 con 0x7f92c80bffd0 2023-10-24T01:44:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92c7fff700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f92b4009130 tx=0x7f92b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.612+0000 7f92cd457700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 0x7f92c80ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:22.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.617+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400be90 con 0x7f92c80bffd0 2023-10-24T01:44:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.617+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400b7f0 con 0x7f92c80bffd0 2023-10-24T01:44:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.617+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8155890 con 0x7f92c80bffd0 2023-10-24T01:44:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.617+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c814f560 con 0x7f92c80bffd0 2023-10-24T01:44:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.617+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b401c630 con 0x7f92c80bffd0 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f92b401c9a0 con 0x7f92c80bffd0 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92c4ff9700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 0x7f92ac0617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f92b407bfb0 con 0x7f92c80bffd0 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92ccc56700 1 -- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 msgr2=0x7f92ac0617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92ccc56700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 0x7f92ac0617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.619+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a8005120 con 0x7f92c80bffd0 2023-10-24T01:44:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.627+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f92b402a070 con 0x7f92c80bffd0 2023-10-24T01:44:22.640 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:22.639+0000 7f8f1b8ff680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:44:22.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.803+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92a8005d70 con 0x7f92c80bffd0 2023-10-24T01:44:22.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.803+0000 7f92c4ff9700 1 -- 172.21.15.148:0/1283463530 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92b40550a0 con 0x7f92c80bffd0 2023-10-24T01:44:22.805 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T01:44:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 msgr2=0x7f92ac0617b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 0x7f92ac0617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 msgr2=0x7f92c814f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f92b4009130 tx=0x7f92b4017000).stop 2023-10-24T01:44:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 shutdown_connections 2023-10-24T01:44:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92c8154430 0x7f92c80ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92c8098bd0 0x7f92c8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f92ac05f2f0 0x7f92ac0617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.805+0000 7f92ceeba700 1 --2- 172.21.15.148:0/1283463530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92c80bffd0 0x7f92c814f070 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.806+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 >> 172.21.15.148:0/1283463530 conn(0x7f92c80cb070 msgr2=0x7f92c814fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.806+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 shutdown_connections 2023-10-24T01:44:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.806+0000 7f92ceeba700 1 -- 172.21.15.148:0/1283463530 wait complete. 2023-10-24T01:44:22.819 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T01:44:22.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.941+0000 7f060f59e700 1 Processor -- start 2023-10-24T01:44:22.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.941+0000 7f060f59e700 1 -- start start 2023-10-24T01:44:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060f59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06101541b0 0x7f06100a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0610154590 0x7f06100c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100a4ef0 con 0x7f06100c30b0 2023-10-24T01:44:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060f59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100a72c0 con 0x7f06101541b0 2023-10-24T01:44:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100c3520 con 0x7f0610154590 2023-10-24T01:44:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06101541b0 0x7f06100a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f06101541b0 0x7f06100a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58878/0 (socket says 172.21.15.148:58878) 2023-10-24T01:44:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 -- 172.21.15.148:0/2098611786 learned_addr learned my addr 172.21.15.148:0/2098611786 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060dd9b700 1 --2- 172.21.15.148:0/2098611786 >> v2:172.21.15.150:3300/0 conn(0x7f0610154590 0x7f06100c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 -- 172.21.15.148:0/2098611786 >> v2:172.21.15.150:3300/0 conn(0x7f0610154590 msgr2=0x7f06100c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 --2- 172.21.15.148:0/2098611786 >> v2:172.21.15.150:3300/0 conn(0x7f0610154590 0x7f06100c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 -- 172.21.15.148:0/2098611786 >> v1:172.21.15.150:6789/0 conn(0x7f06100c30b0 legacy=0x7f0610157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.942+0000 7f060e59c700 1 -- 172.21.15.148:0/2098611786 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100a48e0 con 0x7f06101541b0 2023-10-24T01:44:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060e59c700 1 --2- 172.21.15.148:0/2098611786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06101541b0 0x7f06100a6dd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f0610067f90 tx=0x7f06040090f0).ready entity=mon.0 client_cookie=9bae99c3d92a29e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060d59a700 1 -- 172.21.15.148:0/2098611786 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060400b520 con 0x7f06101541b0 2023-10-24T01:44:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060d59a700 1 -- 172.21.15.148:0/2098611786 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060400b680 con 0x7f06101541b0 2023-10-24T01:44:22.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060d59a700 1 -- 172.21.15.148:0/2098611786 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060400ba00 con 0x7f06101541b0 2023-10-24T01:44:22.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 -- 172.21.15.148:0/2098611786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06101541b0 msgr2=0x7f06100a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 --2- 172.21.15.148:0/2098611786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06101541b0 0x7f06100a6dd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f0610067f90 tx=0x7f06040090f0).stop 2023-10-24T01:44:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 -- 172.21.15.148:0/2098611786 shutdown_connections 2023-10-24T01:44:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 --2- 172.21.15.148:0/2098611786 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06101541b0 0x7f06100a6dd0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 --2- 172.21.15.148:0/2098611786 >> v2:172.21.15.150:3300/0 conn(0x7f0610154590 0x7f06100c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 -- 172.21.15.148:0/2098611786 >> 172.21.15.148:0/2098611786 conn(0x7f06100c86e0 msgr2=0x7f06100c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 -- 172.21.15.148:0/2098611786 shutdown_connections 2023-10-24T01:44:22.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.943+0000 7f060f59e700 1 -- 172.21.15.148:0/2098611786 wait complete. 2023-10-24T01:44:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 Processor -- start 2023-10-24T01:44:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 -- start start 2023-10-24T01:44:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06101541b0 0x7f06100acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0610154590 0x7f0610158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100acb40 con 0x7f06100c30b0 2023-10-24T01:44:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100abf70 con 0x7f06101541b0 2023-10-24T01:44:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100ac210 con 0x7f0610154590 2023-10-24T01:44:22.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58880/0 (socket says 172.21.15.148:58880) 2023-10-24T01:44:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060e59c700 1 -- 172.21.15.148:0/979270066 learned_addr learned my addr 172.21.15.148:0/979270066 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.945+0000 7f060dd9b700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06101541b0 0x7f06100acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060ed9d700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0610154590 0x7f0610158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 -- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0610154590 msgr2=0x7f0610158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0610154590 0x7f0610158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 -- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06101541b0 msgr2=0x7f06100acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06101541b0 0x7f06100acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 -- 172.21.15.148:0/979270066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009370 con 0x7f06100c30b0 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060e59c700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f0604009130 tx=0x7f0604017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604000bc0 con 0x7f06100c30b0 2023-10-24T01:44:22.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060400b7f0 con 0x7f06100c30b0 2023-10-24T01:44:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604000d20 con 0x7f06100c30b0 2023-10-24T01:44:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06100ac4f0 con 0x7f06100c30b0 2023-10-24T01:44:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.946+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061014cf70 con 0x7f06100c30b0 2023-10-24T01:44:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.947+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610047480 con 0x7f06100c30b0 2023-10-24T01:44:22.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.948+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f060401c8c0 con 0x7f06100c30b0 2023-10-24T01:44:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.948+0000 7f05fe7fc700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 0x7f05f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.948+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f060407c270 con 0x7f06100c30b0 2023-10-24T01:44:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.948+0000 7f060dd9b700 1 -- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 msgr2=0x7f05f0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:22.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.948+0000 7f060dd9b700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 0x7f05f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:22.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:22.956+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f060404d1c0 con 0x7f06100c30b0 2023-10-24T01:44:22.991 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:22.990+0000 7f47a884e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:44:23.086 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.085+0000 7f8f1b8ff680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:44:23.093 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.092+0000 7f47a884e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:23.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.124+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06100c4fe0 con 0x7f06100c30b0 2023-10-24T01:44:23.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.125+0000 7f05fe7fc700 1 -- 172.21.15.148:0/979270066 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+11 (secure 0 0 0) 0x7f060402a0a0 con 0x7f06100c30b0 2023-10-24T01:44:23.126 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T01:44:23.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 msgr2=0x7f05f0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:23.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 0x7f05f0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 msgr2=0x7f061014ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f0604009130 tx=0x7f0604017000).stop 2023-10-24T01:44:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 shutdown_connections 2023-10-24T01:44:23.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0610154590 0x7f0610158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f05f005f270 0x7f05f0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f06100c30b0 0x7f061014ca80 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 --2- 172.21.15.148:0/979270066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06101541b0 0x7f06100acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 >> 172.21.15.148:0/979270066 conn(0x7f06100c86e0 msgr2=0x7f06100bd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.126+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 shutdown_connections 2023-10-24T01:44:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.127+0000 7f060f59e700 1 -- 172.21.15.148:0/979270066 wait complete. 2023-10-24T01:44:23.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T01:44:23.196 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.196+0000 7f8f1b8ff680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:23.246 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.245+0000 7f47a884e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:23.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.258+0000 7fb7b3e5d700 1 Processor -- start 2023-10-24T01:44:23.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.258+0000 7fb7b3e5d700 1 -- start start 2023-10-24T01:44:23.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7ac150ec0 0x7fb7ac06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac0bd860 0x7fb7ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb7ac1512a0 0x7fb7ac069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac069e00 con 0x7fb7ac150ec0 2023-10-24T01:44:23.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac065590 con 0x7fb7ac1512a0 2023-10-24T01:44:23.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b3e5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac065290 con 0x7fb7ac0bd860 2023-10-24T01:44:23.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b1bf9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7ac150ec0 0x7fb7ac06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b1bf9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7ac150ec0 0x7fb7ac06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58894/0 (socket says 172.21.15.148:58894) 2023-10-24T01:44:23.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.259+0000 7fb7b1bf9700 1 -- 172.21.15.148:0/500540753 learned_addr learned my addr 172.21.15.148:0/500540753 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:23.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b23fa700 1 --2- 172.21.15.148:0/500540753 >> v2:172.21.15.150:3300/0 conn(0x7fb7ac1512a0 0x7fb7ac069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b13f8700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac0bd860 0x7fb7ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 -- 172.21.15.148:0/500540753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac0bd860 msgr2=0x7fb7ac069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:23.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac0bd860 0x7fb7ac069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 -- 172.21.15.148:0/500540753 >> v2:172.21.15.150:3300/0 conn(0x7fb7ac1512a0 msgr2=0x7fb7ac069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:23.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 --2- 172.21.15.148:0/500540753 >> v2:172.21.15.150:3300/0 conn(0x7fb7ac1512a0 0x7fb7ac069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 -- 172.21.15.148:0/500540753 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0bdd50 con 0x7fb7ac150ec0 2023-10-24T01:44:23.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b1bf9700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac06a160 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fb7ac0a7790 tx=0x7fb7a80090f0).ready entity=mon.0 client_cookie=eea3caa2cc0dc30a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b0bf7700 1 -- 172.21.15.148:0/500540753 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800f510 con 0x7fb7ac150ec0 2023-10-24T01:44:23.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b0bf7700 1 -- 172.21.15.148:0/500540753 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800f670 con 0x7fb7ac150ec0 2023-10-24T01:44:23.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.260+0000 7fb7b0bf7700 1 -- 172.21.15.148:0/500540753 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800fa10 con 0x7fb7ac150ec0 2023-10-24T01:44:23.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/500540753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 msgr2=0x7fb7ac06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac06a160 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fb7ac0a7790 tx=0x7fb7a80090f0).stop 2023-10-24T01:44:23.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/500540753 shutdown_connections 2023-10-24T01:44:23.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac06a160 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/500540753 >> v2:172.21.15.150:3300/0 conn(0x7fb7ac1512a0 0x7fb7ac069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/500540753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac0bd860 0x7fb7ac069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/500540753 >> 172.21.15.148:0/500540753 conn(0x7fb7ac0c7d10 msgr2=0x7fb7ac0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/500540753 shutdown_connections 2023-10-24T01:44:23.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.261+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/500540753 wait complete. 2023-10-24T01:44:23.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.262+0000 7fb7b3e5d700 1 Processor -- start 2023-10-24T01:44:23.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.262+0000 7fb7b3e5d700 1 -- start start 2023-10-24T01:44:23.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac0bd860 0x7fb7ac14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac1512a0 0x7fb7ac062b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac063030 con 0x7fb7ac150ec0 2023-10-24T01:44:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac14cf20 con 0x7fb7ac0bd860 2023-10-24T01:44:23.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b3e5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac14c310 con 0x7fb7ac1512a0 2023-10-24T01:44:23.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58908/0 (socket says 172.21.15.148:58908) 2023-10-24T01:44:23.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 -- 172.21.15.148:0/304645564 learned_addr learned my addr 172.21.15.148:0/304645564 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:23.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b1bf9700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac0bd860 0x7fb7ac14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b23fa700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac1512a0 0x7fb7ac062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 -- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac1512a0 msgr2=0x7fb7ac062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac1512a0 0x7fb7ac062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 -- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac0bd860 msgr2=0x7fb7ac14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac0bd860 0x7fb7ac14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 -- 172.21.15.148:0/304645564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009370 con 0x7fb7ac150ec0 2023-10-24T01:44:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.263+0000 7fb7b13f8700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb79c00e900 tx=0x7fb79c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.264+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c012600 con 0x7fb7ac150ec0 2023-10-24T01:44:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.264+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c012760 con 0x7fb7ac150ec0 2023-10-24T01:44:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.264+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac14c5f0 con 0x7fb7ac150ec0 2023-10-24T01:44:23.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.264+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c012ae0 con 0x7fb7ac150ec0 2023-10-24T01:44:23.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.264+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac14cbb0 con 0x7fb7ac150ec0 2023-10-24T01:44:23.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb79c01b400 con 0x7fb7ac150ec0 2023-10-24T01:44:23.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac14d0d0 con 0x7fb7ac150ec0 2023-10-24T01:44:23.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7a1ffb700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 0x7fb790061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fb79c07a940 con 0x7fb7ac150ec0 2023-10-24T01:44:23.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7b1bf9700 1 -- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 msgr2=0x7fb790061700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:23.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.265+0000 7fb7b1bf9700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 0x7fb790061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:23.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.270+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb7ac14d0d0 con 0x7fb7ac150ec0 2023-10-24T01:44:23.321 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.320+0000 7f47a884e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:44:23.356 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.356+0000 7f8f1b8ff680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:23.388 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.387+0000 7f47a884e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:44:23.434 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.433+0000 7f8f1b8ff680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:44:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.440+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7ac14d090 con 0x7fb7ac150ec0 2023-10-24T01:44:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.441+0000 7fb7a1ffb700 1 -- 172.21.15.148:0/304645564 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb79c016020 con 0x7fb7ac150ec0 2023-10-24T01:44:23.442 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T01:44:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 msgr2=0x7fb790061700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 0x7fb790061700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 msgr2=0x7fb7ac062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb79c00e900 tx=0x7fb79c009060).stop 2023-10-24T01:44:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 shutdown_connections 2023-10-24T01:44:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7ac1512a0 0x7fb7ac062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7ac0bd860 0x7fb7ac14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb79005f240 0x7fb790061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 --2- 172.21.15.148:0/304645564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7ac150ec0 0x7fb7ac062650 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 >> 172.21.15.148:0/304645564 conn(0x7fb7ac0c7d10 msgr2=0x7fb7ac0c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 shutdown_connections 2023-10-24T01:44:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.443+0000 7fb7b3e5d700 1 -- 172.21.15.148:0/304645564 wait complete. 2023-10-24T01:44:23.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:23.506 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.505+0000 7f8f1b8ff680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.572+0000 7efdfc15d700 1 Processor -- start 2023-10-24T01:44:23.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.572+0000 7efdfc15d700 1 -- start start 2023-10-24T01:44:23.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfc15d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efdf413ac20 0x7efdf40655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfc15d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efdf40c2bd0 0x7efdf4065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfc15d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40c4fe0 con 0x7efdf413a840 2023-10-24T01:44:23.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfc15d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf4065fa0 con 0x7efdf413ac20 2023-10-24T01:44:23.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfc15d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40c46f0 con 0x7efdf40c2bd0 2023-10-24T01:44:23.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdf96f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efdf413ac20 0x7efdf40655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdf96f8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efdf413ac20 0x7efdf40655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45578/0 (socket says 172.21.15.148:45578) 2023-10-24T01:44:23.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdf96f8700 1 -- 172.21.15.148:0/82545669 learned_addr learned my addr 172.21.15.148:0/82545669 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:23.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdf9ef9700 1 --1- 172.21.15.148:0/82545669 >> v1:172.21.15.148:6789/0 conn(0x7efdf413a840 0x7efdf4069d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60196/0 (socket says 172.21.15.148:60196) 2023-10-24T01:44:23.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.573+0000 7efdfa6fa700 1 --2- 172.21.15.148:0/82545669 >> v2:172.21.15.150:3300/0 conn(0x7efdf40c2bd0 0x7efdf4065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf96f8700 1 -- 172.21.15.148:0/82545669 >> v2:172.21.15.150:3300/0 conn(0x7efdf40c2bd0 msgr2=0x7efdf4065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf96f8700 1 --2- 172.21.15.148:0/82545669 >> v2:172.21.15.150:3300/0 conn(0x7efdf40c2bd0 0x7efdf4065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf96f8700 1 -- 172.21.15.148:0/82545669 >> v1:172.21.15.148:6789/0 conn(0x7efdf413a840 legacy=0x7efdf4069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf96f8700 1 -- 172.21.15.148:0/82545669 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf406a5a0 con 0x7efdf413ac20 2023-10-24T01:44:23.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf96f8700 1 --2- 172.21.15.148:0/82545669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413ac20 0x7efdf40655c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7efdf40c1140 tx=0x7efdf000b3b0).ready entity=mon.0 client_cookie=c23fc2ea472f6d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf8ef7700 1 -- 172.21.15.148:0/82545669 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000da40 con 0x7efdf413ac20 2023-10-24T01:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf8ef7700 1 -- 172.21.15.148:0/82545669 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000dba0 con 0x7efdf413ac20 2023-10-24T01:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdf8ef7700 1 -- 172.21.15.148:0/82545669 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0010470 con 0x7efdf413ac20 2023-10-24T01:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 -- 172.21.15.148:0/82545669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413ac20 msgr2=0x7efdf40655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 --2- 172.21.15.148:0/82545669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413ac20 0x7efdf40655c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7efdf40c1140 tx=0x7efdf000b3b0).stop 2023-10-24T01:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 -- 172.21.15.148:0/82545669 shutdown_connections 2023-10-24T01:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 --2- 172.21.15.148:0/82545669 >> v2:172.21.15.150:3300/0 conn(0x7efdf40c2bd0 0x7efdf4065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 --2- 172.21.15.148:0/82545669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413ac20 0x7efdf40655c0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.574+0000 7efdfc15d700 1 -- 172.21.15.148:0/82545669 >> 172.21.15.148:0/82545669 conn(0x7efdf4063120 msgr2=0x7efdf40c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.575+0000 7efdfc15d700 1 -- 172.21.15.148:0/82545669 shutdown_connections 2023-10-24T01:44:23.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.575+0000 7efdfc15d700 1 -- 172.21.15.148:0/82545669 wait complete. 2023-10-24T01:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 Processor -- start 2023-10-24T01:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 -- start start 2023-10-24T01:44:23.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf40c2bd0 0x7efdf4150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdf413ac20 0x7efdf41387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4136d90 con 0x7efdf413a840 2023-10-24T01:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4138340 con 0x7efdf40c2bd0 2023-10-24T01:44:23.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.576+0000 7efdfc15d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4137730 con 0x7efdf413ac20 2023-10-24T01:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45584/0 (socket says 172.21.15.148:45584) 2023-10-24T01:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 -- 172.21.15.148:0/4289985950 learned_addr learned my addr 172.21.15.148:0/4289985950 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf9ef9700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf40c2bd0 0x7efdf4150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdfa6fa700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdf413ac20 0x7efdf41387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdf413ac20 msgr2=0x7efdf41387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdf413ac20 0x7efdf41387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf40c2bd0 msgr2=0x7efdf4150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf40c2bd0 0x7efdf4150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 -- 172.21.15.148:0/4289985950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf000b610 con 0x7efdf413a840 2023-10-24T01:44:23.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdf96f8700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7efdf4066160 tx=0x7efdf40c4f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0006d90 con 0x7efdf413a840 2023-10-24T01:44:23.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf001f040 con 0x7efdf413a840 2023-10-24T01:44:23.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4137a10 con 0x7efdf413a840 2023-10-24T01:44:23.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0019680 con 0x7efdf413a840 2023-10-24T01:44:23.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.577+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf4137fd0 con 0x7efdf413a840 2023-10-24T01:44:23.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.578+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf406c6b0 con 0x7efdf413a840 2023-10-24T01:44:23.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.579+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7efdf00199f0 con 0x7efdf413a840 2023-10-24T01:44:23.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.579+0000 7efde9ffb700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 0x7efdd8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.579+0000 7efdf9ef9700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 msgr2=0x7efdd8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:23.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.579+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7efdf007e150 con 0x7efdf413a840 2023-10-24T01:44:23.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.579+0000 7efdf9ef9700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 0x7efdd8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:23.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.584+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efdf004f0d0 con 0x7efdf413a840 2023-10-24T01:44:23.646 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.645+0000 7f47a884e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:44:23.776 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.775+0000 7f8f1b8ff680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:44:23.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.780+0000 7efdf9ef9700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 msgr2=0x7efdd8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:23.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.780+0000 7efdf9ef9700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 0x7efdd8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.793+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdf4063f70 con 0x7efdf413a840 2023-10-24T01:44:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.794+0000 7efde9ffb700 1 -- 172.21.15.148:0/4289985950 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7efdf00526f0 con 0x7efdf413a840 2023-10-24T01:44:23.795 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:23.795 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T01:44:23.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 msgr2=0x7efdd8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:23.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 0x7efdd8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 msgr2=0x7efdf40be020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7efdf4066160 tx=0x7efdf40c4f50).stop 2023-10-24T01:44:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 shutdown_connections 2023-10-24T01:44:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efdf413ac20 0x7efdf41387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf40c2bd0 0x7efdf4150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7efdd805f270 0x7efdd8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 --2- 172.21.15.148:0/4289985950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdf413a840 0x7efdf40be020 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 >> 172.21.15.148:0/4289985950 conn(0x7efdf4063120 msgr2=0x7efdf4064c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 shutdown_connections 2023-10-24T01:44:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.796+0000 7efdfc15d700 1 -- 172.21.15.148:0/4289985950 wait complete. 2023-10-24T01:44:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T01:44:23.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:23.830 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:23.829+0000 7f47a884e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:23.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.930+0000 7faae1590700 1 Processor -- start 2023-10-24T01:44:23.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.930+0000 7faae1590700 1 -- start start 2023-10-24T01:44:23.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faae1590700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faadc0be650 0x7faadc0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faae1590700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0a8260 0x7faadc0a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faae1590700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0a5bd0 con 0x7faadc154540 2023-10-24T01:44:23.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faae1590700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0a86e0 con 0x7faadc0be650 2023-10-24T01:44:23.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faae1590700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc064ab0 con 0x7faadc0a8260 2023-10-24T01:44:23.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faadaffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faadc154540 0x7faadc0640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60212/0 (socket says 172.21.15.148:60212) 2023-10-24T01:44:23.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faadaffd700 1 -- 172.21.15.148:0/106923318 learned_addr learned my addr 172.21.15.148:0/106923318 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:23.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faadb7fe700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0a8260 0x7faadc0a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.931+0000 7faada7fc700 1 --2- 172.21.15.148:0/106923318 >> v2:172.21.15.150:3300/0 conn(0x7faadc0be650 0x7faadc0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faad9ffb700 1 -- 172.21.15.148:0/106923318 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345880229 0 0) 0x7faadc0a5bd0 con 0x7faadc154540 2023-10-24T01:44:23.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faad9ffb700 1 -- 172.21.15.148:0/106923318 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac80033f0 con 0x7faadc154540 2023-10-24T01:44:23.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faada7fc700 1 -- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0a8260 msgr2=0x7faadc0a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:23.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faada7fc700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0a8260 0x7faadc0a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faada7fc700 1 -- 172.21.15.148:0/106923318 >> v1:172.21.15.148:6789/0 conn(0x7faadc154540 legacy=0x7faadc0640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faada7fc700 1 -- 172.21.15.148:0/106923318 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc064d90 con 0x7faadc0be650 2023-10-24T01:44:23.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faada7fc700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0be650 0x7faadc0a7d70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7faacc009760 tx=0x7faacc009060).ready entity=mon.1 client_cookie=4fdae5e498ebba0f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faad9ffb700 1 -- 172.21.15.148:0/106923318 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00d4a0 con 0x7faadc0be650 2023-10-24T01:44:23.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faad9ffb700 1 -- 172.21.15.148:0/106923318 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc00d600 con 0x7faadc0be650 2023-10-24T01:44:23.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.932+0000 7faad9ffb700 1 -- 172.21.15.148:0/106923318 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00d980 con 0x7faadc0be650 2023-10-24T01:44:23.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 -- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0be650 msgr2=0x7faadc0a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0be650 0x7faadc0a7d70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7faacc009760 tx=0x7faacc009060).stop 2023-10-24T01:44:23.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 -- 172.21.15.148:0/106923318 shutdown_connections 2023-10-24T01:44:23.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0a8260 0x7faadc0a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 --2- 172.21.15.148:0/106923318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0be650 0x7faadc0a7d70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 -- 172.21.15.148:0/106923318 >> 172.21.15.148:0/106923318 conn(0x7faadc092480 msgr2=0x7faadc062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:23.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 -- 172.21.15.148:0/106923318 shutdown_connections 2023-10-24T01:44:23.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.933+0000 7faae1590700 1 -- 172.21.15.148:0/106923318 wait complete. 2023-10-24T01:44:23.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.934+0000 7faae1590700 1 Processor -- start 2023-10-24T01:44:23.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.934+0000 7faae1590700 1 -- start start 2023-10-24T01:44:23.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 0x7faadc146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0be650 0x7faadc0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c5620 con 0x7faadc154540 2023-10-24T01:44:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc146740 con 0x7faadc0a8260 2023-10-24T01:44:23.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faae1590700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c4a10 con 0x7faadc0be650 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faadb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45600/0 (socket says 172.21.15.148:45600) 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faadb7fe700 1 -- 172.21.15.148:0/3033631704 learned_addr learned my addr 172.21.15.148:0/3033631704 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faadaffd700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 0x7faadc146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faada7fc700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0be650 0x7faadc0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:23.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.935+0000 7faadb7fe700 1 -- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0be650 msgr2=0x7faadc0c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadb7fe700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0be650 0x7faadc0c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadb7fe700 1 -- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 msgr2=0x7faadc146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadb7fe700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 0x7faadc146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadb7fe700 1 -- 172.21.15.148:0/3033631704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0092a0 con 0x7faadc154540 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadaffd700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 0x7faadc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:23.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faadb7fe700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7faad4009df0 tx=0x7faad400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400caa0 con 0x7faadc154540 2023-10-24T01:44:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400f040 con 0x7faadc154540 2023-10-24T01:44:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0c4cf0 con 0x7faadc154540 2023-10-24T01:44:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ce10 con 0x7faadc154540 2023-10-24T01:44:23.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.936+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0c52b0 con 0x7faadc154540 2023-10-24T01:44:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.937+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0c5790 con 0x7faadc154540 2023-10-24T01:44:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.938+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7faad4013610 con 0x7faadc154540 2023-10-24T01:44:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.938+0000 7faad2ffd700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 0x7faabc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.938+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7faad407ac20 con 0x7faadc154540 2023-10-24T01:44:23.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.938+0000 7faadaffd700 1 -- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 msgr2=0x7faabc061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.938+0000 7faadaffd700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 0x7faabc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:23.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:23.942+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faad404bc30 con 0x7faadc154540 2023-10-24T01:44:23.972 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:23.971+0000 7f8f1b8ff680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.117+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faadc06c6b0 con 0x7faadc154540 2023-10-24T01:44:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.118+0000 7faad2ffd700 1 -- 172.21.15.148:0/3033631704 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+17501 (secure 0 0 0) 0x7faad404f250 con 0x7faadc154540 2023-10-24T01:44:24.120 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:24.120 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":152,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:22.609337+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":152,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.36","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/968071362":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6833/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6832/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:0/3525147224":"2023-10-25T00:48:34.144037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 msgr2=0x7faabc061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:24.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 0x7faabc061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 msgr2=0x7faadc0c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7faad4009df0 tx=0x7faad400b040).stop 2023-10-24T01:44:24.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 shutdown_connections 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faabc05f270 0x7faabc061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faadc154540 0x7faadc0c5fa0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faadc0a8260 0x7faadc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 --2- 172.21.15.148:0/3033631704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faadc0be650 0x7faadc0c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.120+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 >> 172.21.15.148:0/3033631704 conn(0x7faadc092480 msgr2=0x7faadc153800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.121+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 shutdown_connections 2023-10-24T01:44:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.121+0000 7faae1590700 1 -- 172.21.15.148:0/3033631704 wait complete. 2023-10-24T01:44:24.134 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T01:44:24.135 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.251+0000 7fd30d84b700 1 Processor -- start 2023-10-24T01:44:24.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.251+0000 7fd30d84b700 1 -- start start 2023-10-24T01:44:24.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd30d84b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd308150b10 0x7fd30806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd30d84b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd308150ef0 0x7fd3080ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd30d84b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd308062650 con 0x7fd308154930 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd30d84b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308154e30 con 0x7fd308150b10 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd30d84b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308155110 con 0x7fd308150ef0 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd3067fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd308154930 0x7fd308062ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60224/0 (socket says 172.21.15.148:60224) 2023-10-24T01:44:24.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd306ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd308150b10 0x7fd30806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd3067fc700 1 -- 172.21.15.148:0/3217526114 learned_addr learned my addr 172.21.15.148:0/3217526114 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd3077fe700 1 --2- 172.21.15.148:0/3217526114 >> v2:172.21.15.150:3300/0 conn(0x7fd308150ef0 0x7fd3080ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd306ffd700 1 -- 172.21.15.148:0/3217526114 >> v2:172.21.15.150:3300/0 conn(0x7fd308150ef0 msgr2=0x7fd3080ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd306ffd700 1 --2- 172.21.15.148:0/3217526114 >> v2:172.21.15.150:3300/0 conn(0x7fd308150ef0 0x7fd3080ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd306ffd700 1 -- 172.21.15.148:0/3217526114 >> v1:172.21.15.148:6789/0 conn(0x7fd308154930 legacy=0x7fd308062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd306ffd700 1 -- 172.21.15.148:0/3217526114 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3081553f0 con 0x7fd308150b10 2023-10-24T01:44:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.252+0000 7fd305ffb700 1 -- 172.21.15.148:0/3217526114 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524953049 0 0) 0x7fd308062650 con 0x7fd308154930 2023-10-24T01:44:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd306ffd700 1 --2- 172.21.15.148:0/3217526114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308150b10 0x7fd30806b380 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fd308065f70 tx=0x7fd2f8009060).ready entity=mon.0 client_cookie=9750c7bf9393229c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd305ffb700 1 -- 172.21.15.148:0/3217526114 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80090d0 con 0x7fd308150b10 2023-10-24T01:44:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd305ffb700 1 -- 172.21.15.148:0/3217526114 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f800f510 con 0x7fd308150b10 2023-10-24T01:44:24.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd305ffb700 1 -- 172.21.15.148:0/3217526114 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800f890 con 0x7fd308150b10 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 -- 172.21.15.148:0/3217526114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308150b10 msgr2=0x7fd30806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3217526114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308150b10 0x7fd30806b380 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fd308065f70 tx=0x7fd2f8009060).stop 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 -- 172.21.15.148:0/3217526114 shutdown_connections 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3217526114 >> v2:172.21.15.150:3300/0 conn(0x7fd308150ef0 0x7fd3080ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3217526114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308150b10 0x7fd30806b380 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 -- 172.21.15.148:0/3217526114 >> 172.21.15.148:0/3217526114 conn(0x7fd3080c7d60 msgr2=0x7fd3080c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 -- 172.21.15.148:0/3217526114 shutdown_connections 2023-10-24T01:44:24.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.253+0000 7fd30d84b700 1 -- 172.21.15.148:0/3217526114 wait complete. 2023-10-24T01:44:24.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.255+0000 7fd30d84b700 1 Processor -- start 2023-10-24T01:44:24.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.255+0000 7fd30d84b700 1 -- start start 2023-10-24T01:44:24.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd308150b10 0x7fd308139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd308150ef0 0x7fd308163470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308163e50 con 0x7fd308154930 2023-10-24T01:44:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080bf460 con 0x7fd308150b10 2023-10-24T01:44:24.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080bfe00 con 0x7fd308150ef0 2023-10-24T01:44:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45626/0 (socket says 172.21.15.148:45626) 2023-10-24T01:44:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 -- 172.21.15.148:0/3807675869 learned_addr learned my addr 172.21.15.148:0/3807675869 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd306ffd700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd308150b10 0x7fd308139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3067fc700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd308150ef0 0x7fd308163470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd308150ef0 msgr2=0x7fd308163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd308150ef0 0x7fd308163470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd308150b10 msgr2=0x7fd308139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd308150b10 0x7fd308139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 -- 172.21.15.148:0/3807675869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f80092a0 con 0x7fd308154930 2023-10-24T01:44:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd3077fe700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fd30000e1f0 tx=0x7fd30000d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000b2e0 con 0x7fd308154930 2023-10-24T01:44:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300011040 con 0x7fd308154930 2023-10-24T01:44:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308164050 con 0x7fd308154930 2023-10-24T01:44:24.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000ecd0 con 0x7fd308154930 2023-10-24T01:44:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.256+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3080bfa90 con 0x7fd308154930 2023-10-24T01:44:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.257+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080bffb0 con 0x7fd308154930 2023-10-24T01:44:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.258+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd300009760 con 0x7fd308154930 2023-10-24T01:44:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.258+0000 7fd2eeffd700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 0x7fd2f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.258+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fd30007c410 con 0x7fd308154930 2023-10-24T01:44:24.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.258+0000 7fd306ffd700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 msgr2=0x7fd2f4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:24.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.258+0000 7fd306ffd700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 0x7fd2f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:24.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.262+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd30004caf0 con 0x7fd308154930 2023-10-24T01:44:24.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.459+0000 7fd306ffd700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 msgr2=0x7fd2f4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:24.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.459+0000 7fd306ffd700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 0x7fd2f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:24.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.476+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd308047480 con 0x7fd308154930 2023-10-24T01:44:24.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.477+0000 7fd2eeffd700 1 -- 172.21.15.148:0/3807675869 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fd30001b020 con 0x7fd308154930 2023-10-24T01:44:24.478 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:24.478 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T01:44:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 msgr2=0x7fd2f4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 0x7fd2f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 msgr2=0x7fd308163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fd30000e1f0 tx=0x7fd30000d040).stop 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 shutdown_connections 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd2f405f270 0x7fd2f4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd308154930 0x7fd308163960 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd308150b10 0x7fd308139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 --2- 172.21.15.148:0/3807675869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd308150ef0 0x7fd308163470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 >> 172.21.15.148:0/3807675869 conn(0x7fd3080c7d60 msgr2=0x7fd3080c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 shutdown_connections 2023-10-24T01:44:24.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.479+0000 7fd30d84b700 1 -- 172.21.15.148:0/3807675869 wait complete. 2023-10-24T01:44:24.483 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.481+0000 7f47a884e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:44:24.483 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T01:44:24.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:24.550 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.549+0000 7f47a884e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:44:24.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.613+0000 7fbdb8f06700 1 Processor -- start 2023-10-24T01:44:24.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.613+0000 7fbdb8f06700 1 -- start start 2023-10-24T01:44:24.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb8f06700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbdb4065250 0x7fbdb415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb8f06700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40a9de0 con 0x7fbdb4150a80 2023-10-24T01:44:24.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb8f06700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb41553c0 con 0x7fbdb41506a0 2023-10-24T01:44:24.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb8f06700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40aa040 con 0x7fbdb4065250 2023-10-24T01:44:24.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb2ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbdb4150a80 0x7fbdb4064b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60232/0 (socket says 172.21.15.148:60232) 2023-10-24T01:44:24.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb2ffd700 1 -- 172.21.15.148:0/3877871225 learned_addr learned my addr 172.21.15.148:0/3877871225 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:24.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb3fff700 1 --2- 172.21.15.148:0/3877871225 >> v2:172.21.15.150:3300/0 conn(0x7fbdb4065250 0x7fbdb415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb27fc700 1 -- 172.21.15.148:0/3877871225 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523425024 0 0) 0x7fbdb40a9de0 con 0x7fbdb4150a80 2023-10-24T01:44:24.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb27fc700 1 -- 172.21.15.148:0/3877871225 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd9c004500 con 0x7fbdb4150a80 2023-10-24T01:44:24.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb3fff700 1 -- 172.21.15.148:0/3877871225 >> v1:172.21.15.150:6789/0 conn(0x7fbdb41506a0 legacy=0x7fbdb40a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb3fff700 1 -- 172.21.15.148:0/3877871225 >> v1:172.21.15.148:6789/0 conn(0x7fbdb4150a80 legacy=0x7fbdb4064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.614+0000 7fbdb3fff700 1 -- 172.21.15.148:0/3877871225 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb4154600 con 0x7fbdb4065250 2023-10-24T01:44:24.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb3fff700 1 --2- 172.21.15.148:0/3877871225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb415b800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fbdac009e60 tx=0x7fbdac009780).ready entity=mon.1 client_cookie=37ac2c09b24e954c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb27fc700 1 -- 172.21.15.148:0/3877871225 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac00e070 con 0x7fbdb4065250 2023-10-24T01:44:24.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb27fc700 1 -- 172.21.15.148:0/3877871225 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac00bb60 con 0x7fbdb4065250 2023-10-24T01:44:24.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb27fc700 1 -- 172.21.15.148:0/3877871225 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac012410 con 0x7fbdb4065250 2023-10-24T01:44:24.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 -- 172.21.15.148:0/3877871225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 msgr2=0x7fbdb415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/3877871225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb415b800 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fbdac009e60 tx=0x7fbdac009780).stop 2023-10-24T01:44:24.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 -- 172.21.15.148:0/3877871225 shutdown_connections 2023-10-24T01:44:24.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/3877871225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb415b800 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 -- 172.21.15.148:0/3877871225 >> 172.21.15.148:0/3877871225 conn(0x7fbdb40c72d0 msgr2=0x7fbdb40c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 -- 172.21.15.148:0/3877871225 shutdown_connections 2023-10-24T01:44:24.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.615+0000 7fbdb8f06700 1 -- 172.21.15.148:0/3877871225 wait complete. 2023-10-24T01:44:24.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 Processor -- start 2023-10-24T01:44:24.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 -- start start 2023-10-24T01:44:24.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb4150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdb41506a0 0x7fbdb4160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4152160 con 0x7fbdb4150a80 2023-10-24T01:44:24.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4160820 con 0x7fbdb4065250 2023-10-24T01:44:24.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb8f06700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4164810 con 0x7fbdb41506a0 2023-10-24T01:44:24.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45628/0 (socket says 172.21.15.148:45628) 2023-10-24T01:44:24.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.617+0000 7fbdb3fff700 1 -- 172.21.15.148:0/2426994165 learned_addr learned my addr 172.21.15.148:0/2426994165 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:24.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb37fe700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb4150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb2ffd700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdb41506a0 0x7fbdb4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdb41506a0 msgr2=0x7fbdb4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdb41506a0 0x7fbdb4160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 msgr2=0x7fbdb4150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb4150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 -- 172.21.15.148:0/2426994165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac009a20 con 0x7fbdb4150a80 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb37fe700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb4150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb3fff700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fbdb40a9f70 tx=0x7fbdac009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac012410 con 0x7fbdb4150a80 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac01d630 con 0x7fbdb4150a80 2023-10-24T01:44:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac01d9f0 con 0x7fbdb4150a80 2023-10-24T01:44:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb41514e0 con 0x7fbdb4150a80 2023-10-24T01:44:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.618+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb4151aa0 con 0x7fbdb4150a80 2023-10-24T01:44:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.619+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb41522a0 con 0x7fbdb4150a80 2023-10-24T01:44:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.620+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fbdac026410 con 0x7fbdb4150a80 2023-10-24T01:44:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.620+0000 7fbd9b7fe700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 0x7fbda0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.620+0000 7fbdb37fe700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 msgr2=0x7fbda0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.620+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7fbdac07c290 con 0x7fbdb4150a80 2023-10-24T01:44:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.620+0000 7fbdb37fe700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 0x7fbda0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:24.630 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.625+0000 7f47a884e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:44:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.624+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbdb41522a0 con 0x7fbdb4150a80 2023-10-24T01:44:24.659 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:24.658+0000 7f8f1b8ff680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:44:24.729 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:24.729+0000 7f8f1b8ff680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:44:24.772 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.771+0000 7f47a884e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:44:24.806 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:24.806+0000 7f8f1b8ff680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:44:24.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.821+0000 7fbdb37fe700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 msgr2=0x7fbda0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:24.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.821+0000 7fbdb37fe700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 0x7fbda0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:24.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.836+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdb41522a0 con 0x7fbdb4150a80 2023-10-24T01:44:24.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.836+0000 7fbd9b7fe700 1 -- 172.21.15.148:0/2426994165 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fbdb41522a0 con 0x7fbdb4150a80 2023-10-24T01:44:24.837 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:24.837 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T00:48:18.379861+0000","modified":"2023-10-24T00:48:20.387984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8199":{"gid":8199,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.148:6835/1479144223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":1479144223},{"type":"v1","addr":"172.21.15.148:6835","nonce":1479144223}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-24T01:44:24.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 msgr2=0x7fbda0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:24.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 0x7fbda0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 msgr2=0x7fbdb4164320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fbdb40a9f70 tx=0x7fbdac009780).stop 2023-10-24T01:44:24.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 shutdown_connections 2023-10-24T01:44:24.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbda005f270 0x7fbda0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:24.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdb4150a80 0x7fbdb4164320 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbdb4065250 0x7fbdb4150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 --2- 172.21.15.148:0/2426994165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbdb41506a0 0x7fbdb4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 >> 172.21.15.148:0/2426994165 conn(0x7fbdb40c72d0 msgr2=0x7fbdb4068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 shutdown_connections 2023-10-24T01:44:24.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.838+0000 7fbdb8f06700 1 -- 172.21.15.148:0/2426994165 wait complete. 2023-10-24T01:44:24.842 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 49 2023-10-24T01:44:24.843 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.842+0000 7f47a884e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:44:24.851 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:24.959 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:24.958+0000 7f47a884e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:44:24.964 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:24.963+0000 7f8f1b8ff680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:44:24.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.967+0000 7ff51d80d700 1 Processor -- start 2023-10-24T01:44:24.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.967+0000 7ff51d80d700 1 -- start start 2023-10-24T01:44:24.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff51d80d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff5180a8480 0x7ff51815f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff51d80d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180a5bd0 con 0x7ff5180be650 2023-10-24T01:44:24.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff51d80d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff518064ab0 con 0x7ff518154540 2023-10-24T01:44:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff51d80d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff518064d90 con 0x7ff5180a8480 2023-10-24T01:44:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff5167fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff5180be650 0x7ff5180a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60242/0 (socket says 172.21.15.148:60242) 2023-10-24T01:44:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff5167fc700 1 -- 172.21.15.148:0/1429350411 learned_addr learned my addr 172.21.15.148:0/1429350411 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.968+0000 7ff5177fe700 1 --2- 172.21.15.148:0/1429350411 >> v2:172.21.15.150:3300/0 conn(0x7ff5180a8480 0x7ff51815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797104998 0 0) 0x7ff5180a5bd0 con 0x7ff5180be650 2023-10-24T01:44:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5000033f0 con 0x7ff5180be650 2023-10-24T01:44:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff5177fe700 1 -- 172.21.15.148:0/1429350411 >> v1:172.21.15.150:6789/0 conn(0x7ff518154540 legacy=0x7ff5180640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943122640 0 0) 0x7ff518064ab0 con 0x7ff518154540 2023-10-24T01:44:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff5177fe700 1 -- 172.21.15.148:0/1429350411 >> v1:172.21.15.148:6789/0 conn(0x7ff5180be650 legacy=0x7ff5180a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff5177fe700 1 -- 172.21.15.148:0/1429350411 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518065070 con 0x7ff5180a8480 2023-10-24T01:44:24.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff5177fe700 1 --2- 172.21.15.148:0/1429350411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff51815f130 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff510009e60 tx=0x7ff510009780).ready entity=mon.1 client_cookie=c60062faeec66925 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000e070 con 0x7ff5180a8480 2023-10-24T01:44:24.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51000bb60 con 0x7ff5180a8480 2023-10-24T01:44:24.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.969+0000 7ff515ffb700 1 -- 172.21.15.148:0/1429350411 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000bee0 con 0x7ff5180a8480 2023-10-24T01:44:24.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 -- 172.21.15.148:0/1429350411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 msgr2=0x7ff51815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 --2- 172.21.15.148:0/1429350411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff51815f130 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff510009e60 tx=0x7ff510009780).stop 2023-10-24T01:44:24.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 -- 172.21.15.148:0/1429350411 shutdown_connections 2023-10-24T01:44:24.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 --2- 172.21.15.148:0/1429350411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff51815f130 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 -- 172.21.15.148:0/1429350411 >> 172.21.15.148:0/1429350411 conn(0x7ff518092480 msgr2=0x7ff518062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:24.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 -- 172.21.15.148:0/1429350411 shutdown_connections 2023-10-24T01:44:24.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.970+0000 7ff51d80d700 1 -- 172.21.15.148:0/1429350411 wait complete. 2023-10-24T01:44:24.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.971+0000 7ff51d80d700 1 Processor -- start 2023-10-24T01:44:24.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.971+0000 7ff51d80d700 1 -- start start 2023-10-24T01:44:24.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff5180c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff518154540 0x7ff518159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180a9790 con 0x7ff5180be650 2023-10-24T01:44:24.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518158ed0 con 0x7ff5180a8480 2023-10-24T01:44:24.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff51d80d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff518146f80 con 0x7ff518154540 2023-10-24T01:44:24.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45634/0 (socket says 172.21.15.148:45634) 2023-10-24T01:44:24.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 -- 172.21.15.148:0/3219460959 learned_addr learned my addr 172.21.15.148:0/3219460959 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:24.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff516ffd700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff5180c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5177fe700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff518154540 0x7ff518159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:24.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 -- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff518154540 msgr2=0x7ff518159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff518154540 0x7ff518159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 -- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 msgr2=0x7ff5180c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff5180c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff5167fc700 1 -- 172.21.15.148:0/3219460959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510009a20 con 0x7ff5180be650 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.972+0000 7ff516ffd700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff5180c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:24.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff5167fc700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7ff50800c4c0 tx=0x7ff508007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:24.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ce30 con 0x7ff5180be650 2023-10-24T01:44:24.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080072e0 con 0x7ff5180be650 2023-10-24T01:44:24.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080057a0 con 0x7ff5180be650 2023-10-24T01:44:24.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5180a99a0 con 0x7ff5180be650 2023-10-24T01:44:24.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.973+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff518158b60 con 0x7ff5180be650 2023-10-24T01:44:24.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.974+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51806c6b0 con 0x7ff5180be650 2023-10-24T01:44:24.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.974+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff508005b50 con 0x7ff5180be650 2023-10-24T01:44:24.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.975+0000 7ff4feffd700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 0x7ff504061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:24.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.975+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7ff508079bf0 con 0x7ff5180be650 2023-10-24T01:44:24.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.975+0000 7ff516ffd700 1 -- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 msgr2=0x7ff504061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:24.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.975+0000 7ff516ffd700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 0x7ff504061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:24.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:24.979+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff508080080 con 0x7ff5180be650 2023-10-24T01:44:25.040 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:25.039+0000 7f8f1b8ff680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:44:25.068 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.067+0000 7f47a884e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:25.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.150+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5180c7810 con 0x7ff5180be650 2023-10-24T01:44:25.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.151+0000 7ff4feffd700 1 -- 172.21.15.148:0/3219460959 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+17501 (secure 0 0 0) 0x7ff508018030 con 0x7ff5180be650 2023-10-24T01:44:25.152 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:25.153 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":152,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:22.609337+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-24T00:48:16.946933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-24T00:48:17.347755+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":152,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.36","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/968071362":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6833/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:6832/87479":"2023-10-25T00:48:34.144037+0000","172.21.15.150:0/3525147224":"2023-10-25T00:48:34.144037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:25.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 msgr2=0x7ff504061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:25.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 0x7ff504061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:25.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 msgr2=0x7ff518146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:25.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7ff50800c4c0 tx=0x7ff508007c10).stop 2023-10-24T01:44:25.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 shutdown_connections 2023-10-24T01:44:25.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff518154540 0x7ff518159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5180a8480 0x7ff5180c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff50405f270 0x7ff504061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:25.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 --2- 172.21.15.148:0/3219460959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff5180be650 0x7ff518146a90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 >> 172.21.15.148:0/3219460959 conn(0x7ff518092480 msgr2=0x7ff5180a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:25.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 shutdown_connections 2023-10-24T01:44:25.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.153+0000 7ff51d80d700 1 -- 172.21.15.148:0/3219460959 wait complete. 2023-10-24T01:44:25.158 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:25.158+0000 7f8f1b8ff680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:44:25.167 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T01:44:25.275 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:25.274+0000 7f8f1b8ff680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:25.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.284+0000 7f85c29ab700 1 Processor -- start 2023-10-24T01:44:25.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.284+0000 7f85c29ab700 1 -- start start 2023-10-24T01:44:25.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c29ab700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85bc0c28e0 0x7f85bc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c29ab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f85bc0c33d0 0x7f85bc15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c29ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc06ba10 con 0x7f85bc0c4540 2023-10-24T01:44:25.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c29ab700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc0bd350 con 0x7f85bc0c33d0 2023-10-24T01:44:25.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c29ab700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc151220 con 0x7f85bc0c28e0 2023-10-24T01:44:25.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c21aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f85bc0c33d0 0x7f85bc15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:25.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c21aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f85bc0c33d0 0x7f85bc15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45640/0 (socket says 172.21.15.148:45640) 2023-10-24T01:44:25.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c11a8700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f85bc0c4540 0x7f85bc0c2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60256/0 (socket says 172.21.15.148:60256) 2023-10-24T01:44:25.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c21aa700 1 -- 172.21.15.148:0/444251646 learned_addr learned my addr 172.21.15.148:0/444251646 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:25.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.285+0000 7f85c19a9700 1 --2- 172.21.15.148:0/444251646 >> v2:172.21.15.150:3300/0 conn(0x7f85bc0c28e0 0x7f85bc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:25.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c21aa700 1 -- 172.21.15.148:0/444251646 >> v2:172.21.15.150:3300/0 conn(0x7f85bc0c28e0 msgr2=0x7f85bc06b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:25.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c21aa700 1 --2- 172.21.15.148:0/444251646 >> v2:172.21.15.150:3300/0 conn(0x7f85bc0c28e0 0x7f85bc06b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c21aa700 1 -- 172.21.15.148:0/444251646 >> v1:172.21.15.148:6789/0 conn(0x7f85bc0c4540 legacy=0x7f85bc0c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:25.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c21aa700 1 -- 172.21.15.148:0/444251646 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc063190 con 0x7f85bc0c33d0 2023-10-24T01:44:25.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c09a7700 1 -- 172.21.15.148:0/444251646 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592627371 0 0) 0x7f85bc06ba10 con 0x7f85bc0c4540 2023-10-24T01:44:25.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c21aa700 1 --2- 172.21.15.148:0/444251646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c33d0 0x7f85bc15a9c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f85bc0c7230 tx=0x7f85b400ba50).ready entity=mon.0 client_cookie=45f1340625596a13 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:25.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c09a7700 1 -- 172.21.15.148:0/444251646 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4010070 con 0x7f85bc0c33d0 2023-10-24T01:44:25.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c09a7700 1 -- 172.21.15.148:0/444251646 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400dde0 con 0x7f85bc0c33d0 2023-10-24T01:44:25.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c09a7700 1 -- 172.21.15.148:0/444251646 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400b2e0 con 0x7f85bc0c33d0 2023-10-24T01:44:25.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c29ab700 1 -- 172.21.15.148:0/444251646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c33d0 msgr2=0x7f85bc15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:25.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c29ab700 1 --2- 172.21.15.148:0/444251646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c33d0 0x7f85bc15a9c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f85bc0c7230 tx=0x7f85b400ba50).stop 2023-10-24T01:44:25.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.286+0000 7f85c29ab700 1 -- 172.21.15.148:0/444251646 shutdown_connections 2023-10-24T01:44:25.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.287+0000 7f85c29ab700 1 --2- 172.21.15.148:0/444251646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c33d0 0x7f85bc15a9c0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.287+0000 7f85c29ab700 1 --2- 172.21.15.148:0/444251646 >> v2:172.21.15.150:3300/0 conn(0x7f85bc0c28e0 0x7f85bc06b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.287+0000 7f85c29ab700 1 -- 172.21.15.148:0/444251646 >> 172.21.15.148:0/444251646 conn(0x7f85bc0c7d90 msgr2=0x7f85bc0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:25.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.287+0000 7f85c29ab700 1 -- 172.21.15.148:0/444251646 shutdown_connections 2023-10-24T01:44:25.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.287+0000 7f85c29ab700 1 -- 172.21.15.148:0/444251646 wait complete. 2023-10-24T01:44:25.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 Processor -- start 2023-10-24T01:44:25.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 -- start start 2023-10-24T01:44:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85bc0c33d0 0x7f85bc152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85bc0c4540 0x7f85bc14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0ad540 con 0x7f85bc0c28e0 2023-10-24T01:44:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0aa500 con 0x7f85bc0c33d0 2023-10-24T01:44:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.288+0000 7f85c29ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0aa7e0 con 0x7f85bc0c4540 2023-10-24T01:44:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45648/0 (socket says 172.21.15.148:45648) 2023-10-24T01:44:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 -- 172.21.15.148:0/3436603481 learned_addr learned my addr 172.21.15.148:0/3436603481 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c11a8700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85bc0c33d0 0x7f85bc152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c21aa700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85bc0c4540 0x7f85bc14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 -- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85bc0c4540 msgr2=0x7f85bc14b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85bc0c4540 0x7f85bc14b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 -- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85bc0c33d0 msgr2=0x7f85bc152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85bc0c33d0 0x7f85bc152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 -- 172.21.15.148:0/3436603481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b400bcf0 con 0x7f85bc0c28e0 2023-10-24T01:44:25.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c19a9700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f85ac00e900 tx=0x7f85ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:25.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac009390 con 0x7f85bc0c28e0 2023-10-24T01:44:25.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac012600 con 0x7f85bc0c28e0 2023-10-24T01:44:25.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac012980 con 0x7f85bc0c28e0 2023-10-24T01:44:25.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.289+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc0ad1d0 con 0x7f85bc0c28e0 2023-10-24T01:44:25.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.290+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc152c20 con 0x7f85bc0c28e0 2023-10-24T01:44:25.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.290+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc047480 con 0x7f85bc0c28e0 2023-10-24T01:44:25.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.291+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 64) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f85ac012d30 con 0x7f85bc0c28e0 2023-10-24T01:44:25.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.291+0000 7f85b1ffb700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 0x7f85a0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:25.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.291+0000 7f85c11a8700 1 -- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 msgr2=0x7f85a0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:25.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.291+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6439+0+0 (secure 0 0 0) 0x7f85ac07a760 con 0x7f85bc0c28e0 2023-10-24T01:44:25.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.291+0000 7f85c11a8700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 0x7f85a0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:25.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.295+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f85ac04b730 con 0x7f85bc0c28e0 2023-10-24T01:44:25.364 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.363+0000 7f47a884e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:44:25.435 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.434+0000 7f47a884e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:44:25.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.456+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 65) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f85ac078230 con 0x7f85bc0c28e0 2023-10-24T01:44:25.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.456+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 msgr2=0x7f85a0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:25.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.456+0000 7f85b1ffb700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 0x7f85a0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:25.510 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.509+0000 7f47257e6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.509+0000 7f47257e6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.509+0000 7f47257e6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.509+0000 7f47257e6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.509+0000 7f47257e6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.511 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.510+0000 7f4722fe1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.512 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.510+0000 7f4722fe1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.512 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.510+0000 7f4722fe1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.512 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.510+0000 7f4722fe1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.512 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:25.510+0000 7f4722fe1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:25.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:25.516+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f85bc067d30 con 0x7f85bc0c28e0 2023-10-24T01:44:25.584 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:25.584+0000 7f8f1b8ff680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:44:25.656 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:25.655+0000 7f8f1b8ff680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:44:26.450 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T01:44:26.450+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T01:44:26.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.453+0000 7f85b1ffb700 1 -- 172.21.15.148:0/3436603481 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f85ac0714b0 con 0x7f85bc0c28e0 2023-10-24T01:44:26.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 msgr2=0x7f85bc14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f85ac00e900 tx=0x7f85ac009060).stop 2023-10-24T01:44:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 shutdown_connections 2023-10-24T01:44:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85bc0c4540 0x7f85bc14b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f85a005f270 0x7f85a0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:26.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85bc0c28e0 0x7f85bc14b1a0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 --2- 172.21.15.148:0/3436603481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85bc0c33d0 0x7f85bc152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.455+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 >> 172.21.15.148:0/3436603481 conn(0x7f85bc0c7d90 msgr2=0x7f85bc0a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:26.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.456+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 shutdown_connections 2023-10-24T01:44:26.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.456+0000 7f85c29ab700 1 -- 172.21.15.148:0/3436603481 wait complete. 2023-10-24T01:44:26.459 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T01:44:26.475 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T01:44:26.492 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T01:44:26.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.594+0000 7f8db7c0f700 1 Processor -- start 2023-10-24T01:44:26.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.594+0000 7f8db7c0f700 1 -- start start 2023-10-24T01:44:26.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db7c0f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:26.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db7c0f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db00c71d0 con 0x7f8db0098bd0 2023-10-24T01:44:26.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db7c0f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db00c9410 con 0x7f8db0154430 2023-10-24T01:44:26.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db7c0f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00c6a10 con 0x7f8db00c06e0 2023-10-24T01:44:26.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db51aa700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8db0098bd0 0x7f8db00bffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60266/0 (socket says 172.21.15.148:60266) 2023-10-24T01:44:26.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.595+0000 7f8db51aa700 1 -- 172.21.15.148:0/264766210 learned_addr learned my addr 172.21.15.148:0/264766210 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:26.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db61ac700 1 --2- 172.21.15.148:0/264766210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:26.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747856260 0 0) 0x7f8db00c71d0 con 0x7f8db0098bd0 2023-10-24T01:44:26.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d9c0033f0 con 0x7f8db0098bd0 2023-10-24T01:44:26.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761188374 0 0) 0x7f8db00c9410 con 0x7f8db0154430 2023-10-24T01:44:26.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db00c71d0 con 0x7f8db0154430 2023-10-24T01:44:26.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db61ac700 1 -- 172.21.15.148:0/264766210 >> v1:172.21.15.150:6789/0 conn(0x7f8db0154430 legacy=0x7f8db00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db61ac700 1 -- 172.21.15.148:0/264766210 >> v1:172.21.15.148:6789/0 conn(0x7f8db0098bd0 legacy=0x7f8db00bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db61ac700 1 -- 172.21.15.148:0/264766210 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00ca8b0 con 0x7f8db00c06e0 2023-10-24T01:44:26.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db61ac700 1 --2- 172.21.15.148:0/264766210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db0154810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f8da8009e90 tx=0x7f8da8009780).ready entity=mon.2 client_cookie=e4c4616a1ea1236f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:26.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800e070 con 0x7f8db00c06e0 2023-10-24T01:44:26.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da800bab0 con 0x7f8db00c06e0 2023-10-24T01:44:26.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.596+0000 7f8db49a9700 1 -- 172.21.15.148:0/264766210 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800be30 con 0x7f8db00c06e0 2023-10-24T01:44:26.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 -- 172.21.15.148:0/264766210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 msgr2=0x7f8db0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/264766210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db0154810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f8da8009e90 tx=0x7f8da8009780).stop 2023-10-24T01:44:26.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 -- 172.21.15.148:0/264766210 shutdown_connections 2023-10-24T01:44:26.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/264766210 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db0154810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 -- 172.21.15.148:0/264766210 >> 172.21.15.148:0/264766210 conn(0x7f8db00cb070 msgr2=0x7f8db00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:26.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 -- 172.21.15.148:0/264766210 shutdown_connections 2023-10-24T01:44:26.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.597+0000 7f8db7c0f700 1 -- 172.21.15.148:0/264766210 wait complete. 2023-10-24T01:44:26.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.598+0000 7f8db7c0f700 1 Processor -- start 2023-10-24T01:44:26.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.598+0000 7f8db7c0f700 1 -- start start 2023-10-24T01:44:26.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:26.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:26.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db0154430 0x7f8db014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:26.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00aa8f0 con 0x7f8db0098bd0 2023-10-24T01:44:26.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db01520f0 con 0x7f8db0154430 2023-10-24T01:44:26.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0151da0 con 0x7f8db00c06e0 2023-10-24T01:44:26.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:26.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45674/0 (socket says 172.21.15.148:45674) 2023-10-24T01:44:26.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 -- 172.21.15.148:0/2414137928 learned_addr learned my addr 172.21.15.148:0/2414137928 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:26.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db61ac700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db0154430 0x7f8db014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:26.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db51aa700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:26.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 -- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 msgr2=0x7f8db00a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db00a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 -- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db0154430 msgr2=0x7f8db014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db0154430 0x7f8db014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 -- 172.21.15.148:0/2414137928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009a20 con 0x7f8db0098bd0 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db59ab700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f8dac00c3a0 tx=0x7f8dac007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0123f0 con 0x7f8db0098bd0 2023-10-24T01:44:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac012550 con 0x7f8db0098bd0 2023-10-24T01:44:26.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db0150f40 con 0x7f8db0098bd0 2023-10-24T01:44:26.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.599+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac012700 con 0x7f8db0098bd0 2023-10-24T01:44:26.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.600+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db0151a30 con 0x7f8db0098bd0 2023-10-24T01:44:26.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.600+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 66) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f8dac012ab0 con 0x7f8db0098bd0 2023-10-24T01:44:26.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.601+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0151460 con 0x7f8db0098bd0 2023-10-24T01:44:26.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.601+0000 7f8da5ffb700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 0x7f8d940614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:26.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.601+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6653+0+0 (secure 0 0 0) 0x7f8dac079470 con 0x7f8db0098bd0 2023-10-24T01:44:26.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.601+0000 7f8db51aa700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 0x7f8d940614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:26.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.601+0000 7f8db51aa700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 0x7f8d940614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8db00b0650 tx=0x7f8da0009040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:26.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.605+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8dac047af0 con 0x7f8db0098bd0 2023-10-24T01:44:26.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:26.811+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8db0151890 con 0x7f8db0098bd0 2023-10-24T01:44:27.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.463+0000 7f8da5ffb700 1 -- 172.21.15.148:0/2414137928 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8db0151890 con 0x7f8db0098bd0 2023-10-24T01:44:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 msgr2=0x7f8d940614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 0x7f8d940614f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8db00b0650 tx=0x7f8da0009040).stop 2023-10-24T01:44:27.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 msgr2=0x7f8db00aa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f8dac00c3a0 tx=0x7f8dac007c40).stop 2023-10-24T01:44:27.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 shutdown_connections 2023-10-24T01:44:27.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8db0154430 0x7f8db014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8d9405f030 0x7f8d940614f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8db0098bd0 0x7f8db00aa400 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 --2- 172.21.15.148:0/2414137928 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8db00c06e0 0x7f8db00a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 >> 172.21.15.148:0/2414137928 conn(0x7f8db00cb070 msgr2=0x7f8db00a8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 shutdown_connections 2023-10-24T01:44:27.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.466+0000 7f8db7c0f700 1 -- 172.21.15.148:0/2414137928 wait complete. 2023-10-24T01:44:27.480 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T01:44:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.638+0000 7f7aaa771700 1 Processor -- start 2023-10-24T01:44:27.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.638+0000 7f7aaa771700 1 -- start start 2023-10-24T01:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aaa771700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7aa40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aaa771700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40c6830 con 0x7f7aa40c0b50 2023-10-24T01:44:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aaa771700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40c1290 con 0x7f7aa41543b0 2023-10-24T01:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aaa771700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c1530 con 0x7f7aa4154790 2023-10-24T01:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aa8d0e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7aa40c0b50 0x7f7aa40c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60270/0 (socket says 172.21.15.148:60270) 2023-10-24T01:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aa8d0e700 1 -- 172.21.15.148:0/1770548580 learned_addr learned my addr 172.21.15.148:0/1770548580 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7aa40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031291364 0 0) 0x7f7aa40c6830 con 0x7f7aa40c0b50 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.639+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c0033f0 con 0x7f7aa40c0b50 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470257723 0 0) 0x7f7a8c0033f0 con 0x7f7aa40c0b50 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 msgr2=0x7f7aa40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7aa40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 >> v1:172.21.15.150:6789/0 conn(0x7f7aa41543b0 legacy=0x7f7aa40a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40c64c0 con 0x7f7aa40c0b50 2023-10-24T01:44:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f7a9c0017f0 con 0x7f7aa40c0b50 2023-10-24T01:44:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 >> v1:172.21.15.148:6789/0 conn(0x7f7aa40c0b50 legacy=0x7f7aa40c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a8c003910 0x7f7a8c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7a8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7a8c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c1530 con 0x7f7a8c004690 2023-10-24T01:44:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c00b930 con 0x7f7a8c003910 2023-10-24T01:44:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c00baf0 con 0x7f7aa4154790 2023-10-24T01:44:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7a8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa3fff700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a8c003910 0x7f7a8c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa8d0e700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7a8c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 -- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 msgr2=0x7f7a8c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa4154790 0x7f7a8c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 -- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a8c003910 msgr2=0x7f7a8c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a8c003910 0x7f7a8c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 -- 172.21.15.148:0/1770548580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0033f0 con 0x7f7a8c004690 2023-10-24T01:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7a8c004b10 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f7a98009a80 tx=0x7f7a98009060).ready entity=mon.0 client_cookie=62f143c98f6f627b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a98009430 con 0x7f7a8c004690 2023-10-24T01:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800e640 con 0x7f7a8c004690 2023-10-24T01:44:27.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.640+0000 7f7aa2ffd700 1 -- 172.21.15.148:0/1770548580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800e9c0 con 0x7f7a8c004690 2023-10-24T01:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 -- 172.21.15.148:0/1770548580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 msgr2=0x7f7a8c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1770548580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7a8c004b10 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f7a98009a80 tx=0x7f7a98009060).stop 2023-10-24T01:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aa8d0e700 1 -- 172.21.15.148:0/1770548580 reap_dead start 2023-10-24T01:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 -- 172.21.15.148:0/1770548580 shutdown_connections 2023-10-24T01:44:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 -- 172.21.15.148:0/1770548580 >> 172.21.15.148:0/1770548580 conn(0x7f7aa40945d0 msgr2=0x7f7aa406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 -- 172.21.15.148:0/1770548580 shutdown_connections 2023-10-24T01:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.641+0000 7f7aaa771700 1 -- 172.21.15.148:0/1770548580 wait complete. 2023-10-24T01:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.642+0000 7f7aaa771700 1 Processor -- start 2023-10-24T01:44:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.642+0000 7f7aaa771700 1 -- start start 2023-10-24T01:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 0x7f7aa4164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 0x7f7aa40af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4165840 con 0x7f7a8c004690 2023-10-24T01:44:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa41651d0 con 0x7f7aa4164720 2023-10-24T01:44:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aaa771700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4165510 con 0x7f7aa414f2e0 2023-10-24T01:44:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45690/0 (socket says 172.21.15.148:45690) 2023-10-24T01:44:27.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 -- 172.21.15.148:0/1544527434 learned_addr learned my addr 172.21.15.148:0/1544527434 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 0x7f7aa4164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa8d0e700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 0x7f7aa40af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 -- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 msgr2=0x7f7aa4164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 0x7f7aa4164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 -- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 msgr2=0x7f7aa40af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 0x7f7aa40af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa3fff700 1 -- 172.21.15.148:0/1544527434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa41493c0 con 0x7f7a8c004690 2023-10-24T01:44:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 0x7f7aa4164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.643+0000 7f7aa8d0e700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 0x7f7aa40af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:27.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7aa3fff700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f7a940029c0 tx=0x7f7a94007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94002e30 con 0x7f7a8c004690 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9400f8d0 con 0x7f7a8c004690 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa4164c10 con 0x7f7a8c004690 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9400fc50 con 0x7f7a8c004690 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.644+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40afcd0 con 0x7f7a8c004690 2023-10-24T01:44:27.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.645+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4153ce0 con 0x7f7a8c004690 2023-10-24T01:44:27.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.645+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 66) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7a94014450 con 0x7f7a8c004690 2023-10-24T01:44:27.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.645+0000 7f7a8bfff700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 0x7f7a900614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:27.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.645+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6653+0+0 (secure 0 0 0) 0x7f7a94079f80 con 0x7f7a8c004690 2023-10-24T01:44:27.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.646+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 0x7f7a900614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:27.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.646+0000 7f7aa37fe700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 0x7f7a900614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7aa40acfe0 tx=0x7f7a9801a000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:27.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.650+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7a9404aaf0 con 0x7f7a8c004690 2023-10-24T01:44:27.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:27.812+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7aa406c6b0 con 0x7f7a8c004690 2023-10-24T01:44:28.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.476+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7a94077d10 con 0x7f7a8c004690 2023-10-24T01:44:28.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.476+0000 7f7a8bfff700 1 -- 172.21.15.148:0/1544527434 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7a940726c0 con 0x7f7a8c004690 2023-10-24T01:44:28.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 msgr2=0x7f7a900614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 0x7f7a900614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7aa40acfe0 tx=0x7f7a9801a000).stop 2023-10-24T01:44:28.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 msgr2=0x7f7aa4148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f7a940029c0 tx=0x7f7a94007b90).stop 2023-10-24T01:44:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 shutdown_connections 2023-10-24T01:44:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aa4164720 0x7f7aa40af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7a9005f030 0x7f7a900614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a8c004690 0x7f7aa4148ed0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 --2- 172.21.15.148:0/1544527434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7aa414f2e0 0x7f7aa4164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 >> 172.21.15.148:0/1544527434 conn(0x7f7aa40945d0 msgr2=0x7f7aa40ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:28.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 shutdown_connections 2023-10-24T01:44:28.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.479+0000 7f7aaa771700 1 -- 172.21.15.148:0/1544527434 wait complete. 2023-10-24T01:44:28.483 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T01:44:28.494 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T01:44:28.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.612+0000 7fca8f4aa700 1 Processor -- start 2023-10-24T01:44:28.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.612+0000 7fca8f4aa700 1 -- start start 2023-10-24T01:44:28.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8f4aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca88155350 0x7fca880aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:28.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8f4aa700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880c7770 con 0x7fca880c81e0 2023-10-24T01:44:28.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8f4aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880c1070 con 0x7fca880a9f40 2023-10-24T01:44:28.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8f4aa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880c79e0 con 0x7fca88155350 2023-10-24T01:44:28.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8dca7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fca88155350 0x7fca880aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:28.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8eca9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fca880c81e0 0x7fca88153b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60286/0 (socket says 172.21.15.148:60286) 2023-10-24T01:44:28.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.613+0000 7fca8eca9700 1 -- 172.21.15.148:0/277028199 learned_addr learned my addr 172.21.15.148:0/277028199 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:28.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8dca7700 1 -- 172.21.15.148:0/277028199 >> v1:172.21.15.150:6789/0 conn(0x7fca880a9f40 legacy=0x7fca880c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:28.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8d4a6700 1 -- 172.21.15.148:0/277028199 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839381986 0 0) 0x7fca880c7770 con 0x7fca880c81e0 2023-10-24T01:44:28.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8dca7700 1 -- 172.21.15.148:0/277028199 >> v1:172.21.15.148:6789/0 conn(0x7fca880c81e0 legacy=0x7fca88153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8dca7700 1 -- 172.21.15.148:0/277028199 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880c7cc0 con 0x7fca88155350 2023-10-24T01:44:28.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8dca7700 1 --2- 172.21.15.148:0/277028199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca88155350 0x7fca880aa320 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fca78009760 tx=0x7fca78009060).ready entity=mon.0 client_cookie=10c75edddf2d5909 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:28.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8d4a6700 1 -- 172.21.15.148:0/277028199 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800b520 con 0x7fca88155350 2023-10-24T01:44:28.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8d4a6700 1 -- 172.21.15.148:0/277028199 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800b680 con 0x7fca88155350 2023-10-24T01:44:28.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8d4a6700 1 -- 172.21.15.148:0/277028199 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800ba00 con 0x7fca88155350 2023-10-24T01:44:28.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8f4aa700 1 -- 172.21.15.148:0/277028199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca88155350 msgr2=0x7fca880aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/277028199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca88155350 0x7fca880aa320 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fca78009760 tx=0x7fca78009060).stop 2023-10-24T01:44:28.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8f4aa700 1 -- 172.21.15.148:0/277028199 shutdown_connections 2023-10-24T01:44:28.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/277028199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca88155350 0x7fca880aa320 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.614+0000 7fca8f4aa700 1 -- 172.21.15.148:0/277028199 >> 172.21.15.148:0/277028199 conn(0x7fca88094420 msgr2=0x7fca8806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:28.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.615+0000 7fca8f4aa700 1 -- 172.21.15.148:0/277028199 shutdown_connections 2023-10-24T01:44:28.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.615+0000 7fca8f4aa700 1 -- 172.21.15.148:0/277028199 wait complete. 2023-10-24T01:44:28.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 Processor -- start 2023-10-24T01:44:28.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 -- start start 2023-10-24T01:44:28.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:28.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 0x7fca8814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:28.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca88155350 0x7fca880c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:28.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88157210 con 0x7fca880a9f40 2023-10-24T01:44:28.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88156720 con 0x7fca880c81e0 2023-10-24T01:44:28.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8f4aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88156970 con 0x7fca88155350 2023-10-24T01:44:28.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8e4a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:28.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8e4a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45698/0 (socket says 172.21.15.148:45698) 2023-10-24T01:44:28.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.616+0000 7fca8e4a8700 1 -- 172.21.15.148:0/3783988345 learned_addr learned my addr 172.21.15.148:0/3783988345 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:28.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8eca9700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca88155350 0x7fca880c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:28.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8dca7700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 0x7fca8814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:28.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 -- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca88155350 msgr2=0x7fca880c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca88155350 0x7fca880c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 -- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 msgr2=0x7fca8814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:28.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 0x7fca8814e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:28.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 -- 172.21.15.148:0/3783988345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780092a0 con 0x7fca880a9f40 2023-10-24T01:44:28.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8dca7700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 0x7fca8814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:28.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8e4a8700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fca8400b490 tx=0x7fca84006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:28.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84012410 con 0x7fca880a9f40 2023-10-24T01:44:28.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca840125b0 con 0x7fca880a9f40 2023-10-24T01:44:28.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca88156c50 con 0x7fca880a9f40 2023-10-24T01:44:28.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84012970 con 0x7fca880a9f40 2023-10-24T01:44:28.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.617+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca880aaa40 con 0x7fca880a9f40 2023-10-24T01:44:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.618+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca880aac60 con 0x7fca880a9f40 2023-10-24T01:44:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.618+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fca84012d20 con 0x7fca880a9f40 2023-10-24T01:44:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.619+0000 7fca7e7fc700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 0x7fca6c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.619+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6157+0+0 (secure 0 0 0) 0x7fca8407a100 con 0x7fca880a9f40 2023-10-24T01:44:28.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.619+0000 7fca8dca7700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 0x7fca6c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:28.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.619+0000 7fca8dca7700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 0x7fca6c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fca880c8b90 tx=0x7fca78017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:28.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.623+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fca8404b230 con 0x7fca880a9f40 2023-10-24T01:44:28.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:28.790+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca88047480 con 0x7fca880a9f40 2023-10-24T01:44:29.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.473+0000 7fca7e7fc700 1 -- 172.21.15.148:0/3783988345 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca8404e850 con 0x7fca880a9f40 2023-10-24T01:44:29.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 msgr2=0x7fca6c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 0x7fca6c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fca880c8b90 tx=0x7fca78017000).stop 2023-10-24T01:44:29.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 msgr2=0x7fca88156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fca8400b490 tx=0x7fca84006f10).stop 2023-10-24T01:44:29.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 shutdown_connections 2023-10-24T01:44:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca88155350 0x7fca880c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fca6c05f270 0x7fca6c061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fca880a9f40 0x7fca88156230 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 --2- 172.21.15.148:0/3783988345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca880c81e0 0x7fca8814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.476+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 >> 172.21.15.148:0/3783988345 conn(0x7fca88094420 msgr2=0x7fca88063a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:29.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.477+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 shutdown_connections 2023-10-24T01:44:29.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.477+0000 7fca8f4aa700 1 -- 172.21.15.148:0/3783988345 wait complete. 2023-10-24T01:44:29.480 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T01:44:29.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T01:44:29.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.609+0000 7fe18bd26700 1 Processor -- start 2023-10-24T01:44:29.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 -- start start 2023-10-24T01:44:29.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 0x7fe1840c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184063760 con 0x7fe1840be570 2023-10-24T01:44:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840bf110 con 0x7fe1840c65f0 2023-10-24T01:44:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.610+0000 7fe18bd26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184154b50 con 0x7fe1840c6210 2023-10-24T01:44:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe1892c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 0x7fe1840c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:36374/0 (socket says 172.21.15.148:36374) 2023-10-24T01:44:29.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe18a2c3700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe1840be570 0x7fe1840bea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:46104/0 (socket says 172.21.15.148:46104) 2023-10-24T01:44:29.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 -- 172.21.15.148:0/3650400863 learned_addr learned my addr 172.21.15.148:0/3650400863 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:29.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe1892c1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 0x7fe1840c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:44654/0 (socket says 172.21.15.148:44654) 2023-10-24T01:44:29.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 -- 172.21.15.148:0/3650400863 >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 msgr2=0x7fe1840c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 --2- 172.21.15.148:0/3650400863 >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 0x7fe1840c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 -- 172.21.15.148:0/3650400863 >> v1:172.21.15.150:6789/0 conn(0x7fe1840be570 legacy=0x7fe1840bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 -- 172.21.15.148:0/3650400863 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840c4be0 con 0x7fe1840c6210 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe189ac2700 1 --2- 172.21.15.148:0/3650400863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe180009f20 tx=0x7fe180009840).ready entity=mon.2 client_cookie=5487d9a8f3a7c328 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.611+0000 7fe188ac0700 1 -- 172.21.15.148:0/3650400863 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18000e070 con 0x7fe1840c6210 2023-10-24T01:44:29.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe188ac0700 1 -- 172.21.15.148:0/3650400863 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18000b9d0 con 0x7fe1840c6210 2023-10-24T01:44:29.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe188ac0700 1 -- 172.21.15.148:0/3650400863 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18000bd50 con 0x7fe1840c6210 2023-10-24T01:44:29.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 -- 172.21.15.148:0/3650400863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 msgr2=0x7fe1840c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 --2- 172.21.15.148:0/3650400863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fe180009f20 tx=0x7fe180009840).stop 2023-10-24T01:44:29.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 -- 172.21.15.148:0/3650400863 shutdown_connections 2023-10-24T01:44:29.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 --2- 172.21.15.148:0/3650400863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c4200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 --2- 172.21.15.148:0/3650400863 >> v2:172.21.15.150:3300/0 conn(0x7fe1840c65f0 0x7fe1840c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 -- 172.21.15.148:0/3650400863 >> 172.21.15.148:0/3650400863 conn(0x7fe184092510 msgr2=0x7fe184062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 -- 172.21.15.148:0/3650400863 shutdown_connections 2023-10-24T01:44:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.612+0000 7fe18bd26700 1 -- 172.21.15.148:0/3650400863 wait complete. 2023-10-24T01:44:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.613+0000 7fe18bd26700 1 Processor -- start 2023-10-24T01:44:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.613+0000 7fe18bd26700 1 -- start start 2023-10-24T01:44:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1840be570 0x7fe1840c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c1c10 con 0x7fe1840c65f0 2023-10-24T01:44:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c1000 con 0x7fe1840be570 2023-10-24T01:44:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18bd26700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c12e0 con 0x7fe1840c6210 2023-10-24T01:44:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45704/0 (socket says 172.21.15.148:45704) 2023-10-24T01:44:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 -- 172.21.15.148:0/2016283341 learned_addr learned my addr 172.21.15.148:0/2016283341 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe1892c1700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe189ac2700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1840be570 0x7fe1840c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 -- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 msgr2=0x7fe1840c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 -- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1840be570 msgr2=0x7fe1840c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1840be570 0x7fe1840c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.614+0000 7fe18a2c3700 1 -- 172.21.15.148:0/2016283341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009ae0 con 0x7fe1840c65f0 2023-10-24T01:44:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe18a2c3700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe17c00c440 tx=0x7fe17c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0070d0 con 0x7fe1840c65f0 2023-10-24T01:44:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c007230 con 0x7fe1840c65f0 2023-10-24T01:44:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1840c15c0 con 0x7fe1840c65f0 2023-10-24T01:44:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0075b0 con 0x7fe1840c65f0 2023-10-24T01:44:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.615+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1840c0d10 con 0x7fe1840c65f0 2023-10-24T01:44:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.616+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1840c1dc0 con 0x7fe1840c65f0 2023-10-24T01:44:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.616+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe17c0058f0 con 0x7fe1840c65f0 2023-10-24T01:44:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.617+0000 7fe179ffb700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 0x7fe168061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.617+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7fe17c079760 con 0x7fe1840c65f0 2023-10-24T01:44:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.617+0000 7fe189ac2700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 0x7fe168061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.617+0000 7fe189ac2700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 0x7fe168061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe18000b9a0 tx=0x7fe1840c4d70).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.621+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe1840c1dc0 con 0x7fe1840c65f0 2023-10-24T01:44:29.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.797+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe1840c1fa0 con 0x7fe1840c65f0 2023-10-24T01:44:29.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.800+0000 7fe179ffb700 1 -- 172.21.15.148:0/2016283341 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v28) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe17c04aa30 con 0x7fe1840c65f0 2023-10-24T01:44:29.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 msgr2=0x7fe168061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 0x7fe168061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe18000b9a0 tx=0x7fe1840c4d70).stop 2023-10-24T01:44:29.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 msgr2=0x7fe1840ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe17c00c440 tx=0x7fe17c007dd0).stop 2023-10-24T01:44:29.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 shutdown_connections 2023-10-24T01:44:29.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fe16805f240 0x7fe168061700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1840c65f0 0x7fe1840ab130 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1840be570 0x7fe1840c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 --2- 172.21.15.148:0/2016283341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1840c6210 0x7fe1840c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 >> 172.21.15.148:0/2016283341 conn(0x7fe184092510 msgr2=0x7fe184066940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:29.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 shutdown_connections 2023-10-24T01:44:29.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.802+0000 7fe18bd26700 1 -- 172.21.15.148:0/2016283341 wait complete. 2023-10-24T01:44:29.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T01:44:29.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.929+0000 7f12a3544700 1 Processor -- start 2023-10-24T01:44:29.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.929+0000 7f12a3544700 1 -- start start 2023-10-24T01:44:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a3544700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f129c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a3544700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0c71d0 con 0x7f129c098bd0 2023-10-24T01:44:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a3544700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0c9410 con 0x7f129c0bffd0 2023-10-24T01:44:29.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a3544700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c6a10 con 0x7f129c154430 2023-10-24T01:44:29.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a0adf700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f129c098bd0 0x7f129c0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60292/0 (socket says 172.21.15.148:60292) 2023-10-24T01:44:29.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a0adf700 1 -- 172.21.15.148:0/3228958435 learned_addr learned my addr 172.21.15.148:0/3228958435 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f12a12e0700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f129c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816783249 0 0) 0x7f129c0c71d0 con 0x7f129c098bd0 2023-10-24T01:44:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12880033f0 con 0x7f129c098bd0 2023-10-24T01:44:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636701256 0 0) 0x7f12880033f0 con 0x7f129c098bd0 2023-10-24T01:44:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 msgr2=0x7f129c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f129c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 >> v1:172.21.15.150:6789/0 conn(0x7f129c0bffd0 legacy=0x7f129c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0ca8b0 con 0x7f129c098bd0 2023-10-24T01:44:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f128c001470 con 0x7f129c098bd0 2023-10-24T01:44:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 >> v1:172.21.15.148:6789/0 conn(0x7f129c098bd0 legacy=0x7f129c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.930+0000 7f1293fff700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1288003910 0x7f1288003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f1288004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1288004b80 0x7f1288005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c6a10 con 0x7f1288004b80 2023-10-24T01:44:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128800b910 con 0x7f1288003910 2023-10-24T01:44:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128800bad0 con 0x7f129c154430 2023-10-24T01:44:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1288004b80 0x7f1288005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a12e0700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1288003910 0x7f1288003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a0adf700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f1288004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 -- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 msgr2=0x7f1288004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:29.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c154430 0x7f1288004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 -- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1288003910 msgr2=0x7f1288003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:29.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1288003910 0x7f1288003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 -- 172.21.15.148:0/3228958435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880033f0 con 0x7f1288004b80 2023-10-24T01:44:29.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1288004b80 0x7f1288005000 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f1298001730 tx=0x7f1298007bb0).ready entity=mon.0 client_cookie=ae5c98b2c8ea7cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298007020 con 0x7f1288004b80 2023-10-24T01:44:29.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298007180 con 0x7f1288004b80 2023-10-24T01:44:29.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.931+0000 7f1293fff700 1 -- 172.21.15.148:0/3228958435 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298007500 con 0x7f1288004b80 2023-10-24T01:44:29.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 -- 172.21.15.148:0/3228958435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1288004b80 msgr2=0x7f1288005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 --2- 172.21.15.148:0/3228958435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1288004b80 0x7f1288005000 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f1298001730 tx=0x7f1298007bb0).stop 2023-10-24T01:44:29.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a1ae1700 1 -- 172.21.15.148:0/3228958435 reap_dead start 2023-10-24T01:44:29.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 -- 172.21.15.148:0/3228958435 shutdown_connections 2023-10-24T01:44:29.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 -- 172.21.15.148:0/3228958435 >> 172.21.15.148:0/3228958435 conn(0x7f129c0cb070 msgr2=0x7f129c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:29.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 -- 172.21.15.148:0/3228958435 shutdown_connections 2023-10-24T01:44:29.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.932+0000 7f12a3544700 1 -- 172.21.15.148:0/3228958435 wait complete. 2023-10-24T01:44:29.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.933+0000 7f12a3544700 1 Processor -- start 2023-10-24T01:44:29.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.933+0000 7f12a3544700 1 -- start start 2023-10-24T01:44:29.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c14db60 0x7f129c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f129c0c2fd0 0x7f129c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0aecb0 con 0x7f129c0c3450 2023-10-24T01:44:29.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0ae0a0 con 0x7f129c0c2fd0 2023-10-24T01:44:29.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0ae380 con 0x7f129c14db60 2023-10-24T01:44:29.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45718/0 (socket says 172.21.15.148:45718) 2023-10-24T01:44:29.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 -- 172.21.15.148:0/164265394 learned_addr learned my addr 172.21.15.148:0/164265394 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:29.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a12e0700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c14db60 0x7f129c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a0adf700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f129c0c2fd0 0x7f129c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 -- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c14db60 msgr2=0x7f129c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c14db60 0x7f129c14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 -- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f129c0c2fd0 msgr2=0x7f129c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:29.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f129c0c2fd0 0x7f129c0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:29.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 -- 172.21.15.148:0/164265394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0ae660 con 0x7f129c0c3450 2023-10-24T01:44:29.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a1ae1700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f128800b8e0 tx=0x7f1298015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298018030 con 0x7f129c0c3450 2023-10-24T01:44:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298013670 con 0x7f129c0c3450 2023-10-24T01:44:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298013a30 con 0x7f129c0c3450 2023-10-24T01:44:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.934+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0ae940 con 0x7f129c0c3450 2023-10-24T01:44:29.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.935+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c0b0bb0 con 0x7f129c0c3450 2023-10-24T01:44:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.935+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c06c6b0 con 0x7f129c0c3450 2023-10-24T01:44:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.936+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f12980123c0 con 0x7f129c0c3450 2023-10-24T01:44:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.936+0000 7f12917fa700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 0x7f1280061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.936+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f129807a490 con 0x7f129c0c3450 2023-10-24T01:44:29.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.936+0000 7f12a12e0700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 0x7f1280061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.937+0000 7f12a12e0700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 0x7f1280061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f12940094d0 tx=0x7f129400b040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:29.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:29.940+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f129804b700 con 0x7f129c0c3450 2023-10-24T01:44:30.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.104+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f129c0c6c10 con 0x7f129c0c3450 2023-10-24T01:44:30.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.108+0000 7f12917fa700 1 -- 172.21.15.148:0/164265394 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12980240a0 con 0x7f129c0c3450 2023-10-24T01:44:30.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 msgr2=0x7f1280061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 0x7f1280061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f12940094d0 tx=0x7f129400b040).stop 2023-10-24T01:44:30.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 msgr2=0x7f129c0af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f128800b8e0 tx=0x7f1298015000).stop 2023-10-24T01:44:30.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 shutdown_connections 2023-10-24T01:44:30.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f128005f270 0x7f1280061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f129c0c3450 0x7f129c0af630 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f129c14db60 0x7f129c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 --2- 172.21.15.148:0/164265394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f129c0c2fd0 0x7f129c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 >> 172.21.15.148:0/164265394 conn(0x7f129c0cb070 msgr2=0x7f129c0c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:30.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 shutdown_connections 2023-10-24T01:44:30.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.110+0000 7f12a3544700 1 -- 172.21.15.148:0/164265394 wait complete. 2023-10-24T01:44:30.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-24T01:44:30.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.235+0000 7f8fde6f4700 1 Processor -- start 2023-10-24T01:44:30.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.235+0000 7f8fde6f4700 1 -- start start 2023-10-24T01:44:30.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fde6f4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8fd80aa010 0x7f8fd80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fde6f4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80aa820 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fde6f4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80c0960 con 0x7f8fd80c6710 2023-10-24T01:44:30.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fde6f4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80c0c40 con 0x7f8fd80aa010 2023-10-24T01:44:30.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fdcc91700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f8fd80aa3f0 0x7f8fd8069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60298/0 (socket says 172.21.15.148:60298) 2023-10-24T01:44:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.236+0000 7f8fdcc91700 1 -- 172.21.15.148:0/4260454386 learned_addr learned my addr 172.21.15.148:0/4260454386 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/4260454386 >> v2:172.21.15.150:3300/0 conn(0x7f8fd80aa010 0x7f8fd80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456270868 0 0) 0x7f8fd80aa820 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc00033f0 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794441367 0 0) 0x7f8fc00033f0 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 >> v2:172.21.15.150:3300/0 conn(0x7f8fd80aa010 msgr2=0x7f8fd80c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 --2- 172.21.15.148:0/4260454386 >> v2:172.21.15.150:3300/0 conn(0x7f8fd80aa010 0x7f8fd80c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 >> v1:172.21.15.150:6789/0 conn(0x7f8fd80c6710 legacy=0x7f8fd8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80c0f20 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f8fd00017f0 con 0x7f8fd80aa3f0 2023-10-24T01:44:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 >> v1:172.21.15.148:6789/0 conn(0x7f8fd80aa3f0 legacy=0x7f8fd8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 0x7f8fc0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc0004690 0x7f8fc0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fc0005000 0x7f8fc000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80c0c40 con 0x7f8fc00038e0 2023-10-24T01:44:30.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc000bf60 con 0x7f8fc0004690 2023-10-24T01:44:30.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc000c0f0 con 0x7f8fc0005000 2023-10-24T01:44:30.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 0x7f8fc0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd77fe700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc0004690 0x7f8fc0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fdcc91700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fc0005000 0x7f8fc000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 -- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fc0005000 msgr2=0x7f8fc000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:30.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fc0005000 0x7f8fc000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 -- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc0004690 msgr2=0x7f8fc0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:30.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc0004690 0x7f8fc0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fd7fff700 1 -- 172.21.15.148:0/4260454386 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00033f0 con 0x7f8fc00038e0 2023-10-24T01:44:30.248 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.237+0000 7f8fdcc91700 1 -- 172.21.15.148:0/4260454386 reap_dead start 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 0x7f8fc0003d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f8fc8009a80 tx=0x7f8fc8009060).ready entity=mon.0 client_cookie=b245514880a45c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8009430 con 0x7f8fc00038e0 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800e640 con 0x7f8fc00038e0 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fd6ffd700 1 -- 172.21.15.148:0/4260454386 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800e9c0 con 0x7f8fc00038e0 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 -- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 msgr2=0x7f8fc0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 0x7f8fc0003d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f8fc8009a80 tx=0x7f8fc8009060).stop 2023-10-24T01:44:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 -- 172.21.15.148:0/4260454386 shutdown_connections 2023-10-24T01:44:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/4260454386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fc00038e0 0x7f8fc0003d00 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 -- 172.21.15.148:0/4260454386 >> 172.21.15.148:0/4260454386 conn(0x7f8fd80caf40 msgr2=0x7f8fd80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 -- 172.21.15.148:0/4260454386 shutdown_connections 2023-10-24T01:44:30.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.238+0000 7f8fde6f4700 1 -- 172.21.15.148:0/4260454386 wait complete. 2023-10-24T01:44:30.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.239+0000 7f8fde6f4700 1 Processor -- start 2023-10-24T01:44:30.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 -- start start 2023-10-24T01:44:30.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc00038e0 0x7f8fd8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 0x7f8fd8164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81652e0 con 0x7f8fd81438e0 2023-10-24T01:44:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81655c0 con 0x7f8fc00038e0 2023-10-24T01:44:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fde6f4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8155f40 con 0x7f8fd8143d60 2023-10-24T01:44:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fd77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fd77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45748/0 (socket says 172.21.15.148:45748) 2023-10-24T01:44:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fd77fe700 1 -- 172.21.15.148:0/1640584087 learned_addr learned my addr 172.21.15.148:0/1640584087 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc00038e0 0x7f8fd8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.240+0000 7f8fdcc91700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 0x7f8fd8164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 -- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 msgr2=0x7f8fd8164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 0x7f8fd8164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 -- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc00038e0 msgr2=0x7f8fd8156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:30.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc00038e0 0x7f8fd8156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:30.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 -- 172.21.15.148:0/1640584087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8156220 con 0x7f8fd81438e0 2023-10-24T01:44:30.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fdcc91700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 0x7f8fd8164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:30.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fd77fe700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f8fcc0028c0 tx=0x7f8fcc007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:30.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc011590 con 0x7f8fd81438e0 2023-10-24T01:44:30.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0116f0 con 0x7f8fd81438e0 2023-10-24T01:44:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc011a70 con 0x7f8fd81438e0 2023-10-24T01:44:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd8156500 con 0x7f8fd81438e0 2023-10-24T01:44:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.241+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8150ce0 con 0x7f8fd81438e0 2023-10-24T01:44:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.242+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8156870 con 0x7f8fd81438e0 2023-10-24T01:44:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.242+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8fcc0133f0 con 0x7f8fd81438e0 2023-10-24T01:44:30.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.242+0000 7f8fbffff700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 0x7f8fc4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:30.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.243+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f8fcc079bd0 con 0x7f8fd81438e0 2023-10-24T01:44:30.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.243+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 0x7f8fc4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:30.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.243+0000 7f8fd7fff700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 0x7f8fc4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8fc8006d50 tx=0x7f8fc801a000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:30.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.247+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8fcc049af0 con 0x7f8fd81438e0 2023-10-24T01:44:30.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:30.470+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f8fd80cbb80 con 0x7f8fd81438e0 2023-10-24T01:44:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.476+0000 7f8fbffff700 1 -- 172.21.15.148:0/1640584087 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2424) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8fcc018030 con 0x7f8fd81438e0 2023-10-24T01:44:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 msgr2=0x7f8fc4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 0x7f8fc4061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8fc8006d50 tx=0x7f8fc801a000).stop 2023-10-24T01:44:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 msgr2=0x7f8fd81647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f8fcc0028c0 tx=0x7f8fcc007bb0).stop 2023-10-24T01:44:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 shutdown_connections 2023-10-24T01:44:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd8143d60 0x7f8fd8164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fc00038e0 0x7f8fd8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f8fc405f240 0x7f8fc4061700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 --2- 172.21.15.148:0/1640584087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8fd81438e0 0x7f8fd81647f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.478+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 >> 172.21.15.148:0/1640584087 conn(0x7f8fd80caf40 msgr2=0x7f8fd8063b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.479+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 shutdown_connections 2023-10-24T01:44:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.479+0000 7f8fde6f4700 1 -- 172.21.15.148:0/1640584087 wait complete. 2023-10-24T01:44:31.493 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-10-24T01:44:31.494 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-10-24T01:44:31.494 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T01:44:31.494 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-24T01:44:31.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.607+0000 7fa4b3fff700 1 Processor -- start 2023-10-24T01:44:31.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.607+0000 7fa4b3fff700 1 -- start start 2023-10-24T01:44:31.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.608+0000 7fa4b3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.608+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.608+0000 7fa4b3fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b40c6410 con 0x7fa4b40c0cd0 2023-10-24T01:44:31.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.608+0000 7fa4b3fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b40c1140 con 0x7fa4b40aa140 2023-10-24T01:44:31.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.608+0000 7fa4b3fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40ca6e0 con 0x7fa4b40ca110 2023-10-24T01:44:31.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:44714/0 (socket says 172.21.15.148:44714) 2023-10-24T01:44:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:36442/0 (socket says 172.21.15.148:36442) 2023-10-24T01:44:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b37fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa4b40c0cd0 0x7fa4b4157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:46150/0 (socket says 172.21.15.148:46150) 2023-10-24T01:44:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b2ffd700 1 -- 172.21.15.148:0/3446113949 learned_addr learned my addr 172.21.15.148:0/3446113949 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 -- 172.21.15.148:0/3446113949 >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 msgr2=0x7fa4b40c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 --2- 172.21.15.148:0/3446113949 >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 -- 172.21.15.148:0/3446113949 >> v1:172.21.15.150:6789/0 conn(0x7fa4b40c0cd0 legacy=0x7fa4b4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 -- 172.21.15.148:0/3446113949 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40ca9c0 con 0x7fa4b40ca110 2023-10-24T01:44:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b2ffd700 1 --2- 172.21.15.148:0/3446113949 >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4aa7fc700 1 --2- 172.21.15.148:0/3446113949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fa49c009760 tx=0x7fa49c009060).ready entity=mon.2 client_cookie=39ebfac07f87bbdb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b27fc700 1 -- 172.21.15.148:0/3446113949 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00f510 con 0x7fa4b40ca110 2023-10-24T01:44:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b27fc700 1 -- 172.21.15.148:0/3446113949 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00f670 con 0x7fa4b40ca110 2023-10-24T01:44:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.609+0000 7fa4b27fc700 1 -- 172.21.15.148:0/3446113949 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00f9f0 con 0x7fa4b40ca110 2023-10-24T01:44:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3446113949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 msgr2=0x7fa4b40c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3446113949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fa49c009760 tx=0x7fa49c009060).stop 2023-10-24T01:44:31.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3446113949 shutdown_connections 2023-10-24T01:44:31.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3446113949 >> v2:172.21.15.150:3300/0 conn(0x7fa4b40aa140 0x7fa4b40c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3446113949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40ca110 0x7fa4b40c07e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3446113949 >> 172.21.15.148:0/3446113949 conn(0x7fa4b40944a0 msgr2=0x7fa4b406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:31.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3446113949 shutdown_connections 2023-10-24T01:44:31.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.610+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3446113949 wait complete. 2023-10-24T01:44:31.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.611+0000 7fa4b3fff700 1 Processor -- start 2023-10-24T01:44:31.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.611+0000 7fa4b3fff700 1 -- start start 2023-10-24T01:44:31.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40aa140 0x7fa4b4163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b40c0cd0 0x7fa4b40ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40acf60 con 0x7fa4b40ca110 2023-10-24T01:44:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40c2a00 con 0x7fa4b40c0cd0 2023-10-24T01:44:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b3fff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40c2ce0 con 0x7fa4b40aa140 2023-10-24T01:44:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45750/0 (socket says 172.21.15.148:45750) 2023-10-24T01:44:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b37fe700 1 -- 172.21.15.148:0/3672413353 learned_addr learned my addr 172.21.15.148:0/3672413353 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4b2ffd700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40aa140 0x7fa4b4163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.612+0000 7fa4aa7fc700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b40c0cd0 0x7fa4b40ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 -- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40aa140 msgr2=0x7fa4b4163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40aa140 0x7fa4b4163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 -- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b40c0cd0 msgr2=0x7fa4b40ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:31.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b40c0cd0 0x7fa4b40ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:31.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 -- 172.21.15.148:0/3672413353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4009370 con 0x7fa4b40ca110 2023-10-24T01:44:31.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b37fe700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa4ac00c790 tx=0x7fa4ac0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:31.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac005c70 con 0x7fa4b40ca110 2023-10-24T01:44:31.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac005dd0 con 0x7fa4b40ca110 2023-10-24T01:44:31.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c0092a0 con 0x7fa4b40ca110 2023-10-24T01:44:31.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac007320 con 0x7fa4b40ca110 2023-10-24T01:44:31.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.613+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b40c3320 con 0x7fa4b40ca110 2023-10-24T01:44:31.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.614+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b4047480 con 0x7fa4b40ca110 2023-10-24T01:44:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.614+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa4ac0076d0 con 0x7fa4b40ca110 2023-10-24T01:44:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.614+0000 7fa4ab7fe700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 0x7fa494061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.615+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7fa4ac07a0d0 con 0x7fa4b40ca110 2023-10-24T01:44:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.615+0000 7fa4b2ffd700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 0x7fa494061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:31.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.615+0000 7fa4b2ffd700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 0x7fa494061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa4a4006fd0 tx=0x7fa4a40090f0).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:31.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.619+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa4ac04b3a0 con 0x7fa4b40ca110 2023-10-24T01:44:31.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:31.846+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fa4b40c60a0 con 0x7fa4b40ca110 2023-10-24T01:44:32.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.478+0000 7fa4ab7fe700 1 -- 172.21.15.148:0/3672413353 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2425) v1 ==== 177+0+0 (secure 0 0 0) 0x7fa4ac04e9c0 con 0x7fa4b40ca110 2023-10-24T01:44:32.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 msgr2=0x7fa494061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 0x7fa494061730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa4a4006fd0 tx=0x7fa4a40090f0).stop 2023-10-24T01:44:32.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 msgr2=0x7fa4b40ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa4ac00c790 tx=0x7fa4ac0015e0).stop 2023-10-24T01:44:32.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 shutdown_connections 2023-10-24T01:44:32.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa49405f270 0x7fa494061730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4b40ca110 0x7fa4b40ac6b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4b40aa140 0x7fa4b4163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 --2- 172.21.15.148:0/3672413353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4b40c0cd0 0x7fa4b40ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 >> 172.21.15.148:0/3672413353 conn(0x7fa4b40944a0 msgr2=0x7fa4b40a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:32.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 shutdown_connections 2023-10-24T01:44:32.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.481+0000 7fa4b3fff700 1 -- 172.21.15.148:0/3672413353 wait complete. 2023-10-24T01:44:32.495 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T01:44:32.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.609+0000 7f44e5ff9700 1 Processor -- start 2023-10-24T01:44:32.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.609+0000 7f44e5ff9700 1 -- start start 2023-10-24T01:44:32.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44e5ff9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 0x7f44e0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44e5ff9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44e0098bd0 0x7f44e00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44e5ff9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e00c71d0 con 0x7f44e00bffd0 2023-10-24T01:44:32.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44e5ff9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00c9410 con 0x7f44e0098bd0 2023-10-24T01:44:32.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44e5ff9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00c6c10 con 0x7f44e0154430 2023-10-24T01:44:32.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44e0098bd0 0x7f44e00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f44e0098bd0 0x7f44e00c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45766/0 (socket says 172.21.15.148:45766) 2023-10-24T01:44:32.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 -- 172.21.15.148:0/2618234338 learned_addr learned my addr 172.21.15.148:0/2618234338 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:32.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44df7fe700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 0x7f44e0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 -- 172.21.15.148:0/2618234338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 msgr2=0x7f44e0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:32.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 0x7f44e0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 -- 172.21.15.148:0/2618234338 >> v1:172.21.15.150:6789/0 conn(0x7f44e00bffd0 legacy=0x7f44e00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:32.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 -- 172.21.15.148:0/2618234338 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e00c6ef0 con 0x7f44e0098bd0 2023-10-24T01:44:32.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44df7fe700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 0x7f44e0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:32.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.610+0000 7f44deffd700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e0098bd0 0x7f44e00c6300 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f44d4009830 tx=0x7f44d40090f0).ready entity=mon.0 client_cookie=3d1488e3a9fcffdc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:32.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44de7fc700 1 -- 172.21.15.148:0/2618234338 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400b600 con 0x7f44e0098bd0 2023-10-24T01:44:32.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44de7fc700 1 -- 172.21.15.148:0/2618234338 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400b760 con 0x7f44e0098bd0 2023-10-24T01:44:32.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44de7fc700 1 -- 172.21.15.148:0/2618234338 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bae0 con 0x7f44e0098bd0 2023-10-24T01:44:32.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 -- 172.21.15.148:0/2618234338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e0098bd0 msgr2=0x7f44e00c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e0098bd0 0x7f44e00c6300 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f44d4009830 tx=0x7f44d40090f0).stop 2023-10-24T01:44:32.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 -- 172.21.15.148:0/2618234338 shutdown_connections 2023-10-24T01:44:32.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0154430 0x7f44e0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/2618234338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e0098bd0 0x7f44e00c6300 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 -- 172.21.15.148:0/2618234338 >> 172.21.15.148:0/2618234338 conn(0x7f44e00cb070 msgr2=0x7f44e00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:32.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 -- 172.21.15.148:0/2618234338 shutdown_connections 2023-10-24T01:44:32.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.611+0000 7f44e5ff9700 1 -- 172.21.15.148:0/2618234338 wait complete. 2023-10-24T01:44:32.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.612+0000 7f44e5ff9700 1 Processor -- start 2023-10-24T01:44:32.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.612+0000 7f44e5ff9700 1 -- start start 2023-10-24T01:44:32.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0098bd0 0x7f44e0164100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e0154430 0x7f44e00c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0149640 con 0x7f44e00bffd0 2023-10-24T01:44:32.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0150440 con 0x7f44e0154430 2023-10-24T01:44:32.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44e5ff9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0150690 con 0x7f44e0098bd0 2023-10-24T01:44:32.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44deffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45774/0 (socket says 172.21.15.148:45774) 2023-10-24T01:44:32.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44deffd700 1 -- 172.21.15.148:0/456361101 learned_addr learned my addr 172.21.15.148:0/456361101 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:32.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44df7fe700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0098bd0 0x7f44e0164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.613+0000 7f44dffff700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e0154430 0x7f44e00c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 -- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0098bd0 msgr2=0x7f44e0164100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0098bd0 0x7f44e0164100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 -- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e0154430 msgr2=0x7f44e00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e0154430 0x7f44e00c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 -- 172.21.15.148:0/456361101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4009370 con 0x7f44e00bffd0 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44deffd700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f44d4011000 tx=0x7f44d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bae0 con 0x7f44e00bffd0 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4000c90 con 0x7f44e00bffd0 2023-10-24T01:44:32.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d401c670 con 0x7f44e00bffd0 2023-10-24T01:44:32.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e0150970 con 0x7f44e00bffd0 2023-10-24T01:44:32.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.614+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e0150f30 con 0x7f44e00bffd0 2023-10-24T01:44:32.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.615+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00c7650 con 0x7f44e00bffd0 2023-10-24T01:44:32.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.615+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f44d401ca20 con 0x7f44e00bffd0 2023-10-24T01:44:32.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.616+0000 7f44c77fe700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 0x7f44cc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:32.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.616+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f44d407bb00 con 0x7f44e00bffd0 2023-10-24T01:44:32.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.616+0000 7f44df7fe700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 0x7f44cc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:32.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.616+0000 7f44df7fe700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 0x7f44cc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44d000e4b0 tx=0x7f44d0007670).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:32.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.620+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f44d404cdd0 con 0x7f44e00bffd0 2023-10-24T01:44:32.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.787+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f44e006c6b0 con 0x7f44e00bffd0 2023-10-24T01:44:32.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.791+0000 7f44c77fe700 1 -- 172.21.15.148:0/456361101 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44d4020070 con 0x7f44e00bffd0 2023-10-24T01:44:32.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 msgr2=0x7f44cc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 0x7f44cc061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f44d000e4b0 tx=0x7f44d0007670).stop 2023-10-24T01:44:32.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 msgr2=0x7f44e00c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:32.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f44d4011000 tx=0x7f44d4017000).stop 2023-10-24T01:44:32.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 shutdown_connections 2023-10-24T01:44:32.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44e0154430 0x7f44e00c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44e0098bd0 0x7f44e0164100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f44cc05f270 0x7f44cc061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 --2- 172.21.15.148:0/456361101 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44e00bffd0 0x7f44e00c4800 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:32.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 >> 172.21.15.148:0/456361101 conn(0x7f44e00cb070 msgr2=0x7f44e0149800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:32.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 shutdown_connections 2023-10-24T01:44:32.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:32.793+0000 7f44e5ff9700 1 -- 172.21.15.148:0/456361101 wait complete. 2023-10-24T01:44:32.808 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T01:44:32.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:32.852 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:32.896 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T01:44:32.897 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T01:44:32.897 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:33.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.010+0000 7f2a13fc3700 1 Processor -- start 2023-10-24T01:44:33.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.010+0000 7f2a13fc3700 1 -- start start 2023-10-24T01:44:33.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a13fc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 0x7f2a0c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a13fc3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a0c0c6710 0x7f2a0c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a13fc3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c0c0960 con 0x7f2a0c158770 2023-10-24T01:44:33.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a13fc3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c0aa8e0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a13fc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0c0c40 con 0x7f2a0c0aa010 2023-10-24T01:44:33.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2a0c0c6710 0x7f2a0c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a12560700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2a0c158770 0x7f2a0c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60308/0 (socket says 172.21.15.148:60308) 2023-10-24T01:44:33.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a12560700 1 -- 172.21.15.148:0/3682810803 learned_addr learned my addr 172.21.15.148:0/3682810803 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:33.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 0x7f2a0c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 -- 172.21.15.148:0/3682810803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 msgr2=0x7f2a0c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:33.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 0x7f2a0c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 -- 172.21.15.148:0/3682810803 >> v1:172.21.15.148:6789/0 conn(0x7f2a0c158770 legacy=0x7f2a0c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 -- 172.21.15.148:0/3682810803 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0c0f20 con 0x7f2a0c0c6710 2023-10-24T01:44:33.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a10d5d700 1 -- 172.21.15.148:0/3682810803 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484544569 0 0) 0x7f2a0c0c0960 con 0x7f2a0c158770 2023-10-24T01:44:33.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 0x7f2a0c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:33.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a1155e700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c0aa3f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f29fc009760 tx=0x7f29fc009060).ready entity=mon.0 client_cookie=f5c20b99560ab518 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:33.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a10d5d700 1 -- 172.21.15.148:0/3682810803 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00b580 con 0x7f2a0c0c6710 2023-10-24T01:44:33.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a10d5d700 1 -- 172.21.15.148:0/3682810803 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc00b6e0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.011+0000 7f2a10d5d700 1 -- 172.21.15.148:0/3682810803 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00ba60 con 0x7f2a0c0c6710 2023-10-24T01:44:33.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 -- 172.21.15.148:0/3682810803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 msgr2=0x7f2a0c0aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c0aa3f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f29fc009760 tx=0x7f29fc009060).stop 2023-10-24T01:44:33.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 -- 172.21.15.148:0/3682810803 shutdown_connections 2023-10-24T01:44:33.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c0aa010 0x7f2a0c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/3682810803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c0aa3f0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 -- 172.21.15.148:0/3682810803 >> 172.21.15.148:0/3682810803 conn(0x7f2a0c0caf40 msgr2=0x7f2a0c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:33.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 -- 172.21.15.148:0/3682810803 shutdown_connections 2023-10-24T01:44:33.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.012+0000 7f2a13fc3700 1 -- 172.21.15.148:0/3682810803 wait complete. 2023-10-24T01:44:33.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.013+0000 7f2a13fc3700 1 Processor -- start 2023-10-24T01:44:33.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.013+0000 7f2a13fc3700 1 -- start start 2023-10-24T01:44:33.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 0x7f2a0c1652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 0x7f2a0c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c155c10 con 0x7f2a0c0c6710 2023-10-24T01:44:33.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c154d30 con 0x7f2a0c0aa010 2023-10-24T01:44:33.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a13fc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c155000 con 0x7f2a0c158770 2023-10-24T01:44:33.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45786/0 (socket says 172.21.15.148:45786) 2023-10-24T01:44:33.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 -- 172.21.15.148:0/776836650 learned_addr learned my addr 172.21.15.148:0/776836650 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:33.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a12560700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 0x7f2a0c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 0x7f2a0c1652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 -- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 msgr2=0x7f2a0c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 0x7f2a0c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 -- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 msgr2=0x7f2a0c1652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 0x7f2a0c1652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 -- 172.21.15.148:0/776836650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0092a0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a12560700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 0x7f2a0c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:33.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 0x7f2a0c1652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:33.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.014+0000 7f2a1155e700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f29fc011000 tx=0x7f29fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:33.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.015+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00ba60 con 0x7f2a0c0c6710 2023-10-24T01:44:33.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.015+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc000c90 con 0x7f2a0c0c6710 2023-10-24T01:44:33.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.015+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c1552e0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.015+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc01b660 con 0x7f2a0c0c6710 2023-10-24T01:44:33.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.015+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c1558a0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.016+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0c06c6b0 con 0x7f2a0c0c6710 2023-10-24T01:44:33.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.016+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f29fc01ba50 con 0x7f2a0c0c6710 2023-10-24T01:44:33.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.016+0000 7f2a01ffb700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 0x7f29f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:33.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.017+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f29fc07bd10 con 0x7f2a0c0c6710 2023-10-24T01:44:33.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.017+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 0x7f29f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:33.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.017+0000 7f2a11d5f700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 0x7f29f0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2a0c06a1a0 tx=0x7f2a08008040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:33.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.021+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29fc04cf20 con 0x7f2a0c0c6710 2023-10-24T01:44:33.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.224+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a0c155d50 con 0x7f2a0c0c6710 2023-10-24T01:44:33.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.225+0000 7f2a01ffb700 1 -- 172.21.15.148:0/776836650 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f2a0c155d50 con 0x7f2a0c0c6710 2023-10-24T01:44:33.227 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:33.227 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6761,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1020839895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1020839895},{"type":"v1","addr":"172.21.15.150:6835","nonce":1020839895}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7534,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/643790224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":643790224},{"type":"v1","addr":"172.21.15.150:6837","nonce":643790224}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3831103073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3831103073},{"type":"v1","addr":"172.21.15.148:6834","nonce":3831103073}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2354460715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2354460715},{"type":"v1","addr":"172.21.15.148:6835","nonce":2354460715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-24T01:44:33.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 msgr2=0x7f29f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 0x7f29f0061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2a0c06a1a0 tx=0x7f2a08008040).stop 2023-10-24T01:44:33.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 msgr2=0x7f2a0c154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:33.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f29fc011000 tx=0x7f29fc017000).stop 2023-10-24T01:44:33.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 shutdown_connections 2023-10-24T01:44:33.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c158770 0x7f2a0c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c0aa010 0x7f2a0c1652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f29f005f270 0x7f29f0061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 --2- 172.21.15.148:0/776836650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a0c0c6710 0x7f2a0c154840 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:33.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 >> 172.21.15.148:0/776836650 conn(0x7f2a0c0caf40 msgr2=0x7f2a0c0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:33.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 shutdown_connections 2023-10-24T01:44:33.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:33.227+0000 7f2a13fc3700 1 -- 172.21.15.148:0/776836650 wait complete. 2023-10-24T01:44:33.232 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 51 2023-10-24T01:44:33.241 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T01:44:33.241 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T01:44:33.241 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T01:44:33.242 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:44:33.242 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T01:44:33.242 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T01:44:33.243 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T01:44:33.243 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:44:33.243 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T01:44:33.243 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T01:44:33.244 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T01:44:33.244 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:44:33.244 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T01:44:33.245 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T01:44:33.245 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T01:44:33.245 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:44:33.250 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T01:44:33.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T01:44:33.251 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T01:44:33.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T01:44:33.259 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T01:44:33.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T01:44:33.293 INFO:tasks.ceph.mds.a:Started 2023-10-24T01:44:33.294 DEBUG:teuthology.parallel:result is None 2023-10-24T01:44:33.295 INFO:tasks.ceph.mds.c:Started 2023-10-24T01:44:33.295 DEBUG:teuthology.parallel:result is None 2023-10-24T01:44:33.302 INFO:tasks.ceph.mds.d:Started 2023-10-24T01:44:33.302 DEBUG:teuthology.parallel:result is None 2023-10-24T01:44:33.364 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T01:44:33.365 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T01:44:33.382 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T01:44:39.259 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T01:44:39.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T01:44:39.262 INFO:tasks.ceph.mds.b:Started 2023-10-24T01:44:39.263 DEBUG:teuthology.parallel:result is None 2023-10-24T01:44:39.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T01:44:39.344 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T01:44:39.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 Processor -- start 2023-10-24T01:44:39.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 -- start start 2023-10-24T01:44:39.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd60154400 0x7fcd600c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd600c0b30 0x7fcd600c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600c01c0 con 0x7fcd601547e0 2023-10-24T01:44:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.391+0000 7fcd666e6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600aa960 con 0x7fcd60154400 2023-10-24T01:44:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd666e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600c66f0 con 0x7fcd600c0b30 2023-10-24T01:44:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd60154400 0x7fcd600c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcd601547e0 0x7fcd600a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60854/0 (socket says 172.21.15.148:60854) 2023-10-24T01:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5f7fe700 1 -- 172.21.15.148:0/1237748579 learned_addr learned my addr 172.21.15.148:0/1237748579 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd64c83700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd600c0b30 0x7fcd600c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5effd700 1 -- 172.21.15.148:0/1237748579 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633698435 0 0) 0x7fcd600c01c0 con 0x7fcd601547e0 2023-10-24T01:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 -- 172.21.15.148:0/1237748579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd600c0b30 msgr2=0x7fcd600c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:39.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd600c0b30 0x7fcd600c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 -- 172.21.15.148:0/1237748579 >> v1:172.21.15.148:6789/0 conn(0x7fcd601547e0 legacy=0x7fcd600a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 -- 172.21.15.148:0/1237748579 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600c6150 con 0x7fcd60154400 2023-10-24T01:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd60154400 0x7fcd600c8310 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fcd50009760 tx=0x7fcd50009060).ready entity=mon.0 client_cookie=67b8fe89a5bdb02 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5effd700 1 -- 172.21.15.148:0/1237748579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500090d0 con 0x7fcd60154400 2023-10-24T01:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5effd700 1 -- 172.21.15.148:0/1237748579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5000f510 con 0x7fcd60154400 2023-10-24T01:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.392+0000 7fcd5effd700 1 -- 172.21.15.148:0/1237748579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000f890 con 0x7fcd60154400 2023-10-24T01:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 -- 172.21.15.148:0/1237748579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd60154400 msgr2=0x7fcd600c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd60154400 0x7fcd600c8310 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fcd50009760 tx=0x7fcd50009060).stop 2023-10-24T01:44:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 -- 172.21.15.148:0/1237748579 shutdown_connections 2023-10-24T01:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd600c0b30 0x7fcd600c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 --2- 172.21.15.148:0/1237748579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd60154400 0x7fcd600c8310 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 -- 172.21.15.148:0/1237748579 >> 172.21.15.148:0/1237748579 conn(0x7fcd600946a0 msgr2=0x7fcd6006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 -- 172.21.15.148:0/1237748579 shutdown_connections 2023-10-24T01:44:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.393+0000 7fcd666e6700 1 -- 172.21.15.148:0/1237748579 wait complete. 2023-10-24T01:44:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.394+0000 7fcd666e6700 1 Processor -- start 2023-10-24T01:44:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.394+0000 7fcd666e6700 1 -- start start 2023-10-24T01:44:39.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 0x7fcd600c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 0x7fcd60152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600c4940 con 0x7fcd601547e0 2023-10-24T01:44:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600c20e0 con 0x7fcd600c0b30 2023-10-24T01:44:39.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd666e6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600c2fe0 con 0x7fcd60154400 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46216/0 (socket says 172.21.15.148:46216) 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 -- 172.21.15.148:0/2691366161 learned_addr learned my addr 172.21.15.148:0/2691366161 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd5f7fe700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 0x7fcd60152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 0x7fcd600c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 -- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 msgr2=0x7fcd60152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 0x7fcd60152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 -- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 msgr2=0x7fcd600c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 0x7fcd600c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd64c83700 1 -- 172.21.15.148:0/2691366161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500092a0 con 0x7fcd601547e0 2023-10-24T01:44:39.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd5f7fe700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 0x7fcd60152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.395+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 0x7fcd600c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd64c83700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fcd58009e90 tx=0x7fcd5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800cc20 con 0x7fcd601547e0 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800f040 con 0x7fcd601547e0 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58013400 con 0x7fcd601547e0 2023-10-24T01:44:39.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd600c4b50 con 0x7fcd601547e0 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.396+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd600c22f0 con 0x7fcd601547e0 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.397+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6006c6b0 con 0x7fcd601547e0 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.397+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fcd580137b0 con 0x7fcd601547e0 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.397+0000 7fcd47fff700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 0x7fcd4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.397+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5743+0+0 (secure 0 0 0) 0x7fcd5807aad0 con 0x7fcd601547e0 2023-10-24T01:44:39.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.398+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 0x7fcd4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:39.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.398+0000 7fcd5ffff700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 0x7fcd4c061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcd600c48f0 tx=0x7fcd50017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:39.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.402+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcd5804bda0 con 0x7fcd601547e0 2023-10-24T01:44:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:39.578+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd600c2900 con 0x7fcd601547e0 2023-10-24T01:44:40.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.371+0000 7fcd47fff700 1 -- 172.21.15.148:0/2691366161 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v162) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd5804f3c0 con 0x7fcd601547e0 2023-10-24T01:44:40.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 msgr2=0x7fcd4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 0x7fcd4c061730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcd600c48f0 tx=0x7fcd50017000).stop 2023-10-24T01:44:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 msgr2=0x7fcd60146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fcd58009e90 tx=0x7fcd5800b040).stop 2023-10-24T01:44:40.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 shutdown_connections 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcd4c05f270 0x7fcd4c061730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd601547e0 0x7fcd60146c90 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd600c0b30 0x7fcd600c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 --2- 172.21.15.148:0/2691366161 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd60154400 0x7fcd60152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 >> 172.21.15.148:0/2691366161 conn(0x7fcd600946a0 msgr2=0x7fcd60153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:40.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.373+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 shutdown_connections 2023-10-24T01:44:40.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.374+0000 7fcd666e6700 1 -- 172.21.15.148:0/2691366161 wait complete. 2023-10-24T01:44:40.378 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T01:44:40.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T01:44:40.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.503+0000 7fd1b3065700 1 Processor -- start 2023-10-24T01:44:40.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.503+0000 7fd1b3065700 1 -- start start 2023-10-24T01:44:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b3065700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0c6710 0x7fd1ac0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b3065700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1ac0aa3f0 0x7fd1ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b3065700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0aa820 con 0x7fd1ac0aa010 2023-10-24T01:44:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b3065700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c0960 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b3065700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0c0c40 con 0x7fd1ac0c6710 2023-10-24T01:44:40.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b0e01700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd1ac0aa010 0x7fd1ac158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60864/0 (socket says 172.21.15.148:60864) 2023-10-24T01:44:40.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b0e01700 1 -- 172.21.15.148:0/3363742514 learned_addr learned my addr 172.21.15.148:0/3363742514 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:40.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1b1602700 1 --2- 172.21.15.148:0/3363742514 >> v2:172.21.15.148:3300/0 conn(0x7fd1ac0aa3f0 0x7fd1ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.504+0000 7fd1a3fff700 1 --2- 172.21.15.148:0/3363742514 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0c6710 0x7fd1ac0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1a37fe700 1 -- 172.21.15.148:0/3363742514 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249242845 0 0) 0x7fd1ac0aa820 con 0x7fd1ac0aa010 2023-10-24T01:44:40.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1a37fe700 1 -- 172.21.15.148:0/3363742514 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1940033f0 con 0x7fd1ac0aa010 2023-10-24T01:44:40.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1b1602700 1 -- 172.21.15.148:0/3363742514 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0c6710 msgr2=0x7fd1ac0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:40.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1b1602700 1 --2- 172.21.15.148:0/3363742514 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0c6710 0x7fd1ac0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1b1602700 1 -- 172.21.15.148:0/3363742514 >> v1:172.21.15.148:6789/0 conn(0x7fd1ac0aa010 legacy=0x7fd1ac158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1b1602700 1 -- 172.21.15.148:0/3363742514 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0c0f20 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1b1602700 1 --2- 172.21.15.148:0/3363742514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0aa3f0 0x7fd1ac069d80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd1ac157d00 tx=0x7fd1a4009780).ready entity=mon.0 client_cookie=1aa9f1302b8be686 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1a37fe700 1 -- 172.21.15.148:0/3363742514 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400e070 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1a37fe700 1 -- 172.21.15.148:0/3363742514 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400bab0 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.505+0000 7fd1a37fe700 1 -- 172.21.15.148:0/3363742514 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400be30 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 -- 172.21.15.148:0/3363742514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0aa3f0 msgr2=0x7fd1ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 --2- 172.21.15.148:0/3363742514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0aa3f0 0x7fd1ac069d80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fd1ac157d00 tx=0x7fd1a4009780).stop 2023-10-24T01:44:40.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 -- 172.21.15.148:0/3363742514 shutdown_connections 2023-10-24T01:44:40.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 --2- 172.21.15.148:0/3363742514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0aa3f0 0x7fd1ac069d80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 --2- 172.21.15.148:0/3363742514 >> v2:172.21.15.150:3300/0 conn(0x7fd1ac0c6710 0x7fd1ac0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 -- 172.21.15.148:0/3363742514 >> 172.21.15.148:0/3363742514 conn(0x7fd1ac0caf40 msgr2=0x7fd1ac0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:40.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 -- 172.21.15.148:0/3363742514 shutdown_connections 2023-10-24T01:44:40.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.506+0000 7fd1b3065700 1 -- 172.21.15.148:0/3363742514 wait complete. 2023-10-24T01:44:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.507+0000 7fd1b3065700 1 Processor -- start 2023-10-24T01:44:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.507+0000 7fd1b3065700 1 -- start start 2023-10-24T01:44:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0aa010 0x7fd1ac14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 0x7fd1ac14da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac14df60 con 0x7fd1ac0c6710 2023-10-24T01:44:40.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac158630 con 0x7fd1ac0aa010 2023-10-24T01:44:40.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0b0c10 con 0x7fd1ac0aa3f0 2023-10-24T01:44:40.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46230/0 (socket says 172.21.15.148:46230) 2023-10-24T01:44:40.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 -- 172.21.15.148:0/1480057201 learned_addr learned my addr 172.21.15.148:0/1480057201 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:40.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1a3fff700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 0x7fd1ac14da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b0e01700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0aa010 0x7fd1ac14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 -- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 msgr2=0x7fd1ac14da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 0x7fd1ac14da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 -- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0aa010 msgr2=0x7fd1ac14d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0aa010 0x7fd1ac14d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 -- 172.21.15.148:0/1480057201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009a20 con 0x7fd1ac0c6710 2023-10-24T01:44:40.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1a3fff700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 0x7fd1ac14da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:40.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b1602700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd1ac084230 tx=0x7fd1ac0aa9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a401d630 con 0x7fd1ac0c6710 2023-10-24T01:44:40.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a401d790 con 0x7fd1ac0c6710 2023-10-24T01:44:40.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac158880 con 0x7fd1ac0c6710 2023-10-24T01:44:40.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.508+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a401db30 con 0x7fd1ac0c6710 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.509+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac158e40 con 0x7fd1ac0c6710 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.510+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac159060 con 0x7fd1ac0c6710 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.510+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd1a4027460 con 0x7fd1ac0c6710 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.510+0000 7fd1a0ff9700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 0x7fd198061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.510+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fd1a407bfe0 con 0x7fd1ac0c6710 2023-10-24T01:44:40.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.510+0000 7fd1b0e01700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 0x7fd198061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.511+0000 7fd1b0e01700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 0x7fd198061700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd1a8005750 tx=0x7fd1a8009040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.514+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd1a404d3f0 con 0x7fd1ac0c6710 2023-10-24T01:44:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.740+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd1ac06c6b0 con 0x7fd1ac0c6710 2023-10-24T01:44:40.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.740+0000 7fd1a0ff9700 1 -- 172.21.15.148:0/1480057201 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd1a4050a10 con 0x7fd1ac0c6710 2023-10-24T01:44:40.743 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:40.743 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T01:44:40.743 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T01:44:40.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.744 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T01:44:40.744 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T01:44:40.744 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.744 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.745 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:44:40.745 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:44:40.745 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.745 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.746 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T01:44:40.746 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T01:44:40.746 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.746 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.747 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:44:40.747 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:44:40.747 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.750 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T01:44:40.750 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T01:44:40.750 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.750 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.752 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T01:44:40.752 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T01:44:40.752 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.752 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.752 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.753 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T01:44:40.754 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T01:44:40.754 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.754 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.754 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.754 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T01:44:40.755 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.756 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.756 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.756 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.757 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.758 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.758 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T01:44:40.759 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T01:44:40.759 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.759 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.759 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.759 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T01:44:40.760 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.761 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.761 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.761 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.762 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T01:44:40.762 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T01:44:40.762 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.762 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.763 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T01:44:40.764 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T01:44:40.764 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.764 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.764 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.764 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T01:44:40.765 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.766 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:44:40.766 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:44:40.766 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.767 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T01:44:40.767 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T01:44:40.767 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.767 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.768 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T01:44:40.769 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T01:44:40.769 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.769 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.769 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:44:40.769 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:44:40.770 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:44:40.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.770 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T01:44:40.771 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T01:44:40.771 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.771 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.771 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:44:40.771 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:44:40.772 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:44:40.772 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.772 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T01:44:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T01:44:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:44:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:44:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:44:40.774 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:44:40.774 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.774 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T01:44:40.775 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T01:44:40.775 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.775 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:44:40.775 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:44:40.775 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T01:44:40.776 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T01:44:40.777 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.777 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:44:40.777 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T01:44:40.777 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:40.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:40.778 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T01:44:40.778 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T01:44:40.778 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:44:40.779 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:44:40.779 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T01:44:40.779 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:44:40.779 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.779 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:40.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T01:44:40.780 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T01:44:40.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 msgr2=0x7fd198061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 0x7fd198061700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd1a8005750 tx=0x7fd1a8009040).stop 2023-10-24T01:44:40.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 msgr2=0x7fd1ac14f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fd1ac084230 tx=0x7fd1ac0aa9b0).stop 2023-10-24T01:44:40.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 shutdown_connections 2023-10-24T01:44:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd19805f240 0x7fd198061700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1ac0c6710 0x7fd1ac14f620 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1ac0aa010 0x7fd1ac14d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 --2- 172.21.15.148:0/1480057201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1ac0aa3f0 0x7fd1ac14da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 >> 172.21.15.148:0/1480057201 conn(0x7fd1ac0caf40 msgr2=0x7fd1ac0ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:40.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 shutdown_connections 2023-10-24T01:44:40.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.742+0000 7fd1b3065700 1 -- 172.21.15.148:0/1480057201 wait complete. 2023-10-24T01:44:40.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.897+0000 7f4ac540e700 1 Processor -- start 2023-10-24T01:44:40.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.897+0000 7f4ac540e700 1 -- start start 2023-10-24T01:44:40.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4ac540e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ac006a490 0x7f4ac00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4ac540e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00c0960 con 0x7f4ac00aa010 2023-10-24T01:44:40.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4ac540e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00c0c40 con 0x7f4ac00c6710 2023-10-24T01:44:40.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4ac540e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac00c0f20 con 0x7f4ac006a490 2023-10-24T01:44:40.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4abeffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4ac00aa010 0x7f4ac0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60866/0 (socket says 172.21.15.148:60866) 2023-10-24T01:44:40.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4abeffd700 1 -- 172.21.15.148:0/558784454 learned_addr learned my addr 172.21.15.148:0/558784454 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:40.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.898+0000 7f4abf7fe700 1 --2- 172.21.15.148:0/558784454 >> v2:172.21.15.150:3300/0 conn(0x7f4ac006a490 0x7f4ac00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537681263 0 0) 0x7f4ac00c0960 con 0x7f4ac00aa010 2023-10-24T01:44:40.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa80033f0 con 0x7f4ac00aa010 2023-10-24T01:44:40.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327704331 0 0) 0x7f4aa80033f0 con 0x7f4ac00aa010 2023-10-24T01:44:40.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 >> v2:172.21.15.150:3300/0 conn(0x7f4ac006a490 msgr2=0x7f4ac00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:40.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 --2- 172.21.15.148:0/558784454 >> v2:172.21.15.150:3300/0 conn(0x7f4ac006a490 0x7f4ac00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 >> v1:172.21.15.150:6789/0 conn(0x7f4ac00c6710 legacy=0x7f4ac0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00c1200 con 0x7f4ac00aa010 2023-10-24T01:44:40.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f4ab00017f0 con 0x7f4ac00aa010 2023-10-24T01:44:40.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 >> v1:172.21.15.148:6789/0 conn(0x7f4ac00aa010 legacy=0x7f4ac0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa80038e0 0x7f4aa8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 0x7f4aa8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8005000 0x7f4aa800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00c0f20 con 0x7f4aa8004690 2023-10-24T01:44:40.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa800bf60 con 0x7f4aa80038e0 2023-10-24T01:44:40.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa800c0f0 con 0x7f4aa8005000 2023-10-24T01:44:40.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 0x7f4aa8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abeffd700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa80038e0 0x7f4aa8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abf7fe700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8005000 0x7f4aa800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 -- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8005000 msgr2=0x7f4aa800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:40.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8005000 0x7f4aa800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 -- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa80038e0 msgr2=0x7f4aa8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:40.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4aa80038e0 0x7f4aa8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 -- 172.21.15.148:0/558784454 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa80033f0 con 0x7f4aa8004690 2023-10-24T01:44:40.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abf7fe700 1 -- 172.21.15.148:0/558784454 reap_dead start 2023-10-24T01:44:40.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 0x7f4aa8004b10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f4ab4001730 tx=0x7f4ab4007bb0).ready entity=mon.0 client_cookie=aac70fa4ba8e6f6a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.899+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4007020 con 0x7f4aa8004690 2023-10-24T01:44:40.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4007180 con 0x7f4aa8004690 2023-10-24T01:44:40.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4abdffb700 1 -- 172.21.15.148:0/558784454 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4007500 con 0x7f4aa8004690 2023-10-24T01:44:40.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 -- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 msgr2=0x7f4aa8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 0x7f4aa8004b10 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f4ab4001730 tx=0x7f4ab4007bb0).stop 2023-10-24T01:44:40.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 -- 172.21.15.148:0/558784454 shutdown_connections 2023-10-24T01:44:40.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 --2- 172.21.15.148:0/558784454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa8004690 0x7f4aa8004b10 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 -- 172.21.15.148:0/558784454 >> 172.21.15.148:0/558784454 conn(0x7f4ac00caf40 msgr2=0x7f4ac00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:40.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 -- 172.21.15.148:0/558784454 shutdown_connections 2023-10-24T01:44:40.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.900+0000 7f4ac540e700 1 -- 172.21.15.148:0/558784454 wait complete. 2023-10-24T01:44:40.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.901+0000 7f4ac540e700 1 Processor -- start 2023-10-24T01:44:40.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.901+0000 7f4ac540e700 1 -- start start 2023-10-24T01:44:40.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8004690 0x7f4ac0152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac0156080 0x7f4ac0156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0155a20 con 0x7f4ac00b0710 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00b0f20 con 0x7f4ac0156080 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4ac540e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac01569f0 con 0x7f4aa8004690 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46256/0 (socket says 172.21.15.148:46256) 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 -- 172.21.15.148:0/4012817568 learned_addr learned my addr 172.21.15.148:0/4012817568 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:40.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 -- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8004690 msgr2=0x7f4ac0152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8004690 0x7f4ac0152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:40.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abf7fe700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac0156080 0x7f4ac0156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 -- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac0156080 msgr2=0x7f4ac0156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:40.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac0156080 0x7f4ac0156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:40.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.902+0000 7f4abe7fc700 1 -- 172.21.15.148:0/4012817568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0152660 con 0x7f4ac00b0710 2023-10-24T01:44:40.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4abe7fc700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f4ab4001d20 tx=0x7f4ab4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4006fe0 con 0x7f4ac00b0710 2023-10-24T01:44:40.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4013670 con 0x7f4ac00b0710 2023-10-24T01:44:40.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac00b0c40 con 0x7f4ac00b0710 2023-10-24T01:44:40.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4013a30 con 0x7f4ac00b0710 2023-10-24T01:44:40.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.903+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac0155640 con 0x7f4ac00b0710 2023-10-24T01:44:40.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.904+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac006c6b0 con 0x7f4ac00b0710 2023-10-24T01:44:40.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.904+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4ab401f3f0 con 0x7f4ac00b0710 2023-10-24T01:44:40.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.904+0000 7f4aa6ffd700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 0x7f4aac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:40.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.904+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f4ab407ac80 con 0x7f4ac00b0710 2023-10-24T01:44:40.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.905+0000 7f4abeffd700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 0x7f4aac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:40.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.905+0000 7f4abeffd700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 0x7f4aac061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4ab0001920 tx=0x7f4ab0001270).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:40.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:40.908+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ab40a9af0 con 0x7f4ac00b0710 2023-10-24T01:44:41.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.071+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ac0155b60 con 0x7f4ac00b0710 2023-10-24T01:44:41.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.071+0000 7f4aa6ffd700 1 -- 172.21.15.148:0/4012817568 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13842 (secure 0 0 0) 0x7f4ac0155b60 con 0x7f4ac00b0710 2023-10-24T01:44:41.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:41.074 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":162,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:40.367615+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:41.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 msgr2=0x7f4aac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 0x7f4aac061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4ab0001920 tx=0x7f4ab0001270).stop 2023-10-24T01:44:41.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 msgr2=0x7f4ac0143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f4ab4001d20 tx=0x7f4ab4015000).stop 2023-10-24T01:44:41.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 shutdown_connections 2023-10-24T01:44:41.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac0156080 0x7f4ac0156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4aa8004690 0x7f4ac0152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:41.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4aac05f270 0x7f4aac061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 --2- 172.21.15.148:0/4012817568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ac00b0710 0x7f4ac0143860 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.073+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 >> 172.21.15.148:0/4012817568 conn(0x7f4ac00caf40 msgr2=0x7f4ac00ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.074+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 shutdown_connections 2023-10-24T01:44:41.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.074+0000 7f4ac540e700 1 -- 172.21.15.148:0/4012817568 wait complete. 2023-10-24T01:44:41.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T01:44:41.088 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T01:44:41.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.203+0000 7f7f428b0700 1 Processor -- start 2023-10-24T01:44:41.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.203+0000 7f7f428b0700 1 -- start start 2023-10-24T01:44:41.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f428b0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f3c154430 0x7f7f3c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f428b0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c098bd0 0x7f7f3c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f428b0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0c71d0 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f428b0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c9410 con 0x7f7f3c154430 2023-10-24T01:44:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f428b0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c6c10 con 0x7f7f3c098bd0 2023-10-24T01:44:41.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f3c154430 0x7f7f3c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f3c154430 0x7f7f3c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46272/0 (socket says 172.21.15.148:46272) 2023-10-24T01:44:41.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 -- 172.21.15.148:0/4195470830 learned_addr learned my addr 172.21.15.148:0/4195470830 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:41.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3b7fe700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c098bd0 0x7f7f3c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 -- 172.21.15.148:0/4195470830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c098bd0 msgr2=0x7f7f3c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:41.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c098bd0 0x7f7f3c0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 -- 172.21.15.148:0/4195470830 >> v1:172.21.15.150:6789/0 conn(0x7f7f3c0bffd0 legacy=0x7f7f3c0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 -- 172.21.15.148:0/4195470830 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0c6ef0 con 0x7f7f3c154430 2023-10-24T01:44:41.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3bfff700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c154430 0x7f7f3c154810 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7f2c009830 tx=0x7f7f2c0090f0).ready entity=mon.0 client_cookie=773ce870228e42ed server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.204+0000 7f7f3affd700 1 -- 172.21.15.148:0/4195470830 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00b600 con 0x7f7f3c154430 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f3affd700 1 -- 172.21.15.148:0/4195470830 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00b760 con 0x7f7f3c154430 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f3affd700 1 -- 172.21.15.148:0/4195470830 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00bae0 con 0x7f7f3c154430 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 -- 172.21.15.148:0/4195470830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c154430 msgr2=0x7f7f3c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c154430 0x7f7f3c154810 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f7f2c009830 tx=0x7f7f2c0090f0).stop 2023-10-24T01:44:41.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 -- 172.21.15.148:0/4195470830 shutdown_connections 2023-10-24T01:44:41.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c154430 0x7f7f3c154810 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4195470830 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c098bd0 0x7f7f3c0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 -- 172.21.15.148:0/4195470830 >> 172.21.15.148:0/4195470830 conn(0x7f7f3c0cb070 msgr2=0x7f7f3c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 -- 172.21.15.148:0/4195470830 shutdown_connections 2023-10-24T01:44:41.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.205+0000 7f7f428b0700 1 -- 172.21.15.148:0/4195470830 wait complete. 2023-10-24T01:44:41.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.206+0000 7f7f428b0700 1 Processor -- start 2023-10-24T01:44:41.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.206+0000 7f7f428b0700 1 -- start start 2023-10-24T01:44:41.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f3c098bd0 0x7f7f3c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c154430 0x7f7f3c0649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c064ed0 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c2110 con 0x7f7f3c098bd0 2023-10-24T01:44:41.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f428b0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c158f00 con 0x7f7f3c154430 2023-10-24T01:44:41.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46274/0 (socket says 172.21.15.148:46274) 2023-10-24T01:44:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f3b7fe700 1 -- 172.21.15.148:0/4188355328 learned_addr learned my addr 172.21.15.148:0/4188355328 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f3bfff700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f3c098bd0 0x7f7f3c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.207+0000 7f7f40e4d700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c154430 0x7f7f3c0649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 -- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c154430 msgr2=0x7f7f3c0649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c154430 0x7f7f3c0649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 -- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f3c098bd0 msgr2=0x7f7f3c0ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f3c098bd0 0x7f7f3c0ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 -- 172.21.15.148:0/4188355328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c009370 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f3b7fe700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7f3000d890 tx=0x7f7f30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30011590 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f300116f0 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c1582f0 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30011a90 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.208+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c158b90 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.209+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c159040 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.209+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7f30012420 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.209+0000 7f7f23fff700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 0x7f7f28061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.209+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f7f30079a40 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.210+0000 7f7f3bfff700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 0x7f7f28061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.210+0000 7f7f3bfff700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 0x7f7f28061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7f2c009130 tx=0x7f7f2c017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.214+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7f3c159040 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.377+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7f3c159040 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.377+0000 7f7f23fff700 1 -- 172.21.15.148:0/4188355328 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v162) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7f3c159040 con 0x7f7f3c0bffd0 2023-10-24T01:44:41.379 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T01:44:41.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 msgr2=0x7f7f28061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 0x7f7f28061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7f2c009130 tx=0x7f7f2c017000).stop 2023-10-24T01:44:41.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 msgr2=0x7f7f3c0644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f7f3000d890 tx=0x7f7f30008040).stop 2023-10-24T01:44:41.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 shutdown_connections 2023-10-24T01:44:41.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f3c154430 0x7f7f3c0649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f3c098bd0 0x7f7f3c0ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f2805f270 0x7f7f28061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 --2- 172.21.15.148:0/4188355328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f3c0bffd0 0x7f7f3c0644f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 >> 172.21.15.148:0/4188355328 conn(0x7f7f3c0cb070 msgr2=0x7f7f3c0a8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 shutdown_connections 2023-10-24T01:44:41.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.379+0000 7f7f428b0700 1 -- 172.21.15.148:0/4188355328 wait complete. 2023-10-24T01:44:41.393 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T01:44:41.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.508+0000 7f7f5d184700 1 Processor -- start 2023-10-24T01:44:41.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f5d184700 1 -- start start 2023-10-24T01:44:41.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f5d184700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f58154430 0x7f7f58154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f5d184700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f580c71d0 con 0x7f7f58098bd0 2023-10-24T01:44:41.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f5d184700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f580c9410 con 0x7f7f580bffd0 2023-10-24T01:44:41.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f5d184700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f580c6a10 con 0x7f7f58154430 2023-10-24T01:44:41.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f56d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7f58154430 0x7f7f58154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.509+0000 7f7f4e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7f58098bd0 0x7f7f580c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60876/0 (socket says 172.21.15.148:60876) 2023-10-24T01:44:41.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f4e59c700 1 -- 172.21.15.148:0/3129062445 learned_addr learned my addr 172.21.15.148:0/3129062445 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:41.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f56d9d700 1 -- 172.21.15.148:0/3129062445 >> v1:172.21.15.150:6789/0 conn(0x7f7f580bffd0 legacy=0x7f7f5815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f56d9d700 1 -- 172.21.15.148:0/3129062445 >> v1:172.21.15.148:6789/0 conn(0x7f7f58098bd0 legacy=0x7f7f580c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f56d9d700 1 -- 172.21.15.148:0/3129062445 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f580ca8b0 con 0x7f7f58154430 2023-10-24T01:44:41.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f5659c700 1 -- 172.21.15.148:0/3129062445 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335436909 0 0) 0x7f7f580c71d0 con 0x7f7f58098bd0 2023-10-24T01:44:41.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f56d9d700 1 --2- 172.21.15.148:0/3129062445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f58154430 0x7f7f58154810 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7f48009760 tx=0x7f7f48009060).ready entity=mon.0 client_cookie=f96ce962d4ecb00 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f5659c700 1 -- 172.21.15.148:0/3129062445 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800b580 con 0x7f7f58154430 2023-10-24T01:44:41.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f5659c700 1 -- 172.21.15.148:0/3129062445 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800b6e0 con 0x7f7f58154430 2023-10-24T01:44:41.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.510+0000 7f7f5659c700 1 -- 172.21.15.148:0/3129062445 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800ba60 con 0x7f7f58154430 2023-10-24T01:44:41.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 -- 172.21.15.148:0/3129062445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f58154430 msgr2=0x7f7f58154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 --2- 172.21.15.148:0/3129062445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f58154430 0x7f7f58154810 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7f48009760 tx=0x7f7f48009060).stop 2023-10-24T01:44:41.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 -- 172.21.15.148:0/3129062445 shutdown_connections 2023-10-24T01:44:41.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 --2- 172.21.15.148:0/3129062445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f58154430 0x7f7f58154810 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 -- 172.21.15.148:0/3129062445 >> 172.21.15.148:0/3129062445 conn(0x7f7f580cb070 msgr2=0x7f7f580cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 -- 172.21.15.148:0/3129062445 shutdown_connections 2023-10-24T01:44:41.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.511+0000 7f7f5d184700 1 -- 172.21.15.148:0/3129062445 wait complete. 2023-10-24T01:44:41.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.512+0000 7f7f5d184700 1 Processor -- start 2023-10-24T01:44:41.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.512+0000 7f7f5d184700 1 -- start start 2023-10-24T01:44:41.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58098bd0 0x7f7f58149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f58154430 0x7f7f580aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580af7d0 con 0x7f7f580bffd0 2023-10-24T01:44:41.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580afab0 con 0x7f7f58098bd0 2023-10-24T01:44:41.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580afd90 con 0x7f7f58154430 2023-10-24T01:44:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46298/0 (socket says 172.21.15.148:46298) 2023-10-24T01:44:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 -- 172.21.15.148:0/2934644246 learned_addr learned my addr 172.21.15.148:0/2934644246 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f56d9d700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58098bd0 0x7f7f58149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5759e700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f58154430 0x7f7f580aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 -- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f58154430 msgr2=0x7f7f580aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f58154430 0x7f7f580aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 -- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58098bd0 msgr2=0x7f7f58149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58098bd0 0x7f7f58149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 -- 172.21.15.148:0/2934644246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480092a0 con 0x7f7f580bffd0 2023-10-24T01:44:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4e59c700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7f4000c4c0 tx=0x7f7f40007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000ce30 con 0x7f7f580bffd0 2023-10-24T01:44:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400072e0 con 0x7f7f580bffd0 2023-10-24T01:44:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400057a0 con 0x7f7f580bffd0 2023-10-24T01:44:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.513+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f580b0070 con 0x7f7f580bffd0 2023-10-24T01:44:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.514+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f58149670 con 0x7f7f580bffd0 2023-10-24T01:44:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.514+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f580a8890 con 0x7f7f580bffd0 2023-10-24T01:44:41.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.515+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7f40005bd0 con 0x7f7f580bffd0 2023-10-24T01:44:41.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.515+0000 7f7f4f7fe700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 0x7f7f38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.515+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f7f40079730 con 0x7f7f580bffd0 2023-10-24T01:44:41.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.515+0000 7f7f56d9d700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 0x7f7f38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.516+0000 7f7f56d9d700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 0x7f7f38061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7f4800b340 tx=0x7f7f48017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.519+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7f4004aba0 con 0x7f7f580bffd0 2023-10-24T01:44:41.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.685+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f580c6c10 con 0x7f7f580bffd0 2023-10-24T01:44:41.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.686+0000 7f7f4f7fe700 1 -- 172.21.15.148:0/2934644246 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7f4004e1c0 con 0x7f7f580bffd0 2023-10-24T01:44:41.688 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T01:44:41.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.687+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 msgr2=0x7f7f38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.687+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 0x7f7f38061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7f4800b340 tx=0x7f7f48017000).stop 2023-10-24T01:44:41.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 msgr2=0x7f7f580b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f7f4000c4c0 tx=0x7f7f40007c10).stop 2023-10-24T01:44:41.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 shutdown_connections 2023-10-24T01:44:41.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f58154430 0x7f7f580aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58098bd0 0x7f7f58149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f3805f270 0x7f7f38061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 --2- 172.21.15.148:0/2934644246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f580bffd0 0x7f7f580b0870 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 >> 172.21.15.148:0/2934644246 conn(0x7f7f580cb070 msgr2=0x7f7f58156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 shutdown_connections 2023-10-24T01:44:41.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.688+0000 7f7f5d184700 1 -- 172.21.15.148:0/2934644246 wait complete. 2023-10-24T01:44:41.702 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T01:44:41.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.814+0000 7f1821ede700 1 Processor -- start 2023-10-24T01:44:41.816 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.814+0000 7f1821ede700 1 -- start start 2023-10-24T01:44:41.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f1821ede700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f181c0aa010 0x7f181c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f1821ede700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f1821ede700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0c0960 con 0x7f181c158770 2023-10-24T01:44:41.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f1821ede700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0aa8e0 con 0x7f181c0aa010 2023-10-24T01:44:41.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f1821ede700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c0c40 con 0x7f181c0c6710 2023-10-24T01:44:41.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f181c0aa010 0x7f181c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181affd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:33842/0 (socket says 172.21.15.148:33842) 2023-10-24T01:44:41.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f181c0aa010 0x7f181c0c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:57116/0 (socket says 172.21.15.148:57116) 2023-10-24T01:44:41.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181affd700 1 -- 172.21.15.148:0/803565065 learned_addr learned my addr 172.21.15.148:0/803565065 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:41.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181bfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f181c158770 0x7f181c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56068/0 (socket says 172.21.15.148:56068) 2023-10-24T01:44:41.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 -- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 msgr2=0x7f181c0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:41.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 -- 172.21.15.148:0/803565065 >> v1:172.21.15.150:6789/0 conn(0x7f181c158770 legacy=0x7f181c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 -- 172.21.15.148:0/803565065 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0c0f20 con 0x7f181c0aa010 2023-10-24T01:44:41.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181affd700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:41.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.815+0000 7f181b7fe700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c0c1a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f1810009760 tx=0x7f1810009060).ready entity=mon.1 client_cookie=dd2fbb83dcc43387 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f181a7fc700 1 -- 172.21.15.148:0/803565065 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000f510 con 0x7f181c0aa010 2023-10-24T01:44:41.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f181a7fc700 1 -- 172.21.15.148:0/803565065 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000f670 con 0x7f181c0aa010 2023-10-24T01:44:41.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f181a7fc700 1 -- 172.21.15.148:0/803565065 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000f9f0 con 0x7f181c0aa010 2023-10-24T01:44:41.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 -- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 msgr2=0x7f181c0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c0c1a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f1810009760 tx=0x7f1810009060).stop 2023-10-24T01:44:41.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 -- 172.21.15.148:0/803565065 shutdown_connections 2023-10-24T01:44:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c0c1a00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 --2- 172.21.15.148:0/803565065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c0c6710 0x7f181c0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 -- 172.21.15.148:0/803565065 >> 172.21.15.148:0/803565065 conn(0x7f181c0caf40 msgr2=0x7f181c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 -- 172.21.15.148:0/803565065 shutdown_connections 2023-10-24T01:44:41.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.816+0000 7f1821ede700 1 -- 172.21.15.148:0/803565065 wait complete. 2023-10-24T01:44:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.817+0000 7f1821ede700 1 Processor -- start 2023-10-24T01:44:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 -- start start 2023-10-24T01:44:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c158770 0x7f181c06a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c06a760 con 0x7f181c0c6710 2023-10-24T01:44:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1654b0 con 0x7f181c0aa010 2023-10-24T01:44:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f1821ede700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c2160 con 0x7f181c158770 2023-10-24T01:44:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f181affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f181affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46304/0 (socket says 172.21.15.148:46304) 2023-10-24T01:44:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.818+0000 7f181affd700 1 -- 172.21.15.148:0/93522743 learned_addr learned my addr 172.21.15.148:0/93522743 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181b7fe700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181bfff700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c158770 0x7f181c06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 -- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c158770 msgr2=0x7f181c06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c158770 0x7f181c06a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 -- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 msgr2=0x7f181c167460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c167460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 -- 172.21.15.148:0/93522743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009370 con 0x7f181c0c6710 2023-10-24T01:44:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f181affd700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f180c00ea20 tx=0x7f180c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00c850 con 0x7f181c0c6710 2023-10-24T01:44:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00c9b0 con 0x7f181c0c6710 2023-10-24T01:44:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00cd30 con 0x7f181c0c6710 2023-10-24T01:44:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100092a0 con 0x7f181c0c6710 2023-10-24T01:44:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.819+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c0c2720 con 0x7f181c0c6710 2023-10-24T01:44:41.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.820+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c06c6b0 con 0x7f181c0c6710 2023-10-24T01:44:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.820+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f180c012600 con 0x7f181c0c6710 2023-10-24T01:44:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.821+0000 7f18037fe700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 0x7f1808061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.821+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f180c07a6e0 con 0x7f181c0c6710 2023-10-24T01:44:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.821+0000 7f181b7fe700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 0x7f1808061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:41.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.821+0000 7f181b7fe700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 0x7f1808061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1810009760 tx=0x7f1810017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:41.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.825+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f180c04bb50 con 0x7f181c0c6710 2023-10-24T01:44:41.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.989+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f181c0c1200 con 0x7f181c0c6710 2023-10-24T01:44:41.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.989+0000 7f18037fe700 1 -- 172.21.15.148:0/93522743 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) v1 ==== 84+0+143 (secure 0 0 0) 0x7f180c016090 con 0x7f181c0c6710 2023-10-24T01:44:41.992 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:41.992 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T01:44:41.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:41.992 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T01:44:41.993 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T01:44:41.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:44:41.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:41.993 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T01:44:41.993 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T01:44:41.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:41.994 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T01:44:41.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 msgr2=0x7f1808061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 0x7f1808061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1810009760 tx=0x7f1810017000).stop 2023-10-24T01:44:41.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 msgr2=0x7f181c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:41.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f180c00ea20 tx=0x7f180c0090f0).stop 2023-10-24T01:44:41.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 shutdown_connections 2023-10-24T01:44:41.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f181c158770 0x7f181c06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f181c0aa010 0x7f181c167460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f180805f270 0x7f1808061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 --2- 172.21.15.148:0/93522743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f181c0c6710 0x7f181c069d80 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:41.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 >> 172.21.15.148:0/93522743 conn(0x7f181c0caf40 msgr2=0x7f181c0ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:41.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 shutdown_connections 2023-10-24T01:44:41.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:41.991+0000 7f1821ede700 1 -- 172.21.15.148:0/93522743 wait complete. 2023-10-24T01:44:42.005 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T01:44:42.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T01:44:42.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.134+0000 7ff511354700 1 Processor -- start 2023-10-24T01:44:42.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.134+0000 7ff511354700 1 -- start start 2023-10-24T01:44:42.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff511354700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff50c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff511354700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff50c0aa420 0x7ff50c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff511354700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0c6270 con 0x7ff50c1544b0 2023-10-24T01:44:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff511354700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0c60e0 con 0x7ff50c0aa420 2023-10-24T01:44:42.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff511354700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0aa890 con 0x7ff50c0a7d00 2023-10-24T01:44:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff50affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff50c1544b0 0x7ff50c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60886/0 (socket says 172.21.15.148:60886) 2023-10-24T01:44:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.135+0000 7ff50affd700 1 -- 172.21.15.148:0/2832077208 learned_addr learned my addr 172.21.15.148:0/2832077208 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/2832077208 >> v2:172.21.15.150:3300/0 conn(0x7ff50c0aa420 0x7ff50c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886168260 0 0) 0x7ff50c0c6270 con 0x7ff50c1544b0 2023-10-24T01:44:42.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f80033f0 con 0x7ff50c1544b0 2023-10-24T01:44:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50a7fc700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff50c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409497446 0 0) 0x7ff4f80033f0 con 0x7ff50c1544b0 2023-10-24T01:44:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 msgr2=0x7ff50c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:42.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff50c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 >> v2:172.21.15.150:3300/0 conn(0x7ff50c0aa420 msgr2=0x7ff50c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 --2- 172.21.15.148:0/2832077208 >> v2:172.21.15.150:3300/0 conn(0x7ff50c0aa420 0x7ff50c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0c0c80 con 0x7ff50c1544b0 2023-10-24T01:44:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7ff5040017f0 con 0x7ff50c1544b0 2023-10-24T01:44:42.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 >> v1:172.21.15.148:6789/0 conn(0x7ff50c1544b0 legacy=0x7ff50c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f80038e0 0x7ff4f8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff4f8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004b80 0x7ff4f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c60e0 con 0x7ff4f8004b80 2023-10-24T01:44:42.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0aa890 con 0x7ff4f80038e0 2023-10-24T01:44:42.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800b8e0 con 0x7ff50c0a7d00 2023-10-24T01:44:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004b80 0x7ff4f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50affd700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f80038e0 0x7ff4f8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50a7fc700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff4f8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 -- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 msgr2=0x7ff4f8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0a7d00 0x7ff4f8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 -- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f80038e0 msgr2=0x7ff4f8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f80038e0 0x7ff4f8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 -- 172.21.15.148:0/2832077208 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80033f0 con 0x7ff4f8004b80 2023-10-24T01:44:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.136+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004b80 0x7ff4f8005000 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7ff4fc009a80 tx=0x7ff4fc009060).ready entity=mon.0 client_cookie=2973fa37d491685c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc009430 con 0x7ff4f8004b80 2023-10-24T01:44:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00e640 con 0x7ff4f8004b80 2023-10-24T01:44:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff509ffb700 1 -- 172.21.15.148:0/2832077208 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00e9c0 con 0x7ff4f8004b80 2023-10-24T01:44:42.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 -- 172.21.15.148:0/2832077208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004b80 msgr2=0x7ff4f8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 --2- 172.21.15.148:0/2832077208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4f8004b80 0x7ff4f8005000 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7ff4fc009a80 tx=0x7ff4fc009060).stop 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff50b7fe700 1 -- 172.21.15.148:0/2832077208 reap_dead start 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 -- 172.21.15.148:0/2832077208 shutdown_connections 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 -- 172.21.15.148:0/2832077208 >> 172.21.15.148:0/2832077208 conn(0x7ff50c0945d0 msgr2=0x7ff50c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 -- 172.21.15.148:0/2832077208 shutdown_connections 2023-10-24T01:44:42.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.137+0000 7ff511354700 1 -- 172.21.15.148:0/2832077208 wait complete. 2023-10-24T01:44:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.138+0000 7ff511354700 1 Processor -- start 2023-10-24T01:44:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 -- start start 2023-10-24T01:44:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f8004b80 0x7ff50c0c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0c4890 0x7ff50c0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0acd50 con 0x7ff50c0ac400 2023-10-24T01:44:42.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c2fd0 con 0x7ff4f8004b80 2023-10-24T01:44:42.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff511354700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c32b0 con 0x7ff50c0c4890 2023-10-24T01:44:42.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff50b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff50b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46322/0 (socket says 172.21.15.148:46322) 2023-10-24T01:44:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff50b7fe700 1 -- 172.21.15.148:0/823967451 learned_addr learned my addr 172.21.15.148:0/823967451 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff50a7fc700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0c4890 0x7ff50c0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.139+0000 7ff50affd700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f8004b80 0x7ff50c0c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 -- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0c4890 msgr2=0x7ff50c0b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0c4890 0x7ff50c0b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 -- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f8004b80 msgr2=0x7ff50c0c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f8004b80 0x7ff50c0c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 -- 172.21.15.148:0/823967451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0c3590 con 0x7ff50c0ac400 2023-10-24T01:44:42.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff50b7fe700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff4fc001eb0 tx=0x7ff4fc01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00ed30 con 0x7ff50c0ac400 2023-10-24T01:44:42.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00eeb0 con 0x7ff50c0ac400 2023-10-24T01:44:42.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c0c3870 con 0x7ff50c0ac400 2023-10-24T01:44:42.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0253f0 con 0x7ff50c0ac400 2023-10-24T01:44:42.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.140+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c0c4d10 con 0x7ff50c0ac400 2023-10-24T01:44:42.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.141+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c06c6b0 con 0x7ff50c0ac400 2023-10-24T01:44:42.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.141+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff4fc0123f0 con 0x7ff50c0ac400 2023-10-24T01:44:42.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.142+0000 7ff502ffd700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 0x7ff4ec061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.142+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5313+0+0 (secure 0 0 0) 0x7ff4fc000e40 con 0x7ff50c0ac400 2023-10-24T01:44:42.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.142+0000 7ff50affd700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 0x7ff4ec061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.142+0000 7ff50affd700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 0x7ff4ec061760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff504002250 tx=0x7ff504001d90).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.146+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff4fc04cc60 con 0x7ff50c0ac400 2023-10-24T01:44:42.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.311+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ff50c0c0f40 con 0x7ff50c0ac400 2023-10-24T01:44:42.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.817+0000 7ff502ffd700 1 -- 172.21.15.148:0/823967451 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff4fc0160c0 con 0x7ff50c0ac400 2023-10-24T01:44:42.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.821+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 msgr2=0x7ff4ec061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.821+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 0x7ff4ec061760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff504002250 tx=0x7ff504001d90).stop 2023-10-24T01:44:42.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.821+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 msgr2=0x7ff50c0ac860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.821+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff4fc001eb0 tx=0x7ff4fc01a000).stop 2023-10-24T01:44:42.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 shutdown_connections 2023-10-24T01:44:42.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff4ec05f2a0 0x7ff4ec061760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff50c0ac400 0x7ff50c0ac860 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4f8004b80 0x7ff50c0c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 --2- 172.21.15.148:0/823967451 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff50c0c4890 0x7ff50c0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.822+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 >> 172.21.15.148:0/823967451 conn(0x7ff50c0945d0 msgr2=0x7ff50c0c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:42.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.824+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 shutdown_connections 2023-10-24T01:44:42.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.824+0000 7ff511354700 1 -- 172.21.15.148:0/823967451 wait complete. 2023-10-24T01:44:42.827 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T01:44:42.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T01:44:42.937 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:44:42.940 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:44:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.960+0000 7f37058cb700 1 Processor -- start 2023-10-24T01:44:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.960+0000 7f37058cb700 1 -- start start 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f37058cb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3700062650 0x7f37000c4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f37058cb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3700062fc0 con 0x7f3700151e50 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f37058cb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000ad1a0 con 0x7f3700062b00 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f37058cb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000ac870 con 0x7f3700062650 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fe7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3700062650 0x7f37000c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36feffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f3700151e50 0x7f3700152230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:60892/0 (socket says 172.21.15.148:60892) 2023-10-24T01:44:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36feffd700 1 -- 172.21.15.148:0/3072618388 learned_addr learned my addr 172.21.15.148:0/3072618388 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3072618388 >> v1:172.21.15.150:6789/0 conn(0x7f3700062b00 legacy=0x7f3700064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3072618388 >> v1:172.21.15.148:6789/0 conn(0x7f3700151e50 legacy=0x7f3700152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fdffb700 1 -- 172.21.15.148:0/3072618388 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124181951 0 0) 0x7f3700062fc0 con 0x7f3700151e50 2023-10-24T01:44:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3072618388 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000acb50 con 0x7f3700062650 2023-10-24T01:44:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fe7fc700 1 --2- 172.21.15.148:0/3072618388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062650 0x7f37000c4500 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f36f4009760 tx=0x7f36f4009060).ready entity=mon.0 client_cookie=7551c19bbfb68bae server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fdffb700 1 -- 172.21.15.148:0/3072618388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4009120 con 0x7f3700062650 2023-10-24T01:44:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fdffb700 1 -- 172.21.15.148:0/3072618388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b580 con 0x7f3700062650 2023-10-24T01:44:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.961+0000 7f36fdffb700 1 -- 172.21.15.148:0/3072618388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b900 con 0x7f3700062650 2023-10-24T01:44:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 -- 172.21.15.148:0/3072618388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062650 msgr2=0x7f37000c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 --2- 172.21.15.148:0/3072618388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062650 0x7f37000c4500 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f36f4009760 tx=0x7f36f4009060).stop 2023-10-24T01:44:42.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 -- 172.21.15.148:0/3072618388 shutdown_connections 2023-10-24T01:44:42.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 --2- 172.21.15.148:0/3072618388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062650 0x7f37000c4500 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 -- 172.21.15.148:0/3072618388 >> 172.21.15.148:0/3072618388 conn(0x7f37000c7e20 msgr2=0x7f37000c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:42.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 -- 172.21.15.148:0/3072618388 shutdown_connections 2023-10-24T01:44:42.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.962+0000 7f37058cb700 1 -- 172.21.15.148:0/3072618388 wait complete. 2023-10-24T01:44:42.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.963+0000 7f37058cb700 1 Processor -- start 2023-10-24T01:44:42.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 -- start start 2023-10-24T01:44:42.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3700062650 0x7f3700162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3700151e50 0x7f37001466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700147160 con 0x7f3700062b00 2023-10-24T01:44:42.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700147440 con 0x7f3700151e50 2023-10-24T01:44:42.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f37058cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700147720 con 0x7f3700062650 2023-10-24T01:44:42.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f36fe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f36fe7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46340/0 (socket says 172.21.15.148:46340) 2023-10-24T01:44:42.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3726882877 learned_addr learned my addr 172.21.15.148:0/3726882877 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:42.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.964+0000 7f36ff7fe700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3700151e50 0x7f37001466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36feffd700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3700062650 0x7f3700162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3700062650 msgr2=0x7f3700162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3700062650 0x7f3700162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3700151e50 msgr2=0x7f37001466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:42.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3700151e50 0x7f37001466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:42.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 -- 172.21.15.148:0/3726882877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40092a0 con 0x7f3700062b00 2023-10-24T01:44:42.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36fe7fc700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f36f4009eb0 tx=0x7f36f4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b900 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400bcc0 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3700147a00 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f401b410 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.965+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3700162820 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.966+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700147ef0 con 0x7f3700062b00 2023-10-24T01:44:42.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.966+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f36f401b7c0 con 0x7f3700062b00 2023-10-24T01:44:42.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.967+0000 7f36e6ffd700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 0x7f36ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:42.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.967+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5683+0+0 (secure 0 0 0) 0x7f36f407bdf0 con 0x7f3700062b00 2023-10-24T01:44:42.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.967+0000 7f36feffd700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 0x7f36ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:42.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.967+0000 7f36feffd700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 0x7f36ec061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f36f0000c00 tx=0x7f36f0009040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:42.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:42.971+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36f404d0f0 con 0x7f3700062b00 2023-10-24T01:44:43.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.135+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3700047480 con 0x7f3700062b00 2023-10-24T01:44:43.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.824+0000 7f36e6ffd700 1 -- 172.21.15.148:0/3726882877 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) v1 ==== 170+0+0 (secure 0 0 0) 0x7f36f4028020 con 0x7f3700062b00 2023-10-24T01:44:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 msgr2=0x7f36ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 0x7f36ec061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f36f0000c00 tx=0x7f36f0009040).stop 2023-10-24T01:44:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 msgr2=0x7f3700163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f36f4009eb0 tx=0x7f36f4017000).stop 2023-10-24T01:44:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 shutdown_connections 2023-10-24T01:44:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3700151e50 0x7f37001466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3700062650 0x7f3700162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f36ec05f270 0x7f36ec061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 --2- 172.21.15.148:0/3726882877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3700062b00 0x7f3700163160 secure :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0x7f36f4009eb0 tx=0x7f36f4017000).stop 2023-10-24T01:44:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.827+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 >> 172.21.15.148:0/3726882877 conn(0x7f37000c7e20 msgr2=0x7f370014e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.829+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 shutdown_connections 2023-10-24T01:44:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.829+0000 7f37058cb700 1 -- 172.21.15.148:0/3726882877 wait complete. 2023-10-24T01:44:43.837 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T01:44:43.857 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T01:44:43.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.971+0000 7f1b9dc56700 1 Processor -- start 2023-10-24T01:44:43.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.971+0000 7f1b9dc56700 1 -- start start 2023-10-24T01:44:43.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b9dc56700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b98062d60 0x7f1b980bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b9dc56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b980be640 0x7f1b980a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b9dc56700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b98069f60 con 0x7f1b981541d0 2023-10-24T01:44:43.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b9dc56700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b980bd250 con 0x7f1b98062d60 2023-10-24T01:44:43.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b9dc56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98069420 con 0x7f1b980be640 2023-10-24T01:44:43.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b96ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1b98062d60 0x7f1b980bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b977fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1b981541d0 0x7f1b98062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44776/0 (socket says 172.21.15.148:44776) 2023-10-24T01:44:43.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.972+0000 7f1b977fe700 1 -- 172.21.15.148:0/1807266177 learned_addr learned my addr 172.21.15.148:0/1807266177 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:43.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b97fff700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b980be640 0x7f1b980a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b96ffd700 1 -- 172.21.15.148:0/1807266177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b980be640 msgr2=0x7f1b980a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:43.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b96ffd700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b980be640 0x7f1b980a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b96ffd700 1 -- 172.21.15.148:0/1807266177 >> v1:172.21.15.148:6789/0 conn(0x7f1b981541d0 legacy=0x7f1b98062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b967fc700 1 -- 172.21.15.148:0/1807266177 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885908586 0 0) 0x7f1b98069f60 con 0x7f1b981541d0 2023-10-24T01:44:43.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b96ffd700 1 -- 172.21.15.148:0/1807266177 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98069630 con 0x7f1b98062d60 2023-10-24T01:44:43.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b96ffd700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b98062d60 0x7f1b980bcc70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f1b8c009760 tx=0x7f1b8c009060).ready entity=mon.0 client_cookie=5a605eb97055b16c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:43.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b967fc700 1 -- 172.21.15.148:0/1807266177 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00f510 con 0x7f1b98062d60 2023-10-24T01:44:43.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b967fc700 1 -- 172.21.15.148:0/1807266177 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00f670 con 0x7f1b98062d60 2023-10-24T01:44:43.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b967fc700 1 -- 172.21.15.148:0/1807266177 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00f9f0 con 0x7f1b98062d60 2023-10-24T01:44:43.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 -- 172.21.15.148:0/1807266177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b98062d60 msgr2=0x7f1b980bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b98062d60 0x7f1b980bcc70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f1b8c009760 tx=0x7f1b8c009060).stop 2023-10-24T01:44:43.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 -- 172.21.15.148:0/1807266177 shutdown_connections 2023-10-24T01:44:43.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b980be640 0x7f1b980a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/1807266177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b98062d60 0x7f1b980bcc70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.973+0000 7f1b9dc56700 1 -- 172.21.15.148:0/1807266177 >> 172.21.15.148:0/1807266177 conn(0x7f1b980c7d10 msgr2=0x7f1b980c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:43.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.974+0000 7f1b9dc56700 1 -- 172.21.15.148:0/1807266177 shutdown_connections 2023-10-24T01:44:43.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.974+0000 7f1b9dc56700 1 -- 172.21.15.148:0/1807266177 wait complete. 2023-10-24T01:44:43.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.975+0000 7f1b9dc56700 1 Processor -- start 2023-10-24T01:44:43.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.975+0000 7f1b9dc56700 1 -- start start 2023-10-24T01:44:43.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98062d60 0x7f1b98148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b981541d0 0x7f1b980acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98164e80 con 0x7f1b980be640 2023-10-24T01:44:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98148830 con 0x7f1b981541d0 2023-10-24T01:44:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98164300 con 0x7f1b98062d60 2023-10-24T01:44:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47980/0 (socket says 172.21.15.148:47980) 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 -- 172.21.15.148:0/972939610 learned_addr learned my addr 172.21.15.148:0/972939610 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b977fe700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98062d60 0x7f1b98148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b97fff700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b981541d0 0x7f1b980acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 -- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98062d60 msgr2=0x7f1b98148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98062d60 0x7f1b98148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 -- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b981541d0 msgr2=0x7f1b980acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b981541d0 0x7f1b980acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 -- 172.21.15.148:0/972939610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0092a0 con 0x7f1b980be640 2023-10-24T01:44:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b96ffd700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f1b98064ca0 tx=0x7f1b8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00fe80 con 0x7f1b980be640 2023-10-24T01:44:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00f7e0 con 0x7f1b980be640 2023-10-24T01:44:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b981645e0 con 0x7f1b980be640 2023-10-24T01:44:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c01b660 con 0x7f1b980be640 2023-10-24T01:44:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.976+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98164ba0 con 0x7f1b980be640 2023-10-24T01:44:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.977+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9806c6b0 con 0x7f1b980be640 2023-10-24T01:44:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.978+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1b8c01ba10 con 0x7f1b980be640 2023-10-24T01:44:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.978+0000 7f1b7f7fe700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 0x7f1b84061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.978+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6065+0+0 (secure 0 0 0) 0x7f1b8c07bb40 con 0x7f1b980be640 2023-10-24T01:44:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.978+0000 7f1b977fe700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 0x7f1b84061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.979+0000 7f1b977fe700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 0x7f1b84061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1b980c4ae0 tx=0x7f1b880014d0).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:43.982+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b8c04ccc0 con 0x7f1b980be640 2023-10-24T01:44:44.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.188+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1b980ad700 con 0x7f1b980be640 2023-10-24T01:44:44.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.195+0000 7f1b7f7fe700 1 -- 172.21.15.148:0/972939610 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1b8c0502e0 con 0x7f1b980be640 2023-10-24T01:44:44.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.201+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 msgr2=0x7f1b84061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.201+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 0x7f1b84061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1b980c4ae0 tx=0x7f1b880014d0).stop 2023-10-24T01:44:44.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.201+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 msgr2=0x7f1b980c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.201+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f1b98064ca0 tx=0x7f1b8c017000).stop 2023-10-24T01:44:44.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 shutdown_connections 2023-10-24T01:44:44.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b981541d0 0x7f1b980acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b98062d60 0x7f1b98148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1b8405f270 0x7f1b84061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 --2- 172.21.15.148:0/972939610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b980be640 0x7f1b980c4ea0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.203+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 >> 172.21.15.148:0/972939610 conn(0x7f1b980c7d10 msgr2=0x7f1b980c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.205+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 shutdown_connections 2023-10-24T01:44:44.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.207+0000 7f1b9dc56700 1 -- 172.21.15.148:0/972939610 wait complete. 2023-10-24T01:44:44.214 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 19 and data pool 20 2023-10-24T01:44:44.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:44.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.342+0000 7fdacb59e700 1 Processor -- start 2023-10-24T01:44:44.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.342+0000 7fdacb59e700 1 -- start start 2023-10-24T01:44:44.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0aa140 0x7fdacc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdacc0ca110 0x7fdacc0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdacc0c0cd0 0x7fdacc157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c6410 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c1160 con 0x7fdacc0ca110 2023-10-24T01:44:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0ca6e0 con 0x7fdacc0aa140 2023-10-24T01:44:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdacc0c0cd0 0x7fdacc157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdacc0c0cd0 0x7fdacc157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47994/0 (socket says 172.21.15.148:47994) 2023-10-24T01:44:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 -- 172.21.15.148:0/898491096 learned_addr learned my addr 172.21.15.148:0/898491096 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdac9d9b700 1 --2- 172.21.15.148:0/898491096 >> v2:172.21.15.150:3300/0 conn(0x7fdacc0ca110 0x7fdacc0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdaca59c700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0aa140 0x7fdacc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 -- 172.21.15.148:0/898491096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0aa140 msgr2=0x7fdacc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:44.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0aa140 0x7fdacc0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 -- 172.21.15.148:0/898491096 >> v2:172.21.15.150:3300/0 conn(0x7fdacc0ca110 msgr2=0x7fdacc0c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:44.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 --2- 172.21.15.148:0/898491096 >> v2:172.21.15.150:3300/0 conn(0x7fdacc0ca110 0x7fdacc0c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 -- 172.21.15.148:0/898491096 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0ca9c0 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdacad9d700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0c0cd0 0x7fdacc157c00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fdacc084050 tx=0x7fdac4009840).ready entity=mon.0 client_cookie=b0c3c23744fd9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdac959a700 1 -- 172.21.15.148:0/898491096 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e070 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdac959a700 1 -- 172.21.15.148:0/898491096 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400ba50 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.343+0000 7fdac959a700 1 -- 172.21.15.148:0/898491096 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400bdd0 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 -- 172.21.15.148:0/898491096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0c0cd0 msgr2=0x7fdacc157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0c0cd0 0x7fdacc157c00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fdacc084050 tx=0x7fdac4009840).stop 2023-10-24T01:44:44.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 -- 172.21.15.148:0/898491096 shutdown_connections 2023-10-24T01:44:44.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0c0cd0 0x7fdacc157c00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 --2- 172.21.15.148:0/898491096 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0aa140 0x7fdacc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 --2- 172.21.15.148:0/898491096 >> v2:172.21.15.150:3300/0 conn(0x7fdacc0ca110 0x7fdacc0c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 -- 172.21.15.148:0/898491096 >> 172.21.15.148:0/898491096 conn(0x7fdacc0944a0 msgr2=0x7fdacc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 -- 172.21.15.148:0/898491096 shutdown_connections 2023-10-24T01:44:44.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.344+0000 7fdacb59e700 1 -- 172.21.15.148:0/898491096 wait complete. 2023-10-24T01:44:44.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.345+0000 7fdacb59e700 1 Processor -- start 2023-10-24T01:44:44.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.345+0000 7fdacb59e700 1 -- start start 2023-10-24T01:44:44.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdacc0aa140 0x7fdacc0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0c0cd0 0x7fdacc0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0adf50 con 0x7fdacc0ca110 2023-10-24T01:44:44.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0ae230 con 0x7fdacc0aa140 2023-10-24T01:44:44.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0ae510 con 0x7fdacc0c0cd0 2023-10-24T01:44:44.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48000/0 (socket says 172.21.15.148:48000) 2023-10-24T01:44:44.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 -- 172.21.15.148:0/3277908978 learned_addr learned my addr 172.21.15.148:0/3277908978 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:44.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdac9d9b700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0c0cd0 0x7fdacc0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdaca59c700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdacc0aa140 0x7fdacc0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 -- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0c0cd0 msgr2=0x7fdacc0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0c0cd0 0x7fdacc0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 -- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdacc0aa140 msgr2=0x7fdacc0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdacc0aa140 0x7fdacc0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 -- 172.21.15.148:0/3277908978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009ae0 con 0x7fdacc0ca110 2023-10-24T01:44:44.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacad9d700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fdac4009fd0 tx=0x7fdac4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4013e60 con 0x7fdacc0ca110 2023-10-24T01:44:44.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40092e0 con 0x7fdacc0ca110 2023-10-24T01:44:44.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac401e6c0 con 0x7fdacc0ca110 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.346+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc0ae7f0 con 0x7fdacc0ca110 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.347+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0ac230 con 0x7fdacc0ca110 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.348+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc047480 con 0x7fdacc0ca110 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.348+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdac4003040 con 0x7fdacc0ca110 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.348+0000 7fdaba7fc700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 0x7fdaac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.348+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fdac407ba10 con 0x7fdacc0ca110 2023-10-24T01:44:44.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.349+0000 7fdaca59c700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 0x7fdaac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.349+0000 7fdaca59c700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 0x7fdaac061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdabc00bbc0 tx=0x7fdabc008040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.353+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdac404ca70 con 0x7fdacc0ca110 2023-10-24T01:44:44.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.516+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdacc062c60 con 0x7fdacc0ca110 2023-10-24T01:44:44.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.517+0000 7fdaba7fc700 1 -- 172.21.15.148:0/3277908978 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17075 (secure 0 0 0) 0x7fdac4023030 con 0x7fdacc0ca110 2023-10-24T01:44:44.519 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:44.520 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":165,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:44.189976+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 msgr2=0x7fdaac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 0x7fdaac061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdabc00bbc0 tx=0x7fdabc008040).stop 2023-10-24T01:44:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 msgr2=0x7fdacc143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fdac4009fd0 tx=0x7fdac4009840).stop 2023-10-24T01:44:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 shutdown_connections 2023-10-24T01:44:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdaac05f270 0x7fdaac061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdacc0ca110 0x7fdacc143480 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdacc0aa140 0x7fdacc0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 --2- 172.21.15.148:0/3277908978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdacc0c0cd0 0x7fdacc0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 >> 172.21.15.148:0/3277908978 conn(0x7fdacc0944a0 msgr2=0x7fdacc153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 shutdown_connections 2023-10-24T01:44:44.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.519+0000 7fdacb59e700 1 -- 172.21.15.148:0/3277908978 wait complete. 2023-10-24T01:44:44.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:44.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.644+0000 7f388b6c9700 1 Processor -- start 2023-10-24T01:44:44.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.644+0000 7f388b6c9700 1 -- start start 2023-10-24T01:44:44.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.645+0000 7f388b6c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f38840c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.645+0000 7f388b6c9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 0x7f3884069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.645+0000 7f388b6c9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38840c0960 con 0x7f38840c6710 2023-10-24T01:44:44.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.645+0000 7f388b6c9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38840aa8a0 con 0x7f38840aa3f0 2023-10-24T01:44:44.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.645+0000 7f388b6c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840c0c40 con 0x7f38840aa010 2023-10-24T01:44:44.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889c66700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 0x7f3884069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f38840c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889c66700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 0x7f3884069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:57308/0 (socket says 172.21.15.148:57308) 2023-10-24T01:44:44.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889c66700 1 -- 172.21.15.148:0/1298694970 learned_addr learned my addr 172.21.15.148:0/1298694970 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:44.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 -- 172.21.15.148:0/1298694970 >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 msgr2=0x7f3884069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:44.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 --2- 172.21.15.148:0/1298694970 >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 0x7f3884069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 -- 172.21.15.148:0/1298694970 >> v1:172.21.15.150:6789/0 conn(0x7f38840c6710 legacy=0x7f3884158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 -- 172.21.15.148:0/1298694970 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38840c0f20 con 0x7f38840aa010 2023-10-24T01:44:44.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f3889465700 1 --2- 172.21.15.148:0/1298694970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f38840c1a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f3880009760 tx=0x7f3880009060).ready entity=mon.2 client_cookie=8877700490db066 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f387bfff700 1 -- 172.21.15.148:0/1298694970 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388000f510 con 0x7f38840aa010 2023-10-24T01:44:44.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f387bfff700 1 -- 172.21.15.148:0/1298694970 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388000f670 con 0x7f38840aa010 2023-10-24T01:44:44.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.646+0000 7f387bfff700 1 -- 172.21.15.148:0/1298694970 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388000f9f0 con 0x7f38840aa010 2023-10-24T01:44:44.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 -- 172.21.15.148:0/1298694970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 msgr2=0x7f38840c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1298694970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f38840c1a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f3880009760 tx=0x7f3880009060).stop 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 -- 172.21.15.148:0/1298694970 shutdown_connections 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1298694970 >> v2:172.21.15.150:3300/0 conn(0x7f38840aa3f0 0x7f3884069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1298694970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f38840c1a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 -- 172.21.15.148:0/1298694970 >> 172.21.15.148:0/1298694970 conn(0x7f38840caf40 msgr2=0x7f38840cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 -- 172.21.15.148:0/1298694970 shutdown_connections 2023-10-24T01:44:44.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.647+0000 7f388b6c9700 1 -- 172.21.15.148:0/1298694970 wait complete. 2023-10-24T01:44:44.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.648+0000 7f388b6c9700 1 Processor -- start 2023-10-24T01:44:44.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.648+0000 7f388b6c9700 1 -- start start 2023-10-24T01:44:44.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f3884148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38840aa3f0 0x7f38840c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884155440 con 0x7f38840c6710 2023-10-24T01:44:44.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38840c4f30 con 0x7f38840aa3f0 2023-10-24T01:44:44.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f388b6c9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840c3c00 con 0x7f38840aa010 2023-10-24T01:44:44.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48014/0 (socket says 172.21.15.148:48014) 2023-10-24T01:44:44.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 -- 172.21.15.148:0/1564889308 learned_addr learned my addr 172.21.15.148:0/1564889308 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:44.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3888c64700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38840aa3f0 0x7f38840c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889465700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f3884148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 -- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 msgr2=0x7f3884148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f3884148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 -- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38840aa3f0 msgr2=0x7f38840c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38840aa3f0 0x7f38840c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 -- 172.21.15.148:0/1564889308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800092a0 con 0x7f38840c6710 2023-10-24T01:44:44.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.649+0000 7f3889c66700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f387c009e50 tx=0x7f387c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.650+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c009c30 con 0x7f38840c6710 2023-10-24T01:44:44.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.650+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c00f040 con 0x7f38840c6710 2023-10-24T01:44:44.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.650+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38840c30c0 con 0x7f38840c6710 2023-10-24T01:44:44.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.650+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c00cc20 con 0x7f38840c6710 2023-10-24T01:44:44.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.650+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38840c36c0 con 0x7f38840c6710 2023-10-24T01:44:44.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.651+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38840af110 con 0x7f38840c6710 2023-10-24T01:44:44.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.651+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f387c014620 con 0x7f38840c6710 2023-10-24T01:44:44.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.651+0000 7f38797fa700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 0x7f3868061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.651+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f387c07a5b0 con 0x7f38840c6710 2023-10-24T01:44:44.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.652+0000 7f3889465700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 0x7f3868061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.652+0000 7f3889465700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 0x7f3868061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3880009760 tx=0x7f3880017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.655+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f387c049af0 con 0x7f38840c6710 2023-10-24T01:44:44.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.819+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f388406c6b0 con 0x7f38840c6710 2023-10-24T01:44:44.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.820+0000 7f38797fa700 1 -- 172.21.15.148:0/1564889308 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f387c04b6d0 con 0x7f38840c6710 2023-10-24T01:44:44.822 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:44.822 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":165,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:44.189976+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:44.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 msgr2=0x7f3868061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 0x7f3868061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3880009760 tx=0x7f3880017000).stop 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 msgr2=0x7f38840c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f387c009e50 tx=0x7f387c00b040).stop 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 shutdown_connections 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f386805f270 0x7f3868061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38840c6710 0x7f38840c4a40 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38840aa010 0x7f3884148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 --2- 172.21.15.148:0/1564889308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38840aa3f0 0x7f38840c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 >> 172.21.15.148:0/1564889308 conn(0x7f38840caf40 msgr2=0x7f38841537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 shutdown_connections 2023-10-24T01:44:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.822+0000 7f388b6c9700 1 -- 172.21.15.148:0/1564889308 wait complete. 2023-10-24T01:44:44.837 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T01:44:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 Processor -- start 2023-10-24T01:44:44.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 -- start start 2023-10-24T01:44:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc154430 0x7f34dc154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34dc0bffd0 0x7f34dc0c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc0c0970 con 0x7f34dc098bd0 2023-10-24T01:44:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc0c6a10 con 0x7f34dc0bffd0 2023-10-24T01:44:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.952+0000 7f34e19ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0c71d0 con 0x7f34dc154430 2023-10-24T01:44:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f34dc0bffd0 0x7f34dc0c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34d27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f34dc098bd0 0x7f34dc0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44792/0 (socket says 172.21.15.148:44792) 2023-10-24T01:44:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34d27fc700 1 -- 172.21.15.148:0/1125168558 learned_addr learned my addr 172.21.15.148:0/1125168558 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34daffd700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc154430 0x7f34dc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 -- 172.21.15.148:0/1125168558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc154430 msgr2=0x7f34dc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc154430 0x7f34dc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 -- 172.21.15.148:0/1125168558 >> v1:172.21.15.148:6789/0 conn(0x7f34dc098bd0 legacy=0x7f34dc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 -- 172.21.15.148:0/1125168558 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc0c9410 con 0x7f34dc0bffd0 2023-10-24T01:44:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34da7fc700 1 -- 172.21.15.148:0/1125168558 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346252882 0 0) 0x7f34c4001110 con 0x7f34dc098bd0 2023-10-24T01:44:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34db7fe700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc0c0480 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f34d4009e90 tx=0x7f34d4009780).ready entity=mon.0 client_cookie=e6b864f68cfb118d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34da7fc700 1 -- 172.21.15.148:0/1125168558 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400e070 con 0x7f34dc0bffd0 2023-10-24T01:44:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34da7fc700 1 -- 172.21.15.148:0/1125168558 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400bbf0 con 0x7f34dc0bffd0 2023-10-24T01:44:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.953+0000 7f34da7fc700 1 -- 172.21.15.148:0/1125168558 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4012410 con 0x7f34dc0bffd0 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 -- 172.21.15.148:0/1125168558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 msgr2=0x7f34dc0c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc0c0480 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f34d4009e90 tx=0x7f34d4009780).stop 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 -- 172.21.15.148:0/1125168558 shutdown_connections 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc0c0480 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 --2- 172.21.15.148:0/1125168558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc154430 0x7f34dc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 -- 172.21.15.148:0/1125168558 >> 172.21.15.148:0/1125168558 conn(0x7f34dc0cb070 msgr2=0x7f34dc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:44.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 -- 172.21.15.148:0/1125168558 shutdown_connections 2023-10-24T01:44:44.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.954+0000 7f34e19ef700 1 -- 172.21.15.148:0/1125168558 wait complete. 2023-10-24T01:44:44.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.955+0000 7f34e19ef700 1 Processor -- start 2023-10-24T01:44:44.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.955+0000 7f34e19ef700 1 -- start start 2023-10-24T01:44:44.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc098bd0 0x7f34dc0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34dc154430 0x7f34dc14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc1526c0 con 0x7f34dc0bffd0 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc150910 con 0x7f34dc154430 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0b1030 con 0x7f34dc098bd0 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48024/0 (socket says 172.21.15.148:48024) 2023-10-24T01:44:44.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 -- 172.21.15.148:0/553361436 learned_addr learned my addr 172.21.15.148:0/553361436 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:44.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34db7fe700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34dc154430 0x7f34dc14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34daffd700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc098bd0 0x7f34dc0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 -- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc098bd0 msgr2=0x7f34dc0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc098bd0 0x7f34dc0afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 -- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34dc154430 msgr2=0x7f34dc14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:44.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34dc154430 0x7f34dc14e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:44.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 -- 172.21.15.148:0/553361436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009a20 con 0x7f34dc0bffd0 2023-10-24T01:44:44.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d27fc700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f34c400c470 tx=0x7f34c4007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400ce20 con 0x7f34dc0bffd0 2023-10-24T01:44:44.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40072e0 con 0x7f34dc0bffd0 2023-10-24T01:44:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc151b40 con 0x7f34dc0bffd0 2023-10-24T01:44:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.956+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4007680 con 0x7f34dc0bffd0 2023-10-24T01:44:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.957+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc152100 con 0x7f34dc0bffd0 2023-10-24T01:44:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.958+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc06c6b0 con 0x7f34dc0bffd0 2023-10-24T01:44:44.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.958+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f34c40059b0 con 0x7f34dc0bffd0 2023-10-24T01:44:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.958+0000 7f34d37fe700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 0x7f34bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.958+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f34c4079960 con 0x7f34dc0bffd0 2023-10-24T01:44:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.958+0000 7f34daffd700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 0x7f34bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:44.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.959+0000 7f34daffd700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 0x7f34bc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f34cc00baf0 tx=0x7f34cc008040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:44.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:44.962+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f34c404a9c0 con 0x7f34dc0bffd0 2023-10-24T01:44:45.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.167+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34dc0c0970 con 0x7f34dc0bffd0 2023-10-24T01:44:45.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.193+0000 7f34d37fe700 1 -- 172.21.15.148:0/553361436 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34dc0c0970 con 0x7f34dc0bffd0 2023-10-24T01:44:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 msgr2=0x7f34bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 0x7f34bc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f34cc00baf0 tx=0x7f34cc008040).stop 2023-10-24T01:44:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 msgr2=0x7f34dc164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f34c400c470 tx=0x7f34c4007a50).stop 2023-10-24T01:44:45.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 shutdown_connections 2023-10-24T01:44:45.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34dc154430 0x7f34dc14e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34dc098bd0 0x7f34dc0afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f34bc05f270 0x7f34bc061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 --2- 172.21.15.148:0/553361436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34dc0bffd0 0x7f34dc164690 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 >> 172.21.15.148:0/553361436 conn(0x7f34dc0cb070 msgr2=0x7f34dc14fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 shutdown_connections 2023-10-24T01:44:45.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.195+0000 7f34e19ef700 1 -- 172.21.15.148:0/553361436 wait complete. 2023-10-24T01:44:45.209 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T01:44:45.210 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T01:44:45.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.325+0000 7f4dafa56700 1 Processor -- start 2023-10-24T01:44:45.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.325+0000 7f4dafa56700 1 -- start start 2023-10-24T01:44:45.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.326+0000 7f4dafa56700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4da80bf6d0 0x7f4da81567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.326+0000 7f4dafa56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da8156ca0 0x7f4da8152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.326+0000 7f4dafa56700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80bfdb0 con 0x7f4da80a8230 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.326+0000 7f4dafa56700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80c41a0 con 0x7f4da80bf6d0 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.326+0000 7f4dafa56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80bfb50 con 0x7f4da8156ca0 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4da80bf6d0 0x7f4da81567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dad7f2700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4da80a8230 0x7f4da81560a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44802/0 (socket says 172.21.15.148:44802) 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dad7f2700 1 -- 172.21.15.148:0/3506277807 learned_addr learned my addr 172.21.15.148:0/3506277807 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:45.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dadff3700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da8156ca0 0x7f4da8152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 -- 172.21.15.148:0/3506277807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da8156ca0 msgr2=0x7f4da8152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:45.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da8156ca0 0x7f4da8152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 -- 172.21.15.148:0/3506277807 >> v1:172.21.15.148:6789/0 conn(0x7f4da80a8230 legacy=0x7f4da81560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4d9ffff700 1 -- 172.21.15.148:0/3506277807 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120750446 0 0) 0x7f4da80bfdb0 con 0x7f4da80a8230 2023-10-24T01:44:45.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 -- 172.21.15.148:0/3506277807 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80c98b0 con 0x7f4da80bf6d0 2023-10-24T01:44:45.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4dacff1700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da80bf6d0 0x7f4da81567b0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f4d98009760 tx=0x7f4d98009060).ready entity=mon.0 client_cookie=9bdc704b5b3183be server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:45.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4d9ffff700 1 -- 172.21.15.148:0/3506277807 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800f510 con 0x7f4da80bf6d0 2023-10-24T01:44:45.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4d9ffff700 1 -- 172.21.15.148:0/3506277807 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9800f670 con 0x7f4da80bf6d0 2023-10-24T01:44:45.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.327+0000 7f4d9ffff700 1 -- 172.21.15.148:0/3506277807 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800f9f0 con 0x7f4da80bf6d0 2023-10-24T01:44:45.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 -- 172.21.15.148:0/3506277807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da80bf6d0 msgr2=0x7f4da81567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da80bf6d0 0x7f4da81567b0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f4d98009760 tx=0x7f4d98009060).stop 2023-10-24T01:44:45.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 -- 172.21.15.148:0/3506277807 shutdown_connections 2023-10-24T01:44:45.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da8156ca0 0x7f4da8152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 --2- 172.21.15.148:0/3506277807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da80bf6d0 0x7f4da81567b0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 -- 172.21.15.148:0/3506277807 >> 172.21.15.148:0/3506277807 conn(0x7f4da80630d0 msgr2=0x7f4da80c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:45.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 -- 172.21.15.148:0/3506277807 shutdown_connections 2023-10-24T01:44:45.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.328+0000 7f4dafa56700 1 -- 172.21.15.148:0/3506277807 wait complete. 2023-10-24T01:44:45.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.329+0000 7f4dafa56700 1 Processor -- start 2023-10-24T01:44:45.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.329+0000 7f4dafa56700 1 -- start start 2023-10-24T01:44:45.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4da80a8230 0x7f4da81534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da80bf6d0 0x7f4da8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8063b70 con 0x7f4da8156ca0 2023-10-24T01:44:45.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81523d0 con 0x7f4da80a8230 2023-10-24T01:44:45.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dafa56700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da813adb0 con 0x7f4da80bf6d0 2023-10-24T01:44:45.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48042/0 (socket says 172.21.15.148:48042) 2023-10-24T01:44:45.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 -- 172.21.15.148:0/1614630653 learned_addr learned my addr 172.21.15.148:0/1614630653 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:45.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dacff1700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da80bf6d0 0x7f4da8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dad7f2700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4da80a8230 0x7f4da81534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 -- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da80bf6d0 msgr2=0x7f4da8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da80bf6d0 0x7f4da8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 -- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4da80a8230 msgr2=0x7f4da81534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:45.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4da80a8230 0x7f4da81534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 -- 172.21.15.148:0/1614630653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980092a0 con 0x7f4da8156ca0 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.330+0000 7f4dadff3700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f4da000e900 tx=0x7f4da0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.331+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00094d0 con 0x7f4da8156ca0 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.331+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da0012600 con 0x7f4da8156ca0 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.331+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da813b090 con 0x7f4da8156ca0 2023-10-24T01:44:45.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.331+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0012980 con 0x7f4da8156ca0 2023-10-24T01:44:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.331+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da813b370 con 0x7f4da8156ca0 2023-10-24T01:44:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.332+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8063d20 con 0x7f4da8156ca0 2023-10-24T01:44:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.332+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4da0012d30 con 0x7f4da8156ca0 2023-10-24T01:44:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.332+0000 7f4d9d7fa700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 0x7f4d8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:45.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.332+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f4da007a750 con 0x7f4da8156ca0 2023-10-24T01:44:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.333+0000 7f4dad7f2700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 0x7f4d8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.333+0000 7f4dad7f2700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 0x7f4d8c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4da4001a90 tx=0x7f4da40014d0).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:45.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.336+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4da8063d20 con 0x7f4da8156ca0 2023-10-24T01:44:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:45.552+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4da8063cb0 con 0x7f4da8156ca0 2023-10-24T01:44:46.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.197+0000 7f4d9d7fa700 1 -- 172.21.15.148:0/1614630653 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4da004f2a0 con 0x7f4da8156ca0 2023-10-24T01:44:46.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 msgr2=0x7f4d8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 0x7f4d8c061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4da4001a90 tx=0x7f4da40014d0).stop 2023-10-24T01:44:46.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 msgr2=0x7f4da813a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f4da000e900 tx=0x7f4da0009060).stop 2023-10-24T01:44:46.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 shutdown_connections 2023-10-24T01:44:46.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d8c05f270 0x7f4d8c061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4da8156ca0 0x7f4da813a460 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4da80a8230 0x7f4da81534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.199+0000 7f4dafa56700 1 --2- 172.21.15.148:0/1614630653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4da80bf6d0 0x7f4da8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.200+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 >> 172.21.15.148:0/1614630653 conn(0x7f4da80630d0 msgr2=0x7f4da8137a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.200+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 shutdown_connections 2023-10-24T01:44:46.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.200+0000 7f4dafa56700 1 -- 172.21.15.148:0/1614630653 wait complete. 2023-10-24T01:44:46.214 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T01:44:46.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:46.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.327+0000 7fb59d53e700 1 Processor -- start 2023-10-24T01:44:46.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.327+0000 7fb59d53e700 1 -- start start 2023-10-24T01:44:46.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59d53e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980c07e0 0x7fb5980c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59d53e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5980c68a0 0x7fb5980c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59d53e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5980c6410 con 0x7fb5980aa140 2023-10-24T01:44:46.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59d53e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5980c1150 con 0x7fb5980c68a0 2023-10-24T01:44:46.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59d53e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980ca6e0 con 0x7fb5980c07e0 2023-10-24T01:44:46.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5980c68a0 0x7fb5980c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb5980c68a0 0x7fb5980c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48052/0 (socket says 172.21.15.148:48052) 2023-10-24T01:44:46.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 -- 172.21.15.148:0/16971781 learned_addr learned my addr 172.21.15.148:0/16971781 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:46.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb5977fe700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980c07e0 0x7fb5980c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 -- 172.21.15.148:0/16971781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980c07e0 msgr2=0x7fb5980c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:46.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980c07e0 0x7fb5980c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 -- 172.21.15.148:0/16971781 >> v1:172.21.15.150:6789/0 conn(0x7fb5980aa140 legacy=0x7fb5980c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:46.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 -- 172.21.15.148:0/16971781 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980ca9c0 con 0x7fb5980c68a0 2023-10-24T01:44:46.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.328+0000 7fb59cd3d700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c68a0 0x7fb5980c6d10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7fb590009f20 tx=0x7fb590009840).ready entity=mon.0 client_cookie=1ad2d8342595b9d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb596ffd700 1 -- 172.21.15.148:0/16971781 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000e070 con 0x7fb5980c68a0 2023-10-24T01:44:46.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb596ffd700 1 -- 172.21.15.148:0/16971781 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59000ba40 con 0x7fb5980c68a0 2023-10-24T01:44:46.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb596ffd700 1 -- 172.21.15.148:0/16971781 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000bdc0 con 0x7fb5980c68a0 2023-10-24T01:44:46.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 -- 172.21.15.148:0/16971781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c68a0 msgr2=0x7fb5980c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c68a0 0x7fb5980c6d10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7fb590009f20 tx=0x7fb590009840).stop 2023-10-24T01:44:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 -- 172.21.15.148:0/16971781 shutdown_connections 2023-10-24T01:44:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c68a0 0x7fb5980c6d10 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 --2- 172.21.15.148:0/16971781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980c07e0 0x7fb5980c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 -- 172.21.15.148:0/16971781 >> 172.21.15.148:0/16971781 conn(0x7fb5980944a0 msgr2=0x7fb59806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 -- 172.21.15.148:0/16971781 shutdown_connections 2023-10-24T01:44:46.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.329+0000 7fb59d53e700 1 -- 172.21.15.148:0/16971781 wait complete. 2023-10-24T01:44:46.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.330+0000 7fb59d53e700 1 Processor -- start 2023-10-24T01:44:46.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.330+0000 7fb59d53e700 1 -- start start 2023-10-24T01:44:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 0x7fb5980afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 0x7fb5980c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980aeca0 con 0x7fb5980c07e0 2023-10-24T01:44:46.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980addb0 con 0x7fb5980c68a0 2023-10-24T01:44:46.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb59d53e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980ae090 con 0x7fb5980aa140 2023-10-24T01:44:46.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb5977fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb5977fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48060/0 (socket says 172.21.15.148:48060) 2023-10-24T01:44:46.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.331+0000 7fb5977fe700 1 -- 172.21.15.148:0/1461858529 learned_addr learned my addr 172.21.15.148:0/1461858529 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:46.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb59cd3d700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 0x7fb5980c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 -- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 msgr2=0x7fb5980afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb597fff700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 0x7fb5980afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 0x7fb5980afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 -- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 msgr2=0x7fb5980c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 0x7fb5980c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 -- 172.21.15.148:0/1461858529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590009ae0 con 0x7fb5980c07e0 2023-10-24T01:44:46.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb597fff700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 0x7fb5980afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:46.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb59cd3d700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 0x7fb5980c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:46.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb5977fe700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fb58c00c850 tx=0x7fb58c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c010580 con 0x7fb5980c07e0 2023-10-24T01:44:46.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c0106e0 con 0x7fb5980c07e0 2023-10-24T01:44:46.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5980ae370 con 0x7fb5980c07e0 2023-10-24T01:44:46.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c010a60 con 0x7fb5980c07e0 2023-10-24T01:44:46.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.332+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5980ae930 con 0x7fb5980c07e0 2023-10-24T01:44:46.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.333+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5980aee50 con 0x7fb5980c07e0 2023-10-24T01:44:46.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.333+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb58c01b460 con 0x7fb5980c07e0 2023-10-24T01:44:46.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.334+0000 7fb57ffff700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 0x7fb584061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.334+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fb58c07a360 con 0x7fb5980c07e0 2023-10-24T01:44:46.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.334+0000 7fb597fff700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 0x7fb584061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.334+0000 7fb597fff700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 0x7fb584061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb5880026f0 tx=0x7fb588009040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.338+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5980aee50 con 0x7fb5980c07e0 2023-10-24T01:44:46.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.540+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5980af030 con 0x7fb5980c07e0 2023-10-24T01:44:46.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.541+0000 7fb57ffff700 1 -- 172.21.15.148:0/1461858529 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fb5980af030 con 0x7fb5980c07e0 2023-10-24T01:44:46.543 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:46.543 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 msgr2=0x7fb584061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 0x7fb584061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb5880026f0 tx=0x7fb588009040).stop 2023-10-24T01:44:46.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 msgr2=0x7fb598151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fb58c00c850 tx=0x7fb58c008040).stop 2023-10-24T01:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 shutdown_connections 2023-10-24T01:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5980c68a0 0x7fb5980c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5980aa140 0x7fb5980afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb58405f270 0x7fb584061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 --2- 172.21.15.148:0/1461858529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5980c07e0 0x7fb598151f90 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 >> 172.21.15.148:0/1461858529 conn(0x7fb5980944a0 msgr2=0x7fb5980a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 shutdown_connections 2023-10-24T01:44:46.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.543+0000 7fb59d53e700 1 -- 172.21.15.148:0/1461858529 wait complete. 2023-10-24T01:44:46.548 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:44:46.557 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:46.675 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.673+0000 7f18da821700 1 Processor -- start 2023-10-24T01:44:46.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 -- start start 2023-10-24T01:44:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40695f0 0x7f18d40699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18d40aacd0 0x7f18d413a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18d413a7e0 0x7f18d4065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d413ac90 con 0x7f18d413a7e0 2023-10-24T01:44:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d40c57b0 con 0x7f18d40aacd0 2023-10-24T01:44:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.674+0000 7f18da821700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40c5a90 con 0x7f18d40695f0 2023-10-24T01:44:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18d413a7e0 0x7f18d4065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f18d413a7e0 0x7f18d4065fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48064/0 (socket says 172.21.15.148:48064) 2023-10-24T01:44:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 -- 172.21.15.148:0/752769017 learned_addr learned my addr 172.21.15.148:0/752769017 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d3fff700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40695f0 0x7f18d40699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d37fe700 1 --2- 172.21.15.148:0/752769017 >> v2:172.21.15.150:3300/0 conn(0x7f18d40aacd0 0x7f18d413a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 -- 172.21.15.148:0/752769017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40695f0 msgr2=0x7f18d40699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:46.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40695f0 0x7f18d40699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 -- 172.21.15.148:0/752769017 >> v2:172.21.15.150:3300/0 conn(0x7f18d40aacd0 msgr2=0x7f18d413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 --2- 172.21.15.148:0/752769017 >> v2:172.21.15.150:3300/0 conn(0x7f18d40aacd0 0x7f18d413a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 -- 172.21.15.148:0/752769017 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40c5d70 con 0x7f18d413a7e0 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d8dbe700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d413a7e0 0x7f18d4065fb0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f18cc009f20 tx=0x7f18cc009840).ready entity=mon.0 client_cookie=28c91f79b53ef2c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d2ffd700 1 -- 172.21.15.148:0/752769017 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00e070 con 0x7f18d413a7e0 2023-10-24T01:44:46.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d2ffd700 1 -- 172.21.15.148:0/752769017 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00ba40 con 0x7f18d413a7e0 2023-10-24T01:44:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.675+0000 7f18d2ffd700 1 -- 172.21.15.148:0/752769017 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00bdc0 con 0x7f18d413a7e0 2023-10-24T01:44:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 -- 172.21.15.148:0/752769017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d413a7e0 msgr2=0x7f18d4065fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d413a7e0 0x7f18d4065fb0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f18cc009f20 tx=0x7f18cc009840).stop 2023-10-24T01:44:46.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 -- 172.21.15.148:0/752769017 shutdown_connections 2023-10-24T01:44:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d413a7e0 0x7f18d4065fb0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 --2- 172.21.15.148:0/752769017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40695f0 0x7f18d40699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 --2- 172.21.15.148:0/752769017 >> v2:172.21.15.150:3300/0 conn(0x7f18d40aacd0 0x7f18d413a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 -- 172.21.15.148:0/752769017 >> 172.21.15.148:0/752769017 conn(0x7f18d40641f0 msgr2=0x7f18d40c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 -- 172.21.15.148:0/752769017 shutdown_connections 2023-10-24T01:44:46.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.676+0000 7f18da821700 1 -- 172.21.15.148:0/752769017 wait complete. 2023-10-24T01:44:46.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.677+0000 7f18da821700 1 Processor -- start 2023-10-24T01:44:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.677+0000 7f18da821700 1 -- start start 2023-10-24T01:44:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40aacd0 0x7f18d4151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d413a7e0 0x7f18d4062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41552b0 con 0x7f18d40695f0 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4151f00 con 0x7f18d413a7e0 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18da821700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41521e0 con 0x7f18d40aacd0 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48070/0 (socket says 172.21.15.148:48070) 2023-10-24T01:44:46.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 -- 172.21.15.148:0/2303541772 learned_addr learned my addr 172.21.15.148:0/2303541772 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d8dbe700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d413a7e0 0x7f18d4062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d37fe700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40aacd0 0x7f18d4151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 -- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40aacd0 msgr2=0x7f18d4151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40aacd0 0x7f18d4151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 -- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d413a7e0 msgr2=0x7f18d4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d413a7e0 0x7f18d4062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 -- 172.21.15.148:0/2303541772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009ae0 con 0x7f18d40695f0 2023-10-24T01:44:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.678+0000 7f18d3fff700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f18c400d890 tx=0x7f18c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.679+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4011590 con 0x7f18d40695f0 2023-10-24T01:44:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.679+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c40116f0 con 0x7f18d40695f0 2023-10-24T01:44:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.679+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d41524c0 con 0x7f18d40695f0 2023-10-24T01:44:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.679+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4011a70 con 0x7f18d40695f0 2023-10-24T01:44:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.679+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d4154e40 con 0x7f18d40695f0 2023-10-24T01:44:46.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.680+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d41550c0 con 0x7f18d40695f0 2023-10-24T01:44:46.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.680+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f18c401c460 con 0x7f18d40695f0 2023-10-24T01:44:46.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.680+0000 7f18cbfff700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 0x7f18b4061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.680+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f18c407a1b0 con 0x7f18d40695f0 2023-10-24T01:44:46.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.681+0000 7f18d37fe700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 0x7f18b4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.681+0000 7f18d37fe700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 0x7f18b4061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f18d40660d0 tx=0x7f18bc008040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.684+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f18d41550c0 con 0x7f18d40695f0 2023-10-24T01:44:46.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.849+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18d41550c0 con 0x7f18d40695f0 2023-10-24T01:44:46.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.850+0000 7f18cbfff700 1 -- 172.21.15.148:0/2303541772 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+17062 (secure 0 0 0) 0x7f18c404b270 con 0x7f18d40695f0 2023-10-24T01:44:46.852 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:46.852 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":166,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:45.192115+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:46.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 msgr2=0x7f18b4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 0x7f18b4061700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f18d40660d0 tx=0x7f18bc008040).stop 2023-10-24T01:44:46.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 msgr2=0x7f18d4150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f18c400d890 tx=0x7f18c4008040).stop 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 shutdown_connections 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18d413a7e0 0x7f18d4062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f18b405f240 0x7f18b4061700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18d40695f0 0x7f18d4150890 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 --2- 172.21.15.148:0/2303541772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18d40aacd0 0x7f18d4151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 >> 172.21.15.148:0/2303541772 conn(0x7f18d40641f0 msgr2=0x7f18d4065570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 shutdown_connections 2023-10-24T01:44:46.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.852+0000 7f18da821700 1 -- 172.21.15.148:0/2303541772 wait complete. 2023-10-24T01:44:46.866 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T01:44:46.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:44:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.978+0000 7f89882af700 1 Processor -- start 2023-10-24T01:44:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.978+0000 7f89882af700 1 -- start start 2023-10-24T01:44:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f89882af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 0x7f89800c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f89882af700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 0x7f8980069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f89882af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c0960 con 0x7f89800c6710 2023-10-24T01:44:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f89882af700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800aa8a0 con 0x7f89800aa3f0 2023-10-24T01:44:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f89882af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800c0c40 con 0x7f89800aa010 2023-10-24T01:44:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f898604b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 0x7f89800c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f898684c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 0x7f8980069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f898584a700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f89800c6710 0x7f8980158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56542/0 (socket says 172.21.15.148:56542) 2023-10-24T01:44:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.979+0000 7f898584a700 1 -- 172.21.15.148:0/1931056641 learned_addr learned my addr 172.21.15.148:0/1931056641 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898604b700 1 -- 172.21.15.148:0/1931056641 >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 msgr2=0x7f8980069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:46.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898604b700 1 --2- 172.21.15.148:0/1931056641 >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 0x7f8980069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898604b700 1 -- 172.21.15.148:0/1931056641 >> v1:172.21.15.150:6789/0 conn(0x7f89800c6710 legacy=0x7f8980158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898604b700 1 -- 172.21.15.148:0/1931056641 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800c0f20 con 0x7f89800aa010 2023-10-24T01:44:46.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f8985049700 1 -- 172.21.15.148:0/1931056641 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300064858 0 0) 0x7f89800c0960 con 0x7f89800c6710 2023-10-24T01:44:46.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898684c700 1 --2- 172.21.15.148:0/1931056641 >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 0x7f8980069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f898604b700 1 --2- 172.21.15.148:0/1931056641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 0x7f89800c1a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f897c009760 tx=0x7f897c009060).ready entity=mon.2 client_cookie=356234c2af63c36d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f8985049700 1 -- 172.21.15.148:0/1931056641 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00f510 con 0x7f89800aa010 2023-10-24T01:44:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f8985049700 1 -- 172.21.15.148:0/1931056641 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c00f670 con 0x7f89800aa010 2023-10-24T01:44:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.980+0000 7f8985049700 1 -- 172.21.15.148:0/1931056641 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c00f9f0 con 0x7f89800aa010 2023-10-24T01:44:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 -- 172.21.15.148:0/1931056641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 msgr2=0x7f89800c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 --2- 172.21.15.148:0/1931056641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 0x7f89800c1a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f897c009760 tx=0x7f897c009060).stop 2023-10-24T01:44:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 -- 172.21.15.148:0/1931056641 shutdown_connections 2023-10-24T01:44:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 --2- 172.21.15.148:0/1931056641 >> v2:172.21.15.150:3300/0 conn(0x7f89800aa3f0 0x7f8980069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 --2- 172.21.15.148:0/1931056641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800aa010 0x7f89800c1a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 -- 172.21.15.148:0/1931056641 >> 172.21.15.148:0/1931056641 conn(0x7f89800caf40 msgr2=0x7f89800cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:46.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 -- 172.21.15.148:0/1931056641 shutdown_connections 2023-10-24T01:44:46.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.981+0000 7f89882af700 1 -- 172.21.15.148:0/1931056641 wait complete. 2023-10-24T01:44:46.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.982+0000 7f89882af700 1 Processor -- start 2023-10-24T01:44:46.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.982+0000 7f89882af700 1 -- start start 2023-10-24T01:44:46.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800c6710 0x7f89800ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800ca940 con 0x7f89800aa3f0 2023-10-24T01:44:46.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898014ee50 con 0x7f89800aa010 2023-10-24T01:44:46.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980167b20 con 0x7f89800c6710 2023-10-24T01:44:46.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898604b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48082/0 (socket says 172.21.15.148:48082) 2023-10-24T01:44:46.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898604b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:57396/0 (socket says 172.21.15.148:57396) 2023-10-24T01:44:46.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 -- 172.21.15.148:0/2432771797 learned_addr learned my addr 172.21.15.148:0/2432771797 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:46.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898684c700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800c6710 0x7f89800ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 -- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800c6710 msgr2=0x7f89800ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800c6710 0x7f89800ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 -- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 msgr2=0x7f898014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:46.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:46.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 -- 172.21.15.148:0/2432771797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009a20 con 0x7f89800aa3f0 2023-10-24T01:44:46.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898604b700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:46.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f898584a700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f897000c490 tx=0x7f8970007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000ce90 con 0x7f89800aa3f0 2023-10-24T01:44:46.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89700072e0 con 0x7f89800aa3f0 2023-10-24T01:44:46.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0092a0 con 0x7f89800aa3f0 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.983+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970007680 con 0x7f89800aa3f0 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.984+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89801680a0 con 0x7f89800aa3f0 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.985+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898006c6b0 con 0x7f89800aa3f0 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.985+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f89700059b0 con 0x7f89800aa3f0 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.985+0000 7f89767fc700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 0x7f8964061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:46.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.985+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f8970079bf0 con 0x7f89800aa3f0 2023-10-24T01:44:46.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.985+0000 7f898604b700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 0x7f8964061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:46.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.986+0000 7f898604b700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 0x7f8964061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f897c009fd0 tx=0x7f897c017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:46.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:46.989+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8970080080 con 0x7f89800aa3f0 2023-10-24T01:44:47.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.149+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89800c1200 con 0x7f896405f270 2023-10-24T01:44:47.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.160+0000 7f89767fc700 1 -- 172.21.15.148:0/2432771797 <== mgr.6995 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350382 (secure 0 0 0) 0x7f89800c1200 con 0x7f896405f270 2023-10-24T01:44:47.166 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:47.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 msgr2=0x7f8964061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 0x7f8964061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f897c009fd0 tx=0x7f897c017000).stop 2023-10-24T01:44:47.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 msgr2=0x7f89800c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f897000c490 tx=0x7f8970007e60).stop 2023-10-24T01:44:47.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 shutdown_connections 2023-10-24T01:44:47.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89800c6710 0x7f89800ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89800aa010 0x7f898014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f896405f270 0x7f8964061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 --2- 172.21.15.148:0/2432771797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89800aa3f0 0x7f89800c9f60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 >> 172.21.15.148:0/2432771797 conn(0x7f89800caf40 msgr2=0x7f8980069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:47.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 shutdown_connections 2023-10-24T01:44:47.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.163+0000 7f89882af700 1 -- 172.21.15.148:0/2432771797 wait complete. 2023-10-24T01:44:47.171 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:44:47.177 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-24T01:44:45.467691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2437524,"kb_used_data":15700,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752537196,"statfs":{"total":773094113280,"available":770598088704,"internally_reserved":0,"allocated":16076800,"data_stored":8141313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5036901,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-524,"num_write_kb":-5314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000079"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387636+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:44:39.387636+0000","last_peered":"2023-10-24T01:44:39.387636+0000","last_clean":"2023-10-24T01:44:39.387636+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:44:39.387636+0000","last_undegraded":"2023-10-24T01:44:39.387636+0000","last_fullsized":"2023-10-24T01:44:39.387636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":129,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387694+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:44:39.387694+0000","last_peered":"2023-10-24T01:44:39.387694+0000","last_clean":"2023-10-24T01:44:39.387694+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:44:39.387694+0000","last_undegraded":"2023-10-24T01:44:39.387694+0000","last_fullsized":"2023-10-24T01:44:39.387694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":131,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387544+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:44:39.387544+0000","last_peered":"2023-10-24T01:44:39.387544+0000","last_clean":"2023-10-24T01:44:39.387544+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:44:39.387544+0000","last_undegraded":"2023-10-24T01:44:39.387544+0000","last_fullsized":"2023-10-24T01:44:39.387544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":129,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387683+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:44:39.387683+0000","last_peered":"2023-10-24T01:44:39.387683+0000","last_clean":"2023-10-24T01:44:39.387683+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:44:39.387683+0000","last_undegraded":"2023-10-24T01:44:39.387683+0000","last_fullsized":"2023-10-24T01:44:39.387683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.366227+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:44:39.366227+0000","last_peered":"2023-10-24T01:44:39.366227+0000","last_clean":"2023-10-24T01:44:39.366227+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:44:39.366227+0000","last_undegraded":"2023-10-24T01:44:39.366227+0000","last_fullsized":"2023-10-24T01:44:39.366227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.366227+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:44:39.366227+0000","last_peered":"2023-10-24T01:44:39.366227+0000","last_clean":"2023-10-24T01:44:39.366227+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:44:39.366227+0000","last_undegraded":"2023-10-24T01:44:39.366227+0000","last_fullsized":"2023-10-24T01:44:39.366227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.366247+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:44:39.366247+0000","last_peered":"2023-10-24T01:44:39.366247+0000","last_clean":"2023-10-24T01:44:39.366247+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:44:39.366247+0000","last_undegraded":"2023-10-24T01:44:39.366247+0000","last_fullsized":"2023-10-24T01:44:39.366247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387678+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:44:39.387678+0000","last_peered":"2023-10-24T01:44:39.387678+0000","last_clean":"2023-10-24T01:44:39.387678+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:44:39.387678+0000","last_undegraded":"2023-10-24T01:44:39.387678+0000","last_fullsized":"2023-10-24T01:44:39.387678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:43.815412+0000","last_change":"2023-10-24T01:44:43.815412+0000","last_active":"2023-10-24T01:44:43.815412+0000","last_peered":"2023-10-24T01:44:43.815412+0000","last_clean":"2023-10-24T01:44:43.815412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:43.815412+0000","last_undegraded":"2023-10-24T01:44:43.815412+0000","last_fullsized":"2023-10-24T01:44:43.815412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:44:42.810454+0000","last_change":"2023-10-24T01:44:42.810454+0000","last_active":"2023-10-24T01:44:42.810454+0000","last_peered":"2023-10-24T01:44:42.810454+0000","last_clean":"2023-10-24T01:44:42.810454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:44:42.810454+0000","last_undegraded":"2023-10-24T01:44:42.810454+0000","last_fullsized":"2023-10-24T01:44:42.810454+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-24T01:44:39.387643+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:44:39.387643+0000","last_peered":"2023-10-24T01:44:39.387643+0000","last_clean":"2023-10-24T01:44:39.387643+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:44:39.387643+0000","last_undegraded":"2023-10-24T01:44:39.387643+0000","last_fullsized":"2023-10-24T01:44:39.387643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543052,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307252,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064588,"statfs":{"total":96636764160,"available":96322138112,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.499}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.378}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.43099999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.45700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575756,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303156,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.505},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.442}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47599999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.622},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.64100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575757,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303156,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.55000000000000004,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.436,"15min":0.433},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.63,"15min":0.66200000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.625},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.626}]},{"osd":5,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38600000000000001},"max":{"1min":0.878,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.41599999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.96899999999999997},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.751},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.67300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"last":0.72299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575757,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303156,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.41699999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.498}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307252,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064588,"statfs":{"total":96636764160,"available":96322138112,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.252},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.35599999999999998}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.623}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307252,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064588,"statfs":{"total":96636764160,"available":96322138112,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.251},"max":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.66800000000000004,"15min":0.70799999999999996},"last":0.35599999999999998}]},{"osd":1,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.75600000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.69699999999999995,"5min":0.751,"15min":0.751},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.52200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.032},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98799999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.56100000000000005,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":0.96099999999999997,"15min":1.0049999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68799999999999994,"15min":0.67700000000000005},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.59799999999999998,"5min":0.47899999999999998,"15min":0.46000000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99199999999999999},"last":0.65300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575757,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303156,"kb_used_data":1964,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":2011136,"data_stored":1018396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73899999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.72699999999999998}]},{"osd":1,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.78000000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.56699999999999995}]},{"osd":2,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.77400000000000002,"15min":0.81799999999999995},"last":0.53400000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.81100000000000005,"15min":0.83299999999999996},"last":0.436},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68400000000000005,"5min":1.04,"15min":1.04},"last":0.68999999999999995}]},{"osd":6,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.72499999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70999999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63}]},{"osd":7,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]}]},{"osd":5,"up_from":14,"seq":60129543052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303144,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068696,"statfs":{"total":96636764160,"available":96326344704,"internally_reserved":0,"allocated":1998848,"data_stored":1012541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.58099999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:44:47.184 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:44:47.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.327+0000 7f12d0cc1700 1 Processor -- start 2023-10-24T01:44:47.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.328+0000 7f12d0cc1700 1 -- start start 2023-10-24T01:44:47.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.328+0000 7f12d0cc1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12cc0c6710 0x7f12cc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.328+0000 7f12d0cc1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc0aa820 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.328+0000 7f12d0cc1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc0c0960 con 0x7f12cc0aa010 2023-10-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.328+0000 7f12d0cc1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0c0c40 con 0x7f12cc0c6710 2023-10-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12cad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f12cc0aa3f0 0x7f12cc069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44814/0 (socket says 172.21.15.148:44814) 2023-10-24T01:44:47.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12cad9d700 1 -- 172.21.15.148:0/2222091553 learned_addr learned my addr 172.21.15.148:0/2222091553 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c1d9b700 1 --2- 172.21.15.148:0/2222091553 >> v2:172.21.15.150:3300/0 conn(0x7f12cc0c6710 0x7f12cc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265470393 0 0) 0x7f12cc0aa820 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b80033f0 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1044577034 0 0) 0x7f12b80033f0 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 >> v2:172.21.15.150:3300/0 conn(0x7f12cc0c6710 msgr2=0x7f12cc0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:47.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 --2- 172.21.15.148:0/2222091553 >> v2:172.21.15.150:3300/0 conn(0x7f12cc0c6710 0x7f12cc0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 >> v1:172.21.15.150:6789/0 conn(0x7f12cc0aa010 legacy=0x7f12cc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0c0f20 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f12c40017f0 con 0x7f12cc0aa3f0 2023-10-24T01:44:47.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 >> v1:172.21.15.148:6789/0 conn(0x7f12cc0aa3f0 legacy=0x7f12cc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12b8004690 0x7f12b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 0x7f12b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c0c40 con 0x7f12b8005000 2023-10-24T01:44:47.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b800bf60 con 0x7f12b8004690 2023-10-24T01:44:47.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b800c0f0 con 0x7f12b80038e0 2023-10-24T01:44:47.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12cad9d700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 0x7f12b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12c1d9b700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12b8004690 0x7f12b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.329+0000 7f12ca59c700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 -- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b80038e0 msgr2=0x7f12b8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:47.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 -- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12b8004690 msgr2=0x7f12b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:47.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12b8004690 0x7f12b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 -- 172.21.15.148:0/2222091553 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80033f0 con 0x7f12b8005000 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12ca59c700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b80038e0 0x7f12b8003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 -- 172.21.15.148:0/2222091553 reap_dead start 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12cad9d700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 0x7f12b800b8e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f12c400c480 tx=0x7f12c400c790).ready entity=mon.0 client_cookie=950e591fedc387b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4002030 con 0x7f12b8005000 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400ce20 con 0x7f12b8005000 2023-10-24T01:44:47.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12c9d9b700 1 -- 172.21.15.148:0/2222091553 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4005d30 con 0x7f12b8005000 2023-10-24T01:44:47.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 -- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 msgr2=0x7f12b800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 0x7f12b800b8e0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f12c400c480 tx=0x7f12c400c790).stop 2023-10-24T01:44:47.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 -- 172.21.15.148:0/2222091553 shutdown_connections 2023-10-24T01:44:47.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/2222091553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12b8005000 0x7f12b800b8e0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 -- 172.21.15.148:0/2222091553 >> 172.21.15.148:0/2222091553 conn(0x7f12cc0caf40 msgr2=0x7f12cc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:47.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 -- 172.21.15.148:0/2222091553 shutdown_connections 2023-10-24T01:44:47.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.330+0000 7f12d0cc1700 1 -- 172.21.15.148:0/2222091553 wait complete. 2023-10-24T01:44:47.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 Processor -- start 2023-10-24T01:44:47.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 -- start start 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b8005000 0x7f12cc0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12cc0ca1e0 0x7f12cc0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c4300 con 0x7f12cc0b0680 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c3e70 con 0x7f12cc0ca1e0 2023-10-24T01:44:47.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.332+0000 7f12d0cc1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c3260 con 0x7f12b8005000 2023-10-24T01:44:47.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48100/0 (socket says 172.21.15.148:48100) 2023-10-24T01:44:47.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 -- 172.21.15.148:0/730608544 learned_addr learned my addr 172.21.15.148:0/730608544 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:47.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12ca59c700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b8005000 0x7f12cc0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12c1d9b700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12cc0ca1e0 0x7f12cc0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 -- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b8005000 msgr2=0x7f12cc0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b8005000 0x7f12cc0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 -- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12cc0ca1e0 msgr2=0x7f12cc0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12cc0ca1e0 0x7f12cc0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 -- 172.21.15.148:0/730608544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0c3540 con 0x7f12cc0b0680 2023-10-24T01:44:47.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12cad9d700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f12cc084440 tx=0x7f12c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4002030 con 0x7f12cc0b0680 2023-10-24T01:44:47.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4005e40 con 0x7f12cc0b0680 2023-10-24T01:44:47.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc0c3820 con 0x7f12cc0b0680 2023-10-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4013450 con 0x7f12cc0b0680 2023-10-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.333+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc0b0b00 con 0x7f12cc0b0680 2023-10-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.334+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc06c6b0 con 0x7f12cc0b0680 2023-10-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.334+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f12c40137c0 con 0x7f12cc0b0680 2023-10-24T01:44:47.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.335+0000 7f12c2ffd700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 0x7f12ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.335+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f12c407b640 con 0x7f12cc0b0680 2023-10-24T01:44:47.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.335+0000 7f12ca59c700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 0x7f12ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.335+0000 7f12ca59c700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 0x7f12ac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f12bc000c00 tx=0x7f12bc00c040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.339+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f12c404c760 con 0x7f12cc0b0680 2023-10-24T01:44:47.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.498+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12cc0c3fb0 con 0x7f12ac05f270 2023-10-24T01:44:47.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.508+0000 7f12c2ffd700 1 -- 172.21.15.148:0/730608544 <== mgr.6995 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362304 (secure 0 0 0) 0x7f12cc0c3fb0 con 0x7f12ac05f270 2023-10-24T01:44:47.514 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:47.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 msgr2=0x7f12ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 0x7f12ac061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f12bc000c00 tx=0x7f12bc00c040).stop 2023-10-24T01:44:47.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 msgr2=0x7f12cc0aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f12cc084440 tx=0x7f12c4015000).stop 2023-10-24T01:44:47.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 shutdown_connections 2023-10-24T01:44:47.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f12ac05f270 0x7f12ac061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12cc0b0680 0x7f12cc0aded0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12b8005000 0x7f12cc0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 --2- 172.21.15.148:0/730608544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12cc0ca1e0 0x7f12cc0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 >> 172.21.15.148:0/730608544 conn(0x7f12cc0caf40 msgr2=0x7f12cc0aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:47.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 shutdown_connections 2023-10-24T01:44:47.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.512+0000 7f12d0cc1700 1 -- 172.21.15.148:0/730608544 wait complete. 2023-10-24T01:44:47.521 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:44:47.525 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-24T01:44:47.468194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437948,"kb_used_data":16124,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752536772,"statfs":{"total":773094113280,"available":770597654528,"internally_reserved":0,"allocated":16510976,"data_stored":8347208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5036901,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-524,"num_write_kb":-5314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000079"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215397+0000","last_change":"2023-10-24T01:44:44.210894+0000","last_active":"2023-10-24T01:44:44.215397+0000","last_peered":"2023-10-24T01:44:44.215397+0000","last_clean":"2023-10-24T01:44:44.215397+0000","last_became_active":"2023-10-24T01:44:44.210588+0000","last_became_peered":"2023-10-24T01:44:44.210588+0000","last_unstale":"2023-10-24T01:44:44.215397+0000","last_undegraded":"2023-10-24T01:44:44.215397+0000","last_fullsized":"2023-10-24T01:44:44.215397+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"165'3","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.216647+0000","last_change":"2023-10-24T01:44:43.843244+0000","last_active":"2023-10-24T01:44:44.216647+0000","last_peered":"2023-10-24T01:44:44.216647+0000","last_clean":"2023-10-24T01:44:44.216647+0000","last_became_active":"2023-10-24T01:44:43.842973+0000","last_became_peered":"2023-10-24T01:44:43.842973+0000","last_unstale":"2023-10-24T01:44:44.216647+0000","last_undegraded":"2023-10-24T01:44:44.216647+0000","last_fullsized":"2023-10-24T01:44:44.216647+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221815+0000","last_change":"2023-10-24T01:44:44.220115+0000","last_active":"2023-10-24T01:44:44.221815+0000","last_peered":"2023-10-24T01:44:44.221815+0000","last_clean":"2023-10-24T01:44:44.221815+0000","last_became_active":"2023-10-24T01:44:44.219839+0000","last_became_peered":"2023-10-24T01:44:44.219839+0000","last_unstale":"2023-10-24T01:44:44.221815+0000","last_undegraded":"2023-10-24T01:44:44.221815+0000","last_fullsized":"2023-10-24T01:44:44.221815+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.847559+0000","last_change":"2023-10-24T01:44:43.842782+0000","last_active":"2023-10-24T01:44:43.847559+0000","last_peered":"2023-10-24T01:44:43.847559+0000","last_clean":"2023-10-24T01:44:43.847559+0000","last_became_active":"2023-10-24T01:44:43.842503+0000","last_became_peered":"2023-10-24T01:44:43.842503+0000","last_unstale":"2023-10-24T01:44:43.847559+0000","last_undegraded":"2023-10-24T01:44:43.847559+0000","last_fullsized":"2023-10-24T01:44:43.847559+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215096+0000","last_change":"2023-10-24T01:44:44.215096+0000","last_active":"2023-10-24T01:44:44.215096+0000","last_peered":"2023-10-24T01:44:44.215096+0000","last_clean":"2023-10-24T01:44:44.215096+0000","last_became_active":"2023-10-24T01:44:44.214892+0000","last_became_peered":"2023-10-24T01:44:44.214892+0000","last_unstale":"2023-10-24T01:44:44.215096+0000","last_undegraded":"2023-10-24T01:44:44.215096+0000","last_fullsized":"2023-10-24T01:44:44.215096+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.204788+0000","last_change":"2023-10-24T01:44:43.846453+0000","last_active":"2023-10-24T01:44:44.204788+0000","last_peered":"2023-10-24T01:44:44.204788+0000","last_clean":"2023-10-24T01:44:44.204788+0000","last_became_active":"2023-10-24T01:44:43.846195+0000","last_became_peered":"2023-10-24T01:44:43.846195+0000","last_unstale":"2023-10-24T01:44:44.204788+0000","last_undegraded":"2023-10-24T01:44:44.204788+0000","last_fullsized":"2023-10-24T01:44:44.204788+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.206572+0000","last_change":"2023-10-24T01:44:44.206572+0000","last_active":"2023-10-24T01:44:44.206572+0000","last_peered":"2023-10-24T01:44:44.206572+0000","last_clean":"2023-10-24T01:44:44.206572+0000","last_became_active":"2023-10-24T01:44:44.204468+0000","last_became_peered":"2023-10-24T01:44:44.204468+0000","last_unstale":"2023-10-24T01:44:44.206572+0000","last_undegraded":"2023-10-24T01:44:44.206572+0000","last_fullsized":"2023-10-24T01:44:44.206572+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221104+0000","last_change":"2023-10-24T01:44:43.841681+0000","last_active":"2023-10-24T01:44:44.221104+0000","last_peered":"2023-10-24T01:44:44.221104+0000","last_clean":"2023-10-24T01:44:44.221104+0000","last_became_active":"2023-10-24T01:44:43.841404+0000","last_became_peered":"2023-10-24T01:44:43.841404+0000","last_unstale":"2023-10-24T01:44:44.221104+0000","last_undegraded":"2023-10-24T01:44:44.221104+0000","last_fullsized":"2023-10-24T01:44:44.221104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214881+0000","last_change":"2023-10-24T01:44:44.214881+0000","last_active":"2023-10-24T01:44:44.214881+0000","last_peered":"2023-10-24T01:44:44.214881+0000","last_clean":"2023-10-24T01:44:44.214881+0000","last_became_active":"2023-10-24T01:44:44.214345+0000","last_became_peered":"2023-10-24T01:44:44.214345+0000","last_unstale":"2023-10-24T01:44:44.214881+0000","last_undegraded":"2023-10-24T01:44:44.214881+0000","last_fullsized":"2023-10-24T01:44:44.214881+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221312+0000","last_change":"2023-10-24T01:44:43.849484+0000","last_active":"2023-10-24T01:44:44.221312+0000","last_peered":"2023-10-24T01:44:44.221312+0000","last_clean":"2023-10-24T01:44:44.221312+0000","last_became_active":"2023-10-24T01:44:43.849211+0000","last_became_peered":"2023-10-24T01:44:43.849211+0000","last_unstale":"2023-10-24T01:44:44.221312+0000","last_undegraded":"2023-10-24T01:44:44.221312+0000","last_fullsized":"2023-10-24T01:44:44.221312+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214438+0000","last_change":"2023-10-24T01:44:44.211874+0000","last_active":"2023-10-24T01:44:44.214438+0000","last_peered":"2023-10-24T01:44:44.214438+0000","last_clean":"2023-10-24T01:44:44.214438+0000","last_became_active":"2023-10-24T01:44:44.211600+0000","last_became_peered":"2023-10-24T01:44:44.211600+0000","last_unstale":"2023-10-24T01:44:44.214438+0000","last_undegraded":"2023-10-24T01:44:44.214438+0000","last_fullsized":"2023-10-24T01:44:44.214438+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.212452+0000","last_change":"2023-10-24T01:44:43.845370+0000","last_active":"2023-10-24T01:44:44.212452+0000","last_peered":"2023-10-24T01:44:44.212452+0000","last_clean":"2023-10-24T01:44:44.212452+0000","last_became_active":"2023-10-24T01:44:43.845098+0000","last_became_peered":"2023-10-24T01:44:43.845098+0000","last_unstale":"2023-10-24T01:44:44.212452+0000","last_undegraded":"2023-10-24T01:44:44.212452+0000","last_fullsized":"2023-10-24T01:44:44.212452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.217269+0000","last_change":"2023-10-24T01:44:44.217269+0000","last_active":"2023-10-24T01:44:44.217269+0000","last_peered":"2023-10-24T01:44:44.217269+0000","last_clean":"2023-10-24T01:44:44.217269+0000","last_became_active":"2023-10-24T01:44:44.216983+0000","last_became_peered":"2023-10-24T01:44:44.216983+0000","last_unstale":"2023-10-24T01:44:44.217269+0000","last_undegraded":"2023-10-24T01:44:44.217269+0000","last_fullsized":"2023-10-24T01:44:44.217269+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.201293+0000","last_change":"2023-10-24T01:44:43.849793+0000","last_active":"2023-10-24T01:44:44.201293+0000","last_peered":"2023-10-24T01:44:44.201293+0000","last_clean":"2023-10-24T01:44:44.201293+0000","last_became_active":"2023-10-24T01:44:43.849529+0000","last_became_peered":"2023-10-24T01:44:43.849529+0000","last_unstale":"2023-10-24T01:44:44.201293+0000","last_undegraded":"2023-10-24T01:44:44.201293+0000","last_fullsized":"2023-10-24T01:44:44.201293+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214407+0000","last_change":"2023-10-24T01:44:44.208915+0000","last_active":"2023-10-24T01:44:44.214407+0000","last_peered":"2023-10-24T01:44:44.214407+0000","last_clean":"2023-10-24T01:44:44.214407+0000","last_became_active":"2023-10-24T01:44:44.208624+0000","last_became_peered":"2023-10-24T01:44:44.208624+0000","last_unstale":"2023-10-24T01:44:44.214407+0000","last_undegraded":"2023-10-24T01:44:44.214407+0000","last_fullsized":"2023-10-24T01:44:44.214407+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.203665+0000","last_change":"2023-10-24T01:44:43.852632+0000","last_active":"2023-10-24T01:44:44.203665+0000","last_peered":"2023-10-24T01:44:44.203665+0000","last_clean":"2023-10-24T01:44:44.203665+0000","last_became_active":"2023-10-24T01:44:43.852338+0000","last_became_peered":"2023-10-24T01:44:43.852338+0000","last_unstale":"2023-10-24T01:44:44.203665+0000","last_undegraded":"2023-10-24T01:44:44.203665+0000","last_fullsized":"2023-10-24T01:44:44.203665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.212207+0000","last_change":"2023-10-24T01:44:44.212207+0000","last_active":"2023-10-24T01:44:44.212207+0000","last_peered":"2023-10-24T01:44:44.212207+0000","last_clean":"2023-10-24T01:44:44.212207+0000","last_became_active":"2023-10-24T01:44:44.211967+0000","last_became_peered":"2023-10-24T01:44:44.211967+0000","last_unstale":"2023-10-24T01:44:44.212207+0000","last_undegraded":"2023-10-24T01:44:44.212207+0000","last_fullsized":"2023-10-24T01:44:44.212207+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.205099+0000","last_change":"2023-10-24T01:44:43.849682+0000","last_active":"2023-10-24T01:44:44.205099+0000","last_peered":"2023-10-24T01:44:44.205099+0000","last_clean":"2023-10-24T01:44:44.205099+0000","last_became_active":"2023-10-24T01:44:43.849393+0000","last_became_peered":"2023-10-24T01:44:43.849393+0000","last_unstale":"2023-10-24T01:44:44.205099+0000","last_undegraded":"2023-10-24T01:44:44.205099+0000","last_fullsized":"2023-10-24T01:44:44.205099+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214632+0000","last_change":"2023-10-24T01:44:44.209088+0000","last_active":"2023-10-24T01:44:44.214632+0000","last_peered":"2023-10-24T01:44:44.214632+0000","last_clean":"2023-10-24T01:44:44.214632+0000","last_became_active":"2023-10-24T01:44:44.208838+0000","last_became_peered":"2023-10-24T01:44:44.208838+0000","last_unstale":"2023-10-24T01:44:44.214632+0000","last_undegraded":"2023-10-24T01:44:44.214632+0000","last_fullsized":"2023-10-24T01:44:44.214632+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.842861+0000","last_change":"2023-10-24T01:44:43.837819+0000","last_active":"2023-10-24T01:44:43.842861+0000","last_peered":"2023-10-24T01:44:43.842861+0000","last_clean":"2023-10-24T01:44:43.842861+0000","last_became_active":"2023-10-24T01:44:43.837526+0000","last_became_peered":"2023-10-24T01:44:43.837526+0000","last_unstale":"2023-10-24T01:44:43.842861+0000","last_undegraded":"2023-10-24T01:44:43.842861+0000","last_fullsized":"2023-10-24T01:44:43.842861+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.224759+0000","last_change":"2023-10-24T01:44:44.221370+0000","last_active":"2023-10-24T01:44:44.224759+0000","last_peered":"2023-10-24T01:44:44.224759+0000","last_clean":"2023-10-24T01:44:44.224759+0000","last_became_active":"2023-10-24T01:44:44.221095+0000","last_became_peered":"2023-10-24T01:44:44.221095+0000","last_unstale":"2023-10-24T01:44:44.224759+0000","last_undegraded":"2023-10-24T01:44:44.224759+0000","last_fullsized":"2023-10-24T01:44:44.224759+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.201415+0000","last_change":"2023-10-24T01:44:43.848532+0000","last_active":"2023-10-24T01:44:44.201415+0000","last_peered":"2023-10-24T01:44:44.201415+0000","last_clean":"2023-10-24T01:44:44.201415+0000","last_became_active":"2023-10-24T01:44:43.848274+0000","last_became_peered":"2023-10-24T01:44:43.848274+0000","last_unstale":"2023-10-24T01:44:44.201415+0000","last_undegraded":"2023-10-24T01:44:44.201415+0000","last_fullsized":"2023-10-24T01:44:44.201415+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.218026+0000","last_change":"2023-10-24T01:44:44.218026+0000","last_active":"2023-10-24T01:44:44.218026+0000","last_peered":"2023-10-24T01:44:44.218026+0000","last_clean":"2023-10-24T01:44:44.218026+0000","last_became_active":"2023-10-24T01:44:44.217742+0000","last_became_peered":"2023-10-24T01:44:44.217742+0000","last_unstale":"2023-10-24T01:44:44.218026+0000","last_undegraded":"2023-10-24T01:44:44.218026+0000","last_fullsized":"2023-10-24T01:44:44.218026+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"165'4","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.228013+0000","last_change":"2023-10-24T01:44:43.848035+0000","last_active":"2023-10-24T01:44:44.228013+0000","last_peered":"2023-10-24T01:44:44.228013+0000","last_clean":"2023-10-24T01:44:44.228013+0000","last_became_active":"2023-10-24T01:44:43.847818+0000","last_became_peered":"2023-10-24T01:44:43.847818+0000","last_unstale":"2023-10-24T01:44:44.228013+0000","last_undegraded":"2023-10-24T01:44:44.228013+0000","last_fullsized":"2023-10-24T01:44:44.228013+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222571+0000","last_change":"2023-10-24T01:44:44.215825+0000","last_active":"2023-10-24T01:44:44.222571+0000","last_peered":"2023-10-24T01:44:44.222571+0000","last_clean":"2023-10-24T01:44:44.222571+0000","last_became_active":"2023-10-24T01:44:44.215551+0000","last_became_peered":"2023-10-24T01:44:44.215551+0000","last_unstale":"2023-10-24T01:44:44.222571+0000","last_undegraded":"2023-10-24T01:44:44.222571+0000","last_fullsized":"2023-10-24T01:44:44.222571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.216793+0000","last_change":"2023-10-24T01:44:43.842435+0000","last_active":"2023-10-24T01:44:44.216793+0000","last_peered":"2023-10-24T01:44:44.216793+0000","last_clean":"2023-10-24T01:44:44.216793+0000","last_became_active":"2023-10-24T01:44:43.842163+0000","last_became_peered":"2023-10-24T01:44:43.842163+0000","last_unstale":"2023-10-24T01:44:44.216793+0000","last_undegraded":"2023-10-24T01:44:44.216793+0000","last_fullsized":"2023-10-24T01:44:44.216793+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214697+0000","last_change":"2023-10-24T01:44:44.214697+0000","last_active":"2023-10-24T01:44:44.214697+0000","last_peered":"2023-10-24T01:44:44.214697+0000","last_clean":"2023-10-24T01:44:44.214697+0000","last_became_active":"2023-10-24T01:44:44.214396+0000","last_became_peered":"2023-10-24T01:44:44.214396+0000","last_unstale":"2023-10-24T01:44:44.214697+0000","last_undegraded":"2023-10-24T01:44:44.214697+0000","last_fullsized":"2023-10-24T01:44:44.214697+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.842104+0000","last_change":"2023-10-24T01:44:43.835666+0000","last_active":"2023-10-24T01:44:43.842104+0000","last_peered":"2023-10-24T01:44:43.842104+0000","last_clean":"2023-10-24T01:44:43.842104+0000","last_became_active":"2023-10-24T01:44:43.835400+0000","last_became_peered":"2023-10-24T01:44:43.835400+0000","last_unstale":"2023-10-24T01:44:43.842104+0000","last_undegraded":"2023-10-24T01:44:43.842104+0000","last_fullsized":"2023-10-24T01:44:43.842104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214081+0000","last_change":"2023-10-24T01:44:44.211080+0000","last_active":"2023-10-24T01:44:44.214081+0000","last_peered":"2023-10-24T01:44:44.214081+0000","last_clean":"2023-10-24T01:44:44.214081+0000","last_became_active":"2023-10-24T01:44:44.210900+0000","last_became_peered":"2023-10-24T01:44:44.210900+0000","last_unstale":"2023-10-24T01:44:44.214081+0000","last_undegraded":"2023-10-24T01:44:44.214081+0000","last_fullsized":"2023-10-24T01:44:44.214081+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199755+0000","last_change":"2023-10-24T01:44:43.851876+0000","last_active":"2023-10-24T01:44:44.199755+0000","last_peered":"2023-10-24T01:44:44.199755+0000","last_clean":"2023-10-24T01:44:44.199755+0000","last_became_active":"2023-10-24T01:44:43.851618+0000","last_became_peered":"2023-10-24T01:44:43.851618+0000","last_unstale":"2023-10-24T01:44:44.199755+0000","last_undegraded":"2023-10-24T01:44:44.199755+0000","last_fullsized":"2023-10-24T01:44:44.199755+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222985+0000","last_change":"2023-10-24T01:44:44.222985+0000","last_active":"2023-10-24T01:44:44.222985+0000","last_peered":"2023-10-24T01:44:44.222985+0000","last_clean":"2023-10-24T01:44:44.222985+0000","last_became_active":"2023-10-24T01:44:44.222737+0000","last_became_peered":"2023-10-24T01:44:44.222737+0000","last_unstale":"2023-10-24T01:44:44.222985+0000","last_undegraded":"2023-10-24T01:44:44.222985+0000","last_fullsized":"2023-10-24T01:44:44.222985+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.216285+0000","last_change":"2023-10-24T01:44:43.840216+0000","last_active":"2023-10-24T01:44:44.216285+0000","last_peered":"2023-10-24T01:44:44.216285+0000","last_clean":"2023-10-24T01:44:44.216285+0000","last_became_active":"2023-10-24T01:44:43.839855+0000","last_became_peered":"2023-10-24T01:44:43.839855+0000","last_unstale":"2023-10-24T01:44:44.216285+0000","last_undegraded":"2023-10-24T01:44:44.216285+0000","last_fullsized":"2023-10-24T01:44:44.216285+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.207578+0000","last_change":"2023-10-24T01:44:44.207578+0000","last_active":"2023-10-24T01:44:44.207578+0000","last_peered":"2023-10-24T01:44:44.207578+0000","last_clean":"2023-10-24T01:44:44.207578+0000","last_became_active":"2023-10-24T01:44:44.207331+0000","last_became_peered":"2023-10-24T01:44:44.207331+0000","last_unstale":"2023-10-24T01:44:44.207578+0000","last_undegraded":"2023-10-24T01:44:44.207578+0000","last_fullsized":"2023-10-24T01:44:44.207578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199231+0000","last_change":"2023-10-24T01:44:43.840396+0000","last_active":"2023-10-24T01:44:44.199231+0000","last_peered":"2023-10-24T01:44:44.199231+0000","last_clean":"2023-10-24T01:44:44.199231+0000","last_became_active":"2023-10-24T01:44:43.840099+0000","last_became_peered":"2023-10-24T01:44:43.840099+0000","last_unstale":"2023-10-24T01:44:44.199231+0000","last_undegraded":"2023-10-24T01:44:44.199231+0000","last_fullsized":"2023-10-24T01:44:44.199231+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213087+0000","last_change":"2023-10-24T01:44:44.213087+0000","last_active":"2023-10-24T01:44:44.213087+0000","last_peered":"2023-10-24T01:44:44.213087+0000","last_clean":"2023-10-24T01:44:44.213087+0000","last_became_active":"2023-10-24T01:44:44.212741+0000","last_became_peered":"2023-10-24T01:44:44.212741+0000","last_unstale":"2023-10-24T01:44:44.213087+0000","last_undegraded":"2023-10-24T01:44:44.213087+0000","last_fullsized":"2023-10-24T01:44:44.213087+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.840812+0000","last_change":"2023-10-24T01:44:43.838914+0000","last_active":"2023-10-24T01:44:43.840812+0000","last_peered":"2023-10-24T01:44:43.840812+0000","last_clean":"2023-10-24T01:44:43.840812+0000","last_became_active":"2023-10-24T01:44:43.838633+0000","last_became_peered":"2023-10-24T01:44:43.838633+0000","last_unstale":"2023-10-24T01:44:43.840812+0000","last_undegraded":"2023-10-24T01:44:43.840812+0000","last_fullsized":"2023-10-24T01:44:43.840812+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.209177+0000","last_change":"2023-10-24T01:44:44.206776+0000","last_active":"2023-10-24T01:44:44.209177+0000","last_peered":"2023-10-24T01:44:44.209177+0000","last_clean":"2023-10-24T01:44:44.209177+0000","last_became_active":"2023-10-24T01:44:44.206498+0000","last_became_peered":"2023-10-24T01:44:44.206498+0000","last_unstale":"2023-10-24T01:44:44.209177+0000","last_undegraded":"2023-10-24T01:44:44.209177+0000","last_fullsized":"2023-10-24T01:44:44.209177+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.216065+0000","last_change":"2023-10-24T01:44:43.839072+0000","last_active":"2023-10-24T01:44:44.216065+0000","last_peered":"2023-10-24T01:44:44.216065+0000","last_clean":"2023-10-24T01:44:44.216065+0000","last_became_active":"2023-10-24T01:44:43.838492+0000","last_became_peered":"2023-10-24T01:44:43.838492+0000","last_unstale":"2023-10-24T01:44:44.216065+0000","last_undegraded":"2023-10-24T01:44:44.216065+0000","last_fullsized":"2023-10-24T01:44:44.216065+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.219259+0000","last_change":"2023-10-24T01:44:44.219259+0000","last_active":"2023-10-24T01:44:44.219259+0000","last_peered":"2023-10-24T01:44:44.219259+0000","last_clean":"2023-10-24T01:44:44.219259+0000","last_became_active":"2023-10-24T01:44:44.219060+0000","last_became_peered":"2023-10-24T01:44:44.219060+0000","last_unstale":"2023-10-24T01:44:44.219259+0000","last_undegraded":"2023-10-24T01:44:44.219259+0000","last_fullsized":"2023-10-24T01:44:44.219259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.840945+0000","last_change":"2023-10-24T01:44:43.838283+0000","last_active":"2023-10-24T01:44:43.840945+0000","last_peered":"2023-10-24T01:44:43.840945+0000","last_clean":"2023-10-24T01:44:43.840945+0000","last_became_active":"2023-10-24T01:44:43.838024+0000","last_became_peered":"2023-10-24T01:44:43.838024+0000","last_unstale":"2023-10-24T01:44:43.840945+0000","last_undegraded":"2023-10-24T01:44:43.840945+0000","last_fullsized":"2023-10-24T01:44:43.840945+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214356+0000","last_change":"2023-10-24T01:44:44.214356+0000","last_active":"2023-10-24T01:44:44.214356+0000","last_peered":"2023-10-24T01:44:44.214356+0000","last_clean":"2023-10-24T01:44:44.214356+0000","last_became_active":"2023-10-24T01:44:44.213998+0000","last_became_peered":"2023-10-24T01:44:44.213998+0000","last_unstale":"2023-10-24T01:44:44.214356+0000","last_undegraded":"2023-10-24T01:44:44.214356+0000","last_fullsized":"2023-10-24T01:44:44.214356+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.219669+0000","last_change":"2023-10-24T01:44:43.848837+0000","last_active":"2023-10-24T01:44:44.219669+0000","last_peered":"2023-10-24T01:44:44.219669+0000","last_clean":"2023-10-24T01:44:44.219669+0000","last_became_active":"2023-10-24T01:44:43.848555+0000","last_became_peered":"2023-10-24T01:44:43.848555+0000","last_unstale":"2023-10-24T01:44:44.219669+0000","last_undegraded":"2023-10-24T01:44:44.219669+0000","last_fullsized":"2023-10-24T01:44:44.219669+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221626+0000","last_change":"2023-10-24T01:44:44.209449+0000","last_active":"2023-10-24T01:44:44.221626+0000","last_peered":"2023-10-24T01:44:44.221626+0000","last_clean":"2023-10-24T01:44:44.221626+0000","last_became_active":"2023-10-24T01:44:44.208878+0000","last_became_peered":"2023-10-24T01:44:44.208878+0000","last_unstale":"2023-10-24T01:44:44.221626+0000","last_undegraded":"2023-10-24T01:44:44.221626+0000","last_fullsized":"2023-10-24T01:44:44.221626+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.200818+0000","last_change":"2023-10-24T01:44:43.844606+0000","last_active":"2023-10-24T01:44:44.200818+0000","last_peered":"2023-10-24T01:44:44.200818+0000","last_clean":"2023-10-24T01:44:44.200818+0000","last_became_active":"2023-10-24T01:44:43.844336+0000","last_became_peered":"2023-10-24T01:44:43.844336+0000","last_unstale":"2023-10-24T01:44:44.200818+0000","last_undegraded":"2023-10-24T01:44:44.200818+0000","last_fullsized":"2023-10-24T01:44:44.200818+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.205917+0000","last_change":"2023-10-24T01:44:44.205917+0000","last_active":"2023-10-24T01:44:44.205917+0000","last_peered":"2023-10-24T01:44:44.205917+0000","last_clean":"2023-10-24T01:44:44.205917+0000","last_became_active":"2023-10-24T01:44:44.204400+0000","last_became_peered":"2023-10-24T01:44:44.204400+0000","last_unstale":"2023-10-24T01:44:44.205917+0000","last_undegraded":"2023-10-24T01:44:44.205917+0000","last_fullsized":"2023-10-24T01:44:44.205917+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.201948+0000","last_change":"2023-10-24T01:44:43.849976+0000","last_active":"2023-10-24T01:44:44.201948+0000","last_peered":"2023-10-24T01:44:44.201948+0000","last_clean":"2023-10-24T01:44:44.201948+0000","last_became_active":"2023-10-24T01:44:43.849660+0000","last_became_peered":"2023-10-24T01:44:43.849660+0000","last_unstale":"2023-10-24T01:44:44.201948+0000","last_undegraded":"2023-10-24T01:44:44.201948+0000","last_fullsized":"2023-10-24T01:44:44.201948+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.211107+0000","last_change":"2023-10-24T01:44:44.211107+0000","last_active":"2023-10-24T01:44:44.211107+0000","last_peered":"2023-10-24T01:44:44.211107+0000","last_clean":"2023-10-24T01:44:44.211107+0000","last_became_active":"2023-10-24T01:44:44.210941+0000","last_became_peered":"2023-10-24T01:44:44.210941+0000","last_unstale":"2023-10-24T01:44:44.211107+0000","last_undegraded":"2023-10-24T01:44:44.211107+0000","last_fullsized":"2023-10-24T01:44:44.211107+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.202678+0000","last_change":"2023-10-24T01:44:43.846571+0000","last_active":"2023-10-24T01:44:44.202678+0000","last_peered":"2023-10-24T01:44:44.202678+0000","last_clean":"2023-10-24T01:44:44.202678+0000","last_became_active":"2023-10-24T01:44:43.846328+0000","last_became_peered":"2023-10-24T01:44:43.846328+0000","last_unstale":"2023-10-24T01:44:44.202678+0000","last_undegraded":"2023-10-24T01:44:44.202678+0000","last_fullsized":"2023-10-24T01:44:44.202678+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.217501+0000","last_change":"2023-10-24T01:44:44.216311+0000","last_active":"2023-10-24T01:44:44.217501+0000","last_peered":"2023-10-24T01:44:44.217501+0000","last_clean":"2023-10-24T01:44:44.217501+0000","last_became_active":"2023-10-24T01:44:44.216076+0000","last_became_peered":"2023-10-24T01:44:44.216076+0000","last_unstale":"2023-10-24T01:44:44.217501+0000","last_undegraded":"2023-10-24T01:44:44.217501+0000","last_fullsized":"2023-10-24T01:44:44.217501+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.845942+0000","last_change":"2023-10-24T01:44:43.843826+0000","last_active":"2023-10-24T01:44:43.845942+0000","last_peered":"2023-10-24T01:44:43.845942+0000","last_clean":"2023-10-24T01:44:43.845942+0000","last_became_active":"2023-10-24T01:44:43.843572+0000","last_became_peered":"2023-10-24T01:44:43.843572+0000","last_unstale":"2023-10-24T01:44:43.845942+0000","last_undegraded":"2023-10-24T01:44:43.845942+0000","last_fullsized":"2023-10-24T01:44:43.845942+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215262+0000","last_change":"2023-10-24T01:44:44.211712+0000","last_active":"2023-10-24T01:44:44.215262+0000","last_peered":"2023-10-24T01:44:44.215262+0000","last_clean":"2023-10-24T01:44:44.215262+0000","last_became_active":"2023-10-24T01:44:44.211442+0000","last_became_peered":"2023-10-24T01:44:44.211442+0000","last_unstale":"2023-10-24T01:44:44.215262+0000","last_undegraded":"2023-10-24T01:44:44.215262+0000","last_fullsized":"2023-10-24T01:44:44.215262+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.846466+0000","last_change":"2023-10-24T01:44:43.840729+0000","last_active":"2023-10-24T01:44:43.846466+0000","last_peered":"2023-10-24T01:44:43.846466+0000","last_clean":"2023-10-24T01:44:43.846466+0000","last_became_active":"2023-10-24T01:44:43.840280+0000","last_became_peered":"2023-10-24T01:44:43.840280+0000","last_unstale":"2023-10-24T01:44:43.846466+0000","last_undegraded":"2023-10-24T01:44:43.846466+0000","last_fullsized":"2023-10-24T01:44:43.846466+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222715+0000","last_change":"2023-10-24T01:44:44.216142+0000","last_active":"2023-10-24T01:44:44.222715+0000","last_peered":"2023-10-24T01:44:44.222715+0000","last_clean":"2023-10-24T01:44:44.222715+0000","last_became_active":"2023-10-24T01:44:44.215934+0000","last_became_peered":"2023-10-24T01:44:44.215934+0000","last_unstale":"2023-10-24T01:44:44.222715+0000","last_undegraded":"2023-10-24T01:44:44.222715+0000","last_fullsized":"2023-10-24T01:44:44.222715+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199694+0000","last_change":"2023-10-24T01:44:43.842786+0000","last_active":"2023-10-24T01:44:44.199694+0000","last_peered":"2023-10-24T01:44:44.199694+0000","last_clean":"2023-10-24T01:44:44.199694+0000","last_became_active":"2023-10-24T01:44:43.842532+0000","last_became_peered":"2023-10-24T01:44:43.842532+0000","last_unstale":"2023-10-24T01:44:44.199694+0000","last_undegraded":"2023-10-24T01:44:44.199694+0000","last_fullsized":"2023-10-24T01:44:44.199694+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223200+0000","last_change":"2023-10-24T01:44:44.219897+0000","last_active":"2023-10-24T01:44:44.223200+0000","last_peered":"2023-10-24T01:44:44.223200+0000","last_clean":"2023-10-24T01:44:44.223200+0000","last_became_active":"2023-10-24T01:44:44.219633+0000","last_became_peered":"2023-10-24T01:44:44.219633+0000","last_unstale":"2023-10-24T01:44:44.223200+0000","last_undegraded":"2023-10-24T01:44:44.223200+0000","last_fullsized":"2023-10-24T01:44:44.223200+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.847233+0000","last_change":"2023-10-24T01:44:43.844624+0000","last_active":"2023-10-24T01:44:43.847233+0000","last_peered":"2023-10-24T01:44:43.847233+0000","last_clean":"2023-10-24T01:44:43.847233+0000","last_became_active":"2023-10-24T01:44:43.841396+0000","last_became_peered":"2023-10-24T01:44:43.841396+0000","last_unstale":"2023-10-24T01:44:43.847233+0000","last_undegraded":"2023-10-24T01:44:43.847233+0000","last_fullsized":"2023-10-24T01:44:43.847233+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214116+0000","last_change":"2023-10-24T01:44:44.212463+0000","last_active":"2023-10-24T01:44:44.214116+0000","last_peered":"2023-10-24T01:44:44.214116+0000","last_clean":"2023-10-24T01:44:44.214116+0000","last_became_active":"2023-10-24T01:44:44.211697+0000","last_became_peered":"2023-10-24T01:44:44.211697+0000","last_unstale":"2023-10-24T01:44:44.214116+0000","last_undegraded":"2023-10-24T01:44:44.214116+0000","last_fullsized":"2023-10-24T01:44:44.214116+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199395+0000","last_change":"2023-10-24T01:44:43.849392+0000","last_active":"2023-10-24T01:44:44.199395+0000","last_peered":"2023-10-24T01:44:44.199395+0000","last_clean":"2023-10-24T01:44:44.199395+0000","last_became_active":"2023-10-24T01:44:43.848300+0000","last_became_peered":"2023-10-24T01:44:43.848300+0000","last_unstale":"2023-10-24T01:44:44.199395+0000","last_undegraded":"2023-10-24T01:44:44.199395+0000","last_fullsized":"2023-10-24T01:44:44.199395+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221646+0000","last_change":"2023-10-24T01:44:44.209616+0000","last_active":"2023-10-24T01:44:44.221646+0000","last_peered":"2023-10-24T01:44:44.221646+0000","last_clean":"2023-10-24T01:44:44.221646+0000","last_became_active":"2023-10-24T01:44:44.209177+0000","last_became_peered":"2023-10-24T01:44:44.209177+0000","last_unstale":"2023-10-24T01:44:44.221646+0000","last_undegraded":"2023-10-24T01:44:44.221646+0000","last_fullsized":"2023-10-24T01:44:44.221646+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199085+0000","last_change":"2023-10-24T01:44:43.849329+0000","last_active":"2023-10-24T01:44:44.199085+0000","last_peered":"2023-10-24T01:44:44.199085+0000","last_clean":"2023-10-24T01:44:44.199085+0000","last_became_active":"2023-10-24T01:44:43.849066+0000","last_became_peered":"2023-10-24T01:44:43.849066+0000","last_unstale":"2023-10-24T01:44:44.199085+0000","last_undegraded":"2023-10-24T01:44:44.199085+0000","last_fullsized":"2023-10-24T01:44:44.199085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223187+0000","last_change":"2023-10-24T01:44:44.220401+0000","last_active":"2023-10-24T01:44:44.223187+0000","last_peered":"2023-10-24T01:44:44.223187+0000","last_clean":"2023-10-24T01:44:44.223187+0000","last_became_active":"2023-10-24T01:44:44.220141+0000","last_became_peered":"2023-10-24T01:44:44.220141+0000","last_unstale":"2023-10-24T01:44:44.223187+0000","last_undegraded":"2023-10-24T01:44:44.223187+0000","last_fullsized":"2023-10-24T01:44:44.223187+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.196314+0000","last_change":"2023-10-24T01:44:43.847109+0000","last_active":"2023-10-24T01:44:44.196314+0000","last_peered":"2023-10-24T01:44:44.196314+0000","last_clean":"2023-10-24T01:44:44.196314+0000","last_became_active":"2023-10-24T01:44:43.846283+0000","last_became_peered":"2023-10-24T01:44:43.846283+0000","last_unstale":"2023-10-24T01:44:44.196314+0000","last_undegraded":"2023-10-24T01:44:44.196314+0000","last_fullsized":"2023-10-24T01:44:44.196314+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222805+0000","last_change":"2023-10-24T01:44:44.216157+0000","last_active":"2023-10-24T01:44:44.222805+0000","last_peered":"2023-10-24T01:44:44.222805+0000","last_clean":"2023-10-24T01:44:44.222805+0000","last_became_active":"2023-10-24T01:44:44.215867+0000","last_became_peered":"2023-10-24T01:44:44.215867+0000","last_unstale":"2023-10-24T01:44:44.222805+0000","last_undegraded":"2023-10-24T01:44:44.222805+0000","last_fullsized":"2023-10-24T01:44:44.222805+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.198965+0000","last_change":"2023-10-24T01:44:43.839917+0000","last_active":"2023-10-24T01:44:44.198965+0000","last_peered":"2023-10-24T01:44:44.198965+0000","last_clean":"2023-10-24T01:44:44.198965+0000","last_became_active":"2023-10-24T01:44:43.839585+0000","last_became_peered":"2023-10-24T01:44:43.839585+0000","last_unstale":"2023-10-24T01:44:44.198965+0000","last_undegraded":"2023-10-24T01:44:44.198965+0000","last_fullsized":"2023-10-24T01:44:44.198965+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215411+0000","last_change":"2023-10-24T01:44:44.211326+0000","last_active":"2023-10-24T01:44:44.215411+0000","last_peered":"2023-10-24T01:44:44.215411+0000","last_clean":"2023-10-24T01:44:44.215411+0000","last_became_active":"2023-10-24T01:44:44.211019+0000","last_became_peered":"2023-10-24T01:44:44.211019+0000","last_unstale":"2023-10-24T01:44:44.215411+0000","last_undegraded":"2023-10-24T01:44:44.215411+0000","last_fullsized":"2023-10-24T01:44:44.215411+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222713+0000","last_change":"2023-10-24T01:44:43.851800+0000","last_active":"2023-10-24T01:44:44.222713+0000","last_peered":"2023-10-24T01:44:44.222713+0000","last_clean":"2023-10-24T01:44:44.222713+0000","last_became_active":"2023-10-24T01:44:43.851485+0000","last_became_peered":"2023-10-24T01:44:43.851485+0000","last_unstale":"2023-10-24T01:44:44.222713+0000","last_undegraded":"2023-10-24T01:44:44.222713+0000","last_fullsized":"2023-10-24T01:44:44.222713+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215303+0000","last_change":"2023-10-24T01:44:44.209946+0000","last_active":"2023-10-24T01:44:44.215303+0000","last_peered":"2023-10-24T01:44:44.215303+0000","last_clean":"2023-10-24T01:44:44.215303+0000","last_became_active":"2023-10-24T01:44:44.209144+0000","last_became_peered":"2023-10-24T01:44:44.209144+0000","last_unstale":"2023-10-24T01:44:44.215303+0000","last_undegraded":"2023-10-24T01:44:44.215303+0000","last_fullsized":"2023-10-24T01:44:44.215303+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.196303+0000","last_change":"2023-10-24T01:44:43.840686+0000","last_active":"2023-10-24T01:44:44.196303+0000","last_peered":"2023-10-24T01:44:44.196303+0000","last_clean":"2023-10-24T01:44:44.196303+0000","last_became_active":"2023-10-24T01:44:43.839788+0000","last_became_peered":"2023-10-24T01:44:43.839788+0000","last_unstale":"2023-10-24T01:44:44.196303+0000","last_undegraded":"2023-10-24T01:44:44.196303+0000","last_fullsized":"2023-10-24T01:44:44.196303+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214028+0000","last_change":"2023-10-24T01:44:44.214028+0000","last_active":"2023-10-24T01:44:44.214028+0000","last_peered":"2023-10-24T01:44:44.214028+0000","last_clean":"2023-10-24T01:44:44.214028+0000","last_became_active":"2023-10-24T01:44:44.209598+0000","last_became_peered":"2023-10-24T01:44:44.209598+0000","last_unstale":"2023-10-24T01:44:44.214028+0000","last_undegraded":"2023-10-24T01:44:44.214028+0000","last_fullsized":"2023-10-24T01:44:44.214028+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221383+0000","last_change":"2023-10-24T01:44:43.848842+0000","last_active":"2023-10-24T01:44:44.221383+0000","last_peered":"2023-10-24T01:44:44.221383+0000","last_clean":"2023-10-24T01:44:44.221383+0000","last_became_active":"2023-10-24T01:44:43.848496+0000","last_became_peered":"2023-10-24T01:44:43.848496+0000","last_unstale":"2023-10-24T01:44:44.221383+0000","last_undegraded":"2023-10-24T01:44:44.221383+0000","last_fullsized":"2023-10-24T01:44:44.221383+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215292+0000","last_change":"2023-10-24T01:44:44.209332+0000","last_active":"2023-10-24T01:44:44.215292+0000","last_peered":"2023-10-24T01:44:44.215292+0000","last_clean":"2023-10-24T01:44:44.215292+0000","last_became_active":"2023-10-24T01:44:44.209028+0000","last_became_peered":"2023-10-24T01:44:44.209028+0000","last_unstale":"2023-10-24T01:44:44.215292+0000","last_undegraded":"2023-10-24T01:44:44.215292+0000","last_fullsized":"2023-10-24T01:44:44.215292+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.196602+0000","last_change":"2023-10-24T01:44:43.843028+0000","last_active":"2023-10-24T01:44:44.196602+0000","last_peered":"2023-10-24T01:44:44.196602+0000","last_clean":"2023-10-24T01:44:44.196602+0000","last_became_active":"2023-10-24T01:44:43.842417+0000","last_became_peered":"2023-10-24T01:44:43.842417+0000","last_unstale":"2023-10-24T01:44:44.196602+0000","last_undegraded":"2023-10-24T01:44:44.196602+0000","last_fullsized":"2023-10-24T01:44:44.196602+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214784+0000","last_change":"2023-10-24T01:44:44.211278+0000","last_active":"2023-10-24T01:44:44.214784+0000","last_peered":"2023-10-24T01:44:44.214784+0000","last_clean":"2023-10-24T01:44:44.214784+0000","last_became_active":"2023-10-24T01:44:44.210996+0000","last_became_peered":"2023-10-24T01:44:44.210996+0000","last_unstale":"2023-10-24T01:44:44.214784+0000","last_undegraded":"2023-10-24T01:44:44.214784+0000","last_fullsized":"2023-10-24T01:44:44.214784+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199112+0000","last_change":"2023-10-24T01:44:43.840387+0000","last_active":"2023-10-24T01:44:44.199112+0000","last_peered":"2023-10-24T01:44:44.199112+0000","last_clean":"2023-10-24T01:44:44.199112+0000","last_became_active":"2023-10-24T01:44:43.840066+0000","last_became_peered":"2023-10-24T01:44:43.840066+0000","last_unstale":"2023-10-24T01:44:44.199112+0000","last_undegraded":"2023-10-24T01:44:44.199112+0000","last_fullsized":"2023-10-24T01:44:44.199112+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215402+0000","last_change":"2023-10-24T01:44:44.212365+0000","last_active":"2023-10-24T01:44:44.215402+0000","last_peered":"2023-10-24T01:44:44.215402+0000","last_clean":"2023-10-24T01:44:44.215402+0000","last_became_active":"2023-10-24T01:44:44.212060+0000","last_became_peered":"2023-10-24T01:44:44.212060+0000","last_unstale":"2023-10-24T01:44:44.215402+0000","last_undegraded":"2023-10-24T01:44:44.215402+0000","last_fullsized":"2023-10-24T01:44:44.215402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.840841+0000","last_change":"2023-10-24T01:44:43.838812+0000","last_active":"2023-10-24T01:44:43.840841+0000","last_peered":"2023-10-24T01:44:43.840841+0000","last_clean":"2023-10-24T01:44:43.840841+0000","last_became_active":"2023-10-24T01:44:43.838569+0000","last_became_peered":"2023-10-24T01:44:43.838569+0000","last_unstale":"2023-10-24T01:44:43.840841+0000","last_undegraded":"2023-10-24T01:44:43.840841+0000","last_fullsized":"2023-10-24T01:44:43.840841+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213286+0000","last_change":"2023-10-24T01:44:44.213286+0000","last_active":"2023-10-24T01:44:44.213286+0000","last_peered":"2023-10-24T01:44:44.213286+0000","last_clean":"2023-10-24T01:44:44.213286+0000","last_became_active":"2023-10-24T01:44:44.213011+0000","last_became_peered":"2023-10-24T01:44:44.213011+0000","last_unstale":"2023-10-24T01:44:44.213286+0000","last_undegraded":"2023-10-24T01:44:44.213286+0000","last_fullsized":"2023-10-24T01:44:44.213286+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.838766+0000","last_change":"2023-10-24T01:44:43.832380+0000","last_active":"2023-10-24T01:44:43.838766+0000","last_peered":"2023-10-24T01:44:43.838766+0000","last_clean":"2023-10-24T01:44:43.838766+0000","last_became_active":"2023-10-24T01:44:43.832081+0000","last_became_peered":"2023-10-24T01:44:43.832081+0000","last_unstale":"2023-10-24T01:44:43.838766+0000","last_undegraded":"2023-10-24T01:44:43.838766+0000","last_fullsized":"2023-10-24T01:44:43.838766+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220646+0000","last_change":"2023-10-24T01:44:44.218962+0000","last_active":"2023-10-24T01:44:44.220646+0000","last_peered":"2023-10-24T01:44:44.220646+0000","last_clean":"2023-10-24T01:44:44.220646+0000","last_became_active":"2023-10-24T01:44:44.218674+0000","last_became_peered":"2023-10-24T01:44:44.218674+0000","last_unstale":"2023-10-24T01:44:44.220646+0000","last_undegraded":"2023-10-24T01:44:44.220646+0000","last_fullsized":"2023-10-24T01:44:44.220646+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.203682+0000","last_change":"2023-10-24T01:44:43.852342+0000","last_active":"2023-10-24T01:44:44.203682+0000","last_peered":"2023-10-24T01:44:44.203682+0000","last_clean":"2023-10-24T01:44:44.203682+0000","last_became_active":"2023-10-24T01:44:43.852090+0000","last_became_peered":"2023-10-24T01:44:43.852090+0000","last_unstale":"2023-10-24T01:44:44.203682+0000","last_undegraded":"2023-10-24T01:44:44.203682+0000","last_fullsized":"2023-10-24T01:44:44.203682+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213967+0000","last_change":"2023-10-24T01:44:44.213089+0000","last_active":"2023-10-24T01:44:44.213967+0000","last_peered":"2023-10-24T01:44:44.213967+0000","last_clean":"2023-10-24T01:44:44.213967+0000","last_became_active":"2023-10-24T01:44:44.212702+0000","last_became_peered":"2023-10-24T01:44:44.212702+0000","last_unstale":"2023-10-24T01:44:44.213967+0000","last_undegraded":"2023-10-24T01:44:44.213967+0000","last_fullsized":"2023-10-24T01:44:44.213967+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213661+0000","last_change":"2023-10-24T01:44:43.842591+0000","last_active":"2023-10-24T01:44:44.213661+0000","last_peered":"2023-10-24T01:44:44.213661+0000","last_clean":"2023-10-24T01:44:44.213661+0000","last_became_active":"2023-10-24T01:44:43.841011+0000","last_became_peered":"2023-10-24T01:44:43.841011+0000","last_unstale":"2023-10-24T01:44:44.213661+0000","last_undegraded":"2023-10-24T01:44:44.213661+0000","last_fullsized":"2023-10-24T01:44:44.213661+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220318+0000","last_change":"2023-10-24T01:44:44.211864+0000","last_active":"2023-10-24T01:44:44.220318+0000","last_peered":"2023-10-24T01:44:44.220318+0000","last_clean":"2023-10-24T01:44:44.220318+0000","last_became_active":"2023-10-24T01:44:44.211148+0000","last_became_peered":"2023-10-24T01:44:44.211148+0000","last_unstale":"2023-10-24T01:44:44.220318+0000","last_undegraded":"2023-10-24T01:44:44.220318+0000","last_fullsized":"2023-10-24T01:44:44.220318+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.222325+0000","last_change":"2023-10-24T01:44:43.846988+0000","last_active":"2023-10-24T01:44:44.222325+0000","last_peered":"2023-10-24T01:44:44.222325+0000","last_clean":"2023-10-24T01:44:44.222325+0000","last_became_active":"2023-10-24T01:44:43.846712+0000","last_became_peered":"2023-10-24T01:44:43.846712+0000","last_unstale":"2023-10-24T01:44:44.222325+0000","last_undegraded":"2023-10-24T01:44:44.222325+0000","last_fullsized":"2023-10-24T01:44:44.222325+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220434+0000","last_change":"2023-10-24T01:44:44.208441+0000","last_active":"2023-10-24T01:44:44.220434+0000","last_peered":"2023-10-24T01:44:44.220434+0000","last_clean":"2023-10-24T01:44:44.220434+0000","last_became_active":"2023-10-24T01:44:44.207922+0000","last_became_peered":"2023-10-24T01:44:44.207922+0000","last_unstale":"2023-10-24T01:44:44.220434+0000","last_undegraded":"2023-10-24T01:44:44.220434+0000","last_fullsized":"2023-10-24T01:44:44.220434+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.841070+0000","last_change":"2023-10-24T01:44:43.833139+0000","last_active":"2023-10-24T01:44:43.841070+0000","last_peered":"2023-10-24T01:44:43.841070+0000","last_clean":"2023-10-24T01:44:43.841070+0000","last_became_active":"2023-10-24T01:44:43.832875+0000","last_became_peered":"2023-10-24T01:44:43.832875+0000","last_unstale":"2023-10-24T01:44:43.841070+0000","last_undegraded":"2023-10-24T01:44:43.841070+0000","last_fullsized":"2023-10-24T01:44:43.841070+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.224706+0000","last_change":"2023-10-24T01:44:44.217423+0000","last_active":"2023-10-24T01:44:44.224706+0000","last_peered":"2023-10-24T01:44:44.224706+0000","last_clean":"2023-10-24T01:44:44.224706+0000","last_became_active":"2023-10-24T01:44:44.217146+0000","last_became_peered":"2023-10-24T01:44:44.217146+0000","last_unstale":"2023-10-24T01:44:44.224706+0000","last_undegraded":"2023-10-24T01:44:44.224706+0000","last_fullsized":"2023-10-24T01:44:44.224706+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.847377+0000","last_change":"2023-10-24T01:44:43.844745+0000","last_active":"2023-10-24T01:44:43.847377+0000","last_peered":"2023-10-24T01:44:43.847377+0000","last_clean":"2023-10-24T01:44:43.847377+0000","last_became_active":"2023-10-24T01:44:43.844530+0000","last_became_peered":"2023-10-24T01:44:43.844530+0000","last_unstale":"2023-10-24T01:44:43.847377+0000","last_undegraded":"2023-10-24T01:44:43.847377+0000","last_fullsized":"2023-10-24T01:44:43.847377+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.209020+0000","last_change":"2023-10-24T01:44:44.209020+0000","last_active":"2023-10-24T01:44:44.209020+0000","last_peered":"2023-10-24T01:44:44.209020+0000","last_clean":"2023-10-24T01:44:44.209020+0000","last_became_active":"2023-10-24T01:44:44.208519+0000","last_became_peered":"2023-10-24T01:44:44.208519+0000","last_unstale":"2023-10-24T01:44:44.209020+0000","last_undegraded":"2023-10-24T01:44:44.209020+0000","last_fullsized":"2023-10-24T01:44:44.209020+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215598+0000","last_change":"2023-10-24T01:44:43.847187+0000","last_active":"2023-10-24T01:44:44.215598+0000","last_peered":"2023-10-24T01:44:44.215598+0000","last_clean":"2023-10-24T01:44:44.215598+0000","last_became_active":"2023-10-24T01:44:43.846919+0000","last_became_peered":"2023-10-24T01:44:43.846919+0000","last_unstale":"2023-10-24T01:44:44.215598+0000","last_undegraded":"2023-10-24T01:44:44.215598+0000","last_fullsized":"2023-10-24T01:44:44.215598+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.225010+0000","last_change":"2023-10-24T01:44:44.222364+0000","last_active":"2023-10-24T01:44:44.225010+0000","last_peered":"2023-10-24T01:44:44.225010+0000","last_clean":"2023-10-24T01:44:44.225010+0000","last_became_active":"2023-10-24T01:44:44.222107+0000","last_became_peered":"2023-10-24T01:44:44.222107+0000","last_unstale":"2023-10-24T01:44:44.225010+0000","last_undegraded":"2023-10-24T01:44:44.225010+0000","last_fullsized":"2023-10-24T01:44:44.225010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.198996+0000","last_change":"2023-10-24T01:44:43.842292+0000","last_active":"2023-10-24T01:44:44.198996+0000","last_peered":"2023-10-24T01:44:44.198996+0000","last_clean":"2023-10-24T01:44:44.198996+0000","last_became_active":"2023-10-24T01:44:43.842043+0000","last_became_peered":"2023-10-24T01:44:43.842043+0000","last_unstale":"2023-10-24T01:44:44.198996+0000","last_undegraded":"2023-10-24T01:44:44.198996+0000","last_fullsized":"2023-10-24T01:44:44.198996+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214396+0000","last_change":"2023-10-24T01:44:44.214396+0000","last_active":"2023-10-24T01:44:44.214396+0000","last_peered":"2023-10-24T01:44:44.214396+0000","last_clean":"2023-10-24T01:44:44.214396+0000","last_became_active":"2023-10-24T01:44:44.214110+0000","last_became_peered":"2023-10-24T01:44:44.214110+0000","last_unstale":"2023-10-24T01:44:44.214396+0000","last_undegraded":"2023-10-24T01:44:44.214396+0000","last_fullsized":"2023-10-24T01:44:44.214396+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.196452+0000","last_change":"2023-10-24T01:44:43.847296+0000","last_active":"2023-10-24T01:44:44.196452+0000","last_peered":"2023-10-24T01:44:44.196452+0000","last_clean":"2023-10-24T01:44:44.196452+0000","last_became_active":"2023-10-24T01:44:43.846233+0000","last_became_peered":"2023-10-24T01:44:43.846233+0000","last_unstale":"2023-10-24T01:44:44.196452+0000","last_undegraded":"2023-10-24T01:44:44.196452+0000","last_fullsized":"2023-10-24T01:44:44.196452+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220366+0000","last_change":"2023-10-24T01:44:44.220366+0000","last_active":"2023-10-24T01:44:44.220366+0000","last_peered":"2023-10-24T01:44:44.220366+0000","last_clean":"2023-10-24T01:44:44.220366+0000","last_became_active":"2023-10-24T01:44:44.220058+0000","last_became_peered":"2023-10-24T01:44:44.220058+0000","last_unstale":"2023-10-24T01:44:44.220366+0000","last_undegraded":"2023-10-24T01:44:44.220366+0000","last_fullsized":"2023-10-24T01:44:44.220366+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.847623+0000","last_change":"2023-10-24T01:44:43.842557+0000","last_active":"2023-10-24T01:44:43.847623+0000","last_peered":"2023-10-24T01:44:43.847623+0000","last_clean":"2023-10-24T01:44:43.847623+0000","last_became_active":"2023-10-24T01:44:43.842290+0000","last_became_peered":"2023-10-24T01:44:43.842290+0000","last_unstale":"2023-10-24T01:44:43.847623+0000","last_undegraded":"2023-10-24T01:44:43.847623+0000","last_fullsized":"2023-10-24T01:44:43.847623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213941+0000","last_change":"2023-10-24T01:44:44.213941+0000","last_active":"2023-10-24T01:44:44.213941+0000","last_peered":"2023-10-24T01:44:44.213941+0000","last_clean":"2023-10-24T01:44:44.213941+0000","last_became_active":"2023-10-24T01:44:44.213549+0000","last_became_peered":"2023-10-24T01:44:44.213549+0000","last_unstale":"2023-10-24T01:44:44.213941+0000","last_undegraded":"2023-10-24T01:44:44.213941+0000","last_fullsized":"2023-10-24T01:44:44.213941+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.218279+0000","last_change":"2023-10-24T01:44:43.851496+0000","last_active":"2023-10-24T01:44:44.218279+0000","last_peered":"2023-10-24T01:44:44.218279+0000","last_clean":"2023-10-24T01:44:44.218279+0000","last_became_active":"2023-10-24T01:44:43.851233+0000","last_became_peered":"2023-10-24T01:44:43.851233+0000","last_unstale":"2023-10-24T01:44:44.218279+0000","last_undegraded":"2023-10-24T01:44:44.218279+0000","last_fullsized":"2023-10-24T01:44:44.218279+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.213682+0000","last_change":"2023-10-24T01:44:44.212665+0000","last_active":"2023-10-24T01:44:44.213682+0000","last_peered":"2023-10-24T01:44:44.213682+0000","last_clean":"2023-10-24T01:44:44.213682+0000","last_became_active":"2023-10-24T01:44:44.212356+0000","last_became_peered":"2023-10-24T01:44:44.212356+0000","last_unstale":"2023-10-24T01:44:44.213682+0000","last_undegraded":"2023-10-24T01:44:44.213682+0000","last_fullsized":"2023-10-24T01:44:44.213682+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.200098+0000","last_change":"2023-10-24T01:44:43.839296+0000","last_active":"2023-10-24T01:44:44.200098+0000","last_peered":"2023-10-24T01:44:44.200098+0000","last_clean":"2023-10-24T01:44:44.200098+0000","last_became_active":"2023-10-24T01:44:43.839004+0000","last_became_peered":"2023-10-24T01:44:43.839004+0000","last_unstale":"2023-10-24T01:44:44.200098+0000","last_undegraded":"2023-10-24T01:44:44.200098+0000","last_fullsized":"2023-10-24T01:44:44.200098+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220454+0000","last_change":"2023-10-24T01:44:44.218380+0000","last_active":"2023-10-24T01:44:44.220454+0000","last_peered":"2023-10-24T01:44:44.220454+0000","last_clean":"2023-10-24T01:44:44.220454+0000","last_became_active":"2023-10-24T01:44:44.218122+0000","last_became_peered":"2023-10-24T01:44:44.218122+0000","last_unstale":"2023-10-24T01:44:44.220454+0000","last_undegraded":"2023-10-24T01:44:44.220454+0000","last_fullsized":"2023-10-24T01:44:44.220454+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199289+0000","last_change":"2023-10-24T01:44:43.845938+0000","last_active":"2023-10-24T01:44:44.199289+0000","last_peered":"2023-10-24T01:44:44.199289+0000","last_clean":"2023-10-24T01:44:44.199289+0000","last_became_active":"2023-10-24T01:44:43.845681+0000","last_became_peered":"2023-10-24T01:44:43.845681+0000","last_unstale":"2023-10-24T01:44:44.199289+0000","last_undegraded":"2023-10-24T01:44:44.199289+0000","last_fullsized":"2023-10-24T01:44:44.199289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214119+0000","last_change":"2023-10-24T01:44:44.211302+0000","last_active":"2023-10-24T01:44:44.214119+0000","last_peered":"2023-10-24T01:44:44.214119+0000","last_clean":"2023-10-24T01:44:44.214119+0000","last_became_active":"2023-10-24T01:44:44.211042+0000","last_became_peered":"2023-10-24T01:44:44.211042+0000","last_unstale":"2023-10-24T01:44:44.214119+0000","last_undegraded":"2023-10-24T01:44:44.214119+0000","last_fullsized":"2023-10-24T01:44:44.214119+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.847590+0000","last_change":"2023-10-24T01:44:43.843307+0000","last_active":"2023-10-24T01:44:43.847590+0000","last_peered":"2023-10-24T01:44:43.847590+0000","last_clean":"2023-10-24T01:44:43.847590+0000","last_became_active":"2023-10-24T01:44:43.843057+0000","last_became_peered":"2023-10-24T01:44:43.843057+0000","last_unstale":"2023-10-24T01:44:43.847590+0000","last_undegraded":"2023-10-24T01:44:43.847590+0000","last_fullsized":"2023-10-24T01:44:43.847590+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.212338+0000","last_change":"2023-10-24T01:44:44.212338+0000","last_active":"2023-10-24T01:44:44.212338+0000","last_peered":"2023-10-24T01:44:44.212338+0000","last_clean":"2023-10-24T01:44:44.212338+0000","last_became_active":"2023-10-24T01:44:44.212074+0000","last_became_peered":"2023-10-24T01:44:44.212074+0000","last_unstale":"2023-10-24T01:44:44.212338+0000","last_undegraded":"2023-10-24T01:44:44.212338+0000","last_fullsized":"2023-10-24T01:44:44.212338+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.851892+0000","last_change":"2023-10-24T01:44:43.846579+0000","last_active":"2023-10-24T01:44:43.851892+0000","last_peered":"2023-10-24T01:44:43.851892+0000","last_clean":"2023-10-24T01:44:43.851892+0000","last_became_active":"2023-10-24T01:44:43.846270+0000","last_became_peered":"2023-10-24T01:44:43.846270+0000","last_unstale":"2023-10-24T01:44:43.851892+0000","last_undegraded":"2023-10-24T01:44:43.851892+0000","last_fullsized":"2023-10-24T01:44:43.851892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.211731+0000","last_change":"2023-10-24T01:44:44.211731+0000","last_active":"2023-10-24T01:44:44.211731+0000","last_peered":"2023-10-24T01:44:44.211731+0000","last_clean":"2023-10-24T01:44:44.211731+0000","last_became_active":"2023-10-24T01:44:44.211236+0000","last_became_peered":"2023-10-24T01:44:44.211236+0000","last_unstale":"2023-10-24T01:44:44.211731+0000","last_undegraded":"2023-10-24T01:44:44.211731+0000","last_fullsized":"2023-10-24T01:44:44.211731+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199395+0000","last_change":"2023-10-24T01:44:43.842421+0000","last_active":"2023-10-24T01:44:44.199395+0000","last_peered":"2023-10-24T01:44:44.199395+0000","last_clean":"2023-10-24T01:44:44.199395+0000","last_became_active":"2023-10-24T01:44:43.842140+0000","last_became_peered":"2023-10-24T01:44:43.842140+0000","last_unstale":"2023-10-24T01:44:44.199395+0000","last_undegraded":"2023-10-24T01:44:44.199395+0000","last_fullsized":"2023-10-24T01:44:44.199395+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.212625+0000","last_change":"2023-10-24T01:44:44.212625+0000","last_active":"2023-10-24T01:44:44.212625+0000","last_peered":"2023-10-24T01:44:44.212625+0000","last_clean":"2023-10-24T01:44:44.212625+0000","last_became_active":"2023-10-24T01:44:44.212260+0000","last_became_peered":"2023-10-24T01:44:44.212260+0000","last_unstale":"2023-10-24T01:44:44.212625+0000","last_undegraded":"2023-10-24T01:44:44.212625+0000","last_fullsized":"2023-10-24T01:44:44.212625+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.845861+0000","last_change":"2023-10-24T01:44:43.844062+0000","last_active":"2023-10-24T01:44:43.845861+0000","last_peered":"2023-10-24T01:44:43.845861+0000","last_clean":"2023-10-24T01:44:43.845861+0000","last_became_active":"2023-10-24T01:44:43.843813+0000","last_became_peered":"2023-10-24T01:44:43.843813+0000","last_unstale":"2023-10-24T01:44:43.845861+0000","last_undegraded":"2023-10-24T01:44:43.845861+0000","last_fullsized":"2023-10-24T01:44:43.845861+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.220290+0000","last_change":"2023-10-24T01:44:44.216809+0000","last_active":"2023-10-24T01:44:44.220290+0000","last_peered":"2023-10-24T01:44:44.220290+0000","last_clean":"2023-10-24T01:44:44.220290+0000","last_became_active":"2023-10-24T01:44:44.216499+0000","last_became_peered":"2023-10-24T01:44:44.216499+0000","last_unstale":"2023-10-24T01:44:44.220290+0000","last_undegraded":"2023-10-24T01:44:44.220290+0000","last_fullsized":"2023-10-24T01:44:44.220290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.853917+0000","last_change":"2023-10-24T01:44:43.851474+0000","last_active":"2023-10-24T01:44:43.853917+0000","last_peered":"2023-10-24T01:44:43.853917+0000","last_clean":"2023-10-24T01:44:43.853917+0000","last_became_active":"2023-10-24T01:44:43.851182+0000","last_became_peered":"2023-10-24T01:44:43.851182+0000","last_unstale":"2023-10-24T01:44:43.853917+0000","last_undegraded":"2023-10-24T01:44:43.853917+0000","last_fullsized":"2023-10-24T01:44:43.853917+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223069+0000","last_change":"2023-10-24T01:44:44.218324+0000","last_active":"2023-10-24T01:44:44.223069+0000","last_peered":"2023-10-24T01:44:44.223069+0000","last_clean":"2023-10-24T01:44:44.223069+0000","last_became_active":"2023-10-24T01:44:44.217600+0000","last_became_peered":"2023-10-24T01:44:44.217600+0000","last_unstale":"2023-10-24T01:44:44.223069+0000","last_undegraded":"2023-10-24T01:44:44.223069+0000","last_fullsized":"2023-10-24T01:44:44.223069+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"165'3","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.221697+0000","last_change":"2023-10-24T01:44:43.851158+0000","last_active":"2023-10-24T01:44:44.221697+0000","last_peered":"2023-10-24T01:44:44.221697+0000","last_clean":"2023-10-24T01:44:44.221697+0000","last_became_active":"2023-10-24T01:44:43.850897+0000","last_became_peered":"2023-10-24T01:44:43.850897+0000","last_unstale":"2023-10-24T01:44:44.221697+0000","last_undegraded":"2023-10-24T01:44:44.221697+0000","last_fullsized":"2023-10-24T01:44:44.221697+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":141,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.824898+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:44:43.824898+0000","last_peered":"2023-10-24T01:44:43.824898+0000","last_clean":"2023-10-24T01:44:43.824898+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:44:43.824898+0000","last_undegraded":"2023-10-24T01:44:43.824898+0000","last_fullsized":"2023-10-24T01:44:43.824898+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.214135+0000","last_change":"2023-10-24T01:44:44.212617+0000","last_active":"2023-10-24T01:44:44.214135+0000","last_peered":"2023-10-24T01:44:44.214135+0000","last_clean":"2023-10-24T01:44:44.214135+0000","last_became_active":"2023-10-24T01:44:44.212049+0000","last_became_peered":"2023-10-24T01:44:44.212049+0000","last_unstale":"2023-10-24T01:44:44.214135+0000","last_undegraded":"2023-10-24T01:44:44.214135+0000","last_fullsized":"2023-10-24T01:44:44.214135+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.209476+0000","last_change":"2023-10-24T01:44:43.841335+0000","last_active":"2023-10-24T01:44:44.209476+0000","last_peered":"2023-10-24T01:44:44.209476+0000","last_clean":"2023-10-24T01:44:44.209476+0000","last_became_active":"2023-10-24T01:44:43.839378+0000","last_became_peered":"2023-10-24T01:44:43.839378+0000","last_unstale":"2023-10-24T01:44:44.209476+0000","last_undegraded":"2023-10-24T01:44:44.209476+0000","last_fullsized":"2023-10-24T01:44:44.209476+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.834184+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:44:43.834184+0000","last_peered":"2023-10-24T01:44:43.834184+0000","last_clean":"2023-10-24T01:44:43.834184+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:44:43.834184+0000","last_undegraded":"2023-10-24T01:44:43.834184+0000","last_fullsized":"2023-10-24T01:44:43.834184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.212146+0000","last_change":"2023-10-24T01:44:44.212146+0000","last_active":"2023-10-24T01:44:44.212146+0000","last_peered":"2023-10-24T01:44:44.212146+0000","last_clean":"2023-10-24T01:44:44.212146+0000","last_became_active":"2023-10-24T01:44:44.211651+0000","last_became_peered":"2023-10-24T01:44:44.211651+0000","last_unstale":"2023-10-24T01:44:44.212146+0000","last_undegraded":"2023-10-24T01:44:44.212146+0000","last_fullsized":"2023-10-24T01:44:44.212146+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.215263+0000","last_change":"2023-10-24T01:44:43.849903+0000","last_active":"2023-10-24T01:44:44.215263+0000","last_peered":"2023-10-24T01:44:44.215263+0000","last_clean":"2023-10-24T01:44:44.215263+0000","last_became_active":"2023-10-24T01:44:43.849608+0000","last_became_peered":"2023-10-24T01:44:43.849608+0000","last_unstale":"2023-10-24T01:44:44.215263+0000","last_undegraded":"2023-10-24T01:44:44.215263+0000","last_fullsized":"2023-10-24T01:44:44.215263+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199871+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:44:44.199871+0000","last_peered":"2023-10-24T01:44:44.199871+0000","last_clean":"2023-10-24T01:44:44.199871+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:44:44.199871+0000","last_undegraded":"2023-10-24T01:44:44.199871+0000","last_fullsized":"2023-10-24T01:44:44.199871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223114+0000","last_change":"2023-10-24T01:44:44.218990+0000","last_active":"2023-10-24T01:44:44.223114+0000","last_peered":"2023-10-24T01:44:44.223114+0000","last_clean":"2023-10-24T01:44:44.223114+0000","last_became_active":"2023-10-24T01:44:44.218713+0000","last_became_peered":"2023-10-24T01:44:44.218713+0000","last_unstale":"2023-10-24T01:44:44.223114+0000","last_undegraded":"2023-10-24T01:44:44.223114+0000","last_fullsized":"2023-10-24T01:44:44.223114+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199412+0000","last_change":"2023-10-24T01:44:43.845385+0000","last_active":"2023-10-24T01:44:44.199412+0000","last_peered":"2023-10-24T01:44:44.199412+0000","last_clean":"2023-10-24T01:44:44.199412+0000","last_became_active":"2023-10-24T01:44:43.845119+0000","last_became_peered":"2023-10-24T01:44:43.845119+0000","last_unstale":"2023-10-24T01:44:44.199412+0000","last_undegraded":"2023-10-24T01:44:44.199412+0000","last_fullsized":"2023-10-24T01:44:44.199412+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.836329+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:44:43.836329+0000","last_peered":"2023-10-24T01:44:43.836329+0000","last_clean":"2023-10-24T01:44:43.836329+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:44:43.836329+0000","last_undegraded":"2023-10-24T01:44:43.836329+0000","last_fullsized":"2023-10-24T01:44:43.836329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.195452+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:44:44.195452+0000","last_peered":"2023-10-24T01:44:44.195452+0000","last_clean":"2023-10-24T01:44:44.195452+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:44:44.195452+0000","last_undegraded":"2023-10-24T01:44:44.195452+0000","last_fullsized":"2023-10-24T01:44:44.195452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223123+0000","last_change":"2023-10-24T01:44:44.221617+0000","last_active":"2023-10-24T01:44:44.223123+0000","last_peered":"2023-10-24T01:44:44.223123+0000","last_clean":"2023-10-24T01:44:44.223123+0000","last_became_active":"2023-10-24T01:44:44.221331+0000","last_became_peered":"2023-10-24T01:44:44.221331+0000","last_unstale":"2023-10-24T01:44:44.223123+0000","last_undegraded":"2023-10-24T01:44:44.223123+0000","last_fullsized":"2023-10-24T01:44:44.223123+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.201950+0000","last_change":"2023-10-24T01:44:43.849962+0000","last_active":"2023-10-24T01:44:44.201950+0000","last_peered":"2023-10-24T01:44:44.201950+0000","last_clean":"2023-10-24T01:44:44.201950+0000","last_became_active":"2023-10-24T01:44:43.849632+0000","last_became_peered":"2023-10-24T01:44:43.849632+0000","last_unstale":"2023-10-24T01:44:44.201950+0000","last_undegraded":"2023-10-24T01:44:44.201950+0000","last_fullsized":"2023-10-24T01:44:44.201950+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.195529+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:44:44.195529+0000","last_peered":"2023-10-24T01:44:44.195529+0000","last_clean":"2023-10-24T01:44:44.195529+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:44:44.195529+0000","last_undegraded":"2023-10-24T01:44:44.195529+0000","last_fullsized":"2023-10-24T01:44:44.195529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.223004+0000","last_change":"2023-10-24T01:44:44.217576+0000","last_active":"2023-10-24T01:44:44.223004+0000","last_peered":"2023-10-24T01:44:44.223004+0000","last_clean":"2023-10-24T01:44:44.223004+0000","last_became_active":"2023-10-24T01:44:44.217274+0000","last_became_peered":"2023-10-24T01:44:44.217274+0000","last_unstale":"2023-10-24T01:44:44.223004+0000","last_undegraded":"2023-10-24T01:44:44.223004+0000","last_fullsized":"2023-10-24T01:44:44.223004+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.216923+0000","last_change":"2023-10-24T01:44:43.842655+0000","last_active":"2023-10-24T01:44:44.216923+0000","last_peered":"2023-10-24T01:44:44.216923+0000","last_clean":"2023-10-24T01:44:44.216923+0000","last_became_active":"2023-10-24T01:44:43.842052+0000","last_became_peered":"2023-10-24T01:44:43.842052+0000","last_unstale":"2023-10-24T01:44:44.216923+0000","last_undegraded":"2023-10-24T01:44:44.216923+0000","last_fullsized":"2023-10-24T01:44:44.216923+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.198778+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:44:44.198778+0000","last_peered":"2023-10-24T01:44:44.198778+0000","last_clean":"2023-10-24T01:44:44.198778+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:44:44.198778+0000","last_undegraded":"2023-10-24T01:44:44.198778+0000","last_fullsized":"2023-10-24T01:44:44.198778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.219606+0000","last_change":"2023-10-24T01:44:44.213181+0000","last_active":"2023-10-24T01:44:44.219606+0000","last_peered":"2023-10-24T01:44:44.219606+0000","last_clean":"2023-10-24T01:44:44.219606+0000","last_became_active":"2023-10-24T01:44:44.212904+0000","last_became_peered":"2023-10-24T01:44:44.212904+0000","last_unstale":"2023-10-24T01:44:44.219606+0000","last_undegraded":"2023-10-24T01:44:44.219606+0000","last_fullsized":"2023-10-24T01:44:44.219606+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.846533+0000","last_change":"2023-10-24T01:44:43.842597+0000","last_active":"2023-10-24T01:44:43.846533+0000","last_peered":"2023-10-24T01:44:43.846533+0000","last_clean":"2023-10-24T01:44:43.846533+0000","last_became_active":"2023-10-24T01:44:43.841075+0000","last_became_peered":"2023-10-24T01:44:43.841075+0000","last_unstale":"2023-10-24T01:44:43.846533+0000","last_undegraded":"2023-10-24T01:44:43.846533+0000","last_fullsized":"2023-10-24T01:44:43.846533+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-24T01:44:43.825583+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:44:43.825583+0000","last_peered":"2023-10-24T01:44:43.825583+0000","last_clean":"2023-10-24T01:44:43.825583+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:44:43.825583+0000","last_undegraded":"2023-10-24T01:44:43.825583+0000","last_fullsized":"2023-10-24T01:44:43.825583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.211067+0000","last_change":"2023-10-24T01:44:44.211067+0000","last_active":"2023-10-24T01:44:44.211067+0000","last_peered":"2023-10-24T01:44:44.211067+0000","last_clean":"2023-10-24T01:44:44.211067+0000","last_became_active":"2023-10-24T01:44:44.210793+0000","last_became_peered":"2023-10-24T01:44:44.210793+0000","last_unstale":"2023-10-24T01:44:44.211067+0000","last_undegraded":"2023-10-24T01:44:44.211067+0000","last_fullsized":"2023-10-24T01:44:44.211067+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:43.815412+0000","last_clean_scrub_stamp":"2023-10-24T01:44:43.815412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.199424+0000","last_change":"2023-10-24T01:44:43.839474+0000","last_active":"2023-10-24T01:44:44.199424+0000","last_peered":"2023-10-24T01:44:44.199424+0000","last_clean":"2023-10-24T01:44:44.199424+0000","last_became_active":"2023-10-24T01:44:43.839201+0000","last_became_peered":"2023-10-24T01:44:43.839201+0000","last_unstale":"2023-10-24T01:44:44.199424+0000","last_undegraded":"2023-10-24T01:44:44.199424+0000","last_fullsized":"2023-10-24T01:44:44.199424+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:44:42.810454+0000","last_clean_scrub_stamp":"2023-10-24T01:44:42.810454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-24T01:44:44.205372+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:44:44.205372+0000","last_peered":"2023-10-24T01:44:44.205372+0000","last_clean":"2023-10-24T01:44:44.205372+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:44:44.205372+0000","last_undegraded":"2023-10-24T01:44:44.205372+0000","last_fullsized":"2023-10-24T01:44:44.205372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543053,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307312,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064528,"statfs":{"total":96636764160,"available":96322076672,"internally_reserved":0,"allocated":2072576,"data_stored":1046089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.79300000000000004}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.872},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.67300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":2068480,"data_stored":1046337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.47799999999999998}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66000000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.75},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575758,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303192,"kb_used_data":2000,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068648,"statfs":{"total":96636764160,"available":96326295552,"internally_reserved":0,"allocated":2048000,"data_stored":1038607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39900000000000002,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.55000000000000004,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.436,"15min":0.433},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.26700000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61599999999999999,"5min":0.63,"15min":0.66200000000000003},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.373}]},{"osd":3,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.625},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.625},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.45700000000000002,"5min":0.41499999999999998,"15min":0.35299999999999998},"max":{"1min":0.84299999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64300000000000002,"15min":0.63900000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38600000000000001},"max":{"1min":0.878,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.006},"last":0.53200000000000003}]},{"osd":6,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.41599999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.96899999999999997},"last":0.71099999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.89300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68100000000000005,"15min":0.67300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575758,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303216,"kb_used_data":2024,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068624,"statfs":{"total":96636764160,"available":96326270976,"internally_reserved":0,"allocated":2072576,"data_stored":1045481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.28000000000000003}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32000000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.44}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42899999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.47099999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.50700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543053,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307308,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064532,"statfs":{"total":96636764160,"available":96322080768,"internally_reserved":0,"allocated":2068480,"data_stored":1045943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.27800000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.373},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.36199999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575758,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307296,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064544,"statfs":{"total":96636764160,"available":96322093056,"internally_reserved":0,"allocated":2056192,"data_stored":1039251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.251},"max":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.66800000000000004,"15min":0.70799999999999996},"last":0.28499999999999998}]},{"osd":1,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39300000000000002,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.55800000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.45500000000000002,"15min":0.45000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":0.65000000000000002,"5min":0.66500000000000004,"15min":0.75600000000000001},"last":0.373}]},{"osd":2,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.436,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.34499999999999997,"5min":0.33800000000000002,"15min":0.32100000000000001},"max":{"1min":0.69699999999999995,"5min":0.751,"15min":0.751},"last":0.33900000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.52200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.032},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.39500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.48799999999999999,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.98799999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44,"15min":0.39000000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.56100000000000005,"5min":0.47099999999999997,"15min":0.44700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.48599999999999999,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":0.95799999999999996,"5min":0.96099999999999997,"15min":1.0049999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Tue Oct 24 01:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68799999999999994,"15min":0.67700000000000005},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69599999999999995,"15min":0.69299999999999995},"min":{"1min":0.59799999999999998,"5min":0.47899999999999998,"15min":0.46000000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99199999999999999},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575758,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":2068480,"data_stored":1045979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73899999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.78000000000000003,"5min":0.78800000000000003,"15min":0.79600000000000004},"last":0.45300000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.372},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.40400000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.71799999999999997,"5min":0.77400000000000002,"15min":0.81799999999999995},"last":0.48499999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.59699999999999998},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.81100000000000005,"15min":0.83299999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.59899999999999998},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.76200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50800000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.27900000000000003},"max":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68400000000000005,"5min":1.04,"15min":1.04},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.72499999999999998,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70999999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543053,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":2056192,"data_stored":1039521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.38600000000000001}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.58099999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:44:47.533 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T01:44:47.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T01:44:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.684+0000 7ff3a5161700 1 Processor -- start 2023-10-24T01:44:47.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.684+0000 7ff3a5161700 1 -- start start 2023-10-24T01:44:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff3a5161700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff3a5161700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3a0098bd0 0x7ff3a00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff3a5161700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00c71d0 con 0x7ff3a00bffd0 2023-10-24T01:44:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff3a5161700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a00c9410 con 0x7ff3a0098bd0 2023-10-24T01:44:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff3a5161700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00c6c10 con 0x7ff3a0154430 2023-10-24T01:44:47.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff39659c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3a0098bd0 0x7ff3a00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:52756/0 (socket says 172.21.15.148:52756) 2023-10-24T01:44:47.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff39ed9d700 1 -- 172.21.15.148:0/386421775 learned_addr learned my addr 172.21.15.148:0/386421775 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:47.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.685+0000 7ff39f59e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff3a00bffd0 0x7ff3a00c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56566/0 (socket says 172.21.15.148:56566) 2023-10-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39ed9d700 1 -- 172.21.15.148:0/386421775 >> v2:172.21.15.150:3300/0 conn(0x7ff3a0098bd0 msgr2=0x7ff3a00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39ed9d700 1 --2- 172.21.15.148:0/386421775 >> v2:172.21.15.150:3300/0 conn(0x7ff3a0098bd0 0x7ff3a00c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39ed9d700 1 -- 172.21.15.148:0/386421775 >> v1:172.21.15.150:6789/0 conn(0x7ff3a00bffd0 legacy=0x7ff3a00c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39ed9d700 1 -- 172.21.15.148:0/386421775 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00c6ef0 con 0x7ff3a0154430 2023-10-24T01:44:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39ed9d700 1 --2- 172.21.15.148:0/386421775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7ff390009830 tx=0x7ff3900090f0).ready entity=mon.2 client_cookie=4fac7d05cbd78e0f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39e59c700 1 -- 172.21.15.148:0/386421775 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000b580 con 0x7ff3a0154430 2023-10-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39e59c700 1 -- 172.21.15.148:0/386421775 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000b6e0 con 0x7ff3a0154430 2023-10-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff39e59c700 1 -- 172.21.15.148:0/386421775 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000ba60 con 0x7ff3a0154430 2023-10-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 -- 172.21.15.148:0/386421775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 msgr2=0x7ff3a0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 --2- 172.21.15.148:0/386421775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7ff390009830 tx=0x7ff3900090f0).stop 2023-10-24T01:44:47.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 -- 172.21.15.148:0/386421775 shutdown_connections 2023-10-24T01:44:47.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 --2- 172.21.15.148:0/386421775 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a0154430 0x7ff3a0154810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 --2- 172.21.15.148:0/386421775 >> v2:172.21.15.150:3300/0 conn(0x7ff3a0098bd0 0x7ff3a00c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.686+0000 7ff3a5161700 1 -- 172.21.15.148:0/386421775 >> 172.21.15.148:0/386421775 conn(0x7ff3a00cb070 msgr2=0x7ff3a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:47.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.687+0000 7ff3a5161700 1 -- 172.21.15.148:0/386421775 shutdown_connections 2023-10-24T01:44:47.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.687+0000 7ff3a5161700 1 -- 172.21.15.148:0/386421775 wait complete. 2023-10-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.688+0000 7ff3a5161700 1 Processor -- start 2023-10-24T01:44:47.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.688+0000 7ff3a5161700 1 -- start start 2023-10-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a00bffd0 0x7ff3a00c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0154430 0x7ff3a0167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00ab030 con 0x7ff3a0098bd0 2023-10-24T01:44:47.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0164390 con 0x7ff3a0154430 2023-10-24T01:44:47.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00ab2a0 con 0x7ff3a00bffd0 2023-10-24T01:44:47.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48110/0 (socket says 172.21.15.148:48110) 2023-10-24T01:44:47.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 -- 172.21.15.148:0/576426935 learned_addr learned my addr 172.21.15.148:0/576426935 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:47.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39659c700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a00bffd0 0x7ff3a00c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39f59e700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0154430 0x7ff3a0167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 -- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a00bffd0 msgr2=0x7ff3a00c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a00bffd0 0x7ff3a00c2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 -- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0154430 msgr2=0x7ff3a0167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0154430 0x7ff3a0167a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 -- 172.21.15.148:0/576426935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009370 con 0x7ff3a0098bd0 2023-10-24T01:44:47.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff39ed9d700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7ff390009ed0 tx=0x7ff390017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000b850 con 0x7ff3a0098bd0 2023-10-24T01:44:47.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39000b9d0 con 0x7ff3a0098bd0 2023-10-24T01:44:47.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a00ae900 con 0x7ff3a0098bd0 2023-10-24T01:44:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39001c670 con 0x7ff3a0098bd0 2023-10-24T01:44:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.689+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a00c4e80 con 0x7ff3a0098bd0 2023-10-24T01:44:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.690+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a006c6b0 con 0x7ff3a0098bd0 2023-10-24T01:44:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.691+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff39001ca20 con 0x7ff3a0098bd0 2023-10-24T01:44:47.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.691+0000 7ff3977fe700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 0x7ff380061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:47.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.691+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff39007bdb0 con 0x7ff3a0098bd0 2023-10-24T01:44:47.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.691+0000 7ff39659c700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 0x7ff380061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:47.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.692+0000 7ff39659c700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 0x7ff380061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff3a00addc0 tx=0x7ff388009060).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:47.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.695+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff39004cf80 con 0x7ff3a0098bd0 2023-10-24T01:44:47.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.922+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff3a00c90a0 con 0x7ff3a0098bd0 2023-10-24T01:44:47.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.926+0000 7ff3977fe700 1 -- 172.21.15.148:0/576426935 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v43) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff3900505a0 con 0x7ff3a0098bd0 2023-10-24T01:44:47.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 msgr2=0x7ff380061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 0x7ff380061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff3a00addc0 tx=0x7ff388009060).stop 2023-10-24T01:44:47.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 msgr2=0x7ff3a01494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:47.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7ff390009ed0 tx=0x7ff390017000).stop 2023-10-24T01:44:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 shutdown_connections 2023-10-24T01:44:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a0154430 0x7ff3a0167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff38005f270 0x7ff380061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3a0098bd0 0x7ff3a01494a0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 --2- 172.21.15.148:0/576426935 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a00bffd0 0x7ff3a00c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 >> 172.21.15.148:0/576426935 conn(0x7ff3a00cb070 msgr2=0x7ff3a015a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 shutdown_connections 2023-10-24T01:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:47.928+0000 7ff3a5161700 1 -- 172.21.15.148:0/576426935 wait complete. 2023-10-24T01:44:47.932 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T01:44:47.942 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:48.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.054+0000 7fb8b73ae700 1 Processor -- start 2023-10-24T01:44:48.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 -- start start 2023-10-24T01:44:48.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 0x7fb8b00bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8b00a6550 0x7fb8b00a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00a8710 con 0x7fb8b00a8260 2023-10-24T01:44:48.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00a6a50 con 0x7fb8b00a6550 2023-10-24T01:44:48.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.055+0000 7fb8b73ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00a6d30 con 0x7fb8b00c86c0 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8b00a6550 0x7fb8b00a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb8b00a6550 0x7fb8b00a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48114/0 (socket says 172.21.15.148:48114) 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 -- 172.21.15.148:0/1507732382 learned_addr learned my addr 172.21.15.148:0/1507732382 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b514a700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 0x7fb8b00bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 -- 172.21.15.148:0/1507732382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 msgr2=0x7fb8b00bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 0x7fb8b00bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 -- 172.21.15.148:0/1507732382 >> v1:172.21.15.150:6789/0 conn(0x7fb8b00a8260 legacy=0x7fb8b00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 -- 172.21.15.148:0/1507732382 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00a7010 con 0x7fb8b00a6550 2023-10-24T01:44:48.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b514a700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 0x7fb8b00bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:44:48.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8b4949700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00a6550 0x7fb8b00a7d70 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fb8a4009f20 tx=0x7fb8a4009840).ready entity=mon.0 client_cookie=2a8b298a827c9079 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8affff700 1 -- 172.21.15.148:0/1507732382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400e070 con 0x7fb8b00a6550 2023-10-24T01:44:48.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8affff700 1 -- 172.21.15.148:0/1507732382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400ba40 con 0x7fb8b00a6550 2023-10-24T01:44:48.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.056+0000 7fb8affff700 1 -- 172.21.15.148:0/1507732382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400bdc0 con 0x7fb8b00a6550 2023-10-24T01:44:48.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 -- 172.21.15.148:0/1507732382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00a6550 msgr2=0x7fb8b00a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00a6550 0x7fb8b00a7d70 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fb8a4009f20 tx=0x7fb8a4009840).stop 2023-10-24T01:44:48.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 -- 172.21.15.148:0/1507732382 shutdown_connections 2023-10-24T01:44:48.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00c86c0 0x7fb8b00bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/1507732382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00a6550 0x7fb8b00a7d70 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 -- 172.21.15.148:0/1507732382 >> 172.21.15.148:0/1507732382 conn(0x7fb8b0092480 msgr2=0x7fb8b0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 -- 172.21.15.148:0/1507732382 shutdown_connections 2023-10-24T01:44:48.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.057+0000 7fb8b73ae700 1 -- 172.21.15.148:0/1507732382 wait complete. 2023-10-24T01:44:48.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.058+0000 7fb8b73ae700 1 Processor -- start 2023-10-24T01:44:48.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.058+0000 7fb8b73ae700 1 -- start start 2023-10-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 0x7fb8b00abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 0x7fb8b0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00c18e0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00c0cd0 con 0x7fb8b00a6550 2023-10-24T01:44:48.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00c0fb0 con 0x7fb8b00a8260 2023-10-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48128/0 (socket says 172.21.15.148:48128) 2023-10-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 -- 172.21.15.148:0/2042074597 learned_addr learned my addr 172.21.15.148:0/2042074597 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b4949700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 0x7fb8b0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b514a700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 0x7fb8b00abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 -- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 msgr2=0x7fb8b0149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 0x7fb8b0149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 -- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 msgr2=0x7fb8b00abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 0x7fb8b00abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 -- 172.21.15.148:0/2042074597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009ae0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b514a700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 0x7fb8b00abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b4949700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 0x7fb8b0149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b594b700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fb8a000c490 tx=0x7fb8a0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0002ea0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000f470 con 0x7fb8b00c86c0 2023-10-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00c1290 con 0x7fb8b00c86c0 2023-10-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.059+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000f810 con 0x7fb8b00c86c0 2023-10-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.060+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00ac2b0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.060+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00c1a50 con 0x7fb8b00c86c0 2023-10-24T01:44:48.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.061+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb8a000fc40 con 0x7fb8b00c86c0 2023-10-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.061+0000 7fb8ad7fa700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.061+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fb8a0079810 con 0x7fb8b00c86c0 2023-10-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.061+0000 7fb8b514a700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.062+0000 7fb8b514a700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 0x7fb89c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb8a800a9d0 tx=0x7fb8a8008040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.065+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb8a0047af0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.271+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8b006c6b0 con 0x7fb8b00c86c0 2023-10-24T01:44:48.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.272+0000 7fb8ad7fa700 1 -- 172.21.15.148:0/2042074597 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fb8a004a930 con 0x7fb8b00c86c0 2023-10-24T01:44:48.274 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:48.274 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:44:48.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 msgr2=0x7fb89c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 0x7fb89c061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb8a800a9d0 tx=0x7fb8a8008040).stop 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 msgr2=0x7fb8b00a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fb8a000c490 tx=0x7fb8a0007de0).stop 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 shutdown_connections 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb89c05f270 0x7fb89c061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8b00c86c0 0x7fb8b00a92c0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b00a6550 0x7fb8b00abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 --2- 172.21.15.148:0/2042074597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b00a8260 0x7fb8b0149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 >> 172.21.15.148:0/2042074597 conn(0x7fb8b0092480 msgr2=0x7fb8b00c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 shutdown_connections 2023-10-24T01:44:48.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.274+0000 7fb8b73ae700 1 -- 172.21.15.148:0/2042074597 wait complete. 2023-10-24T01:44:48.279 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:44:48.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T01:44:44.190315+0000', 'modified': '2023-10-24T01:44:46.196761+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8682}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8682': {'gid': 8682, 'name': 'd', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.150:6835/236803372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 236803372}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 236803372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T01:44:48.691 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T01:44:48.691 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-24T01:44:48.798 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T01:44:48.796+0000 7f48054cf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.805+0000 7f96545f2700 1 Processor -- start 2023-10-24T01:44:48.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.805+0000 7f96545f2700 1 -- start start 2023-10-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f96545f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f964c1547e0 0x7f964c0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f96545f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f964c0a82c0 0x7f964c0c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f96545f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964c0c01c0 con 0x7f964c154400 2023-10-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f96545f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c0aa960 con 0x7f964c0a82c0 2023-10-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f96545f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964c0c8a20 con 0x7f964c1547e0 2023-10-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f964c0a82c0 0x7f964c0c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f964c0a82c0 0x7f964c0c0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48130/0 (socket says 172.21.15.148:48130) 2023-10-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 -- 172.21.15.148:0/2987078919 learned_addr learned my addr 172.21.15.148:0/2987078919 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9651b8d700 1 --2- 172.21.15.148:0/2987078919 >> v2:172.21.15.150:3300/0 conn(0x7f964c1547e0 0x7f964c0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 -- 172.21.15.148:0/2987078919 >> v2:172.21.15.150:3300/0 conn(0x7f964c1547e0 msgr2=0x7f964c0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 --2- 172.21.15.148:0/2987078919 >> v2:172.21.15.150:3300/0 conn(0x7f964c1547e0 0x7f964c0a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.811 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 -- 172.21.15.148:0/2987078919 >> v1:172.21.15.150:6789/0 conn(0x7f964c154400 legacy=0x7f964c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.806+0000 7f9652b8f700 1 -- 172.21.15.148:0/2987078919 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c0c6150 con 0x7f964c0a82c0 2023-10-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f9652b8f700 1 --2- 172.21.15.148:0/2987078919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0a82c0 0x7f964c0c0b30 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f964c085bc0 tx=0x7f9644009840).ready entity=mon.0 client_cookie=50129c10ab7711 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f965138c700 1 -- 172.21.15.148:0/2987078919 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400e070 con 0x7f964c0a82c0 2023-10-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f965138c700 1 -- 172.21.15.148:0/2987078919 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400ba50 con 0x7f964c0a82c0 2023-10-24T01:44:48.812 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f965138c700 1 -- 172.21.15.148:0/2987078919 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400bdd0 con 0x7f964c0a82c0 2023-10-24T01:44:48.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 -- 172.21.15.148:0/2987078919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0a82c0 msgr2=0x7f964c0c0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 --2- 172.21.15.148:0/2987078919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0a82c0 0x7f964c0c0b30 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f964c085bc0 tx=0x7f9644009840).stop 2023-10-24T01:44:48.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 -- 172.21.15.148:0/2987078919 shutdown_connections 2023-10-24T01:44:48.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 --2- 172.21.15.148:0/2987078919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c0a82c0 0x7f964c0c0b30 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 --2- 172.21.15.148:0/2987078919 >> v2:172.21.15.150:3300/0 conn(0x7f964c1547e0 0x7f964c0a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 -- 172.21.15.148:0/2987078919 >> 172.21.15.148:0/2987078919 conn(0x7f964c0946a0 msgr2=0x7f964c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.814 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 -- 172.21.15.148:0/2987078919 shutdown_connections 2023-10-24T01:44:48.815 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.807+0000 7f96545f2700 1 -- 172.21.15.148:0/2987078919 wait complete. 2023-10-24T01:44:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.808+0000 7f96545f2700 1 Processor -- start 2023-10-24T01:44:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 -- start start 2023-10-24T01:44:48.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f964c0a82c0 0x7f964c0aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c1547e0 0x7f964c0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0c2420 con 0x7f964c154400 2023-10-24T01:44:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0abd10 con 0x7f964c0a82c0 2023-10-24T01:44:48.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f96545f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0ab100 con 0x7f964c1547e0 2023-10-24T01:44:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f9651b8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f9651b8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48138/0 (socket says 172.21.15.148:48138) 2023-10-24T01:44:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f9651b8d700 1 -- 172.21.15.148:0/3311901519 learned_addr learned my addr 172.21.15.148:0/3311901519 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.809+0000 7f965238e700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f964c0a82c0 0x7f964c0aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9652b8f700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c1547e0 0x7f964c0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 -- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c1547e0 msgr2=0x7f964c0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c1547e0 0x7f964c0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 -- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f964c0a82c0 msgr2=0x7f964c0aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f964c0a82c0 0x7f964c0aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 -- 172.21.15.148:0/3311901519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009ae0 con 0x7f964c154400 2023-10-24T01:44:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f963c00d890 tx=0x7f963c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f96427fc700 1 -- 172.21.15.148:0/3311901519 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c011590 con 0x7f964c154400 2023-10-24T01:44:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f96427fc700 1 -- 172.21.15.148:0/3311901519 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c0116f0 con 0x7f964c154400 2023-10-24T01:44:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c0ab3e0 con 0x7f964c154400 2023-10-24T01:44:48.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f96427fc700 1 -- 172.21.15.148:0/3311901519 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c011a70 con 0x7f964c154400 2023-10-24T01:44:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.810+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c0ab9a0 con 0x7f964c154400 2023-10-24T01:44:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.812+0000 7f96427fc700 1 -- 172.21.15.148:0/3311901519 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f963c012420 con 0x7f964c154400 2023-10-24T01:44:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.812+0000 7f96427fc700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 0x7f9630061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.812+0000 7f96427fc700 1 -- 172.21.15.148:0/3311901519 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f963c079d50 con 0x7f964c154400 2023-10-24T01:44:48.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.812+0000 7f965238e700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 0x7f9630061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.813+0000 7f965238e700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 0x7f9630061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9648000c00 tx=0x7f9648007d20).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.814+0000 7f9665f8ab80 1 Processor -- start 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.814+0000 7f9665f8ab80 1 -- start start 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143b729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143b72e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143aee1b0 con 0x561143b76b20 2023-10-24T01:44:48.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143ab3cb0 con 0x561143ba0190 2023-10-24T01:44:48.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561143ac8c90 con 0x561143b79980 2023-10-24T01:44:48.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48150/0 (socket says 172.21.15.148:48150) 2023-10-24T01:44:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 -- 172.21.15.148:0/3860932870 learned_addr learned my addr 172.21.15.148:0/3860932870 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143b729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9652b8f700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143b72e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 -- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 msgr2=0x561143b72e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143b72e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 -- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 msgr2=0x561143b729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143b729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 -- 172.21.15.148:0/3860932870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561143ac1e70 con 0x561143b76b20 2023-10-24T01:44:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143b729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:48.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f965238e700 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f9648003e20 tx=0x7f964800a000).ready entity=mon.0 client_cookie=7ac81bd9e41a6134 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f962f7fe700 1 -- 172.21.15.148:0/3860932870 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964801c070 con 0x561143b76b20 2023-10-24T01:44:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f962f7fe700 1 -- 172.21.15.148:0/3860932870 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96480034d0 con 0x561143b76b20 2023-10-24T01:44:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f962f7fe700 1 -- 172.21.15.148:0/3860932870 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800fe70 con 0x561143b76b20 2023-10-24T01:44:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3860932870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 msgr2=0x561143b76f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f9648003e20 tx=0x7f964800a000).stop 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3860932870 shutdown_connections 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143b72e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143b76f00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3860932870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143b729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3860932870 >> 172.21.15.148:0/3860932870 conn(0x561143933e40 msgr2=0x561143bc0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3860932870 shutdown_connections 2023-10-24T01:44:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.816+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3860932870 wait complete. 2023-10-24T01:44:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.817+0000 7f9665f8ab80 1 -- start start 2023-10-24T01:44:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.817+0000 7f9665f8ab80 1 Processor -- start 2023-10-24T01:44:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bcc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143ba0190 0x561143bbf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143ac8dd0 con 0x561143b79980 2023-10-24T01:44:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143ac9050 con 0x561143b76b20 2023-10-24T01:44:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561143a948d0 con 0x561143ba0190 2023-10-24T01:44:48.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9665f8ab80 10 client.0 ll_register_callbacks cb 0x561143b37030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T01:44:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48158/0 (socket says 172.21.15.148:48158) 2023-10-24T01:44:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 -- 172.21.15.148:0/1880475214 learned_addr learned my addr 172.21.15.148:0/1880475214 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9652b8f700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143ba0190 0x561143bbf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f965238e700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bcc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 -- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143ba0190 msgr2=0x561143bbf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143ba0190 0x561143bbf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 -- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 msgr2=0x561143bcc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bcc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 -- 172.21.15.148:0/1880475214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c0c01c0 con 0x561143b79980 2023-10-24T01:44:48.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f965238e700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bcc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:48.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f9651b8d700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f963c0780d0 tx=0x7f963c00bf90).ready entity=mon.0 client_cookie=66601c97c66b7b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.818+0000 7f962cff9700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T01:44:48.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c04ce70 con 0x561143b79980 2023-10-24T01:44:48.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f963c04b1e0 con 0x561143b79980 2023-10-24T01:44:48.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561143b6b4e0 con 0x561143b79980 2023-10-24T01:44:48.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f963c04b3a0 con 0x561143b79980 2023-10-24T01:44:48.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 10 client.8823 fetch_fsmap learned FSMap version 56 2023-10-24T01:44:48.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x561143abd480 con 0x561143b79980 2023-10-24T01:44:48.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561143b6b4e0 con 0x561143b79980 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f963c04a8c0 con 0x561143b79980 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 10 client.8823 fetch_fsmap finished waiting for FSMap version 56 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 10 client.8823 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 20 client.8823 populate_metadata read hostname 'smithi148' 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bc2010 0x561143bc23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 4 client.8823 mds_command: new command op to 8682 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T01:44:48.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 --> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561143b414b0 con 0x561143bc2010 2023-10-24T01:44:48.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.819+0000 7f965238e700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bc2010 0x561143bc23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f962cff9700 10 client.8823 ms_handle_connect on v2:172.21.15.150:6834/236803372 2023-10-24T01:44:48.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f965238e700 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bc2010 0x561143bc23f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7dbd88afd5bd5c19 server_cookie=c6f70985ed4baf50 in_seq=0 out_seq=0 2023-10-24T01:44:48.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f962cff9700 1 -- 172.21.15.148:0/1880475214 <== mds.0 v2:172.21.15.150:6834/236803372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561143b414b0 con 0x561143bc2010 2023-10-24T01:44:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f962cff9700 10 client.8823 handle_command_reply: tid=0 2023-10-24T01:44:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 client.8823 shutdown 2023-10-24T01:44:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 msgr2=0x561143bc3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f963c0780d0 tx=0x7f963c00bf90).stop 2023-10-24T01:44:48.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 shutdown_connections 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143ba0190 0x561143bbf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bcc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bc2010 0x561143bc23f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/1880475214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b79980 0x561143bc3ee0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f962cff9700 0 client.8823 ms_handle_reset on v2:172.21.15.150:6834/236803372 2023-10-24T01:44:48.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.820+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 >> 172.21.15.148:0/1880475214 conn(0x561143933e40 msgr2=0x561143bbd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.821+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 shutdown_connections 2023-10-24T01:44:48.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.821+0000 7f9665f8ab80 1 -- 172.21.15.148:0/1880475214 wait complete. 2023-10-24T01:44:48.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.821+0000 7f9665f8ab80 20 client.8823 trim_cache size 0 max 16384 2023-10-24T01:44:48.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.837+0000 7f9665f8ab80 1 Processor -- start 2023-10-24T01:44:48.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.837+0000 7f9665f8ab80 1 -- start start 2023-10-24T01:44:48.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bc23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143bc0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143ba0bc0 con 0x561143ba0190 2023-10-24T01:44:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143bc2af0 con 0x561143b76b20 2023-10-24T01:44:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561143bc28e0 con 0x561143b79980 2023-10-24T01:44:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48170/0 (socket says 172.21.15.148:48170) 2023-10-24T01:44:48.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 -- 172.21.15.148:0/855108319 learned_addr learned my addr 172.21.15.148:0/855108319 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9651b8d700 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143bc0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f965238e700 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bc23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 -- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 msgr2=0x561143bc0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143bc0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 -- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 msgr2=0x561143bc23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bc23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 -- 172.21.15.148:0/855108319 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561143abd1d0 con 0x561143ba0190 2023-10-24T01:44:48.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f9652b8f700 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f9644003380 tx=0x7f9644009840).ready entity=mon.0 client_cookie=3bea73454ac2a359 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f962ffff700 1 -- 172.21.15.148:0/855108319 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644013630 con 0x561143ba0190 2023-10-24T01:44:48.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f962ffff700 1 -- 172.21.15.148:0/855108319 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9644013790 con 0x561143ba0190 2023-10-24T01:44:48.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.838+0000 7f962ffff700 1 -- 172.21.15.148:0/855108319 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644013900 con 0x561143ba0190 2023-10-24T01:44:48.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- 172.21.15.148:0/855108319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 msgr2=0x561143bbd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f9644003380 tx=0x7f9644009840).stop 2023-10-24T01:44:48.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- 172.21.15.148:0/855108319 shutdown_connections 2023-10-24T01:44:48.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143ba0190 0x561143bbd4d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143b76b20 0x561143bc23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/855108319 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143bc0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- 172.21.15.148:0/855108319 >> 172.21.15.148:0/855108319 conn(0x561143933e40 msgr2=0x561143b86820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- 172.21.15.148:0/855108319 shutdown_connections 2023-10-24T01:44:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- 172.21.15.148:0/855108319 wait complete. 2023-10-24T01:44:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 -- start start 2023-10-24T01:44:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.839+0000 7f9665f8ab80 1 Processor -- start 2023-10-24T01:44:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143c1bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143ba2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143b78230 con 0x561143b76b20 2023-10-24T01:44:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561143b78510 con 0x561143ba0190 2023-10-24T01:44:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561143b787f0 con 0x561143b79980 2023-10-24T01:44:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9665f8ab80 10 client.0 ll_register_callbacks cb 0x561143b37030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T01:44:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f965238e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f965238e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48176/0 (socket says 172.21.15.148:48176) 2023-10-24T01:44:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f965238e700 1 -- 172.21.15.148:0/3388707111 learned_addr learned my addr 172.21.15.148:0/3388707111 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143c1bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.840+0000 7f9652b8f700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143ba2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 -- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 msgr2=0x561143c1bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143c1bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 -- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 msgr2=0x561143ba2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143ba2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 -- 172.21.15.148:0/3388707111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644017040 con 0x561143b76b20 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f965238e700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f9648003df0 tx=0x7f9648024040).ready entity=mon.0 client_cookie=f831fe2153826ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648034070 con 0x561143b76b20 2023-10-24T01:44:48.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f96480079f0 con 0x561143b76b20 2023-10-24T01:44:48.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96480034d0 con 0x561143b76b20 2023-10-24T01:44:48.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9648016ab0 con 0x561143b76b20 2023-10-24T01:44:48.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 10 client.8829 fetch_fsmap learned FSMap version 56 2023-10-24T01:44:48.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x561143934f80 con 0x561143b76b20 2023-10-24T01:44:48.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96480034d0 con 0x561143b76b20 2023-10-24T01:44:48.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9648016c10 con 0x561143b76b20 2023-10-24T01:44:48.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 10 client.8829 fetch_fsmap finished waiting for FSMap version 56 2023-10-24T01:44:48.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 10 client.8829 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T01:44:48.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 20 client.8829 populate_metadata read hostname 'smithi148' 2023-10-24T01:44:48.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bbea90 0x561143bbee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 4 client.8829 mds_command: new command op to 8682 tid=0[{"prefix": "status"}] 2023-10-24T01:44:48.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.841+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 --> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56114392fca0 con 0x561143bbea90 2023-10-24T01:44:48.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bbea90 0x561143bbee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f962cff9700 10 client.8829 ms_handle_connect on v2:172.21.15.150:6834/236803372 2023-10-24T01:44:48.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9651b8d700 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bbea90 0x561143bbee70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8b9f8df081c373c8 server_cookie=2a8443d7f8f3d359 in_seq=0 out_seq=0 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f962cff9700 1 -- 172.21.15.148:0/3388707111 <== mds.0 v2:172.21.15.150:6834/236803372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56114392fca0 con 0x561143bbea90 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f962cff9700 10 client.8829 handle_command_reply: tid=0 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 client.8829 shutdown 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 msgr2=0x561143bbc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f9648003df0 tx=0x7f9648024040).stop 2023-10-24T01:44:48.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 shutdown_connections 2023-10-24T01:44:48.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561143ba0190 0x561143ba2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:6834/236803372,v1:172.21.15.150:6835/236803372] conn(0x561143bbea90 0x561143bbee70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561143b76b20 0x561143bbc260 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f962cff9700 0 client.8829 ms_handle_reset on v2:172.21.15.150:6834/236803372 2023-10-24T01:44:48.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 --2- 172.21.15.148:0/3388707111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561143b79980 0x561143c1bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 >> 172.21.15.148:0/3388707111 conn(0x561143933e40 msgr2=0x561143bbd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 shutdown_connections 2023-10-24T01:44:48.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 1 -- 172.21.15.148:0/3388707111 wait complete. 2023-10-24T01:44:48.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.842+0000 7f9665f8ab80 20 client.8829 trim_cache size 0 max 16384 2023-10-24T01:44:48.872 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T01:44:48.872 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T01:44:48.872 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T01:44:48.872 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 8682, 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 4.6516084529999997, 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 56, 2023-10-24T01:44:48.873 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 166, 2023-10-24T01:44:48.874 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 166, 2023-10-24T01:44:48.874 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 15.459780353999999 2023-10-24T01:44:48.874 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T01:44:48.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 msgr2=0x7f9630061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 0x7f9630061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f9648000c00 tx=0x7f9648007d20).stop 2023-10-24T01:44:48.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 msgr2=0x7f964c0ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f963c00d890 tx=0x7f963c008040).stop 2023-10-24T01:44:48.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 shutdown_connections 2023-10-24T01:44:48.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f964c1547e0 0x7f964c0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f964c0a82c0 0x7f964c0aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f963005f270 0x7f9630061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 --2- 172.21.15.148:0/3311901519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f964c154400 0x7f964c0ac1a0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 >> 172.21.15.148:0/3311901519 conn(0x7f964c0946a0 msgr2=0x7f964c063670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 shutdown_connections 2023-10-24T01:44:48.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.843+0000 7f96545f2700 1 -- 172.21.15.148:0/3311901519 wait complete. 2023-10-24T01:44:48.878 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T01:44:48.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.978+0000 7f2d5243b700 1 Processor -- start 2023-10-24T01:44:48.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.978+0000 7f2d5243b700 1 -- start start 2023-10-24T01:44:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d5243b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d4c0ab1f0 0x7f2d4c0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d5243b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0ae6c0 con 0x7f2d4c1575e0 2023-10-24T01:44:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d5243b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0c8f40 con 0x7f2d4c1579c0 2023-10-24T01:44:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d5243b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0cae10 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d509d8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2d4c0ab1f0 0x7f2d4c0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d4bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2d4c1575e0 0x7f2d4c0ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44822/0 (socket says 172.21.15.148:44822) 2023-10-24T01:44:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.979+0000 7f2d4bfff700 1 -- 172.21.15.148:0/401538995 learned_addr learned my addr 172.21.15.148:0/401538995 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:48.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d509d8700 1 -- 172.21.15.148:0/401538995 >> v1:172.21.15.150:6789/0 conn(0x7f2d4c1579c0 legacy=0x7f2d4c0aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d509d8700 1 -- 172.21.15.148:0/401538995 >> v1:172.21.15.148:6789/0 conn(0x7f2d4c1575e0 legacy=0x7f2d4c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d509d8700 1 -- 172.21.15.148:0/401538995 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0c91e0 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d4affd700 1 -- 172.21.15.148:0/401538995 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793074741 0 0) 0x7f2d4c0ae6c0 con 0x7f2d4c1575e0 2023-10-24T01:44:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d509d8700 1 --2- 172.21.15.148:0/401538995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c0ab1f0 0x7f2d4c0ca920 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f2d44009e60 tx=0x7f2d44009780).ready entity=mon.0 client_cookie=34d1582c64a2fbd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d4affd700 1 -- 172.21.15.148:0/401538995 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400e070 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d4affd700 1 -- 172.21.15.148:0/401538995 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400bc30 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d4affd700 1 -- 172.21.15.148:0/401538995 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44012410 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 -- 172.21.15.148:0/401538995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c0ab1f0 msgr2=0x7f2d4c0ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 --2- 172.21.15.148:0/401538995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c0ab1f0 0x7f2d4c0ca920 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f2d44009e60 tx=0x7f2d44009780).stop 2023-10-24T01:44:48.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 -- 172.21.15.148:0/401538995 shutdown_connections 2023-10-24T01:44:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 --2- 172.21.15.148:0/401538995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c0ab1f0 0x7f2d4c0ca920 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 -- 172.21.15.148:0/401538995 >> 172.21.15.148:0/401538995 conn(0x7f2d4c094520 msgr2=0x7f2d4c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 -- 172.21.15.148:0/401538995 shutdown_connections 2023-10-24T01:44:48.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.980+0000 7f2d5243b700 1 -- 172.21.15.148:0/401538995 wait complete. 2023-10-24T01:44:48.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 Processor -- start 2023-10-24T01:44:48.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 -- start start 2023-10-24T01:44:48.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d4c0ab1f0 0x7f2d4c1648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4c1579c0 0x7f2d4c096bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c159f40 con 0x7f2d4c1575e0 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c095c80 con 0x7f2d4c1579c0 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.982+0000 7f2d5243b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c095f60 con 0x7f2d4c0ab1f0 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48206/0 (socket says 172.21.15.148:48206) 2023-10-24T01:44:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 -- 172.21.15.148:0/1912112862 learned_addr learned my addr 172.21.15.148:0/1912112862 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d509d8700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4c1579c0 0x7f2d4c096bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4bfff700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d4c0ab1f0 0x7f2d4c1648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 -- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d4c0ab1f0 msgr2=0x7f2d4c1648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d4c0ab1f0 0x7f2d4c1648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 -- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4c1579c0 msgr2=0x7f2d4c096bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4c1579c0 0x7f2d4c096bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 -- 172.21.15.148:0/1912112862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44009a20 con 0x7f2d4c1575e0 2023-10-24T01:44:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d4b7fe700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f2d4000c440 tx=0x7f2d40007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40007020 con 0x7f2d4c1575e0 2023-10-24T01:44:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40007180 con 0x7f2d4c1575e0 2023-10-24T01:44:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40007540 con 0x7f2d4c1575e0 2023-10-24T01:44:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c157f00 con 0x7f2d4c1575e0 2023-10-24T01:44:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.983+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c1584c0 con 0x7f2d4c1575e0 2023-10-24T01:44:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.984+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c047480 con 0x7f2d4c1575e0 2023-10-24T01:44:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.985+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2d400068b0 con 0x7f2d4c1575e0 2023-10-24T01:44:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.985+0000 7f2d33fff700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 0x7f2d38061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.985+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f2d40079c50 con 0x7f2d4c1575e0 2023-10-24T01:44:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.985+0000 7f2d4bfff700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 0x7f2d38061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.986+0000 7f2d4bfff700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 0x7f2d38061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2d3c007fd0 tx=0x7f2d3c009040).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:48.989+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2d4004ad70 con 0x7f2d4c1575e0 2023-10-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.195+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d4c083be0 con 0x7f2d4c1575e0 2023-10-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.195+0000 7f2d33fff700 1 -- 172.21.15.148:0/1912112862 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d4004e390 con 0x7f2d4c1575e0 2023-10-24T01:44:49.198 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T01:44:49.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 msgr2=0x7f2d38061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 0x7f2d38061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2d3c007fd0 tx=0x7f2d3c009040).stop 2023-10-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 msgr2=0x7f2d4c1675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f2d4000c440 tx=0x7f2d40007dd0).stop 2023-10-24T01:44:49.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 shutdown_connections 2023-10-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d4c1579c0 0x7f2d4c096bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d4c0ab1f0 0x7f2d4c1648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f2d3805f270 0x7f2d38061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 --2- 172.21.15.148:0/1912112862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d4c1575e0 0x7f2d4c1675a0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.197+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 >> 172.21.15.148:0/1912112862 conn(0x7f2d4c094520 msgr2=0x7f2d4c0b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.198+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 shutdown_connections 2023-10-24T01:44:49.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.198+0000 7f2d5243b700 1 -- 172.21.15.148:0/1912112862 wait complete. 2023-10-24T01:44:49.211 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T01:44:49.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T01:44:49.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T01:44:49.212 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T01:44:49.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T01:44:49.212 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T01:44:49.213 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T01:44:49.213 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T01:44:49.213 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T01:44:49.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.214 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T01:44:49.230 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T01:44:49.230 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T01:44:49.230 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T01:44:49.230 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.231 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T01:44:49.231 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.231 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:44:49.232 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:44:49.232 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T01:44:49.233 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:44:49.233 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:44:49.233 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T01:44:49.233 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:44:49.234 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:44:49.234 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T01:44:49.234 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:44:49.234 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T01:44:49.234 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 37839sec preferred_lft 37839sec 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T01:44:49.235 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.236 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T01:44:49.236 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.236 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T01:44:49.236 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T01:44:49.236 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T01:44:49.237 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.237 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T01:44:49.237 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T01:44:49.237 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T01:44:49.237 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:44:49.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.238 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T01:44:49.294 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T01:44:49.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.296 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T01:44:49.352 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T01:44:49.352 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T01:44:49.353 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T01:44:49.353 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T01:44:49.353 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T01:44:49.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.354 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T01:44:49.354 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T01:44:49.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T01:44:49.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T01:44:49.355 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T01:44:49.356 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T01:44:49.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.453 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T01:44:49.467 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T01:44:49.468 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T01:44:49.468 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T01:44:49.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T01:44:49.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.532 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T01:44:49.586 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T01:44:49.587 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:44:49.666 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:44:49.667 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T01:44:49.692 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:44:49.692 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T01:44:49.694 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T01:44:49.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:49.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T01:44:49.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T01:44:49.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.917+0000 7f747a29a700 1 Processor -- start 2023-10-24T01:44:49.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.917+0000 7f747a29a700 1 -- start start 2023-10-24T01:44:49.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f747a29a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7474154400 0x7f74740c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f747a29a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f747a29a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74740c01c0 con 0x7f74741547e0 2023-10-24T01:44:49.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f747a29a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740aa960 con 0x7f7474154400 2023-10-24T01:44:49.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f747a29a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740c66f0 con 0x7f74740c0b30 2023-10-24T01:44:49.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7474154400 0x7f74740c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f74737fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f74741547e0 0x7f74740a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44830/0 (socket says 172.21.15.148:44830) 2023-10-24T01:44:49.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f74737fe700 1 -- 172.21.15.148:0/3799770029 learned_addr learned my addr 172.21.15.148:0/3799770029 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:49.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7474154400 0x7f74740c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48210/0 (socket says 172.21.15.148:48210) 2023-10-24T01:44:49.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7478837700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 -- 172.21.15.148:0/3799770029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 msgr2=0x7f74740c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:49.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 -- 172.21.15.148:0/3799770029 >> v1:172.21.15.148:6789/0 conn(0x7f74741547e0 legacy=0x7f74740a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7472ffd700 1 -- 172.21.15.148:0/3799770029 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752692890 0 0) 0x7f74740c01c0 con 0x7f74741547e0 2023-10-24T01:44:49.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 -- 172.21.15.148:0/3799770029 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740c6150 con 0x7f7474154400 2023-10-24T01:44:49.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7473fff700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7474154400 0x7f74740c8310 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f7464009760 tx=0x7f7464009060).ready entity=mon.0 client_cookie=c5bfea045e3d0c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:49.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.918+0000 7f7472ffd700 1 -- 172.21.15.148:0/3799770029 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640090d0 con 0x7f7474154400 2023-10-24T01:44:49.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f7472ffd700 1 -- 172.21.15.148:0/3799770029 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400f510 con 0x7f7474154400 2023-10-24T01:44:49.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f7472ffd700 1 -- 172.21.15.148:0/3799770029 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400f890 con 0x7f7474154400 2023-10-24T01:44:49.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 -- 172.21.15.148:0/3799770029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7474154400 msgr2=0x7f74740c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7474154400 0x7f74740c8310 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f7464009760 tx=0x7f7464009060).stop 2023-10-24T01:44:49.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 -- 172.21.15.148:0/3799770029 shutdown_connections 2023-10-24T01:44:49.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 --2- 172.21.15.148:0/3799770029 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7474154400 0x7f74740c8310 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 -- 172.21.15.148:0/3799770029 >> 172.21.15.148:0/3799770029 conn(0x7f74740946a0 msgr2=0x7f747406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:49.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 -- 172.21.15.148:0/3799770029 shutdown_connections 2023-10-24T01:44:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.919+0000 7f747a29a700 1 -- 172.21.15.148:0/3799770029 wait complete. 2023-10-24T01:44:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.920+0000 7f747a29a700 1 Processor -- start 2023-10-24T01:44:49.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.920+0000 7f747a29a700 1 -- start start 2023-10-24T01:44:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7474154400 0x7f74741526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740af250 con 0x7f74741547e0 2023-10-24T01:44:49.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474152bb0 con 0x7f7474154400 2023-10-24T01:44:49.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f747a29a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740ae640 con 0x7f74740c0b30 2023-10-24T01:44:49.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48220/0 (socket says 172.21.15.148:48220) 2023-10-24T01:44:49.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 -- 172.21.15.148:0/1493566114 learned_addr learned my addr 172.21.15.148:0/1493566114 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:49.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7473fff700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f74737fe700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7474154400 0x7f74741526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 -- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 msgr2=0x7f74740adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 -- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7474154400 msgr2=0x7f74741526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7474154400 0x7f74741526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:49.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.921+0000 7f7478837700 1 -- 172.21.15.148:0/1493566114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640092a0 con 0x7f74741547e0 2023-10-24T01:44:49.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f7478837700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f746c009e90 tx=0x7f746c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:49.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00cc20 con 0x7f74741547e0 2023-10-24T01:44:49.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00f040 con 0x7f74741547e0 2023-10-24T01:44:49.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74740ae920 con 0x7f74741547e0 2023-10-24T01:44:49.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c013400 con 0x7f74741547e0 2023-10-24T01:44:49.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.922+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740aeee0 con 0x7f74741547e0 2023-10-24T01:44:49.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.923+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474165490 con 0x7f74741547e0 2023-10-24T01:44:49.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.923+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f746c0137b0 con 0x7f74741547e0 2023-10-24T01:44:49.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.924+0000 7f746bfff700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 0x7f7454061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:49.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.924+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f746c07aca0 con 0x7f74741547e0 2023-10-24T01:44:49.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.924+0000 7f7473fff700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 0x7f7454061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:49.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.924+0000 7f7473fff700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 0x7f7454061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7464009fd0 tx=0x7f7464017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:49.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:49.928+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7474165490 con 0x7f74741547e0 2023-10-24T01:44:50.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.116+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f74740af390 con 0x7f745405f270 2023-10-24T01:44:50.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.118+0000 7f746bfff700 1 -- 172.21.15.148:0/1493566114 <== mgr.6995 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f74740af390 con 0x7f745405f270 2023-10-24T01:44:50.119 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T01:44:50.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:44:50.119 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T01:44:50.120 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:44:50.120 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T01:44:50.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 msgr2=0x7f7454061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 0x7f7454061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7464009fd0 tx=0x7f7464017000).stop 2023-10-24T01:44:50.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 msgr2=0x7f7474155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f746c009e90 tx=0x7f746c00b040).stop 2023-10-24T01:44:50.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 shutdown_connections 2023-10-24T01:44:50.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f745405f270 0x7f7454061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74741547e0 0x7f7474155740 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74740c0b30 0x7f74740adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 --2- 172.21.15.148:0/1493566114 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7474154400 0x7f74741526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 >> 172.21.15.148:0/1493566114 conn(0x7f74740946a0 msgr2=0x7f74740aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:50.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 shutdown_connections 2023-10-24T01:44:50.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.119+0000 7f747a29a700 1 -- 172.21.15.148:0/1493566114 wait complete. 2023-10-24T01:44:50.133 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T01:44:50.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.248+0000 7fa320cdd700 1 Processor -- start 2023-10-24T01:44:50.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.248+0000 7fa320cdd700 1 -- start start 2023-10-24T01:44:50.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa320cdd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa31c157780 0x7fa31c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa320cdd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 0x7fa31c0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa320cdd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c0c6770 con 0x7fa31c0c0960 2023-10-24T01:44:50.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa320cdd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c0aa780 con 0x7fa31c157780 2023-10-24T01:44:50.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa320cdd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c1120 con 0x7fa31c0a9e60 2023-10-24T01:44:50.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa31b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa31c157780 0x7fa31c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa31affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa31c0c0960 0x7fa31c0a7c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44832/0 (socket says 172.21.15.148:44832) 2023-10-24T01:44:50.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa31affd700 1 -- 172.21.15.148:0/4197566186 learned_addr learned my addr 172.21.15.148:0/4197566186 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:50.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa31b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa31c157780 0x7fa31c0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48226/0 (socket says 172.21.15.148:48226) 2023-10-24T01:44:50.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.249+0000 7fa31bfff700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 0x7fa31c0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31b7fe700 1 -- 172.21.15.148:0/4197566186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 msgr2=0x7fa31c0aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:50.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31b7fe700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 0x7fa31c0aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31b7fe700 1 -- 172.21.15.148:0/4197566186 >> v1:172.21.15.148:6789/0 conn(0x7fa31c0c0960 legacy=0x7fa31c0a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31a7fc700 1 -- 172.21.15.148:0/4197566186 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936302390 0 0) 0x7fa31c0c6770 con 0x7fa31c0c0960 2023-10-24T01:44:50.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31b7fe700 1 -- 172.21.15.148:0/4197566186 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0c1400 con 0x7fa31c157780 2023-10-24T01:44:50.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31bfff700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 0x7fa31c0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:50.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31b7fe700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c8530 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fa30c009eb0 tx=0x7fa30c009780).ready entity=mon.0 client_cookie=60be042b3310e0e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:50.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31a7fc700 1 -- 172.21.15.148:0/4197566186 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00e070 con 0x7fa31c157780 2023-10-24T01:44:50.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31a7fc700 1 -- 172.21.15.148:0/4197566186 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00bc30 con 0x7fa31c157780 2023-10-24T01:44:50.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa31a7fc700 1 -- 172.21.15.148:0/4197566186 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c012410 con 0x7fa31c157780 2023-10-24T01:44:50.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa320cdd700 1 -- 172.21.15.148:0/4197566186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 msgr2=0x7fa31c0c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa320cdd700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c8530 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fa30c009eb0 tx=0x7fa30c009780).stop 2023-10-24T01:44:50.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa320cdd700 1 -- 172.21.15.148:0/4197566186 shutdown_connections 2023-10-24T01:44:50.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa320cdd700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0a9e60 0x7fa31c0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.250+0000 7fa320cdd700 1 --2- 172.21.15.148:0/4197566186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c8530 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.251+0000 7fa320cdd700 1 -- 172.21.15.148:0/4197566186 >> 172.21.15.148:0/4197566186 conn(0x7fa31c094570 msgr2=0x7fa31c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:50.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.251+0000 7fa320cdd700 1 -- 172.21.15.148:0/4197566186 shutdown_connections 2023-10-24T01:44:50.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.251+0000 7fa320cdd700 1 -- 172.21.15.148:0/4197566186 wait complete. 2023-10-24T01:44:50.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.252+0000 7fa320cdd700 1 Processor -- start 2023-10-24T01:44:50.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.252+0000 7fa320cdd700 1 -- start start 2023-10-24T01:44:50.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa31c0a9e60 0x7fa31c0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0c0960 0x7fa31c0ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c151550 con 0x7fa31c157780 2023-10-24T01:44:50.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0acc80 con 0x7fa31c0a9e60 2023-10-24T01:44:50.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0ac070 con 0x7fa31c0c0960 2023-10-24T01:44:50.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48242/0 (socket says 172.21.15.148:48242) 2023-10-24T01:44:50.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 -- 172.21.15.148:0/2449614865 learned_addr learned my addr 172.21.15.148:0/2449614865 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:50.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31affd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0c0960 0x7fa31c0ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31b7fe700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa31c0a9e60 0x7fa31c0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 -- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0c0960 msgr2=0x7fa31c0ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0c0960 0x7fa31c0ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 -- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa31c0a9e60 msgr2=0x7fa31c0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa31c0a9e60 0x7fa31c0c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 -- 172.21.15.148:0/2449614865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009a20 con 0x7fa31c157780 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa31bfff700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fa31400d860 tx=0x7fa314008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:50.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140125f0 con 0x7fa31c157780 2023-10-24T01:44:50.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314012750 con 0x7fa31c157780 2023-10-24T01:44:50.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c0ac350 con 0x7fa31c157780 2023-10-24T01:44:50.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314012af0 con 0x7fa31c157780 2023-10-24T01:44:50.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.253+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c0ac910 con 0x7fa31c157780 2023-10-24T01:44:50.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.254+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c0aa5c0 con 0x7fa31c157780 2023-10-24T01:44:50.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.255+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 67) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa314013480 con 0x7fa31c157780 2023-10-24T01:44:50.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.255+0000 7fa3037fe700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 0x7fa308061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:50.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.255+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa31407a160 con 0x7fa31c157780 2023-10-24T01:44:50.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.255+0000 7fa31b7fe700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 0x7fa308061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:50.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.256+0000 7fa31b7fe700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 0x7fa308061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa30c00b9f0 tx=0x7fa30c017000).ready entity=mgr.6995 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:50.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.259+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa31404b220 con 0x7fa31c157780 2023-10-24T01:44:50.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:50.465+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa31c0acdf0 con 0x7fa31c157780 2023-10-24T01:44:51.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.218+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fa314077d80 con 0x7fa31c157780 2023-10-24T01:44:51.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.219+0000 7fa3037fe700 1 -- 172.21.15.148:0/2449614865 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v68) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa314072640 con 0x7fa31c157780 2023-10-24T01:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 msgr2=0x7fa308061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 0x7fa308061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa30c00b9f0 tx=0x7fa30c017000).stop 2023-10-24T01:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 msgr2=0x7fa31c0c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fa31400d860 tx=0x7fa314008040).stop 2023-10-24T01:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 shutdown_connections 2023-10-24T01:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa30805f270 0x7fa308061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa31c157780 0x7fa31c0c4390 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa31c0a9e60 0x7fa31c0c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 --2- 172.21.15.148:0/2449614865 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa31c0c0960 0x7fa31c0ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 >> 172.21.15.148:0/2449614865 conn(0x7fa31c094570 msgr2=0x7fa31c0c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 shutdown_connections 2023-10-24T01:44:51.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.222+0000 7fa320cdd700 1 -- 172.21.15.148:0/2449614865 wait complete. 2023-10-24T01:44:51.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T01:44:51.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.355+0000 7f7860a57700 1 Processor -- start 2023-10-24T01:44:51.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.355+0000 7f7860a57700 1 -- start start 2023-10-24T01:44:51.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7860a57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7860a57700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 0x7f785c13a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7860a57700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0c54e0 con 0x7f785c0679b0 2023-10-24T01:44:51.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7860a57700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c067e10 con 0x7f785c13a4d0 2023-10-24T01:44:51.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7860a57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c066bf0 con 0x7f785c0c3c50 2023-10-24T01:44:51.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f785c0679b0 0x7f785c0c4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44846/0 (socket says 172.21.15.148:44846) 2023-10-24T01:44:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785a59c700 1 -- 172.21.15.148:0/2899607395 learned_addr learned my addr 172.21.15.148:0/2899607395 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 --2- 172.21.15.148:0/2899607395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785b59e700 1 --2- 172.21.15.148:0/2899607395 >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 0x7f785c13a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7859d9b700 1 -- 172.21.15.148:0/2899607395 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90092566 0 0) 0x7f7850001110 con 0x7f785c0679b0 2023-10-24T01:44:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f7859d9b700 1 -- 172.21.15.148:0/2899607395 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78440033f0 con 0x7f785c0679b0 2023-10-24T01:44:51.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 -- 172.21.15.148:0/2899607395 >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 msgr2=0x7f785c13a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:51.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 --2- 172.21.15.148:0/2899607395 >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 0x7f785c13a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 -- 172.21.15.148:0/2899607395 >> v1:172.21.15.148:6789/0 conn(0x7f785c0679b0 legacy=0x7f785c0c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 -- 172.21.15.148:0/2899607395 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c066ed0 con 0x7f785c0c3c50 2023-10-24T01:44:51.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785b59e700 1 --2- 172.21.15.148:0/2899607395 >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 0x7f785c13a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:51.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.356+0000 7f785ad9d700 1 --2- 172.21.15.148:0/2899607395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c0c4030 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f784c009760 tx=0x7f784c009060).ready entity=mon.2 client_cookie=e50b6fcf0f88fbea server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:51.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7859d9b700 1 -- 172.21.15.148:0/2899607395 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0090d0 con 0x7f785c0c3c50 2023-10-24T01:44:51.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7859d9b700 1 -- 172.21.15.148:0/2899607395 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00d4a0 con 0x7f785c0c3c50 2023-10-24T01:44:51.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7859d9b700 1 -- 172.21.15.148:0/2899607395 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00d820 con 0x7f785c0c3c50 2023-10-24T01:44:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 -- 172.21.15.148:0/2899607395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 msgr2=0x7f785c0c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 --2- 172.21.15.148:0/2899607395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c0c4030 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f784c009760 tx=0x7f784c009060).stop 2023-10-24T01:44:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 -- 172.21.15.148:0/2899607395 shutdown_connections 2023-10-24T01:44:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 --2- 172.21.15.148:0/2899607395 >> v2:172.21.15.150:3300/0 conn(0x7f785c13a4d0 0x7f785c13a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 --2- 172.21.15.148:0/2899607395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c0c4030 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 -- 172.21.15.148:0/2899607395 >> 172.21.15.148:0/2899607395 conn(0x7f785c0c86e0 msgr2=0x7f785c0c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 -- 172.21.15.148:0/2899607395 shutdown_connections 2023-10-24T01:44:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.357+0000 7f7860a57700 1 -- 172.21.15.148:0/2899607395 wait complete. 2023-10-24T01:44:51.365 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:51.356+0000 7ff77e7c8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:51.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.358+0000 7f7860a57700 1 Processor -- start 2023-10-24T01:44:51.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 -- start start 2023-10-24T01:44:51.366 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f179aa99680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:51.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c13a4d0 0x7f785c164b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0bfd40 con 0x7f785c0679b0 2023-10-24T01:44:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0bf720 con 0x7f785c13a4d0 2023-10-24T01:44:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f7860a57700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c1651a0 con 0x7f785c0c3c50 2023-10-24T01:44:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f785ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f785ad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48268/0 (socket says 172.21.15.148:48268) 2023-10-24T01:44:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f785ad9d700 1 -- 172.21.15.148:0/3064169985 learned_addr learned my addr 172.21.15.148:0/3064169985 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f785a59c700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.359+0000 7f785b59e700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c13a4d0 0x7f785c164b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 -- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 msgr2=0x7f785c164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 -- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c13a4d0 msgr2=0x7f785c164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c13a4d0 0x7f785c164b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 -- 172.21.15.148:0/3064169985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009a20 con 0x7f785c0679b0 2023-10-24T01:44:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f785ad9d700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f784c009d50 tx=0x7f784c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c006990 con 0x7f785c0679b0 2023-10-24T01:44:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c012950 con 0x7f785c0679b0 2023-10-24T01:44:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c0092a0 con 0x7f785c0679b0 2023-10-24T01:44:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c012cd0 con 0x7f785c0679b0 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.360+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c0bf9d0 con 0x7f785c0679b0 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.361+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c047480 con 0x7f785c0679b0 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.362+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f784c01c630 con 0x7f785c0679b0 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.362+0000 7f7842ffd700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 0x7f7848061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.362+0000 7f785a59c700 1 -- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 msgr2=0x7f7848061750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.362+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f784c07b7c0 con 0x7f785c0679b0 2023-10-24T01:44:51.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.362+0000 7f785a59c700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 0x7f7848061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:51.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.366+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f784c04c8e0 con 0x7f785c0679b0 2023-10-24T01:44:51.422 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:51.420+0000 7ff77e7c8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:51.427 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:51.426+0000 7f179aa99680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:51.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.538+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f785c0671b0 con 0x7f785c0679b0 2023-10-24T01:44:51.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.542+0000 7f7842ffd700 1 -- 172.21.15.148:0/3064169985 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f784c04ff00 con 0x7f785c0679b0 2023-10-24T01:44:51.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 msgr2=0x7f7848061750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:51.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 0x7f7848061750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:51.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 msgr2=0x7f785c1502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f784c009d50 tx=0x7f784c016000).stop 2023-10-24T01:44:51.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 shutdown_connections 2023-10-24T01:44:51.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c13a4d0 0x7f785c164b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f784805f290 0x7f7848061750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:51.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0679b0 0x7f785c1502b0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 --2- 172.21.15.148:0/3064169985 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0c3c50 0x7f785c164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 >> 172.21.15.148:0/3064169985 conn(0x7f785c0c86e0 msgr2=0x7f785c139810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:51.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 shutdown_connections 2023-10-24T01:44:51.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.544+0000 7f7860a57700 1 -- 172.21.15.148:0/3064169985 wait complete. 2023-10-24T01:44:51.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:51.558 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T01:44:51.579 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-10-24T01:44:51.698 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:51.696+0000 7ff77e7c8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:51.714 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:51.714+0000 7f179aa99680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:51.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.739+0000 7f3f35da9700 1 Processor -- start 2023-10-24T01:44:51.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.739+0000 7f3f35da9700 1 -- start start 2023-10-24T01:44:51.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f300c5f50 0x7f3f300a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f30064c10 0x7f3f30065050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300be780 0x7f3f300bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f30065540 con 0x7f3f30064c10 2023-10-24T01:44:51.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300c7a20 con 0x7f3f300c5f50 2023-10-24T01:44:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f35da9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300bf0e0 con 0x7f3f300be780 2023-10-24T01:44:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f26ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f30064c10 0x7f3f30065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f26ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f3f30064c10 0x7f3f30065050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48278/0 (socket says 172.21.15.148:48278) 2023-10-24T01:44:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.740+0000 7f3f26ffd700 1 -- 172.21.15.148:0/2780065610 learned_addr learned my addr 172.21.15.148:0/2780065610 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:51.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300be780 0x7f3f300bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/2780065610 >> v2:172.21.15.150:3300/0 conn(0x7f3f300c5f50 0x7f3f300a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 -- 172.21.15.148:0/2780065610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300be780 msgr2=0x7f3f300bebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300be780 0x7f3f300bebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 -- 172.21.15.148:0/2780065610 >> v2:172.21.15.150:3300/0 conn(0x7f3f300c5f50 msgr2=0x7f3f300a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/2780065610 >> v2:172.21.15.150:3300/0 conn(0x7f3f300c5f50 0x7f3f300a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 -- 172.21.15.148:0/2780065610 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300c6330 con 0x7f3f30064c10 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f30065050 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f3f30061650 tx=0x7f3f180090f0).ready entity=mon.0 client_cookie=7c71f4bf493085c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f2effd700 1 -- 172.21.15.148:0/2780065610 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800f510 con 0x7f3f30064c10 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f2effd700 1 -- 172.21.15.148:0/2780065610 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1800f670 con 0x7f3f30064c10 2023-10-24T01:44:51.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.741+0000 7f3f2effd700 1 -- 172.21.15.148:0/2780065610 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800f9f0 con 0x7f3f30064c10 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 -- 172.21.15.148:0/2780065610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 msgr2=0x7f3f30065050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f30065050 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f3f30061650 tx=0x7f3f180090f0).stop 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 -- 172.21.15.148:0/2780065610 shutdown_connections 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300be780 0x7f3f300bebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 --2- 172.21.15.148:0/2780065610 >> v2:172.21.15.150:3300/0 conn(0x7f3f300c5f50 0x7f3f300a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 --2- 172.21.15.148:0/2780065610 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f30065050 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 -- 172.21.15.148:0/2780065610 >> 172.21.15.148:0/2780065610 conn(0x7f3f30082f60 msgr2=0x7f3f30092410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 -- 172.21.15.148:0/2780065610 shutdown_connections 2023-10-24T01:44:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.742+0000 7f3f35da9700 1 -- 172.21.15.148:0/2780065610 wait complete. 2023-10-24T01:44:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.743+0000 7f3f35da9700 1 Processor -- start 2023-10-24T01:44:51.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.743+0000 7f3f35da9700 1 -- start start 2023-10-24T01:44:51.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300be780 0x7f3f301640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c5f50 0x7f3f300a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30168c90 con 0x7f3f30064c10 2023-10-24T01:44:51.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300ab6f0 con 0x7f3f300be780 2023-10-24T01:44:51.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f35da9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300aaae0 con 0x7f3f300c5f50 2023-10-24T01:44:51.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48294/0 (socket says 172.21.15.148:48294) 2023-10-24T01:44:51.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 -- 172.21.15.148:0/8240840 learned_addr learned my addr 172.21.15.148:0/8240840 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:51.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300be780 0x7f3f301640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2ffff700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c5f50 0x7f3f300a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:51.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c5f50 msgr2=0x7f3f300a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c5f50 0x7f3f300a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300be780 msgr2=0x7f3f301640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300be780 0x7f3f301640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009370 con 0x7f3f30064c10 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.744+0000 7f3f2f7fe700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f3f2000e900 tx=0x7f3f20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.745+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20012600 con 0x7f3f30064c10 2023-10-24T01:44:51.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.745+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f20012760 con 0x7f3f30064c10 2023-10-24T01:44:51.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.745+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f300aadc0 con 0x7f3f30064c10 2023-10-24T01:44:51.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.745+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20012ae0 con 0x7f3f30064c10 2023-10-24T01:44:51.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.745+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300ab380 con 0x7f3f30064c10 2023-10-24T01:44:51.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 68) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f3f2001b400 con 0x7f3f30064c10 2023-10-24T01:44:51.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3006c6b0 con 0x7f3f30064c10 2023-10-24T01:44:51.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f27fff700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:51.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f3f2007a6b0 con 0x7f3f30064c10 2023-10-24T01:44:51.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f26ffd700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:51.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.746+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:51.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.751+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3f2004b770 con 0x7f3f30064c10 2023-10-24T01:44:51.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.947+0000 7f3f26ffd700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:51.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.947+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:51.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:51.965+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f300bf420 con 0x7f3f1005f2c0 2023-10-24T01:44:52.314 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:52.312+0000 7ff77e7c8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:52.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:52.350+0000 7f3f26ffd700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:52.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:52.350+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T01:44:52.353 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:52.352+0000 7f179aa99680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:52.386 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:52.385+0000 7ff77e7c8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:52.425 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:52.424+0000 7f179aa99680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:52.572 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:52.571+0000 7ff77e7c8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:44:52.612 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:52.611+0000 7f179aa99680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:44:52.993 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:52.991+0000 7ff77e7c8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:44:53.034 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.033+0000 7f179aa99680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:44:53.097 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.096+0000 7ff77e7c8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:53.137 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.136+0000 7f179aa99680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:53.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:53.151+0000 7f3f26ffd700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:53.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:53.151+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T01:44:53.251 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.249+0000 7ff77e7c8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:53.290 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.289+0000 7f179aa99680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:53.326 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.324+0000 7ff77e7c8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:44:53.363 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.363+0000 7f179aa99680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:44:53.393 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.391+0000 7ff77e7c8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:44:53.431 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.430+0000 7f179aa99680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:44:53.650 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.649+0000 7ff77e7c8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:44:53.689 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.688+0000 7f179aa99680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:44:53.835 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:53.833+0000 7ff77e7c8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:53.874 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:53.873+0000 7f179aa99680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:44:54.484 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.483+0000 7ff77e7c8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:44:54.522 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.521+0000 7f179aa99680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:44:54.553 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.552+0000 7ff77e7c8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:44:54.590 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.590+0000 7f179aa99680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:44:54.629 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.627+0000 7ff77e7c8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:44:54.667 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.666+0000 7f179aa99680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:44:54.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:54.753+0000 7f3f26ffd700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:54.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:54.753+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T01:44:54.777 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.775+0000 7ff77e7c8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:44:54.815 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.814+0000 7f179aa99680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:44:54.847 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.845+0000 7ff77e7c8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:44:54.886 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.885+0000 7f179aa99680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:44:54.961 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:54.960+0000 7ff77e7c8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:44:55.000 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:54.999+0000 7f179aa99680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:44:55.069 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.068+0000 7ff77e7c8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:55.108 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:55.107+0000 7f179aa99680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:44:55.362 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.361+0000 7ff77e7c8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:44:55.399 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:55.399+0000 7f179aa99680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:44:55.434 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.432+0000 7ff77e7c8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:44:55.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:55.456+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 69) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f3f200782d0 con 0x7f3f30064c10 2023-10-24T01:44:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:55.456+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:55.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:55.457+0000 7f3f27fff700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:55.475 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:55.474+0000 7f179aa99680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:44:55.521 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f5754700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.521 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f5754700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f5754700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f5754700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f5754700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f274e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.522 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f274e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.523 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f274e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.523 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f274e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:55.523 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:55.519+0000 7ff6f274e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:44:56.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.457+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f3f20078650 con 0x7f3f30064c10 2023-10-24T01:44:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.458+0000 7f3f27fff700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.458+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f300bf420 con 0x7f3f1005f2c0 2023-10-24T01:44:56.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.460+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.462+0000 7f3f26ffd700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3f18009130 tx=0x7f3f18017000).ready entity=mgr.7256 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.477+0000 7f3f27fff700 1 -- 172.21.15.148:0/8240840 <== mgr.7256 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3f300bf420 con 0x7f3f1005f2c0 2023-10-24T01:44:56.478 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T01:44:56.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 msgr2=0x7f3f10061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3f18009130 tx=0x7f3f18017000).stop 2023-10-24T01:44:56.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 msgr2=0x7f3f301687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f3f2000e900 tx=0x7f3f20009060).stop 2023-10-24T01:44:56.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 shutdown_connections 2023-10-24T01:44:56.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f300c5f50 0x7f3f300a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f3f1005f2c0 0x7f3f10061700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f30064c10 0x7f3f301687a0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 --2- 172.21.15.148:0/8240840 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f300be780 0x7f3f301640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 >> 172.21.15.148:0/8240840 conn(0x7f3f30082f60 msgr2=0x7f3f300665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:56.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 shutdown_connections 2023-10-24T01:44:56.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.479+0000 7f3f35da9700 1 -- 172.21.15.148:0/8240840 wait complete. 2023-10-24T01:44:56.494 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T01:44:56.494 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-24T01:44:56.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.613+0000 7f02159d9700 1 Processor -- start 2023-10-24T01:44:56.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.613+0000 7f02159d9700 1 -- start start 2023-10-24T01:44:56.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02159d9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 0x7f0210155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02159d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f0210153b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02159d9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100c7770 con 0x7f02100aa320 2023-10-24T01:44:56.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02159d9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100c8670 con 0x7f02100a9f40 2023-10-24T01:44:56.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02159d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c1070 con 0x7f02100c81e0 2023-10-24T01:44:56.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02151d8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f0210153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02149d7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 0x7f0210155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f020ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f02100aa320 0x7f02100c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:46408/0 (socket says 172.21.15.148:46408) 2023-10-24T01:44:56.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f020ffff700 1 -- 172.21.15.148:0/979531317 learned_addr learned my addr 172.21.15.148:0/979531317 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:56.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02151d8700 1 -- 172.21.15.148:0/979531317 >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 msgr2=0x7f0210155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02151d8700 1 --2- 172.21.15.148:0/979531317 >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 0x7f0210155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02151d8700 1 -- 172.21.15.148:0/979531317 >> v1:172.21.15.150:6789/0 conn(0x7f02100aa320 legacy=0x7f02100c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f020f7fe700 1 -- 172.21.15.148:0/979531317 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102828377 0 0) 0x7f02100c7770 con 0x7f02100aa320 2023-10-24T01:44:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02151d8700 1 -- 172.21.15.148:0/979531317 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100c79e0 con 0x7f02100c81e0 2023-10-24T01:44:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.614+0000 7f02149d7700 1 --2- 172.21.15.148:0/979531317 >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 0x7f0210155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:56.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02151d8700 1 --2- 172.21.15.148:0/979531317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f0210153b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f01f8009760 tx=0x7f01f8009060).ready entity=mon.2 client_cookie=16d4853159972de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f020f7fe700 1 -- 172.21.15.148:0/979531317 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800f510 con 0x7f02100c81e0 2023-10-24T01:44:56.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f020f7fe700 1 -- 172.21.15.148:0/979531317 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800f670 con 0x7f02100c81e0 2023-10-24T01:44:56.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f020f7fe700 1 -- 172.21.15.148:0/979531317 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800f9f0 con 0x7f02100c81e0 2023-10-24T01:44:56.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 -- 172.21.15.148:0/979531317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 msgr2=0x7f0210153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 --2- 172.21.15.148:0/979531317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f0210153b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f01f8009760 tx=0x7f01f8009060).stop 2023-10-24T01:44:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 -- 172.21.15.148:0/979531317 shutdown_connections 2023-10-24T01:44:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 --2- 172.21.15.148:0/979531317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f0210153b60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 --2- 172.21.15.148:0/979531317 >> v2:172.21.15.150:3300/0 conn(0x7f02100a9f40 0x7f0210155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 -- 172.21.15.148:0/979531317 >> 172.21.15.148:0/979531317 conn(0x7f0210094420 msgr2=0x7f021006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 -- 172.21.15.148:0/979531317 shutdown_connections 2023-10-24T01:44:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.615+0000 7f02159d9700 1 -- 172.21.15.148:0/979531317 wait complete. 2023-10-24T01:44:56.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.616+0000 7f02159d9700 1 Processor -- start 2023-10-24T01:44:56.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 -- start start 2023-10-24T01:44:56.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 0x7f02100aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f02100c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c70a0 con 0x7f02100aa320 2023-10-24T01:44:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c9dc0 con 0x7f02100a9f40 2023-10-24T01:44:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f02159d9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100ad840 con 0x7f02100c81e0 2023-10-24T01:44:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.617+0000 7f020ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38278/0 (socket says 172.21.15.148:38278) 2023-10-24T01:44:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 -- 172.21.15.148:0/2701647102 learned_addr learned my addr 172.21.15.148:0/2701647102 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f02149d7700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 0x7f02100aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f02151d8700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f02100c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 -- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 msgr2=0x7f02100c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f02100c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 -- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 msgr2=0x7f02100aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 0x7f02100aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 -- 172.21.15.148:0/2701647102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009250 con 0x7f02100aa320 2023-10-24T01:44:56.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f02149d7700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 0x7f02100aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020ffff700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f020000c960 tx=0x7f0200001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200005d30 con 0x7f02100aa320 2023-10-24T01:44:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200005e90 con 0x7f02100aa320 2023-10-24T01:44:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200007320 con 0x7f02100aa320 2023-10-24T01:44:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f80092a0 con 0x7f02100aa320 2023-10-24T01:44:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.618+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02100c97f0 con 0x7f02100aa320 2023-10-24T01:44:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.619+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0210047480 con 0x7f02100aa320 2023-10-24T01:44:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.620+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0200007750 con 0x7f02100aa320 2023-10-24T01:44:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.620+0000 7f020cff9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 0x7f01f0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.620+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f020007a240 con 0x7f02100aa320 2023-10-24T01:44:56.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.620+0000 7f02149d7700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 0x7f01f0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.620+0000 7f02149d7700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 0x7f01f0061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0208006fd0 tx=0x7f0208006f40).ready entity=mgr.7256 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.625+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f020004b5b0 con 0x7f02100aa320 2023-10-24T01:44:56.813 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.812+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f02100840c0 con 0x7f01f005f080 2023-10-24T01:44:56.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.816+0000 7f020cff9700 1 -- 172.21.15.148:0/2701647102 <== mgr.7256 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f02100840c0 con 0x7f01f005f080 2023-10-24T01:44:56.817 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path snap_test_dir1 2023-10-24T01:44:56.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 msgr2=0x7f01f0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 0x7f01f0061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0208006fd0 tx=0x7f0208006f40).stop 2023-10-24T01:44:56.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 msgr2=0x7f02100c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f020000c960 tx=0x7f0200001630).stop 2023-10-24T01:44:56.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 shutdown_connections 2023-10-24T01:44:56.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f02100c81e0 0x7f02100c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02100a9f40 0x7f02100aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f01f005f080 0x7f01f0061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 --2- 172.21.15.148:0/2701647102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02100aa320 0x7f02100c66c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 >> 172.21.15.148:0/2701647102 conn(0x7f0210094420 msgr2=0x7f02101500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 shutdown_connections 2023-10-24T01:44:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.818+0000 7f02159d9700 1 -- 172.21.15.148:0/2701647102 wait complete. 2023-10-24T01:44:56.831 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-24T01:44:56.831 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-24T01:44:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.948+0000 7f80a4598700 1 Processor -- start 2023-10-24T01:44:56.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.948+0000 7f80a4598700 1 -- start start 2023-10-24T01:44:56.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a4598700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f809c0a7d00 0x7f809c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a4598700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c0aa420 0x7f809c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a4598700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c0c6270 con 0x7f809c1544b0 2023-10-24T01:44:56.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a4598700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0c60e0 con 0x7f809c0a7d00 2023-10-24T01:44:56.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a4598700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0aa870 con 0x7f809c0aa420 2023-10-24T01:44:56.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a2334700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f809c1544b0 0x7f809c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51446/0 (socket says 172.21.15.148:51446) 2023-10-24T01:44:56.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a2334700 1 -- 172.21.15.148:0/3863377949 learned_addr learned my addr 172.21.15.148:0/3863377949 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:56.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a1b33700 1 --2- 172.21.15.148:0/3863377949 >> v2:172.21.15.150:3300/0 conn(0x7f809c0a7d00 0x7f809c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.949+0000 7f80a2b35700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c0aa420 0x7f809c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1332700 1 -- 172.21.15.148:0/3863377949 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228064281 0 0) 0x7f809c0c6270 con 0x7f809c1544b0 2023-10-24T01:44:56.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1332700 1 -- 172.21.15.148:0/3863377949 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80880033f0 con 0x7f809c1544b0 2023-10-24T01:44:56.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1b33700 1 -- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c0aa420 msgr2=0x7f809c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:56.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1b33700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c0aa420 0x7f809c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1b33700 1 -- 172.21.15.148:0/3863377949 >> v1:172.21.15.148:6789/0 conn(0x7f809c1544b0 legacy=0x7f809c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1b33700 1 -- 172.21.15.148:0/3863377949 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0c0c80 con 0x7f809c0a7d00 2023-10-24T01:44:56.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1b33700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c0a9f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f808c009760 tx=0x7f808c009060).ready entity=mon.1 client_cookie=61e6bc2b5efe1218 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1332700 1 -- 172.21.15.148:0/3863377949 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00d4a0 con 0x7f809c0a7d00 2023-10-24T01:44:56.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1332700 1 -- 172.21.15.148:0/3863377949 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00d600 con 0x7f809c0a7d00 2023-10-24T01:44:56.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a1332700 1 -- 172.21.15.148:0/3863377949 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00d980 con 0x7f809c0a7d00 2023-10-24T01:44:56.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a4598700 1 -- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 msgr2=0x7f809c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.950+0000 7f80a4598700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c0a9f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f808c009760 tx=0x7f808c009060).stop 2023-10-24T01:44:56.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 -- 172.21.15.148:0/3863377949 shutdown_connections 2023-10-24T01:44:56.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c0aa420 0x7f809c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 --2- 172.21.15.148:0/3863377949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c0a9f30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 -- 172.21.15.148:0/3863377949 >> 172.21.15.148:0/3863377949 conn(0x7f809c0945d0 msgr2=0x7f809c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:56.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 -- 172.21.15.148:0/3863377949 shutdown_connections 2023-10-24T01:44:56.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.951+0000 7f80a4598700 1 -- 172.21.15.148:0/3863377949 wait complete. 2023-10-24T01:44:56.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 Processor -- start 2023-10-24T01:44:56.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 -- start start 2023-10-24T01:44:56.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f809c0aa420 0x7f809c0adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c1544b0 0x7f809c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c155810 con 0x7f809c0aa420 2023-10-24T01:44:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c154c00 con 0x7f809c0a7d00 2023-10-24T01:44:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.952+0000 7f80a4598700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c154ee0 con 0x7f809c1544b0 2023-10-24T01:44:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f809c0aa420 0x7f809c0adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f809c0aa420 0x7f809c0adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38288/0 (socket says 172.21.15.148:38288) 2023-10-24T01:44:56.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 -- 172.21.15.148:0/867843246 learned_addr learned my addr 172.21.15.148:0/867843246 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:56.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a2334700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a2b35700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c1544b0 0x7f809c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 -- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c1544b0 msgr2=0x7f809c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c1544b0 0x7f809c0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 -- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 msgr2=0x7f809c1536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c0a7d00 0x7f809c1536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 -- 172.21.15.148:0/867843246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0092a0 con 0x7f809c0aa420 2023-10-24T01:44:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a1b33700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f809c0aa420 0x7f809c0adf60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f808c009d50 tx=0x7f808c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c000bc0 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00d770 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a4598700 1 -- 172.21.15.148:0/867843246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c1551c0 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c000d20 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.953+0000 7f80a4598700 1 -- 172.21.15.148:0/867843246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c153bd0 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.954+0000 7f80a4598700 1 -- 172.21.15.148:0/867843246 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c155980 con 0x7f809c0aa420 2023-10-24T01:44:56.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.954+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f808c01d910 con 0x7f809c0aa420 2023-10-24T01:44:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.955+0000 7f80927fc700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f808005f080 0x7f8080061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.955+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f808c07b970 con 0x7f809c0aa420 2023-10-24T01:44:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.955+0000 7f80a2334700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f808005f080 0x7f8080061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.955+0000 7f80a2334700 1 --2- 172.21.15.148:0/867843246 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f808005f080 0x7f8080061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8098005750 tx=0x7f8098009040).ready entity=mgr.7256 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:56.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:56.959+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f808c04cd90 con 0x7f809c0aa420 2023-10-24T01:44:57.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.147+0000 7f80a4598700 1 -- 172.21.15.148:0/867843246 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f809c06c6b0 con 0x7f808005f080 2023-10-24T01:44:57.149 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:57.148+0000 7ff6fcf63700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-24T01:44:57.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.149+0000 7f80927fc700 1 -- 172.21.15.148:0/867843246 <== mgr.7256 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f809c06c6b0 con 0x7f808005f080 2023-10-24T01:44:57.151 INFO:teuthology.orchestra.run.smithi148.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-24T01:44:57.154 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-24T01:44:57.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:57.155 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T01:44:57.173 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T01:44:57.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.327+0000 7f17f3d4d700 1 Processor -- start 2023-10-24T01:44:57.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.327+0000 7f17f3d4d700 1 -- start start 2023-10-24T01:44:57.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f3d4d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17ec098bd0 0x7f17ec154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f3d4d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 0x7f17ec0c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f3d4d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0c71d0 con 0x7f17ec154430 2023-10-24T01:44:57.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f3d4d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0c6a10 con 0x7f17ec098bd0 2023-10-24T01:44:57.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f3d4d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0c9410 con 0x7f17ec0bffd0 2023-10-24T01:44:57.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f12e8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17ec098bd0 0x7f17ec154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f12e8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f17ec098bd0 0x7f17ec154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38304/0 (socket says 172.21.15.148:38304) 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f12e8700 1 -- 172.21.15.148:0/1943138722 learned_addr learned my addr 172.21.15.148:0/1943138722 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f22ea700 1 --2- 172.21.15.148:0/1943138722 >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 0x7f17ec0c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f12e8700 1 -- 172.21.15.148:0/1943138722 >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 msgr2=0x7f17ec0c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.328+0000 7f17f12e8700 1 --2- 172.21.15.148:0/1943138722 >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 0x7f17ec0c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f12e8700 1 -- 172.21.15.148:0/1943138722 >> v1:172.21.15.150:6789/0 conn(0x7f17ec154430 legacy=0x7f17ec0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:57.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f12e8700 1 -- 172.21.15.148:0/1943138722 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0c0950 con 0x7f17ec098bd0 2023-10-24T01:44:57.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f22ea700 1 --2- 172.21.15.148:0/1943138722 >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 0x7f17ec0c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:57.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f12e8700 1 --2- 172.21.15.148:0/1943138722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec098bd0 0x7f17ec154810 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f17ec0aab20 tx=0x7f17dc0090f0).ready entity=mon.0 client_cookie=c5f362e9c3fb6f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:57.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f0ae7700 1 -- 172.21.15.148:0/1943138722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00b600 con 0x7f17ec098bd0 2023-10-24T01:44:57.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f0ae7700 1 -- 172.21.15.148:0/1943138722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00b760 con 0x7f17ec098bd0 2023-10-24T01:44:57.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f0ae7700 1 -- 172.21.15.148:0/1943138722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00bae0 con 0x7f17ec098bd0 2023-10-24T01:44:57.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 -- 172.21.15.148:0/1943138722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec098bd0 msgr2=0x7f17ec154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:57.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/1943138722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec098bd0 0x7f17ec154810 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f17ec0aab20 tx=0x7f17dc0090f0).stop 2023-10-24T01:44:57.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 -- 172.21.15.148:0/1943138722 shutdown_connections 2023-10-24T01:44:57.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/1943138722 >> v2:172.21.15.150:3300/0 conn(0x7f17ec0bffd0 0x7f17ec0c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:57.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/1943138722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec098bd0 0x7f17ec154810 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:57.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 -- 172.21.15.148:0/1943138722 >> 172.21.15.148:0/1943138722 conn(0x7f17ec0cb070 msgr2=0x7f17ec0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:57.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 -- 172.21.15.148:0/1943138722 shutdown_connections 2023-10-24T01:44:57.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.329+0000 7f17f3d4d700 1 -- 172.21.15.148:0/1943138722 wait complete. 2023-10-24T01:44:57.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.330+0000 7f17f3d4d700 1 Processor -- start 2023-10-24T01:44:57.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 -- start start 2023-10-24T01:44:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec098bd0 0x7f17ec13c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 0x7f17ec0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec151e00 con 0x7f17ec0bffd0 2023-10-24T01:44:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec1520e0 con 0x7f17ec154430 2023-10-24T01:44:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f3d4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec1523c0 con 0x7f17ec098bd0 2023-10-24T01:44:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f12e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f12e8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38318/0 (socket says 172.21.15.148:38318) 2023-10-24T01:44:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.331+0000 7f17f12e8700 1 -- 172.21.15.148:0/3902445619 learned_addr learned my addr 172.21.15.148:0/3902445619 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f22ea700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 0x7f17ec0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f1ae9700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec098bd0 0x7f17ec13c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 -- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec098bd0 msgr2=0x7f17ec13c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec098bd0 0x7f17ec13c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 -- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 msgr2=0x7f17ec0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 0x7f17ec0b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 -- 172.21.15.148:0/3902445619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc009370 con 0x7f17ec0bffd0 2023-10-24T01:44:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f22ea700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 0x7f17ec0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f12e8700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f17dc009fd0 tx=0x7f17dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00b8d0 con 0x7f17ec0bffd0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00ba30 con 0x7f17ec0bffd0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec0c2eb0 con 0x7f17ec0bffd0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc01b660 con 0x7f17ec0bffd0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.332+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec0b07e0 con 0x7f17ec0bffd0 2023-10-24T01:44:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.333+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec06c6b0 con 0x7f17ec0bffd0 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.333+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 70) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f17dc01ba10 con 0x7f17ec0bffd0 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.334+0000 7f17e1ffb700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 0x7f17d0061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.334+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f17dc07bb10 con 0x7f17ec0bffd0 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.334+0000 7f17f1ae9700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 0x7f17d0061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.334+0000 7f17f1ae9700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 0x7f17d0061570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f17e80036b0 tx=0x7f17e8009040).ready entity=mgr.7256 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.338+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f17dc04ce80 con 0x7f17ec0bffd0 2023-10-24T01:44:57.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:57.547+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f17ec0612f0 con 0x7f17ec0bffd0 2023-10-24T01:44:58.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.463+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f17dc079980 con 0x7f17ec0bffd0 2023-10-24T01:44:58.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.464+0000 7f17e1ffb700 1 -- 172.21.15.148:0/3902445619 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v71) v1 ==== 93+0+0 (secure 0 0 0) 0x7f17dc042df0 con 0x7f17ec0bffd0 2023-10-24T01:44:58.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 msgr2=0x7f17d0061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 0x7f17d0061570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f17e80036b0 tx=0x7f17e8009040).stop 2023-10-24T01:44:58.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 msgr2=0x7f17ec0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f17dc009fd0 tx=0x7f17dc017000).stop 2023-10-24T01:44:58.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 shutdown_connections 2023-10-24T01:44:58.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec154430 0x7f17ec0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec098bd0 0x7f17ec13c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f17d005f0b0 0x7f17d0061570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 --2- 172.21.15.148:0/3902445619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f17ec0bffd0 0x7f17ec0afe00 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 >> 172.21.15.148:0/3902445619 conn(0x7f17ec0cb070 msgr2=0x7f17ec0a80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:58.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 shutdown_connections 2023-10-24T01:44:58.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.467+0000 7f17f3d4d700 1 -- 172.21.15.148:0/3902445619 wait complete. 2023-10-24T01:44:58.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T01:44:58.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:58.524 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:44:58.561 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T01:44:58.562 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T01:44:58.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:44:58.562 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T01:44:58.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T01:44:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:44:58.603 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T01:44:58.610 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:58.609+0000 7f9a8152b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:58.614 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:58.613+0000 7f08d9de7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:44:58.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:44:58.677 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:58.676+0000 7f9a8152b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:58.679 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:58.677+0000 7f08d9de7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:44:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.782+0000 7f756e4b9700 1 Processor -- start 2023-10-24T01:44:58.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.782+0000 7f756e4b9700 1 -- start start 2023-10-24T01:44:58.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756e4b9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7568151d90 0x7f75680a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756e4b9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f75680a7260 0x7f75680c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756e4b9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7568155550 con 0x7f75680c8470 2023-10-24T01:44:58.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756e4b9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7568154960 con 0x7f75680a7260 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756e4b9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7568154c20 con 0x7f7568151d90 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f75677fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f75680a7260 0x7f75680c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756ca56700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f75680c8470 0x7f7568069410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51456/0 (socket says 172.21.15.148:51456) 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f756ca56700 1 -- 172.21.15.148:0/752317491 learned_addr learned my addr 172.21.15.148:0/752317491 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.783+0000 7f7567fff700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7568151d90 0x7f75680a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:58.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f75677fe700 1 -- 172.21.15.148:0/752317491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7568151d90 msgr2=0x7f75680a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f75677fe700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7568151d90 0x7f75680a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f75677fe700 1 -- 172.21.15.148:0/752317491 >> v1:172.21.15.148:6789/0 conn(0x7f75680c8470 legacy=0x7f7568069410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f7566ffd700 1 -- 172.21.15.148:0/752317491 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472259904 0 0) 0x7f7568155550 con 0x7f75680c8470 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f75677fe700 1 -- 172.21.15.148:0/752317491 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568154f00 con 0x7f75680a7260 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f75677fe700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75680a7260 0x7f75680c57e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f7558009760 tx=0x7f7558009060).ready entity=mon.0 client_cookie=e4790ce4fc9aa5b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:58.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f7566ffd700 1 -- 172.21.15.148:0/752317491 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800f510 con 0x7f75680a7260 2023-10-24T01:44:58.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f7566ffd700 1 -- 172.21.15.148:0/752317491 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800f670 con 0x7f75680a7260 2023-10-24T01:44:58.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f7566ffd700 1 -- 172.21.15.148:0/752317491 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800f9f0 con 0x7f75680a7260 2023-10-24T01:44:58.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 -- 172.21.15.148:0/752317491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75680a7260 msgr2=0x7f75680c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75680a7260 0x7f75680c57e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f7558009760 tx=0x7f7558009060).stop 2023-10-24T01:44:58.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 -- 172.21.15.148:0/752317491 shutdown_connections 2023-10-24T01:44:58.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7568151d90 0x7f75680a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 --2- 172.21.15.148:0/752317491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75680a7260 0x7f75680c57e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.784+0000 7f756e4b9700 1 -- 172.21.15.148:0/752317491 >> 172.21.15.148:0/752317491 conn(0x7f75680641b0 msgr2=0x7f75680c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:58.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.785+0000 7f756e4b9700 1 -- 172.21.15.148:0/752317491 shutdown_connections 2023-10-24T01:44:58.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.785+0000 7f756e4b9700 1 -- 172.21.15.148:0/752317491 wait complete. 2023-10-24T01:44:58.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.786+0000 7f756e4b9700 1 Processor -- start 2023-10-24T01:44:58.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.786+0000 7f756e4b9700 1 -- start start 2023-10-24T01:44:58.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75680a7260 0x7f75681574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 0x7f7568145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75681433f0 con 0x7f7568151d90 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75681570a0 con 0x7f75680a7260 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756814b590 con 0x7f75680c8470 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:58.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f7567fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75680a7260 0x7f75681574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:58.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f75677fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 0x7f7568145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:58.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38356/0 (socket says 172.21.15.148:38356) 2023-10-24T01:44:58.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 -- 172.21.15.148:0/1339945604 learned_addr learned my addr 172.21.15.148:0/1339945604 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:58.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 msgr2=0x7f7568145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 0x7f7568145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75680a7260 msgr2=0x7f75681574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75680a7260 0x7f75681574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 -- 172.21.15.148:0/1339945604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580092a0 con 0x7f7568151d90 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f75677fe700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 0x7f7568145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756ca56700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f756000c810 tx=0x7f7560007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:58.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560005d30 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560005e90 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7568156700 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560007360 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.787+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7568156cc0 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.788+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75681571e0 con 0x7f7568151d90 2023-10-24T01:44:58.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.789+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f75600076d0 con 0x7f7568151d90 2023-10-24T01:44:58.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.789+0000 7f754ffff700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 0x7f75540617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:58.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.789+0000 7f7567fff700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 msgr2=0x7f75540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:58.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.789+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f756007a560 con 0x7f7568151d90 2023-10-24T01:44:58.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.789+0000 7f7567fff700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 0x7f75540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:58.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.793+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f75681571e0 con 0x7f7568151d90 2023-10-24T01:44:58.955 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:58.953+0000 7f08d9de7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:58.966 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:58.966+0000 7f9a8152b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:44:58.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.990+0000 7f7567fff700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 msgr2=0x7f75540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:58.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:58.990+0000 7f7567fff700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 0x7f75540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:59.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.004+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75681571e0 con 0x7f7568151d90 2023-10-24T01:44:59.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.005+0000 7f754ffff700 1 -- 172.21.15.148:0/1339945604 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f75681571e0 con 0x7f7568151d90 2023-10-24T01:44:59.006 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:59.006 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:44:59.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 msgr2=0x7f75540617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:59.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 0x7f75540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 msgr2=0x7f7568167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f756000c810 tx=0x7f7560007f30).stop 2023-10-24T01:44:59.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 shutdown_connections 2023-10-24T01:44:59.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f755405f300 0x7f75540617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7568151d90 0x7f7568167f50 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75680a7260 0x7f75681574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 --2- 172.21.15.148:0/1339945604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75680c8470 0x7f7568145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 >> 172.21.15.148:0/1339945604 conn(0x7f75680641b0 msgr2=0x7f7568066720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 shutdown_connections 2023-10-24T01:44:59.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.007+0000 7f756e4b9700 1 -- 172.21.15.148:0/1339945604 wait complete. 2023-10-24T01:44:59.011 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:44:59.021 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:44:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.176+0000 7fd5a8a24700 1 Processor -- start 2023-10-24T01:44:59.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.176+0000 7fd5a8a24700 1 -- start start 2023-10-24T01:44:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.177+0000 7fd5a8a24700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5a4062d60 0x7fd5a40be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.177+0000 7fd5a8a24700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5a4069d50 0x7fd5a40655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.177+0000 7fd5a8a24700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a406a270 con 0x7fd5a41541c0 2023-10-24T01:44:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.177+0000 7fd5a8a24700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40bcf40 con 0x7fd5a4069d50 2023-10-24T01:44:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.177+0000 7fd5a8a24700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40beb20 con 0x7fd5a4062d60 2023-10-24T01:44:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5a4069d50 0x7fd5a40655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd5a4069d50 0x7fd5a40655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38364/0 (socket says 172.21.15.148:38364) 2023-10-24T01:44:59.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 -- 172.21.15.148:0/543450618 learned_addr learned my addr 172.21.15.148:0/543450618 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a1d9b700 1 --2- 172.21.15.148:0/543450618 >> v2:172.21.15.150:3300/0 conn(0x7fd5a4062d60 0x7fd5a40be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 -- 172.21.15.148:0/543450618 >> v2:172.21.15.150:3300/0 conn(0x7fd5a4062d60 msgr2=0x7fd5a40be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 --2- 172.21.15.148:0/543450618 >> v2:172.21.15.150:3300/0 conn(0x7fd5a4062d60 0x7fd5a40be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 -- 172.21.15.148:0/543450618 >> v1:172.21.15.150:6789/0 conn(0x7fd5a41541c0 legacy=0x7fd5a4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 -- 172.21.15.148:0/543450618 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40bcbf0 con 0x7fd5a4069d50 2023-10-24T01:44:59.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a2d9d700 1 --2- 172.21.15.148:0/543450618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40655a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fd5a406c240 tx=0x7fd59c009840).ready entity=mon.0 client_cookie=724a5135110b55cc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a159a700 1 -- 172.21.15.148:0/543450618 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00e070 con 0x7fd5a4069d50 2023-10-24T01:44:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a159a700 1 -- 172.21.15.148:0/543450618 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00ba20 con 0x7fd5a4069d50 2023-10-24T01:44:59.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.178+0000 7fd5a159a700 1 -- 172.21.15.148:0/543450618 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00bda0 con 0x7fd5a4069d50 2023-10-24T01:44:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 -- 172.21.15.148:0/543450618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 msgr2=0x7fd5a40655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/543450618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40655a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fd5a406c240 tx=0x7fd59c009840).stop 2023-10-24T01:44:59.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 -- 172.21.15.148:0/543450618 shutdown_connections 2023-10-24T01:44:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/543450618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40655a0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/543450618 >> v2:172.21.15.150:3300/0 conn(0x7fd5a4062d60 0x7fd5a40be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 -- 172.21.15.148:0/543450618 >> 172.21.15.148:0/543450618 conn(0x7fd5a4064230 msgr2=0x7fd5a40c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 -- 172.21.15.148:0/543450618 shutdown_connections 2023-10-24T01:44:59.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.179+0000 7fd5a8a24700 1 -- 172.21.15.148:0/543450618 wait complete. 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.181+0000 7fd5a8a24700 1 Processor -- start 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.181+0000 7fd5a8a24700 1 -- start start 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 0x7fd5a4141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a41541c0 0x7fd5a40a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4161df0 con 0x7fd5a4069d50 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40aa280 con 0x7fd5a41541c0 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a8a24700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4165350 con 0x7fd5a4062d60 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a1d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a1d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38378/0 (socket says 172.21.15.148:38378) 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a1d9b700 1 -- 172.21.15.148:0/3864975107 learned_addr learned my addr 172.21.15.148:0/3864975107 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:59.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a2d9d700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a41541c0 0x7fd5a40a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.182+0000 7fd5a259c700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 0x7fd5a4141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 -- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 msgr2=0x7fd5a4141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 0x7fd5a4141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 -- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a41541c0 msgr2=0x7fd5a40a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a41541c0 0x7fd5a40a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 -- 172.21.15.148:0/3864975107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009ae0 con 0x7fd5a4069d50 2023-10-24T01:44:59.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a259c700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 0x7fd5a4141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:44:59.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a1d9b700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fd59400e900 tx=0x7fd594009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400c670 con 0x7fd5a4069d50 2023-10-24T01:44:59.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400c7d0 con 0x7fd5a4069d50 2023-10-24T01:44:59.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400cb50 con 0x7fd5a4069d50 2023-10-24T01:44:59.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4165ed0 con 0x7fd5a4069d50 2023-10-24T01:44:59.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.183+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a4165880 con 0x7fd5a4069d50 2023-10-24T01:44:59.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.184+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a406c6b0 con 0x7fd5a4069d50 2023-10-24T01:44:59.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.184+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd59401b400 con 0x7fd5a4069d50 2023-10-24T01:44:59.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.185+0000 7fd5927fc700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 0x7fd5840617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.185+0000 7fd5a259c700 1 -- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 msgr2=0x7fd5840617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:59.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.185+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fd59407aac0 con 0x7fd5a4069d50 2023-10-24T01:44:59.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.185+0000 7fd5a259c700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 0x7fd5840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:59.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.189+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd59404ba00 con 0x7fd5a4069d50 2023-10-24T01:44:59.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.361+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5a4061360 con 0x7fd5a4069d50 2023-10-24T01:44:59.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.362+0000 7fd5927fc700 1 -- 172.21.15.148:0/3864975107 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+17435 (secure 0 0 0) 0x7fd594016020 con 0x7fd5a4069d50 2023-10-24T01:44:59.363 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:44:59.363 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":167,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:55.448246+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1258397133":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6833/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6832/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2977455524":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2590381384":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/1460017444":"2023-10-25T01:44:55.448202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:44:59.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 msgr2=0x7fd5840617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:59.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 0x7fd5840617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 msgr2=0x7fd5a40a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fd59400e900 tx=0x7fd594009060).stop 2023-10-24T01:44:59.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 shutdown_connections 2023-10-24T01:44:59.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a41541c0 0x7fd5a40a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a4062d60 0x7fd5a4141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fd58405f300 0x7fd5840617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 --2- 172.21.15.148:0/3864975107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5a4069d50 0x7fd5a40a98a0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 >> 172.21.15.148:0/3864975107 conn(0x7fd5a4064230 msgr2=0x7fd5a40c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 shutdown_connections 2023-10-24T01:44:59.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.364+0000 7fd5a8a24700 1 -- 172.21.15.148:0/3864975107 wait complete. 2023-10-24T01:44:59.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T01:44:42.340137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T01:44:43.164534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T01:44:59.378 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T01:44:59.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.499+0000 7f5875ed4700 1 Processor -- start 2023-10-24T01:44:59.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.499+0000 7f5875ed4700 1 -- start start 2023-10-24T01:44:59.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.499+0000 7f5875ed4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 0x7f58700be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5875ed4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5870063760 con 0x7f58700c6210 2023-10-24T01:44:59.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5875ed4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700bf2f0 con 0x7f58700c4910 2023-10-24T01:44:59.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5875ed4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5870154b50 con 0x7f58700c65f0 2023-10-24T01:44:59.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f58700c6210 0x7f58700c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51470/0 (socket says 172.21.15.148:51470) 2023-10-24T01:44:59.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586f7fe700 1 -- 172.21.15.148:0/2393563649 learned_addr learned my addr 172.21.15.148:0/2393563649 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:44:59.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5867fff700 1 --2- 172.21.15.148:0/2393563649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 0x7f58700be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750669344 0 0) 0x7f5870063760 con 0x7f58700c6210 2023-10-24T01:44:59.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f585c0033f0 con 0x7f58700c6210 2023-10-24T01:44:59.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505589397 0 0) 0x7f58700bf2f0 con 0x7f58700c4910 2023-10-24T01:44:59.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5870063760 con 0x7f58700c4910 2023-10-24T01:44:59.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840847409 0 0) 0x7f585c0033f0 con 0x7f58700c6210 2023-10-24T01:44:59.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5867fff700 1 -- 172.21.15.148:0/2393563649 >> v1:172.21.15.150:6789/0 conn(0x7f58700c4910 legacy=0x7f58700bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5867fff700 1 -- 172.21.15.148:0/2393563649 >> v1:172.21.15.148:6789/0 conn(0x7f58700c6210 legacy=0x7f58700c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5867fff700 1 -- 172.21.15.148:0/2393563649 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700bf5d0 con 0x7f58700c65f0 2023-10-24T01:44:59.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.500+0000 7f5867fff700 1 --2- 172.21.15.148:0/2393563649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 0x7f58700be570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f5858009790 tx=0x7f5858009060).ready entity=mon.2 client_cookie=6735d99463e9948a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860001470 con 0x7f58700c65f0 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858011400 con 0x7f58700c65f0 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f586effd700 1 -- 172.21.15.148:0/2393563649 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011780 con 0x7f58700c65f0 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 -- 172.21.15.148:0/2393563649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 msgr2=0x7f58700be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 --2- 172.21.15.148:0/2393563649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 0x7f58700be570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f5858009790 tx=0x7f5858009060).stop 2023-10-24T01:44:59.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 -- 172.21.15.148:0/2393563649 shutdown_connections 2023-10-24T01:44:59.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 --2- 172.21.15.148:0/2393563649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c65f0 0x7f58700be570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 -- 172.21.15.148:0/2393563649 >> 172.21.15.148:0/2393563649 conn(0x7f5870092510 msgr2=0x7f5870062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 -- 172.21.15.148:0/2393563649 shutdown_connections 2023-10-24T01:44:59.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.501+0000 7f5875ed4700 1 -- 172.21.15.148:0/2393563649 wait complete. 2023-10-24T01:44:59.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.502+0000 7f5875ed4700 1 Processor -- start 2023-10-24T01:44:59.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.502+0000 7f5875ed4700 1 -- start start 2023-10-24T01:44:59.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c4910 0x7f587014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58700c6210 0x7f58700a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587014b320 con 0x7f58700c65f0 2023-10-24T01:44:59.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700a75b0 con 0x7f58700c6210 2023-10-24T01:44:59.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5875ed4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58701680b0 con 0x7f58700c4910 2023-10-24T01:44:59.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f586ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f586ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38394/0 (socket says 172.21.15.148:38394) 2023-10-24T01:44:59.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f586ffff700 1 -- 172.21.15.148:0/1328196978 learned_addr learned my addr 172.21.15.148:0/1328196978 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:59.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f5867fff700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58700c6210 0x7f58700a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.503+0000 7f586f7fe700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c4910 0x7f587014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c4910 msgr2=0x7f587014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c4910 0x7f587014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58700c6210 msgr2=0x7f58700a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58700c6210 0x7f58700a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 -- 172.21.15.148:0/1328196978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580092a0 con 0x7f58700c65f0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f586ffff700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f586800c710 tx=0x7f586800ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800e4a0 con 0x7f58700c65f0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800e600 con 0x7f58700c65f0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870168390 con 0x7f58700c65f0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800e980 con 0x7f58700c65f0 2023-10-24T01:44:59.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.504+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5870168950 con 0x7f58700c65f0 2023-10-24T01:44:59.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.505+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587006c6b0 con 0x7f58700c65f0 2023-10-24T01:44:59.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.505+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5868012400 con 0x7f58700c65f0 2023-10-24T01:44:59.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.506+0000 7f58677fe700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 0x7f58500617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.506+0000 7f586f7fe700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 msgr2=0x7f58500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:59.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.506+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f5868079bf0 con 0x7f58700c65f0 2023-10-24T01:44:59.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.506+0000 7f586f7fe700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 0x7f58500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:59.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.513+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5868048af0 con 0x7f58700c65f0 2023-10-24T01:44:59.573 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:59.572+0000 7f08d9de7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:59.623 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:59.622+0000 7f9a8152b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:44:59.646 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:59.645+0000 7f08d9de7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:59.697 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:59.696+0000 7f9a8152b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:44:59.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.707+0000 7f586f7fe700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 msgr2=0x7f58500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:59.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.707+0000 7f586f7fe700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 0x7f58500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:44:59.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.716+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5870065f60 con 0x7f58700c65f0 2023-10-24T01:44:59.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.716+0000 7f58677fe700 1 -- 172.21.15.148:0/1328196978 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v167) v1 ==== 110+0+10 (secure 0 0 0) 0x7f586804abe0 con 0x7f58700c65f0 2023-10-24T01:44:59.717 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T01:44:59.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 msgr2=0x7f58500617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:44:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 0x7f58500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 msgr2=0x7f5870063b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f586800c710 tx=0x7f586800ca20).stop 2023-10-24T01:44:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 shutdown_connections 2023-10-24T01:44:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f585005f300 0x7f58500617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:44:59.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58700c65f0 0x7f5870063b60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58700c4910 0x7f587014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 --2- 172.21.15.148:0/1328196978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58700c6210 0x7f58700a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 >> 172.21.15.148:0/1328196978 conn(0x7f5870092510 msgr2=0x7f58700be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 shutdown_connections 2023-10-24T01:44:59.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.719+0000 7f5875ed4700 1 -- 172.21.15.148:0/1328196978 wait complete. 2023-10-24T01:44:59.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T01:44:59.834 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:44:59.832+0000 7f08d9de7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:44:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.861+0000 7f743d971700 1 Processor -- start 2023-10-24T01:44:59.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.861+0000 7f743d971700 1 -- start start 2023-10-24T01:44:59.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f743d971700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7438098bd0 0x7f7438154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f743d971700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f743d971700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380c71d0 con 0x7f7438154430 2023-10-24T01:44:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f743d971700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380c6a10 con 0x7f7438098bd0 2023-10-24T01:44:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f743d971700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380c9410 con 0x7f74380bffd0 2023-10-24T01:44:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7438098bd0 0x7f7438154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7438098bd0 0x7f7438154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38400/0 (socket says 172.21.15.148:38400) 2023-10-24T01:44:59.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 -- 172.21.15.148:0/3233492297 learned_addr learned my addr 172.21.15.148:0/3233492297 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:59.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74377fe700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 -- 172.21.15.148:0/3233492297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 msgr2=0x7f74380c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:44:59.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 -- 172.21.15.148:0/3233492297 >> v1:172.21.15.150:6789/0 conn(0x7f7438154430 legacy=0x7f74380c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 -- 172.21.15.148:0/3233492297 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380c0950 con 0x7f7438098bd0 2023-10-24T01:44:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.862+0000 7f74367fc700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f7438154810 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f7428006fd0 tx=0x7f74280090f0).ready entity=mon.0 client_cookie=1eec0e193b73813e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f7435ffb700 1 -- 172.21.15.148:0/3233492297 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800b580 con 0x7f7438098bd0 2023-10-24T01:44:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f7435ffb700 1 -- 172.21.15.148:0/3233492297 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800b6e0 con 0x7f7438098bd0 2023-10-24T01:44:59.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f7435ffb700 1 -- 172.21.15.148:0/3233492297 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800ba60 con 0x7f7438098bd0 2023-10-24T01:44:59.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 -- 172.21.15.148:0/3233492297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 msgr2=0x7f7438154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f7438154810 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f7428006fd0 tx=0x7f74280090f0).stop 2023-10-24T01:44:59.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 -- 172.21.15.148:0/3233492297 shutdown_connections 2023-10-24T01:44:59.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 --2- 172.21.15.148:0/3233492297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f7438154810 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 -- 172.21.15.148:0/3233492297 >> 172.21.15.148:0/3233492297 conn(0x7f74380cb070 msgr2=0x7f74380cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:44:59.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 -- 172.21.15.148:0/3233492297 shutdown_connections 2023-10-24T01:44:59.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.863+0000 7f743d971700 1 -- 172.21.15.148:0/3233492297 wait complete. 2023-10-24T01:44:59.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.864+0000 7f743d971700 1 Processor -- start 2023-10-24T01:44:59.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 -- start start 2023-10-24T01:44:59.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 0x7f74380abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ac090 con 0x7f7438098bd0 2023-10-24T01:44:59.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ae9d0 con 0x7f7438154430 2023-10-24T01:44:59.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f743d971700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7438165930 con 0x7f74380bffd0 2023-10-24T01:44:59.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f7436ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f7436ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38410/0 (socket says 172.21.15.148:38410) 2023-10-24T01:44:59.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.865+0000 7f7436ffd700 1 -- 172.21.15.148:0/3581825938 learned_addr learned my addr 172.21.15.148:0/3581825938 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:44:59.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f74377fe700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 0x7f74380abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f74367fc700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:44:59.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 -- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 msgr2=0x7f74380ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 -- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 msgr2=0x7f74380abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:44:59.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 0x7f74380abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:44:59.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 -- 172.21.15.148:0/3581825938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009370 con 0x7f7438098bd0 2023-10-24T01:44:59.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f74377fe700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 0x7f74380abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:44:59.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f7436ffd700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f742c00c4c0 tx=0x7f742c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:44:59.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ce70 con 0x7f7438098bd0 2023-10-24T01:44:59.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c001e90 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c007250 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380ae0a0 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.866+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74380ae660 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.867+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743806c6b0 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.868+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f742c0066a0 con 0x7f7438098bd0 2023-10-24T01:44:59.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.868+0000 7f741effd700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 0x7f7424061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:44:59.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.868+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f742c079df0 con 0x7f7438098bd0 2023-10-24T01:44:59.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.868+0000 7f74367fc700 1 -- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 msgr2=0x7f7424061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:44:59.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.868+0000 7f74367fc700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 0x7f7424061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:44:59.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:44:59.872+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f742c04ad90 con 0x7f7438098bd0 2023-10-24T01:44:59.907 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:44:59.907+0000 7f9a8152b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:45:00.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.044+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74380ab490 con 0x7f7438098bd0 2023-10-24T01:45:00.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.045+0000 7f741effd700 1 -- 172.21.15.148:0/3581825938 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f742c04e3b0 con 0x7f7438098bd0 2023-10-24T01:45:00.046 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T01:45:00.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 msgr2=0x7f7424061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:00.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 0x7f7424061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 msgr2=0x7f74380c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f742c00c4c0 tx=0x7f742c007e00).stop 2023-10-24T01:45:00.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 shutdown_connections 2023-10-24T01:45:00.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7438154430 0x7f74380abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f742405f2d0 0x7f7424061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7438098bd0 0x7f74380c3b70 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 --2- 172.21.15.148:0/3581825938 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f74380bffd0 0x7f74380ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 >> 172.21.15.148:0/3581825938 conn(0x7f74380cb070 msgr2=0x7f74380a9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 shutdown_connections 2023-10-24T01:45:00.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.047+0000 7f743d971700 1 -- 172.21.15.148:0/3581825938 wait complete. 2023-10-24T01:45:00.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T01:45:00.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.182+0000 7fa9aade6700 1 Processor -- start 2023-10-24T01:45:00.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.182+0000 7fa9aade6700 1 -- start start 2023-10-24T01:45:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9aade6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa9a4157f80 0x7fa9a41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9aade6700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a40659b0 con 0x7fa9a40a6b10 2023-10-24T01:45:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9aade6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a4065e40 con 0x7fa9a4062650 2023-10-24T01:45:00.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9aade6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a41588d0 con 0x7fa9a4157f80 2023-10-24T01:45:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9a8b82700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa9a40a6b10 0x7fa9a40a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51486/0 (socket says 172.21.15.148:51486) 2023-10-24T01:45:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9a8b82700 1 -- 172.21.15.148:0/3458820822 learned_addr learned my addr 172.21.15.148:0/3458820822 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.183+0000 7fa9a3fff700 1 --2- 172.21.15.148:0/3458820822 >> v2:172.21.15.150:3300/0 conn(0x7fa9a4157f80 0x7fa9a41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a37fe700 1 -- 172.21.15.148:0/3458820822 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930117642 0 0) 0x7fa9a40659b0 con 0x7fa9a40a6b10 2023-10-24T01:45:00.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a37fe700 1 -- 172.21.15.148:0/3458820822 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9940033f0 con 0x7fa9a40a6b10 2023-10-24T01:45:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a3fff700 1 -- 172.21.15.148:0/3458820822 >> v1:172.21.15.150:6789/0 conn(0x7fa9a4062650 legacy=0x7fa9a4062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a3fff700 1 -- 172.21.15.148:0/3458820822 >> v1:172.21.15.148:6789/0 conn(0x7fa9a40a6b10 legacy=0x7fa9a40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a3fff700 1 -- 172.21.15.148:0/3458820822 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4064da0 con 0x7fa9a4157f80 2023-10-24T01:45:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a3fff700 1 --2- 172.21.15.148:0/3458820822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a41583e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fa990009760 tx=0x7fa990009060).ready entity=mon.1 client_cookie=9a8d991122449da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a37fe700 1 -- 172.21.15.148:0/3458820822 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000f510 con 0x7fa9a4157f80 2023-10-24T01:45:00.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a37fe700 1 -- 172.21.15.148:0/3458820822 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000f670 con 0x7fa9a4157f80 2023-10-24T01:45:00.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.184+0000 7fa9a37fe700 1 -- 172.21.15.148:0/3458820822 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000f9f0 con 0x7fa9a4157f80 2023-10-24T01:45:00.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 -- 172.21.15.148:0/3458820822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 msgr2=0x7fa9a41583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3458820822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a41583e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fa990009760 tx=0x7fa990009060).stop 2023-10-24T01:45:00.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 -- 172.21.15.148:0/3458820822 shutdown_connections 2023-10-24T01:45:00.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3458820822 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a41583e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 -- 172.21.15.148:0/3458820822 >> 172.21.15.148:0/3458820822 conn(0x7fa9a40c3f60 msgr2=0x7fa9a40c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 -- 172.21.15.148:0/3458820822 shutdown_connections 2023-10-24T01:45:00.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.185+0000 7fa9aade6700 1 -- 172.21.15.148:0/3458820822 wait complete. 2023-10-24T01:45:00.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.186+0000 7fa9aade6700 1 Processor -- start 2023-10-24T01:45:00.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.186+0000 7fa9aade6700 1 -- start start 2023-10-24T01:45:00.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9a40a6b10 0x7fa9a40632a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a4063790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4063c80 con 0x7fa9a4062650 2023-10-24T01:45:00.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40ac210 con 0x7fa9a4157f80 2023-10-24T01:45:00.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9aade6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40ab8e0 con 0x7fa9a40a6b10 2023-10-24T01:45:00.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a8b82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a4063790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a8b82700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38418/0 (socket says 172.21.15.148:38418) 2023-10-24T01:45:00.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a8b82700 1 -- 172.21.15.148:0/3339199220 learned_addr learned my addr 172.21.15.148:0/3339199220 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a3fff700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9a40a6b10 0x7fa9a40632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 -- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9a40a6b10 msgr2=0x7fa9a40632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9a40a6b10 0x7fa9a40632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 -- 172.21.15.148:0/3339199220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 msgr2=0x7fa9a4152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 -- 172.21.15.148:0/3339199220 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900092a0 con 0x7fa9a4157f80 2023-10-24T01:45:00.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a8b82700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:00.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.187+0000 7fa9a9383700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a4063790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fa99c0013d0 tx=0x7fa99c001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.188+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00e4a0 con 0x7fa9a4157f80 2023-10-24T01:45:00.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.188+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c00e600 con 0x7fa9a4157f80 2023-10-24T01:45:00.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.188+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c00e980 con 0x7fa9a4157f80 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.188+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40abbc0 con 0x7fa9a4157f80 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.188+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a4152a50 con 0x7fa9a4157f80 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.189+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4152c70 con 0x7fa9a4157f80 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.189+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa99c0123f0 con 0x7fa9a4157f80 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.190+0000 7fa9a0ff9700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 0x7fa9880617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.190+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fa99c079d70 con 0x7fa9a4157f80 2023-10-24T01:45:00.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.190+0000 7fa9a8b82700 1 -- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 msgr2=0x7fa9880617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:00.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.190+0000 7fa9a8b82700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 0x7fa9880617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:00.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.194+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa99c047af0 con 0x7fa9a4157f80 2023-10-24T01:45:00.261 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.260+0000 7f08d9de7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:45:00.356 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:00.355+0000 7f9a8152b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:45:00.364 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.363+0000 7f08d9de7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:00.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.365+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9a4065080 con 0x7fa9a4157f80 2023-10-24T01:45:00.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.366+0000 7fa9a0ff9700 1 -- 172.21.15.148:0/3339199220 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa99c04acb0 con 0x7fa9a4157f80 2023-10-24T01:45:00.367 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T01:45:00.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 msgr2=0x7fa9880617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:00.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 0x7fa9880617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 msgr2=0x7fa9a4063790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a4063790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fa99c0013d0 tx=0x7fa99c001530).stop 2023-10-24T01:45:00.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 shutdown_connections 2023-10-24T01:45:00.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9a4157f80 0x7fa9a4063790 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa98805f300 0x7fa9880617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9a4062650 0x7fa9a4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 --2- 172.21.15.148:0/3339199220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa9a40a6b10 0x7fa9a40632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 >> 172.21.15.148:0/3339199220 conn(0x7fa9a40c3f60 msgr2=0x7fa9a4149160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 shutdown_connections 2023-10-24T01:45:00.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.368+0000 7fa9aade6700 1 -- 172.21.15.148:0/3339199220 wait complete. 2023-10-24T01:45:00.381 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T01:45:00.468 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:00.468+0000 7f9a8152b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:00.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.500+0000 7f5ccb4be700 1 Processor -- start 2023-10-24T01:45:00.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.500+0000 7f5ccb4be700 1 -- start start 2023-10-24T01:45:00.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5ccb4be700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5cc40c06e0 0x7f5cc4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5ccb4be700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40c71d0 con 0x7f5cc4154430 2023-10-24T01:45:00.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5ccb4be700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40c9410 con 0x7f5cc4098bd0 2023-10-24T01:45:00.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5ccb4be700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40c6a10 con 0x7f5cc40c06e0 2023-10-24T01:45:00.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5cc925a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5cc4154430 0x7f5cc40c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51498/0 (socket says 172.21.15.148:51498) 2023-10-24T01:45:00.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.501+0000 7f5cc925a700 1 -- 172.21.15.148:0/4003427836 learned_addr learned my addr 172.21.15.148:0/4003427836 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:00.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cc9a5b700 1 --2- 172.21.15.148:0/4003427836 >> v2:172.21.15.150:3300/0 conn(0x7f5cc40c06e0 0x7f5cc4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cbbfff700 1 -- 172.21.15.148:0/4003427836 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813460688 0 0) 0x7f5cc40c71d0 con 0x7f5cc4154430 2023-10-24T01:45:00.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cbbfff700 1 -- 172.21.15.148:0/4003427836 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb00033f0 con 0x7f5cc4154430 2023-10-24T01:45:00.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cc9a5b700 1 -- 172.21.15.148:0/4003427836 >> v1:172.21.15.150:6789/0 conn(0x7f5cc4098bd0 legacy=0x7f5cc40bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cc9a5b700 1 -- 172.21.15.148:0/4003427836 >> v1:172.21.15.148:6789/0 conn(0x7f5cc4154430 legacy=0x7f5cc40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cc9a5b700 1 -- 172.21.15.148:0/4003427836 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc40ca8b0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cc9a5b700 1 --2- 172.21.15.148:0/4003427836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc40c06e0 0x7f5cc4154810 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f5cbc009e60 tx=0x7f5cbc009780).ready entity=mon.1 client_cookie=a997b093a5374049 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cbbfff700 1 -- 172.21.15.148:0/4003427836 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00e070 con 0x7f5cc40c06e0 2023-10-24T01:45:00.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cbbfff700 1 -- 172.21.15.148:0/4003427836 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00bb60 con 0x7f5cc40c06e0 2023-10-24T01:45:00.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.502+0000 7f5cbbfff700 1 -- 172.21.15.148:0/4003427836 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc012410 con 0x7f5cc40c06e0 2023-10-24T01:45:00.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 -- 172.21.15.148:0/4003427836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc40c06e0 msgr2=0x7f5cc4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/4003427836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc40c06e0 0x7f5cc4154810 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f5cbc009e60 tx=0x7f5cbc009780).stop 2023-10-24T01:45:00.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 -- 172.21.15.148:0/4003427836 shutdown_connections 2023-10-24T01:45:00.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/4003427836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc40c06e0 0x7f5cc4154810 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 -- 172.21.15.148:0/4003427836 >> 172.21.15.148:0/4003427836 conn(0x7f5cc40cb070 msgr2=0x7f5cc40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 -- 172.21.15.148:0/4003427836 shutdown_connections 2023-10-24T01:45:00.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.503+0000 7f5ccb4be700 1 -- 172.21.15.148:0/4003427836 wait complete. 2023-10-24T01:45:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.504+0000 7f5ccb4be700 1 Processor -- start 2023-10-24T01:45:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.504+0000 7f5ccb4be700 1 -- start start 2023-10-24T01:45:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc4098bd0 0x7f5cc414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cc4154430 0x7f5cc4151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4150cc0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c3aa0 con 0x7f5cc4098bd0 2023-10-24T01:45:00.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5ccb4be700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c3d80 con 0x7f5cc4154430 2023-10-24T01:45:00.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38432/0 (socket says 172.21.15.148:38432) 2023-10-24T01:45:00.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 -- 172.21.15.148:0/3899099069 learned_addr learned my addr 172.21.15.148:0/3899099069 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:00.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc925a700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc4098bd0 0x7f5cc414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc9a5b700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cc4154430 0x7f5cc4151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 -- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cc4154430 msgr2=0x7f5cc4151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cc4154430 0x7f5cc4151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 -- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc4098bd0 msgr2=0x7f5cc414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc4098bd0 0x7f5cc414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 -- 172.21.15.148:0/3899099069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc009a20 con 0x7f5cc40c06e0 2023-10-24T01:45:00.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.505+0000 7f5cc8a59700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f5cc000c440 tx=0x7f5cc0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.506+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0012400 con 0x7f5cc40c06e0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.506+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc0012560 con 0x7f5cc40c06e0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.506+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40c4060 con 0x7f5cc40c06e0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.506+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0012900 con 0x7f5cc40c06e0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.506+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc414e280 con 0x7f5cc40c06e0 2023-10-24T01:45:00.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.507+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc406c6b0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.507+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5cc001b3b0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.507+0000 7f5cb97fa700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 0x7f5ca80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.508+0000 7f5cc925a700 1 -- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 msgr2=0x7f5ca80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:00.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.508+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f5cc00798a0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.508+0000 7f5cc925a700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 0x7f5ca80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:00.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.512+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5cc0048af0 con 0x7f5cc40c06e0 2023-10-24T01:45:00.519 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.517+0000 7f08d9de7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:00.594 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.592+0000 7f08d9de7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:45:00.631 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:00.630+0000 7f9a8152b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:00.662 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.660+0000 7f08d9de7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:45:00.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.684+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cc4150e00 con 0x7f5cc40c06e0 2023-10-24T01:45:00.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.684+0000 7f5cb97fa700 1 -- 172.21.15.148:0/3899099069 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cc0017070 con 0x7f5cc40c06e0 2023-10-24T01:45:00.685 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T01:45:00.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 msgr2=0x7f5ca80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:00.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 0x7f5ca80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 msgr2=0x7f5cc40c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f5cc000c440 tx=0x7f5cc0007dc0).stop 2023-10-24T01:45:00.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 shutdown_connections 2023-10-24T01:45:00.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5cc4154430 0x7f5cc4151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cc4098bd0 0x7f5cc414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5ca805f300 0x7f5ca80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:00.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 --2- 172.21.15.148:0/3899099069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5cc40c06e0 0x7f5cc40c30e0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 >> 172.21.15.148:0/3899099069 conn(0x7f5cc40cb070 msgr2=0x7f5cc4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 shutdown_connections 2023-10-24T01:45:00.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.686+0000 7f5ccb4be700 1 -- 172.21.15.148:0/3899099069 wait complete. 2023-10-24T01:45:00.700 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:00.711 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:00.711+0000 7f9a8152b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:45:00.785 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:00.784+0000 7f9a8152b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:45:00.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.817+0000 7f0fa3c61700 1 Processor -- start 2023-10-24T01:45:00.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.817+0000 7f0fa3c61700 1 -- start start 2023-10-24T01:45:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f9c154520 0x7f0f9c0be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c064e40 0x7f0f9c0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f9c0a8260 0x7f0f9c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0a5eb0 con 0x7f0f9c154520 2023-10-24T01:45:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0a86f0 con 0x7f0f9c0a8260 2023-10-24T01:45:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa3c61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0bec30 con 0x7f0f9c064e40 2023-10-24T01:45:00.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f9c154520 0x7f0f9c0be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f9c154520 0x7f0f9c0be650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38436/0 (socket says 172.21.15.148:38436) 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 -- 172.21.15.148:0/2136412348 learned_addr learned my addr 172.21.15.148:0/2136412348 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa11fc700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c064e40 0x7f0f9c0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa21fe700 1 --2- 172.21.15.148:0/2136412348 >> v2:172.21.15.150:3300/0 conn(0x7f0f9c0a8260 0x7f0f9c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 -- 172.21.15.148:0/2136412348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c064e40 msgr2=0x7f0f9c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:00.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c064e40 0x7f0f9c0a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 -- 172.21.15.148:0/2136412348 >> v2:172.21.15.150:3300/0 conn(0x7f0f9c0a8260 msgr2=0x7f0f9c1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/2136412348 >> v2:172.21.15.150:3300/0 conn(0x7f0f9c0a8260 0x7f0f9c1580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.818+0000 7f0fa19fd700 1 -- 172.21.15.148:0/2136412348 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0bef10 con 0x7f0f9c154520 2023-10-24T01:45:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c154520 0x7f0f9c0be650 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0f9c06a530 tx=0x7f0f8c0090f0).ready entity=mon.0 client_cookie=a05aedaa61e962d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa09fb700 1 -- 172.21.15.148:0/2136412348 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00f510 con 0x7f0f9c154520 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa09fb700 1 -- 172.21.15.148:0/2136412348 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c00f670 con 0x7f0f9c154520 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa09fb700 1 -- 172.21.15.148:0/2136412348 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00fa10 con 0x7f0f9c154520 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 -- 172.21.15.148:0/2136412348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c154520 msgr2=0x7f0f9c0be650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c154520 0x7f0f9c0be650 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0f9c06a530 tx=0x7f0f8c0090f0).stop 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 -- 172.21.15.148:0/2136412348 shutdown_connections 2023-10-24T01:45:00.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c154520 0x7f0f9c0be650 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/2136412348 >> v2:172.21.15.150:3300/0 conn(0x7f0f9c0a8260 0x7f0f9c1580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/2136412348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c064e40 0x7f0f9c0a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.819+0000 7f0fa3c61700 1 -- 172.21.15.148:0/2136412348 >> 172.21.15.148:0/2136412348 conn(0x7f0f9c082f60 msgr2=0x7f0f9c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.820+0000 7f0fa3c61700 1 -- 172.21.15.148:0/2136412348 shutdown_connections 2023-10-24T01:45:00.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.820+0000 7f0fa3c61700 1 -- 172.21.15.148:0/2136412348 wait complete. 2023-10-24T01:45:00.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 Processor -- start 2023-10-24T01:45:00.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 -- start start 2023-10-24T01:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c0a8260 0x7f0f9c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c154520 0x7f0f9c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0a91d0 con 0x7f0f9c064e40 2023-10-24T01:45:00.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c9090 con 0x7f0f9c0a8260 2023-10-24T01:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa3c61700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c9370 con 0x7f0f9c154520 2023-10-24T01:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa19fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa19fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38440/0 (socket says 172.21.15.148:38440) 2023-10-24T01:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa19fd700 1 -- 172.21.15.148:0/516102399 learned_addr learned my addr 172.21.15.148:0/516102399 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:00.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.821+0000 7f0fa11fc700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c0a8260 0x7f0f9c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa21fe700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c154520 0x7f0f9c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c154520 msgr2=0x7f0f9c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c154520 0x7f0f9c0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c0a8260 msgr2=0x7f0f9c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c0a8260 0x7f0f9c0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:00.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 -- 172.21.15.148:0/516102399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c009370 con 0x7f0f9c064e40 2023-10-24T01:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa19fd700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f0f8c006fd0 tx=0x7f0f8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c006950 con 0x7f0f9c064e40 2023-10-24T01:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c000bc0 con 0x7f0f9c064e40 2023-10-24T01:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0a9420 con 0x7f0f9c064e40 2023-10-24T01:45:00.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c024470 con 0x7f0f9c064e40 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.822+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c14f9c0 con 0x7f0f9c064e40 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.823+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c0a9a70 con 0x7f0f9c064e40 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.824+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0f8c021070 con 0x7f0f9c064e40 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.824+0000 7f0f91ffb700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 0x7f0f800617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.824+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f0f8c07bcf0 con 0x7f0f9c064e40 2023-10-24T01:45:00.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.824+0000 7f0fa11fc700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 msgr2=0x7f0f800617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:00.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.824+0000 7f0fa11fc700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 0x7f0f800617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:00.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:00.832+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f8c04cc90 con 0x7f0f9c064e40 2023-10-24T01:45:00.923 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:00.921+0000 7f08d9de7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:45:01.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.025+0000 7f0fa11fc700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 msgr2=0x7f0f800617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:01.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.025+0000 7f0fa11fc700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 0x7f0f800617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:45:01.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.044+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f9c06c6b0 con 0x7f0f9c064e40 2023-10-24T01:45:01.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.045+0000 7f0f91ffb700 1 -- 172.21.15.148:0/516102399 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f0f8c029030 con 0x7f0f9c064e40 2023-10-24T01:45:01.046 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:01.049 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:45:01.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 msgr2=0x7f0f800617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:01.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 0x7f0f800617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 msgr2=0x7f0f9c0c00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f0f8c006fd0 tx=0x7f0f8c017000).stop 2023-10-24T01:45:01.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 shutdown_connections 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c154520 0x7f0f9c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0f8005f300 0x7f0f800617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f9c064e40 0x7f0f9c0c00f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 --2- 172.21.15.148:0/516102399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c0a8260 0x7f0f9c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 >> 172.21.15.148:0/516102399 conn(0x7f0f9c082f60 msgr2=0x7f0f9c067d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 shutdown_connections 2023-10-24T01:45:01.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.047+0000 7f0fa3c61700 1 -- 172.21.15.148:0/516102399 wait complete. 2023-10-24T01:45:01.053 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:45:01.060 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:01.061 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:01.061+0000 7f9a8152b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:45:01.108 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:01.106+0000 7f08d9de7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:01.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.180+0000 7faa7efe0700 1 Processor -- start 2023-10-24T01:45:01.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.180+0000 7faa7efe0700 1 -- start start 2023-10-24T01:45:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7efe0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa780699d0 0x7faa7813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7efe0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa7813a7e0 0x7faa78065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7efe0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7813ac70 con 0x7faa780695f0 2023-10-24T01:45:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7efe0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780c57b0 con 0x7faa780699d0 2023-10-24T01:45:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7efe0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780c5a90 con 0x7faa7813a7e0 2023-10-24T01:45:01.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa780699d0 0x7faa7813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faa780699d0 0x7faa7813a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38454/0 (socket says 172.21.15.148:38454) 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 -- 172.21.15.148:0/2252816028 learned_addr learned my addr 172.21.15.148:0/2252816028 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa7d57d700 1 --2- 172.21.15.148:0/2252816028 >> v2:172.21.15.150:3300/0 conn(0x7faa7813a7e0 0x7faa78065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 -- 172.21.15.148:0/2252816028 >> v2:172.21.15.150:3300/0 conn(0x7faa7813a7e0 msgr2=0x7faa78065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 --2- 172.21.15.148:0/2252816028 >> v2:172.21.15.150:3300/0 conn(0x7faa7813a7e0 0x7faa78065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 -- 172.21.15.148:0/2252816028 >> v1:172.21.15.150:6789/0 conn(0x7faa780695f0 legacy=0x7faa780aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 -- 172.21.15.148:0/2252816028 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780c5d70 con 0x7faa780699d0 2023-10-24T01:45:01.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa77fff700 1 --2- 172.21.15.148:0/2252816028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa780699d0 0x7faa7813a2f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7faa780c2430 tx=0x7faa6400b3b0).ready entity=mon.0 client_cookie=e81024c0d77ce151 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.181+0000 7faa777fe700 1 -- 172.21.15.148:0/2252816028 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6400da40 con 0x7faa780699d0 2023-10-24T01:45:01.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa777fe700 1 -- 172.21.15.148:0/2252816028 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6400dba0 con 0x7faa780699d0 2023-10-24T01:45:01.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa777fe700 1 -- 172.21.15.148:0/2252816028 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64010470 con 0x7faa780699d0 2023-10-24T01:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 -- 172.21.15.148:0/2252816028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa780699d0 msgr2=0x7faa7813a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2252816028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa780699d0 0x7faa7813a2f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7faa780c2430 tx=0x7faa6400b3b0).stop 2023-10-24T01:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 -- 172.21.15.148:0/2252816028 shutdown_connections 2023-10-24T01:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2252816028 >> v2:172.21.15.150:3300/0 conn(0x7faa7813a7e0 0x7faa78065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2252816028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa780699d0 0x7faa7813a2f0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 -- 172.21.15.148:0/2252816028 >> 172.21.15.148:0/2252816028 conn(0x7faa780641f0 msgr2=0x7faa780c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 -- 172.21.15.148:0/2252816028 shutdown_connections 2023-10-24T01:45:01.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.182+0000 7faa7efe0700 1 -- 172.21.15.148:0/2252816028 wait complete. 2023-10-24T01:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.183+0000 7faa7efe0700 1 Processor -- start 2023-10-24T01:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 -- start start 2023-10-24T01:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa780695f0 0x7faa78165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa780699d0 0x7faa78152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781529e0 con 0x7faa7813a7e0 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781515b0 con 0x7faa780699d0 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.184+0000 7faa7efe0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa781655a0 con 0x7faa780695f0 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38468/0 (socket says 172.21.15.148:38468) 2023-10-24T01:45:01.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 -- 172.21.15.148:0/2993243761 learned_addr learned my addr 172.21.15.148:0/2993243761 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:01.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa77fff700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa780699d0 0x7faa78152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7cd7c700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa780695f0 0x7faa78165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 -- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa780695f0 msgr2=0x7faa78165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa780695f0 0x7faa78165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 -- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa780699d0 msgr2=0x7faa78152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa780699d0 0x7faa78152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 -- 172.21.15.148:0/2993243761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6400b610 con 0x7faa7813a7e0 2023-10-24T01:45:01.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7d57d700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7faa70009e90 tx=0x7faa7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000caa0 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000f040 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78165880 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000ce10 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.185+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78151ae0 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.186+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78151cd0 con 0x7faa7813a7e0 2023-10-24T01:45:01.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.187+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7faa70013610 con 0x7faa7813a7e0 2023-10-24T01:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.187+0000 7faa74ff9700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 0x7faa5c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.187+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7faa7007ae60 con 0x7faa7813a7e0 2023-10-24T01:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.187+0000 7faa7cd7c700 1 -- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 msgr2=0x7faa5c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:01.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.187+0000 7faa7cd7c700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 0x7faa5c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:01.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.192+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faa7004bcf0 con 0x7faa7813a7e0 2023-10-24T01:45:01.258 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:01.258+0000 7f9a8152b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:01.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.363+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa7806c6b0 con 0x7faa7813a7e0 2023-10-24T01:45:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.364+0000 7faa74ff9700 1 -- 172.21.15.148:0/2993243761 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+17435 (secure 0 0 0) 0x7faa7004f310 con 0x7faa7813a7e0 2023-10-24T01:45:01.365 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:01.366 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":167,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:55.448246+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1258397133":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6833/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6832/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2977455524":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2590381384":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/1460017444":"2023-10-25T01:44:55.448202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:01.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 msgr2=0x7faa5c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:01.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 0x7faa5c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 msgr2=0x7faa781524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7faa70009e90 tx=0x7faa7000b040).stop 2023-10-24T01:45:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 shutdown_connections 2023-10-24T01:45:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7faa5c05f300 0x7faa5c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7813a7e0 0x7faa781524f0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa780695f0 0x7faa78165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 --2- 172.21.15.148:0/2993243761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa780699d0 0x7faa78152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.366+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 >> 172.21.15.148:0/2993243761 conn(0x7faa780641f0 msgr2=0x7faa7813a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.367+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 shutdown_connections 2023-10-24T01:45:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.367+0000 7faa7efe0700 1 -- 172.21.15.148:0/2993243761 wait complete. 2023-10-24T01:45:01.380 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T01:45:01.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:01.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.497+0000 7f7fafa17700 1 Processor -- start 2023-10-24T01:45:01.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.498+0000 7f7fafa17700 1 -- start start 2023-10-24T01:45:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fafa17700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7fa80c1f50 0x7f7fa80bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fafa17700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80c30f0 con 0x7f7fa8150530 2023-10-24T01:45:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fafa17700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80c24e0 con 0x7f7fa8150910 2023-10-24T01:45:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fafa17700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80c3c90 con 0x7f7fa80c1f50 2023-10-24T01:45:01.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7fa80c1f50 0x7f7fa80bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fad7b3700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7fa8150530 0x7f7fa80c3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51504/0 (socket says 172.21.15.148:51504) 2023-10-24T01:45:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f7fa80c1f50 0x7f7fa80bcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38476/0 (socket says 172.21.15.148:38476) 2023-10-24T01:45:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fad7b3700 1 -- 172.21.15.148:0/3162103842 learned_addr learned my addr 172.21.15.148:0/3162103842 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 -- 172.21.15.148:0/3162103842 >> v1:172.21.15.150:6789/0 conn(0x7f7fa8150910 legacy=0x7f7fa80638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 -- 172.21.15.148:0/3162103842 >> v1:172.21.15.148:6789/0 conn(0x7f7fa8150530 legacy=0x7f7fa80c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 -- 172.21.15.148:0/3162103842 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80c27c0 con 0x7f7fa80c1f50 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7f9bfff700 1 -- 172.21.15.148:0/3162103842 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910082312 0 0) 0x7f7fa80c30f0 con 0x7f7fa8150530 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7fadfb4700 1 --2- 172.21.15.148:0/3162103842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa80c1f50 0x7f7fa80bcb50 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f7fa0009e60 tx=0x7f7fa0009780).ready entity=mon.0 client_cookie=72043e1120fe611c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7f9bfff700 1 -- 172.21.15.148:0/3162103842 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000e070 con 0x7f7fa80c1f50 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7f9bfff700 1 -- 172.21.15.148:0/3162103842 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000bc30 con 0x7f7fa80c1f50 2023-10-24T01:45:01.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.499+0000 7f7f9bfff700 1 -- 172.21.15.148:0/3162103842 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0012410 con 0x7f7fa80c1f50 2023-10-24T01:45:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 -- 172.21.15.148:0/3162103842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa80c1f50 msgr2=0x7f7fa80bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 --2- 172.21.15.148:0/3162103842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa80c1f50 0x7f7fa80bcb50 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f7fa0009e60 tx=0x7f7fa0009780).stop 2023-10-24T01:45:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 -- 172.21.15.148:0/3162103842 shutdown_connections 2023-10-24T01:45:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 --2- 172.21.15.148:0/3162103842 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa80c1f50 0x7f7fa80bcb50 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 -- 172.21.15.148:0/3162103842 >> 172.21.15.148:0/3162103842 conn(0x7f7fa80c7ee0 msgr2=0x7f7fa80c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 -- 172.21.15.148:0/3162103842 shutdown_connections 2023-10-24T01:45:01.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.500+0000 7f7fafa17700 1 -- 172.21.15.148:0/3162103842 wait complete. 2023-10-24T01:45:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.501+0000 7f7fafa17700 1 Processor -- start 2023-10-24T01:45:01.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.501+0000 7f7fafa17700 1 -- start start 2023-10-24T01:45:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa80c1f50 0x7f7fa80accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa8150910 0x7f7fa815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80a9b50 con 0x7f7fa8150530 2023-10-24T01:45:01.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8141550 con 0x7f7fa8150910 2023-10-24T01:45:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7fafa17700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81635b0 con 0x7f7fa80c1f50 2023-10-24T01:45:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.502+0000 7f7facfb2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38492/0 (socket says 172.21.15.148:38492) 2023-10-24T01:45:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 -- 172.21.15.148:0/2226734173 learned_addr learned my addr 172.21.15.148:0/2226734173 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:01.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7fadfb4700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa8150910 0x7f7fa815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7fad7b3700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa80c1f50 0x7f7fa80accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa80c1f50 msgr2=0x7f7fa80accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa80c1f50 0x7f7fa80accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa8150910 msgr2=0x7f7fa815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa8150910 0x7f7fa815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 -- 172.21.15.148:0/2226734173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009a20 con 0x7f7fa8150530 2023-10-24T01:45:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7facfb2700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f7fa400c4c0 tx=0x7f7fa4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400ce70 con 0x7f7fa8150530 2023-10-24T01:45:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4001e90 con 0x7f7fa8150530 2023-10-24T01:45:01.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80ad2b0 con 0x7f7fa8150530 2023-10-24T01:45:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4007250 con 0x7f7fa8150530 2023-10-24T01:45:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.503+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa8140f00 con 0x7f7fa8150530 2023-10-24T01:45:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.504+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa806c6b0 con 0x7f7fa8150530 2023-10-24T01:45:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.505+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7fa40066a0 con 0x7f7fa8150530 2023-10-24T01:45:01.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.506+0000 7f7f997fa700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 0x7f7f8c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.506+0000 7f7fad7b3700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 msgr2=0x7f7f8c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.506+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f7fa4079da0 con 0x7f7fa8150530 2023-10-24T01:45:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.506+0000 7f7fad7b3700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 0x7f7f8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:01.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.510+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7fa404ad40 con 0x7f7fa8150530 2023-10-24T01:45:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.707+0000 7f7fad7b3700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 msgr2=0x7f7f8c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:01.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.707+0000 7f7fad7b3700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 0x7f7f8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:45:01.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.723+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fa8065f20 con 0x7f7fa8150530 2023-10-24T01:45:01.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.724+0000 7f7f997fa700 1 -- 172.21.15.148:0/2226734173 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f7fa404e360 con 0x7f7fa8150530 2023-10-24T01:45:01.725 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:01.725 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:45:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 msgr2=0x7f7f8c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:01.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 0x7f7f8c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 msgr2=0x7f7fa81630c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f7fa400c4c0 tx=0x7f7fa4007e00).stop 2023-10-24T01:45:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 shutdown_connections 2023-10-24T01:45:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7fa8150910 0x7f7fa815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7fa80c1f50 0x7f7fa80accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f7f8c05f300 0x7f7f8c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 --2- 172.21.15.148:0/2226734173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7fa8150530 0x7f7fa81630c0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 >> 172.21.15.148:0/2226734173 conn(0x7f7fa80c7ee0 msgr2=0x7f7fa80c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 shutdown_connections 2023-10-24T01:45:01.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.726+0000 7f7fafa17700 1 -- 172.21.15.148:0/2226734173 wait complete. 2023-10-24T01:45:01.730 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:45:01.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:01.771 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:01.769+0000 7f08d9de7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:45:01.840 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:01.839+0000 7f08d9de7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:45:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.860+0000 7ff075658700 1 Processor -- start 2023-10-24T01:45:01.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.860+0000 7ff075658700 1 -- start start 2023-10-24T01:45:01.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff075658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff0700c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff075658700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0700c6710 0x7ff0700aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff075658700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0700c0960 con 0x7ff070158770 2023-10-24T01:45:01.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff075658700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0700aa8e0 con 0x7ff0700c6710 2023-10-24T01:45:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff075658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700c0c40 con 0x7ff0700aa010 2023-10-24T01:45:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff06f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff070158770 0x7ff070069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51518/0 (socket says 172.21.15.148:51518) 2023-10-24T01:45:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff06f7fe700 1 -- 172.21.15.148:0/1161223111 learned_addr learned my addr 172.21.15.148:0/1161223111 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff06e7fc700 1 --2- 172.21.15.148:0/1161223111 >> v2:172.21.15.150:3300/0 conn(0x7ff0700c6710 0x7ff0700aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.861+0000 7ff06effd700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff0700c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06dffb700 1 -- 172.21.15.148:0/1161223111 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738927285 0 0) 0x7ff0700c0960 con 0x7ff070158770 2023-10-24T01:45:01.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06dffb700 1 -- 172.21.15.148:0/1161223111 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0580033f0 con 0x7ff070158770 2023-10-24T01:45:01.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06e7fc700 1 -- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 msgr2=0x7ff0700c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:01.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06e7fc700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff0700c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06e7fc700 1 -- 172.21.15.148:0/1161223111 >> v1:172.21.15.148:6789/0 conn(0x7ff070158770 legacy=0x7ff070069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06e7fc700 1 -- 172.21.15.148:0/1161223111 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700c0f20 con 0x7ff0700c6710 2023-10-24T01:45:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06effd700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff0700c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06e7fc700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700aa3f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff060009760 tx=0x7ff060009060).ready entity=mon.1 client_cookie=921cc03ff2b2b3eb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06dffb700 1 -- 172.21.15.148:0/1161223111 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000d4a0 con 0x7ff0700c6710 2023-10-24T01:45:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06dffb700 1 -- 172.21.15.148:0/1161223111 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000d600 con 0x7ff0700c6710 2023-10-24T01:45:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.862+0000 7ff06dffb700 1 -- 172.21.15.148:0/1161223111 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000d980 con 0x7ff0700c6710 2023-10-24T01:45:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 -- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 msgr2=0x7ff0700aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700aa3f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff060009760 tx=0x7ff060009060).stop 2023-10-24T01:45:01.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 -- 172.21.15.148:0/1161223111 shutdown_connections 2023-10-24T01:45:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff0700c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 --2- 172.21.15.148:0/1161223111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700aa3f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 -- 172.21.15.148:0/1161223111 >> 172.21.15.148:0/1161223111 conn(0x7ff0700caf40 msgr2=0x7ff0700cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:01.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 -- 172.21.15.148:0/1161223111 shutdown_connections 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.863+0000 7ff075658700 1 -- 172.21.15.148:0/1161223111 wait complete. 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.864+0000 7ff075658700 1 Processor -- start 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.864+0000 7ff075658700 1 -- start start 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff070152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700c9c60 con 0x7ff070158770 2023-10-24T01:45:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070164bf0 con 0x7ff0700c6710 2023-10-24T01:45:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff075658700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff070165c00 con 0x7ff0700aa010 2023-10-24T01:45:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38506/0 (socket says 172.21.15.148:38506) 2023-10-24T01:45:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff06f7fe700 1 -- 172.21.15.148:0/2468419123 learned_addr learned my addr 172.21.15.148:0/2468419123 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff06effd700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff070152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.865+0000 7ff06e7fc700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 msgr2=0x7ff070152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff070152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 msgr2=0x7ff0700c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 -- 172.21.15.148:0/2468419123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0640092a0 con 0x7ff070158770 2023-10-24T01:45:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06e7fc700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff06f7fe700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7ff068005ad0 tx=0x7ff0680015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068005d30 con 0x7ff070158770 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff068005e90 con 0x7ff070158770 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600092a0 con 0x7ff070158770 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0680072e0 con 0x7ff070158770 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.866+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff070164e40 con 0x7ff070158770 2023-10-24T01:45:01.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.867+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0700aa600 con 0x7ff070158770 2023-10-24T01:45:01.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.868+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff0680076d0 con 0x7ff070158770 2023-10-24T01:45:01.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.869+0000 7ff056ffd700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 0x7ff05c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:01.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.869+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7ff06807a390 con 0x7ff070158770 2023-10-24T01:45:01.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.869+0000 7ff06effd700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 msgr2=0x7ff05c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:01.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.869+0000 7ff06effd700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 0x7ff05c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:01.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:01.873+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff06804b2b0 con 0x7ff070158770 2023-10-24T01:45:01.917 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:01.916+0000 7f08d9de7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:45:01.956 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:01.955+0000 7f9a8152b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:45:02.028 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.027+0000 7f9a8152b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:45:02.065 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.063+0000 7f08d9de7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:45:02.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.070+0000 7ff06effd700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 msgr2=0x7ff05c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:02.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.070+0000 7ff06effd700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 0x7ff05c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:45:02.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.087+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff07006c6b0 con 0x7ff070158770 2023-10-24T01:45:02.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.087+0000 7ff056ffd700 1 -- 172.21.15.148:0/2468419123 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4500 (secure 0 0 0) 0x7ff06804e8d0 con 0x7ff070158770 2023-10-24T01:45:02.089 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:44:44.190315+0000","modified":"2023-10-24T01:44:46.196761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":4,"addr":"172.21.15.150:6835/236803372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":236803372},{"type":"v1","addr":"172.21.15.150:6835","nonce":236803372}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-24T01:45:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 msgr2=0x7ff05c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 0x7ff05c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 msgr2=0x7ff0700c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7ff068005ad0 tx=0x7ff0680015b0).stop 2023-10-24T01:45:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 shutdown_connections 2023-10-24T01:45:02.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff05c05f300 0x7ff05c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:02.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff070158770 0x7ff0700c9770 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0700aa010 0x7ff070152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.089+0000 7ff075658700 1 --2- 172.21.15.148:0/2468419123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0700c6710 0x7ff0700c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.090+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 >> 172.21.15.148:0/2468419123 conn(0x7ff0700caf40 msgr2=0x7ff0700ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.090+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 shutdown_connections 2023-10-24T01:45:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.090+0000 7ff075658700 1 -- 172.21.15.148:0/2468419123 wait complete. 2023-10-24T01:45:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 56 2023-10-24T01:45:02.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:02.107 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.107+0000 7f9a8152b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:45:02.136 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.134+0000 7f08d9de7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:45:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.218+0000 7fed3fea7700 1 Processor -- start 2023-10-24T01:45:02.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.219+0000 7fed3fea7700 1 -- start start 2023-10-24T01:45:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.219+0000 7fed3fea7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 0x7fed381581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.219+0000 7fed3fea7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed38063d00 con 0x7fed380bca80 2023-10-24T01:45:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.219+0000 7fed3fea7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed38137790 con 0x7fed38062650 2023-10-24T01:45:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.219+0000 7fed3fea7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed380630f0 con 0x7fed38157df0 2023-10-24T01:45:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3e444700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fed380bca80 0x7fed3815e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:51526/0 (socket says 172.21.15.148:51526) 2023-10-24T01:45:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3e444700 1 -- 172.21.15.148:0/1635532294 learned_addr learned my addr 172.21.15.148:0/1635532294 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3dc43700 1 --2- 172.21.15.148:0/1635532294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 0x7fed381581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266576131 0 0) 0x7fed38063d00 con 0x7fed380bca80 2023-10-24T01:45:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed240033f0 con 0x7fed380bca80 2023-10-24T01:45:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704992468 0 0) 0x7fed38137790 con 0x7fed38062650 2023-10-24T01:45:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed38063d00 con 0x7fed38062650 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134966573 0 0) 0x7fed240033f0 con 0x7fed380bca80 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3dc43700 1 -- 172.21.15.148:0/1635532294 >> v1:172.21.15.150:6789/0 conn(0x7fed38062650 legacy=0x7fed380bc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3dc43700 1 -- 172.21.15.148:0/1635532294 >> v1:172.21.15.148:6789/0 conn(0x7fed380bca80 legacy=0x7fed3815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3dc43700 1 -- 172.21.15.148:0/1635532294 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380633d0 con 0x7fed38157df0 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3dc43700 1 --2- 172.21.15.148:0/1635532294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 0x7fed381581d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fed28009790 tx=0x7fed28009060).ready entity=mon.2 client_cookie=69807bac3e6e782e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300017f0 con 0x7fed38157df0 2023-10-24T01:45:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28011400 con 0x7fed38157df0 2023-10-24T01:45:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.220+0000 7fed3cc41700 1 -- 172.21.15.148:0/1635532294 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28011780 con 0x7fed38157df0 2023-10-24T01:45:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 -- 172.21.15.148:0/1635532294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 msgr2=0x7fed381581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 --2- 172.21.15.148:0/1635532294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 0x7fed381581d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fed28009790 tx=0x7fed28009060).stop 2023-10-24T01:45:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 -- 172.21.15.148:0/1635532294 shutdown_connections 2023-10-24T01:45:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 --2- 172.21.15.148:0/1635532294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed38157df0 0x7fed381581d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 -- 172.21.15.148:0/1635532294 >> 172.21.15.148:0/1635532294 conn(0x7fed380c7ee0 msgr2=0x7fed380c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 -- 172.21.15.148:0/1635532294 shutdown_connections 2023-10-24T01:45:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.221+0000 7fed3fea7700 1 -- 172.21.15.148:0/1635532294 wait complete. 2023-10-24T01:45:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.222+0000 7fed3fea7700 1 Processor -- start 2023-10-24T01:45:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.222+0000 7fed3fea7700 1 -- start start 2023-10-24T01:45:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed38062650 0x7fed3814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed380bca80 0x7fed38155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3813b0d0 con 0x7fed38157df0 2023-10-24T01:45:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed381567b0 con 0x7fed38062650 2023-10-24T01:45:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3fea7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3813d440 con 0x7fed380bca80 2023-10-24T01:45:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38514/0 (socket says 172.21.15.148:38514) 2023-10-24T01:45:02.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 -- 172.21.15.148:0/663425479 learned_addr learned my addr 172.21.15.148:0/663425479 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:02.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3dc43700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed38062650 0x7fed3814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3d442700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed380bca80 0x7fed38155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 -- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed380bca80 msgr2=0x7fed38155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed380bca80 0x7fed38155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 -- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed38062650 msgr2=0x7fed3814dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed38062650 0x7fed3814dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.223+0000 7fed3e444700 1 -- 172.21.15.148:0/663425479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280092a0 con 0x7fed38157df0 2023-10-24T01:45:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed3e444700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fed3000cb50 tx=0x7fed30001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30004c40 con 0x7fed38157df0 2023-10-24T01:45:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30004da0 con 0x7fed38157df0 2023-10-24T01:45:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3813d720 con 0x7fed38157df0 2023-10-24T01:45:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30007380 con 0x7fed38157df0 2023-10-24T01:45:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.224+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed381659d0 con 0x7fed38157df0 2023-10-24T01:45:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.225+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed38165bf0 con 0x7fed38157df0 2023-10-24T01:45:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.226+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fed30007730 con 0x7fed38157df0 2023-10-24T01:45:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.227+0000 7fed2dffb700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 0x7fed1c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.227+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fed3007aba0 con 0x7fed38157df0 2023-10-24T01:45:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.227+0000 7fed3dc43700 1 -- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 msgr2=0x7fed1c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.227+0000 7fed3dc43700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 0x7fed1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.230+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed3004bac0 con 0x7fed38157df0 2023-10-24T01:45:02.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.252+0000 7f08d9de7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:45:02.266 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.265+0000 7f9a8152b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:45:02.341 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.340+0000 7f9a8152b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:45:02.362 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.360+0000 7f08d9de7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:02.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.399+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed3813db10 con 0x7fed38157df0 2023-10-24T01:45:02.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.400+0000 7fed2dffb700 1 -- 172.21.15.148:0/663425479 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+17435 (secure 0 0 0) 0x7fed30019030 con 0x7fed38157df0 2023-10-24T01:45:02.401 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:02.402 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":167,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:44:55.448246+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:44:42.340137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-24T01:44:43.164534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/1258397133":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6833/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:6832/87479":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2977455524":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/2590381384":"2023-10-25T01:44:55.448202+0000","172.21.15.150:0/1460017444":"2023-10-25T01:44:55.448202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:02.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 msgr2=0x7fed1c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:02.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 0x7fed1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:02.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 msgr2=0x7fed381562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fed3000cb50 tx=0x7fed30001e50).stop 2023-10-24T01:45:02.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 shutdown_connections 2023-10-24T01:45:02.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fed1c05f300 0x7fed1c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:02.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed38157df0 0x7fed381562c0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.403+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed38062650 0x7fed3814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.404+0000 7fed3fea7700 1 --2- 172.21.15.148:0/663425479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed380bca80 0x7fed38155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.404+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 >> 172.21.15.148:0/663425479 conn(0x7fed380c7ee0 msgr2=0x7fed38136ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:02.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.404+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 shutdown_connections 2023-10-24T01:45:02.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.404+0000 7fed3fea7700 1 -- 172.21.15.148:0/663425479 wait complete. 2023-10-24T01:45:02.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T01:45:02.469 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.468+0000 7f9a8152b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:45:02.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.577+0000 7f0a1a705700 1 Processor -- start 2023-10-24T01:45:02.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.577+0000 7f0a1a705700 1 -- start start 2023-10-24T01:45:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a140c56c0 0x7f0a140be890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0a140bed80 0x7f0a14154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140bf230 con 0x7f0a140c56c0 2023-10-24T01:45:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1406a960 con 0x7f0a140bed80 2023-10-24T01:45:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a1a705700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14065640 con 0x7f0a140a8540 2023-10-24T01:45:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a137fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a140c56c0 0x7f0a140be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a137fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0a140c56c0 0x7f0a140be890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38526/0 (socket says 172.21.15.148:38526) 2023-10-24T01:45:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.578+0000 7f0a137fe700 1 -- 172.21.15.148:0/4023865575 learned_addr learned my addr 172.21.15.148:0/4023865575 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a13fff700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a18ca2700 1 --2- 172.21.15.148:0/4023865575 >> v2:172.21.15.150:3300/0 conn(0x7f0a140bed80 0x7f0a14154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 -- 172.21.15.148:0/4023865575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 msgr2=0x7f0a140641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 -- 172.21.15.148:0/4023865575 >> v2:172.21.15.150:3300/0 conn(0x7f0a140bed80 msgr2=0x7f0a14154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 --2- 172.21.15.148:0/4023865575 >> v2:172.21.15.150:3300/0 conn(0x7f0a140bed80 0x7f0a14154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 -- 172.21.15.148:0/4023865575 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14064a30 con 0x7f0a140c56c0 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a137fe700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140c56c0 0x7f0a140be890 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f0a14069a20 tx=0x7f0a040090f0).ready entity=mon.0 client_cookie=d00179f161d73a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a12ffd700 1 -- 172.21.15.148:0/4023865575 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400f510 con 0x7f0a140c56c0 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a12ffd700 1 -- 172.21.15.148:0/4023865575 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400f670 con 0x7f0a140c56c0 2023-10-24T01:45:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.579+0000 7f0a12ffd700 1 -- 172.21.15.148:0/4023865575 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400fa10 con 0x7f0a140c56c0 2023-10-24T01:45:02.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 -- 172.21.15.148:0/4023865575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140c56c0 msgr2=0x7f0a140be890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140c56c0 0x7f0a140be890 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f0a14069a20 tx=0x7f0a040090f0).stop 2023-10-24T01:45:02.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 -- 172.21.15.148:0/4023865575 shutdown_connections 2023-10-24T01:45:02.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 --2- 172.21.15.148:0/4023865575 >> v2:172.21.15.150:3300/0 conn(0x7f0a140bed80 0x7f0a14154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 --2- 172.21.15.148:0/4023865575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140c56c0 0x7f0a140be890 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 -- 172.21.15.148:0/4023865575 >> 172.21.15.148:0/4023865575 conn(0x7f0a14082f60 msgr2=0x7f0a14062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:02.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 -- 172.21.15.148:0/4023865575 shutdown_connections 2023-10-24T01:45:02.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.580+0000 7f0a1a705700 1 -- 172.21.15.148:0/4023865575 wait complete. 2023-10-24T01:45:02.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.581+0000 7f0a1a705700 1 Processor -- start 2023-10-24T01:45:02.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.581+0000 7f0a1a705700 1 -- start start 2023-10-24T01:45:02.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a140c56c0 0x7f0a14164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1414b480 con 0x7f0a140bed80 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140c8390 con 0x7f0a140c56c0 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1414f6e0 con 0x7f0a140a8540 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38540/0 (socket says 172.21.15.148:38540) 2023-10-24T01:45:02.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 -- 172.21.15.148:0/255918324 learned_addr learned my addr 172.21.15.148:0/255918324 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:02.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a13fff700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a18ca2700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a140c56c0 0x7f0a14164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:02.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 -- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 msgr2=0x7f0a140c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 -- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a140c56c0 msgr2=0x7f0a14164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a140c56c0 0x7f0a14164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 -- 172.21.15.148:0/255918324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009370 con 0x7f0a140bed80 2023-10-24T01:45:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a137fe700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f0a04006fd0 tx=0x7f0a04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04000bc0 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400f7e0 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.582+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a140c7780 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.583+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04000d20 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.583+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a140c7d40 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1414f8a0 con 0x7f0a140bed80 2023-10-24T01:45:02.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 71) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0a04021070 con 0x7f0a140bed80 2023-10-24T01:45:02.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f09fbfff700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 0x7f0a000617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:02.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6423+0+0 (secure 0 0 0) 0x7f0a0407bf40 con 0x7f0a140bed80 2023-10-24T01:45:02.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f0a13fff700 1 -- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 msgr2=0x7f0a000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:02.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.584+0000 7f0a13fff700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 0x7f0a000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:02.594 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.587+0000 7f9a8152b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:02.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.588+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0a040aaaf0 con 0x7f0a140bed80 2023-10-24T01:45:02.657 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.655+0000 7f08d9de7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:45:02.728 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.726+0000 7f08d9de7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:45:02.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.748+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 72) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f0a040799e0 con 0x7f0a140bed80 2023-10-24T01:45:02.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.748+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 msgr2=0x7f0a000617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:02.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.748+0000 7f09fbfff700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 0x7f0a000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:02.805 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f0855d7d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.805 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f0855d7d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.805 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f0855d7d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.805 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f0855d7d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.805 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f0855d7d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.806 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f085457a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.806 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f085457a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.806 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f085457a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.806 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f085457a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.806 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:02.802+0000 7f085457a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:02.810+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a1406c6b0 con 0x7f0a140bed80 2023-10-24T01:45:02.901 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.899+0000 7f9a8152b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:45:02.972 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:02.971+0000 7f9a8152b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:45:03.387 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T01:45:03.385+0000 7f4801cc8700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T01:45:03.390 INFO:tasks.ceph.mds.d.smithi150.stderr: -2626> 2023-10-24T01:44:48.796+0000 7f48054cf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T01:45:03.394 INFO:tasks.ceph.mds.d.smithi150.stderr: -1> 2023-10-24T01:45:03.385+0000 7f4801cc8700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T01:45:03.413 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T01:45:03.743 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T01:45:03.742+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T01:45:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.745+0000 7f09fbfff700 1 -- 172.21.15.148:0/255918324 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a04029090 con 0x7f0a140bed80 2023-10-24T01:45:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 msgr2=0x7f0a140c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f0a04006fd0 tx=0x7f0a04017000).stop 2023-10-24T01:45:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 shutdown_connections 2023-10-24T01:45:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a140c56c0 0x7f0a14164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a140a8540 0x7f0a140c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0a0005f300 0x7f0a000617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 --2- 172.21.15.148:0/255918324 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0a140bed80 0x7f0a140c71b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 >> 172.21.15.148:0/255918324 conn(0x7f0a14082f60 msgr2=0x7f0a140c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 shutdown_connections 2023-10-24T01:45:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.747+0000 7f0a1a705700 1 -- 172.21.15.148:0/255918324 wait complete. 2023-10-24T01:45:03.751 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T01:45:03.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T01:45:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.921+0000 7f72b45bf700 1 Processor -- start 2023-10-24T01:45:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.921+0000 7f72b45bf700 1 -- start start 2023-10-24T01:45:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b45bf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72ac0a9fa0 0x7f72ac154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b45bf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 0x7f72ac0a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b45bf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac154dd0 con 0x7f72ac0acc60 2023-10-24T01:45:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b45bf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac064060 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b45bf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac063bd0 con 0x7f72ac154920 2023-10-24T01:45:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72ac0a9fa0 0x7f72ac154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f72ac0a9fa0 0x7f72ac154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54032/0 (socket says 172.21.15.148:54032) 2023-10-24T01:45:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 -- 172.21.15.148:0/2317336250 learned_addr learned my addr 172.21.15.148:0/2317336250 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:03.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b2b5c700 1 --2- 172.21.15.148:0/2317336250 >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 0x7f72ac0a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 -- 172.21.15.148:0/2317336250 >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 msgr2=0x7f72ac0a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 --2- 172.21.15.148:0/2317336250 >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 0x7f72ac0a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 -- 172.21.15.148:0/2317336250 >> v1:172.21.15.150:6789/0 conn(0x7f72ac0acc60 legacy=0x7f72ac062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b1b5a700 1 -- 172.21.15.148:0/2317336250 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac062d60 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.922+0000 7f72b2b5c700 1 --2- 172.21.15.148:0/2317336250 >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 0x7f72ac0a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b1b5a700 1 --2- 172.21.15.148:0/2317336250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac0a9fa0 0x7f72ac154430 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f72ac0a8bc0 tx=0x7f729c0090f0).ready entity=mon.0 client_cookie=f29c21c7066e6384 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b1359700 1 -- 172.21.15.148:0/2317336250 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00b5a0 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b1359700 1 -- 172.21.15.148:0/2317336250 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c00b700 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b1359700 1 -- 172.21.15.148:0/2317336250 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00baa0 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 -- 172.21.15.148:0/2317336250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac0a9fa0 msgr2=0x7f72ac154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 --2- 172.21.15.148:0/2317336250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac0a9fa0 0x7f72ac154430 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f72ac0a8bc0 tx=0x7f729c0090f0).stop 2023-10-24T01:45:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 -- 172.21.15.148:0/2317336250 shutdown_connections 2023-10-24T01:45:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 --2- 172.21.15.148:0/2317336250 >> v2:172.21.15.150:3300/0 conn(0x7f72ac154920 0x7f72ac0a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 --2- 172.21.15.148:0/2317336250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac0a9fa0 0x7f72ac154430 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 -- 172.21.15.148:0/2317336250 >> 172.21.15.148:0/2317336250 conn(0x7f72ac0c3f60 msgr2=0x7f72ac0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 -- 172.21.15.148:0/2317336250 shutdown_connections 2023-10-24T01:45:03.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.923+0000 7f72b45bf700 1 -- 172.21.15.148:0/2317336250 wait complete. 2023-10-24T01:45:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.924+0000 7f72b45bf700 1 Processor -- start 2023-10-24T01:45:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 -- start start 2023-10-24T01:45:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72ac0a9fa0 0x7f72ac1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72ac0acc60 0x7f72ac167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac1683f0 con 0x7f72ac154920 2023-10-24T01:45:03.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac165fe0 con 0x7f72ac0acc60 2023-10-24T01:45:03.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b45bf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0a1eb0 con 0x7f72ac0a9fa0 2023-10-24T01:45:03.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b2b5c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b2b5c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54044/0 (socket says 172.21.15.148:54044) 2023-10-24T01:45:03.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b2b5c700 1 -- 172.21.15.148:0/605264268 learned_addr learned my addr 172.21.15.148:0/605264268 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b235b700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72ac0a9fa0 0x7f72ac1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.925+0000 7f72b1b5a700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72ac0acc60 0x7f72ac167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 -- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72ac0a9fa0 msgr2=0x7f72ac1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72ac0a9fa0 0x7f72ac1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 -- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72ac0acc60 msgr2=0x7f72ac167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:03.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72ac0acc60 0x7f72ac167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:03.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 -- 172.21.15.148:0/605264268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c009370 con 0x7f72ac154920 2023-10-24T01:45:03.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b2b5c700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f72a400cef0 tx=0x7f72a4007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:03.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400ad20 con 0x7f72ac154920 2023-10-24T01:45:03.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a400ae80 con 0x7f72ac154920 2023-10-24T01:45:03.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac1656b0 con 0x7f72ac154920 2023-10-24T01:45:03.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4016610 con 0x7f72ac154920 2023-10-24T01:45:03.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.926+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac165c70 con 0x7f72ac154920 2023-10-24T01:45:03.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.927+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac062fc0 con 0x7f72ac154920 2023-10-24T01:45:03.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.927+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 73) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f72a40203f0 con 0x7f72ac154920 2023-10-24T01:45:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.928+0000 7f72a27fc700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 0x7f72900614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.928+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6724+0+0 (secure 0 0 0) 0x7f72a407ab90 con 0x7f72ac154920 2023-10-24T01:45:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.928+0000 7f72b235b700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 0x7f72900614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.928+0000 7f72b235b700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 0x7f72900614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f72a80038b0 tx=0x7f72a8007d20).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:03.932+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f72a404bd70 con 0x7f72ac154920 2023-10-24T01:45:04.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.135+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72ac0a7ee0 con 0x7f72ac154920 2023-10-24T01:45:04.817 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.817+0000 7f72a27fc700 1 -- 172.21.15.148:0/605264268 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72ac0a7ee0 con 0x7f72ac154920 2023-10-24T01:45:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 msgr2=0x7f72900614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 0x7f72900614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f72a80038b0 tx=0x7f72a8007d20).stop 2023-10-24T01:45:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 msgr2=0x7f72ac167f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f72a400cef0 tx=0x7f72a4007860).stop 2023-10-24T01:45:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 shutdown_connections 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f729005f030 0x7f72900614f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac154920 0x7f72ac167f00 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f72ac0a9fa0 0x7f72ac1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 --2- 172.21.15.148:0/605264268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f72ac0acc60 0x7f72ac167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 >> 172.21.15.148:0/605264268 conn(0x7f72ac0c3f60 msgr2=0x7f72ac0c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 shutdown_connections 2023-10-24T01:45:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.819+0000 7f72b45bf700 1 -- 172.21.15.148:0/605264268 wait complete. 2023-10-24T01:45:04.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T01:45:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.949+0000 7f4356ee0700 1 Processor -- start 2023-10-24T01:45:04.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.949+0000 7f4356ee0700 1 -- start start 2023-10-24T01:45:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4356ee0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4356ee0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43500c6270 con 0x7f43501544b0 2023-10-24T01:45:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4356ee0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43500aa890 con 0x7f43500aa420 2023-10-24T01:45:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4356ee0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500c60e0 con 0x7f43500a7d00 2023-10-24T01:45:04.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4354c7c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f43501544b0 0x7f43500c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48982/0 (socket says 172.21.15.148:48982) 2023-10-24T01:45:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f4354c7c700 1 -- 172.21.15.148:0/216206562 learned_addr learned my addr 172.21.15.148:0/216206562 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f434ffff700 1 --2- 172.21.15.148:0/216206562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.950+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780882772 0 0) 0x7f43500c6270 con 0x7f43501544b0 2023-10-24T01:45:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43400033f0 con 0x7f43501544b0 2023-10-24T01:45:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055540746 0 0) 0x7f43500aa890 con 0x7f43500aa420 2023-10-24T01:45:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43500c6270 con 0x7f43500aa420 2023-10-24T01:45:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 541070165 0 0) 0x7f43400033f0 con 0x7f43501544b0 2023-10-24T01:45:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434ffff700 1 -- 172.21.15.148:0/216206562 >> v1:172.21.15.150:6789/0 conn(0x7f43500aa420 legacy=0x7f43500c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434ffff700 1 -- 172.21.15.148:0/216206562 >> v1:172.21.15.148:6789/0 conn(0x7f43501544b0 legacy=0x7f43500c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434ffff700 1 -- 172.21.15.148:0/216206562 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500c0c80 con 0x7f43500a7d00 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434ffff700 1 --2- 172.21.15.148:0/216206562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500a9f30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f433c009790 tx=0x7f433c009060).ready entity=mon.2 client_cookie=db473b87d6113eba server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344001470 con 0x7f43500a7d00 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c011400 con 0x7f43500a7d00 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f434f7fe700 1 -- 172.21.15.148:0/216206562 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c011780 con 0x7f43500a7d00 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f4356ee0700 1 -- 172.21.15.148:0/216206562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 msgr2=0x7f43500a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.951+0000 7f4356ee0700 1 --2- 172.21.15.148:0/216206562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500a9f30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f433c009790 tx=0x7f433c009060).stop 2023-10-24T01:45:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.952+0000 7f4356ee0700 1 -- 172.21.15.148:0/216206562 shutdown_connections 2023-10-24T01:45:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.952+0000 7f4356ee0700 1 --2- 172.21.15.148:0/216206562 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500a9f30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.952+0000 7f4356ee0700 1 -- 172.21.15.148:0/216206562 >> 172.21.15.148:0/216206562 conn(0x7f43500945d0 msgr2=0x7f435006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.952+0000 7f4356ee0700 1 -- 172.21.15.148:0/216206562 shutdown_connections 2023-10-24T01:45:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.952+0000 7f4356ee0700 1 -- 172.21.15.148:0/216206562 wait complete. 2023-10-24T01:45:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.953+0000 7f4356ee0700 1 Processor -- start 2023-10-24T01:45:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.953+0000 7f4356ee0700 1 -- start start 2023-10-24T01:45:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:04.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43501544b0 0x7f43500a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500ae280 con 0x7f43500aa420 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500b0f70 con 0x7f43501544b0 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4350164fd0 con 0x7f43500a7d00 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54050/0 (socket says 172.21.15.148:54050) 2023-10-24T01:45:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 -- 172.21.15.148:0/397467247 learned_addr learned my addr 172.21.15.148:0/397467247 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4354c7c700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f435547d700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43501544b0 0x7f43500a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 -- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 msgr2=0x7f43500b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 -- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43501544b0 msgr2=0x7f43500a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43501544b0 0x7f43500a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 -- 172.21.15.148:0/397467247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0092a0 con 0x7f43500aa420 2023-10-24T01:45:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434ffff700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f4350084180 tx=0x7f433c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c010740 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0108a0 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c010c60 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43501652b0 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.954+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350165870 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.955+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435006c6b0 con 0x7f43500aa420 2023-10-24T01:45:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.956+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 73) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f433c0263b0 con 0x7f43500aa420 2023-10-24T01:45:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.956+0000 7f434cff9700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 0x7f43340614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.956+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6724+0+0 (secure 0 0 0) 0x7f433c07ad70 con 0x7f43500aa420 2023-10-24T01:45:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.956+0000 7f4354c7c700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 0x7f43340614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.957+0000 7f4354c7c700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 0x7f43340614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f43440015a0 tx=0x7f4344000bc0).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:04.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:04.960+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f433c04bf50 con 0x7f43500aa420 2023-10-24T01:45:05.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.124+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43500c0f40 con 0x7f43500aa420 2023-10-24T01:45:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.759+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f433c078ab0 con 0x7f43500aa420 2023-10-24T01:45:05.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.821+0000 7f434cff9700 1 -- 172.21.15.148:0/397467247 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v171) v1 ==== 181+0+0 (secure 0 0 0) 0x7f433c0415f0 con 0x7f43500aa420 2023-10-24T01:45:05.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 msgr2=0x7f43340614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 0x7f43340614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f43440015a0 tx=0x7f4344000bc0).stop 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 msgr2=0x7f4350168950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f4350084180 tx=0x7f433c016000).stop 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 shutdown_connections 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43501544b0 0x7f43500a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43500a7d00 0x7f43500b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f433405f030 0x7f43340614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 --2- 172.21.15.148:0/397467247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43500aa420 0x7f4350168950 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.825+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 >> 172.21.15.148:0/397467247 conn(0x7f43500945d0 msgr2=0x7f43500640b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.826+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 shutdown_connections 2023-10-24T01:45:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.826+0000 7f4356ee0700 1 -- 172.21.15.148:0/397467247 wait complete. 2023-10-24T01:45:05.829 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T01:45:05.840 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T01:45:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.959+0000 7fefa69e2700 1 Processor -- start 2023-10-24T01:45:05.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.959+0000 7fefa69e2700 1 -- start start 2023-10-24T01:45:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa69e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fefa01544b0 0x7fefa00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa69e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 0x7fefa00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa69e2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa00c6270 con 0x7fefa00c8290 2023-10-24T01:45:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa69e2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa00c60e0 con 0x7fefa01544b0 2023-10-24T01:45:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa69e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa00c0c80 con 0x7fefa00aa640 2023-10-24T01:45:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fef9ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fefa01544b0 0x7fefa00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fef9f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fefa00c8290 0x7fefa00a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48998/0 (socket says 172.21.15.148:48998) 2023-10-24T01:45:05.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fef9f7fe700 1 -- 172.21.15.148:0/3980051411 learned_addr learned my addr 172.21.15.148:0/3980051411 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.960+0000 7fefa4f7f700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 0x7fefa00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9ffff700 1 -- 172.21.15.148:0/3980051411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 msgr2=0x7fefa00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9ffff700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 0x7fefa00c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9ffff700 1 -- 172.21.15.148:0/3980051411 >> v1:172.21.15.148:6789/0 conn(0x7fefa00c8290 legacy=0x7fefa00a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9ffff700 1 -- 172.21.15.148:0/3980051411 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00c0f40 con 0x7fefa01544b0 2023-10-24T01:45:05.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9effd700 1 -- 172.21.15.148:0/3980051411 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023100848 0 0) 0x7fefa00c6270 con 0x7fefa00c8290 2023-10-24T01:45:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa4f7f700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 0x7fefa00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9ffff700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00a7d00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fef90009760 tx=0x7fef90009060).ready entity=mon.0 client_cookie=1b1199e7d4d8927b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9effd700 1 -- 172.21.15.148:0/3980051411 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000b580 con 0x7fefa01544b0 2023-10-24T01:45:05.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9effd700 1 -- 172.21.15.148:0/3980051411 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9000b6e0 con 0x7fefa01544b0 2023-10-24T01:45:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fef9effd700 1 -- 172.21.15.148:0/3980051411 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000ba60 con 0x7fefa01544b0 2023-10-24T01:45:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 -- 172.21.15.148:0/3980051411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 msgr2=0x7fefa00a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00a7d00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fef90009760 tx=0x7fef90009060).stop 2023-10-24T01:45:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 -- 172.21.15.148:0/3980051411 shutdown_connections 2023-10-24T01:45:05.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00aa640 0x7fefa00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 --2- 172.21.15.148:0/3980051411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00a7d00 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 -- 172.21.15.148:0/3980051411 >> 172.21.15.148:0/3980051411 conn(0x7fefa00945d0 msgr2=0x7fefa006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 -- 172.21.15.148:0/3980051411 shutdown_connections 2023-10-24T01:45:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.961+0000 7fefa69e2700 1 -- 172.21.15.148:0/3980051411 wait complete. 2023-10-24T01:45:05.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.962+0000 7fefa69e2700 1 Processor -- start 2023-10-24T01:45:05.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 -- start start 2023-10-24T01:45:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 0x7fefa0154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00c8290 0x7fefa0155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0156400 con 0x7fefa01544b0 2023-10-24T01:45:05.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0155a80 con 0x7fefa00aa640 2023-10-24T01:45:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.963+0000 7fefa69e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa0154e70 con 0x7fefa00c8290 2023-10-24T01:45:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54068/0 (socket says 172.21.15.148:54068) 2023-10-24T01:45:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 -- 172.21.15.148:0/1587055539 learned_addr learned my addr 172.21.15.148:0/1587055539 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:05.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef9f7fe700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00c8290 0x7fefa0155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef9ffff700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 0x7fefa0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 -- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00c8290 msgr2=0x7fefa0155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00c8290 0x7fefa0155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 -- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 msgr2=0x7fefa0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:05.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 0x7fefa0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 -- 172.21.15.148:0/1587055539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900092a0 con 0x7fefa01544b0 2023-10-24T01:45:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef9ffff700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 0x7fefa0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa4f7f700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fef9800a380 tx=0x7fef980078f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800aea0 con 0x7fefa01544b0 2023-10-24T01:45:05.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800d650 con 0x7fefa01544b0 2023-10-24T01:45:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800d9d0 con 0x7fefa01544b0 2023-10-24T01:45:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa0155150 con 0x7fefa01544b0 2023-10-24T01:45:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.964+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa0155710 con 0x7fefa01544b0 2023-10-24T01:45:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.965+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa0155c30 con 0x7fefa01544b0 2023-10-24T01:45:05.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.965+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fef98013070 con 0x7fefa01544b0 2023-10-24T01:45:05.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.966+0000 7fef87fff700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 0x7fef8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:05.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.966+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6286+0+0 (secure 0 0 0) 0x7fef9807afb0 con 0x7fefa01544b0 2023-10-24T01:45:05.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.966+0000 7fef9ffff700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 0x7fef8c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:05.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.967+0000 7fef9ffff700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 0x7fef8c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fef9000b340 tx=0x7fef90017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:05.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:05.970+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fefa0155c30 con 0x7fefa01544b0 2023-10-24T01:45:06.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.139+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fefa0155bf0 con 0x7fefa01544b0 2023-10-24T01:45:06.820 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.819+0000 7fef87fff700 1 -- 172.21.15.148:0/1587055539 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v172) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef9804c060 con 0x7fefa01544b0 2023-10-24T01:45:06.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.823+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 msgr2=0x7fef8c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:06.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.823+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 0x7fef8c061730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fef9000b340 tx=0x7fef90017000).stop 2023-10-24T01:45:06.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.823+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 msgr2=0x7fefa00ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:06.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.823+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fef9800a380 tx=0x7fef980078f0).stop 2023-10-24T01:45:06.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 shutdown_connections 2023-10-24T01:45:06.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fef8c05f270 0x7fef8c061730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefa01544b0 0x7fefa00ad260 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fefa00aa640 0x7fefa0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 --2- 172.21.15.148:0/1587055539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fefa00c8290 0x7fefa0155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 >> 172.21.15.148:0/1587055539 conn(0x7fefa00945d0 msgr2=0x7fefa00a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 shutdown_connections 2023-10-24T01:45:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.824+0000 7fefa69e2700 1 -- 172.21.15.148:0/1587055539 wait complete. 2023-10-24T01:45:06.827 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T01:45:06.838 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T01:45:06.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.953+0000 7f6db3189700 1 Processor -- start 2023-10-24T01:45:06.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.953+0000 7f6db3189700 1 -- start start 2023-10-24T01:45:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db3189700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dac1546d0 0x7f6dac0aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db3189700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 0x7f6dac0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db3189700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0a8440 con 0x7f6dac0c1370 2023-10-24T01:45:06.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db3189700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c1870 con 0x7f6dac1546d0 2023-10-24T01:45:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db3189700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c1b50 con 0x7f6dac0c6a70 2023-10-24T01:45:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db0f25700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dac1546d0 0x7f6dac0aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db0f25700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dac1546d0 0x7f6dac0aa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54084/0 (socket says 172.21.15.148:54084) 2023-10-24T01:45:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.954+0000 7f6db0f25700 1 -- 172.21.15.148:0/1735003479 learned_addr learned my addr 172.21.15.148:0/1735003479 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:06.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db1726700 1 --2- 172.21.15.148:0/1735003479 >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 0x7f6dac0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db0f25700 1 -- 172.21.15.148:0/1735003479 >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 msgr2=0x7f6dac0a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db0f25700 1 --2- 172.21.15.148:0/1735003479 >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 0x7f6dac0a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db0f25700 1 -- 172.21.15.148:0/1735003479 >> v1:172.21.15.150:6789/0 conn(0x7f6dac0c1370 legacy=0x7f6dac0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db0f25700 1 -- 172.21.15.148:0/1735003479 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0a7df0 con 0x7f6dac1546d0 2023-10-24T01:45:06.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db1726700 1 --2- 172.21.15.148:0/1735003479 >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 0x7f6dac0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db0f25700 1 --2- 172.21.15.148:0/1735003479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac0aa2c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f6dac0b1310 tx=0x7f6da8009840).ready entity=mon.0 client_cookie=4293cdc761079b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6da37fe700 1 -- 172.21.15.148:0/1735003479 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800e070 con 0x7f6dac1546d0 2023-10-24T01:45:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6da37fe700 1 -- 172.21.15.148:0/1735003479 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800ba90 con 0x7f6dac1546d0 2023-10-24T01:45:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6da37fe700 1 -- 172.21.15.148:0/1735003479 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800be10 con 0x7f6dac1546d0 2023-10-24T01:45:06.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 -- 172.21.15.148:0/1735003479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 msgr2=0x7f6dac0aa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 --2- 172.21.15.148:0/1735003479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac0aa2c0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f6dac0b1310 tx=0x7f6da8009840).stop 2023-10-24T01:45:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 -- 172.21.15.148:0/1735003479 shutdown_connections 2023-10-24T01:45:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 --2- 172.21.15.148:0/1735003479 >> v2:172.21.15.150:3300/0 conn(0x7f6dac0c6a70 0x7f6dac0a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 --2- 172.21.15.148:0/1735003479 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac0aa2c0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.955+0000 7f6db3189700 1 -- 172.21.15.148:0/1735003479 >> 172.21.15.148:0/1735003479 conn(0x7f6dac0946c0 msgr2=0x7f6dac06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.956+0000 7f6db3189700 1 -- 172.21.15.148:0/1735003479 shutdown_connections 2023-10-24T01:45:06.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.956+0000 7f6db3189700 1 -- 172.21.15.148:0/1735003479 wait complete. 2023-10-24T01:45:06.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.957+0000 7f6db3189700 1 Processor -- start 2023-10-24T01:45:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.957+0000 7f6db3189700 1 -- start start 2023-10-24T01:45:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.957+0000 7f6db3189700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dac0c1370 0x7f6dac0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac0c6a70 0x7f6dac165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac14cda0 con 0x7f6dac1546d0 2023-10-24T01:45:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c4220 con 0x7f6dac0c6a70 2023-10-24T01:45:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac165100 con 0x7f6dac0c1370 2023-10-24T01:45:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54098/0 (socket says 172.21.15.148:54098) 2023-10-24T01:45:06.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 -- 172.21.15.148:0/532764756 learned_addr learned my addr 172.21.15.148:0/532764756 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6da3fff700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac0c6a70 0x7f6dac165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db0f25700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dac0c1370 0x7f6dac0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 -- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dac0c1370 msgr2=0x7f6dac0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dac0c1370 0x7f6dac0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 -- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac0c6a70 msgr2=0x7f6dac165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:06.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac0c6a70 0x7f6dac165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 -- 172.21.15.148:0/532764756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009ae0 con 0x7f6dac1546d0 2023-10-24T01:45:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db1726700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f6da400c680 tx=0x7f6da4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4010580 con 0x7f6dac1546d0 2023-10-24T01:45:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da40106e0 con 0x7f6dac1546d0 2023-10-24T01:45:06.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac164ad0 con 0x7f6dac1546d0 2023-10-24T01:45:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4010a60 con 0x7f6dac1546d0 2023-10-24T01:45:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.958+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0c4d50 con 0x7f6dac1546d0 2023-10-24T01:45:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.959+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac165290 con 0x7f6dac1546d0 2023-10-24T01:45:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.960+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6da401b460 con 0x7f6dac1546d0 2023-10-24T01:45:06.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.960+0000 7f6da0ff9700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 0x7f6d98061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.960+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f6da407a010 con 0x7f6dac1546d0 2023-10-24T01:45:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.960+0000 7f6db0f25700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 0x7f6d98061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.961+0000 7f6db0f25700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 0x7f6d98061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6da800ba60 tx=0x7f6da8009840).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:06.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:06.964+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6da404b200 con 0x7f6dac1546d0 2023-10-24T01:45:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.131+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6dac165a80 con 0x7f6dac1546d0 2023-10-24T01:45:07.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.134+0000 7f6da0ff9700 1 -- 172.21.15.148:0/532764756 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6da404e820 con 0x7f6dac1546d0 2023-10-24T01:45:07.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 msgr2=0x7f6d98061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 0x7f6d98061700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6da800ba60 tx=0x7f6da8009840).stop 2023-10-24T01:45:07.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 msgr2=0x7f6dac14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f6da400c680 tx=0x7f6da4008040).stop 2023-10-24T01:45:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 shutdown_connections 2023-10-24T01:45:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f6d9805f240 0x7f6d98061700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dac1546d0 0x7f6dac14c8b0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dac0c1370 0x7f6dac0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 --2- 172.21.15.148:0/532764756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dac0c6a70 0x7f6dac165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 >> 172.21.15.148:0/532764756 conn(0x7f6dac0946c0 msgr2=0x7f6dac0c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 shutdown_connections 2023-10-24T01:45:07.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.136+0000 7f6db3189700 1 -- 172.21.15.148:0/532764756 wait complete. 2023-10-24T01:45:07.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T01:45:07.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.263+0000 7f4feb31a700 1 Processor -- start 2023-10-24T01:45:07.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 -- start start 2023-10-24T01:45:07.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fe4098bd0 0x7f4fe4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe40bffd0 0x7f4fe40c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe40c71d0 con 0x7f4fe4154430 2023-10-24T01:45:07.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe40c6a10 con 0x7f4fe4098bd0 2023-10-24T01:45:07.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.264+0000 7f4feb31a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40c9410 con 0x7f4fe40bffd0 2023-10-24T01:45:07.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fe4098bd0 0x7f4fe4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fe4098bd0 0x7f4fe4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54104/0 (socket says 172.21.15.148:54104) 2023-10-24T01:45:07.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 -- 172.21.15.148:0/588183749 learned_addr learned my addr 172.21.15.148:0/588183749 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 -- 172.21.15.148:0/588183749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe40bffd0 msgr2=0x7f4fe40c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:07.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 --2- 172.21.15.148:0/588183749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe40bffd0 0x7f4fe40c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:07.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 -- 172.21.15.148:0/588183749 >> v1:172.21.15.150:6789/0 conn(0x7f4fe4154430 legacy=0x7f4fe40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:07.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 -- 172.21.15.148:0/588183749 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40c0950 con 0x7f4fe4098bd0 2023-10-24T01:45:07.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe88b5700 1 --2- 172.21.15.148:0/588183749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4154810 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f4fd8006fd0 tx=0x7f4fd80090f0).ready entity=mon.0 client_cookie=c674a2680cd5861e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe3fff700 1 -- 172.21.15.148:0/588183749 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800b600 con 0x7f4fe4098bd0 2023-10-24T01:45:07.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe3fff700 1 -- 172.21.15.148:0/588183749 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800b760 con 0x7f4fe4098bd0 2023-10-24T01:45:07.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.265+0000 7f4fe3fff700 1 -- 172.21.15.148:0/588183749 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800bae0 con 0x7f4fe4098bd0 2023-10-24T01:45:07.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 -- 172.21.15.148:0/588183749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 msgr2=0x7f4fe4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 --2- 172.21.15.148:0/588183749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4154810 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f4fd8006fd0 tx=0x7f4fd80090f0).stop 2023-10-24T01:45:07.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 -- 172.21.15.148:0/588183749 shutdown_connections 2023-10-24T01:45:07.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 --2- 172.21.15.148:0/588183749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe40bffd0 0x7f4fe40c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:07.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 --2- 172.21.15.148:0/588183749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4154810 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 -- 172.21.15.148:0/588183749 >> 172.21.15.148:0/588183749 conn(0x7f4fe40cb070 msgr2=0x7f4fe40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 -- 172.21.15.148:0/588183749 shutdown_connections 2023-10-24T01:45:07.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.266+0000 7f4feb31a700 1 -- 172.21.15.148:0/588183749 wait complete. 2023-10-24T01:45:07.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.267+0000 7f4feb31a700 1 Processor -- start 2023-10-24T01:45:07.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.267+0000 7f4feb31a700 1 -- start start 2023-10-24T01:45:07.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fe40bffd0 0x7f4fe40ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 0x7f4fe4167eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4152070 con 0x7f4fe4098bd0 2023-10-24T01:45:07.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4150c00 con 0x7f4fe40bffd0 2023-10-24T01:45:07.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4feb31a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40afe70 con 0x7f4fe4154430 2023-10-24T01:45:07.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54120/0 (socket says 172.21.15.148:54120) 2023-10-24T01:45:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 -- 172.21.15.148:0/1822911531 learned_addr learned my addr 172.21.15.148:0/1822911531 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe88b5700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fe40bffd0 0x7f4fe40ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe98b7700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 0x7f4fe4167eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 -- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 msgr2=0x7f4fe4167eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 0x7f4fe4167eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 -- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fe40bffd0 msgr2=0x7f4fe40ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fe40bffd0 0x7f4fe40ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe90b6700 1 -- 172.21.15.148:0/1822911531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009370 con 0x7f4fe4098bd0 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.268+0000 7f4fe98b7700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 0x7f4fe4167eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:07.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4fe90b6700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4fd400c810 tx=0x7f4fd40025e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010510 con 0x7f4fe4098bd0 2023-10-24T01:45:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4010690 con 0x7f4fe4098bd0 2023-10-24T01:45:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010a50 con 0x7f4fe4098bd0 2023-10-24T01:45:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40b0150 con 0x7f4fe4098bd0 2023-10-24T01:45:07.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.269+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe40b0710 con 0x7f4fe4098bd0 2023-10-24T01:45:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.270+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe406c6b0 con 0x7f4fe4098bd0 2023-10-24T01:45:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.270+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4fd401b400 con 0x7f4fe4098bd0 2023-10-24T01:45:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.270+0000 7f4fe17fa700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 0x7f4fd0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.270+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f4fd407a1e0 con 0x7f4fe4098bd0 2023-10-24T01:45:07.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.271+0000 7f4fe88b5700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 0x7f4fd0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.271+0000 7f4fe88b5700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 0x7f4fd0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4fd8009130 tx=0x7f4fd8017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.274+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4fd404b3d0 con 0x7f4fe4098bd0 2023-10-24T01:45:07.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.449+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4fe41521b0 con 0x7f4fe4098bd0 2023-10-24T01:45:07.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.452+0000 7f4fe17fa700 1 -- 172.21.15.148:0/1822911531 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4fd4002700 con 0x7f4fe4098bd0 2023-10-24T01:45:07.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 msgr2=0x7f4fd0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 0x7f4fd0061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4fd8009130 tx=0x7f4fd8017000).stop 2023-10-24T01:45:07.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 msgr2=0x7f4fe4150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f4fd400c810 tx=0x7f4fd40025e0).stop 2023-10-24T01:45:07.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 shutdown_connections 2023-10-24T01:45:07.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fe4154430 0x7f4fe4167eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4fd005f270 0x7f4fd0061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fe4098bd0 0x7f4fe4150710 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 --2- 172.21.15.148:0/1822911531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fe40bffd0 0x7f4fe40ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 >> 172.21.15.148:0/1822911531 conn(0x7f4fe40cb070 msgr2=0x7f4fe40a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 shutdown_connections 2023-10-24T01:45:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.454+0000 7f4feb31a700 1 -- 172.21.15.148:0/1822911531 wait complete. 2023-10-24T01:45:07.467 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-24T01:45:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.580+0000 7f68f4ba7700 1 Processor -- start 2023-10-24T01:45:07.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.580+0000 7f68f4ba7700 1 -- start start 2023-10-24T01:45:07.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68f4ba7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00c6710 0x7f68f00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68f4ba7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f68f00aa3f0 0x7f68f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68f4ba7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00aa880 con 0x7f68f00aa010 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68f4ba7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00c0960 con 0x7f68f00aa3f0 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68f4ba7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c0c40 con 0x7f68f00c6710 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f68f00aa3f0 0x7f68f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f68f00aa3f0 0x7f68f0069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54134/0 (socket says 172.21.15.148:54134) 2023-10-24T01:45:07.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 -- 172.21.15.148:0/909819438 learned_addr learned my addr 172.21.15.148:0/909819438 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68e5d9b700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00c6710 0x7f68f00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 -- 172.21.15.148:0/909819438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00c6710 msgr2=0x7f68f00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:07.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00c6710 0x7f68f00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 -- 172.21.15.148:0/909819438 >> v1:172.21.15.150:6789/0 conn(0x7f68f00aa010 legacy=0x7f68f0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 -- 172.21.15.148:0/909819438 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00c0f20 con 0x7f68f00aa3f0 2023-10-24T01:45:07.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68eed9d700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0069d80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f68e8009f20 tx=0x7f68e8009840).ready entity=mon.0 client_cookie=ebf3a4cce1c64e6c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68edd9b700 1 -- 172.21.15.148:0/909819438 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800e070 con 0x7f68f00aa3f0 2023-10-24T01:45:07.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68edd9b700 1 -- 172.21.15.148:0/909819438 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800b9d0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.581+0000 7f68edd9b700 1 -- 172.21.15.148:0/909819438 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800bd50 con 0x7f68f00aa3f0 2023-10-24T01:45:07.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 -- 172.21.15.148:0/909819438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 msgr2=0x7f68f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0069d80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f68e8009f20 tx=0x7f68e8009840).stop 2023-10-24T01:45:07.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 -- 172.21.15.148:0/909819438 shutdown_connections 2023-10-24T01:45:07.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0069d80 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/909819438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00c6710 0x7f68f00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 -- 172.21.15.148:0/909819438 >> 172.21.15.148:0/909819438 conn(0x7f68f00caf40 msgr2=0x7f68f00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 -- 172.21.15.148:0/909819438 shutdown_connections 2023-10-24T01:45:07.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.582+0000 7f68f4ba7700 1 -- 172.21.15.148:0/909819438 wait complete. 2023-10-24T01:45:07.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.583+0000 7f68f4ba7700 1 Processor -- start 2023-10-24T01:45:07.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.583+0000 7f68f4ba7700 1 -- start start 2023-10-24T01:45:07.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00aa010 0x7f68f0165b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f00c6710 0x7f68f00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c2110 con 0x7f68f00aa3f0 2023-10-24T01:45:07.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c23f0 con 0x7f68f00c6710 2023-10-24T01:45:07.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68f4ba7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c26d0 con 0x7f68f00aa010 2023-10-24T01:45:07.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54136/0 (socket says 172.21.15.148:54136) 2023-10-24T01:45:07.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 -- 172.21.15.148:0/119533511 learned_addr learned my addr 172.21.15.148:0/119533511 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68eed9d700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f00c6710 0x7f68f00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68ee59c700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00aa010 0x7f68f0165b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 -- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00aa010 msgr2=0x7f68f0165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00aa010 0x7f68f0165b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 -- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f00c6710 msgr2=0x7f68f00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f00c6710 0x7f68f00afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 -- 172.21.15.148:0/119533511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009ae0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.584+0000 7f68e5d9b700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f68d800e900 tx=0x7f68d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.585+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8012600 con 0x7f68f00aa3f0 2023-10-24T01:45:07.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.585+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d8012760 con 0x7f68f00aa3f0 2023-10-24T01:45:07.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.585+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f00c29b0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.585+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8012ae0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.585+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f0165ff0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.586+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f00c2ed0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.586+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f68d801b400 con 0x7f68f00aa3f0 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.586+0000 7f68e6ffd700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 0x7f68d0061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.586+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f68d807a5e0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.586+0000 7f68ee59c700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 0x7f68d0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.587+0000 7f68ee59c700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 0x7f68d0061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f68e00038e0 tx=0x7f68e0007d40).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.590+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f68f00c2ed0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.817+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f68f00c2ed0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.823+0000 7f68e6ffd700 1 -- 172.21.15.148:0/119533511 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2454) v1 ==== 174+0+0 (secure 0 0 0) 0x7f68f00c2ed0 con 0x7f68f00aa3f0 2023-10-24T01:45:07.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 msgr2=0x7f68d0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 0x7f68d0061700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f68e00038e0 tx=0x7f68e0007d40).stop 2023-10-24T01:45:07.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 msgr2=0x7f68f0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f68d800e900 tx=0x7f68d8009060).stop 2023-10-24T01:45:07.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 shutdown_connections 2023-10-24T01:45:07.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68f00c6710 0x7f68f00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68f00aa010 0x7f68f0165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f68d005f240 0x7f68d0061700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 --2- 172.21.15.148:0/119533511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68f00aa3f0 0x7f68f0151e10 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 >> 172.21.15.148:0/119533511 conn(0x7f68f00caf40 msgr2=0x7f68f00c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 shutdown_connections 2023-10-24T01:45:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.825+0000 7f68f4ba7700 1 -- 172.21.15.148:0/119533511 wait complete. 2023-10-24T01:45:07.838 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-10-24T01:45:07.839 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-10-24T01:45:07.839 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T01:45:07.840 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-24T01:45:07.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.953+0000 7f89ebb28700 1 Processor -- start 2023-10-24T01:45:07.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.953+0000 7f89ebb28700 1 -- start start 2023-10-24T01:45:07.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ebb28700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89e40c6710 0x7f89e40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ebb28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa3f0 0x7f89e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ebb28700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40aa860 con 0x7f89e40aa010 2023-10-24T01:45:07.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ebb28700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e40c0960 con 0x7f89e40c6710 2023-10-24T01:45:07.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ebb28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40c0c40 con 0x7f89e40aa3f0 2023-10-24T01:45:07.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89e40c6710 0x7f89e40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f89e40c6710 0x7f89e40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54140/0 (socket says 172.21.15.148:54140) 2023-10-24T01:45:07.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 -- 172.21.15.148:0/3295045335 learned_addr learned my addr 172.21.15.148:0/3295045335 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89ea0c5700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa3f0 0x7f89e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 -- 172.21.15.148:0/3295045335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa3f0 msgr2=0x7f89e4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:07.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa3f0 0x7f89e4069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 -- 172.21.15.148:0/3295045335 >> v1:172.21.15.150:6789/0 conn(0x7f89e40aa010 legacy=0x7f89e4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e88c2700 1 -- 172.21.15.148:0/3295045335 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382391005 0 0) 0x7f89e40aa860 con 0x7f89e40aa010 2023-10-24T01:45:07.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 -- 172.21.15.148:0/3295045335 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40c0f20 con 0x7f89e40c6710 2023-10-24T01:45:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e90c3700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40c6710 0x7f89e40c1a00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f89d4006fd0 tx=0x7f89d40090f0).ready entity=mon.0 client_cookie=fcbaab7113b478af server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e88c2700 1 -- 172.21.15.148:0/3295045335 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400b580 con 0x7f89e40c6710 2023-10-24T01:45:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e88c2700 1 -- 172.21.15.148:0/3295045335 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400b6e0 con 0x7f89e40c6710 2023-10-24T01:45:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.954+0000 7f89e88c2700 1 -- 172.21.15.148:0/3295045335 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400ba60 con 0x7f89e40c6710 2023-10-24T01:45:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 -- 172.21.15.148:0/3295045335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40c6710 msgr2=0x7f89e40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40c6710 0x7f89e40c1a00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f89d4006fd0 tx=0x7f89d40090f0).stop 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 -- 172.21.15.148:0/3295045335 shutdown_connections 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa3f0 0x7f89e4069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 --2- 172.21.15.148:0/3295045335 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40c6710 0x7f89e40c1a00 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 -- 172.21.15.148:0/3295045335 >> 172.21.15.148:0/3295045335 conn(0x7f89e40caf40 msgr2=0x7f89e40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 -- 172.21.15.148:0/3295045335 shutdown_connections 2023-10-24T01:45:07.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.955+0000 7f89ebb28700 1 -- 172.21.15.148:0/3295045335 wait complete. 2023-10-24T01:45:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.956+0000 7f89ebb28700 1 Processor -- start 2023-10-24T01:45:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.956+0000 7f89ebb28700 1 -- start start 2023-10-24T01:45:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa010 0x7f89e40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89e40c6710 0x7f89e40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4164790 con 0x7f89e40aa3f0 2023-10-24T01:45:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41655d0 con 0x7f89e40c6710 2023-10-24T01:45:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ebb28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41649c0 con 0x7f89e40aa010 2023-10-24T01:45:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54144/0 (socket says 172.21.15.148:54144) 2023-10-24T01:45:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 -- 172.21.15.148:0/2176834960 learned_addr learned my addr 172.21.15.148:0/2176834960 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e98c4700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa010 0x7f89e40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89ea0c5700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89e40c6710 0x7f89e40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 -- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa010 msgr2=0x7f89e40aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa010 0x7f89e40aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 -- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89e40c6710 msgr2=0x7f89e40afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89e40c6710 0x7f89e40afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.957+0000 7f89e90c3700 1 -- 172.21.15.148:0/2176834960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009370 con 0x7f89e40aa3f0 2023-10-24T01:45:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89e90c3700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f89d4009ea0 tx=0x7f89d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400b850 con 0x7f89e40aa3f0 2023-10-24T01:45:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400b9b0 con 0x7f89e40aa3f0 2023-10-24T01:45:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e4164ca0 con 0x7f89e40aa3f0 2023-10-24T01:45:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d401d680 con 0x7f89e40aa3f0 2023-10-24T01:45:07.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.958+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e4165260 con 0x7f89e40aa3f0 2023-10-24T01:45:07.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.959+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e406c6b0 con 0x7f89e40aa3f0 2023-10-24T01:45:07.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.959+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f89d401d9f0 con 0x7f89e40aa3f0 2023-10-24T01:45:07.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.960+0000 7f89d9ffb700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 0x7f89c8061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:07.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.960+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f89d407c0a0 con 0x7f89e40aa3f0 2023-10-24T01:45:07.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.960+0000 7f89e98c4700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 0x7f89c8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:07.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.960+0000 7f89e98c4700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 0x7f89c8061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f89e00038c0 tx=0x7f89e0007d40).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:07.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:07.964+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f89d404d2f0 con 0x7f89e40aa3f0 2023-10-24T01:45:08.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.189+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f89e40c1200 con 0x7f89e40aa3f0 2023-10-24T01:45:08.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.827+0000 7f89d9ffb700 1 -- 172.21.15.148:0/2176834960 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2455) v1 ==== 168+0+0 (secure 0 0 0) 0x7f89d4050910 con 0x7f89e40aa3f0 2023-10-24T01:45:08.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 msgr2=0x7f89c8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 0x7f89c8061700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f89e00038c0 tx=0x7f89e0007d40).stop 2023-10-24T01:45:08.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 msgr2=0x7f89e40ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f89d4009ea0 tx=0x7f89d4017000).stop 2023-10-24T01:45:08.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 shutdown_connections 2023-10-24T01:45:08.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89e40c6710 0x7f89e40afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89e40aa010 0x7f89e40aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f89c805f240 0x7f89c8061700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 --2- 172.21.15.148:0/2176834960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89e40aa3f0 0x7f89e40ab800 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 >> 172.21.15.148:0/2176834960 conn(0x7f89e40caf40 msgr2=0x7f89e40cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:08.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 shutdown_connections 2023-10-24T01:45:08.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.829+0000 7f89ebb28700 1 -- 172.21.15.148:0/2176834960 wait complete. 2023-10-24T01:45:08.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T01:45:08.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.961+0000 7f5649ea3700 1 Processor -- start 2023-10-24T01:45:08.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.961+0000 7f5649ea3700 1 -- start start 2023-10-24T01:45:08.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5649ea3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5644154430 0x7f5644154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5649ea3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440c71d0 con 0x7f5644098bd0 2023-10-24T01:45:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5649ea3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56440c9410 con 0x7f56440bffd0 2023-10-24T01:45:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5649ea3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440c6a10 con 0x7f5644154430 2023-10-24T01:45:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f56437fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5644154430 0x7f5644154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5642ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5644098bd0 0x7f56440c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49012/0 (socket says 172.21.15.148:49012) 2023-10-24T01:45:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f5642ffd700 1 -- 172.21.15.148:0/1801739895 learned_addr learned my addr 172.21.15.148:0/1801739895 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.962+0000 7f56437fe700 1 -- 172.21.15.148:0/1801739895 >> v1:172.21.15.150:6789/0 conn(0x7f56440bffd0 legacy=0x7f564415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56437fe700 1 -- 172.21.15.148:0/1801739895 >> v1:172.21.15.148:6789/0 conn(0x7f5644098bd0 legacy=0x7f56440c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56437fe700 1 -- 172.21.15.148:0/1801739895 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440ca8b0 con 0x7f5644154430 2023-10-24T01:45:08.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56437fe700 1 --2- 172.21.15.148:0/1801739895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f5644154810 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f5634009760 tx=0x7f5634009060).ready entity=mon.0 client_cookie=56b7d42f22b8c222 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56427fc700 1 -- 172.21.15.148:0/1801739895 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400b520 con 0x7f5644154430 2023-10-24T01:45:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56427fc700 1 -- 172.21.15.148:0/1801739895 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563400b680 con 0x7f5644154430 2023-10-24T01:45:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f56427fc700 1 -- 172.21.15.148:0/1801739895 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563400ba00 con 0x7f5644154430 2023-10-24T01:45:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 -- 172.21.15.148:0/1801739895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 msgr2=0x7f5644154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1801739895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f5644154810 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f5634009760 tx=0x7f5634009060).stop 2023-10-24T01:45:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 -- 172.21.15.148:0/1801739895 shutdown_connections 2023-10-24T01:45:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1801739895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f5644154810 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 -- 172.21.15.148:0/1801739895 >> 172.21.15.148:0/1801739895 conn(0x7f56440cb070 msgr2=0x7f56440cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 -- 172.21.15.148:0/1801739895 shutdown_connections 2023-10-24T01:45:08.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.963+0000 7f5649ea3700 1 -- 172.21.15.148:0/1801739895 wait complete. 2023-10-24T01:45:08.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 Processor -- start 2023-10-24T01:45:08.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 -- start start 2023-10-24T01:45:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 0x7f56440aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56440bffd0 0x7f5644164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440adb90 con 0x7f5644154430 2023-10-24T01:45:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440ad010 con 0x7f5644098bd0 2023-10-24T01:45:08.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5649ea3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440ad2f0 con 0x7f56440bffd0 2023-10-24T01:45:08.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5643fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:08.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5643fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54162/0 (socket says 172.21.15.148:54162) 2023-10-24T01:45:08.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.965+0000 7f5643fff700 1 -- 172.21.15.148:0/1006026852 learned_addr learned my addr 172.21.15.148:0/1006026852 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:08.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f56437fe700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 0x7f56440aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5642ffd700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56440bffd0 0x7f5644164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 -- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56440bffd0 msgr2=0x7f5644164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56440bffd0 0x7f5644164bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 -- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 msgr2=0x7f56440aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 0x7f56440aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 -- 172.21.15.148:0/1006026852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340092a0 con 0x7f5644154430 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f56437fe700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 0x7f56440aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5643fff700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f563c00c810 tx=0x7f563c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c010510 con 0x7f5644154430 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c0106b0 con 0x7f5644154430 2023-10-24T01:45:08.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c010a70 con 0x7f5644154430 2023-10-24T01:45:08.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56440ad5d0 con 0x7f5644154430 2023-10-24T01:45:08.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.966+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56440ab220 con 0x7f5644154430 2023-10-24T01:45:08.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.967+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440c2470 con 0x7f5644154430 2023-10-24T01:45:08.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.967+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f563c01b400 con 0x7f5644154430 2023-10-24T01:45:08.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.968+0000 7f562b7fe700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 0x7f5630061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:08.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.968+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f563c07a110 con 0x7f5644154430 2023-10-24T01:45:08.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.968+0000 7f56437fe700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 0x7f5630061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:08.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.968+0000 7f56437fe700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 0x7f5630061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5644065370 tx=0x7f5634017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:08.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:08.972+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f563c04b300 con 0x7f5644154430 2023-10-24T01:45:09.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.136+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f564406c6b0 con 0x7f5644154430 2023-10-24T01:45:09.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.139+0000 7f562b7fe700 1 -- 172.21.15.148:0/1006026852 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f563c010e60 con 0x7f5644154430 2023-10-24T01:45:09.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 msgr2=0x7f5630061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 0x7f5630061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f5644065370 tx=0x7f5634017000).stop 2023-10-24T01:45:09.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 msgr2=0x7f56441650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f563c00c810 tx=0x7f563c002560).stop 2023-10-24T01:45:09.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 shutdown_connections 2023-10-24T01:45:09.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f563005f270 0x7f5630061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5644154430 0x7f56441650c0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5644098bd0 0x7f56440aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 --2- 172.21.15.148:0/1006026852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56440bffd0 0x7f5644164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 >> 172.21.15.148:0/1006026852 conn(0x7f56440cb070 msgr2=0x7f5644153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:09.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 shutdown_connections 2023-10-24T01:45:09.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.141+0000 7f5649ea3700 1 -- 172.21.15.148:0/1006026852 wait complete. 2023-10-24T01:45:09.154 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T01:45:09.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:45:09.194 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T01:45:09.237 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T01:45:09.238 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T01:45:09.238 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.351+0000 7fce9fc45700 1 Processor -- start 2023-10-24T01:45:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.351+0000 7fce9fc45700 1 -- start start 2023-10-24T01:45:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9fc45700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce980c1a50 0x7fce9815edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9fc45700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce98155710 con 0x7fce98151cb0 2023-10-24T01:45:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9fc45700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce98154e70 con 0x7fce98154820 2023-10-24T01:45:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9fc45700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce98155150 con 0x7fce980c1a50 2023-10-24T01:45:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9e1e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce980c1a50 0x7fce9815edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9d9e1700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fce98151cb0 0x7fce9806a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49028/0 (socket says 172.21.15.148:49028) 2023-10-24T01:45:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.352+0000 7fce9d9e1700 1 -- 172.21.15.148:0/3349033136 learned_addr learned my addr 172.21.15.148:0/3349033136 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9e1e2700 1 -- 172.21.15.148:0/3349033136 >> v1:172.21.15.150:6789/0 conn(0x7fce98154820 legacy=0x7fce980a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9e1e2700 1 -- 172.21.15.148:0/3349033136 >> v1:172.21.15.148:6789/0 conn(0x7fce98151cb0 legacy=0x7fce9806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9e1e2700 1 -- 172.21.15.148:0/3349033136 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98155430 con 0x7fce980c1a50 2023-10-24T01:45:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9c9df700 1 -- 172.21.15.148:0/3349033136 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492512351 0 0) 0x7fce98155710 con 0x7fce98151cb0 2023-10-24T01:45:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9e1e2700 1 --2- 172.21.15.148:0/3349033136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce9815edc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fce90009e60 tx=0x7fce90009780).ready entity=mon.0 client_cookie=8e8474f2fa2484f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9c9df700 1 -- 172.21.15.148:0/3349033136 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9000e070 con 0x7fce980c1a50 2023-10-24T01:45:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9c9df700 1 -- 172.21.15.148:0/3349033136 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9000bc30 con 0x7fce980c1a50 2023-10-24T01:45:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9c9df700 1 -- 172.21.15.148:0/3349033136 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90012410 con 0x7fce980c1a50 2023-10-24T01:45:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9fc45700 1 -- 172.21.15.148:0/3349033136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 msgr2=0x7fce9815edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3349033136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce9815edc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fce90009e60 tx=0x7fce90009780).stop 2023-10-24T01:45:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9fc45700 1 -- 172.21.15.148:0/3349033136 shutdown_connections 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.353+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3349033136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce9815edc0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.354+0000 7fce9fc45700 1 -- 172.21.15.148:0/3349033136 >> 172.21.15.148:0/3349033136 conn(0x7fce980caf40 msgr2=0x7fce980cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.354+0000 7fce9fc45700 1 -- 172.21.15.148:0/3349033136 shutdown_connections 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.354+0000 7fce9fc45700 1 -- 172.21.15.148:0/3349033136 wait complete. 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.355+0000 7fce9fc45700 1 Processor -- start 2023-10-24T01:45:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.355+0000 7fce9fc45700 1 -- start start 2023-10-24T01:45:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.355+0000 7fce9fc45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.355+0000 7fce9fc45700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce98151cb0 0x7fce98157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 0x7fce98158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce980ab0f0 con 0x7fce980c1a50 2023-10-24T01:45:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce980ad7f0 con 0x7fce98151cb0 2023-10-24T01:45:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce980afc40 con 0x7fce98154820 2023-10-24T01:45:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54186/0 (socket says 172.21.15.148:54186) 2023-10-24T01:45:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 -- 172.21.15.148:0/3081730745 learned_addr learned my addr 172.21.15.148:0/3081730745 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d1e0700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce98151cb0 0x7fce98157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9e1e2700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 0x7fce98158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 -- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 msgr2=0x7fce98158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 0x7fce98158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 -- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce98151cb0 msgr2=0x7fce98157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce98151cb0 0x7fce98157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 -- 172.21.15.148:0/3081730745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90009a20 con 0x7fce980c1a50 2023-10-24T01:45:09.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9e1e2700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 0x7fce98158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:09.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9d9e1700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fce9400c4c0 tx=0x7fce94007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940072e0 con 0x7fce980c1a50 2023-10-24T01:45:09.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94007440 con 0x7fce980c1a50 2023-10-24T01:45:09.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce980aff20 con 0x7fce980c1a50 2023-10-24T01:45:09.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940057a0 con 0x7fce980c1a50 2023-10-24T01:45:09.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.356+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce980b04e0 con 0x7fce980c1a50 2023-10-24T01:45:09.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.357+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9806c6b0 con 0x7fce980c1a50 2023-10-24T01:45:09.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.358+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fce94005b90 con 0x7fce980c1a50 2023-10-24T01:45:09.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.358+0000 7fce8dffb700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.358+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5872+0+0 (secure 0 0 0) 0x7fce94079a10 con 0x7fce980c1a50 2023-10-24T01:45:09.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.358+0000 7fce9d1e0700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.359+0000 7fce9d1e0700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 0x7fce7c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fce98151260 tx=0x7fce88007d40).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.362+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fce9404ac60 con 0x7fce980c1a50 2023-10-24T01:45:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.566+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce980c0520 con 0x7fce980c1a50 2023-10-24T01:45:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.566+0000 7fce8dffb700 1 -- 172.21.15.148:0/3081730745 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fce9404e280 con 0x7fce980c1a50 2023-10-24T01:45:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:09.568 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/4073959906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":4073959906},{"type":"v1","addr":"172.21.15.150:6837","nonce":4073959906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1804539999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1804539999},{"type":"v1","addr":"172.21.15.150:6835","nonce":1804539999}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/3390875664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":3390875664},{"type":"v1","addr":"172.21.15.148:6834","nonce":3390875664}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3788216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3788216017},{"type":"v1","addr":"172.21.15.148:6835","nonce":3788216017}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2023-10-24T01:45:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 msgr2=0x7fce7c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 0x7fce7c061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fce98151260 tx=0x7fce88007d40).stop 2023-10-24T01:45:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 msgr2=0x7fce980ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fce9400c4c0 tx=0x7fce94007c10).stop 2023-10-24T01:45:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 shutdown_connections 2023-10-24T01:45:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce98154820 0x7fce98158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fce7c05f270 0x7fce7c061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce980c1a50 0x7fce980ad300 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 --2- 172.21.15.148:0/3081730745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce98151cb0 0x7fce98157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 >> 172.21.15.148:0/3081730745 conn(0x7fce980caf40 msgr2=0x7fce98063cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 shutdown_connections 2023-10-24T01:45:09.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.568+0000 7fce9fc45700 1 -- 172.21.15.148:0/3081730745 wait complete. 2023-10-24T01:45:09.572 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 58 2023-10-24T01:45:09.581 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T01:45:09.581 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T01:45:09.582 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T01:45:09.582 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:45:09.582 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T01:45:09.583 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T01:45:09.583 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T01:45:09.583 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:45:09.584 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T01:45:09.584 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T01:45:09.584 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T01:45:09.584 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:45:09.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T01:45:09.585 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T01:45:09.585 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T01:45:09.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:45:09.590 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T01:45:09.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T01:45:09.592 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T01:45:09.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T01:45:09.594 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T01:45:09.595 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T01:45:09.596 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T01:45:09.596 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T01:45:09.633 INFO:tasks.ceph.mds.a:Started 2023-10-24T01:45:09.634 DEBUG:teuthology.parallel:result is None 2023-10-24T01:45:09.635 INFO:tasks.ceph.mds.c:Started 2023-10-24T01:45:09.635 DEBUG:teuthology.parallel:result is None 2023-10-24T01:45:09.638 INFO:tasks.ceph.mds.b:Started 2023-10-24T01:45:09.638 DEBUG:teuthology.parallel:result is None 2023-10-24T01:45:09.639 INFO:tasks.ceph.mds.d:Started 2023-10-24T01:45:09.639 DEBUG:teuthology.parallel:result is None 2023-10-24T01:45:09.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T01:45:09.707 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T01:45:09.708 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T01:45:09.718 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T01:45:09.719 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T01:45:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.766+0000 7f38737aa700 1 Processor -- start 2023-10-24T01:45:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.766+0000 7f38737aa700 1 -- start start 2023-10-24T01:45:09.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f38737aa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f386c0a8540 0x7f386c0641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f38737aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0be890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f38737aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c06a960 con 0x7f386c0bed80 2023-10-24T01:45:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f38737aa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c065640 con 0x7f386c0a8540 2023-10-24T01:45:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f38737aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0bf210 con 0x7f386c0c56c0 2023-10-24T01:45:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871546700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f386c0a8540 0x7f386c0641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3870d45700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871d47700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f386c0bed80 0x7f386c154b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:55238/0 (socket says 172.21.15.148:55238) 2023-10-24T01:45:09.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871d47700 1 -- 172.21.15.148:0/1312816726 learned_addr learned my addr 172.21.15.148:0/1312816726 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:09.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871546700 1 -- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 msgr2=0x7f386c0be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871546700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0be890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871546700 1 -- 172.21.15.148:0/1312816726 >> v1:172.21.15.150:6789/0 conn(0x7f386c0bed80 legacy=0x7f386c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3863fff700 1 -- 172.21.15.148:0/1312816726 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015695940 0 0) 0x7f386c06a960 con 0x7f386c0bed80 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3871546700 1 -- 172.21.15.148:0/1312816726 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c064a30 con 0x7f386c0a8540 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.767+0000 7f3870d45700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:09.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f3871546700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c0641e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f385c006fd0 tx=0x7f385c006f40).ready entity=mon.1 client_cookie=59255d6ae39c23f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f3863fff700 1 -- 172.21.15.148:0/1312816726 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c005880 con 0x7f386c0a8540 2023-10-24T01:45:09.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f3863fff700 1 -- 172.21.15.148:0/1312816726 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0059e0 con 0x7f386c0a8540 2023-10-24T01:45:09.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f3863fff700 1 -- 172.21.15.148:0/1312816726 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c005d60 con 0x7f386c0a8540 2023-10-24T01:45:09.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 -- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 msgr2=0x7f386c0641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c0641e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f385c006fd0 tx=0x7f385c006f40).stop 2023-10-24T01:45:09.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 -- 172.21.15.148:0/1312816726 shutdown_connections 2023-10-24T01:45:09.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c0641e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 --2- 172.21.15.148:0/1312816726 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.768+0000 7f38737aa700 1 -- 172.21.15.148:0/1312816726 >> 172.21.15.148:0/1312816726 conn(0x7f386c082f60 msgr2=0x7f386c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.769+0000 7f38737aa700 1 -- 172.21.15.148:0/1312816726 shutdown_connections 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.769+0000 7f38737aa700 1 -- 172.21.15.148:0/1312816726 wait complete. 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.770+0000 7f38737aa700 1 Processor -- start 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.770+0000 7f38737aa700 1 -- start start 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.770+0000 7f38737aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.770+0000 7f38737aa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c165930 con 0x7f386c0bed80 2023-10-24T01:45:09.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1647f0 con 0x7f386c0a8540 2023-10-24T01:45:09.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c164a30 con 0x7f386c0c56c0 2023-10-24T01:45:09.778 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54218/0 (socket says 172.21.15.148:54218) 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 -- 172.21.15.148:0/1928824342 learned_addr learned my addr 172.21.15.148:0/1928824342 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3871546700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3871d47700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 -- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 msgr2=0x7f386c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 -- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 msgr2=0x7f386c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 -- 172.21.15.148:0/1928824342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680092a0 con 0x7f386c0bed80 2023-10-24T01:45:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f3870d45700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f386800ea20 tx=0x7f3868009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800ee60 con 0x7f386c0bed80 2023-10-24T01:45:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800c850 con 0x7f386c0bed80 2023-10-24T01:45:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c009250 con 0x7f386c0bed80 2023-10-24T01:45:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800cbd0 con 0x7f386c0bed80 2023-10-24T01:45:09.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.771+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c164fb0 con 0x7f386c0bed80 2023-10-24T01:45:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.772+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c0abe40 con 0x7f386c0bed80 2023-10-24T01:45:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.773+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f386801b400 con 0x7f386c0bed80 2023-10-24T01:45:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.773+0000 7f38617fa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 0x7f3850061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:09.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.773+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5872+0+0 (secure 0 0 0) 0x7f386807a790 con 0x7f386c0bed80 2023-10-24T01:45:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.773+0000 7f3871546700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 0x7f3850061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.774+0000 7f3871546700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 0x7f3850061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f385c006fa0 tx=0x7f385c016000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:09.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.777+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f386804b980 con 0x7f386c0bed80 2023-10-24T01:45:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:09.956+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f386c064d10 con 0x7f386c0bed80 2023-10-24T01:45:10.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.837+0000 7f38617fa700 1 -- 172.21.15.148:0/1928824342 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v177) v1 ==== 97+0+0 (secure 0 0 0) 0x7f386804efa0 con 0x7f386c0bed80 2023-10-24T01:45:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 msgr2=0x7f3850061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 0x7f3850061730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f385c006fa0 tx=0x7f385c016000).stop 2023-10-24T01:45:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 msgr2=0x7f386c0aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.841 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f386800ea20 tx=0x7f3868009060).stop 2023-10-24T01:45:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 shutdown_connections 2023-10-24T01:45:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f386c0c56c0 0x7f386c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f386c0a8540 0x7f386c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f385005f270 0x7f3850061730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 --2- 172.21.15.148:0/1928824342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f386c0bed80 0x7f386c0aa6f0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 >> 172.21.15.148:0/1928824342 conn(0x7f386c082f60 msgr2=0x7f386c0c4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:10.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 shutdown_connections 2023-10-24T01:45:10.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.840+0000 7f38737aa700 1 -- 172.21.15.148:0/1928824342 wait complete. 2023-10-24T01:45:10.844 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T01:45:10.854 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T01:45:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.968+0000 7fec6306b700 1 Processor -- start 2023-10-24T01:45:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.968+0000 7fec6306b700 1 -- start start 2023-10-24T01:45:10.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.969+0000 7fec6306b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 0x7fec5c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.969+0000 7fec6306b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec5c0aa3f0 0x7fec5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.969+0000 7fec6306b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0aa880 con 0x7fec5c0aa010 2023-10-24T01:45:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.969+0000 7fec6306b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0c0960 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.969+0000 7fec6306b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c0c40 con 0x7fec5c0c6710 2023-10-24T01:45:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec60e07700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fec5c0aa010 0x7fec5c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49036/0 (socket says 172.21.15.148:49036) 2023-10-24T01:45:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec60e07700 1 -- 172.21.15.148:0/3166057778 learned_addr learned my addr 172.21.15.148:0/3166057778 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 --2- 172.21.15.148:0/3166057778 >> v2:172.21.15.150:3300/0 conn(0x7fec5c0aa3f0 0x7fec5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec53fff700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 0x7fec5c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409686487 0 0) 0x7fec58001490 con 0x7fec5c0aa010 2023-10-24T01:45:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec440033f0 con 0x7fec5c0aa010 2023-10-24T01:45:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3578871660 0 0) 0x7fec440033f0 con 0x7fec5c0aa010 2023-10-24T01:45:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 -- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 msgr2=0x7fec5c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 0x7fec5c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 -- 172.21.15.148:0/3166057778 >> v1:172.21.15.148:6789/0 conn(0x7fec5c0aa010 legacy=0x7fec5c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 -- 172.21.15.148:0/3166057778 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0c0f20 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec53fff700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 0x7fec5c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec61608700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0aa3f0 0x7fec5c069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54009060).ready entity=mon.1 client_cookie=75637952d5d84ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58001980 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54011400 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.970+0000 7fec537fe700 1 -- 172.21.15.148:0/3166057778 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011780 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 -- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0aa3f0 msgr2=0x7fec5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0aa3f0 0x7fec5c069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fec54009760 tx=0x7fec54009060).stop 2023-10-24T01:45:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 -- 172.21.15.148:0/3166057778 shutdown_connections 2023-10-24T01:45:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0aa3f0 0x7fec5c069d80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 --2- 172.21.15.148:0/3166057778 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0c6710 0x7fec5c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 -- 172.21.15.148:0/3166057778 >> 172.21.15.148:0/3166057778 conn(0x7fec5c0caf40 msgr2=0x7fec5c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:10.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 -- 172.21.15.148:0/3166057778 shutdown_connections 2023-10-24T01:45:10.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.971+0000 7fec6306b700 1 -- 172.21.15.148:0/3166057778 wait complete. 2023-10-24T01:45:10.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.972+0000 7fec6306b700 1 Processor -- start 2023-10-24T01:45:10.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.972+0000 7fec6306b700 1 -- start start 2023-10-24T01:45:10.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 0x7fec5c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 0x7fec5c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c164560 con 0x7fec5c0aa010 2023-10-24T01:45:10.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c164840 con 0x7fec5c0c6710 2023-10-24T01:45:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec6306b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c164b20 con 0x7fec5c0aa3f0 2023-10-24T01:45:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec60e07700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec60e07700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54226/0 (socket says 172.21.15.148:54226) 2023-10-24T01:45:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.973+0000 7fec60e07700 1 -- 172.21.15.148:0/2457888946 learned_addr learned my addr 172.21.15.148:0/2457888946 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec61608700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 0x7fec5c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec53fff700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 0x7fec5c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 -- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 msgr2=0x7fec5c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 0x7fec5c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 -- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 msgr2=0x7fec5c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 0x7fec5c152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:10.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 -- 172.21.15.148:0/2457888946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0092a0 con 0x7fec5c0aa010 2023-10-24T01:45:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec61608700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 0x7fec5c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec53fff700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 0x7fec5c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec60e07700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fec5800cb70 tx=0x7fec580017d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58004c40 con 0x7fec5c0aa010 2023-10-24T01:45:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540092a0 con 0x7fec5c0aa010 2023-10-24T01:45:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58004da0 con 0x7fec5c0aa010 2023-10-24T01:45:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580073a0 con 0x7fec5c0aa010 2023-10-24T01:45:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.974+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c1673d0 con 0x7fec5c0aa010 2023-10-24T01:45:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.975+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c063f90 con 0x7fec5c0aa010 2023-10-24T01:45:10.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.975+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec58007790 con 0x7fec5c0aa010 2023-10-24T01:45:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.976+0000 7fec50ff9700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 0x7fec48061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.976+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fec58079f30 con 0x7fec5c0aa010 2023-10-24T01:45:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.976+0000 7fec53fff700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 0x7fec48061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.976+0000 7fec53fff700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 0x7fec48061700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fec4c009270 tx=0x7fec4c008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:10.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:10.980+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fec5804b3a0 con 0x7fec5c0aa010 2023-10-24T01:45:11.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.205+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fec5c0aa880 con 0x7fec5c0aa010 2023-10-24T01:45:11.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.206+0000 7fec50ff9700 1 -- 172.21.15.148:0/2457888946 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fec5c0aa880 con 0x7fec5c0aa010 2023-10-24T01:45:11.207 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:11.207 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T01:45:11.207 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T01:45:11.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.208 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T01:45:11.208 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T01:45:11.208 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.208 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.209 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:45:11.209 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:45:11.209 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.210 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T01:45:11.210 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T01:45:11.210 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.212 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T01:45:11.212 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.214 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T01:45:11.214 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T01:45:11.214 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:45:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:45:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.216 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T01:45:11.216 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.218 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T01:45:11.218 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T01:45:11.218 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.218 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.219 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.219 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.219 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.220 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.221 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T01:45:11.221 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T01:45:11.222 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.222 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.222 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.222 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.223 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T01:45:11.223 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T01:45:11.223 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.225 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T01:45:11.225 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T01:45:11.225 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.225 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.225 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.226 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.226 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.227 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T01:45:11.227 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T01:45:11.227 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.227 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.227 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T01:45:11.228 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T01:45:11.229 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.229 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T01:45:11.229 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T01:45:11.229 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.230 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T01:45:11.230 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T01:45:11.230 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.231 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.231 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T01:45:11.231 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T01:45:11.231 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.232 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T01:45:11.232 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T01:45:11.232 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.233 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.233 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:45:11.233 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:45:11.233 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:45:11.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.234 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T01:45:11.234 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T01:45:11.234 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.235 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.235 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:45:11.235 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:45:11.235 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:45:11.235 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.236 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T01:45:11.236 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T01:45:11.237 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.237 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T01:45:11.237 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T01:45:11.237 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T01:45:11.237 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T01:45:11.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.238 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T01:45:11.238 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T01:45:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T01:45:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:11.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:11.242 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T01:45:11.242 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T01:45:11.242 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T01:45:11.242 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T01:45:11.243 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T01:45:11.243 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T01:45:11.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:11.243 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T01:45:11.244 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T01:45:11.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 msgr2=0x7fec48061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 0x7fec48061700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fec4c009270 tx=0x7fec4c008040).stop 2023-10-24T01:45:11.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 msgr2=0x7fec5c166ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fec5800cb70 tx=0x7fec580017d0).stop 2023-10-24T01:45:11.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 shutdown_connections 2023-10-24T01:45:11.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c0c6710 0x7fec5c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fec4805f240 0x7fec48061700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec5c0aa010 0x7fec5c166ee0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 --2- 172.21.15.148:0/2457888946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c0aa3f0 0x7fec5c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 >> 172.21.15.148:0/2457888946 conn(0x7fec5c0caf40 msgr2=0x7fec5c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 shutdown_connections 2023-10-24T01:45:11.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.208+0000 7fec6306b700 1 -- 172.21.15.148:0/2457888946 wait complete. 2023-10-24T01:45:11.248 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:11.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.360+0000 7f41c6260700 1 Processor -- start 2023-10-24T01:45:11.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.360+0000 7f41c6260700 1 -- start start 2023-10-24T01:45:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c6260700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f41c0151750 0x7f41c0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c6260700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c0152760 con 0x7f41c0065d30 2023-10-24T01:45:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c6260700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00c3490 con 0x7f41c014ec20 2023-10-24T01:45:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c6260700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00bd140 con 0x7f41c0151750 2023-10-24T01:45:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c5a5f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f41c0065d30 0x7f41c00c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49040/0 (socket says 172.21.15.148:49040) 2023-10-24T01:45:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c5a5f700 1 -- 172.21.15.148:0/180346982 learned_addr learned my addr 172.21.15.148:0/180346982 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41c4a5d700 1 --2- 172.21.15.148:0/180346982 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151750 0x7f41c0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365991059 0 0) 0x7f41b0001110 con 0x7f41c0065d30 2023-10-24T01:45:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a80033f0 con 0x7f41c0065d30 2023-10-24T01:45:11.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611641939 0 0) 0x7f41a80033f0 con 0x7f41c0065d30 2023-10-24T01:45:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151750 msgr2=0x7f41c0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 --2- 172.21.15.148:0/180346982 >> v2:172.21.15.150:3300/0 conn(0x7f41c0151750 0x7f41c0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 >> v1:172.21.15.150:6789/0 conn(0x7f41c014ec20 legacy=0x7f41c00bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.361+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00c2e80 con 0x7f41c0065d30 2023-10-24T01:45:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f41b0001600 con 0x7f41c0065d30 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 >> v1:172.21.15.148:6789/0 conn(0x7f41c0065d30 legacy=0x7f41c00c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 0x7f41a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a8004690 0x7f41a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41a8005000 0x7f41a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00bd140 con 0x7f41a80038e0 2023-10-24T01:45:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a800beb0 con 0x7f41a8004690 2023-10-24T01:45:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a800c070 con 0x7f41a8005000 2023-10-24T01:45:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 0x7f41a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c4a5d700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a8004690 0x7f41a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c5a5f700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41a8005000 0x7f41a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 -- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41a8005000 msgr2=0x7f41a800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41a8005000 0x7f41a800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 -- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a8004690 msgr2=0x7f41a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a8004690 0x7f41a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 -- 172.21.15.148:0/180346982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80033f0 con 0x7f41a80038e0 2023-10-24T01:45:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c5a5f700 1 -- 172.21.15.148:0/180346982 reap_dead start 2023-10-24T01:45:11.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41c525e700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 0x7f41a8003d00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f41b8001730 tx=0x7f41b8007bb0).ready entity=mon.0 client_cookie=4d39744a391ed133 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8007020 con 0x7f41a80038e0 2023-10-24T01:45:11.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8007180 con 0x7f41a80038e0 2023-10-24T01:45:11.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.362+0000 7f41bffff700 1 -- 172.21.15.148:0/180346982 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8007520 con 0x7f41a80038e0 2023-10-24T01:45:11.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 -- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 msgr2=0x7f41a8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 0x7f41a8003d00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f41b8001730 tx=0x7f41b8007bb0).stop 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 -- 172.21.15.148:0/180346982 shutdown_connections 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 --2- 172.21.15.148:0/180346982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41a80038e0 0x7f41a8003d00 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 -- 172.21.15.148:0/180346982 >> 172.21.15.148:0/180346982 conn(0x7f41c00c7ad0 msgr2=0x7f41c00c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 -- 172.21.15.148:0/180346982 shutdown_connections 2023-10-24T01:45:11.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.363+0000 7f41c6260700 1 -- 172.21.15.148:0/180346982 wait complete. 2023-10-24T01:45:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.364+0000 7f41c6260700 1 Processor -- start 2023-10-24T01:45:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.364+0000 7f41c6260700 1 -- start start 2023-10-24T01:45:11.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a80038e0 0x7f41c01664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c00c71a0 0x7f41c0069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00abf00 con 0x7f41c00acfa0 2023-10-24T01:45:11.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00ac1e0 con 0x7f41a80038e0 2023-10-24T01:45:11.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c6260700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00ac4c0 con 0x7f41c00c71a0 2023-10-24T01:45:11.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54244/0 (socket says 172.21.15.148:54244) 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 -- 172.21.15.148:0/3523084279 learned_addr learned my addr 172.21.15.148:0/3523084279 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c5a5f700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c00c71a0 0x7f41c0069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c525e700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a80038e0 0x7f41c01664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 -- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c00c71a0 msgr2=0x7f41c0069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c00c71a0 0x7f41c0069170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 -- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a80038e0 msgr2=0x7f41c01664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a80038e0 0x7f41c01664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 -- 172.21.15.148:0/3523084279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00ac7a0 con 0x7f41c00acfa0 2023-10-24T01:45:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.365+0000 7f41c4a5d700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f41b4009e20 tx=0x7f41b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.366+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400e040 con 0x7f41c00acfa0 2023-10-24T01:45:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.366+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b400f040 con 0x7f41c00acfa0 2023-10-24T01:45:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.366+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00aca80 con 0x7f41c00acfa0 2023-10-24T01:45:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.366+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400fe50 con 0x7f41c00acfa0 2023-10-24T01:45:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.366+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c0135ea0 con 0x7f41c00acfa0 2023-10-24T01:45:11.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.367+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c00acdf0 con 0x7f41c00acfa0 2023-10-24T01:45:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.367+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f41b4015660 con 0x7f41c00acfa0 2023-10-24T01:45:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.367+0000 7f41bd7fa700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 0x7f41ac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.367+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f41b407add0 con 0x7f41c00acfa0 2023-10-24T01:45:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.368+0000 7f41c525e700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 0x7f41ac061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.368+0000 7f41c525e700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 0x7f41ac061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f41b8000c00 tx=0x7f41b8015000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.371+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f41b404c240 con 0x7f41c00acfa0 2023-10-24T01:45:11.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.538+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41c0047480 con 0x7f41c00acfa0 2023-10-24T01:45:11.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.538+0000 7f41bd7fa700 1 -- 172.21.15.148:0/3523084279 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+13842 (secure 0 0 0) 0x7f41b404f860 con 0x7f41c00acfa0 2023-10-24T01:45:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:11.541 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":177,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:45:10.829894+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:11.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 msgr2=0x7f41ac061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 0x7f41ac061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f41b8000c00 tx=0x7f41b8015000).stop 2023-10-24T01:45:11.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 msgr2=0x7f41c01359b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f41b4009e20 tx=0x7f41b400b040).stop 2023-10-24T01:45:11.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 shutdown_connections 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41c00c71a0 0x7f41c0069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41a80038e0 0x7f41c01664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f41ac05f270 0x7f41ac061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 --2- 172.21.15.148:0/3523084279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41c00acfa0 0x7f41c01359b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 >> 172.21.15.148:0/3523084279 conn(0x7f41c00c7ad0 msgr2=0x7f41c0153380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 shutdown_connections 2023-10-24T01:45:11.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.540+0000 7f41c6260700 1 -- 172.21.15.148:0/3523084279 wait complete. 2023-10-24T01:45:11.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T01:45:11.555 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T01:45:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.671+0000 7f917fdec700 1 Processor -- start 2023-10-24T01:45:11.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.671+0000 7f917fdec700 1 -- start start 2023-10-24T01:45:11.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917fdec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9178154430 0x7f9178154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917fdec700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780c71d0 con 0x7f9178098bd0 2023-10-24T01:45:11.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917fdec700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780c9410 con 0x7f91780bffd0 2023-10-24T01:45:11.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917fdec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91780c6a10 con 0x7f9178154430 2023-10-24T01:45:11.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917d387700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9178098bd0 0x7f91780c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49056/0 (socket says 172.21.15.148:49056) 2023-10-24T01:45:11.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917d387700 1 -- 172.21.15.148:0/4153625381 learned_addr learned my addr 172.21.15.148:0/4153625381 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:11.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.672+0000 7f917db88700 1 --2- 172.21.15.148:0/4153625381 >> v2:172.21.15.150:3300/0 conn(0x7f9178154430 0x7f9178154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162003627 0 0) 0x7f91780c71d0 con 0x7f9178098bd0 2023-10-24T01:45:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91640033f0 con 0x7f9178098bd0 2023-10-24T01:45:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006103674 0 0) 0x7f91640033f0 con 0x7f9178098bd0 2023-10-24T01:45:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 >> v2:172.21.15.150:3300/0 conn(0x7f9178154430 msgr2=0x7f9178154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 --2- 172.21.15.148:0/4153625381 >> v2:172.21.15.150:3300/0 conn(0x7f9178154430 0x7f9178154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 >> v1:172.21.15.150:6789/0 conn(0x7f91780bffd0 legacy=0x7f917815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780ca8b0 con 0x7f9178098bd0 2023-10-24T01:45:11.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f9168001470 con 0x7f9178098bd0 2023-10-24T01:45:11.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 >> v1:172.21.15.148:6789/0 conn(0x7f9178098bd0 legacy=0x7f91780c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91640038e0 0x7f9164003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9164004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9164005000 0x7f916400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c6a10 con 0x7f9164004690 2023-10-24T01:45:11.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bf60 con 0x7f91640038e0 2023-10-24T01:45:11.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916400c0f0 con 0x7f9164005000 2023-10-24T01:45:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9164004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917db88700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91640038e0 0x7f9164003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917e389700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9164005000 0x7f916400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 -- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9164005000 msgr2=0x7f916400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9164005000 0x7f916400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 -- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91640038e0 msgr2=0x7f9164003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91640038e0 0x7f9164003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 -- 172.21.15.148:0/4153625381 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640033f0 con 0x7f9164004690 2023-10-24T01:45:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917e389700 1 -- 172.21.15.148:0/4153625381 reap_dead start 2023-10-24T01:45:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.673+0000 7f917d387700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9164004b10 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f916800c190 tx=0x7f9168001e50).ready entity=mon.0 client_cookie=a33d528010f40da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168007a20 con 0x7f9164004690 2023-10-24T01:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800cac0 con 0x7f9164004690 2023-10-24T01:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917cb86700 1 -- 172.21.15.148:0/4153625381 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800ce40 con 0x7f9164004690 2023-10-24T01:45:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 -- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 msgr2=0x7f9164004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9164004b10 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f916800c190 tx=0x7f9168001e50).stop 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 -- 172.21.15.148:0/4153625381 shutdown_connections 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 --2- 172.21.15.148:0/4153625381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9164004b10 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 -- 172.21.15.148:0/4153625381 >> 172.21.15.148:0/4153625381 conn(0x7f91780cb070 msgr2=0x7f91780cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 -- 172.21.15.148:0/4153625381 shutdown_connections 2023-10-24T01:45:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.674+0000 7f917fdec700 1 -- 172.21.15.148:0/4153625381 wait complete. 2023-10-24T01:45:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.675+0000 7f917fdec700 1 Processor -- start 2023-10-24T01:45:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.675+0000 7f917fdec700 1 -- start start 2023-10-24T01:45:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 0x7f91780ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 0x7f91780afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9178149360 con 0x7f9164004690 2023-10-24T01:45:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780af8d0 con 0x7f91780ad960 2023-10-24T01:45:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917fdec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91781486b0 con 0x7f91780c45b0 2023-10-24T01:45:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54264/0 (socket says 172.21.15.148:54264) 2023-10-24T01:45:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 -- 172.21.15.148:0/4292251567 learned_addr learned my addr 172.21.15.148:0/4292251567 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917e389700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 0x7f91780afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917d387700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 0x7f91780ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 -- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 msgr2=0x7f91780ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 0x7f91780ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 -- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 msgr2=0x7f91780afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 0x7f91780afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917db88700 1 -- 172.21.15.148:0/4292251567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780af310 con 0x7f9164004690 2023-10-24T01:45:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917d387700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 0x7f91780ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.676+0000 7f917e389700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 0x7f91780afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f917db88700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f9174011f80 tx=0x7f917400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400e040 con 0x7f9164004690 2023-10-24T01:45:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400f040 con 0x7f9164004690 2023-10-24T01:45:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174015660 con 0x7f9164004690 2023-10-24T01:45:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91780af5f0 con 0x7f9164004690 2023-10-24T01:45:11.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.677+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780c4a30 con 0x7f9164004690 2023-10-24T01:45:11.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.678+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178148b90 con 0x7f9164004690 2023-10-24T01:45:11.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.678+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9174015a50 con 0x7f9164004690 2023-10-24T01:45:11.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.679+0000 7f916dffb700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 0x7f915c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.679+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f917407b200 con 0x7f9164004690 2023-10-24T01:45:11.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.679+0000 7f917d387700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 0x7f915c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.679+0000 7f917d387700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 0x7f915c061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f91780ae110 tx=0x7f9168015000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.683+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f917404c670 con 0x7f9164004690 2023-10-24T01:45:11.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.845+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f91781484d0 con 0x7f9164004690 2023-10-24T01:45:11.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.845+0000 7f916dffb700 1 -- 172.21.15.148:0/4292251567 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v177) v1 ==== 110+0+10 (secure 0 0 0) 0x7f917404fc90 con 0x7f9164004690 2023-10-24T01:45:11.848 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T01:45:11.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.847+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 msgr2=0x7f915c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.847+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 0x7f915c061700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f91780ae110 tx=0x7f9168015000).stop 2023-10-24T01:45:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.847+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 msgr2=0x7f9178148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.847+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f9174011f80 tx=0x7f917400b040).stop 2023-10-24T01:45:11.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 shutdown_connections 2023-10-24T01:45:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91780ad960 0x7f91780afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f915c05f240 0x7f915c061700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164004690 0x7f9178148e70 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 --2- 172.21.15.148:0/4292251567 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91780c45b0 0x7f91780ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 >> 172.21.15.148:0/4292251567 conn(0x7f91780cb070 msgr2=0x7f91780c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 shutdown_connections 2023-10-24T01:45:11.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.848+0000 7f917fdec700 1 -- 172.21.15.148:0/4292251567 wait complete. 2023-10-24T01:45:11.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T01:45:11.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.976+0000 7eff60c34700 1 Processor -- start 2023-10-24T01:45:11.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.976+0000 7eff60c34700 1 -- start start 2023-10-24T01:45:11.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff60c34700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff5c0c06e0 0x7eff5c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff60c34700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c0c71d0 con 0x7eff5c098bd0 2023-10-24T01:45:11.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff60c34700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c0c9410 con 0x7eff5c154430 2023-10-24T01:45:11.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff60c34700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5c0c6a10 con 0x7eff5c0c06e0 2023-10-24T01:45:11.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff5ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff5c0c06e0 0x7eff5c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff5ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff5c0c06e0 0x7eff5c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54266/0 (socket says 172.21.15.148:54266) 2023-10-24T01:45:11.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff51d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7eff5c098bd0 0x7eff5c0bffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49062/0 (socket says 172.21.15.148:49062) 2023-10-24T01:45:11.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.977+0000 7eff5ad9d700 1 -- 172.21.15.148:0/787385146 learned_addr learned my addr 172.21.15.148:0/787385146 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:11.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff5ad9d700 1 -- 172.21.15.148:0/787385146 >> v1:172.21.15.150:6789/0 conn(0x7eff5c154430 legacy=0x7eff5c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:11.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff5ad9d700 1 -- 172.21.15.148:0/787385146 >> v1:172.21.15.148:6789/0 conn(0x7eff5c098bd0 legacy=0x7eff5c0bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff5ad9d700 1 -- 172.21.15.148:0/787385146 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0ca8b0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff59d9b700 1 -- 172.21.15.148:0/787385146 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455587130 0 0) 0x7eff5c0c71d0 con 0x7eff5c098bd0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff5ad9d700 1 --2- 172.21.15.148:0/787385146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c154810 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7eff54009f20 tx=0x7eff54009840).ready entity=mon.0 client_cookie=d1d29ef5ee3d3cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff59d9b700 1 -- 172.21.15.148:0/787385146 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400e070 con 0x7eff5c0c06e0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff59d9b700 1 -- 172.21.15.148:0/787385146 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400ba40 con 0x7eff5c0c06e0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff59d9b700 1 -- 172.21.15.148:0/787385146 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400bdc0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 -- 172.21.15.148:0/787385146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 msgr2=0x7eff5c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 --2- 172.21.15.148:0/787385146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c154810 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7eff54009f20 tx=0x7eff54009840).stop 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 -- 172.21.15.148:0/787385146 shutdown_connections 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 --2- 172.21.15.148:0/787385146 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c154810 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 -- 172.21.15.148:0/787385146 >> 172.21.15.148:0/787385146 conn(0x7eff5c0cb070 msgr2=0x7eff5c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 -- 172.21.15.148:0/787385146 shutdown_connections 2023-10-24T01:45:11.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.978+0000 7eff60c34700 1 -- 172.21.15.148:0/787385146 wait complete. 2023-10-24T01:45:11.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 Processor -- start 2023-10-24T01:45:11.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 -- start start 2023-10-24T01:45:11.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff5c098bd0 0x7eff5c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff5c154430 0x7eff5c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c167e00 con 0x7eff5c0c06e0 2023-10-24T01:45:11.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c153aa0 con 0x7eff5c098bd0 2023-10-24T01:45:11.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff60c34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0ac210 con 0x7eff5c154430 2023-10-24T01:45:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.980+0000 7eff51d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54276/0 (socket says 172.21.15.148:54276) 2023-10-24T01:45:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 -- 172.21.15.148:0/2476817258 learned_addr learned my addr 172.21.15.148:0/2476817258 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 -- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff5c154430 msgr2=0x7eff5c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff5c154430 0x7eff5c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 -- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff5c098bd0 msgr2=0x7eff5c150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff5c098bd0 0x7eff5c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 -- 172.21.15.148:0/2476817258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54009ae0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff51d9b700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7eff4400c4c0 tx=0x7eff44007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440072e0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44007440 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44005930 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0abf00 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.981+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0aef70 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.982+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c06c6b0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.982+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7eff44005ca0 con 0x7eff5c0c06e0 2023-10-24T01:45:11.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.983+0000 7eff52ffd700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 0x7eff3c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:11.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.983+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7eff44079880 con 0x7eff5c0c06e0 2023-10-24T01:45:11.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.983+0000 7eff5a59c700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 0x7eff3c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:11.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.983+0000 7eff5a59c700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 0x7eff3c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7eff4c0095d0 tx=0x7eff4c006ae0).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:11.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:11.987+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff4404ada0 con 0x7eff5c0c06e0 2023-10-24T01:45:12.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.148+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff5c0c6c10 con 0x7eff5c0c06e0 2023-10-24T01:45:12.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.148+0000 7eff52ffd700 1 -- 172.21.15.148:0/2476817258 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v177) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff4404e3c0 con 0x7eff5c0c06e0 2023-10-24T01:45:12.151 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T01:45:12.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 msgr2=0x7eff3c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 0x7eff3c061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7eff4c0095d0 tx=0x7eff4c006ae0).stop 2023-10-24T01:45:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 msgr2=0x7eff5c1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7eff4400c4c0 tx=0x7eff44007c10).stop 2023-10-24T01:45:12.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 shutdown_connections 2023-10-24T01:45:12.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff5c154430 0x7eff5c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:12.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff5c098bd0 0x7eff5c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:12.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7eff3c05f270 0x7eff3c061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 --2- 172.21.15.148:0/2476817258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff5c0c06e0 0x7eff5c1530c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 >> 172.21.15.148:0/2476817258 conn(0x7eff5c0cb070 msgr2=0x7eff5c0a8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 shutdown_connections 2023-10-24T01:45:12.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.150+0000 7eff60c34700 1 -- 172.21.15.148:0/2476817258 wait complete. 2023-10-24T01:45:12.164 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T01:45:12.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.276+0000 7f08c1191700 1 Processor -- start 2023-10-24T01:45:12.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.276+0000 7f08c1191700 1 -- start start 2023-10-24T01:45:12.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08c1191700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08bc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08c1191700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f08bc0aa3f0 0x7f08bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08c1191700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0aa880 con 0x7f08bc0aa010 2023-10-24T01:45:12.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08c1191700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0c0960 con 0x7f08bc0aa3f0 2023-10-24T01:45:12.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08c1191700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c0c40 con 0x7f08bc0c6710 2023-10-24T01:45:12.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08bad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f08bc0aa010 0x7f08bc158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:49072/0 (socket says 172.21.15.148:49072) 2023-10-24T01:45:12.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08bad9d700 1 -- 172.21.15.148:0/3221307102 learned_addr learned my addr 172.21.15.148:0/3221307102 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:12.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08b3fff700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08bc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> v2:172.21.15.150:3300/0 conn(0x7f08bc0aa3f0 0x7f08bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222354837 0 0) 0x7f08ac001110 con 0x7f08bc0aa010 2023-10-24T01:45:12.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.277+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a80033f0 con 0x7f08bc0aa010 2023-10-24T01:45:12.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1689695675 0 0) 0x7f08a80033f0 con 0x7f08bc0aa010 2023-10-24T01:45:12.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 msgr2=0x7f08bc0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08bc0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 >> v2:172.21.15.150:3300/0 conn(0x7f08bc0aa3f0 msgr2=0x7f08bc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 --2- 172.21.15.148:0/3221307102 >> v2:172.21.15.150:3300/0 conn(0x7f08bc0aa3f0 0x7f08bc069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0c0f20 con 0x7f08bc0aa010 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f08ac001600 con 0x7f08bc0aa010 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> v2:172.21.15.150:3300/0 conn(0x7f08bc0aa3f0 0x7f08bc069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 >> v1:172.21.15.148:6789/0 conn(0x7f08bc0aa010 legacy=0x7f08bc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a80038e0 0x7f08a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08a8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c0960 con 0x7f08a8004b80 2023-10-24T01:45:12.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c0c40 con 0x7f08a80038e0 2023-10-24T01:45:12.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800b8e0 con 0x7f08bc0c6710 2023-10-24T01:45:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08a8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bad9d700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a80038e0 0x7f08a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08b3fff700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 -- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 msgr2=0x7f08a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc0c6710 0x7f08a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 -- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a80038e0 msgr2=0x7f08a8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a80038e0 0x7f08a8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 -- 172.21.15.148:0/3221307102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80033f0 con 0x7f08a8004b80 2023-10-24T01:45:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08bb59e700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08a8005000 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f08b400e3c0 tx=0x7f08b400b040).ready entity=mon.0 client_cookie=66279750c9e19fcc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4009c50 con 0x7f08a8004b80 2023-10-24T01:45:12.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400f040 con 0x7f08a8004b80 2023-10-24T01:45:12.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.278+0000 7f08ba59c700 1 -- 172.21.15.148:0/3221307102 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400ee80 con 0x7f08a8004b80 2023-10-24T01:45:12.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 -- 172.21.15.148:0/3221307102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 msgr2=0x7f08a8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 --2- 172.21.15.148:0/3221307102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08a8005000 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f08b400e3c0 tx=0x7f08b400b040).stop 2023-10-24T01:45:12.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08bb59e700 1 -- 172.21.15.148:0/3221307102 reap_dead start 2023-10-24T01:45:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 -- 172.21.15.148:0/3221307102 shutdown_connections 2023-10-24T01:45:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 -- 172.21.15.148:0/3221307102 >> 172.21.15.148:0/3221307102 conn(0x7f08bc0caf40 msgr2=0x7f08bc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 -- 172.21.15.148:0/3221307102 shutdown_connections 2023-10-24T01:45:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.279+0000 7f08c1191700 1 -- 172.21.15.148:0/3221307102 wait complete. 2023-10-24T01:45:12.290 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.280+0000 7f08c1191700 1 Processor -- start 2023-10-24T01:45:12.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.280+0000 7f08c1191700 1 -- start start 2023-10-24T01:45:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 0x7f08bc0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc153870 0x7f08bc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0c2810 con 0x7f08a8004b80 2023-10-24T01:45:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc154d30 con 0x7f08bc145a70 2023-10-24T01:45:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08c1191700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc1552f0 con 0x7f08bc153870 2023-10-24T01:45:12.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54292/0 (socket says 172.21.15.148:54292) 2023-10-24T01:45:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 -- 172.21.15.148:0/490698482 learned_addr learned my addr 172.21.15.148:0/490698482 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08b3fff700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 0x7f08bc0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bb59e700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc153870 0x7f08bc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 -- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc153870 msgr2=0x7f08bc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc153870 0x7f08bc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 -- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 msgr2=0x7f08bc0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 0x7f08bc0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 -- 172.21.15.148:0/490698482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc1541e0 con 0x7f08a8004b80 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08b3fff700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 0x7f08bc0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:12.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08bad9d700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f08ac004a40 tx=0x7f08bc0c6390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.281+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac001100 con 0x7f08a8004b80 2023-10-24T01:45:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.282+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00f8d0 con 0x7f08a8004b80 2023-10-24T01:45:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.282+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0c4ee0 con 0x7f08a8004b80 2023-10-24T01:45:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.282+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00fc70 con 0x7f08a8004b80 2023-10-24T01:45:12.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.282+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc154f80 con 0x7f08a8004b80 2023-10-24T01:45:12.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.283+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc06c6b0 con 0x7f08a8004b80 2023-10-24T01:45:12.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.283+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f08ac015410 con 0x7f08a8004b80 2023-10-24T01:45:12.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.283+0000 7f08b2ffd700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 0x7f089c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.283+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f08ac07a090 con 0x7f08a8004b80 2023-10-24T01:45:12.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.283+0000 7f08b3fff700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 0x7f089c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.284+0000 7f08b3fff700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 0x7f089c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f08a4006d30 tx=0x7f08a4008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.287+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f08ac04b560 con 0x7f08a8004b80 2023-10-24T01:45:12.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.453+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f08bc0aa880 con 0x7f08a8004b80 2023-10-24T01:45:12.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.454+0000 7f08b2ffd700 1 -- 172.21.15.148:0/490698482 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v177) v1 ==== 84+0+143 (secure 0 0 0) 0x7f08bc0aa880 con 0x7f08a8004b80 2023-10-24T01:45:12.456 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:12.456 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T01:45:12.456 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:12.457 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T01:45:12.457 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T01:45:12.457 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T01:45:12.457 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:12.457 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T01:45:12.458 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T01:45:12.458 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:12.458 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T01:45:12.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 msgr2=0x7f089c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 0x7f089c061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f08a4006d30 tx=0x7f08a4008040).stop 2023-10-24T01:45:12.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 msgr2=0x7f08bc0c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f08ac004a40 tx=0x7f08bc0c6390).stop 2023-10-24T01:45:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 shutdown_connections 2023-10-24T01:45:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f08bc153870 0x7f08bc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f089c05f270 0x7f089c061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08a8004b80 0x7f08bc0c2320 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 --2- 172.21.15.148:0/490698482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08bc145a70 0x7f08bc0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 >> 172.21.15.148:0/490698482 conn(0x7f08bc0caf40 msgr2=0x7f08bc0c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 shutdown_connections 2023-10-24T01:45:12.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.456+0000 7f08c1191700 1 -- 172.21.15.148:0/490698482 wait complete. 2023-10-24T01:45:12.470 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T01:45:12.470 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T01:45:12.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.587+0000 7f78ab60c700 1 Processor -- start 2023-10-24T01:45:12.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.587+0000 7f78ab60c700 1 -- start start 2023-10-24T01:45:12.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78a4154040 0x7f78a4154420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78a41588c0 0x7f78a40ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40ca270 con 0x7f78a4154040 2023-10-24T01:45:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40c9660 con 0x7f78a41588c0 2023-10-24T01:45:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78ab60c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c9940 con 0x7f78a40c7840 2023-10-24T01:45:12.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78a4154040 0x7f78a4154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f78a4154040 0x7f78a4154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54294/0 (socket says 172.21.15.148:54294) 2023-10-24T01:45:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 -- 172.21.15.148:0/3638173166 learned_addr learned my addr 172.21.15.148:0/3638173166 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a8ba7700 1 --2- 172.21.15.148:0/3638173166 >> v2:172.21.15.150:3300/0 conn(0x7f78a41588c0 0x7f78a40ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a9ba9700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a40c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 -- 172.21.15.148:0/3638173166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 msgr2=0x7f78a40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a40c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 -- 172.21.15.148:0/3638173166 >> v2:172.21.15.150:3300/0 conn(0x7f78a41588c0 msgr2=0x7f78a40ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 --2- 172.21.15.148:0/3638173166 >> v2:172.21.15.150:3300/0 conn(0x7f78a41588c0 0x7f78a40ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 -- 172.21.15.148:0/3638173166 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40c9c20 con 0x7f78a4154040 2023-10-24T01:45:12.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a9ba9700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a40c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a93a8700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4154420 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f78a40841b0 tx=0x7f789c0090f0).ready entity=mon.0 client_cookie=798cb21ca1d2184f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.588+0000 7f78a3fff700 1 -- 172.21.15.148:0/3638173166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00b600 con 0x7f78a4154040 2023-10-24T01:45:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78a3fff700 1 -- 172.21.15.148:0/3638173166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00b760 con 0x7f78a4154040 2023-10-24T01:45:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78a3fff700 1 -- 172.21.15.148:0/3638173166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00bae0 con 0x7f78a4154040 2023-10-24T01:45:12.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 -- 172.21.15.148:0/3638173166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 msgr2=0x7f78a4154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4154420 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f78a40841b0 tx=0x7f789c0090f0).stop 2023-10-24T01:45:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 -- 172.21.15.148:0/3638173166 shutdown_connections 2023-10-24T01:45:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4154420 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 --2- 172.21.15.148:0/3638173166 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a40c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 --2- 172.21.15.148:0/3638173166 >> v2:172.21.15.150:3300/0 conn(0x7f78a41588c0 0x7f78a40ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 -- 172.21.15.148:0/3638173166 >> 172.21.15.148:0/3638173166 conn(0x7f78a4069d80 msgr2=0x7f78a406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 -- 172.21.15.148:0/3638173166 shutdown_connections 2023-10-24T01:45:12.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.589+0000 7f78ab60c700 1 -- 172.21.15.148:0/3638173166 wait complete. 2023-10-24T01:45:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.590+0000 7f78ab60c700 1 Processor -- start 2023-10-24T01:45:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.590+0000 7f78ab60c700 1 -- start start 2023-10-24T01:45:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 0x7f78a4156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414d9c0 con 0x7f78a4154040 2023-10-24T01:45:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40ae740 con 0x7f78a41588c0 2023-10-24T01:45:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78ab60c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4168a10 con 0x7f78a40c7840 2023-10-24T01:45:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78a8ba7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78a8ba7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54298/0 (socket says 172.21.15.148:54298) 2023-10-24T01:45:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78a8ba7700 1 -- 172.21.15.148:0/2163625974 learned_addr learned my addr 172.21.15.148:0/2163625974 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78a93a8700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.591+0000 7f78a9ba9700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 0x7f78a4156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 -- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 msgr2=0x7f78a4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 -- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 msgr2=0x7f78a4156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 0x7f78a4156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 -- 172.21.15.148:0/2163625974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009370 con 0x7f78a4154040 2023-10-24T01:45:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a93a8700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a9ba9700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 0x7f78a4156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a8ba7700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f789800d890 tx=0x7f7898008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980125f0 con 0x7f78a4154040 2023-10-24T01:45:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898012750 con 0x7f78a4154040 2023-10-24T01:45:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a4156bf0 con 0x7f78a4154040 2023-10-24T01:45:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898012ad0 con 0x7f78a4154040 2023-10-24T01:45:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.592+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a4155210 con 0x7f78a4154040 2023-10-24T01:45:12.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.593+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a406c6b0 con 0x7f78a4154040 2023-10-24T01:45:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.593+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7898013480 con 0x7f78a4154040 2023-10-24T01:45:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.593+0000 7f78a17fa700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 0x7f7890061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.593+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f7898079e00 con 0x7f78a4154040 2023-10-24T01:45:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.594+0000 7f78a93a8700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 0x7f7890061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.594+0000 7f78a93a8700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 0x7f7890061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f789c009130 tx=0x7f789c017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.598+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f789804b210 con 0x7f78a4154040 2023-10-24T01:45:12.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.763+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f78a40c9f00 con 0x7f78a4154040 2023-10-24T01:45:12.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.847+0000 7f78a17fa700 1 -- 172.21.15.148:0/2163625974 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v178) v1 ==== 152+0+0 (secure 0 0 0) 0x7f789804e830 con 0x7f78a4154040 2023-10-24T01:45:12.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 msgr2=0x7f7890061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 0x7f7890061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f789c009130 tx=0x7f789c017000).stop 2023-10-24T01:45:12.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 msgr2=0x7f78a4168520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f789800d890 tx=0x7f7898008040).stop 2023-10-24T01:45:12.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 shutdown_connections 2023-10-24T01:45:12.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78a41588c0 0x7f78a4156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78a40c7840 0x7f78a4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f789005f270 0x7f7890061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 --2- 172.21.15.148:0/2163625974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f78a4154040 0x7f78a4168520 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 >> 172.21.15.148:0/2163625974 conn(0x7f78a4069d80 msgr2=0x7f78a414dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 shutdown_connections 2023-10-24T01:45:12.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.850+0000 7f78ab60c700 1 -- 172.21.15.148:0/2163625974 wait complete. 2023-10-24T01:45:12.854 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T01:45:12.868 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T01:45:12.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.987+0000 7f1cb3894700 1 Processor -- start 2023-10-24T01:45:12.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.987+0000 7f1cb3894700 1 -- start start 2023-10-24T01:45:12.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cac154430 0x7f1cac154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac098bd0 0x7f1cac0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1cac0bffd0 0x7f1cac0c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac0c0970 con 0x7f1cac154430 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac0c71d0 con 0x7f1cac0bffd0 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb3894700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0c9410 con 0x7f1cac098bd0 2023-10-24T01:45:12.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cac154430 0x7f1cac154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1cac154430 0x7f1cac154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54302/0 (socket says 172.21.15.148:54302) 2023-10-24T01:45:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 -- 172.21.15.148:0/1452940534 learned_addr learned my addr 172.21.15.148:0/1452940534 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1e31700 1 --2- 172.21.15.148:0/1452940534 >> v2:172.21.15.150:3300/0 conn(0x7f1cac0bffd0 0x7f1cac0c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb0e2f700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac098bd0 0x7f1cac0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:12.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 -- 172.21.15.148:0/1452940534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac098bd0 msgr2=0x7f1cac0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac098bd0 0x7f1cac0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 -- 172.21.15.148:0/1452940534 >> v2:172.21.15.150:3300/0 conn(0x7f1cac0bffd0 msgr2=0x7f1cac0c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:12.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.988+0000 7f1cb1630700 1 --2- 172.21.15.148:0/1452940534 >> v2:172.21.15.150:3300/0 conn(0x7f1cac0bffd0 0x7f1cac0c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb1630700 1 -- 172.21.15.148:0/1452940534 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac0c6c10 con 0x7f1cac154430 2023-10-24T01:45:12.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb1630700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac154430 0x7f1cac154810 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f1ca8006fd0 tx=0x7f1ca80090f0).ready entity=mon.0 client_cookie=702ed476e4440ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1ca3fff700 1 -- 172.21.15.148:0/1452940534 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800b600 con 0x7f1cac154430 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1ca3fff700 1 -- 172.21.15.148:0/1452940534 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800b760 con 0x7f1cac154430 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1ca3fff700 1 -- 172.21.15.148:0/1452940534 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800bae0 con 0x7f1cac154430 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 -- 172.21.15.148:0/1452940534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac154430 msgr2=0x7f1cac154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac154430 0x7f1cac154810 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f1ca8006fd0 tx=0x7f1ca80090f0).stop 2023-10-24T01:45:12.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 -- 172.21.15.148:0/1452940534 shutdown_connections 2023-10-24T01:45:12.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac154430 0x7f1cac154810 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 --2- 172.21.15.148:0/1452940534 >> v2:172.21.15.150:3300/0 conn(0x7f1cac0bffd0 0x7f1cac0c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 --2- 172.21.15.148:0/1452940534 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac098bd0 0x7f1cac0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:12.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 -- 172.21.15.148:0/1452940534 >> 172.21.15.148:0/1452940534 conn(0x7f1cac0cb070 msgr2=0x7f1cac0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:12.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 -- 172.21.15.148:0/1452940534 shutdown_connections 2023-10-24T01:45:12.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.989+0000 7f1cb3894700 1 -- 172.21.15.148:0/1452940534 wait complete. 2023-10-24T01:45:12.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.990+0000 7f1cb3894700 1 Processor -- start 2023-10-24T01:45:12.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.990+0000 7f1cb3894700 1 -- start start 2023-10-24T01:45:13.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:13.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cac0bffd0 0x7f1cac0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:13.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac154430 0x7f1cac157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:13.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0b0430 con 0x7f1cac098bd0 2023-10-24T01:45:13.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0af820 con 0x7f1cac0bffd0 2023-10-24T01:45:13.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb3894700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac0afb00 con 0x7f1cac154430 2023-10-24T01:45:13.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.991+0000 7f1cb1630700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:13.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54316/0 (socket says 172.21.15.148:54316) 2023-10-24T01:45:13.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 -- 172.21.15.148:0/2763832400 learned_addr learned my addr 172.21.15.148:0/2763832400 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:13.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb0e2f700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cac0bffd0 0x7f1cac0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:13.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1e31700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac154430 0x7f1cac157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 -- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac154430 msgr2=0x7f1cac157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac154430 0x7f1cac157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 -- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cac0bffd0 msgr2=0x7f1cac0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cac0bffd0 0x7f1cac0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 -- 172.21.15.148:0/2763832400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8009370 con 0x7f1cac098bd0 2023-10-24T01:45:13.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb1630700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1cac0c5910 tx=0x7f1ca8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:13.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800bea0 con 0x7f1cac098bd0 2023-10-24T01:45:13.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800b8d0 con 0x7f1cac098bd0 2023-10-24T01:45:13.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac0afde0 con 0x7f1cac098bd0 2023-10-24T01:45:13.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca801b620 con 0x7f1cac098bd0 2023-10-24T01:45:13.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.992+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac0b08c0 con 0x7f1cac098bd0 2023-10-24T01:45:13.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.993+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac0b0710 con 0x7f1cac098bd0 2023-10-24T01:45:13.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.993+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f1ca801b990 con 0x7f1cac098bd0 2023-10-24T01:45:13.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.994+0000 7f1ca17fa700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 0x7f1c90061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:13.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.994+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5683+0+0 (secure 0 0 0) 0x7f1ca807bc00 con 0x7f1cac098bd0 2023-10-24T01:45:13.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.994+0000 7f1cb0e2f700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 0x7f1c90061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:13.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.994+0000 7f1cb0e2f700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 0x7f1c90061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1cac0c51f0 tx=0x7f1c9c008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:13.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:12.998+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1ca804cf00 con 0x7f1cac098bd0 2023-10-24T01:45:13.051 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:45:13.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:45:13.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.169+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1cac06c6b0 con 0x7f1cac098bd0 2023-10-24T01:45:13.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.855+0000 7f1ca17fa700 1 -- 172.21.15.148:0/2763832400 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v179) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1ca8029070 con 0x7f1cac098bd0 2023-10-24T01:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.864+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 msgr2=0x7f1c90061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.864+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 0x7f1c90061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1cac0c51f0 tx=0x7f1c9c008040).stop 2023-10-24T01:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.864+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 msgr2=0x7f1cac159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:13.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.864+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f1cac0c5910 tx=0x7f1ca8017000).stop 2023-10-24T01:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 shutdown_connections 2023-10-24T01:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1cac154430 0x7f1cac157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f1c9005f270 0x7f1c90061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1cac098bd0 0x7f1cac159e30 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 --2- 172.21.15.148:0/2763832400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cac0bffd0 0x7f1cac0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 >> 172.21.15.148:0/2763832400 conn(0x7f1cac0cb070 msgr2=0x7f1cac153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:13.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.866+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 shutdown_connections 2023-10-24T01:45:13.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:13.867+0000 7f1cb3894700 1 -- 172.21.15.148:0/2763832400 wait complete. 2023-10-24T01:45:13.878 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T01:45:13.891 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T01:45:14.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.007+0000 7ff9a759e700 1 Processor -- start 2023-10-24T01:45:14.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.007+0000 7ff9a759e700 1 -- start start 2023-10-24T01:45:14.011 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 0x7ff9a80a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a759e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9a80c9e00 0x7ff9a815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a759e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a80a9830 con 0x7ff9a8154150 2023-10-24T01:45:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a759e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80a8c20 con 0x7ff9a80c9e00 2023-10-24T01:45:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80a8f00 con 0x7ff9a80c1050 2023-10-24T01:45:14.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9a80c9e00 0x7ff9a815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9a80c9e00 0x7ff9a815dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56812/0 (socket says 172.21.15.148:56812) 2023-10-24T01:45:14.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 -- 172.21.15.148:0/2081346886 learned_addr learned my addr 172.21.15.148:0/2081346886 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/2081346886 >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 0x7ff9a80a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 -- 172.21.15.148:0/2081346886 >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 msgr2=0x7ff9a80a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:14.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 --2- 172.21.15.148:0/2081346886 >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 0x7ff9a80a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 -- 172.21.15.148:0/2081346886 >> v1:172.21.15.148:6789/0 conn(0x7ff9a8154150 legacy=0x7ff9a80c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a559a700 1 -- 172.21.15.148:0/2081346886 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846348465 0 0) 0x7ff9a80a9830 con 0x7ff9a8154150 2023-10-24T01:45:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 -- 172.21.15.148:0/2081346886 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80a91e0 con 0x7ff9a80c9e00 2023-10-24T01:45:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/2081346886 >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 0x7ff9a80a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:14.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a6d9d700 1 --2- 172.21.15.148:0/2081346886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c9e00 0x7ff9a815dd20 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7ff9a8083af0 tx=0x7ff9a00090f0).ready entity=mon.0 client_cookie=11111afa2fc00d6c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.008+0000 7ff9a559a700 1 -- 172.21.15.148:0/2081346886 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000b600 con 0x7ff9a80c9e00 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a559a700 1 -- 172.21.15.148:0/2081346886 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000b760 con 0x7ff9a80c9e00 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a559a700 1 -- 172.21.15.148:0/2081346886 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000bae0 con 0x7ff9a80c9e00 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 -- 172.21.15.148:0/2081346886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c9e00 msgr2=0x7ff9a815dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 --2- 172.21.15.148:0/2081346886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c9e00 0x7ff9a815dd20 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7ff9a8083af0 tx=0x7ff9a00090f0).stop 2023-10-24T01:45:14.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 -- 172.21.15.148:0/2081346886 shutdown_connections 2023-10-24T01:45:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 --2- 172.21.15.148:0/2081346886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c9e00 0x7ff9a815dd20 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 --2- 172.21.15.148:0/2081346886 >> v2:172.21.15.150:3300/0 conn(0x7ff9a80c1050 0x7ff9a80a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 -- 172.21.15.148:0/2081346886 >> 172.21.15.148:0/2081346886 conn(0x7ff9a8094500 msgr2=0x7ff9a806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 -- 172.21.15.148:0/2081346886 shutdown_connections 2023-10-24T01:45:14.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.009+0000 7ff9a759e700 1 -- 172.21.15.148:0/2081346886 wait complete. 2023-10-24T01:45:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.010+0000 7ff9a759e700 1 Processor -- start 2023-10-24T01:45:14.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.010+0000 7ff9a759e700 1 -- start start 2023-10-24T01:45:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 0x7ff9a80c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154150 0x7ff9a8158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80ae7a0 con 0x7ff9a80c1050 2023-10-24T01:45:14.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80c4350 con 0x7ff9a8154150 2023-10-24T01:45:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a759e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80c4630 con 0x7ff9a80c9e00 2023-10-24T01:45:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56818/0 (socket says 172.21.15.148:56818) 2023-10-24T01:45:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 -- 172.21.15.148:0/3950523531 learned_addr learned my addr 172.21.15.148:0/3950523531 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a6d9d700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154150 0x7ff9a8158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 0x7ff9a80c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 -- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 msgr2=0x7ff9a80c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 0x7ff9a80c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 -- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154150 msgr2=0x7ff9a8158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154150 0x7ff9a8158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a659c700 1 -- 172.21.15.148:0/3950523531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009370 con 0x7ff9a80c1050 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.011+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 0x7ff9a80c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff9a659c700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7ff99800c790 tx=0x7ff998001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800a520 con 0x7ff9a80c1050 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99800a6a0 con 0x7ff9a80c1050 2023-10-24T01:45:14.023 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a80ae3c0 con 0x7ff9a80c1050 2023-10-24T01:45:14.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800aa60 con 0x7ff9a80c1050 2023-10-24T01:45:14.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.012+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a8159440 con 0x7ff9a80c1050 2023-10-24T01:45:14.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.013+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80ae220 con 0x7ff9a80c1050 2023-10-24T01:45:14.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.013+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7ff998003070 con 0x7ff9a80c1050 2023-10-24T01:45:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.013+0000 7ff99e7fc700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 0x7ff988061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.013+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6065+0+0 (secure 0 0 0) 0x7ff998079aa0 con 0x7ff9a80c1050 2023-10-24T01:45:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.014+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 0x7ff988061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.014+0000 7ff9a5d9b700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 0x7ff988061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff9a80ad260 tx=0x7ff990008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.018+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff998048af0 con 0x7ff9a80c1050 2023-10-24T01:45:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.223+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff9a8047480 con 0x7ff9a80c1050 2023-10-24T01:45:14.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.228+0000 7ff99e7fc700 1 -- 172.21.15.148:0/3950523531 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff998017030 con 0x7ff9a80c1050 2023-10-24T01:45:14.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 msgr2=0x7ff988061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 0x7ff988061700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff9a80ad260 tx=0x7ff990008040).stop 2023-10-24T01:45:14.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 msgr2=0x7ff9a80c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7ff99800c790 tx=0x7ff998001570).stop 2023-10-24T01:45:14.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 shutdown_connections 2023-10-24T01:45:14.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9a8154150 0x7ff9a8158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff98805f240 0x7ff988061700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9a80c1050 0x7ff9a80c38c0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 --2- 172.21.15.148:0/3950523531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9a80c9e00 0x7ff9a80c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.232+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 >> 172.21.15.148:0/3950523531 conn(0x7ff9a8094500 msgr2=0x7ff9a80c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.233+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 shutdown_connections 2023-10-24T01:45:14.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.233+0000 7ff9a759e700 1 -- 172.21.15.148:0/3950523531 wait complete. 2023-10-24T01:45:14.240 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 21 and data pool 22 2023-10-24T01:45:14.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:14.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.370+0000 7f4d7f920700 1 Processor -- start 2023-10-24T01:45:14.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.370+0000 7f4d7f920700 1 -- start start 2023-10-24T01:45:14.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7f920700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d78151d90 0x7f4d780a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7f920700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d780c8470 0x7f4d78157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7f920700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d78155550 con 0x7f4d780a7260 2023-10-24T01:45:14.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7f920700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d78154960 con 0x7f4d780c8470 2023-10-24T01:45:14.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7f920700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78154c20 con 0x7f4d78151d90 2023-10-24T01:45:14.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7debd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d780c8470 0x7f4d78157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7debd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d780c8470 0x7f4d78157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56834/0 (socket says 172.21.15.148:56834) 2023-10-24T01:45:14.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7debd700 1 -- 172.21.15.148:0/652573631 learned_addr learned my addr 172.21.15.148:0/652573631 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.371+0000 7f4d7cebb700 1 --1- 172.21.15.148:0/652573631 >> v1:172.21.15.148:6789/0 conn(0x7f4d780a7260 0x7f4d780c57e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34852/0 (socket says 172.21.15.148:34852) 2023-10-24T01:45:14.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7d6bc700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d78151d90 0x7f4d780a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7debd700 1 -- 172.21.15.148:0/652573631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d78151d90 msgr2=0x7f4d780a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7debd700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d78151d90 0x7f4d780a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7debd700 1 -- 172.21.15.148:0/652573631 >> v1:172.21.15.148:6789/0 conn(0x7f4d780a7260 legacy=0x7f4d780c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d6ffff700 1 -- 172.21.15.148:0/652573631 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017219155 0 0) 0x7f4d78155550 con 0x7f4d780a7260 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7debd700 1 -- 172.21.15.148:0/652573631 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78154f00 con 0x7f4d780c8470 2023-10-24T01:45:14.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7debd700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d78157f30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f4d70009f20 tx=0x7f4d70009840).ready entity=mon.0 client_cookie=1b467cfa7454ad8a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d6ffff700 1 -- 172.21.15.148:0/652573631 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000e070 con 0x7f4d780c8470 2023-10-24T01:45:14.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d6ffff700 1 -- 172.21.15.148:0/652573631 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7000b9d0 con 0x7f4d780c8470 2023-10-24T01:45:14.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d6ffff700 1 -- 172.21.15.148:0/652573631 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000bd50 con 0x7f4d780c8470 2023-10-24T01:45:14.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7f920700 1 -- 172.21.15.148:0/652573631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 msgr2=0x7f4d78157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.372+0000 7f4d7f920700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d78157f30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f4d70009f20 tx=0x7f4d70009840).stop 2023-10-24T01:45:14.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 -- 172.21.15.148:0/652573631 shutdown_connections 2023-10-24T01:45:14.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d78157f30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 --2- 172.21.15.148:0/652573631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d78151d90 0x7f4d780a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 -- 172.21.15.148:0/652573631 >> 172.21.15.148:0/652573631 conn(0x7f4d780641b0 msgr2=0x7f4d780c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 -- 172.21.15.148:0/652573631 shutdown_connections 2023-10-24T01:45:14.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.373+0000 7f4d7f920700 1 -- 172.21.15.148:0/652573631 wait complete. 2023-10-24T01:45:14.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.374+0000 7f4d7f920700 1 Processor -- start 2023-10-24T01:45:14.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.374+0000 7f4d7f920700 1 -- start start 2023-10-24T01:45:14.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d780a7260 0x7f4d780a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 0x7f4d780aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78157570 con 0x7f4d780c8470 2023-10-24T01:45:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d781593b0 con 0x7f4d78151d90 2023-10-24T01:45:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d781590b0 con 0x7f4d780a7260 2023-10-24T01:45:14.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56840/0 (socket says 172.21.15.148:56840) 2023-10-24T01:45:14.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 -- 172.21.15.148:0/2569522349 learned_addr learned my addr 172.21.15.148:0/2569522349 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7d6bc700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d780a7260 0x7f4d780a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7debd700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 0x7f4d780aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 -- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d780a7260 msgr2=0x7f4d780a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d780a7260 0x7f4d780a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 -- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 msgr2=0x7f4d780aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 0x7f4d780aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 -- 172.21.15.148:0/2569522349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009ae0 con 0x7f4d780c8470 2023-10-24T01:45:14.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7debd700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 0x7f4d780aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:14.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7cebb700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f4d6800c4c0 tx=0x7f4d68007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800ce80 con 0x7f4d780c8470 2023-10-24T01:45:14.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d680072e0 con 0x7f4d780c8470 2023-10-24T01:45:14.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d78168a90 con 0x7f4d780c8470 2023-10-24T01:45:14.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680056e0 con 0x7f4d780c8470 2023-10-24T01:45:14.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.375+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d780aa650 con 0x7f4d780c8470 2023-10-24T01:45:14.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.376+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d780c5a50 con 0x7f4d780c8470 2023-10-24T01:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.377+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4d68005ad0 con 0x7f4d780c8470 2023-10-24T01:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.377+0000 7f4d6d7fa700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 0x7f4d5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.377+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f4d68079b40 con 0x7f4d780c8470 2023-10-24T01:45:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.377+0000 7f4d7d6bc700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 0x7f4d5c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.378+0000 7f4d7d6bc700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 0x7f4d5c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d74009c30 tx=0x7f4d74009060).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.381+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d6804ac60 con 0x7f4d780c8470 2023-10-24T01:45:14.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.543+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d78157000 con 0x7f4d780c8470 2023-10-24T01:45:14.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.544+0000 7f4d6d7fa700 1 -- 172.21.15.148:0/2569522349 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f4d68018030 con 0x7f4d780c8470 2023-10-24T01:45:14.546 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:14.547 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":180,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:45:14.224936+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 msgr2=0x7f4d5c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 0x7f4d5c061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4d74009c30 tx=0x7f4d74009060).stop 2023-10-24T01:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 msgr2=0x7f4d7815abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f4d6800c4c0 tx=0x7f4d68007da0).stop 2023-10-24T01:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 shutdown_connections 2023-10-24T01:45:14.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d78151d90 0x7f4d780aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d780a7260 0x7f4d780a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4d5c05f270 0x7f4d5c061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 --2- 172.21.15.148:0/2569522349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d780c8470 0x7f4d7815abb0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 >> 172.21.15.148:0/2569522349 conn(0x7f4d780641b0 msgr2=0x7f4d780665c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 shutdown_connections 2023-10-24T01:45:14.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.546+0000 7f4d7f920700 1 -- 172.21.15.148:0/2569522349 wait complete. 2023-10-24T01:45:14.560 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.672+0000 7f750f03e700 1 Processor -- start 2023-10-24T01:45:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.672+0000 7f750f03e700 1 -- start start 2023-10-24T01:45:14.676 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750f03e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750f03e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75080c6410 con 0x7f75080ca110 2023-10-24T01:45:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750f03e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75080ca6e0 con 0x7f75080c0ef0 2023-10-24T01:45:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750f03e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75080ca9c0 con 0x7f75080aa140 2023-10-24T01:45:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750d83b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f75080ca110 0x7f75080c07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34860/0 (socket says 172.21.15.148:34860) 2023-10-24T01:45:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750d83b700 1 -- 172.21.15.148:0/3979699461 learned_addr learned my addr 172.21.15.148:0/3979699461 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:14.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750e03c700 1 --2- 172.21.15.148:0/3979699461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100014427 0 0) 0x7f75080c6410 con 0x7f75080ca110 2023-10-24T01:45:14.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.673+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f40033f0 con 0x7f75080ca110 2023-10-24T01:45:14.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670505805 0 0) 0x7f75080ca6e0 con 0x7f75080c0ef0 2023-10-24T01:45:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75080c6410 con 0x7f75080c0ef0 2023-10-24T01:45:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699436623 0 0) 0x7f74f40033f0 con 0x7f75080ca110 2023-10-24T01:45:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750e03c700 1 -- 172.21.15.148:0/3979699461 >> v1:172.21.15.150:6789/0 conn(0x7f75080c0ef0 legacy=0x7f75080c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750e03c700 1 -- 172.21.15.148:0/3979699461 >> v1:172.21.15.148:6789/0 conn(0x7f75080ca110 legacy=0x7f75080c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750e03c700 1 -- 172.21.15.148:0/3979699461 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080c60a0 con 0x7f75080aa140 2023-10-24T01:45:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750e03c700 1 --2- 172.21.15.148:0/3979699461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080c9c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7504009790 tx=0x7f7504009060).ready entity=mon.2 client_cookie=7e7da94eddf827d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8001470 con 0x7f75080aa140 2023-10-24T01:45:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040090d0 con 0x7f75080aa140 2023-10-24T01:45:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750d03a700 1 -- 172.21.15.148:0/3979699461 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504011610 con 0x7f75080aa140 2023-10-24T01:45:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 -- 172.21.15.148:0/3979699461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 msgr2=0x7f75080c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 --2- 172.21.15.148:0/3979699461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080c9c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7504009790 tx=0x7f7504009060).stop 2023-10-24T01:45:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 -- 172.21.15.148:0/3979699461 shutdown_connections 2023-10-24T01:45:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 --2- 172.21.15.148:0/3979699461 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080c9c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 -- 172.21.15.148:0/3979699461 >> 172.21.15.148:0/3979699461 conn(0x7f75080944a0 msgr2=0x7f750806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 -- 172.21.15.148:0/3979699461 shutdown_connections 2023-10-24T01:45:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.674+0000 7f750f03e700 1 -- 172.21.15.148:0/3979699461 wait complete. 2023-10-24T01:45:14.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 Processor -- start 2023-10-24T01:45:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 -- start start 2023-10-24T01:45:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75080c0ef0 0x7f75080b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081655b0 con 0x7f75080ca110 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080c6c10 con 0x7f75080c0ef0 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750f03e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75080b0570 con 0x7f75080aa140 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750e83d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750e83d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56844/0 (socket says 172.21.15.148:56844) 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750e83d700 1 -- 172.21.15.148:0/861229431 learned_addr learned my addr 172.21.15.148:0/861229431 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750e03c700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.676+0000 7f750d83b700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75080c0ef0 0x7f75080b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 -- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 msgr2=0x7f75080afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 -- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75080c0ef0 msgr2=0x7f75080b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75080c0ef0 0x7f75080b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 -- 172.21.15.148:0/861229431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040092a0 con 0x7f75080ca110 2023-10-24T01:45:14.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750e83d700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f750000c7f0 tx=0x7f7500007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000e4a0 con 0x7f75080ca110 2023-10-24T01:45:14.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000e600 con 0x7f75080ca110 2023-10-24T01:45:14.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75080ad640 con 0x7f75080ca110 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000e9a0 con 0x7f75080ca110 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.677+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7508150d60 con 0x7f75080ca110 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.678+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75080c6da0 con 0x7f75080ca110 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.678+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f750000ed10 con 0x7f75080ca110 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.679+0000 7f74fe7fc700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 0x7f74ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.679+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f7500079950 con 0x7f75080ca110 2023-10-24T01:45:14.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.679+0000 7f750e03c700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 0x7f74ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.679+0000 7f750e03c700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 0x7f74ec061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f750400a010 tx=0x7f7504016000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.683+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f750004aa70 con 0x7f75080ca110 2023-10-24T01:45:14.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.848+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7508150d60 con 0x7f75080ca110 2023-10-24T01:45:14.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.849+0000 7f74fe7fc700 1 -- 172.21.15.148:0/861229431 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f7508150d60 con 0x7f75080ca110 2023-10-24T01:45:14.852 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:14.852 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":180,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:45:14.224936+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 msgr2=0x7f74ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 0x7f74ec061730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f750400a010 tx=0x7f7504016000).stop 2023-10-24T01:45:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 msgr2=0x7f7508164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f750000c7f0 tx=0x7f7500007f20).stop 2023-10-24T01:45:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 shutdown_connections 2023-10-24T01:45:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f74ec05f270 0x7f74ec061730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75080ca110 0x7f7508164440 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75080aa140 0x7f75080afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 --2- 172.21.15.148:0/861229431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75080c0ef0 0x7f75080b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 >> 172.21.15.148:0/861229431 conn(0x7f75080944a0 msgr2=0x7f7508151840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 shutdown_connections 2023-10-24T01:45:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.851+0000 7f750f03e700 1 -- 172.21.15.148:0/861229431 wait complete. 2023-10-24T01:45:14.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T01:45:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.980+0000 7fa61bfff700 1 Processor -- start 2023-10-24T01:45:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.980+0000 7fa61bfff700 1 -- start start 2023-10-24T01:45:14.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0c8530 0x7fa61c0a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa61c0a8120 0x7fa61c0a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61bfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0c6770 con 0x7fa61c157780 2023-10-24T01:45:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61bfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0c1120 con 0x7fa61c0a8120 2023-10-24T01:45:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c1400 con 0x7fa61c0c8530 2023-10-24T01:45:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa61c0a8120 0x7fa61c0a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa61c0a8120 0x7fa61c0a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56852/0 (socket says 172.21.15.148:56852) 2023-10-24T01:45:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa61c157780 0x7fa61c0c0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34870/0 (socket says 172.21.15.148:34870) 2023-10-24T01:45:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61b7fe700 1 -- 172.21.15.148:0/3474217660 learned_addr learned my addr 172.21.15.148:0/3474217660 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa613fff700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0c8530 0x7fa61c0a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61b7fe700 1 -- 172.21.15.148:0/3474217660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0c8530 msgr2=0x7fa61c0a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:14.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.981+0000 7fa61b7fe700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0c8530 0x7fa61c0a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61b7fe700 1 -- 172.21.15.148:0/3474217660 >> v1:172.21.15.148:6789/0 conn(0x7fa61c157780 legacy=0x7fa61c0c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61b7fe700 1 -- 172.21.15.148:0/3474217660 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0c6120 con 0x7fa61c0a8120 2023-10-24T01:45:14.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61a7fc700 1 -- 172.21.15.148:0/3474217660 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622798995 0 0) 0x7fa61c0c6770 con 0x7fa61c157780 2023-10-24T01:45:14.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61b7fe700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c0a8120 0x7fa61c0a9e60 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fa614009f20 tx=0x7fa614009840).ready entity=mon.0 client_cookie=341abc0c3df579dc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61a7fc700 1 -- 172.21.15.148:0/3474217660 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400e070 con 0x7fa61c0a8120 2023-10-24T01:45:14.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61a7fc700 1 -- 172.21.15.148:0/3474217660 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400b9d0 con 0x7fa61c0a8120 2023-10-24T01:45:14.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61a7fc700 1 -- 172.21.15.148:0/3474217660 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400bd50 con 0x7fa61c0a8120 2023-10-24T01:45:14.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 -- 172.21.15.148:0/3474217660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c0a8120 msgr2=0x7fa61c0a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c0a8120 0x7fa61c0a9e60 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fa614009f20 tx=0x7fa614009840).stop 2023-10-24T01:45:14.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 -- 172.21.15.148:0/3474217660 shutdown_connections 2023-10-24T01:45:14.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c0a8120 0x7fa61c0a9e60 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 --2- 172.21.15.148:0/3474217660 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0c8530 0x7fa61c0a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 -- 172.21.15.148:0/3474217660 >> 172.21.15.148:0/3474217660 conn(0x7fa61c094570 msgr2=0x7fa61c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:14.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 -- 172.21.15.148:0/3474217660 shutdown_connections 2023-10-24T01:45:14.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.982+0000 7fa61bfff700 1 -- 172.21.15.148:0/3474217660 wait complete. 2023-10-24T01:45:14.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.983+0000 7fa61bfff700 1 Processor -- start 2023-10-24T01:45:14.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 -- start start 2023-10-24T01:45:14.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 0x7fa61c144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 0x7fa61c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c2250 con 0x7fa61c157780 2023-10-24T01:45:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c156dd0 con 0x7fa61c0c8530 2023-10-24T01:45:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61bfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c156530 con 0x7fa61c0a8120 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56858/0 (socket says 172.21.15.148:56858) 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61b7fe700 1 -- 172.21.15.148:0/2299390517 learned_addr learned my addr 172.21.15.148:0/2299390517 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.984+0000 7fa61affd700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 0x7fa61c144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa613fff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 0x7fa61c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 -- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 msgr2=0x7fa61c144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 0x7fa61c144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 -- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 msgr2=0x7fa61c153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 0x7fa61c153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 -- 172.21.15.148:0/2299390517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009ae0 con 0x7fa61c157780 2023-10-24T01:45:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa613fff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 0x7fa61c153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61affd700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 0x7fa61c144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61b7fe700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fa61c05f980 tx=0x7fa614009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400bd50 con 0x7fa61c157780 2023-10-24T01:45:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400b640 con 0x7fa61c157780 2023-10-24T01:45:14.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c156810 con 0x7fa61c157780 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61401c610 con 0x7fa61c157780 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.985+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c144f90 con 0x7fa61c157780 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.986+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c145120 con 0x7fa61c157780 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.986+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa61401ca40 con 0x7fa61c157780 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.987+0000 7fa612ffd700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 0x7fa5fc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:14.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.987+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa61407bf70 con 0x7fa61c157780 2023-10-24T01:45:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.987+0000 7fa61affd700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 0x7fa5fc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.987+0000 7fa61affd700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 0x7fa5fc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa60c0012a0 tx=0x7fa60c009040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:15.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:14.991+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa6140aaaf0 con 0x7fa61c157780 2023-10-24T01:45:15.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.196+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa61c047480 con 0x7fa61c157780 2023-10-24T01:45:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.237+0000 7fa612ffd700 1 -- 172.21.15.148:0/2299390517 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa61404d090 con 0x7fa61c157780 2023-10-24T01:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 msgr2=0x7fa5fc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 0x7fa5fc061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa60c0012a0 tx=0x7fa60c009040).stop 2023-10-24T01:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 msgr2=0x7fa61c1557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fa61c05f980 tx=0x7fa614009840).stop 2023-10-24T01:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 shutdown_connections 2023-10-24T01:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa5fc05f270 0x7fa5fc061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa61c157780 0x7fa61c1557c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa61c0a8120 0x7fa61c144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 --2- 172.21.15.148:0/2299390517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa61c0c8530 0x7fa61c153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 >> 172.21.15.148:0/2299390517 conn(0x7fa61c094570 msgr2=0x7fa61c05e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 shutdown_connections 2023-10-24T01:45:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.240+0000 7fa61bfff700 1 -- 172.21.15.148:0/2299390517 wait complete. 2023-10-24T01:45:15.254 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T01:45:15.254 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T01:45:15.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.369+0000 7f0b3e7ef700 1 Processor -- start 2023-10-24T01:45:15.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.369+0000 7f0b3e7ef700 1 -- start start 2023-10-24T01:45:15.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3e7ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b38154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3e7ef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0b38098bd0 0x7f0b380c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3e7ef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380c71d0 con 0x7f0b380bffd0 2023-10-24T01:45:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3e7ef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380c9410 con 0x7f0b38098bd0 2023-10-24T01:45:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3e7ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380c6c10 con 0x7f0b38154430 2023-10-24T01:45:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3cd8c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0b380bffd0 0x7f0b380c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34880/0 (socket says 172.21.15.148:34880) 2023-10-24T01:45:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b3cd8c700 1 -- 172.21.15.148:0/1110761281 learned_addr learned my addr 172.21.15.148:0/1110761281 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b37fff700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b38154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b377fe700 1 --2- 172.21.15.148:0/1110761281 >> v2:172.21.15.150:3300/0 conn(0x7f0b38098bd0 0x7f0b380c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182095048 0 0) 0x7f0b380c71d0 con 0x7f0b380bffd0 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.370+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b200033f0 con 0x7f0b380bffd0 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571573905 0 0) 0x7f0b200033f0 con 0x7f0b380bffd0 2023-10-24T01:45:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 msgr2=0x7f0b38154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:15.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b38154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 >> v2:172.21.15.150:3300/0 conn(0x7f0b38098bd0 msgr2=0x7f0b380c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:15.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 --2- 172.21.15.148:0/1110761281 >> v2:172.21.15.150:3300/0 conn(0x7f0b38098bd0 0x7f0b380c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380c6ef0 con 0x7f0b380bffd0 2023-10-24T01:45:15.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f0b300017f0 con 0x7f0b380bffd0 2023-10-24T01:45:15.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 >> v1:172.21.15.148:6789/0 conn(0x7f0b380bffd0 legacy=0x7f0b380c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b200038e0 0x7f0b20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b20004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20004b80 0x7f0b20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380c9410 con 0x7f0b20004b80 2023-10-24T01:45:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380c6c10 con 0x7f0b200038e0 2023-10-24T01:45:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2000b8e0 con 0x7f0b38154430 2023-10-24T01:45:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20004b80 0x7f0b20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b37fff700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b200038e0 0x7f0b20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b377fe700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b20004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 -- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 msgr2=0x7f0b20004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b20004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 -- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b200038e0 msgr2=0x7f0b20003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b200038e0 0x7f0b20003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 -- 172.21.15.148:0/1110761281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200033f0 con 0x7f0b20004b80 2023-10-24T01:45:15.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b377fe700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38154430 0x7f0b20004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b3cd8c700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20004b80 0x7f0b20005000 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0b3000c480 tx=0x7f0b3000c790).ready entity=mon.0 client_cookie=4425ca178957bdcb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30002030 con 0x7f0b20004b80 2023-10-24T01:45:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3000ce20 con 0x7f0b20004b80 2023-10-24T01:45:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.371+0000 7f0b36ffd700 1 -- 172.21.15.148:0/1110761281 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30005d30 con 0x7f0b20004b80 2023-10-24T01:45:15.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/1110761281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20004b80 msgr2=0x7f0b20005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/1110761281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20004b80 0x7f0b20005000 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0b3000c480 tx=0x7f0b3000c790).stop 2023-10-24T01:45:15.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3cd8c700 1 -- 172.21.15.148:0/1110761281 reap_dead start 2023-10-24T01:45:15.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/1110761281 shutdown_connections 2023-10-24T01:45:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/1110761281 >> 172.21.15.148:0/1110761281 conn(0x7f0b380cb070 msgr2=0x7f0b380cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/1110761281 shutdown_connections 2023-10-24T01:45:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.372+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/1110761281 wait complete. 2023-10-24T01:45:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.373+0000 7f0b3e7ef700 1 Processor -- start 2023-10-24T01:45:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.373+0000 7f0b3e7ef700 1 -- start start 2023-10-24T01:45:15.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 0x7f0b381649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38164e90 0x7f0b38167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380c3840 con 0x7f0b3814e6b0 2023-10-24T01:45:15.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380af9a0 con 0x7f0b38164520 2023-10-24T01:45:15.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3e7ef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38165310 con 0x7f0b38164e90 2023-10-24T01:45:15.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56886/0 (socket says 172.21.15.148:56886) 2023-10-24T01:45:15.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 -- 172.21.15.148:0/3937940054 learned_addr learned my addr 172.21.15.148:0/3937940054 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:15.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b377fe700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 0x7f0b381649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b3cd8c700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38164e90 0x7f0b38167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 -- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38164e90 msgr2=0x7f0b38167ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38164e90 0x7f0b38167ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 -- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 msgr2=0x7f0b381649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 0x7f0b381649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b37fff700 1 -- 172.21.15.148:0/3937940054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380c2cc0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.374+0000 7f0b377fe700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 0x7f0b381649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b37fff700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f0b280119f0 tx=0x7f0b28009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800f8e0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2800fa40 con 0x7f0b3814e6b0 2023-10-24T01:45:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380c2fa0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800fdc0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.375+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3814ea90 con 0x7f0b3814e6b0 2023-10-24T01:45:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.376+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3806c6b0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.376+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0b28014650 con 0x7f0b3814e6b0 2023-10-24T01:45:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.376+0000 7f0b1ffff700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 0x7f0b24061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.377+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f0b2807afd0 con 0x7f0b3814e6b0 2023-10-24T01:45:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.377+0000 7f0b377fe700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 0x7f0b24061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.377+0000 7f0b377fe700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 0x7f0b24061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0b2c006b00 tx=0x7f0b2c008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.381+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0b2804c090 con 0x7f0b3814e6b0 2023-10-24T01:45:15.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:15.583+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0b380c90a0 con 0x7f0b3814e6b0 2023-10-24T01:45:16.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.239+0000 7f0b1ffff700 1 -- 172.21.15.148:0/3937940054 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b380c90a0 con 0x7f0b3814e6b0 2023-10-24T01:45:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 msgr2=0x7f0b24061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 0x7f0b24061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0b2c006b00 tx=0x7f0b2c008040).stop 2023-10-24T01:45:16.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 msgr2=0x7f0b380b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f0b280119f0 tx=0x7f0b28009060).stop 2023-10-24T01:45:16.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 shutdown_connections 2023-10-24T01:45:16.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0b38164e90 0x7f0b38167ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f0b2405f270 0x7f0b24061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b3814e6b0 0x7f0b380b0cd0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 --2- 172.21.15.148:0/3937940054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0b38164520 0x7f0b381649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 >> 172.21.15.148:0/3937940054 conn(0x7f0b380cb070 msgr2=0x7f0b380644c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 shutdown_connections 2023-10-24T01:45:16.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.241+0000 7f0b3e7ef700 1 -- 172.21.15.148:0/3937940054 wait complete. 2023-10-24T01:45:16.256 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T01:45:16.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:16.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.369+0000 7fea1e492700 1 Processor -- start 2023-10-24T01:45:16.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.369+0000 7fea1e492700 1 -- start start 2023-10-24T01:45:16.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1e492700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea180aa010 0x7fea180c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1e492700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1e492700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180aa820 con 0x7fea180c6710 2023-10-24T01:45:16.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1e492700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c0960 con 0x7fea180aa010 2023-10-24T01:45:16.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1e492700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c0c40 con 0x7fea180aa3f0 2023-10-24T01:45:16.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea17fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea180aa010 0x7fea180c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea177fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fea180c6710 0x7fea18158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34882/0 (socket says 172.21.15.148:34882) 2023-10-24T01:45:16.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea17fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea180aa010 0x7fea180c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56888/0 (socket says 172.21.15.148:56888) 2023-10-24T01:45:16.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea177fe700 1 -- 172.21.15.148:0/258169784 learned_addr learned my addr 172.21.15.148:0/258169784 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:16.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.370+0000 7fea1ca2f700 1 --2- 172.21.15.148:0/258169784 >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea17fff700 1 -- 172.21.15.148:0/258169784 >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 msgr2=0x7fea18069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:16.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea17fff700 1 --2- 172.21.15.148:0/258169784 >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea17fff700 1 -- 172.21.15.148:0/258169784 >> v1:172.21.15.148:6789/0 conn(0x7fea180c6710 legacy=0x7fea18158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea16ffd700 1 -- 172.21.15.148:0/258169784 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839065499 0 0) 0x7fea180aa820 con 0x7fea180c6710 2023-10-24T01:45:16.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea17fff700 1 -- 172.21.15.148:0/258169784 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180c0f20 con 0x7fea180aa010 2023-10-24T01:45:16.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1ca2f700 1 --2- 172.21.15.148:0/258169784 >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea17fff700 1 --2- 172.21.15.148:0/258169784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea180c1a00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fea180c1ef0 tx=0x7fea08009060).ready entity=mon.0 client_cookie=ec6512de0de2d2ca server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea16ffd700 1 -- 172.21.15.148:0/258169784 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800b580 con 0x7fea180aa010 2023-10-24T01:45:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea16ffd700 1 -- 172.21.15.148:0/258169784 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800b6e0 con 0x7fea180aa010 2023-10-24T01:45:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea16ffd700 1 -- 172.21.15.148:0/258169784 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800ba60 con 0x7fea180aa010 2023-10-24T01:45:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 -- 172.21.15.148:0/258169784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 msgr2=0x7fea180c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 --2- 172.21.15.148:0/258169784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea180c1a00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7fea180c1ef0 tx=0x7fea08009060).stop 2023-10-24T01:45:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 -- 172.21.15.148:0/258169784 shutdown_connections 2023-10-24T01:45:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 --2- 172.21.15.148:0/258169784 >> v2:172.21.15.150:3300/0 conn(0x7fea180aa3f0 0x7fea18069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 --2- 172.21.15.148:0/258169784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa010 0x7fea180c1a00 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 -- 172.21.15.148:0/258169784 >> 172.21.15.148:0/258169784 conn(0x7fea180caf40 msgr2=0x7fea180cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:16.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 -- 172.21.15.148:0/258169784 shutdown_connections 2023-10-24T01:45:16.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.371+0000 7fea1e492700 1 -- 172.21.15.148:0/258169784 wait complete. 2023-10-24T01:45:16.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.372+0000 7fea1e492700 1 Processor -- start 2023-10-24T01:45:16.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 -- start start 2023-10-24T01:45:16.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 0x7fea18154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 0x7fea1814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18150f10 con 0x7fea180aa3f0 2023-10-24T01:45:16.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181517b0 con 0x7fea180c6710 2023-10-24T01:45:16.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.373+0000 7fea1e492700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18157ad0 con 0x7fea180aa010 2023-10-24T01:45:16.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56898/0 (socket says 172.21.15.148:56898) 2023-10-24T01:45:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 -- 172.21.15.148:0/42722545 learned_addr learned my addr 172.21.15.148:0/42722545 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea17fff700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 0x7fea18154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea1ca2f700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 0x7fea1814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 -- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 msgr2=0x7fea18154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 0x7fea18154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 -- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 msgr2=0x7fea1814c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 0x7fea1814c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 -- 172.21.15.148:0/42722545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080092a0 con 0x7fea180aa3f0 2023-10-24T01:45:16.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea17fff700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 0x7fea18154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea1ca2f700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 0x7fea1814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea177fe700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fea0c00c460 tx=0x7fea0c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0072e0 con 0x7fea180aa3f0 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c007440 con 0x7fea180aa3f0 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180b0ad0 con 0x7fea180aa3f0 2023-10-24T01:45:16.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0057a0 con 0x7fea180aa3f0 2023-10-24T01:45:16.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.374+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18151440 con 0x7fea180aa3f0 2023-10-24T01:45:16.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.375+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1806c6b0 con 0x7fea180aa3f0 2023-10-24T01:45:16.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.375+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fea0c005b50 con 0x7fea180aa3f0 2023-10-24T01:45:16.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.376+0000 7fe9fffff700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.376+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fea0c079d00 con 0x7fea180aa3f0 2023-10-24T01:45:16.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.376+0000 7fea17fff700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.377+0000 7fea17fff700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fea08009fd0 tx=0x7fea08017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.380+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea0c04ae20 con 0x7fea180aa3f0 2023-10-24T01:45:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.587+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea180c1200 con 0x7fea180aa3f0 2023-10-24T01:45:16.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.587+0000 7fe9fffff700 1 -- 172.21.15.148:0/42722545 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7fea0c018030 con 0x7fea180aa3f0 2023-10-24T01:45:16.589 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:16.590 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T01:45:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 msgr2=0x7fea04061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fea08009fd0 tx=0x7fea08017000).stop 2023-10-24T01:45:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 msgr2=0x7fea181575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fea0c00c460 tx=0x7fea0c007e90).stop 2023-10-24T01:45:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 shutdown_connections 2023-10-24T01:45:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea180c6710 0x7fea1814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea180aa010 0x7fea18154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea0405f270 0x7fea04061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 --2- 172.21.15.148:0/42722545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea180aa3f0 0x7fea181575e0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 >> 172.21.15.148:0/42722545 conn(0x7fea180caf40 msgr2=0x7fea180ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 shutdown_connections 2023-10-24T01:45:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.589+0000 7fea1e492700 1 -- 172.21.15.148:0/42722545 wait complete. 2023-10-24T01:45:16.594 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T01:45:16.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T01:45:16.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.716+0000 7fdad77f0700 1 Processor -- start 2023-10-24T01:45:16.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.716+0000 7fdad77f0700 1 -- start start 2023-10-24T01:45:16.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad77f0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdad00c6710 0x7fdad00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad77f0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad77f0700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00aa860 con 0x7fdad00aa010 2023-10-24T01:45:16.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad77f0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00c0960 con 0x7fdad00c6710 2023-10-24T01:45:16.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad77f0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00c0c40 con 0x7fdad00aa3f0 2023-10-24T01:45:16.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad5d8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdad00c6710 0x7fdad00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdad00c6710 0x7fdad00c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:38368/0 (socket says 172.21.15.148:38368) 2023-10-24T01:45:16.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad5d8d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:55990/0 (socket says 172.21.15.148:55990) 2023-10-24T01:45:16.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad558c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fdad00aa010 0x7fdad0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:51234/0 (socket says 172.21.15.148:51234) 2023-10-24T01:45:16.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 -- 172.21.15.148:0/826989135 learned_addr learned my addr 172.21.15.148:0/826989135 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:16.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 -- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 msgr2=0x7fdad0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:16.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 -- 172.21.15.148:0/826989135 >> v1:172.21.15.150:6789/0 conn(0x7fdad00aa010 legacy=0x7fdad0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 -- 172.21.15.148:0/826989135 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00c0f20 con 0x7fdad00c6710 2023-10-24T01:45:16.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdac7fff700 1 -- 172.21.15.148:0/826989135 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810400427 0 0) 0x7fdad00aa860 con 0x7fdad00aa010 2023-10-24T01:45:16.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad5d8d700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:16.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.717+0000 7fdad4d8b700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00c6710 0x7fdad00c1a00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdac0006fd0 tx=0x7fdac00090f0).ready entity=mon.1 client_cookie=bcaac454ebd70e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.724 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdac7fff700 1 -- 172.21.15.148:0/826989135 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000b580 con 0x7fdad00c6710 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdac7fff700 1 -- 172.21.15.148:0/826989135 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000b6e0 con 0x7fdad00c6710 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdac7fff700 1 -- 172.21.15.148:0/826989135 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000ba60 con 0x7fdad00c6710 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 -- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00c6710 msgr2=0x7fdad00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00c6710 0x7fdad00c1a00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdac0006fd0 tx=0x7fdac00090f0).stop 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 -- 172.21.15.148:0/826989135 shutdown_connections 2023-10-24T01:45:16.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00aa3f0 0x7fdad0069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 --2- 172.21.15.148:0/826989135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00c6710 0x7fdad00c1a00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 -- 172.21.15.148:0/826989135 >> 172.21.15.148:0/826989135 conn(0x7fdad00caf40 msgr2=0x7fdad00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:16.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 -- 172.21.15.148:0/826989135 shutdown_connections 2023-10-24T01:45:16.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.718+0000 7fdad77f0700 1 -- 172.21.15.148:0/826989135 wait complete. 2023-10-24T01:45:16.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.719+0000 7fdad77f0700 1 Processor -- start 2023-10-24T01:45:16.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.719+0000 7fdad77f0700 1 -- start start 2023-10-24T01:45:16.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00aa3f0 0x7fdad00abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00c6710 0x7fdad00ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0155b40 con 0x7fdad00aa010 2023-10-24T01:45:16.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00ac560 con 0x7fdad00aa3f0 2023-10-24T01:45:16.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad77f0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00ac840 con 0x7fdad00c6710 2023-10-24T01:45:16.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad558c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad558c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56904/0 (socket says 172.21.15.148:56904) 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad558c700 1 -- 172.21.15.148:0/6483112 learned_addr learned my addr 172.21.15.148:0/6483112 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad4d8b700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00aa3f0 0x7fdad00abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.720+0000 7fdad5d8d700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00c6710 0x7fdad00ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 -- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00c6710 msgr2=0x7fdad00ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00c6710 0x7fdad00ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 -- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00aa3f0 msgr2=0x7fdad00abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00aa3f0 0x7fdad00abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 -- 172.21.15.148:0/6483112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8009a20 con 0x7fdad00aa010 2023-10-24T01:45:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad558c700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fdacc00c440 tx=0x7fdacc007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00cea0 con 0x7fdad00aa010 2023-10-24T01:45:16.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc0072e0 con 0x7fdad00aa010 2023-10-24T01:45:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0009370 con 0x7fdad00aa010 2023-10-24T01:45:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0056e0 con 0x7fdad00aa010 2023-10-24T01:45:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.721+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad01557d0 con 0x7fdad00aa010 2023-10-24T01:45:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.722+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad0151880 con 0x7fdad00aa010 2023-10-24T01:45:16.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.722+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdacc005ad0 con 0x7fdad00aa010 2023-10-24T01:45:16.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.722+0000 7fdac57fa700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 0x7fdab4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:16.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.723+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fdacc079a50 con 0x7fdad00aa010 2023-10-24T01:45:16.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.723+0000 7fdad4d8b700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 0x7fdab4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:16.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.723+0000 7fdad4d8b700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 0x7fdab4061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdac0009130 tx=0x7fdac0017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:16.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.727+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdacc04ab10 con 0x7fdad00aa010 2023-10-24T01:45:16.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.889+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad006c6b0 con 0x7fdad00aa010 2023-10-24T01:45:16.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.890+0000 7fdac57fa700 1 -- 172.21.15.148:0/6483112 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+17062 (secure 0 0 0) 0x7fdacc04e130 con 0x7fdad00aa010 2023-10-24T01:45:16.892 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:16.892 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":181,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T01:45:15.226962+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T01:45:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 msgr2=0x7fdab4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 0x7fdab4061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdac0009130 tx=0x7fdac0017000).stop 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 msgr2=0x7fdad0151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fdacc00c440 tx=0x7fdacc007e30).stop 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 shutdown_connections 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdad00c6710 0x7fdad00ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fdab405f270 0x7fdab4061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdad00aa010 0x7fdad0151330 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 --2- 172.21.15.148:0/6483112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdad00aa3f0 0x7fdad00abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:16.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 >> 172.21.15.148:0/6483112 conn(0x7fdad00caf40 msgr2=0x7fdad00639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:16.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 shutdown_connections 2023-10-24T01:45:16.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:16.892+0000 7fdad77f0700 1 -- 172.21.15.148:0/6483112 wait complete. 2023-10-24T01:45:16.906 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T01:45:16.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:45:17.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.019+0000 7fea70c83700 1 Processor -- start 2023-10-24T01:45:17.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.019+0000 7fea70c83700 1 -- start start 2023-10-24T01:45:17.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea70c83700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fea6c0be650 0x7fea6c0a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea70c83700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea6c0a8260 0x7fea6c0a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea70c83700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0a8710 con 0x7fea6c154540 2023-10-24T01:45:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea70c83700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0a5bd0 con 0x7fea6c0a8260 2023-10-24T01:45:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea70c83700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c064ab0 con 0x7fea6c0be650 2023-10-24T01:45:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fea6c0a8260 0x7fea6c0a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fea6c154540 0x7fea6c0640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34886/0 (socket says 172.21.15.148:34886) 2023-10-24T01:45:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6a59c700 1 -- 172.21.15.148:0/1867526869 learned_addr learned my addr 172.21.15.148:0/1867526869 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea69d9b700 1 --2- 172.21.15.148:0/1867526869 >> v2:172.21.15.150:3300/0 conn(0x7fea6c0be650 0x7fea6c0a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 -- 172.21.15.148:0/1867526869 >> v2:172.21.15.150:3300/0 conn(0x7fea6c0be650 msgr2=0x7fea6c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 --2- 172.21.15.148:0/1867526869 >> v2:172.21.15.150:3300/0 conn(0x7fea6c0be650 0x7fea6c0a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 -- 172.21.15.148:0/1867526869 >> v1:172.21.15.148:6789/0 conn(0x7fea6c154540 legacy=0x7fea6c0640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 -- 172.21.15.148:0/1867526869 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c064d90 con 0x7fea6c0a8260 2023-10-24T01:45:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6959a700 1 -- 172.21.15.148:0/1867526869 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920117168 0 0) 0x7fea64001610 con 0x7fea6c154540 2023-10-24T01:45:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6ad9d700 1 --2- 172.21.15.148:0/1867526869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0a8260 0x7fea6c0a6060 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fea6c06c330 tx=0x7fea5c009060).ready entity=mon.0 client_cookie=ddb6a0218abf23be server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6959a700 1 -- 172.21.15.148:0/1867526869 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00f510 con 0x7fea6c0a8260 2023-10-24T01:45:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6959a700 1 -- 172.21.15.148:0/1867526869 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c00f670 con 0x7fea6c0a8260 2023-10-24T01:45:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.021+0000 7fea6959a700 1 -- 172.21.15.148:0/1867526869 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00f9f0 con 0x7fea6c0a8260 2023-10-24T01:45:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 -- 172.21.15.148:0/1867526869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0a8260 msgr2=0x7fea6c0a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 --2- 172.21.15.148:0/1867526869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0a8260 0x7fea6c0a6060 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7fea6c06c330 tx=0x7fea5c009060).stop 2023-10-24T01:45:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 -- 172.21.15.148:0/1867526869 shutdown_connections 2023-10-24T01:45:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 --2- 172.21.15.148:0/1867526869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0a8260 0x7fea6c0a6060 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 --2- 172.21.15.148:0/1867526869 >> v2:172.21.15.150:3300/0 conn(0x7fea6c0be650 0x7fea6c0a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 -- 172.21.15.148:0/1867526869 >> 172.21.15.148:0/1867526869 conn(0x7fea6c092480 msgr2=0x7fea6c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 -- 172.21.15.148:0/1867526869 shutdown_connections 2023-10-24T01:45:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.022+0000 7fea70c83700 1 -- 172.21.15.148:0/1867526869 wait complete. 2023-10-24T01:45:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.023+0000 7fea70c83700 1 Processor -- start 2023-10-24T01:45:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.023+0000 7fea70c83700 1 -- start start 2023-10-24T01:45:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea6c0a8260 0x7fea6c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea6c154540 0x7fea6c0c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0c1df0 con 0x7fea6c0be650 2023-10-24T01:45:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0aed50 con 0x7fea6c0a8260 2023-10-24T01:45:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea70c83700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0c0f00 con 0x7fea6c154540 2023-10-24T01:45:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56928/0 (socket says 172.21.15.148:56928) 2023-10-24T01:45:17.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 -- 172.21.15.148:0/2629694185 learned_addr learned my addr 172.21.15.148:0/2629694185 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:17.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea6a59c700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea6c0a8260 0x7fea6c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea6ad9d700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea6c154540 0x7fea6c0c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 -- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea6c154540 msgr2=0x7fea6c0c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea6c154540 0x7fea6c0c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 -- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea6c0a8260 msgr2=0x7fea6c0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea6c0a8260 0x7fea6c0ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 -- 172.21.15.148:0/2629694185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0092a0 con 0x7fea6c0be650 2023-10-24T01:45:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea69d9b700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fea5400e900 tx=0x7fea54009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.024+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400eea0 con 0x7fea6c0be650 2023-10-24T01:45:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.025+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5400c850 con 0x7fea6c0be650 2023-10-24T01:45:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.025+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c0c11e0 con 0x7fea6c0be650 2023-10-24T01:45:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.025+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400cbd0 con 0x7fea6c0be650 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.025+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c0c17a0 con 0x7fea6c0be650 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.025+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c06c6b0 con 0x7fea6c0be650 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.026+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fea5401b400 con 0x7fea6c0be650 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.026+0000 7fea627fc700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 0x7fea4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.026+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fea5407aa40 con 0x7fea6c0be650 2023-10-24T01:45:17.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.026+0000 7fea6a59c700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 0x7fea4c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.027+0000 7fea6a59c700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 0x7fea4c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fea6c150640 tx=0x7fea64009040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.030+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fea5404ba40 con 0x7fea6c0be650 2023-10-24T01:45:17.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.190+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea6c065070 con 0x7fea4c05f270 2023-10-24T01:45:17.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.201+0000 7fea627fc700 1 -- 172.21.15.148:0/2629694185 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353246 (secure 0 0 0) 0x7fea6c065070 con 0x7fea4c05f270 2023-10-24T01:45:17.207 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 msgr2=0x7fea4c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 0x7fea4c061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fea6c150640 tx=0x7fea64009040).stop 2023-10-24T01:45:17.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 msgr2=0x7fea6c165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fea5400e900 tx=0x7fea54009060).stop 2023-10-24T01:45:17.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 shutdown_connections 2023-10-24T01:45:17.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fea6c154540 0x7fea6c0c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea6c0a8260 0x7fea6c0ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fea4c05f270 0x7fea4c061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 --2- 172.21.15.148:0/2629694185 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea6c0be650 0x7fea6c165040 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 >> 172.21.15.148:0/2629694185 conn(0x7fea6c092480 msgr2=0x7fea6c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 shutdown_connections 2023-10-24T01:45:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.205+0000 7fea70c83700 1 -- 172.21.15.148:0/2629694185 wait complete. 2023-10-24T01:45:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:45:17.218 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T01:45:16.759041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439136,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752535584,"statfs":{"total":773094113280,"available":770596438016,"internally_reserved":0,"allocated":17727488,"data_stored":8988408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11956,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.059037"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851999+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857018+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858311+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854657+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856943+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851885+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859603+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851847+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857494+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859878+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851824+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859537+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856558+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858155+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855278+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859718+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859887+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855830+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851411+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853535+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858831+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857766+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853997+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858424+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859346+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850356+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859383+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.860096+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850419+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857300+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856908+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859339+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856969+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859360+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855203+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850402+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854023+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856985+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857246+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856900+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853953+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858905+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850387+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855526+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854770+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854058+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854844+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854451+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855546+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856438+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.849814+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857111+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856056+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853547+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856107+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855132+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856914+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757496+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:45:09.757496+0000","last_peered":"2023-10-24T01:45:09.757496+0000","last_clean":"2023-10-24T01:45:09.757496+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:45:09.757496+0000","last_undegraded":"2023-10-24T01:45:09.757496+0000","last_fullsized":"2023-10-24T01:45:09.757496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853960+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023513+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:45:10.023513+0000","last_peered":"2023-10-24T01:45:10.023513+0000","last_clean":"2023-10-24T01:45:10.023513+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:45:10.023513+0000","last_undegraded":"2023-10-24T01:45:10.023513+0000","last_fullsized":"2023-10-24T01:45:10.023513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856825+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.838323+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:45:10.838323+0000","last_peered":"2023-10-24T01:45:10.838323+0000","last_clean":"2023-10-24T01:45:10.838323+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:45:10.838323+0000","last_undegraded":"2023-10-24T01:45:10.838323+0000","last_fullsized":"2023-10-24T01:45:10.838323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854836+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023463+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:45:10.023463+0000","last_peered":"2023-10-24T01:45:10.023463+0000","last_clean":"2023-10-24T01:45:10.023463+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:45:10.023463+0000","last_undegraded":"2023-10-24T01:45:10.023463+0000","last_fullsized":"2023-10-24T01:45:10.023463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839003+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:45:10.839003+0000","last_peered":"2023-10-24T01:45:10.839003+0000","last_clean":"2023-10-24T01:45:10.839003+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:45:10.839003+0000","last_undegraded":"2023-10-24T01:45:10.839003+0000","last_fullsized":"2023-10-24T01:45:10.839003+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859391+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839007+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:45:10.839007+0000","last_peered":"2023-10-24T01:45:10.839007+0000","last_clean":"2023-10-24T01:45:10.839007+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:45:10.839007+0000","last_undegraded":"2023-10-24T01:45:10.839007+0000","last_fullsized":"2023-10-24T01:45:10.839007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855918+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839016+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:45:10.839016+0000","last_peered":"2023-10-24T01:45:10.839016+0000","last_clean":"2023-10-24T01:45:10.839016+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:45:10.839016+0000","last_undegraded":"2023-10-24T01:45:10.839016+0000","last_fullsized":"2023-10-24T01:45:10.839016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855834+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757555+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:45:09.757555+0000","last_peered":"2023-10-24T01:45:09.757555+0000","last_clean":"2023-10-24T01:45:09.757555+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:45:09.757555+0000","last_undegraded":"2023-10-24T01:45:09.757555+0000","last_fullsized":"2023-10-24T01:45:09.757555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856138+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.762304+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:45:09.762304+0000","last_peered":"2023-10-24T01:45:09.762304+0000","last_clean":"2023-10-24T01:45:09.762304+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:45:09.762304+0000","last_undegraded":"2023-10-24T01:45:09.762304+0000","last_fullsized":"2023-10-24T01:45:09.762304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543057,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.434},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575761,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575762,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.51800000000000002,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.66200000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.434}]},{"osd":3,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"max":{"1min":0.70599999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.67000000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":0.71999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.623}]},{"osd":7,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78700000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.377}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.33100000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.432}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.626}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.313},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.33300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575762,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23999999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.39000000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82499999999999996,"5min":1.071,"15min":1.071},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.46700000000000003}]},{"osd":7,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.624}]},{"osd":1,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.86699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.83299999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.75700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":1.04},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.92100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.83399999999999996,"15min":0.90300000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.84699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.71299999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.44}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:45:17.226 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:45:17.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.371+0000 7f48b6a64700 1 Processor -- start 2023-10-24T01:45:17.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.371+0000 7f48b6a64700 1 -- start start 2023-10-24T01:45:17.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b6a64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 0x7f48b00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b6a64700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00c0960 con 0x7f48b00aa3f0 2023-10-24T01:45:17.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b6a64700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00c0c40 con 0x7f48b00c6710 2023-10-24T01:45:17.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b6a64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00aa8a0 con 0x7f48b00aa010 2023-10-24T01:45:17.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b5001700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f48b00aa3f0 0x7f48b0069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34894/0 (socket says 172.21.15.148:34894) 2023-10-24T01:45:17.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b5001700 1 -- 172.21.15.148:0/3131891253 learned_addr learned my addr 172.21.15.148:0/3131891253 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:17.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b4800700 1 --2- 172.21.15.148:0/3131891253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 0x7f48b00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941067689 0 0) 0x7f48b00c0960 con 0x7f48b00aa3f0 2023-10-24T01:45:17.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a00033f0 con 0x7f48b00aa3f0 2023-10-24T01:45:17.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154436421 0 0) 0x7f48b00c0c40 con 0x7f48b00c6710 2023-10-24T01:45:17.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b00c0960 con 0x7f48b00c6710 2023-10-24T01:45:17.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b4800700 1 -- 172.21.15.148:0/3131891253 >> v1:172.21.15.150:6789/0 conn(0x7f48b00c6710 legacy=0x7f48b0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b4800700 1 -- 172.21.15.148:0/3131891253 >> v1:172.21.15.148:6789/0 conn(0x7f48b00aa3f0 legacy=0x7f48b0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213593384 0 0) 0x7f48a00033f0 con 0x7f48b00aa3f0 2023-10-24T01:45:17.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.372+0000 7f48b4800700 1 -- 172.21.15.148:0/3131891253 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00c0f20 con 0x7f48b00aa010 2023-10-24T01:45:17.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b4800700 1 --2- 172.21.15.148:0/3131891253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 0x7f48b00c1a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f48a4009790 tx=0x7f48a4009060).ready entity=mon.2 client_cookie=ed8fc9a83fc50860 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80017f0 con 0x7f48b00aa010 2023-10-24T01:45:17.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4011400 con 0x7f48b00aa010 2023-10-24T01:45:17.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48af7fe700 1 -- 172.21.15.148:0/3131891253 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4011780 con 0x7f48b00aa010 2023-10-24T01:45:17.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 -- 172.21.15.148:0/3131891253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 msgr2=0x7f48b00c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 --2- 172.21.15.148:0/3131891253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 0x7f48b00c1a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f48a4009790 tx=0x7f48a4009060).stop 2023-10-24T01:45:17.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 -- 172.21.15.148:0/3131891253 shutdown_connections 2023-10-24T01:45:17.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 --2- 172.21.15.148:0/3131891253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa010 0x7f48b00c1a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 -- 172.21.15.148:0/3131891253 >> 172.21.15.148:0/3131891253 conn(0x7f48b00caf40 msgr2=0x7f48b00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 -- 172.21.15.148:0/3131891253 shutdown_connections 2023-10-24T01:45:17.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.373+0000 7f48b6a64700 1 -- 172.21.15.148:0/3131891253 wait complete. 2023-10-24T01:45:17.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.374+0000 7f48b6a64700 1 Processor -- start 2023-10-24T01:45:17.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 -- start start 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa3f0 0x7f48b0150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c6710 0x7f48b01651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0150720 con 0x7f48b00aa010 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00afd70 con 0x7f48b00c6710 2023-10-24T01:45:17.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b6a64700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00ae3d0 con 0x7f48b00aa3f0 2023-10-24T01:45:17.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.375+0000 7f48b4800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56942/0 (socket says 172.21.15.148:56942) 2023-10-24T01:45:17.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 -- 172.21.15.148:0/2749745526 learned_addr learned my addr 172.21.15.148:0/2749745526 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:17.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48affff700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa3f0 0x7f48b0150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b5001700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c6710 0x7f48b01651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 -- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa3f0 msgr2=0x7f48b0150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa3f0 0x7f48b0150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 -- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c6710 msgr2=0x7f48b01651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c6710 0x7f48b01651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 -- 172.21.15.148:0/2749745526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40092a0 con 0x7f48b00aa010 2023-10-24T01:45:17.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b4800700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f48a4009d80 tx=0x7f48a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4021070 con 0x7f48b00aa010 2023-10-24T01:45:17.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4010950 con 0x7f48b00aa010 2023-10-24T01:45:17.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00ae6b0 con 0x7f48b00aa010 2023-10-24T01:45:17.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4010cf0 con 0x7f48b00aa010 2023-10-24T01:45:17.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.376+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00aec70 con 0x7f48b00aa010 2023-10-24T01:45:17.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.377+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b00c8d50 con 0x7f48b00aa010 2023-10-24T01:45:17.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.377+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f48a401d640 con 0x7f48b00aa010 2023-10-24T01:45:17.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.378+0000 7f48acff9700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 0x7f4894061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.378+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f48a407b680 con 0x7f48b00aa010 2023-10-24T01:45:17.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.378+0000 7f48affff700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 0x7f4894061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.378+0000 7f48affff700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 0x7f4894061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f48b00ad1c0 tx=0x7f489c009040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.382+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f48a404c7a0 con 0x7f48b00aa010 2023-10-24T01:45:17.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.542+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48b00aee60 con 0x7f489405f270 2023-10-24T01:45:17.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.552+0000 7f48acff9700 1 -- 172.21.15.148:0/2749745526 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353246 (secure 0 0 0) 0x7f48b00aee60 con 0x7f489405f270 2023-10-24T01:45:17.558 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:17.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 msgr2=0x7f4894061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 0x7f4894061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f48b00ad1c0 tx=0x7f489c009040).stop 2023-10-24T01:45:17.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 msgr2=0x7f48b014fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f48a4009d80 tx=0x7f48a4016000).stop 2023-10-24T01:45:17.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 shutdown_connections 2023-10-24T01:45:17.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c6710 0x7f48b01651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f489405f270 0x7f4894061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48b00aa010 0x7f48b014fd40 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 --2- 172.21.15.148:0/2749745526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00aa3f0 0x7f48b0150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.555+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 >> 172.21.15.148:0/2749745526 conn(0x7f48b00caf40 msgr2=0x7f48b0151720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.556+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 shutdown_connections 2023-10-24T01:45:17.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.556+0000 7f48b6a64700 1 -- 172.21.15.148:0/2749745526 wait complete. 2023-10-24T01:45:17.563 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:45:17.569 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T01:45:16.759041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439136,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752535584,"statfs":{"total":773094113280,"available":770596438016,"internally_reserved":0,"allocated":17727488,"data_stored":8988408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11956,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.059037"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851999+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857018+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858311+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854657+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856943+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851885+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859603+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851847+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857494+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859878+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851824+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859537+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856558+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858155+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855278+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859718+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859887+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855830+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851411+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853535+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858831+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857766+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853997+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858424+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859346+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850356+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859383+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.860096+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850419+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857300+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856908+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859339+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856969+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859360+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855203+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850402+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854023+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856985+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857246+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856900+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853953+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858905+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850387+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855526+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854770+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854058+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854844+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854451+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855546+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856438+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.849814+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857111+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856056+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853547+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856107+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855132+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856914+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757496+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:45:09.757496+0000","last_peered":"2023-10-24T01:45:09.757496+0000","last_clean":"2023-10-24T01:45:09.757496+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:45:09.757496+0000","last_undegraded":"2023-10-24T01:45:09.757496+0000","last_fullsized":"2023-10-24T01:45:09.757496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853960+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023513+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:45:10.023513+0000","last_peered":"2023-10-24T01:45:10.023513+0000","last_clean":"2023-10-24T01:45:10.023513+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:45:10.023513+0000","last_undegraded":"2023-10-24T01:45:10.023513+0000","last_fullsized":"2023-10-24T01:45:10.023513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856825+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.838323+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:45:10.838323+0000","last_peered":"2023-10-24T01:45:10.838323+0000","last_clean":"2023-10-24T01:45:10.838323+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:45:10.838323+0000","last_undegraded":"2023-10-24T01:45:10.838323+0000","last_fullsized":"2023-10-24T01:45:10.838323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854836+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023463+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:45:10.023463+0000","last_peered":"2023-10-24T01:45:10.023463+0000","last_clean":"2023-10-24T01:45:10.023463+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:45:10.023463+0000","last_undegraded":"2023-10-24T01:45:10.023463+0000","last_fullsized":"2023-10-24T01:45:10.023463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839003+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:45:10.839003+0000","last_peered":"2023-10-24T01:45:10.839003+0000","last_clean":"2023-10-24T01:45:10.839003+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:45:10.839003+0000","last_undegraded":"2023-10-24T01:45:10.839003+0000","last_fullsized":"2023-10-24T01:45:10.839003+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859391+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839007+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:45:10.839007+0000","last_peered":"2023-10-24T01:45:10.839007+0000","last_clean":"2023-10-24T01:45:10.839007+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:45:10.839007+0000","last_undegraded":"2023-10-24T01:45:10.839007+0000","last_fullsized":"2023-10-24T01:45:10.839007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855918+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839016+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:45:10.839016+0000","last_peered":"2023-10-24T01:45:10.839016+0000","last_clean":"2023-10-24T01:45:10.839016+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:45:10.839016+0000","last_undegraded":"2023-10-24T01:45:10.839016+0000","last_fullsized":"2023-10-24T01:45:10.839016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855834+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757555+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:45:09.757555+0000","last_peered":"2023-10-24T01:45:09.757555+0000","last_clean":"2023-10-24T01:45:09.757555+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:45:09.757555+0000","last_undegraded":"2023-10-24T01:45:09.757555+0000","last_fullsized":"2023-10-24T01:45:09.757555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856138+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.762304+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:45:09.762304+0000","last_peered":"2023-10-24T01:45:09.762304+0000","last_clean":"2023-10-24T01:45:09.762304+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:45:09.762304+0000","last_undegraded":"2023-10-24T01:45:09.762304+0000","last_fullsized":"2023-10-24T01:45:09.762304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543057,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.434},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575761,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575762,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.51800000000000002,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.66200000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.434}]},{"osd":3,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"max":{"1min":0.70599999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.67000000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":0.71999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.623}]},{"osd":7,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78700000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.377}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.33100000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.432}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.626}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.313},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.33300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575762,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23999999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.39000000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82499999999999996,"5min":1.071,"15min":1.071},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.46700000000000003}]},{"osd":7,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.624}]},{"osd":1,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.86699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.83299999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.75700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":1.04},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.92100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.83399999999999996,"15min":0.90300000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.84699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.71299999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.44}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:45:17.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:45:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.721+0000 7fc861dde700 1 Processor -- start 2023-10-24T01:45:17.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.721+0000 7fc861dde700 1 -- start start 2023-10-24T01:45:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc861dde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0aa140 0x7fc85c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc861dde700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc85c0ca110 0x7fc85c0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.725 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc861dde700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0c6410 con 0x7fc85c0c0cd0 2023-10-24T01:45:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc861dde700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0c1160 con 0x7fc85c0ca110 2023-10-24T01:45:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc861dde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ca6e0 con 0x7fc85c0aa140 2023-10-24T01:45:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc85c0ca110 0x7fc85c0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc85c0ca110 0x7fc85c0c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56944/0 (socket says 172.21.15.148:56944) 2023-10-24T01:45:17.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 -- 172.21.15.148:0/1278563718 learned_addr learned my addr 172.21.15.148:0/1278563718 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc860ddc700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0aa140 0x7fc85c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 -- 172.21.15.148:0/1278563718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0aa140 msgr2=0x7fc85c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0aa140 0x7fc85c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 -- 172.21.15.148:0/1278563718 >> v1:172.21.15.150:6789/0 conn(0x7fc85c0c0cd0 legacy=0x7fc85c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 -- 172.21.15.148:0/1278563718 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0ca9c0 con 0x7fc85c0ca110 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85bfff700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0ca110 0x7fc85c0c07e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fc848006fd0 tx=0x7fc8480090f0).ready entity=mon.0 client_cookie=593343e68491f639 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85b7fe700 1 -- 172.21.15.148:0/1278563718 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800b600 con 0x7fc85c0ca110 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.722+0000 7fc85b7fe700 1 -- 172.21.15.148:0/1278563718 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84800b760 con 0x7fc85c0ca110 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc85b7fe700 1 -- 172.21.15.148:0/1278563718 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800bae0 con 0x7fc85c0ca110 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 -- 172.21.15.148:0/1278563718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0ca110 msgr2=0x7fc85c0c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0ca110 0x7fc85c0c07e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fc848006fd0 tx=0x7fc8480090f0).stop 2023-10-24T01:45:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 -- 172.21.15.148:0/1278563718 shutdown_connections 2023-10-24T01:45:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0aa140 0x7fc85c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 --2- 172.21.15.148:0/1278563718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0ca110 0x7fc85c0c07e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 -- 172.21.15.148:0/1278563718 >> 172.21.15.148:0/1278563718 conn(0x7fc85c0944a0 msgr2=0x7fc85c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 -- 172.21.15.148:0/1278563718 shutdown_connections 2023-10-24T01:45:17.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.723+0000 7fc861dde700 1 -- 172.21.15.148:0/1278563718 wait complete. 2023-10-24T01:45:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.724+0000 7fc861dde700 1 Processor -- start 2023-10-24T01:45:17.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.724+0000 7fc861dde700 1 -- start start 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0c0cd0 0x7fc85c145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85c0ca110 0x7fc85c1681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0aaf20 con 0x7fc85c0aa140 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0ab4a0 con 0x7fc85c0ca110 2023-10-24T01:45:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc861dde700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0af910 con 0x7fc85c0c0cd0 2023-10-24T01:45:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc860ddc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc860ddc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56950/0 (socket says 172.21.15.148:56950) 2023-10-24T01:45:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc860ddc700 1 -- 172.21.15.148:0/1186780362 learned_addr learned my addr 172.21.15.148:0/1186780362 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc85bfff700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0c0cd0 0x7fc85c145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.725+0000 7fc8615dd700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85c0ca110 0x7fc85c1681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 -- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0c0cd0 msgr2=0x7fc85c145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0c0cd0 0x7fc85c145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 -- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85c0ca110 msgr2=0x7fc85c1681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85c0ca110 0x7fc85c1681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 -- 172.21.15.148:0/1186780362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009370 con 0x7fc85c0aa140 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc860ddc700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc85000d890 tx=0x7fc850008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500125f0 con 0x7fc85c0aa140 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850012750 con 0x7fc85c0aa140 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0afbf0 con 0x7fc85c0aa140 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850012ad0 con 0x7fc85c0aa140 2023-10-24T01:45:17.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.726+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c0aac50 con 0x7fc85c0aa140 2023-10-24T01:45:17.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.727+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c047480 con 0x7fc85c0aa140 2023-10-24T01:45:17.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.727+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc850013480 con 0x7fc85c0aa140 2023-10-24T01:45:17.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.728+0000 7fc858ff9700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 0x7fc840061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:17.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.728+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fc85007a200 con 0x7fc85c0aa140 2023-10-24T01:45:17.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.728+0000 7fc85bfff700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 0x7fc840061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:17.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.728+0000 7fc85bfff700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 0x7fc840061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc848006fd0 tx=0x7fc848017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:17.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.732+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc85004b2c0 con 0x7fc85c0aa140 2023-10-24T01:45:17.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.892+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc85c0c60a0 con 0x7fc84005f270 2023-10-24T01:45:17.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.902+0000 7fc858ff9700 1 -- 172.21.15.148:0/1186780362 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353246 (secure 0 0 0) 0x7fc85c0c60a0 con 0x7fc84005f270 2023-10-24T01:45:17.908 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 msgr2=0x7fc840061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 0x7fc840061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc848006fd0 tx=0x7fc848017000).stop 2023-10-24T01:45:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 msgr2=0x7fc85c0aa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc85000d890 tx=0x7fc850008040).stop 2023-10-24T01:45:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 shutdown_connections 2023-10-24T01:45:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc85c0ca110 0x7fc85c1681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fc84005f270 0x7fc840061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc85c0aa140 0x7fc85c0aa760 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 --2- 172.21.15.148:0/1186780362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc85c0c0cd0 0x7fc85c145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 >> 172.21.15.148:0/1186780362 conn(0x7fc85c0944a0 msgr2=0x7fc85c0c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 shutdown_connections 2023-10-24T01:45:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:17.905+0000 7fc861dde700 1 -- 172.21.15.148:0/1186780362 wait complete. 2023-10-24T01:45:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:45:17.919 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T01:45:16.759041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439136,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752535584,"statfs":{"total":773094113280,"available":770596438016,"internally_reserved":0,"allocated":17727488,"data_stored":8988408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11956,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.059037"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851999+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857018+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858311+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854657+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856943+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851885+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859603+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851847+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857494+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859878+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851824+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859537+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856558+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858155+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855278+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859718+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859887+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855830+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851411+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853535+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858831+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857766+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853997+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858424+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859346+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850356+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859383+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.860096+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850419+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857300+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856908+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859339+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856969+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859360+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855203+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850402+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854023+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856985+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857246+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856900+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853953+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858905+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850387+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855526+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854770+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854058+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854844+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854451+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855546+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856438+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.849814+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857111+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856056+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853547+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856107+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855132+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856914+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757496+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:45:09.757496+0000","last_peered":"2023-10-24T01:45:09.757496+0000","last_clean":"2023-10-24T01:45:09.757496+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:45:09.757496+0000","last_undegraded":"2023-10-24T01:45:09.757496+0000","last_fullsized":"2023-10-24T01:45:09.757496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853960+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023513+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:45:10.023513+0000","last_peered":"2023-10-24T01:45:10.023513+0000","last_clean":"2023-10-24T01:45:10.023513+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:45:10.023513+0000","last_undegraded":"2023-10-24T01:45:10.023513+0000","last_fullsized":"2023-10-24T01:45:10.023513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856825+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.838323+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:45:10.838323+0000","last_peered":"2023-10-24T01:45:10.838323+0000","last_clean":"2023-10-24T01:45:10.838323+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:45:10.838323+0000","last_undegraded":"2023-10-24T01:45:10.838323+0000","last_fullsized":"2023-10-24T01:45:10.838323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854836+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023463+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:45:10.023463+0000","last_peered":"2023-10-24T01:45:10.023463+0000","last_clean":"2023-10-24T01:45:10.023463+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:45:10.023463+0000","last_undegraded":"2023-10-24T01:45:10.023463+0000","last_fullsized":"2023-10-24T01:45:10.023463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839003+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:45:10.839003+0000","last_peered":"2023-10-24T01:45:10.839003+0000","last_clean":"2023-10-24T01:45:10.839003+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:45:10.839003+0000","last_undegraded":"2023-10-24T01:45:10.839003+0000","last_fullsized":"2023-10-24T01:45:10.839003+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859391+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839007+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:45:10.839007+0000","last_peered":"2023-10-24T01:45:10.839007+0000","last_clean":"2023-10-24T01:45:10.839007+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:45:10.839007+0000","last_undegraded":"2023-10-24T01:45:10.839007+0000","last_fullsized":"2023-10-24T01:45:10.839007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855918+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839016+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:45:10.839016+0000","last_peered":"2023-10-24T01:45:10.839016+0000","last_clean":"2023-10-24T01:45:10.839016+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:45:10.839016+0000","last_undegraded":"2023-10-24T01:45:10.839016+0000","last_fullsized":"2023-10-24T01:45:10.839016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855834+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757555+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:45:09.757555+0000","last_peered":"2023-10-24T01:45:09.757555+0000","last_clean":"2023-10-24T01:45:09.757555+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:45:09.757555+0000","last_undegraded":"2023-10-24T01:45:09.757555+0000","last_fullsized":"2023-10-24T01:45:09.757555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856138+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.762304+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:45:09.762304+0000","last_peered":"2023-10-24T01:45:09.762304+0000","last_clean":"2023-10-24T01:45:09.762304+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:45:09.762304+0000","last_undegraded":"2023-10-24T01:45:09.762304+0000","last_fullsized":"2023-10-24T01:45:09.762304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543057,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.434},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575761,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575762,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.51800000000000002,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.66200000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.434}]},{"osd":3,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"max":{"1min":0.70599999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.67000000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":0.71999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.623}]},{"osd":7,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78700000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.377}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.33100000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.432}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.626}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.313},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.33300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575762,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23999999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.39000000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82499999999999996,"5min":1.071,"15min":1.071},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.46700000000000003}]},{"osd":7,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.624}]},{"osd":1,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.86699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.83299999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.75700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":1.04},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.92100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.83399999999999996,"15min":0.90300000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.84699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.71299999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.44}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:45:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-10-24T01:45:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-10-24T01:45:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.851999+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-10-24T01:45:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-10-24T01:45:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857018+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-10-24T01:45:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-10-24T01:45:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.858311+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-10-24T01:45:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-10-24T01:45:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854657+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-10-24T01:45:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-10-24T01:45:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856943+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-10-24T01:45:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-10-24T01:45:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.851885+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-10-24T01:45:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-10-24T01:45:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859603+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T01:45:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-10-24T01:45:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-10-24T01:45:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.851847+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-10-24T01:45:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-10-24T01:45:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857494+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-10-24T01:45:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-10-24T01:45:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859878+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-10-24T01:45:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-10-24T01:45:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.851824+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-10-24T01:45:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-10-24T01:45:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859537+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-10-24T01:45:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-10-24T01:45:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856558+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-10-24T01:45:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-10-24T01:45:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.858155+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-10-24T01:45:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-10-24T01:45:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855278+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-10-24T01:45:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-10-24T01:45:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859718+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-10-24T01:45:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-10-24T01:45:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859887+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-10-24T01:45:17.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-10-24T01:45:17.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855830+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:17.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-10-24T01:45:17.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-10-24T01:45:17.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.851411+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-10-24T01:45:17.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-10-24T01:45:17.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.853535+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-10-24T01:45:17.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-10-24T01:45:17.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.858831+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-10-24T01:45:17.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-10-24T01:45:17.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857766+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-10-24T01:45:17.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-10-24T01:45:17.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.853997+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-10-24T01:45:17.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-10-24T01:45:17.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.858424+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-10-24T01:45:17.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-10-24T01:45:17.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859346+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-10-24T01:45:17.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-10-24T01:45:17.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.850356+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-10-24T01:45:17.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-10-24T01:45:17.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859383+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-10-24T01:45:17.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-10-24T01:45:17.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.860096+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T01:45:17.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-10-24T01:45:17.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-10-24T01:45:17.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.850419+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-10-24T01:45:17.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-10-24T01:45:17.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857300+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-10-24T01:45:17.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-10-24T01:45:17.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856908+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-10-24T01:45:17.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-10-24T01:45:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859339+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-10-24T01:45:17.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-10-24T01:45:17.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856969+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-10-24T01:45:17.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-10-24T01:45:17.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859360+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-24T01:45:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-10-24T01:45:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855203+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-10-24T01:45:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-10-24T01:45:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.850402+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-10-24T01:45:17.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-24T01:45:17.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854023+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-24T01:45:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-10-24T01:45:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856985+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-10-24T01:45:17.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-10-24T01:45:17.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857246+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-24T01:45:17.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-10-24T01:45:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856900+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:17.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-10-24T01:45:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-10-24T01:45:17.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.853953+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-10-24T01:45:17.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-10-24T01:45:17.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.858905+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-24T01:45:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-10-24T01:45:17.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.850387+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:17.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-24T01:45:17.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:17.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-24T01:45:17.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855526+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:17.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-10-24T01:45:17.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-10-24T01:45:18.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854770+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T01:45:18.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-10-24T01:45:18.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-24T01:45:18.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854058+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:18.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-10-24T01:45:18.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-10-24T01:45:18.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854844+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T01:45:18.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-10-24T01:45:18.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-24T01:45:18.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854451+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T01:45:18.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-10-24T01:45:18.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-24T01:45:18.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855546+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:18.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-24T01:45:18.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-10-24T01:45:18.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856438+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:18.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-24T01:45:18.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-10-24T01:45:18.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.849814+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T01:45:18.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-10-24T01:45:18.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-10-24T01:45:18.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.857111+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:18.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-24T01:45:18.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-10-24T01:45:18.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856056+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:18.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-24T01:45:18.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-10-24T01:45:18.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.853547+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:18.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-10-24T01:45:18.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-10-24T01:45:18.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856107+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:18.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-24T01:45:18.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-10-24T01:45:18.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855132+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:18.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-24T01:45:18.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-10-24T01:45:18.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856914+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T01:45:18.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-10-24T01:45:18.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-10-24T01:45:18.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.853960+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T01:45:18.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-10-24T01:45:18.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-10-24T01:45:18.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856825+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:18.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-24T01:45:18.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-10-24T01:45:18.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.854836+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T01:45:18.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-24T01:45:18.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-10-24T01:45:18.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.859391+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T01:45:18.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-10-24T01:45:18.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-24T01:45:18.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855918+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:18.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-10-24T01:45:18.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-24T01:45:18.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.855834+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T01:45:18.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-10-24T01:45:18.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-24T01:45:13.847610+0000', 'last_change': '2023-10-24T01:45:13.847610+0000', 'last_active': '2023-10-24T01:45:13.847610+0000', 'last_peered': '2023-10-24T01:45:13.847610+0000', 'last_clean': '2023-10-24T01:45:13.847610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:13.847610+0000', 'last_undegraded': '2023-10-24T01:45:13.847610+0000', 'last_fullsized': '2023-10-24T01:45:13.847610+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:13.847610+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-24T01:45:18.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-10-24T01:45:18.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T01:45:12.840551+0000', 'last_change': '2023-10-24T01:45:12.856138+0000', 'last_active': '2023-10-24T01:45:12.840551+0000', 'last_peered': '2023-10-24T01:45:12.840551+0000', 'last_clean': '2023-10-24T01:45:12.840551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T01:45:12.840551+0000', 'last_undegraded': '2023-10-24T01:45:12.840551+0000', 'last_fullsized': '2023-10-24T01:45:12.840551+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'last_clean_scrub_stamp': '2023-10-24T01:45:12.840551+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T01:45:18.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T01:45:18.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.143+0000 7fa38b41a700 1 Processor -- start 2023-10-24T01:45:18.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 -- start start 2023-10-24T01:45:18.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840aa2f0 0x7fa384064820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa384064d10 0x7fa3840c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3840c6430 0x7fa3840632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384157fa0 con 0x7fa384064d10 2023-10-24T01:45:18.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384065170 con 0x7fa3840c6430 2023-10-24T01:45:18.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.144+0000 7fa38b41a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c68b0 con 0x7fa3840aa2f0 2023-10-24T01:45:18.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa384064d10 0x7fa3840c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa384064d10 0x7fa3840c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56952/0 (socket says 172.21.15.148:56952) 2023-10-24T01:45:18.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 -- 172.21.15.148:0/1381148382 learned_addr learned my addr 172.21.15.148:0/1381148382 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:18.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3891b6700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840aa2f0 0x7fa384064820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3899b7700 1 --2- 172.21.15.148:0/1381148382 >> v2:172.21.15.150:3300/0 conn(0x7fa3840c6430 0x7fa3840632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 -- 172.21.15.148:0/1381148382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840aa2f0 msgr2=0x7fa384064820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:18.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840aa2f0 0x7fa384064820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 -- 172.21.15.148:0/1381148382 >> v2:172.21.15.150:3300/0 conn(0x7fa3840c6430 msgr2=0x7fa3840632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:18.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1381148382 >> v2:172.21.15.150:3300/0 conn(0x7fa3840c6430 0x7fa3840632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 -- 172.21.15.148:0/1381148382 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3841581f0 con 0x7fa384064d10 2023-10-24T01:45:18.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa384064d10 0x7fa3840c5f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa384084590 tx=0x7fa3740090f0).ready entity=mon.0 client_cookie=f164bc8bd39dee37 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa37bfff700 1 -- 172.21.15.148:0/1381148382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400b600 con 0x7fa384064d10 2023-10-24T01:45:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa37bfff700 1 -- 172.21.15.148:0/1381148382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400b760 con 0x7fa384064d10 2023-10-24T01:45:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.145+0000 7fa37bfff700 1 -- 172.21.15.148:0/1381148382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400bae0 con 0x7fa384064d10 2023-10-24T01:45:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 -- 172.21.15.148:0/1381148382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa384064d10 msgr2=0x7fa3840c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa384064d10 0x7fa3840c5f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fa384084590 tx=0x7fa3740090f0).stop 2023-10-24T01:45:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 -- 172.21.15.148:0/1381148382 shutdown_connections 2023-10-24T01:45:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1381148382 >> v2:172.21.15.150:3300/0 conn(0x7fa3840c6430 0x7fa3840632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840aa2f0 0x7fa384064820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1381148382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa384064d10 0x7fa3840c5f40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 -- 172.21.15.148:0/1381148382 >> 172.21.15.148:0/1381148382 conn(0x7fa3840caf90 msgr2=0x7fa3840cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:18.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 -- 172.21.15.148:0/1381148382 shutdown_connections 2023-10-24T01:45:18.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.146+0000 7fa38b41a700 1 -- 172.21.15.148:0/1381148382 wait complete. 2023-10-24T01:45:18.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.147+0000 7fa38b41a700 1 Processor -- start 2023-10-24T01:45:18.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.147+0000 7fa38b41a700 1 -- start start 2023-10-24T01:45:18.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa384064d10 0x7fa3840c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 0x7fa3841483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c4190 con 0x7fa3840aa2f0 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38414e8b0 con 0x7fa384064d10 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa38b41a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c3390 con 0x7fa3840c6430 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56954/0 (socket says 172.21.15.148:56954) 2023-10-24T01:45:18.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 -- 172.21.15.148:0/1436770049 learned_addr learned my addr 172.21.15.148:0/1436770049 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:18.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3891b6700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa384064d10 0x7fa3840c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3899b7700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 0x7fa3841483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 -- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 msgr2=0x7fa3841483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 0x7fa3841483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 -- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa384064d10 msgr2=0x7fa3840c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa384064d10 0x7fa3840c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 -- 172.21.15.148:0/1436770049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa374009370 con 0x7fa3840aa2f0 2023-10-24T01:45:18.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3899b7700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 0x7fa3841483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:18.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.148+0000 7fa3889b5700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fa374011000 tx=0x7fa374017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.149+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400bea0 con 0x7fa3840aa2f0 2023-10-24T01:45:18.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.149+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400b8d0 con 0x7fa3840aa2f0 2023-10-24T01:45:18.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.149+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840c3860 con 0x7fa3840aa2f0 2023-10-24T01:45:18.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.149+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37401c670 con 0x7fa3840aa2f0 2023-10-24T01:45:18.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.149+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840c3e20 con 0x7fa3840aa2f0 2023-10-24T01:45:18.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.150+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3840c4b10 con 0x7fa3840aa2f0 2023-10-24T01:45:18.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.150+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fa37401ca20 con 0x7fa3840aa2f0 2023-10-24T01:45:18.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.150+0000 7fa3797fa700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 0x7fa368061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.150+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa37407c3e0 con 0x7fa3840aa2f0 2023-10-24T01:45:18.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.151+0000 7fa3891b6700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 0x7fa368061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.151+0000 7fa3891b6700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 0x7fa368061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa3840c16b0 tx=0x7fa380008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.155+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa374050f30 con 0x7fa3840aa2f0 2023-10-24T01:45:18.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.383+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa38406c6b0 con 0x7fa3840aa2f0 2023-10-24T01:45:18.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.383+0000 7fa3797fa700 1 -- 172.21.15.148:0/1436770049 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7fa37402a080 con 0x7fa3840aa2f0 2023-10-24T01:45:18.386 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:18.386 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4602,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":181,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2497675264,"bytes_avail":770596438016,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":62,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":9132}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-24T01:34:36.905842+0000","services":{}},"progress_events":{}} 2023-10-24T01:45:18.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 msgr2=0x7fa368061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 0x7fa368061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa3840c16b0 tx=0x7fa380008040).stop 2023-10-24T01:45:18.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 msgr2=0x7fa38414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fa374011000 tx=0x7fa374017000).stop 2023-10-24T01:45:18.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 shutdown_connections 2023-10-24T01:45:18.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3840c6430 0x7fa3841483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa384064d10 0x7fa3840c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fa36805f270 0x7fa368061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 --2- 172.21.15.148:0/1436770049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3840aa2f0 0x7fa38414e3c0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 >> 172.21.15.148:0/1436770049 conn(0x7fa3840caf90 msgr2=0x7fa3840c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:18.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 shutdown_connections 2023-10-24T01:45:18.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.385+0000 7fa38b41a700 1 -- 172.21.15.148:0/1436770049 wait complete. 2023-10-24T01:45:18.400 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T01:45:18.401 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:45:18.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.513+0000 7f71c0358700 1 Processor -- start 2023-10-24T01:45:18.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.513+0000 7f71c0358700 1 -- start start 2023-10-24T01:45:18.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.514+0000 7f71c0358700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.514+0000 7f71c0358700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71b8152170 0x7f71b80c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.514+0000 7f71c0358700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8155550 con 0x7f71b8151d90 2023-10-24T01:45:18.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.514+0000 7f71c0358700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80c61c0 con 0x7f71b8152170 2023-10-24T01:45:18.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.514+0000 7f71c0358700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80a7480 con 0x7f71b80c8470 2023-10-24T01:45:18.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd8f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd8f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:56092/0 (socket says 172.21.15.148:56092) 2023-10-24T01:45:18.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f71b8152170 0x7f71b80c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd8f3700 1 -- 172.21.15.148:0/2375896543 learned_addr learned my addr 172.21.15.148:0/2375896543 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd0f2700 1 -- 172.21.15.148:0/2375896543 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449093305 0 0) 0x7f71b8155550 con 0x7f71b8151d90 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd0f2700 1 -- 172.21.15.148:0/2375896543 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a40033f0 con 0x7f71b8151d90 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 -- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 msgr2=0x7f71b80c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 -- 172.21.15.148:0/2375896543 >> v1:172.21.15.150:6789/0 conn(0x7f71b8151d90 legacy=0x7f71b80a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 -- 172.21.15.148:0/2375896543 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8154960 con 0x7f71b8152170 2023-10-24T01:45:18.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd8f3700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:18.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71be8f5700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8152170 0x7f71b80c5cd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f71b0009e60 tx=0x7f71b0009780).ready entity=mon.1 client_cookie=73203c0246085e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd0f2700 1 -- 172.21.15.148:0/2375896543 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000e070 con 0x7f71b8152170 2023-10-24T01:45:18.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd0f2700 1 -- 172.21.15.148:0/2375896543 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000bab0 con 0x7f71b8152170 2023-10-24T01:45:18.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.515+0000 7f71bd0f2700 1 -- 172.21.15.148:0/2375896543 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000be30 con 0x7f71b8152170 2023-10-24T01:45:18.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 -- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8152170 msgr2=0x7f71b80c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8152170 0x7f71b80c5cd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f71b0009e60 tx=0x7f71b0009780).stop 2023-10-24T01:45:18.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 -- 172.21.15.148:0/2375896543 shutdown_connections 2023-10-24T01:45:18.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b8152170 0x7f71b80c5cd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 --2- 172.21.15.148:0/2375896543 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b80c8470 0x7f71b80c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 -- 172.21.15.148:0/2375896543 >> 172.21.15.148:0/2375896543 conn(0x7f71b80641b0 msgr2=0x7f71b80c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:18.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 -- 172.21.15.148:0/2375896543 shutdown_connections 2023-10-24T01:45:18.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.516+0000 7f71c0358700 1 -- 172.21.15.148:0/2375896543 wait complete. 2023-10-24T01:45:18.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.517+0000 7f71c0358700 1 Processor -- start 2023-10-24T01:45:18.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.517+0000 7f71c0358700 1 -- start start 2023-10-24T01:45:18.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 0x7f71b8149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 0x7f71b8066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8152f60 con 0x7f71b8151d90 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8066c50 con 0x7f71b80c8470 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71c0358700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b814dea0 con 0x7f71b8152170 2023-10-24T01:45:18.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56960/0 (socket says 172.21.15.148:56960) 2023-10-24T01:45:18.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 -- 172.21.15.148:0/3454795783 learned_addr learned my addr 172.21.15.148:0/3454795783 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:18.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71be8f5700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 0x7f71b8066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71be0f4700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 0x7f71b8149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 -- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 msgr2=0x7f71b8066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 0x7f71b8066760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 -- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 msgr2=0x7f71b8149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 0x7f71b8149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71bd8f3700 1 -- 172.21.15.148:0/3454795783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009370 con 0x7f71b8151d90 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71be0f4700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 0x7f71b8149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:18.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.518+0000 7f71be8f5700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 0x7f71b8066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71bd8f3700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f71a8006d00 tx=0x7f71a80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800eee0 con 0x7f71b8151d90 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800c850 con 0x7f71b8151d90 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800cbd0 con 0x7f71b8151d90 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0009a20 con 0x7f71b8151d90 2023-10-24T01:45:18.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.519+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b8153420 con 0x7f71b8151d90 2023-10-24T01:45:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.520+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80c22f0 con 0x7f71b8151d90 2023-10-24T01:45:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.520+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f71a801b400 con 0x7f71b8151d90 2023-10-24T01:45:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.521+0000 7f71ae7fc700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 0x7f719c061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.521+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f71a807a9a0 con 0x7f71b8151d90 2023-10-24T01:45:18.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.521+0000 7f71be0f4700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 0x7f719c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:18.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.521+0000 7f71be0f4700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 0x7f719c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f71b80a6da0 tx=0x7f71b4009040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:18.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.525+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71b80c22f0 con 0x7f71b8151d90 2023-10-24T01:45:18.686 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.684+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71b80c22f0 con 0x7f719c05f240 2023-10-24T01:45:18.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.694+0000 7f71ae7fc700 1 -- 172.21.15.148:0/3454795783 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353246 (secure 0 0 0) 0x7f71b80c22f0 con 0x7f719c05f240 2023-10-24T01:45:18.700 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:18.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.697+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 msgr2=0x7f719c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.697+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 0x7f719c061700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f71b80a6da0 tx=0x7f71b4009040).stop 2023-10-24T01:45:18.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.697+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 msgr2=0x7f71b8066270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:18.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.697+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f71a8006d00 tx=0x7f71a80090f0).stop 2023-10-24T01:45:18.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 shutdown_connections 2023-10-24T01:45:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71b8152170 0x7f71b8066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71b80c8470 0x7f71b8149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f719c05f240 0x7f719c061700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 --2- 172.21.15.148:0/3454795783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71b8151d90 0x7f71b8066270 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:18.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 >> 172.21.15.148:0/3454795783 conn(0x7f71b80641b0 msgr2=0x7f71b8065550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:18.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 shutdown_connections 2023-10-24T01:45:18.706 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:18.698+0000 7f71c0358700 1 -- 172.21.15.148:0/3454795783 wait complete. 2023-10-24T01:45:18.706 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:45:18.711 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T01:45:16.759041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439136,"kb_used_data":17312,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752535584,"statfs":{"total":773094113280,"available":770596438016,"internally_reserved":0,"allocated":17727488,"data_stored":8988408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11956,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.059037"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851999+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857018+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858311+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854657+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856943+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851885+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859603+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851847+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857494+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859878+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851824+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859537+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856558+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858155+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855278+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859718+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859887+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855830+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.851411+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853535+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858831+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857766+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853997+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858424+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859346+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850356+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859383+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.860096+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850419+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857300+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856908+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859339+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856969+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859360+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855203+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850402+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854023+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856985+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857246+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856900+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853953+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.858905+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.850387+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855526+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854770+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854058+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854844+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854451+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855546+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856438+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.849814+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.857111+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856056+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853547+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856107+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855132+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856914+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757496+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:45:09.757496+0000","last_peered":"2023-10-24T01:45:09.757496+0000","last_clean":"2023-10-24T01:45:09.757496+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:45:09.757496+0000","last_undegraded":"2023-10-24T01:45:09.757496+0000","last_fullsized":"2023-10-24T01:45:09.757496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.853960+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023513+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:45:10.023513+0000","last_peered":"2023-10-24T01:45:10.023513+0000","last_clean":"2023-10-24T01:45:10.023513+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:45:10.023513+0000","last_undegraded":"2023-10-24T01:45:10.023513+0000","last_fullsized":"2023-10-24T01:45:10.023513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856825+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.838323+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:45:10.838323+0000","last_peered":"2023-10-24T01:45:10.838323+0000","last_clean":"2023-10-24T01:45:10.838323+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:45:10.838323+0000","last_undegraded":"2023-10-24T01:45:10.838323+0000","last_fullsized":"2023-10-24T01:45:10.838323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.854836+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.023463+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:45:10.023463+0000","last_peered":"2023-10-24T01:45:10.023463+0000","last_clean":"2023-10-24T01:45:10.023463+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:45:10.023463+0000","last_undegraded":"2023-10-24T01:45:10.023463+0000","last_fullsized":"2023-10-24T01:45:10.023463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839003+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:45:10.839003+0000","last_peered":"2023-10-24T01:45:10.839003+0000","last_clean":"2023-10-24T01:45:10.839003+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:45:10.839003+0000","last_undegraded":"2023-10-24T01:45:10.839003+0000","last_fullsized":"2023-10-24T01:45:10.839003+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.859391+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839007+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:45:10.839007+0000","last_peered":"2023-10-24T01:45:10.839007+0000","last_clean":"2023-10-24T01:45:10.839007+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:45:10.839007+0000","last_undegraded":"2023-10-24T01:45:10.839007+0000","last_fullsized":"2023-10-24T01:45:10.839007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855918+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-24T01:45:10.839016+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:45:10.839016+0000","last_peered":"2023-10-24T01:45:10.839016+0000","last_clean":"2023-10-24T01:45:10.839016+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:45:10.839016+0000","last_undegraded":"2023-10-24T01:45:10.839016+0000","last_fullsized":"2023-10-24T01:45:10.839016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.855834+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.757555+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:45:09.757555+0000","last_peered":"2023-10-24T01:45:09.757555+0000","last_clean":"2023-10-24T01:45:09.757555+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:45:09.757555+0000","last_undegraded":"2023-10-24T01:45:09.757555+0000","last_fullsized":"2023-10-24T01:45:09.757555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-24T01:45:13.847610+0000","last_change":"2023-10-24T01:45:13.847610+0000","last_active":"2023-10-24T01:45:13.847610+0000","last_peered":"2023-10-24T01:45:13.847610+0000","last_clean":"2023-10-24T01:45:13.847610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:13.847610+0000","last_undegraded":"2023-10-24T01:45:13.847610+0000","last_fullsized":"2023-10-24T01:45:13.847610+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T01:45:12.840551+0000","last_change":"2023-10-24T01:45:12.856138+0000","last_active":"2023-10-24T01:45:12.840551+0000","last_peered":"2023-10-24T01:45:12.840551+0000","last_clean":"2023-10-24T01:45:12.840551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T01:45:12.840551+0000","last_undegraded":"2023-10-24T01:45:12.840551+0000","last_fullsized":"2023-10-24T01:45:12.840551+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-24T01:45:09.762304+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:45:09.762304+0000","last_peered":"2023-10-24T01:45:09.762304+0000","last_clean":"2023-10-24T01:45:09.762304+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:45:09.762304+0000","last_undegraded":"2023-10-24T01:45:09.762304+0000","last_fullsized":"2023-10-24T01:45:09.762304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543057,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.434},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.624},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575761,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.308},"max":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.76500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.28899999999999998},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.81599999999999995},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.318,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.83599999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.68300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.35399999999999998},"max":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.626}]},{"osd":3,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.77100000000000002,"15min":0.879},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.46200000000000002},"min":{"1min":0.309,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.64000000000000001,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.308},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.372,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.54400000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575762,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.51800000000000002,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.39200000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.66200000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.434}]},{"osd":3,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"max":{"1min":0.70599999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":1.006,"15min":1.006},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.67000000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":0.71999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.623}]},{"osd":7,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78700000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36899999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.52300000000000002,"5min":0.60899999999999999,"15min":0.626},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.23999999999999999},"max":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.68200000000000005},"last":0.377}]},{"osd":2,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.25700000000000001},"max":{"1min":0.57999999999999996,"5min":0.625,"15min":0.65800000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39100000000000001,"15min":0.39600000000000002},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.24399999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.63},"last":0.33100000000000002}]},{"osd":3,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.26700000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.31},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.432}]},{"osd":4,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.26500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.628},"min":{"1min":0.43099999999999999,"5min":0.42699999999999999,"15min":0.33300000000000002},"max":{"1min":0.82999999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64500000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.63400000000000001},"min":{"1min":0.46400000000000002,"5min":0.432,"15min":0.39400000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88400000000000001,"15min":0.98099999999999998},"last":0.626}]},{"osd":7,"last update":"Tue Oct 24 01:44:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.40600000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45800000000000002},"max":{"1min":0.95499999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.313},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.33300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.57099999999999995}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.54000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575762,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307452,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064388,"statfs":{"total":96636764160,"available":96321933312,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.316},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.23999999999999999}]},{"osd":1,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.29199999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.32600000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.39000000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82499999999999996,"5min":1.071,"15min":1.071},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.46700000000000003}]},{"osd":7,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.49199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.624}]},{"osd":1,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.86699999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.83299999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.75700000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":1.04},"last":0.44}]},{"osd":6,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.92100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.83399999999999996,"15min":0.90300000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.84699999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.71299999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.42599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303356,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068484,"statfs":{"total":96636764160,"available":96326127616,"internally_reserved":0,"allocated":2215936,"data_stored":1123551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.44}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.38800000000000001}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.54100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:45:20.146 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T01:45:20.145+0000 7f998d237700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T01:45:21.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T01:45:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.842+0000 7f193794b700 1 Processor -- start 2023-10-24T01:45:21.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.842+0000 7f193794b700 1 -- start start 2023-10-24T01:45:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f193794b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f19300be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f193794b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f19300becb0 0x7f19300c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f193794b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300c70a0 con 0x7f1930155520 2023-10-24T01:45:21.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f193794b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300bf110 con 0x7f19300becb0 2023-10-24T01:45:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f193794b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300c87f0 con 0x7f1930155900 2023-10-24T01:45:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f1935ee8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f19300becb0 0x7f19300c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f19356e7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1930155520 0x7f19300c7c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34902/0 (socket says 172.21.15.148:34902) 2023-10-24T01:45:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.843+0000 7f19356e7700 1 -- 172.21.15.148:0/2040862201 learned_addr learned my addr 172.21.15.148:0/2040862201 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:21.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1934ee6700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f19300be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1935ee8700 1 -- 172.21.15.148:0/2040862201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 msgr2=0x7f19300be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1935ee8700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f19300be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1935ee8700 1 -- 172.21.15.148:0/2040862201 >> v1:172.21.15.148:6789/0 conn(0x7f1930155520 legacy=0x7f19300c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1927fff700 1 -- 172.21.15.148:0/2040862201 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732819396 0 0) 0x7f19300c70a0 con 0x7f1930155520 2023-10-24T01:45:21.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1935ee8700 1 -- 172.21.15.148:0/2040862201 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300c8ad0 con 0x7f19300becb0 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1934ee6700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f19300be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1935ee8700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300c48f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f1928009760 tx=0x7f1928009060).ready entity=mon.0 client_cookie=7448107cfd467aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1927fff700 1 -- 172.21.15.148:0/2040862201 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800b580 con 0x7f19300becb0 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1927fff700 1 -- 172.21.15.148:0/2040862201 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800b6e0 con 0x7f19300becb0 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f1927fff700 1 -- 172.21.15.148:0/2040862201 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ba60 con 0x7f19300becb0 2023-10-24T01:45:21.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 -- 172.21.15.148:0/2040862201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 msgr2=0x7f19300c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:21.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300c48f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f1928009760 tx=0x7f1928009060).stop 2023-10-24T01:45:21.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 -- 172.21.15.148:0/2040862201 shutdown_connections 2023-10-24T01:45:21.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300c48f0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:21.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 --2- 172.21.15.148:0/2040862201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f19300be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:21.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 -- 172.21.15.148:0/2040862201 >> 172.21.15.148:0/2040862201 conn(0x7f1930082f60 msgr2=0x7f19300924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:21.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.844+0000 7f193794b700 1 -- 172.21.15.148:0/2040862201 shutdown_connections 2023-10-24T01:45:21.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.845+0000 7f193794b700 1 -- 172.21.15.148:0/2040862201 wait complete. 2023-10-24T01:45:21.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.846+0000 7f193794b700 1 Processor -- start 2023-10-24T01:45:21.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.846+0000 7f193794b700 1 -- start start 2023-10-24T01:45:21.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 0x7f19300abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f1930148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300aa3f0 con 0x7f19300becb0 2023-10-24T01:45:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300a9b50 con 0x7f1930155520 2023-10-24T01:45:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19300a9e30 con 0x7f1930155900 2023-10-24T01:45:21.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56980/0 (socket says 172.21.15.148:56980) 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 -- 172.21.15.148:0/3073175845 learned_addr learned my addr 172.21.15.148:0/3073175845 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f1934ee6700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 0x7f19300abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f1935ee8700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f1930148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 -- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 msgr2=0x7f1930148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:21.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f1930148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:21.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 -- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 msgr2=0x7f19300abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:21.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 0x7f19300abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:21.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 -- 172.21.15.148:0/3073175845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280092a0 con 0x7f19300becb0 2023-10-24T01:45:21.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f1934ee6700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 0x7f19300abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:21.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19356e7700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f192c00c840 tx=0x7f192c007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:21.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c005c00 con 0x7f19300becb0 2023-10-24T01:45:21.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c005d60 con 0x7f19300becb0 2023-10-24T01:45:21.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19300aa110 con 0x7f19300becb0 2023-10-24T01:45:21.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c007340 con 0x7f19300becb0 2023-10-24T01:45:21.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.847+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19300ac2f0 con 0x7f19300becb0 2023-10-24T01:45:21.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.848+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193006c6b0 con 0x7f19300becb0 2023-10-24T01:45:21.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.849+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f192c0076f0 con 0x7f19300becb0 2023-10-24T01:45:21.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.849+0000 7f19257fa700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 0x7f1914061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:21.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.849+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f192c07a520 con 0x7f19300becb0 2023-10-24T01:45:21.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.849+0000 7f1934ee6700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 0x7f1914061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:21.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.850+0000 7f1934ee6700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 0x7f1914061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1920006fd0 tx=0x7f1920008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:21.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:21.854+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f192c04b640 con 0x7f19300becb0 2023-10-24T01:45:22.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.017+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19300c3e10 con 0x7f191405f270 2023-10-24T01:45:22.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.027+0000 7f19257fa700 1 -- 172.21.15.148:0/3073175845 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361978 (secure 0 0 0) 0x7f19300c3e10 con 0x7f191405f270 2023-10-24T01:45:22.033 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 msgr2=0x7f1914061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 0x7f1914061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1920006fd0 tx=0x7f1920008040).stop 2023-10-24T01:45:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 msgr2=0x7f19300a95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f192c00c840 tx=0x7f192c007e80).stop 2023-10-24T01:45:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 shutdown_connections 2023-10-24T01:45:22.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1930155900 0x7f1930148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f191405f270 0x7f1914061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19300becb0 0x7f19300a95a0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 --2- 172.21.15.148:0/3073175845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1930155520 0x7f19300abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 >> 172.21.15.148:0/3073175845 conn(0x7f1930082f60 msgr2=0x7f1930067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:22.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 shutdown_connections 2023-10-24T01:45:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.031+0000 7f193794b700 1 -- 172.21.15.148:0/3073175845 wait complete. 2023-10-24T01:45:22.039 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T01:45:22.045 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-24T01:45:20.760000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439488,"kb_used_data":17664,"kb_used_omap":0,"kb_used_meta":2421760,"kb_avail":752535232,"statfs":{"total":773094113280,"available":770596077568,"internally_reserved":0,"allocated":18087936,"data_stored":9158572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2479882240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11956,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.059637"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.246812+0000","last_change":"2023-10-24T01:45:14.245443+0000","last_active":"2023-10-24T01:45:14.246812+0000","last_peered":"2023-10-24T01:45:14.246812+0000","last_clean":"2023-10-24T01:45:14.246812+0000","last_became_active":"2023-10-24T01:45:14.245161+0000","last_became_peered":"2023-10-24T01:45:14.245161+0000","last_unstale":"2023-10-24T01:45:14.246812+0000","last_undegraded":"2023-10-24T01:45:14.246812+0000","last_fullsized":"2023-10-24T01:45:14.246812+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"180'3","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247784+0000","last_change":"2023-10-24T01:45:13.870624+0000","last_active":"2023-10-24T01:45:14.247784+0000","last_peered":"2023-10-24T01:45:14.247784+0000","last_clean":"2023-10-24T01:45:14.247784+0000","last_became_active":"2023-10-24T01:45:13.870314+0000","last_became_peered":"2023-10-24T01:45:13.870314+0000","last_unstale":"2023-10-24T01:45:14.247784+0000","last_undegraded":"2023-10-24T01:45:14.247784+0000","last_fullsized":"2023-10-24T01:45:14.247784+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.245375+0000","last_change":"2023-10-24T01:45:14.243959+0000","last_active":"2023-10-24T01:45:14.245375+0000","last_peered":"2023-10-24T01:45:14.245375+0000","last_clean":"2023-10-24T01:45:14.245375+0000","last_became_active":"2023-10-24T01:45:14.243696+0000","last_became_peered":"2023-10-24T01:45:14.243696+0000","last_unstale":"2023-10-24T01:45:14.245375+0000","last_undegraded":"2023-10-24T01:45:14.245375+0000","last_fullsized":"2023-10-24T01:45:14.245375+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232945+0000","last_change":"2023-10-24T01:45:13.868162+0000","last_active":"2023-10-24T01:45:14.232945+0000","last_peered":"2023-10-24T01:45:14.232945+0000","last_clean":"2023-10-24T01:45:14.232945+0000","last_became_active":"2023-10-24T01:45:13.867612+0000","last_became_peered":"2023-10-24T01:45:13.867612+0000","last_unstale":"2023-10-24T01:45:14.232945+0000","last_undegraded":"2023-10-24T01:45:14.232945+0000","last_fullsized":"2023-10-24T01:45:14.232945+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252894+0000","last_change":"2023-10-24T01:45:14.248570+0000","last_active":"2023-10-24T01:45:14.252894+0000","last_peered":"2023-10-24T01:45:14.252894+0000","last_clean":"2023-10-24T01:45:14.252894+0000","last_became_active":"2023-10-24T01:45:14.248302+0000","last_became_peered":"2023-10-24T01:45:14.248302+0000","last_unstale":"2023-10-24T01:45:14.252894+0000","last_undegraded":"2023-10-24T01:45:14.252894+0000","last_fullsized":"2023-10-24T01:45:14.252894+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.235585+0000","last_change":"2023-10-24T01:45:13.876739+0000","last_active":"2023-10-24T01:45:14.235585+0000","last_peered":"2023-10-24T01:45:14.235585+0000","last_clean":"2023-10-24T01:45:14.235585+0000","last_became_active":"2023-10-24T01:45:13.876381+0000","last_became_peered":"2023-10-24T01:45:13.876381+0000","last_unstale":"2023-10-24T01:45:14.235585+0000","last_undegraded":"2023-10-24T01:45:14.235585+0000","last_fullsized":"2023-10-24T01:45:14.235585+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.257356+0000","last_change":"2023-10-24T01:45:14.255817+0000","last_active":"2023-10-24T01:45:14.257356+0000","last_peered":"2023-10-24T01:45:14.257356+0000","last_clean":"2023-10-24T01:45:14.257356+0000","last_became_active":"2023-10-24T01:45:14.255524+0000","last_became_peered":"2023-10-24T01:45:14.255524+0000","last_unstale":"2023-10-24T01:45:14.257356+0000","last_undegraded":"2023-10-24T01:45:14.257356+0000","last_fullsized":"2023-10-24T01:45:14.257356+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254905+0000","last_change":"2023-10-24T01:45:13.883167+0000","last_active":"2023-10-24T01:45:14.254905+0000","last_peered":"2023-10-24T01:45:14.254905+0000","last_clean":"2023-10-24T01:45:14.254905+0000","last_became_active":"2023-10-24T01:45:13.882878+0000","last_became_peered":"2023-10-24T01:45:13.882878+0000","last_unstale":"2023-10-24T01:45:14.254905+0000","last_undegraded":"2023-10-24T01:45:14.254905+0000","last_fullsized":"2023-10-24T01:45:14.254905+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254560+0000","last_change":"2023-10-24T01:45:14.246001+0000","last_active":"2023-10-24T01:45:14.254560+0000","last_peered":"2023-10-24T01:45:14.254560+0000","last_clean":"2023-10-24T01:45:14.254560+0000","last_became_active":"2023-10-24T01:45:14.245372+0000","last_became_peered":"2023-10-24T01:45:14.245372+0000","last_unstale":"2023-10-24T01:45:14.254560+0000","last_undegraded":"2023-10-24T01:45:14.254560+0000","last_fullsized":"2023-10-24T01:45:14.254560+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249633+0000","last_change":"2023-10-24T01:45:13.879651+0000","last_active":"2023-10-24T01:45:14.249633+0000","last_peered":"2023-10-24T01:45:14.249633+0000","last_clean":"2023-10-24T01:45:14.249633+0000","last_became_active":"2023-10-24T01:45:13.879355+0000","last_became_peered":"2023-10-24T01:45:13.879355+0000","last_unstale":"2023-10-24T01:45:14.249633+0000","last_undegraded":"2023-10-24T01:45:14.249633+0000","last_fullsized":"2023-10-24T01:45:14.249633+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255443+0000","last_change":"2023-10-24T01:45:14.243849+0000","last_active":"2023-10-24T01:45:14.255443+0000","last_peered":"2023-10-24T01:45:14.255443+0000","last_clean":"2023-10-24T01:45:14.255443+0000","last_became_active":"2023-10-24T01:45:14.243559+0000","last_became_peered":"2023-10-24T01:45:14.243559+0000","last_unstale":"2023-10-24T01:45:14.255443+0000","last_undegraded":"2023-10-24T01:45:14.255443+0000","last_fullsized":"2023-10-24T01:45:14.255443+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.248103+0000","last_change":"2023-10-24T01:45:13.872975+0000","last_active":"2023-10-24T01:45:14.248103+0000","last_peered":"2023-10-24T01:45:14.248103+0000","last_clean":"2023-10-24T01:45:14.248103+0000","last_became_active":"2023-10-24T01:45:13.872713+0000","last_became_peered":"2023-10-24T01:45:13.872713+0000","last_unstale":"2023-10-24T01:45:14.248103+0000","last_undegraded":"2023-10-24T01:45:14.248103+0000","last_fullsized":"2023-10-24T01:45:14.248103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252848+0000","last_change":"2023-10-24T01:45:14.248062+0000","last_active":"2023-10-24T01:45:14.252848+0000","last_peered":"2023-10-24T01:45:14.252848+0000","last_clean":"2023-10-24T01:45:14.252848+0000","last_became_active":"2023-10-24T01:45:14.247734+0000","last_became_peered":"2023-10-24T01:45:14.247734+0000","last_unstale":"2023-10-24T01:45:14.252848+0000","last_undegraded":"2023-10-24T01:45:14.252848+0000","last_fullsized":"2023-10-24T01:45:14.252848+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.235819+0000","last_change":"2023-10-24T01:45:13.874202+0000","last_active":"2023-10-24T01:45:14.235819+0000","last_peered":"2023-10-24T01:45:14.235819+0000","last_clean":"2023-10-24T01:45:14.235819+0000","last_became_active":"2023-10-24T01:45:13.873725+0000","last_became_peered":"2023-10-24T01:45:13.873725+0000","last_unstale":"2023-10-24T01:45:14.235819+0000","last_undegraded":"2023-10-24T01:45:14.235819+0000","last_fullsized":"2023-10-24T01:45:14.235819+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252931+0000","last_change":"2023-10-24T01:45:14.249975+0000","last_active":"2023-10-24T01:45:14.252931+0000","last_peered":"2023-10-24T01:45:14.252931+0000","last_clean":"2023-10-24T01:45:14.252931+0000","last_became_active":"2023-10-24T01:45:14.249681+0000","last_became_peered":"2023-10-24T01:45:14.249681+0000","last_unstale":"2023-10-24T01:45:14.252931+0000","last_undegraded":"2023-10-24T01:45:14.252931+0000","last_fullsized":"2023-10-24T01:45:14.252931+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233142+0000","last_change":"2023-10-24T01:45:13.875819+0000","last_active":"2023-10-24T01:45:14.233142+0000","last_peered":"2023-10-24T01:45:14.233142+0000","last_clean":"2023-10-24T01:45:14.233142+0000","last_became_active":"2023-10-24T01:45:13.875551+0000","last_became_peered":"2023-10-24T01:45:13.875551+0000","last_unstale":"2023-10-24T01:45:14.233142+0000","last_undegraded":"2023-10-24T01:45:14.233142+0000","last_fullsized":"2023-10-24T01:45:14.233142+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255082+0000","last_change":"2023-10-24T01:45:14.251117+0000","last_active":"2023-10-24T01:45:14.255082+0000","last_peered":"2023-10-24T01:45:14.255082+0000","last_clean":"2023-10-24T01:45:14.255082+0000","last_became_active":"2023-10-24T01:45:14.250783+0000","last_became_peered":"2023-10-24T01:45:14.250783+0000","last_unstale":"2023-10-24T01:45:14.255082+0000","last_undegraded":"2023-10-24T01:45:14.255082+0000","last_fullsized":"2023-10-24T01:45:14.255082+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233982+0000","last_change":"2023-10-24T01:45:13.865204+0000","last_active":"2023-10-24T01:45:14.233982+0000","last_peered":"2023-10-24T01:45:14.233982+0000","last_clean":"2023-10-24T01:45:14.233982+0000","last_became_active":"2023-10-24T01:45:13.864934+0000","last_became_peered":"2023-10-24T01:45:13.864934+0000","last_unstale":"2023-10-24T01:45:14.233982+0000","last_undegraded":"2023-10-24T01:45:14.233982+0000","last_fullsized":"2023-10-24T01:45:14.233982+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.245016+0000","last_change":"2023-10-24T01:45:14.241198+0000","last_active":"2023-10-24T01:45:14.245016+0000","last_peered":"2023-10-24T01:45:14.245016+0000","last_clean":"2023-10-24T01:45:14.245016+0000","last_became_active":"2023-10-24T01:45:14.240404+0000","last_became_peered":"2023-10-24T01:45:14.240404+0000","last_unstale":"2023-10-24T01:45:14.245016+0000","last_undegraded":"2023-10-24T01:45:14.245016+0000","last_fullsized":"2023-10-24T01:45:14.245016+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.230161+0000","last_change":"2023-10-24T01:45:13.884595+0000","last_active":"2023-10-24T01:45:14.230161+0000","last_peered":"2023-10-24T01:45:14.230161+0000","last_clean":"2023-10-24T01:45:14.230161+0000","last_became_active":"2023-10-24T01:45:13.884023+0000","last_became_peered":"2023-10-24T01:45:13.884023+0000","last_unstale":"2023-10-24T01:45:14.230161+0000","last_undegraded":"2023-10-24T01:45:14.230161+0000","last_fullsized":"2023-10-24T01:45:14.230161+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247167+0000","last_change":"2023-10-24T01:45:14.239881+0000","last_active":"2023-10-24T01:45:14.247167+0000","last_peered":"2023-10-24T01:45:14.247167+0000","last_clean":"2023-10-24T01:45:14.247167+0000","last_became_active":"2023-10-24T01:45:14.239632+0000","last_became_peered":"2023-10-24T01:45:14.239632+0000","last_unstale":"2023-10-24T01:45:14.247167+0000","last_undegraded":"2023-10-24T01:45:14.247167+0000","last_fullsized":"2023-10-24T01:45:14.247167+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.234290+0000","last_change":"2023-10-24T01:45:13.879097+0000","last_active":"2023-10-24T01:45:14.234290+0000","last_peered":"2023-10-24T01:45:14.234290+0000","last_clean":"2023-10-24T01:45:14.234290+0000","last_became_active":"2023-10-24T01:45:13.878834+0000","last_became_peered":"2023-10-24T01:45:13.878834+0000","last_unstale":"2023-10-24T01:45:14.234290+0000","last_undegraded":"2023-10-24T01:45:14.234290+0000","last_fullsized":"2023-10-24T01:45:14.234290+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247160+0000","last_change":"2023-10-24T01:45:14.242114+0000","last_active":"2023-10-24T01:45:14.247160+0000","last_peered":"2023-10-24T01:45:14.247160+0000","last_clean":"2023-10-24T01:45:14.247160+0000","last_became_active":"2023-10-24T01:45:14.241716+0000","last_became_peered":"2023-10-24T01:45:14.241716+0000","last_unstale":"2023-10-24T01:45:14.247160+0000","last_undegraded":"2023-10-24T01:45:14.247160+0000","last_fullsized":"2023-10-24T01:45:14.247160+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"180'4","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.256832+0000","last_change":"2023-10-24T01:45:13.878531+0000","last_active":"2023-10-24T01:45:14.256832+0000","last_peered":"2023-10-24T01:45:14.256832+0000","last_clean":"2023-10-24T01:45:14.256832+0000","last_became_active":"2023-10-24T01:45:13.878235+0000","last_became_peered":"2023-10-24T01:45:13.878235+0000","last_unstale":"2023-10-24T01:45:14.256832+0000","last_undegraded":"2023-10-24T01:45:14.256832+0000","last_fullsized":"2023-10-24T01:45:14.256832+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252862+0000","last_change":"2023-10-24T01:45:14.249235+0000","last_active":"2023-10-24T01:45:14.252862+0000","last_peered":"2023-10-24T01:45:14.252862+0000","last_clean":"2023-10-24T01:45:14.252862+0000","last_became_active":"2023-10-24T01:45:14.248974+0000","last_became_peered":"2023-10-24T01:45:14.248974+0000","last_unstale":"2023-10-24T01:45:14.252862+0000","last_undegraded":"2023-10-24T01:45:14.252862+0000","last_fullsized":"2023-10-24T01:45:14.252862+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249796+0000","last_change":"2023-10-24T01:45:13.879469+0000","last_active":"2023-10-24T01:45:14.249796+0000","last_peered":"2023-10-24T01:45:14.249796+0000","last_clean":"2023-10-24T01:45:14.249796+0000","last_became_active":"2023-10-24T01:45:13.879188+0000","last_became_peered":"2023-10-24T01:45:13.879188+0000","last_unstale":"2023-10-24T01:45:14.249796+0000","last_undegraded":"2023-10-24T01:45:14.249796+0000","last_fullsized":"2023-10-24T01:45:14.249796+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253182+0000","last_change":"2023-10-24T01:45:14.250396+0000","last_active":"2023-10-24T01:45:14.253182+0000","last_peered":"2023-10-24T01:45:14.253182+0000","last_clean":"2023-10-24T01:45:14.253182+0000","last_became_active":"2023-10-24T01:45:14.249945+0000","last_became_peered":"2023-10-24T01:45:14.249945+0000","last_unstale":"2023-10-24T01:45:14.253182+0000","last_undegraded":"2023-10-24T01:45:14.253182+0000","last_fullsized":"2023-10-24T01:45:14.253182+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244087+0000","last_change":"2023-10-24T01:45:13.880708+0000","last_active":"2023-10-24T01:45:14.244087+0000","last_peered":"2023-10-24T01:45:14.244087+0000","last_clean":"2023-10-24T01:45:14.244087+0000","last_became_active":"2023-10-24T01:45:13.879942+0000","last_became_peered":"2023-10-24T01:45:13.879942+0000","last_unstale":"2023-10-24T01:45:14.244087+0000","last_undegraded":"2023-10-24T01:45:14.244087+0000","last_fullsized":"2023-10-24T01:45:14.244087+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255177+0000","last_change":"2023-10-24T01:45:14.251308+0000","last_active":"2023-10-24T01:45:14.255177+0000","last_peered":"2023-10-24T01:45:14.255177+0000","last_clean":"2023-10-24T01:45:14.255177+0000","last_became_active":"2023-10-24T01:45:14.250997+0000","last_became_peered":"2023-10-24T01:45:14.250997+0000","last_unstale":"2023-10-24T01:45:14.255177+0000","last_undegraded":"2023-10-24T01:45:14.255177+0000","last_fullsized":"2023-10-24T01:45:14.255177+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.229962+0000","last_change":"2023-10-24T01:45:13.877950+0000","last_active":"2023-10-24T01:45:14.229962+0000","last_peered":"2023-10-24T01:45:14.229962+0000","last_clean":"2023-10-24T01:45:14.229962+0000","last_became_active":"2023-10-24T01:45:13.877636+0000","last_became_peered":"2023-10-24T01:45:13.877636+0000","last_unstale":"2023-10-24T01:45:14.229962+0000","last_undegraded":"2023-10-24T01:45:14.229962+0000","last_fullsized":"2023-10-24T01:45:14.229962+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247209+0000","last_change":"2023-10-24T01:45:14.239822+0000","last_active":"2023-10-24T01:45:14.247209+0000","last_peered":"2023-10-24T01:45:14.247209+0000","last_clean":"2023-10-24T01:45:14.247209+0000","last_became_active":"2023-10-24T01:45:14.239556+0000","last_became_peered":"2023-10-24T01:45:14.239556+0000","last_unstale":"2023-10-24T01:45:14.247209+0000","last_undegraded":"2023-10-24T01:45:14.247209+0000","last_fullsized":"2023-10-24T01:45:14.247209+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"180'4","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247045+0000","last_change":"2023-10-24T01:45:13.870950+0000","last_active":"2023-10-24T01:45:14.247045+0000","last_peered":"2023-10-24T01:45:14.247045+0000","last_clean":"2023-10-24T01:45:14.247045+0000","last_became_active":"2023-10-24T01:45:13.870678+0000","last_became_peered":"2023-10-24T01:45:13.870678+0000","last_unstale":"2023-10-24T01:45:14.247045+0000","last_undegraded":"2023-10-24T01:45:14.247045+0000","last_fullsized":"2023-10-24T01:45:14.247045+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249350+0000","last_change":"2023-10-24T01:45:14.239650+0000","last_active":"2023-10-24T01:45:14.249350+0000","last_peered":"2023-10-24T01:45:14.249350+0000","last_clean":"2023-10-24T01:45:14.249350+0000","last_became_active":"2023-10-24T01:45:14.239343+0000","last_became_peered":"2023-10-24T01:45:14.239343+0000","last_unstale":"2023-10-24T01:45:14.249350+0000","last_undegraded":"2023-10-24T01:45:14.249350+0000","last_fullsized":"2023-10-24T01:45:14.249350+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.230560+0000","last_change":"2023-10-24T01:45:13.875837+0000","last_active":"2023-10-24T01:45:14.230560+0000","last_peered":"2023-10-24T01:45:14.230560+0000","last_clean":"2023-10-24T01:45:14.230560+0000","last_became_active":"2023-10-24T01:45:13.875558+0000","last_became_peered":"2023-10-24T01:45:13.875558+0000","last_unstale":"2023-10-24T01:45:14.230560+0000","last_undegraded":"2023-10-24T01:45:14.230560+0000","last_fullsized":"2023-10-24T01:45:14.230560+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255207+0000","last_change":"2023-10-24T01:45:14.253318+0000","last_active":"2023-10-24T01:45:14.255207+0000","last_peered":"2023-10-24T01:45:14.255207+0000","last_clean":"2023-10-24T01:45:14.255207+0000","last_became_active":"2023-10-24T01:45:14.253048+0000","last_became_peered":"2023-10-24T01:45:14.253048+0000","last_unstale":"2023-10-24T01:45:14.255207+0000","last_undegraded":"2023-10-24T01:45:14.255207+0000","last_fullsized":"2023-10-24T01:45:14.255207+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.239531+0000","last_change":"2023-10-24T01:45:13.877043+0000","last_active":"2023-10-24T01:45:14.239531+0000","last_peered":"2023-10-24T01:45:14.239531+0000","last_clean":"2023-10-24T01:45:14.239531+0000","last_became_active":"2023-10-24T01:45:13.875937+0000","last_became_peered":"2023-10-24T01:45:13.875937+0000","last_unstale":"2023-10-24T01:45:14.239531+0000","last_undegraded":"2023-10-24T01:45:14.239531+0000","last_fullsized":"2023-10-24T01:45:14.239531+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.258311+0000","last_change":"2023-10-24T01:45:14.254214+0000","last_active":"2023-10-24T01:45:14.258311+0000","last_peered":"2023-10-24T01:45:14.258311+0000","last_clean":"2023-10-24T01:45:14.258311+0000","last_became_active":"2023-10-24T01:45:14.253978+0000","last_became_peered":"2023-10-24T01:45:14.253978+0000","last_unstale":"2023-10-24T01:45:14.258311+0000","last_undegraded":"2023-10-24T01:45:14.258311+0000","last_fullsized":"2023-10-24T01:45:14.258311+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.246552+0000","last_change":"2023-10-24T01:45:13.872249+0000","last_active":"2023-10-24T01:45:14.246552+0000","last_peered":"2023-10-24T01:45:14.246552+0000","last_clean":"2023-10-24T01:45:14.246552+0000","last_became_active":"2023-10-24T01:45:13.871189+0000","last_became_peered":"2023-10-24T01:45:13.871189+0000","last_unstale":"2023-10-24T01:45:14.246552+0000","last_undegraded":"2023-10-24T01:45:14.246552+0000","last_fullsized":"2023-10-24T01:45:14.246552+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.256229+0000","last_change":"2023-10-24T01:45:14.253184+0000","last_active":"2023-10-24T01:45:14.256229+0000","last_peered":"2023-10-24T01:45:14.256229+0000","last_clean":"2023-10-24T01:45:14.256229+0000","last_became_active":"2023-10-24T01:45:14.252923+0000","last_became_peered":"2023-10-24T01:45:14.252923+0000","last_unstale":"2023-10-24T01:45:14.256229+0000","last_undegraded":"2023-10-24T01:45:14.256229+0000","last_fullsized":"2023-10-24T01:45:14.256229+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.229432+0000","last_change":"2023-10-24T01:45:13.873570+0000","last_active":"2023-10-24T01:45:14.229432+0000","last_peered":"2023-10-24T01:45:14.229432+0000","last_clean":"2023-10-24T01:45:14.229432+0000","last_became_active":"2023-10-24T01:45:13.873258+0000","last_became_peered":"2023-10-24T01:45:13.873258+0000","last_unstale":"2023-10-24T01:45:14.229432+0000","last_undegraded":"2023-10-24T01:45:14.229432+0000","last_fullsized":"2023-10-24T01:45:14.229432+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.237336+0000","last_change":"2023-10-24T01:45:14.235582+0000","last_active":"2023-10-24T01:45:14.237336+0000","last_peered":"2023-10-24T01:45:14.237336+0000","last_clean":"2023-10-24T01:45:14.237336+0000","last_became_active":"2023-10-24T01:45:14.235295+0000","last_became_peered":"2023-10-24T01:45:14.235295+0000","last_unstale":"2023-10-24T01:45:14.237336+0000","last_undegraded":"2023-10-24T01:45:14.237336+0000","last_fullsized":"2023-10-24T01:45:14.237336+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.250195+0000","last_change":"2023-10-24T01:45:13.883113+0000","last_active":"2023-10-24T01:45:14.250195+0000","last_peered":"2023-10-24T01:45:14.250195+0000","last_clean":"2023-10-24T01:45:14.250195+0000","last_became_active":"2023-10-24T01:45:13.882844+0000","last_became_peered":"2023-10-24T01:45:13.882844+0000","last_unstale":"2023-10-24T01:45:14.250195+0000","last_undegraded":"2023-10-24T01:45:14.250195+0000","last_fullsized":"2023-10-24T01:45:14.250195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255753+0000","last_change":"2023-10-24T01:45:14.250389+0000","last_active":"2023-10-24T01:45:14.255753+0000","last_peered":"2023-10-24T01:45:14.255753+0000","last_clean":"2023-10-24T01:45:14.255753+0000","last_became_active":"2023-10-24T01:45:14.249971+0000","last_became_peered":"2023-10-24T01:45:14.249971+0000","last_unstale":"2023-10-24T01:45:14.255753+0000","last_undegraded":"2023-10-24T01:45:14.255753+0000","last_fullsized":"2023-10-24T01:45:14.255753+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244192+0000","last_change":"2023-10-24T01:45:13.879039+0000","last_active":"2023-10-24T01:45:14.244192+0000","last_peered":"2023-10-24T01:45:14.244192+0000","last_clean":"2023-10-24T01:45:14.244192+0000","last_became_active":"2023-10-24T01:45:13.878544+0000","last_became_peered":"2023-10-24T01:45:13.878544+0000","last_unstale":"2023-10-24T01:45:14.244192+0000","last_undegraded":"2023-10-24T01:45:14.244192+0000","last_fullsized":"2023-10-24T01:45:14.244192+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253344+0000","last_change":"2023-10-24T01:45:14.247494+0000","last_active":"2023-10-24T01:45:14.253344+0000","last_peered":"2023-10-24T01:45:14.253344+0000","last_clean":"2023-10-24T01:45:14.253344+0000","last_became_active":"2023-10-24T01:45:14.246964+0000","last_became_peered":"2023-10-24T01:45:14.246964+0000","last_unstale":"2023-10-24T01:45:14.253344+0000","last_undegraded":"2023-10-24T01:45:14.253344+0000","last_fullsized":"2023-10-24T01:45:14.253344+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.242077+0000","last_change":"2023-10-24T01:45:13.871923+0000","last_active":"2023-10-24T01:45:14.242077+0000","last_peered":"2023-10-24T01:45:14.242077+0000","last_clean":"2023-10-24T01:45:14.242077+0000","last_became_active":"2023-10-24T01:45:13.871664+0000","last_became_peered":"2023-10-24T01:45:13.871664+0000","last_unstale":"2023-10-24T01:45:14.242077+0000","last_undegraded":"2023-10-24T01:45:14.242077+0000","last_fullsized":"2023-10-24T01:45:14.242077+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249870+0000","last_change":"2023-10-24T01:45:14.244847+0000","last_active":"2023-10-24T01:45:14.249870+0000","last_peered":"2023-10-24T01:45:14.249870+0000","last_clean":"2023-10-24T01:45:14.249870+0000","last_became_active":"2023-10-24T01:45:14.244533+0000","last_became_peered":"2023-10-24T01:45:14.244533+0000","last_unstale":"2023-10-24T01:45:14.249870+0000","last_undegraded":"2023-10-24T01:45:14.249870+0000","last_fullsized":"2023-10-24T01:45:14.249870+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.230879+0000","last_change":"2023-10-24T01:45:13.885223+0000","last_active":"2023-10-24T01:45:14.230879+0000","last_peered":"2023-10-24T01:45:14.230879+0000","last_clean":"2023-10-24T01:45:14.230879+0000","last_became_active":"2023-10-24T01:45:13.884855+0000","last_became_peered":"2023-10-24T01:45:13.884855+0000","last_unstale":"2023-10-24T01:45:14.230879+0000","last_undegraded":"2023-10-24T01:45:14.230879+0000","last_fullsized":"2023-10-24T01:45:14.230879+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244623+0000","last_change":"2023-10-24T01:45:14.240853+0000","last_active":"2023-10-24T01:45:14.244623+0000","last_peered":"2023-10-24T01:45:14.244623+0000","last_clean":"2023-10-24T01:45:14.244623+0000","last_became_active":"2023-10-24T01:45:14.240378+0000","last_became_peered":"2023-10-24T01:45:14.240378+0000","last_unstale":"2023-10-24T01:45:14.244623+0000","last_undegraded":"2023-10-24T01:45:14.244623+0000","last_fullsized":"2023-10-24T01:45:14.244623+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.228838+0000","last_change":"2023-10-24T01:45:13.869911+0000","last_active":"2023-10-24T01:45:14.228838+0000","last_peered":"2023-10-24T01:45:14.228838+0000","last_clean":"2023-10-24T01:45:14.228838+0000","last_became_active":"2023-10-24T01:45:13.869667+0000","last_became_peered":"2023-10-24T01:45:13.869667+0000","last_unstale":"2023-10-24T01:45:14.228838+0000","last_undegraded":"2023-10-24T01:45:14.228838+0000","last_fullsized":"2023-10-24T01:45:14.228838+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247320+0000","last_change":"2023-10-24T01:45:14.243595+0000","last_active":"2023-10-24T01:45:14.247320+0000","last_peered":"2023-10-24T01:45:14.247320+0000","last_clean":"2023-10-24T01:45:14.247320+0000","last_became_active":"2023-10-24T01:45:14.243321+0000","last_became_peered":"2023-10-24T01:45:14.243321+0000","last_unstale":"2023-10-24T01:45:14.247320+0000","last_undegraded":"2023-10-24T01:45:14.247320+0000","last_fullsized":"2023-10-24T01:45:14.247320+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.234000+0000","last_change":"2023-10-24T01:45:13.872017+0000","last_active":"2023-10-24T01:45:14.234000+0000","last_peered":"2023-10-24T01:45:14.234000+0000","last_clean":"2023-10-24T01:45:14.234000+0000","last_became_active":"2023-10-24T01:45:13.871722+0000","last_became_peered":"2023-10-24T01:45:13.871722+0000","last_unstale":"2023-10-24T01:45:14.234000+0000","last_undegraded":"2023-10-24T01:45:14.234000+0000","last_fullsized":"2023-10-24T01:45:14.234000+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254681+0000","last_change":"2023-10-24T01:45:14.252392+0000","last_active":"2023-10-24T01:45:14.254681+0000","last_peered":"2023-10-24T01:45:14.254681+0000","last_clean":"2023-10-24T01:45:14.254681+0000","last_became_active":"2023-10-24T01:45:14.251560+0000","last_became_peered":"2023-10-24T01:45:14.251560+0000","last_unstale":"2023-10-24T01:45:14.254681+0000","last_undegraded":"2023-10-24T01:45:14.254681+0000","last_fullsized":"2023-10-24T01:45:14.254681+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.229471+0000","last_change":"2023-10-24T01:45:13.874823+0000","last_active":"2023-10-24T01:45:14.229471+0000","last_peered":"2023-10-24T01:45:14.229471+0000","last_clean":"2023-10-24T01:45:14.229471+0000","last_became_active":"2023-10-24T01:45:13.874571+0000","last_became_peered":"2023-10-24T01:45:13.874571+0000","last_unstale":"2023-10-24T01:45:14.229471+0000","last_undegraded":"2023-10-24T01:45:14.229471+0000","last_fullsized":"2023-10-24T01:45:14.229471+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253386+0000","last_change":"2023-10-24T01:45:14.247277+0000","last_active":"2023-10-24T01:45:14.253386+0000","last_peered":"2023-10-24T01:45:14.253386+0000","last_clean":"2023-10-24T01:45:14.253386+0000","last_became_active":"2023-10-24T01:45:14.246979+0000","last_became_peered":"2023-10-24T01:45:14.246979+0000","last_unstale":"2023-10-24T01:45:14.253386+0000","last_undegraded":"2023-10-24T01:45:14.253386+0000","last_fullsized":"2023-10-24T01:45:14.253386+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.236686+0000","last_change":"2023-10-24T01:45:13.877781+0000","last_active":"2023-10-24T01:45:14.236686+0000","last_peered":"2023-10-24T01:45:14.236686+0000","last_clean":"2023-10-24T01:45:14.236686+0000","last_became_active":"2023-10-24T01:45:13.877483+0000","last_became_peered":"2023-10-24T01:45:13.877483+0000","last_unstale":"2023-10-24T01:45:14.236686+0000","last_undegraded":"2023-10-24T01:45:14.236686+0000","last_fullsized":"2023-10-24T01:45:14.236686+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254582+0000","last_change":"2023-10-24T01:45:14.246173+0000","last_active":"2023-10-24T01:45:14.254582+0000","last_peered":"2023-10-24T01:45:14.254582+0000","last_clean":"2023-10-24T01:45:14.254582+0000","last_became_active":"2023-10-24T01:45:14.245744+0000","last_became_peered":"2023-10-24T01:45:14.245744+0000","last_unstale":"2023-10-24T01:45:14.254582+0000","last_undegraded":"2023-10-24T01:45:14.254582+0000","last_fullsized":"2023-10-24T01:45:14.254582+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.234057+0000","last_change":"2023-10-24T01:45:13.866610+0000","last_active":"2023-10-24T01:45:14.234057+0000","last_peered":"2023-10-24T01:45:14.234057+0000","last_clean":"2023-10-24T01:45:14.234057+0000","last_became_active":"2023-10-24T01:45:13.865359+0000","last_became_peered":"2023-10-24T01:45:13.865359+0000","last_unstale":"2023-10-24T01:45:14.234057+0000","last_undegraded":"2023-10-24T01:45:14.234057+0000","last_fullsized":"2023-10-24T01:45:14.234057+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252768+0000","last_change":"2023-10-24T01:45:14.249134+0000","last_active":"2023-10-24T01:45:14.252768+0000","last_peered":"2023-10-24T01:45:14.252768+0000","last_clean":"2023-10-24T01:45:14.252768+0000","last_became_active":"2023-10-24T01:45:14.248865+0000","last_became_peered":"2023-10-24T01:45:14.248865+0000","last_unstale":"2023-10-24T01:45:14.252768+0000","last_undegraded":"2023-10-24T01:45:14.252768+0000","last_fullsized":"2023-10-24T01:45:14.252768+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244294+0000","last_change":"2023-10-24T01:45:13.879948+0000","last_active":"2023-10-24T01:45:14.244294+0000","last_peered":"2023-10-24T01:45:14.244294+0000","last_clean":"2023-10-24T01:45:14.244294+0000","last_became_active":"2023-10-24T01:45:13.879614+0000","last_became_peered":"2023-10-24T01:45:13.879614+0000","last_unstale":"2023-10-24T01:45:14.244294+0000","last_undegraded":"2023-10-24T01:45:14.244294+0000","last_fullsized":"2023-10-24T01:45:14.244294+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244968+0000","last_change":"2023-10-24T01:45:14.243468+0000","last_active":"2023-10-24T01:45:14.244968+0000","last_peered":"2023-10-24T01:45:14.244968+0000","last_clean":"2023-10-24T01:45:14.244968+0000","last_became_active":"2023-10-24T01:45:14.243190+0000","last_became_peered":"2023-10-24T01:45:14.243190+0000","last_unstale":"2023-10-24T01:45:14.244968+0000","last_undegraded":"2023-10-24T01:45:14.244968+0000","last_fullsized":"2023-10-24T01:45:14.244968+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232225+0000","last_change":"2023-10-24T01:45:13.866654+0000","last_active":"2023-10-24T01:45:14.232225+0000","last_peered":"2023-10-24T01:45:14.232225+0000","last_clean":"2023-10-24T01:45:14.232225+0000","last_became_active":"2023-10-24T01:45:13.866393+0000","last_became_peered":"2023-10-24T01:45:13.866393+0000","last_unstale":"2023-10-24T01:45:14.232225+0000","last_undegraded":"2023-10-24T01:45:14.232225+0000","last_fullsized":"2023-10-24T01:45:14.232225+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.256131+0000","last_change":"2023-10-24T01:45:14.252102+0000","last_active":"2023-10-24T01:45:14.256131+0000","last_peered":"2023-10-24T01:45:14.256131+0000","last_clean":"2023-10-24T01:45:14.256131+0000","last_became_active":"2023-10-24T01:45:14.251802+0000","last_became_peered":"2023-10-24T01:45:14.251802+0000","last_unstale":"2023-10-24T01:45:14.256131+0000","last_undegraded":"2023-10-24T01:45:14.256131+0000","last_fullsized":"2023-10-24T01:45:14.256131+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.228825+0000","last_change":"2023-10-24T01:45:13.877827+0000","last_active":"2023-10-24T01:45:14.228825+0000","last_peered":"2023-10-24T01:45:14.228825+0000","last_clean":"2023-10-24T01:45:14.228825+0000","last_became_active":"2023-10-24T01:45:13.877538+0000","last_became_peered":"2023-10-24T01:45:13.877538+0000","last_unstale":"2023-10-24T01:45:14.228825+0000","last_undegraded":"2023-10-24T01:45:14.228825+0000","last_fullsized":"2023-10-24T01:45:14.228825+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.245585+0000","last_change":"2023-10-24T01:45:14.243320+0000","last_active":"2023-10-24T01:45:14.245585+0000","last_peered":"2023-10-24T01:45:14.245585+0000","last_clean":"2023-10-24T01:45:14.245585+0000","last_became_active":"2023-10-24T01:45:14.243080+0000","last_became_peered":"2023-10-24T01:45:14.243080+0000","last_unstale":"2023-10-24T01:45:14.245585+0000","last_undegraded":"2023-10-24T01:45:14.245585+0000","last_fullsized":"2023-10-24T01:45:14.245585+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249479+0000","last_change":"2023-10-24T01:45:13.868937+0000","last_active":"2023-10-24T01:45:14.249479+0000","last_peered":"2023-10-24T01:45:14.249479+0000","last_clean":"2023-10-24T01:45:14.249479+0000","last_became_active":"2023-10-24T01:45:13.868681+0000","last_became_peered":"2023-10-24T01:45:13.868681+0000","last_unstale":"2023-10-24T01:45:14.249479+0000","last_undegraded":"2023-10-24T01:45:14.249479+0000","last_fullsized":"2023-10-24T01:45:14.249479+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253253+0000","last_change":"2023-10-24T01:45:14.248655+0000","last_active":"2023-10-24T01:45:14.253253+0000","last_peered":"2023-10-24T01:45:14.253253+0000","last_clean":"2023-10-24T01:45:14.253253+0000","last_became_active":"2023-10-24T01:45:14.248374+0000","last_became_peered":"2023-10-24T01:45:14.248374+0000","last_unstale":"2023-10-24T01:45:14.253253+0000","last_undegraded":"2023-10-24T01:45:14.253253+0000","last_fullsized":"2023-10-24T01:45:14.253253+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255029+0000","last_change":"2023-10-24T01:45:13.877895+0000","last_active":"2023-10-24T01:45:14.255029+0000","last_peered":"2023-10-24T01:45:14.255029+0000","last_clean":"2023-10-24T01:45:14.255029+0000","last_became_active":"2023-10-24T01:45:13.877601+0000","last_became_peered":"2023-10-24T01:45:13.877601+0000","last_unstale":"2023-10-24T01:45:14.255029+0000","last_undegraded":"2023-10-24T01:45:14.255029+0000","last_fullsized":"2023-10-24T01:45:14.255029+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254693+0000","last_change":"2023-10-24T01:45:14.248585+0000","last_active":"2023-10-24T01:45:14.254693+0000","last_peered":"2023-10-24T01:45:14.254693+0000","last_clean":"2023-10-24T01:45:14.254693+0000","last_became_active":"2023-10-24T01:45:14.248315+0000","last_became_peered":"2023-10-24T01:45:14.248315+0000","last_unstale":"2023-10-24T01:45:14.254693+0000","last_undegraded":"2023-10-24T01:45:14.254693+0000","last_fullsized":"2023-10-24T01:45:14.254693+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252071+0000","last_change":"2023-10-24T01:45:13.878601+0000","last_active":"2023-10-24T01:45:14.252071+0000","last_peered":"2023-10-24T01:45:14.252071+0000","last_clean":"2023-10-24T01:45:14.252071+0000","last_became_active":"2023-10-24T01:45:13.878309+0000","last_became_peered":"2023-10-24T01:45:13.878309+0000","last_unstale":"2023-10-24T01:45:14.252071+0000","last_undegraded":"2023-10-24T01:45:14.252071+0000","last_fullsized":"2023-10-24T01:45:14.252071+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255373+0000","last_change":"2023-10-24T01:45:14.251351+0000","last_active":"2023-10-24T01:45:14.255373+0000","last_peered":"2023-10-24T01:45:14.255373+0000","last_clean":"2023-10-24T01:45:14.255373+0000","last_became_active":"2023-10-24T01:45:14.249382+0000","last_became_peered":"2023-10-24T01:45:14.249382+0000","last_unstale":"2023-10-24T01:45:14.255373+0000","last_undegraded":"2023-10-24T01:45:14.255373+0000","last_fullsized":"2023-10-24T01:45:14.255373+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233094+0000","last_change":"2023-10-24T01:45:13.871808+0000","last_active":"2023-10-24T01:45:14.233094+0000","last_peered":"2023-10-24T01:45:14.233094+0000","last_clean":"2023-10-24T01:45:14.233094+0000","last_became_active":"2023-10-24T01:45:13.871495+0000","last_became_peered":"2023-10-24T01:45:13.871495+0000","last_unstale":"2023-10-24T01:45:14.233094+0000","last_undegraded":"2023-10-24T01:45:14.233094+0000","last_fullsized":"2023-10-24T01:45:14.233094+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.251044+0000","last_change":"2023-10-24T01:45:14.245452+0000","last_active":"2023-10-24T01:45:14.251044+0000","last_peered":"2023-10-24T01:45:14.251044+0000","last_clean":"2023-10-24T01:45:14.251044+0000","last_became_active":"2023-10-24T01:45:14.245214+0000","last_became_peered":"2023-10-24T01:45:14.245214+0000","last_unstale":"2023-10-24T01:45:14.251044+0000","last_undegraded":"2023-10-24T01:45:14.251044+0000","last_fullsized":"2023-10-24T01:45:14.251044+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.245210+0000","last_change":"2023-10-24T01:45:13.881589+0000","last_active":"2023-10-24T01:45:14.245210+0000","last_peered":"2023-10-24T01:45:14.245210+0000","last_clean":"2023-10-24T01:45:14.245210+0000","last_became_active":"2023-10-24T01:45:13.881330+0000","last_became_peered":"2023-10-24T01:45:13.881330+0000","last_unstale":"2023-10-24T01:45:14.245210+0000","last_undegraded":"2023-10-24T01:45:14.245210+0000","last_fullsized":"2023-10-24T01:45:14.245210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.247741+0000","last_change":"2023-10-24T01:45:14.247061+0000","last_active":"2023-10-24T01:45:14.247741+0000","last_peered":"2023-10-24T01:45:14.247741+0000","last_clean":"2023-10-24T01:45:14.247741+0000","last_became_active":"2023-10-24T01:45:14.246768+0000","last_became_peered":"2023-10-24T01:45:14.246768+0000","last_unstale":"2023-10-24T01:45:14.247741+0000","last_undegraded":"2023-10-24T01:45:14.247741+0000","last_fullsized":"2023-10-24T01:45:14.247741+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233394+0000","last_change":"2023-10-24T01:45:13.875115+0000","last_active":"2023-10-24T01:45:14.233394+0000","last_peered":"2023-10-24T01:45:14.233394+0000","last_clean":"2023-10-24T01:45:14.233394+0000","last_became_active":"2023-10-24T01:45:13.874717+0000","last_became_peered":"2023-10-24T01:45:13.874717+0000","last_unstale":"2023-10-24T01:45:14.233394+0000","last_undegraded":"2023-10-24T01:45:14.233394+0000","last_fullsized":"2023-10-24T01:45:14.233394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.245554+0000","last_change":"2023-10-24T01:45:14.241866+0000","last_active":"2023-10-24T01:45:14.245554+0000","last_peered":"2023-10-24T01:45:14.245554+0000","last_clean":"2023-10-24T01:45:14.245554+0000","last_became_active":"2023-10-24T01:45:14.241612+0000","last_became_peered":"2023-10-24T01:45:14.241612+0000","last_unstale":"2023-10-24T01:45:14.245554+0000","last_undegraded":"2023-10-24T01:45:14.245554+0000","last_fullsized":"2023-10-24T01:45:14.245554+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232713+0000","last_change":"2023-10-24T01:45:13.876932+0000","last_active":"2023-10-24T01:45:14.232713+0000","last_peered":"2023-10-24T01:45:14.232713+0000","last_clean":"2023-10-24T01:45:14.232713+0000","last_became_active":"2023-10-24T01:45:13.876636+0000","last_became_peered":"2023-10-24T01:45:13.876636+0000","last_unstale":"2023-10-24T01:45:14.232713+0000","last_undegraded":"2023-10-24T01:45:14.232713+0000","last_fullsized":"2023-10-24T01:45:14.232713+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253281+0000","last_change":"2023-10-24T01:45:14.248963+0000","last_active":"2023-10-24T01:45:14.253281+0000","last_peered":"2023-10-24T01:45:14.253281+0000","last_clean":"2023-10-24T01:45:14.253281+0000","last_became_active":"2023-10-24T01:45:14.248683+0000","last_became_peered":"2023-10-24T01:45:14.248683+0000","last_unstale":"2023-10-24T01:45:14.253281+0000","last_undegraded":"2023-10-24T01:45:14.253281+0000","last_fullsized":"2023-10-24T01:45:14.253281+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232779+0000","last_change":"2023-10-24T01:45:13.877155+0000","last_active":"2023-10-24T01:45:14.232779+0000","last_peered":"2023-10-24T01:45:14.232779+0000","last_clean":"2023-10-24T01:45:14.232779+0000","last_became_active":"2023-10-24T01:45:13.876894+0000","last_became_peered":"2023-10-24T01:45:13.876894+0000","last_unstale":"2023-10-24T01:45:14.232779+0000","last_undegraded":"2023-10-24T01:45:14.232779+0000","last_fullsized":"2023-10-24T01:45:14.232779+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.242477+0000","last_change":"2023-10-24T01:45:14.238233+0000","last_active":"2023-10-24T01:45:14.242477+0000","last_peered":"2023-10-24T01:45:14.242477+0000","last_clean":"2023-10-24T01:45:14.242477+0000","last_became_active":"2023-10-24T01:45:14.237932+0000","last_became_peered":"2023-10-24T01:45:14.237932+0000","last_unstale":"2023-10-24T01:45:14.242477+0000","last_undegraded":"2023-10-24T01:45:14.242477+0000","last_fullsized":"2023-10-24T01:45:14.242477+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253902+0000","last_change":"2023-10-24T01:45:13.874626+0000","last_active":"2023-10-24T01:45:14.253902+0000","last_peered":"2023-10-24T01:45:14.253902+0000","last_clean":"2023-10-24T01:45:14.253902+0000","last_became_active":"2023-10-24T01:45:13.874021+0000","last_became_peered":"2023-10-24T01:45:13.874021+0000","last_unstale":"2023-10-24T01:45:14.253902+0000","last_undegraded":"2023-10-24T01:45:14.253902+0000","last_fullsized":"2023-10-24T01:45:14.253902+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255190+0000","last_change":"2023-10-24T01:45:14.247594+0000","last_active":"2023-10-24T01:45:14.255190+0000","last_peered":"2023-10-24T01:45:14.255190+0000","last_clean":"2023-10-24T01:45:14.255190+0000","last_became_active":"2023-10-24T01:45:14.247114+0000","last_became_peered":"2023-10-24T01:45:14.247114+0000","last_unstale":"2023-10-24T01:45:14.255190+0000","last_undegraded":"2023-10-24T01:45:14.255190+0000","last_fullsized":"2023-10-24T01:45:14.255190+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244005+0000","last_change":"2023-10-24T01:45:13.876674+0000","last_active":"2023-10-24T01:45:14.244005+0000","last_peered":"2023-10-24T01:45:14.244005+0000","last_clean":"2023-10-24T01:45:14.244005+0000","last_became_active":"2023-10-24T01:45:13.876371+0000","last_became_peered":"2023-10-24T01:45:13.876371+0000","last_unstale":"2023-10-24T01:45:14.244005+0000","last_undegraded":"2023-10-24T01:45:14.244005+0000","last_fullsized":"2023-10-24T01:45:14.244005+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254662+0000","last_change":"2023-10-24T01:45:14.252214+0000","last_active":"2023-10-24T01:45:14.254662+0000","last_peered":"2023-10-24T01:45:14.254662+0000","last_clean":"2023-10-24T01:45:14.254662+0000","last_became_active":"2023-10-24T01:45:14.248971+0000","last_became_peered":"2023-10-24T01:45:14.248971+0000","last_unstale":"2023-10-24T01:45:14.254662+0000","last_undegraded":"2023-10-24T01:45:14.254662+0000","last_fullsized":"2023-10-24T01:45:14.254662+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233735+0000","last_change":"2023-10-24T01:45:13.872784+0000","last_active":"2023-10-24T01:45:14.233735+0000","last_peered":"2023-10-24T01:45:14.233735+0000","last_clean":"2023-10-24T01:45:14.233735+0000","last_became_active":"2023-10-24T01:45:13.872514+0000","last_became_peered":"2023-10-24T01:45:13.872514+0000","last_unstale":"2023-10-24T01:45:14.233735+0000","last_undegraded":"2023-10-24T01:45:14.233735+0000","last_fullsized":"2023-10-24T01:45:14.233735+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253406+0000","last_change":"2023-10-24T01:45:14.250863+0000","last_active":"2023-10-24T01:45:14.253406+0000","last_peered":"2023-10-24T01:45:14.253406+0000","last_clean":"2023-10-24T01:45:14.253406+0000","last_became_active":"2023-10-24T01:45:14.248589+0000","last_became_peered":"2023-10-24T01:45:14.248589+0000","last_unstale":"2023-10-24T01:45:14.253406+0000","last_undegraded":"2023-10-24T01:45:14.253406+0000","last_fullsized":"2023-10-24T01:45:14.253406+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.241941+0000","last_change":"2023-10-24T01:45:13.875786+0000","last_active":"2023-10-24T01:45:14.241941+0000","last_peered":"2023-10-24T01:45:14.241941+0000","last_clean":"2023-10-24T01:45:14.241941+0000","last_became_active":"2023-10-24T01:45:13.875499+0000","last_became_peered":"2023-10-24T01:45:13.875499+0000","last_unstale":"2023-10-24T01:45:14.241941+0000","last_undegraded":"2023-10-24T01:45:14.241941+0000","last_fullsized":"2023-10-24T01:45:14.241941+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255156+0000","last_change":"2023-10-24T01:45:14.248290+0000","last_active":"2023-10-24T01:45:14.255156+0000","last_peered":"2023-10-24T01:45:14.255156+0000","last_clean":"2023-10-24T01:45:14.255156+0000","last_became_active":"2023-10-24T01:45:14.248028+0000","last_became_peered":"2023-10-24T01:45:14.248028+0000","last_unstale":"2023-10-24T01:45:14.255156+0000","last_undegraded":"2023-10-24T01:45:14.255156+0000","last_fullsized":"2023-10-24T01:45:14.255156+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249212+0000","last_change":"2023-10-24T01:45:13.873952+0000","last_active":"2023-10-24T01:45:14.249212+0000","last_peered":"2023-10-24T01:45:14.249212+0000","last_clean":"2023-10-24T01:45:14.249212+0000","last_became_active":"2023-10-24T01:45:13.873605+0000","last_became_peered":"2023-10-24T01:45:13.873605+0000","last_unstale":"2023-10-24T01:45:14.249212+0000","last_undegraded":"2023-10-24T01:45:14.249212+0000","last_fullsized":"2023-10-24T01:45:14.249212+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253164+0000","last_change":"2023-10-24T01:45:14.249148+0000","last_active":"2023-10-24T01:45:14.253164+0000","last_peered":"2023-10-24T01:45:14.253164+0000","last_clean":"2023-10-24T01:45:14.253164+0000","last_became_active":"2023-10-24T01:45:14.248908+0000","last_became_peered":"2023-10-24T01:45:14.248908+0000","last_unstale":"2023-10-24T01:45:14.253164+0000","last_undegraded":"2023-10-24T01:45:14.253164+0000","last_fullsized":"2023-10-24T01:45:14.253164+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244522+0000","last_change":"2023-10-24T01:45:13.873947+0000","last_active":"2023-10-24T01:45:14.244522+0000","last_peered":"2023-10-24T01:45:14.244522+0000","last_clean":"2023-10-24T01:45:14.244522+0000","last_became_active":"2023-10-24T01:45:13.873760+0000","last_became_peered":"2023-10-24T01:45:13.873760+0000","last_unstale":"2023-10-24T01:45:14.244522+0000","last_undegraded":"2023-10-24T01:45:14.244522+0000","last_fullsized":"2023-10-24T01:45:14.244522+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.239930+0000","last_change":"2023-10-24T01:45:14.236902+0000","last_active":"2023-10-24T01:45:14.239930+0000","last_peered":"2023-10-24T01:45:14.239930+0000","last_clean":"2023-10-24T01:45:14.239930+0000","last_became_active":"2023-10-24T01:45:14.236588+0000","last_became_peered":"2023-10-24T01:45:14.236588+0000","last_unstale":"2023-10-24T01:45:14.239930+0000","last_undegraded":"2023-10-24T01:45:14.239930+0000","last_fullsized":"2023-10-24T01:45:14.239930+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.235881+0000","last_change":"2023-10-24T01:45:13.875144+0000","last_active":"2023-10-24T01:45:14.235881+0000","last_peered":"2023-10-24T01:45:14.235881+0000","last_clean":"2023-10-24T01:45:14.235881+0000","last_became_active":"2023-10-24T01:45:13.873976+0000","last_became_peered":"2023-10-24T01:45:13.873976+0000","last_unstale":"2023-10-24T01:45:14.235881+0000","last_undegraded":"2023-10-24T01:45:14.235881+0000","last_fullsized":"2023-10-24T01:45:14.235881+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252948+0000","last_change":"2023-10-24T01:45:14.248580+0000","last_active":"2023-10-24T01:45:14.252948+0000","last_peered":"2023-10-24T01:45:14.252948+0000","last_clean":"2023-10-24T01:45:14.252948+0000","last_became_active":"2023-10-24T01:45:14.248295+0000","last_became_peered":"2023-10-24T01:45:14.248295+0000","last_unstale":"2023-10-24T01:45:14.252948+0000","last_undegraded":"2023-10-24T01:45:14.252948+0000","last_fullsized":"2023-10-24T01:45:14.252948+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.242008+0000","last_change":"2023-10-24T01:45:13.880039+0000","last_active":"2023-10-24T01:45:14.242008+0000","last_peered":"2023-10-24T01:45:14.242008+0000","last_clean":"2023-10-24T01:45:14.242008+0000","last_became_active":"2023-10-24T01:45:13.879704+0000","last_became_peered":"2023-10-24T01:45:13.879704+0000","last_unstale":"2023-10-24T01:45:14.242008+0000","last_undegraded":"2023-10-24T01:45:14.242008+0000","last_fullsized":"2023-10-24T01:45:14.242008+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252890+0000","last_change":"2023-10-24T01:45:14.248620+0000","last_active":"2023-10-24T01:45:14.252890+0000","last_peered":"2023-10-24T01:45:14.252890+0000","last_clean":"2023-10-24T01:45:14.252890+0000","last_became_active":"2023-10-24T01:45:14.248413+0000","last_became_peered":"2023-10-24T01:45:14.248413+0000","last_unstale":"2023-10-24T01:45:14.252890+0000","last_undegraded":"2023-10-24T01:45:14.252890+0000","last_fullsized":"2023-10-24T01:45:14.252890+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255362+0000","last_change":"2023-10-24T01:45:13.874720+0000","last_active":"2023-10-24T01:45:14.255362+0000","last_peered":"2023-10-24T01:45:14.255362+0000","last_clean":"2023-10-24T01:45:14.255362+0000","last_became_active":"2023-10-24T01:45:13.874440+0000","last_became_peered":"2023-10-24T01:45:13.874440+0000","last_unstale":"2023-10-24T01:45:14.255362+0000","last_undegraded":"2023-10-24T01:45:14.255362+0000","last_fullsized":"2023-10-24T01:45:14.255362+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253007+0000","last_change":"2023-10-24T01:45:14.248173+0000","last_active":"2023-10-24T01:45:14.253007+0000","last_peered":"2023-10-24T01:45:14.253007+0000","last_clean":"2023-10-24T01:45:14.253007+0000","last_became_active":"2023-10-24T01:45:14.247830+0000","last_became_peered":"2023-10-24T01:45:14.247830+0000","last_unstale":"2023-10-24T01:45:14.253007+0000","last_undegraded":"2023-10-24T01:45:14.253007+0000","last_fullsized":"2023-10-24T01:45:14.253007+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.235243+0000","last_change":"2023-10-24T01:45:13.880168+0000","last_active":"2023-10-24T01:45:14.235243+0000","last_peered":"2023-10-24T01:45:14.235243+0000","last_clean":"2023-10-24T01:45:14.235243+0000","last_became_active":"2023-10-24T01:45:13.879721+0000","last_became_peered":"2023-10-24T01:45:13.879721+0000","last_unstale":"2023-10-24T01:45:14.235243+0000","last_undegraded":"2023-10-24T01:45:14.235243+0000","last_fullsized":"2023-10-24T01:45:14.235243+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.254696+0000","last_change":"2023-10-24T01:45:14.252588+0000","last_active":"2023-10-24T01:45:14.254696+0000","last_peered":"2023-10-24T01:45:14.254696+0000","last_clean":"2023-10-24T01:45:14.254696+0000","last_became_active":"2023-10-24T01:45:14.251913+0000","last_became_peered":"2023-10-24T01:45:14.251913+0000","last_unstale":"2023-10-24T01:45:14.254696+0000","last_undegraded":"2023-10-24T01:45:14.254696+0000","last_fullsized":"2023-10-24T01:45:14.254696+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233820+0000","last_change":"2023-10-24T01:45:13.873532+0000","last_active":"2023-10-24T01:45:14.233820+0000","last_peered":"2023-10-24T01:45:14.233820+0000","last_clean":"2023-10-24T01:45:14.233820+0000","last_became_active":"2023-10-24T01:45:13.873264+0000","last_became_peered":"2023-10-24T01:45:13.873264+0000","last_unstale":"2023-10-24T01:45:14.233820+0000","last_undegraded":"2023-10-24T01:45:14.233820+0000","last_fullsized":"2023-10-24T01:45:14.233820+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255453+0000","last_change":"2023-10-24T01:45:14.250200+0000","last_active":"2023-10-24T01:45:14.255453+0000","last_peered":"2023-10-24T01:45:14.255453+0000","last_clean":"2023-10-24T01:45:14.255453+0000","last_became_active":"2023-10-24T01:45:14.249441+0000","last_became_peered":"2023-10-24T01:45:14.249441+0000","last_unstale":"2023-10-24T01:45:14.255453+0000","last_undegraded":"2023-10-24T01:45:14.255453+0000","last_fullsized":"2023-10-24T01:45:14.255453+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.234728+0000","last_change":"2023-10-24T01:45:13.871480+0000","last_active":"2023-10-24T01:45:14.234728+0000","last_peered":"2023-10-24T01:45:14.234728+0000","last_clean":"2023-10-24T01:45:14.234728+0000","last_became_active":"2023-10-24T01:45:13.871205+0000","last_became_peered":"2023-10-24T01:45:13.871205+0000","last_unstale":"2023-10-24T01:45:14.234728+0000","last_undegraded":"2023-10-24T01:45:14.234728+0000","last_fullsized":"2023-10-24T01:45:14.234728+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.256302+0000","last_change":"2023-10-24T01:45:14.252517+0000","last_active":"2023-10-24T01:45:14.256302+0000","last_peered":"2023-10-24T01:45:14.256302+0000","last_clean":"2023-10-24T01:45:14.256302+0000","last_became_active":"2023-10-24T01:45:14.252254+0000","last_became_peered":"2023-10-24T01:45:14.252254+0000","last_unstale":"2023-10-24T01:45:14.256302+0000","last_undegraded":"2023-10-24T01:45:14.256302+0000","last_fullsized":"2023-10-24T01:45:14.256302+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233905+0000","last_change":"2023-10-24T01:45:13.878170+0000","last_active":"2023-10-24T01:45:14.233905+0000","last_peered":"2023-10-24T01:45:14.233905+0000","last_clean":"2023-10-24T01:45:14.233905+0000","last_became_active":"2023-10-24T01:45:13.877899+0000","last_became_peered":"2023-10-24T01:45:13.877899+0000","last_unstale":"2023-10-24T01:45:14.233905+0000","last_undegraded":"2023-10-24T01:45:14.233905+0000","last_fullsized":"2023-10-24T01:45:14.233905+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255110+0000","last_change":"2023-10-24T01:45:14.251126+0000","last_active":"2023-10-24T01:45:14.255110+0000","last_peered":"2023-10-24T01:45:14.255110+0000","last_clean":"2023-10-24T01:45:14.255110+0000","last_became_active":"2023-10-24T01:45:14.250841+0000","last_became_peered":"2023-10-24T01:45:14.250841+0000","last_unstale":"2023-10-24T01:45:14.255110+0000","last_undegraded":"2023-10-24T01:45:14.255110+0000","last_fullsized":"2023-10-24T01:45:14.255110+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.228835+0000","last_change":"2023-10-24T01:45:13.881283+0000","last_active":"2023-10-24T01:45:14.228835+0000","last_peered":"2023-10-24T01:45:14.228835+0000","last_clean":"2023-10-24T01:45:14.228835+0000","last_became_active":"2023-10-24T01:45:13.880972+0000","last_became_peered":"2023-10-24T01:45:13.880972+0000","last_unstale":"2023-10-24T01:45:14.228835+0000","last_undegraded":"2023-10-24T01:45:14.228835+0000","last_fullsized":"2023-10-24T01:45:14.228835+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.252843+0000","last_change":"2023-10-24T01:45:14.247576+0000","last_active":"2023-10-24T01:45:14.252843+0000","last_peered":"2023-10-24T01:45:14.252843+0000","last_clean":"2023-10-24T01:45:14.252843+0000","last_became_active":"2023-10-24T01:45:14.247294+0000","last_became_peered":"2023-10-24T01:45:14.247294+0000","last_unstale":"2023-10-24T01:45:14.252843+0000","last_undegraded":"2023-10-24T01:45:14.252843+0000","last_fullsized":"2023-10-24T01:45:14.252843+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232818+0000","last_change":"2023-10-24T01:45:13.874771+0000","last_active":"2023-10-24T01:45:14.232818+0000","last_peered":"2023-10-24T01:45:14.232818+0000","last_clean":"2023-10-24T01:45:14.232818+0000","last_became_active":"2023-10-24T01:45:13.874459+0000","last_became_peered":"2023-10-24T01:45:13.874459+0000","last_unstale":"2023-10-24T01:45:14.232818+0000","last_undegraded":"2023-10-24T01:45:14.232818+0000","last_fullsized":"2023-10-24T01:45:14.232818+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255703+0000","last_change":"2023-10-24T01:45:14.249952+0000","last_active":"2023-10-24T01:45:14.255703+0000","last_peered":"2023-10-24T01:45:14.255703+0000","last_clean":"2023-10-24T01:45:14.255703+0000","last_became_active":"2023-10-24T01:45:14.249681+0000","last_became_peered":"2023-10-24T01:45:14.249681+0000","last_unstale":"2023-10-24T01:45:14.255703+0000","last_undegraded":"2023-10-24T01:45:14.255703+0000","last_fullsized":"2023-10-24T01:45:14.255703+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.230980+0000","last_change":"2023-10-24T01:45:13.877626+0000","last_active":"2023-10-24T01:45:14.230980+0000","last_peered":"2023-10-24T01:45:14.230980+0000","last_clean":"2023-10-24T01:45:14.230980+0000","last_became_active":"2023-10-24T01:45:13.877311+0000","last_became_peered":"2023-10-24T01:45:13.877311+0000","last_unstale":"2023-10-24T01:45:14.230980+0000","last_undegraded":"2023-10-24T01:45:14.230980+0000","last_fullsized":"2023-10-24T01:45:14.230980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.258081+0000","last_change":"2023-10-24T01:45:14.256209+0000","last_active":"2023-10-24T01:45:14.258081+0000","last_peered":"2023-10-24T01:45:14.258081+0000","last_clean":"2023-10-24T01:45:14.258081+0000","last_became_active":"2023-10-24T01:45:14.255672+0000","last_became_peered":"2023-10-24T01:45:14.255672+0000","last_unstale":"2023-10-24T01:45:14.258081+0000","last_undegraded":"2023-10-24T01:45:14.258081+0000","last_fullsized":"2023-10-24T01:45:14.258081+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249623+0000","last_change":"2023-10-24T01:45:13.868561+0000","last_active":"2023-10-24T01:45:14.249623+0000","last_peered":"2023-10-24T01:45:14.249623+0000","last_clean":"2023-10-24T01:45:14.249623+0000","last_became_active":"2023-10-24T01:45:13.868283+0000","last_became_peered":"2023-10-24T01:45:13.868283+0000","last_unstale":"2023-10-24T01:45:14.249623+0000","last_undegraded":"2023-10-24T01:45:14.249623+0000","last_fullsized":"2023-10-24T01:45:14.249623+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233179+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T01:45:14.233179+0000","last_peered":"2023-10-24T01:45:14.233179+0000","last_clean":"2023-10-24T01:45:14.233179+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T01:45:14.233179+0000","last_undegraded":"2023-10-24T01:45:14.233179+0000","last_fullsized":"2023-10-24T01:45:14.233179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.258332+0000","last_change":"2023-10-24T01:45:14.255212+0000","last_active":"2023-10-24T01:45:14.258332+0000","last_peered":"2023-10-24T01:45:14.258332+0000","last_clean":"2023-10-24T01:45:14.258332+0000","last_became_active":"2023-10-24T01:45:14.254926+0000","last_became_peered":"2023-10-24T01:45:14.254926+0000","last_unstale":"2023-10-24T01:45:14.258332+0000","last_undegraded":"2023-10-24T01:45:14.258332+0000","last_fullsized":"2023-10-24T01:45:14.258332+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"180'3","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249941+0000","last_change":"2023-10-24T01:45:13.869376+0000","last_active":"2023-10-24T01:45:14.249941+0000","last_peered":"2023-10-24T01:45:14.249941+0000","last_clean":"2023-10-24T01:45:14.249941+0000","last_became_active":"2023-10-24T01:45:13.869150+0000","last_became_peered":"2023-10-24T01:45:13.869150+0000","last_unstale":"2023-10-24T01:45:14.249941+0000","last_undegraded":"2023-10-24T01:45:14.249941+0000","last_fullsized":"2023-10-24T01:45:14.249941+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.236205+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T01:45:14.236205+0000","last_peered":"2023-10-24T01:45:14.236205+0000","last_clean":"2023-10-24T01:45:14.236205+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T01:45:14.236205+0000","last_undegraded":"2023-10-24T01:45:14.236205+0000","last_fullsized":"2023-10-24T01:45:14.236205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.244998+0000","last_change":"2023-10-24T01:45:14.241032+0000","last_active":"2023-10-24T01:45:14.244998+0000","last_peered":"2023-10-24T01:45:14.244998+0000","last_clean":"2023-10-24T01:45:14.244998+0000","last_became_active":"2023-10-24T01:45:14.240059+0000","last_became_peered":"2023-10-24T01:45:14.240059+0000","last_unstale":"2023-10-24T01:45:14.244998+0000","last_undegraded":"2023-10-24T01:45:14.244998+0000","last_fullsized":"2023-10-24T01:45:14.244998+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.235149+0000","last_change":"2023-10-24T01:45:13.877001+0000","last_active":"2023-10-24T01:45:14.235149+0000","last_peered":"2023-10-24T01:45:14.235149+0000","last_clean":"2023-10-24T01:45:14.235149+0000","last_became_active":"2023-10-24T01:45:13.876679+0000","last_became_peered":"2023-10-24T01:45:13.876679+0000","last_unstale":"2023-10-24T01:45:14.235149+0000","last_undegraded":"2023-10-24T01:45:14.235149+0000","last_fullsized":"2023-10-24T01:45:14.235149+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.228758+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T01:45:14.228758+0000","last_peered":"2023-10-24T01:45:14.228758+0000","last_clean":"2023-10-24T01:45:14.228758+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T01:45:14.228758+0000","last_undegraded":"2023-10-24T01:45:14.228758+0000","last_fullsized":"2023-10-24T01:45:14.228758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.257303+0000","last_change":"2023-10-24T01:45:14.254401+0000","last_active":"2023-10-24T01:45:14.257303+0000","last_peered":"2023-10-24T01:45:14.257303+0000","last_clean":"2023-10-24T01:45:14.257303+0000","last_became_active":"2023-10-24T01:45:14.254139+0000","last_became_peered":"2023-10-24T01:45:14.254139+0000","last_unstale":"2023-10-24T01:45:14.257303+0000","last_undegraded":"2023-10-24T01:45:14.257303+0000","last_fullsized":"2023-10-24T01:45:14.257303+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.249448+0000","last_change":"2023-10-24T01:45:13.880059+0000","last_active":"2023-10-24T01:45:14.249448+0000","last_peered":"2023-10-24T01:45:14.249448+0000","last_clean":"2023-10-24T01:45:14.249448+0000","last_became_active":"2023-10-24T01:45:13.879773+0000","last_became_peered":"2023-10-24T01:45:13.879773+0000","last_unstale":"2023-10-24T01:45:14.249448+0000","last_undegraded":"2023-10-24T01:45:14.249448+0000","last_fullsized":"2023-10-24T01:45:14.249448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.233990+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T01:45:14.233990+0000","last_peered":"2023-10-24T01:45:14.233990+0000","last_clean":"2023-10-24T01:45:14.233990+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T01:45:14.233990+0000","last_undegraded":"2023-10-24T01:45:14.233990+0000","last_fullsized":"2023-10-24T01:45:14.233990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.231876+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T01:45:14.231876+0000","last_peered":"2023-10-24T01:45:14.231876+0000","last_clean":"2023-10-24T01:45:14.231876+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T01:45:14.231876+0000","last_undegraded":"2023-10-24T01:45:14.231876+0000","last_fullsized":"2023-10-24T01:45:14.231876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.258056+0000","last_change":"2023-10-24T01:45:14.255993+0000","last_active":"2023-10-24T01:45:14.258056+0000","last_peered":"2023-10-24T01:45:14.258056+0000","last_clean":"2023-10-24T01:45:14.258056+0000","last_became_active":"2023-10-24T01:45:14.255709+0000","last_became_peered":"2023-10-24T01:45:14.255709+0000","last_unstale":"2023-10-24T01:45:14.258056+0000","last_undegraded":"2023-10-24T01:45:14.258056+0000","last_fullsized":"2023-10-24T01:45:14.258056+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.230689+0000","last_change":"2023-10-24T01:45:13.875963+0000","last_active":"2023-10-24T01:45:14.230689+0000","last_peered":"2023-10-24T01:45:14.230689+0000","last_clean":"2023-10-24T01:45:14.230689+0000","last_became_active":"2023-10-24T01:45:13.875691+0000","last_became_peered":"2023-10-24T01:45:13.875691+0000","last_unstale":"2023-10-24T01:45:14.230689+0000","last_undegraded":"2023-10-24T01:45:14.230689+0000","last_fullsized":"2023-10-24T01:45:14.230689+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.231964+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T01:45:14.231964+0000","last_peered":"2023-10-24T01:45:14.231964+0000","last_clean":"2023-10-24T01:45:14.231964+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T01:45:14.231964+0000","last_undegraded":"2023-10-24T01:45:14.231964+0000","last_fullsized":"2023-10-24T01:45:14.231964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.255570+0000","last_change":"2023-10-24T01:45:14.250565+0000","last_active":"2023-10-24T01:45:14.255570+0000","last_peered":"2023-10-24T01:45:14.255570+0000","last_clean":"2023-10-24T01:45:14.255570+0000","last_became_active":"2023-10-24T01:45:14.249894+0000","last_became_peered":"2023-10-24T01:45:14.249894+0000","last_unstale":"2023-10-24T01:45:14.255570+0000","last_undegraded":"2023-10-24T01:45:14.255570+0000","last_fullsized":"2023-10-24T01:45:14.255570+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.236022+0000","last_change":"2023-10-24T01:45:13.881356+0000","last_active":"2023-10-24T01:45:14.236022+0000","last_peered":"2023-10-24T01:45:14.236022+0000","last_clean":"2023-10-24T01:45:14.236022+0000","last_became_active":"2023-10-24T01:45:13.881074+0000","last_became_peered":"2023-10-24T01:45:13.881074+0000","last_unstale":"2023-10-24T01:45:14.236022+0000","last_undegraded":"2023-10-24T01:45:14.236022+0000","last_fullsized":"2023-10-24T01:45:14.236022+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.232133+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T01:45:14.232133+0000","last_peered":"2023-10-24T01:45:14.232133+0000","last_clean":"2023-10-24T01:45:14.232133+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T01:45:14.232133+0000","last_undegraded":"2023-10-24T01:45:14.232133+0000","last_fullsized":"2023-10-24T01:45:14.232133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.239969+0000","last_change":"2023-10-24T01:45:14.237223+0000","last_active":"2023-10-24T01:45:14.239969+0000","last_peered":"2023-10-24T01:45:14.239969+0000","last_clean":"2023-10-24T01:45:14.239969+0000","last_became_active":"2023-10-24T01:45:14.236960+0000","last_became_peered":"2023-10-24T01:45:14.236960+0000","last_unstale":"2023-10-24T01:45:14.239969+0000","last_undegraded":"2023-10-24T01:45:14.239969+0000","last_fullsized":"2023-10-24T01:45:14.239969+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.240701+0000","last_change":"2023-10-24T01:45:13.872424+0000","last_active":"2023-10-24T01:45:14.240701+0000","last_peered":"2023-10-24T01:45:14.240701+0000","last_clean":"2023-10-24T01:45:14.240701+0000","last_became_active":"2023-10-24T01:45:13.872147+0000","last_became_peered":"2023-10-24T01:45:13.872147+0000","last_unstale":"2023-10-24T01:45:14.240701+0000","last_undegraded":"2023-10-24T01:45:14.240701+0000","last_fullsized":"2023-10-24T01:45:14.240701+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.234110+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T01:45:14.234110+0000","last_peered":"2023-10-24T01:45:14.234110+0000","last_clean":"2023-10-24T01:45:14.234110+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T01:45:14.234110+0000","last_undegraded":"2023-10-24T01:45:14.234110+0000","last_fullsized":"2023-10-24T01:45:14.234110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.242662+0000","last_change":"2023-10-24T01:45:14.238629+0000","last_active":"2023-10-24T01:45:14.242662+0000","last_peered":"2023-10-24T01:45:14.242662+0000","last_clean":"2023-10-24T01:45:14.242662+0000","last_became_active":"2023-10-24T01:45:14.238340+0000","last_became_peered":"2023-10-24T01:45:14.238340+0000","last_unstale":"2023-10-24T01:45:14.242662+0000","last_undegraded":"2023-10-24T01:45:14.242662+0000","last_fullsized":"2023-10-24T01:45:14.242662+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:13.847610+0000","last_clean_scrub_stamp":"2023-10-24T01:45:13.847610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"180'4","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.253915+0000","last_change":"2023-10-24T01:45:13.879843+0000","last_active":"2023-10-24T01:45:14.253915+0000","last_peered":"2023-10-24T01:45:14.253915+0000","last_clean":"2023-10-24T01:45:14.253915+0000","last_became_active":"2023-10-24T01:45:13.879536+0000","last_became_peered":"2023-10-24T01:45:13.879536+0000","last_unstale":"2023-10-24T01:45:14.253915+0000","last_undegraded":"2023-10-24T01:45:14.253915+0000","last_fullsized":"2023-10-24T01:45:14.253915+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T01:45:12.840551+0000","last_clean_scrub_stamp":"2023-10-24T01:45:12.840551+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-24T01:45:14.237924+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T01:45:14.237924+0000","last_peered":"2023-10-24T01:45:14.237924+0000","last_clean":"2023-10-24T01:45:14.237924+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T01:45:14.237924+0000","last_undegraded":"2023-10-24T01:45:14.237924+0000","last_fullsized":"2023-10-24T01:45:14.237924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543058,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307500,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064340,"statfs":{"total":96636764160,"available":96321884160,"internally_reserved":0,"allocated":2265088,"data_stored":1145713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.23799999999999999},"max":{"1min":0.64400000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.439},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52400000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.76300000000000001,"15min":0.83799999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.66600000000000004,"5min":0.78000000000000003,"15min":0.84899999999999998},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80400000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81599999999999995,"15min":0.86499999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26600000000000001},"max":{"1min":0.59899999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.502},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.28499999999999998},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998}]},{"osd":5,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.81499999999999995,"15min":0.82099999999999995},"last":0.627}]},{"osd":6,"last update":"Tue Oct 24 01:44:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.36899999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.88100000000000001},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575762,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303392,"kb_used_data":2200,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068448,"statfs":{"total":96636764160,"available":96326090752,"internally_reserved":0,"allocated":2252800,"data_stored":1144245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54200000000000004,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.33600000000000002,"15min":0.316},"max":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67400000000000004,"5min":0.79000000000000004,"15min":0.80000000000000004},"last":0.442},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.316},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36699999999999999},"max":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.79700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.35399999999999998},"max":{"1min":0.73199999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66000000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.77100000000000002,"15min":0.879},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.49099999999999999,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83699999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.45800000000000002,"15min":0.46500000000000002},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.81200000000000006},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.376,"5min":0.315,"15min":0.315},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.5,"15min":0.495},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.80800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.85499999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.34499999999999997},"max":{"1min":0.77800000000000002,"5min":0.80700000000000005,"15min":0.88800000000000001},"last":0.75},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.36199999999999999},"max":{"1min":0.81000000000000005,"5min":0.82699999999999996,"15min":0.84499999999999997},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2260992,"data_stored":1144869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.224},"max":{"1min":0.51800000000000002,"5min":0.63700000000000001,"15min":0.75600000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.70499999999999996},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.39600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.63,"15min":0.66200000000000003},"last":0.435},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.29599999999999999,"5min":0.29199999999999998,"15min":0.28599999999999998},"max":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.68400000000000005},"last":0.47499999999999998}]},{"osd":3,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44,"15min":0.443},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.70499999999999996,"15min":0.71699999999999997},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":0.87},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38600000000000001},"max":{"1min":0.70599999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.42899999999999999,"15min":0.40300000000000002},"max":{"1min":0.71199999999999997,"5min":1.006,"15min":1.006},"last":0.875}]},{"osd":6,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.45000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.67000000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":0.71999999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44400000000000001},"max":{"1min":0.77900000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78700000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575763,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303408,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068432,"statfs":{"total":96636764160,"available":96326074368,"internally_reserved":0,"allocated":2269184,"data_stored":1145013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.47699999999999998,"5min":0.60899999999999999,"15min":0.626},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.39400000000000002,"15min":0.40699999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.43099999999999999,"5min":0.61799999999999999,"15min":0.68200000000000005},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.48799999999999999,"5min":0.625,"15min":0.65100000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.38100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46500000000000002,"5min":0.59999999999999998,"15min":0.63},"last":0.31}]},{"osd":3,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.41199999999999998,"15min":0.41699999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.505,"5min":0.63800000000000001,"15min":0.64400000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.498,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.71999999999999997,"5min":0.94299999999999995,"15min":0.97399999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.33300000000000002},"max":{"1min":0.83599999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.626,"15min":0.63},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39400000000000002},"max":{"1min":0.80300000000000005,"5min":1.008,"15min":1.008},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80100000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42999999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.63300000000000001,"15min":0.63800000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.65900000000000003,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.623,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.86299999999999999,"5min":0.88300000000000001,"15min":0.98099999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Oct 24 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.998,"15min":0.998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91800000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.496}]}]},{"osd":2,"up_from":14,"seq":60129543058,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307500,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064340,"statfs":{"total":96636764160,"available":96321884160,"internally_reserved":0,"allocated":2265088,"data_stored":1144427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.22700000000000001},"max":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.69199999999999995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40899999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55500000000000005,"5min":0.65500000000000003,"15min":0.70699999999999996},"last":0.26100000000000001}]},{"osd":1,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.54200000000000004,"5min":0.56200000000000006,"15min":0.69499999999999995},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.435},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67700000000000005},"last":0.36699999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.313},"max":{"1min":0.63,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.436,"15min":0.44},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.74399999999999999},"last":0.38}]},{"osd":4,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.746,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.629},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.996,"15min":0.996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.85599999999999998,"5min":0.91100000000000003,"15min":0.92300000000000004},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.749},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.438},"max":{"1min":0.89200000000000002,"5min":0.90200000000000002,"15min":1.056},"last":0.56200000000000006}]},{"osd":7,"last update":"Tue Oct 24 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.44700000000000001,"15min":0.42799999999999999},"max":{"1min":0.95699999999999996,"5min":1.038,"15min":1.038},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575763,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307492,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064348,"statfs":{"total":96636764160,"available":96321892352,"internally_reserved":0,"allocated":2256896,"data_stored":1144279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.40600000000000003,"15min":0.39100000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.45000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.439,"15min":0.42499999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.29299999999999998}]},{"osd":4,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.37},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.38200000000000001}]},{"osd":5,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.65000000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.434},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66900000000000004,"15min":0.65100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.34999999999999998}]},{"osd":6,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.82499999999999996,"5min":1.071,"15min":1.071},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69199999999999995,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.505}]},{"osd":7,"last update":"Tue Oct 24 01:45:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.53200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575763,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2260992,"data_stored":1144889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52600000000000002,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59799999999999998,"5min":0.78600000000000003,"15min":0.81000000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.83899999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.76900000000000002,"15min":0.77500000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.86699999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":0.81799999999999995},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.71699999999999997,"5min":0.80000000000000004,"15min":0.83299999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35199999999999998},"max":{"1min":0.67800000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42699999999999999}]},{"osd":5,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27900000000000003},"max":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.504,"5min":0.503,"15min":0.49199999999999999},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":1.04},"last":0.54400000000000004}]},{"osd":6,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.76100000000000001,"15min":0.92100000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.83399999999999996,"15min":0.90300000000000002},"last":0.435}]},{"osd":7,"last update":"Tue Oct 24 01:45:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.38500000000000001,"5min":0.372,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.84699999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35399999999999998},"max":{"1min":0.71299999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52800000000000002}]}]},{"osd":5,"up_from":14,"seq":60129543058,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303396,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068444,"statfs":{"total":96636764160,"available":96326086656,"internally_reserved":0,"allocated":2256896,"data_stored":1145137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71499999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.379},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.75600000000000001,"15min":0.81699999999999995},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.82999999999999996},"last":0.495}]},{"osd":2,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36899999999999999},"max":{"1min":0.69299999999999995,"5min":0.77400000000000002,"15min":0.82099999999999995},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81399999999999995},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.57899999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.749,"15min":0.78400000000000003},"last":0.61499999999999999}]},{"osd":6,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.502,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.34200000000000003},"max":{"1min":0.72799999999999998,"5min":0.78400000000000003,"15min":0.79300000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Oct 24 01:44:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.31},"max":{"1min":0.746,"5min":0.78500000000000003,"15min":0.84099999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.504,"5min":0.41099999999999998,"15min":0.35399999999999998},"max":{"1min":0.73699999999999999,"5min":0.78500000000000003,"15min":0.81399999999999995},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T01:45:22.052 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T01:45:22.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T01:45:22.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.203+0000 7f0226686700 1 Processor -- start 2023-10-24T01:45:22.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.203+0000 7f0226686700 1 -- start start 2023-10-24T01:45:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0226686700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0220154430 0x7f0220154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0226686700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200c71d0 con 0x7f02200bffd0 2023-10-24T01:45:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0226686700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200c9410 con 0x7f0220098bd0 2023-10-24T01:45:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0226686700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200c6a10 con 0x7f0220154430 2023-10-24T01:45:22.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0220154430 0x7f0220154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0224c23700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f02200bffd0 0x7f022015e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34918/0 (socket says 172.21.15.148:34918) 2023-10-24T01:45:22.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f0224c23700 1 -- 172.21.15.148:0/3195750482 learned_addr learned my addr 172.21.15.148:0/3195750482 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:22.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0220154430 0x7f0220154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56990/0 (socket says 172.21.15.148:56990) 2023-10-24T01:45:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021ffff700 1 -- 172.21.15.148:0/3195750482 >> v1:172.21.15.150:6789/0 conn(0x7f0220098bd0 legacy=0x7f02200c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021ffff700 1 -- 172.21.15.148:0/3195750482 >> v1:172.21.15.148:6789/0 conn(0x7f02200bffd0 legacy=0x7f022015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021effd700 1 -- 172.21.15.148:0/3195750482 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066686196 0 0) 0x7f02200c71d0 con 0x7f02200bffd0 2023-10-24T01:45:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.204+0000 7f021ffff700 1 -- 172.21.15.148:0/3195750482 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200ca8b0 con 0x7f0220154430 2023-10-24T01:45:22.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f021ffff700 1 --2- 172.21.15.148:0/3195750482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0220154430 0x7f0220154810 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0210009760 tx=0x7f0210009060).ready entity=mon.0 client_cookie=f097b68b2e47ae1a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f021effd700 1 -- 172.21.15.148:0/3195750482 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000b520 con 0x7f0220154430 2023-10-24T01:45:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f021effd700 1 -- 172.21.15.148:0/3195750482 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000b680 con 0x7f0220154430 2023-10-24T01:45:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f021effd700 1 -- 172.21.15.148:0/3195750482 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000ba00 con 0x7f0220154430 2023-10-24T01:45:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 -- 172.21.15.148:0/3195750482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0220154430 msgr2=0x7f0220154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 --2- 172.21.15.148:0/3195750482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0220154430 0x7f0220154810 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f0210009760 tx=0x7f0210009060).stop 2023-10-24T01:45:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 -- 172.21.15.148:0/3195750482 shutdown_connections 2023-10-24T01:45:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 --2- 172.21.15.148:0/3195750482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0220154430 0x7f0220154810 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 -- 172.21.15.148:0/3195750482 >> 172.21.15.148:0/3195750482 conn(0x7f02200cb070 msgr2=0x7f02200cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 -- 172.21.15.148:0/3195750482 shutdown_connections 2023-10-24T01:45:22.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.205+0000 7f0226686700 1 -- 172.21.15.148:0/3195750482 wait complete. 2023-10-24T01:45:22.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.206+0000 7f0226686700 1 Processor -- start 2023-10-24T01:45:22.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.206+0000 7f0226686700 1 -- start start 2023-10-24T01:45:22.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 0x7f0220064e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 0x7f022014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220155260 con 0x7f02200bffd0 2023-10-24T01:45:22.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022014fe80 con 0x7f0220154430 2023-10-24T01:45:22.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0226686700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02201554a0 con 0x7f0220098bd0 2023-10-24T01:45:22.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57002/0 (socket says 172.21.15.148:57002) 2023-10-24T01:45:22.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f021f7fe700 1 -- 172.21.15.148:0/2780742638 learned_addr learned my addr 172.21.15.148:0/2780742638 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:22.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f0224c23700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 0x7f022014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.207+0000 7f021ffff700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 0x7f0220064e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 -- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 msgr2=0x7f0220064e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 0x7f0220064e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 -- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 msgr2=0x7f022014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 0x7f022014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 -- 172.21.15.148:0/2780742638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100092a0 con 0x7f02200bffd0 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0224c23700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 0x7f022014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021ffff700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 0x7f0220064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f021f7fe700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f021400c440 tx=0x7f0214007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400f470 con 0x7f02200bffd0 2023-10-24T01:45:22.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400f5d0 con 0x7f02200bffd0 2023-10-24T01:45:22.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0220155780 con 0x7f02200bffd0 2023-10-24T01:45:22.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400f990 con 0x7f02200bffd0 2023-10-24T01:45:22.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.208+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220155d40 con 0x7f02200bffd0 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.209+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022006c6b0 con 0x7f02200bffd0 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.209+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f0214012400 con 0x7f02200bffd0 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.210+0000 7f0207fff700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 0x7f020c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.210+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f0214079990 con 0x7f02200bffd0 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.210+0000 7f021ffff700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 0x7f020c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.210+0000 7f021ffff700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 0x7f020c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f021000b2e0 tx=0x7f0210017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.214+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0214048af0 con 0x7f02200bffd0 2023-10-24T01:45:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.447+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0220062c40 con 0x7f02200bffd0 2023-10-24T01:45:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.453+0000 7f0207fff700 1 -- 172.21.15.148:0/2780742638 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) v1 ==== 190+0+0 (secure 0 0 0) 0x7f021404ab00 con 0x7f02200bffd0 2023-10-24T01:45:22.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 msgr2=0x7f020c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 0x7f020c061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f021000b2e0 tx=0x7f0210017000).stop 2023-10-24T01:45:22.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 msgr2=0x7f0220154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f021400c440 tx=0x7f0214007de0).stop 2023-10-24T01:45:22.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 shutdown_connections 2023-10-24T01:45:22.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220154430 0x7f022014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0220098bd0 0x7f0220064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f020c05f270 0x7f020c061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 --2- 172.21.15.148:0/2780742638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02200bffd0 0x7f0220154d70 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 >> 172.21.15.148:0/2780742638 conn(0x7f02200cb070 msgr2=0x7f02200c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:22.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 shutdown_connections 2023-10-24T01:45:22.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.455+0000 7f0226686700 1 -- 172.21.15.148:0/2780742638 wait complete. 2023-10-24T01:45:22.460 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T01:45:22.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T01:45:22.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 Processor -- start 2023-10-24T01:45:22.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 -- start start 2023-10-24T01:45:22.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4a300aa010 0x7f4a300c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4a300aa3f0 0x7f4a30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300aa820 con 0x7f4a300c6710 2023-10-24T01:45:22.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300c0960 con 0x7f4a300aa010 2023-10-24T01:45:22.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.581+0000 7f4a36f34700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300c0c40 con 0x7f4a300aa3f0 2023-10-24T01:45:22.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4a300aa010 0x7f4a300c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4a300aa010 0x7f4a300c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57012/0 (socket says 172.21.15.148:57012) 2023-10-24T01:45:22.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 -- 172.21.15.148:0/4202542457 learned_addr learned my addr 172.21.15.148:0/4202542457 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:22.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 -- 172.21.15.148:0/4202542457 >> v2:172.21.15.150:3300/0 conn(0x7f4a300aa3f0 msgr2=0x7f4a30069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:22.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a354d1700 1 --2- 172.21.15.148:0/4202542457 >> v2:172.21.15.150:3300/0 conn(0x7f4a300aa3f0 0x7f4a30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 --2- 172.21.15.148:0/4202542457 >> v2:172.21.15.150:3300/0 conn(0x7f4a300aa3f0 0x7f4a30069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 -- 172.21.15.148:0/4202542457 >> v1:172.21.15.150:6789/0 conn(0x7f4a300c6710 legacy=0x7f4a30158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:22.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 -- 172.21.15.148:0/4202542457 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300c0f20 con 0x7f4a300aa010 2023-10-24T01:45:22.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a34cd0700 1 --2- 172.21.15.148:0/4202542457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a300c1a00 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f4a300c1ef0 tx=0x7f4a2c009840).ready entity=mon.0 client_cookie=13d444c35a8c4101 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a277fe700 1 -- 172.21.15.148:0/4202542457 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00e070 con 0x7f4a300aa010 2023-10-24T01:45:22.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a277fe700 1 -- 172.21.15.148:0/4202542457 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00ba10 con 0x7f4a300aa010 2023-10-24T01:45:22.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.582+0000 7f4a277fe700 1 -- 172.21.15.148:0/4202542457 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00bd90 con 0x7f4a300aa010 2023-10-24T01:45:22.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 -- 172.21.15.148:0/4202542457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 msgr2=0x7f4a300c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 --2- 172.21.15.148:0/4202542457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a300c1a00 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f4a300c1ef0 tx=0x7f4a2c009840).stop 2023-10-24T01:45:22.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 -- 172.21.15.148:0/4202542457 shutdown_connections 2023-10-24T01:45:22.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 --2- 172.21.15.148:0/4202542457 >> v2:172.21.15.150:3300/0 conn(0x7f4a300aa3f0 0x7f4a30069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 --2- 172.21.15.148:0/4202542457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a300c1a00 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 -- 172.21.15.148:0/4202542457 >> 172.21.15.148:0/4202542457 conn(0x7f4a300caf40 msgr2=0x7f4a300cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:22.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 -- 172.21.15.148:0/4202542457 shutdown_connections 2023-10-24T01:45:22.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.583+0000 7f4a36f34700 1 -- 172.21.15.148:0/4202542457 wait complete. 2023-10-24T01:45:22.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.584+0000 7f4a36f34700 1 Processor -- start 2023-10-24T01:45:22.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.584+0000 7f4a36f34700 1 -- start start 2023-10-24T01:45:22.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a300aa3f0 0x7f4a300c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 0x7f4a300c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c4a60 con 0x7f4a300aa010 2023-10-24T01:45:22.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301687b0 con 0x7f4a300c6710 2023-10-24T01:45:22.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c2f40 con 0x7f4a300aa3f0 2023-10-24T01:45:22.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57014/0 (socket says 172.21.15.148:57014) 2023-10-24T01:45:22.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 -- 172.21.15.148:0/2512784397 learned_addr learned my addr 172.21.15.148:0/2512784397 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:22.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a354d1700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 0x7f4a300c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a27fff700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a300aa3f0 0x7f4a300c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 -- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a300aa3f0 msgr2=0x7f4a300c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a300aa3f0 0x7f4a300c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 -- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 msgr2=0x7f4a300c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 0x7f4a300c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 -- 172.21.15.148:0/2512784397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009ae0 con 0x7f4a300aa010 2023-10-24T01:45:22.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a354d1700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 0x7f4a300c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:22.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a34cd0700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f4a2c009880 tx=0x7f4a300aa9b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c013d50 con 0x7f4a300aa010 2023-10-24T01:45:22.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c01d410 con 0x7f4a300aa010 2023-10-24T01:45:22.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300c3220 con 0x7f4a300aa010 2023-10-24T01:45:22.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.585+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c01d7d0 con 0x7f4a300aa010 2023-10-24T01:45:22.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.586+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300c37e0 con 0x7f4a300aa010 2023-10-24T01:45:22.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.586+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300af280 con 0x7f4a300aa010 2023-10-24T01:45:22.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.587+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4a2c01dbc0 con 0x7f4a300aa010 2023-10-24T01:45:22.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.587+0000 7f4a24ff9700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 0x7f4a1c061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:22.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.587+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f4a2c07c090 con 0x7f4a300aa010 2023-10-24T01:45:22.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.587+0000 7f4a27fff700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 0x7f4a1c061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:22.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.588+0000 7f4a27fff700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 0x7f4a1c061760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4a300c54a0 tx=0x7f4a20008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:22.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.591+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4a2c04d260 con 0x7f4a300aa010 2023-10-24T01:45:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.793+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a300af280 con 0x7f4a300aa010 2023-10-24T01:45:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.794+0000 7f4a24ff9700 1 -- 172.21.15.148:0/2512784397 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f4a2c050880 con 0x7f4a300aa010 2023-10-24T01:45:22.796 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:45:22.796 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T01:45:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 msgr2=0x7f4a1c061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 0x7f4a1c061760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4a300c54a0 tx=0x7f4a20008040).stop 2023-10-24T01:45:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 msgr2=0x7f4a301682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f4a2c009880 tx=0x7f4a300aa9b0).stop 2023-10-24T01:45:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 shutdown_connections 2023-10-24T01:45:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a300c6710 0x7f4a300c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f4a1c05f2a0 0x7f4a1c061760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4a300aa010 0x7f4a301682c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 --2- 172.21.15.148:0/2512784397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a300aa3f0 0x7f4a300c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 >> 172.21.15.148:0/2512784397 conn(0x7f4a300caf40 msgr2=0x7f4a30069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 shutdown_connections 2023-10-24T01:45:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:22.796+0000 7f4a36f34700 1 -- 172.21.15.148:0/2512784397 wait complete. 2023-10-24T01:45:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T01:45:23.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T01:45:14.225272+0000', 'modified': '2023-10-24T01:45:16.237571+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9132}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9132': {'gid': 9132, 'name': 'd', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6836/1998013081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 1998013081}, {'type': 'v1', 'addr': '172.21.15.150:6836', 'nonce': 1998013081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T01:45:23.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T01:45:23.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-24T01:45:23.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.329+0000 7f3133030700 1 Processor -- start 2023-10-24T01:45:23.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.329+0000 7f3133030700 1 -- start start 2023-10-24T01:45:23.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f312c154400 0x7f312c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c1547e0 0x7f312c0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f312c0a82c0 0x7f312c0c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0aa960 con 0x7f312c0a82c0 2023-10-24T01:45:23.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0c01c0 con 0x7f312c154400 2023-10-24T01:45:23.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f3133030700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c6150 con 0x7f312c1547e0 2023-10-24T01:45:23.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f31315cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f312c0a82c0 0x7f312c0c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f31315cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f312c0a82c0 0x7f312c0c0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49490/0 (socket says 172.21.15.148:49490) 2023-10-24T01:45:23.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.330+0000 7f31315cd700 1 -- 172.21.15.148:0/836807737 learned_addr learned my addr 172.21.15.148:0/836807737 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f312bfff700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c1547e0 0x7f312c0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3130dcc700 1 --2- 172.21.15.148:0/836807737 >> v2:172.21.15.150:3300/0 conn(0x7f312c154400 0x7f312c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 -- 172.21.15.148:0/836807737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c1547e0 msgr2=0x7f312c0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c1547e0 0x7f312c0a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 -- 172.21.15.148:0/836807737 >> v2:172.21.15.150:3300/0 conn(0x7f312c154400 msgr2=0x7f312c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 --2- 172.21.15.148:0/836807737 >> v2:172.21.15.150:3300/0 conn(0x7f312c154400 0x7f312c0c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 -- 172.21.15.148:0/836807737 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0c66f0 con 0x7f312c0a82c0 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f31315cd700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c0a82c0 0x7f312c0c0b30 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f312c084cf0 tx=0x7f31240090f0).ready entity=mon.0 client_cookie=3b9a62bebb2908a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f312b7fe700 1 -- 172.21.15.148:0/836807737 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400b600 con 0x7f312c0a82c0 2023-10-24T01:45:23.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f312b7fe700 1 -- 172.21.15.148:0/836807737 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400b760 con 0x7f312c0a82c0 2023-10-24T01:45:23.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f312b7fe700 1 -- 172.21.15.148:0/836807737 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400bb00 con 0x7f312c0a82c0 2023-10-24T01:45:23.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 -- 172.21.15.148:0/836807737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c0a82c0 msgr2=0x7f312c0c0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c0a82c0 0x7f312c0c0b30 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f312c084cf0 tx=0x7f31240090f0).stop 2023-10-24T01:45:23.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 -- 172.21.15.148:0/836807737 shutdown_connections 2023-10-24T01:45:23.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c0a82c0 0x7f312c0c0b30 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 --2- 172.21.15.148:0/836807737 >> v2:172.21.15.150:3300/0 conn(0x7f312c154400 0x7f312c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 --2- 172.21.15.148:0/836807737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c1547e0 0x7f312c0a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 -- 172.21.15.148:0/836807737 >> 172.21.15.148:0/836807737 conn(0x7f312c0946a0 msgr2=0x7f312c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 -- 172.21.15.148:0/836807737 shutdown_connections 2023-10-24T01:45:23.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.331+0000 7f3133030700 1 -- 172.21.15.148:0/836807737 wait complete. 2023-10-24T01:45:23.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.333+0000 7f3133030700 1 Processor -- start 2023-10-24T01:45:23.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.333+0000 7f3133030700 1 -- start start 2023-10-24T01:45:23.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c0a82c0 0x7f312c143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c154400 0x7f312c143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c144ad0 con 0x7f312c1547e0 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c34c0 con 0x7f312c154400 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c144230 con 0x7f312c0a82c0 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49498/0 (socket says 172.21.15.148:49498) 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 -- 172.21.15.148:0/376085389 learned_addr learned my addr 172.21.15.148:0/376085389 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f312bfff700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c154400 0x7f312c143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3130dcc700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c0a82c0 0x7f312c143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 -- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c0a82c0 msgr2=0x7f312c143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c0a82c0 0x7f312c143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 -- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c154400 msgr2=0x7f312c143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c154400 0x7f312c143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 -- 172.21.15.148:0/376085389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009370 con 0x7f312c1547e0 2023-10-24T01:45:23.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f31315cd700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f312c084250 tx=0x7f3124017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3128ff9700 1 -- 172.21.15.148:0/376085389 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124006d90 con 0x7f312c1547e0 2023-10-24T01:45:23.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3128ff9700 1 -- 172.21.15.148:0/376085389 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400bec0 con 0x7f312c1547e0 2023-10-24T01:45:23.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c144510 con 0x7f312c1547e0 2023-10-24T01:45:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3128ff9700 1 -- 172.21.15.148:0/376085389 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240246c0 con 0x7f312c1547e0 2023-10-24T01:45:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.334+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c1434f0 con 0x7f312c1547e0 2023-10-24T01:45:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.336+0000 7f3128ff9700 1 -- 172.21.15.148:0/376085389 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3124021070 con 0x7f312c1547e0 2023-10-24T01:45:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.336+0000 7f3128ff9700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 0x7f3118061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.336+0000 7f3128ff9700 1 -- 172.21.15.148:0/376085389 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f312407c030 con 0x7f312c1547e0 2023-10-24T01:45:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.337+0000 7f3130dcc700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 0x7f3118061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.337+0000 7f3130dcc700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 0x7f3118061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f311c00f610 tx=0x7f311c0077f0).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.338+0000 7f31449c8b80 1 Processor -- start 2023-10-24T01:45:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.338+0000 7f31449c8b80 1 -- start start 2023-10-24T01:45:23.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcaf8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcb22190 0x561ffcaf49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffca701b0 con 0x561ffcafb980 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffca35cb0 con 0x561ffcb22190 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ffca4ac90 con 0x561ffcaf8b20 2023-10-24T01:45:23.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49510/0 (socket says 172.21.15.148:49510) 2023-10-24T01:45:23.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 -- 172.21.15.148:0/2524116908 learned_addr learned my addr 172.21.15.148:0/2524116908 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f3130dcc700 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcaf8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f312bfff700 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcb22190 0x561ffcaf49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 -- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 msgr2=0x561ffcaf8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcaf8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 -- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcb22190 msgr2=0x561ffcaf49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcb22190 0x561ffcaf49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 -- 172.21.15.148:0/2524116908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ffca43e70 con 0x561ffcafb980 2023-10-24T01:45:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.339+0000 7f31315cd700 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f3124009fd0 tx=0x7f3124051f90).ready entity=mon.0 client_cookie=56460fafca48f7f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f3111ffb700 1 -- 172.21.15.148:0/2524116908 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124050cf0 con 0x561ffcafb980 2023-10-24T01:45:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f3111ffb700 1 -- 172.21.15.148:0/2524116908 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124009170 con 0x561ffcafb980 2023-10-24T01:45:23.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f3111ffb700 1 -- 172.21.15.148:0/2524116908 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312407a3d0 con 0x561ffcafb980 2023-10-24T01:45:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 -- 172.21.15.148:0/2524116908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 msgr2=0x561ffcaf4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f3124009fd0 tx=0x7f3124051f90).stop 2023-10-24T01:45:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 -- 172.21.15.148:0/2524116908 shutdown_connections 2023-10-24T01:45:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcaf4e90 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcaf8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2524116908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcb22190 0x561ffcaf49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 -- 172.21.15.148:0/2524116908 >> 172.21.15.148:0/2524116908 conn(0x561ffc8b5e40 msgr2=0x561ffcb42ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 -- 172.21.15.148:0/2524116908 shutdown_connections 2023-10-24T01:45:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.340+0000 7f31449c8b80 1 -- 172.21.15.148:0/2524116908 wait complete. 2023-10-24T01:45:23.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.341+0000 7f31449c8b80 1 -- start start 2023-10-24T01:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.341+0000 7f31449c8b80 1 Processor -- start 2023-10-24T01:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcaf8b20 0x561ffcb443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcb3dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffca4add0 con 0x561ffcafb980 2023-10-24T01:45:23.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffca4b050 con 0x561ffcaf8b20 2023-10-24T01:45:23.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ffca168d0 con 0x561ffcb22190 2023-10-24T01:45:23.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 10 client.0 ll_register_callbacks cb 0x561ffcab9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T01:45:23.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49516/0 (socket says 172.21.15.148:49516) 2023-10-24T01:45:23.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 -- 172.21.15.148:0/2037525043 learned_addr learned my addr 172.21.15.148:0/2037525043 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f3130dcc700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcaf8b20 0x561ffcb443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31315cd700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcb3dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 -- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 msgr2=0x561ffcb3dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcb3dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 -- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcaf8b20 msgr2=0x561ffcb443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcaf8b20 0x561ffcb443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 -- 172.21.15.148:0/2037525043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c1434f0 con 0x561ffcafb980 2023-10-24T01:45:23.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31315cd700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcb3dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f312bfff700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f312c085450 tx=0x7f3120008040).ready entity=mon.0 client_cookie=bce019a345e8e2b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f310affd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T01:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000a330 con 0x561ffcafb980 2023-10-24T01:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f3120015450 con 0x561ffcafb980 2023-10-24T01:45:23.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.342+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ffcaed4e0 con 0x561ffcafb980 2023-10-24T01:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3120015820 con 0x561ffcafb980 2023-10-24T01:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 10 client.9297 fetch_fsmap learned FSMap version 62 2023-10-24T01:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x561ffca3f480 con 0x561ffcafb980 2023-10-24T01:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ffcaed4e0 con 0x561ffcafb980 2023-10-24T01:45:23.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3120015980 con 0x561ffcafb980 2023-10-24T01:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 10 client.9297 fetch_fsmap finished waiting for FSMap version 62 2023-10-24T01:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 10 client.9297 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T01:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 20 client.9297 populate_metadata read hostname 'smithi148' 2023-10-24T01:45:23.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb20510 0x561ffcb208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 4 client.9297 mds_command: new command op to 9132 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 --> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ffcac34b0 con 0x561ffcb20510 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.343+0000 7f3130dcc700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb20510 0x561ffcb208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.344+0000 7f310affd700 10 client.9297 ms_handle_connect on v2:172.21.15.150:6834/1998013081 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.344+0000 7f3130dcc700 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb20510 0x561ffcb208f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9136edaa158111a3 server_cookie=9512c256b0e1169b in_seq=0 out_seq=0 2023-10-24T01:45:23.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.344+0000 7f310affd700 1 -- 172.21.15.148:0/2037525043 <== mds.0 v2:172.21.15.150:6834/1998013081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561ffcac34b0 con 0x561ffcb20510 2023-10-24T01:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.344+0000 7f310affd700 10 client.9297 handle_command_reply: tid=0 2023-10-24T01:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.344+0000 7f31449c8b80 1 client.9297 shutdown 2023-10-24T01:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 msgr2=0x561ffcb0e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f312c085450 tx=0x7f3120008040).stop 2023-10-24T01:45:23.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 shutdown_connections 2023-10-24T01:45:23.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcb3dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb20510 0x561ffcb208f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcaf8b20 0x561ffcb443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 --2- 172.21.15.148:0/2037525043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcafb980 0x561ffcb0e280 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f310affd700 0 client.9297 ms_handle_reset on v2:172.21.15.150:6834/1998013081 2023-10-24T01:45:23.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 >> 172.21.15.148:0/2037525043 conn(0x561ffc8b5e40 msgr2=0x561ffcb427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 shutdown_connections 2023-10-24T01:45:23.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 1 -- 172.21.15.148:0/2037525043 wait complete. 2023-10-24T01:45:23.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.345+0000 7f31449c8b80 20 client.9297 trim_cache size 0 max 16384 2023-10-24T01:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.361+0000 7f31449c8b80 1 Processor -- start 2023-10-24T01:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.361+0000 7f31449c8b80 1 -- start start 2023-10-24T01:45:23.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcaf5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcaf6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffcaf6540 con 0x561ffcaf8b20 2023-10-24T01:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffcb20a30 con 0x561ffcafb980 2023-10-24T01:45:23.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ffcb477f0 con 0x561ffcb22190 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49524/0 (socket says 172.21.15.148:49524) 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 -- 172.21.15.148:0/3409883290 learned_addr learned my addr 172.21.15.148:0/3409883290 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f312bfff700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcaf5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31315cd700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcaf6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 -- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 msgr2=0x561ffcaf6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcaf6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 -- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 msgr2=0x561ffcaf5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcaf5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 -- 172.21.15.148:0/3409883290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0c2f60 con 0x561ffcaf8b20 2023-10-24T01:45:23.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f312bfff700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcaf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:23.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31315cd700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcaf6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:23.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f3130dcc700 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x561ffcb45080 tx=0x7f311c013000).ready entity=mon.0 client_cookie=a52c394ce01d6c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31127fc700 1 -- 172.21.15.148:0/3409883290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c021070 con 0x561ffcaf8b20 2023-10-24T01:45:23.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.362+0000 7f31127fc700 1 -- 172.21.15.148:0/3409883290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c01c630 con 0x561ffcaf8b20 2023-10-24T01:45:23.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31127fc700 1 -- 172.21.15.148:0/3409883290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c01c9d0 con 0x561ffcaf8b20 2023-10-24T01:45:23.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- 172.21.15.148:0/3409883290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 msgr2=0x561ffcb446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x561ffcb45080 tx=0x7f311c013000).stop 2023-10-24T01:45:23.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- 172.21.15.148:0/3409883290 shutdown_connections 2023-10-24T01:45:23.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcb22190 0x561ffcaf6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcaf8b20 0x561ffcb446e0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 --2- 172.21.15.148:0/3409883290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcaf5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- 172.21.15.148:0/3409883290 >> 172.21.15.148:0/3409883290 conn(0x561ffc8b5e40 msgr2=0x561ffcb3f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- 172.21.15.148:0/3409883290 shutdown_connections 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- 172.21.15.148:0/3409883290 wait complete. 2023-10-24T01:45:23.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.363+0000 7f31449c8b80 1 -- start start 2023-10-24T01:45:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.364+0000 7f31449c8b80 1 Processor -- start 2023-10-24T01:45:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.364+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcba3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.364+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcb25100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffcb25b80 con 0x561ffcb22190 2023-10-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ffcaf41f0 con 0x561ffcafb980 2023-10-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ffcaf47b0 con 0x561ffcaf8b20 2023-10-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 10 client.0 ll_register_callbacks cb 0x561ffcab9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49534/0 (socket says 172.21.15.148:49534) 2023-10-24T01:45:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 -- 172.21.15.148:0/968040665 learned_addr learned my addr 172.21.15.148:0/968040665 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f3130dcc700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcba3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f312bfff700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcb25100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 -- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 msgr2=0x561ffcba3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcba3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 -- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 msgr2=0x561ffcb25100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcb25100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 -- 172.21.15.148:0/968040665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c00d750 con 0x561ffcb22190 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31315cd700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f312407a290 tx=0x7f3124030000).ready entity=mon.0 client_cookie=b929c938680edef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f310affd700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T01:45:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312407a2c0 con 0x561ffcb22190 2023-10-24T01:45:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f312407a420 con 0x561ffcb22190 2023-10-24T01:45:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3124009170 con 0x561ffcb22190 2023-10-24T01:45:23.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3124056250 con 0x561ffcb22190 2023-10-24T01:45:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 10 client.9303 fetch_fsmap learned FSMap version 62 2023-10-24T01:45:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x561ffca3f1d0 con 0x561ffcb22190 2023-10-24T01:45:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.365+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124009170 con 0x561ffcb22190 2023-10-24T01:45:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3124022370 con 0x561ffcb22190 2023-10-24T01:45:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 10 client.9303 fetch_fsmap finished waiting for FSMap version 62 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 10 client.9303 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 20 client.9303 populate_metadata read hostname 'smithi148' 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb21980 0x561ffcb508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 4 client.9303 mds_command: new command op to 9132 tid=0[{"prefix": "status"}] 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 --> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ffc8b1ca0 con 0x561ffcb21980 2023-10-24T01:45:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f3130dcc700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb21980 0x561ffcb508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f310affd700 10 client.9303 ms_handle_connect on v2:172.21.15.150:6834/1998013081 2023-10-24T01:45:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f3130dcc700 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb21980 0x561ffcb508e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fd68d8ca6742201b server_cookie=6d1089a6fd3d4ce in_seq=0 out_seq=0 2023-10-24T01:45:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f310affd700 1 -- 172.21.15.148:0/968040665 <== mds.0 v2:172.21.15.150:6834/1998013081 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x561ffc8b1ca0 con 0x561ffcb21980 2023-10-24T01:45:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f310affd700 10 client.9303 handle_command_reply: tid=0 2023-10-24T01:45:23.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 1 client.9303 shutdown 2023-10-24T01:45:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 msgr2=0x561ffcaf4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.366+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f312407a290 tx=0x7f3124030000).stop 2023-10-24T01:45:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 shutdown_connections 2023-10-24T01:45:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561ffcb22190 0x561ffcaf4c40 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x561ffcaf8b20 0x561ffcba3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:6834/1998013081,v1:172.21.15.150:6836/1998013081] conn(0x561ffcb21980 0x561ffcb508e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 --2- 172.21.15.148:0/968040665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561ffcafb980 0x561ffcb25100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f310affd700 0 client.9303 ms_handle_reset on v2:172.21.15.150:6834/1998013081 2023-10-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 >> 172.21.15.148:0/968040665 conn(0x561ffc8b5e40 msgr2=0x561ffcb45cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 shutdown_connections 2023-10-24T01:45:23.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 1 -- 172.21.15.148:0/968040665 wait complete. 2023-10-24T01:45:23.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f31449c8b80 20 client.9303 trim_cache size 0 max 16384 2023-10-24T01:45:23.394 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T01:45:23.394 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T01:45:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T01:45:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 9132, 2023-10-24T01:45:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T01:45:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T01:45:23.395 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.141004315, 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 62, 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 181, 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 181, 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 13.648301438000001 2023-10-24T01:45:23.396 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T01:45:23.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 msgr2=0x7f3118061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 0x7f3118061700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f311c00f610 tx=0x7f311c0077f0).stop 2023-10-24T01:45:23.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 msgr2=0x7f312c143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f312c084250 tx=0x7f3124017000).stop 2023-10-24T01:45:23.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 shutdown_connections 2023-10-24T01:45:23.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f311805f240 0x7f3118061700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f312c1547e0 0x7f312c143c60 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f312c0a82c0 0x7f312c143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 --2- 172.21.15.148:0/376085389 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c154400 0x7f312c143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 >> 172.21.15.148:0/376085389 conn(0x7f312c0946a0 msgr2=0x7f312c14e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 shutdown_connections 2023-10-24T01:45:23.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.367+0000 7f3133030700 1 -- 172.21.15.148:0/376085389 wait complete. 2023-10-24T01:45:23.400 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T01:45:23.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.501+0000 7f36abfff700 1 Processor -- start 2023-10-24T01:45:23.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.501+0000 7f36abfff700 1 -- start start 2023-10-24T01:45:23.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36abfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f36ac157620 0x7f36ac0a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36abfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36ac0c3bc0 0x7f36ac0c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36abfff700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0c6ca0 con 0x7f36ac157a00 2023-10-24T01:45:23.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36abfff700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac064810 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36abfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac064af0 con 0x7f36ac157620 2023-10-24T01:45:23.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36ab7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f36ac0c3bc0 0x7f36ac0c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36a27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f36ac157a00 0x7f36ac0c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48430/0 (socket says 172.21.15.148:48430) 2023-10-24T01:45:23.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36a27fc700 1 -- 172.21.15.148:0/3803323489 learned_addr learned my addr 172.21.15.148:0/3803323489 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:23.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.502+0000 7f36aaffd700 1 --2- 172.21.15.148:0/3803323489 >> v2:172.21.15.150:3300/0 conn(0x7f36ac157620 0x7f36ac0a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36ab7fe700 1 -- 172.21.15.148:0/3803323489 >> v2:172.21.15.150:3300/0 conn(0x7f36ac157620 msgr2=0x7f36ac0a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:23.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36ab7fe700 1 --2- 172.21.15.148:0/3803323489 >> v2:172.21.15.150:3300/0 conn(0x7f36ac157620 0x7f36ac0a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36ab7fe700 1 -- 172.21.15.148:0/3803323489 >> v1:172.21.15.148:6789/0 conn(0x7f36ac157a00 legacy=0x7f36ac0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36ab7fe700 1 -- 172.21.15.148:0/3803323489 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0a8390 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36aa7fc700 1 -- 172.21.15.148:0/3803323489 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839032685 0 0) 0x7f36ac0c6ca0 con 0x7f36ac157a00 2023-10-24T01:45:23.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36ab7fe700 1 --2- 172.21.15.148:0/3803323489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac0c4010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f36ac068fd0 tx=0x7f36a4009780).ready entity=mon.0 client_cookie=f9332a253761c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36aa7fc700 1 -- 172.21.15.148:0/3803323489 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400e070 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36aa7fc700 1 -- 172.21.15.148:0/3803323489 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400bc30 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36aa7fc700 1 -- 172.21.15.148:0/3803323489 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4012410 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 -- 172.21.15.148:0/3803323489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac0c3bc0 msgr2=0x7f36ac0c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 --2- 172.21.15.148:0/3803323489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac0c4010 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f36ac068fd0 tx=0x7f36a4009780).stop 2023-10-24T01:45:23.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 -- 172.21.15.148:0/3803323489 shutdown_connections 2023-10-24T01:45:23.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 --2- 172.21.15.148:0/3803323489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac0c4010 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 --2- 172.21.15.148:0/3803323489 >> v2:172.21.15.150:3300/0 conn(0x7f36ac157620 0x7f36ac0a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 -- 172.21.15.148:0/3803323489 >> 172.21.15.148:0/3803323489 conn(0x7f36ac062e30 msgr2=0x7f36ac0c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 -- 172.21.15.148:0/3803323489 shutdown_connections 2023-10-24T01:45:23.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.503+0000 7f36abfff700 1 -- 172.21.15.148:0/3803323489 wait complete. 2023-10-24T01:45:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 Processor -- start 2023-10-24T01:45:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 -- start start 2023-10-24T01:45:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36ac157620 0x7f36ac159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1674b0 con 0x7f36ac157a00 2023-10-24T01:45:23.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac167790 con 0x7f36ac0c3bc0 2023-10-24T01:45:23.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.505+0000 7f36abfff700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac167a70 con 0x7f36ac157620 2023-10-24T01:45:23.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49550/0 (socket says 172.21.15.148:49550) 2023-10-24T01:45:23.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 -- 172.21.15.148:0/634284266 learned_addr learned my addr 172.21.15.148:0/634284266 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:23.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36aaffd700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36a27fc700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36ac157620 0x7f36ac159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 -- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36ac157620 msgr2=0x7f36ac159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36ac157620 0x7f36ac159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 -- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac0c3bc0 msgr2=0x7f36ac166ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac166ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 -- 172.21.15.148:0/634284266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009a20 con 0x7f36ac157a00 2023-10-24T01:45:23.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36ab7fe700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f36a4009fd0 tx=0x7f36a4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4012410 con 0x7f36ac157a00 2023-10-24T01:45:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400b6f0 con 0x7f36ac157a00 2023-10-24T01:45:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac167d50 con 0x7f36ac157a00 2023-10-24T01:45:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4011c60 con 0x7f36ac157a00 2023-10-24T01:45:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.506+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac0a96b0 con 0x7f36ac157a00 2023-10-24T01:45:23.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.507+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0c1570 con 0x7f36ac157a00 2023-10-24T01:45:23.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.507+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f36a4003040 con 0x7f36ac157a00 2023-10-24T01:45:23.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.508+0000 7f36a37fe700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 0x7f368c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:23.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.508+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f36a407c3c0 con 0x7f36ac157a00 2023-10-24T01:45:23.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.508+0000 7f36aaffd700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 0x7f368c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:23.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.508+0000 7f36aaffd700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 0x7f368c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f369c00bbc0 tx=0x7f369c008040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:23.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.512+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f36a404d4e0 con 0x7f36ac157a00 2023-10-24T01:45:23.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.717+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36ac05f2e0 con 0x7f36ac157a00 2023-10-24T01:45:23.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.717+0000 7f36a37fe700 1 -- 172.21.15.148:0/634284266 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f36a4050b00 con 0x7f36ac157a00 2023-10-24T01:45:23.719 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T01:45:23.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 msgr2=0x7f368c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 0x7f368c061730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f369c00bbc0 tx=0x7f369c008040).stop 2023-10-24T01:45:23.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 msgr2=0x7f36ac0a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:23.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7f36a4009fd0 tx=0x7f36a4009780).stop 2023-10-24T01:45:23.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 shutdown_connections 2023-10-24T01:45:23.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f368c05f270 0x7f368c061730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f36ac157a00 0x7f36ac0a91c0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac0c3bc0 0x7f36ac166ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.722 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 --2- 172.21.15.148:0/634284266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f36ac157620 0x7f36ac159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:23.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 >> 172.21.15.148:0/634284266 conn(0x7f36ac062e30 msgr2=0x7f36ac0662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:23.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 shutdown_connections 2023-10-24T01:45:23.723 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:23.719+0000 7f36abfff700 1 -- 172.21.15.148:0/634284266 wait complete. 2023-10-24T01:45:23.731 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T01:45:23.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T01:45:23.732 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T01:45:23.732 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T01:45:23.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T01:45:23.733 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T01:45:23.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T01:45:23.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T01:45:23.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T01:45:23.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.735 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T01:45:23.751 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T01:45:23.751 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T01:45:23.751 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T01:45:23.751 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T01:45:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.752 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:45:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:45:23.752 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T01:45:23.753 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:45:23.753 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:45:23.753 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T01:45:23.753 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T01:45:23.753 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:45:23.754 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T01:45:23.754 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T01:45:23.754 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T01:45:23.754 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 37805sec preferred_lft 37805sec 2023-10-24T01:45:23.754 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.755 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T01:45:23.756 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.756 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T01:45:23.756 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T01:45:23.756 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T01:45:23.756 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.757 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T01:45:23.757 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T01:45:23.757 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T01:45:23.757 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T01:45:23.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.758 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T01:45:23.814 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T01:45:23.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.816 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T01:45:23.872 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T01:45:23.873 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T01:45:23.873 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T01:45:23.873 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T01:45:23.874 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T01:45:23.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.875 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T01:45:23.876 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T01:45:23.877 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T01:45:23.877 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T01:45:23.878 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T01:45:23.879 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T01:45:23.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.973 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T01:45:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T01:45:23.988 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T01:45:23.988 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T01:45:23.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:23.989 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T01:45:24.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:24.052 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T01:45:24.106 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T01:45:24.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:45:24.186 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:45:24.186 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T01:45:24.211 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T01:45:24.212 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T01:45:24.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T01:45:24.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T01:45:24.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T01:45:24.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T01:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.432+0000 7f467b442700 1 Processor -- start 2023-10-24T01:45:24.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.432+0000 7f467b442700 1 -- start start 2023-10-24T01:45:24.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467b442700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4674154e70 0x7f46741552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467b442700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467406a860 con 0x7f46740c0810 2023-10-24T01:45:24.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467b442700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740c9d90 con 0x7f4674154a90 2023-10-24T01:45:24.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467b442700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46741561a0 con 0x7f4674154e70 2023-10-24T01:45:24.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f4679c3f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4674154e70 0x7f46741552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467ac41700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f46740c0810 0x7f46740ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48436/0 (socket says 172.21.15.148:48436) 2023-10-24T01:45:24.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467ac41700 1 -- 172.21.15.148:0/4028768770 learned_addr learned my addr 172.21.15.148:0/4028768770 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:24.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f4679c3f700 1 -- 172.21.15.148:0/4028768770 >> v1:172.21.15.150:6789/0 conn(0x7f4674154a90 legacy=0x7f4674155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f4679c3f700 1 -- 172.21.15.148:0/4028768770 >> v1:172.21.15.148:6789/0 conn(0x7f46740c0810 legacy=0x7f46740ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f4679c3f700 1 -- 172.21.15.148:0/4028768770 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740c9180 con 0x7f4674154e70 2023-10-24T01:45:24.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f4679c3f700 1 --2- 172.21.15.148:0/4028768770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46741552f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f4664009760 tx=0x7f4664009060).ready entity=mon.0 client_cookie=927c32e0e5f239d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467943e700 1 -- 172.21.15.148:0/4028768770 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400b580 con 0x7f4674154e70 2023-10-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.433+0000 7f467943e700 1 -- 172.21.15.148:0/4028768770 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400b6e0 con 0x7f4674154e70 2023-10-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467943e700 1 -- 172.21.15.148:0/4028768770 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400ba60 con 0x7f4674154e70 2023-10-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 -- 172.21.15.148:0/4028768770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 msgr2=0x7f46741552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 --2- 172.21.15.148:0/4028768770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46741552f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f4664009760 tx=0x7f4664009060).stop 2023-10-24T01:45:24.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 -- 172.21.15.148:0/4028768770 shutdown_connections 2023-10-24T01:45:24.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 --2- 172.21.15.148:0/4028768770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46741552f0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 -- 172.21.15.148:0/4028768770 >> 172.21.15.148:0/4028768770 conn(0x7f4674084c20 msgr2=0x7f4674094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:24.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 -- 172.21.15.148:0/4028768770 shutdown_connections 2023-10-24T01:45:24.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.434+0000 7f467b442700 1 -- 172.21.15.148:0/4028768770 wait complete. 2023-10-24T01:45:24.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.435+0000 7f467b442700 1 Processor -- start 2023-10-24T01:45:24.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.435+0000 7f467b442700 1 -- start start 2023-10-24T01:45:24.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 0x7f46740ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 0x7f46740aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740ac9d0 con 0x7f4674154e70 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674153600 con 0x7f4674154a90 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467b442700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c4e60 con 0x7f46740c0810 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49554/0 (socket says 172.21.15.148:49554) 2023-10-24T01:45:24.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 -- 172.21.15.148:0/2562977017 learned_addr learned my addr 172.21.15.148:0/2562977017 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:24.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f4679c3f700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 0x7f46740aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467a440700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 0x7f46740ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 -- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 msgr2=0x7f46740ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 0x7f46740ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 -- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 msgr2=0x7f46740aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 0x7f46740aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467ac41700 1 -- 172.21.15.148:0/2562977017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640092a0 con 0x7f4674154e70 2023-10-24T01:45:24.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f4679c3f700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 0x7f46740aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:24.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.436+0000 7f467a440700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 0x7f46740ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:45:24.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f467ac41700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f466c00c7c0 tx=0x7f466c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c005d30 con 0x7f4674154e70 2023-10-24T01:45:24.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c005e90 con 0x7f4674154e70 2023-10-24T01:45:24.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740acbb0 con 0x7f4674154e70 2023-10-24T01:45:24.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c007320 con 0x7f4674154e70 2023-10-24T01:45:24.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.437+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46740ad170 con 0x7f4674154e70 2023-10-24T01:45:24.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.438+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46740c5140 con 0x7f4674154e70 2023-10-24T01:45:24.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.438+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f466c0076d0 con 0x7f4674154e70 2023-10-24T01:45:24.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.438+0000 7f466a7fc700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 0x7f4658061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.438+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f466c07a490 con 0x7f4674154e70 2023-10-24T01:45:24.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.439+0000 7f467a440700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 0x7f4658061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.439+0000 7f467a440700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 0x7f4658061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f46700016d0 tx=0x7f4670009040).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.442+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f466c04b4f0 con 0x7f4674154e70 2023-10-24T01:45:24.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.635+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4674047480 con 0x7f465805f270 2023-10-24T01:45:24.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.636+0000 7f466a7fc700 1 -- 172.21.15.148:0/2562977017 <== mgr.8185 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4674047480 con 0x7f465805f270 2023-10-24T01:45:24.638 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T01:45:24.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T01:45:24.639 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T01:45:24.639 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T01:45:24.639 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T01:45:24.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 msgr2=0x7f4658061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 0x7f4658061730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f46700016d0 tx=0x7f4670009040).stop 2023-10-24T01:45:24.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 msgr2=0x7f46740af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f466c00c7c0 tx=0x7f466c0015e0).stop 2023-10-24T01:45:24.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 shutdown_connections 2023-10-24T01:45:24.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f465805f270 0x7f4658061730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4674154e70 0x7f46740af310 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46740c0810 0x7f46740ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 --2- 172.21.15.148:0/2562977017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4674154a90 0x7f46740aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 >> 172.21.15.148:0/2562977017 conn(0x7f4674084c20 msgr2=0x7f46740631d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:24.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 shutdown_connections 2023-10-24T01:45:24.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.638+0000 7f467b442700 1 -- 172.21.15.148:0/2562977017 wait complete. 2023-10-24T01:45:24.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T01:45:24.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.767+0000 7f5c8e4a6700 1 Processor -- start 2023-10-24T01:45:24.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.767+0000 7f5c8e4a6700 1 -- start start 2023-10-24T01:45:24.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c88154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c88098bd0 0x7f5c880c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c880bffd0 0x7f5c880c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880c0970 con 0x7f5c88098bd0 2023-10-24T01:45:24.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880c71d0 con 0x7f5c880bffd0 2023-10-24T01:45:24.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8e4a6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880c9410 con 0x7f5c88154430 2023-10-24T01:45:24.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c88098bd0 0x7f5c880c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5c88098bd0 0x7f5c880c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49566/0 (socket says 172.21.15.148:49566) 2023-10-24T01:45:24.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 -- 172.21.15.148:0/2318899474 learned_addr learned my addr 172.21.15.148:0/2318899474 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:24.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c8ca43700 1 --2- 172.21.15.148:0/2318899474 >> v2:172.21.15.150:3300/0 conn(0x7f5c880bffd0 0x7f5c880c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 -- 172.21.15.148:0/2318899474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 msgr2=0x7f5c88154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:24.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 --2- 172.21.15.148:0/2318899474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c88154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:24.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 -- 172.21.15.148:0/2318899474 >> v2:172.21.15.150:3300/0 conn(0x7f5c880bffd0 msgr2=0x7f5c880c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:24.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 --2- 172.21.15.148:0/2318899474 >> v2:172.21.15.150:3300/0 conn(0x7f5c880bffd0 0x7f5c880c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 -- 172.21.15.148:0/2318899474 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880c6c10 con 0x7f5c88098bd0 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c877fe700 1 --2- 172.21.15.148:0/2318899474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c880c6300 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f5c7c006fd0 tx=0x7f5c7c0090f0).ready entity=mon.0 client_cookie=a4826ef84c7fb19f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c86ffd700 1 -- 172.21.15.148:0/2318899474 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00b600 con 0x7f5c88098bd0 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c86ffd700 1 -- 172.21.15.148:0/2318899474 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c00b760 con 0x7f5c88098bd0 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.768+0000 7f5c86ffd700 1 -- 172.21.15.148:0/2318899474 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00bae0 con 0x7f5c88098bd0 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/2318899474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 msgr2=0x7f5c880c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/2318899474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c880c6300 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f5c7c006fd0 tx=0x7f5c7c0090f0).stop 2023-10-24T01:45:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/2318899474 shutdown_connections 2023-10-24T01:45:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/2318899474 >> v2:172.21.15.150:3300/0 conn(0x7f5c880bffd0 0x7f5c880c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/2318899474 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c88154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/2318899474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c880c6300 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.776 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/2318899474 >> 172.21.15.148:0/2318899474 conn(0x7f5c880cb070 msgr2=0x7f5c880cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:24.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/2318899474 shutdown_connections 2023-10-24T01:45:24.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.769+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/2318899474 wait complete. 2023-10-24T01:45:24.777 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.770+0000 7f5c8e4a6700 1 Processor -- start 2023-10-24T01:45:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.770+0000 7f5c8e4a6700 1 -- start start 2023-10-24T01:45:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 0x7f5c8814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c880b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c881509b0 con 0x7f5c88098bd0 2023-10-24T01:45:24.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88168610 con 0x7f5c880bffd0 2023-10-24T01:45:24.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8e4a6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88158e00 con 0x7f5c88154430 2023-10-24T01:45:24.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.781 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49582/0 (socket says 172.21.15.148:49582) 2023-10-24T01:45:24.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 -- 172.21.15.148:0/1360666805 learned_addr learned my addr 172.21.15.148:0/1360666805 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:24.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c8ca43700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c880b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c877fe700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 0x7f5c8814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 -- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 msgr2=0x7f5c880b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c880b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 -- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 msgr2=0x7f5c8814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 0x7f5c8814e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 -- 172.21.15.148:0/1360666805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009370 con 0x7f5c88098bd0 2023-10-24T01:45:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c877fe700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 0x7f5c8814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:45:24.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c87fff700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f5c7800b4c0 tx=0x7f5c78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78002320 con 0x7f5c88098bd0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.771+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78002480 con 0x7f5c88098bd0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.772+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78002840 con 0x7f5c88098bd0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.772+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c88167fc0 con 0x7f5c88098bd0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.772+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c88158aa0 con 0x7f5c88098bd0 2023-10-24T01:45:24.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.772+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8806c6b0 con 0x7f5c88098bd0 2023-10-24T01:45:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.773+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 74) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5c78002bf0 con 0x7f5c88098bd0 2023-10-24T01:45:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.773+0000 7f5c6ffff700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 0x7f5c74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.773+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f5c7807a2c0 con 0x7f5c88098bd0 2023-10-24T01:45:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.773+0000 7f5c877fe700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 0x7f5c74061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:24.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.774+0000 7f5c877fe700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 0x7f5c74061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5c7c006fd0 tx=0x7f5c7c017000).ready entity=mgr.8185 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:24.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.777+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5c7804b3e0 con 0x7f5c88098bd0 2023-10-24T01:45:24.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:24.985+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5c88062c40 con 0x7f5c88098bd0 2023-10-24T01:45:25.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.462+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7f5c78019db0 con 0x7f5c88098bd0 2023-10-24T01:45:25.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.464+0000 7f5c6ffff700 1 -- 172.21.15.148:0/1360666805 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v75) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5c780731c0 con 0x7f5c88098bd0 2023-10-24T01:45:25.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 msgr2=0x7f5c74061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 0x7f5c74061730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5c7c006fd0 tx=0x7f5c7c017000).stop 2023-10-24T01:45:25.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 msgr2=0x7f5c881585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f5c7800b4c0 tx=0x7f5c78009060).stop 2023-10-24T01:45:25.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 shutdown_connections 2023-10-24T01:45:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c88154430 0x7f5c880b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.466+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7f5c7405f270 0x7f5c74061730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.467+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c88098bd0 0x7f5c881585b0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.467+0000 7f5c8e4a6700 1 --2- 172.21.15.148:0/1360666805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c880bffd0 0x7f5c8814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.467+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 >> 172.21.15.148:0/1360666805 conn(0x7f5c880cb070 msgr2=0x7f5c880647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.467+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 shutdown_connections 2023-10-24T01:45:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.467+0000 7f5c8e4a6700 1 -- 172.21.15.148:0/1360666805 wait complete. 2023-10-24T01:45:25.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T01:45:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.603+0000 7fcf6acb1700 1 Processor -- start 2023-10-24T01:45:25.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.603+0000 7fcf6acb1700 1 -- start start 2023-10-24T01:45:25.606 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:25.604+0000 7f5622642680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:45:25.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6acb1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf640a7100 0x7fcf64154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6acb1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf64069b30 0x7fcf640bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6acb1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf641589c0 con 0x7fcf64154020 2023-10-24T01:45:25.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6acb1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf64066bd0 con 0x7fcf640a7100 2023-10-24T01:45:25.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6acb1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64066220 con 0x7fcf64069b30 2023-10-24T01:45:25.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf640a7100 0x7fcf64154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:25.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcf640a7100 0x7fcf64154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49608/0 (socket says 172.21.15.148:49608) 2023-10-24T01:45:25.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 -- 172.21.15.148:0/1160962047 learned_addr learned my addr 172.21.15.148:0/1160962047 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf6924e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf64069b30 0x7fcf640bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf68a4d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcf64154020 0x7fcf64069420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:54388/0 (socket says 172.21.15.148:54388) 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 -- 172.21.15.148:0/1160962047 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf64069b30 msgr2=0x7fcf640bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 --2- 172.21.15.148:0/1160962047 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf64069b30 0x7fcf640bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 -- 172.21.15.148:0/1160962047 >> v1:172.21.15.150:6789/0 conn(0x7fcf64154020 legacy=0x7fcf64069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf637fe700 1 -- 172.21.15.148:0/1160962047 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379274143 0 0) 0x7fcf641589c0 con 0x7fcf64154020 2023-10-24T01:45:25.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 -- 172.21.15.148:0/1160962047 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640bd170 con 0x7fcf640a7100 2023-10-24T01:45:25.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.604+0000 7fcf63fff700 1 --2- 172.21.15.148:0/1160962047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640a7100 0x7fcf64154400 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fcf50006fd0 tx=0x7fcf500090f0).ready entity=mon.0 client_cookie=c23152365f56bd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:25.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf637fe700 1 -- 172.21.15.148:0/1160962047 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000b580 con 0x7fcf640a7100 2023-10-24T01:45:25.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf637fe700 1 -- 172.21.15.148:0/1160962047 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000b6e0 con 0x7fcf640a7100 2023-10-24T01:45:25.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf637fe700 1 -- 172.21.15.148:0/1160962047 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ba60 con 0x7fcf640a7100 2023-10-24T01:45:25.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1160962047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640a7100 msgr2=0x7fcf64154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1160962047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640a7100 0x7fcf64154400 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fcf50006fd0 tx=0x7fcf500090f0).stop 2023-10-24T01:45:25.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1160962047 shutdown_connections 2023-10-24T01:45:25.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1160962047 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf64069b30 0x7fcf640bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1160962047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf640a7100 0x7fcf64154400 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1160962047 >> 172.21.15.148:0/1160962047 conn(0x7fcf640c7d20 msgr2=0x7fcf640c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:25.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1160962047 shutdown_connections 2023-10-24T01:45:25.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.605+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1160962047 wait complete. 2023-10-24T01:45:25.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.606+0000 7fcf6acb1700 1 Processor -- start 2023-10-24T01:45:25.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 -- start start 2023-10-24T01:45:25.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf64069b30 0x7fcf641412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf640a7100 0x7fcf640befe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf641578d0 con 0x7fcf64154020 2023-10-24T01:45:25.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64156cc0 con 0x7fcf64069b30 2023-10-24T01:45:25.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.607+0000 7fcf6acb1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64156fa0 con 0x7fcf640a7100 2023-10-24T01:45:25.616 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:25.607+0000 7f886dc35680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:45:25.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:25.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49620/0 (socket says 172.21.15.148:49620) 2023-10-24T01:45:25.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 -- 172.21.15.148:0/1136144276 learned_addr learned my addr 172.21.15.148:0/1136144276 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:25.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf63fff700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf640a7100 0x7fcf640befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:25.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf68a4d700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf64069b30 0x7fcf641412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:25.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 -- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf640a7100 msgr2=0x7fcf640befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf640a7100 0x7fcf640befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 -- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf64069b30 msgr2=0x7fcf641412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf64069b30 0x7fcf641412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 -- 172.21.15.148:0/1136144276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009370 con 0x7fcf64154020 2023-10-24T01:45:25.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6924e700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fcf5c009ec0 tx=0x7fcf5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:25.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00cb70 con 0x7fcf64154020 2023-10-24T01:45:25.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00f040 con 0x7fcf64154020 2023-10-24T01:45:25.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf64157280 con 0x7fcf64154020 2023-10-24T01:45:25.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c013400 con 0x7fcf64154020 2023-10-24T01:45:25.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.608+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf641417d0 con 0x7fcf64154020 2023-10-24T01:45:25.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.609+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf64157a40 con 0x7fcf64154020 2023-10-24T01:45:25.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.610+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fcf5c013770 con 0x7fcf64154020 2023-10-24T01:45:25.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.610+0000 7fcf60ff9700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 0x7fcf48061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:25.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.610+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fcf5c07ac80 con 0x7fcf64154020 2023-10-24T01:45:25.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.610+0000 7fcf68a4d700 1 -- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 msgr2=0x7fcf48061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:25.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.610+0000 7fcf68a4d700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 0x7fcf48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:25.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.614+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcf5c04bda0 con 0x7fcf64154020 2023-10-24T01:45:25.668 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:25.668+0000 7f5622642680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:45:25.675 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:25.674+0000 7f886dc35680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:45:25.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.787+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fcf6406c6b0 con 0x7fcf64154020 2023-10-24T01:45:25.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.790+0000 7fcf60ff9700 1 -- 172.21.15.148:0/1136144276 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcf5c04f3c0 con 0x7fcf64154020 2023-10-24T01:45:25.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 msgr2=0x7fcf48061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:25.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 0x7fcf48061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:25.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 msgr2=0x7fcf640bf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:25.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7fcf5c009ec0 tx=0x7fcf5c00b040).stop 2023-10-24T01:45:25.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 shutdown_connections 2023-10-24T01:45:25.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fcf4805f2c0 0x7fcf48061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:25.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf64154020 0x7fcf640bf4d0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf64069b30 0x7fcf641412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 --2- 172.21.15.148:0/1136144276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf640a7100 0x7fcf640befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:25.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 >> 172.21.15.148:0/1136144276 conn(0x7fcf640c7d20 msgr2=0x7fcf64153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:25.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 shutdown_connections 2023-10-24T01:45:25.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:25.792+0000 7fcf6acb1700 1 -- 172.21.15.148:0/1136144276 wait complete. 2023-10-24T01:45:25.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:45:25.807 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T01:45:25.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:45:25.826 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-10-24T01:45:25.882 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-24T01:45:25.946 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:25.945+0000 7f5622642680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:45:25.961 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:25.959+0000 7f886dc35680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:45:26.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.044+0000 7fbed5430700 1 Processor -- start 2023-10-24T01:45:26.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.044+0000 7fbed5430700 1 -- start start 2023-10-24T01:45:26.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbed5430700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 0x7fbed00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbed5430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 0x7fbed00a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbed5430700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00c6270 con 0x7fbed00aa420 2023-10-24T01:45:26.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbed5430700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00c60e0 con 0x7fbed01544b0 2023-10-24T01:45:26.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbed5430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00aa890 con 0x7fbed00c8290 2023-10-24T01:45:26.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbecf7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbed00aa420 0x7fbed00c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48456/0 (socket says 172.21.15.148:48456) 2023-10-24T01:45:26.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbecf7fe700 1 -- 172.21.15.148:0/2182338772 learned_addr learned my addr 172.21.15.148:0/2182338772 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:45:26.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbece7fc700 1 --2- 172.21.15.148:0/2182338772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 0x7fbed00a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:26.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbeceffd700 1 --2- 172.21.15.148:0/2182338772 >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 0x7fbed00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:26.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbecdffb700 1 -- 172.21.15.148:0/2182338772 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375400067 0 0) 0x7fbed00c6270 con 0x7fbed00aa420 2023-10-24T01:45:26.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.045+0000 7fbecdffb700 1 -- 172.21.15.148:0/2182338772 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb80033f0 con 0x7fbed00aa420 2023-10-24T01:45:26.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbece7fc700 1 -- 172.21.15.148:0/2182338772 >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 msgr2=0x7fbed00a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:26.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbece7fc700 1 --2- 172.21.15.148:0/2182338772 >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 0x7fbed00a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:26.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbece7fc700 1 -- 172.21.15.148:0/2182338772 >> v1:172.21.15.148:6789/0 conn(0x7fbed00aa420 legacy=0x7fbed00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:26.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbece7fc700 1 -- 172.21.15.148:0/2182338772 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00c0c80 con 0x7fbed00c8290 2023-10-24T01:45:26.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbeceffd700 1 --2- 172.21.15.148:0/2182338772 >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 0x7fbed00a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:26.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbece7fc700 1 --2- 172.21.15.148:0/2182338772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 0x7fbed00a9f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fbec0009760 tx=0x7fbec0009060).ready entity=mon.2 client_cookie=feba7da210364fe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:26.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbecdffb700 1 -- 172.21.15.148:0/2182338772 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000d4a0 con 0x7fbed00c8290 2023-10-24T01:45:26.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbecdffb700 1 -- 172.21.15.148:0/2182338772 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000d600 con 0x7fbed00c8290 2023-10-24T01:45:26.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.046+0000 7fbecdffb700 1 -- 172.21.15.148:0/2182338772 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000d980 con 0x7fbed00c8290 2023-10-24T01:45:26.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 -- 172.21.15.148:0/2182338772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 msgr2=0x7fbed00a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:26.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 --2- 172.21.15.148:0/2182338772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 0x7fbed00a9f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fbec0009760 tx=0x7fbec0009060).stop 2023-10-24T01:45:26.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 -- 172.21.15.148:0/2182338772 shutdown_connections 2023-10-24T01:45:26.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 --2- 172.21.15.148:0/2182338772 >> v2:172.21.15.150:3300/0 conn(0x7fbed01544b0 0x7fbed00a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:26.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 --2- 172.21.15.148:0/2182338772 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00c8290 0x7fbed00a9f30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:26.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 -- 172.21.15.148:0/2182338772 >> 172.21.15.148:0/2182338772 conn(0x7fbed00945d0 msgr2=0x7fbed006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:26.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 -- 172.21.15.148:0/2182338772 shutdown_connections 2023-10-24T01:45:26.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.047+0000 7fbed5430700 1 -- 172.21.15.148:0/2182338772 wait complete. 2023-10-24T01:45:26.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.048+0000 7fbed5430700 1 Processor -- start 2023-10-24T01:45:26.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.048+0000 7fbed5430700 1 -- start start 2023-10-24T01:45:26.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 0x7fbed014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 0x7fbed01657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed014f400 con 0x7fbed01544b0 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00aee50 con 0x7fbed00c8290 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbed5430700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0165cb0 con 0x7fbed00aa420 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbece7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 0x7fbed01657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:26.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49636/0 (socket says 172.21.15.148:49636) 2023-10-24T01:45:26.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 -- 172.21.15.148:0/3482559903 learned_addr learned my addr 172.21.15.148:0/3482559903 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:26.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 0x7fbed014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:26.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 msgr2=0x7fbed014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:26.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 0x7fbed014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:26.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 msgr2=0x7fbed01657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:26.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 0x7fbed01657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:26.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40092a0 con 0x7fbed01544b0 2023-10-24T01:45:26.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbece7fc700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 0x7fbed01657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:26.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 0x7fbed014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T01:45:26.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.049+0000 7fbecf7fe700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fbec8005ad0 tx=0x7fbec8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:26.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.050+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8005d30 con 0x7fbed01544b0 2023-10-24T01:45:26.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.050+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8005e90 con 0x7fbed01544b0 2023-10-24T01:45:26.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.050+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec00092a0 con 0x7fbed01544b0 2023-10-24T01:45:26.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.050+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007320 con 0x7fbed01544b0 2023-10-24T01:45:26.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.050+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00ae240 con 0x7fbed01544b0 2023-10-24T01:45:26.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00aefe0 con 0x7fbed01544b0 2023-10-24T01:45:26.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 75) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fbec80076d0 con 0x7fbed01544b0 2023-10-24T01:45:26.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbeb6ffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:26.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fbec807a440 con 0x7fbed01544b0 2023-10-24T01:45:26.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbeceffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:26.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.051+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T01:45:26.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.055+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbec804b560 con 0x7fbed01544b0 2023-10-24T01:45:26.253 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.252+0000 7fbeceffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:26.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.252+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T01:45:26.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.253+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed006c6b0 con 0x7fbebc05f2c0 2023-10-24T01:45:26.563 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:26.562+0000 7f5622642680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:45:26.584 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:26.582+0000 7f886dc35680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:45:26.636 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:26.635+0000 7f5622642680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:45:26.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.653+0000 7fbeceffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:26.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:26.653+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T01:45:26.657 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:26.655+0000 7f886dc35680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:45:26.822 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:26.821+0000 7f5622642680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:45:26.845 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:26.843+0000 7f886dc35680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:45:27.245 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.244+0000 7f5622642680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:45:27.266 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.264+0000 7f886dc35680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:45:27.349 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.348+0000 7f5622642680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:27.369 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.368+0000 7f886dc35680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:27.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:27.454+0000 7fbeceffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:27.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:27.454+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T01:45:27.503 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.503+0000 7f5622642680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:27.523 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.521+0000 7f886dc35680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:27.578 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.577+0000 7f5622642680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:45:27.597 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.596+0000 7f886dc35680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:45:27.646 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.645+0000 7f5622642680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:45:27.665 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.663+0000 7f886dc35680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:45:27.908 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:27.908+0000 7f5622642680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:45:27.923 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:27.921+0000 7f886dc35680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:45:28.095 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:28.095+0000 7f5622642680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:28.107 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:28.106+0000 7f886dc35680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:45:28.753 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:28.752+0000 7f5622642680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:45:28.759 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:28.758+0000 7f886dc35680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:45:28.823 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:28.822+0000 7f5622642680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:45:28.829 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:28.827+0000 7f886dc35680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:45:28.899 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:28.898+0000 7f5622642680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:45:28.905 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:28.903+0000 7f886dc35680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:45:29.047 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.046+0000 7f5622642680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:45:29.053 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.052+0000 7f886dc35680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:45:29.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:29.055+0000 7fbeceffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/87479 2023-10-24T01:45:29.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:29.055+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T01:45:29.118 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.118+0000 7f5622642680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:45:29.124 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.123+0000 7f886dc35680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:45:29.234 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.233+0000 7f5622642680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:45:29.241 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.239+0000 7f886dc35680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:45:29.343 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.342+0000 7f5622642680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:29.349 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.348+0000 7f886dc35680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:45:29.635 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.634+0000 7f5622642680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:45:29.640 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.639+0000 7f886dc35680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:45:29.706 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.705+0000 7f5622642680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:45:29.712 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T01:45:29.710+0000 7f886dc35680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:45:29.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:29.726+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 76) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fbec801adb0 con 0x7fbed01544b0 2023-10-24T01:45:29.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:29.726+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T01:45:29.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:29.726+0000 7fbeb6ffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:45:29.792 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f55995ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.792 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f55995ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f55995ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f55995ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f55995ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f5596dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.793 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f5596dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.794 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f5596dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.794 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f5596dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:29.794 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:45:29.791+0000 7f5596dc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:45:30.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.728+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 77) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fbec80783e0 con 0x7fbed01544b0 2023-10-24T01:45:30.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.728+0000 7fbeb6ffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.728+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbed006c6b0 con 0x7fbebc05f2c0 2023-10-24T01:45:30.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.730+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.746+0000 7fbeceffd700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fbec400a010 tx=0x7fbec4009060).ready entity=mgr.8512 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:30.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.751+0000 7fbeb6ffd700 1 -- 172.21.15.148:0/3482559903 <== mgr.8512 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbed006c6b0 con 0x7fbebc05f2c0 2023-10-24T01:45:30.753 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-10-24T01:45:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 msgr2=0x7fbebc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061700 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fbec400a010 tx=0x7fbec4009060).stop 2023-10-24T01:45:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 msgr2=0x7fbed00af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fbec8005ad0 tx=0x7fbec8001650).stop 2023-10-24T01:45:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 shutdown_connections 2023-10-24T01:45:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fbebc05f2c0 0x7fbebc061700 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbed01544b0 0x7fbed00af2e0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbed00aa420 0x7fbed014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 --2- 172.21.15.148:0/3482559903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbed00c8290 0x7fbed01657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 >> 172.21.15.148:0/3482559903 conn(0x7fbed00945d0 msgr2=0x7fbed00c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 shutdown_connections 2023-10-24T01:45:30.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.754+0000 7fbed5430700 1 -- 172.21.15.148:0/3482559903 wait complete. 2023-10-24T01:45:30.769 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-10-24T01:45:30.770 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-24T01:45:30.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.928+0000 7fb1c6ecf700 1 Processor -- start 2023-10-24T01:45:30.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.928+0000 7fb1c6ecf700 1 -- start start 2023-10-24T01:45:30.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c6ecf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c6ecf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1c00aa640 0x7fb1c00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c6ecf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00c6270 con 0x7fb1c00c8290 2023-10-24T01:45:30.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c6ecf700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00c60e0 con 0x7fb1c00aa640 2023-10-24T01:45:30.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c6ecf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00c0c80 con 0x7fb1c01544b0 2023-10-24T01:45:30.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c546c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1c00aa640 0x7fb1c00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c546c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb1c00aa640 0x7fb1c00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49648/0 (socket says 172.21.15.148:49648) 2023-10-24T01:45:30.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1bffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb1c00c8290 0x7fb1c00a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48468/0 (socket says 172.21.15.148:48468) 2023-10-24T01:45:30.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c546c700 1 -- 172.21.15.148:0/1379018012 learned_addr learned my addr 172.21.15.148:0/1379018012 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:30.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.929+0000 7fb1c4c6b700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c546c700 1 -- 172.21.15.148:0/1379018012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 msgr2=0x7fb1c00a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c546c700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c00a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c546c700 1 -- 172.21.15.148:0/1379018012 >> v1:172.21.15.148:6789/0 conn(0x7fb1c00c8290 legacy=0x7fb1c00a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c546c700 1 -- 172.21.15.148:0/1379018012 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00c0f40 con 0x7fb1c00aa640 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1bf7fe700 1 -- 172.21.15.148:0/1379018012 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993905680 0 0) 0x7fb1c00c6270 con 0x7fb1c00c8290 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c546c700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00aa640 0x7fb1c00c6700 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fb1b8009f20 tx=0x7fb1b8009840).ready entity=mon.0 client_cookie=662f3bd5b5473d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:30.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1bf7fe700 1 -- 172.21.15.148:0/1379018012 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800e070 con 0x7fb1c00aa640 2023-10-24T01:45:30.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1bf7fe700 1 -- 172.21.15.148:0/1379018012 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800b9d0 con 0x7fb1c00aa640 2023-10-24T01:45:30.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1bf7fe700 1 -- 172.21.15.148:0/1379018012 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800bd50 con 0x7fb1c00aa640 2023-10-24T01:45:30.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1379018012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00aa640 msgr2=0x7fb1c00c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00aa640 0x7fb1c00c6700 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fb1b8009f20 tx=0x7fb1b8009840).stop 2023-10-24T01:45:30.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1379018012 shutdown_connections 2023-10-24T01:45:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00aa640 0x7fb1c00c6700 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1379018012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c00a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1379018012 >> 172.21.15.148:0/1379018012 conn(0x7fb1c00945d0 msgr2=0x7fb1c006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1379018012 shutdown_connections 2023-10-24T01:45:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.930+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1379018012 wait complete. 2023-10-24T01:45:30.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.931+0000 7fb1c6ecf700 1 Processor -- start 2023-10-24T01:45:30.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 -- start start 2023-10-24T01:45:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c00aa640 0x7fb1c0148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00ae8d0 con 0x7fb1c00c8290 2023-10-24T01:45:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00aebb0 con 0x7fb1c00aa640 2023-10-24T01:45:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1c6ecf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00aee90 con 0x7fb1c01544b0 2023-10-24T01:45:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.932+0000 7fb1bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49654/0 (socket says 172.21.15.148:49654) 2023-10-24T01:45:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 -- 172.21.15.148:0/1485070175 learned_addr learned my addr 172.21.15.148:0/1485070175 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:45:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1c546c700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1c4c6b700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c00aa640 0x7fb1c0148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 -- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 msgr2=0x7fb1c014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c014ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 -- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c00aa640 msgr2=0x7fb1c0148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c00aa640 0x7fb1c0148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 -- 172.21.15.148:0/1485070175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009ae0 con 0x7fb1c00c8290 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bffff700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4e0 tx=0x7fb1ac007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0072e0 con 0x7fb1c00c8290 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac007440 con 0x7fb1c00c8290 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00af170 con 0x7fb1c00c8290 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0058f0 con 0x7fb1c00c8290 2023-10-24T01:45:30.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.933+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c0148f00 con 0x7fb1c00c8290 2023-10-24T01:45:30.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.934+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00af690 con 0x7fb1c00c8290 2023-10-24T01:45:30.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.934+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 77) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb1ac005ce0 con 0x7fb1c00c8290 2023-10-24T01:45:30.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.935+0000 7fb1bcff9700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 0x7fb1a4061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:45:30.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.935+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6423+0+0 (secure 0 0 0) 0x7fb1ac079a70 con 0x7fb1c00c8290 2023-10-24T01:45:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.935+0000 7fb1c4c6b700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 0x7fb1a4061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:45:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.935+0000 7fb1c4c6b700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 0x7fb1a4061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb1c01493d0 tx=0x7fb1b4008040).ready entity=mgr.8512 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:45:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:30.939+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb1c00af690 con 0x7fb1c00c8290 2023-10-24T01:45:31.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.128+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1c00af690 con 0x7fb1a405f080 2023-10-24T01:45:31.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.134+0000 7fb1bcff9700 1 -- 172.21.15.148:0/1485070175 <== mgr.8512 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7fb1c00af690 con 0x7fb1a405f080 2023-10-24T01:45:31.135 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-10-24T01:45:31.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 msgr2=0x7fb1a4061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:31.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 0x7fb1a4061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb1c01493d0 tx=0x7fb1b4008040).stop 2023-10-24T01:45:31.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 msgr2=0x7fb1c00adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:45:31.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fb1ac00c4e0 tx=0x7fb1ac007c60).stop 2023-10-24T01:45:31.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 shutdown_connections 2023-10-24T01:45:31.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1c01544b0 0x7fb1c014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:31.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c00aa640 0x7fb1c0148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:31.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7fb1a405f080 0x7fb1a4061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:31.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 --2- 172.21.15.148:0/1485070175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb1c00c8290 0x7fb1c00adf80 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:45:31.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 >> 172.21.15.148:0/1485070175 conn(0x7fb1c00945d0 msgr2=0x7fb1c00c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:45:31.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 shutdown_connections 2023-10-24T01:45:31.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:45:31.136+0000 7fb1c6ecf700 1 -- 172.21.15.148:0/1485070175 wait complete. 2023-10-24T01:45:31.149 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-10-24T01:45:43.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:45:43.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:46:00.139 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:46:00.138+0000 7f5588dad700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:46:00.139 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:46:00.138+0000 7f5588dad700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:46:00.140 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:46:00.138+0000 7f5588dad700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:46:00.140 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:46:00.138+0000 7f5588dad700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:46:00.140 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:46:00.138+0000 7f5588dad700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:46:13.247 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:46:13.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:46:43.336 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:46:43.340 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:47:13.492 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:47:13.496 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:47:43.631 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:47:43.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:48:13.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:48:13.765 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:48:43.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:48:43.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:49:13.965 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:49:13.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:49:44.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:49:44.107 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:50:14.351 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:50:14.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:50:44.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:50:44.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:51:14.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:51:14.566 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:51:44.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:51:44.698 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:52:14.834 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:52:14.839 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:52:44.940 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:52:44.943 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:53:15.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:53:15.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:53:45.221 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:53:45.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:54:15.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:54:15.347 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:54:45.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:54:45.460 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:55:15.588 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:55:15.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:55:45.718 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:55:45.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:56:15.833 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:56:15.836 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:56:16.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T01:56:16.151 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-24T01:56:16.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_46_00_UTC 2023-10-24T01:56:16.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_47_00_UTC 2023-10-24T01:56:16.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_48_00_UTC 2023-10-24T01:56:16.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_49_00_UTC 2023-10-24T01:56:16.172 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_50_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_51_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_52_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_53_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_54_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_55_00_UTC 2023-10-24T01:56:16.173 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_56_00_UTC 2023-10-24T01:56:16.174 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-01_46_00_UTC', 'scheduled-2023-10-24-01_47_00_UTC', 'scheduled-2023-10-24-01_48_00_UTC', 'scheduled-2023-10-24-01_49_00_UTC', 'scheduled-2023-10-24-01_50_00_UTC', 'scheduled-2023-10-24-01_51_00_UTC', 'scheduled-2023-10-24-01_52_00_UTC', 'scheduled-2023-10-24-01_53_00_UTC', 'scheduled-2023-10-24-01_54_00_UTC', 'scheduled-2023-10-24-01_55_00_UTC', 'scheduled-2023-10-24-01_56_00_UTC'] 2023-10-24T01:56:16.174 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-24T01:56:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.337+0000 7ff831245700 1 Processor -- start 2023-10-24T01:56:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.337+0000 7ff831245700 1 -- start start 2023-10-24T01:56:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff831245700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff82c0c8560 0x7ff82c0c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff831245700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0c6830 con 0x7ff82c1543b0 2023-10-24T01:56:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff831245700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0c1040 con 0x7ff82c154790 2023-10-24T01:56:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff831245700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0c8970 con 0x7ff82c0c8560 2023-10-24T01:56:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff82c0c8560 0x7ff82c0c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ff82c1543b0 0x7ff82c0a7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57062/0 (socket says 172.21.15.148:57062) 2023-10-24T01:56:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82ad9d700 1 -- 172.21.15.148:0/1275859752 learned_addr learned my addr 172.21.15.148:0/1275859752 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82b59e700 1 -- 172.21.15.148:0/1275859752 >> v1:172.21.15.150:6789/0 conn(0x7ff82c154790 legacy=0x7ff82c0c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82b59e700 1 -- 172.21.15.148:0/1275859752 >> v1:172.21.15.148:6789/0 conn(0x7ff82c1543b0 legacy=0x7ff82c0a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82a59c700 1 -- 172.21.15.148:0/1275859752 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827047180 0 0) 0x7ff82c0c6830 con 0x7ff82c1543b0 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.338+0000 7ff82b59e700 1 -- 172.21.15.148:0/1275859752 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0c1290 con 0x7ff82c0c8560 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff82b59e700 1 --2- 172.21.15.148:0/1275859752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0c8560 0x7ff82c0c0b50 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7ff824009e60 tx=0x7ff824009780).ready entity=mon.0 client_cookie=c523757ba16182e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff82a59c700 1 -- 172.21.15.148:0/1275859752 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400e070 con 0x7ff82c0c8560 2023-10-24T01:56:16.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff82a59c700 1 -- 172.21.15.148:0/1275859752 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400bbf0 con 0x7ff82c0c8560 2023-10-24T01:56:16.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff82a59c700 1 -- 172.21.15.148:0/1275859752 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824012410 con 0x7ff82c0c8560 2023-10-24T01:56:16.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 -- 172.21.15.148:0/1275859752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0c8560 msgr2=0x7ff82c0c0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 --2- 172.21.15.148:0/1275859752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0c8560 0x7ff82c0c0b50 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7ff824009e60 tx=0x7ff824009780).stop 2023-10-24T01:56:16.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 -- 172.21.15.148:0/1275859752 shutdown_connections 2023-10-24T01:56:16.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 --2- 172.21.15.148:0/1275859752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c0c8560 0x7ff82c0c0b50 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 -- 172.21.15.148:0/1275859752 >> 172.21.15.148:0/1275859752 conn(0x7ff82c0945d0 msgr2=0x7ff82c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:56:16.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 -- 172.21.15.148:0/1275859752 shutdown_connections 2023-10-24T01:56:16.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.339+0000 7ff831245700 1 -- 172.21.15.148:0/1275859752 wait complete. 2023-10-24T01:56:16.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.340+0000 7ff831245700 1 Processor -- start 2023-10-24T01:56:16.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.340+0000 7ff831245700 1 -- start start 2023-10-24T01:56:16.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82c0c8560 0x7ff82c142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff82c154790 0x7ff82c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c095a00 con 0x7ff82c1543b0 2023-10-24T01:56:16.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c097be0 con 0x7ff82c154790 2023-10-24T01:56:16.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff831245700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c142f90 con 0x7ff82c0c8560 2023-10-24T01:56:16.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff823fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff823fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36176/0 (socket says 172.21.15.148:36176) 2023-10-24T01:56:16.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.341+0000 7ff823fff700 1 -- 172.21.15.148:0/1014559877 learned_addr learned my addr 172.21.15.148:0/1014559877 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:56:16.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff82b59e700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff82c154790 0x7ff82c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 -- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82c0c8560 msgr2=0x7ff82c142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82c0c8560 0x7ff82c142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:56:16.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 -- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff82c154790 msgr2=0x7ff82c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff82c154790 0x7ff82c0c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 -- 172.21.15.148:0/1014559877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009a20 con 0x7ff82c1543b0 2023-10-24T01:56:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff823fff700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7ff81400b490 tx=0x7ff814006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814002320 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140024c0 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814002880 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c151240 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.342+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c097870 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.343+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c06c6b0 con 0x7ff82c1543b0 2023-10-24T01:56:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.343+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 80) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff814002bf0 con 0x7ff82c1543b0 2023-10-24T01:56:16.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.344+0000 7ff822ffd700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 0x7ff80c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.344+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6510+0+0 (secure 0 0 0) 0x7ff81407a3b0 con 0x7ff82c1543b0 2023-10-24T01:56:16.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.344+0000 7ff82ad9d700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 0x7ff80c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.345+0000 7ff82ad9d700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 0x7ff80c061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff81c0011e0 tx=0x7ff81c007850).ready entity=mgr.8512 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.348+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff81404b380 con 0x7ff82c1543b0 2023-10-24T01:56:16.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.533+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 --> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff82c097d50 con 0x7ff80c05f2c0 2023-10-24T01:56:16.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.536+0000 7ff822ffd700 1 -- 172.21.15.148:0/1014559877 <== mgr.8512 v2:172.21.15.150:6832/87479 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff82c097d50 con 0x7ff80c05f2c0 2023-10-24T01:56:16.537 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:56:16.537 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T01:45:30", "first": "2023-10-24T01:46:00", "last": "2023-10-24T01:56:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-24T01:56:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 msgr2=0x7ff80c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 0x7ff80c061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff81c0011e0 tx=0x7ff81c007850).stop 2023-10-24T01:56:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 msgr2=0x7ff82c151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7ff81400b490 tx=0x7ff814006f00).stop 2023-10-24T01:56:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 shutdown_connections 2023-10-24T01:56:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff82c154790 0x7ff82c0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff82c0c8560 0x7ff82c142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T01:56:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff80c05f2c0 0x7ff80c061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 --2- 172.21.15.148:0/1014559877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff82c1543b0 0x7ff82c151ca0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 >> 172.21.15.148:0/1014559877 conn(0x7ff82c0945d0 msgr2=0x7ff82c0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:56:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 shutdown_connections 2023-10-24T01:56:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.537+0000 7ff831245700 1 -- 172.21.15.148:0/1014559877 wait complete. 2023-10-24T01:56:16.550 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T01:45:30", "first": "2023-10-24T01:46:00", "last": "2023-10-24T01:56:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-24T01:56:16.551 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T01:45:30', 'first': '2023-10-24T01:46:00', 'last': '2023-10-24T01:56:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-10-24T01:56:16.551 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-24T01:56:16.552 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-24T01:56:16.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-24T01:56:16.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.664+0000 7ff31f6e2700 1 Processor -- start 2023-10-24T01:56:16.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 -- start start 2023-10-24T01:56:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 0x7ff318095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff318154780 0x7ff3180962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180bf5c0 con 0x7ff3181543a0 2023-10-24T01:56:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180967c0 con 0x7ff318154780 2023-10-24T01:56:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.665+0000 7ff31f6e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180a86d0 con 0x7ff3180bfa50 2023-10-24T01:56:16.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff318154780 0x7ff3180962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff318154780 0x7ff3180962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36182/0 (socket says 172.21.15.148:36182) 2023-10-24T01:56:16.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 -- 172.21.15.148:0/2308874138 learned_addr learned my addr 172.21.15.148:0/2308874138 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:56:16.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31cc7d700 1 --2- 172.21.15.148:0/2308874138 >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 0x7ff318095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 -- 172.21.15.148:0/2308874138 >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 msgr2=0x7ff318095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:56:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 --2- 172.21.15.148:0/2308874138 >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 0x7ff318095de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 -- 172.21.15.148:0/2308874138 >> v1:172.21.15.150:6789/0 conn(0x7ff3181543a0 legacy=0x7ff3180a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T01:56:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 -- 172.21.15.148:0/2308874138 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180be9b0 con 0x7ff318154780 2023-10-24T01:56:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31cc7d700 1 --2- 172.21.15.148:0/2308874138 >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 0x7ff318095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T01:56:16.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff31dc7f700 1 --2- 172.21.15.148:0/2308874138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff318154780 0x7ff3180962d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7ff31806a2b0 tx=0x7ff310009840).ready entity=mon.0 client_cookie=962816136ae4c1b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff30ffff700 1 -- 172.21.15.148:0/2308874138 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000e070 con 0x7ff318154780 2023-10-24T01:56:16.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff30ffff700 1 -- 172.21.15.148:0/2308874138 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000baa0 con 0x7ff318154780 2023-10-24T01:56:16.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.666+0000 7ff30ffff700 1 -- 172.21.15.148:0/2308874138 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000be20 con 0x7ff318154780 2023-10-24T01:56:16.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 -- 172.21.15.148:0/2308874138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff318154780 msgr2=0x7ff3180962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/2308874138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff318154780 0x7ff3180962d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7ff31806a2b0 tx=0x7ff310009840).stop 2023-10-24T01:56:16.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 -- 172.21.15.148:0/2308874138 shutdown_connections 2023-10-24T01:56:16.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/2308874138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff318154780 0x7ff3180962d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/2308874138 >> v2:172.21.15.150:3300/0 conn(0x7ff3180bfa50 0x7ff318095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 -- 172.21.15.148:0/2308874138 >> 172.21.15.148:0/2308874138 conn(0x7ff3180630f0 msgr2=0x7ff3180c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:56:16.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 -- 172.21.15.148:0/2308874138 shutdown_connections 2023-10-24T01:56:16.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.667+0000 7ff31f6e2700 1 -- 172.21.15.148:0/2308874138 wait complete. 2023-10-24T01:56:16.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.668+0000 7ff31f6e2700 1 Processor -- start 2023-10-24T01:56:16.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.668+0000 7ff31f6e2700 1 -- start start 2023-10-24T01:56:16.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.677 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3181543a0 0x7ff318168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 0x7ff318152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180aeee0 con 0x7ff3180bfa50 2023-10-24T01:56:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180a9f30 con 0x7ff318154780 2023-10-24T01:56:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff318168e60 con 0x7ff3181543a0 2023-10-24T01:56:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36198/0 (socket says 172.21.15.148:36198) 2023-10-24T01:56:16.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 -- 172.21.15.148:0/1469853013 learned_addr learned my addr 172.21.15.148:0/1469853013 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T01:56:16.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31cc7d700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3181543a0 0x7ff318168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.679 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31dc7f700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 0x7ff318152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 -- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3181543a0 msgr2=0x7ff318168610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3181543a0 0x7ff318168610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 -- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 msgr2=0x7ff318152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 0x7ff318152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 -- 172.21.15.148:0/1469853013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310009ae0 con 0x7ff3180bfa50 2023-10-24T01:56:16.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31dc7f700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 0x7ff318152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T01:56:16.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31d47e700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7ff31400c470 tx=0x7ff314007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400ce90 con 0x7ff3180bfa50 2023-10-24T01:56:16.681 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400f470 con 0x7ff3180bfa50 2023-10-24T01:56:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318169140 con 0x7ff3180bfa50 2023-10-24T01:56:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.669+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400f810 con 0x7ff3180bfa50 2023-10-24T01:56:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.670+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318168b00 con 0x7ff3180bfa50 2023-10-24T01:56:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.671+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31806c6b0 con 0x7ff3180bfa50 2023-10-24T01:56:16.682 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.671+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 80) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff31400fc40 con 0x7ff3180bfa50 2023-10-24T01:56:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.671+0000 7ff30d7fa700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 0x7ff2fc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T01:56:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.671+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6510+0+0 (secure 0 0 0) 0x7ff314079a00 con 0x7ff3180bfa50 2023-10-24T01:56:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.671+0000 7ff31cc7d700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 0x7ff2fc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T01:56:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.672+0000 7ff31cc7d700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 0x7ff2fc061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff3180acf10 tx=0x7ff308008040).ready entity=mgr.8512 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T01:56:16.683 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.675+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff314048af0 con 0x7ff3180bfa50 2023-10-24T01:56:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.884+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff3180bec90 con 0x7ff3180bfa50 2023-10-24T01:56:16.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.887+0000 7ff30d7fa700 1 -- 172.21.15.148:0/1469853013 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v80) v1 ==== 74+0+149162 (secure 0 0 0) 0x7ff3140456c0 con 0x7ff3180bfa50 2023-10-24T01:56:16.891 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T01:56:16.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 msgr2=0x7ff2fc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 0x7ff2fc061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff3180acf10 tx=0x7ff308008040).stop 2023-10-24T01:56:16.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 msgr2=0x7ff3180ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T01:56:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7ff31400c470 tx=0x7ff314007de0).stop 2023-10-24T01:56:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 shutdown_connections 2023-10-24T01:56:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff318154780 0x7ff318152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:6832/87479,v1:172.21.15.150:6833/87479] conn(0x7ff2fc05f2c0 0x7ff2fc061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3180bfa50 0x7ff3180ae9f0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 --2- 172.21.15.148:0/1469853013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3181543a0 0x7ff318168610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T01:56:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 >> 172.21.15.148:0/1469853013 conn(0x7ff3180630f0 msgr2=0x7ff3180c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T01:56:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 shutdown_connections 2023-10-24T01:56:16.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T01:56:16.889+0000 7ff31f6e2700 1 -- 172.21.15.148:0/1469853013 wait complete. 2023-10-24T01:56:16.902 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":80,"active_gid":8512,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":87479},{"type":"v1","addr":"172.21.15.150:6833","nonce":87479}]},"active_addr":"172.21.15.150:6833/87479","active_change":"2023-10-24T01:45:29.720318+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":9342,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":182,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":373397057}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3411131123}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":596661116}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3207540675}]}]} 2023-10-24T01:56:16.906 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-10-24T01:56:16.906 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-24T01:56:16.907 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-10-24T01:56:16.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-24T01:56:16.908 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T01:56:16.938 INFO:tasks.ceph.mgr.x:Stopped 2023-10-24T01:56:16.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-24T01:56:16.981 INFO:tasks.ceph.mgr.x:Started 2023-10-24T01:56:17.164 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:17.163+0000 7efecc09b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T01:56:17.226 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:17.224+0000 7efecc09b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T01:56:17.496 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:17.494+0000 7efecc09b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T01:56:18.106 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:18.104+0000 7efecc09b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T01:56:18.178 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:18.176+0000 7efecc09b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T01:56:18.366 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:18.365+0000 7efecc09b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T01:56:18.784 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:18.782+0000 7efecc09b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T01:56:18.886 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:18.885+0000 7efecc09b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:56:19.040 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:19.038+0000 7efecc09b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T01:56:19.114 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:19.113+0000 7efecc09b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T01:56:19.181 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:19.179+0000 7efecc09b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T01:56:19.438 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:19.436+0000 7efecc09b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T01:56:19.621 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:19.619+0000 7efecc09b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T01:56:20.274 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.272+0000 7efecc09b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T01:56:20.344 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.342+0000 7efecc09b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T01:56:20.419 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.418+0000 7efecc09b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T01:56:20.567 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.565+0000 7efecc09b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T01:56:20.637 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.636+0000 7efecc09b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T01:56:20.752 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.750+0000 7efecc09b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T01:56:20.861 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:20.860+0000 7efecc09b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T01:56:21.156 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.154+0000 7efecc09b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T01:56:21.228 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.227+0000 7efecc09b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T01:56:21.308 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe3f01f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.308 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe3f01f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.308 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe3f01f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe3f01f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe3f01f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe43027700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe43027700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.309 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe43027700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.310 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe43027700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:21.310 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:56:21.306+0000 7efe43027700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:56:45.963 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:56:45.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:57:00.294 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:57:00.293+0000 7efe4b838700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:57:00.295 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:57:00.293+0000 7efe4b838700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:57:00.295 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:57:00.293+0000 7efe4b838700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:57:00.295 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:57:00.293+0000 7efe4b838700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:57:00.296 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T01:57:00.293+0000 7efe4b838700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T01:57:16.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:57:16.106 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:57:46.233 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:57:46.237 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:58:16.319 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:58:16.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:58:46.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:58:46.448 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:59:16.576 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:59:16.579 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:59:46.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T01:59:46.702 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:00:16.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:00:16.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:00:46.944 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:00:46.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:01:16.982 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-24T02:01:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.114+0000 7fe62acb0700 1 Processor -- start 2023-10-24T02:01:17.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.114+0000 7fe62acb0700 1 -- start start 2023-10-24T02:01:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe62acb0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6241350f0 0x7fe624062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe62acb0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 0x7fe624062b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe62acb0700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe624064b10 con 0x7fe624064fa0 2023-10-24T02:01:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe62acb0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe624153690 con 0x7fe6241350f0 2023-10-24T02:01:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe62acb0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6241531b0 con 0x7fe624152d40 2023-10-24T02:01:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe628a4c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6241350f0 0x7fe624062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe628a4c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe6241350f0 0x7fe624062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47552/0 (socket says 172.21.15.148:47552) 2023-10-24T02:01:17.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe628a4c700 1 -- 172.21.15.148:0/4224375843 learned_addr learned my addr 172.21.15.148:0/4224375843 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.115+0000 7fe61bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe624064fa0 0x7fe624152630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36378/0 (socket says 172.21.15.148:36378) 2023-10-24T02:01:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe62924d700 1 --2- 172.21.15.148:0/4224375843 >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 0x7fe624062b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe628a4c700 1 -- 172.21.15.148:0/4224375843 >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 msgr2=0x7fe624062b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe628a4c700 1 --2- 172.21.15.148:0/4224375843 >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 0x7fe624062b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe628a4c700 1 -- 172.21.15.148:0/4224375843 >> v1:172.21.15.148:6789/0 conn(0x7fe624064fa0 legacy=0x7fe624152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe61b7fe700 1 -- 172.21.15.148:0/4224375843 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979583664 0 0) 0x7fe624064b10 con 0x7fe624064fa0 2023-10-24T02:01:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe628a4c700 1 -- 172.21.15.148:0/4224375843 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6241533b0 con 0x7fe6241350f0 2023-10-24T02:01:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe62924d700 1 --2- 172.21.15.148:0/4224375843 >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 0x7fe624062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe628a4c700 1 --2- 172.21.15.148:0/4224375843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6241350f0 0x7fe624062650 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fe6241388b0 tx=0x7fe620009840).ready entity=mon.0 client_cookie=25f444a0f7bae3c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe61b7fe700 1 -- 172.21.15.148:0/4224375843 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000e070 con 0x7fe6241350f0 2023-10-24T02:01:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe61b7fe700 1 -- 172.21.15.148:0/4224375843 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000ba50 con 0x7fe6241350f0 2023-10-24T02:01:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe61b7fe700 1 -- 172.21.15.148:0/4224375843 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000bdd0 con 0x7fe6241350f0 2023-10-24T02:01:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe62acb0700 1 -- 172.21.15.148:0/4224375843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6241350f0 msgr2=0x7fe624062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.116+0000 7fe62acb0700 1 --2- 172.21.15.148:0/4224375843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6241350f0 0x7fe624062650 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fe6241388b0 tx=0x7fe620009840).stop 2023-10-24T02:01:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 -- 172.21.15.148:0/4224375843 shutdown_connections 2023-10-24T02:01:17.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 --2- 172.21.15.148:0/4224375843 >> v2:172.21.15.150:3300/0 conn(0x7fe624152d40 0x7fe624062b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 --2- 172.21.15.148:0/4224375843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6241350f0 0x7fe624062650 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 -- 172.21.15.148:0/4224375843 >> 172.21.15.148:0/4224375843 conn(0x7fe6240c3670 msgr2=0x7fe6240c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:17.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 -- 172.21.15.148:0/4224375843 shutdown_connections 2023-10-24T02:01:17.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.117+0000 7fe62acb0700 1 -- 172.21.15.148:0/4224375843 wait complete. 2023-10-24T02:01:17.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.118+0000 7fe62acb0700 1 Processor -- start 2023-10-24T02:01:17.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.118+0000 7fe62acb0700 1 -- start start 2023-10-24T02:01:17.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6241350f0 0x7fe6240c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 0x7fe624168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240c15d0 con 0x7fe624064fa0 2023-10-24T02:01:17.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240c18b0 con 0x7fe624152d40 2023-10-24T02:01:17.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240c1b90 con 0x7fe6241350f0 2023-10-24T02:01:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47556/0 (socket says 172.21.15.148:47556) 2023-10-24T02:01:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 -- 172.21.15.148:0/3508328673 learned_addr learned my addr 172.21.15.148:0/3508328673 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62924d700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 0x7fe624168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe61bfff700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6241350f0 0x7fe6240c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 -- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6241350f0 msgr2=0x7fe6240c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6241350f0 0x7fe6240c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 -- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 msgr2=0x7fe624168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 0x7fe624168020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 -- 172.21.15.148:0/3508328673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009ae0 con 0x7fe624064fa0 2023-10-24T02:01:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62924d700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 0x7fe624168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe628a4c700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fe620009fd0 tx=0x7fe620009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000bbc0 con 0x7fe624064fa0 2023-10-24T02:01:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000bd20 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6240c1e70 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62001d640 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.119+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240c11d0 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.120+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624164bd0 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.121+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe62001da30 con 0x7fe624064fa0 2023-10-24T02:01:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.121+0000 7fe618ff9700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 0x7fe610061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.121+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fe62007c070 con 0x7fe624064fa0 2023-10-24T02:01:17.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.121+0000 7fe61bfff700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 0x7fe610061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.122+0000 7fe61bfff700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 0x7fe610061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe6240a9050 tx=0x7fe614009040).ready entity=mgr.7643 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.126+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe62004cf90 con 0x7fe624064fa0 2023-10-24T02:01:17.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:01:17.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:01:17.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.317+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6240c1a20 con 0x7fe61005f2c0 2023-10-24T02:01:17.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.322+0000 7fe618ff9700 1 -- 172.21.15.148:0/3508328673 <== mgr.7643 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fe6240c1a20 con 0x7fe61005f2c0 2023-10-24T02:01:17.323 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-24T02:01:17.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 msgr2=0x7fe610061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 0x7fe610061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe6240a9050 tx=0x7fe614009040).stop 2023-10-24T02:01:17.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 msgr2=0x7fe624137740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7fe620009fd0 tx=0x7fe620009840).stop 2023-10-24T02:01:17.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 shutdown_connections 2023-10-24T02:01:17.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe61005f2c0 0x7fe610061780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe624152d40 0x7fe624168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe624064fa0 0x7fe624137740 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 --2- 172.21.15.148:0/3508328673 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6241350f0 0x7fe6240c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 >> 172.21.15.148:0/3508328673 conn(0x7fe6240c3670 msgr2=0x7fe6240c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:17.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 shutdown_connections 2023-10-24T02:01:17.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.324+0000 7fe62acb0700 1 -- 172.21.15.148:0/3508328673 wait complete. 2023-10-24T02:01:17.339 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-24T02:01:17.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:17.340 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-24T02:01:17.412 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_46_00_UTC 2023-10-24T02:01:17.412 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_47_00_UTC 2023-10-24T02:01:17.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_48_00_UTC 2023-10-24T02:01:17.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_49_00_UTC 2023-10-24T02:01:17.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_50_00_UTC 2023-10-24T02:01:17.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_51_00_UTC 2023-10-24T02:01:17.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_52_00_UTC 2023-10-24T02:01:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_53_00_UTC 2023-10-24T02:01:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_54_00_UTC 2023-10-24T02:01:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_55_00_UTC 2023-10-24T02:01:17.414 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_56_00_UTC 2023-10-24T02:01:17.415 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_57_00_UTC 2023-10-24T02:01:17.415 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_58_00_UTC 2023-10-24T02:01:17.415 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_59_00_UTC 2023-10-24T02:01:17.415 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_00_00_UTC 2023-10-24T02:01:17.415 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_01_00_UTC 2023-10-24T02:01:17.416 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-24-01_46_00_UTC', 'scheduled-2023-10-24-01_47_00_UTC', 'scheduled-2023-10-24-01_48_00_UTC', 'scheduled-2023-10-24-01_49_00_UTC', 'scheduled-2023-10-24-01_50_00_UTC', 'scheduled-2023-10-24-01_51_00_UTC', 'scheduled-2023-10-24-01_52_00_UTC', 'scheduled-2023-10-24-01_53_00_UTC', 'scheduled-2023-10-24-01_54_00_UTC', 'scheduled-2023-10-24-01_55_00_UTC', 'scheduled-2023-10-24-01_56_00_UTC', 'scheduled-2023-10-24-01_57_00_UTC', 'scheduled-2023-10-24-01_58_00_UTC', 'scheduled-2023-10-24-01_59_00_UTC', 'scheduled-2023-10-24-02_00_00_UTC', 'scheduled-2023-10-24-02_01_00_UTC'] 2023-10-24T02:01:17.417 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-24T02:01:17.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.571+0000 7f2121bee700 1 Processor -- start 2023-10-24T02:01:17.573 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.571+0000 7f2121bee700 1 -- start start 2023-10-24T02:01:17.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.572+0000 7f2121bee700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c0a5970 0x7f211c0a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.575 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.572+0000 7f2121bee700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0a5df0 con 0x7f211c0a8090 2023-10-24T02:01:17.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.572+0000 7f2121bee700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0bdd60 con 0x7f211c151fc0 2023-10-24T02:01:17.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.572+0000 7f2121bee700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0c3d30 con 0x7f211c0a5970 2023-10-24T02:01:17.576 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.572+0000 7f211bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c0a5970 0x7f211c0a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f211c0a5970 0x7f211c0a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47572/0 (socket says 172.21.15.148:47572) 2023-10-24T02:01:17.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f21213ed700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f211c0a8090 0x7f211c0c44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36390/0 (socket says 172.21.15.148:36390) 2023-10-24T02:01:17.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 -- 172.21.15.148:0/2922092889 learned_addr learned my addr 172.21.15.148:0/2922092889 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 -- 172.21.15.148:0/2922092889 >> v1:172.21.15.150:6789/0 conn(0x7f211c151fc0 legacy=0x7f211c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 -- 172.21.15.148:0/2922092889 >> v1:172.21.15.148:6789/0 conn(0x7f211c0a8090 legacy=0x7f211c0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 -- 172.21.15.148:0/2922092889 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0c3fd0 con 0x7f211c0a5970 2023-10-24T02:01:17.578 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211b7fe700 1 -- 172.21.15.148:0/2922092889 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295530827 0 0) 0x7f211c0a5df0 con 0x7f211c0a8090 2023-10-24T02:01:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211bfff700 1 --2- 172.21.15.148:0/2922092889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a5970 0x7f211c0a7ba0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f2108006fd0 tx=0x7f21080090f0).ready entity=mon.0 client_cookie=29926128ec08becb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211b7fe700 1 -- 172.21.15.148:0/2922092889 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800b600 con 0x7f211c0a5970 2023-10-24T02:01:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211b7fe700 1 -- 172.21.15.148:0/2922092889 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800b760 con 0x7f211c0a5970 2023-10-24T02:01:17.579 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.573+0000 7f211b7fe700 1 -- 172.21.15.148:0/2922092889 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800bae0 con 0x7f211c0a5970 2023-10-24T02:01:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 -- 172.21.15.148:0/2922092889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a5970 msgr2=0x7f211c0a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 --2- 172.21.15.148:0/2922092889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a5970 0x7f211c0a7ba0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f2108006fd0 tx=0x7f21080090f0).stop 2023-10-24T02:01:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 -- 172.21.15.148:0/2922092889 shutdown_connections 2023-10-24T02:01:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 --2- 172.21.15.148:0/2922092889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a5970 0x7f211c0a7ba0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 -- 172.21.15.148:0/2922092889 >> 172.21.15.148:0/2922092889 conn(0x7f211c092240 msgr2=0x7f211c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:17.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 -- 172.21.15.148:0/2922092889 shutdown_connections 2023-10-24T02:01:17.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.574+0000 7f2121bee700 1 -- 172.21.15.148:0/2922092889 wait complete. 2023-10-24T02:01:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.575+0000 7f2121bee700 1 Processor -- start 2023-10-24T02:01:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.575+0000 7f2121bee700 1 -- start start 2023-10-24T02:01:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211c0a5970 0x7f211c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f211c151fc0 0x7f211c14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c153da0 con 0x7f211c0a8090 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c03f0 con 0x7f211c151fc0 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c153240 con 0x7f211c0a5970 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47574/0 (socket says 172.21.15.148:47574) 2023-10-24T02:01:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 -- 172.21.15.148:0/3027949044 learned_addr learned my addr 172.21.15.148:0/3027949044 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f21213ed700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f211c151fc0 0x7f211c14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2120bec700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211c0a5970 0x7f211c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 -- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211c0a5970 msgr2=0x7f211c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211c0a5970 0x7f211c152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 -- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f211c151fc0 msgr2=0x7f211c14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f211c151fc0 0x7f211c14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 -- 172.21.15.148:0/3027949044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009370 con 0x7f211c0a8090 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f211bfff700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f2108009130 tx=0x7f2108017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800b8d0 con 0x7f211c0a8090 2023-10-24T02:01:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800ba30 con 0x7f211c0a8090 2023-10-24T02:01:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210801b660 con 0x7f211c0a8090 2023-10-24T02:01:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c153500 con 0x7f211c0a8090 2023-10-24T02:01:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.576+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c153ac0 con 0x7f211c0a8090 2023-10-24T02:01:17.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.577+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c047480 con 0x7f211c0a8090 2023-10-24T02:01:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.578+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f210801ba10 con 0x7f211c0a8090 2023-10-24T02:01:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.578+0000 7f2118ff9700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 0x7f2100061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.578+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f210807bf90 con 0x7f211c0a8090 2023-10-24T02:01:17.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.578+0000 7f2120bec700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 0x7f2100061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.579+0000 7f2120bec700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 0x7f2100061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2110003760 tx=0x7f2110009040).ready entity=mgr.7643 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.582+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f210804ceb0 con 0x7f211c0a8090 2023-10-24T02:01:17.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.766+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f211c06c160 con 0x7f210005f2c0 2023-10-24T02:01:17.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.769+0000 7f2118ff9700 1 -- 172.21.15.148:0/3027949044 <== mgr.7643 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f211c06c160 con 0x7f210005f2c0 2023-10-24T02:01:17.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:17.770 INFO:teuthology.orchestra.run.smithi148.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T01:45:30", "first": "2023-10-24T01:46:00", "last": "2023-10-24T02:01:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-24T02:01:17.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 msgr2=0x7f2100061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 0x7f2100061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2110003760 tx=0x7f2110009040).stop 2023-10-24T02:01:17.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 msgr2=0x7f211c1496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f2108009130 tx=0x7f2108017000).stop 2023-10-24T02:01:17.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 shutdown_connections 2023-10-24T02:01:17.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f210005f2c0 0x7f2100061780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f211c151fc0 0x7f211c14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211c0a5970 0x7f211c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 --2- 172.21.15.148:0/3027949044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f211c0a8090 0x7f211c1496b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 >> 172.21.15.148:0/3027949044 conn(0x7f211c092240 msgr2=0x7f211c14b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:17.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 shutdown_connections 2023-10-24T02:01:17.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.770+0000 7f2121bee700 1 -- 172.21.15.148:0/3027949044 wait complete. 2023-10-24T02:01:17.784 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-24T00:00:00", "created": "2023-10-24T01:45:30", "first": "2023-10-24T01:46:00", "last": "2023-10-24T02:01:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-24T02:01:17.784 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-24T00:00:00', 'created': '2023-10-24T01:45:30', 'first': '2023-10-24T01:46:00', 'last': '2023-10-24T02:01:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-10-24T02:01:17.784 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-10-24T02:01:17.785 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-10-24T02:01:17.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-24T02:01:17.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.901+0000 7fc88420e700 1 Processor -- start 2023-10-24T02:01:17.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 -- start start 2023-10-24T02:01:17.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc87c14c540 0x7fc87c067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c063d70 0x7fc87c153130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c152ca0 con 0x7fc87c14c920 2023-10-24T02:01:17.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c066d50 con 0x7fc87c14c540 2023-10-24T02:01:17.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.902+0000 7fc88420e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c065950 con 0x7fc87c063d70 2023-10-24T02:01:17.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc87c14c540 0x7fc87c067250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc87c14c540 0x7fc87c067250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47590/0 (socket says 172.21.15.148:47590) 2023-10-24T02:01:17.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 -- 172.21.15.148:0/3843332274 learned_addr learned my addr 172.21.15.148:0/3843332274 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc8827ab700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c063d70 0x7fc87c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 -- 172.21.15.148:0/3843332274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c063d70 msgr2=0x7fc87c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c063d70 0x7fc87c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 -- 172.21.15.148:0/3843332274 >> v1:172.21.15.150:6789/0 conn(0x7fc87c14c920 legacy=0x7fc87c063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 -- 172.21.15.148:0/3843332274 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c065c30 con 0x7fc87c14c540 2023-10-24T02:01:17.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc881faa700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c14c540 0x7fc87c067250 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fc878006fd0 tx=0x7fc8780090f0).ready entity=mon.0 client_cookie=25247d49e8a97d24 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc880fa8700 1 -- 172.21.15.148:0/3843332274 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800b600 con 0x7fc87c14c540 2023-10-24T02:01:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc880fa8700 1 -- 172.21.15.148:0/3843332274 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800b760 con 0x7fc87c14c540 2023-10-24T02:01:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.903+0000 7fc880fa8700 1 -- 172.21.15.148:0/3843332274 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800bb00 con 0x7fc87c14c540 2023-10-24T02:01:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 -- 172.21.15.148:0/3843332274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c14c540 msgr2=0x7fc87c067250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c14c540 0x7fc87c067250 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7fc878006fd0 tx=0x7fc8780090f0).stop 2023-10-24T02:01:17.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 -- 172.21.15.148:0/3843332274 shutdown_connections 2023-10-24T02:01:17.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c063d70 0x7fc87c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 --2- 172.21.15.148:0/3843332274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c14c540 0x7fc87c067250 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 -- 172.21.15.148:0/3843332274 >> 172.21.15.148:0/3843332274 conn(0x7fc87c0c49d0 msgr2=0x7fc87c068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:17.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 -- 172.21.15.148:0/3843332274 shutdown_connections 2023-10-24T02:01:17.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.904+0000 7fc88420e700 1 -- 172.21.15.148:0/3843332274 wait complete. 2023-10-24T02:01:17.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.905+0000 7fc88420e700 1 Processor -- start 2023-10-24T02:01:17.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.905+0000 7fc88420e700 1 -- start start 2023-10-24T02:01:17.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 0x7fc87c146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c149400 0x7fc87c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c147360 con 0x7fc87c063d70 2023-10-24T02:01:17.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c14a4e0 con 0x7fc87c14c540 2023-10-24T02:01:17.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1498d0 con 0x7fc87c149400 2023-10-24T02:01:17.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47600/0 (socket says 172.21.15.148:47600) 2023-10-24T02:01:17.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 -- 172.21.15.148:0/1475598465 learned_addr learned my addr 172.21.15.148:0/1475598465 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:17.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc8827ab700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c149400 0x7fc87c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc8817a9700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 0x7fc87c146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 -- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c149400 msgr2=0x7fc87c0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c149400 0x7fc87c0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 -- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 msgr2=0x7fc87c146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:17.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 0x7fc87c146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:17.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 -- 172.21.15.148:0/1475598465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009370 con 0x7fc87c063d70 2023-10-24T02:01:17.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc8817a9700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 0x7fc87c146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:17.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc881faa700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fc87c064260 tx=0x7fc878017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800bec0 con 0x7fc87c063d70 2023-10-24T02:01:17.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800b8d0 con 0x7fc87c063d70 2023-10-24T02:01:17.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c149bb0 con 0x7fc87c063d70 2023-10-24T02:01:17.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.906+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878024470 con 0x7fc87c063d70 2023-10-24T02:01:17.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.907+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c14a170 con 0x7fc87c063d70 2023-10-24T02:01:17.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.908+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0c3a70 con 0x7fc87c063d70 2023-10-24T02:01:17.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.908+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc878021070 con 0x7fc87c063d70 2023-10-24T02:01:17.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.908+0000 7fc871ffb700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 0x7fc860061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:17.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.908+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6682+0+0 (secure 0 0 0) 0x7fc87807c150 con 0x7fc87c063d70 2023-10-24T02:01:17.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.909+0000 7fc8817a9700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 0x7fc860061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:17.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.909+0000 7fc8817a9700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 0x7fc860061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc87c0aa020 tx=0x7fc86c009040).ready entity=mgr.7643 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:17.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:17.913+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc87804d070 con 0x7fc87c063d70 2023-10-24T02:01:18.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.098+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc87c06c6b0 con 0x7fc86005f2c0 2023-10-24T02:01:18.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.102+0000 7fc871ffb700 1 -- 172.21.15.148:0/1475598465 <== mgr.7643 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fc87c06c6b0 con 0x7fc86005f2c0 2023-10-24T02:01:18.104 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-10-24T02:01:18.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 msgr2=0x7fc860061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 0x7fc860061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc87c0aa020 tx=0x7fc86c009040).stop 2023-10-24T02:01:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 msgr2=0x7fc87c0c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7fc87c064260 tx=0x7fc878017000).stop 2023-10-24T02:01:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 shutdown_connections 2023-10-24T02:01:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc87c149400 0x7fc87c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc87c063d70 0x7fc87c0c3520 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc86005f2c0 0x7fc860061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 --2- 172.21.15.148:0/1475598465 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc87c14c540 0x7fc87c146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 >> 172.21.15.148:0/1475598465 conn(0x7fc87c0c49d0 msgr2=0x7fc87c147ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:18.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 shutdown_connections 2023-10-24T02:01:18.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:18.104+0000 7fc88420e700 1 -- 172.21.15.148:0/1475598465 wait complete. 2023-10-24T02:01:18.117 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-10-24T02:01:18.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.118 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-24T02:01:18.134 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_46_00_UTC 2023-10-24T02:01:18.135 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_47_00_UTC 2023-10-24T02:01:18.135 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_48_00_UTC 2023-10-24T02:01:18.136 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_49_00_UTC 2023-10-24T02:01:18.136 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_50_00_UTC 2023-10-24T02:01:18.136 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_51_00_UTC 2023-10-24T02:01:18.137 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_52_00_UTC 2023-10-24T02:01:18.137 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_53_00_UTC 2023-10-24T02:01:18.137 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_54_00_UTC 2023-10-24T02:01:18.138 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_55_00_UTC 2023-10-24T02:01:18.138 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_56_00_UTC 2023-10-24T02:01:18.138 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_57_00_UTC 2023-10-24T02:01:18.139 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_58_00_UTC 2023-10-24T02:01:18.139 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-01_59_00_UTC 2023-10-24T02:01:18.140 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_00_00_UTC 2023-10-24T02:01:18.140 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_01_00_UTC 2023-10-24T02:01:18.141 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_46_00_UTC 2023-10-24T02:01:18.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.142 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_46_00_UTC) 2023-10-24T02:01:18.195 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_47_00_UTC 2023-10-24T02:01:18.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.196 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_47_00_UTC) 2023-10-24T02:01:18.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_48_00_UTC 2023-10-24T02:01:18.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.257 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_48_00_UTC) 2023-10-24T02:01:18.321 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_49_00_UTC 2023-10-24T02:01:18.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.322 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_49_00_UTC) 2023-10-24T02:01:18.381 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_50_00_UTC 2023-10-24T02:01:18.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.382 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_50_00_UTC) 2023-10-24T02:01:18.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_51_00_UTC 2023-10-24T02:01:18.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.445 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_51_00_UTC) 2023-10-24T02:01:18.508 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_52_00_UTC 2023-10-24T02:01:18.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.509 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_52_00_UTC) 2023-10-24T02:01:18.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_53_00_UTC 2023-10-24T02:01:18.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.569 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_53_00_UTC) 2023-10-24T02:01:18.630 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_54_00_UTC 2023-10-24T02:01:18.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.631 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_54_00_UTC) 2023-10-24T02:01:18.690 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_55_00_UTC 2023-10-24T02:01:18.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.691 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_55_00_UTC) 2023-10-24T02:01:18.751 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_56_00_UTC 2023-10-24T02:01:18.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.752 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_56_00_UTC) 2023-10-24T02:01:18.812 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_57_00_UTC 2023-10-24T02:01:18.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.813 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_57_00_UTC) 2023-10-24T02:01:18.875 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_58_00_UTC 2023-10-24T02:01:18.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.876 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_58_00_UTC) 2023-10-24T02:01:18.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_59_00_UTC 2023-10-24T02:01:18.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.936 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-01_59_00_UTC) 2023-10-24T02:01:18.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-02_00_00_UTC 2023-10-24T02:01:18.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:18.999 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-02_00_00_UTC) 2023-10-24T02:01:19.061 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-02_01_00_UTC 2023-10-24T02:01:19.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:19.062 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-24-02_01_00_UTC) 2023-10-24T02:01:19.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:19.127 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-10-24T02:01:19.185 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T02:01:19.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.338+0000 7f6b87e1f700 1 Processor -- start 2023-10-24T02:01:19.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.338+0000 7f6b87e1f700 1 -- start start 2023-10-24T02:01:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b87e1f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6b80154430 0x7f6b80154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b87e1f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 0x7f6b800c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b87e1f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800c71d0 con 0x7f6b800bffd0 2023-10-24T02:01:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b87e1f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800c9410 con 0x7f6b80154430 2023-10-24T02:01:19.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b87e1f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800c6c10 con 0x7f6b80098bd0 2023-10-24T02:01:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6b80154430 0x7f6b80154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b863bc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6b800bffd0 0x7f6b800c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36396/0 (socket says 172.21.15.148:36396) 2023-10-24T02:01:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b863bc700 1 -- 172.21.15.148:0/2707962066 learned_addr learned my addr 172.21.15.148:0/2707962066 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:19.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b853ba700 1 --2- 172.21.15.148:0/2707962066 >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 0x7f6b800c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 -- 172.21.15.148:0/2707962066 >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 msgr2=0x7f6b800c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 --2- 172.21.15.148:0/2707962066 >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 0x7f6b800c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 -- 172.21.15.148:0/2707962066 >> v1:172.21.15.148:6789/0 conn(0x7f6b800bffd0 legacy=0x7f6b800c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b84bb9700 1 -- 172.21.15.148:0/2707962066 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151859422 0 0) 0x7f6b800c71d0 con 0x7f6b800bffd0 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 -- 172.21.15.148:0/2707962066 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800c6ef0 con 0x7f6b80154430 2023-10-24T02:01:19.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b853ba700 1 --2- 172.21.15.148:0/2707962066 >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 0x7f6b800c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.339+0000 7f6b85bbb700 1 --2- 172.21.15.148:0/2707962066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b80154430 0x7f6b80154810 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f6b800c23b0 tx=0x7f6b70009780).ready entity=mon.0 client_cookie=8b494414c10685d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b84bb9700 1 -- 172.21.15.148:0/2707962066 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000e070 con 0x7f6b80154430 2023-10-24T02:01:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b84bb9700 1 -- 172.21.15.148:0/2707962066 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000bc30 con 0x7f6b80154430 2023-10-24T02:01:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b84bb9700 1 -- 172.21.15.148:0/2707962066 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70012410 con 0x7f6b80154430 2023-10-24T02:01:19.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2707962066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b80154430 msgr2=0x7f6b80154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2707962066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b80154430 0x7f6b80154810 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f6b800c23b0 tx=0x7f6b70009780).stop 2023-10-24T02:01:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2707962066 shutdown_connections 2023-10-24T02:01:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2707962066 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b80154430 0x7f6b80154810 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2707962066 >> v2:172.21.15.150:3300/0 conn(0x7f6b80098bd0 0x7f6b800c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:19.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2707962066 >> 172.21.15.148:0/2707962066 conn(0x7f6b800cb070 msgr2=0x7f6b800cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2707962066 shutdown_connections 2023-10-24T02:01:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.340+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2707962066 wait complete. 2023-10-24T02:01:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.341+0000 7f6b87e1f700 1 Processor -- start 2023-10-24T02:01:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.341+0000 7f6b87e1f700 1 -- start start 2023-10-24T02:01:19.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b80098bd0 0x7f6b800ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b80154430 0x7f6b80164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800abf90 con 0x7f6b800bffd0 2023-10-24T02:01:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801655d0 con 0x7f6b80154430 2023-10-24T02:01:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b87e1f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801658b0 con 0x7f6b80098bd0 2023-10-24T02:01:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47618/0 (socket says 172.21.15.148:47618) 2023-10-24T02:01:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 -- 172.21.15.148:0/2897892926 learned_addr learned my addr 172.21.15.148:0/2897892926 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 -- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b80098bd0 msgr2=0x7f6b800ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b80098bd0 0x7f6b800ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 -- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b80154430 msgr2=0x7f6b80164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b80154430 0x7f6b80164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.342+0000 7f6b853ba700 1 -- 172.21.15.148:0/2897892926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009a20 con 0x7f6b800bffd0 2023-10-24T02:01:19.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b853ba700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f6b7400d860 tx=0x7f6b74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74011590 con 0x7f6b800bffd0 2023-10-24T02:01:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740116f0 con 0x7f6b800bffd0 2023-10-24T02:01:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b800ab940 con 0x7f6b800bffd0 2023-10-24T02:01:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74011a70 con 0x7f6b800bffd0 2023-10-24T02:01:19.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.343+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b800ad5d0 con 0x7f6b800bffd0 2023-10-24T02:01:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.344+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b80165ad0 con 0x7f6b800bffd0 2023-10-24T02:01:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.344+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 85) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6b74012420 con 0x7f6b800bffd0 2023-10-24T02:01:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.345+0000 7f6b7dffb700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 0x7f6b6c061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.345+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6682+0+0 (secure 0 0 0) 0x7f6b7407a1d0 con 0x7f6b800bffd0 2023-10-24T02:01:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.345+0000 7f6b85bbb700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 0x7f6b6c061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.346+0000 7f6b85bbb700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 0x7f6b6c061750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6b800add00 tx=0x7f6b70009780).ready entity=mgr.7643 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:19.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.349+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b7404b090 con 0x7f6b800bffd0 2023-10-24T02:01:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.555+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6b8006c6b0 con 0x7f6b800bffd0 2023-10-24T02:01:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.971+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f6b74077bf0 con 0x7f6b800bffd0 2023-10-24T02:01:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.972+0000 7f6b7dffb700 1 -- 172.21.15.148:0/2897892926 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v86) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6b74071c20 con 0x7f6b800bffd0 2023-10-24T02:01:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 msgr2=0x7f6b6c061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 0x7f6b6c061750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6b800add00 tx=0x7f6b70009780).stop 2023-10-24T02:01:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 msgr2=0x7f6b800ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f6b7400d860 tx=0x7f6b74008040).stop 2023-10-24T02:01:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 shutdown_connections 2023-10-24T02:01:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6b6c05f290 0x7f6b6c061750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b80154430 0x7f6b80164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b80098bd0 0x7f6b800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 --2- 172.21.15.148:0/2897892926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b800bffd0 0x7f6b800ae4f0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:19.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 >> 172.21.15.148:0/2897892926 conn(0x7f6b800cb070 msgr2=0x7f6b80148f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:19.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 shutdown_connections 2023-10-24T02:01:19.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:19.976+0000 7f6b87e1f700 1 -- 172.21.15.148:0/2897892926 wait complete. 2023-10-24T02:01:19.998 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T02:01:19.999 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:01:20.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:01:20.140 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T02:01:20.141 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T02:01:20.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:20.141 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T02:01:20.168 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:20.167+0000 7f1b9b617680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:01:20.173 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:20.172+0000 7f8b54ddd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:01:20.182 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:01:20.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:20.183 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T02:01:20.235 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:20.234+0000 7f1b9b617680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:01:20.238 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:20.239 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:20.238+0000 7f8b54ddd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:01:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.395+0000 7f1e2b6fb700 1 Processor -- start 2023-10-24T02:01:20.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.395+0000 7f1e2b6fb700 1 -- start start 2023-10-24T02:01:20.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e2b6fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e2413a840 0x7f1e24069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e2b6fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e240655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e2b6fb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240c4fe0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e2b6fb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240c46f0 con 0x7f1e2413a840 2023-10-24T02:01:20.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e2b6fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2406a5a0 con 0x7f1e2413ac20 2023-10-24T02:01:20.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e29497700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e2413a840 0x7f1e24069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e29c98700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1e240c2bd0 0x7f1e240c1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:52906/0 (socket says 172.21.15.148:52906) 2023-10-24T02:01:20.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e29c98700 1 -- 172.21.15.148:0/1812197193 learned_addr learned my addr 172.21.15.148:0/1812197193 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:20.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.396+0000 7f1e28c96700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e240655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e1bfff700 1 -- 172.21.15.148:0/1812197193 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975345884 0 0) 0x7f1e240c4fe0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e1bfff700 1 -- 172.21.15.148:0/1812197193 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e100033f0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e29497700 1 -- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 msgr2=0x7f1e240655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:20.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e29497700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e240655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e29497700 1 -- 172.21.15.148:0/1812197193 >> v1:172.21.15.150:6789/0 conn(0x7f1e240c2bd0 legacy=0x7f1e240c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e29497700 1 -- 172.21.15.148:0/1812197193 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240c4990 con 0x7f1e2413a840 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e28c96700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e240655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e29497700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e24069d50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f1e14009760 tx=0x7f1e14009060).ready entity=mon.1 client_cookie=b575d07a3dbfba3c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e1bfff700 1 -- 172.21.15.148:0/1812197193 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400d4a0 con 0x7f1e2413a840 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e1bfff700 1 -- 172.21.15.148:0/1812197193 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400d600 con 0x7f1e2413a840 2023-10-24T02:01:20.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.397+0000 7f1e1bfff700 1 -- 172.21.15.148:0/1812197193 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400d980 con 0x7f1e2413a840 2023-10-24T02:01:20.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 msgr2=0x7f1e24069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e24069d50 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f1e14009760 tx=0x7f1e14009060).stop 2023-10-24T02:01:20.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/1812197193 shutdown_connections 2023-10-24T02:01:20.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e24069d50 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/1812197193 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e240655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/1812197193 >> 172.21.15.148:0/1812197193 conn(0x7f1e24063120 msgr2=0x7f1e240c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:20.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/1812197193 shutdown_connections 2023-10-24T02:01:20.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.398+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/1812197193 wait complete. 2023-10-24T02:01:20.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.399+0000 7f1e2b6fb700 1 Processor -- start 2023-10-24T02:01:20.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.399+0000 7f1e2b6fb700 1 -- start start 2023-10-24T02:01:20.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e240a7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e24152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240a7600 con 0x7f1e240c2bd0 2023-10-24T02:01:20.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240a6710 con 0x7f1e2413a840 2023-10-24T02:01:20.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e2b6fb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240a69f0 con 0x7f1e2413ac20 2023-10-24T02:01:20.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29c98700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e24152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e28c96700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e240a7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47642/0 (socket says 172.21.15.148:47642) 2023-10-24T02:01:20.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 -- 172.21.15.148:0/733680473 learned_addr learned my addr 172.21.15.148:0/733680473 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:20.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 msgr2=0x7f1e24152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e24152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 msgr2=0x7f1e240a7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e240a7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 -- 172.21.15.148:0/733680473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200092a0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e28c96700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e240a7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:20.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.400+0000 7f1e29497700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f1e14009d50 tx=0x7f1e14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:20.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.401+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400dd30 con 0x7f1e240c2bd0 2023-10-24T02:01:20.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.401+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400de90 con 0x7f1e240c2bd0 2023-10-24T02:01:20.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.401+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140092a0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.401+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400d9a0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.401+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e240a6fb0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.414 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.402+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2406c6b0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.402+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f1e1401d640 con 0x7f1e240c2bd0 2023-10-24T02:01:20.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.402+0000 7f1e197fa700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 0x7f1e08061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.403+0000 7f1e28c96700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 msgr2=0x7f1e08061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:20.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.403+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f1e1407bd10 con 0x7f1e240c2bd0 2023-10-24T02:01:20.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.403+0000 7f1e28c96700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 0x7f1e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:20.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.407+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e1404cbd0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.513 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:20.513+0000 7f8b54ddd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:01:20.522 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:20.521+0000 7f1b9b617680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:01:20.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.604+0000 7f1e28c96700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 msgr2=0x7f1e08061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:20.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.604+0000 7f1e28c96700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 0x7f1e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:20.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.619+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e24063f70 con 0x7f1e240c2bd0 2023-10-24T02:01:20.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.619+0000 7f1e197fa700 1 -- 172.21.15.148:0/733680473 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f1e140501f0 con 0x7f1e240c2bd0 2023-10-24T02:01:20.621 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:20.621 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T02:01:20.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 msgr2=0x7f1e08061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 0x7f1e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 msgr2=0x7f1e240a9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f1e14009d50 tx=0x7f1e14016000).stop 2023-10-24T02:01:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 shutdown_connections 2023-10-24T02:01:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e2413ac20 0x7f1e24152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.621+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e240c2bd0 0x7f1e240a9120 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.622+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e0805f270 0x7f1e08061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.622+0000 7f1e2b6fb700 1 --2- 172.21.15.148:0/733680473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e2413a840 0x7f1e240a7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.622+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 >> 172.21.15.148:0/733680473 conn(0x7f1e24063120 msgr2=0x7f1e240c3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.622+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 shutdown_connections 2023-10-24T02:01:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.622+0000 7f1e2b6fb700 1 -- 172.21.15.148:0/733680473 wait complete. 2023-10-24T02:01:20.626 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T02:01:20.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.751+0000 7fd87c664700 1 Processor -- start 2023-10-24T02:01:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.751+0000 7fd87c664700 1 -- start start 2023-10-24T02:01:20.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd87c664700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8741543a0 0x7fd8740a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd87c664700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8740a84b0 0x7fd874095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd87c664700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740bf5c0 con 0x7fd8740bfa50 2023-10-24T02:01:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd87c664700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8740be9b0 con 0x7fd8740a84b0 2023-10-24T02:01:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd87c664700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8740bec90 con 0x7fd8741543a0 2023-10-24T02:01:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd879bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8740a84b0 0x7fd874095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.752+0000 7fd879bff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd8740a84b0 0x7fd874095de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47658/0 (socket says 172.21.15.148:47658) 2023-10-24T02:01:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 -- 172.21.15.148:0/3235656493 learned_addr learned my addr 172.21.15.148:0/3235656493 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd87a400700 1 --2- 172.21.15.148:0/3235656493 >> v2:172.21.15.150:3300/0 conn(0x7fd8741543a0 0x7fd8740a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 -- 172.21.15.148:0/3235656493 >> v2:172.21.15.150:3300/0 conn(0x7fd8741543a0 msgr2=0x7fd8740a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 --2- 172.21.15.148:0/3235656493 >> v2:172.21.15.150:3300/0 conn(0x7fd8741543a0 0x7fd8740a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 -- 172.21.15.148:0/3235656493 >> v1:172.21.15.150:6789/0 conn(0x7fd8740bfa50 legacy=0x7fd874158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 -- 172.21.15.148:0/3235656493 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740bef70 con 0x7fd8740a84b0 2023-10-24T02:01:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd879bff700 1 --2- 172.21.15.148:0/3235656493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740a84b0 0x7fd874095de0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fd87405ff80 tx=0x7fd8640090f0).ready entity=mon.0 client_cookie=e706be73bb6be6ff server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd8793fe700 1 -- 172.21.15.148:0/3235656493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400b5b0 con 0x7fd8740a84b0 2023-10-24T02:01:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd8793fe700 1 -- 172.21.15.148:0/3235656493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86400b710 con 0x7fd8740a84b0 2023-10-24T02:01:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.753+0000 7fd8793fe700 1 -- 172.21.15.148:0/3235656493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400ba90 con 0x7fd8740a84b0 2023-10-24T02:01:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 -- 172.21.15.148:0/3235656493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740a84b0 msgr2=0x7fd874095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 --2- 172.21.15.148:0/3235656493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740a84b0 0x7fd874095de0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7fd87405ff80 tx=0x7fd8640090f0).stop 2023-10-24T02:01:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 -- 172.21.15.148:0/3235656493 shutdown_connections 2023-10-24T02:01:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 --2- 172.21.15.148:0/3235656493 >> v2:172.21.15.150:3300/0 conn(0x7fd8741543a0 0x7fd8740a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 --2- 172.21.15.148:0/3235656493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740a84b0 0x7fd874095de0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 -- 172.21.15.148:0/3235656493 >> 172.21.15.148:0/3235656493 conn(0x7fd8740630f0 msgr2=0x7fd8740c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 -- 172.21.15.148:0/3235656493 shutdown_connections 2023-10-24T02:01:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.754+0000 7fd87c664700 1 -- 172.21.15.148:0/3235656493 wait complete. 2023-10-24T02:01:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.755+0000 7fd87c664700 1 Processor -- start 2023-10-24T02:01:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.755+0000 7fd87c664700 1 -- start start 2023-10-24T02:01:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 0x7fd87414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8741543a0 0x7fd8740c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740c1850 con 0x7fd8740bfa50 2023-10-24T02:01:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740c13c0 con 0x7fd8740a84b0 2023-10-24T02:01:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87c664700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87414d970 con 0x7fd8741543a0 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47666/0 (socket says 172.21.15.148:47666) 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 -- 172.21.15.148:0/3519511611 learned_addr learned my addr 172.21.15.148:0/3519511611 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87a400700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 0x7fd87414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87ac01700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8741543a0 0x7fd8740c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 -- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8741543a0 msgr2=0x7fd8740c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8741543a0 0x7fd8740c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 -- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 msgr2=0x7fd87414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 0x7fd87414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd879bff700 1 -- 172.21.15.148:0/3519511611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864009370 con 0x7fd8740bfa50 2023-10-24T02:01:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.756+0000 7fd87a400700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 0x7fd87414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd879bff700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7fd864009130 tx=0x7fd864017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400be50 con 0x7fd8740bfa50 2023-10-24T02:01:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8740c07b0 con 0x7fd8740bfa50 2023-10-24T02:01:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740c0d70 con 0x7fd8740bfa50 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864006bf0 con 0x7fd8740bfa50 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.757+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400ba90 con 0x7fd8740bfa50 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.758+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c005120 con 0x7fd8740bfa50 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.758+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd864027460 con 0x7fd8740bfa50 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.759+0000 7fd86a7fc700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 0x7fd858061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.759+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fd86407c100 con 0x7fd8740bfa50 2023-10-24T02:01:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.759+0000 7fd87a400700 1 -- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 msgr2=0x7fd858061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.759+0000 7fd87a400700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 0x7fd858061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.763+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd86404cf60 con 0x7fd8740bfa50 2023-10-24T02:01:20.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.934+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd85c005ac0 con 0x7fd8740bfa50 2023-10-24T02:01:20.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.935+0000 7fd86a7fc700 1 -- 172.21.15.148:0/3519511611 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17995 (secure 0 0 0) 0x7fd864050580 con 0x7fd8740bfa50 2023-10-24T02:01:20.937 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:20.937 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":186,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:19.958006+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":186,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/3411131123":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/3207540675":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/596661116":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/373397057":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/4188195304":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3516697823":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6833/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6832/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/2014306629":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3656476979":"2023-10-25T01:45:29.720153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]},{"pool":22,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:20.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 msgr2=0x7fd858061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:20.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 0x7fd858061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:20.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 msgr2=0x7fd8740bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:20.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7fd864009130 tx=0x7fd864017000).stop 2023-10-24T02:01:20.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 shutdown_connections 2023-10-24T02:01:20.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8741543a0 0x7fd8740c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd85805f270 0x7fd858061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:20.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8740a84b0 0x7fd87414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 --2- 172.21.15.148:0/3519511611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740bfa50 0x7fd8740bfed0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:20.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 >> 172.21.15.148:0/3519511611 conn(0x7fd8740630f0 msgr2=0x7fd8740c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:20.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 shutdown_connections 2023-10-24T02:01:20.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:20.937+0000 7fd87c664700 1 -- 172.21.15.148:0/3519511611 wait complete. 2023-10-24T02:01:20.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T01:45:12.792045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T01:45:13.198541+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 186, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T02:01:20.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T02:01:21.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.076+0000 7f47a7ba1700 1 Processor -- start 2023-10-24T02:01:21.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.077+0000 7f47a7ba1700 1 -- start start 2023-10-24T02:01:21.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.077+0000 7f47a7ba1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f47a0098bd0 0x7f47a0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a7ba1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a7ba1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00c71d0 con 0x7f47a0154430 2023-10-24T02:01:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a7ba1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00c6a10 con 0x7f47a0098bd0 2023-10-24T02:01:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a7ba1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00c9410 con 0x7f47a00bffd0 2023-10-24T02:01:21.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f47a0098bd0 0x7f47a0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a593d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f47a0154430 0x7f47a00c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36416/0 (socket says 172.21.15.148:36416) 2023-10-24T02:01:21.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a593d700 1 -- 172.21.15.148:0/1490651921 learned_addr learned my addr 172.21.15.148:0/1490651921 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:21.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a613e700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 -- 172.21.15.148:0/1490651921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 msgr2=0x7f47a00c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:21.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a00c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 -- 172.21.15.148:0/1490651921 >> v1:172.21.15.148:6789/0 conn(0x7f47a0154430 legacy=0x7f47a00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a493b700 1 -- 172.21.15.148:0/1490651921 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755612448 0 0) 0x7f47a00c71d0 con 0x7f47a0154430 2023-10-24T02:01:21.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 -- 172.21.15.148:0/1490651921 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00c0950 con 0x7f47a0098bd0 2023-10-24T02:01:21.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a513c700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0098bd0 0x7f47a0154810 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f479c009760 tx=0x7f479c009060).ready entity=mon.0 client_cookie=e77d837ca4947713 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a493b700 1 -- 172.21.15.148:0/1490651921 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00f510 con 0x7f47a0098bd0 2023-10-24T02:01:21.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a493b700 1 -- 172.21.15.148:0/1490651921 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00f670 con 0x7f47a0098bd0 2023-10-24T02:01:21.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.078+0000 7f47a493b700 1 -- 172.21.15.148:0/1490651921 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00f9f0 con 0x7f47a0098bd0 2023-10-24T02:01:21.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1490651921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0098bd0 msgr2=0x7f47a0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0098bd0 0x7f47a0154810 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f479c009760 tx=0x7f479c009060).stop 2023-10-24T02:01:21.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1490651921 shutdown_connections 2023-10-24T02:01:21.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a00c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1490651921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0098bd0 0x7f47a0154810 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1490651921 >> 172.21.15.148:0/1490651921 conn(0x7f47a00cb070 msgr2=0x7f47a00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1490651921 shutdown_connections 2023-10-24T02:01:21.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.079+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1490651921 wait complete. 2023-10-24T02:01:21.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.080+0000 7f47a7ba1700 1 Processor -- start 2023-10-24T02:01:21.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.080+0000 7f47a7ba1700 1 -- start start 2023-10-24T02:01:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a0098bd0 0x7f47a00ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a0164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a014f8f0 con 0x7f47a0154430 2023-10-24T02:01:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00ae520 con 0x7f47a0098bd0 2023-10-24T02:01:21.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a7ba1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0151cb0 con 0x7f47a00bffd0 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47686/0 (socket says 172.21.15.148:47686) 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 -- 172.21.15.148:0/1007976656 learned_addr learned my addr 172.21.15.148:0/1007976656 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a513c700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a0164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a593d700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a0098bd0 0x7f47a00ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 msgr2=0x7f47a0164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a0164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a0098bd0 msgr2=0x7f47a00ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a0098bd0 0x7f47a00ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.081+0000 7f47a613e700 1 -- 172.21.15.148:0/1007976656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0092a0 con 0x7f47a0154430 2023-10-24T02:01:21.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f47a613e700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f4798009ec0 tx=0x7f479800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800cb70 con 0x7f47a0154430 2023-10-24T02:01:21.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800f040 con 0x7f47a0154430 2023-10-24T02:01:21.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a00ac020 con 0x7f47a0154430 2023-10-24T02:01:21.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800cee0 con 0x7f47a0154430 2023-10-24T02:01:21.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.082+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a00ac3b0 con 0x7f47a0154430 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.083+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a00ae9d0 con 0x7f47a0154430 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.084+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4798013610 con 0x7f47a0154430 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.084+0000 7f4795ffb700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 0x7f4784061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.084+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f479807ae80 con 0x7f47a0154430 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.084+0000 7f47a593d700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 msgr2=0x7f4784061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:21.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.084+0000 7f47a593d700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 0x7f4784061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:21.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.088+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f47a00ae9d0 con 0x7f47a0154430 2023-10-24T02:01:21.132 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:21.131+0000 7f8b54ddd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:01:21.173 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:21.171+0000 7f1b9b617680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:01:21.204 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:21.204+0000 7f8b54ddd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:01:21.249 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:21.247+0000 7f1b9b617680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:01:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.285+0000 7f47a593d700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 msgr2=0x7f4784061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:21.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.285+0000 7f47a593d700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 0x7f4784061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:21.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.295+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f47a00ae9d0 con 0x7f47a0154430 2023-10-24T02:01:21.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.296+0000 7f4795ffb700 1 -- 172.21.15.148:0/1007976656 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v187) v1 ==== 110+0+10 (secure 0 0 0) 0x7f47a00ae9d0 con 0x7f47a0154430 2023-10-24T02:01:21.297 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T02:01:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 msgr2=0x7f4784061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 0x7f4784061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 msgr2=0x7f47a0164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f4798009ec0 tx=0x7f479800b040).stop 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 shutdown_connections 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47a0154430 0x7f47a0164a50 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f478405f270 0x7f4784061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47a0098bd0 0x7f47a00ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 --2- 172.21.15.148:0/1007976656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47a00bffd0 0x7f47a0164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 >> 172.21.15.148:0/1007976656 conn(0x7f47a00cb070 msgr2=0x7f47a00c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 shutdown_connections 2023-10-24T02:01:21.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.298+0000 7f47a7ba1700 1 -- 172.21.15.148:0/1007976656 wait complete. 2023-10-24T02:01:21.313 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T02:01:21.393 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:21.393+0000 7f8b54ddd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:01:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.434+0000 7f82e9a95700 1 Processor -- start 2023-10-24T02:01:21.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.434+0000 7f82e9a95700 1 -- start start 2023-10-24T02:01:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.435+0000 7f82e9a95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82e40a9fa0 0x7f82e4154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.435+0000 7f82e9a95700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82e4154920 0x7f82e406b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.435+0000 7f82e9a95700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e4154dd0 con 0x7f82e40acc60 2023-10-24T02:01:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.435+0000 7f82e9a95700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4064060 con 0x7f82e4154920 2023-10-24T02:01:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e9a95700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4063bd0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82e4154920 0x7f82e406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f82e4154920 0x7f82e406b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47696/0 (socket says 172.21.15.148:47696) 2023-10-24T02:01:21.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 -- 172.21.15.148:0/2814006169 learned_addr learned my addr 172.21.15.148:0/2814006169 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e37fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f82e40acc60 0x7f82e4062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36420/0 (socket says 172.21.15.148:36420) 2023-10-24T02:01:21.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e2ffd700 1 --2- 172.21.15.148:0/2814006169 >> v2:172.21.15.150:3300/0 conn(0x7f82e40a9fa0 0x7f82e4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 -- 172.21.15.148:0/2814006169 >> v2:172.21.15.150:3300/0 conn(0x7f82e40a9fa0 msgr2=0x7f82e4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:21.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 --2- 172.21.15.148:0/2814006169 >> v2:172.21.15.150:3300/0 conn(0x7f82e40a9fa0 0x7f82e4154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 -- 172.21.15.148:0/2814006169 >> v1:172.21.15.148:6789/0 conn(0x7f82e40acc60 legacy=0x7f82e4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e27fc700 1 -- 172.21.15.148:0/2814006169 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628488702 0 0) 0x7f82d8001110 con 0x7f82e40acc60 2023-10-24T02:01:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 -- 172.21.15.148:0/2814006169 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4062d60 con 0x7f82e4154920 2023-10-24T02:01:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.436+0000 7f82e3fff700 1 --2- 172.21.15.148:0/2814006169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e4154920 0x7f82e406b380 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f82e4151fe0 tx=0x7f82dc009840).ready entity=mon.0 client_cookie=78e8ee4e2548d276 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e27fc700 1 -- 172.21.15.148:0/2814006169 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00e070 con 0x7f82e4154920 2023-10-24T02:01:21.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e27fc700 1 -- 172.21.15.148:0/2814006169 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc00ba50 con 0x7f82e4154920 2023-10-24T02:01:21.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e27fc700 1 -- 172.21.15.148:0/2814006169 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00bdd0 con 0x7f82e4154920 2023-10-24T02:01:21.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 -- 172.21.15.148:0/2814006169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e4154920 msgr2=0x7f82e406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 --2- 172.21.15.148:0/2814006169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e4154920 0x7f82e406b380 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f82e4151fe0 tx=0x7f82dc009840).stop 2023-10-24T02:01:21.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 -- 172.21.15.148:0/2814006169 shutdown_connections 2023-10-24T02:01:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 --2- 172.21.15.148:0/2814006169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e4154920 0x7f82e406b380 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 --2- 172.21.15.148:0/2814006169 >> v2:172.21.15.150:3300/0 conn(0x7f82e40a9fa0 0x7f82e4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 -- 172.21.15.148:0/2814006169 >> 172.21.15.148:0/2814006169 conn(0x7f82e40c3f60 msgr2=0x7f82e40c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 -- 172.21.15.148:0/2814006169 shutdown_connections 2023-10-24T02:01:21.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.437+0000 7f82e9a95700 1 -- 172.21.15.148:0/2814006169 wait complete. 2023-10-24T02:01:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 Processor -- start 2023-10-24T02:01:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 -- start start 2023-10-24T02:01:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 0x7f82e414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 0x7f82e4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4151100 con 0x7f82e40acc60 2023-10-24T02:01:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41504f0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.439+0000 7f82e9a95700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41507d0 con 0x7f82e4154920 2023-10-24T02:01:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 0x7f82e414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47702/0 (socket says 172.21.15.148:47702) 2023-10-24T02:01:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e2ffd700 1 -- 172.21.15.148:0/3692040127 learned_addr learned my addr 172.21.15.148:0/3692040127 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e3fff700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 0x7f82e4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 -- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 msgr2=0x7f82e4152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 0x7f82e4152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 -- 172.21.15.148:0/3692040127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 msgr2=0x7f82e4167d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 -- 172.21.15.148:0/3692040127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009ae0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e3fff700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 0x7f82e4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e2ffd700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e37fe700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 0x7f82e414fc10 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f82d800c460 tx=0x7f82d8007a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80070d0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8007230 con 0x7f82e40a9fa0 2023-10-24T02:01:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e4150ab0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80056e0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.440+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e4150100 con 0x7f82e40a9fa0 2023-10-24T02:01:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.441+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4148ad0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.442+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f82d8005a90 con 0x7f82e40a9fa0 2023-10-24T02:01:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.442+0000 7f82cb7fe700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 0x7f82d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.442+0000 7f82e2ffd700 1 -- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 msgr2=0x7f82d0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.442+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f82d80799e0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.442+0000 7f82e2ffd700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 0x7f82d0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:21.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.447+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f82d804a850 con 0x7f82e40a9fa0 2023-10-24T02:01:21.453 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:21.448+0000 7f1b9b617680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:01:21.618 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.616+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f82e4154dd0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.617+0000 7f82cb7fe700 1 -- 172.21.15.148:0/3692040127 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v187) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82e4154dd0 con 0x7f82e40a9fa0 2023-10-24T02:01:21.619 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T02:01:21.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 msgr2=0x7f82d0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:21.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 0x7f82d0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 msgr2=0x7f82e414fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 0x7f82e414fc10 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f82d800c460 tx=0x7f82d8007a10).stop 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 shutdown_connections 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82e4154920 0x7f82e4152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f82d005f270 0x7f82d0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82e40a9fa0 0x7f82e414fc10 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 --2- 172.21.15.148:0/3692040127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82e40acc60 0x7f82e4167d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 >> 172.21.15.148:0/3692040127 conn(0x7f82e40c3f60 msgr2=0x7f82e40a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 shutdown_connections 2023-10-24T02:01:21.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.619+0000 7f82e9a95700 1 -- 172.21.15.148:0/3692040127 wait complete. 2023-10-24T02:01:21.633 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T02:01:21.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.755+0000 7f0f7ef58700 1 Processor -- start 2023-10-24T02:01:21.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.755+0000 7f0f7ef58700 1 -- start start 2023-10-24T02:01:21.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ef58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f780bd860 0x7f0f78069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ef58700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f781512a0 0x7f0f78069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ef58700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f78065590 con 0x7f0f78150ec0 2023-10-24T02:01:21.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ef58700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f78069e00 con 0x7f0f781512a0 2023-10-24T02:01:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ef58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7806a870 con 0x7f0f780bd860 2023-10-24T02:01:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0f781512a0 0x7f0f78069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ccf4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0f78150ec0 0x7f0f7806a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36434/0 (socket says 172.21.15.148:36434) 2023-10-24T02:01:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7ccf4700 1 -- 172.21.15.148:0/4098468718 learned_addr learned my addr 172.21.15.148:0/4098468718 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:21.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f77fff700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f780bd860 0x7f0f78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 -- 172.21.15.148:0/4098468718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f780bd860 msgr2=0x7f0f78069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f780bd860 0x7f0f78069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 -- 172.21.15.148:0/4098468718 >> v1:172.21.15.148:6789/0 conn(0x7f0f78150ec0 legacy=0x7f0f7806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f777fe700 1 -- 172.21.15.148:0/4098468718 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989064304 0 0) 0x7f0f78065590 con 0x7f0f78150ec0 2023-10-24T02:01:21.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 -- 172.21.15.148:0/4098468718 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78065290 con 0x7f0f781512a0 2023-10-24T02:01:21.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f7d4f5700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f781512a0 0x7f0f78069910 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f0f70009e90 tx=0x7f0f70009780).ready entity=mon.0 client_cookie=ccd0842be7ec1b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f777fe700 1 -- 172.21.15.148:0/4098468718 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000e070 con 0x7f0f781512a0 2023-10-24T02:01:21.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f777fe700 1 -- 172.21.15.148:0/4098468718 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000bb20 con 0x7f0f781512a0 2023-10-24T02:01:21.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.756+0000 7f0f777fe700 1 -- 172.21.15.148:0/4098468718 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000bea0 con 0x7f0f781512a0 2023-10-24T02:01:21.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4098468718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f781512a0 msgr2=0x7f0f78069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f781512a0 0x7f0f78069910 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f0f70009e90 tx=0x7f0f70009780).stop 2023-10-24T02:01:21.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4098468718 shutdown_connections 2023-10-24T02:01:21.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f781512a0 0x7f0f78069910 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4098468718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f780bd860 0x7f0f78069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4098468718 >> 172.21.15.148:0/4098468718 conn(0x7f0f780c7d10 msgr2=0x7f0f780c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4098468718 shutdown_connections 2023-10-24T02:01:21.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.757+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4098468718 wait complete. 2023-10-24T02:01:21.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.758+0000 7f0f7ef58700 1 Processor -- start 2023-10-24T02:01:21.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.758+0000 7f0f7ef58700 1 -- start start 2023-10-24T02:01:21.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f780bd860 0x7f0f78162980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f781512a0 0x7f0f78165540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780aa490 con 0x7f0f78150ec0 2023-10-24T02:01:21.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78161f20 con 0x7f0f780bd860 2023-10-24T02:01:21.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ef58700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78165fc0 con 0x7f0f781512a0 2023-10-24T02:01:21.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47720/0 (socket says 172.21.15.148:47720) 2023-10-24T02:01:21.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f77fff700 1 -- 172.21.15.148:0/4040313372 learned_addr learned my addr 172.21.15.148:0/4040313372 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7d4f5700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f781512a0 0x7f0f78165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.759+0000 7f0f7ccf4700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f780bd860 0x7f0f78162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 -- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f781512a0 msgr2=0x7f0f78165540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f781512a0 0x7f0f78165540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 -- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f780bd860 msgr2=0x7f0f78162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f780bd860 0x7f0f78162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 -- 172.21.15.148:0/4040313372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70009a20 con 0x7f0f78150ec0 2023-10-24T02:01:21.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f77fff700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f0f6400e900 tx=0x7f0f64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:21.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64012600 con 0x7f0f78150ec0 2023-10-24T02:01:21.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f64012760 con 0x7f0f78150ec0 2023-10-24T02:01:21.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64012ae0 con 0x7f0f78150ec0 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f781662a0 con 0x7f0f78150ec0 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.760+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78162460 con 0x7f0f78150ec0 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.761+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f781627d0 con 0x7f0f78150ec0 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.761+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f0f6401b400 con 0x7f0f78150ec0 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.762+0000 7f0f74ff9700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:21.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.762+0000 7f0f7ccf4700 1 -- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 msgr2=0x7f0f5c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:21.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.762+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f0f6407aa60 con 0x7f0f78150ec0 2023-10-24T02:01:21.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.762+0000 7f0f7ccf4700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:21.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.766+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f6404b8d0 con 0x7f0f78150ec0 2023-10-24T02:01:21.819 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:21.819+0000 7f8b54ddd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:01:21.894 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:21.892+0000 7f1b9b617680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:01:21.925 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:21.925+0000 7f8b54ddd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:21.939 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.938+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f780a7090 con 0x7f0f78150ec0 2023-10-24T02:01:21.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.938+0000 7f0f74ff9700 1 -- 172.21.15.148:0/4040313372 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v187) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f64016020 con 0x7f0f78150ec0 2023-10-24T02:01:21.940 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:01:21.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 msgr2=0x7f0f5c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:21.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 msgr2=0x7f0f7814b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f0f6400e900 tx=0x7f0f64009060).stop 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 shutdown_connections 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f781512a0 0x7f0f78165540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0f5c05f270 0x7f0f5c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:21.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f780bd860 0x7f0f78162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 --2- 172.21.15.148:0/4040313372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f78150ec0 0x7f0f7814b740 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 >> 172.21.15.148:0/4040313372 conn(0x7f0f780c7d10 msgr2=0x7f0f78065a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.940+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 shutdown_connections 2023-10-24T02:01:21.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:21.941+0000 7f0f7ef58700 1 -- 172.21.15.148:0/4040313372 wait complete. 2023-10-24T02:01:21.955 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T02:01:22.007 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.005+0000 7f1b9b617680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:22.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.075+0000 7fee65a5d700 1 Processor -- start 2023-10-24T02:01:22.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.075+0000 7fee65a5d700 1 -- start start 2023-10-24T02:01:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee65a5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee65a5d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600c71d0 con 0x7fee60154430 2023-10-24T02:01:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee65a5d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600c9410 con 0x7fee600bffd0 2023-10-24T02:01:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee65a5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600c6a10 con 0x7fee60098bd0 2023-10-24T02:01:22.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fee60154430 0x7fee600c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36436/0 (socket says 172.21.15.148:36436) 2023-10-24T02:01:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5effd700 1 -- 172.21.15.148:0/806686883 learned_addr learned my addr 172.21.15.148:0/806686883 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5e7fc700 1 --2- 172.21.15.148:0/806686883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483598745 0 0) 0x7fee600c71d0 con 0x7fee60154430 2023-10-24T02:01:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee480033f0 con 0x7fee60154430 2023-10-24T02:01:22.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681348706 0 0) 0x7fee600c9410 con 0x7fee600bffd0 2023-10-24T02:01:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee600c71d0 con 0x7fee600bffd0 2023-10-24T02:01:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5e7fc700 1 -- 172.21.15.148:0/806686883 >> v1:172.21.15.150:6789/0 conn(0x7fee600bffd0 legacy=0x7fee6015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.076+0000 7fee5e7fc700 1 -- 172.21.15.148:0/806686883 >> v1:172.21.15.148:6789/0 conn(0x7fee60154430 legacy=0x7fee600c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee5e7fc700 1 -- 172.21.15.148:0/806686883 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600ca8b0 con 0x7fee60098bd0 2023-10-24T02:01:22.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee5e7fc700 1 --2- 172.21.15.148:0/806686883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60154810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fee540097c0 tx=0x7fee54009060).ready entity=mon.2 client_cookie=e0bb0a272c469ced server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400d4a0 con 0x7fee60098bd0 2023-10-24T02:01:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400d600 con 0x7fee60098bd0 2023-10-24T02:01:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee5dffb700 1 -- 172.21.15.148:0/806686883 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400d980 con 0x7fee60098bd0 2023-10-24T02:01:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.077+0000 7fee65a5d700 1 -- 172.21.15.148:0/806686883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 msgr2=0x7fee60154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.083 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 --2- 172.21.15.148:0/806686883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60154810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fee540097c0 tx=0x7fee54009060).stop 2023-10-24T02:01:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 -- 172.21.15.148:0/806686883 shutdown_connections 2023-10-24T02:01:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 --2- 172.21.15.148:0/806686883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60154810 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 -- 172.21.15.148:0/806686883 >> 172.21.15.148:0/806686883 conn(0x7fee600cb070 msgr2=0x7fee600cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 -- 172.21.15.148:0/806686883 shutdown_connections 2023-10-24T02:01:22.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.078+0000 7fee65a5d700 1 -- 172.21.15.148:0/806686883 wait complete. 2023-10-24T02:01:22.085 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:22.081+0000 7f8b54ddd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:22.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.079+0000 7fee65a5d700 1 Processor -- start 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.079+0000 7fee65a5d700 1 -- start start 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 0x7fee600c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee60164cc0 con 0x7fee60154430 2023-10-24T02:01:22.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b0b90 con 0x7fee600bffd0 2023-10-24T02:01:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee65a5d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee60165640 con 0x7fee60098bd0 2023-10-24T02:01:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 0x7fee600c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5e7fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:50488/0 (socket says 172.21.15.148:50488) 2023-10-24T02:01:22.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:35934/0 (socket says 172.21.15.148:35934) 2023-10-24T02:01:22.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 0x7fee600c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47724/0 (socket says 172.21.15.148:47724) 2023-10-24T02:01:22.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 -- 172.21.15.148:0/1349718020 learned_addr learned my addr 172.21.15.148:0/1349718020 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:22.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 -- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 msgr2=0x7fee6014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 -- 172.21.15.148:0/1349718020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 msgr2=0x7fee600c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 0x7fee600c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 -- 172.21.15.148:0/1349718020 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540092a0 con 0x7fee60098bd0 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5e7fc700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.080+0000 7fee5effd700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fee5000c490 tx=0x7fee50007d00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.081+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500070d0 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.081+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50007230 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.081+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee60159c60 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.081+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500075b0 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.081+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee60164950 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60164fa0 con 0x7fee60098bd0 2023-10-24T02:01:22.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fee500059b0 con 0x7fee60098bd0 2023-10-24T02:01:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee46ffd700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 0x7fee4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fee50079da0 con 0x7fee60098bd0 2023-10-24T02:01:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee5e7fc700 1 -- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 msgr2=0x7fee4c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:22.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.082+0000 7fee5e7fc700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 0x7fee4c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:22.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.087+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fee5004ac70 con 0x7fee60098bd0 2023-10-24T02:01:22.157 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:22.157+0000 7f8b54ddd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:01:22.169 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.168+0000 7f1b9b617680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:22.225 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:22.224+0000 7f8b54ddd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:01:22.246 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.245+0000 7f1b9b617680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:01:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.255+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee6006c6b0 con 0x7fee60098bd0 2023-10-24T02:01:22.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.256+0000 7fee46ffd700 1 -- 172.21.15.148:0/1349718020 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v187) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee50018070 con 0x7fee60098bd0 2023-10-24T02:01:22.258 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:01:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 msgr2=0x7fee4c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 0x7fee4c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 msgr2=0x7fee60165150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fee5000c490 tx=0x7fee50007d00).stop 2023-10-24T02:01:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 shutdown_connections 2023-10-24T02:01:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee60154430 0x7fee600c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60098bd0 0x7fee60165150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f270 0x7fee4c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 --2- 172.21.15.148:0/1349718020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee600bffd0 0x7fee6014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 >> 172.21.15.148:0/1349718020 conn(0x7fee600cb070 msgr2=0x7fee60063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 shutdown_connections 2023-10-24T02:01:22.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.259+0000 7fee65a5d700 1 -- 172.21.15.148:0/1349718020 wait complete. 2023-10-24T02:01:22.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:22.326 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.324+0000 7f1b9b617680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:01:22.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.395+0000 7f29be705700 1 Processor -- start 2023-10-24T02:01:22.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.395+0000 7f29be705700 1 -- start start 2023-10-24T02:01:22.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29be705700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29be705700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b806a160 con 0x7f29b8062810 2023-10-24T02:01:22.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29be705700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b80650f0 con 0x7f29b80a6d50 2023-10-24T02:01:22.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29be705700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8069550 con 0x7f29b8062bf0 2023-10-24T02:01:22.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29bd703700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f29b8062810 0x7f29b81554c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36442/0 (socket says 172.21.15.148:36442) 2023-10-24T02:01:22.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29bd703700 1 -- 172.21.15.148:0/69400654 learned_addr learned my addr 172.21.15.148:0/69400654 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:22.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29bcf02700 1 --2- 172.21.15.148:0/69400654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631488662 0 0) 0x7f29b806a160 con 0x7f29b8062810 2023-10-24T02:01:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a40033f0 con 0x7f29b8062810 2023-10-24T02:01:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.396+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411475241 0 0) 0x7f29b80650f0 con 0x7f29b80a6d50 2023-10-24T02:01:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b806a160 con 0x7f29b80a6d50 2023-10-24T02:01:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29bcf02700 1 -- 172.21.15.148:0/69400654 >> v1:172.21.15.150:6789/0 conn(0x7f29b80a6d50 legacy=0x7f29b8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29bcf02700 1 -- 172.21.15.148:0/69400654 >> v1:172.21.15.148:6789/0 conn(0x7f29b8062810 legacy=0x7f29b81554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29bcf02700 1 -- 172.21.15.148:0/69400654 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8069830 con 0x7f29b8062bf0 2023-10-24T02:01:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29bcf02700 1 --2- 172.21.15.148:0/69400654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80a6860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f29b4009790 tx=0x7f29b4009060).ready entity=mon.2 client_cookie=1f7b4e2532a32ff server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400f510 con 0x7f29b8062bf0 2023-10-24T02:01:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400f670 con 0x7f29b8062bf0 2023-10-24T02:01:22.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29affff700 1 -- 172.21.15.148:0/69400654 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400f9f0 con 0x7f29b8062bf0 2023-10-24T02:01:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29be705700 1 -- 172.21.15.148:0/69400654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 msgr2=0x7f29b80a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.397+0000 7f29be705700 1 --2- 172.21.15.148:0/69400654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80a6860 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f29b4009790 tx=0x7f29b4009060).stop 2023-10-24T02:01:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.398+0000 7f29be705700 1 -- 172.21.15.148:0/69400654 shutdown_connections 2023-10-24T02:01:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.398+0000 7f29be705700 1 --2- 172.21.15.148:0/69400654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80a6860 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.398+0000 7f29be705700 1 -- 172.21.15.148:0/69400654 >> 172.21.15.148:0/69400654 conn(0x7f29b80c7ad0 msgr2=0x7f29b80c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.398+0000 7f29be705700 1 -- 172.21.15.148:0/69400654 shutdown_connections 2023-10-24T02:01:22.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.398+0000 7f29be705700 1 -- 172.21.15.148:0/69400654 wait complete. 2023-10-24T02:01:22.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.399+0000 7f29be705700 1 Processor -- start 2023-10-24T02:01:22.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.399+0000 7f29be705700 1 -- start start 2023-10-24T02:01:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80beb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80a6d50 0x7f29b80bf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80bf550 con 0x7f29b8062810 2023-10-24T02:01:22.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80ad3d0 con 0x7f29b80a6d50 2023-10-24T02:01:22.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80ac7c0 con 0x7f29b8062bf0 2023-10-24T02:01:22.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47740/0 (socket says 172.21.15.148:47740) 2023-10-24T02:01:22.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bcf02700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 -- 172.21.15.148:0/1510425835 learned_addr learned my addr 172.21.15.148:0/1510425835 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:22.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bdf04700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80a6d50 0x7f29b80bf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 msgr2=0x7f29b80beb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80beb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80a6d50 msgr2=0x7f29b80bf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80a6d50 0x7f29b80bf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 -- 172.21.15.148:0/1510425835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40092a0 con 0x7f29b8062810 2023-10-24T02:01:22.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bcf02700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:22.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29bd703700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f29a800c4c0 tx=0x7f29a8007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a80070d0 con 0x7f29b8062810 2023-10-24T02:01:22.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a8007230 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b80acaa0 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a80075b0 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.400+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b80ad060 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.401+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b8047480 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.402+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f29a80059b0 con 0x7f29b8062810 2023-10-24T02:01:22.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.402+0000 7f29ad7fa700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 0x7f299c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.402+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f29a8079d80 con 0x7f29b8062810 2023-10-24T02:01:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.402+0000 7f29bcf02700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 msgr2=0x7f299c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:22.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.402+0000 7f29bcf02700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 0x7f299c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:22.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.406+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29a804ac50 con 0x7f29b8062810 2023-10-24T02:01:22.485 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:22.485+0000 7f8b54ddd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:01:22.598 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.597+0000 7f1b9b617680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:01:22.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.604+0000 7f29bcf02700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 msgr2=0x7f299c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:22.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.604+0000 7f29bcf02700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 0x7f299c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.619+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b80c8900 con 0x7f29b8062810 2023-10-24T02:01:22.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.619+0000 7f29ad7fa700 1 -- 172.21.15.148:0/1510425835 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f29a8018070 con 0x7f29b8062810 2023-10-24T02:01:22.620 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:22.620 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T02:01:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.621+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 msgr2=0x7f299c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:22.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.621+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 0x7f299c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.621+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 msgr2=0x7f29b8167c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.621+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f29a800c4c0 tx=0x7f29a8007d00).stop 2023-10-24T02:01:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 shutdown_connections 2023-10-24T02:01:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f270 0x7f299c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29b80a6d50 0x7f29b80bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29b8062810 0x7f29b8167c90 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 --2- 172.21.15.148:0/1510425835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29b8062bf0 0x7f29b80beb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 >> 172.21.15.148:0/1510425835 conn(0x7f29b80c7ad0 msgr2=0x7f29b8157880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 shutdown_connections 2023-10-24T02:01:22.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.622+0000 7f29be705700 1 -- 172.21.15.148:0/1510425835 wait complete. 2023-10-24T02:01:22.625 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T02:01:22.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:22.669 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:22.668+0000 7f8b54ddd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:22.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.755+0000 7fed97718700 1 Processor -- start 2023-10-24T02:01:22.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.755+0000 7fed97718700 1 -- start start 2023-10-24T02:01:22.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed90157df0 0x7fed901581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed90062650 0x7fed90062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed900bc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed90063d00 con 0x7fed90062650 2023-10-24T02:01:22.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed90137790 con 0x7fed90157df0 2023-10-24T02:01:22.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed97718700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900630f0 con 0x7fed900bc370 2023-10-24T02:01:22.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed90062650 0x7fed90062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fed90062650 0x7fed90062ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47744/0 (socket says 172.21.15.148:47744) 2023-10-24T02:01:22.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 -- 172.21.15.148:0/200899277 learned_addr learned my addr 172.21.15.148:0/200899277 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:22.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed954b4700 1 --2- 172.21.15.148:0/200899277 >> v2:172.21.15.150:3300/0 conn(0x7fed90157df0 0x7fed901581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed95cb5700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed900bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 -- 172.21.15.148:0/200899277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 msgr2=0x7fed900bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:22.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed900bc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 -- 172.21.15.148:0/200899277 >> v2:172.21.15.150:3300/0 conn(0x7fed90157df0 msgr2=0x7fed901581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:22.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 --2- 172.21.15.148:0/200899277 >> v2:172.21.15.150:3300/0 conn(0x7fed90157df0 0x7fed901581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 -- 172.21.15.148:0/200899277 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900633d0 con 0x7fed90062650 2023-10-24T02:01:22.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed94cb3700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90062650 0x7fed90062ad0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fed90068060 tx=0x7fed8c0090f0).ready entity=mon.0 client_cookie=2c6b8ab45f11268a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed87fff700 1 -- 172.21.15.148:0/200899277 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00f510 con 0x7fed90062650 2023-10-24T02:01:22.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed87fff700 1 -- 172.21.15.148:0/200899277 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00f670 con 0x7fed90062650 2023-10-24T02:01:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.756+0000 7fed87fff700 1 -- 172.21.15.148:0/200899277 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00fa10 con 0x7fed90062650 2023-10-24T02:01:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 -- 172.21.15.148:0/200899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90062650 msgr2=0x7fed90062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90062650 0x7fed90062ad0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fed90068060 tx=0x7fed8c0090f0).stop 2023-10-24T02:01:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 -- 172.21.15.148:0/200899277 shutdown_connections 2023-10-24T02:01:22.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed900bc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 --2- 172.21.15.148:0/200899277 >> v2:172.21.15.150:3300/0 conn(0x7fed90157df0 0x7fed901581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 --2- 172.21.15.148:0/200899277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90062650 0x7fed90062ad0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 -- 172.21.15.148:0/200899277 >> 172.21.15.148:0/200899277 conn(0x7fed900c7ee0 msgr2=0x7fed900c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 -- 172.21.15.148:0/200899277 shutdown_connections 2023-10-24T02:01:22.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.757+0000 7fed97718700 1 -- 172.21.15.148:0/200899277 wait complete. 2023-10-24T02:01:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.758+0000 7fed97718700 1 Processor -- start 2023-10-24T02:01:22.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.758+0000 7fed97718700 1 -- start start 2023-10-24T02:01:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed90062650 0x7fed9013b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed9013a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9013c500 con 0x7fed90157df0 2023-10-24T02:01:22.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed900a8910 con 0x7fed90062650 2023-10-24T02:01:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed97718700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9013c220 con 0x7fed900bc370 2023-10-24T02:01:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed95cb5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed95cb5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47752/0 (socket says 172.21.15.148:47752) 2023-10-24T02:01:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.759+0000 7fed95cb5700 1 -- 172.21.15.148:0/366637539 learned_addr learned my addr 172.21.15.148:0/366637539 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:22.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed954b4700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed90062650 0x7fed9013b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed94cb3700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed9013a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 -- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 msgr2=0x7fed9013a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed9013a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 -- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed90062650 msgr2=0x7fed9013b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed90062650 0x7fed9013b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 -- 172.21.15.148:0/366637539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c009370 con 0x7fed90157df0 2023-10-24T02:01:22.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed95cb5700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fed88009e90 tx=0x7fed8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:22.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800caa0 con 0x7fed90157df0 2023-10-24T02:01:22.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800f040 con 0x7fed90157df0 2023-10-24T02:01:22.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800ce10 con 0x7fed90157df0 2023-10-24T02:01:22.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900a82c0 con 0x7fed90157df0 2023-10-24T02:01:22.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.760+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed90137940 con 0x7fed90157df0 2023-10-24T02:01:22.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.761+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900a8120 con 0x7fed90157df0 2023-10-24T02:01:22.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.762+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fed88013610 con 0x7fed90157df0 2023-10-24T02:01:22.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.762+0000 7fed857fa700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 0x7fed74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:22.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.762+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7fed8807add0 con 0x7fed90157df0 2023-10-24T02:01:22.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.762+0000 7fed954b4700 1 -- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 msgr2=0x7fed74061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:22.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.762+0000 7fed954b4700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 0x7fed74061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:22.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.766+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed900a8120 con 0x7fed90157df0 2023-10-24T02:01:22.794 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:22.794+0000 7f1b9b617680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:22.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.939+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed900a8120 con 0x7fed90157df0 2023-10-24T02:01:22.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.940+0000 7fed857fa700 1 -- 172.21.15.148:0/366637539 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+17969 (secure 0 0 0) 0x7fed900a8120 con 0x7fed90157df0 2023-10-24T02:01:22.942 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:22.942 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":187,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:20.965073+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":187,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/3411131123":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/3207540675":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/596661116":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/373397057":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/4188195304":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3516697823":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6833/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6832/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/2014306629":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3656476979":"2023-10-25T01:45:29.720153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:22.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 msgr2=0x7fed74061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 0x7fed74061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 msgr2=0x7fed90135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fed88009e90 tx=0x7fed8800b040).stop 2023-10-24T02:01:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 shutdown_connections 2023-10-24T02:01:22.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fed90157df0 0x7fed90135940 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fed7405f270 0x7fed74061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed90062650 0x7fed9013b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 --2- 172.21.15.148:0/366637539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed900bc370 0x7fed9013a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 >> 172.21.15.148:0/366637539 conn(0x7fed900c7ee0 msgr2=0x7fed900a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:22.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 shutdown_connections 2023-10-24T02:01:22.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:22.943+0000 7fed97718700 1 -- 172.21.15.148:0/366637539 wait complete. 2023-10-24T02:01:22.956 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T02:01:22.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:23.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.074+0000 7f20edf21700 1 Processor -- start 2023-10-24T02:01:23.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.074+0000 7f20edf21700 1 -- start start 2023-10-24T02:01:23.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20edf21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 0x7f20e815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20edf21700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80c4fe0 con 0x7f20e813a840 2023-10-24T02:01:23.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20edf21700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80c46f0 con 0x7f20e813ac20 2023-10-24T02:01:23.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20edf21700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e806a5a0 con 0x7f20e8065cd0 2023-10-24T02:01:23.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e77fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f20e813a840 0x7f20e8069d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:36454/0 (socket says 172.21.15.148:36454) 2023-10-24T02:01:23.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e77fe700 1 -- 172.21.15.148:0/2595135457 learned_addr learned my addr 172.21.15.148:0/2595135457 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:23.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e7fff700 1 --2- 172.21.15.148:0/2595135457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 0x7f20e815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327422240 0 0) 0x7f20e80c4fe0 con 0x7f20e813a840 2023-10-24T02:01:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d40033f0 con 0x7f20e813a840 2023-10-24T02:01:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755268111 0 0) 0x7f20e80c46f0 con 0x7f20e813ac20 2023-10-24T02:01:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e80c4fe0 con 0x7f20e813ac20 2023-10-24T02:01:23.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e7fff700 1 -- 172.21.15.148:0/2595135457 >> v1:172.21.15.150:6789/0 conn(0x7f20e813ac20 legacy=0x7f20e80655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e7fff700 1 -- 172.21.15.148:0/2595135457 >> v1:172.21.15.148:6789/0 conn(0x7f20e813a840 legacy=0x7f20e8069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e7fff700 1 -- 172.21.15.148:0/2595135457 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e80c4990 con 0x7f20e8065cd0 2023-10-24T02:01:23.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.075+0000 7f20e7fff700 1 --2- 172.21.15.148:0/2595135457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 0x7f20e815bc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f20e0009790 tx=0x7f20e0009060).ready entity=mon.2 client_cookie=e064db87f98183f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f510 con 0x7f20e8065cd0 2023-10-24T02:01:23.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e000f670 con 0x7f20e8065cd0 2023-10-24T02:01:23.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20e67fc700 1 -- 172.21.15.148:0/2595135457 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e000f9f0 con 0x7f20e8065cd0 2023-10-24T02:01:23.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 -- 172.21.15.148:0/2595135457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 msgr2=0x7f20e815bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 --2- 172.21.15.148:0/2595135457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 0x7f20e815bc40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f20e0009790 tx=0x7f20e0009060).stop 2023-10-24T02:01:23.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 -- 172.21.15.148:0/2595135457 shutdown_connections 2023-10-24T02:01:23.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 --2- 172.21.15.148:0/2595135457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e8065cd0 0x7f20e815bc40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 -- 172.21.15.148:0/2595135457 >> 172.21.15.148:0/2595135457 conn(0x7f20e8063120 msgr2=0x7f20e80c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 -- 172.21.15.148:0/2595135457 shutdown_connections 2023-10-24T02:01:23.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.076+0000 7f20edf21700 1 -- 172.21.15.148:0/2595135457 wait complete. 2023-10-24T02:01:23.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.077+0000 7f20edf21700 1 Processor -- start 2023-10-24T02:01:23.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.077+0000 7f20edf21700 1 -- start start 2023-10-24T02:01:23.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 0x7f20e814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 0x7f20e80644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8151140 con 0x7f20e8065cd0 2023-10-24T02:01:23.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e81519a0 con 0x7f20e813a840 2023-10-24T02:01:23.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20edf21700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80ac820 con 0x7f20e813ac20 2023-10-24T02:01:23.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47762/0 (socket says 172.21.15.148:47762) 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20e77fe700 1 -- 172.21.15.148:0/174799211 learned_addr learned my addr 172.21.15.148:0/174799211 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20e7fff700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 0x7f20e80644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.078+0000 7f20e6ffd700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 0x7f20e814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 msgr2=0x7f20e80644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 0x7f20e80644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 msgr2=0x7f20e814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 0x7f20e814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 -- 172.21.15.148:0/174799211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00092a0 con 0x7f20e8065cd0 2023-10-24T02:01:23.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e7fff700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 0x7f20e80644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:23.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e6ffd700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 0x7f20e814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:23.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20e77fe700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f20d800c8e0 tx=0x7f20d80016e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8005d30 con 0x7f20e8065cd0 2023-10-24T02:01:23.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8005e90 con 0x7f20e8065cd0 2023-10-24T02:01:23.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e8151350 con 0x7f20e8065cd0 2023-10-24T02:01:23.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8007320 con 0x7f20e8065cd0 2023-10-24T02:01:23.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.079+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e80a7b60 con 0x7f20e8065cd0 2023-10-24T02:01:23.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.080+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e806c6b0 con 0x7f20e8065cd0 2023-10-24T02:01:23.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.081+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f20d80076d0 con 0x7f20e8065cd0 2023-10-24T02:01:23.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.081+0000 7f20df7fe700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 0x7f20c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.081+0000 7f20e6ffd700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 msgr2=0x7f20c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:23.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.081+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f20d807a5a0 con 0x7f20e8065cd0 2023-10-24T02:01:23.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.081+0000 7f20e6ffd700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 0x7f20c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:23.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.085+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f20d804b410 con 0x7f20e8065cd0 2023-10-24T02:01:23.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.282+0000 7f20e6ffd700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 msgr2=0x7f20c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:23.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.282+0000 7f20e6ffd700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 0x7f20c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:23.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.296+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e8063f70 con 0x7f20e8065cd0 2023-10-24T02:01:23.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.296+0000 7f20df7fe700 1 -- 172.21.15.148:0/174799211 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f20d804ea30 con 0x7f20e8065cd0 2023-10-24T02:01:23.297 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:23.297 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T02:01:23.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.298+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 msgr2=0x7f20c8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.298+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 0x7f20c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.298+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 msgr2=0x7f20e80a91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.298+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7f20d800c8e0 tx=0x7f20d80016e0).stop 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 shutdown_connections 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20e813ac20 0x7f20e80644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8065cd0 0x7f20e80a91c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f20c805f270 0x7f20c8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 --2- 172.21.15.148:0/174799211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20e813a840 0x7f20e814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 >> 172.21.15.148:0/174799211 conn(0x7f20e8063120 msgr2=0x7f20e81505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 shutdown_connections 2023-10-24T02:01:23.301 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.299+0000 7f20edf21700 1 -- 172.21.15.148:0/174799211 wait complete. 2023-10-24T02:01:23.302 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T02:01:23.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:23.324 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.323+0000 7f8b54ddd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:01:23.392 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.392+0000 7f8b54ddd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:01:23.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.434+0000 7f2928c2b700 1 Processor -- start 2023-10-24T02:01:23.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.434+0000 7f2928c2b700 1 -- start start 2023-10-24T02:01:23.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.435+0000 7f2928c2b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29240aa010 0x7f29240c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.435+0000 7f2928c2b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240aa820 con 0x7f29240c6710 2023-10-24T02:01:23.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.435+0000 7f2928c2b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240c0960 con 0x7f29240aa3f0 2023-10-24T02:01:23.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.435+0000 7f2928c2b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29240c0c40 con 0x7f29240aa010 2023-10-24T02:01:23.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.435+0000 7f292259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29240aa010 0x7f29240c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29240aa010 0x7f29240c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48966/0 (socket says 172.21.15.148:48966) 2023-10-24T02:01:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 -- 172.21.15.148:0/1613705656 learned_addr learned my addr 172.21.15.148:0/1613705656 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f2921d9b700 1 --1- 172.21.15.148:0/1613705656 >> v1:172.21.15.148:6789/0 conn(0x7f29240c6710 0x7f2924158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48722/0 (socket says 172.21.15.148:48722) 2023-10-24T02:01:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 -- 172.21.15.148:0/1613705656 >> v1:172.21.15.150:6789/0 conn(0x7f29240aa3f0 legacy=0x7f2924069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 -- 172.21.15.148:0/1613705656 >> v1:172.21.15.148:6789/0 conn(0x7f29240c6710 legacy=0x7f2924158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292159a700 1 -- 172.21.15.148:0/1613705656 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077514010 0 0) 0x7f29240aa820 con 0x7f29240c6710 2023-10-24T02:01:23.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 -- 172.21.15.148:0/1613705656 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240c0f20 con 0x7f29240aa010 2023-10-24T02:01:23.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292259c700 1 --2- 172.21.15.148:0/1613705656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240c1a00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f2914006fd0 tx=0x7f29140090f0).ready entity=mon.0 client_cookie=995e38f88c660a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292159a700 1 -- 172.21.15.148:0/1613705656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400b600 con 0x7f29240aa010 2023-10-24T02:01:23.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292159a700 1 -- 172.21.15.148:0/1613705656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400b760 con 0x7f29240aa010 2023-10-24T02:01:23.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.436+0000 7f292159a700 1 -- 172.21.15.148:0/1613705656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400bae0 con 0x7f29240aa010 2023-10-24T02:01:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 -- 172.21.15.148:0/1613705656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 msgr2=0x7f29240c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 --2- 172.21.15.148:0/1613705656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240c1a00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7f2914006fd0 tx=0x7f29140090f0).stop 2023-10-24T02:01:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 -- 172.21.15.148:0/1613705656 shutdown_connections 2023-10-24T02:01:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 --2- 172.21.15.148:0/1613705656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240c1a00 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 -- 172.21.15.148:0/1613705656 >> 172.21.15.148:0/1613705656 conn(0x7f29240caf40 msgr2=0x7f29240cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 -- 172.21.15.148:0/1613705656 shutdown_connections 2023-10-24T02:01:23.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.437+0000 7f2928c2b700 1 -- 172.21.15.148:0/1613705656 wait complete. 2023-10-24T02:01:23.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.438+0000 7f2928c2b700 1 Processor -- start 2023-10-24T02:01:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.438+0000 7f2928c2b700 1 -- start start 2023-10-24T02:01:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29240aa3f0 0x7f292414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29240c6710 0x7f29240ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240b0e40 con 0x7f29240aa010 2023-10-24T02:01:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240b0230 con 0x7f29240c6710 2023-10-24T02:01:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240b0510 con 0x7f29240aa3f0 2023-10-24T02:01:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48976/0 (socket says 172.21.15.148:48976) 2023-10-24T02:01:23.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 -- 172.21.15.148:0/3952637356 learned_addr learned my addr 172.21.15.148:0/3952637356 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2922d9d700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29240c6710 0x7f29240ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2921d9b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29240aa3f0 0x7f292414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29240aa3f0 msgr2=0x7f292414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29240aa3f0 0x7f292414fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29240c6710 msgr2=0x7f29240ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29240c6710 0x7f29240ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 -- 172.21.15.148:0/3952637356 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914009370 con 0x7f29240aa010 2023-10-24T02:01:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f292259c700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f2924084230 tx=0x7f2914017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400b8d0 con 0x7f29240aa010 2023-10-24T02:01:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400ba30 con 0x7f29240aa010 2023-10-24T02:01:23.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.439+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29240b07f0 con 0x7f29240aa010 2023-10-24T02:01:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.440+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291401b660 con 0x7f29240aa010 2023-10-24T02:01:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.440+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2924155980 con 0x7f29240aa010 2023-10-24T02:01:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292406c6b0 con 0x7f29240aa010 2023-10-24T02:01:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f291401ba10 con 0x7f29240aa010 2023-10-24T02:01:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f29127fc700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 0x7f2904061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f2921d9b700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 msgr2=0x7f2904061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f291407c030 con 0x7f29240aa010 2023-10-24T02:01:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.441+0000 7f2921d9b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 0x7f2904061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.445+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f291404cf00 con 0x7f29240aa010 2023-10-24T02:01:23.469 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.468+0000 7f8b54ddd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:01:23.488 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.487+0000 7f1b9b617680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:01:23.560 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.559+0000 7f1b9b617680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:01:23.615 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.615+0000 7f8b54ddd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:01:23.638 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.638+0000 7f1b9b617680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:01:23.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.642+0000 7f2921d9b700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 msgr2=0x7f2904061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:23.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.642+0000 7f2921d9b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 0x7f2904061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:23.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.656+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29240adef0 con 0x7f29240aa010 2023-10-24T02:01:23.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.656+0000 7f29127fc700 1 -- 172.21.15.148:0/3952637356 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f291401f020 con 0x7f29240aa010 2023-10-24T02:01:23.657 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:23.657 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T01:45:14.225272+0000","modified":"2023-10-24T01:45:16.237571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9132},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9132":{"gid":9132,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/1998013081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1998013081},{"type":"v1","addr":"172.21.15.150:6836","nonce":1998013081}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-24T02:01:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 msgr2=0x7f2904061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 0x7f2904061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 msgr2=0x7f29240af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7f2924084230 tx=0x7f2914017000).stop 2023-10-24T02:01:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 shutdown_connections 2023-10-24T02:01:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f290405f270 0x7f2904061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29240c6710 0x7f29240ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29240aa010 0x7f29240af850 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 --2- 172.21.15.148:0/3952637356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29240aa3f0 0x7f292414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 >> 172.21.15.148:0/3952637356 conn(0x7f29240caf40 msgr2=0x7f2924152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 shutdown_connections 2023-10-24T02:01:23.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.658+0000 7f2928c2b700 1 -- 172.21.15.148:0/3952637356 wait complete. 2023-10-24T02:01:23.662 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 62 2023-10-24T02:01:23.671 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:23.686 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.685+0000 7f8b54ddd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:01:23.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.788+0000 7f4d6d4b5700 1 Processor -- start 2023-10-24T02:01:23.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.788+0000 7f4d6d4b5700 1 -- start start 2023-10-24T02:01:23.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6d4b5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d68154400 0x7f4d680c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6d4b5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680c7df0 con 0x7f4d680a59a0 2023-10-24T02:01:23.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6d4b5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680c71e0 con 0x7f4d68065110 2023-10-24T02:01:23.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6d4b5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680655c0 con 0x7f4d68154400 2023-10-24T02:01:23.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d67fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4d68154400 0x7f4d680c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6ccb4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4d680a59a0 0x7f4d680be560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48724/0 (socket says 172.21.15.148:48724) 2023-10-24T02:01:23.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d6ccb4700 1 -- 172.21.15.148:0/1990599365 learned_addr learned my addr 172.21.15.148:0/1990599365 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:23.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d67fff700 1 -- 172.21.15.148:0/1990599365 >> v1:172.21.15.150:6789/0 conn(0x7f4d68065110 legacy=0x7f4d680c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d67fff700 1 -- 172.21.15.148:0/1990599365 >> v1:172.21.15.148:6789/0 conn(0x7f4d680a59a0 legacy=0x7f4d680be560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d67fff700 1 -- 172.21.15.148:0/1990599365 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680c74c0 con 0x7f4d68154400 2023-10-24T02:01:23.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.789+0000 7f4d66ffd700 1 -- 172.21.15.148:0/1990599365 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562634553 0 0) 0x7f4d680c7df0 con 0x7f4d680a59a0 2023-10-24T02:01:23.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d67fff700 1 --2- 172.21.15.148:0/1990599365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68154400 0x7f4d680c6b50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f4d5c009760 tx=0x7f4d5c009060).ready entity=mon.0 client_cookie=1edffff20cb974ec server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d66ffd700 1 -- 172.21.15.148:0/1990599365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00b580 con 0x7f4d68154400 2023-10-24T02:01:23.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d66ffd700 1 -- 172.21.15.148:0/1990599365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00b6e0 con 0x7f4d68154400 2023-10-24T02:01:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d66ffd700 1 -- 172.21.15.148:0/1990599365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00ba60 con 0x7f4d68154400 2023-10-24T02:01:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/1990599365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68154400 msgr2=0x7f4d680c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/1990599365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68154400 0x7f4d680c6b50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f4d5c009760 tx=0x7f4d5c009060).stop 2023-10-24T02:01:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/1990599365 shutdown_connections 2023-10-24T02:01:23.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/1990599365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d68154400 0x7f4d680c6b50 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/1990599365 >> 172.21.15.148:0/1990599365 conn(0x7f4d680922e0 msgr2=0x7f4d68062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/1990599365 shutdown_connections 2023-10-24T02:01:23.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.790+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/1990599365 wait complete. 2023-10-24T02:01:23.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.791+0000 7f4d6d4b5700 1 Processor -- start 2023-10-24T02:01:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 -- start start 2023-10-24T02:01:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 0x7f4d680ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68154400 0x7f4d680ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6814f8a0 con 0x7f4d680a59a0 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680ab740 con 0x7f4d68154400 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d6d4b5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680adb70 con 0x7f4d68065110 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.792+0000 7f4d677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 0x7f4d680ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49000/0 (socket says 172.21.15.148:49000) 2023-10-24T02:01:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d6ccb4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68154400 0x7f4d680ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 -- 172.21.15.148:0/516244353 learned_addr learned my addr 172.21.15.148:0/516244353 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 0x7f4d680ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:37438/0 (socket says 172.21.15.148:37438) 2023-10-24T02:01:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 -- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 msgr2=0x7f4d680ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 0x7f4d680ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 -- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68154400 msgr2=0x7f4d680ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68154400 0x7f4d680ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 -- 172.21.15.148:0/516244353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0092a0 con 0x7f4d680a59a0 2023-10-24T02:01:23.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d677fe700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f4d5800c4c0 tx=0x7f4d58007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:23.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800ce70 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58001e90 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d680ade10 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58007250 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.793+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680ae3d0 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.794+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680aebd0 con 0x7f4d680a59a0 2023-10-24T02:01:23.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.795+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4d580066a0 con 0x7f4d680a59a0 2023-10-24T02:01:23.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.795+0000 7f4d4ffff700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 0x7f4d54061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:23.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.795+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f4d58079f00 con 0x7f4d680a59a0 2023-10-24T02:01:23.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.795+0000 7f4d67fff700 1 -- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 msgr2=0x7f4d54061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:23.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.795+0000 7f4d67fff700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 0x7f4d54061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:23.804 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.800+0000 7f8b54ddd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:01:23.804 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.798+0000 7f1b9b617680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:01:23.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.800+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4d680aebd0 con 0x7f4d680a59a0 2023-10-24T02:01:23.873 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.873+0000 7f1b9b617680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:01:23.911 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:23.911+0000 7f8b54ddd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:23.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.971+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d680aebd0 con 0x7f4d680a59a0 2023-10-24T02:01:23.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.972+0000 7f4d4ffff700 1 -- 172.21.15.148:0/516244353 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+17969 (secure 0 0 0) 0x7f4d680aebd0 con 0x7f4d680a59a0 2023-10-24T02:01:23.973 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:23.973 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":187,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:20.965073+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-24T01:45:12.792045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-24T01:45:13.198541+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":187,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]},{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.28","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:0/3411131123":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/3207540675":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/596661116":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/373397057":"2023-10-25T01:56:21.242146+0000","172.21.15.150:0/4188195304":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3516697823":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6833/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:6832/87479":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/2014306629":"2023-10-25T01:45:29.720153+0000","172.21.15.150:0/3656476979":"2023-10-25T01:45:29.720153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:23.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.974+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 msgr2=0x7f4d54061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:23.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.974+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 0x7f4d54061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.974+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 msgr2=0x7f4d680aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:23.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.974+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 rx=0x7f4d5800c4c0 tx=0x7f4d58007e00).stop 2023-10-24T02:01:23.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 shutdown_connections 2023-10-24T02:01:23.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4d5405f270 0x7f4d54061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:23.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d68154400 0x7f4d680ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d68065110 0x7f4d680ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 --2- 172.21.15.148:0/516244353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d680a59a0 0x7f4d680aad60 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:23.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 >> 172.21.15.148:0/516244353 conn(0x7f4d680922e0 msgr2=0x7f4d681501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:23.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 shutdown_connections 2023-10-24T02:01:23.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:23.975+0000 7f4d6d4b5700 1 -- 172.21.15.148:0/516244353 wait complete. 2023-10-24T02:01:23.988 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T02:01:23.994 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:23.994+0000 7f1b9b617680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:01:24.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.106+0000 7f22c1577700 1 Processor -- start 2023-10-24T02:01:24.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.106+0000 7f22c1577700 1 -- start start 2023-10-24T02:01:24.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc13a970 0x7f22bc0c4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22bc067660 0x7f22bc0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22bc069270 0x7f22bc069720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc066670 con 0x7f22bc069270 2023-10-24T02:01:24.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc069c10 con 0x7f22bc067660 2023-10-24T02:01:24.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c1577700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0c34b0 con 0x7f22bc13a970 2023-10-24T02:01:24.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22bc069270 0x7f22bc069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22bc069270 0x7f22bc069720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49006/0 (socket says 172.21.15.148:49006) 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 -- 172.21.15.148:0/2031662831 learned_addr learned my addr 172.21.15.148:0/2031662831 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22bbfff700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc13a970 0x7f22bc0c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22bb7fe700 1 --2- 172.21.15.148:0/2031662831 >> v2:172.21.15.150:3300/0 conn(0x7f22bc067660 0x7f22bc0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 -- 172.21.15.148:0/2031662831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc13a970 msgr2=0x7f22bc0c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc13a970 0x7f22bc0c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 -- 172.21.15.148:0/2031662831 >> v2:172.21.15.150:3300/0 conn(0x7f22bc067660 msgr2=0x7f22bc0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:24.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 --2- 172.21.15.148:0/2031662831 >> v2:172.21.15.150:3300/0 conn(0x7f22bc067660 0x7f22bc0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 -- 172.21.15.148:0/2031662831 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0671d0 con 0x7f22bc069270 2023-10-24T02:01:24.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.107+0000 7f22c0d76700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc069270 0x7f22bc069720 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f22bc0c5650 tx=0x7f22b400ba50).ready entity=mon.0 client_cookie=cd4fffd6c90e1a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:24.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22baffd700 1 -- 172.21.15.148:0/2031662831 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4010070 con 0x7f22bc069270 2023-10-24T02:01:24.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22baffd700 1 -- 172.21.15.148:0/2031662831 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400dd30 con 0x7f22bc069270 2023-10-24T02:01:24.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22baffd700 1 -- 172.21.15.148:0/2031662831 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400dea0 con 0x7f22bc069270 2023-10-24T02:01:24.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 -- 172.21.15.148:0/2031662831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc069270 msgr2=0x7f22bc069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:24.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc069270 0x7f22bc069720 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f22bc0c5650 tx=0x7f22b400ba50).stop 2023-10-24T02:01:24.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 -- 172.21.15.148:0/2031662831 shutdown_connections 2023-10-24T02:01:24.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc069270 0x7f22bc069720 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 --2- 172.21.15.148:0/2031662831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc13a970 0x7f22bc0c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 --2- 172.21.15.148:0/2031662831 >> v2:172.21.15.150:3300/0 conn(0x7f22bc067660 0x7f22bc0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 -- 172.21.15.148:0/2031662831 >> 172.21.15.148:0/2031662831 conn(0x7f22bc0c7ba0 msgr2=0x7f22bc0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:24.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 -- 172.21.15.148:0/2031662831 shutdown_connections 2023-10-24T02:01:24.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.108+0000 7f22c1577700 1 -- 172.21.15.148:0/2031662831 wait complete. 2023-10-24T02:01:24.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.109+0000 7f22c1577700 1 Processor -- start 2023-10-24T02:01:24.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.109+0000 7f22c1577700 1 -- start start 2023-10-24T02:01:24.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc067660 0x7f22bc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc069270 0x7f22bc137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0a8110 con 0x7f22bc13a970 2023-10-24T02:01:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0a8f00 con 0x7f22bc067660 2023-10-24T02:01:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c1577700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0aa640 con 0x7f22bc069270 2023-10-24T02:01:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c0d76700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c0d76700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49008/0 (socket says 172.21.15.148:49008) 2023-10-24T02:01:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22c0d76700 1 -- 172.21.15.148:0/1498449233 learned_addr learned my addr 172.21.15.148:0/1498449233 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22bbfff700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc067660 0x7f22bc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.110+0000 7f22bb7fe700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc069270 0x7f22bc137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 -- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc069270 msgr2=0x7f22bc137870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:24.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc069270 0x7f22bc137870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 -- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc067660 msgr2=0x7f22bc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:24.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc067660 0x7f22bc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:24.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 -- 172.21.15.148:0/1498449233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b400bcf0 con 0x7f22bc13a970 2023-10-24T02:01:24.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c0d76700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f22b400d760 tx=0x7f22b400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:24.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400b580 con 0x7f22bc13a970 2023-10-24T02:01:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400dea0 con 0x7f22bc13a970 2023-10-24T02:01:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc0a82f0 con 0x7f22bc13a970 2023-10-24T02:01:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4015630 con 0x7f22bc13a970 2023-10-24T02:01:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.111+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc0a88b0 con 0x7f22bc13a970 2023-10-24T02:01:24.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.112+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc0a9090 con 0x7f22bc13a970 2023-10-24T02:01:24.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.112+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 86) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f22b40159a0 con 0x7f22bc13a970 2023-10-24T02:01:24.122 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:24.112+0000 7f1b9b617680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.113+0000 7f22a3fff700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 0x7f22a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.113+0000 7f22bbfff700 1 -- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 msgr2=0x7f22a8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:24.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.113+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6754+0+0 (secure 0 0 0) 0x7f22b407e2f0 con 0x7f22bc13a970 2023-10-24T02:01:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.113+0000 7f22bbfff700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 0x7f22a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:24.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.117+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f22b404f1c0 con 0x7f22bc13a970 2023-10-24T02:01:24.203 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.203+0000 7f8b54ddd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:01:24.274 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.274+0000 7f8b54ddd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:01:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.297+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 87) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f22b407bcc0 con 0x7f22bc13a970 2023-10-24T02:01:24.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.298+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 msgr2=0x7f22a8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:24.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.298+0000 7f22a3fff700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 0x7f22a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:24.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:24.336+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f22bc047480 con 0x7f22bc13a970 2023-10-24T02:01:24.356 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8ad2576700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.357 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8ad2576700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.357 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8ad2576700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.357 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8ad2576700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.357 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8ad2576700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8aced6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8aced6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8aced6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8aced6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.358 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:24.356+0000 7f8aced6f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:24.359 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T02:01:24.359+0000 7f9989a30700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:01:24.359 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T02:01:24.359+0000 7f9989a30700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:01:24.359 INFO:tasks.ceph.mds.d.smithi150.stderr:2023-10-24T02:01:24.359+0000 7f9989a30700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:01:24.374 INFO:tasks.ceph.mds.d.smithi150.stderr: -5> 2023-10-24T02:01:24.359+0000 7f9989a30700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:01:24.374 INFO:tasks.ceph.mds.d.smithi150.stderr: -4> 2023-10-24T02:01:24.359+0000 7f9989a30700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:01:24.374 INFO:tasks.ceph.mds.d.smithi150.stderr: -2> 2023-10-24T02:01:24.359+0000 7f9989a30700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:01:24.392 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T02:01:24.421 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:24.421+0000 7f1b9b617680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:01:24.493 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:24.492+0000 7f1b9b617680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:01:25.290 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T02:01:25.290+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T02:01:25.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.293+0000 7f22a3fff700 1 -- 172.21.15.148:0/1498449233 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22b40565d0 con 0x7f22bc13a970 2023-10-24T02:01:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 msgr2=0x7f22bc0bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f22b400d760 tx=0x7f22b400ba50).stop 2023-10-24T02:01:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 shutdown_connections 2023-10-24T02:01:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22bc13a970 0x7f22bc0bfce0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f22a805f270 0x7f22a8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22bc067660 0x7f22bc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 --2- 172.21.15.148:0/1498449233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22bc069270 0x7f22bc137870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 >> 172.21.15.148:0/1498449233 conn(0x7f22bc0c7ba0 msgr2=0x7f22bc1396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 shutdown_connections 2023-10-24T02:01:25.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.295+0000 7f22c1577700 1 -- 172.21.15.148:0/1498449233 wait complete. 2023-10-24T02:01:25.298 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T02:01:25.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T02:01:25.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.467+0000 7fda7ea0e700 1 Processor -- start 2023-10-24T02:01:25.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.467+0000 7fda7ea0e700 1 -- start start 2023-10-24T02:01:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78154430 0x7fda78154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 0x7fda780c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780c0970 con 0x7fda780bffd0 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780c71d0 con 0x7fda78098bd0 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7ea0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c9410 con 0x7fda78154430 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49018/0 (socket says 172.21.15.148:49018) 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 -- 172.21.15.148:0/3946333301 learned_addr learned my addr 172.21.15.148:0/3946333301 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:25.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda777fe700 1 --2- 172.21.15.148:0/3946333301 >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 0x7fda780c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda77fff700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78154430 0x7fda78154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 -- 172.21.15.148:0/3946333301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78154430 msgr2=0x7fda78154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:25.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78154430 0x7fda78154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 -- 172.21.15.148:0/3946333301 >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 msgr2=0x7fda780c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:25.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 --2- 172.21.15.148:0/3946333301 >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 0x7fda780c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 -- 172.21.15.148:0/3946333301 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780c6c10 con 0x7fda780bffd0 2023-10-24T02:01:25.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda777fe700 1 --2- 172.21.15.148:0/3946333301 >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 0x7fda780c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:25.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.468+0000 7fda7cfab700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fda70009f20 tx=0x7fda70009840).ready entity=mon.0 client_cookie=8d81a5803f2cb3b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:25.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda76ffd700 1 -- 172.21.15.148:0/3946333301 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000e070 con 0x7fda780bffd0 2023-10-24T02:01:25.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda76ffd700 1 -- 172.21.15.148:0/3946333301 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000ba40 con 0x7fda780bffd0 2023-10-24T02:01:25.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda76ffd700 1 -- 172.21.15.148:0/3946333301 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000bdc0 con 0x7fda780bffd0 2023-10-24T02:01:25.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 -- 172.21.15.148:0/3946333301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 msgr2=0x7fda780c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:25.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7fda70009f20 tx=0x7fda70009840).stop 2023-10-24T02:01:25.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 -- 172.21.15.148:0/3946333301 shutdown_connections 2023-10-24T02:01:25.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda780c0480 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/3946333301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78154430 0x7fda78154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/3946333301 >> v2:172.21.15.150:3300/0 conn(0x7fda78098bd0 0x7fda780c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 -- 172.21.15.148:0/3946333301 >> 172.21.15.148:0/3946333301 conn(0x7fda780cb070 msgr2=0x7fda780cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 -- 172.21.15.148:0/3946333301 shutdown_connections 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.469+0000 7fda7ea0e700 1 -- 172.21.15.148:0/3946333301 wait complete. 2023-10-24T02:01:25.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.470+0000 7fda7ea0e700 1 Processor -- start 2023-10-24T02:01:25.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 -- start start 2023-10-24T02:01:25.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda780c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda78151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c3390 con 0x7fda780bffd0 2023-10-24T02:01:25.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78152230 con 0x7fda78154430 2023-10-24T02:01:25.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda7ea0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780c2710 con 0x7fda78098bd0 2023-10-24T02:01:25.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49026/0 (socket says 172.21.15.148:49026) 2023-10-24T02:01:25.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.471+0000 7fda777fe700 1 -- 172.21.15.148:0/2366219433 learned_addr learned my addr 172.21.15.148:0/2366219433 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:25.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda77fff700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda780c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda7cfab700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda78151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 -- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 msgr2=0x7fda780c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:25.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda780c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 -- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 msgr2=0x7fda78151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:25.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda78151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:25.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 -- 172.21.15.148:0/2366219433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70009ae0 con 0x7fda780bffd0 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda7cfab700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda78151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda777fe700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fda6c00d860 tx=0x7fda6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c011590 con 0x7fda780bffd0 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c0116f0 con 0x7fda780bffd0 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780c29f0 con 0x7fda780bffd0 2023-10-24T02:01:25.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c011a70 con 0x7fda780bffd0 2023-10-24T02:01:25.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.472+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda780c2fb0 con 0x7fda780bffd0 2023-10-24T02:01:25.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.473+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7806c6b0 con 0x7fda780bffd0 2023-10-24T02:01:25.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.473+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 88) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fda6c012420 con 0x7fda780bffd0 2023-10-24T02:01:25.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.474+0000 7fda5ffff700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 0x7fda640614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:25.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.474+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 7054+0+0 (secure 0 0 0) 0x7fda6c079e70 con 0x7fda780bffd0 2023-10-24T02:01:25.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.474+0000 7fda77fff700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 0x7fda640614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:25.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.474+0000 7fda77fff700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 0x7fda640614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fda68006fd0 tx=0x7fda68008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:25.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.478+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fda6c04af10 con 0x7fda780bffd0 2023-10-24T02:01:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:25.691+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda780c6ef0 con 0x7fda780bffd0 2023-10-24T02:01:26.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.343+0000 7fda5ffff700 1 -- 172.21.15.148:0/2366219433 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda780c6ef0 con 0x7fda780bffd0 2023-10-24T02:01:26.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.345+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 msgr2=0x7fda640614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.345+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 0x7fda640614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fda68006fd0 tx=0x7fda68008040).stop 2023-10-24T02:01:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 msgr2=0x7fda78151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fda6c00d860 tx=0x7fda6c008040).stop 2023-10-24T02:01:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 shutdown_connections 2023-10-24T02:01:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fda6405f030 0x7fda640614f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda78154430 0x7fda78151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda78098bd0 0x7fda780c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 --2- 172.21.15.148:0/2366219433 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fda780bffd0 0x7fda78151850 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 >> 172.21.15.148:0/2366219433 conn(0x7fda780cb070 msgr2=0x7fda780ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:26.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 shutdown_connections 2023-10-24T02:01:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.346+0000 7fda7ea0e700 1 -- 172.21.15.148:0/2366219433 wait complete. 2023-10-24T02:01:26.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T02:01:26.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.477+0000 7f9aa62de700 1 Processor -- start 2023-10-24T02:01:26.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.477+0000 7f9aa62de700 1 -- start start 2023-10-24T02:01:26.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa62de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa62de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa62de700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00c6270 con 0x7f9aa01544b0 2023-10-24T02:01:26.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa62de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa00c60e0 con 0x7f9aa00a7d00 2023-10-24T02:01:26.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa62de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00aa870 con 0x7f9aa00aa420 2023-10-24T02:01:26.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9a9f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa487b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9a9f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:49370/0 (socket says 172.21.15.148:49370) 2023-10-24T02:01:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9a9ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9aa01544b0 0x7f9aa00c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:41250/0 (socket says 172.21.15.148:41250) 2023-10-24T02:01:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9aa487b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:37478/0 (socket says 172.21.15.148:37478) 2023-10-24T02:01:26.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.478+0000 7f9a9f7fe700 1 -- 172.21.15.148:0/1891237238 learned_addr learned my addr 172.21.15.148:0/1891237238 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9aa487b700 1 -- 172.21.15.148:0/1891237238 >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 msgr2=0x7f9aa00a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9aa487b700 1 --2- 172.21.15.148:0/1891237238 >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9aa487b700 1 -- 172.21.15.148:0/1891237238 >> v1:172.21.15.150:6789/0 conn(0x7f9aa01544b0 legacy=0x7f9aa00c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9aa487b700 1 -- 172.21.15.148:0/1891237238 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00c0c80 con 0x7f9aa00aa420 2023-10-24T02:01:26.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9a9f7fe700 1 --2- 172.21.15.148:0/1891237238 >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9aa487b700 1 --2- 172.21.15.148:0/1891237238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9a98009e60 tx=0x7f9a98009780).ready entity=mon.2 client_cookie=7adc0a091cbf8984 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9a9effd700 1 -- 172.21.15.148:0/1891237238 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800e070 con 0x7f9aa00aa420 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9a9effd700 1 -- 172.21.15.148:0/1891237238 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800bb60 con 0x7f9aa00aa420 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.479+0000 7f9a9effd700 1 -- 172.21.15.148:0/1891237238 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98012410 con 0x7f9aa00aa420 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 -- 172.21.15.148:0/1891237238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 msgr2=0x7f9aa00c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.484 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 --2- 172.21.15.148:0/1891237238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9a98009e60 tx=0x7f9a98009780).stop 2023-10-24T02:01:26.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 -- 172.21.15.148:0/1891237238 shutdown_connections 2023-10-24T02:01:26.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 --2- 172.21.15.148:0/1891237238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00aa420 0x7f9aa00c6700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 --2- 172.21.15.148:0/1891237238 >> v2:172.21.15.150:3300/0 conn(0x7f9aa00a7d00 0x7f9aa00a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 -- 172.21.15.148:0/1891237238 >> 172.21.15.148:0/1891237238 conn(0x7f9aa00945d0 msgr2=0x7f9aa006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:26.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 -- 172.21.15.148:0/1891237238 shutdown_connections 2023-10-24T02:01:26.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.480+0000 7f9aa62de700 1 -- 172.21.15.148:0/1891237238 wait complete. 2023-10-24T02:01:26.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.481+0000 7f9aa62de700 1 Processor -- start 2023-10-24T02:01:26.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.481+0000 7f9aa62de700 1 -- start start 2023-10-24T02:01:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00a7d00 0x7f9aa0145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aa00aa420 0x7f9aa00adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00ae940 con 0x7f9aa01544b0 2023-10-24T02:01:26.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0154f40 con 0x7f9aa00aa420 2023-10-24T02:01:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01464d0 con 0x7f9aa00a7d00 2023-10-24T02:01:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9a9ffff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00a7d00 0x7f9aa0145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49038/0 (socket says 172.21.15.148:49038) 2023-10-24T02:01:26.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 -- 172.21.15.148:0/2217497652 learned_addr learned my addr 172.21.15.148:0/2217497652 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9a9f7fe700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aa00aa420 0x7f9aa00adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 -- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00a7d00 msgr2=0x7f9aa0145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00a7d00 0x7f9aa0145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 -- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aa00aa420 msgr2=0x7f9aa00adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aa00aa420 0x7f9aa00adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 -- 172.21.15.148:0/2217497652 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009370 con 0x7f9aa01544b0 2023-10-24T02:01:26.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa487b700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f9a9800b6c0 tx=0x7f9a98009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9801d630 con 0x7f9aa01544b0 2023-10-24T02:01:26.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9801d790 con 0x7f9aa01544b0 2023-10-24T02:01:26.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9801db50 con 0x7f9aa01544b0 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.482+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98009a20 con 0x7f9aa01544b0 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.483+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00c3b10 con 0x7f9aa01544b0 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.484+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa01550d0 con 0x7f9aa01544b0 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.484+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 88) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f9a98003040 con 0x7f9aa01544b0 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.484+0000 7f9a87fff700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 0x7f9a8c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.484+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f9a9807c3b0 con 0x7f9aa01544b0 2023-10-24T02:01:26.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.484+0000 7f9a9ffff700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 0x7f9a8c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.485+0000 7f9a9ffff700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 0x7f9a8c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9a90007fd0 tx=0x7f9a90000bc0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.488+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9a9804d4b0 con 0x7f9aa01544b0 2023-10-24T02:01:26.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.652+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9aa006c6b0 con 0x7f9aa01544b0 2023-10-24T02:01:26.832 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.832+0000 7f9a87fff700 1 -- 172.21.15.148:0/2217497652 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v191) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9a98050ad0 con 0x7f9aa01544b0 2023-10-24T02:01:26.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 msgr2=0x7f9a8c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 0x7f9a8c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9a90007fd0 tx=0x7f9a90000bc0).stop 2023-10-24T02:01:26.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 msgr2=0x7f9aa00ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7f9a9800b6c0 tx=0x7f9a98009780).stop 2023-10-24T02:01:26.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 shutdown_connections 2023-10-24T02:01:26.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9aa01544b0 0x7f9aa00ae450 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9aa00a7d00 0x7f9aa0145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9a8c05f030 0x7f9a8c0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 --2- 172.21.15.148:0/2217497652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9aa00aa420 0x7f9aa00adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.836+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 >> 172.21.15.148:0/2217497652 conn(0x7f9aa00945d0 msgr2=0x7f9aa00c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:26.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.837+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 shutdown_connections 2023-10-24T02:01:26.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.837+0000 7f9aa62de700 1 -- 172.21.15.148:0/2217497652 wait complete. 2023-10-24T02:01:26.841 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T02:01:26.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T02:01:26.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.969+0000 7fd541ca7700 1 Processor -- start 2023-10-24T02:01:26.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.969+0000 7fd541ca7700 1 -- start start 2023-10-24T02:01:26.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd53c1544b0 0x7fd53c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 0x7fd53c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 0x7fd53c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0c60e0 con 0x7fd53c1544b0 2023-10-24T02:01:26.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0c6270 con 0x7fd53c0aa420 2023-10-24T02:01:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd541ca7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0aa890 con 0x7fd53c0c8290 2023-10-24T02:01:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd53b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd53c1544b0 0x7fd53c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd53b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd53c1544b0 0x7fd53c0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49046/0 (socket says 172.21.15.148:49046) 2023-10-24T02:01:26.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.970+0000 7fd53b7fe700 1 -- 172.21.15.148:0/1991829914 learned_addr learned my addr 172.21.15.148:0/1991829914 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53bfff700 1 --2- 172.21.15.148:0/1991829914 >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 0x7fd53c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 -- 172.21.15.148:0/1991829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 msgr2=0x7fd53c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53affd700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 0x7fd53c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 0x7fd53c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 -- 172.21.15.148:0/1991829914 >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 msgr2=0x7fd53c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/1991829914 >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 0x7fd53c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 -- 172.21.15.148:0/1991829914 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0c0c80 con 0x7fd53c1544b0 2023-10-24T02:01:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53bfff700 1 --2- 172.21.15.148:0/1991829914 >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 0x7fd53c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53affd700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 0x7fd53c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:26.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0a7d00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fd53c084520 tx=0x7fd52c009840).ready entity=mon.0 client_cookie=5467f0469600e50e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53a7fc700 1 -- 172.21.15.148:0/1991829914 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00e070 con 0x7fd53c1544b0 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53a7fc700 1 -- 172.21.15.148:0/1991829914 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00ba50 con 0x7fd53c1544b0 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd53a7fc700 1 -- 172.21.15.148:0/1991829914 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00bdd0 con 0x7fd53c1544b0 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 -- 172.21.15.148:0/1991829914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 msgr2=0x7fd53c0a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0a7d00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fd53c084520 tx=0x7fd52c009840).stop 2023-10-24T02:01:26.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 -- 172.21.15.148:0/1991829914 shutdown_connections 2023-10-24T02:01:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0a7d00 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 --2- 172.21.15.148:0/1991829914 >> v2:172.21.15.150:3300/0 conn(0x7fd53c0aa420 0x7fd53c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 --2- 172.21.15.148:0/1991829914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0c8290 0x7fd53c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 -- 172.21.15.148:0/1991829914 >> 172.21.15.148:0/1991829914 conn(0x7fd53c0945d0 msgr2=0x7fd53c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:26.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.971+0000 7fd541ca7700 1 -- 172.21.15.148:0/1991829914 shutdown_connections 2023-10-24T02:01:26.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.972+0000 7fd541ca7700 1 -- 172.21.15.148:0/1991829914 wait complete. 2023-10-24T02:01:26.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.973+0000 7fd541ca7700 1 Processor -- start 2023-10-24T02:01:26.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.973+0000 7fd541ca7700 1 -- start start 2023-10-24T02:01:26.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 0x7fd53c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0c8290 0x7fd53c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c14eb70 con 0x7fd53c1544b0 2023-10-24T02:01:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0abee0 con 0x7fd53c0c8290 2023-10-24T02:01:26.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1561c0 con 0x7fd53c0aa420 2023-10-24T02:01:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49062/0 (socket says 172.21.15.148:49062) 2023-10-24T02:01:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 -- 172.21.15.148:0/2989390426 learned_addr learned my addr 172.21.15.148:0/2989390426 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53affd700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0c8290 0x7fd53c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 0x7fd53c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 -- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 msgr2=0x7fd53c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 0x7fd53c14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 -- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0c8290 msgr2=0x7fd53c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0c8290 0x7fd53c0ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:26.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 -- 172.21.15.148:0/2989390426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009ae0 con 0x7fd53c1544b0 2023-10-24T02:01:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 0x7fd53c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd53bfff700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fd53400c880 tx=0x7fd534008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534010580 con 0x7fd53c1544b0 2023-10-24T02:01:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5340106e0 con 0x7fd53c1544b0 2023-10-24T02:01:26.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c168500 con 0x7fd53c1544b0 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534010a60 con 0x7fd53c1544b0 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.974+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c168890 con 0x7fd53c1544b0 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.975+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c168ec0 con 0x7fd53c1544b0 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.975+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 88) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fd53401b460 con 0x7fd53c1544b0 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.976+0000 7fd5237fe700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 0x7fd5280614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:26.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.976+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6587+0+0 (secure 0 0 0) 0x7fd53407a0b0 con 0x7fd53c1544b0 2023-10-24T02:01:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.976+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 0x7fd5280614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.977+0000 7fd53b7fe700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 0x7fd5280614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd52c00ba20 tx=0x7fd52c009840).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:26.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:26.980+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd53404b320 con 0x7fd53c1544b0 2023-10-24T02:01:27.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.148+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd53c06c6b0 con 0x7fd53c1544b0 2023-10-24T02:01:27.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.307+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd534077e80 con 0x7fd53c1544b0 2023-10-24T02:01:27.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.986+0000 7fd5237fe700 1 -- 172.21.15.148:0/2989390426 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v192) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd534072520 con 0x7fd53c1544b0 2023-10-24T02:01:27.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 msgr2=0x7fd5280614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:27.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 0x7fd5280614f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd52c00ba20 tx=0x7fd52c009840).stop 2023-10-24T02:01:27.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 msgr2=0x7fd53c0c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:27.990 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fd53400c880 tx=0x7fd534008040).stop 2023-10-24T02:01:27.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 shutdown_connections 2023-10-24T02:01:27.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd53c1544b0 0x7fd53c0c41c0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:27.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd53c0aa420 0x7fd53c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:27.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd52805f030 0x7fd5280614f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:27.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 --2- 172.21.15.148:0/2989390426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd53c0c8290 0x7fd53c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:27.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 >> 172.21.15.148:0/2989390426 conn(0x7fd53c0945d0 msgr2=0x7fd53c14f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:27.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 shutdown_connections 2023-10-24T02:01:27.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:27.989+0000 7fd541ca7700 1 -- 172.21.15.148:0/2989390426 wait complete. 2023-10-24T02:01:27.992 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T02:01:28.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T02:01:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.121+0000 7f37789f2700 1 Processor -- start 2023-10-24T02:01:28.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.121+0000 7f37789f2700 1 -- start start 2023-10-24T02:01:28.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f37789f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37740c6210 0x7f37740c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f37789f2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3774063760 con 0x7f37740bec80 2023-10-24T02:01:28.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f37789f2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740bf2f0 con 0x7f37740c65f0 2023-10-24T02:01:28.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f37789f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3774154b50 con 0x7f37740c6210 2023-10-24T02:01:28.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f377259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37740c6210 0x7f37740c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f377259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f37740c6210 0x7f37740c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49068/0 (socket says 172.21.15.148:49068) 2023-10-24T02:01:28.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f3772d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f37740bec80 0x7f3774063bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48726/0 (socket says 172.21.15.148:48726) 2023-10-24T02:01:28.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.122+0000 7f377259c700 1 -- 172.21.15.148:0/3383328519 learned_addr learned my addr 172.21.15.148:0/3383328519 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:28.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f377259c700 1 -- 172.21.15.148:0/3383328519 >> v1:172.21.15.150:6789/0 conn(0x7f37740c65f0 legacy=0x7f37740be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f377259c700 1 -- 172.21.15.148:0/3383328519 >> v1:172.21.15.148:6789/0 conn(0x7f37740bec80 legacy=0x7f3774063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f3771d9b700 1 -- 172.21.15.148:0/3383328519 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963331270 0 0) 0x7f3774063760 con 0x7f37740bec80 2023-10-24T02:01:28.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f377259c700 1 -- 172.21.15.148:0/3383328519 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740bf5d0 con 0x7f37740c6210 2023-10-24T02:01:28.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f377259c700 1 --2- 172.21.15.148:0/3383328519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f37740c4200 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f3764006fd0 tx=0x7f37640090f0).ready entity=mon.0 client_cookie=b6f9698c851e30fd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f3771d9b700 1 -- 172.21.15.148:0/3383328519 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400b600 con 0x7f37740c6210 2023-10-24T02:01:28.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f3771d9b700 1 -- 172.21.15.148:0/3383328519 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400b760 con 0x7f37740c6210 2023-10-24T02:01:28.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f3771d9b700 1 -- 172.21.15.148:0/3383328519 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400bae0 con 0x7f37740c6210 2023-10-24T02:01:28.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 -- 172.21.15.148:0/3383328519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 msgr2=0x7f37740c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 --2- 172.21.15.148:0/3383328519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f37740c4200 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f3764006fd0 tx=0x7f37640090f0).stop 2023-10-24T02:01:28.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 -- 172.21.15.148:0/3383328519 shutdown_connections 2023-10-24T02:01:28.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 --2- 172.21.15.148:0/3383328519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f37740c4200 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 -- 172.21.15.148:0/3383328519 >> 172.21.15.148:0/3383328519 conn(0x7f3774092510 msgr2=0x7f3774062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:28.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 -- 172.21.15.148:0/3383328519 shutdown_connections 2023-10-24T02:01:28.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.123+0000 7f37789f2700 1 -- 172.21.15.148:0/3383328519 wait complete. 2023-10-24T02:01:28.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 Processor -- start 2023-10-24T02:01:28.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 -- start start 2023-10-24T02:01:28.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37740bec80 0x7f3774063af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740c65f0 0x7f37741510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774063fe0 con 0x7f37740c6210 2023-10-24T02:01:28.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c1c00 con 0x7f37740bec80 2023-10-24T02:01:28.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f37789f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c1ee0 con 0x7f37740c65f0 2023-10-24T02:01:28.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f3769d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.125+0000 7f3769d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49076/0 (socket says 172.21.15.148:49076) 2023-10-24T02:01:28.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 -- 172.21.15.148:0/385320745 learned_addr learned my addr 172.21.15.148:0/385320745 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:28.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3772d9d700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740c65f0 0x7f37741510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f377259c700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37740bec80 0x7f3774063af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 -- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740c65f0 msgr2=0x7f37741510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740c65f0 0x7f37741510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 -- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37740bec80 msgr2=0x7f3774063af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37740bec80 0x7f3774063af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 -- 172.21.15.148:0/385320745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009370 con 0x7f37740c6210 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f3769d9b700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f375c00c4c0 tx=0x7f375c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00ce70 con 0x7f37740c6210 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c001e90 con 0x7f37740c6210 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37740c21c0 con 0x7f37740c6210 2023-10-24T02:01:28.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c007250 con 0x7f37740c6210 2023-10-24T02:01:28.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.126+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740c7900 con 0x7f37740c6210 2023-10-24T02:01:28.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.127+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377406c6b0 con 0x7f37740c6210 2023-10-24T02:01:28.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.127+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f375c0066a0 con 0x7f37740c6210 2023-10-24T02:01:28.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.128+0000 7f376affd700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 0x7f37540615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.128+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f375c079a40 con 0x7f37740c6210 2023-10-24T02:01:28.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.128+0000 7f377259c700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 0x7f37540615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.128+0000 7f377259c700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 0x7f37540615e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3764009130 tx=0x7f3764017000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.132+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f375c07be60 con 0x7f37740c6210 2023-10-24T02:01:28.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.296+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3774065f60 con 0x7f37740c6210 2023-10-24T02:01:28.300 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.299+0000 7f376affd700 1 -- 172.21.15.148:0/385320745 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v36) v1 ==== 120+0+0 (secure 0 0 0) 0x7f375c04ad30 con 0x7f37740c6210 2023-10-24T02:01:28.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 msgr2=0x7f37540615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 0x7f37540615e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3764009130 tx=0x7f3764017000).stop 2023-10-24T02:01:28.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 msgr2=0x7f377414bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f375c00c4c0 tx=0x7f375c007e00).stop 2023-10-24T02:01:28.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 shutdown_connections 2023-10-24T02:01:28.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37740c65f0 0x7f37741510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f375405f120 0x7f37540615e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37740bec80 0x7f3774063af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 --2- 172.21.15.148:0/385320745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37740c6210 0x7f377414bf40 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 >> 172.21.15.148:0/385320745 conn(0x7f3774092510 msgr2=0x7f3774067070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:28.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 shutdown_connections 2023-10-24T02:01:28.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.301+0000 7f37789f2700 1 -- 172.21.15.148:0/385320745 wait complete. 2023-10-24T02:01:28.314 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T02:01:28.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.429+0000 7f474a7fd700 1 Processor -- start 2023-10-24T02:01:28.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.429+0000 7f474a7fd700 1 -- start start 2023-10-24T02:01:28.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f474a7fd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f47440a9e60 0x7f47440aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f474a7fd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440c6770 con 0x7f4744157780 2023-10-24T02:01:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f474a7fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440c1120 con 0x7f47440c8530 2023-10-24T02:01:28.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f474a7fd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440c1400 con 0x7f47440a9e60 2023-10-24T02:01:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f47440a9e60 0x7f47440aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f47497fb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4744157780 0x7f47440c0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48742/0 (socket says 172.21.15.148:48742) 2023-10-24T02:01:28.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f47497fb700 1 -- 172.21.15.148:0/3039226483 learned_addr learned my addr 172.21.15.148:0/3039226483 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 --2- 172.21.15.148:0/3039226483 >> v2:172.21.15.148:3300/0 conn(0x7f47440a9e60 0x7f47440aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49086/0 (socket says 172.21.15.148:49086) 2023-10-24T02:01:28.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 -- 172.21.15.148:0/3039226483 >> v1:172.21.15.150:6789/0 conn(0x7f47440c8530 legacy=0x7f47440a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 -- 172.21.15.148:0/3039226483 >> v1:172.21.15.148:6789/0 conn(0x7f4744157780 legacy=0x7f47440c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4743fff700 1 -- 172.21.15.148:0/3039226483 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894092684 0 0) 0x7f47440c6770 con 0x7f4744157780 2023-10-24T02:01:28.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 -- 172.21.15.148:0/3039226483 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440c6120 con 0x7f47440a9e60 2023-10-24T02:01:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4749ffc700 1 --2- 172.21.15.148:0/3039226483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f47440aa270 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f4734009e60 tx=0x7f4734009780).ready entity=mon.0 client_cookie=77ae09d2a7579300 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4743fff700 1 -- 172.21.15.148:0/3039226483 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400e070 con 0x7f47440a9e60 2023-10-24T02:01:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4743fff700 1 -- 172.21.15.148:0/3039226483 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400bc30 con 0x7f47440a9e60 2023-10-24T02:01:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.430+0000 7f4743fff700 1 -- 172.21.15.148:0/3039226483 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734012410 con 0x7f47440a9e60 2023-10-24T02:01:28.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 -- 172.21.15.148:0/3039226483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 msgr2=0x7f47440aa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 --2- 172.21.15.148:0/3039226483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f47440aa270 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f4734009e60 tx=0x7f4734009780).stop 2023-10-24T02:01:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 -- 172.21.15.148:0/3039226483 shutdown_connections 2023-10-24T02:01:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 --2- 172.21.15.148:0/3039226483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f47440aa270 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 -- 172.21.15.148:0/3039226483 >> 172.21.15.148:0/3039226483 conn(0x7f4744094570 msgr2=0x7f474406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:28.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 -- 172.21.15.148:0/3039226483 shutdown_connections 2023-10-24T02:01:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.431+0000 7f474a7fd700 1 -- 172.21.15.148:0/3039226483 wait complete. 2023-10-24T02:01:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.432+0000 7f474a7fd700 1 Processor -- start 2023-10-24T02:01:28.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.432+0000 7f474a7fd700 1 -- start start 2023-10-24T02:01:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 0x7f47440cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4744157780 0x7f47440cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440c3b00 con 0x7f47440a9e60 2023-10-24T02:01:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440c3de0 con 0x7f4744157780 2023-10-24T02:01:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f474a7fd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440c40c0 con 0x7f47440c8530 2023-10-24T02:01:28.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f47497fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f47497fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49096/0 (socket says 172.21.15.148:49096) 2023-10-24T02:01:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f47497fb700 1 -- 172.21.15.148:0/1330390541 learned_addr learned my addr 172.21.15.148:0/1330390541 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f4749ffc700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4744157780 0x7f47440cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.433+0000 7f4748ffa700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 0x7f47440cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 -- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 msgr2=0x7f47440cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 0x7f47440cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 -- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4744157780 msgr2=0x7f47440cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4744157780 0x7f47440cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 -- 172.21.15.148:0/1330390541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009a20 con 0x7f47440a9e60 2023-10-24T02:01:28.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f4748ffa700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 0x7f47440cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47497fb700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f473c00c440 tx=0x7f473c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0072e0 con 0x7f47440a9e60 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c007440 con 0x7f47440a9e60 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440c43a0 con 0x7f47440a9e60 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c005880 con 0x7f47440a9e60 2023-10-24T02:01:28.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.434+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440c4960 con 0x7f47440a9e60 2023-10-24T02:01:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.435+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744047480 con 0x7f47440a9e60 2023-10-24T02:01:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.435+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f473c005c70 con 0x7f47440a9e60 2023-10-24T02:01:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.435+0000 7f47417fa700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 0x7f4730061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.436+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f473c079840 con 0x7f47440a9e60 2023-10-24T02:01:28.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.436+0000 7f4748ffa700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 0x7f4730061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.436+0000 7f4748ffa700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 0x7f4730061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4744154820 tx=0x7f4738009040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.440+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f473c04aad0 con 0x7f47440a9e60 2023-10-24T02:01:28.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.604+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4744154b00 con 0x7f47440a9e60 2023-10-24T02:01:28.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.607+0000 7f47417fa700 1 -- 172.21.15.148:0/1330390541 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f473c04e0f0 con 0x7f47440a9e60 2023-10-24T02:01:28.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 msgr2=0x7f4730061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 0x7f4730061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4744154820 tx=0x7f4738009040).stop 2023-10-24T02:01:28.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 msgr2=0x7f4744156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f473c00c440 tx=0x7f473c007d00).stop 2023-10-24T02:01:28.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 shutdown_connections 2023-10-24T02:01:28.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f473005f150 0x7f4730061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4744157780 0x7f47440cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47440a9e60 0x7f4744156640 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 --2- 172.21.15.148:0/1330390541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47440c8530 0x7f47440cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 >> 172.21.15.148:0/1330390541 conn(0x7f4744094570 msgr2=0x7f47441530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:28.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 shutdown_connections 2023-10-24T02:01:28.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.610+0000 7f474a7fd700 1 -- 172.21.15.148:0/1330390541 wait complete. 2023-10-24T02:01:28.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-24T02:01:28.735 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 Processor -- start 2023-10-24T02:01:28.736 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 -- start start 2023-10-24T02:01:28.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde980c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980aa880 con 0x7fde980aa010 2023-10-24T02:01:28.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980c0960 con 0x7fde980aa3f0 2023-10-24T02:01:28.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.735+0000 7fde9ec93700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c0c40 con 0x7fde980c6710 2023-10-24T02:01:28.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde9ca2f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fde980aa010 0x7fde98158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48748/0 (socket says 172.21.15.148:48748) 2023-10-24T02:01:28.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde9ca2f700 1 -- 172.21.15.148:0/2847461097 learned_addr learned my addr 172.21.15.148:0/2847461097 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:28.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8ffff700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde980c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307392800 0 0) 0x7fde94001490 con 0x7fde980aa010 2023-10-24T02:01:28.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde800033f0 con 0x7fde980aa010 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283515729 0 0) 0x7fde980c0960 con 0x7fde980aa3f0 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde94001490 con 0x7fde980aa3f0 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016010409 0 0) 0x7fde800033f0 con 0x7fde980aa010 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 msgr2=0x7fde980c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde980c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 >> v1:172.21.15.150:6789/0 conn(0x7fde980aa3f0 legacy=0x7fde98069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980c0f20 con 0x7fde980aa010 2023-10-24T02:01:28.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fde94001980 con 0x7fde980aa010 2023-10-24T02:01:28.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 >> v1:172.21.15.148:6789/0 conn(0x7fde980aa010 legacy=0x7fde98158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde80003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde80004690 0x7fde80004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde80005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c0c40 con 0x7fde80003aa0 2023-10-24T02:01:28.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8000b990 con 0x7fde80004690 2023-10-24T02:01:28.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8000bb20 con 0x7fde980c6710 2023-10-24T02:01:28.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde80003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde8ffff700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde80004690 0x7fde80004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.736+0000 7fde9d230700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde80005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 -- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 msgr2=0x7fde80005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde980c6710 0x7fde80005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 -- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde80004690 msgr2=0x7fde80004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:28.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde80004690 0x7fde80004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 -- 172.21.15.148:0/2847461097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800033f0 con 0x7fde80003aa0 2023-10-24T02:01:28.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde80003ea0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fde9400c620 tx=0x7fde980c6390).ready entity=mon.0 client_cookie=2f603cec70ff55c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400cde0 con 0x7fde80003aa0 2023-10-24T02:01:28.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94005b20 con 0x7fde80003aa0 2023-10-24T02:01:28.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde8f7fe700 1 -- 172.21.15.148:0/2847461097 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940070d0 con 0x7fde80003aa0 2023-10-24T02:01:28.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 -- 172.21.15.148:0/2847461097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 msgr2=0x7fde80003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 --2- 172.21.15.148:0/2847461097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde80003ea0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fde9400c620 tx=0x7fde980c6390).stop 2023-10-24T02:01:28.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9d230700 1 -- 172.21.15.148:0/2847461097 reap_dead start 2023-10-24T02:01:28.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 -- 172.21.15.148:0/2847461097 shutdown_connections 2023-10-24T02:01:28.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 -- 172.21.15.148:0/2847461097 >> 172.21.15.148:0/2847461097 conn(0x7fde980caf40 msgr2=0x7fde980cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:28.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 -- 172.21.15.148:0/2847461097 shutdown_connections 2023-10-24T02:01:28.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.737+0000 7fde9ec93700 1 -- 172.21.15.148:0/2847461097 wait complete. 2023-10-24T02:01:28.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.738+0000 7fde9ec93700 1 Processor -- start 2023-10-24T02:01:28.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 -- start start 2023-10-24T02:01:28.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde98154840 0x7fde98155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde981562d0 0x7fde98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980b0060 con 0x7fde80003aa0 2023-10-24T02:01:28.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98155950 con 0x7fde981562d0 2023-10-24T02:01:28.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.739+0000 7fde9ec93700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98169070 con 0x7fde98154840 2023-10-24T02:01:28.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49112/0 (socket says 172.21.15.148:49112) 2023-10-24T02:01:28.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 -- 172.21.15.148:0/1479644365 learned_addr learned my addr 172.21.15.148:0/1479644365 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:28.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde8ffff700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde98154840 0x7fde98155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9d230700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde981562d0 0x7fde98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 -- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde98154840 msgr2=0x7fde98155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde98154840 0x7fde98155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 -- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde981562d0 msgr2=0x7fde98069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde981562d0 0x7fde98069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:28.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 -- 172.21.15.148:0/1479644365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98154d40 con 0x7fde80003aa0 2023-10-24T02:01:28.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ca2f700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fde9400a000 tx=0x7fde94015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94002010 con 0x7fde80003aa0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94001880 con 0x7fde80003aa0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94004a30 con 0x7fde80003aa0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde98155020 con 0x7fde80003aa0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.740+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde981555e0 con 0x7fde80003aa0 2023-10-24T02:01:28.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.741+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9806c6b0 con 0x7fde80003aa0 2023-10-24T02:01:28.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.741+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fde94005030 con 0x7fde80003aa0 2023-10-24T02:01:28.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.742+0000 7fde8cff9700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 0x7fde84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:28.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.742+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fde9407b1a0 con 0x7fde80003aa0 2023-10-24T02:01:28.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.742+0000 7fde8ffff700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 0x7fde84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:28.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.742+0000 7fde8ffff700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 0x7fde84061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fde981692c0 tx=0x7fde88009060).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:28.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.746+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde9404c430 con 0x7fde80003aa0 2023-10-24T02:01:28.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.975+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fde980aa880 con 0x7fde80003aa0 2023-10-24T02:01:28.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.995+0000 7fde8cff9700 1 -- 172.21.15.148:0/1479644365 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2963) v1 ==== 165+0+0 (secure 0 0 0) 0x7fde980aa880 con 0x7fde80003aa0 2023-10-24T02:01:28.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 msgr2=0x7fde84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 0x7fde84061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fde981692c0 tx=0x7fde88009060).stop 2023-10-24T02:01:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 msgr2=0x7fde98168b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fde9400a000 tx=0x7fde94015000).stop 2023-10-24T02:01:28.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 shutdown_connections 2023-10-24T02:01:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8405f150 0x7fde84061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde981562d0 0x7fde98069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde80003aa0 0x7fde98168b80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 --2- 172.21.15.148:0/1479644365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde98154840 0x7fde98155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 >> 172.21.15.148:0/1479644365 conn(0x7fde980caf40 msgr2=0x7fde980cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 shutdown_connections 2023-10-24T02:01:29.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:28.997+0000 7fde9ec93700 1 -- 172.21.15.148:0/1479644365 wait complete. 2023-10-24T02:01:29.010 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-10-24T02:01:29.010 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-10-24T02:01:29.011 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-24T02:01:29.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-24T02:01:29.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 Processor -- start 2023-10-24T02:01:29.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 -- start start 2023-10-24T02:01:29.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30140c6710 0x7f30140c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30140aa3f0 0x7f3014069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30140aa820 con 0x7f30140aa010 2023-10-24T02:01:29.128 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140c0960 con 0x7f30140c6710 2023-10-24T02:01:29.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.125+0000 7f3019258700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30140c0c40 con 0x7f30140aa3f0 2023-10-24T02:01:29.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30140c6710 0x7f30140c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f30140c6710 0x7f30140c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49114/0 (socket says 172.21.15.148:49114) 2023-10-24T02:01:29.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 -- 172.21.15.148:0/3677556902 learned_addr learned my addr 172.21.15.148:0/3677556902 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:29.129 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f301359e700 1 --2- 172.21.15.148:0/3677556902 >> v2:172.21.15.150:3300/0 conn(0x7f30140aa3f0 0x7f3014069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 -- 172.21.15.148:0/3677556902 >> v2:172.21.15.150:3300/0 conn(0x7f30140aa3f0 msgr2=0x7f3014069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:29.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 --2- 172.21.15.148:0/3677556902 >> v2:172.21.15.150:3300/0 conn(0x7f30140aa3f0 0x7f3014069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 -- 172.21.15.148:0/3677556902 >> v1:172.21.15.150:6789/0 conn(0x7f30140aa010 legacy=0x7f3014158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:29.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 -- 172.21.15.148:0/3677556902 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140c0f20 con 0x7f30140c6710 2023-10-24T02:01:29.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f300a59c700 1 --2- 172.21.15.148:0/3677556902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f30140c1a00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f3014158e80 tx=0x7f2ffc0090f0).ready entity=mon.0 client_cookie=9c730014124aef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:29.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f301259c700 1 -- 172.21.15.148:0/3677556902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00b520 con 0x7f30140c6710 2023-10-24T02:01:29.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f301259c700 1 -- 172.21.15.148:0/3677556902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00b680 con 0x7f30140c6710 2023-10-24T02:01:29.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.126+0000 7f301259c700 1 -- 172.21.15.148:0/3677556902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00ba00 con 0x7f30140c6710 2023-10-24T02:01:29.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 -- 172.21.15.148:0/3677556902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 msgr2=0x7f30140c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:29.131 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 --2- 172.21.15.148:0/3677556902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f30140c1a00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f3014158e80 tx=0x7f2ffc0090f0).stop 2023-10-24T02:01:29.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 -- 172.21.15.148:0/3677556902 shutdown_connections 2023-10-24T02:01:29.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 --2- 172.21.15.148:0/3677556902 >> v2:172.21.15.150:3300/0 conn(0x7f30140aa3f0 0x7f3014069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 --2- 172.21.15.148:0/3677556902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f30140c1a00 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 -- 172.21.15.148:0/3677556902 >> 172.21.15.148:0/3677556902 conn(0x7f30140caf40 msgr2=0x7f30140cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:29.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 -- 172.21.15.148:0/3677556902 shutdown_connections 2023-10-24T02:01:29.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.127+0000 7f3019258700 1 -- 172.21.15.148:0/3677556902 wait complete. 2023-10-24T02:01:29.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.128+0000 7f3019258700 1 Processor -- start 2023-10-24T02:01:29.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.128+0000 7f3019258700 1 -- start start 2023-10-24T02:01:29.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30140aa010 0x7f30141438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30140aa3f0 0x7f30140b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141523e0 con 0x7f30140c6710 2023-10-24T02:01:29.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30140c3b40 con 0x7f30140aa010 2023-10-24T02:01:29.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30140b0370 con 0x7f30140aa3f0 2023-10-24T02:01:29.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49126/0 (socket says 172.21.15.148:49126) 2023-10-24T02:01:29.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 -- 172.21.15.148:0/1056988022 learned_addr learned my addr 172.21.15.148:0/1056988022 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:29.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3012d9d700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30140aa010 0x7f30141438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f300a59c700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30140aa3f0 0x7f30140b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 -- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30140aa3f0 msgr2=0x7f30140b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:29.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30140aa3f0 0x7f30140b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 -- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30140aa010 msgr2=0x7f30141438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30140aa010 0x7f30141438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 -- 172.21.15.148:0/1056988022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009370 con 0x7f30140c6710 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f301359e700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f300c00e8d0 tx=0x7f300c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c009530 con 0x7f30140c6710 2023-10-24T02:01:29.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c012600 con 0x7f30140c6710 2023-10-24T02:01:29.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30140afa40 con 0x7f30140c6710 2023-10-24T02:01:29.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c012980 con 0x7f30140c6710 2023-10-24T02:01:29.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.129+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30140b0000 con 0x7f30140c6710 2023-10-24T02:01:29.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.130+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30140b0500 con 0x7f30140c6710 2023-10-24T02:01:29.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.131+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f300c012cf0 con 0x7f30140c6710 2023-10-24T02:01:29.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.131+0000 7f300b7fe700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 0x7f2ff4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:29.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.131+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f300c07a530 con 0x7f30140c6710 2023-10-24T02:01:29.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.131+0000 7f3012d9d700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 0x7f2ff4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:29.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.132+0000 7f3012d9d700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 0x7f2ff4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3004004290 tx=0x7f3004001560).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:29.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.135+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f300c04b820 con 0x7f30140c6710 2023-10-24T02:01:29.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.366+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f301406c6b0 con 0x7f30140c6710 2023-10-24T02:01:29.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.997+0000 7f300b7fe700 1 -- 172.21.15.148:0/1056988022 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2964) v1 ==== 166+0+0 (secure 0 0 0) 0x7f300c04ee40 con 0x7f30140c6710 2023-10-24T02:01:30.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 msgr2=0x7f2ff4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 0x7f2ff4061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3004004290 tx=0x7f3004001560).stop 2023-10-24T02:01:30.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 msgr2=0x7f3014069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f300c00e8d0 tx=0x7f300c009060).stop 2023-10-24T02:01:30.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 shutdown_connections 2023-10-24T02:01:30.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f30140c6710 0x7f3014069d80 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2ff405f150 0x7f2ff4061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30140aa010 0x7f30141438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 --2- 172.21.15.148:0/1056988022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30140aa3f0 0x7f30140b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 >> 172.21.15.148:0/1056988022 conn(0x7f30140caf40 msgr2=0x7f30140c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 shutdown_connections 2023-10-24T02:01:30.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:29.999+0000 7f3019258700 1 -- 172.21.15.148:0/1056988022 wait complete. 2023-10-24T02:01:30.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T02:01:30.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.129+0000 7f9b265b2700 1 Processor -- start 2023-10-24T02:01:30.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.129+0000 7f9b265b2700 1 -- start start 2023-10-24T02:01:30.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b265b2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b20154430 0x7f9b20154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b265b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.133 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b265b2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b200c71d0 con 0x7f9b20098bd0 2023-10-24T02:01:30.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b265b2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b200c6a10 con 0x7f9b20154430 2023-10-24T02:01:30.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b265b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200c9410 con 0x7f9b200bffd0 2023-10-24T02:01:30.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b24b4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b1ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b20154430 0x7f9b20154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b1ffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b20154430 0x7f9b20154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:49448/0 (socket says 172.21.15.148:49448) 2023-10-24T02:01:30.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b24b4f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:37560/0 (socket says 172.21.15.148:37560) 2023-10-24T02:01:30.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b1ffff700 1 -- 172.21.15.148:0/176181616 learned_addr learned my addr 172.21.15.148:0/176181616 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:30.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.130+0000 7f9b1f7fe700 1 --1- 172.21.15.148:0/176181616 >> v1:172.21.15.150:6789/0 conn(0x7f9b20098bd0 0x7f9b200c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:41308/0 (socket says 172.21.15.148:41308) 2023-10-24T02:01:30.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1ffff700 1 -- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 msgr2=0x7f9b200c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:30.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1ffff700 1 --2- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200c0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1ffff700 1 -- 172.21.15.148:0/176181616 >> v1:172.21.15.150:6789/0 conn(0x7f9b20098bd0 legacy=0x7f9b200c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1ffff700 1 -- 172.21.15.148:0/176181616 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200c0950 con 0x7f9b20154430 2023-10-24T02:01:30.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1ffff700 1 --2- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20154810 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f9b10006fd0 tx=0x7f9b100090f0).ready entity=mon.1 client_cookie=fbd8abc02c88fb9d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1effd700 1 -- 172.21.15.148:0/176181616 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000b580 con 0x7f9b20154430 2023-10-24T02:01:30.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1effd700 1 -- 172.21.15.148:0/176181616 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000b6e0 con 0x7f9b20154430 2023-10-24T02:01:30.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b1effd700 1 -- 172.21.15.148:0/176181616 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000ba60 con 0x7f9b20154430 2023-10-24T02:01:30.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b265b2700 1 -- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 msgr2=0x7f9b20154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.131+0000 7f9b265b2700 1 --2- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20154810 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f9b10006fd0 tx=0x7f9b100090f0).stop 2023-10-24T02:01:30.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 -- 172.21.15.148:0/176181616 shutdown_connections 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 --2- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 --2- 172.21.15.148:0/176181616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20154810 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 -- 172.21.15.148:0/176181616 >> 172.21.15.148:0/176181616 conn(0x7f9b200cb070 msgr2=0x7f9b200cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 -- 172.21.15.148:0/176181616 shutdown_connections 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.132+0000 7f9b265b2700 1 -- 172.21.15.148:0/176181616 wait complete. 2023-10-24T02:01:30.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.133+0000 7f9b265b2700 1 Processor -- start 2023-10-24T02:01:30.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.133+0000 7f9b265b2700 1 -- start start 2023-10-24T02:01:30.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200afc10 con 0x7f9b20098bd0 2023-10-24T02:01:30.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20164c70 con 0x7f9b20154430 2023-10-24T02:01:30.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20149e20 con 0x7f9b200bffd0 2023-10-24T02:01:30.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49136/0 (socket says 172.21.15.148:49136) 2023-10-24T02:01:30.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 -- 172.21.15.148:0/4175771240 learned_addr learned my addr 172.21.15.148:0/4175771240 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:30.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1f7fe700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b24b4f700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 -- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 msgr2=0x7f9b200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 -- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 msgr2=0x7f9b20149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 -- 172.21.15.148:0/4175771240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10009370 con 0x7f9b20098bd0 2023-10-24T02:01:30.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b1ffff700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f9b10009ea0 tx=0x7f9b10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10000bc0 con 0x7f9b20098bd0 2023-10-24T02:01:30.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000b850 con 0x7f9b20098bd0 2023-10-24T02:01:30.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b200aba00 con 0x7f9b20098bd0 2023-10-24T02:01:30.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10000d20 con 0x7f9b20098bd0 2023-10-24T02:01:30.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.134+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b200abfc0 con 0x7f9b20098bd0 2023-10-24T02:01:30.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.135+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2006c6b0 con 0x7f9b20098bd0 2023-10-24T02:01:30.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.136+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b1001d890 con 0x7f9b20098bd0 2023-10-24T02:01:30.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.136+0000 7f9b07fff700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 0x7f9b0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.136+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f9b1007c050 con 0x7f9b20098bd0 2023-10-24T02:01:30.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.136+0000 7f9b1f7fe700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 0x7f9b0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.137+0000 7f9b1f7fe700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 0x7f9b0c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9b200add90 tx=0x7f9b14007d30).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.140+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b1004d340 con 0x7f9b20098bd0 2023-10-24T02:01:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.305+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b200612f0 con 0x7f9b20098bd0 2023-10-24T02:01:30.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.309+0000 7f9b07fff700 1 -- 172.21.15.148:0/4175771240 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b10050960 con 0x7f9b20098bd0 2023-10-24T02:01:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 msgr2=0x7f9b0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 0x7f9b0c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9b200add90 tx=0x7f9b14007d30).stop 2023-10-24T02:01:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 msgr2=0x7f9b200ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f9b10009ea0 tx=0x7f9b10017000).stop 2023-10-24T02:01:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 shutdown_connections 2023-10-24T02:01:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9b0c05f150 0x7f9b0c061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b20154430 0x7f9b20149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b20098bd0 0x7f9b200ab360 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 --2- 172.21.15.148:0/4175771240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b200bffd0 0x7f9b200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 >> 172.21.15.148:0/4175771240 conn(0x7f9b200cb070 msgr2=0x7f9b200c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 shutdown_connections 2023-10-24T02:01:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.311+0000 7f9b265b2700 1 -- 172.21.15.148:0/4175771240 wait complete. 2023-10-24T02:01:30.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T02:01:30.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:01:30.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:01:30.407 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T02:01:30.407 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T02:01:30.408 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:30.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.520+0000 7f6c92448700 1 Processor -- start 2023-10-24T02:01:30.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.520+0000 7f6c92448700 1 -- start start 2023-10-24T02:01:30.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c92448700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c8c152020 0x7f6c8c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c92448700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0c05b0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c92448700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c154e20 con 0x7f6c8c151c40 2023-10-24T02:01:30.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c92448700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c155100 con 0x7f6c8c152020 2023-10-24T02:01:30.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c909e5700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6c8c0a9e90 0x7f6c8c0c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48754/0 (socket says 172.21.15.148:48754) 2023-10-24T02:01:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c909e5700 1 -- 172.21.15.148:0/529886168 learned_addr learned my addr 172.21.15.148:0/529886168 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c8b7fe700 1 --2- 172.21.15.148:0/529886168 >> v2:172.21.15.150:3300/0 conn(0x7f6c8c152020 0x7f6c8c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623705230 0 0) 0x7f6c8c0c05b0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.521+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c740033f0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779181819 0 0) 0x7f6c740033f0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 >> v2:172.21.15.150:3300/0 conn(0x7f6c8c152020 msgr2=0x7f6c8c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 --2- 172.21.15.148:0/529886168 >> v2:172.21.15.150:3300/0 conn(0x7f6c8c152020 0x7f6c8c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 >> v1:172.21.15.150:6789/0 conn(0x7f6c8c151c40 legacy=0x7f6c8c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c1553e0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f6c840017f0 con 0x7f6c8c0a9e90 2023-10-24T02:01:30.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 >> v1:172.21.15.148:6789/0 conn(0x7f6c8c0a9e90 legacy=0x7f6c8c0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 0x7f6c74003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c74004690 0x7f6c74004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c74005000 0x7f6c7400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c155100 con 0x7f6c740038e0 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7400beb0 con 0x7f6c74004690 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7400c070 con 0x7f6c74005000 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 0x7f6c74003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8b7fe700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c74004690 0x7f6c74004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c909e5700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c74005000 0x7f6c7400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 -- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c74005000 msgr2=0x7f6c7400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:30.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c74005000 0x7f6c7400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 -- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c74004690 msgr2=0x7f6c74004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:30.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c74004690 0x7f6c74004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 -- 172.21.15.148:0/529886168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740033f0 con 0x7f6c740038e0 2023-10-24T02:01:30.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c909e5700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c74005000 0x7f6c7400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:30.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c909e5700 1 -- 172.21.15.148:0/529886168 reap_dead start 2023-10-24T02:01:30.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 0x7f6c74003d00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f6c7c001730 tx=0x7f6c7c007bb0).ready entity=mon.0 client_cookie=7cb34b37cb532e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c007020 con 0x7f6c740038e0 2023-10-24T02:01:30.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c007180 con 0x7f6c740038e0 2023-10-24T02:01:30.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.522+0000 7f6c8affd700 1 -- 172.21.15.148:0/529886168 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c007520 con 0x7f6c740038e0 2023-10-24T02:01:30.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 -- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 msgr2=0x7f6c74003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 0x7f6c74003d00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f6c7c001730 tx=0x7f6c7c007bb0).stop 2023-10-24T02:01:30.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 -- 172.21.15.148:0/529886168 shutdown_connections 2023-10-24T02:01:30.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 --2- 172.21.15.148:0/529886168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c740038e0 0x7f6c74003d00 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 -- 172.21.15.148:0/529886168 >> 172.21.15.148:0/529886168 conn(0x7f6c8c0caf40 msgr2=0x7f6c8c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 -- 172.21.15.148:0/529886168 shutdown_connections 2023-10-24T02:01:30.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.523+0000 7f6c92448700 1 -- 172.21.15.148:0/529886168 wait complete. 2023-10-24T02:01:30.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.524+0000 7f6c92448700 1 Processor -- start 2023-10-24T02:01:30.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.524+0000 7f6c92448700 1 -- start start 2023-10-24T02:01:30.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 0x7f6c8c0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 0x7f6c8c0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0ca310 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c2950 con 0x7f6c740038e0 2023-10-24T02:01:30.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c92448700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0c9700 con 0x7f6c8c0c1fe0 2023-10-24T02:01:30.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8b7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49152/0 (socket says 172.21.15.148:49152) 2023-10-24T02:01:30.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8b7fe700 1 -- 172.21.15.148:0/3871367803 learned_addr learned my addr 172.21.15.148:0/3871367803 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:30.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 0x7f6c8c0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c909e5700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 0x7f6c8c0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8b7fe700 1 -- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 msgr2=0x7f6c8c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.525+0000 7f6c8b7fe700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 0x7f6c8c0c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c8b7fe700 1 -- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 msgr2=0x7f6c8c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c8b7fe700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 0x7f6c8c0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c8b7fe700 1 -- 172.21.15.148:0/3871367803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0c99e0 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c909e5700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 0x7f6c8c0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 0x7f6c8c0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c8b7fe700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f6c80011a20 tx=0x7f6c80009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000f940 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000faa0 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0c9cc0 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000fe20 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.526+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0c9410 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.527+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c06c6b0 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.527+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6c80014650 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.527+0000 7f6c73fff700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 0x7f6c78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.528+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f6c8007ad90 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.528+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 0x7f6c78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.528+0000 7f6c8bfff700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 0x7f6c78061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6c7c001010 tx=0x7f6c7c015000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.532+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6c8004c080 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.737+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c8c0ca450 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.738+0000 7f6c73fff700 1 -- 172.21.15.148:0/3871367803 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f6c8004f6a0 con 0x7f6c8c0c8f90 2023-10-24T02:01:30.739 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:30.739 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8740,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/3701353188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":3701353188},{"type":"v1","addr":"172.21.15.150:6836","nonce":3701353188}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/1896954425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1896954425},{"type":"v1","addr":"172.21.15.148:6834","nonce":1896954425}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9117,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/2031131250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":2031131250},{"type":"v1","addr":"172.21.15.148:6835","nonce":2031131250}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3895351146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3895351146},{"type":"v1","addr":"172.21.15.150:6837","nonce":3895351146}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-10-24T02:01:30.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 msgr2=0x7f6c78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 0x7f6c78061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6c7c001010 tx=0x7f6c7c015000).stop 2023-10-24T02:01:30.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 msgr2=0x7f6c8c13aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f6c80011a20 tx=0x7f6c80009060).stop 2023-10-24T02:01:30.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 shutdown_connections 2023-10-24T02:01:30.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c8c0c1fe0 0x7f6c8c0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6c7805f150 0x7f6c78061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740038e0 0x7f6c8c0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 --2- 172.21.15.148:0/3871367803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c8c0c8f90 0x7f6c8c13aca0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.739+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 >> 172.21.15.148:0/3871367803 conn(0x7f6c8c0caf40 msgr2=0x7f6c8c150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.740+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 shutdown_connections 2023-10-24T02:01:30.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.740+0000 7f6c92448700 1 -- 172.21.15.148:0/3871367803 wait complete. 2023-10-24T02:01:30.743 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 64 2023-10-24T02:01:30.753 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T02:01:30.753 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T02:01:30.753 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T02:01:30.753 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:01:30.754 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T02:01:30.754 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T02:01:30.754 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T02:01:30.755 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:01:30.755 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T02:01:30.755 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T02:01:30.755 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T02:01:30.756 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:01:30.756 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T02:01:30.756 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T02:01:30.757 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T02:01:30.757 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:01:30.762 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T02:01:30.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T02:01:30.764 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T02:01:30.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T02:01:30.767 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T02:01:30.767 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T02:01:30.768 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T02:01:30.768 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T02:01:30.806 INFO:tasks.ceph.mds.a:Started 2023-10-24T02:01:30.807 DEBUG:teuthology.parallel:result is None 2023-10-24T02:01:30.807 INFO:tasks.ceph.mds.c:Started 2023-10-24T02:01:30.808 DEBUG:teuthology.parallel:result is None 2023-10-24T02:01:30.810 INFO:tasks.ceph.mds.b:Started 2023-10-24T02:01:30.810 DEBUG:teuthology.parallel:result is None 2023-10-24T02:01:30.811 INFO:tasks.ceph.mds.d:Started 2023-10-24T02:01:30.811 DEBUG:teuthology.parallel:result is None 2023-10-24T02:01:30.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T02:01:30.878 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T02:01:30.879 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T02:01:30.894 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T02:01:30.894 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T02:01:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.937+0000 7f0c2cc3a700 1 Processor -- start 2023-10-24T02:01:30.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.937+0000 7f0c2cc3a700 1 -- start start 2023-10-24T02:01:30.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2cc3a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c281547e0 0x7f0c280a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2cc3a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280c01c0 con 0x7f0c28154400 2023-10-24T02:01:30.940 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2cc3a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280c6150 con 0x7f0c280a82c0 2023-10-24T02:01:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2cc3a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280aa960 con 0x7f0c281547e0 2023-10-24T02:01:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0c28154400 0x7f0c280c8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48776/0 (socket says 172.21.15.148:48776) 2023-10-24T02:01:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c2659c700 1 -- 172.21.15.148:0/2457899502 learned_addr learned my addr 172.21.15.148:0/2457899502 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c1ffff700 1 --2- 172.21.15.148:0/2457899502 >> v2:172.21.15.150:3300/0 conn(0x7f0c281547e0 0x7f0c280a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.941 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.938+0000 7f0c25d9b700 1 -- 172.21.15.148:0/2457899502 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35254936 0 0) 0x7f0c280c01c0 con 0x7f0c28154400 2023-10-24T02:01:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c25d9b700 1 -- 172.21.15.148:0/2457899502 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c140033f0 con 0x7f0c28154400 2023-10-24T02:01:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c1ffff700 1 -- 172.21.15.148:0/2457899502 >> v1:172.21.15.150:6789/0 conn(0x7f0c280a82c0 legacy=0x7f0c280c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c1ffff700 1 -- 172.21.15.148:0/2457899502 >> v1:172.21.15.148:6789/0 conn(0x7f0c28154400 legacy=0x7f0c280c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c1ffff700 1 -- 172.21.15.148:0/2457899502 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280c66f0 con 0x7f0c281547e0 2023-10-24T02:01:30.942 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c1ffff700 1 --2- 172.21.15.148:0/2457899502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c281547e0 0x7f0c280a7dd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f0c10009760 tx=0x7f0c10009060).ready entity=mon.1 client_cookie=2d7033980cd663d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c25d9b700 1 -- 172.21.15.148:0/2457899502 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100090d0 con 0x7f0c281547e0 2023-10-24T02:01:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c25d9b700 1 -- 172.21.15.148:0/2457899502 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000f510 con 0x7f0c281547e0 2023-10-24T02:01:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c25d9b700 1 -- 172.21.15.148:0/2457899502 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000f890 con 0x7f0c281547e0 2023-10-24T02:01:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/2457899502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c281547e0 msgr2=0x7f0c280a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.943 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/2457899502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c281547e0 0x7f0c280a7dd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f0c10009760 tx=0x7f0c10009060).stop 2023-10-24T02:01:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/2457899502 shutdown_connections 2023-10-24T02:01:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/2457899502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c281547e0 0x7f0c280a7dd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/2457899502 >> 172.21.15.148:0/2457899502 conn(0x7f0c280946a0 msgr2=0x7f0c2806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/2457899502 shutdown_connections 2023-10-24T02:01:30.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.939+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/2457899502 wait complete. 2023-10-24T02:01:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 Processor -- start 2023-10-24T02:01:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 -- start start 2023-10-24T02:01:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c28154400 0x7f0c2814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c281547e0 0x7f0c280b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28154be0 con 0x7f0c280a82c0 2023-10-24T02:01:30.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b0a50 con 0x7f0c28154400 2023-10-24T02:01:30.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2cc3a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c281556f0 con 0x7f0c281547e0 2023-10-24T02:01:30.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.948 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49198/0 (socket says 172.21.15.148:49198) 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.941+0000 7f0c2659c700 1 -- 172.21.15.148:0/4004854607 learned_addr learned my addr 172.21.15.148:0/4004854607 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c1ffff700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c28154400 0x7f0c2814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c26d9d700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c281547e0 0x7f0c280b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 -- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c281547e0 msgr2=0x7f0c280b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c281547e0 0x7f0c280b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.949 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 -- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c28154400 msgr2=0x7f0c2814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c28154400 0x7f0c2814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 -- 172.21.15.148:0/4004854607 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100092a0 con 0x7f0c280a82c0 2023-10-24T02:01:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2659c700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f0c1800c590 tx=0x7f0c18007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800ce80 con 0x7f0c280a82c0 2023-10-24T02:01:30.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180072e0 con 0x7f0c280a82c0 2023-10-24T02:01:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28154dc0 con 0x7f0c280a82c0 2023-10-24T02:01:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18007660 con 0x7f0c280a82c0 2023-10-24T02:01:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.942+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28155400 con 0x7f0c280a82c0 2023-10-24T02:01:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.943+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c280c31b0 con 0x7f0c280a82c0 2023-10-24T02:01:30.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.943+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0c180059b0 con 0x7f0c280a82c0 2023-10-24T02:01:30.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.944+0000 7f0c1e7fc700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 0x7f0c08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:30.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.944+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f0c18079920 con 0x7f0c280a82c0 2023-10-24T02:01:30.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.944+0000 7f0c1ffff700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 0x7f0c08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:30.952 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.944+0000 7f0c1ffff700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 0x7f0c08061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0c10009760 tx=0x7f0c10017000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:30.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:30.948+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c1804ac10 con 0x7f0c280a82c0 2023-10-24T02:01:31.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:31.126+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0c280adb50 con 0x7f0c280a82c0 2023-10-24T02:01:32.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.002+0000 7f0c1e7fc700 1 -- 172.21.15.148:0/4004854607 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v197) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0c1804e230 con 0x7f0c280a82c0 2023-10-24T02:01:32.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 msgr2=0x7f0c08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 0x7f0c08061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0c10009760 tx=0x7f0c10017000).stop 2023-10-24T02:01:32.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 msgr2=0x7f0c280c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f0c1800c590 tx=0x7f0c18007c80).stop 2023-10-24T02:01:32.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 shutdown_connections 2023-10-24T02:01:32.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c281547e0 0x7f0c280b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c280a82c0 0x7f0c280c2c60 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0c0805f150 0x7f0c08061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 --2- 172.21.15.148:0/4004854607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c28154400 0x7f0c2814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 >> 172.21.15.148:0/4004854607 conn(0x7f0c280946a0 msgr2=0x7f0c280648e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 shutdown_connections 2023-10-24T02:01:32.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.004+0000 7f0c2cc3a700 1 -- 172.21.15.148:0/4004854607 wait complete. 2023-10-24T02:01:32.008 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T02:01:32.018 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T02:01:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.133+0000 7f534decc700 1 Processor -- start 2023-10-24T02:01:32.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.133+0000 7f534decc700 1 -- start start 2023-10-24T02:01:32.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f534decc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f534decc700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480aa820 con 0x7f53480aa3f0 2023-10-24T02:01:32.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f534decc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480c0960 con 0x7f53480aa010 2023-10-24T02:01:32.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f534decc700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480c0c40 con 0x7f53480c6710 2023-10-24T02:01:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f5346ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f5346ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49214/0 (socket says 172.21.15.148:49214) 2023-10-24T02:01:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f5346ffd700 1 -- 172.21.15.148:0/2368916923 learned_addr learned my addr 172.21.15.148:0/2368916923 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:32.138 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.134+0000 7f5347fff700 1 --1- 172.21.15.148:0/2368916923 >> v1:172.21.15.148:6789/0 conn(0x7f53480aa3f0 0x7f5348069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48782/0 (socket says 172.21.15.148:48782) 2023-10-24T02:01:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f5346ffd700 1 -- 172.21.15.148:0/2368916923 >> v1:172.21.15.150:6789/0 conn(0x7f53480aa010 legacy=0x7f5348158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f5346ffd700 1 -- 172.21.15.148:0/2368916923 >> v1:172.21.15.148:6789/0 conn(0x7f53480aa3f0 legacy=0x7f5348069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f5346ffd700 1 -- 172.21.15.148:0/2368916923 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c0f20 con 0x7f53480c6710 2023-10-24T02:01:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f53467fc700 1 -- 172.21.15.148:0/2368916923 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855924928 0 0) 0x7f53480aa820 con 0x7f53480aa3f0 2023-10-24T02:01:32.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f5346ffd700 1 --2- 172.21.15.148:0/2368916923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480c1a00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f533c006fd0 tx=0x7f533c0090f0).ready entity=mon.0 client_cookie=e82d86bc691f2848 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f53467fc700 1 -- 172.21.15.148:0/2368916923 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00b600 con 0x7f53480c6710 2023-10-24T02:01:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f53467fc700 1 -- 172.21.15.148:0/2368916923 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00b760 con 0x7f53480c6710 2023-10-24T02:01:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f53467fc700 1 -- 172.21.15.148:0/2368916923 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00bae0 con 0x7f53480c6710 2023-10-24T02:01:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f534decc700 1 -- 172.21.15.148:0/2368916923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 msgr2=0x7f53480c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f534decc700 1 --2- 172.21.15.148:0/2368916923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480c1a00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f533c006fd0 tx=0x7f533c0090f0).stop 2023-10-24T02:01:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f534decc700 1 -- 172.21.15.148:0/2368916923 shutdown_connections 2023-10-24T02:01:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f534decc700 1 --2- 172.21.15.148:0/2368916923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480c1a00 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.135+0000 7f534decc700 1 -- 172.21.15.148:0/2368916923 >> 172.21.15.148:0/2368916923 conn(0x7f53480caf40 msgr2=0x7f53480cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.136+0000 7f534decc700 1 -- 172.21.15.148:0/2368916923 shutdown_connections 2023-10-24T02:01:32.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.136+0000 7f534decc700 1 -- 172.21.15.148:0/2368916923 wait complete. 2023-10-24T02:01:32.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 Processor -- start 2023-10-24T02:01:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 -- start start 2023-10-24T02:01:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 0x7f5348157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53480aa3f0 0x7f5348167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53481558b0 con 0x7f53480c6710 2023-10-24T02:01:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348168350 con 0x7f53480aa3f0 2023-10-24T02:01:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.137+0000 7f534decc700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348168630 con 0x7f53480aa010 2023-10-24T02:01:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49228/0 (socket says 172.21.15.148:49228) 2023-10-24T02:01:32.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 -- 172.21.15.148:0/2744929092 learned_addr learned my addr 172.21.15.148:0/2744929092 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5346ffd700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53480aa3f0 0x7f5348167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f53477fe700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 0x7f5348157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 -- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 msgr2=0x7f5348157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 0x7f5348157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 -- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53480aa3f0 msgr2=0x7f5348167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53480aa3f0 0x7f5348167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 -- 172.21.15.148:0/2744929092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009370 con 0x7f53480c6710 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f53477fe700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 0x7f5348157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f5347fff700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f534000c440 tx=0x7f5340007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000ce60 con 0x7f53480c6710 2023-10-24T02:01:32.148 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400072e0 con 0x7f53480c6710 2023-10-24T02:01:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348155b20 con 0x7f53480c6710 2023-10-24T02:01:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400056e0 con 0x7f53480c6710 2023-10-24T02:01:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.138+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53480ae3e0 con 0x7f53480c6710 2023-10-24T02:01:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.139+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53480ae570 con 0x7f53480c6710 2023-10-24T02:01:32.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.139+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5340005a90 con 0x7f53480c6710 2023-10-24T02:01:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.140+0000 7f532f7fe700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 0x7f53340615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.140+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f53400796b0 con 0x7f53480c6710 2023-10-24T02:01:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.140+0000 7f53477fe700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 0x7f53340615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.140+0000 7f53477fe700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 0x7f53340615e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5338001d90 tx=0x7f5338009040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.144+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f534004aca0 con 0x7f53480c6710 2023-10-24T02:01:32.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.368+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f534806c6b0 con 0x7f53480c6710 2023-10-24T02:01:32.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.369+0000 7f532f7fe700 1 -- 172.21.15.148:0/2744929092 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5340018030 con 0x7f53480c6710 2023-10-24T02:01:32.370 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:32.370 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:01:32.370 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T02:01:32.371 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.371 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T02:01:32.371 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T02:01:32.371 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.371 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:01:32.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:01:32.372 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.372 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.373 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.373 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T02:01:32.373 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T02:01:32.373 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.373 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:01:32.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:01:32.374 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.374 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:01:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:01:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.376 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.377 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T02:01:32.377 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T02:01:32.377 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.377 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.377 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.378 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T02:01:32.379 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T02:01:32.379 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.379 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.379 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.379 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.380 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.380 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.380 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T02:01:32.380 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T02:01:32.381 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.381 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.381 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.381 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.381 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.382 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.382 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T02:01:32.382 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T02:01:32.382 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.383 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.384 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T02:01:32.384 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T02:01:32.384 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.384 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.384 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.385 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T02:01:32.386 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T02:01:32.386 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.386 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.386 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.387 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.387 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.387 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.387 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.388 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.389 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.389 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T02:01:32.389 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T02:01:32.389 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.390 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.390 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.390 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.390 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.390 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.391 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.391 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T02:01:32.391 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T02:01:32.391 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.391 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.392 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T02:01:32.393 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.394 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.394 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T02:01:32.394 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T02:01:32.394 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.395 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.395 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:01:32.395 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:01:32.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:01:32.395 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.396 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.397 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:01:32.397 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:01:32.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:01:32.397 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.398 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.398 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T02:01:32.398 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T02:01:32.398 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:01:32.399 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:01:32.399 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:01:32.399 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:01:32.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:01:32.400 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.401 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T02:01:32.402 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T02:01:32.402 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:01:32.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T02:01:32.402 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:32.403 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:32.403 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T02:01:32.403 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:32.405 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T02:01:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:01:32.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 msgr2=0x7f53340615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 0x7f53340615e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5338001d90 tx=0x7f5338009040).stop 2023-10-24T02:01:32.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 msgr2=0x7f53480adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f534000c440 tx=0x7f5340007b90).stop 2023-10-24T02:01:32.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 shutdown_connections 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53480c6710 0x7f53480adef0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53480aa010 0x7f5348157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f533405f120 0x7f53340615e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 --2- 172.21.15.148:0/2744929092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53480aa3f0 0x7f5348167b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 >> 172.21.15.148:0/2744929092 conn(0x7f53480caf40 msgr2=0x7f53480cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.408 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 shutdown_connections 2023-10-24T02:01:32.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.371+0000 7f534decc700 1 -- 172.21.15.148:0/2744929092 wait complete. 2023-10-24T02:01:32.409 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:32.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.521+0000 7fce51cdd700 1 Processor -- start 2023-10-24T02:01:32.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.521+0000 7fce51cdd700 1 -- start start 2023-10-24T02:01:32.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce51cdd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 0x7fce4c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce51cdd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce4c0c6710 0x7fce4c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce51cdd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0c0960 con 0x7fce4c158770 2023-10-24T02:01:32.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce51cdd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0aa8e0 con 0x7fce4c0c6710 2023-10-24T02:01:32.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce51cdd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c0c40 con 0x7fce4c0aa010 2023-10-24T02:01:32.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce4affd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fce4c0c6710 0x7fce4c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce4bfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fce4c158770 0x7fce4c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48796/0 (socket says 172.21.15.148:48796) 2023-10-24T02:01:32.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.522+0000 7fce4bfff700 1 -- 172.21.15.148:0/3356236563 learned_addr learned my addr 172.21.15.148:0/3356236563 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:32.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4b7fe700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 0x7fce4c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4affd700 1 -- 172.21.15.148:0/3356236563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 msgr2=0x7fce4c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:32.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4affd700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 0x7fce4c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4affd700 1 -- 172.21.15.148:0/3356236563 >> v1:172.21.15.148:6789/0 conn(0x7fce4c158770 legacy=0x7fce4c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4a7fc700 1 -- 172.21.15.148:0/3356236563 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423863135 0 0) 0x7fce4c0c0960 con 0x7fce4c158770 2023-10-24T02:01:32.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4affd700 1 -- 172.21.15.148:0/3356236563 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0c0f20 con 0x7fce4c0c6710 2023-10-24T02:01:32.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4b7fe700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 0x7fce4c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:32.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4affd700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c0aa3f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fce40009760 tx=0x7fce40009060).ready entity=mon.0 client_cookie=db1fd0a51efa7199 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4a7fc700 1 -- 172.21.15.148:0/3356236563 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000b580 con 0x7fce4c0c6710 2023-10-24T02:01:32.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4a7fc700 1 -- 172.21.15.148:0/3356236563 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b6e0 con 0x7fce4c0c6710 2023-10-24T02:01:32.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.523+0000 7fce4a7fc700 1 -- 172.21.15.148:0/3356236563 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000ba60 con 0x7fce4c0c6710 2023-10-24T02:01:32.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 -- 172.21.15.148:0/3356236563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 msgr2=0x7fce4c0aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c0aa3f0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7fce40009760 tx=0x7fce40009060).stop 2023-10-24T02:01:32.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 -- 172.21.15.148:0/3356236563 shutdown_connections 2023-10-24T02:01:32.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c0aa010 0x7fce4c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 --2- 172.21.15.148:0/3356236563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c0aa3f0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 -- 172.21.15.148:0/3356236563 >> 172.21.15.148:0/3356236563 conn(0x7fce4c0caf40 msgr2=0x7fce4c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 -- 172.21.15.148:0/3356236563 shutdown_connections 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.524+0000 7fce51cdd700 1 -- 172.21.15.148:0/3356236563 wait complete. 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.525+0000 7fce51cdd700 1 Processor -- start 2023-10-24T02:01:32.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.525+0000 7fce51cdd700 1 -- start start 2023-10-24T02:01:32.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce4c0aa010 0x7fce4c0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c158770 0x7fce4c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c152660 con 0x7fce4c0c6710 2023-10-24T02:01:32.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0a1c70 con 0x7fce4c0aa010 2023-10-24T02:01:32.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c3280 con 0x7fce4c158770 2023-10-24T02:01:32.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49242/0 (socket says 172.21.15.148:49242) 2023-10-24T02:01:32.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 -- 172.21.15.148:0/1507638051 learned_addr learned my addr 172.21.15.148:0/1507638051 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:32.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4bfff700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c158770 0x7fce4c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4b7fe700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce4c0aa010 0x7fce4c0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 -- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c158770 msgr2=0x7fce4c0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c158770 0x7fce4c0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 -- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce4c0aa010 msgr2=0x7fce4c0c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce4c0aa010 0x7fce4c0c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 -- 172.21.15.148:0/1507638051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400092a0 con 0x7fce4c0c6710 2023-10-24T02:01:32.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce4affd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fce4c084230 tx=0x7fce40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40000bc0 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b850 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c165750 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40000d20 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.526+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c0c2c30 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c06c6b0 con 0x7fce4c0c6710 2023-10-24T02:01:32.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fce4001b8f0 con 0x7fce4c0c6710 2023-10-24T02:01:32.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce337fe700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fce4007ba10 con 0x7fce4c0c6710 2023-10-24T02:01:32.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce4b7fe700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.528+0000 7fce4b7fe700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce4c167d10 tx=0x7fce3c007850).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.532+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fce4004d000 con 0x7fce4c0c6710 2023-10-24T02:01:32.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.696+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce4c0c33c0 con 0x7fce4c0c6710 2023-10-24T02:01:32.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.697+0000 7fce337fe700 1 -- 172.21.15.148:0/1507638051 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+13842 (secure 0 0 0) 0x7fce4001f020 con 0x7fce4c0c6710 2023-10-24T02:01:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:32.698 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":197,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:31.999276+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:32.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 msgr2=0x7fce38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fce4c167d10 tx=0x7fce3c007850).stop 2023-10-24T02:01:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 msgr2=0x7fce4c165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7fce4c084230 tx=0x7fce40017000).stop 2023-10-24T02:01:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 shutdown_connections 2023-10-24T02:01:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce4c158770 0x7fce4c0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce4c0aa010 0x7fce4c0c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 --2- 172.21.15.148:0/1507638051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce4c0c6710 0x7fce4c165260 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 >> 172.21.15.148:0/1507638051 conn(0x7fce4c0caf40 msgr2=0x7fce4c0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 shutdown_connections 2023-10-24T02:01:32.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.699+0000 7fce51cdd700 1 -- 172.21.15.148:0/1507638051 wait complete. 2023-10-24T02:01:32.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T02:01:32.713 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T02:01:32.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.830+0000 7fa00b59e700 1 Processor -- start 2023-10-24T02:01:32.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.830+0000 7fa00b59e700 1 -- start start 2023-10-24T02:01:32.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa00c157780 0x7fa00c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00b59e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa00c0c0960 0x7fa00c0a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0c6770 con 0x7fa00c0a8120 2023-10-24T02:01:32.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00b59e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0c1120 con 0x7fa00c0c0960 2023-10-24T02:01:32.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0c1400 con 0x7fa00c157780 2023-10-24T02:01:32.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa00c0c0960 0x7fa00c0a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa00c0a8120 0x7fa00c0a9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48810/0 (socket says 172.21.15.148:48810) 2023-10-24T02:01:32.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00ad9d700 1 -- 172.21.15.148:0/3433514140 learned_addr learned my addr 172.21.15.148:0/3433514140 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:32.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa00c0c0960 0x7fa00c0a7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49250/0 (socket says 172.21.15.148:49250) 2023-10-24T02:01:32.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00a59c700 1 --2- 172.21.15.148:0/3433514140 >> v2:172.21.15.150:3300/0 conn(0x7fa00c157780 0x7fa00c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 -- 172.21.15.148:0/3433514140 >> v2:172.21.15.150:3300/0 conn(0x7fa00c157780 msgr2=0x7fa00c0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:32.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 --2- 172.21.15.148:0/3433514140 >> v2:172.21.15.150:3300/0 conn(0x7fa00c157780 0x7fa00c0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 -- 172.21.15.148:0/3433514140 >> v1:172.21.15.148:6789/0 conn(0x7fa00c0a8120 legacy=0x7fa00c0a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 -- 172.21.15.148:0/3433514140 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0c6120 con 0x7fa00c0c0960 2023-10-24T02:01:32.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa00959a700 1 -- 172.21.15.148:0/3433514140 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320842547 0 0) 0x7fa00c0c6770 con 0x7fa00c0a8120 2023-10-24T02:01:32.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.831+0000 7fa009d9b700 1 --2- 172.21.15.148:0/3433514140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c0a7c30 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fa00c0c08b0 tx=0x7fa000009060).ready entity=mon.0 client_cookie=1d2dc17ad93c3e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00959a700 1 -- 172.21.15.148:0/3433514140 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000090d0 con 0x7fa00c0c0960 2023-10-24T02:01:32.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00959a700 1 -- 172.21.15.148:0/3433514140 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000b580 con 0x7fa00c0c0960 2023-10-24T02:01:32.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00959a700 1 -- 172.21.15.148:0/3433514140 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000b900 con 0x7fa00c0c0960 2023-10-24T02:01:32.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 -- 172.21.15.148:0/3433514140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 msgr2=0x7fa00c0a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 --2- 172.21.15.148:0/3433514140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c0a7c30 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fa00c0c08b0 tx=0x7fa000009060).stop 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 -- 172.21.15.148:0/3433514140 shutdown_connections 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 --2- 172.21.15.148:0/3433514140 >> v2:172.21.15.150:3300/0 conn(0x7fa00c157780 0x7fa00c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 --2- 172.21.15.148:0/3433514140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c0a7c30 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 -- 172.21.15.148:0/3433514140 >> 172.21.15.148:0/3433514140 conn(0x7fa00c094570 msgr2=0x7fa00c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 -- 172.21.15.148:0/3433514140 shutdown_connections 2023-10-24T02:01:32.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.832+0000 7fa00b59e700 1 -- 172.21.15.148:0/3433514140 wait complete. 2023-10-24T02:01:32.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.833+0000 7fa00b59e700 1 Processor -- start 2023-10-24T02:01:32.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.833+0000 7fa00b59e700 1 -- start start 2023-10-24T02:01:32.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa00c0a8120 0x7fa00c142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.842 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa00c157780 0x7fa00c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cb880 con 0x7fa00c0c0960 2023-10-24T02:01:32.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c3610 con 0x7fa00c157780 2023-10-24T02:01:32.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0c96e0 con 0x7fa00c0a8120 2023-10-24T02:01:32.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49264/0 (socket says 172.21.15.148:49264) 2023-10-24T02:01:32.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 -- 172.21.15.148:0/4136520087 learned_addr learned my addr 172.21.15.148:0/4136520087 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:32.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 -- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa00c0a8120 msgr2=0x7fa00c142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.844 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa00c0a8120 0x7fa00c142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:32.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 -- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa00c157780 msgr2=0x7fa00c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:32.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa00ad9d700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa00c157780 0x7fa00c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa00c157780 0x7fa00c0c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:32.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.834+0000 7fa009d9b700 1 -- 172.21.15.148:0/4136520087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000092a0 con 0x7fa00c0c0960 2023-10-24T02:01:32.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7fa009d9b700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fa00c05f980 tx=0x7fa000017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000b900 con 0x7fa00c0c0960 2023-10-24T02:01:32.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa000000d10 con 0x7fa00c0c0960 2023-10-24T02:01:32.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0c8db0 con 0x7fa00c0c0960 2023-10-24T02:01:32.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000bed0 con 0x7fa00c0c0960 2023-10-24T02:01:32.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.835+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0c9370 con 0x7fa00c0c0960 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.836+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c0a7f20 con 0x7fa00c0c0960 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.836+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa00001b620 con 0x7fa00c0c0960 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.836+0000 7f9ffa7fc700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 0x7f9fec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.836+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fa00007b920 con 0x7fa00c0c0960 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.837+0000 7fa00a59c700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 0x7f9fec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.837+0000 7fa00a59c700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 0x7f9fec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9ffc006920 tx=0x7f9ffc008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:32.848 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:32.840+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa00004cf10 con 0x7fa00c0c0960 2023-10-24T02:01:33.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.004+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa00c047480 con 0x7fa00c0c0960 2023-10-24T02:01:33.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.005+0000 7f9ffa7fc700 1 -- 172.21.15.148:0/4136520087 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v197) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa000050530 con 0x7fa00c0c0960 2023-10-24T02:01:33.005 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T02:01:33.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 msgr2=0x7f9fec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 0x7f9fec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9ffc006920 tx=0x7f9ffc008040).stop 2023-10-24T02:01:33.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 msgr2=0x7fa00c164870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fa00c05f980 tx=0x7fa000017000).stop 2023-10-24T02:01:33.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 shutdown_connections 2023-10-24T02:01:33.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9fec05f150 0x7f9fec061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa00c157780 0x7fa00c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa00c0a8120 0x7fa00c142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:33.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 --2- 172.21.15.148:0/4136520087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa00c0c0960 0x7fa00c164870 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 >> 172.21.15.148:0/4136520087 conn(0x7fa00c094570 msgr2=0x7fa00c0c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 shutdown_connections 2023-10-24T02:01:33.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.007+0000 7fa00b59e700 1 -- 172.21.15.148:0/4136520087 wait complete. 2023-10-24T02:01:33.020 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T02:01:33.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 Processor -- start 2023-10-24T02:01:33.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 -- start start 2023-10-24T02:01:33.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8744154150 0x7f87440a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440aa390 0x7f87440c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87440c0e30 0x7f87440c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440a9830 con 0x7f8744154150 2023-10-24T02:01:33.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87440c12c0 con 0x7f87440c0e30 2023-10-24T02:01:33.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.136+0000 7f87489cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440a8c20 con 0x7f87440aa390 2023-10-24T02:01:33.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8744154150 0x7f87440a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8744154150 0x7f87440a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49280/0 (socket says 172.21.15.148:49280) 2023-10-24T02:01:33.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 -- 172.21.15.148:0/962691270 learned_addr learned my addr 172.21.15.148:0/962691270 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:33.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f874359e700 1 --2- 172.21.15.148:0/962691270 >> v2:172.21.15.150:3300/0 conn(0x7f87440c0e30 0x7f87440c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f873a59c700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440aa390 0x7f87440c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 -- 172.21.15.148:0/962691270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440aa390 msgr2=0x7f87440c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440aa390 0x7f87440c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 -- 172.21.15.148:0/962691270 >> v2:172.21.15.150:3300/0 conn(0x7f87440c0e30 msgr2=0x7f87440c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 --2- 172.21.15.148:0/962691270 >> v2:172.21.15.150:3300/0 conn(0x7f87440c0e30 0x7f87440c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 -- 172.21.15.148:0/962691270 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440a8f00 con 0x7f8744154150 2023-10-24T02:01:33.142 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f8742d9d700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744154150 0x7f87440a8640 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f8744084630 tx=0x7f8734009060).ready entity=mon.0 client_cookie=71ad53f30e115a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f874259c700 1 -- 172.21.15.148:0/962691270 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734005880 con 0x7f8744154150 2023-10-24T02:01:33.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f874259c700 1 -- 172.21.15.148:0/962691270 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340059e0 con 0x7f8744154150 2023-10-24T02:01:33.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.137+0000 7f874259c700 1 -- 172.21.15.148:0/962691270 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734005d60 con 0x7f8744154150 2023-10-24T02:01:33.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 -- 172.21.15.148:0/962691270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744154150 msgr2=0x7f87440a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744154150 0x7f87440a8640 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f8744084630 tx=0x7f8734009060).stop 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 -- 172.21.15.148:0/962691270 shutdown_connections 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744154150 0x7f87440a8640 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 --2- 172.21.15.148:0/962691270 >> v2:172.21.15.150:3300/0 conn(0x7f87440c0e30 0x7f87440c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 --2- 172.21.15.148:0/962691270 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440aa390 0x7f87440c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 -- 172.21.15.148:0/962691270 >> 172.21.15.148:0/962691270 conn(0x7f8744094500 msgr2=0x7f874406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 -- 172.21.15.148:0/962691270 shutdown_connections 2023-10-24T02:01:33.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.138+0000 7f87489cb700 1 -- 172.21.15.148:0/962691270 wait complete. 2023-10-24T02:01:33.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.139+0000 7f87489cb700 1 Processor -- start 2023-10-24T02:01:33.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.139+0000 7f87489cb700 1 -- start start 2023-10-24T02:01:33.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.149 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440c0e30 0x7f87440b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8744154150 0x7f87440acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8744157000 con 0x7f87440aa390 2023-10-24T02:01:33.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87440b0b80 con 0x7f8744154150 2023-10-24T02:01:33.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87440b0e60 con 0x7f87440c0e30 2023-10-24T02:01:33.150 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49286/0 (socket says 172.21.15.148:49286) 2023-10-24T02:01:33.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 -- 172.21.15.148:0/1426404211 learned_addr learned my addr 172.21.15.148:0/1426404211 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:33.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f873a59c700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440c0e30 0x7f87440b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f874359e700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8744154150 0x7f87440acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.151 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 -- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440c0e30 msgr2=0x7f87440b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440c0e30 0x7f87440b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 -- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8744154150 msgr2=0x7f87440acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8744154150 0x7f87440acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 -- 172.21.15.148:0/1426404211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009300 con 0x7f87440aa390 2023-10-24T02:01:33.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f8742d9d700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f873400b3c0 tx=0x7f8734016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734005880 con 0x7f87440aa390 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734006770 con 0x7f87440aa390 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87441569b0 con 0x7f87440aa390 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400ba60 con 0x7f87440aa390 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.140+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744152a30 con 0x7f87440aa390 2023-10-24T02:01:33.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.142+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87441572e0 con 0x7f87440aa390 2023-10-24T02:01:33.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.142+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8734018070 con 0x7f87440aa390 2023-10-24T02:01:33.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.142+0000 7f873b7fe700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 0x7f8724061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.142+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f873407ac40 con 0x7f87440aa390 2023-10-24T02:01:33.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.142+0000 7f873a59c700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 0x7f8724061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.143+0000 7f873a59c700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 0x7f8724061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8744153b30 tx=0x7f872c008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.146+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f873404c2e0 con 0x7f87440aa390 2023-10-24T02:01:33.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.309+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8744047480 con 0x7f87440aa390 2023-10-24T02:01:33.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.310+0000 7f873b7fe700 1 -- 172.21.15.148:0/1426404211 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f873404f900 con 0x7f87440aa390 2023-10-24T02:01:33.310 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T02:01:33.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.311+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 msgr2=0x7f8724061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.311+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 0x7f8724061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8744153b30 tx=0x7f872c008040).stop 2023-10-24T02:01:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.311+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 msgr2=0x7f8744152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.311+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f873400b3c0 tx=0x7f8734016000).stop 2023-10-24T02:01:33.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 shutdown_connections 2023-10-24T02:01:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f872405f150 0x7f8724061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8744154150 0x7f87440acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f87440aa390 0x7f8744152540 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 --2- 172.21.15.148:0/1426404211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87440c0e30 0x7f87440b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 >> 172.21.15.148:0/1426404211 conn(0x7f8744094500 msgr2=0x7f874406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 shutdown_connections 2023-10-24T02:01:33.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.312+0000 7f87489cb700 1 -- 172.21.15.148:0/1426404211 wait complete. 2023-10-24T02:01:33.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T02:01:33.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.436+0000 7fe00c62c700 1 Processor -- start 2023-10-24T02:01:33.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.437+0000 7fe00c62c700 1 -- start start 2023-10-24T02:01:33.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.437+0000 7fe00c62c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe0040aa010 0x7fe0040c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00c62c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fe004069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00c62c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0040aa860 con 0x7fe0040c6710 2023-10-24T02:01:33.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00c62c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0040c0960 con 0x7fe0040aa010 2023-10-24T02:01:33.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00c62c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c0c40 con 0x7fe0040aa3f0 2023-10-24T02:01:33.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe009bc7700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe0040c6710 0x7fe004158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46494/0 (socket says 172.21.15.148:46494) 2023-10-24T02:01:33.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe009bc7700 1 -- 172.21.15.148:0/1625879151 learned_addr learned my addr 172.21.15.148:0/1625879151 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:33.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00abc9700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fe004069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> v2:172.21.15.150:3300/0 conn(0x7fe0040aa010 0x7fe0040c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432389082 0 0) 0x7fe0040aa860 con 0x7fe0040c6710 2023-10-24T02:01:33.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00033f0 con 0x7fe0040c6710 2023-10-24T02:01:33.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3581229468 0 0) 0x7fdff00033f0 con 0x7fe0040c6710 2023-10-24T02:01:33.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 msgr2=0x7fe004069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fe004069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 >> v2:172.21.15.150:3300/0 conn(0x7fe0040aa010 msgr2=0x7fe0040c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 --2- 172.21.15.148:0/1625879151 >> v2:172.21.15.150:3300/0 conn(0x7fe0040aa010 0x7fe0040c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040c0f20 con 0x7fe0040c6710 2023-10-24T02:01:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fdff4001470 con 0x7fe0040c6710 2023-10-24T02:01:33.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 >> v1:172.21.15.148:6789/0 conn(0x7fe0040c6710 legacy=0x7fe004158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdff00038e0 0x7fdff0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fdff0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c0960 con 0x7fdff00038e0 2023-10-24T02:01:33.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c0c40 con 0x7fdff0004690 2023-10-24T02:01:33.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000b8e0 con 0x7fe0040aa3f0 2023-10-24T02:01:33.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.438+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> v2:172.21.15.150:3300/0 conn(0x7fe0040aa010 0x7fe0040c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:33.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00abc9700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fdff0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdff00038e0 0x7fdff0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe009bc7700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 -- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 msgr2=0x7fdff0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe0040aa3f0 0x7fdff0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 -- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff0004690 msgr2=0x7fdff0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff0004690 0x7fdff0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 -- 172.21.15.148:0/1625879151 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00033f0 con 0x7fdff00038e0 2023-10-24T02:01:33.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdff00038e0 0x7fdff0003d00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fe00000e3c0 tx=0x7fe00000b040).ready entity=mon.0 client_cookie=c9a53dd1d8697262 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000017070 con 0x7fdff00038e0 2023-10-24T02:01:33.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000f040 con 0x7fdff00038e0 2023-10-24T02:01:33.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.439+0000 7fe0093c6700 1 -- 172.21.15.148:0/1625879151 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000ee80 con 0x7fdff00038e0 2023-10-24T02:01:33.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 -- 172.21.15.148:0/1625879151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdff00038e0 msgr2=0x7fdff0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 --2- 172.21.15.148:0/1625879151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdff00038e0 0x7fdff0003d00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fe00000e3c0 tx=0x7fe00000b040).stop 2023-10-24T02:01:33.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00abc9700 1 -- 172.21.15.148:0/1625879151 reap_dead start 2023-10-24T02:01:33.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 -- 172.21.15.148:0/1625879151 shutdown_connections 2023-10-24T02:01:33.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 -- 172.21.15.148:0/1625879151 >> 172.21.15.148:0/1625879151 conn(0x7fe0040caf40 msgr2=0x7fe0040cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 -- 172.21.15.148:0/1625879151 shutdown_connections 2023-10-24T02:01:33.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.440+0000 7fe00c62c700 1 -- 172.21.15.148:0/1625879151 wait complete. 2023-10-24T02:01:33.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.441+0000 7fe00c62c700 1 Processor -- start 2023-10-24T02:01:33.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.441+0000 7fe00c62c700 1 -- start start 2023-10-24T02:01:33.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.441+0000 7fe00c62c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff00038e0 0x7fe00414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00414b640 0x7fe00414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c3060 con 0x7fe0040c9bc0 2023-10-24T02:01:33.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c3340 con 0x7fe00414b640 2023-10-24T02:01:33.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040c3620 con 0x7fdff00038e0 2023-10-24T02:01:33.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52996/0 (socket says 172.21.15.148:52996) 2023-10-24T02:01:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 -- 172.21.15.148:0/4168468020 learned_addr learned my addr 172.21.15.148:0/4168468020 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00abc9700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00414b640 0x7fe00414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff00038e0 0x7fe00414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 -- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff00038e0 msgr2=0x7fe00414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff00038e0 0x7fe00414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 -- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00414b640 msgr2=0x7fe00414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00414b640 0x7fe00414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 -- 172.21.15.148:0/4168468020 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040c3bb0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe009bc7700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fdff4004990 tx=0x7fe0040c6390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011590 con 0x7fe0040c9bc0 2023-10-24T02:01:33.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff40116f0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0040c3e90 con 0x7fe0040c9bc0 2023-10-24T02:01:33.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011a70 con 0x7fe0040c9bc0 2023-10-24T02:01:33.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.442+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0040c22f0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.443+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00406c6b0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.444+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdff401d3b0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.444+0000 7fdffa7fc700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 0x7fdfe8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.444+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fdff40796b0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.444+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 0x7fdfe8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.445+0000 7fe00a3c8700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 0x7fdfe8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe00000afd0 tx=0x7fe000019000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.448+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdff404acf0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.615+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0040c1200 con 0x7fe0040c9bc0 2023-10-24T02:01:33.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.616+0000 7fdffa7fc700 1 -- 172.21.15.148:0/4168468020 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v197) v1 ==== 84+0+143 (secure 0 0 0) 0x7fdff40790a0 con 0x7fe0040c9bc0 2023-10-24T02:01:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:33.617 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T02:01:33.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:33.617 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T02:01:33.617 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T02:01:33.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:01:33.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:33.618 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T02:01:33.618 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T02:01:33.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:33.618 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T02:01:33.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 msgr2=0x7fdfe8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 0x7fdfe8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe00000afd0 tx=0x7fe000019000).stop 2023-10-24T02:01:33.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 msgr2=0x7fe0040ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7fdff4004990 tx=0x7fe0040c6390).stop 2023-10-24T02:01:33.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 shutdown_connections 2023-10-24T02:01:33.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdfe805f150 0x7fdfe8061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe00414b640 0x7fe00414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff00038e0 0x7fe00414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 --2- 172.21.15.148:0/4168468020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0040c9bc0 0x7fe0040ca040 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 >> 172.21.15.148:0/4168468020 conn(0x7fe0040caf40 msgr2=0x7fe0040aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 shutdown_connections 2023-10-24T02:01:33.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.617+0000 7fe00c62c700 1 -- 172.21.15.148:0/4168468020 wait complete. 2023-10-24T02:01:33.630 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T02:01:33.630 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T02:01:33.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.748+0000 7efcb576e700 1 Processor -- start 2023-10-24T02:01:33.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.748+0000 7efcb576e700 1 -- start start 2023-10-24T02:01:33.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcb576e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efcb0135390 0x7efcb00c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcb576e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 0x7efcb00c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcb576e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb00be9e0 con 0x7efcb01539a0 2023-10-24T02:01:33.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcb576e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb00c3e20 con 0x7efcb0135390 2023-10-24T02:01:33.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcb576e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb00bde40 con 0x7efcb0066ba0 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efcb0135390 0x7efcb00c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efcb0135390 0x7efcb00c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53006/0 (socket says 172.21.15.148:53006) 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 -- 172.21.15.148:0/1308127522 learned_addr learned my addr 172.21.15.148:0/1308127522 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcae7fc700 1 --1- 172.21.15.148:0/1308127522 >> v1:172.21.15.148:6789/0 conn(0x7efcb01539a0 0x7efcb0066490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46500/0 (socket says 172.21.15.148:46500) 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaf7fe700 1 --2- 172.21.15.148:0/1308127522 >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 0x7efcb00c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 -- 172.21.15.148:0/1308127522 >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 msgr2=0x7efcb00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:33.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 --2- 172.21.15.148:0/1308127522 >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 0x7efcb00c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 -- 172.21.15.148:0/1308127522 >> v1:172.21.15.148:6789/0 conn(0x7efcb01539a0 legacy=0x7efcb0066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcadffb700 1 -- 172.21.15.148:0/1308127522 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355679855 0 0) 0x7efcb00be9e0 con 0x7efcb01539a0 2023-10-24T02:01:33.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaeffd700 1 -- 172.21.15.148:0/1308127522 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0135770 con 0x7efcb0135390 2023-10-24T02:01:33.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.749+0000 7efcaf7fe700 1 --2- 172.21.15.148:0/1308127522 >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 0x7efcb00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcaeffd700 1 --2- 172.21.15.148:0/1308127522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0135390 0x7efcb00c3440 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7efcb0067580 tx=0x7efca0009060).ready entity=mon.0 client_cookie=665af1101fa68fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcadffb700 1 -- 172.21.15.148:0/1308127522 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005880 con 0x7efcb0135390 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcadffb700 1 -- 172.21.15.148:0/1308127522 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00059e0 con 0x7efcb0135390 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcadffb700 1 -- 172.21.15.148:0/1308127522 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005d60 con 0x7efcb0135390 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 -- 172.21.15.148:0/1308127522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0135390 msgr2=0x7efcb00c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 --2- 172.21.15.148:0/1308127522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0135390 0x7efcb00c3440 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7efcb0067580 tx=0x7efca0009060).stop 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 -- 172.21.15.148:0/1308127522 shutdown_connections 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 --2- 172.21.15.148:0/1308127522 >> v2:172.21.15.150:3300/0 conn(0x7efcb0066ba0 0x7efcb00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 --2- 172.21.15.148:0/1308127522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0135390 0x7efcb00c3440 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 -- 172.21.15.148:0/1308127522 >> 172.21.15.148:0/1308127522 conn(0x7efcb0063120 msgr2=0x7efcb00c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 -- 172.21.15.148:0/1308127522 shutdown_connections 2023-10-24T02:01:33.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.750+0000 7efcb576e700 1 -- 172.21.15.148:0/1308127522 wait complete. 2023-10-24T02:01:33.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.751+0000 7efcb576e700 1 Processor -- start 2023-10-24T02:01:33.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 -- start start 2023-10-24T02:01:33.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 0x7efcb00640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcb01539a0 0x7efcb0137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0065690 con 0x7efcb0066ba0 2023-10-24T02:01:33.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0064a80 con 0x7efcb0135390 2023-10-24T02:01:33.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcb576e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0064d60 con 0x7efcb01539a0 2023-10-24T02:01:33.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53014/0 (socket says 172.21.15.148:53014) 2023-10-24T02:01:33.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.752+0000 7efcaeffd700 1 -- 172.21.15.148:0/3100457781 learned_addr learned my addr 172.21.15.148:0/3100457781 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:33.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcae7fc700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 0x7efcb00640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 -- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcb01539a0 msgr2=0x7efcb0137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcb01539a0 0x7efcb0137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:33.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 -- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 msgr2=0x7efcb00640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:33.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 0x7efcb00640a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:33.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 -- 172.21.15.148:0/3100457781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0009300 con 0x7efcb0066ba0 2023-10-24T02:01:33.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcae7fc700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 0x7efcb00640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:33.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcaeffd700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7efca000b3c0 tx=0x7efca0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000b810 con 0x7efcb0066ba0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000b970 con 0x7efcb0066ba0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb0065040 con 0x7efcb0066ba0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000bd30 con 0x7efcb0066ba0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.753+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb014ffa0 con 0x7efcb0066ba0 2023-10-24T02:01:33.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.754+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb0065890 con 0x7efcb0066ba0 2023-10-24T02:01:33.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.754+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efca0018070 con 0x7efcb0066ba0 2023-10-24T02:01:33.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.755+0000 7efc96ffd700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 0x7efc9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:33.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.755+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5313+0+0 (secure 0 0 0) 0x7efca007a640 con 0x7efcb0066ba0 2023-10-24T02:01:33.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.755+0000 7efcae7fc700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 0x7efc9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:33.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.755+0000 7efcae7fc700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 0x7efc9c061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efcb0167600 tx=0x7efca4009040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:33.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.759+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efca004bce0 con 0x7efcb0066ba0 2023-10-24T02:01:33.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:33.921+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7efcb006c6b0 con 0x7efcb0066ba0 2023-10-24T02:01:34.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.019+0000 7efc96ffd700 1 -- 172.21.15.148:0/3100457781 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v198) v1 ==== 152+0+0 (secure 0 0 0) 0x7efca0020030 con 0x7efcb0066ba0 2023-10-24T02:01:34.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.023+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 msgr2=0x7efc9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.023+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 0x7efc9c061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7efcb0167600 tx=0x7efca4009040).stop 2023-10-24T02:01:34.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.023+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 msgr2=0x7efcb014b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.023+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7efca000b3c0 tx=0x7efca0016000).stop 2023-10-24T02:01:34.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 shutdown_connections 2023-10-24T02:01:34.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efcb01539a0 0x7efcb0137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:34.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcb0066ba0 0x7efcb014b9f0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.025 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc9c05f150 0x7efc9c061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 --2- 172.21.15.148:0/3100457781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0135390 0x7efcb00640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 >> 172.21.15.148:0/3100457781 conn(0x7efcb0063120 msgr2=0x7efcb00684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:34.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.024+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 shutdown_connections 2023-10-24T02:01:34.026 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.025+0000 7efcb576e700 1 -- 172.21.15.148:0/3100457781 wait complete. 2023-10-24T02:01:34.031 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T02:01:34.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T02:01:34.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.160+0000 7f7861c4c700 1 Processor -- start 2023-10-24T02:01:34.161 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 -- start start 2023-10-24T02:01:34.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f785c0c62b0 0x7f785c063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c065740 con 0x7f785c0644d0 2023-10-24T02:01:34.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c064b30 con 0x7f785c0c62b0 2023-10-24T02:01:34.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.161+0000 7f7861c4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c064e10 con 0x7f785c0bec40 2023-10-24T02:01:34.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f785c0c62b0 0x7f785c063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f785c0c62b0 0x7f785c063fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53028/0 (socket says 172.21.15.148:53028) 2023-10-24T02:01:34.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 -- 172.21.15.148:0/529128915 learned_addr learned my addr 172.21.15.148:0/529128915 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:34.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7853fff700 1 --1- 172.21.15.148:0/529128915 >> v1:172.21.15.148:6789/0 conn(0x7f785c0644d0 0x7f785c0be530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46504/0 (socket says 172.21.15.148:46504) 2023-10-24T02:01:34.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f786144b700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 -- 172.21.15.148:0/529128915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 msgr2=0x7f785c0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:34.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f78537fe700 1 -- 172.21.15.148:0/529128915 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743598301 0 0) 0x7f785c065740 con 0x7f785c0644d0 2023-10-24T02:01:34.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 -- 172.21.15.148:0/529128915 >> v1:172.21.15.148:6789/0 conn(0x7f785c0644d0 legacy=0x7f785c0be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 -- 172.21.15.148:0/529128915 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0650f0 con 0x7f785c0c62b0 2023-10-24T02:01:34.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f7860c4a700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c063fe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f7858009f20 tx=0x7f7858009840).ready entity=mon.0 client_cookie=1fe7d0235884b724 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:34.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f78537fe700 1 -- 172.21.15.148:0/529128915 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800e070 con 0x7f785c0c62b0 2023-10-24T02:01:34.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f78537fe700 1 -- 172.21.15.148:0/529128915 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800ba80 con 0x7f785c0c62b0 2023-10-24T02:01:34.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.162+0000 7f78537fe700 1 -- 172.21.15.148:0/529128915 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800be00 con 0x7f785c0c62b0 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 -- 172.21.15.148:0/529128915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 msgr2=0x7f785c063fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c063fe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7f7858009f20 tx=0x7f7858009840).stop 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 -- 172.21.15.148:0/529128915 shutdown_connections 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 --2- 172.21.15.148:0/529128915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c063fe0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 -- 172.21.15.148:0/529128915 >> 172.21.15.148:0/529128915 conn(0x7f785c0923c0 msgr2=0x7f785c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:34.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 -- 172.21.15.148:0/529128915 shutdown_connections 2023-10-24T02:01:34.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.163+0000 7f7861c4c700 1 -- 172.21.15.148:0/529128915 wait complete. 2023-10-24T02:01:34.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.164+0000 7f7861c4c700 1 Processor -- start 2023-10-24T02:01:34.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.164+0000 7f7861c4c700 1 -- start start 2023-10-24T02:01:34.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c0644d0 0x7f785c0aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0ad400 con 0x7f785c0c62b0 2023-10-24T02:01:34.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0ab1a0 con 0x7f785c0644d0 2023-10-24T02:01:34.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7861c4c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0ab480 con 0x7f785c0bec40 2023-10-24T02:01:34.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53036/0 (socket says 172.21.15.148:53036) 2023-10-24T02:01:34.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 -- 172.21.15.148:0/3747853167 learned_addr learned my addr 172.21.15.148:0/3747853167 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:34.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7853fff700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f7860c4a700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c0644d0 0x7f785c0aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 -- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 msgr2=0x7f785c0a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 -- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c0644d0 msgr2=0x7f785c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:34.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c0644d0 0x7f785c0aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:34.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 -- 172.21.15.148:0/3747853167 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009ae0 con 0x7f785c0c62b0 2023-10-24T02:01:34.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.165+0000 7f786144b700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f785400d860 tx=0x7f7854008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:34.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.166+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854011590 con 0x7f785c0c62b0 2023-10-24T02:01:34.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.166+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78540116f0 con 0x7f785c0c62b0 2023-10-24T02:01:34.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.166+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854011a70 con 0x7f785c0c62b0 2023-10-24T02:01:34.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.166+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0ab760 con 0x7f785c0c62b0 2023-10-24T02:01:34.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.166+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c0a9580 con 0x7f785c0c62b0 2023-10-24T02:01:34.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.167+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0ad5b0 con 0x7f785c0c62b0 2023-10-24T02:01:34.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.167+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f785401c460 con 0x7f785c0c62b0 2023-10-24T02:01:34.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.167+0000 7f7850ff9700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 0x7f7848061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:34.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.168+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5683+0+0 (secure 0 0 0) 0x7f7854079cb0 con 0x7f785c0c62b0 2023-10-24T02:01:34.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.168+0000 7f7860c4a700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 0x7f7848061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:34.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.168+0000 7f7860c4a700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 0x7f7848061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f785800c010 tx=0x7f7858009840).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:34.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.172+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f785c0ad5b0 con 0x7f785c0c62b0 2023-10-24T02:01:34.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:34.334+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f785c0ad5b0 con 0x7f785c0c62b0 2023-10-24T02:01:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.033+0000 7f7850ff9700 1 -- 172.21.15.148:0/3747853167 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v199) v1 ==== 170+0+0 (secure 0 0 0) 0x7f785c0ad5b0 con 0x7f785c0c62b0 2023-10-24T02:01:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 msgr2=0x7f7848061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 0x7f7848061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f785800c010 tx=0x7f7858009840).stop 2023-10-24T02:01:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 msgr2=0x7f785c14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7f785400d860 tx=0x7f7854008040).stop 2023-10-24T02:01:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 shutdown_connections 2023-10-24T02:01:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f785c0c62b0 0x7f785c14eb10 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f784805f150 0x7f7848061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f785c0644d0 0x7f785c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 --2- 172.21.15.148:0/3747853167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f785c0bec40 0x7f785c0a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 >> 172.21.15.148:0/3747853167 conn(0x7f785c0923c0 msgr2=0x7f785c0a6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 shutdown_connections 2023-10-24T02:01:35.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.036+0000 7f7861c4c700 1 -- 172.21.15.148:0/3747853167 wait complete. 2023-10-24T02:01:35.039 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T02:01:35.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T02:01:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.184+0000 7f3957b49700 1 Processor -- start 2023-10-24T02:01:35.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.184+0000 7f3957b49700 1 -- start start 2023-10-24T02:01:35.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f3957b49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 0x7f3950154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f3957b49700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500c71d0 con 0x7f39500bffd0 2023-10-24T02:01:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f3957b49700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500c9410 con 0x7f3950098bd0 2023-10-24T02:01:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f3957b49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500c6a10 con 0x7f3950154430 2023-10-24T02:01:35.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f39560e6700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f39500bffd0 0x7f395015e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46516/0 (socket says 172.21.15.148:46516) 2023-10-24T02:01:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.185+0000 7f39560e6700 1 -- 172.21.15.148:0/2764336965 learned_addr learned my addr 172.21.15.148:0/2764336965 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39558e5700 1 --2- 172.21.15.148:0/2764336965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 0x7f3950154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241666886 0 0) 0x7f39500c71d0 con 0x7f39500bffd0 2023-10-24T02:01:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393c0033f0 con 0x7f39500bffd0 2023-10-24T02:01:35.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522178450 0 0) 0x7f39500c9410 con 0x7f3950098bd0 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39500c71d0 con 0x7f3950098bd0 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39558e5700 1 -- 172.21.15.148:0/2764336965 >> v1:172.21.15.150:6789/0 conn(0x7f3950098bd0 legacy=0x7f39500c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39558e5700 1 -- 172.21.15.148:0/2764336965 >> v1:172.21.15.148:6789/0 conn(0x7f39500bffd0 legacy=0x7f395015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39558e5700 1 -- 172.21.15.148:0/2764336965 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500ca8b0 con 0x7f3950154430 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39558e5700 1 --2- 172.21.15.148:0/2764336965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 0x7f3950154810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f394c0097c0 tx=0x7f394c009060).ready entity=mon.2 client_cookie=51ca1f531275e17c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c00d4a0 con 0x7f3950154430 2023-10-24T02:01:35.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c00d600 con 0x7f3950154430 2023-10-24T02:01:35.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.186+0000 7f39548e3700 1 -- 172.21.15.148:0/2764336965 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c00d980 con 0x7f3950154430 2023-10-24T02:01:35.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 -- 172.21.15.148:0/2764336965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 msgr2=0x7f3950154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 --2- 172.21.15.148:0/2764336965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 0x7f3950154810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f394c0097c0 tx=0x7f394c009060).stop 2023-10-24T02:01:35.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 -- 172.21.15.148:0/2764336965 shutdown_connections 2023-10-24T02:01:35.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 --2- 172.21.15.148:0/2764336965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950154430 0x7f3950154810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 -- 172.21.15.148:0/2764336965 >> 172.21.15.148:0/2764336965 conn(0x7f39500cb070 msgr2=0x7f39500cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 -- 172.21.15.148:0/2764336965 shutdown_connections 2023-10-24T02:01:35.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.187+0000 7f3957b49700 1 -- 172.21.15.148:0/2764336965 wait complete. 2023-10-24T02:01:35.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.188+0000 7f3957b49700 1 Processor -- start 2023-10-24T02:01:35.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.188+0000 7f3957b49700 1 -- start start 2023-10-24T02:01:35.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950098bd0 0x7f39500aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3950154430 0x7f39500ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500af720 con 0x7f39500bffd0 2023-10-24T02:01:35.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500aeb70 con 0x7f3950154430 2023-10-24T02:01:35.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500aedf0 con 0x7f3950098bd0 2023-10-24T02:01:35.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53046/0 (socket says 172.21.15.148:53046) 2023-10-24T02:01:35.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 -- 172.21.15.148:0/1108081773 learned_addr learned my addr 172.21.15.148:0/1108081773 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:35.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39558e5700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950098bd0 0x7f39500aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39560e6700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3950154430 0x7f39500ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 -- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950098bd0 msgr2=0x7f39500aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950098bd0 0x7f39500aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 -- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3950154430 msgr2=0x7f39500ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3950154430 0x7f39500ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 -- 172.21.15.148:0/1108081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0092a0 con 0x7f39500bffd0 2023-10-24T02:01:35.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f39550e4700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f394000c4c0 tx=0x7f3940007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000f470 con 0x7f39500bffd0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394000f5d0 con 0x7f39500bffd0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000f990 con 0x7f39500bffd0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.189+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39500af0d0 con 0x7f39500bffd0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.190+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3950149340 con 0x7f39500bffd0 2023-10-24T02:01:35.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.190+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395006c6b0 con 0x7f39500bffd0 2023-10-24T02:01:35.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.191+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f394000fd40 con 0x7f39500bffd0 2023-10-24T02:01:35.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.191+0000 7f3945ffb700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 0x7f3934061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.191+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6065+0+0 (secure 0 0 0) 0x7f3940079750 con 0x7f39500bffd0 2023-10-24T02:01:35.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.191+0000 7f39558e5700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 0x7f3934061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.192+0000 7f39558e5700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 0x7f3934061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f394c0096e0 tx=0x7f394c016000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.195+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f394004aa50 con 0x7f39500bffd0 2023-10-24T02:01:35.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.399+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f39500c6c10 con 0x7f39500bffd0 2023-10-24T02:01:35.405 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.405+0000 7f3945ffb700 1 -- 172.21.15.148:0/1108081773 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3940007d80 con 0x7f39500bffd0 2023-10-24T02:01:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.415+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 msgr2=0x7f3934061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.415+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 0x7f3934061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f394c0096e0 tx=0x7f394c016000).stop 2023-10-24T02:01:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.415+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 msgr2=0x7f3950148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.415+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f394000c4c0 tx=0x7f3940007c60).stop 2023-10-24T02:01:35.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 shutdown_connections 2023-10-24T02:01:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f393405f150 0x7f3934061610 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0x7f394c0096e0 tx=0x7f394c016000).stop 2023-10-24T02:01:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3950154430 0x7f39500ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3950098bd0 0x7f39500aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 --2- 172.21.15.148:0/1108081773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39500bffd0 0x7f3950148e50 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 >> 172.21.15.148:0/1108081773 conn(0x7f39500cb070 msgr2=0x7f395015a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.417+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 shutdown_connections 2023-10-24T02:01:35.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.418+0000 7f3957b49700 1 -- 172.21.15.148:0/1108081773 wait complete. 2023-10-24T02:01:35.423 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 23 and data pool 24 2023-10-24T02:01:35.438 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.551+0000 7f7358762700 1 Processor -- start 2023-10-24T02:01:35.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.551+0000 7f7358762700 1 -- start start 2023-10-24T02:01:35.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.552+0000 7f7358762700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73500c6710 0x7f73500c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.552+0000 7f7358762700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73500aa3f0 0x7f7350069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.552+0000 7f7358762700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73500aa820 con 0x7f73500aa010 2023-10-24T02:01:35.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.552+0000 7f7358762700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73500c0960 con 0x7f73500aa3f0 2023-10-24T02:01:35.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.552+0000 7f7358762700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73500c0c40 con 0x7f73500c6710 2023-10-24T02:01:35.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73500aa3f0 0x7f7350069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73564fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f73500aa010 0x7f7350158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46526/0 (socket says 172.21.15.148:46526) 2023-10-24T02:01:35.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73500aa3f0 0x7f7350069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53060/0 (socket says 172.21.15.148:53060) 2023-10-24T02:01:35.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73564fe700 1 -- 172.21.15.148:0/3659128693 learned_addr learned my addr 172.21.15.148:0/3659128693 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:35.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7355cfd700 1 --2- 172.21.15.148:0/3659128693 >> v2:172.21.15.150:3300/0 conn(0x7f73500c6710 0x7f73500c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 -- 172.21.15.148:0/3659128693 >> v2:172.21.15.150:3300/0 conn(0x7f73500c6710 msgr2=0x7f73500c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:35.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 --2- 172.21.15.148:0/3659128693 >> v2:172.21.15.150:3300/0 conn(0x7f73500c6710 0x7f73500c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 -- 172.21.15.148:0/3659128693 >> v1:172.21.15.148:6789/0 conn(0x7f73500aa010 legacy=0x7f7350158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73554fc700 1 -- 172.21.15.148:0/3659128693 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202189051 0 0) 0x7f73500aa820 con 0x7f73500aa010 2023-10-24T02:01:35.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 -- 172.21.15.148:0/3659128693 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73500c0f20 con 0x7f73500aa3f0 2023-10-24T02:01:35.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f7356cff700 1 --2- 172.21.15.148:0/3659128693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f7350069d80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f7350157d00 tx=0x7f7348009060).ready entity=mon.0 client_cookie=6e093e5e89981bee server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73554fc700 1 -- 172.21.15.148:0/3659128693 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734800f510 con 0x7f73500aa3f0 2023-10-24T02:01:35.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73554fc700 1 -- 172.21.15.148:0/3659128693 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734800f670 con 0x7f73500aa3f0 2023-10-24T02:01:35.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.553+0000 7f73554fc700 1 -- 172.21.15.148:0/3659128693 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734800f9f0 con 0x7f73500aa3f0 2023-10-24T02:01:35.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 -- 172.21.15.148:0/3659128693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 msgr2=0x7f7350069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 --2- 172.21.15.148:0/3659128693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f7350069d80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f7350157d00 tx=0x7f7348009060).stop 2023-10-24T02:01:35.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 -- 172.21.15.148:0/3659128693 shutdown_connections 2023-10-24T02:01:35.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 --2- 172.21.15.148:0/3659128693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f7350069d80 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 --2- 172.21.15.148:0/3659128693 >> v2:172.21.15.150:3300/0 conn(0x7f73500c6710 0x7f73500c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 -- 172.21.15.148:0/3659128693 >> 172.21.15.148:0/3659128693 conn(0x7f73500caf40 msgr2=0x7f73500cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 -- 172.21.15.148:0/3659128693 shutdown_connections 2023-10-24T02:01:35.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.554+0000 7f7358762700 1 -- 172.21.15.148:0/3659128693 wait complete. 2023-10-24T02:01:35.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.555+0000 7f7358762700 1 Processor -- start 2023-10-24T02:01:35.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.555+0000 7f7358762700 1 -- start start 2023-10-24T02:01:35.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73500aa010 0x7f73500c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73500c6710 0x7f73500afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73500b04e0 con 0x7f73500aa3f0 2023-10-24T02:01:35.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73500c3fa0 con 0x7f73500aa010 2023-10-24T02:01:35.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73500c3390 con 0x7f73500c6710 2023-10-24T02:01:35.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53068/0 (socket says 172.21.15.148:53068) 2023-10-24T02:01:35.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 -- 172.21.15.148:0/3636282510 learned_addr learned my addr 172.21.15.148:0/3636282510 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:35.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f73564fe700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73500aa010 0x7f73500c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7356cff700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73500c6710 0x7f73500afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 -- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73500c6710 msgr2=0x7f73500afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73500c6710 0x7f73500afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 -- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73500aa010 msgr2=0x7f73500c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73500aa010 0x7f73500c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 -- 172.21.15.148:0/3636282510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480092a0 con 0x7f73500aa3f0 2023-10-24T02:01:35.569 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7355cfd700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f734000e900 tx=0x7f7340009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340012600 con 0x7f73500aa3f0 2023-10-24T02:01:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340012760 con 0x7f73500aa3f0 2023-10-24T02:01:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73500c3670 con 0x7f73500aa3f0 2023-10-24T02:01:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340012ae0 con 0x7f73500aa3f0 2023-10-24T02:01:35.570 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.556+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73500c3c30 con 0x7f73500aa3f0 2023-10-24T02:01:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.557+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735006c6b0 con 0x7f73500aa3f0 2023-10-24T02:01:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.558+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f734001b400 con 0x7f73500aa3f0 2023-10-24T02:01:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.558+0000 7f73467fc700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 0x7f7334061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.558+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f734007a4f0 con 0x7f73500aa3f0 2023-10-24T02:01:35.571 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.558+0000 7f73564fe700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 0x7f7334061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.558+0000 7f73564fe700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 0x7f7334061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f734c001560 tx=0x7f734c007f30).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.572 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.562+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f734004b730 con 0x7f73500aa3f0 2023-10-24T02:01:35.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.726+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73500c1200 con 0x7f73500aa3f0 2023-10-24T02:01:35.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.727+0000 7f73467fc700 1 -- 172.21.15.148:0/3636282510 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f7340016020 con 0x7f73500aa3f0 2023-10-24T02:01:35.728 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:35.728 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":200,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:35.400331+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 msgr2=0x7f7334061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 0x7f7334061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f734c001560 tx=0x7f734c007f30).stop 2023-10-24T02:01:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 msgr2=0x7f73500afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f734000e900 tx=0x7f7340009060).stop 2023-10-24T02:01:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 shutdown_connections 2023-10-24T02:01:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73500c6710 0x7f73500afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f733405f150 0x7f7334061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73500aa010 0x7f73500c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 --2- 172.21.15.148:0/3636282510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73500aa3f0 0x7f73500afb00 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 >> 172.21.15.148:0/3636282510 conn(0x7f73500caf40 msgr2=0x7f73500cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 shutdown_connections 2023-10-24T02:01:35.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.729+0000 7f7358762700 1 -- 172.21.15.148:0/3636282510 wait complete. 2023-10-24T02:01:35.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:35.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.854+0000 7f589e670700 1 Processor -- start 2023-10-24T02:01:35.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.854+0000 7f589e670700 1 -- start start 2023-10-24T02:01:35.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f589e670700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58980aa010 0x7f58980c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f589e670700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58980aa3f0 0x7f5898069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f589e670700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980aa820 con 0x7f58980c6710 2023-10-24T02:01:35.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f589e670700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980c0960 con 0x7f58980aa010 2023-10-24T02:01:35.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f589e670700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980c0c40 con 0x7f58980aa3f0 2023-10-24T02:01:35.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f5897fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58980aa010 0x7f58980c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f5897fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f58980aa010 0x7f58980c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53070/0 (socket says 172.21.15.148:53070) 2023-10-24T02:01:35.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.855+0000 7f5897fff700 1 -- 172.21.15.148:0/3547994673 learned_addr learned my addr 172.21.15.148:0/3547994673 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:35.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589cc0d700 1 --2- 172.21.15.148:0/3547994673 >> v2:172.21.15.150:3300/0 conn(0x7f58980aa3f0 0x7f5898069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5897fff700 1 -- 172.21.15.148:0/3547994673 >> v2:172.21.15.150:3300/0 conn(0x7f58980aa3f0 msgr2=0x7f5898069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:35.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5897fff700 1 --2- 172.21.15.148:0/3547994673 >> v2:172.21.15.150:3300/0 conn(0x7f58980aa3f0 0x7f5898069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5897fff700 1 -- 172.21.15.148:0/3547994673 >> v1:172.21.15.148:6789/0 conn(0x7f58980c6710 legacy=0x7f5898158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5896ffd700 1 -- 172.21.15.148:0/3547994673 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603282400 0 0) 0x7f58980aa820 con 0x7f58980c6710 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5897fff700 1 -- 172.21.15.148:0/3547994673 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980c0f20 con 0x7f58980aa010 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5897fff700 1 --2- 172.21.15.148:0/3547994673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980aa010 0x7f58980c1a00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f58980c1ef0 tx=0x7f58880090f0).ready entity=mon.0 client_cookie=1286b12a47984a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5896ffd700 1 -- 172.21.15.148:0/3547994673 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800b600 con 0x7f58980aa010 2023-10-24T02:01:35.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5896ffd700 1 -- 172.21.15.148:0/3547994673 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588800b760 con 0x7f58980aa010 2023-10-24T02:01:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f5896ffd700 1 -- 172.21.15.148:0/3547994673 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800bae0 con 0x7f58980aa010 2023-10-24T02:01:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 -- 172.21.15.148:0/3547994673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980aa010 msgr2=0x7f58980c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 --2- 172.21.15.148:0/3547994673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980aa010 0x7f58980c1a00 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f58980c1ef0 tx=0x7f58880090f0).stop 2023-10-24T02:01:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 -- 172.21.15.148:0/3547994673 shutdown_connections 2023-10-24T02:01:35.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 --2- 172.21.15.148:0/3547994673 >> v2:172.21.15.150:3300/0 conn(0x7f58980aa3f0 0x7f5898069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 --2- 172.21.15.148:0/3547994673 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980aa010 0x7f58980c1a00 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 -- 172.21.15.148:0/3547994673 >> 172.21.15.148:0/3547994673 conn(0x7f58980caf40 msgr2=0x7f58980cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 -- 172.21.15.148:0/3547994673 shutdown_connections 2023-10-24T02:01:35.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.856+0000 7f589e670700 1 -- 172.21.15.148:0/3547994673 wait complete. 2023-10-24T02:01:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 Processor -- start 2023-10-24T02:01:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 -- start start 2023-10-24T02:01:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 0x7f5898155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58980aa3f0 0x7f5898151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898156be0 con 0x7f58980c6710 2023-10-24T02:01:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898152360 con 0x7f58980aa3f0 2023-10-24T02:01:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.858+0000 7f589e670700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898157ae0 con 0x7f58980aa010 2023-10-24T02:01:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53076/0 (socket says 172.21.15.148:53076) 2023-10-24T02:01:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 -- 172.21.15.148:0/2085556004 learned_addr learned my addr 172.21.15.148:0/2085556004 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f5897fff700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 0x7f5898155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f58977fe700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58980aa3f0 0x7f5898151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 -- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 msgr2=0x7f5898155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 0x7f5898155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 -- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58980aa3f0 msgr2=0x7f5898151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58980aa3f0 0x7f5898151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 -- 172.21.15.148:0/2085556004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5888009370 con 0x7f58980c6710 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f5897fff700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 0x7f5898155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589cc0d700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f589000ceb0 tx=0x7f5890007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000ae40 con 0x7f58980c6710 2023-10-24T02:01:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890016400 con 0x7f58980c6710 2023-10-24T02:01:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890016780 con 0x7f58980c6710 2023-10-24T02:01:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898155fd0 con 0x7f58980c6710 2023-10-24T02:01:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.859+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898156590 con 0x7f58980c6710 2023-10-24T02:01:35.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.860+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58980ca800 con 0x7f58980c6710 2023-10-24T02:01:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.860+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5890009030 con 0x7f58980c6710 2023-10-24T02:01:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.861+0000 7f587ffff700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 0x7f58840615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.861+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f589007a930 con 0x7f58980c6710 2023-10-24T02:01:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.861+0000 7f5897fff700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 0x7f58840615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:35.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.861+0000 7f5897fff700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 0x7f58840615e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5888009130 tx=0x7f5888017000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:35.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:35.865+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f589004bbd0 con 0x7f58980c6710 2023-10-24T02:01:36.028 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.027+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f589806c6b0 con 0x7f58980c6710 2023-10-24T02:01:36.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.028+0000 7f587ffff700 1 -- 172.21.15.148:0/2085556004 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f589004f1f0 con 0x7f58980c6710 2023-10-24T02:01:36.029 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:36.029 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":200,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:35.400331+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:36.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 msgr2=0x7f58840615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.031 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 0x7f58840615e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5888009130 tx=0x7f5888017000).stop 2023-10-24T02:01:36.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 msgr2=0x7f58981575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f589000ceb0 tx=0x7f5890007870).stop 2023-10-24T02:01:36.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 shutdown_connections 2023-10-24T02:01:36.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58980c6710 0x7f58981575f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.032 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58980aa010 0x7f5898155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f588405f120 0x7f58840615e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 --2- 172.21.15.148:0/2085556004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58980aa3f0 0x7f5898151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.030+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 >> 172.21.15.148:0/2085556004 conn(0x7f58980caf40 msgr2=0x7f58980c5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:36.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.031+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 shutdown_connections 2023-10-24T02:01:36.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.031+0000 7f589e670700 1 -- 172.21.15.148:0/2085556004 wait complete. 2023-10-24T02:01:36.043 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T02:01:36.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.159+0000 7f1aa7208700 1 Processor -- start 2023-10-24T02:01:36.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.159+0000 7f1aa7208700 1 -- start start 2023-10-24T02:01:36.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa7208700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1aa00c06e0 0x7f1aa0154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa7208700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00c71d0 con 0x7f1aa0098bd0 2023-10-24T02:01:36.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa7208700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa00c9410 con 0x7f1aa0154430 2023-10-24T02:01:36.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa7208700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00c6a10 con 0x7f1aa00c06e0 2023-10-24T02:01:36.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa57a5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1aa00c06e0 0x7f1aa0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa57a5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1aa00c06e0 0x7f1aa0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53084/0 (socket says 172.21.15.148:53084) 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1aa57a5700 1 -- 172.21.15.148:0/1143631868 learned_addr learned my addr 172.21.15.148:0/1143631868 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.160+0000 7f1a97fff700 1 --1- 172.21.15.148:0/1143631868 >> v1:172.21.15.148:6789/0 conn(0x7f1aa0098bd0 0x7f1aa00bffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46540/0 (socket says 172.21.15.148:46540) 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa57a5700 1 -- 172.21.15.148:0/1143631868 >> v1:172.21.15.150:6789/0 conn(0x7f1aa0154430 legacy=0x7f1aa00c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa57a5700 1 -- 172.21.15.148:0/1143631868 >> v1:172.21.15.148:6789/0 conn(0x7f1aa0098bd0 legacy=0x7f1aa00bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1a977fe700 1 -- 172.21.15.148:0/1143631868 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91035599 0 0) 0x7f1aa00c71d0 con 0x7f1aa0098bd0 2023-10-24T02:01:36.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa57a5700 1 -- 172.21.15.148:0/1143631868 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00ca8b0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa57a5700 1 --2- 172.21.15.148:0/1143631868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa0154810 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f1a98009f20 tx=0x7f1a98009840).ready entity=mon.0 client_cookie=d78c03b4f4621ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1a977fe700 1 -- 172.21.15.148:0/1143631868 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800e070 con 0x7f1aa00c06e0 2023-10-24T02:01:36.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1a977fe700 1 -- 172.21.15.148:0/1143631868 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9800ba40 con 0x7f1aa00c06e0 2023-10-24T02:01:36.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1a977fe700 1 -- 172.21.15.148:0/1143631868 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9800bdc0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 -- 172.21.15.148:0/1143631868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 msgr2=0x7f1aa0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 --2- 172.21.15.148:0/1143631868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa0154810 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f1a98009f20 tx=0x7f1a98009840).stop 2023-10-24T02:01:36.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 -- 172.21.15.148:0/1143631868 shutdown_connections 2023-10-24T02:01:36.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 --2- 172.21.15.148:0/1143631868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa0154810 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 -- 172.21.15.148:0/1143631868 >> 172.21.15.148:0/1143631868 conn(0x7f1aa00cb070 msgr2=0x7f1aa00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:36.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 -- 172.21.15.148:0/1143631868 shutdown_connections 2023-10-24T02:01:36.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.161+0000 7f1aa7208700 1 -- 172.21.15.148:0/1143631868 wait complete. 2023-10-24T02:01:36.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.162+0000 7f1aa7208700 1 Processor -- start 2023-10-24T02:01:36.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 -- start start 2023-10-24T02:01:36.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa0098bd0 0x7f1aa01685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0154430 0x7f1aa01646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c4e30 con 0x7f1aa00c06e0 2023-10-24T02:01:36.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0167dc0 con 0x7f1aa0154430 2023-10-24T02:01:36.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1aa7208700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0165140 con 0x7f1aa0098bd0 2023-10-24T02:01:36.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.163+0000 7f1a97fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53086/0 (socket says 172.21.15.148:53086) 2023-10-24T02:01:36.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 -- 172.21.15.148:0/3872794468 learned_addr learned my addr 172.21.15.148:0/3872794468 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:36.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 -- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa0098bd0 msgr2=0x7f1aa01685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa0098bd0 0x7f1aa01685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:36.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1aa57a5700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0154430 0x7f1aa01646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 -- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0154430 msgr2=0x7f1aa01646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0154430 0x7f1aa01646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 -- 172.21.15.148:0/3872794468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009ae0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a97fff700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f1a9000c560 tx=0x7f1a90007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900072e0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90007440 con 0x7f1aa00c06e0 2023-10-24T02:01:36.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa0165420 con 0x7f1aa00c06e0 2023-10-24T02:01:36.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900058f0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.164+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0168a90 con 0x7f1aa00c06e0 2023-10-24T02:01:36.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.165+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa01682c0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.165+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1a90005ce0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.166+0000 7f1a94ff9700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 0x7f1a8c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.166+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f1a90079b80 con 0x7f1aa00c06e0 2023-10-24T02:01:36.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.166+0000 7f1aa4fa4700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 0x7f1a8c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.166+0000 7f1aa4fa4700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 0x7f1a8c0615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1aa00a8c80 tx=0x7f1a9c006ae0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.170+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1aa01682c0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.375+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1aa01682c0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.407 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.406+0000 7f1a94ff9700 1 -- 172.21.15.148:0/3872794468 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1aa01682c0 con 0x7f1aa00c06e0 2023-10-24T02:01:36.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 msgr2=0x7f1a8c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 0x7f1a8c0615e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1aa00a8c80 tx=0x7f1a9c006ae0).stop 2023-10-24T02:01:36.409 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 msgr2=0x7f1aa014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f1a9000c560 tx=0x7f1a90007c90).stop 2023-10-24T02:01:36.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 shutdown_connections 2023-10-24T02:01:36.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1a8c05f120 0x7f1a8c0615e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1aa0154430 0x7f1aa01646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.410 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1aa0098bd0 0x7f1aa01685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:36.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 --2- 172.21.15.148:0/3872794468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1aa00c06e0 0x7f1aa014d6a0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 >> 172.21.15.148:0/3872794468 conn(0x7f1aa00cb070 msgr2=0x7f1aa0064ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:36.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 shutdown_connections 2023-10-24T02:01:36.411 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.408+0000 7f1aa7208700 1 -- 172.21.15.148:0/3872794468 wait complete. 2023-10-24T02:01:36.421 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T02:01:36.422 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T02:01:36.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.538+0000 7fb7c0a1d700 1 Processor -- start 2023-10-24T02:01:36.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.538+0000 7fb7c0a1d700 1 -- start start 2023-10-24T02:01:36.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7c0a1d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb7bc152290 0x7fb7bc155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.541 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7c0a1d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7c0a1d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc0c6bb0 con 0x7fb7bc0c0940 2023-10-24T02:01:36.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7c0a1d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c8800 con 0x7fb7bc0c6240 2023-10-24T02:01:36.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7c0a1d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc155c00 con 0x7fb7bc152290 2023-10-24T02:01:36.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53100/0 (socket says 172.21.15.148:53100) 2023-10-24T02:01:36.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 -- 172.21.15.148:0/563020184 learned_addr learned my addr 172.21.15.148:0/563020184 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:36.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 -- 172.21.15.148:0/563020184 >> v2:172.21.15.150:3300/0 conn(0x7fb7bc152290 msgr2=0x7fb7bc155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:36.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7ba59c700 1 --2- 172.21.15.148:0/563020184 >> v2:172.21.15.150:3300/0 conn(0x7fb7bc152290 0x7fb7bc155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/563020184 >> v2:172.21.15.150:3300/0 conn(0x7fb7bc152290 0x7fb7bc155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 -- 172.21.15.148:0/563020184 >> v1:172.21.15.150:6789/0 conn(0x7fb7bc0c0940 legacy=0x7fb7bc0c0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:36.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.539+0000 7fb7b1d9b700 1 -- 172.21.15.148:0/563020184 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0c7b80 con 0x7fb7bc0c6240 2023-10-24T02:01:36.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/563020184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fb7bc083820 tx=0x7fb7a40090f0).ready entity=mon.0 client_cookie=c24e144e1ef92058 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7b9d9b700 1 -- 172.21.15.148:0/563020184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400b5a0 con 0x7fb7bc0c6240 2023-10-24T02:01:36.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7b9d9b700 1 -- 172.21.15.148:0/563020184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400b700 con 0x7fb7bc0c6240 2023-10-24T02:01:36.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7b9d9b700 1 -- 172.21.15.148:0/563020184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400baa0 con 0x7fb7bc0c6240 2023-10-24T02:01:36.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/563020184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c6240 msgr2=0x7fb7bc0c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/563020184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fb7bc083820 tx=0x7fb7a40090f0).stop 2023-10-24T02:01:36.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/563020184 shutdown_connections 2023-10-24T02:01:36.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/563020184 >> v2:172.21.15.150:3300/0 conn(0x7fb7bc152290 0x7fb7bc155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/563020184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c6240 0x7fb7bc0c66c0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/563020184 >> 172.21.15.148:0/563020184 conn(0x7fb7bc0946c0 msgr2=0x7fb7bc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:36.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/563020184 shutdown_connections 2023-10-24T02:01:36.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.540+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/563020184 wait complete. 2023-10-24T02:01:36.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.541+0000 7fb7c0a1d700 1 Processor -- start 2023-10-24T02:01:36.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.541+0000 7fb7c0a1d700 1 -- start start 2023-10-24T02:01:36.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 0x7fb7bc14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 0x7fb7bc0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc166070 con 0x7fb7bc0c0940 2023-10-24T02:01:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc153040 con 0x7fb7bc152290 2023-10-24T02:01:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7c0a1d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c4790 con 0x7fb7bc0c6240 2023-10-24T02:01:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7ba59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7ba59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53104/0 (socket says 172.21.15.148:53104) 2023-10-24T02:01:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7ba59c700 1 -- 172.21.15.148:0/2147472834 learned_addr learned my addr 172.21.15.148:0/2147472834 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:36.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 0x7fb7bc14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.542+0000 7fb7bad9d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 0x7fb7bc0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 -- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 msgr2=0x7fb7bc14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 0x7fb7bc14d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 -- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 msgr2=0x7fb7bc0c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 0x7fb7bc0c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 -- 172.21.15.148:0/2147472834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4009370 con 0x7fb7bc0c0940 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7bad9d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 0x7fb7bc0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 0x7fb7bc14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7ba59c700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fb7ac00c880 tx=0x7fb7ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac010580 con 0x7fb7bc0c0940 2023-10-24T02:01:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0106e0 con 0x7fb7bc0c0940 2023-10-24T02:01:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc152710 con 0x7fb7bc0c0940 2023-10-24T02:01:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac010a60 con 0x7fb7bc0c0940 2023-10-24T02:01:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.543+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc152cd0 con 0x7fb7bc0c0940 2023-10-24T02:01:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.544+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc06c6b0 con 0x7fb7bc0c0940 2023-10-24T02:01:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.544+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb7ac01b460 con 0x7fb7bc0c0940 2023-10-24T02:01:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.544+0000 7fb7b2ffd700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 0x7fb79c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.545+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fb7ac07a1f0 con 0x7fb7bc0c0940 2023-10-24T02:01:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.545+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 0x7fb79c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.545+0000 7fb7b1d9b700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 0x7fb79c0615e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb7a4006df0 tx=0x7fb7a4015000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:36.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.549+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb7ac04b430 con 0x7fb7bc0c0940 2023-10-24T02:01:36.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:36.753+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7bc0c7e60 con 0x7fb7bc0c0940 2023-10-24T02:01:37.412 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.412+0000 7fb7b2ffd700 1 -- 172.21.15.148:0/2147472834 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7ac04ea50 con 0x7fb7bc0c0940 2023-10-24T02:01:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 msgr2=0x7fb79c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 0x7fb79c0615e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb7a4006df0 tx=0x7fb7a4015000).stop 2023-10-24T02:01:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 msgr2=0x7fb7bc165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fb7ac00c880 tx=0x7fb7ac008040).stop 2023-10-24T02:01:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 shutdown_connections 2023-10-24T02:01:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb79c05f120 0x7fb79c0615e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7bc152290 0x7fb7bc0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb7bc0c0940 0x7fb7bc165b80 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 --2- 172.21.15.148:0/2147472834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7bc0c6240 0x7fb7bc14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 >> 172.21.15.148:0/2147472834 conn(0x7fb7bc0946c0 msgr2=0x7fb7bc064680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 shutdown_connections 2023-10-24T02:01:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.414+0000 7fb7c0a1d700 1 -- 172.21.15.148:0/2147472834 wait complete. 2023-10-24T02:01:37.427 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T02:01:37.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:37.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.541+0000 7f1e7dee1700 1 Processor -- start 2023-10-24T02:01:37.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.541+0000 7f1e7dee1700 1 -- start start 2023-10-24T02:01:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e7dee1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e780aa010 0x7f1e780c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e7dee1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 0x7f1e780aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e7dee1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780c0960 con 0x7f1e78158770 2023-10-24T02:01:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e7dee1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780aa8e0 con 0x7f1e780aa010 2023-10-24T02:01:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e7dee1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780c0c40 con 0x7f1e780c6710 2023-10-24T02:01:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e777fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e780aa010 0x7f1e780c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e777fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e780aa010 0x7f1e780c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53120/0 (socket says 172.21.15.148:53120) 2023-10-24T02:01:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e777fe700 1 -- 172.21.15.148:0/3298419028 learned_addr learned my addr 172.21.15.148:0/3298419028 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e77fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1e78158770 0x7f1e78069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46556/0 (socket says 172.21.15.148:46556) 2023-10-24T02:01:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.542+0000 7f1e76ffd700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 0x7f1e780aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e777fe700 1 -- 172.21.15.148:0/3298419028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 msgr2=0x7f1e780aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:37.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e777fe700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 0x7f1e780aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e777fe700 1 -- 172.21.15.148:0/3298419028 >> v1:172.21.15.148:6789/0 conn(0x7f1e78158770 legacy=0x7f1e78069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e767fc700 1 -- 172.21.15.148:0/3298419028 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525980655 0 0) 0x7f1e780c0960 con 0x7f1e78158770 2023-10-24T02:01:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e777fe700 1 -- 172.21.15.148:0/3298419028 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780c0f20 con 0x7f1e780aa010 2023-10-24T02:01:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e76ffd700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 0x7f1e780aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:37.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e777fe700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e780c1a00 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f1e68009f20 tx=0x7f1e68009840).ready entity=mon.0 client_cookie=391424054e41f7f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e767fc700 1 -- 172.21.15.148:0/3298419028 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800e070 con 0x7f1e780aa010 2023-10-24T02:01:37.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e767fc700 1 -- 172.21.15.148:0/3298419028 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800ba80 con 0x7f1e780aa010 2023-10-24T02:01:37.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e767fc700 1 -- 172.21.15.148:0/3298419028 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800be00 con 0x7f1e780aa010 2023-10-24T02:01:37.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3298419028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 msgr2=0x7f1e780c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e780c1a00 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f1e68009f20 tx=0x7f1e68009840).stop 2023-10-24T02:01:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3298419028 shutdown_connections 2023-10-24T02:01:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e780c1a00 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3298419028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e780c6710 0x7f1e780aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3298419028 >> 172.21.15.148:0/3298419028 conn(0x7f1e780caf40 msgr2=0x7f1e780cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3298419028 shutdown_connections 2023-10-24T02:01:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.543+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3298419028 wait complete. 2023-10-24T02:01:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 Processor -- start 2023-10-24T02:01:37.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 -- start start 2023-10-24T02:01:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e780c6710 0x7f1e781418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e78158770 0x7f1e78155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78157a90 con 0x7f1e780aa010 2023-10-24T02:01:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78157110 con 0x7f1e780c6710 2023-10-24T02:01:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e7dee1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78156500 con 0x7f1e78158770 2023-10-24T02:01:37.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e777fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53122/0 (socket says 172.21.15.148:53122) 2023-10-24T02:01:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.545+0000 7f1e777fe700 1 -- 172.21.15.148:0/3253121671 learned_addr learned my addr 172.21.15.148:0/3253121671 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 -- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e78158770 msgr2=0x7f1e78155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e78158770 0x7f1e78155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:37.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 -- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e780c6710 msgr2=0x7f1e781418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e76ffd700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e780c6710 0x7f1e781418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e780c6710 0x7f1e781418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 -- 172.21.15.148:0/3253121671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009ae0 con 0x7f1e780aa010 2023-10-24T02:01:37.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e777fe700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1e78084230 tx=0x7f1e68009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800bcc0 con 0x7f1e780aa010 2023-10-24T02:01:37.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6801e470 con 0x7f1e780aa010 2023-10-24T02:01:37.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6801e7f0 con 0x7f1e780aa010 2023-10-24T02:01:37.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e781567e0 con 0x7f1e780aa010 2023-10-24T02:01:37.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.546+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e78156da0 con 0x7f1e780aa010 2023-10-24T02:01:37.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.547+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e781573f0 con 0x7f1e780aa010 2023-10-24T02:01:37.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.547+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1e68003040 con 0x7f1e780aa010 2023-10-24T02:01:37.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.548+0000 7f1e5f7fe700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 0x7f1e640615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.548+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f1e6807b750 con 0x7f1e780aa010 2023-10-24T02:01:37.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.548+0000 7f1e76ffd700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 0x7f1e640615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.548+0000 7f1e76ffd700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 0x7f1e640615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1e780c53d0 tx=0x7f1e6c008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.552+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1e6804caa0 con 0x7f1e780aa010 2023-10-24T02:01:37.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.756+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e7806c6b0 con 0x7f1e780aa010 2023-10-24T02:01:37.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.756+0000 7f1e5f7fe700 1 -- 172.21.15.148:0/3253121671 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f1e68023070 con 0x7f1e780aa010 2023-10-24T02:01:37.757 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:37.758 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:01:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 msgr2=0x7f1e640615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 0x7f1e640615e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1e780c53d0 tx=0x7f1e6c008040).stop 2023-10-24T02:01:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 msgr2=0x7f1e781575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f1e78084230 tx=0x7f1e68009840).stop 2023-10-24T02:01:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 shutdown_connections 2023-10-24T02:01:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e78158770 0x7f1e78155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e780aa010 0x7f1e781575a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1e6405f120 0x7f1e640615e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 --2- 172.21.15.148:0/3253121671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e780c6710 0x7f1e781418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 >> 172.21.15.148:0/3253121671 conn(0x7f1e780caf40 msgr2=0x7f1e78152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.758+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 shutdown_connections 2023-10-24T02:01:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.759+0000 7f1e7dee1700 1 -- 172.21.15.148:0/3253121671 wait complete. 2023-10-24T02:01:37.762 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:01:37.772 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:01:37.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.887+0000 7f2ce1579700 1 Processor -- start 2023-10-24T02:01:37.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.887+0000 7f2ce1579700 1 -- start start 2023-10-24T02:01:37.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2ce1579700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cdc151cb0 0x7f2cdc154820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2ce1579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2ce1579700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc155710 con 0x7f2cdc06a230 2023-10-24T02:01:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2ce1579700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc154e70 con 0x7f2cdc151cb0 2023-10-24T02:01:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2ce1579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc155150 con 0x7f2cdc0aa5a0 2023-10-24T02:01:37.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cdc151cb0 0x7f2cdc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2cdc151cb0 0x7f2cdc154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53130/0 (socket says 172.21.15.148:53130) 2023-10-24T02:01:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 -- 172.21.15.148:0/3018733465 learned_addr learned my addr 172.21.15.148:0/3018733465 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdb7fe700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 -- 172.21.15.148:0/3018733465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 msgr2=0x7f2cdc0c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:37.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 -- 172.21.15.148:0/3018733465 >> v1:172.21.15.150:6789/0 conn(0x7f2cdc06a230 legacy=0x7f2cdc0a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdaffd700 1 -- 172.21.15.148:0/3018733465 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc155430 con 0x7f2cdc151cb0 2023-10-24T02:01:37.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.888+0000 7f2cdb7fe700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:37.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2cdaffd700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc151cb0 0x7f2cdc154820 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f2ccc006fd0 tx=0x7f2ccc0090f0).ready entity=mon.0 client_cookie=220397602b8087f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2cd9ffb700 1 -- 172.21.15.148:0/3018733465 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00b600 con 0x7f2cdc151cb0 2023-10-24T02:01:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2cd9ffb700 1 -- 172.21.15.148:0/3018733465 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00b760 con 0x7f2cdc151cb0 2023-10-24T02:01:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2cd9ffb700 1 -- 172.21.15.148:0/3018733465 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00bae0 con 0x7f2cdc151cb0 2023-10-24T02:01:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 -- 172.21.15.148:0/3018733465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc151cb0 msgr2=0x7f2cdc154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc151cb0 0x7f2cdc154820 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7f2ccc006fd0 tx=0x7f2ccc0090f0).stop 2023-10-24T02:01:37.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 -- 172.21.15.148:0/3018733465 shutdown_connections 2023-10-24T02:01:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 --2- 172.21.15.148:0/3018733465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc151cb0 0x7f2cdc154820 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 -- 172.21.15.148:0/3018733465 >> 172.21.15.148:0/3018733465 conn(0x7f2cdc0caf40 msgr2=0x7f2cdc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 -- 172.21.15.148:0/3018733465 shutdown_connections 2023-10-24T02:01:37.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.889+0000 7f2ce1579700 1 -- 172.21.15.148:0/3018733465 wait complete. 2023-10-24T02:01:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.890+0000 7f2ce1579700 1 Processor -- start 2023-10-24T02:01:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 -- start start 2023-10-24T02:01:37.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc151cb0 0x7f2cdc1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc152130 con 0x7f2cdc06a230 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc152410 con 0x7f2cdc0aa5a0 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2ce1579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc1526f0 con 0x7f2cdc151cb0 2023-10-24T02:01:37.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2cdaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2cdaffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53138/0 (socket says 172.21.15.148:53138) 2023-10-24T02:01:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2cdaffd700 1 -- 172.21.15.148:0/2427935387 learned_addr learned my addr 172.21.15.148:0/2427935387 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2cdb7fe700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc151cb0 0x7f2cdc1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.891+0000 7f2cda7fc700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 -- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc151cb0 msgr2=0x7f2cdc1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc151cb0 0x7f2cdc1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 -- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cdc0aa5a0 msgr2=0x7f2cdc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:37.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:37.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 -- 172.21.15.148:0/2427935387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc009370 con 0x7f2cdc06a230 2023-10-24T02:01:37.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cdaffd700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f2ccc009f50 tx=0x7f2ccc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00b8d0 con 0x7f2cdc06a230 2023-10-24T02:01:37.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00ba30 con 0x7f2cdc06a230 2023-10-24T02:01:37.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc1529d0 con 0x7f2cdc06a230 2023-10-24T02:01:37.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc01b690 con 0x7f2cdc06a230 2023-10-24T02:01:37.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.892+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc0c4db0 con 0x7f2cdc06a230 2023-10-24T02:01:37.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.893+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc153020 con 0x7f2cdc06a230 2023-10-24T02:01:37.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.893+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2ccc01ba00 con 0x7f2cdc06a230 2023-10-24T02:01:37.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.894+0000 7f2cc2ffd700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 0x7f2cc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:37.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.894+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f2ccc07ba50 con 0x7f2cdc06a230 2023-10-24T02:01:37.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.894+0000 7f2cda7fc700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 0x7f2cc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:37.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.894+0000 7f2cda7fc700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 0x7f2cc8061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2cdc063a10 tx=0x7f2cd0009040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:37.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:37.898+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ccc04ccf0 con 0x7f2cdc06a230 2023-10-24T02:01:38.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.060+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cdc06c6b0 con 0x7f2cdc06a230 2023-10-24T02:01:38.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.061+0000 7f2cc2ffd700 1 -- 172.21.15.148:0/2427935387 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+17062 (secure 0 0 0) 0x7f2ccc01bcb0 con 0x7f2cdc06a230 2023-10-24T02:01:38.062 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:38.062 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":201,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:36.402460+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:01:38.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 msgr2=0x7f2cc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 0x7f2cc8061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2cdc063a10 tx=0x7f2cd0009040).stop 2023-10-24T02:01:38.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 msgr2=0x7f2cdc14efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f2ccc009f50 tx=0x7f2ccc017000).stop 2023-10-24T02:01:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 shutdown_connections 2023-10-24T02:01:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2cdc151cb0 0x7f2cdc1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2cdc06a230 0x7f2cdc14efd0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2cc805f150 0x7f2cc8061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 --2- 172.21.15.148:0/2427935387 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2cdc0aa5a0 0x7f2cdc0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 >> 172.21.15.148:0/2427935387 conn(0x7f2cdc0caf40 msgr2=0x7f2cdc150f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 shutdown_connections 2023-10-24T02:01:38.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.063+0000 7f2ce1579700 1 -- 172.21.15.148:0/2427935387 wait complete. 2023-10-24T02:01:38.075 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T02:01:38.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:01:38.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.189+0000 7fcdd2bed700 1 Processor -- start 2023-10-24T02:01:38.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.189+0000 7fcdd2bed700 1 -- start start 2023-10-24T02:01:38.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd2bed700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcdcc154500 0x7fcdcc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd2bed700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc158000 con 0x7fcdcc154120 2023-10-24T02:01:38.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd2bed700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc158e60 con 0x7fcdcc06a270 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd2bed700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc06a6c0 con 0x7fcdcc154500 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd0989700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcdcc154120 0x7fcdcc0a9f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46560/0 (socket says 172.21.15.148:46560) 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdd0989700 1 -- 172.21.15.148:0/2886813333 learned_addr learned my addr 172.21.15.148:0/2886813333 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2886813333 >> v2:172.21.15.150:3300/0 conn(0x7fcdcc154500 0x7fcdcc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.190+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467564978 0 0) 0x7fcdcc158000 con 0x7fcdcc154120 2023-10-24T02:01:38.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb40033f0 con 0x7fcdcc154120 2023-10-24T02:01:38.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125119120 0 0) 0x7fcdb40033f0 con 0x7fcdcc154120 2023-10-24T02:01:38.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 >> v2:172.21.15.150:3300/0 conn(0x7fcdcc154500 msgr2=0x7fcdcc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 --2- 172.21.15.148:0/2886813333 >> v2:172.21.15.150:3300/0 conn(0x7fcdcc154500 0x7fcdcc069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 >> v1:172.21.15.150:6789/0 conn(0x7fcdcc06a270 legacy=0x7fcdcc0c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc158250 con 0x7fcdcc154120 2023-10-24T02:01:38.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fcdc80017f0 con 0x7fcdcc154120 2023-10-24T02:01:38.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 >> v1:172.21.15.148:6789/0 conn(0x7fcdcc154120 legacy=0x7fcdcc0a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 0x7fcdb4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdb4005050 0x7fcdb400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc06a6c0 con 0x7fcdb4004690 2023-10-24T02:01:38.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400bfe0 con 0x7fcdb40038e0 2023-10-24T02:01:38.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400c1a0 con 0x7fcdb4005050 2023-10-24T02:01:38.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 0x7fcdb4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdd0989700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdd118a700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdb4005050 0x7fcdb400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 -- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdb4005050 msgr2=0x7fcdb400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdb4005050 0x7fcdb400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 -- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb40038e0 msgr2=0x7fcdb4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb40038e0 0x7fcdb4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 -- 172.21.15.148:0/2886813333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40033f0 con 0x7fcdb4004690 2023-10-24T02:01:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdd118a700 1 -- 172.21.15.148:0/2886813333 reap_dead start 2023-10-24T02:01:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 0x7fcdb4004b10 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fcdbc006d80 tx=0x7fcdbc009060).ready entity=mon.0 client_cookie=c63b9e4acf3f3cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc009e70 con 0x7fcdb4004690 2023-10-24T02:01:38.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00e640 con 0x7fcdb4004690 2023-10-24T02:01:38.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.191+0000 7fcdc37fe700 1 -- 172.21.15.148:0/2886813333 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00e9e0 con 0x7fcdb4004690 2023-10-24T02:01:38.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 msgr2=0x7fcdb4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 0x7fcdb4004b10 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fcdbc006d80 tx=0x7fcdbc009060).stop 2023-10-24T02:01:38.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2886813333 shutdown_connections 2023-10-24T02:01:38.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2886813333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdb4004690 0x7fcdb4004b10 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2886813333 >> 172.21.15.148:0/2886813333 conn(0x7fcdcc0cba30 msgr2=0x7fcdcc063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2886813333 shutdown_connections 2023-10-24T02:01:38.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.192+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2886813333 wait complete. 2023-10-24T02:01:38.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.193+0000 7fcdd2bed700 1 Processor -- start 2023-10-24T02:01:38.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.193+0000 7fcdd2bed700 1 -- start start 2023-10-24T02:01:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 0x7fcdcc14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdcc0c2be0 0x7fcdcc0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc15a020 con 0x7fcdcc0abf20 2023-10-24T02:01:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c2750 con 0x7fcdb4004690 2023-10-24T02:01:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd2bed700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0ac890 con 0x7fcdcc0c2be0 2023-10-24T02:01:38.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53154/0 (socket says 172.21.15.148:53154) 2023-10-24T02:01:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 -- 172.21.15.148:0/2859517900 learned_addr learned my addr 172.21.15.148:0/2859517900 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdc3fff700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdcc0c2be0 0x7fcdcc0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd0989700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 0x7fcdcc14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 -- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdcc0c2be0 msgr2=0x7fcdcc0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdcc0c2be0 0x7fcdcc0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 -- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 msgr2=0x7fcdcc14eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 0x7fcdcc14eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd118a700 1 -- 172.21.15.148:0/2859517900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc159d40 con 0x7fcdcc0abf20 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.194+0000 7fcdd0989700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 0x7fcdcc14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:38.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdd118a700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fcdcc065940 tx=0x7fcdc4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4007b90 con 0x7fcdcc0abf20 2023-10-24T02:01:38.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400ed60 con 0x7fcdcc0abf20 2023-10-24T02:01:38.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0c2100 con 0x7fcdcc0abf20 2023-10-24T02:01:38.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4014640 con 0x7fcdcc0abf20 2023-10-24T02:01:38.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.195+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc14f190 con 0x7fcdcc0abf20 2023-10-24T02:01:38.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.196+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc06c6b0 con 0x7fcdcc0abf20 2023-10-24T02:01:38.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.196+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcdc4014a70 con 0x7fcdcc0abf20 2023-10-24T02:01:38.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.196+0000 7fcdc0ff9700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 0x7fcdb8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.196+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fcdc4079890 con 0x7fcdcc0abf20 2023-10-24T02:01:38.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.197+0000 7fcdd0989700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 0x7fcdb8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.197+0000 7fcdd0989700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 0x7fcdb8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcdc8002220 tx=0x7fcdc8009040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.200+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcdc4049af0 con 0x7fcdcc0abf20 2023-10-24T02:01:38.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.359+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcdcc0cbe40 con 0x7fcdb805f150 2023-10-24T02:01:38.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.370+0000 7fcdc0ff9700 1 -- 172.21.15.148:0/2859517900 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358887 (secure 0 0 0) 0x7fcdcc0cbe40 con 0x7fcdb805f150 2023-10-24T02:01:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:38.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 msgr2=0x7fcdb8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 0x7fcdb8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcdc8002220 tx=0x7fcdc8009040).stop 2023-10-24T02:01:38.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 msgr2=0x7fcdcc0ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fcdcc065940 tx=0x7fcdc4009040).stop 2023-10-24T02:01:38.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 shutdown_connections 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcdcc0abf20 0x7fcdcc0ac3a0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcdb805f150 0x7fcdb8061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdb4004690 0x7fcdcc14eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 --2- 172.21.15.148:0/2859517900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdcc0c2be0 0x7fcdcc0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 >> 172.21.15.148:0/2859517900 conn(0x7fcdcc0cba30 msgr2=0x7fcdcc0c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 shutdown_connections 2023-10-24T02:01:38.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.373+0000 7fcdd2bed700 1 -- 172.21.15.148:0/2859517900 wait complete. 2023-10-24T02:01:38.380 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:01:38.386 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T02:01:38.308993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449348,"kb_used_data":19332,"kb_used_omap":0,"kb_used_meta":2429952,"kb_avail":752525372,"statfs":{"total":773094113280,"available":770585980928,"internally_reserved":0,"allocated":19795968,"data_stored":10106777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488270848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593109,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-644,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.524136"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050817+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080916+0000","last_change":"2023-10-24T02:01:35.080916+0000","last_active":"2023-10-24T02:01:35.080916+0000","last_peered":"2023-10-24T02:01:35.080916+0000","last_clean":"2023-10-24T02:01:35.080916+0000","last_became_active":"2023-10-24T02:01:35.080521+0000","last_became_peered":"2023-10-24T02:01:35.080521+0000","last_unstale":"2023-10-24T02:01:35.080916+0000","last_undegraded":"2023-10-24T02:01:35.080916+0000","last_fullsized":"2023-10-24T02:01:35.080916+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059227+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074581+0000","last_change":"2023-10-24T02:01:35.074581+0000","last_active":"2023-10-24T02:01:35.074581+0000","last_peered":"2023-10-24T02:01:35.074581+0000","last_clean":"2023-10-24T02:01:35.074581+0000","last_became_active":"2023-10-24T02:01:35.074242+0000","last_became_peered":"2023-10-24T02:01:35.074242+0000","last_unstale":"2023-10-24T02:01:35.074581+0000","last_undegraded":"2023-10-24T02:01:35.074581+0000","last_fullsized":"2023-10-24T02:01:35.074581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043065+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.075078+0000","last_change":"2023-10-24T02:01:35.075078+0000","last_active":"2023-10-24T02:01:35.075078+0000","last_peered":"2023-10-24T02:01:35.075078+0000","last_clean":"2023-10-24T02:01:35.075078+0000","last_became_active":"2023-10-24T02:01:35.074742+0000","last_became_peered":"2023-10-24T02:01:35.074742+0000","last_unstale":"2023-10-24T02:01:35.075078+0000","last_undegraded":"2023-10-24T02:01:35.075078+0000","last_fullsized":"2023-10-24T02:01:35.075078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038711+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051648+0000","last_change":"2023-10-24T02:01:35.051648+0000","last_active":"2023-10-24T02:01:35.051648+0000","last_peered":"2023-10-24T02:01:35.051648+0000","last_clean":"2023-10-24T02:01:35.051648+0000","last_became_active":"2023-10-24T02:01:35.051381+0000","last_became_peered":"2023-10-24T02:01:35.051381+0000","last_unstale":"2023-10-24T02:01:35.051648+0000","last_undegraded":"2023-10-24T02:01:35.051648+0000","last_fullsized":"2023-10-24T02:01:35.051648+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052757+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070025+0000","last_change":"2023-10-24T02:01:35.070025+0000","last_active":"2023-10-24T02:01:35.070025+0000","last_peered":"2023-10-24T02:01:35.070025+0000","last_clean":"2023-10-24T02:01:35.070025+0000","last_became_active":"2023-10-24T02:01:35.069755+0000","last_became_peered":"2023-10-24T02:01:35.069755+0000","last_unstale":"2023-10-24T02:01:35.070025+0000","last_undegraded":"2023-10-24T02:01:35.070025+0000","last_fullsized":"2023-10-24T02:01:35.070025+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057955+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057037+0000","last_change":"2023-10-24T02:01:35.057037+0000","last_active":"2023-10-24T02:01:35.057037+0000","last_peered":"2023-10-24T02:01:35.057037+0000","last_clean":"2023-10-24T02:01:35.057037+0000","last_became_active":"2023-10-24T02:01:35.056784+0000","last_became_peered":"2023-10-24T02:01:35.056784+0000","last_unstale":"2023-10-24T02:01:35.057037+0000","last_undegraded":"2023-10-24T02:01:35.057037+0000","last_fullsized":"2023-10-24T02:01:35.057037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034349+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066421+0000","last_change":"2023-10-24T02:01:35.066421+0000","last_active":"2023-10-24T02:01:35.066421+0000","last_peered":"2023-10-24T02:01:35.066421+0000","last_clean":"2023-10-24T02:01:35.066421+0000","last_became_active":"2023-10-24T02:01:35.066139+0000","last_became_peered":"2023-10-24T02:01:35.066139+0000","last_unstale":"2023-10-24T02:01:35.066421+0000","last_undegraded":"2023-10-24T02:01:35.066421+0000","last_fullsized":"2023-10-24T02:01:35.066421+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035056+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069974+0000","last_change":"2023-10-24T02:01:35.069974+0000","last_active":"2023-10-24T02:01:35.069974+0000","last_peered":"2023-10-24T02:01:35.069974+0000","last_clean":"2023-10-24T02:01:35.069974+0000","last_became_active":"2023-10-24T02:01:35.069681+0000","last_became_peered":"2023-10-24T02:01:35.069681+0000","last_unstale":"2023-10-24T02:01:35.069974+0000","last_undegraded":"2023-10-24T02:01:35.069974+0000","last_fullsized":"2023-10-24T02:01:35.069974+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034853+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067758+0000","last_change":"2023-10-24T02:01:35.067758+0000","last_active":"2023-10-24T02:01:35.067758+0000","last_peered":"2023-10-24T02:01:35.067758+0000","last_clean":"2023-10-24T02:01:35.067758+0000","last_became_active":"2023-10-24T02:01:35.067539+0000","last_became_peered":"2023-10-24T02:01:35.067539+0000","last_unstale":"2023-10-24T02:01:35.067758+0000","last_undegraded":"2023-10-24T02:01:35.067758+0000","last_fullsized":"2023-10-24T02:01:35.067758+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035326+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066613+0000","last_change":"2023-10-24T02:01:35.066613+0000","last_active":"2023-10-24T02:01:35.066613+0000","last_peered":"2023-10-24T02:01:35.066613+0000","last_clean":"2023-10-24T02:01:35.066613+0000","last_became_active":"2023-10-24T02:01:35.066302+0000","last_became_peered":"2023-10-24T02:01:35.066302+0000","last_unstale":"2023-10-24T02:01:35.066613+0000","last_undegraded":"2023-10-24T02:01:35.066613+0000","last_fullsized":"2023-10-24T02:01:35.066613+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051632+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070561+0000","last_change":"2023-10-24T02:01:35.070561+0000","last_active":"2023-10-24T02:01:35.070561+0000","last_peered":"2023-10-24T02:01:35.070561+0000","last_clean":"2023-10-24T02:01:35.070561+0000","last_became_active":"2023-10-24T02:01:35.070276+0000","last_became_peered":"2023-10-24T02:01:35.070276+0000","last_unstale":"2023-10-24T02:01:35.070561+0000","last_undegraded":"2023-10-24T02:01:35.070561+0000","last_fullsized":"2023-10-24T02:01:35.070561+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045886+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068883+0000","last_change":"2023-10-24T02:01:35.068883+0000","last_active":"2023-10-24T02:01:35.068883+0000","last_peered":"2023-10-24T02:01:35.068883+0000","last_clean":"2023-10-24T02:01:35.068883+0000","last_became_active":"2023-10-24T02:01:35.068265+0000","last_became_peered":"2023-10-24T02:01:35.068265+0000","last_unstale":"2023-10-24T02:01:35.068883+0000","last_undegraded":"2023-10-24T02:01:35.068883+0000","last_fullsized":"2023-10-24T02:01:35.068883+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057424+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063484+0000","last_change":"2023-10-24T02:01:35.063484+0000","last_active":"2023-10-24T02:01:35.063484+0000","last_peered":"2023-10-24T02:01:35.063484+0000","last_clean":"2023-10-24T02:01:35.063484+0000","last_became_active":"2023-10-24T02:01:35.062894+0000","last_became_peered":"2023-10-24T02:01:35.062894+0000","last_unstale":"2023-10-24T02:01:35.063484+0000","last_undegraded":"2023-10-24T02:01:35.063484+0000","last_fullsized":"2023-10-24T02:01:35.063484+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056442+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068139+0000","last_change":"2023-10-24T02:01:35.068139+0000","last_active":"2023-10-24T02:01:35.068139+0000","last_peered":"2023-10-24T02:01:35.068139+0000","last_clean":"2023-10-24T02:01:35.068139+0000","last_became_active":"2023-10-24T02:01:35.067885+0000","last_became_peered":"2023-10-24T02:01:35.067885+0000","last_unstale":"2023-10-24T02:01:35.068139+0000","last_undegraded":"2023-10-24T02:01:35.068139+0000","last_fullsized":"2023-10-24T02:01:35.068139+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050267+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071046+0000","last_change":"2023-10-24T02:01:35.071046+0000","last_active":"2023-10-24T02:01:35.071046+0000","last_peered":"2023-10-24T02:01:35.071046+0000","last_clean":"2023-10-24T02:01:35.071046+0000","last_became_active":"2023-10-24T02:01:35.070470+0000","last_became_peered":"2023-10-24T02:01:35.070470+0000","last_unstale":"2023-10-24T02:01:35.071046+0000","last_undegraded":"2023-10-24T02:01:35.071046+0000","last_fullsized":"2023-10-24T02:01:35.071046+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055108+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071852+0000","last_change":"2023-10-24T02:01:35.071852+0000","last_active":"2023-10-24T02:01:35.071852+0000","last_peered":"2023-10-24T02:01:35.071852+0000","last_clean":"2023-10-24T02:01:35.071852+0000","last_became_active":"2023-10-24T02:01:35.071578+0000","last_became_peered":"2023-10-24T02:01:35.071578+0000","last_unstale":"2023-10-24T02:01:35.071852+0000","last_undegraded":"2023-10-24T02:01:35.071852+0000","last_fullsized":"2023-10-24T02:01:35.071852+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051673+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060097+0000","last_change":"2023-10-24T02:01:35.060097+0000","last_active":"2023-10-24T02:01:35.060097+0000","last_peered":"2023-10-24T02:01:35.060097+0000","last_clean":"2023-10-24T02:01:35.060097+0000","last_became_active":"2023-10-24T02:01:35.059406+0000","last_became_peered":"2023-10-24T02:01:35.059406+0000","last_unstale":"2023-10-24T02:01:35.060097+0000","last_undegraded":"2023-10-24T02:01:35.060097+0000","last_fullsized":"2023-10-24T02:01:35.060097+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.058822+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048351+0000","last_change":"2023-10-24T02:01:35.048351+0000","last_active":"2023-10-24T02:01:35.048351+0000","last_peered":"2023-10-24T02:01:35.048351+0000","last_clean":"2023-10-24T02:01:35.048351+0000","last_became_active":"2023-10-24T02:01:35.048142+0000","last_became_peered":"2023-10-24T02:01:35.048142+0000","last_unstale":"2023-10-24T02:01:35.048351+0000","last_undegraded":"2023-10-24T02:01:35.048351+0000","last_fullsized":"2023-10-24T02:01:35.048351+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053194+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063242+0000","last_change":"2023-10-24T02:01:35.063242+0000","last_active":"2023-10-24T02:01:35.063242+0000","last_peered":"2023-10-24T02:01:35.063242+0000","last_clean":"2023-10-24T02:01:35.063242+0000","last_became_active":"2023-10-24T02:01:35.062923+0000","last_became_peered":"2023-10-24T02:01:35.062923+0000","last_unstale":"2023-10-24T02:01:35.063242+0000","last_undegraded":"2023-10-24T02:01:35.063242+0000","last_fullsized":"2023-10-24T02:01:35.063242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059768+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067615+0000","last_change":"2023-10-24T02:01:35.067615+0000","last_active":"2023-10-24T02:01:35.067615+0000","last_peered":"2023-10-24T02:01:35.067615+0000","last_clean":"2023-10-24T02:01:35.067615+0000","last_became_active":"2023-10-24T02:01:35.067351+0000","last_became_peered":"2023-10-24T02:01:35.067351+0000","last_unstale":"2023-10-24T02:01:35.067615+0000","last_undegraded":"2023-10-24T02:01:35.067615+0000","last_fullsized":"2023-10-24T02:01:35.067615+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039970+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072772+0000","last_change":"2023-10-24T02:01:35.072772+0000","last_active":"2023-10-24T02:01:35.072772+0000","last_peered":"2023-10-24T02:01:35.072772+0000","last_clean":"2023-10-24T02:01:35.072772+0000","last_became_active":"2023-10-24T02:01:35.072515+0000","last_became_peered":"2023-10-24T02:01:35.072515+0000","last_unstale":"2023-10-24T02:01:35.072772+0000","last_undegraded":"2023-10-24T02:01:35.072772+0000","last_fullsized":"2023-10-24T02:01:35.072772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053856+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061840+0000","last_became_peered":"2023-10-24T02:01:35.061840+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.044421+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065231+0000","last_change":"2023-10-24T02:01:35.065231+0000","last_active":"2023-10-24T02:01:35.065231+0000","last_peered":"2023-10-24T02:01:35.065231+0000","last_clean":"2023-10-24T02:01:35.065231+0000","last_became_active":"2023-10-24T02:01:35.064941+0000","last_became_peered":"2023-10-24T02:01:35.064941+0000","last_unstale":"2023-10-24T02:01:35.065231+0000","last_undegraded":"2023-10-24T02:01:35.065231+0000","last_fullsized":"2023-10-24T02:01:35.065231+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039279+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069087+0000","last_change":"2023-10-24T02:01:35.069087+0000","last_active":"2023-10-24T02:01:35.069087+0000","last_peered":"2023-10-24T02:01:35.069087+0000","last_clean":"2023-10-24T02:01:35.069087+0000","last_became_active":"2023-10-24T02:01:35.066064+0000","last_became_peered":"2023-10-24T02:01:35.066064+0000","last_unstale":"2023-10-24T02:01:35.069087+0000","last_undegraded":"2023-10-24T02:01:35.069087+0000","last_fullsized":"2023-10-24T02:01:35.069087+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050308+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074140+0000","last_change":"2023-10-24T02:01:35.074140+0000","last_active":"2023-10-24T02:01:35.074140+0000","last_peered":"2023-10-24T02:01:35.074140+0000","last_clean":"2023-10-24T02:01:35.074140+0000","last_became_active":"2023-10-24T02:01:35.073879+0000","last_became_peered":"2023-10-24T02:01:35.073879+0000","last_unstale":"2023-10-24T02:01:35.074140+0000","last_undegraded":"2023-10-24T02:01:35.074140+0000","last_fullsized":"2023-10-24T02:01:35.074140+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042266+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056668+0000","last_change":"2023-10-24T02:01:35.056668+0000","last_active":"2023-10-24T02:01:35.056668+0000","last_peered":"2023-10-24T02:01:35.056668+0000","last_clean":"2023-10-24T02:01:35.056668+0000","last_became_active":"2023-10-24T02:01:35.056456+0000","last_became_peered":"2023-10-24T02:01:35.056456+0000","last_unstale":"2023-10-24T02:01:35.056668+0000","last_undegraded":"2023-10-24T02:01:35.056668+0000","last_fullsized":"2023-10-24T02:01:35.056668+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051238+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066552+0000","last_change":"2023-10-24T02:01:35.066552+0000","last_active":"2023-10-24T02:01:35.066552+0000","last_peered":"2023-10-24T02:01:35.066552+0000","last_clean":"2023-10-24T02:01:35.066552+0000","last_became_active":"2023-10-24T02:01:35.066026+0000","last_became_peered":"2023-10-24T02:01:35.066026+0000","last_unstale":"2023-10-24T02:01:35.066552+0000","last_undegraded":"2023-10-24T02:01:35.066552+0000","last_fullsized":"2023-10-24T02:01:35.066552+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038320+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066458+0000","last_change":"2023-10-24T02:01:35.066458+0000","last_active":"2023-10-24T02:01:35.066458+0000","last_peered":"2023-10-24T02:01:35.066458+0000","last_clean":"2023-10-24T02:01:35.066458+0000","last_became_active":"2023-10-24T02:01:35.066109+0000","last_became_peered":"2023-10-24T02:01:35.066109+0000","last_unstale":"2023-10-24T02:01:35.066458+0000","last_undegraded":"2023-10-24T02:01:35.066458+0000","last_fullsized":"2023-10-24T02:01:35.066458+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042386+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065554+0000","last_change":"2023-10-24T02:01:35.065554+0000","last_active":"2023-10-24T02:01:35.065554+0000","last_peered":"2023-10-24T02:01:35.065554+0000","last_clean":"2023-10-24T02:01:35.065554+0000","last_became_active":"2023-10-24T02:01:35.065264+0000","last_became_peered":"2023-10-24T02:01:35.065264+0000","last_unstale":"2023-10-24T02:01:35.065554+0000","last_undegraded":"2023-10-24T02:01:35.065554+0000","last_fullsized":"2023-10-24T02:01:35.065554+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057553+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067711+0000","last_change":"2023-10-24T02:01:35.067711+0000","last_active":"2023-10-24T02:01:35.067711+0000","last_peered":"2023-10-24T02:01:35.067711+0000","last_clean":"2023-10-24T02:01:35.067711+0000","last_became_active":"2023-10-24T02:01:35.067429+0000","last_became_peered":"2023-10-24T02:01:35.067429+0000","last_unstale":"2023-10-24T02:01:35.067711+0000","last_undegraded":"2023-10-24T02:01:35.067711+0000","last_fullsized":"2023-10-24T02:01:35.067711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053241+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065740+0000","last_change":"2023-10-24T02:01:35.065740+0000","last_active":"2023-10-24T02:01:35.065740+0000","last_peered":"2023-10-24T02:01:35.065740+0000","last_clean":"2023-10-24T02:01:35.065740+0000","last_became_active":"2023-10-24T02:01:35.065413+0000","last_became_peered":"2023-10-24T02:01:35.065413+0000","last_unstale":"2023-10-24T02:01:35.065740+0000","last_undegraded":"2023-10-24T02:01:35.065740+0000","last_fullsized":"2023-10-24T02:01:35.065740+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034683+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048085+0000","last_change":"2023-10-24T02:01:35.048085+0000","last_active":"2023-10-24T02:01:35.048085+0000","last_peered":"2023-10-24T02:01:35.048085+0000","last_clean":"2023-10-24T02:01:35.048085+0000","last_became_active":"2023-10-24T02:01:35.047789+0000","last_became_peered":"2023-10-24T02:01:35.047789+0000","last_unstale":"2023-10-24T02:01:35.048085+0000","last_undegraded":"2023-10-24T02:01:35.048085+0000","last_fullsized":"2023-10-24T02:01:35.048085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.060595+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062733+0000","last_change":"2023-10-24T02:01:35.062733+0000","last_active":"2023-10-24T02:01:35.062733+0000","last_peered":"2023-10-24T02:01:35.062733+0000","last_clean":"2023-10-24T02:01:35.062733+0000","last_became_active":"2023-10-24T02:01:35.062388+0000","last_became_peered":"2023-10-24T02:01:35.062388+0000","last_unstale":"2023-10-24T02:01:35.062733+0000","last_undegraded":"2023-10-24T02:01:35.062733+0000","last_fullsized":"2023-10-24T02:01:35.062733+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038283+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056643+0000","last_change":"2023-10-24T02:01:35.056643+0000","last_active":"2023-10-24T02:01:35.056643+0000","last_peered":"2023-10-24T02:01:35.056643+0000","last_clean":"2023-10-24T02:01:35.056643+0000","last_became_active":"2023-10-24T02:01:35.056224+0000","last_became_peered":"2023-10-24T02:01:35.056224+0000","last_unstale":"2023-10-24T02:01:35.056643+0000","last_undegraded":"2023-10-24T02:01:35.056643+0000","last_fullsized":"2023-10-24T02:01:35.056643+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042654+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072602+0000","last_change":"2023-10-24T02:01:35.072602+0000","last_active":"2023-10-24T02:01:35.072602+0000","last_peered":"2023-10-24T02:01:35.072602+0000","last_clean":"2023-10-24T02:01:35.072602+0000","last_became_active":"2023-10-24T02:01:35.072258+0000","last_became_peered":"2023-10-24T02:01:35.072258+0000","last_unstale":"2023-10-24T02:01:35.072602+0000","last_undegraded":"2023-10-24T02:01:35.072602+0000","last_fullsized":"2023-10-24T02:01:35.072602+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052528+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067842+0000","last_change":"2023-10-24T02:01:35.067842+0000","last_active":"2023-10-24T02:01:35.067842+0000","last_peered":"2023-10-24T02:01:35.067842+0000","last_clean":"2023-10-24T02:01:35.067842+0000","last_became_active":"2023-10-24T02:01:35.067481+0000","last_became_peered":"2023-10-24T02:01:35.067481+0000","last_unstale":"2023-10-24T02:01:35.067842+0000","last_undegraded":"2023-10-24T02:01:35.067842+0000","last_fullsized":"2023-10-24T02:01:35.067842+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035644+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051447+0000","last_change":"2023-10-24T02:01:35.051447+0000","last_active":"2023-10-24T02:01:35.051447+0000","last_peered":"2023-10-24T02:01:35.051447+0000","last_clean":"2023-10-24T02:01:35.051447+0000","last_became_active":"2023-10-24T02:01:35.050511+0000","last_became_peered":"2023-10-24T02:01:35.050511+0000","last_unstale":"2023-10-24T02:01:35.051447+0000","last_undegraded":"2023-10-24T02:01:35.051447+0000","last_fullsized":"2023-10-24T02:01:35.051447+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.046393+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.054678+0000","last_change":"2023-10-24T02:01:35.054678+0000","last_active":"2023-10-24T02:01:35.054678+0000","last_peered":"2023-10-24T02:01:35.054678+0000","last_clean":"2023-10-24T02:01:35.054678+0000","last_became_active":"2023-10-24T02:01:35.054410+0000","last_became_peered":"2023-10-24T02:01:35.054410+0000","last_unstale":"2023-10-24T02:01:35.054678+0000","last_undegraded":"2023-10-24T02:01:35.054678+0000","last_fullsized":"2023-10-24T02:01:35.054678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043975+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057004+0000","last_change":"2023-10-24T02:01:35.057004+0000","last_active":"2023-10-24T02:01:35.057004+0000","last_peered":"2023-10-24T02:01:35.057004+0000","last_clean":"2023-10-24T02:01:35.057004+0000","last_became_active":"2023-10-24T02:01:35.056703+0000","last_became_peered":"2023-10-24T02:01:35.056703+0000","last_unstale":"2023-10-24T02:01:35.057004+0000","last_undegraded":"2023-10-24T02:01:35.057004+0000","last_fullsized":"2023-10-24T02:01:35.057004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050848+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070176+0000","last_change":"2023-10-24T02:01:35.070176+0000","last_active":"2023-10-24T02:01:35.070176+0000","last_peered":"2023-10-24T02:01:35.070176+0000","last_clean":"2023-10-24T02:01:35.070176+0000","last_became_active":"2023-10-24T02:01:35.069790+0000","last_became_peered":"2023-10-24T02:01:35.069790+0000","last_unstale":"2023-10-24T02:01:35.070176+0000","last_undegraded":"2023-10-24T02:01:35.070176+0000","last_fullsized":"2023-10-24T02:01:35.070176+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034321+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066486+0000","last_change":"2023-10-24T02:01:35.066486+0000","last_active":"2023-10-24T02:01:35.066486+0000","last_peered":"2023-10-24T02:01:35.066486+0000","last_clean":"2023-10-24T02:01:35.066486+0000","last_became_active":"2023-10-24T02:01:35.066230+0000","last_became_peered":"2023-10-24T02:01:35.066230+0000","last_unstale":"2023-10-24T02:01:35.066486+0000","last_undegraded":"2023-10-24T02:01:35.066486+0000","last_fullsized":"2023-10-24T02:01:35.066486+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054352+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.049824+0000","last_change":"2023-10-24T02:01:35.049824+0000","last_active":"2023-10-24T02:01:35.049824+0000","last_peered":"2023-10-24T02:01:35.049824+0000","last_clean":"2023-10-24T02:01:35.049824+0000","last_became_active":"2023-10-24T02:01:35.049440+0000","last_became_peered":"2023-10-24T02:01:35.049440+0000","last_unstale":"2023-10-24T02:01:35.049824+0000","last_undegraded":"2023-10-24T02:01:35.049824+0000","last_fullsized":"2023-10-24T02:01:35.049824+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055578+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069408+0000","last_change":"2023-10-24T02:01:35.069408+0000","last_active":"2023-10-24T02:01:35.069408+0000","last_peered":"2023-10-24T02:01:35.069408+0000","last_clean":"2023-10-24T02:01:35.069408+0000","last_became_active":"2023-10-24T02:01:35.069083+0000","last_became_peered":"2023-10-24T02:01:35.069083+0000","last_unstale":"2023-10-24T02:01:35.069408+0000","last_undegraded":"2023-10-24T02:01:35.069408+0000","last_fullsized":"2023-10-24T02:01:35.069408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061594+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050116+0000","last_change":"2023-10-24T02:01:35.050116+0000","last_active":"2023-10-24T02:01:35.050116+0000","last_peered":"2023-10-24T02:01:35.050116+0000","last_clean":"2023-10-24T02:01:35.050116+0000","last_became_active":"2023-10-24T02:01:35.049854+0000","last_became_peered":"2023-10-24T02:01:35.049854+0000","last_unstale":"2023-10-24T02:01:35.050116+0000","last_undegraded":"2023-10-24T02:01:35.050116+0000","last_fullsized":"2023-10-24T02:01:35.050116+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.040387+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067595+0000","last_change":"2023-10-24T02:01:35.067595+0000","last_active":"2023-10-24T02:01:35.067595+0000","last_peered":"2023-10-24T02:01:35.067595+0000","last_clean":"2023-10-24T02:01:35.067595+0000","last_became_active":"2023-10-24T02:01:35.067318+0000","last_became_peered":"2023-10-24T02:01:35.067318+0000","last_unstale":"2023-10-24T02:01:35.067595+0000","last_undegraded":"2023-10-24T02:01:35.067595+0000","last_fullsized":"2023-10-24T02:01:35.067595+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043570+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063179+0000","last_change":"2023-10-24T02:01:35.063179+0000","last_active":"2023-10-24T02:01:35.063179+0000","last_peered":"2023-10-24T02:01:35.063179+0000","last_clean":"2023-10-24T02:01:35.063179+0000","last_became_active":"2023-10-24T02:01:35.062905+0000","last_became_peered":"2023-10-24T02:01:35.062905+0000","last_unstale":"2023-10-24T02:01:35.063179+0000","last_undegraded":"2023-10-24T02:01:35.063179+0000","last_fullsized":"2023-10-24T02:01:35.063179+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043243+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061859+0000","last_became_peered":"2023-10-24T02:01:35.061859+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051911+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074890+0000","last_change":"2023-10-24T02:01:35.074890+0000","last_active":"2023-10-24T02:01:35.074890+0000","last_peered":"2023-10-24T02:01:35.074890+0000","last_clean":"2023-10-24T02:01:35.074890+0000","last_became_active":"2023-10-24T02:01:35.074531+0000","last_became_peered":"2023-10-24T02:01:35.074531+0000","last_unstale":"2023-10-24T02:01:35.074890+0000","last_undegraded":"2023-10-24T02:01:35.074890+0000","last_fullsized":"2023-10-24T02:01:35.074890+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054064+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065366+0000","last_change":"2023-10-24T02:01:35.065366+0000","last_active":"2023-10-24T02:01:35.065366+0000","last_peered":"2023-10-24T02:01:35.065366+0000","last_clean":"2023-10-24T02:01:35.065366+0000","last_became_active":"2023-10-24T02:01:35.065020+0000","last_became_peered":"2023-10-24T02:01:35.065020+0000","last_unstale":"2023-10-24T02:01:35.065366+0000","last_undegraded":"2023-10-24T02:01:35.065366+0000","last_fullsized":"2023-10-24T02:01:35.065366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034982+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050315+0000","last_change":"2023-10-24T02:01:35.050315+0000","last_active":"2023-10-24T02:01:35.050315+0000","last_peered":"2023-10-24T02:01:35.050315+0000","last_clean":"2023-10-24T02:01:35.050315+0000","last_became_active":"2023-10-24T02:01:35.049685+0000","last_became_peered":"2023-10-24T02:01:35.049685+0000","last_unstale":"2023-10-24T02:01:35.050315+0000","last_undegraded":"2023-10-24T02:01:35.050315+0000","last_fullsized":"2023-10-24T02:01:35.050315+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045773+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060505+0000","last_change":"2023-10-24T02:01:35.060505+0000","last_active":"2023-10-24T02:01:35.060505+0000","last_peered":"2023-10-24T02:01:35.060505+0000","last_clean":"2023-10-24T02:01:35.060505+0000","last_became_active":"2023-10-24T02:01:35.060288+0000","last_became_peered":"2023-10-24T02:01:35.060288+0000","last_unstale":"2023-10-24T02:01:35.060505+0000","last_undegraded":"2023-10-24T02:01:35.060505+0000","last_fullsized":"2023-10-24T02:01:35.060505+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034307+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053840+0000","last_change":"2023-10-24T02:01:35.053840+0000","last_active":"2023-10-24T02:01:35.053840+0000","last_peered":"2023-10-24T02:01:35.053840+0000","last_clean":"2023-10-24T02:01:35.053840+0000","last_became_active":"2023-10-24T02:01:35.053577+0000","last_became_peered":"2023-10-24T02:01:35.053577+0000","last_unstale":"2023-10-24T02:01:35.053840+0000","last_undegraded":"2023-10-24T02:01:35.053840+0000","last_fullsized":"2023-10-24T02:01:35.053840+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056043+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062771+0000","last_change":"2023-10-24T02:01:35.062771+0000","last_active":"2023-10-24T02:01:35.062771+0000","last_peered":"2023-10-24T02:01:35.062771+0000","last_clean":"2023-10-24T02:01:35.062771+0000","last_became_active":"2023-10-24T02:01:35.062245+0000","last_became_peered":"2023-10-24T02:01:35.062245+0000","last_unstale":"2023-10-24T02:01:35.062771+0000","last_undegraded":"2023-10-24T02:01:35.062771+0000","last_fullsized":"2023-10-24T02:01:35.062771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053496+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050373+0000","last_change":"2023-10-24T02:01:35.050373+0000","last_active":"2023-10-24T02:01:35.050373+0000","last_peered":"2023-10-24T02:01:35.050373+0000","last_clean":"2023-10-24T02:01:35.050373+0000","last_became_active":"2023-10-24T02:01:35.050108+0000","last_became_peered":"2023-10-24T02:01:35.050108+0000","last_unstale":"2023-10-24T02:01:35.050373+0000","last_undegraded":"2023-10-24T02:01:35.050373+0000","last_fullsized":"2023-10-24T02:01:35.050373+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039550+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.077262+0000","last_change":"2023-10-24T02:01:35.077262+0000","last_active":"2023-10-24T02:01:35.077262+0000","last_peered":"2023-10-24T02:01:35.077262+0000","last_clean":"2023-10-24T02:01:35.077262+0000","last_became_active":"2023-10-24T02:01:35.076871+0000","last_became_peered":"2023-10-24T02:01:35.076871+0000","last_unstale":"2023-10-24T02:01:35.077262+0000","last_undegraded":"2023-10-24T02:01:35.077262+0000","last_fullsized":"2023-10-24T02:01:35.077262+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045418+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071577+0000","last_change":"2023-10-24T02:01:35.071577+0000","last_active":"2023-10-24T02:01:35.071577+0000","last_peered":"2023-10-24T02:01:35.071577+0000","last_clean":"2023-10-24T02:01:35.071577+0000","last_became_active":"2023-10-24T02:01:35.071242+0000","last_became_peered":"2023-10-24T02:01:35.071242+0000","last_unstale":"2023-10-24T02:01:35.071577+0000","last_undegraded":"2023-10-24T02:01:35.071577+0000","last_fullsized":"2023-10-24T02:01:35.071577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054205+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065762+0000","last_change":"2023-10-24T02:01:35.065762+0000","last_active":"2023-10-24T02:01:35.065762+0000","last_peered":"2023-10-24T02:01:35.065762+0000","last_clean":"2023-10-24T02:01:35.065762+0000","last_became_active":"2023-10-24T02:01:35.065467+0000","last_became_peered":"2023-10-24T02:01:35.065467+0000","last_unstale":"2023-10-24T02:01:35.065762+0000","last_undegraded":"2023-10-24T02:01:35.065762+0000","last_fullsized":"2023-10-24T02:01:35.065762+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029128+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:01:34.029128+0000","last_peered":"2023-10-24T02:01:34.029128+0000","last_clean":"2023-10-24T02:01:34.029128+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:01:34.029128+0000","last_undegraded":"2023-10-24T02:01:34.029128+0000","last_fullsized":"2023-10-24T02:01:34.029128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061505+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.047264+0000","last_change":"2023-10-24T02:01:35.047264+0000","last_active":"2023-10-24T02:01:35.047264+0000","last_peered":"2023-10-24T02:01:35.047264+0000","last_clean":"2023-10-24T02:01:35.047264+0000","last_became_active":"2023-10-24T02:01:35.047045+0000","last_became_peered":"2023-10-24T02:01:35.047045+0000","last_unstale":"2023-10-24T02:01:35.047264+0000","last_undegraded":"2023-10-24T02:01:35.047264+0000","last_fullsized":"2023-10-24T02:01:35.047264+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024727+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:01:34.024727+0000","last_peered":"2023-10-24T02:01:34.024727+0000","last_clean":"2023-10-24T02:01:34.024727+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:01:34.024727+0000","last_undegraded":"2023-10-24T02:01:34.024727+0000","last_fullsized":"2023-10-24T02:01:34.024727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.041316+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053784+0000","last_change":"2023-10-24T02:01:35.053784+0000","last_active":"2023-10-24T02:01:35.053784+0000","last_peered":"2023-10-24T02:01:35.053784+0000","last_clean":"2023-10-24T02:01:35.053784+0000","last_became_active":"2023-10-24T02:01:35.053537+0000","last_became_peered":"2023-10-24T02:01:35.053537+0000","last_unstale":"2023-10-24T02:01:35.053784+0000","last_undegraded":"2023-10-24T02:01:35.053784+0000","last_fullsized":"2023-10-24T02:01:35.053784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.020684+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:01:34.020684+0000","last_peered":"2023-10-24T02:01:34.020684+0000","last_clean":"2023-10-24T02:01:34.020684+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:01:34.020684+0000","last_undegraded":"2023-10-24T02:01:34.020684+0000","last_fullsized":"2023-10-24T02:01:34.020684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050783+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050465+0000","last_change":"2023-10-24T02:01:35.050465+0000","last_active":"2023-10-24T02:01:35.050465+0000","last_peered":"2023-10-24T02:01:35.050465+0000","last_clean":"2023-10-24T02:01:35.050465+0000","last_became_active":"2023-10-24T02:01:35.050041+0000","last_became_peered":"2023-10-24T02:01:35.050041+0000","last_unstale":"2023-10-24T02:01:35.050465+0000","last_undegraded":"2023-10-24T02:01:35.050465+0000","last_fullsized":"2023-10-24T02:01:35.050465+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024886+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:01:34.024886+0000","last_peered":"2023-10-24T02:01:34.024886+0000","last_clean":"2023-10-24T02:01:34.024886+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:01:34.024886+0000","last_undegraded":"2023-10-24T02:01:34.024886+0000","last_fullsized":"2023-10-24T02:01:34.024886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":192,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028141+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:01:34.028141+0000","last_peered":"2023-10-24T02:01:34.028141+0000","last_clean":"2023-10-24T02:01:34.028141+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:01:34.028141+0000","last_undegraded":"2023-10-24T02:01:34.028141+0000","last_fullsized":"2023-10-24T02:01:34.028141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038885+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062583+0000","last_change":"2023-10-24T02:01:35.062583+0000","last_active":"2023-10-24T02:01:35.062583+0000","last_peered":"2023-10-24T02:01:35.062583+0000","last_clean":"2023-10-24T02:01:35.062583+0000","last_became_active":"2023-10-24T02:01:35.062270+0000","last_became_peered":"2023-10-24T02:01:35.062270+0000","last_unstale":"2023-10-24T02:01:35.062583+0000","last_undegraded":"2023-10-24T02:01:35.062583+0000","last_fullsized":"2023-10-24T02:01:35.062583+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028231+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:01:34.028231+0000","last_peered":"2023-10-24T02:01:34.028231+0000","last_clean":"2023-10-24T02:01:34.028231+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:01:34.028231+0000","last_undegraded":"2023-10-24T02:01:34.028231+0000","last_fullsized":"2023-10-24T02:01:34.028231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045087+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.059711+0000","last_change":"2023-10-24T02:01:35.059711+0000","last_active":"2023-10-24T02:01:35.059711+0000","last_peered":"2023-10-24T02:01:35.059711+0000","last_clean":"2023-10-24T02:01:35.059711+0000","last_became_active":"2023-10-24T02:01:35.059392+0000","last_became_peered":"2023-10-24T02:01:35.059392+0000","last_unstale":"2023-10-24T02:01:35.059711+0000","last_undegraded":"2023-10-24T02:01:35.059711+0000","last_fullsized":"2023-10-24T02:01:35.059711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.022778+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:01:34.022778+0000","last_peered":"2023-10-24T02:01:34.022778+0000","last_clean":"2023-10-24T02:01:34.022778+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:01:34.022778+0000","last_undegraded":"2023-10-24T02:01:34.022778+0000","last_fullsized":"2023-10-24T02:01:34.022778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052239+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080408+0000","last_change":"2023-10-24T02:01:35.080408+0000","last_active":"2023-10-24T02:01:35.080408+0000","last_peered":"2023-10-24T02:01:35.080408+0000","last_clean":"2023-10-24T02:01:35.080408+0000","last_became_active":"2023-10-24T02:01:35.080124+0000","last_became_peered":"2023-10-24T02:01:35.080124+0000","last_unstale":"2023-10-24T02:01:35.080408+0000","last_undegraded":"2023-10-24T02:01:35.080408+0000","last_fullsized":"2023-10-24T02:01:35.080408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028674+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:01:34.028674+0000","last_peered":"2023-10-24T02:01:34.028674+0000","last_clean":"2023-10-24T02:01:34.028674+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:01:34.028674+0000","last_undegraded":"2023-10-24T02:01:34.028674+0000","last_fullsized":"2023-10-24T02:01:34.028674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034388+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065227+0000","last_change":"2023-10-24T02:01:35.065227+0000","last_active":"2023-10-24T02:01:35.065227+0000","last_peered":"2023-10-24T02:01:35.065227+0000","last_clean":"2023-10-24T02:01:35.065227+0000","last_became_active":"2023-10-24T02:01:35.065007+0000","last_became_peered":"2023-10-24T02:01:35.065007+0000","last_unstale":"2023-10-24T02:01:35.065227+0000","last_undegraded":"2023-10-24T02:01:35.065227+0000","last_fullsized":"2023-10-24T02:01:35.065227+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029393+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:01:34.029393+0000","last_peered":"2023-10-24T02:01:34.029393+0000","last_clean":"2023-10-24T02:01:34.029393+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:01:34.029393+0000","last_undegraded":"2023-10-24T02:01:34.029393+0000","last_fullsized":"2023-10-24T02:01:34.029393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543252,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.745,"15min":0.86399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.314},"max":{"1min":0.749,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.81999999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.83999999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.55100000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.752,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.85699999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.86499999999999999,"15min":0.90900000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.43099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.877},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.873,"5min":0.873,"15min":1.0049999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.78700000000000003,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.48099999999999998,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.873},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.80200000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575957,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39800000000000002,"15min":0.39100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55100000000000005,"5min":0.878,"15min":0.878},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.51400000000000001,"5min":0.627,"15min":0.63200000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.75},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59099999999999997,"5min":0.67600000000000005,"15min":0.71599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.41199999999999998},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.502},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.82599999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.52600000000000002,"5min":0.47799999999999998,"15min":0.45600000000000002},"max":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575957,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":0.624,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52300000000000002,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.25700000000000001},"max":{"1min":0.52900000000000003,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.375}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.312,"15min":0.25900000000000001},"max":{"1min":0.58999999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.52200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.97299999999999998},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.008},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47799999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":1.028},"last":0.503}]}]},{"osd":2,"up_from":14,"seq":60129543252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.72899999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":0.68300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.95199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.53100000000000003,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97299999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.875,"15min":0.99299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.186},"max":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.59999999999999998},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22500000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.752},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.21299999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.314,"5min":0.314,"15min":0.26100000000000001},"max":{"1min":0.56999999999999995,"5min":0.623,"15min":0.64600000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.65600000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.60899999999999999,"5min":0.68799999999999994,"15min":0.72799999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.35599999999999998},"max":{"1min":0.93600000000000005,"5min":1.097,"15min":1.097},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.41299999999999998,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":1.034,"15min":1.056},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.93799999999999994,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":1.0700000000000001,"15min":1.083},"last":0.624}]},{"osd":7,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":1.155,"15min":1.155},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.45100000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.73599999999999999,"15min":0.83799999999999997},"last":0.438},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.27200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86099999999999999},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.46700000000000003,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83799999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.35899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66100000000000003,"5min":0.76100000000000001,"15min":0.83599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.874},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.80300000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.30299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.499,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.54200000000000004,"5min":0.41699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45900000000000002,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.501,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.27000000000000002},"max":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"max":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.98799999999999999},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:01:38.394 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:01:38.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.538+0000 7fdd6b943700 1 Processor -- start 2023-10-24T02:01:38.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.539+0000 7fdd6b943700 1 -- start start 2023-10-24T02:01:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.539+0000 7fdd6b943700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd640c1b40 0x7fdd64098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.539+0000 7fdd6b943700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd640ca640 0x7fdd640cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd6b943700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640c5910 con 0x7fdd64098700 2023-10-24T02:01:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd6b943700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd64154860 con 0x7fdd640ca640 2023-10-24T02:01:38.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd6b943700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c6490 con 0x7fdd640c1b40 2023-10-24T02:01:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd640ca640 0x7fdd640cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd640ca640 0x7fdd640cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53160/0 (socket says 172.21.15.148:53160) 2023-10-24T02:01:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 -- 172.21.15.148:0/3496592359 learned_addr learned my addr 172.21.15.148:0/3496592359 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:38.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd68ede700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd640c1b40 0x7fdd64098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 -- 172.21.15.148:0/3496592359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd640c1b40 msgr2=0x7fdd64098ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd640c1b40 0x7fdd64098ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 -- 172.21.15.148:0/3496592359 >> v1:172.21.15.150:6789/0 conn(0x7fdd64098700 legacy=0x7fdd640c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 -- 172.21.15.148:0/3496592359 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640c5b60 con 0x7fdd640ca640 2023-10-24T02:01:38.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd69ee0700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640ca640 0x7fdd640cb480 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fdd54006fd0 tx=0x7fdd540090f0).ready entity=mon.0 client_cookie=b37e504d85a0f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd63fff700 1 -- 172.21.15.148:0/3496592359 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400b600 con 0x7fdd640ca640 2023-10-24T02:01:38.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd63fff700 1 -- 172.21.15.148:0/3496592359 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400b760 con 0x7fdd640ca640 2023-10-24T02:01:38.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.540+0000 7fdd63fff700 1 -- 172.21.15.148:0/3496592359 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400bae0 con 0x7fdd640ca640 2023-10-24T02:01:38.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 -- 172.21.15.148:0/3496592359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640ca640 msgr2=0x7fdd640cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640ca640 0x7fdd640cb480 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7fdd54006fd0 tx=0x7fdd540090f0).stop 2023-10-24T02:01:38.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 -- 172.21.15.148:0/3496592359 shutdown_connections 2023-10-24T02:01:38.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640ca640 0x7fdd640cb480 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3496592359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd640c1b40 0x7fdd64098ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 -- 172.21.15.148:0/3496592359 >> 172.21.15.148:0/3496592359 conn(0x7fdd6406b380 msgr2=0x7fdd6406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 -- 172.21.15.148:0/3496592359 shutdown_connections 2023-10-24T02:01:38.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.541+0000 7fdd6b943700 1 -- 172.21.15.148:0/3496592359 wait complete. 2023-10-24T02:01:38.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.542+0000 7fdd6b943700 1 Processor -- start 2023-10-24T02:01:38.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.542+0000 7fdd6b943700 1 -- start start 2023-10-24T02:01:38.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd64098700 0x7fdd641593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640ca640 0x7fdd64145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c5040 con 0x7fdd640c1b40 2023-10-24T02:01:38.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c4d60 con 0x7fdd640ca640 2023-10-24T02:01:38.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd6b943700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64158900 con 0x7fdd64098700 2023-10-24T02:01:38.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53166/0 (socket says 172.21.15.148:53166) 2023-10-24T02:01:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 -- 172.21.15.148:0/3155558148 learned_addr learned my addr 172.21.15.148:0/3155558148 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd69ee0700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640ca640 0x7fdd64145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd696df700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd64098700 0x7fdd641593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 -- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd64098700 msgr2=0x7fdd641593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd64098700 0x7fdd641593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 -- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640ca640 msgr2=0x7fdd64145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640ca640 0x7fdd64145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 -- 172.21.15.148:0/3155558148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54009370 con 0x7fdd640c1b40 2023-10-24T02:01:38.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.543+0000 7fdd68ede700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fdd5800e190 tx=0x7fdd58009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.544+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ec70 con 0x7fdd640c1b40 2023-10-24T02:01:38.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.544+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800edd0 con 0x7fdd640c1b40 2023-10-24T02:01:38.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.544+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd64158be0 con 0x7fdd640c1b40 2023-10-24T02:01:38.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.544+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58015620 con 0x7fdd640c1b40 2023-10-24T02:01:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.544+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640ad920 con 0x7fdd640c1b40 2023-10-24T02:01:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.545+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64159080 con 0x7fdd640c1b40 2023-10-24T02:01:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.545+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd58015a50 con 0x7fdd640c1b40 2023-10-24T02:01:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.545+0000 7fdd617fa700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.546+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fdd5807acb0 con 0x7fdd640c1b40 2023-10-24T02:01:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.546+0000 7fdd696df700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.546+0000 7fdd696df700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 0x7fdd50061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdd5c003860 tx=0x7fdd5c007d40).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.550+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd5804bef0 con 0x7fdd640c1b40 2023-10-24T02:01:38.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.709+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd64159230 con 0x7fdd5005f150 2023-10-24T02:01:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.719+0000 7fdd617fa700 1 -- 172.21.15.148:0/3155558148 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358887 (secure 0 0 0) 0x7fdd64159230 con 0x7fdd5005f150 2023-10-24T02:01:38.724 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:38.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 msgr2=0x7fdd50061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 0x7fdd50061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdd5c003860 tx=0x7fdd5c007d40).stop 2023-10-24T02:01:38.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 msgr2=0x7fdd640ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.727 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fdd5800e190 tx=0x7fdd58009920).stop 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 shutdown_connections 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd5005f150 0x7fdd50061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd640ca640 0x7fdd64145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd64098700 0x7fdd641593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 --2- 172.21.15.148:0/3155558148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd640c1b40 0x7fdd640ad430 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.728 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 >> 172.21.15.148:0/3155558148 conn(0x7fdd6406b380 msgr2=0x7fdd640cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 shutdown_connections 2023-10-24T02:01:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.723+0000 7fdd6b943700 1 -- 172.21.15.148:0/3155558148 wait complete. 2023-10-24T02:01:38.729 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:01:38.735 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T02:01:38.308993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449348,"kb_used_data":19332,"kb_used_omap":0,"kb_used_meta":2429952,"kb_avail":752525372,"statfs":{"total":773094113280,"available":770585980928,"internally_reserved":0,"allocated":19795968,"data_stored":10106777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488270848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593109,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-644,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.524136"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050817+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080916+0000","last_change":"2023-10-24T02:01:35.080916+0000","last_active":"2023-10-24T02:01:35.080916+0000","last_peered":"2023-10-24T02:01:35.080916+0000","last_clean":"2023-10-24T02:01:35.080916+0000","last_became_active":"2023-10-24T02:01:35.080521+0000","last_became_peered":"2023-10-24T02:01:35.080521+0000","last_unstale":"2023-10-24T02:01:35.080916+0000","last_undegraded":"2023-10-24T02:01:35.080916+0000","last_fullsized":"2023-10-24T02:01:35.080916+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059227+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074581+0000","last_change":"2023-10-24T02:01:35.074581+0000","last_active":"2023-10-24T02:01:35.074581+0000","last_peered":"2023-10-24T02:01:35.074581+0000","last_clean":"2023-10-24T02:01:35.074581+0000","last_became_active":"2023-10-24T02:01:35.074242+0000","last_became_peered":"2023-10-24T02:01:35.074242+0000","last_unstale":"2023-10-24T02:01:35.074581+0000","last_undegraded":"2023-10-24T02:01:35.074581+0000","last_fullsized":"2023-10-24T02:01:35.074581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043065+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.075078+0000","last_change":"2023-10-24T02:01:35.075078+0000","last_active":"2023-10-24T02:01:35.075078+0000","last_peered":"2023-10-24T02:01:35.075078+0000","last_clean":"2023-10-24T02:01:35.075078+0000","last_became_active":"2023-10-24T02:01:35.074742+0000","last_became_peered":"2023-10-24T02:01:35.074742+0000","last_unstale":"2023-10-24T02:01:35.075078+0000","last_undegraded":"2023-10-24T02:01:35.075078+0000","last_fullsized":"2023-10-24T02:01:35.075078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038711+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051648+0000","last_change":"2023-10-24T02:01:35.051648+0000","last_active":"2023-10-24T02:01:35.051648+0000","last_peered":"2023-10-24T02:01:35.051648+0000","last_clean":"2023-10-24T02:01:35.051648+0000","last_became_active":"2023-10-24T02:01:35.051381+0000","last_became_peered":"2023-10-24T02:01:35.051381+0000","last_unstale":"2023-10-24T02:01:35.051648+0000","last_undegraded":"2023-10-24T02:01:35.051648+0000","last_fullsized":"2023-10-24T02:01:35.051648+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052757+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070025+0000","last_change":"2023-10-24T02:01:35.070025+0000","last_active":"2023-10-24T02:01:35.070025+0000","last_peered":"2023-10-24T02:01:35.070025+0000","last_clean":"2023-10-24T02:01:35.070025+0000","last_became_active":"2023-10-24T02:01:35.069755+0000","last_became_peered":"2023-10-24T02:01:35.069755+0000","last_unstale":"2023-10-24T02:01:35.070025+0000","last_undegraded":"2023-10-24T02:01:35.070025+0000","last_fullsized":"2023-10-24T02:01:35.070025+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057955+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057037+0000","last_change":"2023-10-24T02:01:35.057037+0000","last_active":"2023-10-24T02:01:35.057037+0000","last_peered":"2023-10-24T02:01:35.057037+0000","last_clean":"2023-10-24T02:01:35.057037+0000","last_became_active":"2023-10-24T02:01:35.056784+0000","last_became_peered":"2023-10-24T02:01:35.056784+0000","last_unstale":"2023-10-24T02:01:35.057037+0000","last_undegraded":"2023-10-24T02:01:35.057037+0000","last_fullsized":"2023-10-24T02:01:35.057037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034349+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066421+0000","last_change":"2023-10-24T02:01:35.066421+0000","last_active":"2023-10-24T02:01:35.066421+0000","last_peered":"2023-10-24T02:01:35.066421+0000","last_clean":"2023-10-24T02:01:35.066421+0000","last_became_active":"2023-10-24T02:01:35.066139+0000","last_became_peered":"2023-10-24T02:01:35.066139+0000","last_unstale":"2023-10-24T02:01:35.066421+0000","last_undegraded":"2023-10-24T02:01:35.066421+0000","last_fullsized":"2023-10-24T02:01:35.066421+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035056+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069974+0000","last_change":"2023-10-24T02:01:35.069974+0000","last_active":"2023-10-24T02:01:35.069974+0000","last_peered":"2023-10-24T02:01:35.069974+0000","last_clean":"2023-10-24T02:01:35.069974+0000","last_became_active":"2023-10-24T02:01:35.069681+0000","last_became_peered":"2023-10-24T02:01:35.069681+0000","last_unstale":"2023-10-24T02:01:35.069974+0000","last_undegraded":"2023-10-24T02:01:35.069974+0000","last_fullsized":"2023-10-24T02:01:35.069974+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034853+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067758+0000","last_change":"2023-10-24T02:01:35.067758+0000","last_active":"2023-10-24T02:01:35.067758+0000","last_peered":"2023-10-24T02:01:35.067758+0000","last_clean":"2023-10-24T02:01:35.067758+0000","last_became_active":"2023-10-24T02:01:35.067539+0000","last_became_peered":"2023-10-24T02:01:35.067539+0000","last_unstale":"2023-10-24T02:01:35.067758+0000","last_undegraded":"2023-10-24T02:01:35.067758+0000","last_fullsized":"2023-10-24T02:01:35.067758+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035326+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066613+0000","last_change":"2023-10-24T02:01:35.066613+0000","last_active":"2023-10-24T02:01:35.066613+0000","last_peered":"2023-10-24T02:01:35.066613+0000","last_clean":"2023-10-24T02:01:35.066613+0000","last_became_active":"2023-10-24T02:01:35.066302+0000","last_became_peered":"2023-10-24T02:01:35.066302+0000","last_unstale":"2023-10-24T02:01:35.066613+0000","last_undegraded":"2023-10-24T02:01:35.066613+0000","last_fullsized":"2023-10-24T02:01:35.066613+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051632+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070561+0000","last_change":"2023-10-24T02:01:35.070561+0000","last_active":"2023-10-24T02:01:35.070561+0000","last_peered":"2023-10-24T02:01:35.070561+0000","last_clean":"2023-10-24T02:01:35.070561+0000","last_became_active":"2023-10-24T02:01:35.070276+0000","last_became_peered":"2023-10-24T02:01:35.070276+0000","last_unstale":"2023-10-24T02:01:35.070561+0000","last_undegraded":"2023-10-24T02:01:35.070561+0000","last_fullsized":"2023-10-24T02:01:35.070561+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045886+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068883+0000","last_change":"2023-10-24T02:01:35.068883+0000","last_active":"2023-10-24T02:01:35.068883+0000","last_peered":"2023-10-24T02:01:35.068883+0000","last_clean":"2023-10-24T02:01:35.068883+0000","last_became_active":"2023-10-24T02:01:35.068265+0000","last_became_peered":"2023-10-24T02:01:35.068265+0000","last_unstale":"2023-10-24T02:01:35.068883+0000","last_undegraded":"2023-10-24T02:01:35.068883+0000","last_fullsized":"2023-10-24T02:01:35.068883+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057424+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063484+0000","last_change":"2023-10-24T02:01:35.063484+0000","last_active":"2023-10-24T02:01:35.063484+0000","last_peered":"2023-10-24T02:01:35.063484+0000","last_clean":"2023-10-24T02:01:35.063484+0000","last_became_active":"2023-10-24T02:01:35.062894+0000","last_became_peered":"2023-10-24T02:01:35.062894+0000","last_unstale":"2023-10-24T02:01:35.063484+0000","last_undegraded":"2023-10-24T02:01:35.063484+0000","last_fullsized":"2023-10-24T02:01:35.063484+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056442+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068139+0000","last_change":"2023-10-24T02:01:35.068139+0000","last_active":"2023-10-24T02:01:35.068139+0000","last_peered":"2023-10-24T02:01:35.068139+0000","last_clean":"2023-10-24T02:01:35.068139+0000","last_became_active":"2023-10-24T02:01:35.067885+0000","last_became_peered":"2023-10-24T02:01:35.067885+0000","last_unstale":"2023-10-24T02:01:35.068139+0000","last_undegraded":"2023-10-24T02:01:35.068139+0000","last_fullsized":"2023-10-24T02:01:35.068139+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050267+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071046+0000","last_change":"2023-10-24T02:01:35.071046+0000","last_active":"2023-10-24T02:01:35.071046+0000","last_peered":"2023-10-24T02:01:35.071046+0000","last_clean":"2023-10-24T02:01:35.071046+0000","last_became_active":"2023-10-24T02:01:35.070470+0000","last_became_peered":"2023-10-24T02:01:35.070470+0000","last_unstale":"2023-10-24T02:01:35.071046+0000","last_undegraded":"2023-10-24T02:01:35.071046+0000","last_fullsized":"2023-10-24T02:01:35.071046+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055108+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071852+0000","last_change":"2023-10-24T02:01:35.071852+0000","last_active":"2023-10-24T02:01:35.071852+0000","last_peered":"2023-10-24T02:01:35.071852+0000","last_clean":"2023-10-24T02:01:35.071852+0000","last_became_active":"2023-10-24T02:01:35.071578+0000","last_became_peered":"2023-10-24T02:01:35.071578+0000","last_unstale":"2023-10-24T02:01:35.071852+0000","last_undegraded":"2023-10-24T02:01:35.071852+0000","last_fullsized":"2023-10-24T02:01:35.071852+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051673+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060097+0000","last_change":"2023-10-24T02:01:35.060097+0000","last_active":"2023-10-24T02:01:35.060097+0000","last_peered":"2023-10-24T02:01:35.060097+0000","last_clean":"2023-10-24T02:01:35.060097+0000","last_became_active":"2023-10-24T02:01:35.059406+0000","last_became_peered":"2023-10-24T02:01:35.059406+0000","last_unstale":"2023-10-24T02:01:35.060097+0000","last_undegraded":"2023-10-24T02:01:35.060097+0000","last_fullsized":"2023-10-24T02:01:35.060097+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.058822+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048351+0000","last_change":"2023-10-24T02:01:35.048351+0000","last_active":"2023-10-24T02:01:35.048351+0000","last_peered":"2023-10-24T02:01:35.048351+0000","last_clean":"2023-10-24T02:01:35.048351+0000","last_became_active":"2023-10-24T02:01:35.048142+0000","last_became_peered":"2023-10-24T02:01:35.048142+0000","last_unstale":"2023-10-24T02:01:35.048351+0000","last_undegraded":"2023-10-24T02:01:35.048351+0000","last_fullsized":"2023-10-24T02:01:35.048351+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053194+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063242+0000","last_change":"2023-10-24T02:01:35.063242+0000","last_active":"2023-10-24T02:01:35.063242+0000","last_peered":"2023-10-24T02:01:35.063242+0000","last_clean":"2023-10-24T02:01:35.063242+0000","last_became_active":"2023-10-24T02:01:35.062923+0000","last_became_peered":"2023-10-24T02:01:35.062923+0000","last_unstale":"2023-10-24T02:01:35.063242+0000","last_undegraded":"2023-10-24T02:01:35.063242+0000","last_fullsized":"2023-10-24T02:01:35.063242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059768+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067615+0000","last_change":"2023-10-24T02:01:35.067615+0000","last_active":"2023-10-24T02:01:35.067615+0000","last_peered":"2023-10-24T02:01:35.067615+0000","last_clean":"2023-10-24T02:01:35.067615+0000","last_became_active":"2023-10-24T02:01:35.067351+0000","last_became_peered":"2023-10-24T02:01:35.067351+0000","last_unstale":"2023-10-24T02:01:35.067615+0000","last_undegraded":"2023-10-24T02:01:35.067615+0000","last_fullsized":"2023-10-24T02:01:35.067615+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039970+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072772+0000","last_change":"2023-10-24T02:01:35.072772+0000","last_active":"2023-10-24T02:01:35.072772+0000","last_peered":"2023-10-24T02:01:35.072772+0000","last_clean":"2023-10-24T02:01:35.072772+0000","last_became_active":"2023-10-24T02:01:35.072515+0000","last_became_peered":"2023-10-24T02:01:35.072515+0000","last_unstale":"2023-10-24T02:01:35.072772+0000","last_undegraded":"2023-10-24T02:01:35.072772+0000","last_fullsized":"2023-10-24T02:01:35.072772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053856+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061840+0000","last_became_peered":"2023-10-24T02:01:35.061840+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.044421+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065231+0000","last_change":"2023-10-24T02:01:35.065231+0000","last_active":"2023-10-24T02:01:35.065231+0000","last_peered":"2023-10-24T02:01:35.065231+0000","last_clean":"2023-10-24T02:01:35.065231+0000","last_became_active":"2023-10-24T02:01:35.064941+0000","last_became_peered":"2023-10-24T02:01:35.064941+0000","last_unstale":"2023-10-24T02:01:35.065231+0000","last_undegraded":"2023-10-24T02:01:35.065231+0000","last_fullsized":"2023-10-24T02:01:35.065231+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039279+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069087+0000","last_change":"2023-10-24T02:01:35.069087+0000","last_active":"2023-10-24T02:01:35.069087+0000","last_peered":"2023-10-24T02:01:35.069087+0000","last_clean":"2023-10-24T02:01:35.069087+0000","last_became_active":"2023-10-24T02:01:35.066064+0000","last_became_peered":"2023-10-24T02:01:35.066064+0000","last_unstale":"2023-10-24T02:01:35.069087+0000","last_undegraded":"2023-10-24T02:01:35.069087+0000","last_fullsized":"2023-10-24T02:01:35.069087+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050308+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074140+0000","last_change":"2023-10-24T02:01:35.074140+0000","last_active":"2023-10-24T02:01:35.074140+0000","last_peered":"2023-10-24T02:01:35.074140+0000","last_clean":"2023-10-24T02:01:35.074140+0000","last_became_active":"2023-10-24T02:01:35.073879+0000","last_became_peered":"2023-10-24T02:01:35.073879+0000","last_unstale":"2023-10-24T02:01:35.074140+0000","last_undegraded":"2023-10-24T02:01:35.074140+0000","last_fullsized":"2023-10-24T02:01:35.074140+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042266+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056668+0000","last_change":"2023-10-24T02:01:35.056668+0000","last_active":"2023-10-24T02:01:35.056668+0000","last_peered":"2023-10-24T02:01:35.056668+0000","last_clean":"2023-10-24T02:01:35.056668+0000","last_became_active":"2023-10-24T02:01:35.056456+0000","last_became_peered":"2023-10-24T02:01:35.056456+0000","last_unstale":"2023-10-24T02:01:35.056668+0000","last_undegraded":"2023-10-24T02:01:35.056668+0000","last_fullsized":"2023-10-24T02:01:35.056668+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051238+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066552+0000","last_change":"2023-10-24T02:01:35.066552+0000","last_active":"2023-10-24T02:01:35.066552+0000","last_peered":"2023-10-24T02:01:35.066552+0000","last_clean":"2023-10-24T02:01:35.066552+0000","last_became_active":"2023-10-24T02:01:35.066026+0000","last_became_peered":"2023-10-24T02:01:35.066026+0000","last_unstale":"2023-10-24T02:01:35.066552+0000","last_undegraded":"2023-10-24T02:01:35.066552+0000","last_fullsized":"2023-10-24T02:01:35.066552+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038320+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066458+0000","last_change":"2023-10-24T02:01:35.066458+0000","last_active":"2023-10-24T02:01:35.066458+0000","last_peered":"2023-10-24T02:01:35.066458+0000","last_clean":"2023-10-24T02:01:35.066458+0000","last_became_active":"2023-10-24T02:01:35.066109+0000","last_became_peered":"2023-10-24T02:01:35.066109+0000","last_unstale":"2023-10-24T02:01:35.066458+0000","last_undegraded":"2023-10-24T02:01:35.066458+0000","last_fullsized":"2023-10-24T02:01:35.066458+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042386+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065554+0000","last_change":"2023-10-24T02:01:35.065554+0000","last_active":"2023-10-24T02:01:35.065554+0000","last_peered":"2023-10-24T02:01:35.065554+0000","last_clean":"2023-10-24T02:01:35.065554+0000","last_became_active":"2023-10-24T02:01:35.065264+0000","last_became_peered":"2023-10-24T02:01:35.065264+0000","last_unstale":"2023-10-24T02:01:35.065554+0000","last_undegraded":"2023-10-24T02:01:35.065554+0000","last_fullsized":"2023-10-24T02:01:35.065554+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057553+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067711+0000","last_change":"2023-10-24T02:01:35.067711+0000","last_active":"2023-10-24T02:01:35.067711+0000","last_peered":"2023-10-24T02:01:35.067711+0000","last_clean":"2023-10-24T02:01:35.067711+0000","last_became_active":"2023-10-24T02:01:35.067429+0000","last_became_peered":"2023-10-24T02:01:35.067429+0000","last_unstale":"2023-10-24T02:01:35.067711+0000","last_undegraded":"2023-10-24T02:01:35.067711+0000","last_fullsized":"2023-10-24T02:01:35.067711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053241+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065740+0000","last_change":"2023-10-24T02:01:35.065740+0000","last_active":"2023-10-24T02:01:35.065740+0000","last_peered":"2023-10-24T02:01:35.065740+0000","last_clean":"2023-10-24T02:01:35.065740+0000","last_became_active":"2023-10-24T02:01:35.065413+0000","last_became_peered":"2023-10-24T02:01:35.065413+0000","last_unstale":"2023-10-24T02:01:35.065740+0000","last_undegraded":"2023-10-24T02:01:35.065740+0000","last_fullsized":"2023-10-24T02:01:35.065740+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034683+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048085+0000","last_change":"2023-10-24T02:01:35.048085+0000","last_active":"2023-10-24T02:01:35.048085+0000","last_peered":"2023-10-24T02:01:35.048085+0000","last_clean":"2023-10-24T02:01:35.048085+0000","last_became_active":"2023-10-24T02:01:35.047789+0000","last_became_peered":"2023-10-24T02:01:35.047789+0000","last_unstale":"2023-10-24T02:01:35.048085+0000","last_undegraded":"2023-10-24T02:01:35.048085+0000","last_fullsized":"2023-10-24T02:01:35.048085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.060595+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062733+0000","last_change":"2023-10-24T02:01:35.062733+0000","last_active":"2023-10-24T02:01:35.062733+0000","last_peered":"2023-10-24T02:01:35.062733+0000","last_clean":"2023-10-24T02:01:35.062733+0000","last_became_active":"2023-10-24T02:01:35.062388+0000","last_became_peered":"2023-10-24T02:01:35.062388+0000","last_unstale":"2023-10-24T02:01:35.062733+0000","last_undegraded":"2023-10-24T02:01:35.062733+0000","last_fullsized":"2023-10-24T02:01:35.062733+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038283+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056643+0000","last_change":"2023-10-24T02:01:35.056643+0000","last_active":"2023-10-24T02:01:35.056643+0000","last_peered":"2023-10-24T02:01:35.056643+0000","last_clean":"2023-10-24T02:01:35.056643+0000","last_became_active":"2023-10-24T02:01:35.056224+0000","last_became_peered":"2023-10-24T02:01:35.056224+0000","last_unstale":"2023-10-24T02:01:35.056643+0000","last_undegraded":"2023-10-24T02:01:35.056643+0000","last_fullsized":"2023-10-24T02:01:35.056643+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042654+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072602+0000","last_change":"2023-10-24T02:01:35.072602+0000","last_active":"2023-10-24T02:01:35.072602+0000","last_peered":"2023-10-24T02:01:35.072602+0000","last_clean":"2023-10-24T02:01:35.072602+0000","last_became_active":"2023-10-24T02:01:35.072258+0000","last_became_peered":"2023-10-24T02:01:35.072258+0000","last_unstale":"2023-10-24T02:01:35.072602+0000","last_undegraded":"2023-10-24T02:01:35.072602+0000","last_fullsized":"2023-10-24T02:01:35.072602+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052528+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067842+0000","last_change":"2023-10-24T02:01:35.067842+0000","last_active":"2023-10-24T02:01:35.067842+0000","last_peered":"2023-10-24T02:01:35.067842+0000","last_clean":"2023-10-24T02:01:35.067842+0000","last_became_active":"2023-10-24T02:01:35.067481+0000","last_became_peered":"2023-10-24T02:01:35.067481+0000","last_unstale":"2023-10-24T02:01:35.067842+0000","last_undegraded":"2023-10-24T02:01:35.067842+0000","last_fullsized":"2023-10-24T02:01:35.067842+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035644+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051447+0000","last_change":"2023-10-24T02:01:35.051447+0000","last_active":"2023-10-24T02:01:35.051447+0000","last_peered":"2023-10-24T02:01:35.051447+0000","last_clean":"2023-10-24T02:01:35.051447+0000","last_became_active":"2023-10-24T02:01:35.050511+0000","last_became_peered":"2023-10-24T02:01:35.050511+0000","last_unstale":"2023-10-24T02:01:35.051447+0000","last_undegraded":"2023-10-24T02:01:35.051447+0000","last_fullsized":"2023-10-24T02:01:35.051447+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.046393+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.054678+0000","last_change":"2023-10-24T02:01:35.054678+0000","last_active":"2023-10-24T02:01:35.054678+0000","last_peered":"2023-10-24T02:01:35.054678+0000","last_clean":"2023-10-24T02:01:35.054678+0000","last_became_active":"2023-10-24T02:01:35.054410+0000","last_became_peered":"2023-10-24T02:01:35.054410+0000","last_unstale":"2023-10-24T02:01:35.054678+0000","last_undegraded":"2023-10-24T02:01:35.054678+0000","last_fullsized":"2023-10-24T02:01:35.054678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043975+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057004+0000","last_change":"2023-10-24T02:01:35.057004+0000","last_active":"2023-10-24T02:01:35.057004+0000","last_peered":"2023-10-24T02:01:35.057004+0000","last_clean":"2023-10-24T02:01:35.057004+0000","last_became_active":"2023-10-24T02:01:35.056703+0000","last_became_peered":"2023-10-24T02:01:35.056703+0000","last_unstale":"2023-10-24T02:01:35.057004+0000","last_undegraded":"2023-10-24T02:01:35.057004+0000","last_fullsized":"2023-10-24T02:01:35.057004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050848+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070176+0000","last_change":"2023-10-24T02:01:35.070176+0000","last_active":"2023-10-24T02:01:35.070176+0000","last_peered":"2023-10-24T02:01:35.070176+0000","last_clean":"2023-10-24T02:01:35.070176+0000","last_became_active":"2023-10-24T02:01:35.069790+0000","last_became_peered":"2023-10-24T02:01:35.069790+0000","last_unstale":"2023-10-24T02:01:35.070176+0000","last_undegraded":"2023-10-24T02:01:35.070176+0000","last_fullsized":"2023-10-24T02:01:35.070176+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034321+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066486+0000","last_change":"2023-10-24T02:01:35.066486+0000","last_active":"2023-10-24T02:01:35.066486+0000","last_peered":"2023-10-24T02:01:35.066486+0000","last_clean":"2023-10-24T02:01:35.066486+0000","last_became_active":"2023-10-24T02:01:35.066230+0000","last_became_peered":"2023-10-24T02:01:35.066230+0000","last_unstale":"2023-10-24T02:01:35.066486+0000","last_undegraded":"2023-10-24T02:01:35.066486+0000","last_fullsized":"2023-10-24T02:01:35.066486+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054352+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.049824+0000","last_change":"2023-10-24T02:01:35.049824+0000","last_active":"2023-10-24T02:01:35.049824+0000","last_peered":"2023-10-24T02:01:35.049824+0000","last_clean":"2023-10-24T02:01:35.049824+0000","last_became_active":"2023-10-24T02:01:35.049440+0000","last_became_peered":"2023-10-24T02:01:35.049440+0000","last_unstale":"2023-10-24T02:01:35.049824+0000","last_undegraded":"2023-10-24T02:01:35.049824+0000","last_fullsized":"2023-10-24T02:01:35.049824+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055578+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069408+0000","last_change":"2023-10-24T02:01:35.069408+0000","last_active":"2023-10-24T02:01:35.069408+0000","last_peered":"2023-10-24T02:01:35.069408+0000","last_clean":"2023-10-24T02:01:35.069408+0000","last_became_active":"2023-10-24T02:01:35.069083+0000","last_became_peered":"2023-10-24T02:01:35.069083+0000","last_unstale":"2023-10-24T02:01:35.069408+0000","last_undegraded":"2023-10-24T02:01:35.069408+0000","last_fullsized":"2023-10-24T02:01:35.069408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061594+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050116+0000","last_change":"2023-10-24T02:01:35.050116+0000","last_active":"2023-10-24T02:01:35.050116+0000","last_peered":"2023-10-24T02:01:35.050116+0000","last_clean":"2023-10-24T02:01:35.050116+0000","last_became_active":"2023-10-24T02:01:35.049854+0000","last_became_peered":"2023-10-24T02:01:35.049854+0000","last_unstale":"2023-10-24T02:01:35.050116+0000","last_undegraded":"2023-10-24T02:01:35.050116+0000","last_fullsized":"2023-10-24T02:01:35.050116+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.040387+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067595+0000","last_change":"2023-10-24T02:01:35.067595+0000","last_active":"2023-10-24T02:01:35.067595+0000","last_peered":"2023-10-24T02:01:35.067595+0000","last_clean":"2023-10-24T02:01:35.067595+0000","last_became_active":"2023-10-24T02:01:35.067318+0000","last_became_peered":"2023-10-24T02:01:35.067318+0000","last_unstale":"2023-10-24T02:01:35.067595+0000","last_undegraded":"2023-10-24T02:01:35.067595+0000","last_fullsized":"2023-10-24T02:01:35.067595+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043570+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063179+0000","last_change":"2023-10-24T02:01:35.063179+0000","last_active":"2023-10-24T02:01:35.063179+0000","last_peered":"2023-10-24T02:01:35.063179+0000","last_clean":"2023-10-24T02:01:35.063179+0000","last_became_active":"2023-10-24T02:01:35.062905+0000","last_became_peered":"2023-10-24T02:01:35.062905+0000","last_unstale":"2023-10-24T02:01:35.063179+0000","last_undegraded":"2023-10-24T02:01:35.063179+0000","last_fullsized":"2023-10-24T02:01:35.063179+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043243+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061859+0000","last_became_peered":"2023-10-24T02:01:35.061859+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051911+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074890+0000","last_change":"2023-10-24T02:01:35.074890+0000","last_active":"2023-10-24T02:01:35.074890+0000","last_peered":"2023-10-24T02:01:35.074890+0000","last_clean":"2023-10-24T02:01:35.074890+0000","last_became_active":"2023-10-24T02:01:35.074531+0000","last_became_peered":"2023-10-24T02:01:35.074531+0000","last_unstale":"2023-10-24T02:01:35.074890+0000","last_undegraded":"2023-10-24T02:01:35.074890+0000","last_fullsized":"2023-10-24T02:01:35.074890+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054064+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065366+0000","last_change":"2023-10-24T02:01:35.065366+0000","last_active":"2023-10-24T02:01:35.065366+0000","last_peered":"2023-10-24T02:01:35.065366+0000","last_clean":"2023-10-24T02:01:35.065366+0000","last_became_active":"2023-10-24T02:01:35.065020+0000","last_became_peered":"2023-10-24T02:01:35.065020+0000","last_unstale":"2023-10-24T02:01:35.065366+0000","last_undegraded":"2023-10-24T02:01:35.065366+0000","last_fullsized":"2023-10-24T02:01:35.065366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034982+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050315+0000","last_change":"2023-10-24T02:01:35.050315+0000","last_active":"2023-10-24T02:01:35.050315+0000","last_peered":"2023-10-24T02:01:35.050315+0000","last_clean":"2023-10-24T02:01:35.050315+0000","last_became_active":"2023-10-24T02:01:35.049685+0000","last_became_peered":"2023-10-24T02:01:35.049685+0000","last_unstale":"2023-10-24T02:01:35.050315+0000","last_undegraded":"2023-10-24T02:01:35.050315+0000","last_fullsized":"2023-10-24T02:01:35.050315+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045773+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060505+0000","last_change":"2023-10-24T02:01:35.060505+0000","last_active":"2023-10-24T02:01:35.060505+0000","last_peered":"2023-10-24T02:01:35.060505+0000","last_clean":"2023-10-24T02:01:35.060505+0000","last_became_active":"2023-10-24T02:01:35.060288+0000","last_became_peered":"2023-10-24T02:01:35.060288+0000","last_unstale":"2023-10-24T02:01:35.060505+0000","last_undegraded":"2023-10-24T02:01:35.060505+0000","last_fullsized":"2023-10-24T02:01:35.060505+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034307+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053840+0000","last_change":"2023-10-24T02:01:35.053840+0000","last_active":"2023-10-24T02:01:35.053840+0000","last_peered":"2023-10-24T02:01:35.053840+0000","last_clean":"2023-10-24T02:01:35.053840+0000","last_became_active":"2023-10-24T02:01:35.053577+0000","last_became_peered":"2023-10-24T02:01:35.053577+0000","last_unstale":"2023-10-24T02:01:35.053840+0000","last_undegraded":"2023-10-24T02:01:35.053840+0000","last_fullsized":"2023-10-24T02:01:35.053840+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056043+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062771+0000","last_change":"2023-10-24T02:01:35.062771+0000","last_active":"2023-10-24T02:01:35.062771+0000","last_peered":"2023-10-24T02:01:35.062771+0000","last_clean":"2023-10-24T02:01:35.062771+0000","last_became_active":"2023-10-24T02:01:35.062245+0000","last_became_peered":"2023-10-24T02:01:35.062245+0000","last_unstale":"2023-10-24T02:01:35.062771+0000","last_undegraded":"2023-10-24T02:01:35.062771+0000","last_fullsized":"2023-10-24T02:01:35.062771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053496+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050373+0000","last_change":"2023-10-24T02:01:35.050373+0000","last_active":"2023-10-24T02:01:35.050373+0000","last_peered":"2023-10-24T02:01:35.050373+0000","last_clean":"2023-10-24T02:01:35.050373+0000","last_became_active":"2023-10-24T02:01:35.050108+0000","last_became_peered":"2023-10-24T02:01:35.050108+0000","last_unstale":"2023-10-24T02:01:35.050373+0000","last_undegraded":"2023-10-24T02:01:35.050373+0000","last_fullsized":"2023-10-24T02:01:35.050373+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039550+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.077262+0000","last_change":"2023-10-24T02:01:35.077262+0000","last_active":"2023-10-24T02:01:35.077262+0000","last_peered":"2023-10-24T02:01:35.077262+0000","last_clean":"2023-10-24T02:01:35.077262+0000","last_became_active":"2023-10-24T02:01:35.076871+0000","last_became_peered":"2023-10-24T02:01:35.076871+0000","last_unstale":"2023-10-24T02:01:35.077262+0000","last_undegraded":"2023-10-24T02:01:35.077262+0000","last_fullsized":"2023-10-24T02:01:35.077262+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045418+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071577+0000","last_change":"2023-10-24T02:01:35.071577+0000","last_active":"2023-10-24T02:01:35.071577+0000","last_peered":"2023-10-24T02:01:35.071577+0000","last_clean":"2023-10-24T02:01:35.071577+0000","last_became_active":"2023-10-24T02:01:35.071242+0000","last_became_peered":"2023-10-24T02:01:35.071242+0000","last_unstale":"2023-10-24T02:01:35.071577+0000","last_undegraded":"2023-10-24T02:01:35.071577+0000","last_fullsized":"2023-10-24T02:01:35.071577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054205+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065762+0000","last_change":"2023-10-24T02:01:35.065762+0000","last_active":"2023-10-24T02:01:35.065762+0000","last_peered":"2023-10-24T02:01:35.065762+0000","last_clean":"2023-10-24T02:01:35.065762+0000","last_became_active":"2023-10-24T02:01:35.065467+0000","last_became_peered":"2023-10-24T02:01:35.065467+0000","last_unstale":"2023-10-24T02:01:35.065762+0000","last_undegraded":"2023-10-24T02:01:35.065762+0000","last_fullsized":"2023-10-24T02:01:35.065762+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029128+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:01:34.029128+0000","last_peered":"2023-10-24T02:01:34.029128+0000","last_clean":"2023-10-24T02:01:34.029128+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:01:34.029128+0000","last_undegraded":"2023-10-24T02:01:34.029128+0000","last_fullsized":"2023-10-24T02:01:34.029128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061505+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.047264+0000","last_change":"2023-10-24T02:01:35.047264+0000","last_active":"2023-10-24T02:01:35.047264+0000","last_peered":"2023-10-24T02:01:35.047264+0000","last_clean":"2023-10-24T02:01:35.047264+0000","last_became_active":"2023-10-24T02:01:35.047045+0000","last_became_peered":"2023-10-24T02:01:35.047045+0000","last_unstale":"2023-10-24T02:01:35.047264+0000","last_undegraded":"2023-10-24T02:01:35.047264+0000","last_fullsized":"2023-10-24T02:01:35.047264+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024727+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:01:34.024727+0000","last_peered":"2023-10-24T02:01:34.024727+0000","last_clean":"2023-10-24T02:01:34.024727+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:01:34.024727+0000","last_undegraded":"2023-10-24T02:01:34.024727+0000","last_fullsized":"2023-10-24T02:01:34.024727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.041316+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053784+0000","last_change":"2023-10-24T02:01:35.053784+0000","last_active":"2023-10-24T02:01:35.053784+0000","last_peered":"2023-10-24T02:01:35.053784+0000","last_clean":"2023-10-24T02:01:35.053784+0000","last_became_active":"2023-10-24T02:01:35.053537+0000","last_became_peered":"2023-10-24T02:01:35.053537+0000","last_unstale":"2023-10-24T02:01:35.053784+0000","last_undegraded":"2023-10-24T02:01:35.053784+0000","last_fullsized":"2023-10-24T02:01:35.053784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.020684+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:01:34.020684+0000","last_peered":"2023-10-24T02:01:34.020684+0000","last_clean":"2023-10-24T02:01:34.020684+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:01:34.020684+0000","last_undegraded":"2023-10-24T02:01:34.020684+0000","last_fullsized":"2023-10-24T02:01:34.020684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050783+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050465+0000","last_change":"2023-10-24T02:01:35.050465+0000","last_active":"2023-10-24T02:01:35.050465+0000","last_peered":"2023-10-24T02:01:35.050465+0000","last_clean":"2023-10-24T02:01:35.050465+0000","last_became_active":"2023-10-24T02:01:35.050041+0000","last_became_peered":"2023-10-24T02:01:35.050041+0000","last_unstale":"2023-10-24T02:01:35.050465+0000","last_undegraded":"2023-10-24T02:01:35.050465+0000","last_fullsized":"2023-10-24T02:01:35.050465+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024886+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:01:34.024886+0000","last_peered":"2023-10-24T02:01:34.024886+0000","last_clean":"2023-10-24T02:01:34.024886+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:01:34.024886+0000","last_undegraded":"2023-10-24T02:01:34.024886+0000","last_fullsized":"2023-10-24T02:01:34.024886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":192,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028141+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:01:34.028141+0000","last_peered":"2023-10-24T02:01:34.028141+0000","last_clean":"2023-10-24T02:01:34.028141+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:01:34.028141+0000","last_undegraded":"2023-10-24T02:01:34.028141+0000","last_fullsized":"2023-10-24T02:01:34.028141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038885+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062583+0000","last_change":"2023-10-24T02:01:35.062583+0000","last_active":"2023-10-24T02:01:35.062583+0000","last_peered":"2023-10-24T02:01:35.062583+0000","last_clean":"2023-10-24T02:01:35.062583+0000","last_became_active":"2023-10-24T02:01:35.062270+0000","last_became_peered":"2023-10-24T02:01:35.062270+0000","last_unstale":"2023-10-24T02:01:35.062583+0000","last_undegraded":"2023-10-24T02:01:35.062583+0000","last_fullsized":"2023-10-24T02:01:35.062583+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028231+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:01:34.028231+0000","last_peered":"2023-10-24T02:01:34.028231+0000","last_clean":"2023-10-24T02:01:34.028231+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:01:34.028231+0000","last_undegraded":"2023-10-24T02:01:34.028231+0000","last_fullsized":"2023-10-24T02:01:34.028231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045087+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.059711+0000","last_change":"2023-10-24T02:01:35.059711+0000","last_active":"2023-10-24T02:01:35.059711+0000","last_peered":"2023-10-24T02:01:35.059711+0000","last_clean":"2023-10-24T02:01:35.059711+0000","last_became_active":"2023-10-24T02:01:35.059392+0000","last_became_peered":"2023-10-24T02:01:35.059392+0000","last_unstale":"2023-10-24T02:01:35.059711+0000","last_undegraded":"2023-10-24T02:01:35.059711+0000","last_fullsized":"2023-10-24T02:01:35.059711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.022778+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:01:34.022778+0000","last_peered":"2023-10-24T02:01:34.022778+0000","last_clean":"2023-10-24T02:01:34.022778+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:01:34.022778+0000","last_undegraded":"2023-10-24T02:01:34.022778+0000","last_fullsized":"2023-10-24T02:01:34.022778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052239+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080408+0000","last_change":"2023-10-24T02:01:35.080408+0000","last_active":"2023-10-24T02:01:35.080408+0000","last_peered":"2023-10-24T02:01:35.080408+0000","last_clean":"2023-10-24T02:01:35.080408+0000","last_became_active":"2023-10-24T02:01:35.080124+0000","last_became_peered":"2023-10-24T02:01:35.080124+0000","last_unstale":"2023-10-24T02:01:35.080408+0000","last_undegraded":"2023-10-24T02:01:35.080408+0000","last_fullsized":"2023-10-24T02:01:35.080408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028674+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:01:34.028674+0000","last_peered":"2023-10-24T02:01:34.028674+0000","last_clean":"2023-10-24T02:01:34.028674+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:01:34.028674+0000","last_undegraded":"2023-10-24T02:01:34.028674+0000","last_fullsized":"2023-10-24T02:01:34.028674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034388+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065227+0000","last_change":"2023-10-24T02:01:35.065227+0000","last_active":"2023-10-24T02:01:35.065227+0000","last_peered":"2023-10-24T02:01:35.065227+0000","last_clean":"2023-10-24T02:01:35.065227+0000","last_became_active":"2023-10-24T02:01:35.065007+0000","last_became_peered":"2023-10-24T02:01:35.065007+0000","last_unstale":"2023-10-24T02:01:35.065227+0000","last_undegraded":"2023-10-24T02:01:35.065227+0000","last_fullsized":"2023-10-24T02:01:35.065227+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029393+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:01:34.029393+0000","last_peered":"2023-10-24T02:01:34.029393+0000","last_clean":"2023-10-24T02:01:34.029393+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:01:34.029393+0000","last_undegraded":"2023-10-24T02:01:34.029393+0000","last_fullsized":"2023-10-24T02:01:34.029393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543252,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.745,"15min":0.86399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.314},"max":{"1min":0.749,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.81999999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.83999999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.55100000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.752,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.85699999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.86499999999999999,"15min":0.90900000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.43099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.877},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.873,"5min":0.873,"15min":1.0049999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.78700000000000003,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.48099999999999998,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.873},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.80200000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575957,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39800000000000002,"15min":0.39100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55100000000000005,"5min":0.878,"15min":0.878},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.51400000000000001,"5min":0.627,"15min":0.63200000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.75},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59099999999999997,"5min":0.67600000000000005,"15min":0.71599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.41199999999999998},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.502},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.82599999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.52600000000000002,"5min":0.47799999999999998,"15min":0.45600000000000002},"max":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575957,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":0.624,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52300000000000002,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.25700000000000001},"max":{"1min":0.52900000000000003,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.375}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.312,"15min":0.25900000000000001},"max":{"1min":0.58999999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.52200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.97299999999999998},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.008},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47799999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":1.028},"last":0.503}]}]},{"osd":2,"up_from":14,"seq":60129543252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.72899999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":0.68300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.95199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.53100000000000003,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97299999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.875,"15min":0.99299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.186},"max":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.59999999999999998},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22500000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.752},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.21299999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.314,"5min":0.314,"15min":0.26100000000000001},"max":{"1min":0.56999999999999995,"5min":0.623,"15min":0.64600000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.65600000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.60899999999999999,"5min":0.68799999999999994,"15min":0.72799999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.35599999999999998},"max":{"1min":0.93600000000000005,"5min":1.097,"15min":1.097},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.41299999999999998,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":1.034,"15min":1.056},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.93799999999999994,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":1.0700000000000001,"15min":1.083},"last":0.624}]},{"osd":7,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":1.155,"15min":1.155},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.45100000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.73599999999999999,"15min":0.83799999999999997},"last":0.438},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.27200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86099999999999999},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.46700000000000003,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83799999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.35899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66100000000000003,"5min":0.76100000000000001,"15min":0.83599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.874},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.80300000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.30299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.499,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.54200000000000004,"5min":0.41699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45900000000000002,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.501,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.27000000000000002},"max":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"max":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.98799999999999999},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:01:38.743 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:01:38.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.889+0000 7f1f4cf84700 1 Processor -- start 2023-10-24T02:01:38.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.889+0000 7f1f4cf84700 1 -- start start 2023-10-24T02:01:38.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f4cf84700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f480aa140 0x7f1f480c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f4cf84700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480c6410 con 0x7f1f480ca110 2023-10-24T02:01:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f4cf84700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480ca6e0 con 0x7f1f480c0ef0 2023-10-24T02:01:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f4cf84700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480ca9c0 con 0x7f1f480aa140 2023-10-24T02:01:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f46ffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f1f480ca110 0x7f1f480c07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46564/0 (socket says 172.21.15.148:46564) 2023-10-24T02:01:38.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f46ffd700 1 -- 172.21.15.148:0/630954976 learned_addr learned my addr 172.21.15.148:0/630954976 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:38.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f477fe700 1 --2- 172.21.15.148:0/630954976 >> v2:172.21.15.150:3300/0 conn(0x7f1f480aa140 0x7f1f480c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903718636 0 0) 0x7f1f480c6410 con 0x7f1f480ca110 2023-10-24T02:01:38.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.890+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f300033f0 con 0x7f1f480ca110 2023-10-24T02:01:38.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560766628 0 0) 0x7f1f300033f0 con 0x7f1f480ca110 2023-10-24T02:01:38.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 >> v2:172.21.15.150:3300/0 conn(0x7f1f480aa140 msgr2=0x7f1f480c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 --2- 172.21.15.148:0/630954976 >> v2:172.21.15.150:3300/0 conn(0x7f1f480aa140 0x7f1f480c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 >> v1:172.21.15.150:6789/0 conn(0x7f1f480c0ef0 legacy=0x7f1f480c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480c60a0 con 0x7f1f480ca110 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f1f3c001470 con 0x7f1f480ca110 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f477fe700 1 --2- 172.21.15.148:0/630954976 >> v2:172.21.15.150:3300/0 conn(0x7f1f480aa140 0x7f1f480c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:01:38.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 >> v1:172.21.15.148:6789/0 conn(0x7f1f480ca110 legacy=0x7f1f480c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f300038e0 0x7f1f30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30004690 0x7f1f30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 0x7f1f3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480ca9c0 con 0x7f1f30005000 2023-10-24T02:01:38.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3000bf60 con 0x7f1f30004690 2023-10-24T02:01:38.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3000c0f0 con 0x7f1f300038e0 2023-10-24T02:01:38.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 0x7f1f3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f477fe700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f300038e0 0x7f1f30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f46ffd700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30004690 0x7f1f30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 -- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f300038e0 msgr2=0x7f1f30003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f300038e0 0x7f1f30003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 -- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30004690 msgr2=0x7f1f30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:38.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30004690 0x7f1f30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 -- 172.21.15.148:0/630954976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300033f0 con 0x7f1f30005000 2023-10-24T02:01:38.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 -- 172.21.15.148:0/630954976 reap_dead start 2023-10-24T02:01:38.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f47fff700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 0x7f1f3000b8e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f1f40001730 tx=0x7f1f40007bb0).ready entity=mon.0 client_cookie=2a3c1738f5419019 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40007020 con 0x7f1f30005000 2023-10-24T02:01:38.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40007180 con 0x7f1f30005000 2023-10-24T02:01:38.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.891+0000 7f1f467fc700 1 -- 172.21.15.148:0/630954976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40007520 con 0x7f1f30005000 2023-10-24T02:01:38.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 -- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 msgr2=0x7f1f3000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 0x7f1f3000b8e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f1f40001730 tx=0x7f1f40007bb0).stop 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 -- 172.21.15.148:0/630954976 shutdown_connections 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/630954976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f30005000 0x7f1f3000b8e0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 -- 172.21.15.148:0/630954976 >> 172.21.15.148:0/630954976 conn(0x7f1f480944a0 msgr2=0x7f1f4806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 -- 172.21.15.148:0/630954976 shutdown_connections 2023-10-24T02:01:38.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.892+0000 7f1f4cf84700 1 -- 172.21.15.148:0/630954976 wait complete. 2023-10-24T02:01:38.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.893+0000 7f1f4cf84700 1 Processor -- start 2023-10-24T02:01:38.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.893+0000 7f1f4cf84700 1 -- start start 2023-10-24T02:01:38.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30005000 0x7f1f48163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f480c1ea0 0x7f1f480c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480c37a0 con 0x7f1f480aca80 2023-10-24T02:01:38.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480ad3f0 con 0x7f1f30005000 2023-10-24T02:01:38.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f4cf84700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480c2b90 con 0x7f1f480c1ea0 2023-10-24T02:01:38.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53178/0 (socket says 172.21.15.148:53178) 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 -- 172.21.15.148:0/77825258 learned_addr learned my addr 172.21.15.148:0/77825258 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 -- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f480c1ea0 msgr2=0x7f1f480c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f477fe700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30005000 0x7f1f48163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f480c1ea0 0x7f1f480c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:38.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 -- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30005000 msgr2=0x7f1f48163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:38.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30005000 0x7f1f48163fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:38.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 -- 172.21.15.148:0/77825258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480c2e70 con 0x7f1f480aca80 2023-10-24T02:01:38.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.894+0000 7f1f46ffd700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f1f3c004760 tx=0x7f1f3c001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.895+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00f5f0 con 0x7f1f480aca80 2023-10-24T02:01:38.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.895+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00f750 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.895+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f480c3150 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.895+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00faf0 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.895+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f480c2810 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.896+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f480c35f0 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.896+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1f3c015410 con 0x7f1f480aca80 2023-10-24T02:01:38.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.896+0000 7f1f2f7fe700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 0x7f1f34061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:38.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.896+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f1f3c07a420 con 0x7f1f480aca80 2023-10-24T02:01:38.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.897+0000 7f1f477fe700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 0x7f1f34061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:38.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.897+0000 7f1f477fe700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 0x7f1f34061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1f481532b0 tx=0x7f1f3800b040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:38.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:38.900+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1f3c04b660 con 0x7f1f480aca80 2023-10-24T02:01:39.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.059+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f48047480 con 0x7f1f3405f150 2023-10-24T02:01:39.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.069+0000 7f1f2f7fe700 1 -- 172.21.15.148:0/77825258 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358887 (secure 0 0 0) 0x7f1f48047480 con 0x7f1f3405f150 2023-10-24T02:01:39.073 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:39.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 msgr2=0x7f1f34061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 0x7f1f34061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1f481532b0 tx=0x7f1f3800b040).stop 2023-10-24T02:01:39.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 msgr2=0x7f1f480acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7f1f3c004760 tx=0x7f1f3c001e50).stop 2023-10-24T02:01:39.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 shutdown_connections 2023-10-24T02:01:39.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1f480c1ea0 0x7f1f480c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:39.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1f3405f150 0x7f1f34061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f30005000 0x7f1f48163fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 --2- 172.21.15.148:0/77825258 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f480aca80 0x7f1f480acf00 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.072+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 >> 172.21.15.148:0/77825258 conn(0x7f1f480944a0 msgr2=0x7f1f480cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:39.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.073+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 shutdown_connections 2023-10-24T02:01:39.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.073+0000 7f1f4cf84700 1 -- 172.21.15.148:0/77825258 wait complete. 2023-10-24T02:01:39.079 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:01:39.085 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T02:01:38.308993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449348,"kb_used_data":19332,"kb_used_omap":0,"kb_used_meta":2429952,"kb_avail":752525372,"statfs":{"total":773094113280,"available":770585980928,"internally_reserved":0,"allocated":19795968,"data_stored":10106777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488270848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593109,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-644,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.524136"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050817+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080916+0000","last_change":"2023-10-24T02:01:35.080916+0000","last_active":"2023-10-24T02:01:35.080916+0000","last_peered":"2023-10-24T02:01:35.080916+0000","last_clean":"2023-10-24T02:01:35.080916+0000","last_became_active":"2023-10-24T02:01:35.080521+0000","last_became_peered":"2023-10-24T02:01:35.080521+0000","last_unstale":"2023-10-24T02:01:35.080916+0000","last_undegraded":"2023-10-24T02:01:35.080916+0000","last_fullsized":"2023-10-24T02:01:35.080916+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059227+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074581+0000","last_change":"2023-10-24T02:01:35.074581+0000","last_active":"2023-10-24T02:01:35.074581+0000","last_peered":"2023-10-24T02:01:35.074581+0000","last_clean":"2023-10-24T02:01:35.074581+0000","last_became_active":"2023-10-24T02:01:35.074242+0000","last_became_peered":"2023-10-24T02:01:35.074242+0000","last_unstale":"2023-10-24T02:01:35.074581+0000","last_undegraded":"2023-10-24T02:01:35.074581+0000","last_fullsized":"2023-10-24T02:01:35.074581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043065+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.075078+0000","last_change":"2023-10-24T02:01:35.075078+0000","last_active":"2023-10-24T02:01:35.075078+0000","last_peered":"2023-10-24T02:01:35.075078+0000","last_clean":"2023-10-24T02:01:35.075078+0000","last_became_active":"2023-10-24T02:01:35.074742+0000","last_became_peered":"2023-10-24T02:01:35.074742+0000","last_unstale":"2023-10-24T02:01:35.075078+0000","last_undegraded":"2023-10-24T02:01:35.075078+0000","last_fullsized":"2023-10-24T02:01:35.075078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038711+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051648+0000","last_change":"2023-10-24T02:01:35.051648+0000","last_active":"2023-10-24T02:01:35.051648+0000","last_peered":"2023-10-24T02:01:35.051648+0000","last_clean":"2023-10-24T02:01:35.051648+0000","last_became_active":"2023-10-24T02:01:35.051381+0000","last_became_peered":"2023-10-24T02:01:35.051381+0000","last_unstale":"2023-10-24T02:01:35.051648+0000","last_undegraded":"2023-10-24T02:01:35.051648+0000","last_fullsized":"2023-10-24T02:01:35.051648+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052757+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070025+0000","last_change":"2023-10-24T02:01:35.070025+0000","last_active":"2023-10-24T02:01:35.070025+0000","last_peered":"2023-10-24T02:01:35.070025+0000","last_clean":"2023-10-24T02:01:35.070025+0000","last_became_active":"2023-10-24T02:01:35.069755+0000","last_became_peered":"2023-10-24T02:01:35.069755+0000","last_unstale":"2023-10-24T02:01:35.070025+0000","last_undegraded":"2023-10-24T02:01:35.070025+0000","last_fullsized":"2023-10-24T02:01:35.070025+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057955+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057037+0000","last_change":"2023-10-24T02:01:35.057037+0000","last_active":"2023-10-24T02:01:35.057037+0000","last_peered":"2023-10-24T02:01:35.057037+0000","last_clean":"2023-10-24T02:01:35.057037+0000","last_became_active":"2023-10-24T02:01:35.056784+0000","last_became_peered":"2023-10-24T02:01:35.056784+0000","last_unstale":"2023-10-24T02:01:35.057037+0000","last_undegraded":"2023-10-24T02:01:35.057037+0000","last_fullsized":"2023-10-24T02:01:35.057037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034349+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066421+0000","last_change":"2023-10-24T02:01:35.066421+0000","last_active":"2023-10-24T02:01:35.066421+0000","last_peered":"2023-10-24T02:01:35.066421+0000","last_clean":"2023-10-24T02:01:35.066421+0000","last_became_active":"2023-10-24T02:01:35.066139+0000","last_became_peered":"2023-10-24T02:01:35.066139+0000","last_unstale":"2023-10-24T02:01:35.066421+0000","last_undegraded":"2023-10-24T02:01:35.066421+0000","last_fullsized":"2023-10-24T02:01:35.066421+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035056+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069974+0000","last_change":"2023-10-24T02:01:35.069974+0000","last_active":"2023-10-24T02:01:35.069974+0000","last_peered":"2023-10-24T02:01:35.069974+0000","last_clean":"2023-10-24T02:01:35.069974+0000","last_became_active":"2023-10-24T02:01:35.069681+0000","last_became_peered":"2023-10-24T02:01:35.069681+0000","last_unstale":"2023-10-24T02:01:35.069974+0000","last_undegraded":"2023-10-24T02:01:35.069974+0000","last_fullsized":"2023-10-24T02:01:35.069974+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034853+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067758+0000","last_change":"2023-10-24T02:01:35.067758+0000","last_active":"2023-10-24T02:01:35.067758+0000","last_peered":"2023-10-24T02:01:35.067758+0000","last_clean":"2023-10-24T02:01:35.067758+0000","last_became_active":"2023-10-24T02:01:35.067539+0000","last_became_peered":"2023-10-24T02:01:35.067539+0000","last_unstale":"2023-10-24T02:01:35.067758+0000","last_undegraded":"2023-10-24T02:01:35.067758+0000","last_fullsized":"2023-10-24T02:01:35.067758+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035326+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066613+0000","last_change":"2023-10-24T02:01:35.066613+0000","last_active":"2023-10-24T02:01:35.066613+0000","last_peered":"2023-10-24T02:01:35.066613+0000","last_clean":"2023-10-24T02:01:35.066613+0000","last_became_active":"2023-10-24T02:01:35.066302+0000","last_became_peered":"2023-10-24T02:01:35.066302+0000","last_unstale":"2023-10-24T02:01:35.066613+0000","last_undegraded":"2023-10-24T02:01:35.066613+0000","last_fullsized":"2023-10-24T02:01:35.066613+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051632+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070561+0000","last_change":"2023-10-24T02:01:35.070561+0000","last_active":"2023-10-24T02:01:35.070561+0000","last_peered":"2023-10-24T02:01:35.070561+0000","last_clean":"2023-10-24T02:01:35.070561+0000","last_became_active":"2023-10-24T02:01:35.070276+0000","last_became_peered":"2023-10-24T02:01:35.070276+0000","last_unstale":"2023-10-24T02:01:35.070561+0000","last_undegraded":"2023-10-24T02:01:35.070561+0000","last_fullsized":"2023-10-24T02:01:35.070561+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045886+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068883+0000","last_change":"2023-10-24T02:01:35.068883+0000","last_active":"2023-10-24T02:01:35.068883+0000","last_peered":"2023-10-24T02:01:35.068883+0000","last_clean":"2023-10-24T02:01:35.068883+0000","last_became_active":"2023-10-24T02:01:35.068265+0000","last_became_peered":"2023-10-24T02:01:35.068265+0000","last_unstale":"2023-10-24T02:01:35.068883+0000","last_undegraded":"2023-10-24T02:01:35.068883+0000","last_fullsized":"2023-10-24T02:01:35.068883+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057424+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063484+0000","last_change":"2023-10-24T02:01:35.063484+0000","last_active":"2023-10-24T02:01:35.063484+0000","last_peered":"2023-10-24T02:01:35.063484+0000","last_clean":"2023-10-24T02:01:35.063484+0000","last_became_active":"2023-10-24T02:01:35.062894+0000","last_became_peered":"2023-10-24T02:01:35.062894+0000","last_unstale":"2023-10-24T02:01:35.063484+0000","last_undegraded":"2023-10-24T02:01:35.063484+0000","last_fullsized":"2023-10-24T02:01:35.063484+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056442+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068139+0000","last_change":"2023-10-24T02:01:35.068139+0000","last_active":"2023-10-24T02:01:35.068139+0000","last_peered":"2023-10-24T02:01:35.068139+0000","last_clean":"2023-10-24T02:01:35.068139+0000","last_became_active":"2023-10-24T02:01:35.067885+0000","last_became_peered":"2023-10-24T02:01:35.067885+0000","last_unstale":"2023-10-24T02:01:35.068139+0000","last_undegraded":"2023-10-24T02:01:35.068139+0000","last_fullsized":"2023-10-24T02:01:35.068139+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050267+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071046+0000","last_change":"2023-10-24T02:01:35.071046+0000","last_active":"2023-10-24T02:01:35.071046+0000","last_peered":"2023-10-24T02:01:35.071046+0000","last_clean":"2023-10-24T02:01:35.071046+0000","last_became_active":"2023-10-24T02:01:35.070470+0000","last_became_peered":"2023-10-24T02:01:35.070470+0000","last_unstale":"2023-10-24T02:01:35.071046+0000","last_undegraded":"2023-10-24T02:01:35.071046+0000","last_fullsized":"2023-10-24T02:01:35.071046+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055108+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071852+0000","last_change":"2023-10-24T02:01:35.071852+0000","last_active":"2023-10-24T02:01:35.071852+0000","last_peered":"2023-10-24T02:01:35.071852+0000","last_clean":"2023-10-24T02:01:35.071852+0000","last_became_active":"2023-10-24T02:01:35.071578+0000","last_became_peered":"2023-10-24T02:01:35.071578+0000","last_unstale":"2023-10-24T02:01:35.071852+0000","last_undegraded":"2023-10-24T02:01:35.071852+0000","last_fullsized":"2023-10-24T02:01:35.071852+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051673+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060097+0000","last_change":"2023-10-24T02:01:35.060097+0000","last_active":"2023-10-24T02:01:35.060097+0000","last_peered":"2023-10-24T02:01:35.060097+0000","last_clean":"2023-10-24T02:01:35.060097+0000","last_became_active":"2023-10-24T02:01:35.059406+0000","last_became_peered":"2023-10-24T02:01:35.059406+0000","last_unstale":"2023-10-24T02:01:35.060097+0000","last_undegraded":"2023-10-24T02:01:35.060097+0000","last_fullsized":"2023-10-24T02:01:35.060097+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.058822+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048351+0000","last_change":"2023-10-24T02:01:35.048351+0000","last_active":"2023-10-24T02:01:35.048351+0000","last_peered":"2023-10-24T02:01:35.048351+0000","last_clean":"2023-10-24T02:01:35.048351+0000","last_became_active":"2023-10-24T02:01:35.048142+0000","last_became_peered":"2023-10-24T02:01:35.048142+0000","last_unstale":"2023-10-24T02:01:35.048351+0000","last_undegraded":"2023-10-24T02:01:35.048351+0000","last_fullsized":"2023-10-24T02:01:35.048351+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053194+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063242+0000","last_change":"2023-10-24T02:01:35.063242+0000","last_active":"2023-10-24T02:01:35.063242+0000","last_peered":"2023-10-24T02:01:35.063242+0000","last_clean":"2023-10-24T02:01:35.063242+0000","last_became_active":"2023-10-24T02:01:35.062923+0000","last_became_peered":"2023-10-24T02:01:35.062923+0000","last_unstale":"2023-10-24T02:01:35.063242+0000","last_undegraded":"2023-10-24T02:01:35.063242+0000","last_fullsized":"2023-10-24T02:01:35.063242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059768+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067615+0000","last_change":"2023-10-24T02:01:35.067615+0000","last_active":"2023-10-24T02:01:35.067615+0000","last_peered":"2023-10-24T02:01:35.067615+0000","last_clean":"2023-10-24T02:01:35.067615+0000","last_became_active":"2023-10-24T02:01:35.067351+0000","last_became_peered":"2023-10-24T02:01:35.067351+0000","last_unstale":"2023-10-24T02:01:35.067615+0000","last_undegraded":"2023-10-24T02:01:35.067615+0000","last_fullsized":"2023-10-24T02:01:35.067615+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039970+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072772+0000","last_change":"2023-10-24T02:01:35.072772+0000","last_active":"2023-10-24T02:01:35.072772+0000","last_peered":"2023-10-24T02:01:35.072772+0000","last_clean":"2023-10-24T02:01:35.072772+0000","last_became_active":"2023-10-24T02:01:35.072515+0000","last_became_peered":"2023-10-24T02:01:35.072515+0000","last_unstale":"2023-10-24T02:01:35.072772+0000","last_undegraded":"2023-10-24T02:01:35.072772+0000","last_fullsized":"2023-10-24T02:01:35.072772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053856+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061840+0000","last_became_peered":"2023-10-24T02:01:35.061840+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.044421+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065231+0000","last_change":"2023-10-24T02:01:35.065231+0000","last_active":"2023-10-24T02:01:35.065231+0000","last_peered":"2023-10-24T02:01:35.065231+0000","last_clean":"2023-10-24T02:01:35.065231+0000","last_became_active":"2023-10-24T02:01:35.064941+0000","last_became_peered":"2023-10-24T02:01:35.064941+0000","last_unstale":"2023-10-24T02:01:35.065231+0000","last_undegraded":"2023-10-24T02:01:35.065231+0000","last_fullsized":"2023-10-24T02:01:35.065231+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039279+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069087+0000","last_change":"2023-10-24T02:01:35.069087+0000","last_active":"2023-10-24T02:01:35.069087+0000","last_peered":"2023-10-24T02:01:35.069087+0000","last_clean":"2023-10-24T02:01:35.069087+0000","last_became_active":"2023-10-24T02:01:35.066064+0000","last_became_peered":"2023-10-24T02:01:35.066064+0000","last_unstale":"2023-10-24T02:01:35.069087+0000","last_undegraded":"2023-10-24T02:01:35.069087+0000","last_fullsized":"2023-10-24T02:01:35.069087+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050308+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074140+0000","last_change":"2023-10-24T02:01:35.074140+0000","last_active":"2023-10-24T02:01:35.074140+0000","last_peered":"2023-10-24T02:01:35.074140+0000","last_clean":"2023-10-24T02:01:35.074140+0000","last_became_active":"2023-10-24T02:01:35.073879+0000","last_became_peered":"2023-10-24T02:01:35.073879+0000","last_unstale":"2023-10-24T02:01:35.074140+0000","last_undegraded":"2023-10-24T02:01:35.074140+0000","last_fullsized":"2023-10-24T02:01:35.074140+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042266+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056668+0000","last_change":"2023-10-24T02:01:35.056668+0000","last_active":"2023-10-24T02:01:35.056668+0000","last_peered":"2023-10-24T02:01:35.056668+0000","last_clean":"2023-10-24T02:01:35.056668+0000","last_became_active":"2023-10-24T02:01:35.056456+0000","last_became_peered":"2023-10-24T02:01:35.056456+0000","last_unstale":"2023-10-24T02:01:35.056668+0000","last_undegraded":"2023-10-24T02:01:35.056668+0000","last_fullsized":"2023-10-24T02:01:35.056668+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051238+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066552+0000","last_change":"2023-10-24T02:01:35.066552+0000","last_active":"2023-10-24T02:01:35.066552+0000","last_peered":"2023-10-24T02:01:35.066552+0000","last_clean":"2023-10-24T02:01:35.066552+0000","last_became_active":"2023-10-24T02:01:35.066026+0000","last_became_peered":"2023-10-24T02:01:35.066026+0000","last_unstale":"2023-10-24T02:01:35.066552+0000","last_undegraded":"2023-10-24T02:01:35.066552+0000","last_fullsized":"2023-10-24T02:01:35.066552+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038320+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066458+0000","last_change":"2023-10-24T02:01:35.066458+0000","last_active":"2023-10-24T02:01:35.066458+0000","last_peered":"2023-10-24T02:01:35.066458+0000","last_clean":"2023-10-24T02:01:35.066458+0000","last_became_active":"2023-10-24T02:01:35.066109+0000","last_became_peered":"2023-10-24T02:01:35.066109+0000","last_unstale":"2023-10-24T02:01:35.066458+0000","last_undegraded":"2023-10-24T02:01:35.066458+0000","last_fullsized":"2023-10-24T02:01:35.066458+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042386+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065554+0000","last_change":"2023-10-24T02:01:35.065554+0000","last_active":"2023-10-24T02:01:35.065554+0000","last_peered":"2023-10-24T02:01:35.065554+0000","last_clean":"2023-10-24T02:01:35.065554+0000","last_became_active":"2023-10-24T02:01:35.065264+0000","last_became_peered":"2023-10-24T02:01:35.065264+0000","last_unstale":"2023-10-24T02:01:35.065554+0000","last_undegraded":"2023-10-24T02:01:35.065554+0000","last_fullsized":"2023-10-24T02:01:35.065554+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057553+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067711+0000","last_change":"2023-10-24T02:01:35.067711+0000","last_active":"2023-10-24T02:01:35.067711+0000","last_peered":"2023-10-24T02:01:35.067711+0000","last_clean":"2023-10-24T02:01:35.067711+0000","last_became_active":"2023-10-24T02:01:35.067429+0000","last_became_peered":"2023-10-24T02:01:35.067429+0000","last_unstale":"2023-10-24T02:01:35.067711+0000","last_undegraded":"2023-10-24T02:01:35.067711+0000","last_fullsized":"2023-10-24T02:01:35.067711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053241+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065740+0000","last_change":"2023-10-24T02:01:35.065740+0000","last_active":"2023-10-24T02:01:35.065740+0000","last_peered":"2023-10-24T02:01:35.065740+0000","last_clean":"2023-10-24T02:01:35.065740+0000","last_became_active":"2023-10-24T02:01:35.065413+0000","last_became_peered":"2023-10-24T02:01:35.065413+0000","last_unstale":"2023-10-24T02:01:35.065740+0000","last_undegraded":"2023-10-24T02:01:35.065740+0000","last_fullsized":"2023-10-24T02:01:35.065740+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034683+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048085+0000","last_change":"2023-10-24T02:01:35.048085+0000","last_active":"2023-10-24T02:01:35.048085+0000","last_peered":"2023-10-24T02:01:35.048085+0000","last_clean":"2023-10-24T02:01:35.048085+0000","last_became_active":"2023-10-24T02:01:35.047789+0000","last_became_peered":"2023-10-24T02:01:35.047789+0000","last_unstale":"2023-10-24T02:01:35.048085+0000","last_undegraded":"2023-10-24T02:01:35.048085+0000","last_fullsized":"2023-10-24T02:01:35.048085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.060595+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062733+0000","last_change":"2023-10-24T02:01:35.062733+0000","last_active":"2023-10-24T02:01:35.062733+0000","last_peered":"2023-10-24T02:01:35.062733+0000","last_clean":"2023-10-24T02:01:35.062733+0000","last_became_active":"2023-10-24T02:01:35.062388+0000","last_became_peered":"2023-10-24T02:01:35.062388+0000","last_unstale":"2023-10-24T02:01:35.062733+0000","last_undegraded":"2023-10-24T02:01:35.062733+0000","last_fullsized":"2023-10-24T02:01:35.062733+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038283+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056643+0000","last_change":"2023-10-24T02:01:35.056643+0000","last_active":"2023-10-24T02:01:35.056643+0000","last_peered":"2023-10-24T02:01:35.056643+0000","last_clean":"2023-10-24T02:01:35.056643+0000","last_became_active":"2023-10-24T02:01:35.056224+0000","last_became_peered":"2023-10-24T02:01:35.056224+0000","last_unstale":"2023-10-24T02:01:35.056643+0000","last_undegraded":"2023-10-24T02:01:35.056643+0000","last_fullsized":"2023-10-24T02:01:35.056643+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042654+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072602+0000","last_change":"2023-10-24T02:01:35.072602+0000","last_active":"2023-10-24T02:01:35.072602+0000","last_peered":"2023-10-24T02:01:35.072602+0000","last_clean":"2023-10-24T02:01:35.072602+0000","last_became_active":"2023-10-24T02:01:35.072258+0000","last_became_peered":"2023-10-24T02:01:35.072258+0000","last_unstale":"2023-10-24T02:01:35.072602+0000","last_undegraded":"2023-10-24T02:01:35.072602+0000","last_fullsized":"2023-10-24T02:01:35.072602+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052528+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067842+0000","last_change":"2023-10-24T02:01:35.067842+0000","last_active":"2023-10-24T02:01:35.067842+0000","last_peered":"2023-10-24T02:01:35.067842+0000","last_clean":"2023-10-24T02:01:35.067842+0000","last_became_active":"2023-10-24T02:01:35.067481+0000","last_became_peered":"2023-10-24T02:01:35.067481+0000","last_unstale":"2023-10-24T02:01:35.067842+0000","last_undegraded":"2023-10-24T02:01:35.067842+0000","last_fullsized":"2023-10-24T02:01:35.067842+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035644+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051447+0000","last_change":"2023-10-24T02:01:35.051447+0000","last_active":"2023-10-24T02:01:35.051447+0000","last_peered":"2023-10-24T02:01:35.051447+0000","last_clean":"2023-10-24T02:01:35.051447+0000","last_became_active":"2023-10-24T02:01:35.050511+0000","last_became_peered":"2023-10-24T02:01:35.050511+0000","last_unstale":"2023-10-24T02:01:35.051447+0000","last_undegraded":"2023-10-24T02:01:35.051447+0000","last_fullsized":"2023-10-24T02:01:35.051447+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.046393+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.054678+0000","last_change":"2023-10-24T02:01:35.054678+0000","last_active":"2023-10-24T02:01:35.054678+0000","last_peered":"2023-10-24T02:01:35.054678+0000","last_clean":"2023-10-24T02:01:35.054678+0000","last_became_active":"2023-10-24T02:01:35.054410+0000","last_became_peered":"2023-10-24T02:01:35.054410+0000","last_unstale":"2023-10-24T02:01:35.054678+0000","last_undegraded":"2023-10-24T02:01:35.054678+0000","last_fullsized":"2023-10-24T02:01:35.054678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043975+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057004+0000","last_change":"2023-10-24T02:01:35.057004+0000","last_active":"2023-10-24T02:01:35.057004+0000","last_peered":"2023-10-24T02:01:35.057004+0000","last_clean":"2023-10-24T02:01:35.057004+0000","last_became_active":"2023-10-24T02:01:35.056703+0000","last_became_peered":"2023-10-24T02:01:35.056703+0000","last_unstale":"2023-10-24T02:01:35.057004+0000","last_undegraded":"2023-10-24T02:01:35.057004+0000","last_fullsized":"2023-10-24T02:01:35.057004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050848+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070176+0000","last_change":"2023-10-24T02:01:35.070176+0000","last_active":"2023-10-24T02:01:35.070176+0000","last_peered":"2023-10-24T02:01:35.070176+0000","last_clean":"2023-10-24T02:01:35.070176+0000","last_became_active":"2023-10-24T02:01:35.069790+0000","last_became_peered":"2023-10-24T02:01:35.069790+0000","last_unstale":"2023-10-24T02:01:35.070176+0000","last_undegraded":"2023-10-24T02:01:35.070176+0000","last_fullsized":"2023-10-24T02:01:35.070176+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034321+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066486+0000","last_change":"2023-10-24T02:01:35.066486+0000","last_active":"2023-10-24T02:01:35.066486+0000","last_peered":"2023-10-24T02:01:35.066486+0000","last_clean":"2023-10-24T02:01:35.066486+0000","last_became_active":"2023-10-24T02:01:35.066230+0000","last_became_peered":"2023-10-24T02:01:35.066230+0000","last_unstale":"2023-10-24T02:01:35.066486+0000","last_undegraded":"2023-10-24T02:01:35.066486+0000","last_fullsized":"2023-10-24T02:01:35.066486+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054352+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.049824+0000","last_change":"2023-10-24T02:01:35.049824+0000","last_active":"2023-10-24T02:01:35.049824+0000","last_peered":"2023-10-24T02:01:35.049824+0000","last_clean":"2023-10-24T02:01:35.049824+0000","last_became_active":"2023-10-24T02:01:35.049440+0000","last_became_peered":"2023-10-24T02:01:35.049440+0000","last_unstale":"2023-10-24T02:01:35.049824+0000","last_undegraded":"2023-10-24T02:01:35.049824+0000","last_fullsized":"2023-10-24T02:01:35.049824+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055578+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069408+0000","last_change":"2023-10-24T02:01:35.069408+0000","last_active":"2023-10-24T02:01:35.069408+0000","last_peered":"2023-10-24T02:01:35.069408+0000","last_clean":"2023-10-24T02:01:35.069408+0000","last_became_active":"2023-10-24T02:01:35.069083+0000","last_became_peered":"2023-10-24T02:01:35.069083+0000","last_unstale":"2023-10-24T02:01:35.069408+0000","last_undegraded":"2023-10-24T02:01:35.069408+0000","last_fullsized":"2023-10-24T02:01:35.069408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061594+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050116+0000","last_change":"2023-10-24T02:01:35.050116+0000","last_active":"2023-10-24T02:01:35.050116+0000","last_peered":"2023-10-24T02:01:35.050116+0000","last_clean":"2023-10-24T02:01:35.050116+0000","last_became_active":"2023-10-24T02:01:35.049854+0000","last_became_peered":"2023-10-24T02:01:35.049854+0000","last_unstale":"2023-10-24T02:01:35.050116+0000","last_undegraded":"2023-10-24T02:01:35.050116+0000","last_fullsized":"2023-10-24T02:01:35.050116+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.040387+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067595+0000","last_change":"2023-10-24T02:01:35.067595+0000","last_active":"2023-10-24T02:01:35.067595+0000","last_peered":"2023-10-24T02:01:35.067595+0000","last_clean":"2023-10-24T02:01:35.067595+0000","last_became_active":"2023-10-24T02:01:35.067318+0000","last_became_peered":"2023-10-24T02:01:35.067318+0000","last_unstale":"2023-10-24T02:01:35.067595+0000","last_undegraded":"2023-10-24T02:01:35.067595+0000","last_fullsized":"2023-10-24T02:01:35.067595+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043570+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063179+0000","last_change":"2023-10-24T02:01:35.063179+0000","last_active":"2023-10-24T02:01:35.063179+0000","last_peered":"2023-10-24T02:01:35.063179+0000","last_clean":"2023-10-24T02:01:35.063179+0000","last_became_active":"2023-10-24T02:01:35.062905+0000","last_became_peered":"2023-10-24T02:01:35.062905+0000","last_unstale":"2023-10-24T02:01:35.063179+0000","last_undegraded":"2023-10-24T02:01:35.063179+0000","last_fullsized":"2023-10-24T02:01:35.063179+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043243+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061859+0000","last_became_peered":"2023-10-24T02:01:35.061859+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051911+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074890+0000","last_change":"2023-10-24T02:01:35.074890+0000","last_active":"2023-10-24T02:01:35.074890+0000","last_peered":"2023-10-24T02:01:35.074890+0000","last_clean":"2023-10-24T02:01:35.074890+0000","last_became_active":"2023-10-24T02:01:35.074531+0000","last_became_peered":"2023-10-24T02:01:35.074531+0000","last_unstale":"2023-10-24T02:01:35.074890+0000","last_undegraded":"2023-10-24T02:01:35.074890+0000","last_fullsized":"2023-10-24T02:01:35.074890+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054064+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065366+0000","last_change":"2023-10-24T02:01:35.065366+0000","last_active":"2023-10-24T02:01:35.065366+0000","last_peered":"2023-10-24T02:01:35.065366+0000","last_clean":"2023-10-24T02:01:35.065366+0000","last_became_active":"2023-10-24T02:01:35.065020+0000","last_became_peered":"2023-10-24T02:01:35.065020+0000","last_unstale":"2023-10-24T02:01:35.065366+0000","last_undegraded":"2023-10-24T02:01:35.065366+0000","last_fullsized":"2023-10-24T02:01:35.065366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034982+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050315+0000","last_change":"2023-10-24T02:01:35.050315+0000","last_active":"2023-10-24T02:01:35.050315+0000","last_peered":"2023-10-24T02:01:35.050315+0000","last_clean":"2023-10-24T02:01:35.050315+0000","last_became_active":"2023-10-24T02:01:35.049685+0000","last_became_peered":"2023-10-24T02:01:35.049685+0000","last_unstale":"2023-10-24T02:01:35.050315+0000","last_undegraded":"2023-10-24T02:01:35.050315+0000","last_fullsized":"2023-10-24T02:01:35.050315+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045773+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060505+0000","last_change":"2023-10-24T02:01:35.060505+0000","last_active":"2023-10-24T02:01:35.060505+0000","last_peered":"2023-10-24T02:01:35.060505+0000","last_clean":"2023-10-24T02:01:35.060505+0000","last_became_active":"2023-10-24T02:01:35.060288+0000","last_became_peered":"2023-10-24T02:01:35.060288+0000","last_unstale":"2023-10-24T02:01:35.060505+0000","last_undegraded":"2023-10-24T02:01:35.060505+0000","last_fullsized":"2023-10-24T02:01:35.060505+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034307+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053840+0000","last_change":"2023-10-24T02:01:35.053840+0000","last_active":"2023-10-24T02:01:35.053840+0000","last_peered":"2023-10-24T02:01:35.053840+0000","last_clean":"2023-10-24T02:01:35.053840+0000","last_became_active":"2023-10-24T02:01:35.053577+0000","last_became_peered":"2023-10-24T02:01:35.053577+0000","last_unstale":"2023-10-24T02:01:35.053840+0000","last_undegraded":"2023-10-24T02:01:35.053840+0000","last_fullsized":"2023-10-24T02:01:35.053840+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056043+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062771+0000","last_change":"2023-10-24T02:01:35.062771+0000","last_active":"2023-10-24T02:01:35.062771+0000","last_peered":"2023-10-24T02:01:35.062771+0000","last_clean":"2023-10-24T02:01:35.062771+0000","last_became_active":"2023-10-24T02:01:35.062245+0000","last_became_peered":"2023-10-24T02:01:35.062245+0000","last_unstale":"2023-10-24T02:01:35.062771+0000","last_undegraded":"2023-10-24T02:01:35.062771+0000","last_fullsized":"2023-10-24T02:01:35.062771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053496+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050373+0000","last_change":"2023-10-24T02:01:35.050373+0000","last_active":"2023-10-24T02:01:35.050373+0000","last_peered":"2023-10-24T02:01:35.050373+0000","last_clean":"2023-10-24T02:01:35.050373+0000","last_became_active":"2023-10-24T02:01:35.050108+0000","last_became_peered":"2023-10-24T02:01:35.050108+0000","last_unstale":"2023-10-24T02:01:35.050373+0000","last_undegraded":"2023-10-24T02:01:35.050373+0000","last_fullsized":"2023-10-24T02:01:35.050373+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039550+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.077262+0000","last_change":"2023-10-24T02:01:35.077262+0000","last_active":"2023-10-24T02:01:35.077262+0000","last_peered":"2023-10-24T02:01:35.077262+0000","last_clean":"2023-10-24T02:01:35.077262+0000","last_became_active":"2023-10-24T02:01:35.076871+0000","last_became_peered":"2023-10-24T02:01:35.076871+0000","last_unstale":"2023-10-24T02:01:35.077262+0000","last_undegraded":"2023-10-24T02:01:35.077262+0000","last_fullsized":"2023-10-24T02:01:35.077262+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045418+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071577+0000","last_change":"2023-10-24T02:01:35.071577+0000","last_active":"2023-10-24T02:01:35.071577+0000","last_peered":"2023-10-24T02:01:35.071577+0000","last_clean":"2023-10-24T02:01:35.071577+0000","last_became_active":"2023-10-24T02:01:35.071242+0000","last_became_peered":"2023-10-24T02:01:35.071242+0000","last_unstale":"2023-10-24T02:01:35.071577+0000","last_undegraded":"2023-10-24T02:01:35.071577+0000","last_fullsized":"2023-10-24T02:01:35.071577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054205+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065762+0000","last_change":"2023-10-24T02:01:35.065762+0000","last_active":"2023-10-24T02:01:35.065762+0000","last_peered":"2023-10-24T02:01:35.065762+0000","last_clean":"2023-10-24T02:01:35.065762+0000","last_became_active":"2023-10-24T02:01:35.065467+0000","last_became_peered":"2023-10-24T02:01:35.065467+0000","last_unstale":"2023-10-24T02:01:35.065762+0000","last_undegraded":"2023-10-24T02:01:35.065762+0000","last_fullsized":"2023-10-24T02:01:35.065762+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029128+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:01:34.029128+0000","last_peered":"2023-10-24T02:01:34.029128+0000","last_clean":"2023-10-24T02:01:34.029128+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:01:34.029128+0000","last_undegraded":"2023-10-24T02:01:34.029128+0000","last_fullsized":"2023-10-24T02:01:34.029128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061505+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.047264+0000","last_change":"2023-10-24T02:01:35.047264+0000","last_active":"2023-10-24T02:01:35.047264+0000","last_peered":"2023-10-24T02:01:35.047264+0000","last_clean":"2023-10-24T02:01:35.047264+0000","last_became_active":"2023-10-24T02:01:35.047045+0000","last_became_peered":"2023-10-24T02:01:35.047045+0000","last_unstale":"2023-10-24T02:01:35.047264+0000","last_undegraded":"2023-10-24T02:01:35.047264+0000","last_fullsized":"2023-10-24T02:01:35.047264+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024727+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:01:34.024727+0000","last_peered":"2023-10-24T02:01:34.024727+0000","last_clean":"2023-10-24T02:01:34.024727+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:01:34.024727+0000","last_undegraded":"2023-10-24T02:01:34.024727+0000","last_fullsized":"2023-10-24T02:01:34.024727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.041316+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053784+0000","last_change":"2023-10-24T02:01:35.053784+0000","last_active":"2023-10-24T02:01:35.053784+0000","last_peered":"2023-10-24T02:01:35.053784+0000","last_clean":"2023-10-24T02:01:35.053784+0000","last_became_active":"2023-10-24T02:01:35.053537+0000","last_became_peered":"2023-10-24T02:01:35.053537+0000","last_unstale":"2023-10-24T02:01:35.053784+0000","last_undegraded":"2023-10-24T02:01:35.053784+0000","last_fullsized":"2023-10-24T02:01:35.053784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.020684+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:01:34.020684+0000","last_peered":"2023-10-24T02:01:34.020684+0000","last_clean":"2023-10-24T02:01:34.020684+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:01:34.020684+0000","last_undegraded":"2023-10-24T02:01:34.020684+0000","last_fullsized":"2023-10-24T02:01:34.020684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050783+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050465+0000","last_change":"2023-10-24T02:01:35.050465+0000","last_active":"2023-10-24T02:01:35.050465+0000","last_peered":"2023-10-24T02:01:35.050465+0000","last_clean":"2023-10-24T02:01:35.050465+0000","last_became_active":"2023-10-24T02:01:35.050041+0000","last_became_peered":"2023-10-24T02:01:35.050041+0000","last_unstale":"2023-10-24T02:01:35.050465+0000","last_undegraded":"2023-10-24T02:01:35.050465+0000","last_fullsized":"2023-10-24T02:01:35.050465+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024886+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:01:34.024886+0000","last_peered":"2023-10-24T02:01:34.024886+0000","last_clean":"2023-10-24T02:01:34.024886+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:01:34.024886+0000","last_undegraded":"2023-10-24T02:01:34.024886+0000","last_fullsized":"2023-10-24T02:01:34.024886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":192,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028141+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:01:34.028141+0000","last_peered":"2023-10-24T02:01:34.028141+0000","last_clean":"2023-10-24T02:01:34.028141+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:01:34.028141+0000","last_undegraded":"2023-10-24T02:01:34.028141+0000","last_fullsized":"2023-10-24T02:01:34.028141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038885+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062583+0000","last_change":"2023-10-24T02:01:35.062583+0000","last_active":"2023-10-24T02:01:35.062583+0000","last_peered":"2023-10-24T02:01:35.062583+0000","last_clean":"2023-10-24T02:01:35.062583+0000","last_became_active":"2023-10-24T02:01:35.062270+0000","last_became_peered":"2023-10-24T02:01:35.062270+0000","last_unstale":"2023-10-24T02:01:35.062583+0000","last_undegraded":"2023-10-24T02:01:35.062583+0000","last_fullsized":"2023-10-24T02:01:35.062583+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028231+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:01:34.028231+0000","last_peered":"2023-10-24T02:01:34.028231+0000","last_clean":"2023-10-24T02:01:34.028231+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:01:34.028231+0000","last_undegraded":"2023-10-24T02:01:34.028231+0000","last_fullsized":"2023-10-24T02:01:34.028231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045087+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.059711+0000","last_change":"2023-10-24T02:01:35.059711+0000","last_active":"2023-10-24T02:01:35.059711+0000","last_peered":"2023-10-24T02:01:35.059711+0000","last_clean":"2023-10-24T02:01:35.059711+0000","last_became_active":"2023-10-24T02:01:35.059392+0000","last_became_peered":"2023-10-24T02:01:35.059392+0000","last_unstale":"2023-10-24T02:01:35.059711+0000","last_undegraded":"2023-10-24T02:01:35.059711+0000","last_fullsized":"2023-10-24T02:01:35.059711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.022778+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:01:34.022778+0000","last_peered":"2023-10-24T02:01:34.022778+0000","last_clean":"2023-10-24T02:01:34.022778+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:01:34.022778+0000","last_undegraded":"2023-10-24T02:01:34.022778+0000","last_fullsized":"2023-10-24T02:01:34.022778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052239+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080408+0000","last_change":"2023-10-24T02:01:35.080408+0000","last_active":"2023-10-24T02:01:35.080408+0000","last_peered":"2023-10-24T02:01:35.080408+0000","last_clean":"2023-10-24T02:01:35.080408+0000","last_became_active":"2023-10-24T02:01:35.080124+0000","last_became_peered":"2023-10-24T02:01:35.080124+0000","last_unstale":"2023-10-24T02:01:35.080408+0000","last_undegraded":"2023-10-24T02:01:35.080408+0000","last_fullsized":"2023-10-24T02:01:35.080408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028674+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:01:34.028674+0000","last_peered":"2023-10-24T02:01:34.028674+0000","last_clean":"2023-10-24T02:01:34.028674+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:01:34.028674+0000","last_undegraded":"2023-10-24T02:01:34.028674+0000","last_fullsized":"2023-10-24T02:01:34.028674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034388+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065227+0000","last_change":"2023-10-24T02:01:35.065227+0000","last_active":"2023-10-24T02:01:35.065227+0000","last_peered":"2023-10-24T02:01:35.065227+0000","last_clean":"2023-10-24T02:01:35.065227+0000","last_became_active":"2023-10-24T02:01:35.065007+0000","last_became_peered":"2023-10-24T02:01:35.065007+0000","last_unstale":"2023-10-24T02:01:35.065227+0000","last_undegraded":"2023-10-24T02:01:35.065227+0000","last_fullsized":"2023-10-24T02:01:35.065227+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029393+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:01:34.029393+0000","last_peered":"2023-10-24T02:01:34.029393+0000","last_clean":"2023-10-24T02:01:34.029393+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:01:34.029393+0000","last_undegraded":"2023-10-24T02:01:34.029393+0000","last_fullsized":"2023-10-24T02:01:34.029393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543252,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.745,"15min":0.86399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.314},"max":{"1min":0.749,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.81999999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.83999999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.55100000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.752,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.85699999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.86499999999999999,"15min":0.90900000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.43099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.877},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.873,"5min":0.873,"15min":1.0049999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.78700000000000003,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.48099999999999998,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.873},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.80200000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575957,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39800000000000002,"15min":0.39100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55100000000000005,"5min":0.878,"15min":0.878},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.51400000000000001,"5min":0.627,"15min":0.63200000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.75},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59099999999999997,"5min":0.67600000000000005,"15min":0.71599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.41199999999999998},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.502},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.82599999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.52600000000000002,"5min":0.47799999999999998,"15min":0.45600000000000002},"max":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575957,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":0.624,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52300000000000002,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.25700000000000001},"max":{"1min":0.52900000000000003,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.375}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.312,"15min":0.25900000000000001},"max":{"1min":0.58999999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.52200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.97299999999999998},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.008},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47799999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":1.028},"last":0.503}]}]},{"osd":2,"up_from":14,"seq":60129543252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.72899999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":0.68300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.95199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.53100000000000003,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97299999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.875,"15min":0.99299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.186},"max":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.59999999999999998},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22500000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.752},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.21299999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.314,"5min":0.314,"15min":0.26100000000000001},"max":{"1min":0.56999999999999995,"5min":0.623,"15min":0.64600000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.65600000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.60899999999999999,"5min":0.68799999999999994,"15min":0.72799999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.35599999999999998},"max":{"1min":0.93600000000000005,"5min":1.097,"15min":1.097},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.41299999999999998,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":1.034,"15min":1.056},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.93799999999999994,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":1.0700000000000001,"15min":1.083},"last":0.624}]},{"osd":7,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":1.155,"15min":1.155},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.45100000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.73599999999999999,"15min":0.83799999999999997},"last":0.438},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.27200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86099999999999999},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.46700000000000003,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83799999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.35899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66100000000000003,"5min":0.76100000000000001,"15min":0.83599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.874},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.80300000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.30299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.499,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.54200000000000004,"5min":0.41699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45900000000000002,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.501,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.27000000000000002},"max":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"max":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.98799999999999999},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:01:39.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-10-24T02:01:39.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.050817+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-10-24T02:01:39.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.059227+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-10-24T02:01:39.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.043065+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-10-24T02:01:39.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.038711+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-10-24T02:01:39.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.052757+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-10-24T02:01:39.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.057955+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-10-24T02:01:39.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034349+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-10-24T02:01:39.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.035056+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-10-24T02:01:39.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034853+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-10-24T02:01:39.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.035326+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-10-24T02:01:39.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.051632+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-10-24T02:01:39.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.045886+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-10-24T02:01:39.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.057424+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-10-24T02:01:39.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.056442+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-10-24T02:01:39.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.050267+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-10-24T02:01:39.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.055108+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-10-24T02:01:39.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.051673+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:01:39.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-10-24T02:01:39.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.058822+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-10-24T02:01:39.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.053194+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:01:39.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-10-24T02:01:39.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.059768+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-10-24T02:01:39.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.039970+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-10-24T02:01:39.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.053856+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-10-24T02:01:39.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.044421+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-10-24T02:01:39.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.039279+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-10-24T02:01:39.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.050308+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-10-24T02:01:39.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.042266+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-10-24T02:01:39.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.051238+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-10-24T02:01:39.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.038320+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-10-24T02:01:39.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.042386+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-10-24T02:01:39.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.057553+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-10-24T02:01:39.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.053241+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:01:39.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-10-24T02:01:39.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034683+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-10-24T02:01:39.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.060595+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-10-24T02:01:39.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.038283+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-10-24T02:01:39.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.042654+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-10-24T02:01:39.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.052528+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-10-24T02:01:39.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.035644+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-10-24T02:01:39.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.046393+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-10-24T02:01:39.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.043975+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-10-24T02:01:39.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.050848+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-10-24T02:01:39.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034321+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-10-24T02:01:39.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.054352+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:01:39.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-10-24T02:01:39.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.055578+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-10-24T02:01:39.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.061594+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-10-24T02:01:39.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.040387+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-10-24T02:01:39.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.043570+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-10-24T02:01:39.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.043243+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:01:39.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-10-24T02:01:39.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.051911+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-10-24T02:01:39.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.054064+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-10-24T02:01:39.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034982+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-10-24T02:01:39.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.045773+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-10-24T02:01:39.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034307+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-10-24T02:01:39.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.056043+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:01:39.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-10-24T02:01:39.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.053496+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-10-24T02:01:39.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.039550+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-10-24T02:01:39.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.045418+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-10-24T02:01:39.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.054205+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:01:39.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-10-24T02:01:39.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.061505+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-10-24T02:01:39.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.041316+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-10-24T02:01:39.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.050783+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:01:39.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-10-24T02:01:39.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.038885+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:01:39.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-10-24T02:01:39.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.045087+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:01:39.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-10-24T02:01:39.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.052239+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:01:39.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-10-24T02:01:39.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:01:35.019239+0000', 'last_change': '2023-10-24T02:01:35.034388+0000', 'last_active': '2023-10-24T02:01:35.019239+0000', 'last_peered': '2023-10-24T02:01:35.019239+0000', 'last_clean': '2023-10-24T02:01:35.019239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:01:35.019239+0000', 'last_undegraded': '2023-10-24T02:01:35.019239+0000', 'last_fullsized': '2023-10-24T02:01:35.019239+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'last_clean_scrub_stamp': '2023-10-24T02:01:35.019239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:01:39.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T02:01:39.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.255+0000 7f78134e4700 1 Processor -- start 2023-10-24T02:01:39.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 -- start start 2023-10-24T02:01:39.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f780c154350 0x7f780c154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f780c065190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.262 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0bf2d0 con 0x7f780c064d10 2023-10-24T02:01:39.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0bea30 con 0x7f780c154350 2023-10-24T02:01:39.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.256+0000 7f78134e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0bed10 con 0x7f780c0a8480 2023-10-24T02:01:39.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7810a7f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f780c064d10 0x7f780c0a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46572/0 (socket says 172.21.15.148:46572) 2023-10-24T02:01:39.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7810a7f700 1 -- 172.21.15.148:0/3202564428 learned_addr learned my addr 172.21.15.148:0/3202564428 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:39.263 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7811280700 1 --2- 172.21.15.148:0/3202564428 >> v2:172.21.15.150:3300/0 conn(0x7f780c154350 0x7f780c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7811a81700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f780c065190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422988230 0 0) 0x7f780c0bf2d0 con 0x7f780c064d10 2023-10-24T02:01:39.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f80033f0 con 0x7f780c064d10 2023-10-24T02:01:39.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2074700819 0 0) 0x7f77f80033f0 con 0x7f780c064d10 2023-10-24T02:01:39.264 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 msgr2=0x7f780c065190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:39.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f780c065190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 >> v2:172.21.15.150:3300/0 conn(0x7f780c154350 msgr2=0x7f780c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:39.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 --2- 172.21.15.148:0/3202564428 >> v2:172.21.15.150:3300/0 conn(0x7f780c154350 0x7f780c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0beff0 con 0x7f780c064d10 2023-10-24T02:01:39.265 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f77fc001470 con 0x7f780c064d10 2023-10-24T02:01:39.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 >> v1:172.21.15.148:6789/0 conn(0x7f780c064d10 legacy=0x7f780c0a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f77f80038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f8003e10 0x7f77f8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f8004b80 0x7f77f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0bea30 con 0x7f77f8003e10 2023-10-24T02:01:39.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0bed10 con 0x7f77f8004b80 2023-10-24T02:01:39.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800b910 con 0x7f780c0a8480 2023-10-24T02:01:39.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7811280700 1 --2- 172.21.15.148:0/3202564428 >> v2:172.21.15.150:3300/0 conn(0x7f780c154350 0x7f780c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:39.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7810a7f700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f8003e10 0x7f77f8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7811a81700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f8004b80 0x7f77f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.257+0000 7f7811280700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f77f80038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 -- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 msgr2=0x7f77f80038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:39.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f780c0a8480 0x7f77f80038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 -- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f8004b80 msgr2=0x7f77f8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f8004b80 0x7f77f8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 -- 172.21.15.148:0/3202564428 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80033f0 con 0x7f77f8003e10 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7811a81700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77f8004b80 0x7f77f8005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7810a7f700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f8003e10 0x7f77f8004690 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f77fc00c210 tx=0x7f77fc001e90).ready entity=mon.0 client_cookie=35c4b60ab404faa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc007a60 con 0x7f77f8003e10 2023-10-24T02:01:39.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00ca80 con 0x7f77f8003e10 2023-10-24T02:01:39.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7803fff700 1 -- 172.21.15.148:0/3202564428 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00ce40 con 0x7f77f8003e10 2023-10-24T02:01:39.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 -- 172.21.15.148:0/3202564428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f8003e10 msgr2=0x7f77f8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 --2- 172.21.15.148:0/3202564428 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77f8003e10 0x7f77f8004690 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f77fc00c210 tx=0x7f77fc001e90).stop 2023-10-24T02:01:39.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f7811a81700 1 -- 172.21.15.148:0/3202564428 reap_dead start 2023-10-24T02:01:39.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 -- 172.21.15.148:0/3202564428 shutdown_connections 2023-10-24T02:01:39.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 -- 172.21.15.148:0/3202564428 >> 172.21.15.148:0/3202564428 conn(0x7f780c082f60 msgr2=0x7f780c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:39.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 -- 172.21.15.148:0/3202564428 shutdown_connections 2023-10-24T02:01:39.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.258+0000 7f78134e4700 1 -- 172.21.15.148:0/3202564428 wait complete. 2023-10-24T02:01:39.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.259+0000 7f78134e4700 1 Processor -- start 2023-10-24T02:01:39.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.259+0000 7f78134e4700 1 -- start start 2023-10-24T02:01:39.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f8003e10 0x7f780c1697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f780c156960 0x7f780c16c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0aa7b0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0ab050 con 0x7f780c156960 2023-10-24T02:01:39.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.260+0000 7f78134e4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c150440 con 0x7f77f8003e10 2023-10-24T02:01:39.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53198/0 (socket says 172.21.15.148:53198) 2023-10-24T02:01:39.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 -- 172.21.15.148:0/1033589466 learned_addr learned my addr 172.21.15.148:0/1033589466 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:39.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7811280700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f8003e10 0x7f780c1697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7811a81700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f780c156960 0x7f780c16c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 -- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f8003e10 msgr2=0x7f780c1697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f8003e10 0x7f780c1697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 -- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f780c156960 msgr2=0x7f780c16c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f780c156960 0x7f780c16c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 -- 172.21.15.148:0/1033589466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c156de0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f7810a7f700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f77fc001ed0 tx=0x7f77fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc001580 con 0x7f780c0ab4e0 2023-10-24T02:01:39.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc018070 con 0x7f780c0ab4e0 2023-10-24T02:01:39.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0046b0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c16d1d0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.261+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0aace0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.262+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c0aae70 con 0x7f780c0ab4e0 2023-10-24T02:01:39.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.262+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f77fc004a20 con 0x7f780c0ab4e0 2023-10-24T02:01:39.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.263+0000 7f78017fa700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 0x7f77f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.263+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f77fc07a570 con 0x7f780c0ab4e0 2023-10-24T02:01:39.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.263+0000 7f7811280700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 0x7f77f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.263+0000 7f7811280700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 0x7f77f0061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f780c157eb0 tx=0x7f7808009a10).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.267+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f77fc04b810 con 0x7f780c0ab4e0 2023-10-24T02:01:39.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.494+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f780c06c6b0 con 0x7f780c0ab4e0 2023-10-24T02:01:39.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.495+0000 7f78017fa700 1 -- 172.21.15.148:0/1033589466 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1038 (secure 0 0 0) 0x7f77fc024420 con 0x7f780c0ab4e0 2023-10-24T02:01:39.496 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:39.496 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5583,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":201,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2508132352,"bytes_avail":770585980928,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":68,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"b","status":"up:active","gid":9699}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-10-24T01:57:23.276055+0000","services":{}},"progress_events":{}} 2023-10-24T02:01:39.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 msgr2=0x7f77f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 0x7f77f0061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f780c157eb0 tx=0x7f7808009a10).stop 2023-10-24T02:01:39.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 msgr2=0x7f780c156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f77fc001ed0 tx=0x7f77fc015000).stop 2023-10-24T02:01:39.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 shutdown_connections 2023-10-24T02:01:39.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f77f005f150 0x7f77f0061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f780c156960 0x7f780c16c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77f8003e10 0x7f780c1697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 --2- 172.21.15.148:0/1033589466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f780c0ab4e0 0x7f780c156470 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 >> 172.21.15.148:0/1033589466 conn(0x7f780c082f60 msgr2=0x7f780c151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 shutdown_connections 2023-10-24T02:01:39.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.497+0000 7f78134e4700 1 -- 172.21.15.148:0/1033589466 wait complete. 2023-10-24T02:01:39.509 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T02:01:39.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:01:39.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.622+0000 7f7765c8b700 1 Processor -- start 2023-10-24T02:01:39.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 -- start start 2023-10-24T02:01:39.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77600aa010 0x7f77600c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77600aa3f0 0x7f7760069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600aa820 con 0x7f77600c6710 2023-10-24T02:01:39.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600c0960 con 0x7f77600aa010 2023-10-24T02:01:39.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.623+0000 7f7765c8b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600c0c40 con 0x7f77600aa3f0 2023-10-24T02:01:39.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77600aa010 0x7f77600c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f77600aa010 0x7f77600c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53210/0 (socket says 172.21.15.148:53210) 2023-10-24T02:01:39.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 -- 172.21.15.148:0/1985272375 learned_addr learned my addr 172.21.15.148:0/1985272375 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:39.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775effd700 1 --1- 172.21.15.148:0/1985272375 >> v1:172.21.15.148:6789/0 conn(0x7f77600c6710 0x7f7760158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46576/0 (socket says 172.21.15.148:46576) 2023-10-24T02:01:39.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 -- 172.21.15.148:0/1985272375 >> v2:172.21.15.150:3300/0 conn(0x7f77600aa3f0 msgr2=0x7f7760069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:39.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775ffff700 1 --2- 172.21.15.148:0/1985272375 >> v2:172.21.15.150:3300/0 conn(0x7f77600aa3f0 0x7f7760069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 --2- 172.21.15.148:0/1985272375 >> v2:172.21.15.150:3300/0 conn(0x7f77600aa3f0 0x7f7760069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775e7fc700 1 -- 172.21.15.148:0/1985272375 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093722010 0 0) 0x7f77600aa820 con 0x7f77600c6710 2023-10-24T02:01:39.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 -- 172.21.15.148:0/1985272375 >> v1:172.21.15.148:6789/0 conn(0x7f77600c6710 legacy=0x7f7760158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 -- 172.21.15.148:0/1985272375 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600c0f20 con 0x7f77600aa010 2023-10-24T02:01:39.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775f7fe700 1 --2- 172.21.15.148:0/1985272375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa010 0x7f77600c1a00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f77600c1ef0 tx=0x7f7750009840).ready entity=mon.0 client_cookie=96a324b506f3a161 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775e7fc700 1 -- 172.21.15.148:0/1985272375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000e070 con 0x7f77600aa010 2023-10-24T02:01:39.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775e7fc700 1 -- 172.21.15.148:0/1985272375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000ba50 con 0x7f77600aa010 2023-10-24T02:01:39.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.624+0000 7f775e7fc700 1 -- 172.21.15.148:0/1985272375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000bdd0 con 0x7f77600aa010 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 -- 172.21.15.148:0/1985272375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa010 msgr2=0x7f77600c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 --2- 172.21.15.148:0/1985272375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa010 0x7f77600c1a00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f77600c1ef0 tx=0x7f7750009840).stop 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 -- 172.21.15.148:0/1985272375 shutdown_connections 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 --2- 172.21.15.148:0/1985272375 >> v2:172.21.15.150:3300/0 conn(0x7f77600aa3f0 0x7f7760069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 --2- 172.21.15.148:0/1985272375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa010 0x7f77600c1a00 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 -- 172.21.15.148:0/1985272375 >> 172.21.15.148:0/1985272375 conn(0x7f77600caf40 msgr2=0x7f77600cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:39.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 -- 172.21.15.148:0/1985272375 shutdown_connections 2023-10-24T02:01:39.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.625+0000 7f7765c8b700 1 -- 172.21.15.148:0/1985272375 wait complete. 2023-10-24T02:01:39.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.626+0000 7f7765c8b700 1 Processor -- start 2023-10-24T02:01:39.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.626+0000 7f7765c8b700 1 -- start start 2023-10-24T02:01:39.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77600aa010 0x7f776014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 0x7f77601527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600af260 con 0x7f77600aa3f0 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600afd50 con 0x7f77600aa010 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600b0310 con 0x7f77600c6710 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53224/0 (socket says 172.21.15.148:53224) 2023-10-24T02:01:39.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 -- 172.21.15.148:0/2100881801 learned_addr learned my addr 172.21.15.148:0/2100881801 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:39.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775f7fe700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77600aa010 0x7f776014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775ffff700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 0x7f77601527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 -- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 msgr2=0x7f77601527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 0x7f77601527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 -- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77600aa010 msgr2=0x7f776014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77600aa010 0x7f776014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 -- 172.21.15.148:0/2100881801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009ae0 con 0x7f77600aa3f0 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775ffff700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 0x7f77601527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f775effd700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f775400c440 tx=0x7f7754007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400cea0 con 0x7f77600aa3f0 2023-10-24T02:01:39.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540072e0 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540056e0 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.627+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776014cd70 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.628+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760154bc0 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.629+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760154db0 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.629+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7754005a90 con 0x7f77600aa3f0 2023-10-24T02:01:39.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.629+0000 7f77477fe700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 0x7f774c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:39.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.629+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f77540797d0 con 0x7f77600aa3f0 2023-10-24T02:01:39.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.629+0000 7f775f7fe700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 0x7f774c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:39.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.630+0000 7f775f7fe700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 0x7f774c0615e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7760167830 tx=0x7f77600aa9b0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:39.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.633+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f775404aa70 con 0x7f77600aa3f0 2023-10-24T02:01:39.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.790+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f776006c6b0 con 0x7f774c05f120 2023-10-24T02:01:39.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.801+0000 7f77477fe700 1 -- 172.21.15.148:0/2100881801 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358887 (secure 0 0 0) 0x7f776006c6b0 con 0x7f774c05f120 2023-10-24T02:01:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:39.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 msgr2=0x7f774c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 0x7f774c0615e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7760167830 tx=0x7f77600aa9b0).stop 2023-10-24T02:01:39.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 msgr2=0x7f77600aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:39.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f775400c440 tx=0x7f7754007e30).stop 2023-10-24T02:01:39.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 shutdown_connections 2023-10-24T02:01:39.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77600c6710 0x7f77601527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f774c05f120 0x7f774c0615e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77600aa010 0x7f776014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 --2- 172.21.15.148:0/2100881801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77600aa3f0 0x7f77600aed70 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:39.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 >> 172.21.15.148:0/2100881801 conn(0x7f77600caf40 msgr2=0x7f77600c5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:39.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 shutdown_connections 2023-10-24T02:01:39.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:39.804+0000 7f7765c8b700 1 -- 172.21.15.148:0/2100881801 wait complete. 2023-10-24T02:01:39.810 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:01:39.816 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-24T02:01:38.308993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2449348,"kb_used_data":19332,"kb_used_omap":0,"kb_used_meta":2429952,"kb_avail":752525372,"statfs":{"total":773094113280,"available":770585980928,"internally_reserved":0,"allocated":19795968,"data_stored":10106777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2488270848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593109,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-644,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.524136"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050817+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080916+0000","last_change":"2023-10-24T02:01:35.080916+0000","last_active":"2023-10-24T02:01:35.080916+0000","last_peered":"2023-10-24T02:01:35.080916+0000","last_clean":"2023-10-24T02:01:35.080916+0000","last_became_active":"2023-10-24T02:01:35.080521+0000","last_became_peered":"2023-10-24T02:01:35.080521+0000","last_unstale":"2023-10-24T02:01:35.080916+0000","last_undegraded":"2023-10-24T02:01:35.080916+0000","last_fullsized":"2023-10-24T02:01:35.080916+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059227+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074581+0000","last_change":"2023-10-24T02:01:35.074581+0000","last_active":"2023-10-24T02:01:35.074581+0000","last_peered":"2023-10-24T02:01:35.074581+0000","last_clean":"2023-10-24T02:01:35.074581+0000","last_became_active":"2023-10-24T02:01:35.074242+0000","last_became_peered":"2023-10-24T02:01:35.074242+0000","last_unstale":"2023-10-24T02:01:35.074581+0000","last_undegraded":"2023-10-24T02:01:35.074581+0000","last_fullsized":"2023-10-24T02:01:35.074581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043065+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.075078+0000","last_change":"2023-10-24T02:01:35.075078+0000","last_active":"2023-10-24T02:01:35.075078+0000","last_peered":"2023-10-24T02:01:35.075078+0000","last_clean":"2023-10-24T02:01:35.075078+0000","last_became_active":"2023-10-24T02:01:35.074742+0000","last_became_peered":"2023-10-24T02:01:35.074742+0000","last_unstale":"2023-10-24T02:01:35.075078+0000","last_undegraded":"2023-10-24T02:01:35.075078+0000","last_fullsized":"2023-10-24T02:01:35.075078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038711+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051648+0000","last_change":"2023-10-24T02:01:35.051648+0000","last_active":"2023-10-24T02:01:35.051648+0000","last_peered":"2023-10-24T02:01:35.051648+0000","last_clean":"2023-10-24T02:01:35.051648+0000","last_became_active":"2023-10-24T02:01:35.051381+0000","last_became_peered":"2023-10-24T02:01:35.051381+0000","last_unstale":"2023-10-24T02:01:35.051648+0000","last_undegraded":"2023-10-24T02:01:35.051648+0000","last_fullsized":"2023-10-24T02:01:35.051648+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052757+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070025+0000","last_change":"2023-10-24T02:01:35.070025+0000","last_active":"2023-10-24T02:01:35.070025+0000","last_peered":"2023-10-24T02:01:35.070025+0000","last_clean":"2023-10-24T02:01:35.070025+0000","last_became_active":"2023-10-24T02:01:35.069755+0000","last_became_peered":"2023-10-24T02:01:35.069755+0000","last_unstale":"2023-10-24T02:01:35.070025+0000","last_undegraded":"2023-10-24T02:01:35.070025+0000","last_fullsized":"2023-10-24T02:01:35.070025+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057955+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057037+0000","last_change":"2023-10-24T02:01:35.057037+0000","last_active":"2023-10-24T02:01:35.057037+0000","last_peered":"2023-10-24T02:01:35.057037+0000","last_clean":"2023-10-24T02:01:35.057037+0000","last_became_active":"2023-10-24T02:01:35.056784+0000","last_became_peered":"2023-10-24T02:01:35.056784+0000","last_unstale":"2023-10-24T02:01:35.057037+0000","last_undegraded":"2023-10-24T02:01:35.057037+0000","last_fullsized":"2023-10-24T02:01:35.057037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034349+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066421+0000","last_change":"2023-10-24T02:01:35.066421+0000","last_active":"2023-10-24T02:01:35.066421+0000","last_peered":"2023-10-24T02:01:35.066421+0000","last_clean":"2023-10-24T02:01:35.066421+0000","last_became_active":"2023-10-24T02:01:35.066139+0000","last_became_peered":"2023-10-24T02:01:35.066139+0000","last_unstale":"2023-10-24T02:01:35.066421+0000","last_undegraded":"2023-10-24T02:01:35.066421+0000","last_fullsized":"2023-10-24T02:01:35.066421+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035056+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069974+0000","last_change":"2023-10-24T02:01:35.069974+0000","last_active":"2023-10-24T02:01:35.069974+0000","last_peered":"2023-10-24T02:01:35.069974+0000","last_clean":"2023-10-24T02:01:35.069974+0000","last_became_active":"2023-10-24T02:01:35.069681+0000","last_became_peered":"2023-10-24T02:01:35.069681+0000","last_unstale":"2023-10-24T02:01:35.069974+0000","last_undegraded":"2023-10-24T02:01:35.069974+0000","last_fullsized":"2023-10-24T02:01:35.069974+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034853+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067758+0000","last_change":"2023-10-24T02:01:35.067758+0000","last_active":"2023-10-24T02:01:35.067758+0000","last_peered":"2023-10-24T02:01:35.067758+0000","last_clean":"2023-10-24T02:01:35.067758+0000","last_became_active":"2023-10-24T02:01:35.067539+0000","last_became_peered":"2023-10-24T02:01:35.067539+0000","last_unstale":"2023-10-24T02:01:35.067758+0000","last_undegraded":"2023-10-24T02:01:35.067758+0000","last_fullsized":"2023-10-24T02:01:35.067758+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035326+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066613+0000","last_change":"2023-10-24T02:01:35.066613+0000","last_active":"2023-10-24T02:01:35.066613+0000","last_peered":"2023-10-24T02:01:35.066613+0000","last_clean":"2023-10-24T02:01:35.066613+0000","last_became_active":"2023-10-24T02:01:35.066302+0000","last_became_peered":"2023-10-24T02:01:35.066302+0000","last_unstale":"2023-10-24T02:01:35.066613+0000","last_undegraded":"2023-10-24T02:01:35.066613+0000","last_fullsized":"2023-10-24T02:01:35.066613+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051632+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070561+0000","last_change":"2023-10-24T02:01:35.070561+0000","last_active":"2023-10-24T02:01:35.070561+0000","last_peered":"2023-10-24T02:01:35.070561+0000","last_clean":"2023-10-24T02:01:35.070561+0000","last_became_active":"2023-10-24T02:01:35.070276+0000","last_became_peered":"2023-10-24T02:01:35.070276+0000","last_unstale":"2023-10-24T02:01:35.070561+0000","last_undegraded":"2023-10-24T02:01:35.070561+0000","last_fullsized":"2023-10-24T02:01:35.070561+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045886+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068883+0000","last_change":"2023-10-24T02:01:35.068883+0000","last_active":"2023-10-24T02:01:35.068883+0000","last_peered":"2023-10-24T02:01:35.068883+0000","last_clean":"2023-10-24T02:01:35.068883+0000","last_became_active":"2023-10-24T02:01:35.068265+0000","last_became_peered":"2023-10-24T02:01:35.068265+0000","last_unstale":"2023-10-24T02:01:35.068883+0000","last_undegraded":"2023-10-24T02:01:35.068883+0000","last_fullsized":"2023-10-24T02:01:35.068883+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057424+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063484+0000","last_change":"2023-10-24T02:01:35.063484+0000","last_active":"2023-10-24T02:01:35.063484+0000","last_peered":"2023-10-24T02:01:35.063484+0000","last_clean":"2023-10-24T02:01:35.063484+0000","last_became_active":"2023-10-24T02:01:35.062894+0000","last_became_peered":"2023-10-24T02:01:35.062894+0000","last_unstale":"2023-10-24T02:01:35.063484+0000","last_undegraded":"2023-10-24T02:01:35.063484+0000","last_fullsized":"2023-10-24T02:01:35.063484+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056442+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.068139+0000","last_change":"2023-10-24T02:01:35.068139+0000","last_active":"2023-10-24T02:01:35.068139+0000","last_peered":"2023-10-24T02:01:35.068139+0000","last_clean":"2023-10-24T02:01:35.068139+0000","last_became_active":"2023-10-24T02:01:35.067885+0000","last_became_peered":"2023-10-24T02:01:35.067885+0000","last_unstale":"2023-10-24T02:01:35.068139+0000","last_undegraded":"2023-10-24T02:01:35.068139+0000","last_fullsized":"2023-10-24T02:01:35.068139+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050267+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071046+0000","last_change":"2023-10-24T02:01:35.071046+0000","last_active":"2023-10-24T02:01:35.071046+0000","last_peered":"2023-10-24T02:01:35.071046+0000","last_clean":"2023-10-24T02:01:35.071046+0000","last_became_active":"2023-10-24T02:01:35.070470+0000","last_became_peered":"2023-10-24T02:01:35.070470+0000","last_unstale":"2023-10-24T02:01:35.071046+0000","last_undegraded":"2023-10-24T02:01:35.071046+0000","last_fullsized":"2023-10-24T02:01:35.071046+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055108+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071852+0000","last_change":"2023-10-24T02:01:35.071852+0000","last_active":"2023-10-24T02:01:35.071852+0000","last_peered":"2023-10-24T02:01:35.071852+0000","last_clean":"2023-10-24T02:01:35.071852+0000","last_became_active":"2023-10-24T02:01:35.071578+0000","last_became_peered":"2023-10-24T02:01:35.071578+0000","last_unstale":"2023-10-24T02:01:35.071852+0000","last_undegraded":"2023-10-24T02:01:35.071852+0000","last_fullsized":"2023-10-24T02:01:35.071852+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051673+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060097+0000","last_change":"2023-10-24T02:01:35.060097+0000","last_active":"2023-10-24T02:01:35.060097+0000","last_peered":"2023-10-24T02:01:35.060097+0000","last_clean":"2023-10-24T02:01:35.060097+0000","last_became_active":"2023-10-24T02:01:35.059406+0000","last_became_peered":"2023-10-24T02:01:35.059406+0000","last_unstale":"2023-10-24T02:01:35.060097+0000","last_undegraded":"2023-10-24T02:01:35.060097+0000","last_fullsized":"2023-10-24T02:01:35.060097+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.058822+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048351+0000","last_change":"2023-10-24T02:01:35.048351+0000","last_active":"2023-10-24T02:01:35.048351+0000","last_peered":"2023-10-24T02:01:35.048351+0000","last_clean":"2023-10-24T02:01:35.048351+0000","last_became_active":"2023-10-24T02:01:35.048142+0000","last_became_peered":"2023-10-24T02:01:35.048142+0000","last_unstale":"2023-10-24T02:01:35.048351+0000","last_undegraded":"2023-10-24T02:01:35.048351+0000","last_fullsized":"2023-10-24T02:01:35.048351+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053194+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063242+0000","last_change":"2023-10-24T02:01:35.063242+0000","last_active":"2023-10-24T02:01:35.063242+0000","last_peered":"2023-10-24T02:01:35.063242+0000","last_clean":"2023-10-24T02:01:35.063242+0000","last_became_active":"2023-10-24T02:01:35.062923+0000","last_became_peered":"2023-10-24T02:01:35.062923+0000","last_unstale":"2023-10-24T02:01:35.063242+0000","last_undegraded":"2023-10-24T02:01:35.063242+0000","last_fullsized":"2023-10-24T02:01:35.063242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.059768+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067615+0000","last_change":"2023-10-24T02:01:35.067615+0000","last_active":"2023-10-24T02:01:35.067615+0000","last_peered":"2023-10-24T02:01:35.067615+0000","last_clean":"2023-10-24T02:01:35.067615+0000","last_became_active":"2023-10-24T02:01:35.067351+0000","last_became_peered":"2023-10-24T02:01:35.067351+0000","last_unstale":"2023-10-24T02:01:35.067615+0000","last_undegraded":"2023-10-24T02:01:35.067615+0000","last_fullsized":"2023-10-24T02:01:35.067615+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039970+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072772+0000","last_change":"2023-10-24T02:01:35.072772+0000","last_active":"2023-10-24T02:01:35.072772+0000","last_peered":"2023-10-24T02:01:35.072772+0000","last_clean":"2023-10-24T02:01:35.072772+0000","last_became_active":"2023-10-24T02:01:35.072515+0000","last_became_peered":"2023-10-24T02:01:35.072515+0000","last_unstale":"2023-10-24T02:01:35.072772+0000","last_undegraded":"2023-10-24T02:01:35.072772+0000","last_fullsized":"2023-10-24T02:01:35.072772+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053856+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061840+0000","last_became_peered":"2023-10-24T02:01:35.061840+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.044421+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065231+0000","last_change":"2023-10-24T02:01:35.065231+0000","last_active":"2023-10-24T02:01:35.065231+0000","last_peered":"2023-10-24T02:01:35.065231+0000","last_clean":"2023-10-24T02:01:35.065231+0000","last_became_active":"2023-10-24T02:01:35.064941+0000","last_became_peered":"2023-10-24T02:01:35.064941+0000","last_unstale":"2023-10-24T02:01:35.065231+0000","last_undegraded":"2023-10-24T02:01:35.065231+0000","last_fullsized":"2023-10-24T02:01:35.065231+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039279+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069087+0000","last_change":"2023-10-24T02:01:35.069087+0000","last_active":"2023-10-24T02:01:35.069087+0000","last_peered":"2023-10-24T02:01:35.069087+0000","last_clean":"2023-10-24T02:01:35.069087+0000","last_became_active":"2023-10-24T02:01:35.066064+0000","last_became_peered":"2023-10-24T02:01:35.066064+0000","last_unstale":"2023-10-24T02:01:35.069087+0000","last_undegraded":"2023-10-24T02:01:35.069087+0000","last_fullsized":"2023-10-24T02:01:35.069087+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050308+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074140+0000","last_change":"2023-10-24T02:01:35.074140+0000","last_active":"2023-10-24T02:01:35.074140+0000","last_peered":"2023-10-24T02:01:35.074140+0000","last_clean":"2023-10-24T02:01:35.074140+0000","last_became_active":"2023-10-24T02:01:35.073879+0000","last_became_peered":"2023-10-24T02:01:35.073879+0000","last_unstale":"2023-10-24T02:01:35.074140+0000","last_undegraded":"2023-10-24T02:01:35.074140+0000","last_fullsized":"2023-10-24T02:01:35.074140+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042266+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056668+0000","last_change":"2023-10-24T02:01:35.056668+0000","last_active":"2023-10-24T02:01:35.056668+0000","last_peered":"2023-10-24T02:01:35.056668+0000","last_clean":"2023-10-24T02:01:35.056668+0000","last_became_active":"2023-10-24T02:01:35.056456+0000","last_became_peered":"2023-10-24T02:01:35.056456+0000","last_unstale":"2023-10-24T02:01:35.056668+0000","last_undegraded":"2023-10-24T02:01:35.056668+0000","last_fullsized":"2023-10-24T02:01:35.056668+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051238+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066552+0000","last_change":"2023-10-24T02:01:35.066552+0000","last_active":"2023-10-24T02:01:35.066552+0000","last_peered":"2023-10-24T02:01:35.066552+0000","last_clean":"2023-10-24T02:01:35.066552+0000","last_became_active":"2023-10-24T02:01:35.066026+0000","last_became_peered":"2023-10-24T02:01:35.066026+0000","last_unstale":"2023-10-24T02:01:35.066552+0000","last_undegraded":"2023-10-24T02:01:35.066552+0000","last_fullsized":"2023-10-24T02:01:35.066552+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038320+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066458+0000","last_change":"2023-10-24T02:01:35.066458+0000","last_active":"2023-10-24T02:01:35.066458+0000","last_peered":"2023-10-24T02:01:35.066458+0000","last_clean":"2023-10-24T02:01:35.066458+0000","last_became_active":"2023-10-24T02:01:35.066109+0000","last_became_peered":"2023-10-24T02:01:35.066109+0000","last_unstale":"2023-10-24T02:01:35.066458+0000","last_undegraded":"2023-10-24T02:01:35.066458+0000","last_fullsized":"2023-10-24T02:01:35.066458+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042386+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065554+0000","last_change":"2023-10-24T02:01:35.065554+0000","last_active":"2023-10-24T02:01:35.065554+0000","last_peered":"2023-10-24T02:01:35.065554+0000","last_clean":"2023-10-24T02:01:35.065554+0000","last_became_active":"2023-10-24T02:01:35.065264+0000","last_became_peered":"2023-10-24T02:01:35.065264+0000","last_unstale":"2023-10-24T02:01:35.065554+0000","last_undegraded":"2023-10-24T02:01:35.065554+0000","last_fullsized":"2023-10-24T02:01:35.065554+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.057553+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067711+0000","last_change":"2023-10-24T02:01:35.067711+0000","last_active":"2023-10-24T02:01:35.067711+0000","last_peered":"2023-10-24T02:01:35.067711+0000","last_clean":"2023-10-24T02:01:35.067711+0000","last_became_active":"2023-10-24T02:01:35.067429+0000","last_became_peered":"2023-10-24T02:01:35.067429+0000","last_unstale":"2023-10-24T02:01:35.067711+0000","last_undegraded":"2023-10-24T02:01:35.067711+0000","last_fullsized":"2023-10-24T02:01:35.067711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053241+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065740+0000","last_change":"2023-10-24T02:01:35.065740+0000","last_active":"2023-10-24T02:01:35.065740+0000","last_peered":"2023-10-24T02:01:35.065740+0000","last_clean":"2023-10-24T02:01:35.065740+0000","last_became_active":"2023-10-24T02:01:35.065413+0000","last_became_peered":"2023-10-24T02:01:35.065413+0000","last_unstale":"2023-10-24T02:01:35.065740+0000","last_undegraded":"2023-10-24T02:01:35.065740+0000","last_fullsized":"2023-10-24T02:01:35.065740+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034683+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.048085+0000","last_change":"2023-10-24T02:01:35.048085+0000","last_active":"2023-10-24T02:01:35.048085+0000","last_peered":"2023-10-24T02:01:35.048085+0000","last_clean":"2023-10-24T02:01:35.048085+0000","last_became_active":"2023-10-24T02:01:35.047789+0000","last_became_peered":"2023-10-24T02:01:35.047789+0000","last_unstale":"2023-10-24T02:01:35.048085+0000","last_undegraded":"2023-10-24T02:01:35.048085+0000","last_fullsized":"2023-10-24T02:01:35.048085+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.060595+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062733+0000","last_change":"2023-10-24T02:01:35.062733+0000","last_active":"2023-10-24T02:01:35.062733+0000","last_peered":"2023-10-24T02:01:35.062733+0000","last_clean":"2023-10-24T02:01:35.062733+0000","last_became_active":"2023-10-24T02:01:35.062388+0000","last_became_peered":"2023-10-24T02:01:35.062388+0000","last_unstale":"2023-10-24T02:01:35.062733+0000","last_undegraded":"2023-10-24T02:01:35.062733+0000","last_fullsized":"2023-10-24T02:01:35.062733+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038283+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.056643+0000","last_change":"2023-10-24T02:01:35.056643+0000","last_active":"2023-10-24T02:01:35.056643+0000","last_peered":"2023-10-24T02:01:35.056643+0000","last_clean":"2023-10-24T02:01:35.056643+0000","last_became_active":"2023-10-24T02:01:35.056224+0000","last_became_peered":"2023-10-24T02:01:35.056224+0000","last_unstale":"2023-10-24T02:01:35.056643+0000","last_undegraded":"2023-10-24T02:01:35.056643+0000","last_fullsized":"2023-10-24T02:01:35.056643+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.042654+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.072602+0000","last_change":"2023-10-24T02:01:35.072602+0000","last_active":"2023-10-24T02:01:35.072602+0000","last_peered":"2023-10-24T02:01:35.072602+0000","last_clean":"2023-10-24T02:01:35.072602+0000","last_became_active":"2023-10-24T02:01:35.072258+0000","last_became_peered":"2023-10-24T02:01:35.072258+0000","last_unstale":"2023-10-24T02:01:35.072602+0000","last_undegraded":"2023-10-24T02:01:35.072602+0000","last_fullsized":"2023-10-24T02:01:35.072602+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052528+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067842+0000","last_change":"2023-10-24T02:01:35.067842+0000","last_active":"2023-10-24T02:01:35.067842+0000","last_peered":"2023-10-24T02:01:35.067842+0000","last_clean":"2023-10-24T02:01:35.067842+0000","last_became_active":"2023-10-24T02:01:35.067481+0000","last_became_peered":"2023-10-24T02:01:35.067481+0000","last_unstale":"2023-10-24T02:01:35.067842+0000","last_undegraded":"2023-10-24T02:01:35.067842+0000","last_fullsized":"2023-10-24T02:01:35.067842+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.035644+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.051447+0000","last_change":"2023-10-24T02:01:35.051447+0000","last_active":"2023-10-24T02:01:35.051447+0000","last_peered":"2023-10-24T02:01:35.051447+0000","last_clean":"2023-10-24T02:01:35.051447+0000","last_became_active":"2023-10-24T02:01:35.050511+0000","last_became_peered":"2023-10-24T02:01:35.050511+0000","last_unstale":"2023-10-24T02:01:35.051447+0000","last_undegraded":"2023-10-24T02:01:35.051447+0000","last_fullsized":"2023-10-24T02:01:35.051447+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.046393+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.054678+0000","last_change":"2023-10-24T02:01:35.054678+0000","last_active":"2023-10-24T02:01:35.054678+0000","last_peered":"2023-10-24T02:01:35.054678+0000","last_clean":"2023-10-24T02:01:35.054678+0000","last_became_active":"2023-10-24T02:01:35.054410+0000","last_became_peered":"2023-10-24T02:01:35.054410+0000","last_unstale":"2023-10-24T02:01:35.054678+0000","last_undegraded":"2023-10-24T02:01:35.054678+0000","last_fullsized":"2023-10-24T02:01:35.054678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043975+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.057004+0000","last_change":"2023-10-24T02:01:35.057004+0000","last_active":"2023-10-24T02:01:35.057004+0000","last_peered":"2023-10-24T02:01:35.057004+0000","last_clean":"2023-10-24T02:01:35.057004+0000","last_became_active":"2023-10-24T02:01:35.056703+0000","last_became_peered":"2023-10-24T02:01:35.056703+0000","last_unstale":"2023-10-24T02:01:35.057004+0000","last_undegraded":"2023-10-24T02:01:35.057004+0000","last_fullsized":"2023-10-24T02:01:35.057004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050848+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.070176+0000","last_change":"2023-10-24T02:01:35.070176+0000","last_active":"2023-10-24T02:01:35.070176+0000","last_peered":"2023-10-24T02:01:35.070176+0000","last_clean":"2023-10-24T02:01:35.070176+0000","last_became_active":"2023-10-24T02:01:35.069790+0000","last_became_peered":"2023-10-24T02:01:35.069790+0000","last_unstale":"2023-10-24T02:01:35.070176+0000","last_undegraded":"2023-10-24T02:01:35.070176+0000","last_fullsized":"2023-10-24T02:01:35.070176+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034321+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.066486+0000","last_change":"2023-10-24T02:01:35.066486+0000","last_active":"2023-10-24T02:01:35.066486+0000","last_peered":"2023-10-24T02:01:35.066486+0000","last_clean":"2023-10-24T02:01:35.066486+0000","last_became_active":"2023-10-24T02:01:35.066230+0000","last_became_peered":"2023-10-24T02:01:35.066230+0000","last_unstale":"2023-10-24T02:01:35.066486+0000","last_undegraded":"2023-10-24T02:01:35.066486+0000","last_fullsized":"2023-10-24T02:01:35.066486+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054352+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.049824+0000","last_change":"2023-10-24T02:01:35.049824+0000","last_active":"2023-10-24T02:01:35.049824+0000","last_peered":"2023-10-24T02:01:35.049824+0000","last_clean":"2023-10-24T02:01:35.049824+0000","last_became_active":"2023-10-24T02:01:35.049440+0000","last_became_peered":"2023-10-24T02:01:35.049440+0000","last_unstale":"2023-10-24T02:01:35.049824+0000","last_undegraded":"2023-10-24T02:01:35.049824+0000","last_fullsized":"2023-10-24T02:01:35.049824+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.055578+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.069408+0000","last_change":"2023-10-24T02:01:35.069408+0000","last_active":"2023-10-24T02:01:35.069408+0000","last_peered":"2023-10-24T02:01:35.069408+0000","last_clean":"2023-10-24T02:01:35.069408+0000","last_became_active":"2023-10-24T02:01:35.069083+0000","last_became_peered":"2023-10-24T02:01:35.069083+0000","last_unstale":"2023-10-24T02:01:35.069408+0000","last_undegraded":"2023-10-24T02:01:35.069408+0000","last_fullsized":"2023-10-24T02:01:35.069408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061594+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050116+0000","last_change":"2023-10-24T02:01:35.050116+0000","last_active":"2023-10-24T02:01:35.050116+0000","last_peered":"2023-10-24T02:01:35.050116+0000","last_clean":"2023-10-24T02:01:35.050116+0000","last_became_active":"2023-10-24T02:01:35.049854+0000","last_became_peered":"2023-10-24T02:01:35.049854+0000","last_unstale":"2023-10-24T02:01:35.050116+0000","last_undegraded":"2023-10-24T02:01:35.050116+0000","last_fullsized":"2023-10-24T02:01:35.050116+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.040387+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.067595+0000","last_change":"2023-10-24T02:01:35.067595+0000","last_active":"2023-10-24T02:01:35.067595+0000","last_peered":"2023-10-24T02:01:35.067595+0000","last_clean":"2023-10-24T02:01:35.067595+0000","last_became_active":"2023-10-24T02:01:35.067318+0000","last_became_peered":"2023-10-24T02:01:35.067318+0000","last_unstale":"2023-10-24T02:01:35.067595+0000","last_undegraded":"2023-10-24T02:01:35.067595+0000","last_fullsized":"2023-10-24T02:01:35.067595+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043570+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.063179+0000","last_change":"2023-10-24T02:01:35.063179+0000","last_active":"2023-10-24T02:01:35.063179+0000","last_peered":"2023-10-24T02:01:35.063179+0000","last_clean":"2023-10-24T02:01:35.063179+0000","last_became_active":"2023-10-24T02:01:35.062905+0000","last_became_peered":"2023-10-24T02:01:35.062905+0000","last_unstale":"2023-10-24T02:01:35.063179+0000","last_undegraded":"2023-10-24T02:01:35.063179+0000","last_fullsized":"2023-10-24T02:01:35.063179+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.043243+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062125+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.062125+0000","last_peered":"2023-10-24T02:01:35.062125+0000","last_clean":"2023-10-24T02:01:35.062125+0000","last_became_active":"2023-10-24T02:01:35.061859+0000","last_became_peered":"2023-10-24T02:01:35.061859+0000","last_unstale":"2023-10-24T02:01:35.062125+0000","last_undegraded":"2023-10-24T02:01:35.062125+0000","last_fullsized":"2023-10-24T02:01:35.062125+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.051911+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.074890+0000","last_change":"2023-10-24T02:01:35.074890+0000","last_active":"2023-10-24T02:01:35.074890+0000","last_peered":"2023-10-24T02:01:35.074890+0000","last_clean":"2023-10-24T02:01:35.074890+0000","last_became_active":"2023-10-24T02:01:35.074531+0000","last_became_peered":"2023-10-24T02:01:35.074531+0000","last_unstale":"2023-10-24T02:01:35.074890+0000","last_undegraded":"2023-10-24T02:01:35.074890+0000","last_fullsized":"2023-10-24T02:01:35.074890+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054064+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065366+0000","last_change":"2023-10-24T02:01:35.065366+0000","last_active":"2023-10-24T02:01:35.065366+0000","last_peered":"2023-10-24T02:01:35.065366+0000","last_clean":"2023-10-24T02:01:35.065366+0000","last_became_active":"2023-10-24T02:01:35.065020+0000","last_became_peered":"2023-10-24T02:01:35.065020+0000","last_unstale":"2023-10-24T02:01:35.065366+0000","last_undegraded":"2023-10-24T02:01:35.065366+0000","last_fullsized":"2023-10-24T02:01:35.065366+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034982+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050315+0000","last_change":"2023-10-24T02:01:35.050315+0000","last_active":"2023-10-24T02:01:35.050315+0000","last_peered":"2023-10-24T02:01:35.050315+0000","last_clean":"2023-10-24T02:01:35.050315+0000","last_became_active":"2023-10-24T02:01:35.049685+0000","last_became_peered":"2023-10-24T02:01:35.049685+0000","last_unstale":"2023-10-24T02:01:35.050315+0000","last_undegraded":"2023-10-24T02:01:35.050315+0000","last_fullsized":"2023-10-24T02:01:35.050315+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045773+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.060505+0000","last_change":"2023-10-24T02:01:35.060505+0000","last_active":"2023-10-24T02:01:35.060505+0000","last_peered":"2023-10-24T02:01:35.060505+0000","last_clean":"2023-10-24T02:01:35.060505+0000","last_became_active":"2023-10-24T02:01:35.060288+0000","last_became_peered":"2023-10-24T02:01:35.060288+0000","last_unstale":"2023-10-24T02:01:35.060505+0000","last_undegraded":"2023-10-24T02:01:35.060505+0000","last_fullsized":"2023-10-24T02:01:35.060505+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034307+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053840+0000","last_change":"2023-10-24T02:01:35.053840+0000","last_active":"2023-10-24T02:01:35.053840+0000","last_peered":"2023-10-24T02:01:35.053840+0000","last_clean":"2023-10-24T02:01:35.053840+0000","last_became_active":"2023-10-24T02:01:35.053577+0000","last_became_peered":"2023-10-24T02:01:35.053577+0000","last_unstale":"2023-10-24T02:01:35.053840+0000","last_undegraded":"2023-10-24T02:01:35.053840+0000","last_fullsized":"2023-10-24T02:01:35.053840+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.056043+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062771+0000","last_change":"2023-10-24T02:01:35.062771+0000","last_active":"2023-10-24T02:01:35.062771+0000","last_peered":"2023-10-24T02:01:35.062771+0000","last_clean":"2023-10-24T02:01:35.062771+0000","last_became_active":"2023-10-24T02:01:35.062245+0000","last_became_peered":"2023-10-24T02:01:35.062245+0000","last_unstale":"2023-10-24T02:01:35.062771+0000","last_undegraded":"2023-10-24T02:01:35.062771+0000","last_fullsized":"2023-10-24T02:01:35.062771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.053496+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050373+0000","last_change":"2023-10-24T02:01:35.050373+0000","last_active":"2023-10-24T02:01:35.050373+0000","last_peered":"2023-10-24T02:01:35.050373+0000","last_clean":"2023-10-24T02:01:35.050373+0000","last_became_active":"2023-10-24T02:01:35.050108+0000","last_became_peered":"2023-10-24T02:01:35.050108+0000","last_unstale":"2023-10-24T02:01:35.050373+0000","last_undegraded":"2023-10-24T02:01:35.050373+0000","last_fullsized":"2023-10-24T02:01:35.050373+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.039550+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.077262+0000","last_change":"2023-10-24T02:01:35.077262+0000","last_active":"2023-10-24T02:01:35.077262+0000","last_peered":"2023-10-24T02:01:35.077262+0000","last_clean":"2023-10-24T02:01:35.077262+0000","last_became_active":"2023-10-24T02:01:35.076871+0000","last_became_peered":"2023-10-24T02:01:35.076871+0000","last_unstale":"2023-10-24T02:01:35.077262+0000","last_undegraded":"2023-10-24T02:01:35.077262+0000","last_fullsized":"2023-10-24T02:01:35.077262+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045418+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.071577+0000","last_change":"2023-10-24T02:01:35.071577+0000","last_active":"2023-10-24T02:01:35.071577+0000","last_peered":"2023-10-24T02:01:35.071577+0000","last_clean":"2023-10-24T02:01:35.071577+0000","last_became_active":"2023-10-24T02:01:35.071242+0000","last_became_peered":"2023-10-24T02:01:35.071242+0000","last_unstale":"2023-10-24T02:01:35.071577+0000","last_undegraded":"2023-10-24T02:01:35.071577+0000","last_fullsized":"2023-10-24T02:01:35.071577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.054205+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065762+0000","last_change":"2023-10-24T02:01:35.065762+0000","last_active":"2023-10-24T02:01:35.065762+0000","last_peered":"2023-10-24T02:01:35.065762+0000","last_clean":"2023-10-24T02:01:35.065762+0000","last_became_active":"2023-10-24T02:01:35.065467+0000","last_became_peered":"2023-10-24T02:01:35.065467+0000","last_unstale":"2023-10-24T02:01:35.065762+0000","last_undegraded":"2023-10-24T02:01:35.065762+0000","last_fullsized":"2023-10-24T02:01:35.065762+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029128+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:01:34.029128+0000","last_peered":"2023-10-24T02:01:34.029128+0000","last_clean":"2023-10-24T02:01:34.029128+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:01:34.029128+0000","last_undegraded":"2023-10-24T02:01:34.029128+0000","last_fullsized":"2023-10-24T02:01:34.029128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.061505+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.047264+0000","last_change":"2023-10-24T02:01:35.047264+0000","last_active":"2023-10-24T02:01:35.047264+0000","last_peered":"2023-10-24T02:01:35.047264+0000","last_clean":"2023-10-24T02:01:35.047264+0000","last_became_active":"2023-10-24T02:01:35.047045+0000","last_became_peered":"2023-10-24T02:01:35.047045+0000","last_unstale":"2023-10-24T02:01:35.047264+0000","last_undegraded":"2023-10-24T02:01:35.047264+0000","last_fullsized":"2023-10-24T02:01:35.047264+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024727+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:01:34.024727+0000","last_peered":"2023-10-24T02:01:34.024727+0000","last_clean":"2023-10-24T02:01:34.024727+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:01:34.024727+0000","last_undegraded":"2023-10-24T02:01:34.024727+0000","last_fullsized":"2023-10-24T02:01:34.024727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.041316+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.053784+0000","last_change":"2023-10-24T02:01:35.053784+0000","last_active":"2023-10-24T02:01:35.053784+0000","last_peered":"2023-10-24T02:01:35.053784+0000","last_clean":"2023-10-24T02:01:35.053784+0000","last_became_active":"2023-10-24T02:01:35.053537+0000","last_became_peered":"2023-10-24T02:01:35.053537+0000","last_unstale":"2023-10-24T02:01:35.053784+0000","last_undegraded":"2023-10-24T02:01:35.053784+0000","last_fullsized":"2023-10-24T02:01:35.053784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.020684+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:01:34.020684+0000","last_peered":"2023-10-24T02:01:34.020684+0000","last_clean":"2023-10-24T02:01:34.020684+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:01:34.020684+0000","last_undegraded":"2023-10-24T02:01:34.020684+0000","last_fullsized":"2023-10-24T02:01:34.020684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.050783+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.050465+0000","last_change":"2023-10-24T02:01:35.050465+0000","last_active":"2023-10-24T02:01:35.050465+0000","last_peered":"2023-10-24T02:01:35.050465+0000","last_clean":"2023-10-24T02:01:35.050465+0000","last_became_active":"2023-10-24T02:01:35.050041+0000","last_became_peered":"2023-10-24T02:01:35.050041+0000","last_unstale":"2023-10-24T02:01:35.050465+0000","last_undegraded":"2023-10-24T02:01:35.050465+0000","last_fullsized":"2023-10-24T02:01:35.050465+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":158,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.024886+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:01:34.024886+0000","last_peered":"2023-10-24T02:01:34.024886+0000","last_clean":"2023-10-24T02:01:34.024886+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:01:34.024886+0000","last_undegraded":"2023-10-24T02:01:34.024886+0000","last_fullsized":"2023-10-24T02:01:34.024886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":192,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028141+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:01:34.028141+0000","last_peered":"2023-10-24T02:01:34.028141+0000","last_clean":"2023-10-24T02:01:34.028141+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:01:34.028141+0000","last_undegraded":"2023-10-24T02:01:34.028141+0000","last_fullsized":"2023-10-24T02:01:34.028141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.038885+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.062583+0000","last_change":"2023-10-24T02:01:35.062583+0000","last_active":"2023-10-24T02:01:35.062583+0000","last_peered":"2023-10-24T02:01:35.062583+0000","last_clean":"2023-10-24T02:01:35.062583+0000","last_became_active":"2023-10-24T02:01:35.062270+0000","last_became_peered":"2023-10-24T02:01:35.062270+0000","last_unstale":"2023-10-24T02:01:35.062583+0000","last_undegraded":"2023-10-24T02:01:35.062583+0000","last_fullsized":"2023-10-24T02:01:35.062583+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028231+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:01:34.028231+0000","last_peered":"2023-10-24T02:01:34.028231+0000","last_clean":"2023-10-24T02:01:34.028231+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:01:34.028231+0000","last_undegraded":"2023-10-24T02:01:34.028231+0000","last_fullsized":"2023-10-24T02:01:34.028231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.045087+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.059711+0000","last_change":"2023-10-24T02:01:35.059711+0000","last_active":"2023-10-24T02:01:35.059711+0000","last_peered":"2023-10-24T02:01:35.059711+0000","last_clean":"2023-10-24T02:01:35.059711+0000","last_became_active":"2023-10-24T02:01:35.059392+0000","last_became_peered":"2023-10-24T02:01:35.059392+0000","last_unstale":"2023-10-24T02:01:35.059711+0000","last_undegraded":"2023-10-24T02:01:35.059711+0000","last_fullsized":"2023-10-24T02:01:35.059711+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.022778+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:01:34.022778+0000","last_peered":"2023-10-24T02:01:34.022778+0000","last_clean":"2023-10-24T02:01:34.022778+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:01:34.022778+0000","last_undegraded":"2023-10-24T02:01:34.022778+0000","last_fullsized":"2023-10-24T02:01:34.022778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.052239+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.080408+0000","last_change":"2023-10-24T02:01:35.080408+0000","last_active":"2023-10-24T02:01:35.080408+0000","last_peered":"2023-10-24T02:01:35.080408+0000","last_clean":"2023-10-24T02:01:35.080408+0000","last_became_active":"2023-10-24T02:01:35.080124+0000","last_became_peered":"2023-10-24T02:01:35.080124+0000","last_unstale":"2023-10-24T02:01:35.080408+0000","last_undegraded":"2023-10-24T02:01:35.080408+0000","last_fullsized":"2023-10-24T02:01:35.080408+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.028674+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:01:34.028674+0000","last_peered":"2023-10-24T02:01:34.028674+0000","last_clean":"2023-10-24T02:01:34.028674+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:01:34.028674+0000","last_undegraded":"2023-10-24T02:01:34.028674+0000","last_fullsized":"2023-10-24T02:01:34.028674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:01:35.019239+0000","last_change":"2023-10-24T02:01:35.034388+0000","last_active":"2023-10-24T02:01:35.019239+0000","last_peered":"2023-10-24T02:01:35.019239+0000","last_clean":"2023-10-24T02:01:35.019239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:01:35.019239+0000","last_undegraded":"2023-10-24T02:01:35.019239+0000","last_fullsized":"2023-10-24T02:01:35.019239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.065227+0000","last_change":"2023-10-24T02:01:35.065227+0000","last_active":"2023-10-24T02:01:35.065227+0000","last_peered":"2023-10-24T02:01:35.065227+0000","last_clean":"2023-10-24T02:01:35.065227+0000","last_became_active":"2023-10-24T02:01:35.065007+0000","last_became_peered":"2023-10-24T02:01:35.065007+0000","last_unstale":"2023-10-24T02:01:35.065227+0000","last_undegraded":"2023-10-24T02:01:35.065227+0000","last_fullsized":"2023-10-24T02:01:35.065227+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-24T02:01:34.029393+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:01:34.029393+0000","last_peered":"2023-10-24T02:01:34.029393+0000","last_clean":"2023-10-24T02:01:34.029393+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:01:34.029393+0000","last_undegraded":"2023-10-24T02:01:34.029393+0000","last_fullsized":"2023-10-24T02:01:34.029393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543252,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.745,"15min":0.86399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.314},"max":{"1min":0.749,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.39800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.81999999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.83999999999999997},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.432},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.49099999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.032,"15min":1.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.55100000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.752,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.85699999999999998},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.86499999999999999,"15min":0.90900000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.43099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.877},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.873,"5min":0.873,"15min":1.0049999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575956,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55900000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.78700000000000003,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.48099999999999998,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.873},"last":0.67700000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.80200000000000005},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575957,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303616,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068224,"statfs":{"total":96636764160,"available":96325861376,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39800000000000002,"15min":0.39100000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55100000000000005,"5min":0.878,"15min":0.878},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.436,"15min":0.42199999999999999},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.56699999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"min":{"1min":0.28799999999999998,"5min":0.252,"15min":0.24399999999999999},"max":{"1min":0.51400000000000001,"5min":0.627,"15min":0.63200000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.30199999999999999,"5min":0.28899999999999998,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.75},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59099999999999997,"5min":0.67600000000000005,"15min":0.71599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.46700000000000003},"min":{"1min":0.34000000000000002,"5min":0.29399999999999998,"15min":0.28799999999999998},"max":{"1min":0.68100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.41199999999999998},"max":{"1min":0.75600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.502},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":0.81399999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.44700000000000001,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.82599999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.52600000000000002,"5min":0.47799999999999998,"15min":0.45600000000000002},"max":{"1min":0.78000000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575957,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":0.624,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52300000000000002,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.25700000000000001},"max":{"1min":0.52900000000000003,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.375}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.312,"15min":0.25900000000000001},"max":{"1min":0.58999999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.30199999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.52200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.97299999999999998},"last":0.44700000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.008},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47799999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.498},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":1.028},"last":0.503}]}]},{"osd":2,"up_from":14,"seq":60129543252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307700,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064140,"statfs":{"total":96636764160,"available":96321679360,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.48999999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.72899999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":0.68300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.68200000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.95199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.53100000000000003,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97299999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.875,"15min":0.99299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.024},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834575957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.186},"max":{"1min":0.51700000000000002,"5min":0.54700000000000004,"15min":0.59999999999999998},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41299999999999998,"15min":0.41899999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.22500000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.752},"last":0.55800000000000005}]},{"osd":1,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38900000000000001},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.21299999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.439,"15min":0.436},"min":{"1min":0.314,"5min":0.314,"15min":0.26100000000000001},"max":{"1min":0.56999999999999995,"5min":0.623,"15min":0.64600000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.41899999999999998},"min":{"1min":0.34200000000000003,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.65600000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.60899999999999999,"5min":0.68799999999999994,"15min":0.72799999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.42199999999999999,"15min":0.35599999999999998},"max":{"1min":0.93600000000000005,"5min":1.097,"15min":1.097},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":1.167,"15min":1.167},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.505,"5min":0.41299999999999998,"15min":0.38100000000000001},"max":{"1min":0.91100000000000003,"5min":1.034,"15min":1.056},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":0.93799999999999994,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":1.0700000000000001,"15min":1.083},"last":0.624}]},{"osd":7,"last update":"Tue Oct 24 02:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92600000000000005,"5min":1.155,"15min":1.155},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.45100000000000001,"15min":0.44700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303604,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068236,"statfs":{"total":96636764160,"available":96325873664,"internally_reserved":0,"allocated":2469888,"data_stored":1260826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.65200000000000002,"5min":0.73599999999999999,"15min":0.83799999999999997},"last":0.438},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.27200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.86099999999999999},"last":0.502}]},{"osd":1,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.80900000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.46700000000000003,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.435,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41499999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83799999999999997,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.35899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66100000000000003,"5min":0.76100000000000001,"15min":0.83599999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.379,"5min":0.316,"15min":0.316},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.874},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.74399999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 02:00:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39000000000000001},"max":{"1min":0.80300000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307712,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064128,"statfs":{"total":96636764160,"available":96321667072,"internally_reserved":0,"allocated":2482176,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.30299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.499,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.53600000000000003}]},{"osd":2,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.54200000000000004,"5min":0.41699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45900000000000002,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.501,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.27000000000000002},"max":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"max":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.98799999999999999},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:01:41.319 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:01:41.319+0000 7faf632a4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T02:01:42.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:01:42.950 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.950+0000 7efc78931700 1 Processor -- start 2023-10-24T02:01:42.951 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.950+0000 7efc78931700 1 -- start start 2023-10-24T02:01:42.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc78931700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc74154540 0x7efc740640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc78931700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc740645a0 0x7efc740a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc78931700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740a5bd0 con 0x7efc740be650 2023-10-24T02:01:42.953 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc78931700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc74064ab0 con 0x7efc74154540 2023-10-24T02:01:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc78931700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74064d90 con 0x7efc740645a0 2023-10-24T02:01:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc74154540 0x7efc740640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7efc74154540 0x7efc740640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53228/0 (socket says 172.21.15.148:53228) 2023-10-24T02:01:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 -- 172.21.15.148:0/510908708 learned_addr learned my addr 172.21.15.148:0/510908708 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:42.954 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc71d9b700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc740645a0 0x7efc740a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 -- 172.21.15.148:0/510908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc740645a0 msgr2=0x7efc740a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc740645a0 0x7efc740a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 -- 172.21.15.148:0/510908708 >> v1:172.21.15.150:6789/0 conn(0x7efc740be650 legacy=0x7efc740c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 -- 172.21.15.148:0/510908708 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74065070 con 0x7efc74154540 2023-10-24T02:01:42.955 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.951+0000 7efc7259c700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc74154540 0x7efc740640b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7efc64009810 tx=0x7efc64009060).ready entity=mon.0 client_cookie=723ad9d3a27bef0d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc7159a700 1 -- 172.21.15.148:0/510908708 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64005880 con 0x7efc74154540 2023-10-24T02:01:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc7159a700 1 -- 172.21.15.148:0/510908708 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640059e0 con 0x7efc74154540 2023-10-24T02:01:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc7159a700 1 -- 172.21.15.148:0/510908708 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64005d60 con 0x7efc74154540 2023-10-24T02:01:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 -- 172.21.15.148:0/510908708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc74154540 msgr2=0x7efc740640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:42.956 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc74154540 0x7efc740640b0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7efc64009810 tx=0x7efc64009060).stop 2023-10-24T02:01:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 -- 172.21.15.148:0/510908708 shutdown_connections 2023-10-24T02:01:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc74154540 0x7efc740640b0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 --2- 172.21.15.148:0/510908708 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc740645a0 0x7efc740a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 -- 172.21.15.148:0/510908708 >> 172.21.15.148:0/510908708 conn(0x7efc74092480 msgr2=0x7efc74062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:42.957 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 -- 172.21.15.148:0/510908708 shutdown_connections 2023-10-24T02:01:42.958 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.952+0000 7efc78931700 1 -- 172.21.15.148:0/510908708 wait complete. 2023-10-24T02:01:42.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.953+0000 7efc78931700 1 Processor -- start 2023-10-24T02:01:42.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.953+0000 7efc78931700 1 -- start start 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc740be650 0x7efc740a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc74154540 0x7efc74166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740c44a0 con 0x7efc740645a0 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740c41c0 con 0x7efc740be650 2023-10-24T02:01:42.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc78931700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740c4a90 con 0x7efc74154540 2023-10-24T02:01:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53232/0 (socket says 172.21.15.148:53232) 2023-10-24T02:01:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 -- 172.21.15.148:0/830982150 learned_addr learned my addr 172.21.15.148:0/830982150 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 -- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc74154540 msgr2=0x7efc74166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:42.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc74154540 0x7efc74166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:42.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc71d9b700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc740be650 0x7efc740a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:42.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 -- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc740be650 msgr2=0x7efc740a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:42.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.954+0000 7efc7259c700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc740be650 0x7efc740a9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:42.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc7259c700 1 -- 172.21.15.148:0/830982150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009300 con 0x7efc740645a0 2023-10-24T02:01:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc7259c700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7efc7405f5d0 tx=0x7efc64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400b850 con 0x7efc740645a0 2023-10-24T02:01:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400b9b0 con 0x7efc740645a0 2023-10-24T02:01:42.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400bd70 con 0x7efc740645a0 2023-10-24T02:01:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740c4d70 con 0x7efc740645a0 2023-10-24T02:01:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.955+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740a9af0 con 0x7efc740645a0 2023-10-24T02:01:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.956+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740c5210 con 0x7efc740645a0 2023-10-24T02:01:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.956+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efc64018070 con 0x7efc740645a0 2023-10-24T02:01:42.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.956+0000 7efc627fc700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 0x7efc54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.956+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7efc6407b2d0 con 0x7efc740645a0 2023-10-24T02:01:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.957+0000 7efc71d9b700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 0x7efc54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.957+0000 7efc71d9b700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 0x7efc54061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efc68006fd0 tx=0x7efc68008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:42.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:42.961+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efc6404c570 con 0x7efc740645a0 2023-10-24T02:01:43.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.125+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc740c53c0 con 0x7efc5405f150 2023-10-24T02:01:43.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.135+0000 7efc627fc700 1 -- 172.21.15.148:0/830982150 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361948 (secure 0 0 0) 0x7efc740c53c0 con 0x7efc5405f150 2023-10-24T02:01:43.140 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:43.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 msgr2=0x7efc54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 0x7efc54061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efc68006fd0 tx=0x7efc68008040).stop 2023-10-24T02:01:43.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 msgr2=0x7efc74164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7efc7405f5d0 tx=0x7efc64016000).stop 2023-10-24T02:01:43.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 shutdown_connections 2023-10-24T02:01:43.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc74154540 0x7efc74166ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:43.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc740645a0 0x7efc74164600 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7efc5405f150 0x7efc54061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 --2- 172.21.15.148:0/830982150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc740be650 0x7efc740a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 >> 172.21.15.148:0/830982150 conn(0x7efc74092480 msgr2=0x7efc740c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:43.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 shutdown_connections 2023-10-24T02:01:43.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.139+0000 7efc78931700 1 -- 172.21.15.148:0/830982150 wait complete. 2023-10-24T02:01:43.145 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:01:43.151 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-24T02:01:42.310001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453760,"kb_used_data":19648,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752520960,"statfs":{"total":773094113280,"available":770581463040,"internally_reserved":0,"allocated":20119552,"data_stored":10256772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-593109,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-209,"num_write_kb":-719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-644,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.524719"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432538+0000","last_change":"2023-10-24T02:01:35.424088+0000","last_active":"2023-10-24T02:01:35.432538+0000","last_peered":"2023-10-24T02:01:35.432538+0000","last_clean":"2023-10-24T02:01:35.432538+0000","last_became_active":"2023-10-24T02:01:35.423907+0000","last_became_peered":"2023-10-24T02:01:35.423907+0000","last_unstale":"2023-10-24T02:01:35.432538+0000","last_undegraded":"2023-10-24T02:01:35.432538+0000","last_fullsized":"2023-10-24T02:01:35.432538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"200'3","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.425987+0000","last_change":"2023-10-24T02:01:35.080916+0000","last_active":"2023-10-24T02:01:35.425987+0000","last_peered":"2023-10-24T02:01:35.425987+0000","last_clean":"2023-10-24T02:01:35.425987+0000","last_became_active":"2023-10-24T02:01:35.080521+0000","last_became_peered":"2023-10-24T02:01:35.080521+0000","last_unstale":"2023-10-24T02:01:35.425987+0000","last_undegraded":"2023-10-24T02:01:35.425987+0000","last_fullsized":"2023-10-24T02:01:35.425987+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432302+0000","last_change":"2023-10-24T02:01:35.427793+0000","last_active":"2023-10-24T02:01:35.432302+0000","last_peered":"2023-10-24T02:01:35.432302+0000","last_clean":"2023-10-24T02:01:35.432302+0000","last_became_active":"2023-10-24T02:01:35.427309+0000","last_became_peered":"2023-10-24T02:01:35.427309+0000","last_unstale":"2023-10-24T02:01:35.432302+0000","last_undegraded":"2023-10-24T02:01:35.432302+0000","last_fullsized":"2023-10-24T02:01:35.432302+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414151+0000","last_change":"2023-10-24T02:01:35.074581+0000","last_active":"2023-10-24T02:01:35.414151+0000","last_peered":"2023-10-24T02:01:35.414151+0000","last_clean":"2023-10-24T02:01:35.414151+0000","last_became_active":"2023-10-24T02:01:35.074242+0000","last_became_peered":"2023-10-24T02:01:35.074242+0000","last_unstale":"2023-10-24T02:01:35.414151+0000","last_undegraded":"2023-10-24T02:01:35.414151+0000","last_fullsized":"2023-10-24T02:01:35.414151+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428565+0000","last_change":"2023-10-24T02:01:35.420494+0000","last_active":"2023-10-24T02:01:35.428565+0000","last_peered":"2023-10-24T02:01:35.428565+0000","last_clean":"2023-10-24T02:01:35.428565+0000","last_became_active":"2023-10-24T02:01:35.420225+0000","last_became_peered":"2023-10-24T02:01:35.420225+0000","last_unstale":"2023-10-24T02:01:35.428565+0000","last_undegraded":"2023-10-24T02:01:35.428565+0000","last_fullsized":"2023-10-24T02:01:35.428565+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.418894+0000","last_change":"2023-10-24T02:01:35.075078+0000","last_active":"2023-10-24T02:01:35.418894+0000","last_peered":"2023-10-24T02:01:35.418894+0000","last_clean":"2023-10-24T02:01:35.418894+0000","last_became_active":"2023-10-24T02:01:35.074742+0000","last_became_peered":"2023-10-24T02:01:35.074742+0000","last_unstale":"2023-10-24T02:01:35.418894+0000","last_undegraded":"2023-10-24T02:01:35.418894+0000","last_fullsized":"2023-10-24T02:01:35.418894+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426102+0000","last_change":"2023-10-24T02:01:35.422977+0000","last_active":"2023-10-24T02:01:35.426102+0000","last_peered":"2023-10-24T02:01:35.426102+0000","last_clean":"2023-10-24T02:01:35.426102+0000","last_became_active":"2023-10-24T02:01:35.422555+0000","last_became_peered":"2023-10-24T02:01:35.422555+0000","last_unstale":"2023-10-24T02:01:35.426102+0000","last_undegraded":"2023-10-24T02:01:35.426102+0000","last_fullsized":"2023-10-24T02:01:35.426102+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"200'2","reported_seq":12,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421178+0000","last_change":"2023-10-24T02:01:35.051648+0000","last_active":"2023-10-24T02:01:35.421178+0000","last_peered":"2023-10-24T02:01:35.421178+0000","last_clean":"2023-10-24T02:01:35.421178+0000","last_became_active":"2023-10-24T02:01:35.051381+0000","last_became_peered":"2023-10-24T02:01:35.051381+0000","last_unstale":"2023-10-24T02:01:35.421178+0000","last_undegraded":"2023-10-24T02:01:35.421178+0000","last_fullsized":"2023-10-24T02:01:35.421178+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429783+0000","last_change":"2023-10-24T02:01:35.425039+0000","last_active":"2023-10-24T02:01:35.429783+0000","last_peered":"2023-10-24T02:01:35.429783+0000","last_clean":"2023-10-24T02:01:35.429783+0000","last_became_active":"2023-10-24T02:01:35.424728+0000","last_became_peered":"2023-10-24T02:01:35.424728+0000","last_unstale":"2023-10-24T02:01:35.429783+0000","last_undegraded":"2023-10-24T02:01:35.429783+0000","last_fullsized":"2023-10-24T02:01:35.429783+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.423236+0000","last_change":"2023-10-24T02:01:35.070025+0000","last_active":"2023-10-24T02:01:35.423236+0000","last_peered":"2023-10-24T02:01:35.423236+0000","last_clean":"2023-10-24T02:01:35.423236+0000","last_became_active":"2023-10-24T02:01:35.069755+0000","last_became_peered":"2023-10-24T02:01:35.069755+0000","last_unstale":"2023-10-24T02:01:35.423236+0000","last_undegraded":"2023-10-24T02:01:35.423236+0000","last_fullsized":"2023-10-24T02:01:35.423236+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.434640+0000","last_change":"2023-10-24T02:01:35.429720+0000","last_active":"2023-10-24T02:01:35.434640+0000","last_peered":"2023-10-24T02:01:35.434640+0000","last_clean":"2023-10-24T02:01:35.434640+0000","last_became_active":"2023-10-24T02:01:35.429453+0000","last_became_peered":"2023-10-24T02:01:35.429453+0000","last_unstale":"2023-10-24T02:01:35.434640+0000","last_undegraded":"2023-10-24T02:01:35.434640+0000","last_fullsized":"2023-10-24T02:01:35.434640+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.423243+0000","last_change":"2023-10-24T02:01:35.057037+0000","last_active":"2023-10-24T02:01:35.423243+0000","last_peered":"2023-10-24T02:01:35.423243+0000","last_clean":"2023-10-24T02:01:35.423243+0000","last_became_active":"2023-10-24T02:01:35.056784+0000","last_became_peered":"2023-10-24T02:01:35.056784+0000","last_unstale":"2023-10-24T02:01:35.423243+0000","last_undegraded":"2023-10-24T02:01:35.423243+0000","last_fullsized":"2023-10-24T02:01:35.423243+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428262+0000","last_change":"2023-10-24T02:01:35.425724+0000","last_active":"2023-10-24T02:01:35.428262+0000","last_peered":"2023-10-24T02:01:35.428262+0000","last_clean":"2023-10-24T02:01:35.428262+0000","last_became_active":"2023-10-24T02:01:35.425457+0000","last_became_peered":"2023-10-24T02:01:35.425457+0000","last_unstale":"2023-10-24T02:01:35.428262+0000","last_undegraded":"2023-10-24T02:01:35.428262+0000","last_fullsized":"2023-10-24T02:01:35.428262+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407048+0000","last_change":"2023-10-24T02:01:35.066421+0000","last_active":"2023-10-24T02:01:35.407048+0000","last_peered":"2023-10-24T02:01:35.407048+0000","last_clean":"2023-10-24T02:01:35.407048+0000","last_became_active":"2023-10-24T02:01:35.066139+0000","last_became_peered":"2023-10-24T02:01:35.066139+0000","last_unstale":"2023-10-24T02:01:35.407048+0000","last_undegraded":"2023-10-24T02:01:35.407048+0000","last_fullsized":"2023-10-24T02:01:35.407048+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.430240+0000","last_change":"2023-10-24T02:01:35.429043+0000","last_active":"2023-10-24T02:01:35.430240+0000","last_peered":"2023-10-24T02:01:35.430240+0000","last_clean":"2023-10-24T02:01:35.430240+0000","last_became_active":"2023-10-24T02:01:35.428087+0000","last_became_peered":"2023-10-24T02:01:35.428087+0000","last_unstale":"2023-10-24T02:01:35.430240+0000","last_undegraded":"2023-10-24T02:01:35.430240+0000","last_fullsized":"2023-10-24T02:01:35.430240+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414356+0000","last_change":"2023-10-24T02:01:35.069974+0000","last_active":"2023-10-24T02:01:35.414356+0000","last_peered":"2023-10-24T02:01:35.414356+0000","last_clean":"2023-10-24T02:01:35.414356+0000","last_became_active":"2023-10-24T02:01:35.069681+0000","last_became_peered":"2023-10-24T02:01:35.069681+0000","last_unstale":"2023-10-24T02:01:35.414356+0000","last_undegraded":"2023-10-24T02:01:35.414356+0000","last_fullsized":"2023-10-24T02:01:35.414356+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428099+0000","last_change":"2023-10-24T02:01:35.425753+0000","last_active":"2023-10-24T02:01:35.428099+0000","last_peered":"2023-10-24T02:01:35.428099+0000","last_clean":"2023-10-24T02:01:35.428099+0000","last_became_active":"2023-10-24T02:01:35.425485+0000","last_became_peered":"2023-10-24T02:01:35.425485+0000","last_unstale":"2023-10-24T02:01:35.428099+0000","last_undegraded":"2023-10-24T02:01:35.428099+0000","last_fullsized":"2023-10-24T02:01:35.428099+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414880+0000","last_change":"2023-10-24T02:01:35.067758+0000","last_active":"2023-10-24T02:01:35.414880+0000","last_peered":"2023-10-24T02:01:35.414880+0000","last_clean":"2023-10-24T02:01:35.414880+0000","last_became_active":"2023-10-24T02:01:35.067539+0000","last_became_peered":"2023-10-24T02:01:35.067539+0000","last_unstale":"2023-10-24T02:01:35.414880+0000","last_undegraded":"2023-10-24T02:01:35.414880+0000","last_fullsized":"2023-10-24T02:01:35.414880+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428381+0000","last_change":"2023-10-24T02:01:35.423810+0000","last_active":"2023-10-24T02:01:35.428381+0000","last_peered":"2023-10-24T02:01:35.428381+0000","last_clean":"2023-10-24T02:01:35.428381+0000","last_became_active":"2023-10-24T02:01:35.423518+0000","last_became_peered":"2023-10-24T02:01:35.423518+0000","last_unstale":"2023-10-24T02:01:35.428381+0000","last_undegraded":"2023-10-24T02:01:35.428381+0000","last_fullsized":"2023-10-24T02:01:35.428381+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414222+0000","last_change":"2023-10-24T02:01:35.066613+0000","last_active":"2023-10-24T02:01:35.414222+0000","last_peered":"2023-10-24T02:01:35.414222+0000","last_clean":"2023-10-24T02:01:35.414222+0000","last_became_active":"2023-10-24T02:01:35.066302+0000","last_became_peered":"2023-10-24T02:01:35.066302+0000","last_unstale":"2023-10-24T02:01:35.414222+0000","last_undegraded":"2023-10-24T02:01:35.414222+0000","last_fullsized":"2023-10-24T02:01:35.414222+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427331+0000","last_change":"2023-10-24T02:01:35.420984+0000","last_active":"2023-10-24T02:01:35.427331+0000","last_peered":"2023-10-24T02:01:35.427331+0000","last_clean":"2023-10-24T02:01:35.427331+0000","last_became_active":"2023-10-24T02:01:35.420719+0000","last_became_peered":"2023-10-24T02:01:35.420719+0000","last_unstale":"2023-10-24T02:01:35.427331+0000","last_undegraded":"2023-10-24T02:01:35.427331+0000","last_fullsized":"2023-10-24T02:01:35.427331+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414117+0000","last_change":"2023-10-24T02:01:35.070561+0000","last_active":"2023-10-24T02:01:35.414117+0000","last_peered":"2023-10-24T02:01:35.414117+0000","last_clean":"2023-10-24T02:01:35.414117+0000","last_became_active":"2023-10-24T02:01:35.070276+0000","last_became_peered":"2023-10-24T02:01:35.070276+0000","last_unstale":"2023-10-24T02:01:35.414117+0000","last_undegraded":"2023-10-24T02:01:35.414117+0000","last_fullsized":"2023-10-24T02:01:35.414117+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429739+0000","last_change":"2023-10-24T02:01:35.424516+0000","last_active":"2023-10-24T02:01:35.429739+0000","last_peered":"2023-10-24T02:01:35.429739+0000","last_clean":"2023-10-24T02:01:35.429739+0000","last_became_active":"2023-10-24T02:01:35.424252+0000","last_became_peered":"2023-10-24T02:01:35.424252+0000","last_unstale":"2023-10-24T02:01:35.429739+0000","last_undegraded":"2023-10-24T02:01:35.429739+0000","last_fullsized":"2023-10-24T02:01:35.429739+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"200'4","reported_seq":14,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.435037+0000","last_change":"2023-10-24T02:01:35.068883+0000","last_active":"2023-10-24T02:01:35.435037+0000","last_peered":"2023-10-24T02:01:35.435037+0000","last_clean":"2023-10-24T02:01:35.435037+0000","last_became_active":"2023-10-24T02:01:35.068265+0000","last_became_peered":"2023-10-24T02:01:35.068265+0000","last_unstale":"2023-10-24T02:01:35.435037+0000","last_undegraded":"2023-10-24T02:01:35.435037+0000","last_fullsized":"2023-10-24T02:01:35.435037+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.431064+0000","last_change":"2023-10-24T02:01:35.424022+0000","last_active":"2023-10-24T02:01:35.431064+0000","last_peered":"2023-10-24T02:01:35.431064+0000","last_clean":"2023-10-24T02:01:35.431064+0000","last_became_active":"2023-10-24T02:01:35.423771+0000","last_became_peered":"2023-10-24T02:01:35.423771+0000","last_unstale":"2023-10-24T02:01:35.431064+0000","last_undegraded":"2023-10-24T02:01:35.431064+0000","last_fullsized":"2023-10-24T02:01:35.431064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426388+0000","last_change":"2023-10-24T02:01:35.063484+0000","last_active":"2023-10-24T02:01:35.426388+0000","last_peered":"2023-10-24T02:01:35.426388+0000","last_clean":"2023-10-24T02:01:35.426388+0000","last_became_active":"2023-10-24T02:01:35.062894+0000","last_became_peered":"2023-10-24T02:01:35.062894+0000","last_unstale":"2023-10-24T02:01:35.426388+0000","last_undegraded":"2023-10-24T02:01:35.426388+0000","last_fullsized":"2023-10-24T02:01:35.426388+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424239+0000","last_change":"2023-10-24T02:01:35.418994+0000","last_active":"2023-10-24T02:01:35.424239+0000","last_peered":"2023-10-24T02:01:35.424239+0000","last_clean":"2023-10-24T02:01:35.424239+0000","last_became_active":"2023-10-24T02:01:35.418664+0000","last_became_peered":"2023-10-24T02:01:35.418664+0000","last_unstale":"2023-10-24T02:01:35.424239+0000","last_undegraded":"2023-10-24T02:01:35.424239+0000","last_fullsized":"2023-10-24T02:01:35.424239+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414579+0000","last_change":"2023-10-24T02:01:35.068139+0000","last_active":"2023-10-24T02:01:35.414579+0000","last_peered":"2023-10-24T02:01:35.414579+0000","last_clean":"2023-10-24T02:01:35.414579+0000","last_became_active":"2023-10-24T02:01:35.067885+0000","last_became_peered":"2023-10-24T02:01:35.067885+0000","last_unstale":"2023-10-24T02:01:35.414579+0000","last_undegraded":"2023-10-24T02:01:35.414579+0000","last_fullsized":"2023-10-24T02:01:35.414579+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432505+0000","last_change":"2023-10-24T02:01:35.428748+0000","last_active":"2023-10-24T02:01:35.432505+0000","last_peered":"2023-10-24T02:01:35.432505+0000","last_clean":"2023-10-24T02:01:35.432505+0000","last_became_active":"2023-10-24T02:01:35.428462+0000","last_became_peered":"2023-10-24T02:01:35.428462+0000","last_unstale":"2023-10-24T02:01:35.432505+0000","last_undegraded":"2023-10-24T02:01:35.432505+0000","last_fullsized":"2023-10-24T02:01:35.432505+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407265+0000","last_change":"2023-10-24T02:01:35.071046+0000","last_active":"2023-10-24T02:01:35.407265+0000","last_peered":"2023-10-24T02:01:35.407265+0000","last_clean":"2023-10-24T02:01:35.407265+0000","last_became_active":"2023-10-24T02:01:35.070470+0000","last_became_peered":"2023-10-24T02:01:35.070470+0000","last_unstale":"2023-10-24T02:01:35.407265+0000","last_undegraded":"2023-10-24T02:01:35.407265+0000","last_fullsized":"2023-10-24T02:01:35.407265+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432368+0000","last_change":"2023-10-24T02:01:35.427431+0000","last_active":"2023-10-24T02:01:35.432368+0000","last_peered":"2023-10-24T02:01:35.432368+0000","last_clean":"2023-10-24T02:01:35.432368+0000","last_became_active":"2023-10-24T02:01:35.426951+0000","last_became_peered":"2023-10-24T02:01:35.426951+0000","last_unstale":"2023-10-24T02:01:35.432368+0000","last_undegraded":"2023-10-24T02:01:35.432368+0000","last_fullsized":"2023-10-24T02:01:35.432368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"200'4","reported_seq":14,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432230+0000","last_change":"2023-10-24T02:01:35.071852+0000","last_active":"2023-10-24T02:01:35.432230+0000","last_peered":"2023-10-24T02:01:35.432230+0000","last_clean":"2023-10-24T02:01:35.432230+0000","last_became_active":"2023-10-24T02:01:35.071578+0000","last_became_peered":"2023-10-24T02:01:35.071578+0000","last_unstale":"2023-10-24T02:01:35.432230+0000","last_undegraded":"2023-10-24T02:01:35.432230+0000","last_fullsized":"2023-10-24T02:01:35.432230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429756+0000","last_change":"2023-10-24T02:01:35.425838+0000","last_active":"2023-10-24T02:01:35.429756+0000","last_peered":"2023-10-24T02:01:35.429756+0000","last_clean":"2023-10-24T02:01:35.429756+0000","last_became_active":"2023-10-24T02:01:35.425522+0000","last_became_peered":"2023-10-24T02:01:35.425522+0000","last_unstale":"2023-10-24T02:01:35.429756+0000","last_undegraded":"2023-10-24T02:01:35.429756+0000","last_fullsized":"2023-10-24T02:01:35.429756+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407887+0000","last_change":"2023-10-24T02:01:35.060097+0000","last_active":"2023-10-24T02:01:35.407887+0000","last_peered":"2023-10-24T02:01:35.407887+0000","last_clean":"2023-10-24T02:01:35.407887+0000","last_became_active":"2023-10-24T02:01:35.059406+0000","last_became_peered":"2023-10-24T02:01:35.059406+0000","last_unstale":"2023-10-24T02:01:35.407887+0000","last_undegraded":"2023-10-24T02:01:35.407887+0000","last_fullsized":"2023-10-24T02:01:35.407887+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432281+0000","last_change":"2023-10-24T02:01:35.427616+0000","last_active":"2023-10-24T02:01:35.432281+0000","last_peered":"2023-10-24T02:01:35.432281+0000","last_clean":"2023-10-24T02:01:35.432281+0000","last_became_active":"2023-10-24T02:01:35.427023+0000","last_became_peered":"2023-10-24T02:01:35.427023+0000","last_unstale":"2023-10-24T02:01:35.432281+0000","last_undegraded":"2023-10-24T02:01:35.432281+0000","last_fullsized":"2023-10-24T02:01:35.432281+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408524+0000","last_change":"2023-10-24T02:01:35.048351+0000","last_active":"2023-10-24T02:01:35.408524+0000","last_peered":"2023-10-24T02:01:35.408524+0000","last_clean":"2023-10-24T02:01:35.408524+0000","last_became_active":"2023-10-24T02:01:35.048142+0000","last_became_peered":"2023-10-24T02:01:35.048142+0000","last_unstale":"2023-10-24T02:01:35.408524+0000","last_undegraded":"2023-10-24T02:01:35.408524+0000","last_fullsized":"2023-10-24T02:01:35.408524+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.423006+0000","last_change":"2023-10-24T02:01:35.420334+0000","last_active":"2023-10-24T02:01:35.423006+0000","last_peered":"2023-10-24T02:01:35.423006+0000","last_clean":"2023-10-24T02:01:35.423006+0000","last_became_active":"2023-10-24T02:01:35.420051+0000","last_became_peered":"2023-10-24T02:01:35.420051+0000","last_unstale":"2023-10-24T02:01:35.423006+0000","last_undegraded":"2023-10-24T02:01:35.423006+0000","last_fullsized":"2023-10-24T02:01:35.423006+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426133+0000","last_change":"2023-10-24T02:01:35.063242+0000","last_active":"2023-10-24T02:01:35.426133+0000","last_peered":"2023-10-24T02:01:35.426133+0000","last_clean":"2023-10-24T02:01:35.426133+0000","last_became_active":"2023-10-24T02:01:35.062923+0000","last_became_peered":"2023-10-24T02:01:35.062923+0000","last_unstale":"2023-10-24T02:01:35.426133+0000","last_undegraded":"2023-10-24T02:01:35.426133+0000","last_fullsized":"2023-10-24T02:01:35.426133+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427356+0000","last_change":"2023-10-24T02:01:35.420601+0000","last_active":"2023-10-24T02:01:35.427356+0000","last_peered":"2023-10-24T02:01:35.427356+0000","last_clean":"2023-10-24T02:01:35.427356+0000","last_became_active":"2023-10-24T02:01:35.419547+0000","last_became_peered":"2023-10-24T02:01:35.419547+0000","last_unstale":"2023-10-24T02:01:35.427356+0000","last_undegraded":"2023-10-24T02:01:35.427356+0000","last_fullsized":"2023-10-24T02:01:35.427356+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414915+0000","last_change":"2023-10-24T02:01:35.067615+0000","last_active":"2023-10-24T02:01:35.414915+0000","last_peered":"2023-10-24T02:01:35.414915+0000","last_clean":"2023-10-24T02:01:35.414915+0000","last_became_active":"2023-10-24T02:01:35.067351+0000","last_became_peered":"2023-10-24T02:01:35.067351+0000","last_unstale":"2023-10-24T02:01:35.414915+0000","last_undegraded":"2023-10-24T02:01:35.414915+0000","last_fullsized":"2023-10-24T02:01:35.414915+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421915+0000","last_change":"2023-10-24T02:01:35.417741+0000","last_active":"2023-10-24T02:01:35.421915+0000","last_peered":"2023-10-24T02:01:35.421915+0000","last_clean":"2023-10-24T02:01:35.421915+0000","last_became_active":"2023-10-24T02:01:35.417149+0000","last_became_peered":"2023-10-24T02:01:35.417149+0000","last_unstale":"2023-10-24T02:01:35.421915+0000","last_undegraded":"2023-10-24T02:01:35.421915+0000","last_fullsized":"2023-10-24T02:01:35.421915+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426910+0000","last_change":"2023-10-24T02:01:35.072772+0000","last_active":"2023-10-24T02:01:35.426910+0000","last_peered":"2023-10-24T02:01:35.426910+0000","last_clean":"2023-10-24T02:01:35.426910+0000","last_became_active":"2023-10-24T02:01:35.072515+0000","last_became_peered":"2023-10-24T02:01:35.072515+0000","last_unstale":"2023-10-24T02:01:35.426910+0000","last_undegraded":"2023-10-24T02:01:35.426910+0000","last_fullsized":"2023-10-24T02:01:35.426910+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426578+0000","last_change":"2023-10-24T02:01:35.418872+0000","last_active":"2023-10-24T02:01:35.426578+0000","last_peered":"2023-10-24T02:01:35.426578+0000","last_clean":"2023-10-24T02:01:35.426578+0000","last_became_active":"2023-10-24T02:01:35.418558+0000","last_became_peered":"2023-10-24T02:01:35.418558+0000","last_unstale":"2023-10-24T02:01:35.426578+0000","last_undegraded":"2023-10-24T02:01:35.426578+0000","last_fullsized":"2023-10-24T02:01:35.426578+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.415004+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.415004+0000","last_peered":"2023-10-24T02:01:35.415004+0000","last_clean":"2023-10-24T02:01:35.415004+0000","last_became_active":"2023-10-24T02:01:35.061840+0000","last_became_peered":"2023-10-24T02:01:35.061840+0000","last_unstale":"2023-10-24T02:01:35.415004+0000","last_undegraded":"2023-10-24T02:01:35.415004+0000","last_fullsized":"2023-10-24T02:01:35.415004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427895+0000","last_change":"2023-10-24T02:01:35.426445+0000","last_active":"2023-10-24T02:01:35.427895+0000","last_peered":"2023-10-24T02:01:35.427895+0000","last_clean":"2023-10-24T02:01:35.427895+0000","last_became_active":"2023-10-24T02:01:35.426167+0000","last_became_peered":"2023-10-24T02:01:35.426167+0000","last_unstale":"2023-10-24T02:01:35.427895+0000","last_undegraded":"2023-10-24T02:01:35.427895+0000","last_fullsized":"2023-10-24T02:01:35.427895+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.405401+0000","last_change":"2023-10-24T02:01:35.065231+0000","last_active":"2023-10-24T02:01:35.405401+0000","last_peered":"2023-10-24T02:01:35.405401+0000","last_clean":"2023-10-24T02:01:35.405401+0000","last_became_active":"2023-10-24T02:01:35.064941+0000","last_became_peered":"2023-10-24T02:01:35.064941+0000","last_unstale":"2023-10-24T02:01:35.405401+0000","last_undegraded":"2023-10-24T02:01:35.405401+0000","last_fullsized":"2023-10-24T02:01:35.405401+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.430082+0000","last_change":"2023-10-24T02:01:35.427684+0000","last_active":"2023-10-24T02:01:35.430082+0000","last_peered":"2023-10-24T02:01:35.430082+0000","last_clean":"2023-10-24T02:01:35.430082+0000","last_became_active":"2023-10-24T02:01:35.427426+0000","last_became_peered":"2023-10-24T02:01:35.427426+0000","last_unstale":"2023-10-24T02:01:35.430082+0000","last_undegraded":"2023-10-24T02:01:35.430082+0000","last_fullsized":"2023-10-24T02:01:35.430082+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414452+0000","last_change":"2023-10-24T02:01:35.069087+0000","last_active":"2023-10-24T02:01:35.414452+0000","last_peered":"2023-10-24T02:01:35.414452+0000","last_clean":"2023-10-24T02:01:35.414452+0000","last_became_active":"2023-10-24T02:01:35.066064+0000","last_became_peered":"2023-10-24T02:01:35.066064+0000","last_unstale":"2023-10-24T02:01:35.414452+0000","last_undegraded":"2023-10-24T02:01:35.414452+0000","last_fullsized":"2023-10-24T02:01:35.414452+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432557+0000","last_change":"2023-10-24T02:01:35.425927+0000","last_active":"2023-10-24T02:01:35.432557+0000","last_peered":"2023-10-24T02:01:35.432557+0000","last_clean":"2023-10-24T02:01:35.432557+0000","last_became_active":"2023-10-24T02:01:35.424815+0000","last_became_peered":"2023-10-24T02:01:35.424815+0000","last_unstale":"2023-10-24T02:01:35.432557+0000","last_undegraded":"2023-10-24T02:01:35.432557+0000","last_fullsized":"2023-10-24T02:01:35.432557+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.419096+0000","last_change":"2023-10-24T02:01:35.074140+0000","last_active":"2023-10-24T02:01:35.419096+0000","last_peered":"2023-10-24T02:01:35.419096+0000","last_clean":"2023-10-24T02:01:35.419096+0000","last_became_active":"2023-10-24T02:01:35.073879+0000","last_became_peered":"2023-10-24T02:01:35.073879+0000","last_unstale":"2023-10-24T02:01:35.419096+0000","last_undegraded":"2023-10-24T02:01:35.419096+0000","last_fullsized":"2023-10-24T02:01:35.419096+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427129+0000","last_change":"2023-10-24T02:01:35.421170+0000","last_active":"2023-10-24T02:01:35.427129+0000","last_peered":"2023-10-24T02:01:35.427129+0000","last_clean":"2023-10-24T02:01:35.427129+0000","last_became_active":"2023-10-24T02:01:35.420907+0000","last_became_peered":"2023-10-24T02:01:35.420907+0000","last_unstale":"2023-10-24T02:01:35.427129+0000","last_undegraded":"2023-10-24T02:01:35.427129+0000","last_fullsized":"2023-10-24T02:01:35.427129+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408580+0000","last_change":"2023-10-24T02:01:35.056668+0000","last_active":"2023-10-24T02:01:35.408580+0000","last_peered":"2023-10-24T02:01:35.408580+0000","last_clean":"2023-10-24T02:01:35.408580+0000","last_became_active":"2023-10-24T02:01:35.056456+0000","last_became_peered":"2023-10-24T02:01:35.056456+0000","last_unstale":"2023-10-24T02:01:35.408580+0000","last_undegraded":"2023-10-24T02:01:35.408580+0000","last_fullsized":"2023-10-24T02:01:35.408580+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421956+0000","last_change":"2023-10-24T02:01:35.413208+0000","last_active":"2023-10-24T02:01:35.421956+0000","last_peered":"2023-10-24T02:01:35.421956+0000","last_clean":"2023-10-24T02:01:35.421956+0000","last_became_active":"2023-10-24T02:01:35.412932+0000","last_became_peered":"2023-10-24T02:01:35.412932+0000","last_unstale":"2023-10-24T02:01:35.421956+0000","last_undegraded":"2023-10-24T02:01:35.421956+0000","last_fullsized":"2023-10-24T02:01:35.421956+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.419717+0000","last_change":"2023-10-24T02:01:35.066552+0000","last_active":"2023-10-24T02:01:35.419717+0000","last_peered":"2023-10-24T02:01:35.419717+0000","last_clean":"2023-10-24T02:01:35.419717+0000","last_became_active":"2023-10-24T02:01:35.066026+0000","last_became_peered":"2023-10-24T02:01:35.066026+0000","last_unstale":"2023-10-24T02:01:35.419717+0000","last_undegraded":"2023-10-24T02:01:35.419717+0000","last_fullsized":"2023-10-24T02:01:35.419717+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421818+0000","last_change":"2023-10-24T02:01:35.417841+0000","last_active":"2023-10-24T02:01:35.421818+0000","last_peered":"2023-10-24T02:01:35.421818+0000","last_clean":"2023-10-24T02:01:35.421818+0000","last_became_active":"2023-10-24T02:01:35.417581+0000","last_became_peered":"2023-10-24T02:01:35.417581+0000","last_unstale":"2023-10-24T02:01:35.421818+0000","last_undegraded":"2023-10-24T02:01:35.421818+0000","last_fullsized":"2023-10-24T02:01:35.421818+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.411953+0000","last_change":"2023-10-24T02:01:35.066458+0000","last_active":"2023-10-24T02:01:35.411953+0000","last_peered":"2023-10-24T02:01:35.411953+0000","last_clean":"2023-10-24T02:01:35.411953+0000","last_became_active":"2023-10-24T02:01:35.066109+0000","last_became_peered":"2023-10-24T02:01:35.066109+0000","last_unstale":"2023-10-24T02:01:35.411953+0000","last_undegraded":"2023-10-24T02:01:35.411953+0000","last_fullsized":"2023-10-24T02:01:35.411953+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.418217+0000","last_change":"2023-10-24T02:01:35.415191+0000","last_active":"2023-10-24T02:01:35.418217+0000","last_peered":"2023-10-24T02:01:35.418217+0000","last_clean":"2023-10-24T02:01:35.418217+0000","last_became_active":"2023-10-24T02:01:35.414914+0000","last_became_peered":"2023-10-24T02:01:35.414914+0000","last_unstale":"2023-10-24T02:01:35.418217+0000","last_undegraded":"2023-10-24T02:01:35.418217+0000","last_fullsized":"2023-10-24T02:01:35.418217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.415705+0000","last_change":"2023-10-24T02:01:35.065554+0000","last_active":"2023-10-24T02:01:35.415705+0000","last_peered":"2023-10-24T02:01:35.415705+0000","last_clean":"2023-10-24T02:01:35.415705+0000","last_became_active":"2023-10-24T02:01:35.065264+0000","last_became_peered":"2023-10-24T02:01:35.065264+0000","last_unstale":"2023-10-24T02:01:35.415705+0000","last_undegraded":"2023-10-24T02:01:35.415705+0000","last_fullsized":"2023-10-24T02:01:35.415705+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.430735+0000","last_change":"2023-10-24T02:01:35.426930+0000","last_active":"2023-10-24T02:01:35.430735+0000","last_peered":"2023-10-24T02:01:35.430735+0000","last_clean":"2023-10-24T02:01:35.430735+0000","last_became_active":"2023-10-24T02:01:35.426599+0000","last_became_peered":"2023-10-24T02:01:35.426599+0000","last_unstale":"2023-10-24T02:01:35.430735+0000","last_undegraded":"2023-10-24T02:01:35.430735+0000","last_fullsized":"2023-10-24T02:01:35.430735+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.416725+0000","last_change":"2023-10-24T02:01:35.067711+0000","last_active":"2023-10-24T02:01:35.416725+0000","last_peered":"2023-10-24T02:01:35.416725+0000","last_clean":"2023-10-24T02:01:35.416725+0000","last_became_active":"2023-10-24T02:01:35.067429+0000","last_became_peered":"2023-10-24T02:01:35.067429+0000","last_unstale":"2023-10-24T02:01:35.416725+0000","last_undegraded":"2023-10-24T02:01:35.416725+0000","last_fullsized":"2023-10-24T02:01:35.416725+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426613+0000","last_change":"2023-10-24T02:01:35.422751+0000","last_active":"2023-10-24T02:01:35.426613+0000","last_peered":"2023-10-24T02:01:35.426613+0000","last_clean":"2023-10-24T02:01:35.426613+0000","last_became_active":"2023-10-24T02:01:35.422497+0000","last_became_peered":"2023-10-24T02:01:35.422497+0000","last_unstale":"2023-10-24T02:01:35.426613+0000","last_undegraded":"2023-10-24T02:01:35.426613+0000","last_fullsized":"2023-10-24T02:01:35.426613+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.417583+0000","last_change":"2023-10-24T02:01:35.065740+0000","last_active":"2023-10-24T02:01:35.417583+0000","last_peered":"2023-10-24T02:01:35.417583+0000","last_clean":"2023-10-24T02:01:35.417583+0000","last_became_active":"2023-10-24T02:01:35.065413+0000","last_became_peered":"2023-10-24T02:01:35.065413+0000","last_unstale":"2023-10-24T02:01:35.417583+0000","last_undegraded":"2023-10-24T02:01:35.417583+0000","last_fullsized":"2023-10-24T02:01:35.417583+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429901+0000","last_change":"2023-10-24T02:01:35.428676+0000","last_active":"2023-10-24T02:01:35.429901+0000","last_peered":"2023-10-24T02:01:35.429901+0000","last_clean":"2023-10-24T02:01:35.429901+0000","last_became_active":"2023-10-24T02:01:35.428421+0000","last_became_peered":"2023-10-24T02:01:35.428421+0000","last_unstale":"2023-10-24T02:01:35.429901+0000","last_undegraded":"2023-10-24T02:01:35.429901+0000","last_fullsized":"2023-10-24T02:01:35.429901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.410277+0000","last_change":"2023-10-24T02:01:35.048085+0000","last_active":"2023-10-24T02:01:35.410277+0000","last_peered":"2023-10-24T02:01:35.410277+0000","last_clean":"2023-10-24T02:01:35.410277+0000","last_became_active":"2023-10-24T02:01:35.047789+0000","last_became_peered":"2023-10-24T02:01:35.047789+0000","last_unstale":"2023-10-24T02:01:35.410277+0000","last_undegraded":"2023-10-24T02:01:35.410277+0000","last_fullsized":"2023-10-24T02:01:35.410277+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427376+0000","last_change":"2023-10-24T02:01:35.420209+0000","last_active":"2023-10-24T02:01:35.427376+0000","last_peered":"2023-10-24T02:01:35.427376+0000","last_clean":"2023-10-24T02:01:35.427376+0000","last_became_active":"2023-10-24T02:01:35.420002+0000","last_became_peered":"2023-10-24T02:01:35.420002+0000","last_unstale":"2023-10-24T02:01:35.427376+0000","last_undegraded":"2023-10-24T02:01:35.427376+0000","last_fullsized":"2023-10-24T02:01:35.427376+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427262+0000","last_change":"2023-10-24T02:01:35.062733+0000","last_active":"2023-10-24T02:01:35.427262+0000","last_peered":"2023-10-24T02:01:35.427262+0000","last_clean":"2023-10-24T02:01:35.427262+0000","last_became_active":"2023-10-24T02:01:35.062388+0000","last_became_peered":"2023-10-24T02:01:35.062388+0000","last_unstale":"2023-10-24T02:01:35.427262+0000","last_undegraded":"2023-10-24T02:01:35.427262+0000","last_fullsized":"2023-10-24T02:01:35.427262+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424998+0000","last_change":"2023-10-24T02:01:35.421432+0000","last_active":"2023-10-24T02:01:35.424998+0000","last_peered":"2023-10-24T02:01:35.424998+0000","last_clean":"2023-10-24T02:01:35.424998+0000","last_became_active":"2023-10-24T02:01:35.421165+0000","last_became_peered":"2023-10-24T02:01:35.421165+0000","last_unstale":"2023-10-24T02:01:35.424998+0000","last_undegraded":"2023-10-24T02:01:35.424998+0000","last_fullsized":"2023-10-24T02:01:35.424998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421708+0000","last_change":"2023-10-24T02:01:35.056643+0000","last_active":"2023-10-24T02:01:35.421708+0000","last_peered":"2023-10-24T02:01:35.421708+0000","last_clean":"2023-10-24T02:01:35.421708+0000","last_became_active":"2023-10-24T02:01:35.056224+0000","last_became_peered":"2023-10-24T02:01:35.056224+0000","last_unstale":"2023-10-24T02:01:35.421708+0000","last_undegraded":"2023-10-24T02:01:35.421708+0000","last_fullsized":"2023-10-24T02:01:35.421708+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428553+0000","last_change":"2023-10-24T02:01:35.420234+0000","last_active":"2023-10-24T02:01:35.428553+0000","last_peered":"2023-10-24T02:01:35.428553+0000","last_clean":"2023-10-24T02:01:35.428553+0000","last_became_active":"2023-10-24T02:01:35.419902+0000","last_became_peered":"2023-10-24T02:01:35.419902+0000","last_unstale":"2023-10-24T02:01:35.428553+0000","last_undegraded":"2023-10-24T02:01:35.428553+0000","last_fullsized":"2023-10-24T02:01:35.428553+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"200'2","reported_seq":12,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427822+0000","last_change":"2023-10-24T02:01:35.072602+0000","last_active":"2023-10-24T02:01:35.427822+0000","last_peered":"2023-10-24T02:01:35.427822+0000","last_clean":"2023-10-24T02:01:35.427822+0000","last_became_active":"2023-10-24T02:01:35.072258+0000","last_became_peered":"2023-10-24T02:01:35.072258+0000","last_unstale":"2023-10-24T02:01:35.427822+0000","last_undegraded":"2023-10-24T02:01:35.427822+0000","last_fullsized":"2023-10-24T02:01:35.427822+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429545+0000","last_change":"2023-10-24T02:01:35.421678+0000","last_active":"2023-10-24T02:01:35.429545+0000","last_peered":"2023-10-24T02:01:35.429545+0000","last_clean":"2023-10-24T02:01:35.429545+0000","last_became_active":"2023-10-24T02:01:35.420485+0000","last_became_peered":"2023-10-24T02:01:35.420485+0000","last_unstale":"2023-10-24T02:01:35.429545+0000","last_undegraded":"2023-10-24T02:01:35.429545+0000","last_fullsized":"2023-10-24T02:01:35.429545+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.405905+0000","last_change":"2023-10-24T02:01:35.067842+0000","last_active":"2023-10-24T02:01:35.405905+0000","last_peered":"2023-10-24T02:01:35.405905+0000","last_clean":"2023-10-24T02:01:35.405905+0000","last_became_active":"2023-10-24T02:01:35.067481+0000","last_became_peered":"2023-10-24T02:01:35.067481+0000","last_unstale":"2023-10-24T02:01:35.405905+0000","last_undegraded":"2023-10-24T02:01:35.405905+0000","last_fullsized":"2023-10-24T02:01:35.405905+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428082+0000","last_change":"2023-10-24T02:01:35.425807+0000","last_active":"2023-10-24T02:01:35.428082+0000","last_peered":"2023-10-24T02:01:35.428082+0000","last_clean":"2023-10-24T02:01:35.428082+0000","last_became_active":"2023-10-24T02:01:35.425537+0000","last_became_peered":"2023-10-24T02:01:35.425537+0000","last_unstale":"2023-10-24T02:01:35.428082+0000","last_undegraded":"2023-10-24T02:01:35.428082+0000","last_fullsized":"2023-10-24T02:01:35.428082+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.411759+0000","last_change":"2023-10-24T02:01:35.051447+0000","last_active":"2023-10-24T02:01:35.411759+0000","last_peered":"2023-10-24T02:01:35.411759+0000","last_clean":"2023-10-24T02:01:35.411759+0000","last_became_active":"2023-10-24T02:01:35.050511+0000","last_became_peered":"2023-10-24T02:01:35.050511+0000","last_unstale":"2023-10-24T02:01:35.411759+0000","last_undegraded":"2023-10-24T02:01:35.411759+0000","last_fullsized":"2023-10-24T02:01:35.411759+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426944+0000","last_change":"2023-10-24T02:01:35.418202+0000","last_active":"2023-10-24T02:01:35.426944+0000","last_peered":"2023-10-24T02:01:35.426944+0000","last_clean":"2023-10-24T02:01:35.426944+0000","last_became_active":"2023-10-24T02:01:35.417924+0000","last_became_peered":"2023-10-24T02:01:35.417924+0000","last_unstale":"2023-10-24T02:01:35.426944+0000","last_undegraded":"2023-10-24T02:01:35.426944+0000","last_fullsized":"2023-10-24T02:01:35.426944+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.409808+0000","last_change":"2023-10-24T02:01:35.054678+0000","last_active":"2023-10-24T02:01:35.409808+0000","last_peered":"2023-10-24T02:01:35.409808+0000","last_clean":"2023-10-24T02:01:35.409808+0000","last_became_active":"2023-10-24T02:01:35.054410+0000","last_became_peered":"2023-10-24T02:01:35.054410+0000","last_unstale":"2023-10-24T02:01:35.409808+0000","last_undegraded":"2023-10-24T02:01:35.409808+0000","last_fullsized":"2023-10-24T02:01:35.409808+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427425+0000","last_change":"2023-10-24T02:01:35.421975+0000","last_active":"2023-10-24T02:01:35.427425+0000","last_peered":"2023-10-24T02:01:35.427425+0000","last_clean":"2023-10-24T02:01:35.427425+0000","last_became_active":"2023-10-24T02:01:35.421477+0000","last_became_peered":"2023-10-24T02:01:35.421477+0000","last_unstale":"2023-10-24T02:01:35.427425+0000","last_undegraded":"2023-10-24T02:01:35.427425+0000","last_fullsized":"2023-10-24T02:01:35.427425+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.405309+0000","last_change":"2023-10-24T02:01:35.057004+0000","last_active":"2023-10-24T02:01:35.405309+0000","last_peered":"2023-10-24T02:01:35.405309+0000","last_clean":"2023-10-24T02:01:35.405309+0000","last_became_active":"2023-10-24T02:01:35.056703+0000","last_became_peered":"2023-10-24T02:01:35.056703+0000","last_unstale":"2023-10-24T02:01:35.405309+0000","last_undegraded":"2023-10-24T02:01:35.405309+0000","last_fullsized":"2023-10-24T02:01:35.405309+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.434694+0000","last_change":"2023-10-24T02:01:35.430466+0000","last_active":"2023-10-24T02:01:35.434694+0000","last_peered":"2023-10-24T02:01:35.434694+0000","last_clean":"2023-10-24T02:01:35.434694+0000","last_became_active":"2023-10-24T02:01:35.430109+0000","last_became_peered":"2023-10-24T02:01:35.430109+0000","last_unstale":"2023-10-24T02:01:35.434694+0000","last_undegraded":"2023-10-24T02:01:35.434694+0000","last_fullsized":"2023-10-24T02:01:35.434694+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.413189+0000","last_change":"2023-10-24T02:01:35.070176+0000","last_active":"2023-10-24T02:01:35.413189+0000","last_peered":"2023-10-24T02:01:35.413189+0000","last_clean":"2023-10-24T02:01:35.413189+0000","last_became_active":"2023-10-24T02:01:35.069790+0000","last_became_peered":"2023-10-24T02:01:35.069790+0000","last_unstale":"2023-10-24T02:01:35.413189+0000","last_undegraded":"2023-10-24T02:01:35.413189+0000","last_fullsized":"2023-10-24T02:01:35.413189+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424278+0000","last_change":"2023-10-24T02:01:35.420618+0000","last_active":"2023-10-24T02:01:35.424278+0000","last_peered":"2023-10-24T02:01:35.424278+0000","last_clean":"2023-10-24T02:01:35.424278+0000","last_became_active":"2023-10-24T02:01:35.420265+0000","last_became_peered":"2023-10-24T02:01:35.420265+0000","last_unstale":"2023-10-24T02:01:35.424278+0000","last_undegraded":"2023-10-24T02:01:35.424278+0000","last_fullsized":"2023-10-24T02:01:35.424278+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427834+0000","last_change":"2023-10-24T02:01:35.066486+0000","last_active":"2023-10-24T02:01:35.427834+0000","last_peered":"2023-10-24T02:01:35.427834+0000","last_clean":"2023-10-24T02:01:35.427834+0000","last_became_active":"2023-10-24T02:01:35.066230+0000","last_became_peered":"2023-10-24T02:01:35.066230+0000","last_unstale":"2023-10-24T02:01:35.427834+0000","last_undegraded":"2023-10-24T02:01:35.427834+0000","last_fullsized":"2023-10-24T02:01:35.427834+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432212+0000","last_change":"2023-10-24T02:01:35.428653+0000","last_active":"2023-10-24T02:01:35.432212+0000","last_peered":"2023-10-24T02:01:35.432212+0000","last_clean":"2023-10-24T02:01:35.432212+0000","last_became_active":"2023-10-24T02:01:35.428311+0000","last_became_peered":"2023-10-24T02:01:35.428311+0000","last_unstale":"2023-10-24T02:01:35.432212+0000","last_undegraded":"2023-10-24T02:01:35.432212+0000","last_fullsized":"2023-10-24T02:01:35.432212+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"200'2","reported_seq":12,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427159+0000","last_change":"2023-10-24T02:01:35.049824+0000","last_active":"2023-10-24T02:01:35.427159+0000","last_peered":"2023-10-24T02:01:35.427159+0000","last_clean":"2023-10-24T02:01:35.427159+0000","last_became_active":"2023-10-24T02:01:35.049440+0000","last_became_peered":"2023-10-24T02:01:35.049440+0000","last_unstale":"2023-10-24T02:01:35.427159+0000","last_undegraded":"2023-10-24T02:01:35.427159+0000","last_fullsized":"2023-10-24T02:01:35.427159+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432266+0000","last_change":"2023-10-24T02:01:35.428062+0000","last_active":"2023-10-24T02:01:35.432266+0000","last_peered":"2023-10-24T02:01:35.432266+0000","last_clean":"2023-10-24T02:01:35.432266+0000","last_became_active":"2023-10-24T02:01:35.427777+0000","last_became_peered":"2023-10-24T02:01:35.427777+0000","last_unstale":"2023-10-24T02:01:35.432266+0000","last_undegraded":"2023-10-24T02:01:35.432266+0000","last_fullsized":"2023-10-24T02:01:35.432266+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407414+0000","last_change":"2023-10-24T02:01:35.069408+0000","last_active":"2023-10-24T02:01:35.407414+0000","last_peered":"2023-10-24T02:01:35.407414+0000","last_clean":"2023-10-24T02:01:35.407414+0000","last_became_active":"2023-10-24T02:01:35.069083+0000","last_became_peered":"2023-10-24T02:01:35.069083+0000","last_unstale":"2023-10-24T02:01:35.407414+0000","last_undegraded":"2023-10-24T02:01:35.407414+0000","last_fullsized":"2023-10-24T02:01:35.407414+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.434665+0000","last_change":"2023-10-24T02:01:35.429265+0000","last_active":"2023-10-24T02:01:35.434665+0000","last_peered":"2023-10-24T02:01:35.434665+0000","last_clean":"2023-10-24T02:01:35.434665+0000","last_became_active":"2023-10-24T02:01:35.428987+0000","last_became_peered":"2023-10-24T02:01:35.428987+0000","last_unstale":"2023-10-24T02:01:35.434665+0000","last_undegraded":"2023-10-24T02:01:35.434665+0000","last_fullsized":"2023-10-24T02:01:35.434665+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.412067+0000","last_change":"2023-10-24T02:01:35.050116+0000","last_active":"2023-10-24T02:01:35.412067+0000","last_peered":"2023-10-24T02:01:35.412067+0000","last_clean":"2023-10-24T02:01:35.412067+0000","last_became_active":"2023-10-24T02:01:35.049854+0000","last_became_peered":"2023-10-24T02:01:35.049854+0000","last_unstale":"2023-10-24T02:01:35.412067+0000","last_undegraded":"2023-10-24T02:01:35.412067+0000","last_fullsized":"2023-10-24T02:01:35.412067+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.421936+0000","last_change":"2023-10-24T02:01:35.417971+0000","last_active":"2023-10-24T02:01:35.421936+0000","last_peered":"2023-10-24T02:01:35.421936+0000","last_clean":"2023-10-24T02:01:35.421936+0000","last_became_active":"2023-10-24T02:01:35.417708+0000","last_became_peered":"2023-10-24T02:01:35.417708+0000","last_unstale":"2023-10-24T02:01:35.421936+0000","last_undegraded":"2023-10-24T02:01:35.421936+0000","last_fullsized":"2023-10-24T02:01:35.421936+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426791+0000","last_change":"2023-10-24T02:01:35.067595+0000","last_active":"2023-10-24T02:01:35.426791+0000","last_peered":"2023-10-24T02:01:35.426791+0000","last_clean":"2023-10-24T02:01:35.426791+0000","last_became_active":"2023-10-24T02:01:35.067318+0000","last_became_peered":"2023-10-24T02:01:35.067318+0000","last_unstale":"2023-10-24T02:01:35.426791+0000","last_undegraded":"2023-10-24T02:01:35.426791+0000","last_fullsized":"2023-10-24T02:01:35.426791+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428878+0000","last_change":"2023-10-24T02:01:35.423669+0000","last_active":"2023-10-24T02:01:35.428878+0000","last_peered":"2023-10-24T02:01:35.428878+0000","last_clean":"2023-10-24T02:01:35.428878+0000","last_became_active":"2023-10-24T02:01:35.423251+0000","last_became_peered":"2023-10-24T02:01:35.423251+0000","last_unstale":"2023-10-24T02:01:35.428878+0000","last_undegraded":"2023-10-24T02:01:35.428878+0000","last_fullsized":"2023-10-24T02:01:35.428878+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414685+0000","last_change":"2023-10-24T02:01:35.063179+0000","last_active":"2023-10-24T02:01:35.414685+0000","last_peered":"2023-10-24T02:01:35.414685+0000","last_clean":"2023-10-24T02:01:35.414685+0000","last_became_active":"2023-10-24T02:01:35.062905+0000","last_became_peered":"2023-10-24T02:01:35.062905+0000","last_unstale":"2023-10-24T02:01:35.414685+0000","last_undegraded":"2023-10-24T02:01:35.414685+0000","last_fullsized":"2023-10-24T02:01:35.414685+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428892+0000","last_change":"2023-10-24T02:01:35.422490+0000","last_active":"2023-10-24T02:01:35.428892+0000","last_peered":"2023-10-24T02:01:35.428892+0000","last_clean":"2023-10-24T02:01:35.428892+0000","last_became_active":"2023-10-24T02:01:35.422178+0000","last_became_peered":"2023-10-24T02:01:35.422178+0000","last_unstale":"2023-10-24T02:01:35.428892+0000","last_undegraded":"2023-10-24T02:01:35.428892+0000","last_fullsized":"2023-10-24T02:01:35.428892+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.406908+0000","last_change":"2023-10-24T02:01:35.062125+0000","last_active":"2023-10-24T02:01:35.406908+0000","last_peered":"2023-10-24T02:01:35.406908+0000","last_clean":"2023-10-24T02:01:35.406908+0000","last_became_active":"2023-10-24T02:01:35.061859+0000","last_became_peered":"2023-10-24T02:01:35.061859+0000","last_unstale":"2023-10-24T02:01:35.406908+0000","last_undegraded":"2023-10-24T02:01:35.406908+0000","last_fullsized":"2023-10-24T02:01:35.406908+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429666+0000","last_change":"2023-10-24T02:01:35.425650+0000","last_active":"2023-10-24T02:01:35.429666+0000","last_peered":"2023-10-24T02:01:35.429666+0000","last_clean":"2023-10-24T02:01:35.429666+0000","last_became_active":"2023-10-24T02:01:35.425366+0000","last_became_peered":"2023-10-24T02:01:35.425366+0000","last_unstale":"2023-10-24T02:01:35.429666+0000","last_undegraded":"2023-10-24T02:01:35.429666+0000","last_fullsized":"2023-10-24T02:01:35.429666+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407365+0000","last_change":"2023-10-24T02:01:35.074890+0000","last_active":"2023-10-24T02:01:35.407365+0000","last_peered":"2023-10-24T02:01:35.407365+0000","last_clean":"2023-10-24T02:01:35.407365+0000","last_became_active":"2023-10-24T02:01:35.074531+0000","last_became_peered":"2023-10-24T02:01:35.074531+0000","last_unstale":"2023-10-24T02:01:35.407365+0000","last_undegraded":"2023-10-24T02:01:35.407365+0000","last_fullsized":"2023-10-24T02:01:35.407365+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.430637+0000","last_change":"2023-10-24T02:01:35.427063+0000","last_active":"2023-10-24T02:01:35.430637+0000","last_peered":"2023-10-24T02:01:35.430637+0000","last_clean":"2023-10-24T02:01:35.430637+0000","last_became_active":"2023-10-24T02:01:35.426797+0000","last_became_peered":"2023-10-24T02:01:35.426797+0000","last_unstale":"2023-10-24T02:01:35.430637+0000","last_undegraded":"2023-10-24T02:01:35.430637+0000","last_fullsized":"2023-10-24T02:01:35.430637+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"200'2","reported_seq":12,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424195+0000","last_change":"2023-10-24T02:01:35.065366+0000","last_active":"2023-10-24T02:01:35.424195+0000","last_peered":"2023-10-24T02:01:35.424195+0000","last_clean":"2023-10-24T02:01:35.424195+0000","last_became_active":"2023-10-24T02:01:35.065020+0000","last_became_peered":"2023-10-24T02:01:35.065020+0000","last_unstale":"2023-10-24T02:01:35.424195+0000","last_undegraded":"2023-10-24T02:01:35.424195+0000","last_fullsized":"2023-10-24T02:01:35.424195+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424624+0000","last_change":"2023-10-24T02:01:35.421356+0000","last_active":"2023-10-24T02:01:35.424624+0000","last_peered":"2023-10-24T02:01:35.424624+0000","last_clean":"2023-10-24T02:01:35.424624+0000","last_became_active":"2023-10-24T02:01:35.421136+0000","last_became_peered":"2023-10-24T02:01:35.421136+0000","last_unstale":"2023-10-24T02:01:35.424624+0000","last_undegraded":"2023-10-24T02:01:35.424624+0000","last_fullsized":"2023-10-24T02:01:35.424624+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408704+0000","last_change":"2023-10-24T02:01:35.050315+0000","last_active":"2023-10-24T02:01:35.408704+0000","last_peered":"2023-10-24T02:01:35.408704+0000","last_clean":"2023-10-24T02:01:35.408704+0000","last_became_active":"2023-10-24T02:01:35.049685+0000","last_became_peered":"2023-10-24T02:01:35.049685+0000","last_unstale":"2023-10-24T02:01:35.408704+0000","last_undegraded":"2023-10-24T02:01:35.408704+0000","last_fullsized":"2023-10-24T02:01:35.408704+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427373+0000","last_change":"2023-10-24T02:01:35.421851+0000","last_active":"2023-10-24T02:01:35.427373+0000","last_peered":"2023-10-24T02:01:35.427373+0000","last_clean":"2023-10-24T02:01:35.427373+0000","last_became_active":"2023-10-24T02:01:35.421544+0000","last_became_peered":"2023-10-24T02:01:35.421544+0000","last_unstale":"2023-10-24T02:01:35.427373+0000","last_undegraded":"2023-10-24T02:01:35.427373+0000","last_fullsized":"2023-10-24T02:01:35.427373+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.409880+0000","last_change":"2023-10-24T02:01:35.060505+0000","last_active":"2023-10-24T02:01:35.409880+0000","last_peered":"2023-10-24T02:01:35.409880+0000","last_clean":"2023-10-24T02:01:35.409880+0000","last_became_active":"2023-10-24T02:01:35.060288+0000","last_became_peered":"2023-10-24T02:01:35.060288+0000","last_unstale":"2023-10-24T02:01:35.409880+0000","last_undegraded":"2023-10-24T02:01:35.409880+0000","last_fullsized":"2023-10-24T02:01:35.409880+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429282+0000","last_change":"2023-10-24T02:01:35.428175+0000","last_active":"2023-10-24T02:01:35.429282+0000","last_peered":"2023-10-24T02:01:35.429282+0000","last_clean":"2023-10-24T02:01:35.429282+0000","last_became_active":"2023-10-24T02:01:35.427790+0000","last_became_peered":"2023-10-24T02:01:35.427790+0000","last_unstale":"2023-10-24T02:01:35.429282+0000","last_undegraded":"2023-10-24T02:01:35.429282+0000","last_fullsized":"2023-10-24T02:01:35.429282+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.405998+0000","last_change":"2023-10-24T02:01:35.053840+0000","last_active":"2023-10-24T02:01:35.405998+0000","last_peered":"2023-10-24T02:01:35.405998+0000","last_clean":"2023-10-24T02:01:35.405998+0000","last_became_active":"2023-10-24T02:01:35.053577+0000","last_became_peered":"2023-10-24T02:01:35.053577+0000","last_unstale":"2023-10-24T02:01:35.405998+0000","last_undegraded":"2023-10-24T02:01:35.405998+0000","last_fullsized":"2023-10-24T02:01:35.405998+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429169+0000","last_change":"2023-10-24T02:01:35.423782+0000","last_active":"2023-10-24T02:01:35.429169+0000","last_peered":"2023-10-24T02:01:35.429169+0000","last_clean":"2023-10-24T02:01:35.429169+0000","last_became_active":"2023-10-24T02:01:35.423202+0000","last_became_peered":"2023-10-24T02:01:35.423202+0000","last_unstale":"2023-10-24T02:01:35.429169+0000","last_undegraded":"2023-10-24T02:01:35.429169+0000","last_fullsized":"2023-10-24T02:01:35.429169+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.416848+0000","last_change":"2023-10-24T02:01:35.062771+0000","last_active":"2023-10-24T02:01:35.416848+0000","last_peered":"2023-10-24T02:01:35.416848+0000","last_clean":"2023-10-24T02:01:35.416848+0000","last_became_active":"2023-10-24T02:01:35.062245+0000","last_became_peered":"2023-10-24T02:01:35.062245+0000","last_unstale":"2023-10-24T02:01:35.416848+0000","last_undegraded":"2023-10-24T02:01:35.416848+0000","last_fullsized":"2023-10-24T02:01:35.416848+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428001+0000","last_change":"2023-10-24T02:01:35.420003+0000","last_active":"2023-10-24T02:01:35.428001+0000","last_peered":"2023-10-24T02:01:35.428001+0000","last_clean":"2023-10-24T02:01:35.428001+0000","last_became_active":"2023-10-24T02:01:35.419743+0000","last_became_peered":"2023-10-24T02:01:35.419743+0000","last_unstale":"2023-10-24T02:01:35.428001+0000","last_undegraded":"2023-10-24T02:01:35.428001+0000","last_fullsized":"2023-10-24T02:01:35.428001+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.409209+0000","last_change":"2023-10-24T02:01:35.050373+0000","last_active":"2023-10-24T02:01:35.409209+0000","last_peered":"2023-10-24T02:01:35.409209+0000","last_clean":"2023-10-24T02:01:35.409209+0000","last_became_active":"2023-10-24T02:01:35.050108+0000","last_became_peered":"2023-10-24T02:01:35.050108+0000","last_unstale":"2023-10-24T02:01:35.409209+0000","last_undegraded":"2023-10-24T02:01:35.409209+0000","last_fullsized":"2023-10-24T02:01:35.409209+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429557+0000","last_change":"2023-10-24T02:01:35.424600+0000","last_active":"2023-10-24T02:01:35.429557+0000","last_peered":"2023-10-24T02:01:35.429557+0000","last_clean":"2023-10-24T02:01:35.429557+0000","last_became_active":"2023-10-24T02:01:35.424332+0000","last_became_peered":"2023-10-24T02:01:35.424332+0000","last_unstale":"2023-10-24T02:01:35.429557+0000","last_undegraded":"2023-10-24T02:01:35.429557+0000","last_fullsized":"2023-10-24T02:01:35.429557+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.418109+0000","last_change":"2023-10-24T02:01:35.077262+0000","last_active":"2023-10-24T02:01:35.418109+0000","last_peered":"2023-10-24T02:01:35.418109+0000","last_clean":"2023-10-24T02:01:35.418109+0000","last_became_active":"2023-10-24T02:01:35.076871+0000","last_became_peered":"2023-10-24T02:01:35.076871+0000","last_unstale":"2023-10-24T02:01:35.418109+0000","last_undegraded":"2023-10-24T02:01:35.418109+0000","last_fullsized":"2023-10-24T02:01:35.418109+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.418064+0000","last_change":"2023-10-24T02:01:35.415757+0000","last_active":"2023-10-24T02:01:35.418064+0000","last_peered":"2023-10-24T02:01:35.418064+0000","last_clean":"2023-10-24T02:01:35.418064+0000","last_became_active":"2023-10-24T02:01:35.415461+0000","last_became_peered":"2023-10-24T02:01:35.415461+0000","last_unstale":"2023-10-24T02:01:35.418064+0000","last_undegraded":"2023-10-24T02:01:35.418064+0000","last_fullsized":"2023-10-24T02:01:35.418064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407177+0000","last_change":"2023-10-24T02:01:35.071577+0000","last_active":"2023-10-24T02:01:35.407177+0000","last_peered":"2023-10-24T02:01:35.407177+0000","last_clean":"2023-10-24T02:01:35.407177+0000","last_became_active":"2023-10-24T02:01:35.071242+0000","last_became_peered":"2023-10-24T02:01:35.071242+0000","last_unstale":"2023-10-24T02:01:35.407177+0000","last_undegraded":"2023-10-24T02:01:35.407177+0000","last_fullsized":"2023-10-24T02:01:35.407177+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.429607+0000","last_change":"2023-10-24T02:01:35.426997+0000","last_active":"2023-10-24T02:01:35.429607+0000","last_peered":"2023-10-24T02:01:35.429607+0000","last_clean":"2023-10-24T02:01:35.429607+0000","last_became_active":"2023-10-24T02:01:35.426687+0000","last_became_peered":"2023-10-24T02:01:35.426687+0000","last_unstale":"2023-10-24T02:01:35.429607+0000","last_undegraded":"2023-10-24T02:01:35.429607+0000","last_fullsized":"2023-10-24T02:01:35.429607+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.418053+0000","last_change":"2023-10-24T02:01:35.065762+0000","last_active":"2023-10-24T02:01:35.418053+0000","last_peered":"2023-10-24T02:01:35.418053+0000","last_clean":"2023-10-24T02:01:35.418053+0000","last_became_active":"2023-10-24T02:01:35.065467+0000","last_became_peered":"2023-10-24T02:01:35.065467+0000","last_unstale":"2023-10-24T02:01:35.418053+0000","last_undegraded":"2023-10-24T02:01:35.418053+0000","last_fullsized":"2023-10-24T02:01:35.418053+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.412144+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:01:35.412144+0000","last_peered":"2023-10-24T02:01:35.412144+0000","last_clean":"2023-10-24T02:01:35.412144+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:01:35.412144+0000","last_undegraded":"2023-10-24T02:01:35.412144+0000","last_fullsized":"2023-10-24T02:01:35.412144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427357+0000","last_change":"2023-10-24T02:01:35.420128+0000","last_active":"2023-10-24T02:01:35.427357+0000","last_peered":"2023-10-24T02:01:35.427357+0000","last_clean":"2023-10-24T02:01:35.427357+0000","last_became_active":"2023-10-24T02:01:35.419849+0000","last_became_peered":"2023-10-24T02:01:35.419849+0000","last_unstale":"2023-10-24T02:01:35.427357+0000","last_undegraded":"2023-10-24T02:01:35.427357+0000","last_fullsized":"2023-10-24T02:01:35.427357+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408956+0000","last_change":"2023-10-24T02:01:35.047264+0000","last_active":"2023-10-24T02:01:35.408956+0000","last_peered":"2023-10-24T02:01:35.408956+0000","last_clean":"2023-10-24T02:01:35.408956+0000","last_became_active":"2023-10-24T02:01:35.047045+0000","last_became_peered":"2023-10-24T02:01:35.047045+0000","last_unstale":"2023-10-24T02:01:35.408956+0000","last_undegraded":"2023-10-24T02:01:35.408956+0000","last_fullsized":"2023-10-24T02:01:35.408956+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414770+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:01:35.414770+0000","last_peered":"2023-10-24T02:01:35.414770+0000","last_clean":"2023-10-24T02:01:35.414770+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:01:35.414770+0000","last_undegraded":"2023-10-24T02:01:35.414770+0000","last_fullsized":"2023-10-24T02:01:35.414770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426986+0000","last_change":"2023-10-24T02:01:35.419390+0000","last_active":"2023-10-24T02:01:35.426986+0000","last_peered":"2023-10-24T02:01:35.426986+0000","last_clean":"2023-10-24T02:01:35.426986+0000","last_became_active":"2023-10-24T02:01:35.414980+0000","last_became_peered":"2023-10-24T02:01:35.414980+0000","last_unstale":"2023-10-24T02:01:35.426986+0000","last_undegraded":"2023-10-24T02:01:35.426986+0000","last_fullsized":"2023-10-24T02:01:35.426986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"200'2","reported_seq":12,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.423401+0000","last_change":"2023-10-24T02:01:35.053784+0000","last_active":"2023-10-24T02:01:35.423401+0000","last_peered":"2023-10-24T02:01:35.423401+0000","last_clean":"2023-10-24T02:01:35.423401+0000","last_became_active":"2023-10-24T02:01:35.053537+0000","last_became_peered":"2023-10-24T02:01:35.053537+0000","last_unstale":"2023-10-24T02:01:35.423401+0000","last_undegraded":"2023-10-24T02:01:35.423401+0000","last_fullsized":"2023-10-24T02:01:35.423401+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.405206+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:01:35.405206+0000","last_peered":"2023-10-24T02:01:35.405206+0000","last_clean":"2023-10-24T02:01:35.405206+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:01:35.405206+0000","last_undegraded":"2023-10-24T02:01:35.405206+0000","last_fullsized":"2023-10-24T02:01:35.405206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432082+0000","last_change":"2023-10-24T02:01:35.425925+0000","last_active":"2023-10-24T02:01:35.432082+0000","last_peered":"2023-10-24T02:01:35.432082+0000","last_clean":"2023-10-24T02:01:35.432082+0000","last_became_active":"2023-10-24T02:01:35.425629+0000","last_became_peered":"2023-10-24T02:01:35.425629+0000","last_unstale":"2023-10-24T02:01:35.432082+0000","last_undegraded":"2023-10-24T02:01:35.432082+0000","last_fullsized":"2023-10-24T02:01:35.432082+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.409018+0000","last_change":"2023-10-24T02:01:35.050465+0000","last_active":"2023-10-24T02:01:35.409018+0000","last_peered":"2023-10-24T02:01:35.409018+0000","last_clean":"2023-10-24T02:01:35.409018+0000","last_became_active":"2023-10-24T02:01:35.050041+0000","last_became_peered":"2023-10-24T02:01:35.050041+0000","last_unstale":"2023-10-24T02:01:35.409018+0000","last_undegraded":"2023-10-24T02:01:35.409018+0000","last_fullsized":"2023-10-24T02:01:35.409018+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.415795+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:01:35.415795+0000","last_peered":"2023-10-24T02:01:35.415795+0000","last_clean":"2023-10-24T02:01:35.415795+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:01:35.415795+0000","last_undegraded":"2023-10-24T02:01:35.415795+0000","last_fullsized":"2023-10-24T02:01:35.415795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":194,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407450+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:01:35.407450+0000","last_peered":"2023-10-24T02:01:35.407450+0000","last_clean":"2023-10-24T02:01:35.407450+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:01:35.407450+0000","last_undegraded":"2023-10-24T02:01:35.407450+0000","last_fullsized":"2023-10-24T02:01:35.407450+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.424796+0000","last_change":"2023-10-24T02:01:35.421158+0000","last_active":"2023-10-24T02:01:35.424796+0000","last_peered":"2023-10-24T02:01:35.424796+0000","last_clean":"2023-10-24T02:01:35.424796+0000","last_became_active":"2023-10-24T02:01:35.420959+0000","last_became_peered":"2023-10-24T02:01:35.420959+0000","last_unstale":"2023-10-24T02:01:35.424796+0000","last_undegraded":"2023-10-24T02:01:35.424796+0000","last_fullsized":"2023-10-24T02:01:35.424796+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"200'3","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428731+0000","last_change":"2023-10-24T02:01:35.062583+0000","last_active":"2023-10-24T02:01:35.428731+0000","last_peered":"2023-10-24T02:01:35.428731+0000","last_clean":"2023-10-24T02:01:35.428731+0000","last_became_active":"2023-10-24T02:01:35.062270+0000","last_became_peered":"2023-10-24T02:01:35.062270+0000","last_unstale":"2023-10-24T02:01:35.428731+0000","last_undegraded":"2023-10-24T02:01:35.428731+0000","last_fullsized":"2023-10-24T02:01:35.428731+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":192,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.407529+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:01:35.407529+0000","last_peered":"2023-10-24T02:01:35.407529+0000","last_clean":"2023-10-24T02:01:35.407529+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:01:35.407529+0000","last_undegraded":"2023-10-24T02:01:35.407529+0000","last_fullsized":"2023-10-24T02:01:35.407529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426808+0000","last_change":"2023-10-24T02:01:35.418045+0000","last_active":"2023-10-24T02:01:35.426808+0000","last_peered":"2023-10-24T02:01:35.426808+0000","last_clean":"2023-10-24T02:01:35.426808+0000","last_became_active":"2023-10-24T02:01:35.417706+0000","last_became_peered":"2023-10-24T02:01:35.417706+0000","last_unstale":"2023-10-24T02:01:35.426808+0000","last_undegraded":"2023-10-24T02:01:35.426808+0000","last_fullsized":"2023-10-24T02:01:35.426808+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"200'4","reported_seq":14,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.428051+0000","last_change":"2023-10-24T02:01:35.059711+0000","last_active":"2023-10-24T02:01:35.428051+0000","last_peered":"2023-10-24T02:01:35.428051+0000","last_clean":"2023-10-24T02:01:35.428051+0000","last_became_active":"2023-10-24T02:01:35.059392+0000","last_became_peered":"2023-10-24T02:01:35.059392+0000","last_unstale":"2023-10-24T02:01:35.428051+0000","last_undegraded":"2023-10-24T02:01:35.428051+0000","last_fullsized":"2023-10-24T02:01:35.428051+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":192,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408959+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:01:35.408959+0000","last_peered":"2023-10-24T02:01:35.408959+0000","last_clean":"2023-10-24T02:01:35.408959+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:01:35.408959+0000","last_undegraded":"2023-10-24T02:01:35.408959+0000","last_fullsized":"2023-10-24T02:01:35.408959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.432238+0000","last_change":"2023-10-24T02:01:35.428537+0000","last_active":"2023-10-24T02:01:35.432238+0000","last_peered":"2023-10-24T02:01:35.432238+0000","last_clean":"2023-10-24T02:01:35.432238+0000","last_became_active":"2023-10-24T02:01:35.428282+0000","last_became_peered":"2023-10-24T02:01:35.428282+0000","last_unstale":"2023-10-24T02:01:35.432238+0000","last_undegraded":"2023-10-24T02:01:35.432238+0000","last_fullsized":"2023-10-24T02:01:35.432238+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"200'1","reported_seq":11,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.426662+0000","last_change":"2023-10-24T02:01:35.080408+0000","last_active":"2023-10-24T02:01:35.426662+0000","last_peered":"2023-10-24T02:01:35.426662+0000","last_clean":"2023-10-24T02:01:35.426662+0000","last_became_active":"2023-10-24T02:01:35.080124+0000","last_became_peered":"2023-10-24T02:01:35.080124+0000","last_unstale":"2023-10-24T02:01:35.426662+0000","last_undegraded":"2023-10-24T02:01:35.426662+0000","last_fullsized":"2023-10-24T02:01:35.426662+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.412789+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:01:35.412789+0000","last_peered":"2023-10-24T02:01:35.412789+0000","last_clean":"2023-10-24T02:01:35.412789+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:01:35.412789+0000","last_undegraded":"2023-10-24T02:01:35.412789+0000","last_fullsized":"2023-10-24T02:01:35.412789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.427558+0000","last_change":"2023-10-24T02:01:35.422506+0000","last_active":"2023-10-24T02:01:35.427558+0000","last_peered":"2023-10-24T02:01:35.427558+0000","last_clean":"2023-10-24T02:01:35.427558+0000","last_became_active":"2023-10-24T02:01:35.422252+0000","last_became_peered":"2023-10-24T02:01:35.422252+0000","last_unstale":"2023-10-24T02:01:35.427558+0000","last_undegraded":"2023-10-24T02:01:35.427558+0000","last_fullsized":"2023-10-24T02:01:35.427558+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:35.019239+0000","last_clean_scrub_stamp":"2023-10-24T02:01:35.019239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.408999+0000","last_change":"2023-10-24T02:01:35.065227+0000","last_active":"2023-10-24T02:01:35.408999+0000","last_peered":"2023-10-24T02:01:35.408999+0000","last_clean":"2023-10-24T02:01:35.408999+0000","last_became_active":"2023-10-24T02:01:35.065007+0000","last_became_peered":"2023-10-24T02:01:35.065007+0000","last_unstale":"2023-10-24T02:01:35.408999+0000","last_undegraded":"2023-10-24T02:01:35.408999+0000","last_fullsized":"2023-10-24T02:01:35.408999+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:01:34.010472+0000","last_clean_scrub_stamp":"2023-10-24T02:01:34.010472+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-24T02:01:35.414948+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:01:35.414948+0000","last_peered":"2023-10-24T02:01:35.414948+0000","last_clean":"2023-10-24T02:01:35.414948+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:01:35.414948+0000","last_undegraded":"2023-10-24T02:01:35.414948+0000","last_fullsized":"2023-10-24T02:01:35.414948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543253,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307744,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064096,"statfs":{"total":96636764160,"available":96321634304,"internally_reserved":0,"allocated":2514944,"data_stored":1282966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.442,"5min":0.33900000000000002,"15min":0.25700000000000001},"max":{"1min":0.69799999999999995,"5min":0.745,"15min":0.86399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.375,"15min":0.314},"max":{"1min":0.749,"5min":0.77600000000000002,"15min":0.81200000000000006},"last":0.49099999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.81999999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.45600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.83999999999999997},"last":0.58799999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48299999999999998,"5min":0.41899999999999998,"15min":0.35299999999999998},"max":{"1min":0.753,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.72999999999999998,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.42399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.032,"15min":1.032},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.55100000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.752,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.85699999999999998},"last":0.47199999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79100000000000004,"5min":0.86499999999999999,"15min":0.90900000000000003},"last":0.622},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.55800000000000005},"min":{"1min":0.44400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63600000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.43099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.877},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.873,"5min":0.873,"15min":1.0049999999999999},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575957,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2452,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2510848,"data_stored":1282412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.29999999999999999},"max":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.622},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.67200000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.63100000000000001,"5min":0.77700000000000002,"15min":0.79100000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.58599999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.78700000000000003,"15min":0.83999999999999997},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.48099999999999998,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.69199999999999995,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.38},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.873},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.27600000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.33500000000000002},"max":{"1min":0.746,"5min":0.746,"15min":0.80200000000000005},"last":0.48299999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.83399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.318},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.499}]},{"osd":7,"last update":"Tue Oct 24 02:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.36399999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575958,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303648,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068192,"statfs":{"total":96636764160,"available":96325828608,"internally_reserved":0,"allocated":2514944,"data_stored":1282164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.66900000000000004,"5min":0.878,"15min":0.878},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.44,"15min":0.42399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.249},"max":{"1min":0.56100000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.627,"15min":0.63200000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42799999999999999,"15min":0.42699999999999999},"min":{"1min":0.30599999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.30599999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.443,"15min":0.436},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.61599999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.29899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70399999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.622},"min":{"1min":0.46800000000000003,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":0.83199999999999996,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.627}]},{"osd":5,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89900000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.82599999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83399999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.45600000000000002},"max":{"1min":0.86099999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575958,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2452,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2510848,"data_stored":1281554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38700000000000001,"15min":0.379},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":0.624,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.27500000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52300000000000002,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.314},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.27200000000000002,"5min":0.27100000000000002,"15min":0.25700000000000001},"max":{"1min":0.52900000000000003,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.30399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.315,"5min":0.312,"15min":0.25900000000000001},"max":{"1min":0.58999999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34499999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.88200000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.52200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.97299999999999998},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.008},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.441,"15min":0.44},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":1.028},"last":0.61199999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543253,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2452,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2510848,"data_stored":1281590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36899999999999999},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.28499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.29599999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.309},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.72899999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44600000000000001,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":0.68300000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.42599999999999999,"15min":0.438},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.68200000000000005},"last":0.36799999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.46899999999999997,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.95199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.623,"15min":0.629},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64400000000000002,"15min":0.64500000000000002},"min":{"1min":0.53100000000000003,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.97299999999999998},"last":0.499}]},{"osd":6,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.501,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.875,"15min":0.99299999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42799999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:00:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.43099999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.024},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.56000000000000005,"5min":0.46400000000000002,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1282186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.27600000000000002,"5min":0.25600000000000001,"15min":0.23599999999999999},"max":{"1min":0.47299999999999998,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.40400000000000003,"15min":0.41799999999999998},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.752},"last":0.33300000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.24299999999999999},"max":{"1min":0.498,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26100000000000001},"max":{"1min":0.54000000000000004,"5min":0.623,"15min":0.64600000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42099999999999999},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.28299999999999997},"max":{"1min":0.59199999999999997,"5min":0.65200000000000002,"15min":0.65600000000000003},"last":0.307},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47199999999999998,"15min":0.47399999999999998},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57499999999999996,"5min":0.68799999999999994,"15min":0.72799999999999998},"last":0.432}]},{"osd":4,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.35599999999999998},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":1.097},"last":0.624},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.81999999999999995,"5min":0.88600000000000001,"15min":1.167},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63600000000000001,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.39800000000000002},"max":{"1min":0.754,"5min":0.91100000000000003,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.624,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86299999999999999,"5min":0.88500000000000001,"15min":1.109},"last":0.73299999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.749,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.80600000000000005,"5min":0.91700000000000004,"15min":1.083},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:01:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65400000000000003,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.92600000000000005,"15min":1.155},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.45100000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.79700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575958,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1281702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.60499999999999998,"5min":0.73599999999999999,"15min":0.80100000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.68300000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63700000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.71699999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.31,"15min":0.31},"max":{"1min":0.72599999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50800000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.749,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.67500000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.72999999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.67600000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56799999999999995}]},{"osd":5,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.76100000000000001,"15min":0.83599999999999997},"last":0.622},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.318,"5min":0.316,"15min":0.316},"max":{"1min":0.625,"5min":0.77200000000000002,"15min":0.874},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77100000000000002,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.505},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.67800000000000005}]},{"osd":7,"last update":"Tue Oct 24 02:01:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68400000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.69499999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66800000000000004}]}]},{"osd":5,"up_from":14,"seq":60129543253,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1282198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56799999999999995,"15min":0.55100000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.30299999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.499,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.622}]},{"osd":1,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.47099999999999997,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.75}]},{"osd":2,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59799999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.54200000000000004,"5min":0.41699999999999998,"15min":0.35099999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.68899999999999995}]},{"osd":4,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45900000000000002,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.51000000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.501,"15min":0.51000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.27000000000000002},"max":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.60999999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"max":{"1min":0.81699999999999995,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.98799999999999999},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:01:43.158 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T02:01:43.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T02:01:43.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.311+0000 7f9cbece1700 1 Processor -- start 2023-10-24T02:01:43.312 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.311+0000 7f9cbece1700 1 -- start start 2023-10-24T02:01:43.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbece1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9cb8154430 0x7f9cb8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbece1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80c71d0 con 0x7f9cb80bffd0 2023-10-24T02:01:43.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbece1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80c9410 con 0x7f9cb8098bd0 2023-10-24T02:01:43.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbece1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb80c6a10 con 0x7f9cb8154430 2023-10-24T02:01:43.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9cb8154430 0x7f9cb8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbd27e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9cb80bffd0 0x7f9cb815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:46582/0 (socket says 172.21.15.148:46582) 2023-10-24T02:01:43.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9cb8154430 0x7f9cb8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53248/0 (socket says 172.21.15.148:53248) 2023-10-24T02:01:43.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbd27e700 1 -- 172.21.15.148:0/2697227734 learned_addr learned my addr 172.21.15.148:0/2697227734 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 -- 172.21.15.148:0/2697227734 >> v1:172.21.15.150:6789/0 conn(0x7f9cb8098bd0 legacy=0x7f9cb80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 -- 172.21.15.148:0/2697227734 >> v1:172.21.15.148:6789/0 conn(0x7f9cb80bffd0 legacy=0x7f9cb815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 -- 172.21.15.148:0/2697227734 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80ca8b0 con 0x7f9cb8154430 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cb77fe700 1 -- 172.21.15.148:0/2697227734 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815919467 0 0) 0x7f9cb80c71d0 con 0x7f9cb80bffd0 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.312+0000 7f9cbca7d700 1 --2- 172.21.15.148:0/2697227734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb8154810 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f9cac009760 tx=0x7f9cac009060).ready entity=mon.0 client_cookie=76a76e59f9dfb5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.316 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cb77fe700 1 -- 172.21.15.148:0/2697227734 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00b520 con 0x7f9cb8154430 2023-10-24T02:01:43.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cb77fe700 1 -- 172.21.15.148:0/2697227734 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00b680 con 0x7f9cb8154430 2023-10-24T02:01:43.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cb77fe700 1 -- 172.21.15.148:0/2697227734 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00ba00 con 0x7f9cb8154430 2023-10-24T02:01:43.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 -- 172.21.15.148:0/2697227734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 msgr2=0x7f9cb8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 --2- 172.21.15.148:0/2697227734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb8154810 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7f9cac009760 tx=0x7f9cac009060).stop 2023-10-24T02:01:43.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 -- 172.21.15.148:0/2697227734 shutdown_connections 2023-10-24T02:01:43.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 --2- 172.21.15.148:0/2697227734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb8154810 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 -- 172.21.15.148:0/2697227734 >> 172.21.15.148:0/2697227734 conn(0x7f9cb80cb070 msgr2=0x7f9cb80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:43.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 -- 172.21.15.148:0/2697227734 shutdown_connections 2023-10-24T02:01:43.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.313+0000 7f9cbece1700 1 -- 172.21.15.148:0/2697227734 wait complete. 2023-10-24T02:01:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.314+0000 7f9cbece1700 1 Processor -- start 2023-10-24T02:01:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.314+0000 7f9cbece1700 1 -- start start 2023-10-24T02:01:43.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 0x7f9cb8064e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cb80bffd0 0x7f9cb8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8155260 con 0x7f9cb8154430 2023-10-24T02:01:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb814fe80 con 0x7f9cb8098bd0 2023-10-24T02:01:43.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbece1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb81554a0 con 0x7f9cb80bffd0 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbd27e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbd27e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53250/0 (socket says 172.21.15.148:53250) 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbd27e700 1 -- 172.21.15.148:0/964500918 learned_addr learned my addr 172.21.15.148:0/964500918 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cbca7d700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 0x7f9cb8064e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.315+0000 7f9cb7fff700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cb80bffd0 0x7f9cb8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 -- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cb80bffd0 msgr2=0x7f9cb8154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cb80bffd0 0x7f9cb8154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 -- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 msgr2=0x7f9cb8064e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 0x7f9cb8064e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 -- 172.21.15.148:0/964500918 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0092a0 con 0x7f9cb8154430 2023-10-24T02:01:43.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbca7d700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 0x7f9cb8064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbd27e700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f9cb000c7e0 tx=0x7f9cb0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005d30 con 0x7f9cb8154430 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0005e90 con 0x7f9cb8154430 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb8155780 con 0x7f9cb8154430 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0007320 con 0x7f9cb8154430 2023-10-24T02:01:43.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.316+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8155d40 con 0x7f9cb8154430 2023-10-24T02:01:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.317+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb806c6b0 con 0x7f9cb8154430 2023-10-24T02:01:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.317+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9cb0007710 con 0x7f9cb8154430 2023-10-24T02:01:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.318+0000 7f9cb4ff9700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 0x7f9c9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.318+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f9cb007a360 con 0x7f9cb8154430 2023-10-24T02:01:43.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.318+0000 7f9cbca7d700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 0x7f9c9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.318+0000 7f9cbca7d700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 0x7f9c9c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9cac00b2e0 tx=0x7f9cac017000).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.322+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9cb004b600 con 0x7f9cb8154430 2023-10-24T02:01:43.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.552+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9cb8062c40 con 0x7f9cb8154430 2023-10-24T02:01:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.555+0000 7f9cb4ff9700 1 -- 172.21.15.148:0/964500918 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v51) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9cb004ec20 con 0x7f9cb8154430 2023-10-24T02:01:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 msgr2=0x7f9c9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 0x7f9c9c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9cac00b2e0 tx=0x7f9cac017000).stop 2023-10-24T02:01:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 msgr2=0x7f9cb814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f9cb000c7e0 tx=0x7f9cb0007f90).stop 2023-10-24T02:01:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 shutdown_connections 2023-10-24T02:01:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9cb8154430 0x7f9cb814f990 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9c9c05f150 0x7f9c9c061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cb8098bd0 0x7f9cb8064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 --2- 172.21.15.148:0/964500918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cb80bffd0 0x7f9cb8154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 >> 172.21.15.148:0/964500918 conn(0x7f9cb80cb070 msgr2=0x7f9cb80c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:43.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 shutdown_connections 2023-10-24T02:01:43.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.557+0000 7f9cbece1700 1 -- 172.21.15.148:0/964500918 wait complete. 2023-10-24T02:01:43.561 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T02:01:43.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:01:43.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.683+0000 7f82b6dec700 1 Processor -- start 2023-10-24T02:01:43.684 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.683+0000 7f82b6dec700 1 -- start start 2023-10-24T02:01:43.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.684+0000 7f82b6dec700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f82b013a840 0x7f82b0069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.684+0000 7f82b6dec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82b00655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.684+0000 7f82b6dec700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b00c4fe0 con 0x7f82b00c2bd0 2023-10-24T02:01:43.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.684+0000 7f82b6dec700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00c46f0 con 0x7f82b013a840 2023-10-24T02:01:43.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.684+0000 7f82b6dec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b006a5a0 con 0x7f82b013ac20 2023-10-24T02:01:43.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f82b00c2bd0 0x7f82b00c1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58432/0 (socket says 172.21.15.148:58432) 2023-10-24T02:01:43.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 -- 172.21.15.148:0/1544964449 learned_addr learned my addr 172.21.15.148:0/1544964449 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:43.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681835007 0 0) 0x7f82b00c4fe0 con 0x7f82b00c2bd0 2023-10-24T02:01:43.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82980033f0 con 0x7f82b00c2bd0 2023-10-24T02:01:43.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a7fff700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82b00655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1544964449 >> v2:172.21.15.150:3300/0 conn(0x7f82b013a840 0x7f82b0069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 612313863 0 0) 0x7f82980033f0 con 0x7f82b00c2bd0 2023-10-24T02:01:43.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 msgr2=0x7f82b00655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:43.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82b00655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 >> v2:172.21.15.150:3300/0 conn(0x7f82b013a840 msgr2=0x7f82b0069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:43.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 --2- 172.21.15.148:0/1544964449 >> v2:172.21.15.150:3300/0 conn(0x7f82b013a840 0x7f82b0069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00c4990 con 0x7f82b00c2bd0 2023-10-24T02:01:43.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f82a80017f0 con 0x7f82b00c2bd0 2023-10-24T02:01:43.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 >> v1:172.21.15.148:6789/0 conn(0x7f82b00c2bd0 legacy=0x7f82b00c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82980038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8298003e10 0x7f8298004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8298004b80 0x7f8298005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c46f0 con 0x7f8298004b80 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b006a5a0 con 0x7f8298003e10 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829800daf0 con 0x7f82b013ac20 2023-10-24T02:01:43.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8298004b80 0x7f8298005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82980038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82a7fff700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8298003e10 0x7f8298004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 -- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 msgr2=0x7f82980038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:43.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82b013ac20 0x7f82980038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.685+0000 7f82b5389700 1 -- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8298003e10 msgr2=0x7f8298004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:43.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b5389700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8298003e10 0x7f8298004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b5389700 1 -- 172.21.15.148:0/1544964449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980033f0 con 0x7f8298004b80 2023-10-24T02:01:43.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b5389700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8298004b80 0x7f8298005000 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f82a800c560 tx=0x7f82b0151690).ready entity=mon.0 client_cookie=af4555ce24f5f885 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800ce50 con 0x7f8298004b80 2023-10-24T02:01:43.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8005b20 con 0x7f8298004b80 2023-10-24T02:01:43.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82a77fe700 1 -- 172.21.15.148:0/1544964449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80070d0 con 0x7f8298004b80 2023-10-24T02:01:43.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 -- 172.21.15.148:0/1544964449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8298004b80 msgr2=0x7f8298005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1544964449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8298004b80 0x7f8298005000 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7f82a800c560 tx=0x7f82b0151690).stop 2023-10-24T02:01:43.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b5389700 1 -- 172.21.15.148:0/1544964449 reap_dead start 2023-10-24T02:01:43.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 -- 172.21.15.148:0/1544964449 shutdown_connections 2023-10-24T02:01:43.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 -- 172.21.15.148:0/1544964449 >> 172.21.15.148:0/1544964449 conn(0x7f82b0063120 msgr2=0x7f82b00c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:43.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 -- 172.21.15.148:0/1544964449 shutdown_connections 2023-10-24T02:01:43.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.686+0000 7f82b6dec700 1 -- 172.21.15.148:0/1544964449 wait complete. 2023-10-24T02:01:43.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.687+0000 7f82b6dec700 1 Processor -- start 2023-10-24T02:01:43.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 -- start start 2023-10-24T02:01:43.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 0x7f82b00643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 0x7f82b00648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b0064da0 con 0x7f82b0154570 2023-10-24T02:01:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c0790 con 0x7f82b00c0c20 2023-10-24T02:01:43.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b6dec700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00bfb80 con 0x7f8298004b80 2023-10-24T02:01:43.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.688+0000 7f82b5389700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49906/0 (socket says 172.21.15.148:49906) 2023-10-24T02:01:43.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 -- 172.21.15.148:0/1622008019 learned_addr learned my addr 172.21.15.148:0/1622008019 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:43.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 0x7f82b00643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82a7fff700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 0x7f82b00648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 -- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 msgr2=0x7f82b00643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 0x7f82b00643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 -- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 msgr2=0x7f82b00648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.702 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 0x7f82b00648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 -- 172.21.15.148:0/1622008019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00bfe60 con 0x7f82b0154570 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 0x7f82b00643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82a7fff700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 0x7f82b00648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b5389700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f82a8007fd0 tx=0x7f82a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80017b0 con 0x7f82b0154570 2023-10-24T02:01:43.703 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8005c90 con 0x7f82b0154570 2023-10-24T02:01:43.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8013680 con 0x7f82b0154570 2023-10-24T02:01:43.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b00c0140 con 0x7f82b0154570 2023-10-24T02:01:43.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.689+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b0154ea0 con 0x7f82b0154570 2023-10-24T02:01:43.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.690+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b00c0940 con 0x7f82b0154570 2023-10-24T02:01:43.704 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.690+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f82a80139f0 con 0x7f82b0154570 2023-10-24T02:01:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.691+0000 7f82a4ff9700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 0x7f829c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.691+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f82a8019070 con 0x7f82b0154570 2023-10-24T02:01:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.691+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 0x7f829c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.691+0000 7f82b4b88700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 0x7f829c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f82b00c10e0 tx=0x7f82ac008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.695+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f82b00c0940 con 0x7f82b0154570 2023-10-24T02:01:43.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.900+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82b00c0940 con 0x7f82b0154570 2023-10-24T02:01:43.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.900+0000 7f82a4ff9700 1 -- 172.21.15.148:0/1622008019 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f82b00c0940 con 0x7f82b0154570 2023-10-24T02:01:43.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:43.901 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:01:43.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 msgr2=0x7f829c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.903 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 0x7f829c061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f82b00c10e0 tx=0x7f82ac008040).stop 2023-10-24T02:01:43.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 msgr2=0x7f82b01549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:43.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f82a8007fd0 tx=0x7f82a8015000).stop 2023-10-24T02:01:43.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 shutdown_connections 2023-10-24T02:01:43.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82b0154570 0x7f82b01549b0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8298004b80 0x7f82b00643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f829c05f150 0x7f829c061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 --2- 172.21.15.148:0/1622008019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82b00c0c20 0x7f82b00648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:43.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.902+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 >> 172.21.15.148:0/1622008019 conn(0x7f82b0063120 msgr2=0x7f82b00bbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:43.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.903+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 shutdown_connections 2023-10-24T02:01:43.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:43.903+0000 7f82b6dec700 1 -- 172.21.15.148:0/1622008019 wait complete. 2023-10-24T02:01:43.906 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:01:44.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T02:01:35.400665+0000', 'modified': '2023-10-24T02:01:37.410603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9699}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9699': {'gid': 9699, 'name': 'b', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6835/4014138600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 4014138600}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 4014138600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T02:01:44.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T02:01:44.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-24T02:01:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.436+0000 7f929cd2b700 1 Processor -- start 2023-10-24T02:01:44.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.436+0000 7f929cd2b700 1 -- start start 2023-10-24T02:01:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929cd2b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9298137520 0x7f9298069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929cd2b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92980c11f0 0x7f92980bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929cd2b700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929806a4f0 con 0x7f9298137900 2023-10-24T02:01:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929cd2b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9298065d60 con 0x7f92980c11f0 2023-10-24T02:01:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929cd2b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929806a2e0 con 0x7f9298137520 2023-10-24T02:01:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f9296d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f92980c11f0 0x7f92980bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f928dd9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9298137900 0x7f92980bc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58444/0 (socket says 172.21.15.148:58444) 2023-10-24T02:01:44.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f928dd9b700 1 -- 172.21.15.148:0/3835249168 learned_addr learned my addr 172.21.15.148:0/3835249168 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.437+0000 7f929659c700 1 --2- 172.21.15.148:0/3835249168 >> v2:172.21.15.150:3300/0 conn(0x7f9298137520 0x7f9298069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9296d9d700 1 -- 172.21.15.148:0/3835249168 >> v2:172.21.15.150:3300/0 conn(0x7f9298137520 msgr2=0x7f9298069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9296d9d700 1 --2- 172.21.15.148:0/3835249168 >> v2:172.21.15.150:3300/0 conn(0x7f9298137520 0x7f9298069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9296d9d700 1 -- 172.21.15.148:0/3835249168 >> v1:172.21.15.148:6789/0 conn(0x7f9298137900 legacy=0x7f92980bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9295d9b700 1 -- 172.21.15.148:0/3835249168 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520049940 0 0) 0x7f929806a4f0 con 0x7f9298137900 2023-10-24T02:01:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9296d9d700 1 -- 172.21.15.148:0/3835249168 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980bbcd0 con 0x7f92980c11f0 2023-10-24T02:01:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9296d9d700 1 --2- 172.21.15.148:0/3835249168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980c11f0 0x7f92980bcec0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f92980c6b00 tx=0x7f929000b990).ready entity=mon.0 client_cookie=cf803a9e991372a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9295d9b700 1 -- 172.21.15.148:0/3835249168 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290010070 con 0x7f92980c11f0 2023-10-24T02:01:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9295d9b700 1 -- 172.21.15.148:0/3835249168 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000b2e0 con 0x7f92980c11f0 2023-10-24T02:01:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f9295d9b700 1 -- 172.21.15.148:0/3835249168 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000dd10 con 0x7f92980c11f0 2023-10-24T02:01:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 -- 172.21.15.148:0/3835249168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980c11f0 msgr2=0x7f92980bcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 --2- 172.21.15.148:0/3835249168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980c11f0 0x7f92980bcec0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f92980c6b00 tx=0x7f929000b990).stop 2023-10-24T02:01:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 -- 172.21.15.148:0/3835249168 shutdown_connections 2023-10-24T02:01:44.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 --2- 172.21.15.148:0/3835249168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92980c11f0 0x7f92980bcec0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 --2- 172.21.15.148:0/3835249168 >> v2:172.21.15.150:3300/0 conn(0x7f9298137520 0x7f9298069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 -- 172.21.15.148:0/3835249168 >> 172.21.15.148:0/3835249168 conn(0x7f92980c6bf0 msgr2=0x7f92980c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 -- 172.21.15.148:0/3835249168 shutdown_connections 2023-10-24T02:01:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.438+0000 7f929cd2b700 1 -- 172.21.15.148:0/3835249168 wait complete. 2023-10-24T02:01:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 Processor -- start 2023-10-24T02:01:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 -- start start 2023-10-24T02:01:44.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 0x7f92980bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9298137900 0x7f9298137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298138d60 con 0x7f9298137520 2023-10-24T02:01:44.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980be180 con 0x7f9298137900 2023-10-24T02:01:44.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.440+0000 7f929cd2b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92981387a0 con 0x7f92980c11f0 2023-10-24T02:01:44.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49920/0 (socket says 172.21.15.148:49920) 2023-10-24T02:01:44.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 -- 172.21.15.148:0/66941188 learned_addr learned my addr 172.21.15.148:0/66941188 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f929659c700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 0x7f92980bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f9296d9d700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9298137900 0x7f9298137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 -- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 msgr2=0x7f92980bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 0x7f92980bdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 -- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9298137900 msgr2=0x7f9298137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9298137900 0x7f9298137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 -- 172.21.15.148:0/66941188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929000bc30 con 0x7f9298137520 2023-10-24T02:01:44.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f929659c700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 0x7f92980bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:44.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928dd9b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f928000c460 tx=0x7f9280007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928effd700 1 -- 172.21.15.148:0/66941188 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928000ce10 con 0x7f9298137520 2023-10-24T02:01:44.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928effd700 1 -- 172.21.15.148:0/66941188 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800072e0 con 0x7f9298137520 2023-10-24T02:01:44.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9298138a80 con 0x7f9298137520 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f928effd700 1 -- 172.21.15.148:0/66941188 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800057a0 con 0x7f9298137520 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.441+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9298139b60 con 0x7f9298137520 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.443+0000 7f928effd700 1 -- 172.21.15.148:0/66941188 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9280005bd0 con 0x7f9298137520 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.443+0000 7f928effd700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 0x7f9278061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.443+0000 7f928effd700 1 -- 172.21.15.148:0/66941188 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f9280079900 con 0x7f9298137520 2023-10-24T02:01:44.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.443+0000 7f929659c700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 0x7f9278061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.444+0000 7f929659c700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 0x7f9278061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9288009b70 tx=0x7f9288008040).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.445+0000 7f92ae6c3b80 1 Processor -- start 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.445+0000 7f92ae6c3b80 1 -- start start 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d42b20 0x55dea7d42f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d3e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7cba1b0 con 0x55dea7d45980 2023-10-24T02:01:44.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7c7fcb0 con 0x55dea7d6c190 2023-10-24T02:01:44.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dea7c94c90 con 0x55dea7d42b20 2023-10-24T02:01:44.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49926/0 (socket says 172.21.15.148:49926) 2023-10-24T02:01:44.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 -- 172.21.15.148:0/1575409053 learned_addr learned my addr 172.21.15.148:0/1575409053 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f929659c700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d42b20 0x55dea7d42f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d3e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 -- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d42b20 msgr2=0x55dea7d42f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d42b20 0x55dea7d42f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 -- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 msgr2=0x55dea7d3e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d3e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f9296d9d700 1 -- 172.21.15.148:0/1575409053 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dea7c8de70 con 0x55dea7d45980 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.446+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d3e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:44.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f9298066ef0 tx=0x7f929000b990).ready entity=mon.0 client_cookie=2a83481777d78c33 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92777fe700 1 -- 172.21.15.148:0/1575409053 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290025070 con 0x55dea7d45980 2023-10-24T02:01:44.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92777fe700 1 -- 172.21.15.148:0/1575409053 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000da30 con 0x55dea7d45980 2023-10-24T02:01:44.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92777fe700 1 -- 172.21.15.148:0/1575409053 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000dba0 con 0x55dea7d45980 2023-10-24T02:01:44.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1575409053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 msgr2=0x55dea7d3ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f9298066ef0 tx=0x7f929000b990).stop 2023-10-24T02:01:44.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1575409053 shutdown_connections 2023-10-24T02:01:44.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d45980 0x55dea7d3ee90 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d42b20 0x55dea7d42f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1575409053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d3e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.466 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1575409053 >> 172.21.15.148:0/1575409053 conn(0x55dea7affe40 msgr2=0x55dea7d8cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.447+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1575409053 shutdown_connections 2023-10-24T02:01:44.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.448+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1575409053 wait complete. 2023-10-24T02:01:44.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.448+0000 7f92ae6c3b80 1 -- start start 2023-10-24T02:01:44.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.448+0000 7f92ae6c3b80 1 Processor -- start 2023-10-24T02:01:44.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d86c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d65ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7c94dd0 con 0x55dea7d42b20 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7c95050 con 0x55dea7d6c190 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dea7c608d0 con 0x55dea7d45980 2023-10-24T02:01:44.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f92ae6c3b80 10 client.0 ll_register_callbacks cb 0x55dea7d03030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T02:01:44.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49932/0 (socket says 172.21.15.148:49932) 2023-10-24T02:01:44.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f929659c700 1 -- 172.21.15.148:0/1127394466 learned_addr learned my addr 172.21.15.148:0/1127394466 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d65ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d86c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.449+0000 7f929659c700 1 -- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 msgr2=0x55dea7d86c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f929659c700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d86c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f929659c700 1 -- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 msgr2=0x55dea7d65ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f929659c700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d65ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f929659c700 1 -- 172.21.15.148:0/1127394466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980bbcd0 con 0x55dea7d42b20 2023-10-24T02:01:44.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d65ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:44.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f929659c700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f9288015800 tx=0x7f9288018040).ready entity=mon.0 client_cookie=1c448293ba9fd96e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T02:01:44.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288014740 con 0x55dea7d42b20 2023-10-24T02:01:44.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f92880148a0 con 0x55dea7d42b20 2023-10-24T02:01:44.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dea7d374e0 con 0x55dea7d42b20 2023-10-24T02:01:44.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9288014c70 con 0x55dea7d42b20 2023-10-24T02:01:44.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 10 client.9888 fetch_fsmap learned FSMap version 68 2023-10-24T02:01:44.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55dea7c89480 con 0x55dea7d42b20 2023-10-24T02:01:44.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dea7d374e0 con 0x55dea7d42b20 2023-10-24T02:01:44.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9288022480 con 0x55dea7d42b20 2023-10-24T02:01:44.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 10 client.9888 fetch_fsmap finished waiting for FSMap version 68 2023-10-24T02:01:44.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 10 client.9888 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-24T02:01:44.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 20 client.9888 populate_metadata read hostname 'smithi148' 2023-10-24T02:01:44.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7d8ef90 0x55dea7d8f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 4 client.9888 mds_command: new command op to 9699 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T02:01:44.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.450+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 --> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dea7d0d4b0 con 0x55dea7d8ef90 2023-10-24T02:01:44.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7d8ef90 0x55dea7d8f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f9274ff9700 10 client.9888 ms_handle_connect on v2:172.21.15.150:6834/4014138600 2023-10-24T02:01:44.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7d8ef90 0x55dea7d8f370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8a597d89c91dffb3 server_cookie=9213f648f0ceed7c in_seq=0 out_seq=0 2023-10-24T02:01:44.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f9274ff9700 1 -- 172.21.15.148:0/1127394466 <== mds.0 v2:172.21.15.150:6834/4014138600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55dea7d0d4b0 con 0x55dea7d8ef90 2023-10-24T02:01:44.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f9274ff9700 10 client.9888 handle_command_reply: tid=0 2023-10-24T02:01:44.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.451+0000 7f92ae6c3b80 1 client.9888 shutdown 2023-10-24T02:01:44.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 msgr2=0x55dea7d6a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f9288015800 tx=0x7f9288018040).stop 2023-10-24T02:01:44.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 shutdown_connections 2023-10-24T02:01:44.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7d8ef90 0x55dea7d8f370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d65ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f9274ff9700 0 client.9888 ms_handle_reset on v2:172.21.15.150:6834/4014138600 2023-10-24T02:01:44.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d6a050 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1127394466 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d86c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 >> 172.21.15.148:0/1127394466 conn(0x55dea7affe40 msgr2=0x55dea7d89340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 shutdown_connections 2023-10-24T02:01:44.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1127394466 wait complete. 2023-10-24T02:01:44.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.452+0000 7f92ae6c3b80 20 client.9888 trim_cache size 0 max 16384 2023-10-24T02:01:44.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.468+0000 7f92ae6c3b80 1 Processor -- start 2023-10-24T02:01:44.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.468+0000 7f92ae6c3b80 1 -- start start 2023-10-24T02:01:44.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7d891c0 con 0x55dea7d42b20 2023-10-24T02:01:44.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7d39b80 con 0x55dea7d6c190 2023-10-24T02:01:44.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dea7d8e260 con 0x55dea7d45980 2023-10-24T02:01:44.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49940/0 (socket says 172.21.15.148:49940) 2023-10-24T02:01:44.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 -- 172.21.15.148:0/406294252 learned_addr learned my addr 172.21.15.148:0/406294252 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 -- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 msgr2=0x55dea7d8cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f928dd9b700 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f9296d9d700 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 -- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 msgr2=0x55dea7d8dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 -- 172.21.15.148:0/406294252 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dea7c891d0 con 0x55dea7d42b20 2023-10-24T02:01:44.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f929659c700 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f9288006970 tx=0x7f9288019000).ready entity=mon.0 client_cookie=4063f919455f14df server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f9277fff700 1 -- 172.21.15.148:0/406294252 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92880229e0 con 0x55dea7d42b20 2023-10-24T02:01:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f9277fff700 1 -- 172.21.15.148:0/406294252 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288022480 con 0x55dea7d42b20 2023-10-24T02:01:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.469+0000 7f9277fff700 1 -- 172.21.15.148:0/406294252 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92880225f0 con 0x55dea7d42b20 2023-10-24T02:01:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/406294252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 msgr2=0x55dea7d3d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f9288006970 tx=0x7f9288019000).stop 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/406294252 shutdown_connections 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d3d720 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/406294252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/406294252 >> 172.21.15.148:0/406294252 conn(0x55dea7affe40 msgr2=0x55dea7d65330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/406294252 shutdown_connections 2023-10-24T02:01:44.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/406294252 wait complete. 2023-10-24T02:01:44.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.470+0000 7f92ae6c3b80 1 -- start start 2023-10-24T02:01:44.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 Processor -- start 2023-10-24T02:01:44.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7d8fd50 con 0x55dea7d42b20 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea7d887b0 con 0x55dea7d6c190 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dea7deef20 con 0x55dea7d45980 2023-10-24T02:01:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.471+0000 7f92ae6c3b80 10 client.0 ll_register_callbacks cb 0x55dea7d03030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T02:01:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49956/0 (socket says 172.21.15.148:49956) 2023-10-24T02:01:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 -- 172.21.15.148:0/1904412846 learned_addr learned my addr 172.21.15.148:0/1904412846 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 -- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 msgr2=0x55dea7d8f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 -- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 msgr2=0x55dea7d8f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9296d9d700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 -- 172.21.15.148:0/1904412846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dea7c89480 con 0x55dea7d42b20 2023-10-24T02:01:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f929659c700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f9288015800 tx=0x7f9288024040).ready entity=mon.0 client_cookie=39d07f09674753d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92880143e0 con 0x55dea7d42b20 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f9288014540 con 0x55dea7d42b20 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f929000da30 con 0x55dea7d42b20 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f928803a440 con 0x55dea7d42b20 2023-10-24T02:01:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 10 client.9894 fetch_fsmap learned FSMap version 68 2023-10-24T02:01:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55dea7b00f80 con 0x55dea7d42b20 2023-10-24T02:01:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000da30 con 0x55dea7d42b20 2023-10-24T02:01:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f928803a5a0 con 0x55dea7d42b20 2023-10-24T02:01:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 10 client.9894 fetch_fsmap finished waiting for FSMap version 68 2023-10-24T02:01:44.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 10 client.9894 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 20 client.9894 populate_metadata read hostname 'smithi148' 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7dee000 0x55dea7dee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 4 client.9894 mds_command: new command op to 9699 tid=0[{"prefix": "status"}] 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.472+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 --> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dea7afbca0 con 0x55dea7dee000 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7dee000 0x55dea7dee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f9274ff9700 10 client.9894 ms_handle_connect on v2:172.21.15.150:6834/4014138600 2023-10-24T02:01:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f928dd9b700 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7dee000 0x55dea7dee3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ae8acd6e7b41adab server_cookie=2b77435e17f3430e in_seq=0 out_seq=0 2023-10-24T02:01:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f9274ff9700 1 -- 172.21.15.148:0/1904412846 <== mds.0 v2:172.21.15.150:6834/4014138600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55dea7afbca0 con 0x55dea7dee000 2023-10-24T02:01:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f9274ff9700 10 client.9894 handle_command_reply: tid=0 2023-10-24T02:01:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 client.9894 shutdown 2023-10-24T02:01:44.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 msgr2=0x55dea7d882c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f9288015800 tx=0x7f9288024040).stop 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 shutdown_connections 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:6834/4014138600,v1:172.21.15.150:6835/4014138600] conn(0x55dea7dee000 0x55dea7dee3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dea7d6c190 0x55dea7d8f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dea7d42b20 0x55dea7d882c0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f9274ff9700 0 client.9894 ms_handle_reset on v2:172.21.15.150:6834/4014138600 2023-10-24T02:01:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 --2- 172.21.15.148:0/1904412846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55dea7d45980 0x55dea7d8f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 >> 172.21.15.148:0/1904412846 conn(0x55dea7affe40 msgr2=0x55dea7d896d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 shutdown_connections 2023-10-24T02:01:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.473+0000 7f92ae6c3b80 1 -- 172.21.15.148:0/1904412846 wait complete. 2023-10-24T02:01:44.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f92ae6c3b80 20 client.9894 trim_cache size 0 max 16384 2023-10-24T02:01:44.502 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:01:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T02:01:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T02:01:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 9699, 2023-10-24T02:01:44.502 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.0726160769999993, 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 68, 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 201, 2023-10-24T02:01:44.503 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 201, 2023-10-24T02:01:44.504 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 13.578864348 2023-10-24T02:01:44.504 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:01:44.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 msgr2=0x7f9278061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 0x7f9278061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9288009b70 tx=0x7f9288008040).stop 2023-10-24T02:01:44.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 msgr2=0x7f9298154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f928000c460 tx=0x7f9280007e10).stop 2023-10-24T02:01:44.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 shutdown_connections 2023-10-24T02:01:44.506 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f927805f150 0x7f9278061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9298137900 0x7f9298137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92980c11f0 0x7f92980bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 --2- 172.21.15.148:0/66941188 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9298137520 0x7f9298154ca0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.507 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 >> 172.21.15.148:0/66941188 conn(0x7f92980c6bf0 msgr2=0x7f92980c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 shutdown_connections 2023-10-24T02:01:44.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.474+0000 7f929cd2b700 1 -- 172.21.15.148:0/66941188 wait complete. 2023-10-24T02:01:44.508 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T02:01:44.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.607+0000 7fd1b90fa700 1 Processor -- start 2023-10-24T02:01:44.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 -- start start 2023-10-24T02:01:44.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 0x7fd1b4154a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1b4154f10 0x7fd1b40a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40a8d50 con 0x7fd1b40c4310 2023-10-24T02:01:44.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40c46f0 con 0x7fd1b4154f10 2023-10-24T02:01:44.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.608+0000 7fd1b90fa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b4155380 con 0x7fd1b4063760 2023-10-24T02:01:44.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1b4154f10 0x7fd1b40a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd1b4154f10 0x7fd1b40a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49958/0 (socket says 172.21.15.148:49958) 2023-10-24T02:01:44.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 -- 172.21.15.148:0/1954176931 learned_addr learned my addr 172.21.15.148:0/1954176931 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1abfff700 1 --2- 172.21.15.148:0/1954176931 >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 0x7fd1b4154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 -- 172.21.15.148:0/1954176931 >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 msgr2=0x7fd1b4154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 --2- 172.21.15.148:0/1954176931 >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 0x7fd1b4154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 -- 172.21.15.148:0/1954176931 >> v1:172.21.15.150:6789/0 conn(0x7fd1b40c4310 legacy=0x7fd1b40a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:44.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 -- 172.21.15.148:0/1954176931 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40a8140 con 0x7fd1b4154f10 2023-10-24T02:01:44.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1abfff700 1 --2- 172.21.15.148:0/1954176931 >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 0x7fd1b4154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:44.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b359e700 1 --2- 172.21.15.148:0/1954176931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b4154f10 0x7fd1b40a91e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7fd1b4064170 tx=0x7fd1ac009840).ready entity=mon.0 client_cookie=6725606ff128e26c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b259c700 1 -- 172.21.15.148:0/1954176931 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00e070 con 0x7fd1b4154f10 2023-10-24T02:01:44.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b259c700 1 -- 172.21.15.148:0/1954176931 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00ba10 con 0x7fd1b4154f10 2023-10-24T02:01:44.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b259c700 1 -- 172.21.15.148:0/1954176931 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00bd90 con 0x7fd1b4154f10 2023-10-24T02:01:44.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.609+0000 7fd1b90fa700 1 -- 172.21.15.148:0/1954176931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b4154f10 msgr2=0x7fd1b40a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/1954176931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b4154f10 0x7fd1b40a91e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7fd1b4064170 tx=0x7fd1ac009840).stop 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 -- 172.21.15.148:0/1954176931 shutdown_connections 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/1954176931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b4154f10 0x7fd1b40a91e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/1954176931 >> v2:172.21.15.150:3300/0 conn(0x7fd1b4063760 0x7fd1b4154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 -- 172.21.15.148:0/1954176931 >> 172.21.15.148:0/1954176931 conn(0x7fd1b40c7ea0 msgr2=0x7fd1b40aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 -- 172.21.15.148:0/1954176931 shutdown_connections 2023-10-24T02:01:44.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.610+0000 7fd1b90fa700 1 -- 172.21.15.148:0/1954176931 wait complete. 2023-10-24T02:01:44.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 Processor -- start 2023-10-24T02:01:44.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 -- start start 2023-10-24T02:01:44.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1b4063760 0x7fd1b40a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1b4154f10 0x7fd1b4165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40a3b40 con 0x7fd1b40c4310 2023-10-24T02:01:44.620 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4165a40 con 0x7fd1b4063760 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.611+0000 7fd1b90fa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40a37b0 con 0x7fd1b4154f10 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49964/0 (socket says 172.21.15.148:49964) 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 -- 172.21.15.148:0/3905737804 learned_addr learned my addr 172.21.15.148:0/3905737804 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1b2d9d700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1b4063760 0x7fd1b40a31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.621 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1b359e700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1b4154f10 0x7fd1b4165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 -- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1b4154f10 msgr2=0x7fd1b4165c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1b4154f10 0x7fd1b4165c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 -- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1b4063760 msgr2=0x7fd1b40a31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1b4063760 0x7fd1b40a31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.622 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 -- 172.21.15.148:0/3905737804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009ae0 con 0x7fd1b40c4310 2023-10-24T02:01:44.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1abfff700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fd19c00d860 tx=0x7fd19c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00f520 con 0x7fd1b40c4310 2023-10-24T02:01:44.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00f680 con 0x7fd1b40c4310 2023-10-24T02:01:44.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00fa00 con 0x7fd1b40c4310 2023-10-24T02:01:44.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b40a3d90 con 0x7fd1b40c4310 2023-10-24T02:01:44.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.612+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b40a4350 con 0x7fd1b40c4310 2023-10-24T02:01:44.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.613+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b40a46c0 con 0x7fd1b40c4310 2023-10-24T02:01:44.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.613+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd19c0123e0 con 0x7fd1b40c4310 2023-10-24T02:01:44.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.614+0000 7fd1aaffd700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 0x7fd194061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:44.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.614+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd19c079e80 con 0x7fd1b40c4310 2023-10-24T02:01:44.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.614+0000 7fd1b2d9d700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 0x7fd194061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:44.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.614+0000 7fd1b2d9d700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 0x7fd194061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd1b4167fc0 tx=0x7fd1a4007d20).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:44.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.618+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd19c04b0c0 con 0x7fd1b40c4310 2023-10-24T02:01:44.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.821+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1b4047480 con 0x7fd1b40c4310 2023-10-24T02:01:44.823 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.822+0000 7fd1aaffd700 1 -- 172.21.15.148:0/3905737804 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd19c04e6e0 con 0x7fd1b40c4310 2023-10-24T02:01:44.823 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T02:01:44.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 msgr2=0x7fd194061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 0x7fd194061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd1b4167fc0 tx=0x7fd1a4007d20).stop 2023-10-24T02:01:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 msgr2=0x7fd1b4165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fd19c00d860 tx=0x7fd19c008040).stop 2023-10-24T02:01:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 shutdown_connections 2023-10-24T02:01:44.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1b4154f10 0x7fd1b4165c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd19405f150 0x7fd194061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1b4063760 0x7fd1b40a31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 --2- 172.21.15.148:0/3905737804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd1b40c4310 0x7fd1b4165550 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:44.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 >> 172.21.15.148:0/3905737804 conn(0x7fd1b40c7ea0 msgr2=0x7fd1b40a6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:44.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 shutdown_connections 2023-10-24T02:01:44.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:44.824+0000 7fd1b90fa700 1 -- 172.21.15.148:0/3905737804 wait complete. 2023-10-24T02:01:44.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T02:01:44.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T02:01:44.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T02:01:44.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T02:01:44.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T02:01:44.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T02:01:44.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T02:01:44.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T02:01:44.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T02:01:44.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:44.840 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T02:01:44.855 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T02:01:44.855 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T02:01:44.855 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T02:01:44.855 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.856 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T02:01:44.856 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.856 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:01:44.856 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:01:44.856 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T02:01:44.857 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:01:44.857 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:01:44.857 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T02:01:44.857 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:01:44.857 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:01:44.858 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T02:01:44.858 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:01:44.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T02:01:44.858 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 36824sec preferred_lft 36824sec 2023-10-24T02:01:44.858 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.859 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T02:01:44.860 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.860 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T02:01:44.860 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T02:01:44.860 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T02:01:44.860 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.861 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T02:01:44.861 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T02:01:44.861 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T02:01:44.861 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:01:44.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:44.862 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T02:01:44.918 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T02:01:44.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:44.919 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T02:01:44.975 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T02:01:44.976 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T02:01:44.976 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T02:01:44.976 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T02:01:44.976 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T02:01:44.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:44.977 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T02:01:44.977 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T02:01:44.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T02:01:44.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T02:01:44.979 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T02:01:44.979 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T02:01:45.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:45.076 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T02:01:45.090 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T02:01:45.091 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T02:01:45.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T02:01:45.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:45.092 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T02:01:45.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:45.156 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T02:01:45.210 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T02:01:45.210 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:01:45.289 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:01:45.289 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T02:01:45.315 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:01:45.315 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T02:01:45.317 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T02:01:45.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:01:45.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T02:01:45.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T02:01:45.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.537+0000 7f26d48ca700 1 Processor -- start 2023-10-24T02:01:45.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.537+0000 7f26d48ca700 1 -- start start 2023-10-24T02:01:45.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.538+0000 7f26d48ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 0x7f26d00c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.538+0000 7f26d48ca700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d00c01c0 con 0x7f26d01547e0 2023-10-24T02:01:45.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.538+0000 7f26d48ca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d00c6150 con 0x7f26d00c0b30 2023-10-24T02:01:45.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.538+0000 7f26d48ca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d00aa960 con 0x7f26d0154400 2023-10-24T02:01:45.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cdd9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f26d01547e0 0x7f26d00a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58446/0 (socket says 172.21.15.148:58446) 2023-10-24T02:01:45.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cdd9b700 1 -- 172.21.15.148:0/2982778131 learned_addr learned my addr 172.21.15.148:0/2982778131 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:45.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26ce59c700 1 --2- 172.21.15.148:0/2982778131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 0x7f26d00c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130469462 0 0) 0x7f26d00c01c0 con 0x7f26d01547e0 2023-10-24T02:01:45.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26bc0033f0 con 0x7f26d01547e0 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941274799 0 0) 0x7f26d00c6150 con 0x7f26d00c0b30 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d00c01c0 con 0x7f26d00c0b30 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26ce59c700 1 -- 172.21.15.148:0/2982778131 >> v1:172.21.15.150:6789/0 conn(0x7f26d00c0b30 legacy=0x7f26d00c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26ce59c700 1 -- 172.21.15.148:0/2982778131 >> v1:172.21.15.148:6789/0 conn(0x7f26d01547e0 legacy=0x7f26d00a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26ce59c700 1 -- 172.21.15.148:0/2982778131 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00c66f0 con 0x7f26d0154400 2023-10-24T02:01:45.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26ce59c700 1 --2- 172.21.15.148:0/2982778131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 0x7f26d00c8310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f26c0009e90 tx=0x7f26c0009780).ready entity=mon.2 client_cookie=c8c22e2265c05be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000e070 con 0x7f26d0154400 2023-10-24T02:01:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c000bab0 con 0x7f26d0154400 2023-10-24T02:01:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.539+0000 7f26cd59a700 1 -- 172.21.15.148:0/2982778131 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000be30 con 0x7f26d0154400 2023-10-24T02:01:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 -- 172.21.15.148:0/2982778131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 msgr2=0x7f26d00c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2982778131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 0x7f26d00c8310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f26c0009e90 tx=0x7f26c0009780).stop 2023-10-24T02:01:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 -- 172.21.15.148:0/2982778131 shutdown_connections 2023-10-24T02:01:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2982778131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d0154400 0x7f26d00c8310 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 -- 172.21.15.148:0/2982778131 >> 172.21.15.148:0/2982778131 conn(0x7f26d00946a0 msgr2=0x7f26d006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 -- 172.21.15.148:0/2982778131 shutdown_connections 2023-10-24T02:01:45.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.540+0000 7f26d48ca700 1 -- 172.21.15.148:0/2982778131 wait complete. 2023-10-24T02:01:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.541+0000 7f26d48ca700 1 Processor -- start 2023-10-24T02:01:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.541+0000 7f26d48ca700 1 -- start start 2023-10-24T02:01:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d00c0b30 0x7f26d0167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26d0154400 0x7f26d00ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01558c0 con 0x7f26d01547e0 2023-10-24T02:01:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0154cb0 con 0x7f26d0154400 2023-10-24T02:01:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26d48ca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0154f90 con 0x7f26d00c0b30 2023-10-24T02:01:45.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49970/0 (socket says 172.21.15.148:49970) 2023-10-24T02:01:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 -- 172.21.15.148:0/2955955824 learned_addr learned my addr 172.21.15.148:0/2955955824 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26cdd9b700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26d0154400 0x7f26d00ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ce59c700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d00c0b30 0x7f26d0167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 -- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d00c0b30 msgr2=0x7f26d0167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d00c0b30 0x7f26d0167970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 -- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26d0154400 msgr2=0x7f26d00ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26d0154400 0x7f26d00ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 -- 172.21.15.148:0/2955955824 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009a20 con 0x7f26d01547e0 2023-10-24T02:01:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.542+0000 7f26ced9d700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f26c800c4c0 tx=0x7f26c8007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.543+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800ce10 con 0x7f26d01547e0 2023-10-24T02:01:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.543+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c800f470 con 0x7f26d01547e0 2023-10-24T02:01:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.543+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d0155270 con 0x7f26d01547e0 2023-10-24T02:01:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.543+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800f810 con 0x7f26d01547e0 2023-10-24T02:01:45.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.543+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d0167e60 con 0x7f26d01547e0 2023-10-24T02:01:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.544+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d006c6b0 con 0x7f26d01547e0 2023-10-24T02:01:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.544+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f26c800fc00 con 0x7f26d01547e0 2023-10-24T02:01:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.544+0000 7f26c67fc700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 0x7f26b00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.544+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f26c8079530 con 0x7f26d01547e0 2023-10-24T02:01:45.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.544+0000 7f26ce59c700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 0x7f26b00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.545+0000 7f26ce59c700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 0x7f26b00615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f26c0009480 tx=0x7f26c0009780).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.548+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f26c8048af0 con 0x7f26d01547e0 2023-10-24T02:01:45.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.735+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f26d00bffa0 con 0x7f26b005f120 2023-10-24T02:01:45.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.737+0000 7f26c67fc700 1 -- 172.21.15.148:0/2955955824 <== mgr.7694 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f26d00bffa0 con 0x7f26b005f120 2023-10-24T02:01:45.739 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T02:01:45.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:01:45.739 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T02:01:45.739 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:01:45.739 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T02:01:45.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 msgr2=0x7f26b00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 0x7f26b00615e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f26c0009480 tx=0x7f26c0009780).stop 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 msgr2=0x7f26d0164c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f26c800c4c0 tx=0x7f26c8007c00).stop 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 shutdown_connections 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26d01547e0 0x7f26d0164c30 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26d00c0b30 0x7f26d0167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f26b005f120 0x7f26b00615e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 --2- 172.21.15.148:0/2955955824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26d0154400 0x7f26d00ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 >> 172.21.15.148:0/2955955824 conn(0x7f26d00946a0 msgr2=0x7f26d0153790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:45.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 shutdown_connections 2023-10-24T02:01:45.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.739+0000 7f26d48ca700 1 -- 172.21.15.148:0/2955955824 wait complete. 2023-10-24T02:01:45.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T02:01:45.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.867+0000 7fe2cc5a4700 1 Processor -- start 2023-10-24T02:01:45.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.867+0000 7fe2cc5a4700 1 -- start start 2023-10-24T02:01:45.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2cc5a4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2c4154430 0x7fe2c4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2cc5a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4098bd0 0x7fe2c40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2cc5a4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40c71d0 con 0x7fe2c40bffd0 2023-10-24T02:01:45.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2cc5a4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40c9410 con 0x7fe2c4154430 2023-10-24T02:01:45.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2cc5a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40c6c10 con 0x7fe2c4098bd0 2023-10-24T02:01:45.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2c4154430 0x7fe2c4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe2c4154430 0x7fe2c4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49980/0 (socket says 172.21.15.148:49980) 2023-10-24T02:01:45.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 -- 172.21.15.148:0/356678954 learned_addr learned my addr 172.21.15.148:0/356678954 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:45.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 -- 172.21.15.148:0/356678954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4098bd0 msgr2=0x7fe2c40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:45.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 --2- 172.21.15.148:0/356678954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4098bd0 0x7fe2c40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 -- 172.21.15.148:0/356678954 >> v1:172.21.15.150:6789/0 conn(0x7fe2c40bffd0 legacy=0x7fe2c40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 -- 172.21.15.148:0/356678954 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40c6ef0 con 0x7fe2c4154430 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2ca340700 1 --2- 172.21.15.148:0/356678954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4154430 0x7fe2c4154810 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fe2bc009830 tx=0x7fe2bc0090f0).ready entity=mon.0 client_cookie=b4a8818d7303a1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2c933e700 1 -- 172.21.15.148:0/356678954 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00b600 con 0x7fe2c4154430 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2c933e700 1 -- 172.21.15.148:0/356678954 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00b760 con 0x7fe2c4154430 2023-10-24T02:01:45.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.868+0000 7fe2c933e700 1 -- 172.21.15.148:0/356678954 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00bae0 con 0x7fe2c4154430 2023-10-24T02:01:45.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/356678954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4154430 msgr2=0x7fe2c4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/356678954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4154430 0x7fe2c4154810 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fe2bc009830 tx=0x7fe2bc0090f0).stop 2023-10-24T02:01:45.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/356678954 shutdown_connections 2023-10-24T02:01:45.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/356678954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4154430 0x7fe2c4154810 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/356678954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4098bd0 0x7fe2c40c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:45.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/356678954 >> 172.21.15.148:0/356678954 conn(0x7fe2c40cb070 msgr2=0x7fe2c40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:45.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/356678954 shutdown_connections 2023-10-24T02:01:45.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.869+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/356678954 wait complete. 2023-10-24T02:01:45.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.870+0000 7fe2cc5a4700 1 Processor -- start 2023-10-24T02:01:45.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.870+0000 7fe2cc5a4700 1 -- start start 2023-10-24T02:01:45.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2c40bffd0 0x7fe2c414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4154430 0x7fe2c40c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414bba0 con 0x7fe2c4098bd0 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c414b220 con 0x7fe2c40bffd0 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cc5a4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40c3e70 con 0x7fe2c4154430 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49992/0 (socket says 172.21.15.148:49992) 2023-10-24T02:01:45.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 -- 172.21.15.148:0/861794250 learned_addr learned my addr 172.21.15.148:0/861794250 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2cab41700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4154430 0x7fe2c40c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 -- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4154430 msgr2=0x7fe2c40c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4154430 0x7fe2c40c3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 -- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2c40bffd0 msgr2=0x7fe2c414b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:45.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2c40bffd0 0x7fe2c414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 -- 172.21.15.148:0/861794250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009370 con 0x7fe2c4098bd0 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.871+0000 7fe2ca340700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7fe2c40c5910 tx=0x7fe2bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.872+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00b8d0 con 0x7fe2c4098bd0 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.872+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00ba30 con 0x7fe2c4098bd0 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.872+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc01b660 con 0x7fe2c4098bd0 2023-10-24T02:01:45.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.872+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c414a8f0 con 0x7fe2c4098bd0 2023-10-24T02:01:45.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.872+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c414aeb0 con 0x7fe2c4098bd0 2023-10-24T02:01:45.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.873+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c414b040 con 0x7fe2c4098bd0 2023-10-24T02:01:45.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.873+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 89) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe2bc01ba10 con 0x7fe2c4098bd0 2023-10-24T02:01:45.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.873+0000 7fe2ba7fc700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 0x7fe2a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:45.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.873+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fe2bc07bb80 con 0x7fe2c4098bd0 2023-10-24T02:01:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.874+0000 7fe2c9b3f700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 0x7fe2a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.874+0000 7fe2c9b3f700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 0x7fe2a8061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe2c40afc90 tx=0x7fe2b4006c30).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:45.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:45.877+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe2bc04ce20 con 0x7fe2c4098bd0 2023-10-24T02:01:46.087 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.085+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe2c414b500 con 0x7fe2c4098bd0 2023-10-24T02:01:46.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.860+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 90) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fe2bc079920 con 0x7fe2c4098bd0 2023-10-24T02:01:46.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.861+0000 7fe2ba7fc700 1 -- 172.21.15.148:0/861794250 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v90) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe2bc042f80 con 0x7fe2c4098bd0 2023-10-24T02:01:46.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 msgr2=0x7fe2a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:46.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 0x7fe2a8061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe2c40afc90 tx=0x7fe2b4006c30).stop 2023-10-24T02:01:46.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 msgr2=0x7fe2c40c4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:46.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7fe2c40c5910 tx=0x7fe2bc017000).stop 2023-10-24T02:01:46.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 shutdown_connections 2023-10-24T02:01:46.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2c4154430 0x7fe2c40c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:46.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c4098bd0 0x7fe2c40c4ee0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:46.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe2a805f150 0x7fe2a8061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:46.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 --2- 172.21.15.148:0/861794250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2c40bffd0 0x7fe2c414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:46.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 >> 172.21.15.148:0/861794250 conn(0x7fe2c40cb070 msgr2=0x7fe2c40c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:46.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 shutdown_connections 2023-10-24T02:01:46.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:46.865+0000 7fe2cc5a4700 1 -- 172.21.15.148:0/861794250 wait complete. 2023-10-24T02:01:46.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T02:01:47.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.003+0000 7f8980975700 1 Processor -- start 2023-10-24T02:01:47.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.003+0000 7f8980975700 1 -- start start 2023-10-24T02:01:47.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8980975700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c151970 0x7f897c0c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8980975700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f897c0bc7a0 0x7f897c0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8980975700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c151220 con 0x7f897c0c1f10 2023-10-24T02:01:47.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8980975700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0c3210 con 0x7f897c0bc7a0 2023-10-24T02:01:47.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8980975700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c2390 con 0x7f897c151970 2023-10-24T02:01:47.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897a59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f897c0c1f10 0x7f897c0bc090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58454/0 (socket says 172.21.15.148:58454) 2023-10-24T02:01:47.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897a59c700 1 -- 172.21.15.148:0/2237661381 learned_addr learned my addr 172.21.15.148:0/2237661381 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:47.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 --2- 172.21.15.148:0/2237661381 >> v2:172.21.15.148:3300/0 conn(0x7f897c0bc7a0 0x7f897c0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897ad9d700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c151970 0x7f897c0c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8979d9b700 1 -- 172.21.15.148:0/2237661381 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575935725 0 0) 0x7f897c151220 con 0x7f897c0c1f10 2023-10-24T02:01:47.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f8979d9b700 1 -- 172.21.15.148:0/2237661381 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89640033f0 con 0x7f897c0c1f10 2023-10-24T02:01:47.008 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f4ea88f9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:01:47.010 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:47.004+0000 7f509cbd2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:01:47.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 -- 172.21.15.148:0/2237661381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c151970 msgr2=0x7f897c0c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:47.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c151970 0x7f897c0c1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 -- 172.21.15.148:0/2237661381 >> v1:172.21.15.148:6789/0 conn(0x7f897c0c1f10 legacy=0x7f897c0bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 -- 172.21.15.148:0/2237661381 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0c2600 con 0x7f897c0bc7a0 2023-10-24T02:01:47.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.004+0000 7f897b59e700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c0bc7a0 0x7f897c0644a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f8974009e60 tx=0x7f8974009780).ready entity=mon.0 client_cookie=5b5d1222893049c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:47.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8979d9b700 1 -- 172.21.15.148:0/2237661381 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400e070 con 0x7f897c0bc7a0 2023-10-24T02:01:47.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8979d9b700 1 -- 172.21.15.148:0/2237661381 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400bab0 con 0x7f897c0bc7a0 2023-10-24T02:01:47.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8979d9b700 1 -- 172.21.15.148:0/2237661381 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400be30 con 0x7f897c0bc7a0 2023-10-24T02:01:47.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 -- 172.21.15.148:0/2237661381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c0bc7a0 msgr2=0x7f897c0644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c0bc7a0 0x7f897c0644a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f8974009e60 tx=0x7f8974009780).stop 2023-10-24T02:01:47.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 -- 172.21.15.148:0/2237661381 shutdown_connections 2023-10-24T02:01:47.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c0bc7a0 0x7f897c0644a0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 --2- 172.21.15.148:0/2237661381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c151970 0x7f897c0c1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 -- 172.21.15.148:0/2237661381 >> 172.21.15.148:0/2237661381 conn(0x7f897c063120 msgr2=0x7f897c0c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:47.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 -- 172.21.15.148:0/2237661381 shutdown_connections 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.005+0000 7f8980975700 1 -- 172.21.15.148:0/2237661381 wait complete. 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.006+0000 7f8980975700 1 Processor -- start 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.006+0000 7f8980975700 1 -- start start 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c0bc7a0 0x7f897c137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f897c0c1f10 0x7f897c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0c5360 con 0x7f897c151970 2023-10-24T02:01:47.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c160c10 con 0x7f897c0c1f10 2023-10-24T02:01:47.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f8980975700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1614b0 con 0x7f897c0bc7a0 2023-10-24T02:01:47.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f897b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f897b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50036/0 (socket says 172.21.15.148:50036) 2023-10-24T02:01:47.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f897b59e700 1 -- 172.21.15.148:0/901531184 learned_addr learned my addr 172.21.15.148:0/901531184 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:47.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f897ad9d700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c0bc7a0 0x7f897c137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.007+0000 7f897a59c700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f897c0c1f10 0x7f897c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 -- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c0bc7a0 msgr2=0x7f897c137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c0bc7a0 0x7f897c137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 -- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f897c0c1f10 msgr2=0x7f897c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f897c0c1f10 0x7f897c0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 -- 172.21.15.148:0/901531184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8974009a20 con 0x7f897c151970 2023-10-24T02:01:47.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f897b59e700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f897400b610 tx=0x7f8974009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:47.019 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974021070 con 0x7f897c151970 2023-10-24T02:01:47.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897401d630 con 0x7f897c151970 2023-10-24T02:01:47.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c160890 con 0x7f897c151970 2023-10-24T02:01:47.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897401d9f0 con 0x7f897c151970 2023-10-24T02:01:47.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.008+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c161140 con 0x7f897c151970 2023-10-24T02:01:47.020 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.009+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c047480 con 0x7f897c151970 2023-10-24T02:01:47.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.009+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 90) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f8974003040 con 0x7f897c151970 2023-10-24T02:01:47.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.010+0000 7f8962ffd700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 0x7f8968061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.010+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f897407bf70 con 0x7f897c151970 2023-10-24T02:01:47.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.010+0000 7f897ad9d700 1 -- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 msgr2=0x7f8968061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:47.021 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.010+0000 7f897ad9d700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 0x7f8968061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:47.022 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.014+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f89740aaaf0 con 0x7f897c151970 2023-10-24T02:01:47.069 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:47.068+0000 7f509cbd2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:01:47.071 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:47.070+0000 7f4ea88f9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:01:47.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.187+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f897c0c28e0 con 0x7f897c151970 2023-10-24T02:01:47.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.191+0000 7f8962ffd700 1 -- 172.21.15.148:0/901531184 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f897404d210 con 0x7f897c151970 2023-10-24T02:01:47.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 msgr2=0x7f8968061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:47.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 0x7f8968061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 msgr2=0x7f897c0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f897400b610 tx=0x7f8974009780).stop 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 shutdown_connections 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f897c151970 0x7f897c0c4e70 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f897c0bc7a0 0x7f897c137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f896805f1a0 0x7f8968061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:47.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 --2- 172.21.15.148:0/901531184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f897c0c1f10 0x7f897c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.192+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 >> 172.21.15.148:0/901531184 conn(0x7f897c063120 msgr2=0x7f897c150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:47.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.193+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 shutdown_connections 2023-10-24T02:01:47.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.193+0000 7f8980975700 1 -- 172.21.15.148:0/901531184 wait complete. 2023-10-24T02:01:47.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:47.207 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T02:01:47.224 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-24T02:01:47.346 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:47.344+0000 7f509cbd2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:01:47.356 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:47.355+0000 7f4ea88f9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:01:47.381 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:01:47.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:01:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.386+0000 7fcd0ca49700 1 Processor -- start 2023-10-24T02:01:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.386+0000 7fcd0ca49700 1 -- start start 2023-10-24T02:01:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0ca49700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd08069910 0x7fcd08151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0ca49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd080c1a60 0x7fcd080c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0ca49700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd080c3c30 con 0x7fcd08150e30 2023-10-24T02:01:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0ca49700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080667a0 con 0x7fcd08069910 2023-10-24T02:01:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0ca49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080c3670 con 0x7fcd080c1a60 2023-10-24T02:01:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd05d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd08069910 0x7fcd08151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fcd08150e30 0x7fcd080c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58460/0 (socket says 172.21.15.148:58460) 2023-10-24T02:01:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd05d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fcd08069910 0x7fcd08151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50040/0 (socket says 172.21.15.148:50040) 2023-10-24T02:01:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd0659c700 1 -- 172.21.15.148:0/1959060350 learned_addr learned my addr 172.21.15.148:0/1959060350 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.387+0000 7fcd06d9d700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd080c1a60 0x7fcd080c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd05d9b700 1 -- 172.21.15.148:0/1959060350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd080c1a60 msgr2=0x7fcd080c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:47.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd080c1a60 0x7fcd080c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd05d9b700 1 -- 172.21.15.148:0/1959060350 >> v1:172.21.15.148:6789/0 conn(0x7fcd08150e30 legacy=0x7fcd080c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd05d9b700 1 -- 172.21.15.148:0/1959060350 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080c3950 con 0x7fcd08069910 2023-10-24T02:01:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd0559a700 1 -- 172.21.15.148:0/1959060350 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120893885 0 0) 0x7fcd080c3c30 con 0x7fcd08150e30 2023-10-24T02:01:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08151210 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc009060).ready entity=mon.0 client_cookie=181d7f8290c6fd9c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:47.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd0559a700 1 -- 172.21.15.148:0/1959060350 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f510 con 0x7fcd08069910 2023-10-24T02:01:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd0559a700 1 -- 172.21.15.148:0/1959060350 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00f670 con 0x7fcd08069910 2023-10-24T02:01:47.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.388+0000 7fcd0559a700 1 -- 172.21.15.148:0/1959060350 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f9f0 con 0x7fcd08069910 2023-10-24T02:01:47.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 -- 172.21.15.148:0/1959060350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 msgr2=0x7fcd08151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08151210 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc009060).stop 2023-10-24T02:01:47.397 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 -- 172.21.15.148:0/1959060350 shutdown_connections 2023-10-24T02:01:47.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd080c1a60 0x7fcd080c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/1959060350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08151210 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 -- 172.21.15.148:0/1959060350 >> 172.21.15.148:0/1959060350 conn(0x7fcd080c49d0 msgr2=0x7fcd08068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:47.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 -- 172.21.15.148:0/1959060350 shutdown_connections 2023-10-24T02:01:47.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.389+0000 7fcd0ca49700 1 -- 172.21.15.148:0/1959060350 wait complete. 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.391+0000 7fcd0ca49700 1 Processor -- start 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.391+0000 7fcd0ca49700 1 -- start start 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c1a60 0x7fcd081672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08150e30 0x7fcd080bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081655b0 con 0x7fcd08069910 2023-10-24T02:01:47.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080a8c30 con 0x7fcd080c1a60 2023-10-24T02:01:47.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0ca49700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081652d0 con 0x7fcd08150e30 2023-10-24T02:01:47.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50042/0 (socket says 172.21.15.148:50042) 2023-10-24T02:01:47.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd0659c700 1 -- 172.21.15.148:0/2540984157 learned_addr learned my addr 172.21.15.148:0/2540984157 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd06d9d700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08150e30 0x7fcd080bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.392+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c1a60 0x7fcd081672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08150e30 msgr2=0x7fcd080bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08150e30 0x7fcd080bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c1a60 msgr2=0x7fcd081672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:47.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c1a60 0x7fcd081672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:47.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0092a0 con 0x7fcd08069910 2023-10-24T02:01:47.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0659c700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fccf800c460 tx=0x7fccf8007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:47.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80070d0 con 0x7fcd08069910 2023-10-24T02:01:47.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8007230 con 0x7fcd08069910 2023-10-24T02:01:47.402 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080a85e0 con 0x7fcd08069910 2023-10-24T02:01:47.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80075b0 con 0x7fcd08069910 2023-10-24T02:01:47.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.393+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd081677a0 con 0x7fcd08069910 2023-10-24T02:01:47.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.394+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd080a8440 con 0x7fcd08069910 2023-10-24T02:01:47.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.395+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 90) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fccf80059b0 con 0x7fcd08069910 2023-10-24T02:01:47.403 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.395+0000 7fccf67fc700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:47.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.395+0000 7fcd05d9b700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:47.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.395+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fccf8079980 con 0x7fcd08069910 2023-10-24T02:01:47.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.395+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:01:47.404 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.403+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcd080a8440 con 0x7fcd08069910 2023-10-24T02:01:47.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.596+0000 7fcd05d9b700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:47.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.596+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:01:47.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.601+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd080a8440 con 0x7fcce805f1a0 2023-10-24T02:01:47.962 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:47.961+0000 7f509cbd2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:01:47.979 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:47.978+0000 7f4ea88f9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:01:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.997+0000 7fcd05d9b700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:47.998 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:47.997+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T02:01:48.034 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.033+0000 7f509cbd2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:01:48.051 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.050+0000 7f4ea88f9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:01:48.221 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.220+0000 7f509cbd2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:01:48.237 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.236+0000 7f4ea88f9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:01:48.642 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.641+0000 7f509cbd2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:01:48.656 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.655+0000 7f4ea88f9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:01:48.745 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.743+0000 7f509cbd2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:48.759 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.758+0000 7f4ea88f9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:48.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:48.798+0000 7fcd05d9b700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:48.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:48.798+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T02:01:48.898 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.896+0000 7f509cbd2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:48.913 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.911+0000 7f4ea88f9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:48.972 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:48.971+0000 7f509cbd2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:01:48.987 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:48.986+0000 7f4ea88f9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:01:49.040 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:49.039+0000 7f509cbd2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:01:49.054 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:49.052+0000 7f4ea88f9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:01:49.299 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:49.297+0000 7f509cbd2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:01:49.311 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:49.309+0000 7f4ea88f9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:01:49.488 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:49.486+0000 7f509cbd2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:49.496 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:49.495+0000 7f4ea88f9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:01:50.139 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.137+0000 7f509cbd2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:01:50.147 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.146+0000 7f4ea88f9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:01:50.207 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.206+0000 7f509cbd2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:01:50.216 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.215+0000 7f4ea88f9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:01:50.283 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.281+0000 7f509cbd2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:01:50.290 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.289+0000 7f4ea88f9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:01:50.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:50.400+0000 7fcd05d9b700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:01:50.401 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:50.400+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T02:01:50.430 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.429+0000 7f509cbd2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:01:50.436 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.435+0000 7f4ea88f9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:01:50.500 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.499+0000 7f509cbd2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:01:50.507 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.506+0000 7f4ea88f9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:01:50.614 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.613+0000 7f509cbd2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:01:50.623 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.621+0000 7f4ea88f9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:01:50.722 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:50.721+0000 7f509cbd2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:50.733 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:50.731+0000 7f4ea88f9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:01:51.022 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.020+0000 7f509cbd2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:01:51.028 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:51.027+0000 7f4ea88f9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:01:51.095 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.094+0000 7f509cbd2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:01:51.102 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:01:51.101+0000 7f4ea88f9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:01:51.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:51.115+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 91) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fccf8077720 con 0x7fcd08069910 2023-10-24T02:01:51.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:51.116+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce8061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:01:51.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:51.116+0000 7fccf67fc700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:51.167 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f5011359700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.167 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f5011359700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.167 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f5011359700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.167 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f5011359700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.168 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f5011359700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.168 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f501435f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.168 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f501435f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.168 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f501435f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.168 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f501435f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:51.169 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:01:51.165+0000 7f501435f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:01:52.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.115+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fccf8077aa0 con 0x7fcd08069910 2023-10-24T02:01:52.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.116+0000 7fccf67fc700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.116+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd080a8440 con 0x7fcce805f1a0 2023-10-24T02:01:52.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.117+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.118+0000 7fcd05d9b700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce80615e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc017000).ready entity=mgr.8944 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.131+0000 7fccf67fc700 1 -- 172.21.15.148:0/2540984157 <== mgr.8944 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcd080a8440 con 0x7fcce805f1a0 2023-10-24T02:01:52.133 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T02:01:52.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.133+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 msgr2=0x7fcce80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.133+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce80615e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fccfc009760 tx=0x7fccfc017000).stop 2023-10-24T02:01:52.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.133+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 msgr2=0x7fcd08165740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.133+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fccf800c460 tx=0x7fccf8007e90).stop 2023-10-24T02:01:52.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.133+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 shutdown_connections 2023-10-24T02:01:52.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd08150e30 0x7fcd080bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd08069910 0x7fcd08165740 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fcce805f1a0 0x7fcce80615e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 --2- 172.21.15.148:0/2540984157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd080c1a60 0x7fcd081672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 >> 172.21.15.148:0/2540984157 conn(0x7fcd080c49d0 msgr2=0x7fcd080c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:52.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 shutdown_connections 2023-10-24T02:01:52.137 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.134+0000 7fcd0ca49700 1 -- 172.21.15.148:0/2540984157 wait complete. 2023-10-24T02:01:52.148 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T02:01:52.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-24T02:01:52.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.267+0000 7fa051855700 1 Processor -- start 2023-10-24T02:01:52.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.267+0000 7fa051855700 1 -- start start 2023-10-24T02:01:52.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa051855700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa04c0c06e0 0x7fa04c154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa051855700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0c71d0 con 0x7fa04c154430 2023-10-24T02:01:52.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa051855700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0c9410 con 0x7fa04c098bd0 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa051855700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c0c6a10 con 0x7fa04c0c06e0 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa04c154430 0x7fa04c0c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:58466/0 (socket says 172.21.15.148:58466) 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04affd700 1 -- 172.21.15.148:0/2051958910 learned_addr learned my addr 172.21.15.148:0/2051958910 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04b7fe700 1 --2- 172.21.15.148:0/2051958910 >> v2:172.21.15.150:3300/0 conn(0x7fa04c0c06e0 0x7fa04c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925134464 0 0) 0x7fa04c0c71d0 con 0x7fa04c154430 2023-10-24T02:01:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0340033f0 con 0x7fa04c154430 2023-10-24T02:01:52.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04b7fe700 1 -- 172.21.15.148:0/2051958910 >> v1:172.21.15.150:6789/0 conn(0x7fa04c098bd0 legacy=0x7fa04c0bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120405847 0 0) 0x7fa04c0c9410 con 0x7fa04c098bd0 2023-10-24T02:01:52.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04b7fe700 1 -- 172.21.15.148:0/2051958910 >> v1:172.21.15.148:6789/0 conn(0x7fa04c154430 legacy=0x7fa04c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.268+0000 7fa04b7fe700 1 -- 172.21.15.148:0/2051958910 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0ca8b0 con 0x7fa04c0c06e0 2023-10-24T02:01:52.273 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa04b7fe700 1 --2- 172.21.15.148:0/2051958910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c154810 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa03c009760 tx=0x7fa03c009060).ready entity=mon.1 client_cookie=ab26c8fe5212d02b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00f510 con 0x7fa04c0c06e0 2023-10-24T02:01:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00f670 con 0x7fa04c0c06e0 2023-10-24T02:01:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa049ffb700 1 -- 172.21.15.148:0/2051958910 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00f9f0 con 0x7fa04c0c06e0 2023-10-24T02:01:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 -- 172.21.15.148:0/2051958910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 msgr2=0x7fa04c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 --2- 172.21.15.148:0/2051958910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c154810 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fa03c009760 tx=0x7fa03c009060).stop 2023-10-24T02:01:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 -- 172.21.15.148:0/2051958910 shutdown_connections 2023-10-24T02:01:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 --2- 172.21.15.148:0/2051958910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c154810 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 -- 172.21.15.148:0/2051958910 >> 172.21.15.148:0/2051958910 conn(0x7fa04c0cb070 msgr2=0x7fa04c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 -- 172.21.15.148:0/2051958910 shutdown_connections 2023-10-24T02:01:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.269+0000 7fa051855700 1 -- 172.21.15.148:0/2051958910 wait complete. 2023-10-24T02:01:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 Processor -- start 2023-10-24T02:01:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 -- start start 2023-10-24T02:01:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 0x7fa04c146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1473f0 con 0x7fa04c098bd0 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0aecb0 con 0x7fa04c0c06e0 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa051855700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ae0a0 con 0x7fa04c154430 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa04affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa04affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50058/0 (socket says 172.21.15.148:50058) 2023-10-24T02:01:52.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.271+0000 7fa04affd700 1 -- 172.21.15.148:0/1691974999 learned_addr learned my addr 172.21.15.148:0/1691974999 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:52.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04a7fc700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04b7fe700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 0x7fa04c146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 -- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 msgr2=0x7fa04c146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 0x7fa04c146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 -- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 msgr2=0x7fa04c146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 -- 172.21.15.148:0/1691974999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0092a0 con 0x7fa04c098bd0 2023-10-24T02:01:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04b7fe700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 0x7fa04c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:01:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa04affd700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fa044002250 tx=0x7fa0440015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044005d30 con 0x7fa04c098bd0 2023-10-24T02:01:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044005e90 con 0x7fa04c098bd0 2023-10-24T02:01:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044007340 con 0x7fa04c098bd0 2023-10-24T02:01:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c0ae380 con 0x7fa04c098bd0 2023-10-24T02:01:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.272+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0ae940 con 0x7fa04c098bd0 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.273+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c06c6b0 con 0x7fa04c098bd0 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.273+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fa0440076f0 con 0x7fa04c098bd0 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.274+0000 7fa032ffd700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 0x7fa038061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.274+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fa04407a0f0 con 0x7fa04c098bd0 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.274+0000 7fa04a7fc700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 0x7fa038061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.274+0000 7fa04a7fc700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 0x7fa038061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa040007fd0 tx=0x7fa040007bb0).ready entity=mgr.8944 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.278+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa04404b4b0 con 0x7fa04c098bd0 2023-10-24T02:01:52.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.463+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa04c0c6c10 con 0x7fa03805f080 2023-10-24T02:01:52.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.468+0000 7fa032ffd700 1 -- 172.21.15.148:0/1691974999 <== mgr.8944 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fa04c0c6c10 con 0x7fa03805f080 2023-10-24T02:01:52.469 INFO:teuthology.orchestra.run.smithi148.stdout:Retention added to path snap_test_dir1 2023-10-24T02:01:52.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 msgr2=0x7fa038061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 0x7fa038061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa040007fd0 tx=0x7fa040007bb0).stop 2023-10-24T02:01:52.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 msgr2=0x7fa04c0ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fa044002250 tx=0x7fa0440015b0).stop 2023-10-24T02:01:52.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 shutdown_connections 2023-10-24T02:01:52.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa04c154430 0x7fa04c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa04c098bd0 0x7fa04c0ab3c0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa03805f080 0x7fa038061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 --2- 172.21.15.148:0/1691974999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa04c0c06e0 0x7fa04c146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 >> 172.21.15.148:0/1691974999 conn(0x7fa04c0cb070 msgr2=0x7fa04c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:52.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 shutdown_connections 2023-10-24T02:01:52.474 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.470+0000 7fa051855700 1 -- 172.21.15.148:0/1691974999 wait complete. 2023-10-24T02:01:52.483 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-24T02:01:52.484 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-24-02_02_00 in ~8s... 2023-10-24T02:01:52.484 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-24T02:01:52.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-24T02:01:52.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.599+0000 7f71cff78700 1 Processor -- start 2023-10-24T02:01:52.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.599+0000 7f71cff78700 1 -- start start 2023-10-24T02:01:52.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cff78700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71c81544b0 0x7f71c80a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cff78700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c80aa640 0x7f71c80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cff78700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80c6270 con 0x7f71c80c8290 2023-10-24T02:01:52.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cff78700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80c60e0 con 0x7f71c81544b0 2023-10-24T02:01:52.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cff78700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80c0c80 con 0x7f71c80aa640 2023-10-24T02:01:52.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cdd14700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71c81544b0 0x7f71c80a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cdd14700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f71c81544b0 0x7f71c80a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50068/0 (socket says 172.21.15.148:50068) 2023-10-24T02:01:52.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.600+0000 7f71cdd14700 1 -- 172.21.15.148:0/776717289 learned_addr learned my addr 172.21.15.148:0/776717289 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:52.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cdd14700 1 -- 172.21.15.148:0/776717289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c80aa640 msgr2=0x7f71c80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:52.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cdd14700 1 --2- 172.21.15.148:0/776717289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c80aa640 0x7f71c80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:52.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cdd14700 1 -- 172.21.15.148:0/776717289 >> v1:172.21.15.150:6789/0 conn(0x7f71c80c8290 legacy=0x7f71c80a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:01:52.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cdd14700 1 -- 172.21.15.148:0/776717289 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80c0f40 con 0x7f71c81544b0 2023-10-24T02:01:52.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cdd14700 1 --2- 172.21.15.148:0/776717289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c81544b0 0x7f71c80a7d00 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f71c4009f20 tx=0x7f71c4009840).ready entity=mon.0 client_cookie=ba236f36f02a1705 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71ccd12700 1 -- 172.21.15.148:0/776717289 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400e070 con 0x7f71c81544b0 2023-10-24T02:01:52.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71ccd12700 1 -- 172.21.15.148:0/776717289 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400ba40 con 0x7f71c81544b0 2023-10-24T02:01:52.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71ccd12700 1 -- 172.21.15.148:0/776717289 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400bdc0 con 0x7f71c81544b0 2023-10-24T02:01:52.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 -- 172.21.15.148:0/776717289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c81544b0 msgr2=0x7f71c80a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 --2- 172.21.15.148:0/776717289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c81544b0 0x7f71c80a7d00 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f71c4009f20 tx=0x7f71c4009840).stop 2023-10-24T02:01:52.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 -- 172.21.15.148:0/776717289 shutdown_connections 2023-10-24T02:01:52.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 --2- 172.21.15.148:0/776717289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c80aa640 0x7f71c80c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:01:52.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 --2- 172.21.15.148:0/776717289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c81544b0 0x7f71c80a7d00 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.601+0000 7f71cff78700 1 -- 172.21.15.148:0/776717289 >> 172.21.15.148:0/776717289 conn(0x7f71c80945d0 msgr2=0x7f71c806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:52.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.602+0000 7f71cff78700 1 -- 172.21.15.148:0/776717289 shutdown_connections 2023-10-24T02:01:52.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.602+0000 7f71cff78700 1 -- 172.21.15.148:0/776717289 wait complete. 2023-10-24T02:01:52.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 Processor -- start 2023-10-24T02:01:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 -- start start 2023-10-24T02:01:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71c80aa640 0x7f71c80c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c81544b0 0x7f71c8164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80c97e0 con 0x7f71c80c8290 2023-10-24T02:01:52.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8168690 con 0x7f71c80aa640 2023-10-24T02:01:52.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.603+0000 7f71cff78700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8168970 con 0x7f71c81544b0 2023-10-24T02:01:52.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50074/0 (socket says 172.21.15.148:50074) 2023-10-24T02:01:52.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cdd14700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71c80aa640 0x7f71c80c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 -- 172.21.15.148:0/3931662956 learned_addr learned my addr 172.21.15.148:0/3931662956 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71ce515700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c81544b0 0x7f71c8164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 -- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c81544b0 msgr2=0x7f71c8164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c81544b0 0x7f71c8164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 -- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71c80aa640 msgr2=0x7f71c80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71c80aa640 0x7f71c80c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 -- 172.21.15.148:0/3931662956 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009ae0 con 0x7f71c80c8290 2023-10-24T02:01:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cd513700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f71b800c440 tx=0x7f71b8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8012400 con 0x7f71c80c8290 2023-10-24T02:01:52.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b8012580 con 0x7f71c80c8290 2023-10-24T02:01:52.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8168c50 con 0x7f71c80c8290 2023-10-24T02:01:52.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8012940 con 0x7f71c80c8290 2023-10-24T02:01:52.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.604+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c8168360 con 0x7f71c80c8290 2023-10-24T02:01:52.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.605+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 92) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f71b8012d30 con 0x7f71c80c8290 2023-10-24T02:01:52.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.605+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c80adff0 con 0x7f71c80c8290 2023-10-24T02:01:52.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.606+0000 7f71bdffb700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 0x7f71ac061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:01:52.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.606+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f71b8079400 con 0x7f71c80c8290 2023-10-24T02:01:52.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.606+0000 7f71cdd14700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 0x7f71ac061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:01:52.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.606+0000 7f71cdd14700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 0x7f71ac061570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f71c400ba10 tx=0x7f71c4009840).ready entity=mgr.8944 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:01:52.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.610+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71b8048af0 con 0x7f71c80c8290 2023-10-24T02:01:52.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.797+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71c806c6b0 con 0x7f71ac05f0b0 2023-10-24T02:01:52.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.800+0000 7f71bdffb700 1 -- 172.21.15.148:0/3931662956 <== mgr.8944 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f71c806c6b0 con 0x7f71ac05f0b0 2023-10-24T02:01:52.801 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:01:52.801 INFO:teuthology.orchestra.run.smithi148.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-24T02:01:52.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 msgr2=0x7f71ac061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 0x7f71ac061570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f71c400ba10 tx=0x7f71c4009840).stop 2023-10-24T02:01:52.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 msgr2=0x7f71c80c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:01:52.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7f71b800c440 tx=0x7f71b8007de0).stop 2023-10-24T02:01:52.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 shutdown_connections 2023-10-24T02:01:52.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71c81544b0 0x7f71c8164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f71ac05f0b0 0x7f71ac061570 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71c80aa640 0x7f71c80c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 --2- 172.21.15.148:0/3931662956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f71c80c8290 0x7f71c80c92f0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:01:52.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 >> 172.21.15.148:0/3931662956 conn(0x7f71c80945d0 msgr2=0x7f71c80bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:01:52.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 shutdown_connections 2023-10-24T02:01:52.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:01:52.801+0000 7f71cff78700 1 -- 172.21.15.148:0/3931662956 wait complete. 2023-10-24T02:01:52.814 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-24T02:01:52.815 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-24T02:01:52.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:52.816 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:53.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:53.834 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:54.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:54.852 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:55.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:55.872 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:56.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:56.894 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:57.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:57.915 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:58.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:58.936 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:01:59.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:01:59.957 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:00.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:02:00.472+0000 7f500333d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:02:00.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:02:00.472+0000 7f500333d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:02:00.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:02:00.472+0000 7f500333d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:02:00.475 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:02:00.472+0000 7f500333d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:02:00.475 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:02:00.472+0000 7f500333d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:02:00.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:00.977 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:00.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:00.997 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-24-02_02_00_UTC'] 2023-10-24T02:02:00.998 DEBUG:tasks.cephfs.test_snap_schedules:exec=1698112912.4842236, now = 1698112920.9979887, timo = 8 2023-10-24T02:02:01.999 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-10-24-02_02_00 in ~68s... 2023-10-24T02:02:01.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:02.000 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:03.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:03.020 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:03.039 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:04.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:04.041 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:04.059 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:05.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:05.062 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:05.080 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:06.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:06.082 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:06.102 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:07.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:07.104 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:07.122 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:08.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:08.125 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:08.143 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:09.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:09.146 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:09.165 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:10.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:10.167 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:10.184 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:11.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:11.187 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:11.204 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:12.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:12.207 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:12.226 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:13.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:13.228 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:13.247 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:14.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:14.249 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:14.268 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:15.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:15.270 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:15.287 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:16.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:16.290 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:16.309 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:17.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:17.311 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:17.330 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:17.487 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:02:17.490 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:02:18.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:18.332 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:18.349 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:19.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:19.352 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:19.370 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:20.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:20.373 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:20.391 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:21.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:21.393 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:21.413 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:22.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:22.415 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:22.432 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:23.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:23.435 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:23.454 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:24.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:24.455 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:24.475 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:25.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:25.477 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:25.496 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:26.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:26.498 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:26.517 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:27.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:27.519 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:27.538 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:28.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:28.540 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:28.558 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:29.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:29.560 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:29.579 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:30.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:30.581 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:30.600 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:31.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:31.602 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:31.621 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:32.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:32.624 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:32.644 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:33.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:33.645 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:33.663 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:34.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:34.666 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:34.685 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:35.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:35.687 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:35.706 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:36.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:36.708 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:36.727 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:37.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:37.728 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:37.747 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:38.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:38.749 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:38.767 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:39.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:39.769 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:39.789 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:40.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:40.790 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:40.809 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:41.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:41.811 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:41.828 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:42.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:42.831 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:42.850 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:43.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:43.852 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:43.871 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:44.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:44.873 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:44.892 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:45.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:45.895 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:45.913 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:46.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:46.915 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:46.933 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:47.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:02:47.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:02:47.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:47.935 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:47.953 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:48.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:48.956 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:48.974 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:49.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:49.977 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:49.996 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:50.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:50.998 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:51.018 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:52.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:52.019 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:52.038 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:53.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:53.040 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:53.058 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:54.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:54.061 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:54.080 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:55.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:55.081 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:55.100 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:56.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:56.102 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:56.121 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:57.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:57.123 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:57.142 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:58.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:58.145 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:58.164 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:02:59.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:02:59.166 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:02:59.185 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:03:00.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:00.187 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:03:00.206 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_02_00_UTC 2023-10-24T02:03:01.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:01.208 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:03:01.227 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_03_00_UTC 2023-10-24T02:03:01.228 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-10-24-02_02_00_UTC'] 2023-10-24T02:03:01.229 DEBUG:tasks.cephfs.test_snap_schedules:exec=1698112912.4842236, now = 1698112981.2292647, timo = 68 2023-10-24T02:03:02.230 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-24T02:03:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.360+0000 7f5bf16d1700 1 Processor -- start 2023-10-24T02:03:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.360+0000 7f5bf16d1700 1 -- start start 2023-10-24T02:03:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5bf16d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bec0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5bf16d1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0c6270 con 0x7f5bec1544b0 2023-10-24T02:03:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5bf16d1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0c0c80 con 0x7f5bec0a7d00 2023-10-24T02:03:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5bf16d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0c60e0 con 0x7f5bec0aa640 2023-10-24T02:03:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5beaffd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5bec1544b0 0x7f5bec0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:34810/0 (socket says 172.21.15.148:34810) 2023-10-24T02:03:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5beaffd700 1 -- 172.21.15.148:0/970879375 learned_addr learned my addr 172.21.15.148:0/970879375 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bec0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302103748 0 0) 0x7f5bec0c6270 con 0x7f5bec1544b0 2023-10-24T02:03:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80033f0 con 0x7f5bec1544b0 2023-10-24T02:03:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167872873 0 0) 0x7f5bec0c0c80 con 0x7f5bec0a7d00 2023-10-24T02:03:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bec0c6270 con 0x7f5bec0a7d00 2023-10-24T02:03:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524621421 0 0) 0x7f5bd80033f0 con 0x7f5bec1544b0 2023-10-24T02:03:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 msgr2=0x7f5bec0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bec0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 >> v1:172.21.15.150:6789/0 conn(0x7f5bec0a7d00 legacy=0x7f5bec0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0c0f40 con 0x7f5bec1544b0 2023-10-24T02:03:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f5be40017f0 con 0x7f5bec1544b0 2023-10-24T02:03:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 >> v1:172.21.15.148:6789/0 conn(0x7f5bec1544b0 legacy=0x7f5bec0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bd8003aa0 0x7f5bd8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bd8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.368 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.361+0000 7f5be9ffb700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bd8004b80 0x7f5bd8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0c60e0 con 0x7f5bd8004b80 2023-10-24T02:03:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd800b910 con 0x7f5bd8003aa0 2023-10-24T02:03:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd800bad0 con 0x7f5bec0aa640 2023-10-24T02:03:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bd8004b80 0x7f5bd8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beaffd700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bd8003aa0 0x7f5bd8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5bea7fc700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bd8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 -- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 msgr2=0x7f5bd8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec0aa640 0x7f5bd8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 -- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bd8003aa0 msgr2=0x7f5bd8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bd8003aa0 0x7f5bd8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 -- 172.21.15.148:0/970879375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80033f0 con 0x7f5bd8004b80 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bd8004b80 0x7f5bd8005000 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f5bec085af0 tx=0x7f5bdc009060).ready entity=mon.0 client_cookie=4b8f505d2d8e25fc server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009430 con 0x7f5bd8004b80 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc009e70 con 0x7f5bd8004b80 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.362+0000 7f5be9ffb700 1 -- 172.21.15.148:0/970879375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00e850 con 0x7f5bd8004b80 2023-10-24T02:03:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 -- 172.21.15.148:0/970879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bd8004b80 msgr2=0x7f5bd8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/970879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bd8004b80 0x7f5bd8005000 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7f5bec085af0 tx=0x7f5bdc009060).stop 2023-10-24T02:03:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5beb7fe700 1 -- 172.21.15.148:0/970879375 reap_dead start 2023-10-24T02:03:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 -- 172.21.15.148:0/970879375 shutdown_connections 2023-10-24T02:03:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 -- 172.21.15.148:0/970879375 >> 172.21.15.148:0/970879375 conn(0x7f5bec0945d0 msgr2=0x7f5bec06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 -- 172.21.15.148:0/970879375 shutdown_connections 2023-10-24T02:03:02.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.363+0000 7f5bf16d1700 1 -- 172.21.15.148:0/970879375 wait complete. 2023-10-24T02:03:02.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.364+0000 7f5bf16d1700 1 Processor -- start 2023-10-24T02:03:02.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.364+0000 7f5bf16d1700 1 -- start start 2023-10-24T02:03:02.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec156fa0 0x7f5bec168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 0x7f5bec164a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0afb20 con 0x7f5bec157380 2023-10-24T02:03:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1652e0 con 0x7f5bec165b80 2023-10-24T02:03:02.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bf16d1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1655c0 con 0x7f5bec156fa0 2023-10-24T02:03:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60746/0 (socket says 172.21.15.148:60746) 2023-10-24T02:03:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 -- 172.21.15.148:0/818004390 learned_addr learned my addr 172.21.15.148:0/818004390 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beaffd700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec156fa0 0x7f5bec168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bea7fc700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 0x7f5bec164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 -- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec156fa0 msgr2=0x7f5bec168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec156fa0 0x7f5bec168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 -- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 msgr2=0x7f5bec164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 0x7f5bec164a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 -- 172.21.15.148:0/818004390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec1658a0 con 0x7f5bec157380 2023-10-24T02:03:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5bea7fc700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 0x7f5bec164a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.365+0000 7f5beb7fe700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f5bdc014000 tx=0x7f5bdc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.366+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc01c7e0 con 0x7f5bec157380 2023-10-24T02:03:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.366+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc01c960 con 0x7f5bec157380 2023-10-24T02:03:02.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.366+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec164f80 con 0x7f5bec157380 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.366+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc01cd20 con 0x7f5bec157380 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.366+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0c9840 con 0x7f5bec157380 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.367+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0af8b0 con 0x7f5bec157380 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.367+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 94) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f5bdc0123f0 con 0x7f5bec157380 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.367+0000 7f5be2ffd700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 0x7f5bcc0618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.367+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f5bdc07b0f0 con 0x7f5bec157380 2023-10-24T02:03:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.367+0000 7f5beaffd700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 0x7f5bcc0618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.368+0000 7f5beaffd700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 0x7f5bcc0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5be4002250 tx=0x7f5be4009040).ready entity=mgr.8944 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.371+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5bdc04bf80 con 0x7f5bec157380 2023-10-24T02:03:02.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.559+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bec06c6b0 con 0x7f5bcc05f3e0 2023-10-24T02:03:02.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.563+0000 7f5be2ffd700 1 -- 172.21.15.148:0/818004390 <== mgr.8944 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5bec06c6b0 con 0x7f5bcc05f3e0 2023-10-24T02:03:02.564 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path snap_test_dir1 2023-10-24T02:03:02.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 msgr2=0x7f5bcc0618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 0x7f5bcc0618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5be4002250 tx=0x7f5be4009040).stop 2023-10-24T02:03:02.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 msgr2=0x7f5bec0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f5bdc014000 tx=0x7f5bdc019000).stop 2023-10-24T02:03:02.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 shutdown_connections 2023-10-24T02:03:02.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bec157380 0x7f5bec0c9350 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec156fa0 0x7f5bec168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5bcc05f3e0 0x7f5bcc0618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 --2- 172.21.15.148:0/818004390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec165b80 0x7f5bec164a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 >> 172.21.15.148:0/818004390 conn(0x7f5bec0945d0 msgr2=0x7f5bec0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 shutdown_connections 2023-10-24T02:03:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.565+0000 7f5bf16d1700 1 -- 172.21.15.148:0/818004390 wait complete. 2023-10-24T02:03:02.577 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-24T02:03:02.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:02.578 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:03:02.593 INFO:teuthology.orchestra.run.smithi148.stdout:scheduled-2023-10-24-02_03_00_UTC 2023-10-24T02:03:02.594 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-24-02_03_00_UTC 2023-10-24T02:03:02.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:02.594 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-24-02_03_00_UTC) 2023-10-24T02:03:02.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:02.654 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T02:03:02.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T02:03:02.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.866+0000 7f6a37d91700 1 Processor -- start 2023-10-24T02:03:02.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.866+0000 7f6a37d91700 1 -- start start 2023-10-24T02:03:02.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a37d91700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a300a8230 0x7f6a300bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a37d91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a30152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a37d91700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a300bfdb0 con 0x7f6a301560a0 2023-10-24T02:03:02.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a37d91700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a300bfbc0 con 0x7f6a300a8230 2023-10-24T02:03:02.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a37d91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300c41a0 con 0x7f6a30156c30 2023-10-24T02:03:02.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a35b2d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a300a8230 0x7f6a300bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a35b2d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6a300a8230 0x7f6a300bf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60756/0 (socket says 172.21.15.148:60756) 2023-10-24T02:03:02.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.867+0000 7f6a35b2d700 1 -- 172.21.15.148:0/576113639 learned_addr learned my addr 172.21.15.148:0/576113639 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:02.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a3632e700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a30152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a35b2d700 1 -- 172.21.15.148:0/576113639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 msgr2=0x7f6a30152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:02.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a35b2d700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a30152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a35b2d700 1 -- 172.21.15.148:0/576113639 >> v1:172.21.15.150:6789/0 conn(0x7f6a301560a0 legacy=0x7f6a30156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a35b2d700 1 -- 172.21.15.148:0/576113639 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300c98b0 con 0x7f6a300a8230 2023-10-24T02:03:02.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a35b2d700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300bf6d0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f6a2c009f20 tx=0x7f6a2c009840).ready entity=mon.0 client_cookie=f77e7a59c32f3c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a34b2b700 1 -- 172.21.15.148:0/576113639 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00e070 con 0x7f6a300a8230 2023-10-24T02:03:02.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a34b2b700 1 -- 172.21.15.148:0/576113639 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00ba80 con 0x7f6a300a8230 2023-10-24T02:03:02.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a34b2b700 1 -- 172.21.15.148:0/576113639 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00be00 con 0x7f6a300a8230 2023-10-24T02:03:02.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a37d91700 1 -- 172.21.15.148:0/576113639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 msgr2=0x7f6a300bf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a37d91700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300bf6d0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7f6a2c009f20 tx=0x7f6a2c009840).stop 2023-10-24T02:03:02.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a37d91700 1 -- 172.21.15.148:0/576113639 shutdown_connections 2023-10-24T02:03:02.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a37d91700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a30152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.868+0000 7f6a37d91700 1 --2- 172.21.15.148:0/576113639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300bf6d0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.869+0000 7f6a37d91700 1 -- 172.21.15.148:0/576113639 >> 172.21.15.148:0/576113639 conn(0x7f6a300630d0 msgr2=0x7f6a300c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:02.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.869+0000 7f6a37d91700 1 -- 172.21.15.148:0/576113639 shutdown_connections 2023-10-24T02:03:02.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.869+0000 7f6a37d91700 1 -- 172.21.15.148:0/576113639 wait complete. 2023-10-24T02:03:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 Processor -- start 2023-10-24T02:03:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 -- start start 2023-10-24T02:03:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 0x7f6a30095de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a300962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300967c0 con 0x7f6a300a8230 2023-10-24T02:03:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300ae570 con 0x7f6a301560a0 2023-10-24T02:03:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.870+0000 7f6a37d91700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30064210 con 0x7f6a30156c30 2023-10-24T02:03:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60770/0 (socket says 172.21.15.148:60770) 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 -- 172.21.15.148:0/3063944697 learned_addr learned my addr 172.21.15.148:0/3063944697 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a3632e700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a300962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a3532c700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 0x7f6a30095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 -- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 msgr2=0x7f6a300962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a300962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 -- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 msgr2=0x7f6a30095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 0x7f6a30095de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 -- 172.21.15.148:0/3063944697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009ae0 con 0x7f6a300a8230 2023-10-24T02:03:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a3532c700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 0x7f6a30095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a35b2d700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f6a300c4e60 tx=0x7f6a2c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0092e0 con 0x7f6a300a8230 2023-10-24T02:03:02.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c013c20 con 0x7f6a300a8230 2023-10-24T02:03:02.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a300644b0 con 0x7f6a300a8230 2023-10-24T02:03:02.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c01e470 con 0x7f6a300a8230 2023-10-24T02:03:02.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.871+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a30064790 con 0x7f6a300a8230 2023-10-24T02:03:02.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.872+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3006c6b0 con 0x7f6a300a8230 2023-10-24T02:03:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.873+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 94) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f6a2c003040 con 0x7f6a300a8230 2023-10-24T02:03:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.873+0000 7f6a25ffb700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 0x7f6a140618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.873+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f6a2c07bab0 con 0x7f6a300a8230 2023-10-24T02:03:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.873+0000 7f6a3532c700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 0x7f6a140618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:02.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.874+0000 7f6a3532c700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 0x7f6a140618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6a30156690 tx=0x7f6a20009040).ready entity=mgr.8944 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:02.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:02.877+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6a2c04c940 con 0x7f6a300a8230 2023-10-24T02:03:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.087+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f6a300c5320 con 0x7f6a300a8230 2023-10-24T02:03:03.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.890+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f6a2c079390 con 0x7f6a300a8230 2023-10-24T02:03:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.891+0000 7f6a25ffb700 1 -- 172.21.15.148:0/3063944697 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v95) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6a2c041b80 con 0x7f6a300a8230 2023-10-24T02:03:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 msgr2=0x7f6a140618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 0x7f6a140618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6a30156690 tx=0x7f6a20009040).stop 2023-10-24T02:03:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 msgr2=0x7f6a300ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7f6a300c4e60 tx=0x7f6a2c009840).stop 2023-10-24T02:03:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 shutdown_connections 2023-10-24T02:03:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a30156c30 0x7f6a300962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a300a8230 0x7f6a300ac170 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6a1405f3e0 0x7f6a140618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 --2- 172.21.15.148:0/3063944697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a301560a0 0x7f6a30095de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.893+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 >> 172.21.15.148:0/3063944697 conn(0x7f6a300630d0 msgr2=0x7f6a30067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.894+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 shutdown_connections 2023-10-24T02:03:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:03.894+0000 7f6a37d91700 1 -- 172.21.15.148:0/3063944697 wait complete. 2023-10-24T02:03:03.907 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T02:03:03.907 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:03.945 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:03.984 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T02:03:03.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T02:03:03.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:03.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T02:03:04.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:03:04.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:04.025 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T02:03:04.035 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:04.035+0000 7f89ff2bf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:04.038 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:04.038+0000 7f8e0511e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:04.050 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:04.100 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:04.100+0000 7f89ff2bf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:04.101 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:04.101+0000 7f8e0511e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:04.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.206+0000 7f5f69420700 1 Processor -- start 2023-10-24T02:03:04.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.206+0000 7f5f69420700 1 -- start start 2023-10-24T02:03:04.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.207+0000 7f5f69420700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f64150530 0x7f5f640c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.207+0000 7f5f69420700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c30f0 con 0x7f5f64150910 2023-10-24T02:03:04.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.207+0000 7f5f69420700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640c24e0 con 0x7f5f640638c0 2023-10-24T02:03:04.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.207+0000 7f5f69420700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640c3c90 con 0x7f5f64150530 2023-10-24T02:03:04.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.207+0000 7f5f62ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f64150530 0x7f5f640c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5f64150530 0x7f5f640c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46326/0 (socket says 172.21.15.148:46326) 2023-10-24T02:03:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 -- 172.21.15.148:0/2326023795 learned_addr learned my addr 172.21.15.148:0/2326023795 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 -- 172.21.15.148:0/2326023795 >> v1:172.21.15.150:6789/0 conn(0x7f5f640638c0 legacy=0x7f5f640bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 -- 172.21.15.148:0/2326023795 >> v1:172.21.15.148:6789/0 conn(0x7f5f64150910 legacy=0x7f5f640c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 -- 172.21.15.148:0/2326023795 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640c27c0 con 0x7f5f64150530 2023-10-24T02:03:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f62ffd700 1 --2- 172.21.15.148:0/2326023795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640c1f50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f5f5c009f20 tx=0x7f5f5c009840).ready entity=mon.0 client_cookie=b267ccdaafd7cad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f61ffb700 1 -- 172.21.15.148:0/2326023795 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00e070 con 0x7f5f64150530 2023-10-24T02:03:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f61ffb700 1 -- 172.21.15.148:0/2326023795 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00ba80 con 0x7f5f64150530 2023-10-24T02:03:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.208+0000 7f5f61ffb700 1 -- 172.21.15.148:0/2326023795 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00be00 con 0x7f5f64150530 2023-10-24T02:03:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 -- 172.21.15.148:0/2326023795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 msgr2=0x7f5f640c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 --2- 172.21.15.148:0/2326023795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640c1f50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f5f5c009f20 tx=0x7f5f5c009840).stop 2023-10-24T02:03:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 -- 172.21.15.148:0/2326023795 shutdown_connections 2023-10-24T02:03:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 --2- 172.21.15.148:0/2326023795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640c1f50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 -- 172.21.15.148:0/2326023795 >> 172.21.15.148:0/2326023795 conn(0x7f5f640c7ee0 msgr2=0x7f5f640c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 -- 172.21.15.148:0/2326023795 shutdown_connections 2023-10-24T02:03:04.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.209+0000 7f5f69420700 1 -- 172.21.15.148:0/2326023795 wait complete. 2023-10-24T02:03:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.210+0000 7f5f69420700 1 Processor -- start 2023-10-24T02:03:04.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.210+0000 7f5f69420700 1 -- start start 2023-10-24T02:03:04.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f640638c0 0x7f5f6413f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f64150910 0x7f5f640aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640aaf50 con 0x7f5f64150530 2023-10-24T02:03:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640be5a0 con 0x7f5f64150910 2023-10-24T02:03:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640ad0f0 con 0x7f5f640638c0 2023-10-24T02:03:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46342/0 (socket says 172.21.15.148:46342) 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 -- 172.21.15.148:0/3313735369 learned_addr learned my addr 172.21.15.148:0/3313735369 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f62ffd700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f640638c0 0x7f5f6413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f637fe700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f64150910 0x7f5f640aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f640638c0 msgr2=0x7f5f6413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f640638c0 0x7f5f6413f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f64150910 msgr2=0x7f5f640aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f64150910 0x7f5f640aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 -- 172.21.15.148:0/3313735369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009ae0 con 0x7f5f64150530 2023-10-24T02:03:04.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f627fc700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f5f5800c440 tx=0x7f5f58007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007020 con 0x7f5f64150530 2023-10-24T02:03:04.220 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f58007180 con 0x7f5f64150530 2023-10-24T02:03:04.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007520 con 0x7f5f64150530 2023-10-24T02:03:04.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.211+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f64141fa0 con 0x7f5f64150530 2023-10-24T02:03:04.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.212+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f64142840 con 0x7f5f64150530 2023-10-24T02:03:04.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.213+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f640be730 con 0x7f5f64150530 2023-10-24T02:03:04.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.214+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5f580068b0 con 0x7f5f64150530 2023-10-24T02:03:04.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.214+0000 7f5f4affd700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 0x7f5f50061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.214+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f5f58079ec0 con 0x7f5f64150530 2023-10-24T02:03:04.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.214+0000 7f5f62ffd700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 msgr2=0x7f5f50061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:04.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.214+0000 7f5f62ffd700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 0x7f5f50061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.218+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5f5804ae70 con 0x7f5f64150530 2023-10-24T02:03:04.377 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:04.377+0000 7f8e0511e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:04.385 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:04.385+0000 7f89ff2bf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.415+0000 7f5f62ffd700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 msgr2=0x7f5f50061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.415+0000 7f5f62ffd700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 0x7f5f50061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.425+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f6406c6b0 con 0x7f5f64150530 2023-10-24T02:03:04.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.425+0000 7f5f4affd700 1 -- 172.21.15.148:0/3313735369 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f5f58020020 con 0x7f5f64150530 2023-10-24T02:03:04.426 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:04.426 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:03:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 msgr2=0x7f5f50061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 0x7f5f50061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:04.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 msgr2=0x7f5f640aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f5f5800c440 tx=0x7f5f58007e00).stop 2023-10-24T02:03:04.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 shutdown_connections 2023-10-24T02:03:04.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5f5005f390 0x7f5f50061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:04.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f64150910 0x7f5f640aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f640638c0 0x7f5f6413f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 --2- 172.21.15.148:0/3313735369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f64150530 0x7f5f640aa570 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 >> 172.21.15.148:0/3313735369 conn(0x7f5f640c7ee0 msgr2=0x7f5f640a99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:04.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 shutdown_connections 2023-10-24T02:03:04.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.427+0000 7f5f69420700 1 -- 172.21.15.148:0/3313735369 wait complete. 2023-10-24T02:03:04.431 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:03:04.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:04.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.597+0000 7f2b6002e700 1 Processor -- start 2023-10-24T02:03:04.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 -- start start 2023-10-24T02:03:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 0x7f2b580bef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b5815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b580a6d10 con 0x7f2b580a6550 2023-10-24T02:03:04.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b58152880 con 0x7f2b580c6160 2023-10-24T02:03:04.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.598+0000 7f2b6002e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580bf400 con 0x7f2b580a8480 2023-10-24T02:03:04.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5d5c9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2b580a6550 0x7f2b580a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47192/0 (socket says 172.21.15.148:47192) 2023-10-24T02:03:04.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5d5c9700 1 -- 172.21.15.148:0/2004169081 learned_addr learned my addr 172.21.15.148:0/2004169081 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:04.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5ddca700 1 --2- 172.21.15.148:0/2004169081 >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 0x7f2b580bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 --2- 172.21.15.148:0/2004169081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b5815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5cdc8700 1 -- 172.21.15.148:0/2004169081 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302468712 0 0) 0x7f2b580a6d10 con 0x7f2b580a6550 2023-10-24T02:03:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5cdc8700 1 -- 172.21.15.148:0/2004169081 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b440033f0 con 0x7f2b580a6550 2023-10-24T02:03:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 -- 172.21.15.148:0/2004169081 >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 msgr2=0x7f2b580bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 --2- 172.21.15.148:0/2004169081 >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 0x7f2b580bef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 -- 172.21.15.148:0/2004169081 >> v1:172.21.15.148:6789/0 conn(0x7f2b580a6550 legacy=0x7f2b580a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 -- 172.21.15.148:0/2004169081 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580a6ff0 con 0x7f2b580a8480 2023-10-24T02:03:04.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5ddca700 1 --2- 172.21.15.148:0/2004169081 >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 0x7f2b580bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:04.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5e5cb700 1 --2- 172.21.15.148:0/2004169081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b5815bf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f2b50009e60 tx=0x7f2b50009780).ready entity=mon.2 client_cookie=d3302d6fb33099d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.604 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5cdc8700 1 -- 172.21.15.148:0/2004169081 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000e070 con 0x7f2b580a8480 2023-10-24T02:03:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5cdc8700 1 -- 172.21.15.148:0/2004169081 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000bab0 con 0x7f2b580a8480 2023-10-24T02:03:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.599+0000 7f2b5cdc8700 1 -- 172.21.15.148:0/2004169081 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000be30 con 0x7f2b580a8480 2023-10-24T02:03:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 -- 172.21.15.148:0/2004169081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 msgr2=0x7f2b5815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 --2- 172.21.15.148:0/2004169081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b5815bf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f2b50009e60 tx=0x7f2b50009780).stop 2023-10-24T02:03:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 -- 172.21.15.148:0/2004169081 shutdown_connections 2023-10-24T02:03:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 --2- 172.21.15.148:0/2004169081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b5815bf50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 --2- 172.21.15.148:0/2004169081 >> v2:172.21.15.150:3300/0 conn(0x7f2b580c6160 0x7f2b580bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 -- 172.21.15.148:0/2004169081 >> 172.21.15.148:0/2004169081 conn(0x7f2b58082f60 msgr2=0x7f2b58062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 -- 172.21.15.148:0/2004169081 shutdown_connections 2023-10-24T02:03:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.600+0000 7f2b6002e700 1 -- 172.21.15.148:0/2004169081 wait complete. 2023-10-24T02:03:04.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.601+0000 7f2b6002e700 1 Processor -- start 2023-10-24T02:03:04.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.601+0000 7f2b6002e700 1 -- start start 2023-10-24T02:03:04.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b580a6550 0x7f2b581613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b580a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580c0bb0 con 0x7f2b580c6160 2023-10-24T02:03:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58161890 con 0x7f2b580a6550 2023-10-24T02:03:04.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b6002e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580bffa0 con 0x7f2b580a8480 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b5e5cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b5e5cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46354/0 (socket says 172.21.15.148:46354) 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b5e5cb700 1 -- 172.21.15.148:0/1296766894 learned_addr learned my addr 172.21.15.148:0/1296766894 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b5d5c9700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b580a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.602+0000 7f2b5ddca700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b580a6550 0x7f2b581613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 -- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b580a6550 msgr2=0x7f2b581613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b580a6550 0x7f2b581613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 -- 172.21.15.148:0/1296766894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 msgr2=0x7f2b580c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 -- 172.21.15.148:0/1296766894 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009250 con 0x7f2b580a8480 2023-10-24T02:03:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5e5cb700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b5d5c9700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b580a9280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2b54001ed0 tx=0x7f2b54007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540070d0 con 0x7f2b580a8480 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54007230 con 0x7f2b580a8480 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b50009a20 con 0x7f2b580a8480 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540075f0 con 0x7f2b580a8480 2023-10-24T02:03:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.603+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b580c0560 con 0x7f2b580a8480 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.604+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b580c0d20 con 0x7f2b580a8480 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.604+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f2b540059b0 con 0x7f2b580a8480 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.605+0000 7f2b4dffb700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 0x7f2b3c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.605+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f2b54079d60 con 0x7f2b580a8480 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.605+0000 7f2b5ddca700 1 -- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 msgr2=0x7f2b3c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.605+0000 7f2b5ddca700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 0x7f2b3c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.609+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2b5404ac50 con 0x7f2b580a8480 2023-10-24T02:03:04.779 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.779+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b5806c6b0 con 0x7f2b580a8480 2023-10-24T02:03:04.780 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.780+0000 7f2b4dffb700 1 -- 172.21.15.148:0/1296766894 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17310 (secure 0 0 0) 0x7f2b5404e270 con 0x7f2b580a8480 2023-10-24T02:03:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:04.781 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":202,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:51.109103+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:6832/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/1630888363":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/213201995":"2023-10-25T02:01:51.109055+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 msgr2=0x7f2b3c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 0x7f2b3c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 msgr2=0x7f2b580a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b580a9280 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2b54001ed0 tx=0x7f2b54007bd0).stop 2023-10-24T02:03:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 shutdown_connections 2023-10-24T02:03:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2b580c6160 0x7f2b580c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2b3c05f390 0x7f2b3c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b580a6550 0x7f2b581613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 --2- 172.21.15.148:0/1296766894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b580a8480 0x7f2b580a9280 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 >> 172.21.15.148:0/1296766894 conn(0x7f2b58082f60 msgr2=0x7f2b580be7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 shutdown_connections 2023-10-24T02:03:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.782+0000 7f2b6002e700 1 -- 172.21.15.148:0/1296766894 wait complete. 2023-10-24T02:03:04.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T02:01:33.950823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '200', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T02:01:34.364961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T02:03:04.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T02:03:04.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.917+0000 7f2c24c66700 1 Processor -- start 2023-10-24T02:03:04.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.917+0000 7f2c24c66700 1 -- start start 2023-10-24T02:03:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c24c66700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2c200c65f0 0x7f2c200be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c24c66700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 0x7f2c200bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c24c66700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c20063760 con 0x7f2c200c6210 2023-10-24T02:03:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c24c66700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c20154b50 con 0x7f2c200c65f0 2023-10-24T02:03:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c24c66700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200bf2f0 con 0x7f2c200c4910 2023-10-24T02:03:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1e59c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2c200c6210 0x7f2c200c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47202/0 (socket says 172.21.15.148:47202) 2023-10-24T02:03:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1e59c700 1 -- 172.21.15.148:0/731008258 learned_addr learned my addr 172.21.15.148:0/731008258 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1ed9d700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 0x7f2c200bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/731008258 >> v2:172.21.15.150:3300/0 conn(0x7f2c200c65f0 0x7f2c200be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1d59a700 1 -- 172.21.15.148:0/731008258 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202607507 0 0) 0x7f2c20063760 con 0x7f2c200c6210 2023-10-24T02:03:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.918+0000 7f2c1d59a700 1 -- 172.21.15.148:0/731008258 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c0033f0 con 0x7f2c200c6210 2023-10-24T02:03:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1dd9b700 1 -- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 msgr2=0x7f2c200bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 0x7f2c200bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1dd9b700 1 -- 172.21.15.148:0/731008258 >> v1:172.21.15.148:6789/0 conn(0x7f2c200c6210 legacy=0x7f2c200c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1dd9b700 1 -- 172.21.15.148:0/731008258 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c200bf5d0 con 0x7f2c200c65f0 2023-10-24T02:03:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1ed9d700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 0x7f2c200bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200be570 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f2c08009760 tx=0x7f2c08009060).ready entity=mon.1 client_cookie=59f0e687c59b9e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1d59a700 1 -- 172.21.15.148:0/731008258 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800d4a0 con 0x7f2c200c65f0 2023-10-24T02:03:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1d59a700 1 -- 172.21.15.148:0/731008258 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800d600 con 0x7f2c200c65f0 2023-10-24T02:03:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c1d59a700 1 -- 172.21.15.148:0/731008258 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800d980 con 0x7f2c200c65f0 2023-10-24T02:03:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c24c66700 1 -- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 msgr2=0x7f2c200be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.919+0000 7f2c24c66700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200be570 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f2c08009760 tx=0x7f2c08009060).stop 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 -- 172.21.15.148:0/731008258 shutdown_connections 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c4910 0x7f2c200bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 --2- 172.21.15.148:0/731008258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200be570 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 -- 172.21.15.148:0/731008258 >> 172.21.15.148:0/731008258 conn(0x7f2c20092510 msgr2=0x7f2c20062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 -- 172.21.15.148:0/731008258 shutdown_connections 2023-10-24T02:03:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.920+0000 7f2c24c66700 1 -- 172.21.15.148:0/731008258 wait complete. 2023-10-24T02:03:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.921+0000 7f2c24c66700 1 Processor -- start 2023-10-24T02:03:04.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.921+0000 7f2c24c66700 1 -- start start 2023-10-24T02:03:04.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.921+0000 7f2c24c66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.921+0000 7f2c24c66700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 0x7f2c200ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200aec00 con 0x7f2c200c4910 2023-10-24T02:03:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200a6780 con 0x7f2c200c65f0 2023-10-24T02:03:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200a6a60 con 0x7f2c200c6210 2023-10-24T02:03:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46364/0 (socket says 172.21.15.148:46364) 2023-10-24T02:03:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 -- 172.21.15.148:0/1304327917 learned_addr learned my addr 172.21.15.148:0/1304327917 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 0x7f2c200ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 msgr2=0x7f2c200ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 0x7f2c200ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 msgr2=0x7f2c200ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 -- 172.21.15.148:0/1304327917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18009a20 con 0x7f2c200c4910 2023-10-24T02:03:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 0x7f2c200ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:04.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1ed9d700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c1e59c700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f2c1000c420 tx=0x7f2c10007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000ce80 con 0x7f2c200c4910 2023-10-24T02:03:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c100072e0 con 0x7f2c200c4910 2023-10-24T02:03:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c080092a0 con 0x7f2c200c4910 2023-10-24T02:03:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10007660 con 0x7f2c200c4910 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.922+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c200a7020 con 0x7f2c200c4910 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.923+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2006c6b0 con 0x7f2c200c4910 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.924+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f2c100059b0 con 0x7f2c200c4910 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.924+0000 7f2c167fc700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 0x7f2c00061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.924+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f2c10079d10 con 0x7f2c200c4910 2023-10-24T02:03:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.924+0000 7f2c1dd9b700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 msgr2=0x7f2c00061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.924+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 0x7f2c00061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:04.928+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2c1004ac00 con 0x7f2c200c4910 2023-10-24T02:03:05.000 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:04.993+0000 7f8e0511e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:05.031 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:05.031+0000 7f89ff2bf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:05.065 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:05.065+0000 7f8e0511e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:05.104 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:05.104+0000 7f89ff2bf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:05.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.125+0000 7f2c1dd9b700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 msgr2=0x7f2c00061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:05.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.125+0000 7f2c1dd9b700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 0x7f2c00061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:05.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.130+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2c200aee90 con 0x7f2c200c4910 2023-10-24T02:03:05.130 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.130+0000 7f2c167fc700 1 -- 172.21.15.148:0/1304327917 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v202) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2c1004e220 con 0x7f2c200c4910 2023-10-24T02:03:05.131 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T02:03:05.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 msgr2=0x7f2c00061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:05.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 0x7f2c00061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 msgr2=0x7f2c2014f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f2c1000c420 tx=0x7f2c10007c80).stop 2023-10-24T02:03:05.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 shutdown_connections 2023-10-24T02:03:05.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2c0005f360 0x7f2c00061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c200c65f0 0x7f2c200ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c200c4910 0x7f2c2014f020 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 --2- 172.21.15.148:0/1304327917 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c200c6210 0x7f2c200ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 >> 172.21.15.148:0/1304327917 conn(0x7f2c20092510 msgr2=0x7f2c2014f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 shutdown_connections 2023-10-24T02:03:05.136 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.132+0000 7f2c24c66700 1 -- 172.21.15.148:0/1304327917 wait complete. 2023-10-24T02:03:05.145 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T02:03:05.253 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:05.252+0000 7f8e0511e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:05.266 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.266+0000 7f54009dd700 1 Processor -- start 2023-10-24T02:03:05.267 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.266+0000 7f54009dd700 1 -- start start 2023-10-24T02:03:05.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f54009dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f54009dd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53fc0be640 0x7f53fc0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.268 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f54009dd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc069f60 con 0x7f53fc1541d0 2023-10-24T02:03:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f54009dd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0beac0 con 0x7f53fc0be640 2023-10-24T02:03:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f54009dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0bd250 con 0x7f53fc062d60 2023-10-24T02:03:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53fc0be640 0x7f53fc0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f53fc0be640 0x7f53fc0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46370/0 (socket says 172.21.15.148:46370) 2023-10-24T02:03:05.269 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 -- 172.21.15.148:0/1650329725 learned_addr learned my addr 172.21.15.148:0/1650329725 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53f9d9b700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 -- 172.21.15.148:0/1650329725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 msgr2=0x7f53fc0bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc0bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 -- 172.21.15.148:0/1650329725 >> v1:172.21.15.150:6789/0 conn(0x7f53fc1541d0 legacy=0x7f53fc062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 -- 172.21.15.148:0/1650329725 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc069630 con 0x7f53fc0be640 2023-10-24T02:03:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.267+0000 7f53fad9d700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc0a4d10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f53f4009f20 tx=0x7f53f4009840).ready entity=mon.0 client_cookie=7c55cc9cd883442a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f53f959a700 1 -- 172.21.15.148:0/1650329725 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400e070 con 0x7f53fc0be640 2023-10-24T02:03:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f53f959a700 1 -- 172.21.15.148:0/1650329725 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400b9d0 con 0x7f53fc0be640 2023-10-24T02:03:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f53f959a700 1 -- 172.21.15.148:0/1650329725 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400bd50 con 0x7f53fc0be640 2023-10-24T02:03:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 -- 172.21.15.148:0/1650329725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 msgr2=0x7f53fc0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc0a4d10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f53f4009f20 tx=0x7f53f4009840).stop 2023-10-24T02:03:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 -- 172.21.15.148:0/1650329725 shutdown_connections 2023-10-24T02:03:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc0a4d10 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 --2- 172.21.15.148:0/1650329725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc0bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 -- 172.21.15.148:0/1650329725 >> 172.21.15.148:0/1650329725 conn(0x7f53fc0c7d10 msgr2=0x7f53fc0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 -- 172.21.15.148:0/1650329725 shutdown_connections 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.268+0000 7f54009dd700 1 -- 172.21.15.148:0/1650329725 wait complete. 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.269+0000 7f54009dd700 1 Processor -- start 2023-10-24T02:03:05.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.269+0000 7f54009dd700 1 -- start start 2023-10-24T02:03:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1541d0 0x7f53fc156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc159690 con 0x7f53fc0be640 2023-10-24T02:03:05.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc163fe0 con 0x7f53fc1541d0 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f54009dd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc157430 con 0x7f53fc062d60 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f53f9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46376/0 (socket says 172.21.15.148:46376) 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f53f9d9b700 1 -- 172.21.15.148:0/65739557 learned_addr learned my addr 172.21.15.148:0/65739557 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f53fad9d700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1541d0 0x7f53fc156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.270+0000 7f53fa59c700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 -- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 msgr2=0x7f53fc146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 -- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1541d0 msgr2=0x7f53fc156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1541d0 0x7f53fc156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 -- 172.21.15.148:0/65739557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009ae0 con 0x7f53fc0be640 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53f9d9b700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f53ec00e900 tx=0x7f53ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012600 con 0x7f53fc0be640 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec012760 con 0x7f53fc0be640 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012ae0 con 0x7f53fc0be640 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc157710 con 0x7f53fc0be640 2023-10-24T02:03:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.271+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc157cd0 con 0x7f53fc0be640 2023-10-24T02:03:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.272+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc157ef0 con 0x7f53fc0be640 2023-10-24T02:03:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.272+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f53ec01b400 con 0x7f53fc0be640 2023-10-24T02:03:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.272+0000 7f53ea7fc700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 0x7f53dc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.273+0000 7f53fa59c700 1 -- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 msgr2=0x7f53dc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.273+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f53ec07aae0 con 0x7f53fc0be640 2023-10-24T02:03:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.273+0000 7f53fa59c700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 0x7f53dc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:05.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.280+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f53ec04b970 con 0x7f53fc0be640 2023-10-24T02:03:05.305 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:05.305+0000 7f89ff2bf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.449+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53fc164170 con 0x7f53fc0be640 2023-10-24T02:03:05.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.450+0000 7f53ea7fc700 1 -- 172.21.15.148:0/65739557 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v202) v1 ==== 92+0+10 (secure 0 0 0) 0x7f53ec016070 con 0x7f53fc0be640 2023-10-24T02:03:05.450 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T02:03:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 msgr2=0x7f53dc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 0x7f53dc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 msgr2=0x7f53fc156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f53ec00e900 tx=0x7f53ec009060).stop 2023-10-24T02:03:05.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 shutdown_connections 2023-10-24T02:03:05.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f53dc05f390 0x7f53dc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53fc1541d0 0x7f53fc156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53fc062d60 0x7f53fc146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 --2- 172.21.15.148:0/65739557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53fc0be640 0x7f53fc156990 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 >> 172.21.15.148:0/65739557 conn(0x7f53fc0c7d10 msgr2=0x7f53fc0a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 shutdown_connections 2023-10-24T02:03:05.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.452+0000 7f54009dd700 1 -- 172.21.15.148:0/65739557 wait complete. 2023-10-24T02:03:05.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T02:03:05.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.587+0000 7f5d67de7700 1 Processor -- start 2023-10-24T02:03:05.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.587+0000 7f5d67de7700 1 -- start start 2023-10-24T02:03:05.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d67de7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d6006b590 0x7f5d60064ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d67de7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5d600653b0 0x7f5d600a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d67de7700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6006ba70 con 0x7f5d600ac520 2023-10-24T02:03:05.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d67de7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600ad0f0 con 0x7f5d6006b590 2023-10-24T02:03:05.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d67de7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600ad3d0 con 0x7f5d600653b0 2023-10-24T02:03:05.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d65382700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d6006b590 0x7f5d60064ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d65382700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5d6006b590 0x7f5d60064ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46382/0 (socket says 172.21.15.148:46382) 2023-10-24T02:03:05.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.588+0000 7f5d65382700 1 -- 172.21.15.148:0/2707758614 learned_addr learned my addr 172.21.15.148:0/2707758614 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:05.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d66384700 1 --2- 172.21.15.148:0/2707758614 >> v2:172.21.15.150:3300/0 conn(0x7f5d600653b0 0x7f5d600a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d65382700 1 -- 172.21.15.148:0/2707758614 >> v2:172.21.15.150:3300/0 conn(0x7f5d600653b0 msgr2=0x7f5d600a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:05.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d65382700 1 --2- 172.21.15.148:0/2707758614 >> v2:172.21.15.150:3300/0 conn(0x7f5d600653b0 0x7f5d600a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d65382700 1 -- 172.21.15.148:0/2707758614 >> v1:172.21.15.150:6789/0 conn(0x7f5d600ac520 legacy=0x7f5d600ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d65382700 1 -- 172.21.15.148:0/2707758614 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600627f0 con 0x7f5d6006b590 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d65382700 1 --2- 172.21.15.148:0/2707758614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d6006b590 0x7f5d60064ec0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f5d60069d80 tx=0x7f5d5c0090f0).ready entity=mon.0 client_cookie=55df73bc2ad248ac server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d64b81700 1 -- 172.21.15.148:0/2707758614 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00b520 con 0x7f5d6006b590 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d64b81700 1 -- 172.21.15.148:0/2707758614 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00b680 con 0x7f5d6006b590 2023-10-24T02:03:05.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.589+0000 7f5d64b81700 1 -- 172.21.15.148:0/2707758614 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00ba00 con 0x7f5d6006b590 2023-10-24T02:03:05.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 -- 172.21.15.148:0/2707758614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d6006b590 msgr2=0x7f5d60064ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 --2- 172.21.15.148:0/2707758614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d6006b590 0x7f5d60064ec0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f5d60069d80 tx=0x7f5d5c0090f0).stop 2023-10-24T02:03:05.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 -- 172.21.15.148:0/2707758614 shutdown_connections 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 --2- 172.21.15.148:0/2707758614 >> v2:172.21.15.150:3300/0 conn(0x7f5d600653b0 0x7f5d600a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 --2- 172.21.15.148:0/2707758614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d6006b590 0x7f5d60064ec0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 -- 172.21.15.148:0/2707758614 >> 172.21.15.148:0/2707758614 conn(0x7f5d600c3f60 msgr2=0x7f5d600c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 -- 172.21.15.148:0/2707758614 shutdown_connections 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.590+0000 7f5d67de7700 1 -- 172.21.15.148:0/2707758614 wait complete. 2023-10-24T02:03:05.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.592+0000 7f5d67de7700 1 Processor -- start 2023-10-24T02:03:05.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.592+0000 7f5d67de7700 1 -- start start 2023-10-24T02:03:05.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d6006b590 0x7f5d600bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d600ac520 0x7f5d600bc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600c3220 con 0x7f5d600653b0 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600a5e20 con 0x7f5d600ac520 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d67de7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600a5210 con 0x7f5d6006b590 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46384/0 (socket says 172.21.15.148:46384) 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 -- 172.21.15.148:0/4011846179 learned_addr learned my addr 172.21.15.148:0/4011846179 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:05.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d66384700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d600ac520 0x7f5d600bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65382700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d6006b590 0x7f5d600bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 -- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d6006b590 msgr2=0x7f5d600bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d6006b590 0x7f5d600bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 -- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d600ac520 msgr2=0x7f5d600bc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d600ac520 0x7f5d600bc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.593+0000 7f5d65b83700 1 -- 172.21.15.148:0/4011846179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009370 con 0x7f5d600653b0 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d65b83700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f5d5000c440 tx=0x7f5d50007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50007020 con 0x7f5d600653b0 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50007180 con 0x7f5d600653b0 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50007520 con 0x7f5d600653b0 2023-10-24T02:03:05.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d600a54f0 con 0x7f5d600653b0 2023-10-24T02:03:05.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.594+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d600a5ab0 con 0x7f5d600653b0 2023-10-24T02:03:05.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.595+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d600a67a0 con 0x7f5d600653b0 2023-10-24T02:03:05.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.596+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5d500068b0 con 0x7f5d600653b0 2023-10-24T02:03:05.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.596+0000 7f5d55ffb700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 0x7f5d44061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.596+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f5d50079710 con 0x7f5d600653b0 2023-10-24T02:03:05.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.596+0000 7f5d65382700 1 -- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 msgr2=0x7f5d44061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:05.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.596+0000 7f5d65382700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 0x7f5d44061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:05.603 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.600+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5d50047af0 con 0x7f5d600653b0 2023-10-24T02:03:05.678 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:05.678+0000 7f8e0511e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:05.749 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:05.749+0000 7f89ff2bf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:05.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.770+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d6006ba70 con 0x7f5d600653b0 2023-10-24T02:03:05.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.770+0000 7f5d55ffb700 1 -- 172.21.15.148:0/4011846179 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v202) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d6006ba70 con 0x7f5d600653b0 2023-10-24T02:03:05.771 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:03:05.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 msgr2=0x7f5d44061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:05.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 0x7f5d44061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 msgr2=0x7f5d600a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f5d5000c440 tx=0x7f5d50007e00).stop 2023-10-24T02:03:05.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 shutdown_connections 2023-10-24T02:03:05.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5d4405f390 0x7f5d44061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d600ac520 0x7f5d600bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d600653b0 0x7f5d600a62b0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 --2- 172.21.15.148:0/4011846179 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d6006b590 0x7f5d600bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 >> 172.21.15.148:0/4011846179 conn(0x7f5d600c3f60 msgr2=0x7f5d600c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 shutdown_connections 2023-10-24T02:03:05.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.773+0000 7f5d67de7700 1 -- 172.21.15.148:0/4011846179 wait complete. 2023-10-24T02:03:05.781 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:05.781+0000 7f8e0511e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:05.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T02:03:05.860 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:05.860+0000 7f89ff2bf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:05.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.905+0000 7f946c171700 1 Processor -- start 2023-10-24T02:03:05.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.906+0000 7f946c171700 1 -- start start 2023-10-24T02:03:05.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.906+0000 7f946c171700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 0x7f9464064ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.906+0000 7f946c171700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946406ba70 con 0x7f94640653b0 2023-10-24T02:03:05.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.906+0000 7f946c171700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640ad0f0 con 0x7f94640ac520 2023-10-24T02:03:05.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.906+0000 7f946c171700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640ad3d0 con 0x7f946406b590 2023-10-24T02:03:05.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946a70e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f94640653b0 0x7f94640a9480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47218/0 (socket says 172.21.15.148:47218) 2023-10-24T02:03:05.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946a70e700 1 -- 172.21.15.148:0/1084890587 learned_addr learned my addr 172.21.15.148:0/1084890587 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946970c700 1 --2- 172.21.15.148:0/1084890587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 0x7f9464064ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200707379 0 0) 0x7f945c001490 con 0x7f94640653b0 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94500033f0 con 0x7f94640653b0 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256937022 0 0) 0x7f94640ad0f0 con 0x7f94640ac520 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f945c001490 con 0x7f94640ac520 2023-10-24T02:03:05.910 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946970c700 1 -- 172.21.15.148:0/1084890587 >> v1:172.21.15.150:6789/0 conn(0x7f94640ac520 legacy=0x7f94640ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946970c700 1 -- 172.21.15.148:0/1084890587 >> v1:172.21.15.148:6789/0 conn(0x7f94640653b0 legacy=0x7f94640a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946970c700 1 -- 172.21.15.148:0/1084890587 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640627f0 con 0x7f946406b590 2023-10-24T02:03:05.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f946970c700 1 --2- 172.21.15.148:0/1084890587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 0x7f9464064ec0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f9458009790 tx=0x7f9458009060).ready entity=mon.2 client_cookie=aa6059fc8de8f471 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800f510 con 0x7f946406b590 2023-10-24T02:03:05.911 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800f670 con 0x7f946406b590 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.907+0000 7f9468f0b700 1 -- 172.21.15.148:0/1084890587 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800f9f0 con 0x7f946406b590 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 -- 172.21.15.148:0/1084890587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 msgr2=0x7f9464064ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 --2- 172.21.15.148:0/1084890587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 0x7f9464064ec0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f9458009790 tx=0x7f9458009060).stop 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 -- 172.21.15.148:0/1084890587 shutdown_connections 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 --2- 172.21.15.148:0/1084890587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f946406b590 0x7f9464064ec0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 -- 172.21.15.148:0/1084890587 >> 172.21.15.148:0/1084890587 conn(0x7f94640c3f60 msgr2=0x7f94640c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:05.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 -- 172.21.15.148:0/1084890587 shutdown_connections 2023-10-24T02:03:05.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.908+0000 7f946c171700 1 -- 172.21.15.148:0/1084890587 wait complete. 2023-10-24T02:03:05.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.909+0000 7f946c171700 1 Processor -- start 2023-10-24T02:03:05.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.909+0000 7f946c171700 1 -- start start 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94640653b0 0x7f94640c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94640ac520 0x7f94640c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c18b0 con 0x7f946406b590 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640a8520 con 0x7f94640ac520 2023-10-24T02:03:05.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946c171700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640a8800 con 0x7f94640653b0 2023-10-24T02:03:05.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46398/0 (socket says 172.21.15.148:46398) 2023-10-24T02:03:05.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 -- 172.21.15.148:0/6145656 learned_addr learned my addr 172.21.15.148:0/6145656 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:05.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f9469f0d700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94640653b0 0x7f94640c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946a70e700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94640ac520 0x7f94640c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:05.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 -- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94640653b0 msgr2=0x7f94640c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94640653b0 0x7f94640c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 -- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94640ac520 msgr2=0x7f94640c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:05.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94640ac520 0x7f94640c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:05.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.910+0000 7f946970c700 1 -- 172.21.15.148:0/6145656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580092a0 con 0x7f946406b590 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f946970c700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f9464067750 tx=0x7f9458017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800fe80 con 0x7f946406b590 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800f7e0 con 0x7f946406b590 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640a8ae0 con 0x7f946406b590 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945801b640 con 0x7f946406b590 2023-10-24T02:03:05.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.911+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640c0e60 con 0x7f946406b590 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.912+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f945801b9b0 con 0x7f946406b590 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.912+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94640a8ca0 con 0x7f946406b590 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.913+0000 7f9455ffb700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 0x7f9448061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.913+0000 7f9469f0d700 1 -- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 msgr2=0x7f9448061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.913+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f945807c030 con 0x7f946406b590 2023-10-24T02:03:05.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.913+0000 7f9469f0d700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 0x7f9448061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:05.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:05.917+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f945804cf20 con 0x7f946406b590 2023-10-24T02:03:05.938 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:05.937+0000 7f8e0511e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:06.013 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:06.013+0000 7f8e0511e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:06.023 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:06.023+0000 7f89ff2bf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:06.081 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:06.081+0000 7f8e0511e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:06.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.085+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f946406c6b0 con 0x7f946406b590 2023-10-24T02:03:06.086 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.085+0000 7f9455ffb700 1 -- 172.21.15.148:0/6145656 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v202) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9458028020 con 0x7f946406b590 2023-10-24T02:03:06.086 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:03:06.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 msgr2=0x7f9448061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:06.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 0x7f9448061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 msgr2=0x7f9464147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f9464067750 tx=0x7f9458017000).stop 2023-10-24T02:03:06.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 shutdown_connections 2023-10-24T02:03:06.090 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f944805f390 0x7f9448061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94640ac520 0x7f94640c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f94640653b0 0x7f94640c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 --2- 172.21.15.148:0/6145656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f946406b590 0x7f9464147ed0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 >> 172.21.15.148:0/6145656 conn(0x7f94640c3f60 msgr2=0x7f94641541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 shutdown_connections 2023-10-24T02:03:06.091 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.089+0000 7f946c171700 1 -- 172.21.15.148:0/6145656 wait complete. 2023-10-24T02:03:06.106 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:06.107 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:06.106+0000 7f89ff2bf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:06.179 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:06.179+0000 7f89ff2bf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:06.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 Processor -- start 2023-10-24T02:03:06.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 -- start start 2023-10-24T02:03:06.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0841543a0 0x7fb0840be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb084154780 0x7fb0840c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb084064610 con 0x7fb0840c33f0 2023-10-24T02:03:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840c6600 con 0x7fb0841543a0 2023-10-24T02:03:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.223+0000 7fb08a999700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840becc0 con 0x7fb084154780 2023-10-24T02:03:06.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0841543a0 0x7fb0840be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb0841543a0 0x7fb0840be690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46408/0 (socket says 172.21.15.148:46408) 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 -- 172.21.15.148:0/1895788233 learned_addr learned my addr 172.21.15.148:0/1895788233 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb0837fe700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb084154780 0x7fb0840c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 -- 172.21.15.148:0/1895788233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb084154780 msgr2=0x7fb0840c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb084154780 0x7fb0840c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 -- 172.21.15.148:0/1895788233 >> v1:172.21.15.150:6789/0 conn(0x7fb0840c33f0 legacy=0x7fb0840a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb082ffd700 1 -- 172.21.15.148:0/1895788233 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759901818 0 0) 0x7fb084064610 con 0x7fb0840c33f0 2023-10-24T02:03:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 -- 172.21.15.148:0/1895788233 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840befa0 con 0x7fb0841543a0 2023-10-24T02:03:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb083fff700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0841543a0 0x7fb0840be690 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7fb074009810 tx=0x7fb074009060).ready entity=mon.0 client_cookie=ceb460ea0dbf2628 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb082ffd700 1 -- 172.21.15.148:0/1895788233 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005880 con 0x7fb0841543a0 2023-10-24T02:03:06.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb082ffd700 1 -- 172.21.15.148:0/1895788233 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740059e0 con 0x7fb0841543a0 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.224+0000 7fb082ffd700 1 -- 172.21.15.148:0/1895788233 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005d60 con 0x7fb0841543a0 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 -- 172.21.15.148:0/1895788233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0841543a0 msgr2=0x7fb0840be690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0841543a0 0x7fb0840be690 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7fb074009810 tx=0x7fb074009060).stop 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 -- 172.21.15.148:0/1895788233 shutdown_connections 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0841543a0 0x7fb0840be690 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 --2- 172.21.15.148:0/1895788233 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb084154780 0x7fb0840c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 -- 172.21.15.148:0/1895788233 >> 172.21.15.148:0/1895788233 conn(0x7fb084082f60 msgr2=0x7fb084062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 -- 172.21.15.148:0/1895788233 shutdown_connections 2023-10-24T02:03:06.230 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.225+0000 7fb08a999700 1 -- 172.21.15.148:0/1895788233 wait complete. 2023-10-24T02:03:06.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.226+0000 7fb08a999700 1 Processor -- start 2023-10-24T02:03:06.232 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.226+0000 7fb08a999700 1 -- start start 2023-10-24T02:03:06.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 0x7fb0840c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0841543a0 0x7fb08414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 0x7fb0840c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c2ce0 con 0x7fb084154780 2023-10-24T02:03:06.233 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c7c80 con 0x7fb0841543a0 2023-10-24T02:03:06.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb08a999700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840c7070 con 0x7fb0840c33f0 2023-10-24T02:03:06.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb088f36700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 0x7fb0840c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb0837fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0841543a0 0x7fb08414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb088f36700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 0x7fb0840c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46422/0 (socket says 172.21.15.148:46422) 2023-10-24T02:03:06.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb088f36700 1 -- 172.21.15.148:0/2738982022 learned_addr learned my addr 172.21.15.148:0/2738982022 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.227+0000 7fb083fff700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 0x7fb0840c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0841543a0 msgr2=0x7fb08414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0841543a0 0x7fb08414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 msgr2=0x7fb0840c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 0x7fb0840c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.235 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 -- 172.21.15.148:0/2738982022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009300 con 0x7fb0840c33f0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb083fff700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 0x7fb0840c27f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb08405f5b0 tx=0x7fb074016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005880 con 0x7fb0840c33f0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740067c0 con 0x7fb0840c33f0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0840c7350 con 0x7fb0840c33f0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400b9a0 con 0x7fb0840c33f0 2023-10-24T02:03:06.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.228+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0840c7910 con 0x7fb0840c33f0 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.229+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08406c6b0 con 0x7fb0840c33f0 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.229+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fb074018070 con 0x7fb0840c33f0 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.230+0000 7fb06bfff700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 0x7fb070061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.230+0000 7fb0837fe700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 msgr2=0x7fb070061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.230+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fb07407b590 con 0x7fb0840c33f0 2023-10-24T02:03:06.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.230+0000 7fb0837fe700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 0x7fb070061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:06.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.234+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb07404c540 con 0x7fb0840c33f0 2023-10-24T02:03:06.342 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:06.341+0000 7f8e0511e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:06.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.431+0000 7fb0837fe700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 msgr2=0x7fb070061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:06.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.431+0000 7fb0837fe700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 0x7fb070061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:06.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.447+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0840bf280 con 0x7fb0840c33f0 2023-10-24T02:03:06.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.447+0000 7fb06bfff700 1 -- 172.21.15.148:0/2738982022 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7fb07404fb60 con 0x7fb0840c33f0 2023-10-24T02:03:06.448 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:06.448 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:03:06.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 msgr2=0x7fb070061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:06.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 0x7fb070061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 msgr2=0x7fb0840c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 0x7fb0840c27f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb08405f5b0 tx=0x7fb074016000).stop 2023-10-24T02:03:06.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 shutdown_connections 2023-10-24T02:03:06.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb084154780 0x7fb0840c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0840c33f0 0x7fb0840c27f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb07005f390 0x7fb070061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 --2- 172.21.15.148:0/2738982022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0841543a0 0x7fb08414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.449+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 >> 172.21.15.148:0/2738982022 conn(0x7fb084082f60 msgr2=0x7fb08415a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.450+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 shutdown_connections 2023-10-24T02:03:06.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.450+0000 7fb08a999700 1 -- 172.21.15.148:0/2738982022 wait complete. 2023-10-24T02:03:06.452 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:03:06.453 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:06.451+0000 7f89ff2bf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:06.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:06.526 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:06.526+0000 7f8e0511e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:06.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 Processor -- start 2023-10-24T02:03:06.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 -- start start 2023-10-24T02:03:06.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4218150530 0x7f42180c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4218150910 0x7f42180c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f42180bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.583+0000 7f421dc2e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180c30f0 con 0x7f4218150530 2023-10-24T02:03:06.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f421dc2e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180c24e0 con 0x7f4218150910 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f421dc2e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c27c0 con 0x7f42180638c0 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4218150530 0x7f42180c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4218150530 0x7f42180c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46436/0 (socket says 172.21.15.148:46436) 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 -- 172.21.15.148:0/2124740497 learned_addr learned my addr 172.21.15.148:0/2124740497 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f4216ffd700 1 --2- 172.21.15.148:0/2124740497 >> v2:172.21.15.150:3300/0 conn(0x7f4218150910 0x7f42180c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f4217fff700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f42180bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 -- 172.21.15.148:0/2124740497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 msgr2=0x7f42180bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:06.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f42180bcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 -- 172.21.15.148:0/2124740497 >> v2:172.21.15.150:3300/0 conn(0x7f4218150910 msgr2=0x7f42180c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:06.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 --2- 172.21.15.148:0/2124740497 >> v2:172.21.15.150:3300/0 conn(0x7f4218150910 0x7f42180c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 -- 172.21.15.148:0/2124740497 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180c2aa0 con 0x7f4218150530 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42177fe700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150530 0x7f42180c1f50 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f4218068060 tx=0x7f42080090f0).ready entity=mon.0 client_cookie=64906bcbf8ea3c5e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42167fc700 1 -- 172.21.15.148:0/2124740497 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800f510 con 0x7f4218150530 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42167fc700 1 -- 172.21.15.148:0/2124740497 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800f670 con 0x7f4218150530 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.584+0000 7f42167fc700 1 -- 172.21.15.148:0/2124740497 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800f9f0 con 0x7f4218150530 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 -- 172.21.15.148:0/2124740497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150530 msgr2=0x7f42180c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150530 0x7f42180c1f50 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f4218068060 tx=0x7f42080090f0).stop 2023-10-24T02:03:06.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 -- 172.21.15.148:0/2124740497 shutdown_connections 2023-10-24T02:03:06.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150530 0x7f42180c1f50 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2124740497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f42180bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2124740497 >> v2:172.21.15.150:3300/0 conn(0x7f4218150910 0x7f42180c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 -- 172.21.15.148:0/2124740497 >> 172.21.15.148:0/2124740497 conn(0x7f42180c7ee0 msgr2=0x7f42180c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 -- 172.21.15.148:0/2124740497 shutdown_connections 2023-10-24T02:03:06.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.585+0000 7f421dc2e700 1 -- 172.21.15.148:0/2124740497 wait complete. 2023-10-24T02:03:06.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.586+0000 7f421dc2e700 1 Processor -- start 2023-10-24T02:03:06.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.586+0000 7f421dc2e700 1 -- start start 2023-10-24T02:03:06.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f421814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4218150530 0x7f4218142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 0x7f4218146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421814b880 con 0x7f4218150910 2023-10-24T02:03:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421814ac70 con 0x7f4218150530 2023-10-24T02:03:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f421dc2e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421814af50 con 0x7f42180638c0 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f4217fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 0x7f4218146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f4217fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 0x7f4218146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46452/0 (socket says 172.21.15.148:46452) 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f4217fff700 1 -- 172.21.15.148:0/2754981212 learned_addr learned my addr 172.21.15.148:0/2754981212 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f42177fe700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f421814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.587+0000 7f4216ffd700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4218150530 0x7f4218142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 -- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4218150530 msgr2=0x7f4218142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4218150530 0x7f4218142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 -- 172.21.15.148:0/2754981212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 msgr2=0x7f4218146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 0x7f4218146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 -- 172.21.15.148:0/2754981212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009370 con 0x7f42180638c0 2023-10-24T02:03:06.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f42177fe700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f421814a3e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f4208014000 tx=0x7f4208017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800f7e0 con 0x7f42180638c0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800f940 con 0x7f42180638c0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421814b230 con 0x7f42180638c0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420801c670 con 0x7f42180638c0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.588+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421814a8d0 con 0x7f42180638c0 2023-10-24T02:03:06.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.589+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421814bb60 con 0x7f42180638c0 2023-10-24T02:03:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.589+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f420801ca60 con 0x7f42180638c0 2023-10-24T02:03:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.590+0000 7f41ff7fe700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 0x7f4204061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.590+0000 7f4216ffd700 1 -- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 msgr2=0x7f4204061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.590+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f420807c150 con 0x7f42180638c0 2023-10-24T02:03:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.590+0000 7f4216ffd700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 0x7f4204061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.595+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f420804d040 con 0x7f42180638c0 2023-10-24T02:03:06.648 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:06.648+0000 7f89ff2bf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:06.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.765+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42180c2d80 con 0x7f42180638c0 2023-10-24T02:03:06.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.766+0000 7f41ff7fe700 1 -- 172.21.15.148:0/2754981212 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+17310 (secure 0 0 0) 0x7f420802a090 con 0x7f42180638c0 2023-10-24T02:03:06.768 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:06.768 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":202,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:01:51.109103+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:6832/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/1630888363":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/213201995":"2023-10-25T02:01:51.109055+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:06.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 msgr2=0x7f4204061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:06.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 0x7f4204061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 msgr2=0x7f421814a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f421814a3e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f4208014000 tx=0x7f4208017000).stop 2023-10-24T02:03:06.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 shutdown_connections 2023-10-24T02:03:06.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4218150910 0x7f4218146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42180638c0 0x7f421814a3e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f420405f390 0x7f4204061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:06.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 --2- 172.21.15.148:0/2754981212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4218150530 0x7f4218142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 >> 172.21.15.148:0/2754981212 conn(0x7f42180c7ee0 msgr2=0x7f42180c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 shutdown_connections 2023-10-24T02:03:06.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.768+0000 7f421dc2e700 1 -- 172.21.15.148:0/2754981212 wait complete. 2023-10-24T02:03:06.782 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T02:03:06.782 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.903+0000 7f599bcca700 1 Processor -- start 2023-10-24T02:03:06.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.903+0000 7f599bcca700 1 -- start start 2023-10-24T02:03:06.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f599bcca700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5994153470 0x7f5994062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f599bcca700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5994062f90 con 0x7f5994153090 2023-10-24T02:03:06.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f599bcca700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5994069420 con 0x7f5994062b40 2023-10-24T02:03:06.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f599bcca700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5994153900 con 0x7f5994153470 2023-10-24T02:03:06.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f5999a66700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5994153090 0x7f59940bcbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47234/0 (socket says 172.21.15.148:47234) 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f5999a66700 1 -- 172.21.15.148:0/1767497233 learned_addr learned my addr 172.21.15.148:0/1767497233 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.904+0000 7f5999265700 1 --2- 172.21.15.148:0/1767497233 >> v2:172.21.15.150:3300/0 conn(0x7f5994153470 0x7f5994062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5998a64700 1 -- 172.21.15.148:0/1767497233 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940701190 0 0) 0x7f5994062f90 con 0x7f5994153090 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5998a64700 1 -- 172.21.15.148:0/1767497233 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59800033f0 con 0x7f5994153090 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5999265700 1 -- 172.21.15.148:0/1767497233 >> v1:172.21.15.150:6789/0 conn(0x7f5994062b40 legacy=0x7f59940654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5999265700 1 -- 172.21.15.148:0/1767497233 >> v1:172.21.15.148:6789/0 conn(0x7f5994153090 legacy=0x7f59940bcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5999265700 1 -- 172.21.15.148:0/1767497233 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994069700 con 0x7f5994153470 2023-10-24T02:03:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5999265700 1 --2- 172.21.15.148:0/1767497233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153470 0x7f5994062650 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5990009760 tx=0x7f5990009060).ready entity=mon.1 client_cookie=7d4f03daa7d1f716 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5998a64700 1 -- 172.21.15.148:0/1767497233 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000f510 con 0x7f5994153470 2023-10-24T02:03:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5998a64700 1 -- 172.21.15.148:0/1767497233 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000f670 con 0x7f5994153470 2023-10-24T02:03:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.905+0000 7f5998a64700 1 -- 172.21.15.148:0/1767497233 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000f9f0 con 0x7f5994153470 2023-10-24T02:03:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 -- 172.21.15.148:0/1767497233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153470 msgr2=0x7f5994062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 --2- 172.21.15.148:0/1767497233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153470 0x7f5994062650 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5990009760 tx=0x7f5990009060).stop 2023-10-24T02:03:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 -- 172.21.15.148:0/1767497233 shutdown_connections 2023-10-24T02:03:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 --2- 172.21.15.148:0/1767497233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153470 0x7f5994062650 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 -- 172.21.15.148:0/1767497233 >> 172.21.15.148:0/1767497233 conn(0x7f5994064230 msgr2=0x7f59940c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 -- 172.21.15.148:0/1767497233 shutdown_connections 2023-10-24T02:03:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.906+0000 7f599bcca700 1 -- 172.21.15.148:0/1767497233 wait complete. 2023-10-24T02:03:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.907+0000 7f599bcca700 1 Processor -- start 2023-10-24T02:03:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.907+0000 7f599bcca700 1 -- start start 2023-10-24T02:03:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153090 0x7f5994136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5994153470 0x7f599413af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59940a7c40 con 0x7f5994062b40 2023-10-24T02:03:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994166c90 con 0x7f5994153090 2023-10-24T02:03:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599bcca700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59940ac580 con 0x7f5994153470 2023-10-24T02:03:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f5999a66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f5999a66700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46454/0 (socket says 172.21.15.148:46454) 2023-10-24T02:03:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f5999a66700 1 -- 172.21.15.148:0/3669156355 learned_addr learned my addr 172.21.15.148:0/3669156355 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f5999265700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153090 0x7f5994136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.908+0000 7f599a267700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5994153470 0x7f599413af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:06.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5994153470 msgr2=0x7f599413af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5994153470 0x7f599413af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153090 msgr2=0x7f5994136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153090 0x7f5994136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 -- 172.21.15.148:0/3669156355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900092a0 con 0x7f5994062b40 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5999a66700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f598400c5c0 tx=0x7f5984007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:06.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840072e0 con 0x7f5994062b40 2023-10-24T02:03:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984007440 con 0x7f5994062b40 2023-10-24T02:03:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599413baf0 con 0x7f5994062b40 2023-10-24T02:03:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840057a0 con 0x7f5994062b40 2023-10-24T02:03:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.909+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59940ac210 con 0x7f5994062b40 2023-10-24T02:03:06.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.910+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599406c6b0 con 0x7f5994062b40 2023-10-24T02:03:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.910+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5984005b90 con 0x7f5994062b40 2023-10-24T02:03:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.911+0000 7f5989ffb700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 0x7f5978061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.911+0000 7f5999265700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 msgr2=0x7f5978061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.911+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f5984079d70 con 0x7f5994062b40 2023-10-24T02:03:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.911+0000 7f5999265700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 0x7f5978061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:06.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:06.919+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f598404acf0 con 0x7f5994062b40 2023-10-24T02:03:07.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.112+0000 7f5999265700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 msgr2=0x7f5978061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:07.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.112+0000 7f5999265700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 0x7f5978061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:07.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.140+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f599413b850 con 0x7f5994062b40 2023-10-24T02:03:07.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.140+0000 7f5989ffb700 1 -- 172.21.15.148:0/3669156355 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f598404e310 con 0x7f5994062b40 2023-10-24T02:03:07.142 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:07.142 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:03:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 msgr2=0x7f5978061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 0x7f5978061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 msgr2=0x7f59940a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f598400c5c0 tx=0x7f5984007c80).stop 2023-10-24T02:03:07.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 shutdown_connections 2023-10-24T02:03:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5994153470 0x7f599413af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5994062b40 0x7f59940a7750 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f597805f390 0x7f5978061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 --2- 172.21.15.148:0/3669156355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5994153090 0x7f5994136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.146 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 >> 172.21.15.148:0/3669156355 conn(0x7f5994064230 msgr2=0x7f59940c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 shutdown_connections 2023-10-24T02:03:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.142+0000 7f599bcca700 1 -- 172.21.15.148:0/3669156355 wait complete. 2023-10-24T02:03:07.147 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:03:07.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:07.194 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.194+0000 7f8e0511e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:07.265 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.265+0000 7f8e0511e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:07.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.279+0000 7f79c6716700 1 Processor -- start 2023-10-24T02:03:07.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.279+0000 7f79c6716700 1 -- start start 2023-10-24T02:03:07.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c6716700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79c0154530 0x7f79c0063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c6716700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c6716700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c0063400 con 0x7f79c00bc910 2023-10-24T02:03:07.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c6716700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c0063100 con 0x7f79c0154530 2023-10-24T02:03:07.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c6716700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00c1ea0 con 0x7f79c006b410 2023-10-24T02:03:07.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bf7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79c0154530 0x7f79c0063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bf7fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:42672/0 (socket says 172.21.15.148:42672) 2023-10-24T02:03:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79c0154530 0x7f79c0063890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:55358/0 (socket says 172.21.15.148:55358) 2023-10-24T02:03:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bf7fe700 1 -- 172.21.15.148:0/1272653671 learned_addr learned my addr 172.21.15.148:0/1272653671 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79c4cb3700 1 --1- 172.21.15.148:0/1272653671 >> v1:172.21.15.150:6789/0 conn(0x7f79c00bc910 0x7f79c0064ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:44024/0 (socket says 172.21.15.148:44024) 2023-10-24T02:03:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 -- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 msgr2=0x7f79c00bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 -- 172.21.15.148:0/1272653671 >> v1:172.21.15.150:6789/0 conn(0x7f79c00bc910 legacy=0x7f79c0064ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 -- 172.21.15.148:0/1272653671 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00c2180 con 0x7f79c0154530 2023-10-24T02:03:07.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bf7fe700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.280+0000 7f79bffff700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c0154530 0x7f79c0063890 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f79b0009760 tx=0x7f79b0009060).ready entity=mon.1 client_cookie=3ef9dcf4904c01b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79beffd700 1 -- 172.21.15.148:0/1272653671 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000f510 con 0x7f79c0154530 2023-10-24T02:03:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79beffd700 1 -- 172.21.15.148:0/1272653671 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000f670 con 0x7f79c0154530 2023-10-24T02:03:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79beffd700 1 -- 172.21.15.148:0/1272653671 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000f9f0 con 0x7f79c0154530 2023-10-24T02:03:07.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 -- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c0154530 msgr2=0x7f79c0063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c0154530 0x7f79c0063890 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f79b0009760 tx=0x7f79b0009060).stop 2023-10-24T02:03:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 -- 172.21.15.148:0/1272653671 shutdown_connections 2023-10-24T02:03:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c0154530 0x7f79c0063890 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 --2- 172.21.15.148:0/1272653671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c006b410 0x7f79c00bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 -- 172.21.15.148:0/1272653671 >> 172.21.15.148:0/1272653671 conn(0x7f79c00c3f00 msgr2=0x7f79c00c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 -- 172.21.15.148:0/1272653671 shutdown_connections 2023-10-24T02:03:07.289 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.281+0000 7f79c6716700 1 -- 172.21.15.148:0/1272653671 wait complete. 2023-10-24T02:03:07.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.282+0000 7f79c6716700 1 Processor -- start 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 -- start start 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c006b410 0x7f79c014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c0154530 0x7f79c00c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01507d0 con 0x7f79c00bc910 2023-10-24T02:03:07.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0150ab0 con 0x7f79c006b410 2023-10-24T02:03:07.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.283+0000 7f79c6716700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0150d90 con 0x7f79c0154530 2023-10-24T02:03:07.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46456/0 (socket says 172.21.15.148:46456) 2023-10-24T02:03:07.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79c4cb3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c0154530 0x7f79c00c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.293 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 -- 172.21.15.148:0/3307494847 learned_addr learned my addr 172.21.15.148:0/3307494847 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bffff700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c006b410 0x7f79c014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c0154530 msgr2=0x7f79c00c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c0154530 0x7f79c00c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c006b410 msgr2=0x7f79c014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c006b410 0x7f79c014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 -- 172.21.15.148:0/3307494847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4009370 con 0x7f79c00bc910 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79bf7fe700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f79b4006d00 tx=0x7f79b40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4012600 con 0x7f79c00bc910 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4012760 con 0x7f79c00bc910 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b00092a0 con 0x7f79c00bc910 2023-10-24T02:03:07.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4012ae0 con 0x7f79c00bc910 2023-10-24T02:03:07.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.284+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0151350 con 0x7f79c00bc910 2023-10-24T02:03:07.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.285+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c006c6b0 con 0x7f79c00bc910 2023-10-24T02:03:07.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.286+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f79b401b400 con 0x7f79c00bc910 2023-10-24T02:03:07.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.286+0000 7f79a7fff700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 0x7f79ac061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.286+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f79b407ab90 con 0x7f79c00bc910 2023-10-24T02:03:07.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.286+0000 7f79bffff700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 msgr2=0x7f79ac061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:07.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.286+0000 7f79bffff700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 0x7f79ac061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:07.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.296+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f79b404ba50 con 0x7f79c00bc910 2023-10-24T02:03:07.343 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.343+0000 7f8e0511e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:07.358 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.357+0000 7f89ff2bf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:07.430 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.429+0000 7f89ff2bf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:07.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.487+0000 7f79bffff700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 msgr2=0x7f79ac061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:07.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.487+0000 7f79bffff700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 0x7f79ac061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:07.491 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.490+0000 7f8e0511e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:07.509 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.508+0000 7f89ff2bf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:07.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.508+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c0069f10 con 0x7f79c00bc910 2023-10-24T02:03:07.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.509+0000 7f79a7fff700 1 -- 172.21.15.148:0/3307494847 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4505 (secure 0 0 0) 0x7f79b4016020 con 0x7f79c00bc910 2023-10-24T02:03:07.511 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:07.511 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:01:35.400665+0000","modified":"2023-10-24T02:01:37.410603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9699":{"gid":9699,"name":"b","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6835/4014138600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4014138600},{"type":"v1","addr":"172.21.15.150:6835","nonce":4014138600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-24T02:03:07.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 msgr2=0x7f79ac061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:07.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 0x7f79ac061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 msgr2=0x7f79c00a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f79b4006d00 tx=0x7f79b40090f0).stop 2023-10-24T02:03:07.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 shutdown_connections 2023-10-24T02:03:07.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79c0154530 0x7f79c00c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f79ac05f390 0x7f79ac061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79c006b410 0x7f79c014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 --2- 172.21.15.148:0/3307494847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79c00bc910 0x7f79c00a4eb0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.511+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 >> 172.21.15.148:0/3307494847 conn(0x7f79c00c3f00 msgr2=0x7f79c0062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.512+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 shutdown_connections 2023-10-24T02:03:07.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.512+0000 7f79c6716700 1 -- 172.21.15.148:0/3307494847 wait complete. 2023-10-24T02:03:07.516 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 68 2023-10-24T02:03:07.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:07.561 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.561+0000 7f8e0511e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:07.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.641+0000 7faee947d700 1 Processor -- start 2023-10-24T02:03:07.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.641+0000 7faee947d700 1 -- start start 2023-10-24T02:03:07.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee947d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 0x7faee40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee947d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee947d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40c0960 con 0x7faee4158770 2023-10-24T02:03:07.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee947d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40aa8e0 con 0x7faee40c6710 2023-10-24T02:03:07.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee947d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40c0c40 con 0x7faee40aa010 2023-10-24T02:03:07.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.642+0000 7faee27fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee27fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46472/0 (socket says 172.21.15.148:46472) 2023-10-24T02:03:07.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee27fc700 1 -- 172.21.15.148:0/3089966446 learned_addr learned my addr 172.21.15.148:0/3089966446 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3089966446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 0x7faee40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 -- 172.21.15.148:0/3089966446 >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 msgr2=0x7faee40aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3089966446 >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 -- 172.21.15.148:0/3089966446 >> v1:172.21.15.148:6789/0 conn(0x7faee4158770 legacy=0x7faee4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 -- 172.21.15.148:0/3089966446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40c0f20 con 0x7faee40aa010 2023-10-24T02:03:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee27fc700 1 --2- 172.21.15.148:0/3089966446 >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:07.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3089966446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 0x7faee40c1a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7faecc009760 tx=0x7faecc009060).ready entity=mon.2 client_cookie=2c149333c54697e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee1ffb700 1 -- 172.21.15.148:0/3089966446 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f510 con 0x7faee40aa010 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee1ffb700 1 -- 172.21.15.148:0/3089966446 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f670 con 0x7faee40aa010 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.643+0000 7faee1ffb700 1 -- 172.21.15.148:0/3089966446 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f9f0 con 0x7faee40aa010 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 -- 172.21.15.148:0/3089966446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 msgr2=0x7faee40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 --2- 172.21.15.148:0/3089966446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 0x7faee40c1a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7faecc009760 tx=0x7faecc009060).stop 2023-10-24T02:03:07.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 -- 172.21.15.148:0/3089966446 shutdown_connections 2023-10-24T02:03:07.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 --2- 172.21.15.148:0/3089966446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40aa010 0x7faee40c1a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 --2- 172.21.15.148:0/3089966446 >> v2:172.21.15.148:3300/0 conn(0x7faee40c6710 0x7faee40aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 -- 172.21.15.148:0/3089966446 >> 172.21.15.148:0/3089966446 conn(0x7faee40caf40 msgr2=0x7faee40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 -- 172.21.15.148:0/3089966446 shutdown_connections 2023-10-24T02:03:07.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.644+0000 7faee947d700 1 -- 172.21.15.148:0/3089966446 wait complete. 2023-10-24T02:03:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.645+0000 7faee947d700 1 Processor -- start 2023-10-24T02:03:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.645+0000 7faee947d700 1 -- start start 2023-10-24T02:03:07.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40c6710 0x7faee40aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee4158770 0x7faee40abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40ac3f0 con 0x7faee40aa010 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4156630 con 0x7faee4158770 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee947d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee4155a20 con 0x7faee40c6710 2023-10-24T02:03:07.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46476/0 (socket says 172.21.15.148:46476) 2023-10-24T02:03:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 -- 172.21.15.148:0/3104442142 learned_addr learned my addr 172.21.15.148:0/3104442142 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee27fc700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40c6710 0x7faee40aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee37fe700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee4158770 0x7faee40abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 -- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40c6710 msgr2=0x7faee40aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40c6710 0x7faee40aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 -- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee4158770 msgr2=0x7faee40abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee4158770 0x7faee40abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.646+0000 7faee2ffd700 1 -- 172.21.15.148:0/3104442142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4009370 con 0x7faee40aa010 2023-10-24T02:03:07.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faee2ffd700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7faee40c0d80 tx=0x7faecc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00f7e0 con 0x7faee40aa010 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00f940 con 0x7faee40aa010 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0092a0 con 0x7faee40aa010 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc01b660 con 0x7faee40aa010 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.647+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4155fe0 con 0x7faee40aa010 2023-10-24T02:03:07.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.648+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee406c6b0 con 0x7faee40aa010 2023-10-24T02:03:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.648+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7faecc01ba50 con 0x7faee40aa010 2023-10-24T02:03:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.648+0000 7faedaffd700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 0x7faec4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.649+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6393+0+0 (secure 0 0 0) 0x7faecc07c110 con 0x7faee40aa010 2023-10-24T02:03:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.649+0000 7faee27fc700 1 -- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 msgr2=0x7faec4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:07.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.649+0000 7faee27fc700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 0x7faec4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:07.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.653+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faecc04cfd0 con 0x7faee40aa010 2023-10-24T02:03:07.669 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.667+0000 7f89ff2bf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:07.678 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.678+0000 7f8e0511e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:07.743 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.741+0000 7f89ff2bf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:07.785 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:07.785+0000 7f8e0511e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:07.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.824+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee40c1200 con 0x7faee40aa010 2023-10-24T02:03:07.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.825+0000 7faedaffd700 1 -- 172.21.15.148:0/3104442142 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+17422 (secure 0 0 0) 0x7faecc028090 con 0x7faee40aa010 2023-10-24T02:03:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:07.827 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":203,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:06.889594+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:01:33.950823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-24T02:01:34.364961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"203","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":203,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:6832/100598":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/1630888363":"2023-10-25T02:01:51.109055+0000","172.21.15.150:0/213201995":"2023-10-25T02:01:51.109055+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:07.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 msgr2=0x7faec4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 0x7faec4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 msgr2=0x7faee4147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7faee40c0d80 tx=0x7faecc017000).stop 2023-10-24T02:03:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 shutdown_connections 2023-10-24T02:03:07.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faec405f390 0x7faec4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:07.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faee4158770 0x7faee40abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faee40aa010 0x7faee4147fa0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 --2- 172.21.15.148:0/3104442142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faee40c6710 0x7faee40aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 >> 172.21.15.148:0/3104442142 conn(0x7faee40caf40 msgr2=0x7faee40ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 shutdown_connections 2023-10-24T02:03:07.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.827+0000 7faee947d700 1 -- 172.21.15.148:0/3104442142 wait complete. 2023-10-24T02:03:07.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T02:03:07.864 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.863+0000 7f89ff2bf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:07.959 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.958+0000 7fe82df4e700 1 Processor -- start 2023-10-24T02:03:07.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.958+0000 7fe82df4e700 1 -- start start 2023-10-24T02:03:07.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe82df4e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8280c6420 0x7fe8280be600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.962 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe82df4e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8280c48a0 0x7fe82815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe82df4e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280bfcf0 con 0x7fe8280beaf0 2023-10-24T02:03:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe82df4e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280c6800 con 0x7fe8280c6420 2023-10-24T02:03:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe82df4e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280bf0e0 con 0x7fe8280c48a0 2023-10-24T02:03:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8280c6420 0x7fe8280be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe8280c6420 0x7fe8280be600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46492/0 (socket says 172.21.15.148:46492) 2023-10-24T02:03:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 -- 172.21.15.148:0/3453914069 learned_addr learned my addr 172.21.15.148:0/3453914069 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe827fff700 1 --2- 172.21.15.148:0/3453914069 >> v2:172.21.15.150:3300/0 conn(0x7fe8280c48a0 0x7fe82815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 -- 172.21.15.148:0/3453914069 >> v2:172.21.15.150:3300/0 conn(0x7fe8280c48a0 msgr2=0x7fe82815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 --2- 172.21.15.148:0/3453914069 >> v2:172.21.15.150:3300/0 conn(0x7fe8280c48a0 0x7fe82815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 -- 172.21.15.148:0/3453914069 >> v1:172.21.15.148:6789/0 conn(0x7fe8280beaf0 legacy=0x7fe8280c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.959+0000 7fe8277fe700 1 -- 172.21.15.148:0/3453914069 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280bf3c0 con 0x7fe8280c6420 2023-10-24T02:03:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe8277fe700 1 --2- 172.21.15.148:0/3453914069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280c6420 0x7fe8280be600 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fe828158110 tx=0x7fe818009060).ready entity=mon.0 client_cookie=7acd394c83a67bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe826ffd700 1 -- 172.21.15.148:0/3453914069 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818005880 con 0x7fe8280c6420 2023-10-24T02:03:07.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe826ffd700 1 -- 172.21.15.148:0/3453914069 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180059e0 con 0x7fe8280c6420 2023-10-24T02:03:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe826ffd700 1 -- 172.21.15.148:0/3453914069 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818005d60 con 0x7fe8280c6420 2023-10-24T02:03:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 -- 172.21.15.148:0/3453914069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280c6420 msgr2=0x7fe8280be600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 --2- 172.21.15.148:0/3453914069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280c6420 0x7fe8280be600 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7fe828158110 tx=0x7fe818009060).stop 2023-10-24T02:03:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 -- 172.21.15.148:0/3453914069 shutdown_connections 2023-10-24T02:03:07.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 --2- 172.21.15.148:0/3453914069 >> v2:172.21.15.150:3300/0 conn(0x7fe8280c48a0 0x7fe82815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 --2- 172.21.15.148:0/3453914069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280c6420 0x7fe8280be600 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 -- 172.21.15.148:0/3453914069 >> 172.21.15.148:0/3453914069 conn(0x7fe828092510 msgr2=0x7fe828062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 -- 172.21.15.148:0/3453914069 shutdown_connections 2023-10-24T02:03:07.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.960+0000 7fe82df4e700 1 -- 172.21.15.148:0/3453914069 wait complete. 2023-10-24T02:03:07.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.961+0000 7fe82df4e700 1 Processor -- start 2023-10-24T02:03:07.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 -- start start 2023-10-24T02:03:07.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8280c48a0 0x7fe8280c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8280c6420 0x7fe8280c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280aa1e0 con 0x7fe8280beaf0 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280aa460 con 0x7fe8280c6420 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe82df4e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280aa740 con 0x7fe8280c48a0 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46506/0 (socket says 172.21.15.148:46506) 2023-10-24T02:03:07.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.962+0000 7fe8277fe700 1 -- 172.21.15.148:0/826029593 learned_addr learned my addr 172.21.15.148:0/826029593 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:07.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe81effd700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8280c48a0 0x7fe8280c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe827fff700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8280c6420 0x7fe8280c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:07.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8280c48a0 msgr2=0x7fe8280c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8280c48a0 0x7fe8280c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8280c6420 msgr2=0x7fe8280c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8280c6420 0x7fe8280c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 -- 172.21.15.148:0/826029593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009300 con 0x7fe8280beaf0 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe8277fe700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7fe828069d60 tx=0x7fe818016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800b580 con 0x7fe8280beaf0 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800b6e0 con 0x7fe8280beaf0 2023-10-24T02:03:07.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8280aaa20 con 0x7fe8280beaf0 2023-10-24T02:03:07.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800ba80 con 0x7fe8280beaf0 2023-10-24T02:03:07.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.963+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280aafe0 con 0x7fe8280beaf0 2023-10-24T02:03:07.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.964+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8280ab9f0 con 0x7fe8280beaf0 2023-10-24T02:03:07.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.964+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 95) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe818018070 con 0x7fe8280beaf0 2023-10-24T02:03:07.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.965+0000 7fe81ffff700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 0x7fe808061820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.965+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6393+0+0 (secure 0 0 0) 0x7fe81807b510 con 0x7fe8280beaf0 2023-10-24T02:03:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.965+0000 7fe81effd700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 msgr2=0x7fe808061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.965+0000 7fe81effd700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 0x7fe808061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:07.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:07.969+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe81804c3d0 con 0x7fe8280beaf0 2023-10-24T02:03:07.983 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:07.981+0000 7f89ff2bf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:08.080 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.080+0000 7f8e0511e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:08.153 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.153+0000 7f8e0511e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.166+0000 7fe81effd700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 msgr2=0x7fe808061820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:08.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.166+0000 7fe81effd700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 0x7fe808061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.179+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 96) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fe818078ed0 con 0x7fe8280beaf0 2023-10-24T02:03:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.180+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 msgr2=0x7fe808061820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:08.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.180+0000 7fe81ffff700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 0x7fe808061820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:08.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:08.180+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe8280c3850 con 0x7fe8280beaf0 2023-10-24T02:03:08.241 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d828b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.242 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d828b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.242 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d828b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d828b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d828b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d7f8b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d7f8b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d7f8b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.244 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d7f8b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.244 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:08.241+0000 7f8d7f8b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:08.244 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:08.245 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:08.245 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:03:08.258 INFO:tasks.ceph.mds.b.smithi150.stderr: -4> 2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:08.259 INFO:tasks.ceph.mds.b.smithi150.stderr: -3> 2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:08.259 INFO:tasks.ceph.mds.b.smithi150.stderr: -1> 2023-10-24T02:03:08.244+0000 7faf5fa9d700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:03:08.277 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T02:03:08.289 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:08.287+0000 7f89ff2bf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:08.360 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:08.359+0000 7f89ff2bf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:09.171 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T02:03:09.170+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T02:03:09.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.172+0000 7fe81ffff700 1 -- 172.21.15.148:0/826029593 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe818042330 con 0x7fe8280beaf0 2023-10-24T02:03:09.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 msgr2=0x7fe8280ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7fe828069d60 tx=0x7fe818016000).stop 2023-10-24T02:03:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 shutdown_connections 2023-10-24T02:03:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe80805f360 0x7fe808061820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8280c6420 0x7fe8280c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8280beaf0 0x7fe8280ab500 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 --2- 172.21.15.148:0/826029593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8280c48a0 0x7fe8280c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 >> 172.21.15.148:0/826029593 conn(0x7fe828092510 msgr2=0x7fe828067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:09.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 shutdown_connections 2023-10-24T02:03:09.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.174+0000 7fe82df4e700 1 -- 172.21.15.148:0/826029593 wait complete. 2023-10-24T02:03:09.177 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T02:03:09.189 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T02:03:09.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.345+0000 7f7040209700 1 Processor -- start 2023-10-24T02:03:09.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.345+0000 7f7040209700 1 -- start start 2023-10-24T02:03:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f7040209700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 0x7f7038154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:09.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f7040209700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380c71d0 con 0x7f7038154430 2023-10-24T02:03:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f7040209700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380c9410 con 0x7f70380bffd0 2023-10-24T02:03:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f7040209700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380c6a10 con 0x7f7038098bd0 2023-10-24T02:03:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f703dfa5700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f7038154430 0x7f70380c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47262/0 (socket says 172.21.15.148:47262) 2023-10-24T02:03:09.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f703dfa5700 1 -- 172.21.15.148:0/4172441612 learned_addr learned my addr 172.21.15.148:0/4172441612 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f703d7a4700 1 --2- 172.21.15.148:0/4172441612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 0x7f7038154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.346+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820576159 0 0) 0x7f70380c71d0 con 0x7f7038154430 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70240033f0 con 0x7f7038154430 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647053387 0 0) 0x7f70380c9410 con 0x7f70380bffd0 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70380c71d0 con 0x7f70380bffd0 2023-10-24T02:03:09.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703d7a4700 1 -- 172.21.15.148:0/4172441612 >> v1:172.21.15.150:6789/0 conn(0x7f70380bffd0 legacy=0x7f703815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703d7a4700 1 -- 172.21.15.148:0/4172441612 >> v1:172.21.15.148:6789/0 conn(0x7f7038154430 legacy=0x7f70380c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703d7a4700 1 -- 172.21.15.148:0/4172441612 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380ca8b0 con 0x7f7038098bd0 2023-10-24T02:03:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703d7a4700 1 --2- 172.21.15.148:0/4172441612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 0x7f7038154810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f70280097c0 tx=0x7f7028009060).ready entity=mon.2 client_cookie=dacadd360dda0486 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800d4a0 con 0x7f7038098bd0 2023-10-24T02:03:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702800d600 con 0x7f7038098bd0 2023-10-24T02:03:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f703cfa3700 1 -- 172.21.15.148:0/4172441612 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800d980 con 0x7f7038098bd0 2023-10-24T02:03:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f7040209700 1 -- 172.21.15.148:0/4172441612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 msgr2=0x7f7038154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f7040209700 1 --2- 172.21.15.148:0/4172441612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 0x7f7038154810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f70280097c0 tx=0x7f7028009060).stop 2023-10-24T02:03:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f7040209700 1 -- 172.21.15.148:0/4172441612 shutdown_connections 2023-10-24T02:03:09.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f7040209700 1 --2- 172.21.15.148:0/4172441612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038098bd0 0x7f7038154810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.347+0000 7f7040209700 1 -- 172.21.15.148:0/4172441612 >> 172.21.15.148:0/4172441612 conn(0x7f70380cb070 msgr2=0x7f70380cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.348+0000 7f7040209700 1 -- 172.21.15.148:0/4172441612 shutdown_connections 2023-10-24T02:03:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.348+0000 7f7040209700 1 -- 172.21.15.148:0/4172441612 wait complete. 2023-10-24T02:03:09.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 Processor -- start 2023-10-24T02:03:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 -- start start 2023-10-24T02:03:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70380bffd0 0x7f7038167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 0x7f7038167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038168880 con 0x7f7038098bd0 2023-10-24T02:03:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038152490 con 0x7f70380bffd0 2023-10-24T02:03:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.349+0000 7f7040209700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380ae2c0 con 0x7f7038154430 2023-10-24T02:03:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46518/0 (socket says 172.21.15.148:46518) 2023-10-24T02:03:09.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 -- 172.21.15.148:0/2665336411 learned_addr learned my addr 172.21.15.148:0/2665336411 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703d7a4700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70380bffd0 0x7f7038167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703e7a6700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 0x7f7038167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 -- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 msgr2=0x7f7038167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 0x7f7038167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 -- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70380bffd0 msgr2=0x7f7038167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70380bffd0 0x7f7038167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 -- 172.21.15.148:0/2665336411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280092a0 con 0x7f7038098bd0 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703e7a6700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 0x7f7038167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f703dfa5700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f703400c810 tx=0x7f7034001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034005d30 con 0x7f7038098bd0 2023-10-24T02:03:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034005e90 con 0x7f7038098bd0 2023-10-24T02:03:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70381685a0 con 0x7f7038098bd0 2023-10-24T02:03:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034007320 con 0x7f7038098bd0 2023-10-24T02:03:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.350+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7038152120 con 0x7f7038098bd0 2023-10-24T02:03:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.351+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 97) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f70340076d0 con 0x7f7038098bd0 2023-10-24T02:03:09.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.351+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703806c6b0 con 0x7f7038098bd0 2023-10-24T02:03:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.352+0000 7f702dffb700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 0x7f701c0614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.352+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f703407a190 con 0x7f7038098bd0 2023-10-24T02:03:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.352+0000 7f703d7a4700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 0x7f701c0614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:09.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.352+0000 7f703d7a4700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 0x7f701c0614c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f70280097c0 tx=0x7f7028016000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:09.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.356+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f703404ee10 con 0x7f7038098bd0 2023-10-24T02:03:09.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:09.561+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7038062c40 con 0x7f7038098bd0 2023-10-24T02:03:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.194+0000 7f702dffb700 1 -- 172.21.15.148:0/2665336411 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f70340017a0 con 0x7f7038098bd0 2023-10-24T02:03:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 msgr2=0x7f701c0614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 0x7f701c0614c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f70280097c0 tx=0x7f7028016000).stop 2023-10-24T02:03:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 msgr2=0x7f7038141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f703400c810 tx=0x7f7034001660).stop 2023-10-24T02:03:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 shutdown_connections 2023-10-24T02:03:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7038154430 0x7f7038167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7038098bd0 0x7f7038141b70 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f701c05f000 0x7f701c0614c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 --2- 172.21.15.148:0/2665336411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70380bffd0 0x7f7038167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 >> 172.21.15.148:0/2665336411 conn(0x7f70380cb070 msgr2=0x7f7038150000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 shutdown_connections 2023-10-24T02:03:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.196+0000 7f7040209700 1 -- 172.21.15.148:0/2665336411 wait complete. 2023-10-24T02:03:10.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T02:03:10.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.328+0000 7f90309eb700 1 Processor -- start 2023-10-24T02:03:10.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.328+0000 7f90309eb700 1 -- start start 2023-10-24T02:03:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f90309eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 0x7f902c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f90309eb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f902c0c8290 0x7f902c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f90309eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c0c6270 con 0x7f902c0aa420 2023-10-24T02:03:10.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f90309eb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0c60e0 con 0x7f902c0c8290 2023-10-24T02:03:10.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f90309eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c0c0c80 con 0x7f902c1544b0 2023-10-24T02:03:10.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f902ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f902c0aa420 0x7f902c0c6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47270/0 (socket says 172.21.15.148:47270) 2023-10-24T02:03:10.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f9021d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f902c0c8290 0x7f902c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.329+0000 7f902ad9d700 1 -- 172.21.15.148:0/1704699602 learned_addr learned my addr 172.21.15.148:0/1704699602 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f902a59c700 1 --2- 172.21.15.148:0/1704699602 >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 0x7f902c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9021d9b700 1 -- 172.21.15.148:0/1704699602 >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 msgr2=0x7f902c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9021d9b700 1 --2- 172.21.15.148:0/1704699602 >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 0x7f902c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9021d9b700 1 -- 172.21.15.148:0/1704699602 >> v1:172.21.15.148:6789/0 conn(0x7f902c0aa420 legacy=0x7f902c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9021d9b700 1 -- 172.21.15.148:0/1704699602 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0c0f40 con 0x7f902c0c8290 2023-10-24T02:03:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9029d9b700 1 -- 172.21.15.148:0/1704699602 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412061601 0 0) 0x7f902c0c6270 con 0x7f902c0aa420 2023-10-24T02:03:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f902a59c700 1 --2- 172.21.15.148:0/1704699602 >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 0x7f902c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9021d9b700 1 --2- 172.21.15.148:0/1704699602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0c8290 0x7f902c0a9f30 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f902c084570 tx=0x7f9014009060).ready entity=mon.0 client_cookie=6c966c3cdce03843 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9029d9b700 1 -- 172.21.15.148:0/1704699602 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400b580 con 0x7f902c0c8290 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9029d9b700 1 -- 172.21.15.148:0/1704699602 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400b6e0 con 0x7f902c0c8290 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f9029d9b700 1 -- 172.21.15.148:0/1704699602 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400ba60 con 0x7f902c0c8290 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 -- 172.21.15.148:0/1704699602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0c8290 msgr2=0x7f902c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 --2- 172.21.15.148:0/1704699602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0c8290 0x7f902c0a9f30 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f902c084570 tx=0x7f9014009060).stop 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 -- 172.21.15.148:0/1704699602 shutdown_connections 2023-10-24T02:03:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 --2- 172.21.15.148:0/1704699602 >> v2:172.21.15.150:3300/0 conn(0x7f902c1544b0 0x7f902c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 --2- 172.21.15.148:0/1704699602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0c8290 0x7f902c0a9f30 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 -- 172.21.15.148:0/1704699602 >> 172.21.15.148:0/1704699602 conn(0x7f902c0945d0 msgr2=0x7f902c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 -- 172.21.15.148:0/1704699602 shutdown_connections 2023-10-24T02:03:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.330+0000 7f90309eb700 1 -- 172.21.15.148:0/1704699602 wait complete. 2023-10-24T02:03:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 Processor -- start 2023-10-24T02:03:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 -- start start 2023-10-24T02:03:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f902c0c8290 0x7f902c164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902c1544b0 0x7f902c164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c14c660 con 0x7f902c0aa420 2023-10-24T02:03:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c155a80 con 0x7f902c0c8290 2023-10-24T02:03:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.332+0000 7f90309eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c154e70 con 0x7f902c1544b0 2023-10-24T02:03:10.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46530/0 (socket says 172.21.15.148:46530) 2023-10-24T02:03:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 -- 172.21.15.148:0/3754099803 learned_addr learned my addr 172.21.15.148:0/3754099803 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f9021d9b700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f902c0c8290 0x7f902c164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902ad9d700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902c1544b0 0x7f902c164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 -- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902c1544b0 msgr2=0x7f902c164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902c1544b0 0x7f902c164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 -- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f902c0c8290 msgr2=0x7f902c164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f902c0c8290 0x7f902c164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 -- 172.21.15.148:0/3754099803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140092a0 con 0x7f902c0aa420 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f902a59c700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f901c00d890 tx=0x7f901c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:10.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0125f0 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c012750 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c012ad0 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c155150 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.333+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c155710 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.334+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c06c6b0 con 0x7f902c0aa420 2023-10-24T02:03:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.334+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 97) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f901c013480 con 0x7f902c0aa420 2023-10-24T02:03:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.335+0000 7f9022ffd700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 0x7f900c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.335+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f901c07a320 con 0x7f902c0aa420 2023-10-24T02:03:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.335+0000 7f9021d9b700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 0x7f900c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:10.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.335+0000 7f9021d9b700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 0x7f900c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9014009fd0 tx=0x7f9014017000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:10.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.339+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f901c04b510 con 0x7f902c0aa420 2023-10-24T02:03:10.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.502+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f902c0c1220 con 0x7f902c0aa420 2023-10-24T02:03:10.902 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:10.901+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f901c078070 con 0x7f902c0aa420 2023-10-24T02:03:11.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.197+0000 7f9022ffd700 1 -- 172.21.15.148:0/3754099803 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v206) v1 ==== 181+0+0 (secure 0 0 0) 0x7f901c072340 con 0x7f902c0aa420 2023-10-24T02:03:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 msgr2=0x7f900c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 0x7f900c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9014009fd0 tx=0x7f9014017000).stop 2023-10-24T02:03:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 msgr2=0x7f902c154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f901c00d890 tx=0x7f901c008040).stop 2023-10-24T02:03:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 shutdown_connections 2023-10-24T02:03:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902c1544b0 0x7f902c164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f902c0aa420 0x7f902c154890 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f900c05f030 0x7f900c0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 --2- 172.21.15.148:0/3754099803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f902c0c8290 0x7f902c164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 >> 172.21.15.148:0/3754099803 conn(0x7f902c0945d0 msgr2=0x7f902c14ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:11.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 shutdown_connections 2023-10-24T02:03:11.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.200+0000 7f90309eb700 1 -- 172.21.15.148:0/3754099803 wait complete. 2023-10-24T02:03:11.204 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T02:03:11.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T02:03:11.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.331+0000 7faeb2bce700 1 Processor -- start 2023-10-24T02:03:11.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.331+0000 7faeb2bce700 1 -- start start 2023-10-24T02:03:11.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb2bce700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faeac0a9f40 0x7faeac155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:11.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb2bce700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0c7770 con 0x7faeac0aa320 2023-10-24T02:03:11.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb2bce700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0c1070 con 0x7faeac0c81e0 2023-10-24T02:03:11.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb2bce700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0c79e0 con 0x7faeac0a9f40 2023-10-24T02:03:11.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faeac0a9f40 0x7faeac155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:11.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb13cb700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faeac0aa320 0x7faeac0c0820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47282/0 (socket says 172.21.15.148:47282) 2023-10-24T02:03:11.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faeac0a9f40 0x7faeac155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46540/0 (socket says 172.21.15.148:46540) 2023-10-24T02:03:11.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb13cb700 1 -- 172.21.15.148:0/1357908724 learned_addr learned my addr 172.21.15.148:0/1357908724 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:11.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 -- 172.21.15.148:0/1357908724 >> v1:172.21.15.150:6789/0 conn(0x7faeac0c81e0 legacy=0x7faeac153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 -- 172.21.15.148:0/1357908724 >> v1:172.21.15.148:6789/0 conn(0x7faeac0aa320 legacy=0x7faeac0c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 -- 172.21.15.148:0/1357908724 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0c7cc0 con 0x7faeac0a9f40 2023-10-24T02:03:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb0bca700 1 -- 172.21.15.148:0/1357908724 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609740416 0 0) 0x7faeac0c7770 con 0x7faeac0aa320 2023-10-24T02:03:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb1bcc700 1 --2- 172.21.15.148:0/1357908724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0a9f40 0x7faeac155350 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7faea8006fd0 tx=0x7faea8006f40).ready entity=mon.0 client_cookie=5bb9379acaffc87d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb0bca700 1 -- 172.21.15.148:0/1357908724 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8005880 con 0x7faeac0a9f40 2023-10-24T02:03:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb0bca700 1 -- 172.21.15.148:0/1357908724 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea80059e0 con 0x7faeac0a9f40 2023-10-24T02:03:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.332+0000 7faeb0bca700 1 -- 172.21.15.148:0/1357908724 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8005d60 con 0x7faeac0a9f40 2023-10-24T02:03:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 -- 172.21.15.148:0/1357908724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0a9f40 msgr2=0x7faeac155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 --2- 172.21.15.148:0/1357908724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0a9f40 0x7faeac155350 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7faea8006fd0 tx=0x7faea8006f40).stop 2023-10-24T02:03:11.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 -- 172.21.15.148:0/1357908724 shutdown_connections 2023-10-24T02:03:11.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 --2- 172.21.15.148:0/1357908724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0a9f40 0x7faeac155350 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 -- 172.21.15.148:0/1357908724 >> 172.21.15.148:0/1357908724 conn(0x7faeac094420 msgr2=0x7faeac06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:11.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 -- 172.21.15.148:0/1357908724 shutdown_connections 2023-10-24T02:03:11.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.333+0000 7faeb2bce700 1 -- 172.21.15.148:0/1357908724 wait complete. 2023-10-24T02:03:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.334+0000 7faeb2bce700 1 Processor -- start 2023-10-24T02:03:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.334+0000 7faeb2bce700 1 -- start start 2023-10-24T02:03:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeac0a9f40 0x7faeac0ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 0x7faeac0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0c46c0 con 0x7faeac0aa320 2023-10-24T02:03:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0c3820 con 0x7faeac0c81e0 2023-10-24T02:03:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb2bce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0b0db0 con 0x7faeac0a9f40 2023-10-24T02:03:11.343 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46542/0 (socket says 172.21.15.148:46542) 2023-10-24T02:03:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 -- 172.21.15.148:0/807098490 learned_addr learned my addr 172.21.15.148:0/807098490 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb23cd700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 0x7faeac0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb1bcc700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeac0a9f40 0x7faeac0ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:11.344 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 -- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeac0a9f40 msgr2=0x7faeac0ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeac0a9f40 0x7faeac0ab1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 -- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 msgr2=0x7faeac0acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 0x7faeac0acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb13cb700 1 -- 172.21.15.148:0/807098490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009250 con 0x7faeac0aa320 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.335+0000 7faeb23cd700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 0x7faeac0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faeb13cb700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fae9c00c4e0 tx=0x7fae9c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0072e0 con 0x7faeac0aa320 2023-10-24T02:03:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c007440 con 0x7faeac0aa320 2023-10-24T02:03:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0057a0 con 0x7faeac0aa320 2023-10-24T02:03:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0c3ab0 con 0x7faeac0aa320 2023-10-24T02:03:11.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.336+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0c4070 con 0x7faeac0aa320 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.337+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac047480 con 0x7faeac0aa320 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.337+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fae9c005bd0 con 0x7faeac0aa320 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.337+0000 7faea1ffb700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 0x7fae90061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.337+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6271+0+0 (secure 0 0 0) 0x7fae9c079bb0 con 0x7faeac0aa320 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.338+0000 7faeb1bcc700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 0x7fae90061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:11.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.338+0000 7faeb1bcc700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 0x7fae90061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faea8006fd0 tx=0x7faea8016000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:11.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.342+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fae9c04adf0 con 0x7faeac0aa320 2023-10-24T02:03:11.508 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.507+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faeac06c160 con 0x7faeac0aa320 2023-10-24T02:03:11.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.861+0000 7faea1ffb700 1 -- 172.21.15.148:0/807098490 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v207) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae9c04e410 con 0x7faeac0aa320 2023-10-24T02:03:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 msgr2=0x7fae90061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 0x7fae90061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faea8006fd0 tx=0x7faea8016000).stop 2023-10-24T02:03:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 msgr2=0x7faeac0cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fae9c00c4e0 tx=0x7fae9c007c70).stop 2023-10-24T02:03:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 shutdown_connections 2023-10-24T02:03:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fae9005f150 0x7fae90061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faeac0c81e0 0x7faeac0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faeac0a9f40 0x7faeac0ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 --2- 172.21.15.148:0/807098490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faeac0aa320 0x7faeac0cb610 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.865+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 >> 172.21.15.148:0/807098490 conn(0x7faeac094420 msgr2=0x7faeac151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.866+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 shutdown_connections 2023-10-24T02:03:11.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:11.866+0000 7faeb2bce700 1 -- 172.21.15.148:0/807098490 wait complete. 2023-10-24T02:03:11.870 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T02:03:11.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T02:03:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.000+0000 7f0c08f62700 1 Processor -- start 2023-10-24T02:03:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.000+0000 7f0c08f62700 1 -- start start 2023-10-24T02:03:12.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.001+0000 7f0c08f62700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c040a7100 0x7f0c04154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.001+0000 7f0c08f62700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c04069b30 0x7f0c040bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.001+0000 7f0c08f62700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c041589c0 con 0x7f0c04154020 2023-10-24T02:03:12.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c08f62700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c04066bd0 con 0x7f0c040a7100 2023-10-24T02:03:12.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c08f62700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c04066220 con 0x7f0c04069b30 2023-10-24T02:03:12.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c040a7100 0x7f0c04154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0c040a7100 0x7f0c04154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46548/0 (socket says 172.21.15.148:46548) 2023-10-24T02:03:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 -- 172.21.15.148:0/2759228302 learned_addr learned my addr 172.21.15.148:0/2759228302 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c02d9d700 1 --2- 172.21.15.148:0/2759228302 >> v2:172.21.15.150:3300/0 conn(0x7f0c04069b30 0x7f0c040bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 -- 172.21.15.148:0/2759228302 >> v2:172.21.15.150:3300/0 conn(0x7f0c04069b30 msgr2=0x7f0c040bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 --2- 172.21.15.148:0/2759228302 >> v2:172.21.15.150:3300/0 conn(0x7f0c04069b30 0x7f0c040bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 -- 172.21.15.148:0/2759228302 >> v1:172.21.15.150:6789/0 conn(0x7f0c04154020 legacy=0x7f0c04069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 -- 172.21.15.148:0/2759228302 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040bd170 con 0x7f0c040a7100 2023-10-24T02:03:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c01d9b700 1 --2- 172.21.15.148:0/2759228302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04154400 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f0c041548f0 tx=0x7f0bf80090f0).ready entity=mon.0 client_cookie=5f8485356c7a4a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c0159a700 1 -- 172.21.15.148:0/2759228302 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800b600 con 0x7f0c040a7100 2023-10-24T02:03:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c0159a700 1 -- 172.21.15.148:0/2759228302 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800b760 con 0x7f0c040a7100 2023-10-24T02:03:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.002+0000 7f0c0159a700 1 -- 172.21.15.148:0/2759228302 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800bae0 con 0x7f0c040a7100 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 -- 172.21.15.148:0/2759228302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 msgr2=0x7f0c04154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 --2- 172.21.15.148:0/2759228302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04154400 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f0c041548f0 tx=0x7f0bf80090f0).stop 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 -- 172.21.15.148:0/2759228302 shutdown_connections 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 --2- 172.21.15.148:0/2759228302 >> v2:172.21.15.150:3300/0 conn(0x7f0c04069b30 0x7f0c040bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 --2- 172.21.15.148:0/2759228302 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04154400 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.009 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 -- 172.21.15.148:0/2759228302 >> 172.21.15.148:0/2759228302 conn(0x7f0c040c7d20 msgr2=0x7f0c040c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 -- 172.21.15.148:0/2759228302 shutdown_connections 2023-10-24T02:03:12.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.003+0000 7f0c08f62700 1 -- 172.21.15.148:0/2759228302 wait complete. 2023-10-24T02:03:12.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.004+0000 7f0c08f62700 1 Processor -- start 2023-10-24T02:03:12.010 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.004+0000 7f0c08f62700 1 -- start start 2023-10-24T02:03:12.012 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04069b30 0x7f0c04154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04154020 0x7f0c040a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c04155100 con 0x7f0c040a7100 2023-10-24T02:03:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041553e0 con 0x7f0c04154020 2023-10-24T02:03:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c08f62700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041556c0 con 0x7f0c04069b30 2023-10-24T02:03:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46552/0 (socket says 172.21.15.148:46552) 2023-10-24T02:03:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 -- 172.21.15.148:0/3883261639 learned_addr learned my addr 172.21.15.148:0/3883261639 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c0259c700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04069b30 0x7f0c04154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c02d9d700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04154020 0x7f0c040a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 -- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04069b30 msgr2=0x7f0c04154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04069b30 0x7f0c04154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 -- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04154020 msgr2=0x7f0c040a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04154020 0x7f0c040a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.015 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 -- 172.21.15.148:0/3883261639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009370 con 0x7f0c040a7100 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0c01d9b700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f0bf8009130 tx=0x7f0bf8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800bae0 con 0x7f0c040a7100 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8000c90 con 0x7f0c040a7100 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.005+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf801c670 con 0x7f0c040a7100 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.006+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c041559a0 con 0x7f0c040a7100 2023-10-24T02:03:12.016 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.006+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c04154e10 con 0x7f0c040a7100 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.007+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0406c6b0 con 0x7f0c040a7100 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.007+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0bf801ca20 con 0x7f0c040a7100 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.007+0000 7f0bf27fc700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 0x7f0be4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.007+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f0bf807b8a0 con 0x7f0c040a7100 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.007+0000 7f0c0259c700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 0x7f0be4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.017 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.008+0000 7f0c0259c700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 0x7f0be4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0bf4003dd0 tx=0x7f0bf4009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.011+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0bf804cc70 con 0x7f0c040a7100 2023-10-24T02:03:12.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.180+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f0c0406a7b0 con 0x7f0c040a7100 2023-10-24T02:03:12.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.184+0000 7f0bf27fc700 1 -- 172.21.15.148:0/3883261639 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v40) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0bf80200b0 con 0x7f0c040a7100 2023-10-24T02:03:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.185+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 msgr2=0x7f0be4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.185+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 0x7f0be4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0bf4003dd0 tx=0x7f0bf4009040).stop 2023-10-24T02:03:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.185+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 msgr2=0x7f0c04147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.185+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7f0bf8009130 tx=0x7f0bf8017000).stop 2023-10-24T02:03:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 shutdown_connections 2023-10-24T02:03:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0be405f150 0x7f0be4061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c04154020 0x7f0c040a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c04069b30 0x7f0c04154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 --2- 172.21.15.148:0/3883261639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c040a7100 0x7f0c04147710 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 >> 172.21.15.148:0/3883261639 conn(0x7f0c040c7d20 msgr2=0x7f0c040c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 shutdown_connections 2023-10-24T02:03:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.186+0000 7f0c08f62700 1 -- 172.21.15.148:0/3883261639 wait complete. 2023-10-24T02:03:12.199 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T02:03:12.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.313+0000 7f911f59e700 1 Processor -- start 2023-10-24T02:03:12.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.313+0000 7f911f59e700 1 -- start start 2023-10-24T02:03:12.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911f59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911f59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200a9830 con 0x7f9120154150 2023-10-24T02:03:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911f59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200a8c20 con 0x7f91200c9e00 2023-10-24T02:03:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200a8f00 con 0x7f91200c1050 2023-10-24T02:03:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911dd9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911dd9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:42756/0 (socket says 172.21.15.148:42756) 2023-10-24T02:03:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:55482/0 (socket says 172.21.15.148:55482) 2023-10-24T02:03:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911dd9b700 1 -- 172.21.15.148:0/4014176236 learned_addr learned my addr 172.21.15.148:0/4014176236 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.314+0000 7f911e59c700 1 --1- 172.21.15.148:0/4014176236 >> v1:172.21.15.150:6789/0 conn(0x7f9120154150 0x7f91200c0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:44060/0 (socket says 172.21.15.148:44060) 2023-10-24T02:03:12.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911dd9b700 1 -- 172.21.15.148:0/4014176236 >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 msgr2=0x7f912015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:12.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911dd9b700 1 --2- 172.21.15.148:0/4014176236 >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911dd9b700 1 -- 172.21.15.148:0/4014176236 >> v1:172.21.15.150:6789/0 conn(0x7f9120154150 legacy=0x7f91200c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911dd9b700 1 -- 172.21.15.148:0/4014176236 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200a91e0 con 0x7f91200c1050 2023-10-24T02:03:12.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911ed9d700 1 --2- 172.21.15.148:0/4014176236 >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:12.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911dd9b700 1 --2- 172.21.15.148:0/4014176236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f9114006fd0 tx=0x7f91140090f0).ready entity=mon.2 client_cookie=3ebd15b564c4ea9e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911d59a700 1 -- 172.21.15.148:0/4014176236 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400b580 con 0x7f91200c1050 2023-10-24T02:03:12.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911d59a700 1 -- 172.21.15.148:0/4014176236 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911400b6e0 con 0x7f91200c1050 2023-10-24T02:03:12.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911d59a700 1 -- 172.21.15.148:0/4014176236 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400ba60 con 0x7f91200c1050 2023-10-24T02:03:12.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911f59e700 1 -- 172.21.15.148:0/4014176236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 msgr2=0x7f91200a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.315+0000 7f911f59e700 1 --2- 172.21.15.148:0/4014176236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f9114006fd0 tx=0x7f91140090f0).stop 2023-10-24T02:03:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 -- 172.21.15.148:0/4014176236 shutdown_connections 2023-10-24T02:03:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 --2- 172.21.15.148:0/4014176236 >> v2:172.21.15.150:3300/0 conn(0x7f91200c9e00 0x7f912015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 --2- 172.21.15.148:0/4014176236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c1050 0x7f91200a8640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 -- 172.21.15.148:0/4014176236 >> 172.21.15.148:0/4014176236 conn(0x7f9120094500 msgr2=0x7f912006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 -- 172.21.15.148:0/4014176236 shutdown_connections 2023-10-24T02:03:12.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.316+0000 7f911f59e700 1 -- 172.21.15.148:0/4014176236 wait complete. 2023-10-24T02:03:12.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.317+0000 7f911f59e700 1 Processor -- start 2023-10-24T02:03:12.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.317+0000 7f911f59e700 1 -- start start 2023-10-24T02:03:12.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200c1050 0x7f91200abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c9e00 0x7f9120142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.326 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91201579e0 con 0x7f9120154150 2023-10-24T02:03:12.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200ac300 con 0x7f91200c1050 2023-10-24T02:03:12.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200ac5e0 con 0x7f91200c9e00 2023-10-24T02:03:12.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.327 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46568/0 (socket says 172.21.15.148:46568) 2023-10-24T02:03:12.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 -- 172.21.15.148:0/3948722489 learned_addr learned my addr 172.21.15.148:0/3948722489 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911e59c700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200c1050 0x7f91200abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911dd9b700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c9e00 0x7f9120142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 -- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c9e00 msgr2=0x7f9120142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.328 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c9e00 0x7f9120142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 -- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200c1050 msgr2=0x7f91200abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200c1050 0x7f91200abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 -- 172.21.15.148:0/3948722489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009a20 con 0x7f9120154150 2023-10-24T02:03:12.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911ed9d700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f911800ef90 tx=0x7f911800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800cbd0 con 0x7f9120154150 2023-10-24T02:03:12.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911800f040 con 0x7f9120154150 2023-10-24T02:03:12.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9114009370 con 0x7f9120154150 2023-10-24T02:03:12.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.318+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118013400 con 0x7f9120154150 2023-10-24T02:03:12.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.319+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200ac8c0 con 0x7f9120154150 2023-10-24T02:03:12.330 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.319+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120157ec0 con 0x7f9120154150 2023-10-24T02:03:12.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.320+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9118013830 con 0x7f9120154150 2023-10-24T02:03:12.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.320+0000 7f910e7fc700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 0x7f91000615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.320+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f911807a990 con 0x7f9120154150 2023-10-24T02:03:12.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.320+0000 7f911e59c700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 0x7f91000615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.331 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.321+0000 7f911e59c700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 0x7f91000615e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9110004700 tx=0x7f9110007d80).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.324+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9120157ec0 con 0x7f9120154150 2023-10-24T02:03:12.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.490+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9120157ec0 con 0x7f9120154150 2023-10-24T02:03:12.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.494+0000 7f910e7fc700 1 -- 172.21.15.148:0/3948722489 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9120157ec0 con 0x7f9120154150 2023-10-24T02:03:12.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 msgr2=0x7f91000615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 0x7f91000615e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9110004700 tx=0x7f9110007d80).stop 2023-10-24T02:03:12.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 msgr2=0x7f912014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f911800ef90 tx=0x7f911800b040).stop 2023-10-24T02:03:12.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 shutdown_connections 2023-10-24T02:03:12.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9120154150 0x7f912014fba0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f910005f120 0x7f91000615e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200c1050 0x7f91200abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 --2- 172.21.15.148:0/3948722489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91200c9e00 0x7f9120142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 >> 172.21.15.148:0/3948722489 conn(0x7f9120094500 msgr2=0x7f91200c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 shutdown_connections 2023-10-24T02:03:12.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.496+0000 7f911f59e700 1 -- 172.21.15.148:0/3948722489 wait complete. 2023-10-24T02:03:12.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-24T02:03:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.622+0000 7f733d42a700 1 Processor -- start 2023-10-24T02:03:12.624 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.622+0000 7f733d42a700 1 -- start start 2023-10-24T02:03:12.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f733d42a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 0x7f73380bec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f733d42a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73380a8480 0x7f733815be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f733d42a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73380a6a50 con 0x7f73380a6550 2023-10-24T02:03:12.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f733d42a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73380a6d30 con 0x7f73380a8480 2023-10-24T02:03:12.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f733d42a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73380a7010 con 0x7f73380c86c0 2023-10-24T02:03:12.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73380a8480 0x7f733815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f73380a8480 0x7f733815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46582/0 (socket says 172.21.15.148:46582) 2023-10-24T02:03:12.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 -- 172.21.15.148:0/193728686 learned_addr learned my addr 172.21.15.148:0/193728686 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f7336ffd700 1 --2- 172.21.15.148:0/193728686 >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 0x7f73380bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 -- 172.21.15.148:0/193728686 >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 msgr2=0x7f73380bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:12.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 --2- 172.21.15.148:0/193728686 >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 0x7f73380bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 -- 172.21.15.148:0/193728686 >> v1:172.21.15.150:6789/0 conn(0x7f73380a6550 legacy=0x7f73380a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:12.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 -- 172.21.15.148:0/193728686 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73380a72f0 con 0x7f73380a8480 2023-10-24T02:03:12.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f7336ffd700 1 --2- 172.21.15.148:0/193728686 >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 0x7f73380bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:12.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f73377fe700 1 --2- 172.21.15.148:0/193728686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a8480 0x7f733815be90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f73380699f0 tx=0x7f73280090f0).ready entity=mon.0 client_cookie=3f400ae68e181ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f7335ffb700 1 -- 172.21.15.148:0/193728686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800b5a0 con 0x7f73380a8480 2023-10-24T02:03:12.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f7335ffb700 1 -- 172.21.15.148:0/193728686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800b700 con 0x7f73380a8480 2023-10-24T02:03:12.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.623+0000 7f7335ffb700 1 -- 172.21.15.148:0/193728686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800ba80 con 0x7f73380a8480 2023-10-24T02:03:12.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 -- 172.21.15.148:0/193728686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a8480 msgr2=0x7f733815be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 --2- 172.21.15.148:0/193728686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a8480 0x7f733815be90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f73380699f0 tx=0x7f73280090f0).stop 2023-10-24T02:03:12.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 -- 172.21.15.148:0/193728686 shutdown_connections 2023-10-24T02:03:12.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 --2- 172.21.15.148:0/193728686 >> v2:172.21.15.150:3300/0 conn(0x7f73380c86c0 0x7f73380bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 --2- 172.21.15.148:0/193728686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a8480 0x7f733815be90 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 -- 172.21.15.148:0/193728686 >> 172.21.15.148:0/193728686 conn(0x7f7338092480 msgr2=0x7f7338062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 -- 172.21.15.148:0/193728686 shutdown_connections 2023-10-24T02:03:12.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.624+0000 7f733d42a700 1 -- 172.21.15.148:0/193728686 wait complete. 2023-10-24T02:03:12.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.625+0000 7f733d42a700 1 Processor -- start 2023-10-24T02:03:12.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.625+0000 7f733d42a700 1 -- start start 2023-10-24T02:03:12.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73380a8480 0x7f7338163e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f7336ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73380c86c0 0x7f7338164330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73380ae270 con 0x7f73380a6550 2023-10-24T02:03:12.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73380ad660 con 0x7f73380a8480 2023-10-24T02:03:12.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f733d42a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73380ad940 con 0x7f73380c86c0 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f7336ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46592/0 (socket says 172.21.15.148:46592) 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f7336ffd700 1 -- 172.21.15.148:0/3012924989 learned_addr learned my addr 172.21.15.148:0/3012924989 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f73367fc700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73380a8480 0x7f7338163e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.626+0000 7f73377fe700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73380c86c0 0x7f7338164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 -- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73380c86c0 msgr2=0x7f7338164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73380c86c0 0x7f7338164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 -- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73380a8480 msgr2=0x7f7338163e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73380a8480 0x7f7338163e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 -- 172.21.15.148:0/3012924989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328009370 con 0x7f73380a6550 2023-10-24T02:03:12.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f7336ffd700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f733000a300 tx=0x7f73300078c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330016470 con 0x7f73380a6550 2023-10-24T02:03:12.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73300165d0 con 0x7f73380a6550 2023-10-24T02:03:12.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330016950 con 0x7f73380a6550 2023-10-24T02:03:12.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73380adc20 con 0x7f73380a6550 2023-10-24T02:03:12.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.627+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73380ae700 con 0x7f73380a6550 2023-10-24T02:03:12.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.628+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73380ae550 con 0x7f73380a6550 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.628+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7330013070 con 0x7f73380a6550 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.629+0000 7f731effd700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 0x7f7324061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.629+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f733007a940 con 0x7f73380a6550 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.629+0000 7f73367fc700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 0x7f7324061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.629+0000 7f73367fc700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 0x7f7324061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f73380658b0 tx=0x7f732c007d20).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:12.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.633+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f733004bd10 con 0x7f73380a6550 2023-10-24T02:03:12.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.861+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f733806c6b0 con 0x7f73380a6550 2023-10-24T02:03:12.912 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.910+0000 7f731effd700 1 -- 172.21.15.148:0/3012924989 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3028) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7330007a00 con 0x7f73380a6550 2023-10-24T02:03:12.914 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.912+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 msgr2=0x7f7324061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 0x7f7324061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f73380658b0 tx=0x7f732c007d20).stop 2023-10-24T02:03:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 msgr2=0x7f73380a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f733000a300 tx=0x7f73300078c0).stop 2023-10-24T02:03:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 shutdown_connections 2023-10-24T02:03:12.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73380c86c0 0x7f7338164330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73380a6550 0x7f73380a9840 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f732405f180 0x7f7324061640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 --2- 172.21.15.148:0/3012924989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f73380a8480 0x7f7338163e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 >> 172.21.15.148:0/3012924989 conn(0x7f7338092480 msgr2=0x7f7338067e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 shutdown_connections 2023-10-24T02:03:12.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:12.913+0000 7f733d42a700 1 -- 172.21.15.148:0/3012924989 wait complete. 2023-10-24T02:03:12.926 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-10-24T02:03:12.927 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-10-24T02:03:12.927 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-10-24T02:03:12.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-24T02:03:13.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.041+0000 7fb32dc53700 1 Processor -- start 2023-10-24T02:03:13.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 -- start start 2023-10-24T02:03:13.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb328151c80 0x7fb328068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3280690c0 0x7fb3280c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3280bd540 con 0x7fb328150910 2023-10-24T02:03:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb328069550 con 0x7fb3280690c0 2023-10-24T02:03:13.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.042+0000 7fb32dc53700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280bc4c0 con 0x7fb328151c80 2023-10-24T02:03:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fb3280690c0 0x7fb3280c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3277fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb328150910 0x7fb3280bce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47292/0 (socket says 172.21.15.148:47292) 2023-10-24T02:03:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3277fe700 1 -- 172.21.15.148:0/2920075999 learned_addr learned my addr 172.21.15.148:0/2920075999 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb326ffd700 1 --2- 172.21.15.148:0/2920075999 >> v2:172.21.15.150:3300/0 conn(0x7fb328151c80 0x7fb328068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 -- 172.21.15.148:0/2920075999 >> v2:172.21.15.150:3300/0 conn(0x7fb328151c80 msgr2=0x7fb328068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:13.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 --2- 172.21.15.148:0/2920075999 >> v2:172.21.15.150:3300/0 conn(0x7fb328151c80 0x7fb328068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 -- 172.21.15.148:0/2920075999 >> v1:172.21.15.148:6789/0 conn(0x7fb328150910 legacy=0x7fb3280bce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3267fc700 1 -- 172.21.15.148:0/2920075999 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163285134 0 0) 0x7fb3280bd540 con 0x7fb328150910 2023-10-24T02:03:13.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 -- 172.21.15.148:0/2920075999 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280bc7a0 con 0x7fb3280690c0 2023-10-24T02:03:13.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb327fff700 1 --2- 172.21.15.148:0/2920075999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280690c0 0x7fb3280c2b60 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fb3280c1a70 tx=0x7fb320009060).ready entity=mon.0 client_cookie=5e6b23ed1e5c529a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:13.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3267fc700 1 -- 172.21.15.148:0/2920075999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000b580 con 0x7fb3280690c0 2023-10-24T02:03:13.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3267fc700 1 -- 172.21.15.148:0/2920075999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32000b6e0 con 0x7fb3280690c0 2023-10-24T02:03:13.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.043+0000 7fb3267fc700 1 -- 172.21.15.148:0/2920075999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000ba60 con 0x7fb3280690c0 2023-10-24T02:03:13.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 -- 172.21.15.148:0/2920075999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280690c0 msgr2=0x7fb3280c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 --2- 172.21.15.148:0/2920075999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280690c0 0x7fb3280c2b60 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fb3280c1a70 tx=0x7fb320009060).stop 2023-10-24T02:03:13.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 -- 172.21.15.148:0/2920075999 shutdown_connections 2023-10-24T02:03:13.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 --2- 172.21.15.148:0/2920075999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb3280690c0 0x7fb3280c2b60 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 --2- 172.21.15.148:0/2920075999 >> v2:172.21.15.150:3300/0 conn(0x7fb328151c80 0x7fb328068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 -- 172.21.15.148:0/2920075999 >> 172.21.15.148:0/2920075999 conn(0x7fb3280c7eb0 msgr2=0x7fb3280c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:13.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 -- 172.21.15.148:0/2920075999 shutdown_connections 2023-10-24T02:03:13.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.044+0000 7fb32dc53700 1 -- 172.21.15.148:0/2920075999 wait complete. 2023-10-24T02:03:13.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.045+0000 7fb32dc53700 1 Processor -- start 2023-10-24T02:03:13.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.045+0000 7fb32dc53700 1 -- start start 2023-10-24T02:03:13.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280690c0 0x7fb32813d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328151c80 0x7fb32814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32814c1b0 con 0x7fb328150910 2023-10-24T02:03:13.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb328163930 con 0x7fb3280690c0 2023-10-24T02:03:13.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281634a0 con 0x7fb328151c80 2023-10-24T02:03:13.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46608/0 (socket says 172.21.15.148:46608) 2023-10-24T02:03:13.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 -- 172.21.15.148:0/1175034087 learned_addr learned my addr 172.21.15.148:0/1175034087 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:13.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb327fff700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328151c80 0x7fb32814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb3277fe700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280690c0 0x7fb32813d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 -- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328151c80 msgr2=0x7fb32814bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328151c80 0x7fb32814bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 -- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280690c0 msgr2=0x7fb32813d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280690c0 0x7fb32813d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 -- 172.21.15.148:0/1175034087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200092a0 con 0x7fb328150910 2023-10-24T02:03:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb326ffd700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7fb31c00d8c0 tx=0x7fb31c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0095b0 con 0x7fb328150910 2023-10-24T02:03:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c009710 con 0x7fb328150910 2023-10-24T02:03:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb328166e60 con 0x7fb328150910 2023-10-24T02:03:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.046+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c009a90 con 0x7fb328150910 2023-10-24T02:03:13.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.047+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb328162e50 con 0x7fb328150910 2023-10-24T02:03:13.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.048+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb328163650 con 0x7fb328150910 2023-10-24T02:03:13.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.048+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb31c013480 con 0x7fb328150910 2023-10-24T02:03:13.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.048+0000 7fb30f7fe700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 0x7fb314061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:13.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.048+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fb31c079ee0 con 0x7fb328150910 2023-10-24T02:03:13.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.048+0000 7fb3277fe700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 0x7fb314061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:13.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.049+0000 7fb3277fe700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 0x7fb314061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb3180016e0 tx=0x7fb318009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:13.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.052+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb328163650 con 0x7fb328150910 2023-10-24T02:03:13.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.283+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fb328163610 con 0x7fb328150910 2023-10-24T02:03:13.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.912+0000 7fb30f7fe700 1 -- 172.21.15.148:0/1175034087 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3029) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb31c04b250 con 0x7fb328150910 2023-10-24T02:03:13.915 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 msgr2=0x7fb314061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 0x7fb314061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb3180016e0 tx=0x7fb318009040).stop 2023-10-24T02:03:13.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 msgr2=0x7fb32814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:13.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7fb31c00d8c0 tx=0x7fb31c008040).stop 2023-10-24T02:03:13.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 shutdown_connections 2023-10-24T02:03:13.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb328151c80 0x7fb32814bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb31405f150 0x7fb314061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3280690c0 0x7fb32813d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 --2- 172.21.15.148:0/1175034087 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb328150910 0x7fb32814b7d0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:13.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 >> 172.21.15.148:0/1175034087 conn(0x7fb3280c7eb0 msgr2=0x7fb328063860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:13.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 shutdown_connections 2023-10-24T02:03:13.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:13.914+0000 7fb32dc53700 1 -- 172.21.15.148:0/1175034087 wait complete. 2023-10-24T02:03:13.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-24T02:03:14.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.042+0000 7f543e011700 1 Processor -- start 2023-10-24T02:03:14.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.042+0000 7f543e011700 1 -- start start 2023-10-24T02:03:14.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f543e011700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c6950 0x7f5438155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f543e011700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 0x7f543815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f543e011700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5438155c00 con 0x7f5438152290 2023-10-24T02:03:14.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f543e011700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54380c8800 con 0x7f54380c6950 2023-10-24T02:03:14.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f543e011700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380c7b80 con 0x7f54380c1950 2023-10-24T02:03:14.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c6950 0x7f5438155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f54380c6950 0x7f5438155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37850/0 (socket says 172.21.15.148:37850) 2023-10-24T02:03:14.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 -- 172.21.15.148:0/1697848228 learned_addr learned my addr 172.21.15.148:0/1697848228 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5437fff700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 0x7f543815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 -- 172.21.15.148:0/1697848228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 msgr2=0x7f543815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 0x7f543815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.043+0000 7f5436ffd700 1 -- 172.21.15.148:0/1697848228 >> v1:172.21.15.150:6789/0 conn(0x7f5438152290 legacy=0x7f54380c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f5436ffd700 1 -- 172.21.15.148:0/1697848228 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380c7e60 con 0x7f54380c6950 2023-10-24T02:03:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f5437fff700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 0x7f543815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:14.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f5436ffd700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c6950 0x7f5438155710 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f542c006fd0 tx=0x7f542c0090f0).ready entity=mon.0 client_cookie=61b59b7c2d11d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f54367fc700 1 -- 172.21.15.148:0/1697848228 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00b600 con 0x7f54380c6950 2023-10-24T02:03:14.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f54367fc700 1 -- 172.21.15.148:0/1697848228 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c00b760 con 0x7f54380c6950 2023-10-24T02:03:14.050 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f54367fc700 1 -- 172.21.15.148:0/1697848228 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00bb00 con 0x7f54380c6950 2023-10-24T02:03:14.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 -- 172.21.15.148:0/1697848228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c6950 msgr2=0x7f5438155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c6950 0x7f5438155710 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7f542c006fd0 tx=0x7f542c0090f0).stop 2023-10-24T02:03:14.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 -- 172.21.15.148:0/1697848228 shutdown_connections 2023-10-24T02:03:14.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c1950 0x7f543815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 --2- 172.21.15.148:0/1697848228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c6950 0x7f5438155710 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 -- 172.21.15.148:0/1697848228 >> 172.21.15.148:0/1697848228 conn(0x7f54380946c0 msgr2=0x7f543806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:14.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 -- 172.21.15.148:0/1697848228 shutdown_connections 2023-10-24T02:03:14.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.044+0000 7f543e011700 1 -- 172.21.15.148:0/1697848228 wait complete. 2023-10-24T02:03:14.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 Processor -- start 2023-10-24T02:03:14.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 -- start start 2023-10-24T02:03:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c6950 0x7f5438153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5438152290 0x7f5438153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54381543e0 con 0x7f54380c1950 2023-10-24T02:03:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438153b40 con 0x7f5438152290 2023-10-24T02:03:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f543e011700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5438153e20 con 0x7f54380c6950 2023-10-24T02:03:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.046+0000 7f54377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37862/0 (socket says 172.21.15.148:37862) 2023-10-24T02:03:14.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 -- 172.21.15.148:0/3962097871 learned_addr learned my addr 172.21.15.148:0/3962097871 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f5437fff700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5438152290 0x7f5438153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f5436ffd700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c6950 0x7f5438153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 -- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c6950 msgr2=0x7f5438153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c6950 0x7f5438153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 -- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5438152290 msgr2=0x7f5438153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5438152290 0x7f5438153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 -- 172.21.15.148:0/3962097871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009370 con 0x7f54380c1950 2023-10-24T02:03:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f54377fe700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f542800c4c0 tx=0x7f5428007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542800ce70 con 0x7f54380c1950 2023-10-24T02:03:14.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428001e90 con 0x7f54380c1950 2023-10-24T02:03:14.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5438154100 con 0x7f54380c1950 2023-10-24T02:03:14.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428007250 con 0x7f54380c1950 2023-10-24T02:03:14.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.047+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54380c4070 con 0x7f54380c1950 2023-10-24T02:03:14.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.048+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54380a7df0 con 0x7f54380c1950 2023-10-24T02:03:14.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.048+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f54280066a0 con 0x7f54380c1950 2023-10-24T02:03:14.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.049+0000 7f541f7fe700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 0x7f5424061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.049+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f5428079960 con 0x7f54380c1950 2023-10-24T02:03:14.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.049+0000 7f5436ffd700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 0x7f5424061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.049+0000 7f5436ffd700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 0x7f5424061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54380c6d50 tx=0x7f542c017000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.053+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f54380a7df0 con 0x7f54380c1950 2023-10-24T02:03:14.219 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.217+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f543806c6b0 con 0x7f54380c1950 2023-10-24T02:03:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.223+0000 7f541f7fe700 1 -- 172.21.15.148:0/3962097871 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f542804ad30 con 0x7f54380c1950 2023-10-24T02:03:14.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 msgr2=0x7f5424061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 0x7f5424061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f54380c6d50 tx=0x7f542c017000).stop 2023-10-24T02:03:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 msgr2=0x7f543813fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f542800c4c0 tx=0x7f5428007e00).stop 2023-10-24T02:03:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 shutdown_connections 2023-10-24T02:03:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f542405f150 0x7f5424061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5438152290 0x7f5438153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54380c1950 0x7f543813fc20 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 --2- 172.21.15.148:0/3962097871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54380c6950 0x7f5438153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 >> 172.21.15.148:0/3962097871 conn(0x7f54380946c0 msgr2=0x7f543806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:14.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 shutdown_connections 2023-10-24T02:03:14.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.225+0000 7f543e011700 1 -- 172.21.15.148:0/3962097871 wait complete. 2023-10-24T02:03:14.238 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T02:03:14.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:14.287 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:14.332 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T02:03:14.333 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-24T02:03:14.333 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:14.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.445+0000 7f905810c700 1 Processor -- start 2023-10-24T02:03:14.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 -- start start 2023-10-24T02:03:14.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f90500aa010 0x7f90500c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90500c6710 0x7f90500aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9050158770 0x7f9050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500aa8e0 con 0x7f90500aa010 2023-10-24T02:03:14.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500c0960 con 0x7f90500c6710 2023-10-24T02:03:14.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.446+0000 7f905810c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90500c0c40 con 0x7f9050158770 2023-10-24T02:03:14.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f90500aa010 0x7f90500c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f90500aa010 0x7f90500c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37876/0 (socket says 172.21.15.148:37876) 2023-10-24T02:03:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 -- 172.21.15.148:0/2912870183 learned_addr learned my addr 172.21.15.148:0/2912870183 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f90566a9700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9050158770 0x7f9050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f90556a7700 1 --2- 172.21.15.148:0/2912870183 >> v2:172.21.15.150:3300/0 conn(0x7f90500c6710 0x7f90500aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 -- 172.21.15.148:0/2912870183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9050158770 msgr2=0x7f9050069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9050158770 0x7f9050069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 -- 172.21.15.148:0/2912870183 >> v2:172.21.15.150:3300/0 conn(0x7f90500c6710 msgr2=0x7f90500aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 --2- 172.21.15.148:0/2912870183 >> v2:172.21.15.150:3300/0 conn(0x7f90500c6710 0x7f90500aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 -- 172.21.15.148:0/2912870183 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500c0f20 con 0x7f90500aa010 2023-10-24T02:03:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9055ea8700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c1a00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7f9050157d00 tx=0x7f904c0090f0).ready entity=mon.0 client_cookie=86f98bd7b6b408c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9054ea6700 1 -- 172.21.15.148:0/2912870183 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00b600 con 0x7f90500aa010 2023-10-24T02:03:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9054ea6700 1 -- 172.21.15.148:0/2912870183 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c00b760 con 0x7f90500aa010 2023-10-24T02:03:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.447+0000 7f9054ea6700 1 -- 172.21.15.148:0/2912870183 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00bae0 con 0x7f90500aa010 2023-10-24T02:03:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 -- 172.21.15.148:0/2912870183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 msgr2=0x7f90500c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c1a00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7f9050157d00 tx=0x7f904c0090f0).stop 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 -- 172.21.15.148:0/2912870183 shutdown_connections 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c1a00 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 --2- 172.21.15.148:0/2912870183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9050158770 0x7f9050069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 --2- 172.21.15.148:0/2912870183 >> v2:172.21.15.150:3300/0 conn(0x7f90500c6710 0x7f90500aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 -- 172.21.15.148:0/2912870183 >> 172.21.15.148:0/2912870183 conn(0x7f90500caf40 msgr2=0x7f90500cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:14.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 -- 172.21.15.148:0/2912870183 shutdown_connections 2023-10-24T02:03:14.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.448+0000 7f905810c700 1 -- 172.21.15.148:0/2912870183 wait complete. 2023-10-24T02:03:14.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.449+0000 7f905810c700 1 Processor -- start 2023-10-24T02:03:14.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.449+0000 7f905810c700 1 -- start start 2023-10-24T02:03:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90500c6710 0x7f9050143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9050158770 0x7f90500af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500c3630 con 0x7f90500aa010 2023-10-24T02:03:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500c3910 con 0x7f9050158770 2023-10-24T02:03:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90500c3bf0 con 0x7f90500c6710 2023-10-24T02:03:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37888/0 (socket says 172.21.15.148:37888) 2023-10-24T02:03:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 -- 172.21.15.148:0/1726449231 learned_addr learned my addr 172.21.15.148:0/1726449231 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f90556a7700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90500c6710 0x7f9050143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f90566a9700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9050158770 0x7f90500af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 -- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90500c6710 msgr2=0x7f9050143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90500c6710 0x7f9050143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 -- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9050158770 msgr2=0x7f90500af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9050158770 0x7f90500af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 -- 172.21.15.148:0/1726449231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c009370 con 0x7f90500aa010 2023-10-24T02:03:14.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9055ea8700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f904c009130 tx=0x7f904c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00bea0 con 0x7f90500aa010 2023-10-24T02:03:14.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c00b8d0 con 0x7f90500aa010 2023-10-24T02:03:14.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90500c3ed0 con 0x7f90500aa010 2023-10-24T02:03:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.450+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c01c650 con 0x7f90500aa010 2023-10-24T02:03:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.451+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90500c4490 con 0x7f90500aa010 2023-10-24T02:03:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.452+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905006c6b0 con 0x7f90500aa010 2023-10-24T02:03:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.452+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f904c01c9c0 con 0x7f90500aa010 2023-10-24T02:03:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.452+0000 7f9045ffb700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 0x7f9034061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.452+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f904c07bc60 con 0x7f90500aa010 2023-10-24T02:03:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.452+0000 7f90556a7700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 0x7f9034061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.453+0000 7f90556a7700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 0x7f9034061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f90500ac9b0 tx=0x7f9040008040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.456+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f904c04d030 con 0x7f90500aa010 2023-10-24T02:03:14.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.661+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90500c4800 con 0x7f90500aa010 2023-10-24T02:03:14.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.662+0000 7f9045ffb700 1 -- 172.21.15.148:0/1726449231 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f904c02a070 con 0x7f90500aa010 2023-10-24T02:03:14.664 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:14.664 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/1556231861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":1556231861},{"type":"v1","addr":"172.21.15.150:6837","nonce":1556231861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9130,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2625138685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2625138685},{"type":"v1","addr":"172.21.15.150:6835","nonce":2625138685}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9687,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/4017610648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4017610648},{"type":"v1","addr":"172.21.15.148:6834","nonce":4017610648}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3229583948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3229583948},{"type":"v1","addr":"172.21.15.148:6835","nonce":3229583948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-10-24T02:03:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 msgr2=0x7f9034061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 0x7f9034061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f90500ac9b0 tx=0x7f9040008040).stop 2023-10-24T02:03:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 msgr2=0x7f90500c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f904c009130 tx=0x7f904c017000).stop 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 shutdown_connections 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f903405f150 0x7f9034061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9050158770 0x7f90500af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90500aa010 0x7f90500c49b0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 --2- 172.21.15.148:0/1726449231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90500c6710 0x7f9050143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 >> 172.21.15.148:0/1726449231 conn(0x7f90500caf40 msgr2=0x7f90500ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:14.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 shutdown_connections 2023-10-24T02:03:14.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.664+0000 7f905810c700 1 -- 172.21.15.148:0/1726449231 wait complete. 2023-10-24T02:03:14.668 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 70 2023-10-24T02:03:14.677 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-24T02:03:14.678 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-24T02:03:14.678 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T02:03:14.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:03:14.678 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-24T02:03:14.679 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-24T02:03:14.679 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T02:03:14.679 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:03:14.680 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-24T02:03:14.680 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-24T02:03:14.680 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T02:03:14.680 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:03:14.681 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-24T02:03:14.681 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-24T02:03:14.681 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T02:03:14.682 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:03:14.688 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T02:03:14.689 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-24T02:03:14.689 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T02:03:14.690 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-24T02:03:14.694 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T02:03:14.694 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-24T02:03:14.695 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T02:03:14.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-24T02:03:14.731 INFO:tasks.ceph.mds.a:Started 2023-10-24T02:03:14.731 DEBUG:teuthology.parallel:result is None 2023-10-24T02:03:14.732 INFO:tasks.ceph.mds.c:Started 2023-10-24T02:03:14.732 DEBUG:teuthology.parallel:result is None 2023-10-24T02:03:14.736 INFO:tasks.ceph.mds.b:Started 2023-10-24T02:03:14.737 DEBUG:teuthology.parallel:result is None 2023-10-24T02:03:14.737 INFO:tasks.ceph.mds.d:Started 2023-10-24T02:03:14.738 DEBUG:teuthology.parallel:result is None 2023-10-24T02:03:14.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-24T02:03:14.803 INFO:tasks.ceph.mds.a.smithi148.stdout:starting mds.a at 2023-10-24T02:03:14.803 INFO:tasks.ceph.mds.c.smithi148.stdout:starting mds.c at 2023-10-24T02:03:14.820 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T02:03:14.820 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2023-10-24T02:03:14.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.863+0000 7f23caae9700 1 Processor -- start 2023-10-24T02:03:14.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.863+0000 7f23caae9700 1 -- start start 2023-10-24T02:03:14.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23caae9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 0x7f23c40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23caae9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23c40c2e00 0x7f23c40c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23caae9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c4151810 con 0x7f23c40695c0 2023-10-24T02:03:14.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23caae9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40c3ae0 con 0x7f23c40c2e00 2023-10-24T02:03:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23caae9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40c3dc0 con 0x7f23c414eca0 2023-10-24T02:03:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23c40c2e00 0x7f23c40c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f23c40c2e00 0x7f23c40c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37928/0 (socket says 172.21.15.148:37928) 2023-10-24T02:03:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 -- 172.21.15.148:0/1299250122 learned_addr learned my addr 172.21.15.148:0/1299250122 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c8885700 1 --1- 172.21.15.148:0/1299250122 >> v1:172.21.15.148:6789/0 conn(0x7f23c40695c0 0x7f23c414e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48396/0 (socket says 172.21.15.148:48396) 2023-10-24T02:03:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bbfff700 1 --2- 172.21.15.148:0/1299250122 >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 0x7f23c40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 -- 172.21.15.148:0/1299250122 >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 msgr2=0x7f23c40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 --2- 172.21.15.148:0/1299250122 >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 0x7f23c40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 -- 172.21.15.148:0/1299250122 >> v1:172.21.15.148:6789/0 conn(0x7f23c40695c0 legacy=0x7f23c414e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bb7fe700 1 -- 172.21.15.148:0/1299250122 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834154846 0 0) 0x7f23c4151810 con 0x7f23c40695c0 2023-10-24T02:03:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 -- 172.21.15.148:0/1299250122 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40c40a0 con 0x7f23c40c2e00 2023-10-24T02:03:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bbfff700 1 --2- 172.21.15.148:0/1299250122 >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 0x7f23c40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23c9086700 1 --2- 172.21.15.148:0/1299250122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40c2e00 0x7f23c40c3250 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f23c405f9a0 tx=0x7f23bc0090f0).ready entity=mon.0 client_cookie=d649e633c22c9354 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bb7fe700 1 -- 172.21.15.148:0/1299250122 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00b600 con 0x7f23c40c2e00 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bb7fe700 1 -- 172.21.15.148:0/1299250122 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc00b760 con 0x7f23c40c2e00 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.864+0000 7f23bb7fe700 1 -- 172.21.15.148:0/1299250122 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00bae0 con 0x7f23c40c2e00 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 -- 172.21.15.148:0/1299250122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40c2e00 msgr2=0x7f23c40c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 --2- 172.21.15.148:0/1299250122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40c2e00 0x7f23c40c3250 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 rx=0x7f23c405f9a0 tx=0x7f23bc0090f0).stop 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 -- 172.21.15.148:0/1299250122 shutdown_connections 2023-10-24T02:03:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 --2- 172.21.15.148:0/1299250122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40c2e00 0x7f23c40c3250 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 --2- 172.21.15.148:0/1299250122 >> v2:172.21.15.150:3300/0 conn(0x7f23c414eca0 0x7f23c40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 -- 172.21.15.148:0/1299250122 >> 172.21.15.148:0/1299250122 conn(0x7f23c40c7cf0 msgr2=0x7f23c40c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 -- 172.21.15.148:0/1299250122 shutdown_connections 2023-10-24T02:03:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.865+0000 7f23caae9700 1 -- 172.21.15.148:0/1299250122 wait complete. 2023-10-24T02:03:14.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.866+0000 7f23caae9700 1 Processor -- start 2023-10-24T02:03:14.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.866+0000 7f23caae9700 1 -- start start 2023-10-24T02:03:14.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c40c2e00 0x7f23c4165c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c414eca0 0x7f23c40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c414cb50 con 0x7f23c40695c0 2023-10-24T02:03:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40a9840 con 0x7f23c40c2e00 2023-10-24T02:03:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23caae9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c4166120 con 0x7f23c414eca0 2023-10-24T02:03:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37932/0 (socket says 172.21.15.148:37932) 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 -- 172.21.15.148:0/1576441308 learned_addr learned my addr 172.21.15.148:0/1576441308 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23bbfff700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c40c2e00 0x7f23c4165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c9086700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c414eca0 0x7f23c40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 -- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c414eca0 msgr2=0x7f23c40ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c414eca0 0x7f23c40ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 -- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c40c2e00 msgr2=0x7f23c4165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c40c2e00 0x7f23c4165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 -- 172.21.15.148:0/1576441308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc009370 con 0x7f23c40695c0 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.867+0000 7f23c8885700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f23c0001560 tx=0x7f23c00016c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.868+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0001750 con 0x7f23c40695c0 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.868+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0005c70 con 0x7f23c40695c0 2023-10-24T02:03:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.868+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c40a9a30 con 0x7f23c40695c0 2023-10-24T02:03:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.868+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0007110 con 0x7f23c40695c0 2023-10-24T02:03:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.868+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c40a7790 con 0x7f23c40695c0 2023-10-24T02:03:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.869+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c40aa050 con 0x7f23c40695c0 2023-10-24T02:03:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.869+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f23c0007500 con 0x7f23c40695c0 2023-10-24T02:03:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.869+0000 7f23b8ff9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 0x7f23b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.869+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f23c007a050 con 0x7f23c40695c0 2023-10-24T02:03:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.869+0000 7f23bbfff700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 0x7f23b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.870+0000 7f23bbfff700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 0x7f23b0061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f23c414cef0 tx=0x7f23b4008040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:14.873+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f23c004b440 con 0x7f23c40695c0 2023-10-24T02:03:15.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.053+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f23c406c6b0 con 0x7f23c40695c0 2023-10-24T02:03:15.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.917+0000 7f23b8ff9700 1 -- 172.21.15.148:0/1576441308 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v212) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23c004ea60 con 0x7f23c40695c0 2023-10-24T02:03:15.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.919+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 msgr2=0x7f23b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:15.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.919+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 0x7f23b0061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f23c414cef0 tx=0x7f23b4008040).stop 2023-10-24T02:03:15.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.919+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 msgr2=0x7f23c40a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:15.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.919+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f23c0001560 tx=0x7f23c00016c0).stop 2023-10-24T02:03:15.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 shutdown_connections 2023-10-24T02:03:15.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c414eca0 0x7f23c40ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:15.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40695c0 0x7f23c40a9350 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23b005f150 0x7f23b0061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 --2- 172.21.15.148:0/1576441308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c40c2e00 0x7f23c4165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 >> 172.21.15.148:0/1576441308 conn(0x7f23c40c7cf0 msgr2=0x7f23c4151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 shutdown_connections 2023-10-24T02:03:15.923 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:15.920+0000 7f23caae9700 1 -- 172.21.15.148:0/1576441308 wait complete. 2023-10-24T02:03:15.924 INFO:teuthology.orchestra.run.smithi148.stderr: removed all blocklist entries 2023-10-24T02:03:15.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-24T02:03:16.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.050+0000 7fd33402e700 1 Processor -- start 2023-10-24T02:03:16.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.050+0000 7fd33402e700 1 -- start start 2023-10-24T02:03:16.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd33402e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0c6710 0x7fd32c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd33402e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd32c0aa3f0 0x7fd32c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd33402e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0aa880 con 0x7fd32c0aa010 2023-10-24T02:03:16.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd33402e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0c0960 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd33402e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c0c40 con 0x7fd32c0c6710 2023-10-24T02:03:16.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3325cb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd32c0aa3f0 0x7fd32c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd331dca700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fd32c0aa010 0x7fd32c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48406/0 (socket says 172.21.15.148:48406) 2023-10-24T02:03:16.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd331dca700 1 -- 172.21.15.148:0/2689724746 learned_addr learned my addr 172.21.15.148:0/2689724746 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:16.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3315c9700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0c6710 0x7fd32c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3325cb700 1 -- 172.21.15.148:0/2689724746 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0c6710 msgr2=0x7fd32c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:16.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3325cb700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0c6710 0x7fd32c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3325cb700 1 -- 172.21.15.148:0/2689724746 >> v1:172.21.15.148:6789/0 conn(0x7fd32c0aa010 legacy=0x7fd32c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd3325cb700 1 -- 172.21.15.148:0/2689724746 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0c0f20 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.051+0000 7fd330dc8700 1 -- 172.21.15.148:0/2689724746 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959046364 0 0) 0x7fd328001490 con 0x7fd32c0aa010 2023-10-24T02:03:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd3325cb700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c069d80 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7fd324009760 tx=0x7fd324009060).ready entity=mon.0 client_cookie=ee51dc46c765c81e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd330dc8700 1 -- 172.21.15.148:0/2689724746 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400b580 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd330dc8700 1 -- 172.21.15.148:0/2689724746 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b6e0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd330dc8700 1 -- 172.21.15.148:0/2689724746 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400ba60 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 -- 172.21.15.148:0/2689724746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 msgr2=0x7fd32c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c069d80 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7fd324009760 tx=0x7fd324009060).stop 2023-10-24T02:03:16.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 -- 172.21.15.148:0/2689724746 shutdown_connections 2023-10-24T02:03:16.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c069d80 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 --2- 172.21.15.148:0/2689724746 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0c6710 0x7fd32c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 -- 172.21.15.148:0/2689724746 >> 172.21.15.148:0/2689724746 conn(0x7fd32c0caf40 msgr2=0x7fd32c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 -- 172.21.15.148:0/2689724746 shutdown_connections 2023-10-24T02:03:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.052+0000 7fd33402e700 1 -- 172.21.15.148:0/2689724746 wait complete. 2023-10-24T02:03:16.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.053+0000 7fd33402e700 1 Processor -- start 2023-10-24T02:03:16.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 -- start start 2023-10-24T02:03:16.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 0x7fd32c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 0x7fd32c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c167d10 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c1679e0 con 0x7fd32c0c6710 2023-10-24T02:03:16.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd33402e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0c2810 con 0x7fd32c0aa010 2023-10-24T02:03:16.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd3315c9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd3315c9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37964/0 (socket says 172.21.15.148:37964) 2023-10-24T02:03:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.054+0000 7fd3315c9700 1 -- 172.21.15.148:0/2780696306 learned_addr learned my addr 172.21.15.148:0/2780696306 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 -- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 msgr2=0x7fd32c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd331dca700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 0x7fd32c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3325cb700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 0x7fd32c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 0x7fd32c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 -- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 msgr2=0x7fd32c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 0x7fd32c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 -- 172.21.15.148:0/2780696306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240092a0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd331dca700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 0x7fd32c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3325cb700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 0x7fd32c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd3315c9700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fd31c00d860 tx=0x7fd31c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011590 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c0116f0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c0c2af0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011a70 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.055+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c0c24d0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.056+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd31c012420 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.056+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c167ec0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.057+0000 7fd321ffb700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 0x7fd3100615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.057+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fd31c079930 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.057+0000 7fd331dca700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 0x7fd3100615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.057+0000 7fd331dca700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 0x7fd3100615e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd32c0b1110 tx=0x7fd328009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.061+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd32c167ec0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.286+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd32c06c6b0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.286+0000 7fd321ffb700 1 -- 172.21.15.148:0/2780696306 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd31c04aec0 con 0x7fd32c0aa3f0 2023-10-24T02:03:16.288 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:16.289 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: "auth_dump": [ 2023-10-24T02:03:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.a", 2023-10-24T02:03:16.289 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlbwUsHxAAiYwh3VysT2tQhkNqx29pvg==", 2023-10-24T02:03:16.290 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.290 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.290 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:03:16.290 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:03:16.290 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.b", 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlBE9UKhAACSZ2bFMZpmQXZFb90stRAw==", 2023-10-24T02:03:16.291 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.c", 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlthvsJRAA5ax+0AkJbW47FKIi4Vwj/g==", 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.293 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:03:16.294 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:03:16.294 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.294 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.295 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mds.d", 2023-10-24T02:03:16.295 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlQdgYMRAAeXbeNcKVjEfCg4Hm/ahSfg==", 2023-10-24T02:03:16.295 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.295 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.295 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.296 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.0", 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCWDzdlapaUDhAAX1FFsJxOmdGyeqrQ/llw1A==", 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.297 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.298 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.1", 2023-10-24T02:03:16.298 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCZDzdlKzN1DBAAmIT2mvKnKkChnh2dU8VI7Q==", 2023-10-24T02:03:16.298 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.300 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.2", 2023-10-24T02:03:16.300 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCcDzdlhsAVDBAAHfhcAz8Rapc+DROr6xptGw==", 2023-10-24T02:03:16.300 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.300 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.300 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.301 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.301 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.301 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.3", 2023-10-24T02:03:16.302 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCfDzdlOqzYCxAAxa6/AdlCYnSHrDp4E83iNw==", 2023-10-24T02:03:16.302 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.302 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.302 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.302 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.4", 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQClDzdlzWFvDxAAEnqXLWce8XonkQ7Bm6+QAQ==", 2023-10-24T02:03:16.303 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.5", 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCoDzdlo/s5DBAAJC0KvmrEryTf+/Qlt5GTFA==", 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.305 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.306 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.306 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.6", 2023-10-24T02:03:16.306 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCrDzdlIO7dCxAAP2uyvLcrhjl+VNR20876xg==", 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "osd.7", 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCuDzdlgY/CCBAArV13qEaNWD673h5scJV2mQ==", 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow profile osd", 2023-10-24T02:03:16.308 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile osd", 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.0", 2023-10-24T02:03:16.309 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlYC/yNBAAItpyFztVgG45yeAdBq/yMg==", 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow r", 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.1", 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlRpGXARAAB1f+/x/583j6X+3KziOJqQ==", 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.311 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.312 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.2", 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl/Y9BOhAAFSIvLJrgiWMnGwXQaUZJdA==", 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:03:16.313 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:03:16.314 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.314 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.3", 2023-10-24T02:03:16.314 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCTDzdlwAj3BhAA0HiSL5EW2mJI0S2v1Yah+w==", 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow", 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow r", 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow rw", 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow rwx" 2023-10-24T02:03:16.315 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "client.admin", 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlkBHNAxAA9nxgg8dCzMlFKFJdv1jl3A==", 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.316 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": "allow *", 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow *", 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.318 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.x", 2023-10-24T02:03:16.318 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdlDz82HBAALrTU0pT3WUX90j9SAxMc2Q==", 2023-10-24T02:03:16.318 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.318 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:03:16.318 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T02:03:16.319 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.319 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:16.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:16.319 INFO:teuthology.orchestra.run.smithi148.stdout: "entity": "mgr.y", 2023-10-24T02:03:16.320 INFO:teuthology.orchestra.run.smithi148.stdout: "key": "AQCSDzdl+GYHGBAAULTHLxVyJosg6fzuj0rlSQ==", 2023-10-24T02:03:16.320 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": { 2023-10-24T02:03:16.320 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": "allow *", 2023-10-24T02:03:16.320 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": "allow profile mgr", 2023-10-24T02:03:16.320 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": "allow *" 2023-10-24T02:03:16.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:16.321 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2023-10-24T02:03:16.321 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:16.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 msgr2=0x7fd3100615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 0x7fd3100615e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd32c0b1110 tx=0x7fd328009040).stop 2023-10-24T02:03:16.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 msgr2=0x7fd32c0c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fd31c00d860 tx=0x7fd31c008040).stop 2023-10-24T02:03:16.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 shutdown_connections 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd31005f120 0x7fd3100615e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd32c0c6710 0x7fd32c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd32c0aa010 0x7fd32c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 --2- 172.21.15.148:0/2780696306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd32c0aa3f0 0x7fd32c0c1fe0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 >> 172.21.15.148:0/2780696306 conn(0x7fd32c0caf40 msgr2=0x7fd32c0c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.324 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 shutdown_connections 2023-10-24T02:03:16.325 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.288+0000 7fd33402e700 1 -- 172.21.15.148:0/2780696306 wait complete. 2023-10-24T02:03:16.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:16.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.437+0000 7f46a74ce700 1 Processor -- start 2023-10-24T02:03:16.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.437+0000 7f46a74ce700 1 -- start start 2023-10-24T02:03:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a74ce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a006a490 0x7f46a00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a74ce700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00c0960 con 0x7f46a00aa010 2023-10-24T02:03:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a74ce700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00c0c40 con 0x7f46a00c6710 2023-10-24T02:03:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a74ce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00c0f20 con 0x7f46a006a490 2023-10-24T02:03:16.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a526a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f46a00aa010 0x7f46a0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48416/0 (socket says 172.21.15.148:48416) 2023-10-24T02:03:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a526a700 1 -- 172.21.15.148:0/270399620 learned_addr learned my addr 172.21.15.148:0/270399620 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a006a490 0x7f46a00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.438+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442955845 0 0) 0x7f46a00c0960 con 0x7f46a00aa010 2023-10-24T02:03:16.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c0033f0 con 0x7f46a00aa010 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913190997 0 0) 0x7f46a00c0c40 con 0x7f46a00c6710 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a00c0960 con 0x7f46a00c6710 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665245346 0 0) 0x7f468c0033f0 con 0x7f46a00aa010 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a006a490 msgr2=0x7f46a00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a006a490 0x7f46a00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 >> v1:172.21.15.150:6789/0 conn(0x7f46a00c6710 legacy=0x7f46a0069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00c1200 con 0x7f46a00aa010 2023-10-24T02:03:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f469c0017f0 con 0x7f46a00aa010 2023-10-24T02:03:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 >> v1:172.21.15.148:6789/0 conn(0x7f46a00aa010 legacy=0x7f46a0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c003aa0 0x7f468c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f468c004690 0x7f468c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c005000 0x7f468c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00c0f20 con 0x7f468c003aa0 2023-10-24T02:03:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00be80 con 0x7f468c005000 2023-10-24T02:03:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c00c040 con 0x7f468c004690 2023-10-24T02:03:16.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a006a490 0x7f46a00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:16.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c003aa0 0x7f468c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a4a69700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f468c004690 0x7f468c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c005000 0x7f468c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 -- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f468c004690 msgr2=0x7f468c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:16.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f468c004690 0x7f468c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 -- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c005000 msgr2=0x7f468c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c005000 0x7f468c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 -- 172.21.15.148:0/270399620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0033f0 con 0x7f468c003aa0 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c005000 0x7f468c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a4a69700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f468c004690 0x7f468c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f46a526a700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c003aa0 0x7f468c003ea0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f469c00c5c0 tx=0x7f469c007f40).ready entity=mon.0 client_cookie=c2721617964bc13c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00cdc0 con 0x7f468c003aa0 2023-10-24T02:03:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005b20 con 0x7f468c003aa0 2023-10-24T02:03:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.439+0000 7f4697fff700 1 -- 172.21.15.148:0/270399620 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0070d0 con 0x7f468c003aa0 2023-10-24T02:03:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 -- 172.21.15.148:0/270399620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c003aa0 msgr2=0x7f468c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 --2- 172.21.15.148:0/270399620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f468c003aa0 0x7f468c003ea0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f469c00c5c0 tx=0x7f469c007f40).stop 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a5a6b700 1 -- 172.21.15.148:0/270399620 reap_dead start 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 -- 172.21.15.148:0/270399620 shutdown_connections 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 -- 172.21.15.148:0/270399620 >> 172.21.15.148:0/270399620 conn(0x7f46a00caf40 msgr2=0x7f46a00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 -- 172.21.15.148:0/270399620 shutdown_connections 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.440+0000 7f46a74ce700 1 -- 172.21.15.148:0/270399620 wait complete. 2023-10-24T02:03:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.441+0000 7f46a74ce700 1 Processor -- start 2023-10-24T02:03:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.441+0000 7f46a74ce700 1 -- start start 2023-10-24T02:03:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 0x7f46a00c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 0x7f46a0155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01680e0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00c4600 con 0x7f468c003aa0 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a74ce700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0168380 con 0x7f46a0164ad0 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37976/0 (socket says 172.21.15.148:37976) 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 -- 172.21.15.148:0/3082629740 learned_addr learned my addr 172.21.15.148:0/3082629740 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:16.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a4a69700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 0x7f46a0155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a526a700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 0x7f46a00c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 -- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 msgr2=0x7f46a0155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 0x7f46a0155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 -- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 msgr2=0x7f46a00c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 0x7f46a00c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a5a6b700 1 -- 172.21.15.148:0/3082629740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00ca420 con 0x7f46a00c9ab0 2023-10-24T02:03:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a4a69700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 0x7f46a0155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.442+0000 7f46a526a700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 0x7f46a00c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46a5a6b700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f46a0158ea0 tx=0x7f4698008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980094d0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980125b0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698012950 con 0x7f46a00c9ab0 2023-10-24T02:03:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01652d0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.443+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0165890 con 0x7f46a00c9ab0 2023-10-24T02:03:16.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.444+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a0165a80 con 0x7f46a00c9ab0 2023-10-24T02:03:16.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.444+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4698012cc0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.444+0000 7f46957fa700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 0x7f4684061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.444+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f4698079bb0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.444+0000 7f46a526a700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 0x7f4684061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.445+0000 7f46a526a700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 0x7f4684061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f46a00a8f70 tx=0x7f469c015000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.448+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f469804b1a0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.610+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a006c6b0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.612 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.611+0000 7f46957fa700 1 -- 172.21.15.148:0/3082629740 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+13842 (secure 0 0 0) 0x7f469804e7c0 con 0x7f46a00c9ab0 2023-10-24T02:03:16.613 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:16.613 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":212,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:15.915114+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:16.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 msgr2=0x7f4684061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 0x7f4684061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f46a00a8f70 tx=0x7f469c015000).stop 2023-10-24T02:03:16.615 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 msgr2=0x7f46a00c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f46a0158ea0 tx=0x7f4698008040).stop 2023-10-24T02:03:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 shutdown_connections 2023-10-24T02:03:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a00c9ab0 0x7f46a00c9f30 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f468405f150 0x7f4684061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.616 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f468c003aa0 0x7f46a00c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 --2- 172.21.15.148:0/3082629740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46a0164ad0 0x7f46a0155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 >> 172.21.15.148:0/3082629740 conn(0x7f46a00caf40 msgr2=0x7f46a01515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 shutdown_connections 2023-10-24T02:03:16.617 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.613+0000 7f46a74ce700 1 -- 172.21.15.148:0/3082629740 wait complete. 2023-10-24T02:03:16.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '207', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-24T02:03:16.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T02:03:16.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.742+0000 7f4bcbef4700 1 Processor -- start 2023-10-24T02:03:16.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.742+0000 7f4bcbef4700 1 -- start start 2023-10-24T02:03:16.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bcbef4700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bc4154430 0x7f4bc4154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bcbef4700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40c71d0 con 0x7f4bc4098bd0 2023-10-24T02:03:16.745 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bcbef4700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40c9410 con 0x7f4bc40bffd0 2023-10-24T02:03:16.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bcbef4700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc40c6a10 con 0x7f4bc4154430 2023-10-24T02:03:16.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bc9c90700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bc4154430 0x7f4bc4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bc948f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4bc4098bd0 0x7f4bc40c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48420/0 (socket says 172.21.15.148:48420) 2023-10-24T02:03:16.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bc9c90700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4bc4154430 0x7f4bc4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37984/0 (socket says 172.21.15.148:37984) 2023-10-24T02:03:16.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.743+0000 7f4bc948f700 1 -- 172.21.15.148:0/2005304494 learned_addr learned my addr 172.21.15.148:0/2005304494 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:16.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2005304494 >> v1:172.21.15.150:6789/0 conn(0x7f4bc40bffd0 legacy=0x7f4bc415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2005304494 >> v1:172.21.15.148:6789/0 conn(0x7f4bc4098bd0 legacy=0x7f4bc40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2005304494 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40ca8b0 con 0x7f4bc4154430 2023-10-24T02:03:16.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc9c90700 1 --2- 172.21.15.148:0/2005304494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4154430 0x7f4bc4154810 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f4bc0009760 tx=0x7f4bc0009060).ready entity=mon.0 client_cookie=5d7756b715e05e04 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.747 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc8c8e700 1 -- 172.21.15.148:0/2005304494 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000b580 con 0x7f4bc4154430 2023-10-24T02:03:16.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc8c8e700 1 -- 172.21.15.148:0/2005304494 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc000b6e0 con 0x7f4bc4154430 2023-10-24T02:03:16.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bc8c8e700 1 -- 172.21.15.148:0/2005304494 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000ba60 con 0x7f4bc4154430 2023-10-24T02:03:16.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2005304494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4154430 msgr2=0x7f4bc4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2005304494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4154430 0x7f4bc4154810 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f4bc0009760 tx=0x7f4bc0009060).stop 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2005304494 shutdown_connections 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2005304494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4154430 0x7f4bc4154810 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2005304494 >> 172.21.15.148:0/2005304494 conn(0x7f4bc40cb070 msgr2=0x7f4bc40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2005304494 shutdown_connections 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.744+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2005304494 wait complete. 2023-10-24T02:03:16.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 Processor -- start 2023-10-24T02:03:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 -- start start 2023-10-24T02:03:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40bffd0 0x7f4bc40ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bc4154430 0x7f4bc414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.753 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40aead0 con 0x7f4bc4098bd0 2023-10-24T02:03:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40af930 con 0x7f4bc40bffd0 2023-10-24T02:03:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bcbef4700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ad1f0 con 0x7f4bc4154430 2023-10-24T02:03:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bc9c90700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bc9c90700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37992/0 (socket says 172.21.15.148:37992) 2023-10-24T02:03:16.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.746+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2385672872 learned_addr learned my addr 172.21.15.148:0/2385672872 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc948f700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40bffd0 0x7f4bc40ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bca491700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bc4154430 0x7f4bc414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bc4154430 msgr2=0x7f4bc414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bc4154430 0x7f4bc414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40bffd0 msgr2=0x7f4bc40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.755 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40bffd0 0x7f4bc40ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 -- 172.21.15.148:0/2385672872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00092a0 con 0x7f4bc4098bd0 2023-10-24T02:03:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bc9c90700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f4bc0009eb0 tx=0x7f4bc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000ba60 con 0x7f4bc4098bd0 2023-10-24T02:03:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0000c90 con 0x7f4bc4098bd0 2023-10-24T02:03:16.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc40ab980 con 0x7f4bc4098bd0 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc001b620 con 0x7f4bc4098bd0 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.747+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc40af000 con 0x7f4bc4098bd0 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.748+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc406c6b0 con 0x7f4bc4098bd0 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.749+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4bc001ba10 con 0x7f4bc4098bd0 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.749+0000 7f4bb9ffb700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 0x7f4ba8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:16.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.749+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f4bc007b970 con 0x7f4bc4098bd0 2023-10-24T02:03:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.749+0000 7f4bc948f700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 0x7f4ba8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.749+0000 7f4bc948f700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 0x7f4ba8061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4bc40c47a0 tx=0x7f4bb4007d30).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:16.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.753+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4bc004cf60 con 0x7f4bc4098bd0 2023-10-24T02:03:16.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.916+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4bc40c6c10 con 0x7f4bc4098bd0 2023-10-24T02:03:16.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.916+0000 7f4bb9ffb700 1 -- 172.21.15.148:0/2385672872 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v212) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4bc001f0b0 con 0x7f4bc4098bd0 2023-10-24T02:03:16.918 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T02:03:16.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 msgr2=0x7f4ba8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 0x7f4ba8061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4bc40c47a0 tx=0x7f4bb4007d30).stop 2023-10-24T02:03:16.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 msgr2=0x7f4bc40ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:16.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f4bc0009eb0 tx=0x7f4bc0017000).stop 2023-10-24T02:03:16.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 shutdown_connections 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4bc4154430 0x7f4bc414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc4098bd0 0x7f4bc40ab490 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4ba805f150 0x7f4ba8061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 --2- 172.21.15.148:0/2385672872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4bc40bffd0 0x7f4bc40ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 >> 172.21.15.148:0/2385672872 conn(0x7f4bc40cb070 msgr2=0x7f4bc40a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:16.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 shutdown_connections 2023-10-24T02:03:16.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:16.918+0000 7f4bcbef4700 1 -- 172.21.15.148:0/2385672872 wait complete. 2023-10-24T02:03:16.932 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T02:03:17.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.047+0000 7fdd9a3e9700 1 Processor -- start 2023-10-24T02:03:17.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.047+0000 7fdd9a3e9700 1 -- start start 2023-10-24T02:03:17.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd9a3e9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd940c06e0 0x7fdd94154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.051 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd9a3e9700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940c71d0 con 0x7fdd94154430 2023-10-24T02:03:17.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd9a3e9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940c9410 con 0x7fdd94098bd0 2023-10-24T02:03:17.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd9a3e9700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940c6a10 con 0x7fdd940c06e0 2023-10-24T02:03:17.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd98986700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd940c06e0 0x7fdd94154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd98986700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdd940c06e0 0x7fdd94154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37998/0 (socket says 172.21.15.148:37998) 2023-10-24T02:03:17.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd98986700 1 -- 172.21.15.148:0/1252957301 learned_addr learned my addr 172.21.15.148:0/1252957301 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:17.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.048+0000 7fdd93fff700 1 --1- 172.21.15.148:0/1252957301 >> v1:172.21.15.148:6789/0 conn(0x7fdd94154430 0x7fdd940c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48432/0 (socket says 172.21.15.148:48432) 2023-10-24T02:03:17.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd98986700 1 -- 172.21.15.148:0/1252957301 >> v1:172.21.15.150:6789/0 conn(0x7fdd94098bd0 legacy=0x7fdd940bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:17.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd98986700 1 -- 172.21.15.148:0/1252957301 >> v1:172.21.15.148:6789/0 conn(0x7fdd94154430 legacy=0x7fdd940c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd98986700 1 -- 172.21.15.148:0/1252957301 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940ca8b0 con 0x7fdd940c06e0 2023-10-24T02:03:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd92ffd700 1 -- 172.21.15.148:0/1252957301 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848516400 0 0) 0x7fdd940c71d0 con 0x7fdd94154430 2023-10-24T02:03:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd98986700 1 --2- 172.21.15.148:0/1252957301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd940c06e0 0x7fdd94154810 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fdd8c009f20 tx=0x7fdd8c009840).ready entity=mon.0 client_cookie=b3d9c2886b80daa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd92ffd700 1 -- 172.21.15.148:0/1252957301 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00e070 con 0x7fdd940c06e0 2023-10-24T02:03:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd92ffd700 1 -- 172.21.15.148:0/1252957301 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00ba80 con 0x7fdd940c06e0 2023-10-24T02:03:17.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd92ffd700 1 -- 172.21.15.148:0/1252957301 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00be00 con 0x7fdd940c06e0 2023-10-24T02:03:17.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.049+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1252957301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd940c06e0 msgr2=0x7fdd94154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1252957301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd940c06e0 0x7fdd94154810 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fdd8c009f20 tx=0x7fdd8c009840).stop 2023-10-24T02:03:17.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1252957301 shutdown_connections 2023-10-24T02:03:17.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1252957301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd940c06e0 0x7fdd94154810 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1252957301 >> 172.21.15.148:0/1252957301 conn(0x7fdd940cb070 msgr2=0x7fdd940cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1252957301 shutdown_connections 2023-10-24T02:03:17.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.050+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1252957301 wait complete. 2023-10-24T02:03:17.058 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.051+0000 7fdd9a3e9700 1 Processor -- start 2023-10-24T02:03:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.051+0000 7fdd9a3e9700 1 -- start start 2023-10-24T02:03:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 0x7fdd94141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd940c06e0 0x7fdd940c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940c3770 con 0x7fdd94154430 2023-10-24T02:03:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940c2940 con 0x7fdd94098bd0 2023-10-24T02:03:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940c2c20 con 0x7fdd940c06e0 2023-10-24T02:03:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38010/0 (socket says 172.21.15.148:38010) 2023-10-24T02:03:17.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 -- 172.21.15.148:0/1733160363 learned_addr learned my addr 172.21.15.148:0/1733160363 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd93fff700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 0x7fdd94141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd937fe700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd940c06e0 0x7fdd940c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 -- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd940c06e0 msgr2=0x7fdd940c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd940c06e0 0x7fdd940c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 -- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 msgr2=0x7fdd94141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.061 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 0x7fdd94141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 -- 172.21.15.148:0/1733160363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c009ae0 con 0x7fdd94154430 2023-10-24T02:03:17.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd93fff700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 0x7fdd94141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:17.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd98986700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7fdd940c5910 tx=0x7fdd940caa40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0092e0 con 0x7fdd94154430 2023-10-24T02:03:17.062 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c01d410 con 0x7fdd94154430 2023-10-24T02:03:17.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd940c2f00 con 0x7fdd94154430 2023-10-24T02:03:17.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c01d790 con 0x7fdd94154430 2023-10-24T02:03:17.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.052+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd940c2600 con 0x7fdd94154430 2023-10-24T02:03:17.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.053+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd940c3540 con 0x7fdd94154430 2023-10-24T02:03:17.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.054+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd8c01db00 con 0x7fdd94154430 2023-10-24T02:03:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.054+0000 7fdd7bfff700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 0x7fdd80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.054+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fdd8c07bb80 con 0x7fdd94154430 2023-10-24T02:03:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.054+0000 7fdd93fff700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 0x7fdd80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.055+0000 7fdd93fff700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 0x7fdd80061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdd84000c00 tx=0x7fdd84007cd0).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.058+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdd940c3540 con 0x7fdd94154430 2023-10-24T02:03:17.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.220+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd940c3540 con 0x7fdd94154430 2023-10-24T02:03:17.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.220+0000 7fdd7bfff700 1 -- 172.21.15.148:0/1733160363 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v212) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd940c3540 con 0x7fdd94154430 2023-10-24T02:03:17.222 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T02:03:17.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 msgr2=0x7fdd80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 0x7fdd80061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fdd84000c00 tx=0x7fdd84007cd0).stop 2023-10-24T02:03:17.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 msgr2=0x7fdd94063e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7fdd940c5910 tx=0x7fdd940caa40).stop 2023-10-24T02:03:17.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 shutdown_connections 2023-10-24T02:03:17.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd94154430 0x7fdd94063e80 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdd8005f150 0x7fdd80061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd94098bd0 0x7fdd94141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 --2- 172.21.15.148:0/1733160363 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd940c06e0 0x7fdd940c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 >> 172.21.15.148:0/1733160363 conn(0x7fdd940cb070 msgr2=0x7fdd94063370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 shutdown_connections 2023-10-24T02:03:17.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.222+0000 7fdd9a3e9700 1 -- 172.21.15.148:0/1733160363 wait complete. 2023-10-24T02:03:17.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-24T02:03:17.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.348+0000 7f2edd2aa700 1 Processor -- start 2023-10-24T02:03:17.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.348+0000 7f2edd2aa700 1 -- start start 2023-10-24T02:03:17.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2edd2aa700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ed80c6710 0x7f2ed80c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2edd2aa700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 0x7f2ed8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2edd2aa700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80aa820 con 0x7f2ed80aa010 2023-10-24T02:03:17.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2edd2aa700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80c0960 con 0x7f2ed80c6710 2023-10-24T02:03:17.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2edd2aa700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80c0c40 con 0x7f2ed80aa3f0 2023-10-24T02:03:17.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2ece7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ed80c6710 0x7f2ed80c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2ece7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2ed80c6710 0x7f2ed80c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38018/0 (socket says 172.21.15.148:38018) 2023-10-24T02:03:17.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.349+0000 7f2ece7fc700 1 -- 172.21.15.148:0/3769387836 learned_addr learned my addr 172.21.15.148:0/3769387836 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:17.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ed77fe700 1 --2- 172.21.15.148:0/3769387836 >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 0x7f2ed8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ece7fc700 1 -- 172.21.15.148:0/3769387836 >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 msgr2=0x7f2ed8069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/3769387836 >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 0x7f2ed8069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ece7fc700 1 -- 172.21.15.148:0/3769387836 >> v1:172.21.15.150:6789/0 conn(0x7f2ed80aa010 legacy=0x7f2ed8158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ece7fc700 1 -- 172.21.15.148:0/3769387836 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80c0f20 con 0x7f2ed80c6710 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ed77fe700 1 --2- 172.21.15.148:0/3769387836 >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 0x7f2ed8069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:17.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/3769387836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80c6710 0x7f2ed80c1a00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f2ed8158e80 tx=0x7f2ec00090f0).ready entity=mon.0 client_cookie=998209436a56a104 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ed67fc700 1 -- 172.21.15.148:0/3769387836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000b5a0 con 0x7f2ed80c6710 2023-10-24T02:03:17.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ed67fc700 1 -- 172.21.15.148:0/3769387836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000b700 con 0x7f2ed80c6710 2023-10-24T02:03:17.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2ed67fc700 1 -- 172.21.15.148:0/3769387836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000ba80 con 0x7f2ed80c6710 2023-10-24T02:03:17.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2edd2aa700 1 -- 172.21.15.148:0/3769387836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80c6710 msgr2=0x7f2ed80c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.350+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/3769387836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80c6710 0x7f2ed80c1a00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f2ed8158e80 tx=0x7f2ec00090f0).stop 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 -- 172.21.15.148:0/3769387836 shutdown_connections 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/3769387836 >> v2:172.21.15.150:3300/0 conn(0x7f2ed80aa3f0 0x7f2ed8069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/3769387836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80c6710 0x7f2ed80c1a00 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 -- 172.21.15.148:0/3769387836 >> 172.21.15.148:0/3769387836 conn(0x7f2ed80caf40 msgr2=0x7f2ed80cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 -- 172.21.15.148:0/3769387836 shutdown_connections 2023-10-24T02:03:17.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.351+0000 7f2edd2aa700 1 -- 172.21.15.148:0/3769387836 wait complete. 2023-10-24T02:03:17.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.352+0000 7f2edd2aa700 1 Processor -- start 2023-10-24T02:03:17.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.352+0000 7f2edd2aa700 1 -- start start 2023-10-24T02:03:17.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.352+0000 7f2edd2aa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ed80aa3f0 0x7f2ed8156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ed80c6710 0x7f2ed813eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8156a80 con 0x7f2ed80aa010 2023-10-24T02:03:17.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8156d60 con 0x7f2ed80aa3f0 2023-10-24T02:03:17.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8157040 con 0x7f2ed80c6710 2023-10-24T02:03:17.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38026/0 (socket says 172.21.15.148:38026) 2023-10-24T02:03:17.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 -- 172.21.15.148:0/2644744659 learned_addr learned my addr 172.21.15.148:0/2644744659 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:17.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ed80aa3f0 0x7f2ed8156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed77fe700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ed80c6710 0x7f2ed813eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 -- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ed80c6710 msgr2=0x7f2ed813eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ed80c6710 0x7f2ed813eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 -- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ed80aa3f0 msgr2=0x7f2ed8156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ed80aa3f0 0x7f2ed8156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 -- 172.21.15.148:0/2644744659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009370 con 0x7f2ed80aa010 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ed6ffd700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f2ec800c440 tx=0x7f2ec8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8012400 con 0x7f2ed80aa010 2023-10-24T02:03:17.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8012580 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8012940 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8157320 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.353+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed8157b20 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.354+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed806c6b0 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.355+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2ec8012d30 con 0x7f2ed80aa010 2023-10-24T02:03:17.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.355+0000 7f2ecf7fe700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 0x7f2eb8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.355+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f2ec8079290 con 0x7f2ed80aa010 2023-10-24T02:03:17.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.355+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 0x7f2eb8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.355+0000 7f2ece7fc700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 0x7f2eb8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2ec0009130 tx=0x7f2ec0015000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.359+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2ec8048af0 con 0x7f2ed80aa010 2023-10-24T02:03:17.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.522+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ed80c1200 con 0x7f2ed80aa010 2023-10-24T02:03:17.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.523+0000 7f2ecf7fe700 1 -- 172.21.15.148:0/2644744659 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v212) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2ec804a930 con 0x7f2ed80aa010 2023-10-24T02:03:17.525 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:17.525 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T02:03:17.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:17.526 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 1, 2023-10-24T02:03:17.526 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "device_health_metrics" 2023-10-24T02:03:17.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2023-10-24T02:03:17.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:17.527 INFO:teuthology.orchestra.run.smithi148.stdout: "poolnum": 2, 2023-10-24T02:03:17.527 INFO:teuthology.orchestra.run.smithi148.stdout: "poolname": "rbd" 2023-10-24T02:03:17.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:17.527 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T02:03:17.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 msgr2=0x7f2eb8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 0x7f2eb8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2ec0009130 tx=0x7f2ec0015000).stop 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 msgr2=0x7f2ed80c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f2ec800c440 tx=0x7f2ec8007de0).stop 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 shutdown_connections 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ed80c6710 0x7f2ed813eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ed80aa010 0x7f2ed80c4f20 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f2eb805f150 0x7f2eb8061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 --2- 172.21.15.148:0/2644744659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ed80aa3f0 0x7f2ed8156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 >> 172.21.15.148:0/2644744659 conn(0x7f2ed80caf40 msgr2=0x7f2ed8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 shutdown_connections 2023-10-24T02:03:17.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.525+0000 7f2edd2aa700 1 -- 172.21.15.148:0/2644744659 wait complete. 2023-10-24T02:03:17.538 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-24T02:03:17.539 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-24T02:03:17.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.655+0000 7fa4feb72700 1 Processor -- start 2023-10-24T02:03:17.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.655+0000 7fa4feb72700 1 -- start start 2023-10-24T02:03:17.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4feb72700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 0x7fa4f80a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4feb72700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 0x7fa4f80c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4feb72700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80c6270 con 0x7fa4f81544b0 2023-10-24T02:03:17.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4feb72700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80c60e0 con 0x7fa4f80a7d00 2023-10-24T02:03:17.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4feb72700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80aa870 con 0x7fa4f80aa420 2023-10-24T02:03:17.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4fc90e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa4f81544b0 0x7fa4f80c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48434/0 (socket says 172.21.15.148:48434) 2023-10-24T02:03:17.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.656+0000 7fa4fc90e700 1 -- 172.21.15.148:0/3371955052 learned_addr learned my addr 172.21.15.148:0/3371955052 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:17.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 --2- 172.21.15.148:0/3371955052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 0x7fa4f80c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4effff700 1 --2- 172.21.15.148:0/3371955052 >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 0x7fa4f80a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4ef7fe700 1 -- 172.21.15.148:0/3371955052 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164545752 0 0) 0x7fa4f80c6270 con 0x7fa4f81544b0 2023-10-24T02:03:17.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4ef7fe700 1 -- 172.21.15.148:0/3371955052 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e00033f0 con 0x7fa4f81544b0 2023-10-24T02:03:17.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 -- 172.21.15.148:0/3371955052 >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 msgr2=0x7fa4f80a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:17.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 --2- 172.21.15.148:0/3371955052 >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 0x7fa4f80a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 -- 172.21.15.148:0/3371955052 >> v1:172.21.15.148:6789/0 conn(0x7fa4f81544b0 legacy=0x7fa4f80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 -- 172.21.15.148:0/3371955052 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80c0c80 con 0x7fa4f80aa420 2023-10-24T02:03:17.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4effff700 1 --2- 172.21.15.148:0/3371955052 >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 0x7fa4f80a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:17.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4fd10f700 1 --2- 172.21.15.148:0/3371955052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 0x7fa4f80c6700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa4f0009e60 tx=0x7fa4f0009780).ready entity=mon.2 client_cookie=649aa5aa377b9094 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4ef7fe700 1 -- 172.21.15.148:0/3371955052 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000e070 con 0x7fa4f80aa420 2023-10-24T02:03:17.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4ef7fe700 1 -- 172.21.15.148:0/3371955052 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f000bab0 con 0x7fa4f80aa420 2023-10-24T02:03:17.663 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.657+0000 7fa4ef7fe700 1 -- 172.21.15.148:0/3371955052 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000be30 con 0x7fa4f80aa420 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 -- 172.21.15.148:0/3371955052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 msgr2=0x7fa4f80c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 --2- 172.21.15.148:0/3371955052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 0x7fa4f80c6700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fa4f0009e60 tx=0x7fa4f0009780).stop 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 -- 172.21.15.148:0/3371955052 shutdown_connections 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 --2- 172.21.15.148:0/3371955052 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f80aa420 0x7fa4f80c6700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 --2- 172.21.15.148:0/3371955052 >> v2:172.21.15.150:3300/0 conn(0x7fa4f80a7d00 0x7fa4f80a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 -- 172.21.15.148:0/3371955052 >> 172.21.15.148:0/3371955052 conn(0x7fa4f80945d0 msgr2=0x7fa4f806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 -- 172.21.15.148:0/3371955052 shutdown_connections 2023-10-24T02:03:17.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.658+0000 7fa4feb72700 1 -- 172.21.15.148:0/3371955052 wait complete. 2023-10-24T02:03:17.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.659+0000 7fa4feb72700 1 Processor -- start 2023-10-24T02:03:17.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.659+0000 7fa4feb72700 1 -- start start 2023-10-24T02:03:17.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80a7d00 0x7fa4f8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.668 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f81544b0 0x7fa4f8145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8157660 con 0x7fa4f80aa420 2023-10-24T02:03:17.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8165530 con 0x7fa4f80a7d00 2023-10-24T02:03:17.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4feb72700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81569e0 con 0x7fa4f81544b0 2023-10-24T02:03:17.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.669 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38032/0 (socket says 172.21.15.148:38032) 2023-10-24T02:03:17.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 -- 172.21.15.148:0/868388790 learned_addr learned my addr 172.21.15.148:0/868388790 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:17.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4fd10f700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f81544b0 0x7fa4f8145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4fc90e700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80a7d00 0x7fa4f8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 -- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f81544b0 msgr2=0x7fa4f8145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.670 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f81544b0 0x7fa4f8145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 -- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80a7d00 msgr2=0x7fa4f8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80a7d00 0x7fa4f8156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.660+0000 7fa4effff700 1 -- 172.21.15.148:0/868388790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80092a0 con 0x7fa4f80aa420 2023-10-24T02:03:17.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4effff700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fa4e800ea20 tx=0x7fa4e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.671 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800c850 con 0x7fa4f80aa420 2023-10-24T02:03:17.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800c9b0 con 0x7fa4f80aa420 2023-10-24T02:03:17.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f0009a20 con 0x7fa4f80aa420 2023-10-24T02:03:17.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800cd30 con 0x7fa4f80aa420 2023-10-24T02:03:17.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.661+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f8156fa0 con 0x7fa4f80aa420 2023-10-24T02:03:17.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.662+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f806c6b0 con 0x7fa4f80aa420 2023-10-24T02:03:17.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.662+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa4e8012600 con 0x7fa4f80aa420 2023-10-24T02:03:17.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.662+0000 7fa4ecff9700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 0x7fa4e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:17.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.663+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fa4e807a4c0 con 0x7fa4f80aa420 2023-10-24T02:03:17.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.663+0000 7fa4fc90e700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 0x7fa4e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:17.673 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.663+0000 7fa4fc90e700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 0x7fa4e4061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa4f8153cf0 tx=0x7fa4f4009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:17.674 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.667+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa4e804bab0 con 0x7fa4f80aa420 2023-10-24T02:03:17.773 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:03:17.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:03:17.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.834+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fa4f80c0f40 con 0x7fa4f80aa420 2023-10-24T02:03:17.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.929+0000 7fa4ecff9700 1 -- 172.21.15.148:0/868388790 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v213) v1 ==== 152+0+0 (secure 0 0 0) 0x7fa4e804f0d0 con 0x7fa4f80aa420 2023-10-24T02:03:17.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 msgr2=0x7fa4e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 0x7fa4e4061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa4f8153cf0 tx=0x7fa4f4009040).stop 2023-10-24T02:03:17.935 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 msgr2=0x7fa4f8165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:17.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fa4e800ea20 tx=0x7fa4e8009060).stop 2023-10-24T02:03:17.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 shutdown_connections 2023-10-24T02:03:17.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4f81544b0 0x7fa4f8145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4e405f150 0x7fa4e4061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4f80a7d00 0x7fa4f8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 --2- 172.21.15.148:0/868388790 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4f80aa420 0x7fa4f8165040 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:17.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.933+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 >> 172.21.15.148:0/868388790 conn(0x7fa4f80945d0 msgr2=0x7fa4f80a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:17.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.934+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 shutdown_connections 2023-10-24T02:03:17.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:17.934+0000 7fa4feb72700 1 -- 172.21.15.148:0/868388790 wait complete. 2023-10-24T02:03:17.940 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' created 2023-10-24T02:03:17.950 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-24T02:03:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.108+0000 7f5e8e9f6700 1 Processor -- start 2023-10-24T02:03:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 -- start start 2023-10-24T02:03:18.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e880c8530 0x7f5e880a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 0x7f5e880a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880c6770 con 0x7f5e88157780 2023-10-24T02:03:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e880c1120 con 0x7f5e880c8530 2023-10-24T02:03:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.109+0000 7f5e8e9f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880c1400 con 0x7f5e880a8120 2023-10-24T02:03:18.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e880c8530 0x7f5e880a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e880c8530 0x7f5e880a7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38040/0 (socket says 172.21.15.148:38040) 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 -- 172.21.15.148:0/2308776886 learned_addr learned my addr 172.21.15.148:0/2308776886 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8e1f5700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 0x7f5e880a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 -- 172.21.15.148:0/2308776886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 msgr2=0x7f5e880a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 0x7f5e880a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 -- 172.21.15.148:0/2308776886 >> v1:172.21.15.150:6789/0 conn(0x7f5e88157780 legacy=0x7f5e880c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 -- 172.21.15.148:0/2308776886 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880c6120 con 0x7f5e880c8530 2023-10-24T02:03:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8e1f5700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 0x7f5e880a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8d1f3700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e880c8530 0x7f5e880a7c30 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7f5e78006fd0 tx=0x7f5e780090f0).ready entity=mon.0 client_cookie=a2746855870c9d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:18.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8c9f2700 1 -- 172.21.15.148:0/2308776886 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800b600 con 0x7f5e880c8530 2023-10-24T02:03:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8c9f2700 1 -- 172.21.15.148:0/2308776886 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800b760 con 0x7f5e880c8530 2023-10-24T02:03:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.110+0000 7f5e8c9f2700 1 -- 172.21.15.148:0/2308776886 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800bb00 con 0x7f5e880c8530 2023-10-24T02:03:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/2308776886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e880c8530 msgr2=0x7f5e880a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e880c8530 0x7f5e880a7c30 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7f5e78006fd0 tx=0x7f5e780090f0).stop 2023-10-24T02:03:18.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/2308776886 shutdown_connections 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880a8120 0x7f5e880a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/2308776886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e880c8530 0x7f5e880a7c30 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/2308776886 >> 172.21.15.148:0/2308776886 conn(0x7f5e88094570 msgr2=0x7f5e8806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/2308776886 shutdown_connections 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.111+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/2308776886 wait complete. 2023-10-24T02:03:18.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.112+0000 7f5e8e9f6700 1 Processor -- start 2023-10-24T02:03:18.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.112+0000 7f5e8e9f6700 1 -- start start 2023-10-24T02:03:18.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 0x7f5e88069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.121 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880c8530 0x7f5e88153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88153650 con 0x7f5e88157780 2023-10-24T02:03:18.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88154470 con 0x7f5e880a8120 2023-10-24T02:03:18.122 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e9f6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88168ed0 con 0x7f5e880c8530 2023-10-24T02:03:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38046/0 (socket says 172.21.15.148:38046) 2023-10-24T02:03:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 -- 172.21.15.148:0/3196305355 learned_addr learned my addr 172.21.15.148:0/3196305355 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8d9f4700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 0x7f5e88069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.123 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8d1f3700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880c8530 0x7f5e88153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 -- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880c8530 msgr2=0x7f5e88153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880c8530 0x7f5e88153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 -- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 msgr2=0x7f5e88069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 0x7f5e88069770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.124 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 -- 172.21.15.148:0/3196305355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78009370 con 0x7f5e88157780 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8d9f4700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 0x7f5e88069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e8e1f5700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f5e8000cef0 tx=0x7f5e80007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.113+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000ae00 con 0x7f5e88157780 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.114+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80016400 con 0x7f5e88157780 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.114+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e88153860 con 0x7f5e88157780 2023-10-24T02:03:18.125 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.114+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80016780 con 0x7f5e88157780 2023-10-24T02:03:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.114+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e88153e20 con 0x7f5e88157780 2023-10-24T02:03:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.115+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e88047480 con 0x7f5e88157780 2023-10-24T02:03:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.115+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e8001f3f0 con 0x7f5e88157780 2023-10-24T02:03:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.115+0000 7f5e7dffb700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 0x7f5e6c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:18.126 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.115+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 5683+0+0 (secure 0 0 0) 0x7f5e8007a7e0 con 0x7f5e88157780 2023-10-24T02:03:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.116+0000 7f5e8d9f4700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 0x7f5e6c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.116+0000 7f5e8d9f4700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 0x7f5e6c061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5e84007fd0 tx=0x7f5e84009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:18.127 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.120+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e8004bc00 con 0x7f5e88157780 2023-10-24T02:03:18.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.284+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e880c6400 con 0x7f5e88157780 2023-10-24T02:03:18.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.935+0000 7f5e7dffb700 1 -- 172.21.15.148:0/3196305355 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v214) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5e8004f220 con 0x7f5e88157780 2023-10-24T02:03:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 msgr2=0x7f5e6c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.944 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 0x7f5e6c061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5e84007fd0 tx=0x7f5e84009040).stop 2023-10-24T02:03:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 msgr2=0x7f5e88150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:18.945 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f5e8000cef0 tx=0x7f5e80007860).stop 2023-10-24T02:03:18.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 shutdown_connections 2023-10-24T02:03:18.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e88157780 0x7f5e88150cf0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.946 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e6c05f150 0x7f5e6c061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e880a8120 0x7f5e88069770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 --2- 172.21.15.148:0/3196305355 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e880c8530 0x7f5e88153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.943+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 >> 172.21.15.148:0/3196305355 conn(0x7f5e88094570 msgr2=0x7f5e880ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.944+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 shutdown_connections 2023-10-24T02:03:18.947 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:18.945+0000 7f5e8e9f6700 1 -- 172.21.15.148:0/3196305355 wait complete. 2023-10-24T02:03:18.955 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' created 2023-10-24T02:03:18.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-24T02:03:19.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.087+0000 7fbc156b7700 1 Processor -- start 2023-10-24T02:03:19.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 -- start start 2023-10-24T02:03:19.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc1014e6e0 0x7fbc1014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1006b380 0x7fbc10151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc101523b0 con 0x7fbc100aa530 2023-10-24T02:03:19.092 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc100627d0 con 0x7fbc1014e6e0 2023-10-24T02:03:19.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc156b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10062ab0 con 0x7fbc1006b380 2023-10-24T02:03:19.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.088+0000 7fbc0effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc1014e6e0 0x7fbc1014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbc1014e6e0 0x7fbc1014eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38050/0 (socket says 172.21.15.148:38050) 2023-10-24T02:03:19.093 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0f7fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbc100aa530 0x7fbc10063870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48438/0 (socket says 172.21.15.148:48438) 2023-10-24T02:03:19.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 -- 172.21.15.148:0/548818414 learned_addr learned my addr 172.21.15.148:0/548818414 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:19.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0e7fc700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1006b380 0x7fbc10151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 -- 172.21.15.148:0/548818414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1006b380 msgr2=0x7fbc10151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:19.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1006b380 0x7fbc10151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.094 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 -- 172.21.15.148:0/548818414 >> v1:172.21.15.148:6789/0 conn(0x7fbc100aa530 legacy=0x7fbc10063870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 -- 172.21.15.148:0/548818414 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10062d90 con 0x7fbc1014e6e0 2023-10-24T02:03:19.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0dffb700 1 -- 172.21.15.148:0/548818414 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553605003 0 0) 0x7fbc101523b0 con 0x7fbc100aa530 2023-10-24T02:03:19.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0effd700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1014e6e0 0x7fbc1014eac0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fbc0000d1a0 tx=0x7fbc0000ba50).ready entity=mon.0 client_cookie=31ec664ce6afafc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0dffb700 1 -- 172.21.15.148:0/548818414 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00010070 con 0x7fbc1014e6e0 2023-10-24T02:03:19.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0dffb700 1 -- 172.21.15.148:0/548818414 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000de10 con 0x7fbc1014e6e0 2023-10-24T02:03:19.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.089+0000 7fbc0dffb700 1 -- 172.21.15.148:0/548818414 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000b2e0 con 0x7fbc1014e6e0 2023-10-24T02:03:19.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 -- 172.21.15.148:0/548818414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1014e6e0 msgr2=0x7fbc1014eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1014e6e0 0x7fbc1014eac0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7fbc0000d1a0 tx=0x7fbc0000ba50).stop 2023-10-24T02:03:19.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 -- 172.21.15.148:0/548818414 shutdown_connections 2023-10-24T02:03:19.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1014e6e0 0x7fbc1014eac0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 --2- 172.21.15.148:0/548818414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1006b380 0x7fbc10151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 -- 172.21.15.148:0/548818414 >> 172.21.15.148:0/548818414 conn(0x7fbc100c7e20 msgr2=0x7fbc100c3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 -- 172.21.15.148:0/548818414 shutdown_connections 2023-10-24T02:03:19.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.090+0000 7fbc156b7700 1 -- 172.21.15.148:0/548818414 wait complete. 2023-10-24T02:03:19.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.091+0000 7fbc156b7700 1 Processor -- start 2023-10-24T02:03:19.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.091+0000 7fbc156b7700 1 -- start start 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 0x7fbc100c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1014e6e0 0x7fbc10152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100c2030 con 0x7fbc1006b380 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100c0ce0 con 0x7fbc100aa530 2023-10-24T02:03:19.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100c0fb0 con 0x7fbc1014e6e0 2023-10-24T02:03:19.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38062/0 (socket says 172.21.15.148:38062) 2023-10-24T02:03:19.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 -- 172.21.15.148:0/1581813338 learned_addr learned my addr 172.21.15.148:0/1581813338 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:19.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0e7fc700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 0x7fbc100c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0f7fe700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1014e6e0 0x7fbc10152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 -- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1014e6e0 msgr2=0x7fbc10152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1014e6e0 0x7fbc10152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 -- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 msgr2=0x7fbc100c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 0x7fbc100c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 -- 172.21.15.148:0/1581813338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0000bcf0 con 0x7fbc1006b380 2023-10-24T02:03:19.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0e7fc700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 0x7fbc100c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc0effd700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fbc10068200 tx=0x7fbc0000ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000b2e0 con 0x7fbc1006b380 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0001e480 con 0x7fbc1006b380 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc100c1290 con 0x7fbc1006b380 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0001e820 con 0x7fbc1006b380 2023-10-24T02:03:19.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.092+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc100c1850 con 0x7fbc1006b380 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.093+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc10047480 con 0x7fbc1006b380 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.094+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbc0001ec10 con 0x7fbc1006b380 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.094+0000 7fbbf6ffd700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 0x7fbbfc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.094+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6065+0+0 (secure 0 0 0) 0x7fbc0007ba10 con 0x7fbc1006b380 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.094+0000 7fbc0e7fc700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 0x7fbbfc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.095+0000 7fbc0e7fc700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 0x7fbbfc0615e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbc10151940 tx=0x7fbc04008040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.098+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbc0004cdc0 con 0x7fbc1006b380 2023-10-24T02:03:19.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.304+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbc10063070 con 0x7fbc1006b380 2023-10-24T02:03:19.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.311+0000 7fbbf6ffd700 1 -- 172.21.15.148:0/1581813338 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbc00023030 con 0x7fbc1006b380 2023-10-24T02:03:19.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.319+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 msgr2=0x7fbbfc0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.319+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 0x7fbbfc0615e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbc10151940 tx=0x7fbc04008040).stop 2023-10-24T02:03:19.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.319+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 msgr2=0x7fbc100c07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.319+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fbc10068200 tx=0x7fbc0000ba50).stop 2023-10-24T02:03:19.321 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 shutdown_connections 2023-10-24T02:03:19.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc1014e6e0 0x7fbc10152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc1006b380 0x7fbc100c07f0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbbfc05f120 0x7fbbfc0615e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 --2- 172.21.15.148:0/1581813338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc100aa530 0x7fbc100c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.322 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.320+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 >> 172.21.15.148:0/1581813338 conn(0x7fbc100c7e20 msgr2=0x7fbc10149f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.322+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 shutdown_connections 2023-10-24T02:03:19.323 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.322+0000 7fbc156b7700 1 -- 172.21.15.148:0/1581813338 wait complete. 2023-10-24T02:03:19.325 INFO:teuthology.orchestra.run.smithi148.stderr:new fs with metadata pool 25 and data pool 26 2023-10-24T02:03:19.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.455+0000 7fa499439700 1 Processor -- start 2023-10-24T02:03:19.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.455+0000 7fa499439700 1 -- start start 2023-10-24T02:03:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa499439700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4940c6710 0x7fa4940c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa499439700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4940aa3f0 0x7fa494069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa499439700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940aa820 con 0x7fa4940aa010 2023-10-24T02:03:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa499439700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940c0960 con 0x7fa4940c6710 2023-10-24T02:03:19.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa499439700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940c0c40 con 0x7fa4940aa3f0 2023-10-24T02:03:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa48a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4940c6710 0x7fa4940c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.456+0000 7fa48a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4940c6710 0x7fa4940c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38074/0 (socket says 172.21.15.148:38074) 2023-10-24T02:03:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 -- 172.21.15.148:0/522181668 learned_addr learned my addr 172.21.15.148:0/522181668 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa4937fe700 1 --2- 172.21.15.148:0/522181668 >> v2:172.21.15.150:3300/0 conn(0x7fa4940aa3f0 0x7fa494069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 -- 172.21.15.148:0/522181668 >> v2:172.21.15.150:3300/0 conn(0x7fa4940aa3f0 msgr2=0x7fa494069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 --2- 172.21.15.148:0/522181668 >> v2:172.21.15.150:3300/0 conn(0x7fa4940aa3f0 0x7fa494069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa4927fc700 1 -- 172.21.15.148:0/522181668 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353530766 0 0) 0x7fa4940aa820 con 0x7fa4940aa010 2023-10-24T02:03:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 -- 172.21.15.148:0/522181668 >> v1:172.21.15.150:6789/0 conn(0x7fa4940aa010 legacy=0x7fa494158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 -- 172.21.15.148:0/522181668 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940c0f20 con 0x7fa4940c6710 2023-10-24T02:03:19.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa48a7fc700 1 --2- 172.21.15.148:0/522181668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940c6710 0x7fa4940c1a00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7fa494158e80 tx=0x7fa47c0090f0).ready entity=mon.0 client_cookie=491291229fa3ed06 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa4927fc700 1 -- 172.21.15.148:0/522181668 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00b520 con 0x7fa4940c6710 2023-10-24T02:03:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa4927fc700 1 -- 172.21.15.148:0/522181668 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00b680 con 0x7fa4940c6710 2023-10-24T02:03:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.457+0000 7fa4927fc700 1 -- 172.21.15.148:0/522181668 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00ba00 con 0x7fa4940c6710 2023-10-24T02:03:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 -- 172.21.15.148:0/522181668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940c6710 msgr2=0x7fa4940c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.463 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 --2- 172.21.15.148:0/522181668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940c6710 0x7fa4940c1a00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7fa494158e80 tx=0x7fa47c0090f0).stop 2023-10-24T02:03:19.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 -- 172.21.15.148:0/522181668 shutdown_connections 2023-10-24T02:03:19.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 --2- 172.21.15.148:0/522181668 >> v2:172.21.15.150:3300/0 conn(0x7fa4940aa3f0 0x7fa494069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 --2- 172.21.15.148:0/522181668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940c6710 0x7fa4940c1a00 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 -- 172.21.15.148:0/522181668 >> 172.21.15.148:0/522181668 conn(0x7fa4940caf40 msgr2=0x7fa4940cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.464 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 -- 172.21.15.148:0/522181668 shutdown_connections 2023-10-24T02:03:19.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.458+0000 7fa499439700 1 -- 172.21.15.148:0/522181668 wait complete. 2023-10-24T02:03:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.459+0000 7fa499439700 1 Processor -- start 2023-10-24T02:03:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.459+0000 7fa499439700 1 -- start start 2023-10-24T02:03:19.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4940aa010 0x7fa4940aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 0x7fa4940c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940c1fe0 con 0x7fa4940aa3f0 2023-10-24T02:03:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940aed50 con 0x7fa4940c6710 2023-10-24T02:03:19.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4941675a0 con 0x7fa4940aa010 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38090/0 (socket says 172.21.15.148:38090) 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 -- 172.21.15.148:0/1964959056 learned_addr learned my addr 172.21.15.148:0/1964959056 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa492ffd700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4940aa010 0x7fa4940aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa4937fe700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 0x7fa4940c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 -- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4940aa010 msgr2=0x7fa4940aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4940aa010 0x7fa4940aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 -- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 msgr2=0x7fa4940c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 0x7fa4940c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 -- 172.21.15.148:0/1964959056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009370 con 0x7fa4940aa3f0 2023-10-24T02:03:19.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa4937fe700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 0x7fa4940c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48a7fc700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fa494084230 tx=0x7fa47c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00be90 con 0x7fa4940aa3f0 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00b7f0 con 0x7fa4940aa3f0 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940ae4b0 con 0x7fa4940aa3f0 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c01c670 con 0x7fa4940aa3f0 2023-10-24T02:03:19.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.460+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940aea70 con 0x7fa4940aa3f0 2023-10-24T02:03:19.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.462+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49406c6b0 con 0x7fa4940aa3f0 2023-10-24T02:03:19.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.462+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa47c01ca20 con 0x7fa4940aa3f0 2023-10-24T02:03:19.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.462+0000 7fa48b7fe700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 0x7fa4740615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.462+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa47c07bfa0 con 0x7fa4940aa3f0 2023-10-24T02:03:19.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.462+0000 7fa492ffd700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 0x7fa4740615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.463+0000 7fa492ffd700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 0x7fa4740615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa484007fd0 tx=0x7fa484007bb0).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.473 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.466+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa47c04d240 con 0x7fa4940aa3f0 2023-10-24T02:03:19.631 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.629+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4940c1200 con 0x7fa4940aa3f0 2023-10-24T02:03:19.632 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.630+0000 7fa48b7fe700 1 -- 172.21.15.148:0/1964959056 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) v1 ==== 74+0+17075 (secure 0 0 0) 0x7fa47c020070 con 0x7fa4940aa3f0 2023-10-24T02:03:19.632 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:19.632 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":215,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:19.306117+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:19.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 msgr2=0x7fa4740615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 0x7fa4740615e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa484007fd0 tx=0x7fa484007bb0).stop 2023-10-24T02:03:19.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 msgr2=0x7fa4941560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fa494084230 tx=0x7fa47c017000).stop 2023-10-24T02:03:19.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 shutdown_connections 2023-10-24T02:03:19.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa47405f120 0x7fa4740615e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.635 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4940c6710 0x7fa4940c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4940aa010 0x7fa4940aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 --2- 172.21.15.148:0/1964959056 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4940aa3f0 0x7fa4941560f0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 >> 172.21.15.148:0/1964959056 conn(0x7fa4940caf40 msgr2=0x7fa494069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 shutdown_connections 2023-10-24T02:03:19.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.632+0000 7fa499439700 1 -- 172.21.15.148:0/1964959056 wait complete. 2023-10-24T02:03:19.646 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:19.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.757+0000 7fafc8e43700 1 Processor -- start 2023-10-24T02:03:19.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.757+0000 7fafc8e43700 1 -- start start 2023-10-24T02:03:19.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc8e43700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 0x7fafc40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc8e43700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40aa880 con 0x7fafc40aa3f0 2023-10-24T02:03:19.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc8e43700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40c0960 con 0x7fafc40aa010 2023-10-24T02:03:19.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc8e43700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40c0c40 con 0x7fafc40c6710 2023-10-24T02:03:19.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc2d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fafc40aa3f0 0x7fafc4069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48454/0 (socket says 172.21.15.148:48454) 2023-10-24T02:03:19.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc2d9d700 1 -- 172.21.15.148:0/3984371868 learned_addr learned my addr 172.21.15.148:0/3984371868 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:19.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.758+0000 7fafc1d9b700 1 --2- 172.21.15.148:0/3984371868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 0x7fafc40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971838653 0 0) 0x7fafbc001110 con 0x7fafc40aa3f0 2023-10-24T02:03:19.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb00033f0 con 0x7fafc40aa3f0 2023-10-24T02:03:19.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781782399 0 0) 0x7fafc40c0960 con 0x7fafc40aa010 2023-10-24T02:03:19.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafbc001110 con 0x7fafc40aa010 2023-10-24T02:03:19.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc1d9b700 1 -- 172.21.15.148:0/3984371868 >> v1:172.21.15.150:6789/0 conn(0x7fafc40aa010 legacy=0x7fafc4158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc1d9b700 1 -- 172.21.15.148:0/3984371868 >> v1:172.21.15.148:6789/0 conn(0x7fafc40aa3f0 legacy=0x7fafc4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc1d9b700 1 -- 172.21.15.148:0/3984371868 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40c0f20 con 0x7fafc40c6710 2023-10-24T02:03:19.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc1d9b700 1 --2- 172.21.15.148:0/3984371868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 0x7fafc40c1a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fafac009790 tx=0x7fafac009060).ready entity=mon.2 client_cookie=753f8d4469aaa3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00f510 con 0x7fafc40c6710 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac00f670 con 0x7fafc40c6710 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc159a700 1 -- 172.21.15.148:0/3984371868 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00f9f0 con 0x7fafc40c6710 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc8e43700 1 -- 172.21.15.148:0/3984371868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 msgr2=0x7fafc40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.759+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3984371868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 0x7fafc40c1a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fafac009790 tx=0x7fafac009060).stop 2023-10-24T02:03:19.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.760+0000 7fafc8e43700 1 -- 172.21.15.148:0/3984371868 shutdown_connections 2023-10-24T02:03:19.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.760+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3984371868 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40c6710 0x7fafc40c1a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.760+0000 7fafc8e43700 1 -- 172.21.15.148:0/3984371868 >> 172.21.15.148:0/3984371868 conn(0x7fafc40caf40 msgr2=0x7fafc40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.760+0000 7fafc8e43700 1 -- 172.21.15.148:0/3984371868 shutdown_connections 2023-10-24T02:03:19.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.760+0000 7fafc8e43700 1 -- 172.21.15.148:0/3984371868 wait complete. 2023-10-24T02:03:19.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 Processor -- start 2023-10-24T02:03:19.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 -- start start 2023-10-24T02:03:19.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40aa010 0x7fafc41641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc40aa3f0 0x7fafc4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4156ac0 con 0x7fafc40c6710 2023-10-24T02:03:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4155eb0 con 0x7fafc40aa3f0 2023-10-24T02:03:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.761+0000 7fafc8e43700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4156190 con 0x7fafc40aa010 2023-10-24T02:03:19.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38100/0 (socket says 172.21.15.148:38100) 2023-10-24T02:03:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 -- 172.21.15.148:0/3717050609 learned_addr learned my addr 172.21.15.148:0/3717050609 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc1d9b700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc40aa3f0 0x7fafc4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc259c700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40aa010 0x7fafc41641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 -- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40aa010 msgr2=0x7fafc41641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40aa010 0x7fafc41641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 -- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc40aa3f0 msgr2=0x7fafc4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc40aa3f0 0x7fafc4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 -- 172.21.15.148:0/3717050609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0092a0 con 0x7fafc40c6710 2023-10-24T02:03:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc2d9d700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fafbc00c790 tx=0x7fafbc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0072e0 con 0x7fafc40c6710 2023-10-24T02:03:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc007440 con 0x7fafc40c6710 2023-10-24T02:03:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4156470 con 0x7fafc40c6710 2023-10-24T02:03:19.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0057a0 con 0x7fafc40c6710 2023-10-24T02:03:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.762+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4155ad0 con 0x7fafc40c6710 2023-10-24T02:03:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.763+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc406c6b0 con 0x7fafc40c6710 2023-10-24T02:03:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.763+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fafbc005b50 con 0x7fafc40c6710 2023-10-24T02:03:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.764+0000 7fafba7fc700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:19.774 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.764+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fafbc0798d0 con 0x7fafc40c6710 2023-10-24T02:03:19.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.764+0000 7fafc259c700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:19.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.764+0000 7fafc259c700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 0x7fafa4061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fafc40cb680 tx=0x7fafb4007f30).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:19.775 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.768+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fafbc04ab70 con 0x7fafc40c6710 2023-10-24T02:03:19.933 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.932+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafc40aa880 con 0x7fafc40c6710 2023-10-24T02:03:19.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.933+0000 7fafba7fc700 1 -- 172.21.15.148:0/3717050609 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) v1 ==== 74+0+17075 (secure 0 0 0) 0x7fafc40aa880 con 0x7fafc40c6710 2023-10-24T02:03:19.935 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:19.935 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":215,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:19.306117+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:19.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 msgr2=0x7fafa4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 0x7fafa4061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fafc40cb680 tx=0x7fafb4007f30).stop 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 msgr2=0x7fafc40c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fafbc00c790 tx=0x7fafbc007c30).stop 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 shutdown_connections 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc40c6710 0x7fafc40c2b10 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fafc40aa010 0x7fafc41641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fafa405f150 0x7fafa4061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 --2- 172.21.15.148:0/3717050609 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafc40aa3f0 0x7fafc4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:19.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.934+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 >> 172.21.15.148:0/3717050609 conn(0x7fafc40caf40 msgr2=0x7fafc41539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:19.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.935+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 shutdown_connections 2023-10-24T02:03:19.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:19.935+0000 7fafc8e43700 1 -- 172.21.15.148:0/3717050609 wait complete. 2023-10-24T02:03:19.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-24T02:03:20.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.064+0000 7fb5b7779700 1 Processor -- start 2023-10-24T02:03:20.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.064+0000 7fb5b7779700 1 -- start start 2023-10-24T02:03:20.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b7779700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb5b014ffb0 0x7fb5b0153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b7779700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00c64e0 con 0x7fb5b00c4170 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b7779700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b0153960 con 0x7fb5b00c45f0 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b7779700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00c58d0 con 0x7fb5b014ffb0 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b4d14700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fb5b00c4170 0x7fb5b00be570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48458/0 (socket says 172.21.15.148:48458) 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b4d14700 1 -- 172.21.15.148:0/450189382 learned_addr learned my addr 172.21.15.148:0/450189382 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:20.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5b5515700 1 --2- 172.21.15.148:0/450189382 >> v2:172.21.15.150:3300/0 conn(0x7fb5b014ffb0 0x7fb5b0153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969724449 0 0) 0x7fb5b00c64e0 con 0x7fb5b00c4170 2023-10-24T02:03:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.065+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c0033f0 con 0x7fb5b00c4170 2023-10-24T02:03:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560379809 0 0) 0x7fb59c0033f0 con 0x7fb5b00c4170 2023-10-24T02:03:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 >> v2:172.21.15.150:3300/0 conn(0x7fb5b014ffb0 msgr2=0x7fb5b0153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:20.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 --2- 172.21.15.148:0/450189382 >> v2:172.21.15.150:3300/0 conn(0x7fb5b014ffb0 0x7fb5b0153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 >> v1:172.21.15.150:6789/0 conn(0x7fb5b00c45f0 legacy=0x7fb5b00bec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00c5bb0 con 0x7fb5b00c4170 2023-10-24T02:03:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fb5a0001470 con 0x7fb5b00c4170 2023-10-24T02:03:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5515700 1 --2- 172.21.15.148:0/450189382 >> v2:172.21.15.150:3300/0 conn(0x7fb5b014ffb0 0x7fb5b0153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:20.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 >> v1:172.21.15.148:6789/0 conn(0x7fb5b00c4170 legacy=0x7fb5b00be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c0038e0 0x7fb59c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c004690 0x7fb59c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 0x7fb59c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c58d0 con 0x7fb59c005000 2023-10-24T02:03:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c00bf30 con 0x7fb59c004690 2023-10-24T02:03:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c00c0f0 con 0x7fb59c0038e0 2023-10-24T02:03:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 0x7fb59c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b4d14700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c004690 0x7fb59c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5515700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c0038e0 0x7fb59c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 -- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c0038e0 msgr2=0x7fb59c003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c0038e0 0x7fb59c003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 -- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c004690 msgr2=0x7fb59c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c004690 0x7fb59c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 -- 172.21.15.148:0/450189382 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0033f0 con 0x7fb59c005000 2023-10-24T02:03:20.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 -- 172.21.15.148:0/450189382 reap_dead start 2023-10-24T02:03:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.066+0000 7fb5b5d16700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 0x7fb59c00b8e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fb5a8001f20 tx=0x7fb5a8007f10).ready entity=mon.0 client_cookie=eb9a135572721b05 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80017e0 con 0x7fb59c005000 2023-10-24T02:03:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a800c6d0 con 0x7fb59c005000 2023-10-24T02:03:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5a7fff700 1 -- 172.21.15.148:0/450189382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800ca70 con 0x7fb59c005000 2023-10-24T02:03:20.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 -- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 msgr2=0x7fb59c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 0x7fb59c00b8e0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7fb5a8001f20 tx=0x7fb5a8007f10).stop 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 -- 172.21.15.148:0/450189382 shutdown_connections 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 --2- 172.21.15.148:0/450189382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb59c005000 0x7fb59c00b8e0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 -- 172.21.15.148:0/450189382 >> 172.21.15.148:0/450189382 conn(0x7fb5b0092510 msgr2=0x7fb5b0062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 -- 172.21.15.148:0/450189382 shutdown_connections 2023-10-24T02:03:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.067+0000 7fb5b7779700 1 -- 172.21.15.148:0/450189382 wait complete. 2023-10-24T02:03:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.068+0000 7fb5b7779700 1 Processor -- start 2023-10-24T02:03:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.068+0000 7fb5b7779700 1 -- start start 2023-10-24T02:03:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c005000 0x7fb5b00aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b0151850 0x7fb5b0063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00adab0 con 0x7fb5b00abe40 2023-10-24T02:03:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00ac5b0 con 0x7fb5b0151850 2023-10-24T02:03:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b7779700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b0151cb0 con 0x7fb59c005000 2023-10-24T02:03:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b4d14700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b4d14700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38110/0 (socket says 172.21.15.148:38110) 2023-10-24T02:03:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.069+0000 7fb5b4d14700 1 -- 172.21.15.148:0/551616144 learned_addr learned my addr 172.21.15.148:0/551616144 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 -- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c005000 msgr2=0x7fb5b00aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c005000 0x7fb5b00aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 -- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b0151850 msgr2=0x7fb5b0063cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b0151850 0x7fb5b0063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 -- 172.21.15.148:0/551616144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00adce0 con 0x7fb5b00abe40 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b4d14700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fb5a0001c20 tx=0x7fb5b01529f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0000fe0 con 0x7fb5b00abe40 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0011590 con 0x7fb5b00abe40 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00adfc0 con 0x7fb5b00abe40 2023-10-24T02:03:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0011950 con 0x7fb5b00abe40 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.070+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b00ae580 con 0x7fb5b00abe40 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.071+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00ae8f0 con 0x7fb5b00abe40 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.071+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5a0011cc0 con 0x7fb5b00abe40 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.072+0000 7fb5a57fa700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 0x7fb594061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.072+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fb5a00798f0 con 0x7fb5b00abe40 2023-10-24T02:03:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.072+0000 7fb5b5515700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 0x7fb594061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.072+0000 7fb5b5515700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 0x7fb594061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb5ac006f70 tx=0x7fb5ac009060).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.076+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb5a004ac40 con 0x7fb5b00abe40 2023-10-24T02:03:20.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.284+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb5b006c6b0 con 0x7fb5b00abe40 2023-10-24T02:03:20.310 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.309+0000 7fb5a57fa700 1 -- 172.21.15.148:0/551616144 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb5a0019020 con 0x7fb5b00abe40 2023-10-24T02:03:20.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 msgr2=0x7fb594061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 0x7fb594061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb5ac006f70 tx=0x7fb5ac009060).stop 2023-10-24T02:03:20.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 msgr2=0x7fb5b0151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.313 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7fb5a0001c20 tx=0x7fb5b01529f0).stop 2023-10-24T02:03:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 shutdown_connections 2023-10-24T02:03:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fb59405f150 0x7fb594061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5b0151850 0x7fb5b0063cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb59c005000 0x7fb5b00aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:20.314 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 --2- 172.21.15.148:0/551616144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5b00abe40 0x7fb5b0151360 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 >> 172.21.15.148:0/551616144 conn(0x7fb5b0092510 msgr2=0x7fb5b00c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 shutdown_connections 2023-10-24T02:03:20.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.311+0000 7fb5b7779700 1 -- 172.21.15.148:0/551616144 wait complete. 2023-10-24T02:03:20.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-24T02:03:20.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-24T02:03:20.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.440+0000 7fd8c0325700 1 Processor -- start 2023-10-24T02:03:20.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.440+0000 7fd8c0325700 1 -- start start 2023-10-24T02:03:20.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8c0325700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8c0325700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 0x7fd8b80c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8c0325700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80c71d0 con 0x7fd8b8154430 2023-10-24T02:03:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8c0325700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80c6a10 con 0x7fd8b8098bd0 2023-10-24T02:03:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8c0325700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c9410 con 0x7fd8b80bffd0 2023-10-24T02:03:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8bd8c0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8be8c2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 0x7fd8b80c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8bd8c0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:58762/0 (socket says 172.21.15.148:58762) 2023-10-24T02:03:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8be0c1700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd8b8154430 0x7fd8b80c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:44364/0 (socket says 172.21.15.148:44364) 2023-10-24T02:03:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.441+0000 7fd8bd8c0700 1 -- 172.21.15.148:0/1272370312 learned_addr learned my addr 172.21.15.148:0/1272370312 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8be8c2700 1 -- 172.21.15.148:0/1272370312 >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 msgr2=0x7fd8b8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8be8c2700 1 --2- 172.21.15.148:0/1272370312 >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8be8c2700 1 -- 172.21.15.148:0/1272370312 >> v1:172.21.15.150:6789/0 conn(0x7fd8b8154430 legacy=0x7fd8b80c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8bd0bf700 1 -- 172.21.15.148:0/1272370312 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003459358 0 0) 0x7fd8b80c71d0 con 0x7fd8b8154430 2023-10-24T02:03:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8be8c2700 1 -- 172.21.15.148:0/1272370312 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80c0950 con 0x7fd8b80bffd0 2023-10-24T02:03:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8bd8c0700 1 --2- 172.21.15.148:0/1272370312 >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8be8c2700 1 --2- 172.21.15.148:0/1272370312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 0x7fd8b80c0460 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd8b0009e60 tx=0x7fd8b0009780).ready entity=mon.2 client_cookie=8414061f6cedf4fb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8bd0bf700 1 -- 172.21.15.148:0/1272370312 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b000e070 con 0x7fd8b80bffd0 2023-10-24T02:03:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8bd0bf700 1 -- 172.21.15.148:0/1272370312 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000bb60 con 0x7fd8b80bffd0 2023-10-24T02:03:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.442+0000 7fd8bd0bf700 1 -- 172.21.15.148:0/1272370312 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0012410 con 0x7fd8b80bffd0 2023-10-24T02:03:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 -- 172.21.15.148:0/1272370312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 msgr2=0x7fd8b80c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1272370312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 0x7fd8b80c0460 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd8b0009e60 tx=0x7fd8b0009780).stop 2023-10-24T02:03:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 -- 172.21.15.148:0/1272370312 shutdown_connections 2023-10-24T02:03:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1272370312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b80bffd0 0x7fd8b80c0460 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1272370312 >> v2:172.21.15.150:3300/0 conn(0x7fd8b8098bd0 0x7fd8b8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 -- 172.21.15.148:0/1272370312 >> 172.21.15.148:0/1272370312 conn(0x7fd8b80cb070 msgr2=0x7fd8b80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 -- 172.21.15.148:0/1272370312 shutdown_connections 2023-10-24T02:03:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.443+0000 7fd8c0325700 1 -- 172.21.15.148:0/1272370312 wait complete. 2023-10-24T02:03:20.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.444+0000 7fd8c0325700 1 Processor -- start 2023-10-24T02:03:20.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.444+0000 7fd8c0325700 1 -- start start 2023-10-24T02:03:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 0x7fd8b80aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 0x7fd8b80ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b814e5c0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80abc40 con 0x7fd8b80bffd0 2023-10-24T02:03:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80abf20 con 0x7fd8b8154430 2023-10-24T02:03:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38122/0 (socket says 172.21.15.148:38122) 2023-10-24T02:03:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 -- 172.21.15.148:0/1609983650 learned_addr learned my addr 172.21.15.148:0/1609983650 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8bd8c0700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 0x7fd8b80aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be8c2700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 0x7fd8b80ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 -- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 msgr2=0x7fd8b80ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 0x7fd8b80ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 -- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 msgr2=0x7fd8b80aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 0x7fd8b80aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 -- 172.21.15.148:0/1609983650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009370 con 0x7fd8b8098bd0 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8bd8c0700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 0x7fd8b80aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be8c2700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 0x7fd8b80ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8be0c1700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7fd8b400c440 tx=0x7fd8b4007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40070d0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4007230 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0009a20 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40056e0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.445+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b80ac4e0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.446+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b806c6b0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.447+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd8b4005ad0 con 0x7fd8b8098bd0 2023-10-24T02:03:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.447+0000 7fd8ae7fc700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 0x7fd89c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.447+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fd8b4079760 con 0x7fd8b8098bd0 2023-10-24T02:03:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.447+0000 7fd8bd8c0700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 0x7fd89c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.447+0000 7fd8bd8c0700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 0x7fd89c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd8b814fdd0 tx=0x7fd8a80090f0).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.451+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd8b404aa00 con 0x7fd8b8098bd0 2023-10-24T02:03:20.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:20.657+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd8b80acac0 con 0x7fd8b8098bd0 2023-10-24T02:03:21.315 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.313+0000 7fd8ae7fc700 1 -- 172.21.15.148:0/1609983650 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd8b404e020 con 0x7fd8b8098bd0 2023-10-24T02:03:21.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 msgr2=0x7fd89c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.317 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 0x7fd89c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd8b814fdd0 tx=0x7fd8a80090f0).stop 2023-10-24T02:03:21.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 msgr2=0x7fd8b80acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7fd8b400c440 tx=0x7fd8b4007e30).stop 2023-10-24T02:03:21.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 shutdown_connections 2023-10-24T02:03:21.318 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8b8154430 0x7fd8b80ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8b8098bd0 0x7fd8b80acce0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd89c05f150 0x7fd89c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 --2- 172.21.15.148:0/1609983650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8b80bffd0 0x7fd8b80aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.315+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 >> 172.21.15.148:0/1609983650 conn(0x7fd8b80cb070 msgr2=0x7fd8b814fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:21.319 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.316+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 shutdown_connections 2023-10-24T02:03:21.320 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.316+0000 7fd8c0325700 1 -- 172.21.15.148:0/1609983650 wait complete. 2023-10-24T02:03:21.329 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-24T02:03:21.330 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.441+0000 7fa2e8fc1700 1 Processor -- start 2023-10-24T02:03:21.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.441+0000 7fa2e8fc1700 1 -- start start 2023-10-24T02:03:21.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e8fc1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2e40aa010 0x7fa2e40c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e8fc1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa2e40c6710 0x7fa2e40aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e8fc1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40c0960 con 0x7fa2e4158770 2023-10-24T02:03:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e8fc1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40aa8e0 con 0x7fa2e40aa010 2023-10-24T02:03:21.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e8fc1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40c0c40 con 0x7fa2e40c6710 2023-10-24T02:03:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2e40aa010 0x7fa2e40c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e2d9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa2e4158770 0x7fa2e4069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48474/0 (socket says 172.21.15.148:48474) 2023-10-24T02:03:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e259c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa2e40aa010 0x7fa2e40c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38126/0 (socket says 172.21.15.148:38126) 2023-10-24T02:03:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.442+0000 7fa2e2d9d700 1 -- 172.21.15.148:0/1651025940 learned_addr learned my addr 172.21.15.148:0/1651025940 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:21.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2d9d9b700 1 --2- 172.21.15.148:0/1651025940 >> v2:172.21.15.150:3300/0 conn(0x7fa2e40c6710 0x7fa2e40aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e259c700 1 -- 172.21.15.148:0/1651025940 >> v2:172.21.15.150:3300/0 conn(0x7fa2e40c6710 msgr2=0x7fa2e40aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e259c700 1 --2- 172.21.15.148:0/1651025940 >> v2:172.21.15.150:3300/0 conn(0x7fa2e40c6710 0x7fa2e40aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e259c700 1 -- 172.21.15.148:0/1651025940 >> v1:172.21.15.148:6789/0 conn(0x7fa2e4158770 legacy=0x7fa2e4069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e1d9b700 1 -- 172.21.15.148:0/1651025940 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583329564 0 0) 0x7fa2e40c0960 con 0x7fa2e4158770 2023-10-24T02:03:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e259c700 1 -- 172.21.15.148:0/1651025940 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40c0f20 con 0x7fa2e40aa010 2023-10-24T02:03:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e259c700 1 --2- 172.21.15.148:0/1651025940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40aa010 0x7fa2e40c1a00 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fa2e4157d00 tx=0x7fa2d4009060).ready entity=mon.0 client_cookie=16ddfb16b3a7b2c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e1d9b700 1 -- 172.21.15.148:0/1651025940 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400b580 con 0x7fa2e40aa010 2023-10-24T02:03:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e1d9b700 1 -- 172.21.15.148:0/1651025940 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d400b6e0 con 0x7fa2e40aa010 2023-10-24T02:03:21.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e1d9b700 1 -- 172.21.15.148:0/1651025940 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400ba60 con 0x7fa2e40aa010 2023-10-24T02:03:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/1651025940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40aa010 msgr2=0x7fa2e40c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.443+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/1651025940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40aa010 0x7fa2e40c1a00 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fa2e4157d00 tx=0x7fa2d4009060).stop 2023-10-24T02:03:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/1651025940 shutdown_connections 2023-10-24T02:03:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/1651025940 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40aa010 0x7fa2e40c1a00 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/1651025940 >> v2:172.21.15.150:3300/0 conn(0x7fa2e40c6710 0x7fa2e40aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/1651025940 >> 172.21.15.148:0/1651025940 conn(0x7fa2e40caf40 msgr2=0x7fa2e40cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/1651025940 shutdown_connections 2023-10-24T02:03:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.444+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/1651025940 wait complete. 2023-10-24T02:03:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.445+0000 7fa2e8fc1700 1 Processor -- start 2023-10-24T02:03:21.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.445+0000 7fa2e8fc1700 1 -- start start 2023-10-24T02:03:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 0x7fa2e4152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 0x7fa2e40b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b0b30 con 0x7fa2e40c6710 2023-10-24T02:03:21.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40ae5c0 con 0x7fa2e40aa010 2023-10-24T02:03:21.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4156460 con 0x7fa2e4158770 2023-10-24T02:03:21.456 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38138/0 (socket says 172.21.15.148:38138) 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 -- 172.21.15.148:0/170170107 learned_addr learned my addr 172.21.15.148:0/170170107 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e259c700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 0x7fa2e4152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e2d9d700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 0x7fa2e40b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 -- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 msgr2=0x7fa2e40b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 0x7fa2e40b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 -- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 msgr2=0x7fa2e4152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 0x7fa2e4152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 -- 172.21.15.148:0/170170107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40092a0 con 0x7fa2e40c6710 2023-10-24T02:03:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e259c700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 0x7fa2e4152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:21.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e2d9d700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 0x7fa2e40b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:21.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2d9d9b700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fa2cc00d890 tx=0x7fa2cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0125f0 con 0x7fa2e40c6710 2023-10-24T02:03:21.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc012750 con 0x7fa2e40c6710 2023-10-24T02:03:21.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc012ad0 con 0x7fa2e40c6710 2023-10-24T02:03:21.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e40adf70 con 0x7fa2e40c6710 2023-10-24T02:03:21.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.446+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4152830 con 0x7fa2e40c6710 2023-10-24T02:03:21.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.447+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e40ae750 con 0x7fa2e40c6710 2023-10-24T02:03:21.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.448+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa2cc013480 con 0x7fa2e40c6710 2023-10-24T02:03:21.460 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.448+0000 7fa2daffd700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 0x7fa2c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.448+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa2cc079ff0 con 0x7fa2e40c6710 2023-10-24T02:03:21.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.448+0000 7fa2e259c700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 0x7fa2c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.448+0000 7fa2e259c700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 0x7fa2c4061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa2d400b340 tx=0x7fa2d4017000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.461 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.452+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa2cc04b230 con 0x7fa2e40c6710 2023-10-24T02:03:21.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.653+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2e406c6b0 con 0x7fa2e40c6710 2023-10-24T02:03:21.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.654+0000 7fa2daffd700 1 -- 172.21.15.148:0/170170107 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7fa2cc04e850 con 0x7fa2e40c6710 2023-10-24T02:03:21.655 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:21.656 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:21.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 msgr2=0x7fa2c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 0x7fa2c4061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa2d400b340 tx=0x7fa2d4017000).stop 2023-10-24T02:03:21.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 msgr2=0x7fa2e40b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fa2cc00d890 tx=0x7fa2cc008040).stop 2023-10-24T02:03:21.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 shutdown_connections 2023-10-24T02:03:21.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2e4158770 0x7fa2e40b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa2c405f150 0x7fa2c4061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2e40aa010 0x7fa2e4152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 --2- 172.21.15.148:0/170170107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2e40c6710 0x7fa2e40b0150 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 >> 172.21.15.148:0/170170107 conn(0x7fa2e40caf40 msgr2=0x7fa2e40c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:21.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 shutdown_connections 2023-10-24T02:03:21.660 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.655+0000 7fa2e8fc1700 1 -- 172.21.15.148:0/170170107 wait complete. 2023-10-24T02:03:21.660 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:21.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:21.783 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.782+0000 7eff685cd700 1 Processor -- start 2023-10-24T02:03:21.784 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.782+0000 7eff685cd700 1 -- start start 2023-10-24T02:03:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff685cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff600aa010 0x7eff600c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.786 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff685cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff600c6710 0x7eff600aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff685cd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff600c0960 con 0x7eff60158770 2023-10-24T02:03:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff685cd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600aa8e0 con 0x7eff600aa010 2023-10-24T02:03:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff685cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600c0c40 con 0x7eff600c6710 2023-10-24T02:03:21.787 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff600aa010 0x7eff600c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff600aa010 0x7eff600c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38154/0 (socket says 172.21.15.148:38154) 2023-10-24T02:03:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 -- 172.21.15.148:0/3375434230 learned_addr learned my addr 172.21.15.148:0/3375434230 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff65b68700 1 --2- 172.21.15.148:0/3375434230 >> v2:172.21.15.150:3300/0 conn(0x7eff600c6710 0x7eff600aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 -- 172.21.15.148:0/3375434230 >> v2:172.21.15.150:3300/0 conn(0x7eff600c6710 msgr2=0x7eff600aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:21.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 --2- 172.21.15.148:0/3375434230 >> v2:172.21.15.150:3300/0 conn(0x7eff600c6710 0x7eff600aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 -- 172.21.15.148:0/3375434230 >> v1:172.21.15.150:6789/0 conn(0x7eff60158770 legacy=0x7eff60069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.783+0000 7eff66369700 1 -- 172.21.15.148:0/3375434230 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600c0f20 con 0x7eff600aa010 2023-10-24T02:03:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff66369700 1 --2- 172.21.15.148:0/3375434230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff600aa010 0x7eff600c1a00 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7eff60157d00 tx=0x7eff5c0090f0).ready entity=mon.0 client_cookie=ebb291b78232c972 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff65367700 1 -- 172.21.15.148:0/3375434230 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00b600 con 0x7eff600aa010 2023-10-24T02:03:21.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff65367700 1 -- 172.21.15.148:0/3375434230 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00b760 con 0x7eff600aa010 2023-10-24T02:03:21.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff65367700 1 -- 172.21.15.148:0/3375434230 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00bae0 con 0x7eff600aa010 2023-10-24T02:03:21.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 -- 172.21.15.148:0/3375434230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff600aa010 msgr2=0x7eff600c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 --2- 172.21.15.148:0/3375434230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff600aa010 0x7eff600c1a00 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7eff60157d00 tx=0x7eff5c0090f0).stop 2023-10-24T02:03:21.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 -- 172.21.15.148:0/3375434230 shutdown_connections 2023-10-24T02:03:21.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 --2- 172.21.15.148:0/3375434230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff600aa010 0x7eff600c1a00 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 --2- 172.21.15.148:0/3375434230 >> v2:172.21.15.150:3300/0 conn(0x7eff600c6710 0x7eff600aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 -- 172.21.15.148:0/3375434230 >> 172.21.15.148:0/3375434230 conn(0x7eff600caf40 msgr2=0x7eff600cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:21.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 -- 172.21.15.148:0/3375434230 shutdown_connections 2023-10-24T02:03:21.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.784+0000 7eff685cd700 1 -- 172.21.15.148:0/3375434230 wait complete. 2023-10-24T02:03:21.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.785+0000 7eff685cd700 1 Processor -- start 2023-10-24T02:03:21.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.785+0000 7eff685cd700 1 -- start start 2023-10-24T02:03:21.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff600aa010 0x7eff600c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff600c6710 0x7eff600c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600c4030 con 0x7eff60158770 2023-10-24T02:03:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600c36b0 con 0x7eff600aa010 2023-10-24T02:03:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff685cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff600c2aa0 con 0x7eff600c6710 2023-10-24T02:03:21.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff66b6a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff66b6a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38164/0 (socket says 172.21.15.148:38164) 2023-10-24T02:03:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff66b6a700 1 -- 172.21.15.148:0/3474750172 learned_addr learned my addr 172.21.15.148:0/3474750172 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff66369700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff600aa010 0x7eff600c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.786+0000 7eff65b68700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff600c6710 0x7eff600c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 -- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff600c6710 msgr2=0x7eff600c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff600c6710 0x7eff600c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 -- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff600aa010 msgr2=0x7eff600c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff600aa010 0x7eff600c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 -- 172.21.15.148:0/3474750172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009370 con 0x7eff60158770 2023-10-24T02:03:21.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff66b6a700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7eff5800c7c0 tx=0x7eff58001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800e4a0 con 0x7eff60158770 2023-10-24T02:03:21.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5800e600 con 0x7eff60158770 2023-10-24T02:03:21.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff600c2d80 con 0x7eff60158770 2023-10-24T02:03:21.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800e980 con 0x7eff60158770 2023-10-24T02:03:21.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.787+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff600c3340 con 0x7eff60158770 2023-10-24T02:03:21.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.788+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600c3840 con 0x7eff60158770 2023-10-24T02:03:21.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.788+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7eff580123f0 con 0x7eff60158770 2023-10-24T02:03:21.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.788+0000 7eff567fc700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 0x7eff440615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:21.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.789+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7eff58079a10 con 0x7eff60158770 2023-10-24T02:03:21.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.789+0000 7eff66369700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 0x7eff440615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.789+0000 7eff66369700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 0x7eff440615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7eff5c009130 tx=0x7eff5c017000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:21.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.792+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff58047af0 con 0x7eff60158770 2023-10-24T02:03:21.960 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.958+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff60156b40 con 0x7eff60158770 2023-10-24T02:03:21.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.959+0000 7eff567fc700 1 -- 172.21.15.148:0/3474750172 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v216) v1 ==== 74+0+17062 (secure 0 0 0) 0x7eff5804ac50 con 0x7eff60158770 2023-10-24T02:03:21.961 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:21.962 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":216,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:20.308027+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 msgr2=0x7eff440615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 0x7eff440615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7eff5c009130 tx=0x7eff5c017000).stop 2023-10-24T02:03:21.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 msgr2=0x7eff600c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7eff5800c7c0 tx=0x7eff58001510).stop 2023-10-24T02:03:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 shutdown_connections 2023-10-24T02:03:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff60158770 0x7eff600c24d0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff4405f120 0x7eff440615e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff600aa010 0x7eff600c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 --2- 172.21.15.148:0/3474750172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff600c6710 0x7eff600c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:21.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 >> 172.21.15.148:0/3474750172 conn(0x7eff600caf40 msgr2=0x7eff600ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:21.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 shutdown_connections 2023-10-24T02:03:21.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:21.961+0000 7eff685cd700 1 -- 172.21.15.148:0/3474750172 wait complete. 2023-10-24T02:03:21.975 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-24T02:03:21.975 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.087+0000 7f24130cd700 1 Processor -- start 2023-10-24T02:03:22.089 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.087+0000 7f24130cd700 1 -- start start 2023-10-24T02:03:22.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24130cd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f240c0c6710 0x7f240c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24130cd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0aa820 con 0x7f240c0aa3f0 2023-10-24T02:03:22.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24130cd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c0c0960 con 0x7f240c0aa010 2023-10-24T02:03:22.096 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24130cd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0c0c40 con 0x7f240c0c6710 2023-10-24T02:03:22.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f241166a700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f240c0aa3f0 0x7f240c069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48482/0 (socket says 172.21.15.148:48482) 2023-10-24T02:03:22.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f241166a700 1 -- 172.21.15.148:0/2380178753 learned_addr learned my addr 172.21.15.148:0/2380178753 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:22.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f2403fff700 1 --2- 172.21.15.148:0/2380178753 >> v2:172.21.15.150:3300/0 conn(0x7f240c0c6710 0x7f240c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515097444 0 0) 0x7f240c0aa820 con 0x7f240c0aa3f0 2023-10-24T02:03:22.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.088+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f40033f0 con 0x7f240c0aa3f0 2023-10-24T02:03:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901169691 0 0) 0x7f23f40033f0 con 0x7f240c0aa3f0 2023-10-24T02:03:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 >> v2:172.21.15.150:3300/0 conn(0x7f240c0c6710 msgr2=0x7f240c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 --2- 172.21.15.148:0/2380178753 >> v2:172.21.15.150:3300/0 conn(0x7f240c0c6710 0x7f240c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 >> v1:172.21.15.150:6789/0 conn(0x7f240c0aa010 legacy=0x7f240c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0c0f20 con 0x7f240c0aa3f0 2023-10-24T02:03:22.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7f24040017f0 con 0x7f240c0aa3f0 2023-10-24T02:03:22.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 >> v1:172.21.15.148:6789/0 conn(0x7f240c0aa3f0 legacy=0x7f240c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23f40038e0 0x7f23f4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23f4004690 0x7f23f4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f23f400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c0c40 con 0x7f23f4005000 2023-10-24T02:03:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f400bf60 con 0x7f23f40038e0 2023-10-24T02:03:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f400c0f0 con 0x7f23f4004690 2023-10-24T02:03:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f23f400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f2410e69700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23f40038e0 0x7f23f4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f2403fff700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23f4004690 0x7f23f4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 -- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23f4004690 msgr2=0x7f23f4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23f4004690 0x7f23f4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 -- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23f40038e0 msgr2=0x7f23f4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23f40038e0 0x7f23f4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 -- 172.21.15.148:0/2380178753 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40033f0 con 0x7f23f4005000 2023-10-24T02:03:22.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 -- 172.21.15.148:0/2380178753 reap_dead start 2023-10-24T02:03:22.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f241166a700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f23f400b8e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f240400c480 tx=0x7f240400c790).ready entity=mon.0 client_cookie=793124012da2f17e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404002030 con 0x7f23f4005000 2023-10-24T02:03:22.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400ce20 con 0x7f23f4005000 2023-10-24T02:03:22.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.089+0000 7f24037fe700 1 -- 172.21.15.148:0/2380178753 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404005d30 con 0x7f23f4005000 2023-10-24T02:03:22.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 -- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 msgr2=0x7f23f400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f23f400b8e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f240400c480 tx=0x7f240400c790).stop 2023-10-24T02:03:22.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 -- 172.21.15.148:0/2380178753 shutdown_connections 2023-10-24T02:03:22.103 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 --2- 172.21.15.148:0/2380178753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f23f400b8e0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 -- 172.21.15.148:0/2380178753 >> 172.21.15.148:0/2380178753 conn(0x7f240c0caf40 msgr2=0x7f240c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 -- 172.21.15.148:0/2380178753 shutdown_connections 2023-10-24T02:03:22.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.090+0000 7f24130cd700 1 -- 172.21.15.148:0/2380178753 wait complete. 2023-10-24T02:03:22.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.091+0000 7f24130cd700 1 Processor -- start 2023-10-24T02:03:22.104 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.091+0000 7f24130cd700 1 -- start start 2023-10-24T02:03:22.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c147d70 0x7f240c0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f240c0c2e70 0x7f240c164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c165360 con 0x7f23f4005000 2023-10-24T02:03:22.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c164da0 con 0x7f240c147d70 2023-10-24T02:03:22.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f24130cd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c165080 con 0x7f240c0c2e70 2023-10-24T02:03:22.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38180/0 (socket says 172.21.15.148:38180) 2023-10-24T02:03:22.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 -- 172.21.15.148:0/2214327876 learned_addr learned my addr 172.21.15.148:0/2214327876 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2403fff700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c147d70 0x7f240c0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f241166a700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f240c0c2e70 0x7f240c164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 -- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f240c0c2e70 msgr2=0x7f240c164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f240c0c2e70 0x7f240c164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 -- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c147d70 msgr2=0x7f240c0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c147d70 0x7f240c0c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.092+0000 7f2410e69700 1 -- 172.21.15.148:0/2214327876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0c2180 con 0x7f23f4005000 2023-10-24T02:03:22.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f2410e69700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f24080028c0 tx=0x7f2408007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011590 con 0x7f23f4005000 2023-10-24T02:03:22.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24080116f0 con 0x7f23f4005000 2023-10-24T02:03:22.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408011a70 con 0x7f23f4005000 2023-10-24T02:03:22.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0c2460 con 0x7f23f4005000 2023-10-24T02:03:22.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.093+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c151c10 con 0x7f23f4005000 2023-10-24T02:03:22.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.094+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f240801c3b0 con 0x7f23f4005000 2023-10-24T02:03:22.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.094+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c0c1fc0 con 0x7f23f4005000 2023-10-24T02:03:22.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.094+0000 7f2400ff9700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 0x7f23f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.095+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f2408079c60 con 0x7f23f4005000 2023-10-24T02:03:22.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.095+0000 7f2403fff700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 0x7f23f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.095+0000 7f2403fff700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 0x7f23f8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f23fc006d80 tx=0x7f23fc009060).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.099+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f240804aea0 con 0x7f23f4005000 2023-10-24T02:03:22.261 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.260+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f240c06c6b0 con 0x7f23f805f150 2023-10-24T02:03:22.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.270+0000 7f2400ff9700 1 -- 172.21.15.148:0/2214327876 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358732 (secure 0 0 0) 0x7f240c06c6b0 con 0x7f23f805f150 2023-10-24T02:03:22.276 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:22.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 msgr2=0x7f23f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 0x7f23f8061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f23fc006d80 tx=0x7f23fc009060).stop 2023-10-24T02:03:22.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 msgr2=0x7f240c147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7f24080028c0 tx=0x7f2408007bb0).stop 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 shutdown_connections 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f240c0c2e70 0x7f240c164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23f4005000 0x7f240c147880 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f23f805f150 0x7f23f8061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 --2- 172.21.15.148:0/2214327876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f240c147d70 0x7f240c0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.280 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 >> 172.21.15.148:0/2214327876 conn(0x7f240c0caf40 msgr2=0x7f240c152850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 shutdown_connections 2023-10-24T02:03:22.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.274+0000 7f24130cd700 1 -- 172.21.15.148:0/2214327876 wait complete. 2023-10-24T02:03:22.281 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:22.287 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T02:03:22.190551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454924,"kb_used_data":20812,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752519796,"statfs":{"total":773094113280,"available":770580271104,"internally_reserved":0,"allocated":21311488,"data_stored":10882211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28002,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998190"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948730+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960697+0000","last_change":"2023-10-24T02:03:18.960697+0000","last_active":"2023-10-24T02:03:18.960697+0000","last_peered":"2023-10-24T02:03:18.960697+0000","last_clean":"2023-10-24T02:03:18.960697+0000","last_became_active":"2023-10-24T02:03:18.960308+0000","last_became_peered":"2023-10-24T02:03:18.960308+0000","last_unstale":"2023-10-24T02:03:18.960697+0000","last_undegraded":"2023-10-24T02:03:18.960697+0000","last_fullsized":"2023-10-24T02:03:18.960697+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941835+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954224+0000","last_change":"2023-10-24T02:03:18.954224+0000","last_active":"2023-10-24T02:03:18.954224+0000","last_peered":"2023-10-24T02:03:18.954224+0000","last_clean":"2023-10-24T02:03:18.954224+0000","last_became_active":"2023-10-24T02:03:18.953951+0000","last_became_peered":"2023-10-24T02:03:18.953951+0000","last_unstale":"2023-10-24T02:03:18.954224+0000","last_undegraded":"2023-10-24T02:03:18.954224+0000","last_fullsized":"2023-10-24T02:03:18.954224+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946425+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961632+0000","last_change":"2023-10-24T02:03:18.961632+0000","last_active":"2023-10-24T02:03:18.961632+0000","last_peered":"2023-10-24T02:03:18.961632+0000","last_clean":"2023-10-24T02:03:18.961632+0000","last_became_active":"2023-10-24T02:03:18.961285+0000","last_became_peered":"2023-10-24T02:03:18.961285+0000","last_unstale":"2023-10-24T02:03:18.961632+0000","last_undegraded":"2023-10-24T02:03:18.961632+0000","last_fullsized":"2023-10-24T02:03:18.961632+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946211+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.948595+0000","last_change":"2023-10-24T02:03:18.948595+0000","last_active":"2023-10-24T02:03:18.948595+0000","last_peered":"2023-10-24T02:03:18.948595+0000","last_clean":"2023-10-24T02:03:18.948595+0000","last_became_active":"2023-10-24T02:03:18.948274+0000","last_became_peered":"2023-10-24T02:03:18.948274+0000","last_unstale":"2023-10-24T02:03:18.948595+0000","last_undegraded":"2023-10-24T02:03:18.948595+0000","last_fullsized":"2023-10-24T02:03:18.948595+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938439+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954687+0000","last_change":"2023-10-24T02:03:18.954687+0000","last_active":"2023-10-24T02:03:18.954687+0000","last_peered":"2023-10-24T02:03:18.954687+0000","last_clean":"2023-10-24T02:03:18.954687+0000","last_became_active":"2023-10-24T02:03:18.954415+0000","last_became_peered":"2023-10-24T02:03:18.954415+0000","last_unstale":"2023-10-24T02:03:18.954687+0000","last_undegraded":"2023-10-24T02:03:18.954687+0000","last_fullsized":"2023-10-24T02:03:18.954687+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941406+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955738+0000","last_change":"2023-10-24T02:03:18.955738+0000","last_active":"2023-10-24T02:03:18.955738+0000","last_peered":"2023-10-24T02:03:18.955738+0000","last_clean":"2023-10-24T02:03:18.955738+0000","last_became_active":"2023-10-24T02:03:18.955455+0000","last_became_peered":"2023-10-24T02:03:18.955455+0000","last_unstale":"2023-10-24T02:03:18.955738+0000","last_undegraded":"2023-10-24T02:03:18.955738+0000","last_fullsized":"2023-10-24T02:03:18.955738+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942385+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959944+0000","last_change":"2023-10-24T02:03:18.959944+0000","last_active":"2023-10-24T02:03:18.959944+0000","last_peered":"2023-10-24T02:03:18.959944+0000","last_clean":"2023-10-24T02:03:18.959944+0000","last_became_active":"2023-10-24T02:03:18.959611+0000","last_became_peered":"2023-10-24T02:03:18.959611+0000","last_unstale":"2023-10-24T02:03:18.959944+0000","last_undegraded":"2023-10-24T02:03:18.959944+0000","last_fullsized":"2023-10-24T02:03:18.959944+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942291+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950385+0000","last_change":"2023-10-24T02:03:18.950385+0000","last_active":"2023-10-24T02:03:18.950385+0000","last_peered":"2023-10-24T02:03:18.950385+0000","last_clean":"2023-10-24T02:03:18.950385+0000","last_became_active":"2023-10-24T02:03:18.950119+0000","last_became_peered":"2023-10-24T02:03:18.950119+0000","last_unstale":"2023-10-24T02:03:18.950385+0000","last_undegraded":"2023-10-24T02:03:18.950385+0000","last_fullsized":"2023-10-24T02:03:18.950385+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948296+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957027+0000","last_change":"2023-10-24T02:03:18.957027+0000","last_active":"2023-10-24T02:03:18.957027+0000","last_peered":"2023-10-24T02:03:18.957027+0000","last_clean":"2023-10-24T02:03:18.957027+0000","last_became_active":"2023-10-24T02:03:18.956564+0000","last_became_peered":"2023-10-24T02:03:18.956564+0000","last_unstale":"2023-10-24T02:03:18.957027+0000","last_undegraded":"2023-10-24T02:03:18.957027+0000","last_fullsized":"2023-10-24T02:03:18.957027+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.950191+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958302+0000","last_change":"2023-10-24T02:03:18.958302+0000","last_active":"2023-10-24T02:03:18.958302+0000","last_peered":"2023-10-24T02:03:18.958302+0000","last_clean":"2023-10-24T02:03:18.958302+0000","last_became_active":"2023-10-24T02:03:18.956921+0000","last_became_peered":"2023-10-24T02:03:18.956921+0000","last_unstale":"2023-10-24T02:03:18.958302+0000","last_undegraded":"2023-10-24T02:03:18.958302+0000","last_fullsized":"2023-10-24T02:03:18.958302+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942875+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955357+0000","last_change":"2023-10-24T02:03:18.955357+0000","last_active":"2023-10-24T02:03:18.955357+0000","last_peered":"2023-10-24T02:03:18.955357+0000","last_clean":"2023-10-24T02:03:18.955357+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955357+0000","last_undegraded":"2023-10-24T02:03:18.955357+0000","last_fullsized":"2023-10-24T02:03:18.955357+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945804+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953879+0000","last_change":"2023-10-24T02:03:18.953879+0000","last_active":"2023-10-24T02:03:18.953879+0000","last_peered":"2023-10-24T02:03:18.953879+0000","last_clean":"2023-10-24T02:03:18.953879+0000","last_became_active":"2023-10-24T02:03:18.953399+0000","last_became_peered":"2023-10-24T02:03:18.953399+0000","last_unstale":"2023-10-24T02:03:18.953879+0000","last_undegraded":"2023-10-24T02:03:18.953879+0000","last_fullsized":"2023-10-24T02:03:18.953879+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943416+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952773+0000","last_change":"2023-10-24T02:03:18.952773+0000","last_active":"2023-10-24T02:03:18.952773+0000","last_peered":"2023-10-24T02:03:18.952773+0000","last_clean":"2023-10-24T02:03:18.952773+0000","last_became_active":"2023-10-24T02:03:18.952455+0000","last_became_peered":"2023-10-24T02:03:18.952455+0000","last_unstale":"2023-10-24T02:03:18.952773+0000","last_undegraded":"2023-10-24T02:03:18.952773+0000","last_fullsized":"2023-10-24T02:03:18.952773+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946187+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960004+0000","last_became_peered":"2023-10-24T02:03:18.960004+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941468+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953693+0000","last_change":"2023-10-24T02:03:18.953693+0000","last_active":"2023-10-24T02:03:18.953693+0000","last_peered":"2023-10-24T02:03:18.953693+0000","last_clean":"2023-10-24T02:03:18.953693+0000","last_became_active":"2023-10-24T02:03:18.952846+0000","last_became_peered":"2023-10-24T02:03:18.952846+0000","last_unstale":"2023-10-24T02:03:18.953693+0000","last_undegraded":"2023-10-24T02:03:18.953693+0000","last_fullsized":"2023-10-24T02:03:18.953693+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948739+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954593+0000","last_change":"2023-10-24T02:03:18.954593+0000","last_active":"2023-10-24T02:03:18.954593+0000","last_peered":"2023-10-24T02:03:18.954593+0000","last_clean":"2023-10-24T02:03:18.954593+0000","last_became_active":"2023-10-24T02:03:18.954332+0000","last_became_peered":"2023-10-24T02:03:18.954332+0000","last_unstale":"2023-10-24T02:03:18.954593+0000","last_undegraded":"2023-10-24T02:03:18.954593+0000","last_fullsized":"2023-10-24T02:03:18.954593+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943122+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954493+0000","last_change":"2023-10-24T02:03:18.954493+0000","last_active":"2023-10-24T02:03:18.954493+0000","last_peered":"2023-10-24T02:03:18.954493+0000","last_clean":"2023-10-24T02:03:18.954493+0000","last_became_active":"2023-10-24T02:03:18.954206+0000","last_became_peered":"2023-10-24T02:03:18.954206+0000","last_unstale":"2023-10-24T02:03:18.954493+0000","last_undegraded":"2023-10-24T02:03:18.954493+0000","last_fullsized":"2023-10-24T02:03:18.954493+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946639+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960005+0000","last_became_peered":"2023-10-24T02:03:18.960005+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946951+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958037+0000","last_change":"2023-10-24T02:03:18.958037+0000","last_active":"2023-10-24T02:03:18.958037+0000","last_peered":"2023-10-24T02:03:18.958037+0000","last_clean":"2023-10-24T02:03:18.958037+0000","last_became_active":"2023-10-24T02:03:18.957793+0000","last_became_peered":"2023-10-24T02:03:18.957793+0000","last_unstale":"2023-10-24T02:03:18.958037+0000","last_undegraded":"2023-10-24T02:03:18.958037+0000","last_fullsized":"2023-10-24T02:03:18.958037+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941812+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954035+0000","last_change":"2023-10-24T02:03:18.954035+0000","last_active":"2023-10-24T02:03:18.954035+0000","last_peered":"2023-10-24T02:03:18.954035+0000","last_clean":"2023-10-24T02:03:18.954035+0000","last_became_active":"2023-10-24T02:03:18.953757+0000","last_became_peered":"2023-10-24T02:03:18.953757+0000","last_unstale":"2023-10-24T02:03:18.954035+0000","last_undegraded":"2023-10-24T02:03:18.954035+0000","last_fullsized":"2023-10-24T02:03:18.954035+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944117+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953464+0000","last_change":"2023-10-24T02:03:18.953464+0000","last_active":"2023-10-24T02:03:18.953464+0000","last_peered":"2023-10-24T02:03:18.953464+0000","last_clean":"2023-10-24T02:03:18.953464+0000","last_became_active":"2023-10-24T02:03:18.953155+0000","last_became_peered":"2023-10-24T02:03:18.953155+0000","last_unstale":"2023-10-24T02:03:18.953464+0000","last_undegraded":"2023-10-24T02:03:18.953464+0000","last_fullsized":"2023-10-24T02:03:18.953464+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938047+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.964197+0000","last_change":"2023-10-24T02:03:18.964197+0000","last_active":"2023-10-24T02:03:18.964197+0000","last_peered":"2023-10-24T02:03:18.964197+0000","last_clean":"2023-10-24T02:03:18.964197+0000","last_became_active":"2023-10-24T02:03:18.963936+0000","last_became_peered":"2023-10-24T02:03:18.963936+0000","last_unstale":"2023-10-24T02:03:18.964197+0000","last_undegraded":"2023-10-24T02:03:18.964197+0000","last_fullsized":"2023-10-24T02:03:18.964197+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945460+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961462+0000","last_change":"2023-10-24T02:03:18.961462+0000","last_active":"2023-10-24T02:03:18.961462+0000","last_peered":"2023-10-24T02:03:18.961462+0000","last_clean":"2023-10-24T02:03:18.961462+0000","last_became_active":"2023-10-24T02:03:18.961159+0000","last_became_peered":"2023-10-24T02:03:18.961159+0000","last_unstale":"2023-10-24T02:03:18.961462+0000","last_undegraded":"2023-10-24T02:03:18.961462+0000","last_fullsized":"2023-10-24T02:03:18.961462+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945861+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949485+0000","last_change":"2023-10-24T02:03:18.949485+0000","last_active":"2023-10-24T02:03:18.949485+0000","last_peered":"2023-10-24T02:03:18.949485+0000","last_clean":"2023-10-24T02:03:18.949485+0000","last_became_active":"2023-10-24T02:03:18.949208+0000","last_became_peered":"2023-10-24T02:03:18.949208+0000","last_unstale":"2023-10-24T02:03:18.949485+0000","last_undegraded":"2023-10-24T02:03:18.949485+0000","last_fullsized":"2023-10-24T02:03:18.949485+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942309+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957342+0000","last_change":"2023-10-24T02:03:18.957342+0000","last_active":"2023-10-24T02:03:18.957342+0000","last_peered":"2023-10-24T02:03:18.957342+0000","last_clean":"2023-10-24T02:03:18.957342+0000","last_became_active":"2023-10-24T02:03:18.957072+0000","last_became_peered":"2023-10-24T02:03:18.957072+0000","last_unstale":"2023-10-24T02:03:18.957342+0000","last_undegraded":"2023-10-24T02:03:18.957342+0000","last_fullsized":"2023-10-24T02:03:18.957342+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938514+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959865+0000","last_change":"2023-10-24T02:03:18.959865+0000","last_active":"2023-10-24T02:03:18.959865+0000","last_peered":"2023-10-24T02:03:18.959865+0000","last_clean":"2023-10-24T02:03:18.959865+0000","last_became_active":"2023-10-24T02:03:18.959532+0000","last_became_peered":"2023-10-24T02:03:18.959532+0000","last_unstale":"2023-10-24T02:03:18.959865+0000","last_undegraded":"2023-10-24T02:03:18.959865+0000","last_fullsized":"2023-10-24T02:03:18.959865+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948092+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955695+0000","last_change":"2023-10-24T02:03:18.955695+0000","last_active":"2023-10-24T02:03:18.955695+0000","last_peered":"2023-10-24T02:03:18.955695+0000","last_clean":"2023-10-24T02:03:18.955695+0000","last_became_active":"2023-10-24T02:03:18.955414+0000","last_became_peered":"2023-10-24T02:03:18.955414+0000","last_unstale":"2023-10-24T02:03:18.955695+0000","last_undegraded":"2023-10-24T02:03:18.955695+0000","last_fullsized":"2023-10-24T02:03:18.955695+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938989+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960459+0000","last_change":"2023-10-24T02:03:18.960459+0000","last_active":"2023-10-24T02:03:18.960459+0000","last_peered":"2023-10-24T02:03:18.960459+0000","last_clean":"2023-10-24T02:03:18.960459+0000","last_became_active":"2023-10-24T02:03:18.959875+0000","last_became_peered":"2023-10-24T02:03:18.959875+0000","last_unstale":"2023-10-24T02:03:18.960459+0000","last_undegraded":"2023-10-24T02:03:18.960459+0000","last_fullsized":"2023-10-24T02:03:18.960459+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942616+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953320+0000","last_change":"2023-10-24T02:03:18.953320+0000","last_active":"2023-10-24T02:03:18.953320+0000","last_peered":"2023-10-24T02:03:18.953320+0000","last_clean":"2023-10-24T02:03:18.953320+0000","last_became_active":"2023-10-24T02:03:18.953054+0000","last_became_peered":"2023-10-24T02:03:18.953054+0000","last_unstale":"2023-10-24T02:03:18.953320+0000","last_undegraded":"2023-10-24T02:03:18.953320+0000","last_fullsized":"2023-10-24T02:03:18.953320+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938968+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957976+0000","last_change":"2023-10-24T02:03:18.957976+0000","last_active":"2023-10-24T02:03:18.957976+0000","last_peered":"2023-10-24T02:03:18.957976+0000","last_clean":"2023-10-24T02:03:18.957976+0000","last_became_active":"2023-10-24T02:03:18.957677+0000","last_became_peered":"2023-10-24T02:03:18.957677+0000","last_unstale":"2023-10-24T02:03:18.957976+0000","last_undegraded":"2023-10-24T02:03:18.957976+0000","last_fullsized":"2023-10-24T02:03:18.957976+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949317+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956247+0000","last_change":"2023-10-24T02:03:18.956247+0000","last_active":"2023-10-24T02:03:18.956247+0000","last_peered":"2023-10-24T02:03:18.956247+0000","last_clean":"2023-10-24T02:03:18.956247+0000","last_became_active":"2023-10-24T02:03:18.955992+0000","last_became_peered":"2023-10-24T02:03:18.955992+0000","last_unstale":"2023-10-24T02:03:18.956247+0000","last_undegraded":"2023-10-24T02:03:18.956247+0000","last_fullsized":"2023-10-24T02:03:18.956247+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949068+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954814+0000","last_change":"2023-10-24T02:03:18.954814+0000","last_active":"2023-10-24T02:03:18.954814+0000","last_peered":"2023-10-24T02:03:18.954814+0000","last_clean":"2023-10-24T02:03:18.954814+0000","last_became_active":"2023-10-24T02:03:18.954573+0000","last_became_peered":"2023-10-24T02:03:18.954573+0000","last_unstale":"2023-10-24T02:03:18.954814+0000","last_undegraded":"2023-10-24T02:03:18.954814+0000","last_fullsized":"2023-10-24T02:03:18.954814+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938381+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959730+0000","last_change":"2023-10-24T02:03:18.959730+0000","last_active":"2023-10-24T02:03:18.959730+0000","last_peered":"2023-10-24T02:03:18.959730+0000","last_clean":"2023-10-24T02:03:18.959730+0000","last_became_active":"2023-10-24T02:03:18.959495+0000","last_became_peered":"2023-10-24T02:03:18.959495+0000","last_unstale":"2023-10-24T02:03:18.959730+0000","last_undegraded":"2023-10-24T02:03:18.959730+0000","last_fullsized":"2023-10-24T02:03:18.959730+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938966+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960384+0000","last_change":"2023-10-24T02:03:18.960384+0000","last_active":"2023-10-24T02:03:18.960384+0000","last_peered":"2023-10-24T02:03:18.960384+0000","last_clean":"2023-10-24T02:03:18.960384+0000","last_became_active":"2023-10-24T02:03:18.960105+0000","last_became_peered":"2023-10-24T02:03:18.960105+0000","last_unstale":"2023-10-24T02:03:18.960384+0000","last_undegraded":"2023-10-24T02:03:18.960384+0000","last_fullsized":"2023-10-24T02:03:18.960384+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945718+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956077+0000","last_change":"2023-10-24T02:03:18.956077+0000","last_active":"2023-10-24T02:03:18.956077+0000","last_peered":"2023-10-24T02:03:18.956077+0000","last_clean":"2023-10-24T02:03:18.956077+0000","last_became_active":"2023-10-24T02:03:18.955798+0000","last_became_peered":"2023-10-24T02:03:18.955798+0000","last_unstale":"2023-10-24T02:03:18.956077+0000","last_undegraded":"2023-10-24T02:03:18.956077+0000","last_fullsized":"2023-10-24T02:03:18.956077+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942879+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957635+0000","last_change":"2023-10-24T02:03:18.957635+0000","last_active":"2023-10-24T02:03:18.957635+0000","last_peered":"2023-10-24T02:03:18.957635+0000","last_clean":"2023-10-24T02:03:18.957635+0000","last_became_active":"2023-10-24T02:03:18.957339+0000","last_became_peered":"2023-10-24T02:03:18.957339+0000","last_unstale":"2023-10-24T02:03:18.957635+0000","last_undegraded":"2023-10-24T02:03:18.957635+0000","last_fullsized":"2023-10-24T02:03:18.957635+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939720+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958287+0000","last_change":"2023-10-24T02:03:18.958287+0000","last_active":"2023-10-24T02:03:18.958287+0000","last_peered":"2023-10-24T02:03:18.958287+0000","last_clean":"2023-10-24T02:03:18.958287+0000","last_became_active":"2023-10-24T02:03:18.958012+0000","last_became_peered":"2023-10-24T02:03:18.958012+0000","last_unstale":"2023-10-24T02:03:18.958287+0000","last_undegraded":"2023-10-24T02:03:18.958287+0000","last_fullsized":"2023-10-24T02:03:18.958287+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938394+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961603+0000","last_change":"2023-10-24T02:03:18.961603+0000","last_active":"2023-10-24T02:03:18.961603+0000","last_peered":"2023-10-24T02:03:18.961603+0000","last_clean":"2023-10-24T02:03:18.961603+0000","last_became_active":"2023-10-24T02:03:18.961258+0000","last_became_peered":"2023-10-24T02:03:18.961258+0000","last_unstale":"2023-10-24T02:03:18.961603+0000","last_undegraded":"2023-10-24T02:03:18.961603+0000","last_fullsized":"2023-10-24T02:03:18.961603+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945329+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956207+0000","last_change":"2023-10-24T02:03:18.956207+0000","last_active":"2023-10-24T02:03:18.956207+0000","last_peered":"2023-10-24T02:03:18.956207+0000","last_clean":"2023-10-24T02:03:18.956207+0000","last_became_active":"2023-10-24T02:03:18.955935+0000","last_became_peered":"2023-10-24T02:03:18.955935+0000","last_unstale":"2023-10-24T02:03:18.956207+0000","last_undegraded":"2023-10-24T02:03:18.956207+0000","last_fullsized":"2023-10-24T02:03:18.956207+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945982+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959527+0000","last_change":"2023-10-24T02:03:18.959527+0000","last_active":"2023-10-24T02:03:18.959527+0000","last_peered":"2023-10-24T02:03:18.959527+0000","last_clean":"2023-10-24T02:03:18.959527+0000","last_became_active":"2023-10-24T02:03:18.959259+0000","last_became_peered":"2023-10-24T02:03:18.959259+0000","last_unstale":"2023-10-24T02:03:18.959527+0000","last_undegraded":"2023-10-24T02:03:18.959527+0000","last_fullsized":"2023-10-24T02:03:18.959527+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940348+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960234+0000","last_change":"2023-10-24T02:03:18.960234+0000","last_active":"2023-10-24T02:03:18.960234+0000","last_peered":"2023-10-24T02:03:18.960234+0000","last_clean":"2023-10-24T02:03:18.960234+0000","last_became_active":"2023-10-24T02:03:18.959668+0000","last_became_peered":"2023-10-24T02:03:18.959668+0000","last_unstale":"2023-10-24T02:03:18.960234+0000","last_undegraded":"2023-10-24T02:03:18.960234+0000","last_fullsized":"2023-10-24T02:03:18.960234+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938338+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957158+0000","last_change":"2023-10-24T02:03:18.957158+0000","last_active":"2023-10-24T02:03:18.957158+0000","last_peered":"2023-10-24T02:03:18.957158+0000","last_clean":"2023-10-24T02:03:18.957158+0000","last_became_active":"2023-10-24T02:03:18.956881+0000","last_became_peered":"2023-10-24T02:03:18.956881+0000","last_unstale":"2023-10-24T02:03:18.957158+0000","last_undegraded":"2023-10-24T02:03:18.957158+0000","last_fullsized":"2023-10-24T02:03:18.957158+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947708+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952051+0000","last_change":"2023-10-24T02:03:18.952051+0000","last_active":"2023-10-24T02:03:18.952051+0000","last_peered":"2023-10-24T02:03:18.952051+0000","last_clean":"2023-10-24T02:03:18.952051+0000","last_became_active":"2023-10-24T02:03:18.951753+0000","last_became_peered":"2023-10-24T02:03:18.951753+0000","last_unstale":"2023-10-24T02:03:18.952051+0000","last_undegraded":"2023-10-24T02:03:18.952051+0000","last_fullsized":"2023-10-24T02:03:18.952051+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942314+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956970+0000","last_change":"2023-10-24T02:03:18.956970+0000","last_active":"2023-10-24T02:03:18.956970+0000","last_peered":"2023-10-24T02:03:18.956970+0000","last_clean":"2023-10-24T02:03:18.956970+0000","last_became_active":"2023-10-24T02:03:18.956541+0000","last_became_peered":"2023-10-24T02:03:18.956541+0000","last_unstale":"2023-10-24T02:03:18.956970+0000","last_undegraded":"2023-10-24T02:03:18.956970+0000","last_fullsized":"2023-10-24T02:03:18.956970+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942012+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955188+0000","last_change":"2023-10-24T02:03:18.955188+0000","last_active":"2023-10-24T02:03:18.955188+0000","last_peered":"2023-10-24T02:03:18.955188+0000","last_clean":"2023-10-24T02:03:18.955188+0000","last_became_active":"2023-10-24T02:03:18.954463+0000","last_became_peered":"2023-10-24T02:03:18.954463+0000","last_unstale":"2023-10-24T02:03:18.955188+0000","last_undegraded":"2023-10-24T02:03:18.955188+0000","last_fullsized":"2023-10-24T02:03:18.955188+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946373+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958952+0000","last_change":"2023-10-24T02:03:18.958952+0000","last_active":"2023-10-24T02:03:18.958952+0000","last_peered":"2023-10-24T02:03:18.958952+0000","last_clean":"2023-10-24T02:03:18.958952+0000","last_became_active":"2023-10-24T02:03:18.958614+0000","last_became_peered":"2023-10-24T02:03:18.958614+0000","last_unstale":"2023-10-24T02:03:18.958952+0000","last_undegraded":"2023-10-24T02:03:18.958952+0000","last_fullsized":"2023-10-24T02:03:18.958952+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.951289+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949597+0000","last_change":"2023-10-24T02:03:18.949597+0000","last_active":"2023-10-24T02:03:18.949597+0000","last_peered":"2023-10-24T02:03:18.949597+0000","last_clean":"2023-10-24T02:03:18.949597+0000","last_became_active":"2023-10-24T02:03:18.949301+0000","last_became_peered":"2023-10-24T02:03:18.949301+0000","last_unstale":"2023-10-24T02:03:18.949597+0000","last_undegraded":"2023-10-24T02:03:18.949597+0000","last_fullsized":"2023-10-24T02:03:18.949597+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938339+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953286+0000","last_change":"2023-10-24T02:03:18.953286+0000","last_active":"2023-10-24T02:03:18.953286+0000","last_peered":"2023-10-24T02:03:18.953286+0000","last_clean":"2023-10-24T02:03:18.953286+0000","last_became_active":"2023-10-24T02:03:18.952922+0000","last_became_peered":"2023-10-24T02:03:18.952922+0000","last_unstale":"2023-10-24T02:03:18.953286+0000","last_undegraded":"2023-10-24T02:03:18.953286+0000","last_fullsized":"2023-10-24T02:03:18.953286+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940728+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955515+0000","last_change":"2023-10-24T02:03:18.955515+0000","last_active":"2023-10-24T02:03:18.955515+0000","last_peered":"2023-10-24T02:03:18.955515+0000","last_clean":"2023-10-24T02:03:18.955515+0000","last_became_active":"2023-10-24T02:03:18.955154+0000","last_became_peered":"2023-10-24T02:03:18.955154+0000","last_unstale":"2023-10-24T02:03:18.955515+0000","last_undegraded":"2023-10-24T02:03:18.955515+0000","last_fullsized":"2023-10-24T02:03:18.955515+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942181+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950142+0000","last_change":"2023-10-24T02:03:18.950142+0000","last_active":"2023-10-24T02:03:18.950142+0000","last_peered":"2023-10-24T02:03:18.950142+0000","last_clean":"2023-10-24T02:03:18.950142+0000","last_became_active":"2023-10-24T02:03:18.949874+0000","last_became_peered":"2023-10-24T02:03:18.949874+0000","last_unstale":"2023-10-24T02:03:18.950142+0000","last_undegraded":"2023-10-24T02:03:18.950142+0000","last_fullsized":"2023-10-24T02:03:18.950142+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938512+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959033+0000","last_change":"2023-10-24T02:03:18.959033+0000","last_active":"2023-10-24T02:03:18.959033+0000","last_peered":"2023-10-24T02:03:18.959033+0000","last_clean":"2023-10-24T02:03:18.959033+0000","last_became_active":"2023-10-24T02:03:18.958731+0000","last_became_peered":"2023-10-24T02:03:18.958731+0000","last_unstale":"2023-10-24T02:03:18.959033+0000","last_undegraded":"2023-10-24T02:03:18.959033+0000","last_fullsized":"2023-10-24T02:03:18.959033+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939401+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.951834+0000","last_change":"2023-10-24T02:03:18.951834+0000","last_active":"2023-10-24T02:03:18.951834+0000","last_peered":"2023-10-24T02:03:18.951834+0000","last_clean":"2023-10-24T02:03:18.951834+0000","last_became_active":"2023-10-24T02:03:18.949164+0000","last_became_peered":"2023-10-24T02:03:18.949164+0000","last_unstale":"2023-10-24T02:03:18.951834+0000","last_undegraded":"2023-10-24T02:03:18.951834+0000","last_fullsized":"2023-10-24T02:03:18.951834+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942937+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950503+0000","last_change":"2023-10-24T02:03:18.950503+0000","last_active":"2023-10-24T02:03:18.950503+0000","last_peered":"2023-10-24T02:03:18.950503+0000","last_clean":"2023-10-24T02:03:18.950503+0000","last_became_active":"2023-10-24T02:03:18.950174+0000","last_became_peered":"2023-10-24T02:03:18.950174+0000","last_unstale":"2023-10-24T02:03:18.950503+0000","last_undegraded":"2023-10-24T02:03:18.950503+0000","last_fullsized":"2023-10-24T02:03:18.950503+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.947343+0000","last_change":"2023-10-24T02:03:18.947343+0000","last_active":"2023-10-24T02:03:18.947343+0000","last_peered":"2023-10-24T02:03:18.947343+0000","last_clean":"2023-10-24T02:03:18.947343+0000","last_became_active":"2023-10-24T02:03:18.947006+0000","last_became_peered":"2023-10-24T02:03:18.947006+0000","last_unstale":"2023-10-24T02:03:18.947343+0000","last_undegraded":"2023-10-24T02:03:18.947343+0000","last_fullsized":"2023-10-24T02:03:18.947343+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944473+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953817+0000","last_change":"2023-10-24T02:03:18.953817+0000","last_active":"2023-10-24T02:03:18.953817+0000","last_peered":"2023-10-24T02:03:18.953817+0000","last_clean":"2023-10-24T02:03:18.953817+0000","last_became_active":"2023-10-24T02:03:18.953457+0000","last_became_peered":"2023-10-24T02:03:18.953457+0000","last_unstale":"2023-10-24T02:03:18.953817+0000","last_undegraded":"2023-10-24T02:03:18.953817+0000","last_fullsized":"2023-10-24T02:03:18.953817+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938138+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954146+0000","last_change":"2023-10-24T02:03:18.954146+0000","last_active":"2023-10-24T02:03:18.954146+0000","last_peered":"2023-10-24T02:03:18.954146+0000","last_clean":"2023-10-24T02:03:18.954146+0000","last_became_active":"2023-10-24T02:03:18.953805+0000","last_became_peered":"2023-10-24T02:03:18.953805+0000","last_unstale":"2023-10-24T02:03:18.954146+0000","last_undegraded":"2023-10-24T02:03:18.954146+0000","last_fullsized":"2023-10-24T02:03:18.954146+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956705+0000","last_change":"2023-10-24T02:03:18.956705+0000","last_active":"2023-10-24T02:03:18.956705+0000","last_peered":"2023-10-24T02:03:18.956705+0000","last_clean":"2023-10-24T02:03:18.956705+0000","last_became_active":"2023-10-24T02:03:18.956408+0000","last_became_peered":"2023-10-24T02:03:18.956408+0000","last_unstale":"2023-10-24T02:03:18.956705+0000","last_undegraded":"2023-10-24T02:03:18.956705+0000","last_fullsized":"2023-10-24T02:03:18.956705+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931186+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:17.931186+0000","last_peered":"2023-10-24T02:03:17.931186+0000","last_clean":"2023-10-24T02:03:17.931186+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:17.931186+0000","last_undegraded":"2023-10-24T02:03:17.931186+0000","last_fullsized":"2023-10-24T02:03:17.931186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944922+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957336+0000","last_change":"2023-10-24T02:03:18.957336+0000","last_active":"2023-10-24T02:03:18.957336+0000","last_peered":"2023-10-24T02:03:18.957336+0000","last_clean":"2023-10-24T02:03:18.957336+0000","last_became_active":"2023-10-24T02:03:18.957093+0000","last_became_peered":"2023-10-24T02:03:18.957093+0000","last_unstale":"2023-10-24T02:03:18.957336+0000","last_undegraded":"2023-10-24T02:03:18.957336+0000","last_fullsized":"2023-10-24T02:03:18.957336+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.937664+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:17.937664+0000","last_peered":"2023-10-24T02:03:17.937664+0000","last_clean":"2023-10-24T02:03:17.937664+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:17.937664+0000","last_undegraded":"2023-10-24T02:03:17.937664+0000","last_fullsized":"2023-10-24T02:03:17.937664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943642+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.963798+0000","last_change":"2023-10-24T02:03:18.963798+0000","last_active":"2023-10-24T02:03:18.963798+0000","last_peered":"2023-10-24T02:03:18.963798+0000","last_clean":"2023-10-24T02:03:18.963798+0000","last_became_active":"2023-10-24T02:03:18.963483+0000","last_became_peered":"2023-10-24T02:03:18.963483+0000","last_unstale":"2023-10-24T02:03:18.963798+0000","last_undegraded":"2023-10-24T02:03:18.963798+0000","last_fullsized":"2023-10-24T02:03:18.963798+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.938872+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:17.938872+0000","last_peered":"2023-10-24T02:03:17.938872+0000","last_clean":"2023-10-24T02:03:17.938872+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:17.938872+0000","last_undegraded":"2023-10-24T02:03:17.938872+0000","last_fullsized":"2023-10-24T02:03:17.938872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943235+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957250+0000","last_change":"2023-10-24T02:03:18.957250+0000","last_active":"2023-10-24T02:03:18.957250+0000","last_peered":"2023-10-24T02:03:18.957250+0000","last_clean":"2023-10-24T02:03:18.957250+0000","last_became_active":"2023-10-24T02:03:18.957017+0000","last_became_peered":"2023-10-24T02:03:18.957017+0000","last_unstale":"2023-10-24T02:03:18.957250+0000","last_undegraded":"2023-10-24T02:03:18.957250+0000","last_fullsized":"2023-10-24T02:03:18.957250+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.936331+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:17.936331+0000","last_peered":"2023-10-24T02:03:17.936331+0000","last_clean":"2023-10-24T02:03:17.936331+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:17.936331+0000","last_undegraded":"2023-10-24T02:03:17.936331+0000","last_fullsized":"2023-10-24T02:03:17.936331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":207,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933701+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:17.933701+0000","last_peered":"2023-10-24T02:03:17.933701+0000","last_clean":"2023-10-24T02:03:17.933701+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:17.933701+0000","last_undegraded":"2023-10-24T02:03:17.933701+0000","last_fullsized":"2023-10-24T02:03:17.933701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947175+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954457+0000","last_change":"2023-10-24T02:03:18.954457+0000","last_active":"2023-10-24T02:03:18.954457+0000","last_peered":"2023-10-24T02:03:18.954457+0000","last_clean":"2023-10-24T02:03:18.954457+0000","last_became_active":"2023-10-24T02:03:18.954148+0000","last_became_peered":"2023-10-24T02:03:18.954148+0000","last_unstale":"2023-10-24T02:03:18.954457+0000","last_undegraded":"2023-10-24T02:03:18.954457+0000","last_fullsized":"2023-10-24T02:03:18.954457+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933781+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:17.933781+0000","last_peered":"2023-10-24T02:03:17.933781+0000","last_clean":"2023-10-24T02:03:17.933781+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:17.933781+0000","last_undegraded":"2023-10-24T02:03:17.933781+0000","last_fullsized":"2023-10-24T02:03:17.933781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938761+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958703+0000","last_change":"2023-10-24T02:03:18.958703+0000","last_active":"2023-10-24T02:03:18.958703+0000","last_peered":"2023-10-24T02:03:18.958703+0000","last_clean":"2023-10-24T02:03:18.958703+0000","last_became_active":"2023-10-24T02:03:18.958421+0000","last_became_peered":"2023-10-24T02:03:18.958421+0000","last_unstale":"2023-10-24T02:03:18.958703+0000","last_undegraded":"2023-10-24T02:03:18.958703+0000","last_fullsized":"2023-10-24T02:03:18.958703+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934171+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:17.934171+0000","last_peered":"2023-10-24T02:03:17.934171+0000","last_clean":"2023-10-24T02:03:17.934171+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:17.934171+0000","last_undegraded":"2023-10-24T02:03:17.934171+0000","last_fullsized":"2023-10-24T02:03:17.934171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944811+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961237+0000","last_change":"2023-10-24T02:03:18.961237+0000","last_active":"2023-10-24T02:03:18.961237+0000","last_peered":"2023-10-24T02:03:18.961237+0000","last_clean":"2023-10-24T02:03:18.961237+0000","last_became_active":"2023-10-24T02:03:18.960957+0000","last_became_peered":"2023-10-24T02:03:18.960957+0000","last_unstale":"2023-10-24T02:03:18.961237+0000","last_undegraded":"2023-10-24T02:03:18.961237+0000","last_fullsized":"2023-10-24T02:03:18.961237+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931161+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:17.931161+0000","last_peered":"2023-10-24T02:03:17.931161+0000","last_clean":"2023-10-24T02:03:17.931161+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:17.931161+0000","last_undegraded":"2023-10-24T02:03:17.931161+0000","last_fullsized":"2023-10-24T02:03:17.931161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942958+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955078+0000","last_change":"2023-10-24T02:03:18.955078+0000","last_active":"2023-10-24T02:03:18.955078+0000","last_peered":"2023-10-24T02:03:18.955078+0000","last_clean":"2023-10-24T02:03:18.955078+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955078+0000","last_undegraded":"2023-10-24T02:03:18.955078+0000","last_fullsized":"2023-10-24T02:03:18.955078+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934801+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:17.934801+0000","last_peered":"2023-10-24T02:03:17.934801+0000","last_clean":"2023-10-24T02:03:17.934801+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:17.934801+0000","last_undegraded":"2023-10-24T02:03:17.934801+0000","last_fullsized":"2023-10-24T02:03:17.934801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2674688,"data_stored":1366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.50600000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575976,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.502}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46500000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.26000000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.627},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.435},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61599999999999999,"15min":0.67600000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.438}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.57999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.35899999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.31}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60999999999999999,"15min":0.752},"last":0.24199999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":0.52100000000000002,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.64600000000000002},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.499,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54100000000000004,"5min":0.63,"15min":0.72799999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":1.097},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.88600000000000001,"15min":1.167},"last":0.34100000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":1.056},"last":0.505},{"interface":"front","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.88500000000000001,"15min":1.109},"last":0.36399999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.91700000000000004,"15min":1.083},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.437,"15min":0.437},"max":{"1min":0.81599999999999995,"5min":0.92600000000000005,"15min":1.155},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.441},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.433}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.49399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.36499999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:22.295 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:22.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.438+0000 7f5e4ab9d700 1 Processor -- start 2023-10-24T02:03:22.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.439+0000 7f5e4ab9d700 1 -- start start 2023-10-24T02:03:22.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.439+0000 7f5e4ab9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e440a7ef0 0x7f5e440be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.439+0000 7f5e4ab9d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c42a0 con 0x7f5e440c8140 2023-10-24T02:03:22.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.439+0000 7f5e4ab9d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c3cc0 con 0x7f5e440a82d0 2023-10-24T02:03:22.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.439+0000 7f5e4ab9d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e44152300 con 0x7f5e440a7ef0 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e440a7ef0 0x7f5e440be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f5e440a7ef0 0x7f5e440be550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38182/0 (socket says 172.21.15.148:38182) 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e4a39c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f5e440c8140 0x7f5e440c4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48492/0 (socket says 172.21.15.148:48492) 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 -- 172.21.15.148:0/4247237189 learned_addr learned my addr 172.21.15.148:0/4247237189 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 -- 172.21.15.148:0/4247237189 >> v1:172.21.15.150:6789/0 conn(0x7f5e440a82d0 legacy=0x7f5e440c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 -- 172.21.15.148:0/4247237189 >> v1:172.21.15.148:6789/0 conn(0x7f5e440c8140 legacy=0x7f5e440c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 -- 172.21.15.148:0/4247237189 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440c86b0 con 0x7f5e440a7ef0 2023-10-24T02:03:22.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e48b99700 1 -- 172.21.15.148:0/4247237189 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430229358 0 0) 0x7f5e440c42a0 con 0x7f5e440c8140 2023-10-24T02:03:22.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e49b9b700 1 --2- 172.21.15.148:0/4247237189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440a7ef0 0x7f5e440be550 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f5e40009f20 tx=0x7f5e40009840).ready entity=mon.0 client_cookie=43d065103df5b2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e48b99700 1 -- 172.21.15.148:0/4247237189 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000e070 con 0x7f5e440a7ef0 2023-10-24T02:03:22.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e48b99700 1 -- 172.21.15.148:0/4247237189 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000ba40 con 0x7f5e440a7ef0 2023-10-24T02:03:22.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.440+0000 7f5e48b99700 1 -- 172.21.15.148:0/4247237189 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000bdc0 con 0x7f5e440a7ef0 2023-10-24T02:03:22.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/4247237189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440a7ef0 msgr2=0x7f5e440be550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/4247237189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440a7ef0 0x7f5e440be550 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f5e40009f20 tx=0x7f5e40009840).stop 2023-10-24T02:03:22.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/4247237189 shutdown_connections 2023-10-24T02:03:22.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/4247237189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440a7ef0 0x7f5e440be550 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/4247237189 >> 172.21.15.148:0/4247237189 conn(0x7f5e440922e0 msgr2=0x7f5e44062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/4247237189 shutdown_connections 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.441+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/4247237189 wait complete. 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.442+0000 7f5e4ab9d700 1 Processor -- start 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.442+0000 7f5e4ab9d700 1 -- start start 2023-10-24T02:03:22.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e440a7ef0 0x7f5e44145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 0x7f5e44164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44063760 con 0x7f5e440c8140 2023-10-24T02:03:22.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44063d20 con 0x7f5e440a82d0 2023-10-24T02:03:22.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e44165640 con 0x7f5e440a7ef0 2023-10-24T02:03:22.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38196/0 (socket says 172.21.15.148:38196) 2023-10-24T02:03:22.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 -- 172.21.15.148:0/2885863651 learned_addr learned my addr 172.21.15.148:0/2885863651 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:22.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e49b9b700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e440a7ef0 0x7f5e44145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4939a700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 0x7f5e44164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 -- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e440a7ef0 msgr2=0x7f5e44145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e440a7ef0 0x7f5e44145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 -- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 msgr2=0x7f5e44164ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 0x7f5e44164ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 -- 172.21.15.148:0/2885863651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40009ae0 con 0x7f5e440c8140 2023-10-24T02:03:22.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4939a700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 0x7f5e44164ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4a39c700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f5e3c00c4c0 tx=0x7f5e3c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00ce60 con 0x7f5e440c8140 2023-10-24T02:03:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0072e0 con 0x7f5e440c8140 2023-10-24T02:03:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e44165920 con 0x7f5e440c8140 2023-10-24T02:03:22.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.443+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0056e0 con 0x7f5e440c8140 2023-10-24T02:03:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.444+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e441461c0 con 0x7f5e440c8140 2023-10-24T02:03:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.445+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e44063eb0 con 0x7f5e440c8140 2023-10-24T02:03:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.445+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e3c005a90 con 0x7f5e440c8140 2023-10-24T02:03:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.445+0000 7f5e39ffb700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 0x7f5e280615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.445+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f5e3c0798b0 con 0x7f5e440c8140 2023-10-24T02:03:22.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.445+0000 7f5e49b9b700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 0x7f5e280615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.446+0000 7f5e49b9b700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 0x7f5e280615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5e4000c010 tx=0x7f5e40009840).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.449+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5e3c04ab50 con 0x7f5e440c8140 2023-10-24T02:03:22.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.608+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e44047480 con 0x7f5e2805f120 2023-10-24T02:03:22.619 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.618+0000 7f5e39ffb700 1 -- 172.21.15.148:0/2885863651 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358732 (secure 0 0 0) 0x7f5e44047480 con 0x7f5e2805f120 2023-10-24T02:03:22.623 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:22.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 msgr2=0x7f5e280615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 0x7f5e280615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5e4000c010 tx=0x7f5e40009840).stop 2023-10-24T02:03:22.626 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 msgr2=0x7f5e44165090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f5e3c00c4c0 tx=0x7f5e3c007dc0).stop 2023-10-24T02:03:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 shutdown_connections 2023-10-24T02:03:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e440c8140 0x7f5e44165090 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e440a7ef0 0x7f5e44145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.627 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f5e2805f120 0x7f5e280615e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 --2- 172.21.15.148:0/2885863651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e440a82d0 0x7f5e44164ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 >> 172.21.15.148:0/2885863651 conn(0x7f5e440922e0 msgr2=0x7f5e440a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 shutdown_connections 2023-10-24T02:03:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.621+0000 7f5e4ab9d700 1 -- 172.21.15.148:0/2885863651 wait complete. 2023-10-24T02:03:22.628 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:22.635 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T02:03:22.190551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454924,"kb_used_data":20812,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752519796,"statfs":{"total":773094113280,"available":770580271104,"internally_reserved":0,"allocated":21311488,"data_stored":10882211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28002,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998190"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948730+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960697+0000","last_change":"2023-10-24T02:03:18.960697+0000","last_active":"2023-10-24T02:03:18.960697+0000","last_peered":"2023-10-24T02:03:18.960697+0000","last_clean":"2023-10-24T02:03:18.960697+0000","last_became_active":"2023-10-24T02:03:18.960308+0000","last_became_peered":"2023-10-24T02:03:18.960308+0000","last_unstale":"2023-10-24T02:03:18.960697+0000","last_undegraded":"2023-10-24T02:03:18.960697+0000","last_fullsized":"2023-10-24T02:03:18.960697+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941835+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954224+0000","last_change":"2023-10-24T02:03:18.954224+0000","last_active":"2023-10-24T02:03:18.954224+0000","last_peered":"2023-10-24T02:03:18.954224+0000","last_clean":"2023-10-24T02:03:18.954224+0000","last_became_active":"2023-10-24T02:03:18.953951+0000","last_became_peered":"2023-10-24T02:03:18.953951+0000","last_unstale":"2023-10-24T02:03:18.954224+0000","last_undegraded":"2023-10-24T02:03:18.954224+0000","last_fullsized":"2023-10-24T02:03:18.954224+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946425+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961632+0000","last_change":"2023-10-24T02:03:18.961632+0000","last_active":"2023-10-24T02:03:18.961632+0000","last_peered":"2023-10-24T02:03:18.961632+0000","last_clean":"2023-10-24T02:03:18.961632+0000","last_became_active":"2023-10-24T02:03:18.961285+0000","last_became_peered":"2023-10-24T02:03:18.961285+0000","last_unstale":"2023-10-24T02:03:18.961632+0000","last_undegraded":"2023-10-24T02:03:18.961632+0000","last_fullsized":"2023-10-24T02:03:18.961632+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946211+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.948595+0000","last_change":"2023-10-24T02:03:18.948595+0000","last_active":"2023-10-24T02:03:18.948595+0000","last_peered":"2023-10-24T02:03:18.948595+0000","last_clean":"2023-10-24T02:03:18.948595+0000","last_became_active":"2023-10-24T02:03:18.948274+0000","last_became_peered":"2023-10-24T02:03:18.948274+0000","last_unstale":"2023-10-24T02:03:18.948595+0000","last_undegraded":"2023-10-24T02:03:18.948595+0000","last_fullsized":"2023-10-24T02:03:18.948595+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938439+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954687+0000","last_change":"2023-10-24T02:03:18.954687+0000","last_active":"2023-10-24T02:03:18.954687+0000","last_peered":"2023-10-24T02:03:18.954687+0000","last_clean":"2023-10-24T02:03:18.954687+0000","last_became_active":"2023-10-24T02:03:18.954415+0000","last_became_peered":"2023-10-24T02:03:18.954415+0000","last_unstale":"2023-10-24T02:03:18.954687+0000","last_undegraded":"2023-10-24T02:03:18.954687+0000","last_fullsized":"2023-10-24T02:03:18.954687+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941406+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955738+0000","last_change":"2023-10-24T02:03:18.955738+0000","last_active":"2023-10-24T02:03:18.955738+0000","last_peered":"2023-10-24T02:03:18.955738+0000","last_clean":"2023-10-24T02:03:18.955738+0000","last_became_active":"2023-10-24T02:03:18.955455+0000","last_became_peered":"2023-10-24T02:03:18.955455+0000","last_unstale":"2023-10-24T02:03:18.955738+0000","last_undegraded":"2023-10-24T02:03:18.955738+0000","last_fullsized":"2023-10-24T02:03:18.955738+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942385+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959944+0000","last_change":"2023-10-24T02:03:18.959944+0000","last_active":"2023-10-24T02:03:18.959944+0000","last_peered":"2023-10-24T02:03:18.959944+0000","last_clean":"2023-10-24T02:03:18.959944+0000","last_became_active":"2023-10-24T02:03:18.959611+0000","last_became_peered":"2023-10-24T02:03:18.959611+0000","last_unstale":"2023-10-24T02:03:18.959944+0000","last_undegraded":"2023-10-24T02:03:18.959944+0000","last_fullsized":"2023-10-24T02:03:18.959944+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942291+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950385+0000","last_change":"2023-10-24T02:03:18.950385+0000","last_active":"2023-10-24T02:03:18.950385+0000","last_peered":"2023-10-24T02:03:18.950385+0000","last_clean":"2023-10-24T02:03:18.950385+0000","last_became_active":"2023-10-24T02:03:18.950119+0000","last_became_peered":"2023-10-24T02:03:18.950119+0000","last_unstale":"2023-10-24T02:03:18.950385+0000","last_undegraded":"2023-10-24T02:03:18.950385+0000","last_fullsized":"2023-10-24T02:03:18.950385+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948296+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957027+0000","last_change":"2023-10-24T02:03:18.957027+0000","last_active":"2023-10-24T02:03:18.957027+0000","last_peered":"2023-10-24T02:03:18.957027+0000","last_clean":"2023-10-24T02:03:18.957027+0000","last_became_active":"2023-10-24T02:03:18.956564+0000","last_became_peered":"2023-10-24T02:03:18.956564+0000","last_unstale":"2023-10-24T02:03:18.957027+0000","last_undegraded":"2023-10-24T02:03:18.957027+0000","last_fullsized":"2023-10-24T02:03:18.957027+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.950191+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958302+0000","last_change":"2023-10-24T02:03:18.958302+0000","last_active":"2023-10-24T02:03:18.958302+0000","last_peered":"2023-10-24T02:03:18.958302+0000","last_clean":"2023-10-24T02:03:18.958302+0000","last_became_active":"2023-10-24T02:03:18.956921+0000","last_became_peered":"2023-10-24T02:03:18.956921+0000","last_unstale":"2023-10-24T02:03:18.958302+0000","last_undegraded":"2023-10-24T02:03:18.958302+0000","last_fullsized":"2023-10-24T02:03:18.958302+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942875+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955357+0000","last_change":"2023-10-24T02:03:18.955357+0000","last_active":"2023-10-24T02:03:18.955357+0000","last_peered":"2023-10-24T02:03:18.955357+0000","last_clean":"2023-10-24T02:03:18.955357+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955357+0000","last_undegraded":"2023-10-24T02:03:18.955357+0000","last_fullsized":"2023-10-24T02:03:18.955357+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945804+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953879+0000","last_change":"2023-10-24T02:03:18.953879+0000","last_active":"2023-10-24T02:03:18.953879+0000","last_peered":"2023-10-24T02:03:18.953879+0000","last_clean":"2023-10-24T02:03:18.953879+0000","last_became_active":"2023-10-24T02:03:18.953399+0000","last_became_peered":"2023-10-24T02:03:18.953399+0000","last_unstale":"2023-10-24T02:03:18.953879+0000","last_undegraded":"2023-10-24T02:03:18.953879+0000","last_fullsized":"2023-10-24T02:03:18.953879+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943416+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952773+0000","last_change":"2023-10-24T02:03:18.952773+0000","last_active":"2023-10-24T02:03:18.952773+0000","last_peered":"2023-10-24T02:03:18.952773+0000","last_clean":"2023-10-24T02:03:18.952773+0000","last_became_active":"2023-10-24T02:03:18.952455+0000","last_became_peered":"2023-10-24T02:03:18.952455+0000","last_unstale":"2023-10-24T02:03:18.952773+0000","last_undegraded":"2023-10-24T02:03:18.952773+0000","last_fullsized":"2023-10-24T02:03:18.952773+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946187+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960004+0000","last_became_peered":"2023-10-24T02:03:18.960004+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941468+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953693+0000","last_change":"2023-10-24T02:03:18.953693+0000","last_active":"2023-10-24T02:03:18.953693+0000","last_peered":"2023-10-24T02:03:18.953693+0000","last_clean":"2023-10-24T02:03:18.953693+0000","last_became_active":"2023-10-24T02:03:18.952846+0000","last_became_peered":"2023-10-24T02:03:18.952846+0000","last_unstale":"2023-10-24T02:03:18.953693+0000","last_undegraded":"2023-10-24T02:03:18.953693+0000","last_fullsized":"2023-10-24T02:03:18.953693+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948739+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954593+0000","last_change":"2023-10-24T02:03:18.954593+0000","last_active":"2023-10-24T02:03:18.954593+0000","last_peered":"2023-10-24T02:03:18.954593+0000","last_clean":"2023-10-24T02:03:18.954593+0000","last_became_active":"2023-10-24T02:03:18.954332+0000","last_became_peered":"2023-10-24T02:03:18.954332+0000","last_unstale":"2023-10-24T02:03:18.954593+0000","last_undegraded":"2023-10-24T02:03:18.954593+0000","last_fullsized":"2023-10-24T02:03:18.954593+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943122+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954493+0000","last_change":"2023-10-24T02:03:18.954493+0000","last_active":"2023-10-24T02:03:18.954493+0000","last_peered":"2023-10-24T02:03:18.954493+0000","last_clean":"2023-10-24T02:03:18.954493+0000","last_became_active":"2023-10-24T02:03:18.954206+0000","last_became_peered":"2023-10-24T02:03:18.954206+0000","last_unstale":"2023-10-24T02:03:18.954493+0000","last_undegraded":"2023-10-24T02:03:18.954493+0000","last_fullsized":"2023-10-24T02:03:18.954493+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946639+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960005+0000","last_became_peered":"2023-10-24T02:03:18.960005+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946951+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958037+0000","last_change":"2023-10-24T02:03:18.958037+0000","last_active":"2023-10-24T02:03:18.958037+0000","last_peered":"2023-10-24T02:03:18.958037+0000","last_clean":"2023-10-24T02:03:18.958037+0000","last_became_active":"2023-10-24T02:03:18.957793+0000","last_became_peered":"2023-10-24T02:03:18.957793+0000","last_unstale":"2023-10-24T02:03:18.958037+0000","last_undegraded":"2023-10-24T02:03:18.958037+0000","last_fullsized":"2023-10-24T02:03:18.958037+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941812+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954035+0000","last_change":"2023-10-24T02:03:18.954035+0000","last_active":"2023-10-24T02:03:18.954035+0000","last_peered":"2023-10-24T02:03:18.954035+0000","last_clean":"2023-10-24T02:03:18.954035+0000","last_became_active":"2023-10-24T02:03:18.953757+0000","last_became_peered":"2023-10-24T02:03:18.953757+0000","last_unstale":"2023-10-24T02:03:18.954035+0000","last_undegraded":"2023-10-24T02:03:18.954035+0000","last_fullsized":"2023-10-24T02:03:18.954035+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944117+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953464+0000","last_change":"2023-10-24T02:03:18.953464+0000","last_active":"2023-10-24T02:03:18.953464+0000","last_peered":"2023-10-24T02:03:18.953464+0000","last_clean":"2023-10-24T02:03:18.953464+0000","last_became_active":"2023-10-24T02:03:18.953155+0000","last_became_peered":"2023-10-24T02:03:18.953155+0000","last_unstale":"2023-10-24T02:03:18.953464+0000","last_undegraded":"2023-10-24T02:03:18.953464+0000","last_fullsized":"2023-10-24T02:03:18.953464+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938047+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.964197+0000","last_change":"2023-10-24T02:03:18.964197+0000","last_active":"2023-10-24T02:03:18.964197+0000","last_peered":"2023-10-24T02:03:18.964197+0000","last_clean":"2023-10-24T02:03:18.964197+0000","last_became_active":"2023-10-24T02:03:18.963936+0000","last_became_peered":"2023-10-24T02:03:18.963936+0000","last_unstale":"2023-10-24T02:03:18.964197+0000","last_undegraded":"2023-10-24T02:03:18.964197+0000","last_fullsized":"2023-10-24T02:03:18.964197+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945460+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961462+0000","last_change":"2023-10-24T02:03:18.961462+0000","last_active":"2023-10-24T02:03:18.961462+0000","last_peered":"2023-10-24T02:03:18.961462+0000","last_clean":"2023-10-24T02:03:18.961462+0000","last_became_active":"2023-10-24T02:03:18.961159+0000","last_became_peered":"2023-10-24T02:03:18.961159+0000","last_unstale":"2023-10-24T02:03:18.961462+0000","last_undegraded":"2023-10-24T02:03:18.961462+0000","last_fullsized":"2023-10-24T02:03:18.961462+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945861+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949485+0000","last_change":"2023-10-24T02:03:18.949485+0000","last_active":"2023-10-24T02:03:18.949485+0000","last_peered":"2023-10-24T02:03:18.949485+0000","last_clean":"2023-10-24T02:03:18.949485+0000","last_became_active":"2023-10-24T02:03:18.949208+0000","last_became_peered":"2023-10-24T02:03:18.949208+0000","last_unstale":"2023-10-24T02:03:18.949485+0000","last_undegraded":"2023-10-24T02:03:18.949485+0000","last_fullsized":"2023-10-24T02:03:18.949485+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942309+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957342+0000","last_change":"2023-10-24T02:03:18.957342+0000","last_active":"2023-10-24T02:03:18.957342+0000","last_peered":"2023-10-24T02:03:18.957342+0000","last_clean":"2023-10-24T02:03:18.957342+0000","last_became_active":"2023-10-24T02:03:18.957072+0000","last_became_peered":"2023-10-24T02:03:18.957072+0000","last_unstale":"2023-10-24T02:03:18.957342+0000","last_undegraded":"2023-10-24T02:03:18.957342+0000","last_fullsized":"2023-10-24T02:03:18.957342+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938514+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959865+0000","last_change":"2023-10-24T02:03:18.959865+0000","last_active":"2023-10-24T02:03:18.959865+0000","last_peered":"2023-10-24T02:03:18.959865+0000","last_clean":"2023-10-24T02:03:18.959865+0000","last_became_active":"2023-10-24T02:03:18.959532+0000","last_became_peered":"2023-10-24T02:03:18.959532+0000","last_unstale":"2023-10-24T02:03:18.959865+0000","last_undegraded":"2023-10-24T02:03:18.959865+0000","last_fullsized":"2023-10-24T02:03:18.959865+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948092+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955695+0000","last_change":"2023-10-24T02:03:18.955695+0000","last_active":"2023-10-24T02:03:18.955695+0000","last_peered":"2023-10-24T02:03:18.955695+0000","last_clean":"2023-10-24T02:03:18.955695+0000","last_became_active":"2023-10-24T02:03:18.955414+0000","last_became_peered":"2023-10-24T02:03:18.955414+0000","last_unstale":"2023-10-24T02:03:18.955695+0000","last_undegraded":"2023-10-24T02:03:18.955695+0000","last_fullsized":"2023-10-24T02:03:18.955695+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938989+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960459+0000","last_change":"2023-10-24T02:03:18.960459+0000","last_active":"2023-10-24T02:03:18.960459+0000","last_peered":"2023-10-24T02:03:18.960459+0000","last_clean":"2023-10-24T02:03:18.960459+0000","last_became_active":"2023-10-24T02:03:18.959875+0000","last_became_peered":"2023-10-24T02:03:18.959875+0000","last_unstale":"2023-10-24T02:03:18.960459+0000","last_undegraded":"2023-10-24T02:03:18.960459+0000","last_fullsized":"2023-10-24T02:03:18.960459+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942616+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953320+0000","last_change":"2023-10-24T02:03:18.953320+0000","last_active":"2023-10-24T02:03:18.953320+0000","last_peered":"2023-10-24T02:03:18.953320+0000","last_clean":"2023-10-24T02:03:18.953320+0000","last_became_active":"2023-10-24T02:03:18.953054+0000","last_became_peered":"2023-10-24T02:03:18.953054+0000","last_unstale":"2023-10-24T02:03:18.953320+0000","last_undegraded":"2023-10-24T02:03:18.953320+0000","last_fullsized":"2023-10-24T02:03:18.953320+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938968+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957976+0000","last_change":"2023-10-24T02:03:18.957976+0000","last_active":"2023-10-24T02:03:18.957976+0000","last_peered":"2023-10-24T02:03:18.957976+0000","last_clean":"2023-10-24T02:03:18.957976+0000","last_became_active":"2023-10-24T02:03:18.957677+0000","last_became_peered":"2023-10-24T02:03:18.957677+0000","last_unstale":"2023-10-24T02:03:18.957976+0000","last_undegraded":"2023-10-24T02:03:18.957976+0000","last_fullsized":"2023-10-24T02:03:18.957976+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949317+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956247+0000","last_change":"2023-10-24T02:03:18.956247+0000","last_active":"2023-10-24T02:03:18.956247+0000","last_peered":"2023-10-24T02:03:18.956247+0000","last_clean":"2023-10-24T02:03:18.956247+0000","last_became_active":"2023-10-24T02:03:18.955992+0000","last_became_peered":"2023-10-24T02:03:18.955992+0000","last_unstale":"2023-10-24T02:03:18.956247+0000","last_undegraded":"2023-10-24T02:03:18.956247+0000","last_fullsized":"2023-10-24T02:03:18.956247+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949068+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954814+0000","last_change":"2023-10-24T02:03:18.954814+0000","last_active":"2023-10-24T02:03:18.954814+0000","last_peered":"2023-10-24T02:03:18.954814+0000","last_clean":"2023-10-24T02:03:18.954814+0000","last_became_active":"2023-10-24T02:03:18.954573+0000","last_became_peered":"2023-10-24T02:03:18.954573+0000","last_unstale":"2023-10-24T02:03:18.954814+0000","last_undegraded":"2023-10-24T02:03:18.954814+0000","last_fullsized":"2023-10-24T02:03:18.954814+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938381+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959730+0000","last_change":"2023-10-24T02:03:18.959730+0000","last_active":"2023-10-24T02:03:18.959730+0000","last_peered":"2023-10-24T02:03:18.959730+0000","last_clean":"2023-10-24T02:03:18.959730+0000","last_became_active":"2023-10-24T02:03:18.959495+0000","last_became_peered":"2023-10-24T02:03:18.959495+0000","last_unstale":"2023-10-24T02:03:18.959730+0000","last_undegraded":"2023-10-24T02:03:18.959730+0000","last_fullsized":"2023-10-24T02:03:18.959730+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938966+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960384+0000","last_change":"2023-10-24T02:03:18.960384+0000","last_active":"2023-10-24T02:03:18.960384+0000","last_peered":"2023-10-24T02:03:18.960384+0000","last_clean":"2023-10-24T02:03:18.960384+0000","last_became_active":"2023-10-24T02:03:18.960105+0000","last_became_peered":"2023-10-24T02:03:18.960105+0000","last_unstale":"2023-10-24T02:03:18.960384+0000","last_undegraded":"2023-10-24T02:03:18.960384+0000","last_fullsized":"2023-10-24T02:03:18.960384+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945718+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956077+0000","last_change":"2023-10-24T02:03:18.956077+0000","last_active":"2023-10-24T02:03:18.956077+0000","last_peered":"2023-10-24T02:03:18.956077+0000","last_clean":"2023-10-24T02:03:18.956077+0000","last_became_active":"2023-10-24T02:03:18.955798+0000","last_became_peered":"2023-10-24T02:03:18.955798+0000","last_unstale":"2023-10-24T02:03:18.956077+0000","last_undegraded":"2023-10-24T02:03:18.956077+0000","last_fullsized":"2023-10-24T02:03:18.956077+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942879+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957635+0000","last_change":"2023-10-24T02:03:18.957635+0000","last_active":"2023-10-24T02:03:18.957635+0000","last_peered":"2023-10-24T02:03:18.957635+0000","last_clean":"2023-10-24T02:03:18.957635+0000","last_became_active":"2023-10-24T02:03:18.957339+0000","last_became_peered":"2023-10-24T02:03:18.957339+0000","last_unstale":"2023-10-24T02:03:18.957635+0000","last_undegraded":"2023-10-24T02:03:18.957635+0000","last_fullsized":"2023-10-24T02:03:18.957635+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939720+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958287+0000","last_change":"2023-10-24T02:03:18.958287+0000","last_active":"2023-10-24T02:03:18.958287+0000","last_peered":"2023-10-24T02:03:18.958287+0000","last_clean":"2023-10-24T02:03:18.958287+0000","last_became_active":"2023-10-24T02:03:18.958012+0000","last_became_peered":"2023-10-24T02:03:18.958012+0000","last_unstale":"2023-10-24T02:03:18.958287+0000","last_undegraded":"2023-10-24T02:03:18.958287+0000","last_fullsized":"2023-10-24T02:03:18.958287+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938394+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961603+0000","last_change":"2023-10-24T02:03:18.961603+0000","last_active":"2023-10-24T02:03:18.961603+0000","last_peered":"2023-10-24T02:03:18.961603+0000","last_clean":"2023-10-24T02:03:18.961603+0000","last_became_active":"2023-10-24T02:03:18.961258+0000","last_became_peered":"2023-10-24T02:03:18.961258+0000","last_unstale":"2023-10-24T02:03:18.961603+0000","last_undegraded":"2023-10-24T02:03:18.961603+0000","last_fullsized":"2023-10-24T02:03:18.961603+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945329+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956207+0000","last_change":"2023-10-24T02:03:18.956207+0000","last_active":"2023-10-24T02:03:18.956207+0000","last_peered":"2023-10-24T02:03:18.956207+0000","last_clean":"2023-10-24T02:03:18.956207+0000","last_became_active":"2023-10-24T02:03:18.955935+0000","last_became_peered":"2023-10-24T02:03:18.955935+0000","last_unstale":"2023-10-24T02:03:18.956207+0000","last_undegraded":"2023-10-24T02:03:18.956207+0000","last_fullsized":"2023-10-24T02:03:18.956207+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945982+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959527+0000","last_change":"2023-10-24T02:03:18.959527+0000","last_active":"2023-10-24T02:03:18.959527+0000","last_peered":"2023-10-24T02:03:18.959527+0000","last_clean":"2023-10-24T02:03:18.959527+0000","last_became_active":"2023-10-24T02:03:18.959259+0000","last_became_peered":"2023-10-24T02:03:18.959259+0000","last_unstale":"2023-10-24T02:03:18.959527+0000","last_undegraded":"2023-10-24T02:03:18.959527+0000","last_fullsized":"2023-10-24T02:03:18.959527+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940348+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960234+0000","last_change":"2023-10-24T02:03:18.960234+0000","last_active":"2023-10-24T02:03:18.960234+0000","last_peered":"2023-10-24T02:03:18.960234+0000","last_clean":"2023-10-24T02:03:18.960234+0000","last_became_active":"2023-10-24T02:03:18.959668+0000","last_became_peered":"2023-10-24T02:03:18.959668+0000","last_unstale":"2023-10-24T02:03:18.960234+0000","last_undegraded":"2023-10-24T02:03:18.960234+0000","last_fullsized":"2023-10-24T02:03:18.960234+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938338+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957158+0000","last_change":"2023-10-24T02:03:18.957158+0000","last_active":"2023-10-24T02:03:18.957158+0000","last_peered":"2023-10-24T02:03:18.957158+0000","last_clean":"2023-10-24T02:03:18.957158+0000","last_became_active":"2023-10-24T02:03:18.956881+0000","last_became_peered":"2023-10-24T02:03:18.956881+0000","last_unstale":"2023-10-24T02:03:18.957158+0000","last_undegraded":"2023-10-24T02:03:18.957158+0000","last_fullsized":"2023-10-24T02:03:18.957158+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947708+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952051+0000","last_change":"2023-10-24T02:03:18.952051+0000","last_active":"2023-10-24T02:03:18.952051+0000","last_peered":"2023-10-24T02:03:18.952051+0000","last_clean":"2023-10-24T02:03:18.952051+0000","last_became_active":"2023-10-24T02:03:18.951753+0000","last_became_peered":"2023-10-24T02:03:18.951753+0000","last_unstale":"2023-10-24T02:03:18.952051+0000","last_undegraded":"2023-10-24T02:03:18.952051+0000","last_fullsized":"2023-10-24T02:03:18.952051+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942314+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956970+0000","last_change":"2023-10-24T02:03:18.956970+0000","last_active":"2023-10-24T02:03:18.956970+0000","last_peered":"2023-10-24T02:03:18.956970+0000","last_clean":"2023-10-24T02:03:18.956970+0000","last_became_active":"2023-10-24T02:03:18.956541+0000","last_became_peered":"2023-10-24T02:03:18.956541+0000","last_unstale":"2023-10-24T02:03:18.956970+0000","last_undegraded":"2023-10-24T02:03:18.956970+0000","last_fullsized":"2023-10-24T02:03:18.956970+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942012+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955188+0000","last_change":"2023-10-24T02:03:18.955188+0000","last_active":"2023-10-24T02:03:18.955188+0000","last_peered":"2023-10-24T02:03:18.955188+0000","last_clean":"2023-10-24T02:03:18.955188+0000","last_became_active":"2023-10-24T02:03:18.954463+0000","last_became_peered":"2023-10-24T02:03:18.954463+0000","last_unstale":"2023-10-24T02:03:18.955188+0000","last_undegraded":"2023-10-24T02:03:18.955188+0000","last_fullsized":"2023-10-24T02:03:18.955188+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946373+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958952+0000","last_change":"2023-10-24T02:03:18.958952+0000","last_active":"2023-10-24T02:03:18.958952+0000","last_peered":"2023-10-24T02:03:18.958952+0000","last_clean":"2023-10-24T02:03:18.958952+0000","last_became_active":"2023-10-24T02:03:18.958614+0000","last_became_peered":"2023-10-24T02:03:18.958614+0000","last_unstale":"2023-10-24T02:03:18.958952+0000","last_undegraded":"2023-10-24T02:03:18.958952+0000","last_fullsized":"2023-10-24T02:03:18.958952+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.951289+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949597+0000","last_change":"2023-10-24T02:03:18.949597+0000","last_active":"2023-10-24T02:03:18.949597+0000","last_peered":"2023-10-24T02:03:18.949597+0000","last_clean":"2023-10-24T02:03:18.949597+0000","last_became_active":"2023-10-24T02:03:18.949301+0000","last_became_peered":"2023-10-24T02:03:18.949301+0000","last_unstale":"2023-10-24T02:03:18.949597+0000","last_undegraded":"2023-10-24T02:03:18.949597+0000","last_fullsized":"2023-10-24T02:03:18.949597+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938339+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953286+0000","last_change":"2023-10-24T02:03:18.953286+0000","last_active":"2023-10-24T02:03:18.953286+0000","last_peered":"2023-10-24T02:03:18.953286+0000","last_clean":"2023-10-24T02:03:18.953286+0000","last_became_active":"2023-10-24T02:03:18.952922+0000","last_became_peered":"2023-10-24T02:03:18.952922+0000","last_unstale":"2023-10-24T02:03:18.953286+0000","last_undegraded":"2023-10-24T02:03:18.953286+0000","last_fullsized":"2023-10-24T02:03:18.953286+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940728+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955515+0000","last_change":"2023-10-24T02:03:18.955515+0000","last_active":"2023-10-24T02:03:18.955515+0000","last_peered":"2023-10-24T02:03:18.955515+0000","last_clean":"2023-10-24T02:03:18.955515+0000","last_became_active":"2023-10-24T02:03:18.955154+0000","last_became_peered":"2023-10-24T02:03:18.955154+0000","last_unstale":"2023-10-24T02:03:18.955515+0000","last_undegraded":"2023-10-24T02:03:18.955515+0000","last_fullsized":"2023-10-24T02:03:18.955515+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942181+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950142+0000","last_change":"2023-10-24T02:03:18.950142+0000","last_active":"2023-10-24T02:03:18.950142+0000","last_peered":"2023-10-24T02:03:18.950142+0000","last_clean":"2023-10-24T02:03:18.950142+0000","last_became_active":"2023-10-24T02:03:18.949874+0000","last_became_peered":"2023-10-24T02:03:18.949874+0000","last_unstale":"2023-10-24T02:03:18.950142+0000","last_undegraded":"2023-10-24T02:03:18.950142+0000","last_fullsized":"2023-10-24T02:03:18.950142+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938512+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959033+0000","last_change":"2023-10-24T02:03:18.959033+0000","last_active":"2023-10-24T02:03:18.959033+0000","last_peered":"2023-10-24T02:03:18.959033+0000","last_clean":"2023-10-24T02:03:18.959033+0000","last_became_active":"2023-10-24T02:03:18.958731+0000","last_became_peered":"2023-10-24T02:03:18.958731+0000","last_unstale":"2023-10-24T02:03:18.959033+0000","last_undegraded":"2023-10-24T02:03:18.959033+0000","last_fullsized":"2023-10-24T02:03:18.959033+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939401+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.951834+0000","last_change":"2023-10-24T02:03:18.951834+0000","last_active":"2023-10-24T02:03:18.951834+0000","last_peered":"2023-10-24T02:03:18.951834+0000","last_clean":"2023-10-24T02:03:18.951834+0000","last_became_active":"2023-10-24T02:03:18.949164+0000","last_became_peered":"2023-10-24T02:03:18.949164+0000","last_unstale":"2023-10-24T02:03:18.951834+0000","last_undegraded":"2023-10-24T02:03:18.951834+0000","last_fullsized":"2023-10-24T02:03:18.951834+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942937+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950503+0000","last_change":"2023-10-24T02:03:18.950503+0000","last_active":"2023-10-24T02:03:18.950503+0000","last_peered":"2023-10-24T02:03:18.950503+0000","last_clean":"2023-10-24T02:03:18.950503+0000","last_became_active":"2023-10-24T02:03:18.950174+0000","last_became_peered":"2023-10-24T02:03:18.950174+0000","last_unstale":"2023-10-24T02:03:18.950503+0000","last_undegraded":"2023-10-24T02:03:18.950503+0000","last_fullsized":"2023-10-24T02:03:18.950503+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.947343+0000","last_change":"2023-10-24T02:03:18.947343+0000","last_active":"2023-10-24T02:03:18.947343+0000","last_peered":"2023-10-24T02:03:18.947343+0000","last_clean":"2023-10-24T02:03:18.947343+0000","last_became_active":"2023-10-24T02:03:18.947006+0000","last_became_peered":"2023-10-24T02:03:18.947006+0000","last_unstale":"2023-10-24T02:03:18.947343+0000","last_undegraded":"2023-10-24T02:03:18.947343+0000","last_fullsized":"2023-10-24T02:03:18.947343+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944473+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953817+0000","last_change":"2023-10-24T02:03:18.953817+0000","last_active":"2023-10-24T02:03:18.953817+0000","last_peered":"2023-10-24T02:03:18.953817+0000","last_clean":"2023-10-24T02:03:18.953817+0000","last_became_active":"2023-10-24T02:03:18.953457+0000","last_became_peered":"2023-10-24T02:03:18.953457+0000","last_unstale":"2023-10-24T02:03:18.953817+0000","last_undegraded":"2023-10-24T02:03:18.953817+0000","last_fullsized":"2023-10-24T02:03:18.953817+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938138+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954146+0000","last_change":"2023-10-24T02:03:18.954146+0000","last_active":"2023-10-24T02:03:18.954146+0000","last_peered":"2023-10-24T02:03:18.954146+0000","last_clean":"2023-10-24T02:03:18.954146+0000","last_became_active":"2023-10-24T02:03:18.953805+0000","last_became_peered":"2023-10-24T02:03:18.953805+0000","last_unstale":"2023-10-24T02:03:18.954146+0000","last_undegraded":"2023-10-24T02:03:18.954146+0000","last_fullsized":"2023-10-24T02:03:18.954146+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956705+0000","last_change":"2023-10-24T02:03:18.956705+0000","last_active":"2023-10-24T02:03:18.956705+0000","last_peered":"2023-10-24T02:03:18.956705+0000","last_clean":"2023-10-24T02:03:18.956705+0000","last_became_active":"2023-10-24T02:03:18.956408+0000","last_became_peered":"2023-10-24T02:03:18.956408+0000","last_unstale":"2023-10-24T02:03:18.956705+0000","last_undegraded":"2023-10-24T02:03:18.956705+0000","last_fullsized":"2023-10-24T02:03:18.956705+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931186+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:17.931186+0000","last_peered":"2023-10-24T02:03:17.931186+0000","last_clean":"2023-10-24T02:03:17.931186+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:17.931186+0000","last_undegraded":"2023-10-24T02:03:17.931186+0000","last_fullsized":"2023-10-24T02:03:17.931186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944922+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957336+0000","last_change":"2023-10-24T02:03:18.957336+0000","last_active":"2023-10-24T02:03:18.957336+0000","last_peered":"2023-10-24T02:03:18.957336+0000","last_clean":"2023-10-24T02:03:18.957336+0000","last_became_active":"2023-10-24T02:03:18.957093+0000","last_became_peered":"2023-10-24T02:03:18.957093+0000","last_unstale":"2023-10-24T02:03:18.957336+0000","last_undegraded":"2023-10-24T02:03:18.957336+0000","last_fullsized":"2023-10-24T02:03:18.957336+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.937664+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:17.937664+0000","last_peered":"2023-10-24T02:03:17.937664+0000","last_clean":"2023-10-24T02:03:17.937664+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:17.937664+0000","last_undegraded":"2023-10-24T02:03:17.937664+0000","last_fullsized":"2023-10-24T02:03:17.937664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943642+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.963798+0000","last_change":"2023-10-24T02:03:18.963798+0000","last_active":"2023-10-24T02:03:18.963798+0000","last_peered":"2023-10-24T02:03:18.963798+0000","last_clean":"2023-10-24T02:03:18.963798+0000","last_became_active":"2023-10-24T02:03:18.963483+0000","last_became_peered":"2023-10-24T02:03:18.963483+0000","last_unstale":"2023-10-24T02:03:18.963798+0000","last_undegraded":"2023-10-24T02:03:18.963798+0000","last_fullsized":"2023-10-24T02:03:18.963798+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.938872+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:17.938872+0000","last_peered":"2023-10-24T02:03:17.938872+0000","last_clean":"2023-10-24T02:03:17.938872+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:17.938872+0000","last_undegraded":"2023-10-24T02:03:17.938872+0000","last_fullsized":"2023-10-24T02:03:17.938872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943235+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957250+0000","last_change":"2023-10-24T02:03:18.957250+0000","last_active":"2023-10-24T02:03:18.957250+0000","last_peered":"2023-10-24T02:03:18.957250+0000","last_clean":"2023-10-24T02:03:18.957250+0000","last_became_active":"2023-10-24T02:03:18.957017+0000","last_became_peered":"2023-10-24T02:03:18.957017+0000","last_unstale":"2023-10-24T02:03:18.957250+0000","last_undegraded":"2023-10-24T02:03:18.957250+0000","last_fullsized":"2023-10-24T02:03:18.957250+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.936331+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:17.936331+0000","last_peered":"2023-10-24T02:03:17.936331+0000","last_clean":"2023-10-24T02:03:17.936331+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:17.936331+0000","last_undegraded":"2023-10-24T02:03:17.936331+0000","last_fullsized":"2023-10-24T02:03:17.936331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":207,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933701+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:17.933701+0000","last_peered":"2023-10-24T02:03:17.933701+0000","last_clean":"2023-10-24T02:03:17.933701+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:17.933701+0000","last_undegraded":"2023-10-24T02:03:17.933701+0000","last_fullsized":"2023-10-24T02:03:17.933701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947175+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954457+0000","last_change":"2023-10-24T02:03:18.954457+0000","last_active":"2023-10-24T02:03:18.954457+0000","last_peered":"2023-10-24T02:03:18.954457+0000","last_clean":"2023-10-24T02:03:18.954457+0000","last_became_active":"2023-10-24T02:03:18.954148+0000","last_became_peered":"2023-10-24T02:03:18.954148+0000","last_unstale":"2023-10-24T02:03:18.954457+0000","last_undegraded":"2023-10-24T02:03:18.954457+0000","last_fullsized":"2023-10-24T02:03:18.954457+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933781+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:17.933781+0000","last_peered":"2023-10-24T02:03:17.933781+0000","last_clean":"2023-10-24T02:03:17.933781+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:17.933781+0000","last_undegraded":"2023-10-24T02:03:17.933781+0000","last_fullsized":"2023-10-24T02:03:17.933781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938761+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958703+0000","last_change":"2023-10-24T02:03:18.958703+0000","last_active":"2023-10-24T02:03:18.958703+0000","last_peered":"2023-10-24T02:03:18.958703+0000","last_clean":"2023-10-24T02:03:18.958703+0000","last_became_active":"2023-10-24T02:03:18.958421+0000","last_became_peered":"2023-10-24T02:03:18.958421+0000","last_unstale":"2023-10-24T02:03:18.958703+0000","last_undegraded":"2023-10-24T02:03:18.958703+0000","last_fullsized":"2023-10-24T02:03:18.958703+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934171+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:17.934171+0000","last_peered":"2023-10-24T02:03:17.934171+0000","last_clean":"2023-10-24T02:03:17.934171+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:17.934171+0000","last_undegraded":"2023-10-24T02:03:17.934171+0000","last_fullsized":"2023-10-24T02:03:17.934171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944811+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961237+0000","last_change":"2023-10-24T02:03:18.961237+0000","last_active":"2023-10-24T02:03:18.961237+0000","last_peered":"2023-10-24T02:03:18.961237+0000","last_clean":"2023-10-24T02:03:18.961237+0000","last_became_active":"2023-10-24T02:03:18.960957+0000","last_became_peered":"2023-10-24T02:03:18.960957+0000","last_unstale":"2023-10-24T02:03:18.961237+0000","last_undegraded":"2023-10-24T02:03:18.961237+0000","last_fullsized":"2023-10-24T02:03:18.961237+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931161+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:17.931161+0000","last_peered":"2023-10-24T02:03:17.931161+0000","last_clean":"2023-10-24T02:03:17.931161+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:17.931161+0000","last_undegraded":"2023-10-24T02:03:17.931161+0000","last_fullsized":"2023-10-24T02:03:17.931161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942958+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955078+0000","last_change":"2023-10-24T02:03:18.955078+0000","last_active":"2023-10-24T02:03:18.955078+0000","last_peered":"2023-10-24T02:03:18.955078+0000","last_clean":"2023-10-24T02:03:18.955078+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955078+0000","last_undegraded":"2023-10-24T02:03:18.955078+0000","last_fullsized":"2023-10-24T02:03:18.955078+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934801+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:17.934801+0000","last_peered":"2023-10-24T02:03:17.934801+0000","last_clean":"2023-10-24T02:03:17.934801+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:17.934801+0000","last_undegraded":"2023-10-24T02:03:17.934801+0000","last_fullsized":"2023-10-24T02:03:17.934801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2674688,"data_stored":1366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.50600000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575976,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.502}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46500000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.26000000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.627},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.435},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61599999999999999,"15min":0.67600000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.438}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.57999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.35899999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.31}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60999999999999999,"15min":0.752},"last":0.24199999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":0.52100000000000002,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.64600000000000002},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.499,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54100000000000004,"5min":0.63,"15min":0.72799999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":1.097},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.88600000000000001,"15min":1.167},"last":0.34100000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":1.056},"last":0.505},{"interface":"front","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.88500000000000001,"15min":1.109},"last":0.36399999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.91700000000000004,"15min":1.083},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.437,"15min":0.437},"max":{"1min":0.81599999999999995,"5min":0.92600000000000005,"15min":1.155},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.441},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.433}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.49399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.36499999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:22.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:22.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.787+0000 7fad112a1700 1 Processor -- start 2023-10-24T02:03:22.789 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.787+0000 7fad112a1700 1 -- start start 2023-10-24T02:03:22.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad112a1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad0c0688a0 0x7fad0c1382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad112a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7fad0c0c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad112a1700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c0c1b60 con 0x7fad0c0684c0 2023-10-24T02:03:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad112a1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c064770 con 0x7fad0c0688a0 2023-10-24T02:03:22.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad112a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c065f40 con 0x7fad0c1387e0 2023-10-24T02:03:22.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad0affd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fad0c0684c0 0x7fad0c0653d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48494/0 (socket says 172.21.15.148:48494) 2023-10-24T02:03:22.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad0affd700 1 -- 172.21.15.148:0/1332559305 learned_addr learned my addr 172.21.15.148:0/1332559305 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:22.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7fad0c0c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad027fc700 1 --2- 172.21.15.148:0/1332559305 >> v2:172.21.15.150:3300/0 conn(0x7fad0c0688a0 0x7fad0c1382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301629772 0 0) 0x7fad0c0c1b60 con 0x7fad0c0684c0 2023-10-24T02:03:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.788+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf80033f0 con 0x7fad0c0684c0 2023-10-24T02:03:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771657492 0 0) 0x7facf80033f0 con 0x7fad0c0684c0 2023-10-24T02:03:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 msgr2=0x7fad0c0c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7fad0c0c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 >> v2:172.21.15.150:3300/0 conn(0x7fad0c0688a0 msgr2=0x7fad0c1382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 --2- 172.21.15.148:0/1332559305 >> v2:172.21.15.150:3300/0 conn(0x7fad0c0688a0 0x7fad0c1382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0c1230 con 0x7fad0c0684c0 2023-10-24T02:03:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7facfc001470 con 0x7fad0c0684c0 2023-10-24T02:03:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 >> v1:172.21.15.148:6789/0 conn(0x7fad0c0684c0 legacy=0x7fad0c0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf80038e0 0x7facf8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7facf8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7facf8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c064770 con 0x7facf8004b80 2023-10-24T02:03:22.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c065f40 con 0x7facf80038e0 2023-10-24T02:03:22.797 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf800b8e0 con 0x7fad0c1387e0 2023-10-24T02:03:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad027fc700 1 --2- 172.21.15.148:0/1332559305 >> v2:172.21.15.150:3300/0 conn(0x7fad0c0688a0 0x7fad0c1382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7facf8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0affd700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf80038e0 0x7facf8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad027fc700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7facf8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 -- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 msgr2=0x7facf8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c1387e0 0x7facf8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 -- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf80038e0 msgr2=0x7facf8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf80038e0 0x7facf8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 -- 172.21.15.148:0/1332559305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80033f0 con 0x7facf8004b80 2023-10-24T02:03:22.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7facf8005000 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fad0400e1c0 tx=0x7fad0400b040).ready entity=mon.0 client_cookie=a7ceb4534809524f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04009ac0 con 0x7facf8004b80 2023-10-24T02:03:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400f040 con 0x7facf8004b80 2023-10-24T02:03:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.789+0000 7fad0a7fc700 1 -- 172.21.15.148:0/1332559305 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400eca0 con 0x7facf8004b80 2023-10-24T02:03:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 -- 172.21.15.148:0/1332559305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 msgr2=0x7facf8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 --2- 172.21.15.148:0/1332559305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7facf8005000 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fad0400e1c0 tx=0x7fad0400b040).stop 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad0b7fe700 1 -- 172.21.15.148:0/1332559305 reap_dead start 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 -- 172.21.15.148:0/1332559305 shutdown_connections 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 -- 172.21.15.148:0/1332559305 >> 172.21.15.148:0/1332559305 conn(0x7fad0c063120 msgr2=0x7fad0c0c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 -- 172.21.15.148:0/1332559305 shutdown_connections 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.790+0000 7fad112a1700 1 -- 172.21.15.148:0/1332559305 wait complete. 2023-10-24T02:03:22.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.791+0000 7fad112a1700 1 Processor -- start 2023-10-24T02:03:22.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.791+0000 7fad112a1700 1 -- start start 2023-10-24T02:03:22.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 0x7fad0c163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c0be7d0 0x7fad0c0bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c156c10 con 0x7facf8004b80 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c163a40 con 0x7fad0c154de0 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad112a1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1554e0 con 0x7fad0c0be7d0 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.805 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38226/0 (socket says 172.21.15.148:38226) 2023-10-24T02:03:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 -- 172.21.15.148:0/3049512777 learned_addr learned my addr 172.21.15.148:0/3049512777 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad027fc700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 0x7fad0c163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 -- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c0be7d0 msgr2=0x7fad0c0bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0b7fe700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c0be7d0 0x7fad0c0bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.806 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c0be7d0 0x7fad0c0bc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 -- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 msgr2=0x7fad0c163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 0x7fad0c163550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad0affd700 1 -- 172.21.15.148:0/3049512777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c155260 con 0x7facf8004b80 2023-10-24T02:03:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.792+0000 7fad027fc700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 0x7fad0c163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:22.807 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad0affd700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7facfc004a10 tx=0x7fad0c0c1ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00f870 con 0x7facf8004b80 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00f9d0 con 0x7facf8004b80 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00fd50 con 0x7facf8004b80 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c0bdf90 con 0x7facf8004b80 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.793+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c0be550 con 0x7facf8004b80 2023-10-24T02:03:22.808 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.794+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c1569e0 con 0x7facf8004b80 2023-10-24T02:03:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.794+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7facfc015620 con 0x7facf8004b80 2023-10-24T02:03:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.794+0000 7fad037fe700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 0x7facec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.794+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7facfc07a660 con 0x7facf8004b80 2023-10-24T02:03:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.795+0000 7fad027fc700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 0x7facec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:22.809 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.795+0000 7fad027fc700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 0x7facec061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad0c0bd530 tx=0x7facf400b040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:22.810 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.798+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fad0c1569e0 con 0x7facf8004b80 2023-10-24T02:03:22.961 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.960+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad0c068d20 con 0x7facec05f150 2023-10-24T02:03:22.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.970+0000 7fad037fe700 1 -- 172.21.15.148:0/3049512777 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358732 (secure 0 0 0) 0x7fad0c068d20 con 0x7facec05f150 2023-10-24T02:03:22.976 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:22.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 msgr2=0x7facec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 0x7facec061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad0c0bd530 tx=0x7facf400b040).stop 2023-10-24T02:03:22.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 msgr2=0x7fad0c14ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:22.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7facfc004a10 tx=0x7fad0c0c1ad0).stop 2023-10-24T02:03:22.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 shutdown_connections 2023-10-24T02:03:22.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad0c0be7d0 0x7fad0c0bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facf8004b80 0x7fad0c14ee90 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7facec05f150 0x7facec061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 --2- 172.21.15.148:0/3049512777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad0c154de0 0x7fad0c163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:22.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 >> 172.21.15.148:0/3049512777 conn(0x7fad0c063120 msgr2=0x7fad0c0a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:22.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 shutdown_connections 2023-10-24T02:03:22.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:22.973+0000 7fad112a1700 1 -- 172.21.15.148:0/3049512777 wait complete. 2023-10-24T02:03:22.981 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:22.987 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T02:03:22.190551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454924,"kb_used_data":20812,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752519796,"statfs":{"total":773094113280,"available":770580271104,"internally_reserved":0,"allocated":21311488,"data_stored":10882211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28002,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998190"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948730+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960697+0000","last_change":"2023-10-24T02:03:18.960697+0000","last_active":"2023-10-24T02:03:18.960697+0000","last_peered":"2023-10-24T02:03:18.960697+0000","last_clean":"2023-10-24T02:03:18.960697+0000","last_became_active":"2023-10-24T02:03:18.960308+0000","last_became_peered":"2023-10-24T02:03:18.960308+0000","last_unstale":"2023-10-24T02:03:18.960697+0000","last_undegraded":"2023-10-24T02:03:18.960697+0000","last_fullsized":"2023-10-24T02:03:18.960697+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941835+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954224+0000","last_change":"2023-10-24T02:03:18.954224+0000","last_active":"2023-10-24T02:03:18.954224+0000","last_peered":"2023-10-24T02:03:18.954224+0000","last_clean":"2023-10-24T02:03:18.954224+0000","last_became_active":"2023-10-24T02:03:18.953951+0000","last_became_peered":"2023-10-24T02:03:18.953951+0000","last_unstale":"2023-10-24T02:03:18.954224+0000","last_undegraded":"2023-10-24T02:03:18.954224+0000","last_fullsized":"2023-10-24T02:03:18.954224+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946425+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961632+0000","last_change":"2023-10-24T02:03:18.961632+0000","last_active":"2023-10-24T02:03:18.961632+0000","last_peered":"2023-10-24T02:03:18.961632+0000","last_clean":"2023-10-24T02:03:18.961632+0000","last_became_active":"2023-10-24T02:03:18.961285+0000","last_became_peered":"2023-10-24T02:03:18.961285+0000","last_unstale":"2023-10-24T02:03:18.961632+0000","last_undegraded":"2023-10-24T02:03:18.961632+0000","last_fullsized":"2023-10-24T02:03:18.961632+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946211+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.948595+0000","last_change":"2023-10-24T02:03:18.948595+0000","last_active":"2023-10-24T02:03:18.948595+0000","last_peered":"2023-10-24T02:03:18.948595+0000","last_clean":"2023-10-24T02:03:18.948595+0000","last_became_active":"2023-10-24T02:03:18.948274+0000","last_became_peered":"2023-10-24T02:03:18.948274+0000","last_unstale":"2023-10-24T02:03:18.948595+0000","last_undegraded":"2023-10-24T02:03:18.948595+0000","last_fullsized":"2023-10-24T02:03:18.948595+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938439+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954687+0000","last_change":"2023-10-24T02:03:18.954687+0000","last_active":"2023-10-24T02:03:18.954687+0000","last_peered":"2023-10-24T02:03:18.954687+0000","last_clean":"2023-10-24T02:03:18.954687+0000","last_became_active":"2023-10-24T02:03:18.954415+0000","last_became_peered":"2023-10-24T02:03:18.954415+0000","last_unstale":"2023-10-24T02:03:18.954687+0000","last_undegraded":"2023-10-24T02:03:18.954687+0000","last_fullsized":"2023-10-24T02:03:18.954687+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941406+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955738+0000","last_change":"2023-10-24T02:03:18.955738+0000","last_active":"2023-10-24T02:03:18.955738+0000","last_peered":"2023-10-24T02:03:18.955738+0000","last_clean":"2023-10-24T02:03:18.955738+0000","last_became_active":"2023-10-24T02:03:18.955455+0000","last_became_peered":"2023-10-24T02:03:18.955455+0000","last_unstale":"2023-10-24T02:03:18.955738+0000","last_undegraded":"2023-10-24T02:03:18.955738+0000","last_fullsized":"2023-10-24T02:03:18.955738+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942385+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959944+0000","last_change":"2023-10-24T02:03:18.959944+0000","last_active":"2023-10-24T02:03:18.959944+0000","last_peered":"2023-10-24T02:03:18.959944+0000","last_clean":"2023-10-24T02:03:18.959944+0000","last_became_active":"2023-10-24T02:03:18.959611+0000","last_became_peered":"2023-10-24T02:03:18.959611+0000","last_unstale":"2023-10-24T02:03:18.959944+0000","last_undegraded":"2023-10-24T02:03:18.959944+0000","last_fullsized":"2023-10-24T02:03:18.959944+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942291+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950385+0000","last_change":"2023-10-24T02:03:18.950385+0000","last_active":"2023-10-24T02:03:18.950385+0000","last_peered":"2023-10-24T02:03:18.950385+0000","last_clean":"2023-10-24T02:03:18.950385+0000","last_became_active":"2023-10-24T02:03:18.950119+0000","last_became_peered":"2023-10-24T02:03:18.950119+0000","last_unstale":"2023-10-24T02:03:18.950385+0000","last_undegraded":"2023-10-24T02:03:18.950385+0000","last_fullsized":"2023-10-24T02:03:18.950385+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948296+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957027+0000","last_change":"2023-10-24T02:03:18.957027+0000","last_active":"2023-10-24T02:03:18.957027+0000","last_peered":"2023-10-24T02:03:18.957027+0000","last_clean":"2023-10-24T02:03:18.957027+0000","last_became_active":"2023-10-24T02:03:18.956564+0000","last_became_peered":"2023-10-24T02:03:18.956564+0000","last_unstale":"2023-10-24T02:03:18.957027+0000","last_undegraded":"2023-10-24T02:03:18.957027+0000","last_fullsized":"2023-10-24T02:03:18.957027+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.950191+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958302+0000","last_change":"2023-10-24T02:03:18.958302+0000","last_active":"2023-10-24T02:03:18.958302+0000","last_peered":"2023-10-24T02:03:18.958302+0000","last_clean":"2023-10-24T02:03:18.958302+0000","last_became_active":"2023-10-24T02:03:18.956921+0000","last_became_peered":"2023-10-24T02:03:18.956921+0000","last_unstale":"2023-10-24T02:03:18.958302+0000","last_undegraded":"2023-10-24T02:03:18.958302+0000","last_fullsized":"2023-10-24T02:03:18.958302+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942875+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955357+0000","last_change":"2023-10-24T02:03:18.955357+0000","last_active":"2023-10-24T02:03:18.955357+0000","last_peered":"2023-10-24T02:03:18.955357+0000","last_clean":"2023-10-24T02:03:18.955357+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955357+0000","last_undegraded":"2023-10-24T02:03:18.955357+0000","last_fullsized":"2023-10-24T02:03:18.955357+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945804+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953879+0000","last_change":"2023-10-24T02:03:18.953879+0000","last_active":"2023-10-24T02:03:18.953879+0000","last_peered":"2023-10-24T02:03:18.953879+0000","last_clean":"2023-10-24T02:03:18.953879+0000","last_became_active":"2023-10-24T02:03:18.953399+0000","last_became_peered":"2023-10-24T02:03:18.953399+0000","last_unstale":"2023-10-24T02:03:18.953879+0000","last_undegraded":"2023-10-24T02:03:18.953879+0000","last_fullsized":"2023-10-24T02:03:18.953879+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943416+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952773+0000","last_change":"2023-10-24T02:03:18.952773+0000","last_active":"2023-10-24T02:03:18.952773+0000","last_peered":"2023-10-24T02:03:18.952773+0000","last_clean":"2023-10-24T02:03:18.952773+0000","last_became_active":"2023-10-24T02:03:18.952455+0000","last_became_peered":"2023-10-24T02:03:18.952455+0000","last_unstale":"2023-10-24T02:03:18.952773+0000","last_undegraded":"2023-10-24T02:03:18.952773+0000","last_fullsized":"2023-10-24T02:03:18.952773+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946187+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960004+0000","last_became_peered":"2023-10-24T02:03:18.960004+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941468+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953693+0000","last_change":"2023-10-24T02:03:18.953693+0000","last_active":"2023-10-24T02:03:18.953693+0000","last_peered":"2023-10-24T02:03:18.953693+0000","last_clean":"2023-10-24T02:03:18.953693+0000","last_became_active":"2023-10-24T02:03:18.952846+0000","last_became_peered":"2023-10-24T02:03:18.952846+0000","last_unstale":"2023-10-24T02:03:18.953693+0000","last_undegraded":"2023-10-24T02:03:18.953693+0000","last_fullsized":"2023-10-24T02:03:18.953693+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948739+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954593+0000","last_change":"2023-10-24T02:03:18.954593+0000","last_active":"2023-10-24T02:03:18.954593+0000","last_peered":"2023-10-24T02:03:18.954593+0000","last_clean":"2023-10-24T02:03:18.954593+0000","last_became_active":"2023-10-24T02:03:18.954332+0000","last_became_peered":"2023-10-24T02:03:18.954332+0000","last_unstale":"2023-10-24T02:03:18.954593+0000","last_undegraded":"2023-10-24T02:03:18.954593+0000","last_fullsized":"2023-10-24T02:03:18.954593+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943122+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954493+0000","last_change":"2023-10-24T02:03:18.954493+0000","last_active":"2023-10-24T02:03:18.954493+0000","last_peered":"2023-10-24T02:03:18.954493+0000","last_clean":"2023-10-24T02:03:18.954493+0000","last_became_active":"2023-10-24T02:03:18.954206+0000","last_became_peered":"2023-10-24T02:03:18.954206+0000","last_unstale":"2023-10-24T02:03:18.954493+0000","last_undegraded":"2023-10-24T02:03:18.954493+0000","last_fullsized":"2023-10-24T02:03:18.954493+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946639+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960005+0000","last_became_peered":"2023-10-24T02:03:18.960005+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946951+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958037+0000","last_change":"2023-10-24T02:03:18.958037+0000","last_active":"2023-10-24T02:03:18.958037+0000","last_peered":"2023-10-24T02:03:18.958037+0000","last_clean":"2023-10-24T02:03:18.958037+0000","last_became_active":"2023-10-24T02:03:18.957793+0000","last_became_peered":"2023-10-24T02:03:18.957793+0000","last_unstale":"2023-10-24T02:03:18.958037+0000","last_undegraded":"2023-10-24T02:03:18.958037+0000","last_fullsized":"2023-10-24T02:03:18.958037+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941812+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954035+0000","last_change":"2023-10-24T02:03:18.954035+0000","last_active":"2023-10-24T02:03:18.954035+0000","last_peered":"2023-10-24T02:03:18.954035+0000","last_clean":"2023-10-24T02:03:18.954035+0000","last_became_active":"2023-10-24T02:03:18.953757+0000","last_became_peered":"2023-10-24T02:03:18.953757+0000","last_unstale":"2023-10-24T02:03:18.954035+0000","last_undegraded":"2023-10-24T02:03:18.954035+0000","last_fullsized":"2023-10-24T02:03:18.954035+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944117+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953464+0000","last_change":"2023-10-24T02:03:18.953464+0000","last_active":"2023-10-24T02:03:18.953464+0000","last_peered":"2023-10-24T02:03:18.953464+0000","last_clean":"2023-10-24T02:03:18.953464+0000","last_became_active":"2023-10-24T02:03:18.953155+0000","last_became_peered":"2023-10-24T02:03:18.953155+0000","last_unstale":"2023-10-24T02:03:18.953464+0000","last_undegraded":"2023-10-24T02:03:18.953464+0000","last_fullsized":"2023-10-24T02:03:18.953464+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938047+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.964197+0000","last_change":"2023-10-24T02:03:18.964197+0000","last_active":"2023-10-24T02:03:18.964197+0000","last_peered":"2023-10-24T02:03:18.964197+0000","last_clean":"2023-10-24T02:03:18.964197+0000","last_became_active":"2023-10-24T02:03:18.963936+0000","last_became_peered":"2023-10-24T02:03:18.963936+0000","last_unstale":"2023-10-24T02:03:18.964197+0000","last_undegraded":"2023-10-24T02:03:18.964197+0000","last_fullsized":"2023-10-24T02:03:18.964197+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945460+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961462+0000","last_change":"2023-10-24T02:03:18.961462+0000","last_active":"2023-10-24T02:03:18.961462+0000","last_peered":"2023-10-24T02:03:18.961462+0000","last_clean":"2023-10-24T02:03:18.961462+0000","last_became_active":"2023-10-24T02:03:18.961159+0000","last_became_peered":"2023-10-24T02:03:18.961159+0000","last_unstale":"2023-10-24T02:03:18.961462+0000","last_undegraded":"2023-10-24T02:03:18.961462+0000","last_fullsized":"2023-10-24T02:03:18.961462+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945861+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949485+0000","last_change":"2023-10-24T02:03:18.949485+0000","last_active":"2023-10-24T02:03:18.949485+0000","last_peered":"2023-10-24T02:03:18.949485+0000","last_clean":"2023-10-24T02:03:18.949485+0000","last_became_active":"2023-10-24T02:03:18.949208+0000","last_became_peered":"2023-10-24T02:03:18.949208+0000","last_unstale":"2023-10-24T02:03:18.949485+0000","last_undegraded":"2023-10-24T02:03:18.949485+0000","last_fullsized":"2023-10-24T02:03:18.949485+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942309+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957342+0000","last_change":"2023-10-24T02:03:18.957342+0000","last_active":"2023-10-24T02:03:18.957342+0000","last_peered":"2023-10-24T02:03:18.957342+0000","last_clean":"2023-10-24T02:03:18.957342+0000","last_became_active":"2023-10-24T02:03:18.957072+0000","last_became_peered":"2023-10-24T02:03:18.957072+0000","last_unstale":"2023-10-24T02:03:18.957342+0000","last_undegraded":"2023-10-24T02:03:18.957342+0000","last_fullsized":"2023-10-24T02:03:18.957342+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938514+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959865+0000","last_change":"2023-10-24T02:03:18.959865+0000","last_active":"2023-10-24T02:03:18.959865+0000","last_peered":"2023-10-24T02:03:18.959865+0000","last_clean":"2023-10-24T02:03:18.959865+0000","last_became_active":"2023-10-24T02:03:18.959532+0000","last_became_peered":"2023-10-24T02:03:18.959532+0000","last_unstale":"2023-10-24T02:03:18.959865+0000","last_undegraded":"2023-10-24T02:03:18.959865+0000","last_fullsized":"2023-10-24T02:03:18.959865+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948092+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955695+0000","last_change":"2023-10-24T02:03:18.955695+0000","last_active":"2023-10-24T02:03:18.955695+0000","last_peered":"2023-10-24T02:03:18.955695+0000","last_clean":"2023-10-24T02:03:18.955695+0000","last_became_active":"2023-10-24T02:03:18.955414+0000","last_became_peered":"2023-10-24T02:03:18.955414+0000","last_unstale":"2023-10-24T02:03:18.955695+0000","last_undegraded":"2023-10-24T02:03:18.955695+0000","last_fullsized":"2023-10-24T02:03:18.955695+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938989+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960459+0000","last_change":"2023-10-24T02:03:18.960459+0000","last_active":"2023-10-24T02:03:18.960459+0000","last_peered":"2023-10-24T02:03:18.960459+0000","last_clean":"2023-10-24T02:03:18.960459+0000","last_became_active":"2023-10-24T02:03:18.959875+0000","last_became_peered":"2023-10-24T02:03:18.959875+0000","last_unstale":"2023-10-24T02:03:18.960459+0000","last_undegraded":"2023-10-24T02:03:18.960459+0000","last_fullsized":"2023-10-24T02:03:18.960459+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942616+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953320+0000","last_change":"2023-10-24T02:03:18.953320+0000","last_active":"2023-10-24T02:03:18.953320+0000","last_peered":"2023-10-24T02:03:18.953320+0000","last_clean":"2023-10-24T02:03:18.953320+0000","last_became_active":"2023-10-24T02:03:18.953054+0000","last_became_peered":"2023-10-24T02:03:18.953054+0000","last_unstale":"2023-10-24T02:03:18.953320+0000","last_undegraded":"2023-10-24T02:03:18.953320+0000","last_fullsized":"2023-10-24T02:03:18.953320+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938968+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957976+0000","last_change":"2023-10-24T02:03:18.957976+0000","last_active":"2023-10-24T02:03:18.957976+0000","last_peered":"2023-10-24T02:03:18.957976+0000","last_clean":"2023-10-24T02:03:18.957976+0000","last_became_active":"2023-10-24T02:03:18.957677+0000","last_became_peered":"2023-10-24T02:03:18.957677+0000","last_unstale":"2023-10-24T02:03:18.957976+0000","last_undegraded":"2023-10-24T02:03:18.957976+0000","last_fullsized":"2023-10-24T02:03:18.957976+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949317+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956247+0000","last_change":"2023-10-24T02:03:18.956247+0000","last_active":"2023-10-24T02:03:18.956247+0000","last_peered":"2023-10-24T02:03:18.956247+0000","last_clean":"2023-10-24T02:03:18.956247+0000","last_became_active":"2023-10-24T02:03:18.955992+0000","last_became_peered":"2023-10-24T02:03:18.955992+0000","last_unstale":"2023-10-24T02:03:18.956247+0000","last_undegraded":"2023-10-24T02:03:18.956247+0000","last_fullsized":"2023-10-24T02:03:18.956247+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949068+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954814+0000","last_change":"2023-10-24T02:03:18.954814+0000","last_active":"2023-10-24T02:03:18.954814+0000","last_peered":"2023-10-24T02:03:18.954814+0000","last_clean":"2023-10-24T02:03:18.954814+0000","last_became_active":"2023-10-24T02:03:18.954573+0000","last_became_peered":"2023-10-24T02:03:18.954573+0000","last_unstale":"2023-10-24T02:03:18.954814+0000","last_undegraded":"2023-10-24T02:03:18.954814+0000","last_fullsized":"2023-10-24T02:03:18.954814+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938381+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959730+0000","last_change":"2023-10-24T02:03:18.959730+0000","last_active":"2023-10-24T02:03:18.959730+0000","last_peered":"2023-10-24T02:03:18.959730+0000","last_clean":"2023-10-24T02:03:18.959730+0000","last_became_active":"2023-10-24T02:03:18.959495+0000","last_became_peered":"2023-10-24T02:03:18.959495+0000","last_unstale":"2023-10-24T02:03:18.959730+0000","last_undegraded":"2023-10-24T02:03:18.959730+0000","last_fullsized":"2023-10-24T02:03:18.959730+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938966+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960384+0000","last_change":"2023-10-24T02:03:18.960384+0000","last_active":"2023-10-24T02:03:18.960384+0000","last_peered":"2023-10-24T02:03:18.960384+0000","last_clean":"2023-10-24T02:03:18.960384+0000","last_became_active":"2023-10-24T02:03:18.960105+0000","last_became_peered":"2023-10-24T02:03:18.960105+0000","last_unstale":"2023-10-24T02:03:18.960384+0000","last_undegraded":"2023-10-24T02:03:18.960384+0000","last_fullsized":"2023-10-24T02:03:18.960384+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945718+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956077+0000","last_change":"2023-10-24T02:03:18.956077+0000","last_active":"2023-10-24T02:03:18.956077+0000","last_peered":"2023-10-24T02:03:18.956077+0000","last_clean":"2023-10-24T02:03:18.956077+0000","last_became_active":"2023-10-24T02:03:18.955798+0000","last_became_peered":"2023-10-24T02:03:18.955798+0000","last_unstale":"2023-10-24T02:03:18.956077+0000","last_undegraded":"2023-10-24T02:03:18.956077+0000","last_fullsized":"2023-10-24T02:03:18.956077+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942879+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957635+0000","last_change":"2023-10-24T02:03:18.957635+0000","last_active":"2023-10-24T02:03:18.957635+0000","last_peered":"2023-10-24T02:03:18.957635+0000","last_clean":"2023-10-24T02:03:18.957635+0000","last_became_active":"2023-10-24T02:03:18.957339+0000","last_became_peered":"2023-10-24T02:03:18.957339+0000","last_unstale":"2023-10-24T02:03:18.957635+0000","last_undegraded":"2023-10-24T02:03:18.957635+0000","last_fullsized":"2023-10-24T02:03:18.957635+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939720+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958287+0000","last_change":"2023-10-24T02:03:18.958287+0000","last_active":"2023-10-24T02:03:18.958287+0000","last_peered":"2023-10-24T02:03:18.958287+0000","last_clean":"2023-10-24T02:03:18.958287+0000","last_became_active":"2023-10-24T02:03:18.958012+0000","last_became_peered":"2023-10-24T02:03:18.958012+0000","last_unstale":"2023-10-24T02:03:18.958287+0000","last_undegraded":"2023-10-24T02:03:18.958287+0000","last_fullsized":"2023-10-24T02:03:18.958287+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938394+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961603+0000","last_change":"2023-10-24T02:03:18.961603+0000","last_active":"2023-10-24T02:03:18.961603+0000","last_peered":"2023-10-24T02:03:18.961603+0000","last_clean":"2023-10-24T02:03:18.961603+0000","last_became_active":"2023-10-24T02:03:18.961258+0000","last_became_peered":"2023-10-24T02:03:18.961258+0000","last_unstale":"2023-10-24T02:03:18.961603+0000","last_undegraded":"2023-10-24T02:03:18.961603+0000","last_fullsized":"2023-10-24T02:03:18.961603+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945329+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956207+0000","last_change":"2023-10-24T02:03:18.956207+0000","last_active":"2023-10-24T02:03:18.956207+0000","last_peered":"2023-10-24T02:03:18.956207+0000","last_clean":"2023-10-24T02:03:18.956207+0000","last_became_active":"2023-10-24T02:03:18.955935+0000","last_became_peered":"2023-10-24T02:03:18.955935+0000","last_unstale":"2023-10-24T02:03:18.956207+0000","last_undegraded":"2023-10-24T02:03:18.956207+0000","last_fullsized":"2023-10-24T02:03:18.956207+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945982+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959527+0000","last_change":"2023-10-24T02:03:18.959527+0000","last_active":"2023-10-24T02:03:18.959527+0000","last_peered":"2023-10-24T02:03:18.959527+0000","last_clean":"2023-10-24T02:03:18.959527+0000","last_became_active":"2023-10-24T02:03:18.959259+0000","last_became_peered":"2023-10-24T02:03:18.959259+0000","last_unstale":"2023-10-24T02:03:18.959527+0000","last_undegraded":"2023-10-24T02:03:18.959527+0000","last_fullsized":"2023-10-24T02:03:18.959527+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940348+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960234+0000","last_change":"2023-10-24T02:03:18.960234+0000","last_active":"2023-10-24T02:03:18.960234+0000","last_peered":"2023-10-24T02:03:18.960234+0000","last_clean":"2023-10-24T02:03:18.960234+0000","last_became_active":"2023-10-24T02:03:18.959668+0000","last_became_peered":"2023-10-24T02:03:18.959668+0000","last_unstale":"2023-10-24T02:03:18.960234+0000","last_undegraded":"2023-10-24T02:03:18.960234+0000","last_fullsized":"2023-10-24T02:03:18.960234+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938338+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957158+0000","last_change":"2023-10-24T02:03:18.957158+0000","last_active":"2023-10-24T02:03:18.957158+0000","last_peered":"2023-10-24T02:03:18.957158+0000","last_clean":"2023-10-24T02:03:18.957158+0000","last_became_active":"2023-10-24T02:03:18.956881+0000","last_became_peered":"2023-10-24T02:03:18.956881+0000","last_unstale":"2023-10-24T02:03:18.957158+0000","last_undegraded":"2023-10-24T02:03:18.957158+0000","last_fullsized":"2023-10-24T02:03:18.957158+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947708+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952051+0000","last_change":"2023-10-24T02:03:18.952051+0000","last_active":"2023-10-24T02:03:18.952051+0000","last_peered":"2023-10-24T02:03:18.952051+0000","last_clean":"2023-10-24T02:03:18.952051+0000","last_became_active":"2023-10-24T02:03:18.951753+0000","last_became_peered":"2023-10-24T02:03:18.951753+0000","last_unstale":"2023-10-24T02:03:18.952051+0000","last_undegraded":"2023-10-24T02:03:18.952051+0000","last_fullsized":"2023-10-24T02:03:18.952051+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942314+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956970+0000","last_change":"2023-10-24T02:03:18.956970+0000","last_active":"2023-10-24T02:03:18.956970+0000","last_peered":"2023-10-24T02:03:18.956970+0000","last_clean":"2023-10-24T02:03:18.956970+0000","last_became_active":"2023-10-24T02:03:18.956541+0000","last_became_peered":"2023-10-24T02:03:18.956541+0000","last_unstale":"2023-10-24T02:03:18.956970+0000","last_undegraded":"2023-10-24T02:03:18.956970+0000","last_fullsized":"2023-10-24T02:03:18.956970+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942012+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955188+0000","last_change":"2023-10-24T02:03:18.955188+0000","last_active":"2023-10-24T02:03:18.955188+0000","last_peered":"2023-10-24T02:03:18.955188+0000","last_clean":"2023-10-24T02:03:18.955188+0000","last_became_active":"2023-10-24T02:03:18.954463+0000","last_became_peered":"2023-10-24T02:03:18.954463+0000","last_unstale":"2023-10-24T02:03:18.955188+0000","last_undegraded":"2023-10-24T02:03:18.955188+0000","last_fullsized":"2023-10-24T02:03:18.955188+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946373+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958952+0000","last_change":"2023-10-24T02:03:18.958952+0000","last_active":"2023-10-24T02:03:18.958952+0000","last_peered":"2023-10-24T02:03:18.958952+0000","last_clean":"2023-10-24T02:03:18.958952+0000","last_became_active":"2023-10-24T02:03:18.958614+0000","last_became_peered":"2023-10-24T02:03:18.958614+0000","last_unstale":"2023-10-24T02:03:18.958952+0000","last_undegraded":"2023-10-24T02:03:18.958952+0000","last_fullsized":"2023-10-24T02:03:18.958952+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.951289+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949597+0000","last_change":"2023-10-24T02:03:18.949597+0000","last_active":"2023-10-24T02:03:18.949597+0000","last_peered":"2023-10-24T02:03:18.949597+0000","last_clean":"2023-10-24T02:03:18.949597+0000","last_became_active":"2023-10-24T02:03:18.949301+0000","last_became_peered":"2023-10-24T02:03:18.949301+0000","last_unstale":"2023-10-24T02:03:18.949597+0000","last_undegraded":"2023-10-24T02:03:18.949597+0000","last_fullsized":"2023-10-24T02:03:18.949597+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938339+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953286+0000","last_change":"2023-10-24T02:03:18.953286+0000","last_active":"2023-10-24T02:03:18.953286+0000","last_peered":"2023-10-24T02:03:18.953286+0000","last_clean":"2023-10-24T02:03:18.953286+0000","last_became_active":"2023-10-24T02:03:18.952922+0000","last_became_peered":"2023-10-24T02:03:18.952922+0000","last_unstale":"2023-10-24T02:03:18.953286+0000","last_undegraded":"2023-10-24T02:03:18.953286+0000","last_fullsized":"2023-10-24T02:03:18.953286+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940728+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955515+0000","last_change":"2023-10-24T02:03:18.955515+0000","last_active":"2023-10-24T02:03:18.955515+0000","last_peered":"2023-10-24T02:03:18.955515+0000","last_clean":"2023-10-24T02:03:18.955515+0000","last_became_active":"2023-10-24T02:03:18.955154+0000","last_became_peered":"2023-10-24T02:03:18.955154+0000","last_unstale":"2023-10-24T02:03:18.955515+0000","last_undegraded":"2023-10-24T02:03:18.955515+0000","last_fullsized":"2023-10-24T02:03:18.955515+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942181+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950142+0000","last_change":"2023-10-24T02:03:18.950142+0000","last_active":"2023-10-24T02:03:18.950142+0000","last_peered":"2023-10-24T02:03:18.950142+0000","last_clean":"2023-10-24T02:03:18.950142+0000","last_became_active":"2023-10-24T02:03:18.949874+0000","last_became_peered":"2023-10-24T02:03:18.949874+0000","last_unstale":"2023-10-24T02:03:18.950142+0000","last_undegraded":"2023-10-24T02:03:18.950142+0000","last_fullsized":"2023-10-24T02:03:18.950142+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938512+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959033+0000","last_change":"2023-10-24T02:03:18.959033+0000","last_active":"2023-10-24T02:03:18.959033+0000","last_peered":"2023-10-24T02:03:18.959033+0000","last_clean":"2023-10-24T02:03:18.959033+0000","last_became_active":"2023-10-24T02:03:18.958731+0000","last_became_peered":"2023-10-24T02:03:18.958731+0000","last_unstale":"2023-10-24T02:03:18.959033+0000","last_undegraded":"2023-10-24T02:03:18.959033+0000","last_fullsized":"2023-10-24T02:03:18.959033+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939401+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.951834+0000","last_change":"2023-10-24T02:03:18.951834+0000","last_active":"2023-10-24T02:03:18.951834+0000","last_peered":"2023-10-24T02:03:18.951834+0000","last_clean":"2023-10-24T02:03:18.951834+0000","last_became_active":"2023-10-24T02:03:18.949164+0000","last_became_peered":"2023-10-24T02:03:18.949164+0000","last_unstale":"2023-10-24T02:03:18.951834+0000","last_undegraded":"2023-10-24T02:03:18.951834+0000","last_fullsized":"2023-10-24T02:03:18.951834+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942937+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950503+0000","last_change":"2023-10-24T02:03:18.950503+0000","last_active":"2023-10-24T02:03:18.950503+0000","last_peered":"2023-10-24T02:03:18.950503+0000","last_clean":"2023-10-24T02:03:18.950503+0000","last_became_active":"2023-10-24T02:03:18.950174+0000","last_became_peered":"2023-10-24T02:03:18.950174+0000","last_unstale":"2023-10-24T02:03:18.950503+0000","last_undegraded":"2023-10-24T02:03:18.950503+0000","last_fullsized":"2023-10-24T02:03:18.950503+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.947343+0000","last_change":"2023-10-24T02:03:18.947343+0000","last_active":"2023-10-24T02:03:18.947343+0000","last_peered":"2023-10-24T02:03:18.947343+0000","last_clean":"2023-10-24T02:03:18.947343+0000","last_became_active":"2023-10-24T02:03:18.947006+0000","last_became_peered":"2023-10-24T02:03:18.947006+0000","last_unstale":"2023-10-24T02:03:18.947343+0000","last_undegraded":"2023-10-24T02:03:18.947343+0000","last_fullsized":"2023-10-24T02:03:18.947343+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944473+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953817+0000","last_change":"2023-10-24T02:03:18.953817+0000","last_active":"2023-10-24T02:03:18.953817+0000","last_peered":"2023-10-24T02:03:18.953817+0000","last_clean":"2023-10-24T02:03:18.953817+0000","last_became_active":"2023-10-24T02:03:18.953457+0000","last_became_peered":"2023-10-24T02:03:18.953457+0000","last_unstale":"2023-10-24T02:03:18.953817+0000","last_undegraded":"2023-10-24T02:03:18.953817+0000","last_fullsized":"2023-10-24T02:03:18.953817+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938138+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954146+0000","last_change":"2023-10-24T02:03:18.954146+0000","last_active":"2023-10-24T02:03:18.954146+0000","last_peered":"2023-10-24T02:03:18.954146+0000","last_clean":"2023-10-24T02:03:18.954146+0000","last_became_active":"2023-10-24T02:03:18.953805+0000","last_became_peered":"2023-10-24T02:03:18.953805+0000","last_unstale":"2023-10-24T02:03:18.954146+0000","last_undegraded":"2023-10-24T02:03:18.954146+0000","last_fullsized":"2023-10-24T02:03:18.954146+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956705+0000","last_change":"2023-10-24T02:03:18.956705+0000","last_active":"2023-10-24T02:03:18.956705+0000","last_peered":"2023-10-24T02:03:18.956705+0000","last_clean":"2023-10-24T02:03:18.956705+0000","last_became_active":"2023-10-24T02:03:18.956408+0000","last_became_peered":"2023-10-24T02:03:18.956408+0000","last_unstale":"2023-10-24T02:03:18.956705+0000","last_undegraded":"2023-10-24T02:03:18.956705+0000","last_fullsized":"2023-10-24T02:03:18.956705+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931186+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:17.931186+0000","last_peered":"2023-10-24T02:03:17.931186+0000","last_clean":"2023-10-24T02:03:17.931186+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:17.931186+0000","last_undegraded":"2023-10-24T02:03:17.931186+0000","last_fullsized":"2023-10-24T02:03:17.931186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944922+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957336+0000","last_change":"2023-10-24T02:03:18.957336+0000","last_active":"2023-10-24T02:03:18.957336+0000","last_peered":"2023-10-24T02:03:18.957336+0000","last_clean":"2023-10-24T02:03:18.957336+0000","last_became_active":"2023-10-24T02:03:18.957093+0000","last_became_peered":"2023-10-24T02:03:18.957093+0000","last_unstale":"2023-10-24T02:03:18.957336+0000","last_undegraded":"2023-10-24T02:03:18.957336+0000","last_fullsized":"2023-10-24T02:03:18.957336+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.937664+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:17.937664+0000","last_peered":"2023-10-24T02:03:17.937664+0000","last_clean":"2023-10-24T02:03:17.937664+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:17.937664+0000","last_undegraded":"2023-10-24T02:03:17.937664+0000","last_fullsized":"2023-10-24T02:03:17.937664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943642+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.963798+0000","last_change":"2023-10-24T02:03:18.963798+0000","last_active":"2023-10-24T02:03:18.963798+0000","last_peered":"2023-10-24T02:03:18.963798+0000","last_clean":"2023-10-24T02:03:18.963798+0000","last_became_active":"2023-10-24T02:03:18.963483+0000","last_became_peered":"2023-10-24T02:03:18.963483+0000","last_unstale":"2023-10-24T02:03:18.963798+0000","last_undegraded":"2023-10-24T02:03:18.963798+0000","last_fullsized":"2023-10-24T02:03:18.963798+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.938872+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:17.938872+0000","last_peered":"2023-10-24T02:03:17.938872+0000","last_clean":"2023-10-24T02:03:17.938872+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:17.938872+0000","last_undegraded":"2023-10-24T02:03:17.938872+0000","last_fullsized":"2023-10-24T02:03:17.938872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943235+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957250+0000","last_change":"2023-10-24T02:03:18.957250+0000","last_active":"2023-10-24T02:03:18.957250+0000","last_peered":"2023-10-24T02:03:18.957250+0000","last_clean":"2023-10-24T02:03:18.957250+0000","last_became_active":"2023-10-24T02:03:18.957017+0000","last_became_peered":"2023-10-24T02:03:18.957017+0000","last_unstale":"2023-10-24T02:03:18.957250+0000","last_undegraded":"2023-10-24T02:03:18.957250+0000","last_fullsized":"2023-10-24T02:03:18.957250+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.936331+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:17.936331+0000","last_peered":"2023-10-24T02:03:17.936331+0000","last_clean":"2023-10-24T02:03:17.936331+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:17.936331+0000","last_undegraded":"2023-10-24T02:03:17.936331+0000","last_fullsized":"2023-10-24T02:03:17.936331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":207,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933701+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:17.933701+0000","last_peered":"2023-10-24T02:03:17.933701+0000","last_clean":"2023-10-24T02:03:17.933701+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:17.933701+0000","last_undegraded":"2023-10-24T02:03:17.933701+0000","last_fullsized":"2023-10-24T02:03:17.933701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947175+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954457+0000","last_change":"2023-10-24T02:03:18.954457+0000","last_active":"2023-10-24T02:03:18.954457+0000","last_peered":"2023-10-24T02:03:18.954457+0000","last_clean":"2023-10-24T02:03:18.954457+0000","last_became_active":"2023-10-24T02:03:18.954148+0000","last_became_peered":"2023-10-24T02:03:18.954148+0000","last_unstale":"2023-10-24T02:03:18.954457+0000","last_undegraded":"2023-10-24T02:03:18.954457+0000","last_fullsized":"2023-10-24T02:03:18.954457+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933781+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:17.933781+0000","last_peered":"2023-10-24T02:03:17.933781+0000","last_clean":"2023-10-24T02:03:17.933781+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:17.933781+0000","last_undegraded":"2023-10-24T02:03:17.933781+0000","last_fullsized":"2023-10-24T02:03:17.933781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938761+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958703+0000","last_change":"2023-10-24T02:03:18.958703+0000","last_active":"2023-10-24T02:03:18.958703+0000","last_peered":"2023-10-24T02:03:18.958703+0000","last_clean":"2023-10-24T02:03:18.958703+0000","last_became_active":"2023-10-24T02:03:18.958421+0000","last_became_peered":"2023-10-24T02:03:18.958421+0000","last_unstale":"2023-10-24T02:03:18.958703+0000","last_undegraded":"2023-10-24T02:03:18.958703+0000","last_fullsized":"2023-10-24T02:03:18.958703+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934171+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:17.934171+0000","last_peered":"2023-10-24T02:03:17.934171+0000","last_clean":"2023-10-24T02:03:17.934171+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:17.934171+0000","last_undegraded":"2023-10-24T02:03:17.934171+0000","last_fullsized":"2023-10-24T02:03:17.934171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944811+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961237+0000","last_change":"2023-10-24T02:03:18.961237+0000","last_active":"2023-10-24T02:03:18.961237+0000","last_peered":"2023-10-24T02:03:18.961237+0000","last_clean":"2023-10-24T02:03:18.961237+0000","last_became_active":"2023-10-24T02:03:18.960957+0000","last_became_peered":"2023-10-24T02:03:18.960957+0000","last_unstale":"2023-10-24T02:03:18.961237+0000","last_undegraded":"2023-10-24T02:03:18.961237+0000","last_fullsized":"2023-10-24T02:03:18.961237+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931161+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:17.931161+0000","last_peered":"2023-10-24T02:03:17.931161+0000","last_clean":"2023-10-24T02:03:17.931161+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:17.931161+0000","last_undegraded":"2023-10-24T02:03:17.931161+0000","last_fullsized":"2023-10-24T02:03:17.931161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942958+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955078+0000","last_change":"2023-10-24T02:03:18.955078+0000","last_active":"2023-10-24T02:03:18.955078+0000","last_peered":"2023-10-24T02:03:18.955078+0000","last_clean":"2023-10-24T02:03:18.955078+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955078+0000","last_undegraded":"2023-10-24T02:03:18.955078+0000","last_fullsized":"2023-10-24T02:03:18.955078+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934801+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:17.934801+0000","last_peered":"2023-10-24T02:03:17.934801+0000","last_clean":"2023-10-24T02:03:17.934801+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:17.934801+0000","last_undegraded":"2023-10-24T02:03:17.934801+0000","last_fullsized":"2023-10-24T02:03:17.934801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2674688,"data_stored":1366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.50600000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575976,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.502}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46500000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.26000000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.627},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.435},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61599999999999999,"15min":0.67600000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.438}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.57999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.35899999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.31}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60999999999999999,"15min":0.752},"last":0.24199999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":0.52100000000000002,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.64600000000000002},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.499,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54100000000000004,"5min":0.63,"15min":0.72799999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":1.097},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.88600000000000001,"15min":1.167},"last":0.34100000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":1.056},"last":0.505},{"interface":"front","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.88500000000000001,"15min":1.109},"last":0.36399999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.91700000000000004,"15min":1.083},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.437,"15min":0.437},"max":{"1min":0.81599999999999995,"5min":0.92600000000000005,"15min":1.155},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.441},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.433}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.49399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.36499999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:22.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3c is not active+clean 2023-10-24T02:03:22.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.948730+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:03:22.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3d is not active+clean 2023-10-24T02:03:22.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.941835+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:03:22.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3e is not active+clean 2023-10-24T02:03:22.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946425+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:22.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3f is not active+clean 2023-10-24T02:03:22.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946211+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:22.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.38 is not active+clean 2023-10-24T02:03:22.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938439+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:22.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.39 is not active+clean 2023-10-24T02:03:22.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.941406+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:22.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3a is not active+clean 2023-10-24T02:03:22.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942385+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:22.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3b is not active+clean 2023-10-24T02:03:22.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942291+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:22.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.34 is not active+clean 2023-10-24T02:03:23.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.948296+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:03:23.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.35 is not active+clean 2023-10-24T02:03:23.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.950191+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.36 is not active+clean 2023-10-24T02:03:23.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942875+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.37 is not active+clean 2023-10-24T02:03:23.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945804+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.30 is not active+clean 2023-10-24T02:03:23.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.943416+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.31 is not active+clean 2023-10-24T02:03:23.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946187+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.32 is not active+clean 2023-10-24T02:03:23.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.941468+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.33 is not active+clean 2023-10-24T02:03:23.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.948739+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2c is not active+clean 2023-10-24T02:03:23.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.943122+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2d is not active+clean 2023-10-24T02:03:23.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946639+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2e is not active+clean 2023-10-24T02:03:23.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946951+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2f is not active+clean 2023-10-24T02:03:23.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.941812+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.28 is not active+clean 2023-10-24T02:03:23.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.944117+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.29 is not active+clean 2023-10-24T02:03:23.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938047+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2a is not active+clean 2023-10-24T02:03:23.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945460+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2b is not active+clean 2023-10-24T02:03:23.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945861+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.24 is not active+clean 2023-10-24T02:03:23.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942309+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.25 is not active+clean 2023-10-24T02:03:23.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938514+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.26 is not active+clean 2023-10-24T02:03:23.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.948092+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.27 is not active+clean 2023-10-24T02:03:23.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938989+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.20 is not active+clean 2023-10-24T02:03:23.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942616+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.21 is not active+clean 2023-10-24T02:03:23.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938968+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.22 is not active+clean 2023-10-24T02:03:23.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.949317+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.23 is not active+clean 2023-10-24T02:03:23.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.949068+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.14 is not active+clean 2023-10-24T02:03:23.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938381+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.15 is not active+clean 2023-10-24T02:03:23.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938966+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.16 is not active+clean 2023-10-24T02:03:23.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945718+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.17 is not active+clean 2023-10-24T02:03:23.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942879+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.10 is not active+clean 2023-10-24T02:03:23.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.939720+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.11 is not active+clean 2023-10-24T02:03:23.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938394+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.12 is not active+clean 2023-10-24T02:03:23.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945329+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.13 is not active+clean 2023-10-24T02:03:23.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.945982+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.c is not active+clean 2023-10-24T02:03:23.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.940348+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.d is not active+clean 2023-10-24T02:03:23.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938338+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.e is not active+clean 2023-10-24T02:03:23.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.947708+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.f is not active+clean 2023-10-24T02:03:23.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942314+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.8 is not active+clean 2023-10-24T02:03:23.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942012+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.9 is not active+clean 2023-10-24T02:03:23.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946373+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:03:23.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.a is not active+clean 2023-10-24T02:03:23.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.951289+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-24T02:03:23.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.b is not active+clean 2023-10-24T02:03:23.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938339+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-24T02:03:23.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.4 is not active+clean 2023-10-24T02:03:23.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.940728+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.5 is not active+clean 2023-10-24T02:03:23.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942181+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.6 is not active+clean 2023-10-24T02:03:23.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938512+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.7 is not active+clean 2023-10-24T02:03:23.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.939401+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.0 is not active+clean 2023-10-24T02:03:23.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942937+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:03:23.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1 is not active+clean 2023-10-24T02:03:23.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.946965+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2 is not active+clean 2023-10-24T02:03:23.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.944473+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3 is not active+clean 2023-10-24T02:03:23.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938138+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1c is not active+clean 2023-10-24T02:03:23.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938965+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-24T02:03:23.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1a is not active+clean 2023-10-24T02:03:23.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.944922+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.19 is not active+clean 2023-10-24T02:03:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.943642+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-24T02:03:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1b is not active+clean 2023-10-24T02:03:23.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.943235+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:03:23.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.18 is not active+clean 2023-10-24T02:03:23.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.947175+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-24T02:03:23.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1d is not active+clean 2023-10-24T02:03:23.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.938761+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-24T02:03:23.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1e is not active+clean 2023-10-24T02:03:23.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.944811+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-24T02:03:23.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1f is not active+clean 2023-10-24T02:03:23.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-24T02:03:18.930100+0000', 'last_change': '2023-10-24T02:03:18.942958+0000', 'last_active': '2023-10-24T02:03:18.930100+0000', 'last_peered': '2023-10-24T02:03:18.930100+0000', 'last_clean': '2023-10-24T02:03:18.930100+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-24T02:03:18.930100+0000', 'last_undegraded': '2023-10-24T02:03:18.930100+0000', 'last_fullsized': '2023-10-24T02:03:18.930100+0000', 'mapping_epoch': 214, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 214, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'last_clean_scrub_stamp': '2023-10-24T02:03:18.930100+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-24T02:03:23.040 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-24T02:03:23.152 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.151+0000 7fa4e6f4d700 1 Processor -- start 2023-10-24T02:03:23.153 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.151+0000 7fa4e6f4d700 1 -- start start 2023-10-24T02:03:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e6f4d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa4e00c07e0 0x7fa4e00c0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.155 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e6f4d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa4e00c68a0 0x7fa4e00c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e6f4d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e00c1180 con 0x7fa4e00aa140 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e6f4d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00c6410 con 0x7fa4e00c68a0 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e6f4d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00ca6e0 con 0x7fa4e00c07e0 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e5f4b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa4e00aa140 0x7fa4e00c9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:48508/0 (socket says 172.21.15.148:48508) 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e5f4b700 1 -- 172.21.15.148:0/3171488198 learned_addr learned my addr 172.21.15.148:0/3171488198 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:23.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e674c700 1 --2- 172.21.15.148:0/3171488198 >> v2:172.21.15.148:3300/0 conn(0x7fa4e00c68a0 0x7fa4e00c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e574a700 1 --2- 172.21.15.148:0/3171488198 >> v2:172.21.15.150:3300/0 conn(0x7fa4e00c07e0 0x7fa4e00c0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e4f49700 1 -- 172.21.15.148:0/3171488198 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190278200 0 0) 0x7fa4dc001110 con 0x7fa4e00aa140 2023-10-24T02:03:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e4f49700 1 -- 172.21.15.148:0/3171488198 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc0033f0 con 0x7fa4e00aa140 2023-10-24T02:03:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.152+0000 7fa4e674c700 1 -- 172.21.15.148:0/3171488198 >> v2:172.21.15.150:3300/0 conn(0x7fa4e00c07e0 msgr2=0x7fa4e00c0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:23.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e674c700 1 --2- 172.21.15.148:0/3171488198 >> v2:172.21.15.150:3300/0 conn(0x7fa4e00c07e0 0x7fa4e00c0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e674c700 1 -- 172.21.15.148:0/3171488198 >> v1:172.21.15.148:6789/0 conn(0x7fa4e00aa140 legacy=0x7fa4e00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e674c700 1 -- 172.21.15.148:0/3171488198 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00ca9c0 con 0x7fa4e00c68a0 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e674c700 1 --2- 172.21.15.148:0/3171488198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c68a0 0x7fa4e00c6cd0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fa4e0085440 tx=0x7fa4d8009780).ready entity=mon.0 client_cookie=68f9f934c2c99a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e4f49700 1 -- 172.21.15.148:0/3171488198 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800e070 con 0x7fa4e00c68a0 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e4f49700 1 -- 172.21.15.148:0/3171488198 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800bab0 con 0x7fa4e00c68a0 2023-10-24T02:03:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e4f49700 1 -- 172.21.15.148:0/3171488198 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800be30 con 0x7fa4e00c68a0 2023-10-24T02:03:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/3171488198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c68a0 msgr2=0x7fa4e00c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/3171488198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c68a0 0x7fa4e00c6cd0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fa4e0085440 tx=0x7fa4d8009780).stop 2023-10-24T02:03:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/3171488198 shutdown_connections 2023-10-24T02:03:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/3171488198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c68a0 0x7fa4e00c6cd0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/3171488198 >> v2:172.21.15.150:3300/0 conn(0x7fa4e00c07e0 0x7fa4e00c0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/3171488198 >> 172.21.15.148:0/3171488198 conn(0x7fa4e00944a0 msgr2=0x7fa4e006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/3171488198 shutdown_connections 2023-10-24T02:03:23.160 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.153+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/3171488198 wait complete. 2023-10-24T02:03:23.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 Processor -- start 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 -- start start 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e00aa140 0x7fa4e00ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4e00c68a0 0x7fa4e0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00afe20 con 0x7fa4e00c07e0 2023-10-24T02:03:23.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00aed80 con 0x7fa4e00aa140 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e6f4d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00af060 con 0x7fa4e00c68a0 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e574a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e574a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38240/0 (socket says 172.21.15.148:38240) 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.155+0000 7fa4e574a700 1 -- 172.21.15.148:0/282355700 learned_addr learned my addr 172.21.15.148:0/282355700 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e5f4b700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e00aa140 0x7fa4e00ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e674c700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4e00c68a0 0x7fa4e0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 -- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4e00c68a0 msgr2=0x7fa4e0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4e00c68a0 0x7fa4e0151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 -- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e00aa140 msgr2=0x7fa4e00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e00aa140 0x7fa4e00ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 -- 172.21.15.148:0/282355700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009a20 con 0x7fa4e00c07e0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e574a700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fa4d000e930 tx=0x7fa4d0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0012600 con 0x7fa4e00c07e0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0012760 con 0x7fa4e00c07e0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e00af340 con 0x7fa4e00c07e0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0012ae0 con 0x7fa4e00c07e0 2023-10-24T02:03:23.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.156+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e00af900 con 0x7fa4e00c07e0 2023-10-24T02:03:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.157+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0047480 con 0x7fa4e00c07e0 2023-10-24T02:03:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.157+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa4d001b400 con 0x7fa4e00c07e0 2023-10-24T02:03:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.158+0000 7fa4d5ffb700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 0x7fa4c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.158+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fa4d007a600 con 0x7fa4e00c07e0 2023-10-24T02:03:23.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.158+0000 7fa4e5f4b700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 0x7fa4c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.158+0000 7fa4e5f4b700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 0x7fa4c4061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa4dc001270 tx=0x7fa4dc007a70).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.162+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa4d004b840 con 0x7fa4e00c07e0 2023-10-24T02:03:23.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.388+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa4e00c60a0 con 0x7fa4e00c07e0 2023-10-24T02:03:23.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.388+0000 7fa4d5ffb700 1 -- 172.21.15.148:0/282355700 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1039 (secure 0 0 0) 0x7fa4d004ee60 con 0x7fa4e00c07e0 2023-10-24T02:03:23.390 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:23.391 INFO:teuthology.orchestra.run.smithi148.stdout:{"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5687,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":216,"num_osds":8,"num_up_osds":8,"osd_up_since":1698107325,"num_in_osds":8,"osd_in_since":1698107318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"creating+peering","count":64}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2513842176,"bytes_avail":770580271104,"bytes_total":773094113280,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":74,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"b","status":"up:active","gid":10194}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-24T02:02:53.138053+0000","services":{}},"progress_events":{}} 2023-10-24T02:03:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 msgr2=0x7fa4c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 0x7fa4c4061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa4dc001270 tx=0x7fa4dc007a70).stop 2023-10-24T02:03:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 msgr2=0x7fa4e00b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fa4d000e930 tx=0x7fa4d0009060).stop 2023-10-24T02:03:23.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 shutdown_connections 2023-10-24T02:03:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa4e00c68a0 0x7fa4e0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa4c405f150 0x7fa4c4061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4e00aa140 0x7fa4e00ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 --2- 172.21.15.148:0/282355700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4e00c07e0 0x7fa4e00b0840 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 >> 172.21.15.148:0/282355700 conn(0x7fa4e00944a0 msgr2=0x7fa4e0152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:23.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 shutdown_connections 2023-10-24T02:03:23.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.390+0000 7fa4e6f4d700 1 -- 172.21.15.148:0/282355700 wait complete. 2023-10-24T02:03:23.404 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-24T02:03:23.404 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.516+0000 7f52193b6700 1 Processor -- start 2023-10-24T02:03:23.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.516+0000 7f52193b6700 1 -- start start 2023-10-24T02:03:23.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52193b6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52140be650 0x7f52140a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52193b6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f52140a8260 0x7f52140a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52193b6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140a8710 con 0x7f5214154540 2023-10-24T02:03:23.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52193b6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140a5bd0 con 0x7f52140be650 2023-10-24T02:03:23.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52193b6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5214064ab0 con 0x7f52140a8260 2023-10-24T02:03:23.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f520a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52140be650 0x7f52140a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f520a7fc700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f52140be650 0x7f52140a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60782/0 (socket says 172.21.15.148:60782) 2023-10-24T02:03:23.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f520a7fc700 1 -- 172.21.15.148:0/4258772308 learned_addr learned my addr 172.21.15.148:0/4258772308 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:23.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.517+0000 7f52137fe700 1 --2- 172.21.15.148:0/4258772308 >> v2:172.21.15.150:3300/0 conn(0x7f52140a8260 0x7f52140a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f520a7fc700 1 -- 172.21.15.148:0/4258772308 >> v2:172.21.15.150:3300/0 conn(0x7f52140a8260 msgr2=0x7f52140a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:23.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f520a7fc700 1 --2- 172.21.15.148:0/4258772308 >> v2:172.21.15.150:3300/0 conn(0x7f52140a8260 0x7f52140a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f520a7fc700 1 -- 172.21.15.148:0/4258772308 >> v1:172.21.15.150:6789/0 conn(0x7f5214154540 legacy=0x7f52140640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:23.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f520a7fc700 1 -- 172.21.15.148:0/4258772308 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214064d90 con 0x7f52140be650 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f520a7fc700 1 --2- 172.21.15.148:0/4258772308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52140be650 0x7f52140a7d70 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f5214092b90 tx=0x7f51fc0090f0).ready entity=mon.0 client_cookie=1e8ee943f6ad9aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52127fc700 1 -- 172.21.15.148:0/4258772308 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00b600 con 0x7f52140be650 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52127fc700 1 -- 172.21.15.148:0/4258772308 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00b760 con 0x7f52140be650 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52127fc700 1 -- 172.21.15.148:0/4258772308 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00bae0 con 0x7f52140be650 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 -- 172.21.15.148:0/4258772308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52140be650 msgr2=0x7f52140a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 --2- 172.21.15.148:0/4258772308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52140be650 0x7f52140a7d70 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f5214092b90 tx=0x7f51fc0090f0).stop 2023-10-24T02:03:23.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 -- 172.21.15.148:0/4258772308 shutdown_connections 2023-10-24T02:03:23.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 --2- 172.21.15.148:0/4258772308 >> v2:172.21.15.150:3300/0 conn(0x7f52140a8260 0x7f52140a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 --2- 172.21.15.148:0/4258772308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52140be650 0x7f52140a7d70 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 -- 172.21.15.148:0/4258772308 >> 172.21.15.148:0/4258772308 conn(0x7f5214092480 msgr2=0x7f5214062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:23.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 -- 172.21.15.148:0/4258772308 shutdown_connections 2023-10-24T02:03:23.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.518+0000 7f52193b6700 1 -- 172.21.15.148:0/4258772308 wait complete. 2023-10-24T02:03:23.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 Processor -- start 2023-10-24T02:03:23.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 -- start start 2023-10-24T02:03:23.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52140a8260 0x7f52141647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140be650 0x7f52140c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521414aa10 con 0x7f5214154540 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c4f30 con 0x7f52140a8260 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.520+0000 7f52193b6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5214164df0 con 0x7f52140be650 2023-10-24T02:03:23.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60798/0 (socket says 172.21.15.148:60798) 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 -- 172.21.15.148:0/3452177580 learned_addr learned my addr 172.21.15.148:0/3452177580 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f520a7fc700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140be650 0x7f52140c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f5212ffd700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52140a8260 0x7f52141647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 -- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140be650 msgr2=0x7f52140c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140be650 0x7f52140c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 -- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52140a8260 msgr2=0x7f52141647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52140a8260 0x7f52141647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 -- 172.21.15.148:0/3452177580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009370 con 0x7f5214154540 2023-10-24T02:03:23.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52137fe700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f520c007f20 tx=0x7f520c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c00eb90 con 0x7f5214154540 2023-10-24T02:03:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c00ecf0 con 0x7f5214154540 2023-10-24T02:03:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c014610 con 0x7f5214154540 2023-10-24T02:03:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52141650d0 con 0x7f5214154540 2023-10-24T02:03:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.521+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5214165690 con 0x7f5214154540 2023-10-24T02:03:23.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.522+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521406c6b0 con 0x7f5214154540 2023-10-24T02:03:23.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.522+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f520c014980 con 0x7f5214154540 2023-10-24T02:03:23.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.523+0000 7f520b7fe700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 0x7f51f4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:23.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.523+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f520c07a680 con 0x7f5214154540 2023-10-24T02:03:23.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.523+0000 7f5212ffd700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 0x7f51f4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:23.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.523+0000 7f5212ffd700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 0x7f51f4061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f52141530f0 tx=0x7f5204009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:23.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.527+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f520c04b920 con 0x7f5214154540 2023-10-24T02:03:23.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.688+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5214065070 con 0x7f51f405f150 2023-10-24T02:03:23.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.698+0000 7f520b7fe700 1 -- 172.21.15.148:0/3452177580 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358732 (secure 0 0 0) 0x7f5214065070 con 0x7f51f405f150 2023-10-24T02:03:23.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:23.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 msgr2=0x7f51f4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 0x7f51f4061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f52141530f0 tx=0x7f5204009040).stop 2023-10-24T02:03:23.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 msgr2=0x7f52140c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:23.707 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7f520c007f20 tx=0x7f520c009860).stop 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 shutdown_connections 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5214154540 0x7f52140c8290 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f51f405f150 0x7f51f4061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52140a8260 0x7f52141647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 --2- 172.21.15.148:0/3452177580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52140be650 0x7f52140c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:23.708 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 >> 172.21.15.148:0/3452177580 conn(0x7f5214092480 msgr2=0x7f5214067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:23.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 shutdown_connections 2023-10-24T02:03:23.709 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:23.702+0000 7f52193b6700 1 -- 172.21.15.148:0/3452177580 wait complete. 2023-10-24T02:03:23.709 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:23.715 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T02:03:22.190551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454924,"kb_used_data":20812,"kb_used_omap":0,"kb_used_meta":2434048,"kb_avail":752519796,"statfs":{"total":773094113280,"available":770580271104,"internally_reserved":0,"allocated":21311488,"data_stored":10882211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2492465152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28002,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998190"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948730+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960697+0000","last_change":"2023-10-24T02:03:18.960697+0000","last_active":"2023-10-24T02:03:18.960697+0000","last_peered":"2023-10-24T02:03:18.960697+0000","last_clean":"2023-10-24T02:03:18.960697+0000","last_became_active":"2023-10-24T02:03:18.960308+0000","last_became_peered":"2023-10-24T02:03:18.960308+0000","last_unstale":"2023-10-24T02:03:18.960697+0000","last_undegraded":"2023-10-24T02:03:18.960697+0000","last_fullsized":"2023-10-24T02:03:18.960697+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941835+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954224+0000","last_change":"2023-10-24T02:03:18.954224+0000","last_active":"2023-10-24T02:03:18.954224+0000","last_peered":"2023-10-24T02:03:18.954224+0000","last_clean":"2023-10-24T02:03:18.954224+0000","last_became_active":"2023-10-24T02:03:18.953951+0000","last_became_peered":"2023-10-24T02:03:18.953951+0000","last_unstale":"2023-10-24T02:03:18.954224+0000","last_undegraded":"2023-10-24T02:03:18.954224+0000","last_fullsized":"2023-10-24T02:03:18.954224+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946425+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961632+0000","last_change":"2023-10-24T02:03:18.961632+0000","last_active":"2023-10-24T02:03:18.961632+0000","last_peered":"2023-10-24T02:03:18.961632+0000","last_clean":"2023-10-24T02:03:18.961632+0000","last_became_active":"2023-10-24T02:03:18.961285+0000","last_became_peered":"2023-10-24T02:03:18.961285+0000","last_unstale":"2023-10-24T02:03:18.961632+0000","last_undegraded":"2023-10-24T02:03:18.961632+0000","last_fullsized":"2023-10-24T02:03:18.961632+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946211+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.948595+0000","last_change":"2023-10-24T02:03:18.948595+0000","last_active":"2023-10-24T02:03:18.948595+0000","last_peered":"2023-10-24T02:03:18.948595+0000","last_clean":"2023-10-24T02:03:18.948595+0000","last_became_active":"2023-10-24T02:03:18.948274+0000","last_became_peered":"2023-10-24T02:03:18.948274+0000","last_unstale":"2023-10-24T02:03:18.948595+0000","last_undegraded":"2023-10-24T02:03:18.948595+0000","last_fullsized":"2023-10-24T02:03:18.948595+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938439+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954687+0000","last_change":"2023-10-24T02:03:18.954687+0000","last_active":"2023-10-24T02:03:18.954687+0000","last_peered":"2023-10-24T02:03:18.954687+0000","last_clean":"2023-10-24T02:03:18.954687+0000","last_became_active":"2023-10-24T02:03:18.954415+0000","last_became_peered":"2023-10-24T02:03:18.954415+0000","last_unstale":"2023-10-24T02:03:18.954687+0000","last_undegraded":"2023-10-24T02:03:18.954687+0000","last_fullsized":"2023-10-24T02:03:18.954687+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941406+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955738+0000","last_change":"2023-10-24T02:03:18.955738+0000","last_active":"2023-10-24T02:03:18.955738+0000","last_peered":"2023-10-24T02:03:18.955738+0000","last_clean":"2023-10-24T02:03:18.955738+0000","last_became_active":"2023-10-24T02:03:18.955455+0000","last_became_peered":"2023-10-24T02:03:18.955455+0000","last_unstale":"2023-10-24T02:03:18.955738+0000","last_undegraded":"2023-10-24T02:03:18.955738+0000","last_fullsized":"2023-10-24T02:03:18.955738+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942385+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959944+0000","last_change":"2023-10-24T02:03:18.959944+0000","last_active":"2023-10-24T02:03:18.959944+0000","last_peered":"2023-10-24T02:03:18.959944+0000","last_clean":"2023-10-24T02:03:18.959944+0000","last_became_active":"2023-10-24T02:03:18.959611+0000","last_became_peered":"2023-10-24T02:03:18.959611+0000","last_unstale":"2023-10-24T02:03:18.959944+0000","last_undegraded":"2023-10-24T02:03:18.959944+0000","last_fullsized":"2023-10-24T02:03:18.959944+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942291+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950385+0000","last_change":"2023-10-24T02:03:18.950385+0000","last_active":"2023-10-24T02:03:18.950385+0000","last_peered":"2023-10-24T02:03:18.950385+0000","last_clean":"2023-10-24T02:03:18.950385+0000","last_became_active":"2023-10-24T02:03:18.950119+0000","last_became_peered":"2023-10-24T02:03:18.950119+0000","last_unstale":"2023-10-24T02:03:18.950385+0000","last_undegraded":"2023-10-24T02:03:18.950385+0000","last_fullsized":"2023-10-24T02:03:18.950385+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948296+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957027+0000","last_change":"2023-10-24T02:03:18.957027+0000","last_active":"2023-10-24T02:03:18.957027+0000","last_peered":"2023-10-24T02:03:18.957027+0000","last_clean":"2023-10-24T02:03:18.957027+0000","last_became_active":"2023-10-24T02:03:18.956564+0000","last_became_peered":"2023-10-24T02:03:18.956564+0000","last_unstale":"2023-10-24T02:03:18.957027+0000","last_undegraded":"2023-10-24T02:03:18.957027+0000","last_fullsized":"2023-10-24T02:03:18.957027+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.950191+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958302+0000","last_change":"2023-10-24T02:03:18.958302+0000","last_active":"2023-10-24T02:03:18.958302+0000","last_peered":"2023-10-24T02:03:18.958302+0000","last_clean":"2023-10-24T02:03:18.958302+0000","last_became_active":"2023-10-24T02:03:18.956921+0000","last_became_peered":"2023-10-24T02:03:18.956921+0000","last_unstale":"2023-10-24T02:03:18.958302+0000","last_undegraded":"2023-10-24T02:03:18.958302+0000","last_fullsized":"2023-10-24T02:03:18.958302+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942875+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955357+0000","last_change":"2023-10-24T02:03:18.955357+0000","last_active":"2023-10-24T02:03:18.955357+0000","last_peered":"2023-10-24T02:03:18.955357+0000","last_clean":"2023-10-24T02:03:18.955357+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955357+0000","last_undegraded":"2023-10-24T02:03:18.955357+0000","last_fullsized":"2023-10-24T02:03:18.955357+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945804+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953879+0000","last_change":"2023-10-24T02:03:18.953879+0000","last_active":"2023-10-24T02:03:18.953879+0000","last_peered":"2023-10-24T02:03:18.953879+0000","last_clean":"2023-10-24T02:03:18.953879+0000","last_became_active":"2023-10-24T02:03:18.953399+0000","last_became_peered":"2023-10-24T02:03:18.953399+0000","last_unstale":"2023-10-24T02:03:18.953879+0000","last_undegraded":"2023-10-24T02:03:18.953879+0000","last_fullsized":"2023-10-24T02:03:18.953879+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943416+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952773+0000","last_change":"2023-10-24T02:03:18.952773+0000","last_active":"2023-10-24T02:03:18.952773+0000","last_peered":"2023-10-24T02:03:18.952773+0000","last_clean":"2023-10-24T02:03:18.952773+0000","last_became_active":"2023-10-24T02:03:18.952455+0000","last_became_peered":"2023-10-24T02:03:18.952455+0000","last_unstale":"2023-10-24T02:03:18.952773+0000","last_undegraded":"2023-10-24T02:03:18.952773+0000","last_fullsized":"2023-10-24T02:03:18.952773+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946187+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960004+0000","last_became_peered":"2023-10-24T02:03:18.960004+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941468+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953693+0000","last_change":"2023-10-24T02:03:18.953693+0000","last_active":"2023-10-24T02:03:18.953693+0000","last_peered":"2023-10-24T02:03:18.953693+0000","last_clean":"2023-10-24T02:03:18.953693+0000","last_became_active":"2023-10-24T02:03:18.952846+0000","last_became_peered":"2023-10-24T02:03:18.952846+0000","last_unstale":"2023-10-24T02:03:18.953693+0000","last_undegraded":"2023-10-24T02:03:18.953693+0000","last_fullsized":"2023-10-24T02:03:18.953693+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948739+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954593+0000","last_change":"2023-10-24T02:03:18.954593+0000","last_active":"2023-10-24T02:03:18.954593+0000","last_peered":"2023-10-24T02:03:18.954593+0000","last_clean":"2023-10-24T02:03:18.954593+0000","last_became_active":"2023-10-24T02:03:18.954332+0000","last_became_peered":"2023-10-24T02:03:18.954332+0000","last_unstale":"2023-10-24T02:03:18.954593+0000","last_undegraded":"2023-10-24T02:03:18.954593+0000","last_fullsized":"2023-10-24T02:03:18.954593+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943122+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954493+0000","last_change":"2023-10-24T02:03:18.954493+0000","last_active":"2023-10-24T02:03:18.954493+0000","last_peered":"2023-10-24T02:03:18.954493+0000","last_clean":"2023-10-24T02:03:18.954493+0000","last_became_active":"2023-10-24T02:03:18.954206+0000","last_became_peered":"2023-10-24T02:03:18.954206+0000","last_unstale":"2023-10-24T02:03:18.954493+0000","last_undegraded":"2023-10-24T02:03:18.954493+0000","last_fullsized":"2023-10-24T02:03:18.954493+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946639+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960289+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:18.960289+0000","last_peered":"2023-10-24T02:03:18.960289+0000","last_clean":"2023-10-24T02:03:18.960289+0000","last_became_active":"2023-10-24T02:03:18.960005+0000","last_became_peered":"2023-10-24T02:03:18.960005+0000","last_unstale":"2023-10-24T02:03:18.960289+0000","last_undegraded":"2023-10-24T02:03:18.960289+0000","last_fullsized":"2023-10-24T02:03:18.960289+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946951+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958037+0000","last_change":"2023-10-24T02:03:18.958037+0000","last_active":"2023-10-24T02:03:18.958037+0000","last_peered":"2023-10-24T02:03:18.958037+0000","last_clean":"2023-10-24T02:03:18.958037+0000","last_became_active":"2023-10-24T02:03:18.957793+0000","last_became_peered":"2023-10-24T02:03:18.957793+0000","last_unstale":"2023-10-24T02:03:18.958037+0000","last_undegraded":"2023-10-24T02:03:18.958037+0000","last_fullsized":"2023-10-24T02:03:18.958037+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.941812+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954035+0000","last_change":"2023-10-24T02:03:18.954035+0000","last_active":"2023-10-24T02:03:18.954035+0000","last_peered":"2023-10-24T02:03:18.954035+0000","last_clean":"2023-10-24T02:03:18.954035+0000","last_became_active":"2023-10-24T02:03:18.953757+0000","last_became_peered":"2023-10-24T02:03:18.953757+0000","last_unstale":"2023-10-24T02:03:18.954035+0000","last_undegraded":"2023-10-24T02:03:18.954035+0000","last_fullsized":"2023-10-24T02:03:18.954035+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944117+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953464+0000","last_change":"2023-10-24T02:03:18.953464+0000","last_active":"2023-10-24T02:03:18.953464+0000","last_peered":"2023-10-24T02:03:18.953464+0000","last_clean":"2023-10-24T02:03:18.953464+0000","last_became_active":"2023-10-24T02:03:18.953155+0000","last_became_peered":"2023-10-24T02:03:18.953155+0000","last_unstale":"2023-10-24T02:03:18.953464+0000","last_undegraded":"2023-10-24T02:03:18.953464+0000","last_fullsized":"2023-10-24T02:03:18.953464+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938047+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.964197+0000","last_change":"2023-10-24T02:03:18.964197+0000","last_active":"2023-10-24T02:03:18.964197+0000","last_peered":"2023-10-24T02:03:18.964197+0000","last_clean":"2023-10-24T02:03:18.964197+0000","last_became_active":"2023-10-24T02:03:18.963936+0000","last_became_peered":"2023-10-24T02:03:18.963936+0000","last_unstale":"2023-10-24T02:03:18.964197+0000","last_undegraded":"2023-10-24T02:03:18.964197+0000","last_fullsized":"2023-10-24T02:03:18.964197+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945460+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961462+0000","last_change":"2023-10-24T02:03:18.961462+0000","last_active":"2023-10-24T02:03:18.961462+0000","last_peered":"2023-10-24T02:03:18.961462+0000","last_clean":"2023-10-24T02:03:18.961462+0000","last_became_active":"2023-10-24T02:03:18.961159+0000","last_became_peered":"2023-10-24T02:03:18.961159+0000","last_unstale":"2023-10-24T02:03:18.961462+0000","last_undegraded":"2023-10-24T02:03:18.961462+0000","last_fullsized":"2023-10-24T02:03:18.961462+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945861+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949485+0000","last_change":"2023-10-24T02:03:18.949485+0000","last_active":"2023-10-24T02:03:18.949485+0000","last_peered":"2023-10-24T02:03:18.949485+0000","last_clean":"2023-10-24T02:03:18.949485+0000","last_became_active":"2023-10-24T02:03:18.949208+0000","last_became_peered":"2023-10-24T02:03:18.949208+0000","last_unstale":"2023-10-24T02:03:18.949485+0000","last_undegraded":"2023-10-24T02:03:18.949485+0000","last_fullsized":"2023-10-24T02:03:18.949485+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942309+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957342+0000","last_change":"2023-10-24T02:03:18.957342+0000","last_active":"2023-10-24T02:03:18.957342+0000","last_peered":"2023-10-24T02:03:18.957342+0000","last_clean":"2023-10-24T02:03:18.957342+0000","last_became_active":"2023-10-24T02:03:18.957072+0000","last_became_peered":"2023-10-24T02:03:18.957072+0000","last_unstale":"2023-10-24T02:03:18.957342+0000","last_undegraded":"2023-10-24T02:03:18.957342+0000","last_fullsized":"2023-10-24T02:03:18.957342+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938514+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959865+0000","last_change":"2023-10-24T02:03:18.959865+0000","last_active":"2023-10-24T02:03:18.959865+0000","last_peered":"2023-10-24T02:03:18.959865+0000","last_clean":"2023-10-24T02:03:18.959865+0000","last_became_active":"2023-10-24T02:03:18.959532+0000","last_became_peered":"2023-10-24T02:03:18.959532+0000","last_unstale":"2023-10-24T02:03:18.959865+0000","last_undegraded":"2023-10-24T02:03:18.959865+0000","last_fullsized":"2023-10-24T02:03:18.959865+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.948092+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955695+0000","last_change":"2023-10-24T02:03:18.955695+0000","last_active":"2023-10-24T02:03:18.955695+0000","last_peered":"2023-10-24T02:03:18.955695+0000","last_clean":"2023-10-24T02:03:18.955695+0000","last_became_active":"2023-10-24T02:03:18.955414+0000","last_became_peered":"2023-10-24T02:03:18.955414+0000","last_unstale":"2023-10-24T02:03:18.955695+0000","last_undegraded":"2023-10-24T02:03:18.955695+0000","last_fullsized":"2023-10-24T02:03:18.955695+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938989+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960459+0000","last_change":"2023-10-24T02:03:18.960459+0000","last_active":"2023-10-24T02:03:18.960459+0000","last_peered":"2023-10-24T02:03:18.960459+0000","last_clean":"2023-10-24T02:03:18.960459+0000","last_became_active":"2023-10-24T02:03:18.959875+0000","last_became_peered":"2023-10-24T02:03:18.959875+0000","last_unstale":"2023-10-24T02:03:18.960459+0000","last_undegraded":"2023-10-24T02:03:18.960459+0000","last_fullsized":"2023-10-24T02:03:18.960459+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942616+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953320+0000","last_change":"2023-10-24T02:03:18.953320+0000","last_active":"2023-10-24T02:03:18.953320+0000","last_peered":"2023-10-24T02:03:18.953320+0000","last_clean":"2023-10-24T02:03:18.953320+0000","last_became_active":"2023-10-24T02:03:18.953054+0000","last_became_peered":"2023-10-24T02:03:18.953054+0000","last_unstale":"2023-10-24T02:03:18.953320+0000","last_undegraded":"2023-10-24T02:03:18.953320+0000","last_fullsized":"2023-10-24T02:03:18.953320+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938968+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957976+0000","last_change":"2023-10-24T02:03:18.957976+0000","last_active":"2023-10-24T02:03:18.957976+0000","last_peered":"2023-10-24T02:03:18.957976+0000","last_clean":"2023-10-24T02:03:18.957976+0000","last_became_active":"2023-10-24T02:03:18.957677+0000","last_became_peered":"2023-10-24T02:03:18.957677+0000","last_unstale":"2023-10-24T02:03:18.957976+0000","last_undegraded":"2023-10-24T02:03:18.957976+0000","last_fullsized":"2023-10-24T02:03:18.957976+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949317+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956247+0000","last_change":"2023-10-24T02:03:18.956247+0000","last_active":"2023-10-24T02:03:18.956247+0000","last_peered":"2023-10-24T02:03:18.956247+0000","last_clean":"2023-10-24T02:03:18.956247+0000","last_became_active":"2023-10-24T02:03:18.955992+0000","last_became_peered":"2023-10-24T02:03:18.955992+0000","last_unstale":"2023-10-24T02:03:18.956247+0000","last_undegraded":"2023-10-24T02:03:18.956247+0000","last_fullsized":"2023-10-24T02:03:18.956247+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.949068+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954814+0000","last_change":"2023-10-24T02:03:18.954814+0000","last_active":"2023-10-24T02:03:18.954814+0000","last_peered":"2023-10-24T02:03:18.954814+0000","last_clean":"2023-10-24T02:03:18.954814+0000","last_became_active":"2023-10-24T02:03:18.954573+0000","last_became_peered":"2023-10-24T02:03:18.954573+0000","last_unstale":"2023-10-24T02:03:18.954814+0000","last_undegraded":"2023-10-24T02:03:18.954814+0000","last_fullsized":"2023-10-24T02:03:18.954814+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938381+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959730+0000","last_change":"2023-10-24T02:03:18.959730+0000","last_active":"2023-10-24T02:03:18.959730+0000","last_peered":"2023-10-24T02:03:18.959730+0000","last_clean":"2023-10-24T02:03:18.959730+0000","last_became_active":"2023-10-24T02:03:18.959495+0000","last_became_peered":"2023-10-24T02:03:18.959495+0000","last_unstale":"2023-10-24T02:03:18.959730+0000","last_undegraded":"2023-10-24T02:03:18.959730+0000","last_fullsized":"2023-10-24T02:03:18.959730+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938966+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960384+0000","last_change":"2023-10-24T02:03:18.960384+0000","last_active":"2023-10-24T02:03:18.960384+0000","last_peered":"2023-10-24T02:03:18.960384+0000","last_clean":"2023-10-24T02:03:18.960384+0000","last_became_active":"2023-10-24T02:03:18.960105+0000","last_became_peered":"2023-10-24T02:03:18.960105+0000","last_unstale":"2023-10-24T02:03:18.960384+0000","last_undegraded":"2023-10-24T02:03:18.960384+0000","last_fullsized":"2023-10-24T02:03:18.960384+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945718+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956077+0000","last_change":"2023-10-24T02:03:18.956077+0000","last_active":"2023-10-24T02:03:18.956077+0000","last_peered":"2023-10-24T02:03:18.956077+0000","last_clean":"2023-10-24T02:03:18.956077+0000","last_became_active":"2023-10-24T02:03:18.955798+0000","last_became_peered":"2023-10-24T02:03:18.955798+0000","last_unstale":"2023-10-24T02:03:18.956077+0000","last_undegraded":"2023-10-24T02:03:18.956077+0000","last_fullsized":"2023-10-24T02:03:18.956077+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942879+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957635+0000","last_change":"2023-10-24T02:03:18.957635+0000","last_active":"2023-10-24T02:03:18.957635+0000","last_peered":"2023-10-24T02:03:18.957635+0000","last_clean":"2023-10-24T02:03:18.957635+0000","last_became_active":"2023-10-24T02:03:18.957339+0000","last_became_peered":"2023-10-24T02:03:18.957339+0000","last_unstale":"2023-10-24T02:03:18.957635+0000","last_undegraded":"2023-10-24T02:03:18.957635+0000","last_fullsized":"2023-10-24T02:03:18.957635+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939720+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958287+0000","last_change":"2023-10-24T02:03:18.958287+0000","last_active":"2023-10-24T02:03:18.958287+0000","last_peered":"2023-10-24T02:03:18.958287+0000","last_clean":"2023-10-24T02:03:18.958287+0000","last_became_active":"2023-10-24T02:03:18.958012+0000","last_became_peered":"2023-10-24T02:03:18.958012+0000","last_unstale":"2023-10-24T02:03:18.958287+0000","last_undegraded":"2023-10-24T02:03:18.958287+0000","last_fullsized":"2023-10-24T02:03:18.958287+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938394+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961603+0000","last_change":"2023-10-24T02:03:18.961603+0000","last_active":"2023-10-24T02:03:18.961603+0000","last_peered":"2023-10-24T02:03:18.961603+0000","last_clean":"2023-10-24T02:03:18.961603+0000","last_became_active":"2023-10-24T02:03:18.961258+0000","last_became_peered":"2023-10-24T02:03:18.961258+0000","last_unstale":"2023-10-24T02:03:18.961603+0000","last_undegraded":"2023-10-24T02:03:18.961603+0000","last_fullsized":"2023-10-24T02:03:18.961603+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945329+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956207+0000","last_change":"2023-10-24T02:03:18.956207+0000","last_active":"2023-10-24T02:03:18.956207+0000","last_peered":"2023-10-24T02:03:18.956207+0000","last_clean":"2023-10-24T02:03:18.956207+0000","last_became_active":"2023-10-24T02:03:18.955935+0000","last_became_peered":"2023-10-24T02:03:18.955935+0000","last_unstale":"2023-10-24T02:03:18.956207+0000","last_undegraded":"2023-10-24T02:03:18.956207+0000","last_fullsized":"2023-10-24T02:03:18.956207+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.945982+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959527+0000","last_change":"2023-10-24T02:03:18.959527+0000","last_active":"2023-10-24T02:03:18.959527+0000","last_peered":"2023-10-24T02:03:18.959527+0000","last_clean":"2023-10-24T02:03:18.959527+0000","last_became_active":"2023-10-24T02:03:18.959259+0000","last_became_peered":"2023-10-24T02:03:18.959259+0000","last_unstale":"2023-10-24T02:03:18.959527+0000","last_undegraded":"2023-10-24T02:03:18.959527+0000","last_fullsized":"2023-10-24T02:03:18.959527+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940348+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.960234+0000","last_change":"2023-10-24T02:03:18.960234+0000","last_active":"2023-10-24T02:03:18.960234+0000","last_peered":"2023-10-24T02:03:18.960234+0000","last_clean":"2023-10-24T02:03:18.960234+0000","last_became_active":"2023-10-24T02:03:18.959668+0000","last_became_peered":"2023-10-24T02:03:18.959668+0000","last_unstale":"2023-10-24T02:03:18.960234+0000","last_undegraded":"2023-10-24T02:03:18.960234+0000","last_fullsized":"2023-10-24T02:03:18.960234+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938338+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957158+0000","last_change":"2023-10-24T02:03:18.957158+0000","last_active":"2023-10-24T02:03:18.957158+0000","last_peered":"2023-10-24T02:03:18.957158+0000","last_clean":"2023-10-24T02:03:18.957158+0000","last_became_active":"2023-10-24T02:03:18.956881+0000","last_became_peered":"2023-10-24T02:03:18.956881+0000","last_unstale":"2023-10-24T02:03:18.957158+0000","last_undegraded":"2023-10-24T02:03:18.957158+0000","last_fullsized":"2023-10-24T02:03:18.957158+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947708+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.952051+0000","last_change":"2023-10-24T02:03:18.952051+0000","last_active":"2023-10-24T02:03:18.952051+0000","last_peered":"2023-10-24T02:03:18.952051+0000","last_clean":"2023-10-24T02:03:18.952051+0000","last_became_active":"2023-10-24T02:03:18.951753+0000","last_became_peered":"2023-10-24T02:03:18.951753+0000","last_unstale":"2023-10-24T02:03:18.952051+0000","last_undegraded":"2023-10-24T02:03:18.952051+0000","last_fullsized":"2023-10-24T02:03:18.952051+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942314+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956970+0000","last_change":"2023-10-24T02:03:18.956970+0000","last_active":"2023-10-24T02:03:18.956970+0000","last_peered":"2023-10-24T02:03:18.956970+0000","last_clean":"2023-10-24T02:03:18.956970+0000","last_became_active":"2023-10-24T02:03:18.956541+0000","last_became_peered":"2023-10-24T02:03:18.956541+0000","last_unstale":"2023-10-24T02:03:18.956970+0000","last_undegraded":"2023-10-24T02:03:18.956970+0000","last_fullsized":"2023-10-24T02:03:18.956970+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942012+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955188+0000","last_change":"2023-10-24T02:03:18.955188+0000","last_active":"2023-10-24T02:03:18.955188+0000","last_peered":"2023-10-24T02:03:18.955188+0000","last_clean":"2023-10-24T02:03:18.955188+0000","last_became_active":"2023-10-24T02:03:18.954463+0000","last_became_peered":"2023-10-24T02:03:18.954463+0000","last_unstale":"2023-10-24T02:03:18.955188+0000","last_undegraded":"2023-10-24T02:03:18.955188+0000","last_fullsized":"2023-10-24T02:03:18.955188+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946373+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958952+0000","last_change":"2023-10-24T02:03:18.958952+0000","last_active":"2023-10-24T02:03:18.958952+0000","last_peered":"2023-10-24T02:03:18.958952+0000","last_clean":"2023-10-24T02:03:18.958952+0000","last_became_active":"2023-10-24T02:03:18.958614+0000","last_became_peered":"2023-10-24T02:03:18.958614+0000","last_unstale":"2023-10-24T02:03:18.958952+0000","last_undegraded":"2023-10-24T02:03:18.958952+0000","last_fullsized":"2023-10-24T02:03:18.958952+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.951289+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.949597+0000","last_change":"2023-10-24T02:03:18.949597+0000","last_active":"2023-10-24T02:03:18.949597+0000","last_peered":"2023-10-24T02:03:18.949597+0000","last_clean":"2023-10-24T02:03:18.949597+0000","last_became_active":"2023-10-24T02:03:18.949301+0000","last_became_peered":"2023-10-24T02:03:18.949301+0000","last_unstale":"2023-10-24T02:03:18.949597+0000","last_undegraded":"2023-10-24T02:03:18.949597+0000","last_fullsized":"2023-10-24T02:03:18.949597+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938339+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953286+0000","last_change":"2023-10-24T02:03:18.953286+0000","last_active":"2023-10-24T02:03:18.953286+0000","last_peered":"2023-10-24T02:03:18.953286+0000","last_clean":"2023-10-24T02:03:18.953286+0000","last_became_active":"2023-10-24T02:03:18.952922+0000","last_became_peered":"2023-10-24T02:03:18.952922+0000","last_unstale":"2023-10-24T02:03:18.953286+0000","last_undegraded":"2023-10-24T02:03:18.953286+0000","last_fullsized":"2023-10-24T02:03:18.953286+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.940728+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955515+0000","last_change":"2023-10-24T02:03:18.955515+0000","last_active":"2023-10-24T02:03:18.955515+0000","last_peered":"2023-10-24T02:03:18.955515+0000","last_clean":"2023-10-24T02:03:18.955515+0000","last_became_active":"2023-10-24T02:03:18.955154+0000","last_became_peered":"2023-10-24T02:03:18.955154+0000","last_unstale":"2023-10-24T02:03:18.955515+0000","last_undegraded":"2023-10-24T02:03:18.955515+0000","last_fullsized":"2023-10-24T02:03:18.955515+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942181+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950142+0000","last_change":"2023-10-24T02:03:18.950142+0000","last_active":"2023-10-24T02:03:18.950142+0000","last_peered":"2023-10-24T02:03:18.950142+0000","last_clean":"2023-10-24T02:03:18.950142+0000","last_became_active":"2023-10-24T02:03:18.949874+0000","last_became_peered":"2023-10-24T02:03:18.949874+0000","last_unstale":"2023-10-24T02:03:18.950142+0000","last_undegraded":"2023-10-24T02:03:18.950142+0000","last_fullsized":"2023-10-24T02:03:18.950142+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938512+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.959033+0000","last_change":"2023-10-24T02:03:18.959033+0000","last_active":"2023-10-24T02:03:18.959033+0000","last_peered":"2023-10-24T02:03:18.959033+0000","last_clean":"2023-10-24T02:03:18.959033+0000","last_became_active":"2023-10-24T02:03:18.958731+0000","last_became_peered":"2023-10-24T02:03:18.958731+0000","last_unstale":"2023-10-24T02:03:18.959033+0000","last_undegraded":"2023-10-24T02:03:18.959033+0000","last_fullsized":"2023-10-24T02:03:18.959033+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.939401+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.951834+0000","last_change":"2023-10-24T02:03:18.951834+0000","last_active":"2023-10-24T02:03:18.951834+0000","last_peered":"2023-10-24T02:03:18.951834+0000","last_clean":"2023-10-24T02:03:18.951834+0000","last_became_active":"2023-10-24T02:03:18.949164+0000","last_became_peered":"2023-10-24T02:03:18.949164+0000","last_unstale":"2023-10-24T02:03:18.951834+0000","last_undegraded":"2023-10-24T02:03:18.951834+0000","last_fullsized":"2023-10-24T02:03:18.951834+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942937+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.950503+0000","last_change":"2023-10-24T02:03:18.950503+0000","last_active":"2023-10-24T02:03:18.950503+0000","last_peered":"2023-10-24T02:03:18.950503+0000","last_clean":"2023-10-24T02:03:18.950503+0000","last_became_active":"2023-10-24T02:03:18.950174+0000","last_became_peered":"2023-10-24T02:03:18.950174+0000","last_unstale":"2023-10-24T02:03:18.950503+0000","last_undegraded":"2023-10-24T02:03:18.950503+0000","last_fullsized":"2023-10-24T02:03:18.950503+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.946965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.947343+0000","last_change":"2023-10-24T02:03:18.947343+0000","last_active":"2023-10-24T02:03:18.947343+0000","last_peered":"2023-10-24T02:03:18.947343+0000","last_clean":"2023-10-24T02:03:18.947343+0000","last_became_active":"2023-10-24T02:03:18.947006+0000","last_became_peered":"2023-10-24T02:03:18.947006+0000","last_unstale":"2023-10-24T02:03:18.947343+0000","last_undegraded":"2023-10-24T02:03:18.947343+0000","last_fullsized":"2023-10-24T02:03:18.947343+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944473+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.953817+0000","last_change":"2023-10-24T02:03:18.953817+0000","last_active":"2023-10-24T02:03:18.953817+0000","last_peered":"2023-10-24T02:03:18.953817+0000","last_clean":"2023-10-24T02:03:18.953817+0000","last_became_active":"2023-10-24T02:03:18.953457+0000","last_became_peered":"2023-10-24T02:03:18.953457+0000","last_unstale":"2023-10-24T02:03:18.953817+0000","last_undegraded":"2023-10-24T02:03:18.953817+0000","last_fullsized":"2023-10-24T02:03:18.953817+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938138+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954146+0000","last_change":"2023-10-24T02:03:18.954146+0000","last_active":"2023-10-24T02:03:18.954146+0000","last_peered":"2023-10-24T02:03:18.954146+0000","last_clean":"2023-10-24T02:03:18.954146+0000","last_became_active":"2023-10-24T02:03:18.953805+0000","last_became_peered":"2023-10-24T02:03:18.953805+0000","last_unstale":"2023-10-24T02:03:18.954146+0000","last_undegraded":"2023-10-24T02:03:18.954146+0000","last_fullsized":"2023-10-24T02:03:18.954146+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938965+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.956705+0000","last_change":"2023-10-24T02:03:18.956705+0000","last_active":"2023-10-24T02:03:18.956705+0000","last_peered":"2023-10-24T02:03:18.956705+0000","last_clean":"2023-10-24T02:03:18.956705+0000","last_became_active":"2023-10-24T02:03:18.956408+0000","last_became_peered":"2023-10-24T02:03:18.956408+0000","last_unstale":"2023-10-24T02:03:18.956705+0000","last_undegraded":"2023-10-24T02:03:18.956705+0000","last_fullsized":"2023-10-24T02:03:18.956705+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931186+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:17.931186+0000","last_peered":"2023-10-24T02:03:17.931186+0000","last_clean":"2023-10-24T02:03:17.931186+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:17.931186+0000","last_undegraded":"2023-10-24T02:03:17.931186+0000","last_fullsized":"2023-10-24T02:03:17.931186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944922+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957336+0000","last_change":"2023-10-24T02:03:18.957336+0000","last_active":"2023-10-24T02:03:18.957336+0000","last_peered":"2023-10-24T02:03:18.957336+0000","last_clean":"2023-10-24T02:03:18.957336+0000","last_became_active":"2023-10-24T02:03:18.957093+0000","last_became_peered":"2023-10-24T02:03:18.957093+0000","last_unstale":"2023-10-24T02:03:18.957336+0000","last_undegraded":"2023-10-24T02:03:18.957336+0000","last_fullsized":"2023-10-24T02:03:18.957336+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.937664+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:17.937664+0000","last_peered":"2023-10-24T02:03:17.937664+0000","last_clean":"2023-10-24T02:03:17.937664+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:17.937664+0000","last_undegraded":"2023-10-24T02:03:17.937664+0000","last_fullsized":"2023-10-24T02:03:17.937664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943642+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.963798+0000","last_change":"2023-10-24T02:03:18.963798+0000","last_active":"2023-10-24T02:03:18.963798+0000","last_peered":"2023-10-24T02:03:18.963798+0000","last_clean":"2023-10-24T02:03:18.963798+0000","last_became_active":"2023-10-24T02:03:18.963483+0000","last_became_peered":"2023-10-24T02:03:18.963483+0000","last_unstale":"2023-10-24T02:03:18.963798+0000","last_undegraded":"2023-10-24T02:03:18.963798+0000","last_fullsized":"2023-10-24T02:03:18.963798+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":172,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.938872+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:17.938872+0000","last_peered":"2023-10-24T02:03:17.938872+0000","last_clean":"2023-10-24T02:03:17.938872+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:17.938872+0000","last_undegraded":"2023-10-24T02:03:17.938872+0000","last_fullsized":"2023-10-24T02:03:17.938872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.943235+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.957250+0000","last_change":"2023-10-24T02:03:18.957250+0000","last_active":"2023-10-24T02:03:18.957250+0000","last_peered":"2023-10-24T02:03:18.957250+0000","last_clean":"2023-10-24T02:03:18.957250+0000","last_became_active":"2023-10-24T02:03:18.957017+0000","last_became_peered":"2023-10-24T02:03:18.957017+0000","last_unstale":"2023-10-24T02:03:18.957250+0000","last_undegraded":"2023-10-24T02:03:18.957250+0000","last_fullsized":"2023-10-24T02:03:18.957250+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":170,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.936331+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:17.936331+0000","last_peered":"2023-10-24T02:03:17.936331+0000","last_clean":"2023-10-24T02:03:17.936331+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:17.936331+0000","last_undegraded":"2023-10-24T02:03:17.936331+0000","last_fullsized":"2023-10-24T02:03:17.936331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":207,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933701+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:17.933701+0000","last_peered":"2023-10-24T02:03:17.933701+0000","last_clean":"2023-10-24T02:03:17.933701+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:17.933701+0000","last_undegraded":"2023-10-24T02:03:17.933701+0000","last_fullsized":"2023-10-24T02:03:17.933701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.947175+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.954457+0000","last_change":"2023-10-24T02:03:18.954457+0000","last_active":"2023-10-24T02:03:18.954457+0000","last_peered":"2023-10-24T02:03:18.954457+0000","last_clean":"2023-10-24T02:03:18.954457+0000","last_became_active":"2023-10-24T02:03:18.954148+0000","last_became_peered":"2023-10-24T02:03:18.954148+0000","last_unstale":"2023-10-24T02:03:18.954457+0000","last_undegraded":"2023-10-24T02:03:18.954457+0000","last_fullsized":"2023-10-24T02:03:18.954457+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.933781+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:17.933781+0000","last_peered":"2023-10-24T02:03:17.933781+0000","last_clean":"2023-10-24T02:03:17.933781+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:17.933781+0000","last_undegraded":"2023-10-24T02:03:17.933781+0000","last_fullsized":"2023-10-24T02:03:17.933781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.938761+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.958703+0000","last_change":"2023-10-24T02:03:18.958703+0000","last_active":"2023-10-24T02:03:18.958703+0000","last_peered":"2023-10-24T02:03:18.958703+0000","last_clean":"2023-10-24T02:03:18.958703+0000","last_became_active":"2023-10-24T02:03:18.958421+0000","last_became_peered":"2023-10-24T02:03:18.958421+0000","last_unstale":"2023-10-24T02:03:18.958703+0000","last_undegraded":"2023-10-24T02:03:18.958703+0000","last_fullsized":"2023-10-24T02:03:18.958703+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934171+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:17.934171+0000","last_peered":"2023-10-24T02:03:17.934171+0000","last_clean":"2023-10-24T02:03:17.934171+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:17.934171+0000","last_undegraded":"2023-10-24T02:03:17.934171+0000","last_fullsized":"2023-10-24T02:03:17.934171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.944811+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.961237+0000","last_change":"2023-10-24T02:03:18.961237+0000","last_active":"2023-10-24T02:03:18.961237+0000","last_peered":"2023-10-24T02:03:18.961237+0000","last_clean":"2023-10-24T02:03:18.961237+0000","last_became_active":"2023-10-24T02:03:18.960957+0000","last_became_peered":"2023-10-24T02:03:18.960957+0000","last_unstale":"2023-10-24T02:03:18.961237+0000","last_undegraded":"2023-10-24T02:03:18.961237+0000","last_fullsized":"2023-10-24T02:03:18.961237+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.931161+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:17.931161+0000","last_peered":"2023-10-24T02:03:17.931161+0000","last_clean":"2023-10-24T02:03:17.931161+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:17.931161+0000","last_undegraded":"2023-10-24T02:03:17.931161+0000","last_fullsized":"2023-10-24T02:03:17.931161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-24T02:03:18.930100+0000","last_change":"2023-10-24T02:03:18.942958+0000","last_active":"2023-10-24T02:03:18.930100+0000","last_peered":"2023-10-24T02:03:18.930100+0000","last_clean":"2023-10-24T02:03:18.930100+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-24T02:03:18.930100+0000","last_undegraded":"2023-10-24T02:03:18.930100+0000","last_fullsized":"2023-10-24T02:03:18.930100+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":8,"reported_epoch":214,"state":"active+clean","last_fresh":"2023-10-24T02:03:18.955078+0000","last_change":"2023-10-24T02:03:18.955078+0000","last_active":"2023-10-24T02:03:18.955078+0000","last_peered":"2023-10-24T02:03:18.955078+0000","last_clean":"2023-10-24T02:03:18.955078+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:18.955078+0000","last_undegraded":"2023-10-24T02:03:18.955078+0000","last_fullsized":"2023-10-24T02:03:18.955078+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":213,"state":"active+clean","last_fresh":"2023-10-24T02:03:17.934801+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:17.934801+0000","last_peered":"2023-10-24T02:03:17.934801+0000","last_clean":"2023-10-24T02:03:17.934801+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:17.934801+0000","last_undegraded":"2023-10-24T02:03:17.934801+0000","last_fullsized":"2023-10-24T02:03:17.934801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2674688,"data_stored":1366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.50600000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575976,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.502}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.42499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46500000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.26000000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.627},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.435},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61599999999999999,"15min":0.67600000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.317},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.438}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.499},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.44900000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.57999999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.35899999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.31}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60999999999999999,"15min":0.752},"last":0.24199999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":0.52100000000000002,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.64600000000000002},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.499,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54100000000000004,"5min":0.63,"15min":0.72799999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":1.097},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.88600000000000001,"15min":1.167},"last":0.34100000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":1.056},"last":0.505},{"interface":"front","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.88500000000000001,"15min":1.109},"last":0.36399999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.91700000000000004,"15min":1.083},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.437,"15min":0.437},"max":{"1min":0.81599999999999995,"5min":0.92600000000000005,"15min":1.155},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.505},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.441},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67500000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65000000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.63800000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1359436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.433}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.60999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.49399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.36499999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:25.231 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:25.228+0000 7f01e14c6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T02:03:26.722 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:26.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.849+0000 7fc35061c700 1 Processor -- start 2023-10-24T02:03:26.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.849+0000 7fc35061c700 1 -- start start 2023-10-24T02:03:26.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc3480aa010 0x7fc3480c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3480c6710 0x7fc3480aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc348158770 0x7fc348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480aa8e0 con 0x7fc348158770 2023-10-24T02:03:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480c0960 con 0x7fc3480aa010 2023-10-24T02:03:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc35061c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480c0c40 con 0x7fc3480c6710 2023-10-24T02:03:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc34ebb9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc348158770 0x7fc348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc34ebb9700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc348158770 0x7fc348069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60812/0 (socket says 172.21.15.148:60812) 2023-10-24T02:03:26.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc34ebb9700 1 -- 172.21.15.148:0/1367747951 learned_addr learned my addr 172.21.15.148:0/1367747951 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:26.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc34e3b8700 1 --2- 172.21.15.148:0/1367747951 >> v2:172.21.15.150:3300/0 conn(0x7fc3480aa010 0x7fc3480c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.850+0000 7fc34dbb7700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3480c6710 0x7fc3480aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 -- 172.21.15.148:0/1367747951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3480c6710 msgr2=0x7fc3480aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:26.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3480c6710 0x7fc3480aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 -- 172.21.15.148:0/1367747951 >> v2:172.21.15.150:3300/0 conn(0x7fc3480aa010 msgr2=0x7fc3480c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:26.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 --2- 172.21.15.148:0/1367747951 >> v2:172.21.15.150:3300/0 conn(0x7fc3480aa010 0x7fc3480c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 -- 172.21.15.148:0/1367747951 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480c0f20 con 0x7fc348158770 2023-10-24T02:03:26.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34ebb9700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc348158770 0x7fc348069d80 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fc348083e30 tx=0x7fc340009840).ready entity=mon.0 client_cookie=e0bada2c13ab4d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:26.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34d3b6700 1 -- 172.21.15.148:0/1367747951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000e070 con 0x7fc348158770 2023-10-24T02:03:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34d3b6700 1 -- 172.21.15.148:0/1367747951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000b970 con 0x7fc348158770 2023-10-24T02:03:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc34d3b6700 1 -- 172.21.15.148:0/1367747951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000bcf0 con 0x7fc348158770 2023-10-24T02:03:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.851+0000 7fc35061c700 1 -- 172.21.15.148:0/1367747951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc348158770 msgr2=0x7fc348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc348158770 0x7fc348069d80 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fc348083e30 tx=0x7fc340009840).stop 2023-10-24T02:03:26.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 -- 172.21.15.148:0/1367747951 shutdown_connections 2023-10-24T02:03:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc348158770 0x7fc348069d80 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 --2- 172.21.15.148:0/1367747951 >> v2:172.21.15.150:3300/0 conn(0x7fc3480aa010 0x7fc3480c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 --2- 172.21.15.148:0/1367747951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3480c6710 0x7fc3480aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 -- 172.21.15.148:0/1367747951 >> 172.21.15.148:0/1367747951 conn(0x7fc3480caf40 msgr2=0x7fc3480cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:26.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 -- 172.21.15.148:0/1367747951 shutdown_connections 2023-10-24T02:03:26.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.852+0000 7fc35061c700 1 -- 172.21.15.148:0/1367747951 wait complete. 2023-10-24T02:03:26.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.853+0000 7fc35061c700 1 Processor -- start 2023-10-24T02:03:26.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.853+0000 7fc35061c700 1 -- start start 2023-10-24T02:03:26.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3480aa010 0x7fc3480c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc348158770 0x7fc3481522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481676b0 con 0x7fc3480c6710 2023-10-24T02:03:26.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348167c70 con 0x7fc3480aa010 2023-10-24T02:03:26.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481685f0 con 0x7fc348158770 2023-10-24T02:03:26.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60816/0 (socket says 172.21.15.148:60816) 2023-10-24T02:03:26.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 -- 172.21.15.148:0/3571951614 learned_addr learned my addr 172.21.15.148:0/3571951614 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:26.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34e3b8700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3480aa010 0x7fc3480c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34ebb9700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc348158770 0x7fc3481522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 -- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc348158770 msgr2=0x7fc3481522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:26.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc348158770 0x7fc3481522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 -- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3480aa010 msgr2=0x7fc3480c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:26.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3480aa010 0x7fc3480c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:26.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 -- 172.21.15.148:0/3571951614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009ae0 con 0x7fc3480c6710 2023-10-24T02:03:26.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc34dbb7700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fc33800e9b0 tx=0x7fc338009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338009530 con 0x7fc3480c6710 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800c670 con 0x7fc3480c6710 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3481527b0 con 0x7fc3480c6710 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800c9f0 con 0x7fc3480c6710 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.854+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480c3780 con 0x7fc3480c6710 2023-10-24T02:03:26.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.855+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34805fce0 con 0x7fc3480c6710 2023-10-24T02:03:26.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.856+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc33801b400 con 0x7fc3480c6710 2023-10-24T02:03:26.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.856+0000 7fc33e7fc700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 0x7fc32c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:26.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.856+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fc33807a610 con 0x7fc3480c6710 2023-10-24T02:03:26.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.856+0000 7fc34e3b8700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 0x7fc32c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:26.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.856+0000 7fc34e3b8700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 0x7fc32c0615e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc344009c30 tx=0x7fc344009060).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:26.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:26.860+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc33804b850 con 0x7fc3480c6710 2023-10-24T02:03:27.024 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.024+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc34806c6b0 con 0x7fc32c05f120 2023-10-24T02:03:27.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.034+0000 7fc33e7fc700 1 -- 172.21.15.148:0/3571951614 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361783 (secure 0 0 0) 0x7fc34806c6b0 con 0x7fc32c05f120 2023-10-24T02:03:27.039 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:27.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 msgr2=0x7fc32c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 0x7fc32c0615e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc344009c30 tx=0x7fc344009060).stop 2023-10-24T02:03:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 msgr2=0x7fc348168100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fc33800e9b0 tx=0x7fc338009060).stop 2023-10-24T02:03:27.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 shutdown_connections 2023-10-24T02:03:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc348158770 0x7fc3481522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc32c05f120 0x7fc32c0615e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3480aa010 0x7fc3480c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 --2- 172.21.15.148:0/3571951614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3480c6710 0x7fc348168100 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 >> 172.21.15.148:0/3571951614 conn(0x7fc3480caf40 msgr2=0x7fc3480c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 shutdown_connections 2023-10-24T02:03:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.038+0000 7fc35061c700 1 -- 172.21.15.148:0/3571951614 wait complete. 2023-10-24T02:03:27.044 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:27.050 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-24T02:03:26.191467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459360,"kb_used_data":21152,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752515360,"statfs":{"total":773094113280,"available":770575728640,"internally_reserved":0,"allocated":21659648,"data_stored":11045652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28002,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.998190"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343817+0000","last_change":"2023-10-24T02:03:19.335591+0000","last_active":"2023-10-24T02:03:19.343817+0000","last_peered":"2023-10-24T02:03:19.343817+0000","last_clean":"2023-10-24T02:03:19.343817+0000","last_became_active":"2023-10-24T02:03:19.335278+0000","last_became_peered":"2023-10-24T02:03:19.335278+0000","last_unstale":"2023-10-24T02:03:19.343817+0000","last_undegraded":"2023-10-24T02:03:19.343817+0000","last_fullsized":"2023-10-24T02:03:19.343817+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"215'3","reported_seq":13,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323091+0000","last_change":"2023-10-24T02:03:18.960697+0000","last_active":"2023-10-24T02:03:19.323091+0000","last_peered":"2023-10-24T02:03:19.323091+0000","last_clean":"2023-10-24T02:03:19.323091+0000","last_became_active":"2023-10-24T02:03:18.960308+0000","last_became_peered":"2023-10-24T02:03:18.960308+0000","last_unstale":"2023-10-24T02:03:19.323091+0000","last_undegraded":"2023-10-24T02:03:19.323091+0000","last_fullsized":"2023-10-24T02:03:19.323091+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.338643+0000","last_change":"2023-10-24T02:03:19.334526+0000","last_active":"2023-10-24T02:03:19.338643+0000","last_peered":"2023-10-24T02:03:19.338643+0000","last_clean":"2023-10-24T02:03:19.338643+0000","last_became_active":"2023-10-24T02:03:19.334207+0000","last_became_peered":"2023-10-24T02:03:19.334207+0000","last_unstale":"2023-10-24T02:03:19.338643+0000","last_undegraded":"2023-10-24T02:03:19.338643+0000","last_fullsized":"2023-10-24T02:03:19.338643+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323893+0000","last_change":"2023-10-24T02:03:18.954224+0000","last_active":"2023-10-24T02:03:19.323893+0000","last_peered":"2023-10-24T02:03:19.323893+0000","last_clean":"2023-10-24T02:03:19.323893+0000","last_became_active":"2023-10-24T02:03:18.953951+0000","last_became_peered":"2023-10-24T02:03:18.953951+0000","last_unstale":"2023-10-24T02:03:19.323893+0000","last_undegraded":"2023-10-24T02:03:19.323893+0000","last_fullsized":"2023-10-24T02:03:19.323893+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343789+0000","last_change":"2023-10-24T02:03:19.338323+0000","last_active":"2023-10-24T02:03:19.343789+0000","last_peered":"2023-10-24T02:03:19.343789+0000","last_clean":"2023-10-24T02:03:19.343789+0000","last_became_active":"2023-10-24T02:03:19.338067+0000","last_became_peered":"2023-10-24T02:03:19.338067+0000","last_unstale":"2023-10-24T02:03:19.343789+0000","last_undegraded":"2023-10-24T02:03:19.343789+0000","last_fullsized":"2023-10-24T02:03:19.343789+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317203+0000","last_change":"2023-10-24T02:03:18.961632+0000","last_active":"2023-10-24T02:03:19.317203+0000","last_peered":"2023-10-24T02:03:19.317203+0000","last_clean":"2023-10-24T02:03:19.317203+0000","last_became_active":"2023-10-24T02:03:18.961285+0000","last_became_peered":"2023-10-24T02:03:18.961285+0000","last_unstale":"2023-10-24T02:03:19.317203+0000","last_undegraded":"2023-10-24T02:03:19.317203+0000","last_fullsized":"2023-10-24T02:03:19.317203+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332684+0000","last_change":"2023-10-24T02:03:19.329608+0000","last_active":"2023-10-24T02:03:19.332684+0000","last_peered":"2023-10-24T02:03:19.332684+0000","last_clean":"2023-10-24T02:03:19.332684+0000","last_became_active":"2023-10-24T02:03:19.329347+0000","last_became_peered":"2023-10-24T02:03:19.329347+0000","last_unstale":"2023-10-24T02:03:19.332684+0000","last_undegraded":"2023-10-24T02:03:19.332684+0000","last_fullsized":"2023-10-24T02:03:19.332684+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"215'2","reported_seq":12,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333256+0000","last_change":"2023-10-24T02:03:18.948595+0000","last_active":"2023-10-24T02:03:19.333256+0000","last_peered":"2023-10-24T02:03:19.333256+0000","last_clean":"2023-10-24T02:03:19.333256+0000","last_became_active":"2023-10-24T02:03:18.948274+0000","last_became_peered":"2023-10-24T02:03:18.948274+0000","last_unstale":"2023-10-24T02:03:19.333256+0000","last_undegraded":"2023-10-24T02:03:19.333256+0000","last_fullsized":"2023-10-24T02:03:19.333256+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.346104+0000","last_change":"2023-10-24T02:03:19.339223+0000","last_active":"2023-10-24T02:03:19.346104+0000","last_peered":"2023-10-24T02:03:19.346104+0000","last_clean":"2023-10-24T02:03:19.346104+0000","last_became_active":"2023-10-24T02:03:19.338956+0000","last_became_peered":"2023-10-24T02:03:19.338956+0000","last_unstale":"2023-10-24T02:03:19.346104+0000","last_undegraded":"2023-10-24T02:03:19.346104+0000","last_fullsized":"2023-10-24T02:03:19.346104+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334025+0000","last_change":"2023-10-24T02:03:18.954687+0000","last_active":"2023-10-24T02:03:19.334025+0000","last_peered":"2023-10-24T02:03:19.334025+0000","last_clean":"2023-10-24T02:03:19.334025+0000","last_became_active":"2023-10-24T02:03:18.954415+0000","last_became_peered":"2023-10-24T02:03:18.954415+0000","last_unstale":"2023-10-24T02:03:19.334025+0000","last_undegraded":"2023-10-24T02:03:19.334025+0000","last_fullsized":"2023-10-24T02:03:19.334025+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333735+0000","last_change":"2023-10-24T02:03:19.326161+0000","last_active":"2023-10-24T02:03:19.333735+0000","last_peered":"2023-10-24T02:03:19.333735+0000","last_clean":"2023-10-24T02:03:19.333735+0000","last_became_active":"2023-10-24T02:03:19.325870+0000","last_became_peered":"2023-10-24T02:03:19.325870+0000","last_unstale":"2023-10-24T02:03:19.333735+0000","last_undegraded":"2023-10-24T02:03:19.333735+0000","last_fullsized":"2023-10-24T02:03:19.333735+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336735+0000","last_change":"2023-10-24T02:03:18.955738+0000","last_active":"2023-10-24T02:03:19.336735+0000","last_peered":"2023-10-24T02:03:19.336735+0000","last_clean":"2023-10-24T02:03:19.336735+0000","last_became_active":"2023-10-24T02:03:18.955455+0000","last_became_peered":"2023-10-24T02:03:18.955455+0000","last_unstale":"2023-10-24T02:03:19.336735+0000","last_undegraded":"2023-10-24T02:03:19.336735+0000","last_fullsized":"2023-10-24T02:03:19.336735+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332987+0000","last_change":"2023-10-24T02:03:19.328388+0000","last_active":"2023-10-24T02:03:19.332987+0000","last_peered":"2023-10-24T02:03:19.332987+0000","last_clean":"2023-10-24T02:03:19.332987+0000","last_became_active":"2023-10-24T02:03:19.328059+0000","last_became_peered":"2023-10-24T02:03:19.328059+0000","last_unstale":"2023-10-24T02:03:19.332987+0000","last_undegraded":"2023-10-24T02:03:19.332987+0000","last_fullsized":"2023-10-24T02:03:19.332987+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.328090+0000","last_change":"2023-10-24T02:03:18.959944+0000","last_active":"2023-10-24T02:03:19.328090+0000","last_peered":"2023-10-24T02:03:19.328090+0000","last_clean":"2023-10-24T02:03:19.328090+0000","last_became_active":"2023-10-24T02:03:18.959611+0000","last_became_peered":"2023-10-24T02:03:18.959611+0000","last_unstale":"2023-10-24T02:03:19.328090+0000","last_undegraded":"2023-10-24T02:03:19.328090+0000","last_fullsized":"2023-10-24T02:03:19.328090+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.338459+0000","last_change":"2023-10-24T02:03:19.336378+0000","last_active":"2023-10-24T02:03:19.338459+0000","last_peered":"2023-10-24T02:03:19.338459+0000","last_clean":"2023-10-24T02:03:19.338459+0000","last_became_active":"2023-10-24T02:03:19.336111+0000","last_became_peered":"2023-10-24T02:03:19.336111+0000","last_unstale":"2023-10-24T02:03:19.338459+0000","last_undegraded":"2023-10-24T02:03:19.338459+0000","last_fullsized":"2023-10-24T02:03:19.338459+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.311914+0000","last_change":"2023-10-24T02:03:18.950385+0000","last_active":"2023-10-24T02:03:19.311914+0000","last_peered":"2023-10-24T02:03:19.311914+0000","last_clean":"2023-10-24T02:03:19.311914+0000","last_became_active":"2023-10-24T02:03:18.950119+0000","last_became_peered":"2023-10-24T02:03:18.950119+0000","last_unstale":"2023-10-24T02:03:19.311914+0000","last_undegraded":"2023-10-24T02:03:19.311914+0000","last_fullsized":"2023-10-24T02:03:19.311914+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334877+0000","last_change":"2023-10-24T02:03:19.330266+0000","last_active":"2023-10-24T02:03:19.334877+0000","last_peered":"2023-10-24T02:03:19.334877+0000","last_clean":"2023-10-24T02:03:19.334877+0000","last_became_active":"2023-10-24T02:03:19.329824+0000","last_became_peered":"2023-10-24T02:03:19.329824+0000","last_unstale":"2023-10-24T02:03:19.334877+0000","last_undegraded":"2023-10-24T02:03:19.334877+0000","last_fullsized":"2023-10-24T02:03:19.334877+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337822+0000","last_change":"2023-10-24T02:03:18.957027+0000","last_active":"2023-10-24T02:03:19.337822+0000","last_peered":"2023-10-24T02:03:19.337822+0000","last_clean":"2023-10-24T02:03:19.337822+0000","last_became_active":"2023-10-24T02:03:18.956564+0000","last_became_peered":"2023-10-24T02:03:18.956564+0000","last_unstale":"2023-10-24T02:03:19.337822+0000","last_undegraded":"2023-10-24T02:03:19.337822+0000","last_fullsized":"2023-10-24T02:03:19.337822+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339475+0000","last_change":"2023-10-24T02:03:19.335785+0000","last_active":"2023-10-24T02:03:19.339475+0000","last_peered":"2023-10-24T02:03:19.339475+0000","last_clean":"2023-10-24T02:03:19.339475+0000","last_became_active":"2023-10-24T02:03:19.335509+0000","last_became_peered":"2023-10-24T02:03:19.335509+0000","last_unstale":"2023-10-24T02:03:19.339475+0000","last_undegraded":"2023-10-24T02:03:19.339475+0000","last_fullsized":"2023-10-24T02:03:19.339475+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.318046+0000","last_change":"2023-10-24T02:03:18.958302+0000","last_active":"2023-10-24T02:03:19.318046+0000","last_peered":"2023-10-24T02:03:19.318046+0000","last_clean":"2023-10-24T02:03:19.318046+0000","last_became_active":"2023-10-24T02:03:18.956921+0000","last_became_peered":"2023-10-24T02:03:18.956921+0000","last_unstale":"2023-10-24T02:03:19.318046+0000","last_undegraded":"2023-10-24T02:03:19.318046+0000","last_fullsized":"2023-10-24T02:03:19.318046+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333561+0000","last_change":"2023-10-24T02:03:19.331592+0000","last_active":"2023-10-24T02:03:19.333561+0000","last_peered":"2023-10-24T02:03:19.333561+0000","last_clean":"2023-10-24T02:03:19.333561+0000","last_became_active":"2023-10-24T02:03:19.331219+0000","last_became_peered":"2023-10-24T02:03:19.331219+0000","last_unstale":"2023-10-24T02:03:19.333561+0000","last_undegraded":"2023-10-24T02:03:19.333561+0000","last_fullsized":"2023-10-24T02:03:19.333561+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.325656+0000","last_change":"2023-10-24T02:03:18.955357+0000","last_active":"2023-10-24T02:03:19.325656+0000","last_peered":"2023-10-24T02:03:19.325656+0000","last_clean":"2023-10-24T02:03:19.325656+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:19.325656+0000","last_undegraded":"2023-10-24T02:03:19.325656+0000","last_fullsized":"2023-10-24T02:03:19.325656+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332666+0000","last_change":"2023-10-24T02:03:19.327735+0000","last_active":"2023-10-24T02:03:19.332666+0000","last_peered":"2023-10-24T02:03:19.332666+0000","last_clean":"2023-10-24T02:03:19.332666+0000","last_became_active":"2023-10-24T02:03:19.327433+0000","last_became_peered":"2023-10-24T02:03:19.327433+0000","last_unstale":"2023-10-24T02:03:19.332666+0000","last_undegraded":"2023-10-24T02:03:19.332666+0000","last_fullsized":"2023-10-24T02:03:19.332666+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"215'4","reported_seq":14,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.346562+0000","last_change":"2023-10-24T02:03:18.953879+0000","last_active":"2023-10-24T02:03:19.346562+0000","last_peered":"2023-10-24T02:03:19.346562+0000","last_clean":"2023-10-24T02:03:19.346562+0000","last_became_active":"2023-10-24T02:03:18.953399+0000","last_became_peered":"2023-10-24T02:03:18.953399+0000","last_unstale":"2023-10-24T02:03:19.346562+0000","last_undegraded":"2023-10-24T02:03:19.346562+0000","last_fullsized":"2023-10-24T02:03:19.346562+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.341006+0000","last_change":"2023-10-24T02:03:19.336945+0000","last_active":"2023-10-24T02:03:19.341006+0000","last_peered":"2023-10-24T02:03:19.341006+0000","last_clean":"2023-10-24T02:03:19.341006+0000","last_became_active":"2023-10-24T02:03:19.336667+0000","last_became_peered":"2023-10-24T02:03:19.336667+0000","last_unstale":"2023-10-24T02:03:19.341006+0000","last_undegraded":"2023-10-24T02:03:19.341006+0000","last_fullsized":"2023-10-24T02:03:19.341006+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333709+0000","last_change":"2023-10-24T02:03:18.952773+0000","last_active":"2023-10-24T02:03:19.333709+0000","last_peered":"2023-10-24T02:03:19.333709+0000","last_clean":"2023-10-24T02:03:19.333709+0000","last_became_active":"2023-10-24T02:03:18.952455+0000","last_became_peered":"2023-10-24T02:03:18.952455+0000","last_unstale":"2023-10-24T02:03:19.333709+0000","last_undegraded":"2023-10-24T02:03:19.333709+0000","last_fullsized":"2023-10-24T02:03:19.333709+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334874+0000","last_change":"2023-10-24T02:03:19.332569+0000","last_active":"2023-10-24T02:03:19.334874+0000","last_peered":"2023-10-24T02:03:19.334874+0000","last_clean":"2023-10-24T02:03:19.334874+0000","last_became_active":"2023-10-24T02:03:19.332241+0000","last_became_peered":"2023-10-24T02:03:19.332241+0000","last_unstale":"2023-10-24T02:03:19.334874+0000","last_undegraded":"2023-10-24T02:03:19.334874+0000","last_fullsized":"2023-10-24T02:03:19.334874+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334975+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:19.334975+0000","last_peered":"2023-10-24T02:03:19.334975+0000","last_clean":"2023-10-24T02:03:19.334975+0000","last_became_active":"2023-10-24T02:03:18.960004+0000","last_became_peered":"2023-10-24T02:03:18.960004+0000","last_unstale":"2023-10-24T02:03:19.334975+0000","last_undegraded":"2023-10-24T02:03:19.334975+0000","last_fullsized":"2023-10-24T02:03:19.334975+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333938+0000","last_change":"2023-10-24T02:03:19.331200+0000","last_active":"2023-10-24T02:03:19.333938+0000","last_peered":"2023-10-24T02:03:19.333938+0000","last_clean":"2023-10-24T02:03:19.333938+0000","last_became_active":"2023-10-24T02:03:19.330924+0000","last_became_peered":"2023-10-24T02:03:19.330924+0000","last_unstale":"2023-10-24T02:03:19.333938+0000","last_undegraded":"2023-10-24T02:03:19.333938+0000","last_fullsized":"2023-10-24T02:03:19.333938+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323109+0000","last_change":"2023-10-24T02:03:18.953693+0000","last_active":"2023-10-24T02:03:19.323109+0000","last_peered":"2023-10-24T02:03:19.323109+0000","last_clean":"2023-10-24T02:03:19.323109+0000","last_became_active":"2023-10-24T02:03:18.952846+0000","last_became_peered":"2023-10-24T02:03:18.952846+0000","last_unstale":"2023-10-24T02:03:19.323109+0000","last_undegraded":"2023-10-24T02:03:19.323109+0000","last_fullsized":"2023-10-24T02:03:19.323109+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336945+0000","last_change":"2023-10-24T02:03:19.330647+0000","last_active":"2023-10-24T02:03:19.336945+0000","last_peered":"2023-10-24T02:03:19.336945+0000","last_clean":"2023-10-24T02:03:19.336945+0000","last_became_active":"2023-10-24T02:03:19.329985+0000","last_became_peered":"2023-10-24T02:03:19.329985+0000","last_unstale":"2023-10-24T02:03:19.336945+0000","last_undegraded":"2023-10-24T02:03:19.336945+0000","last_fullsized":"2023-10-24T02:03:19.336945+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"215'4","reported_seq":14,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337177+0000","last_change":"2023-10-24T02:03:18.954593+0000","last_active":"2023-10-24T02:03:19.337177+0000","last_peered":"2023-10-24T02:03:19.337177+0000","last_clean":"2023-10-24T02:03:19.337177+0000","last_became_active":"2023-10-24T02:03:18.954332+0000","last_became_peered":"2023-10-24T02:03:18.954332+0000","last_unstale":"2023-10-24T02:03:19.337177+0000","last_undegraded":"2023-10-24T02:03:19.337177+0000","last_fullsized":"2023-10-24T02:03:19.337177+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330037+0000","last_change":"2023-10-24T02:03:19.321675+0000","last_active":"2023-10-24T02:03:19.330037+0000","last_peered":"2023-10-24T02:03:19.330037+0000","last_clean":"2023-10-24T02:03:19.330037+0000","last_became_active":"2023-10-24T02:03:19.321400+0000","last_became_peered":"2023-10-24T02:03:19.321400+0000","last_unstale":"2023-10-24T02:03:19.330037+0000","last_undegraded":"2023-10-24T02:03:19.330037+0000","last_fullsized":"2023-10-24T02:03:19.330037+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319526+0000","last_change":"2023-10-24T02:03:18.954493+0000","last_active":"2023-10-24T02:03:19.319526+0000","last_peered":"2023-10-24T02:03:19.319526+0000","last_clean":"2023-10-24T02:03:19.319526+0000","last_became_active":"2023-10-24T02:03:18.954206+0000","last_became_peered":"2023-10-24T02:03:18.954206+0000","last_unstale":"2023-10-24T02:03:19.319526+0000","last_undegraded":"2023-10-24T02:03:19.319526+0000","last_fullsized":"2023-10-24T02:03:19.319526+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.341773+0000","last_change":"2023-10-24T02:03:19.334579+0000","last_active":"2023-10-24T02:03:19.341773+0000","last_peered":"2023-10-24T02:03:19.341773+0000","last_clean":"2023-10-24T02:03:19.341773+0000","last_became_active":"2023-10-24T02:03:19.334313+0000","last_became_peered":"2023-10-24T02:03:19.334313+0000","last_unstale":"2023-10-24T02:03:19.341773+0000","last_undegraded":"2023-10-24T02:03:19.341773+0000","last_fullsized":"2023-10-24T02:03:19.341773+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.313358+0000","last_change":"2023-10-24T02:03:18.960289+0000","last_active":"2023-10-24T02:03:19.313358+0000","last_peered":"2023-10-24T02:03:19.313358+0000","last_clean":"2023-10-24T02:03:19.313358+0000","last_became_active":"2023-10-24T02:03:18.960005+0000","last_became_peered":"2023-10-24T02:03:18.960005+0000","last_unstale":"2023-10-24T02:03:19.313358+0000","last_undegraded":"2023-10-24T02:03:19.313358+0000","last_fullsized":"2023-10-24T02:03:19.313358+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336887+0000","last_change":"2023-10-24T02:03:19.330446+0000","last_active":"2023-10-24T02:03:19.336887+0000","last_peered":"2023-10-24T02:03:19.336887+0000","last_clean":"2023-10-24T02:03:19.336887+0000","last_became_active":"2023-10-24T02:03:19.330146+0000","last_became_peered":"2023-10-24T02:03:19.330146+0000","last_unstale":"2023-10-24T02:03:19.336887+0000","last_undegraded":"2023-10-24T02:03:19.336887+0000","last_fullsized":"2023-10-24T02:03:19.336887+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335639+0000","last_change":"2023-10-24T02:03:18.958037+0000","last_active":"2023-10-24T02:03:19.335639+0000","last_peered":"2023-10-24T02:03:19.335639+0000","last_clean":"2023-10-24T02:03:19.335639+0000","last_became_active":"2023-10-24T02:03:18.957793+0000","last_became_peered":"2023-10-24T02:03:18.957793+0000","last_unstale":"2023-10-24T02:03:19.335639+0000","last_undegraded":"2023-10-24T02:03:19.335639+0000","last_fullsized":"2023-10-24T02:03:19.335639+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323949+0000","last_change":"2023-10-24T02:03:19.320212+0000","last_active":"2023-10-24T02:03:19.323949+0000","last_peered":"2023-10-24T02:03:19.323949+0000","last_clean":"2023-10-24T02:03:19.323949+0000","last_became_active":"2023-10-24T02:03:19.319941+0000","last_became_peered":"2023-10-24T02:03:19.319941+0000","last_unstale":"2023-10-24T02:03:19.323949+0000","last_undegraded":"2023-10-24T02:03:19.323949+0000","last_fullsized":"2023-10-24T02:03:19.323949+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319232+0000","last_change":"2023-10-24T02:03:18.954035+0000","last_active":"2023-10-24T02:03:19.319232+0000","last_peered":"2023-10-24T02:03:19.319232+0000","last_clean":"2023-10-24T02:03:19.319232+0000","last_became_active":"2023-10-24T02:03:18.953757+0000","last_became_peered":"2023-10-24T02:03:18.953757+0000","last_unstale":"2023-10-24T02:03:19.319232+0000","last_undegraded":"2023-10-24T02:03:19.319232+0000","last_fullsized":"2023-10-24T02:03:19.319232+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330401+0000","last_change":"2023-10-24T02:03:19.321984+0000","last_active":"2023-10-24T02:03:19.330401+0000","last_peered":"2023-10-24T02:03:19.330401+0000","last_clean":"2023-10-24T02:03:19.330401+0000","last_became_active":"2023-10-24T02:03:19.321724+0000","last_became_peered":"2023-10-24T02:03:19.321724+0000","last_unstale":"2023-10-24T02:03:19.330401+0000","last_undegraded":"2023-10-24T02:03:19.330401+0000","last_fullsized":"2023-10-24T02:03:19.330401+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334144+0000","last_change":"2023-10-24T02:03:18.953464+0000","last_active":"2023-10-24T02:03:19.334144+0000","last_peered":"2023-10-24T02:03:19.334144+0000","last_clean":"2023-10-24T02:03:19.334144+0000","last_became_active":"2023-10-24T02:03:18.953155+0000","last_became_peered":"2023-10-24T02:03:18.953155+0000","last_unstale":"2023-10-24T02:03:19.334144+0000","last_undegraded":"2023-10-24T02:03:19.334144+0000","last_fullsized":"2023-10-24T02:03:19.334144+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330520+0000","last_change":"2023-10-24T02:03:19.323200+0000","last_active":"2023-10-24T02:03:19.330520+0000","last_peered":"2023-10-24T02:03:19.330520+0000","last_clean":"2023-10-24T02:03:19.330520+0000","last_became_active":"2023-10-24T02:03:19.322914+0000","last_became_peered":"2023-10-24T02:03:19.322914+0000","last_unstale":"2023-10-24T02:03:19.330520+0000","last_undegraded":"2023-10-24T02:03:19.330520+0000","last_fullsized":"2023-10-24T02:03:19.330520+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317586+0000","last_change":"2023-10-24T02:03:18.964197+0000","last_active":"2023-10-24T02:03:19.317586+0000","last_peered":"2023-10-24T02:03:19.317586+0000","last_clean":"2023-10-24T02:03:19.317586+0000","last_became_active":"2023-10-24T02:03:18.963936+0000","last_became_peered":"2023-10-24T02:03:18.963936+0000","last_unstale":"2023-10-24T02:03:19.317586+0000","last_undegraded":"2023-10-24T02:03:19.317586+0000","last_fullsized":"2023-10-24T02:03:19.317586+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333024+0000","last_change":"2023-10-24T02:03:19.327356+0000","last_active":"2023-10-24T02:03:19.333024+0000","last_peered":"2023-10-24T02:03:19.333024+0000","last_clean":"2023-10-24T02:03:19.333024+0000","last_became_active":"2023-10-24T02:03:19.327115+0000","last_became_peered":"2023-10-24T02:03:19.327115+0000","last_unstale":"2023-10-24T02:03:19.333024+0000","last_undegraded":"2023-10-24T02:03:19.333024+0000","last_fullsized":"2023-10-24T02:03:19.333024+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317419+0000","last_change":"2023-10-24T02:03:18.961462+0000","last_active":"2023-10-24T02:03:19.317419+0000","last_peered":"2023-10-24T02:03:19.317419+0000","last_clean":"2023-10-24T02:03:19.317419+0000","last_became_active":"2023-10-24T02:03:18.961159+0000","last_became_peered":"2023-10-24T02:03:18.961159+0000","last_unstale":"2023-10-24T02:03:19.317419+0000","last_undegraded":"2023-10-24T02:03:19.317419+0000","last_fullsized":"2023-10-24T02:03:19.317419+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332587+0000","last_change":"2023-10-24T02:03:19.327978+0000","last_active":"2023-10-24T02:03:19.332587+0000","last_peered":"2023-10-24T02:03:19.332587+0000","last_clean":"2023-10-24T02:03:19.332587+0000","last_became_active":"2023-10-24T02:03:19.327512+0000","last_became_peered":"2023-10-24T02:03:19.327512+0000","last_unstale":"2023-10-24T02:03:19.332587+0000","last_undegraded":"2023-10-24T02:03:19.332587+0000","last_fullsized":"2023-10-24T02:03:19.332587+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312503+0000","last_change":"2023-10-24T02:03:18.949485+0000","last_active":"2023-10-24T02:03:19.312503+0000","last_peered":"2023-10-24T02:03:19.312503+0000","last_clean":"2023-10-24T02:03:19.312503+0000","last_became_active":"2023-10-24T02:03:18.949208+0000","last_became_peered":"2023-10-24T02:03:18.949208+0000","last_unstale":"2023-10-24T02:03:19.312503+0000","last_undegraded":"2023-10-24T02:03:19.312503+0000","last_fullsized":"2023-10-24T02:03:19.312503+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337059+0000","last_change":"2023-10-24T02:03:19.336424+0000","last_active":"2023-10-24T02:03:19.337059+0000","last_peered":"2023-10-24T02:03:19.337059+0000","last_clean":"2023-10-24T02:03:19.337059+0000","last_became_active":"2023-10-24T02:03:19.336178+0000","last_became_peered":"2023-10-24T02:03:19.336178+0000","last_unstale":"2023-10-24T02:03:19.337059+0000","last_undegraded":"2023-10-24T02:03:19.337059+0000","last_fullsized":"2023-10-24T02:03:19.337059+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.324221+0000","last_change":"2023-10-24T02:03:18.957342+0000","last_active":"2023-10-24T02:03:19.324221+0000","last_peered":"2023-10-24T02:03:19.324221+0000","last_clean":"2023-10-24T02:03:19.324221+0000","last_became_active":"2023-10-24T02:03:18.957072+0000","last_became_peered":"2023-10-24T02:03:18.957072+0000","last_unstale":"2023-10-24T02:03:19.324221+0000","last_undegraded":"2023-10-24T02:03:19.324221+0000","last_fullsized":"2023-10-24T02:03:19.324221+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334549+0000","last_change":"2023-10-24T02:03:19.327702+0000","last_active":"2023-10-24T02:03:19.334549+0000","last_peered":"2023-10-24T02:03:19.334549+0000","last_clean":"2023-10-24T02:03:19.334549+0000","last_became_active":"2023-10-24T02:03:19.327444+0000","last_became_peered":"2023-10-24T02:03:19.327444+0000","last_unstale":"2023-10-24T02:03:19.334549+0000","last_undegraded":"2023-10-24T02:03:19.334549+0000","last_fullsized":"2023-10-24T02:03:19.334549+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.326035+0000","last_change":"2023-10-24T02:03:18.959865+0000","last_active":"2023-10-24T02:03:19.326035+0000","last_peered":"2023-10-24T02:03:19.326035+0000","last_clean":"2023-10-24T02:03:19.326035+0000","last_became_active":"2023-10-24T02:03:18.959532+0000","last_became_peered":"2023-10-24T02:03:18.959532+0000","last_unstale":"2023-10-24T02:03:19.326035+0000","last_undegraded":"2023-10-24T02:03:19.326035+0000","last_fullsized":"2023-10-24T02:03:19.326035+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339985+0000","last_change":"2023-10-24T02:03:19.337262+0000","last_active":"2023-10-24T02:03:19.339985+0000","last_peered":"2023-10-24T02:03:19.339985+0000","last_clean":"2023-10-24T02:03:19.339985+0000","last_became_active":"2023-10-24T02:03:19.336834+0000","last_became_peered":"2023-10-24T02:03:19.336834+0000","last_unstale":"2023-10-24T02:03:19.339985+0000","last_undegraded":"2023-10-24T02:03:19.339985+0000","last_fullsized":"2023-10-24T02:03:19.339985+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317301+0000","last_change":"2023-10-24T02:03:18.955695+0000","last_active":"2023-10-24T02:03:19.317301+0000","last_peered":"2023-10-24T02:03:19.317301+0000","last_clean":"2023-10-24T02:03:19.317301+0000","last_became_active":"2023-10-24T02:03:18.955414+0000","last_became_peered":"2023-10-24T02:03:18.955414+0000","last_unstale":"2023-10-24T02:03:19.317301+0000","last_undegraded":"2023-10-24T02:03:19.317301+0000","last_fullsized":"2023-10-24T02:03:19.317301+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333698+0000","last_change":"2023-10-24T02:03:19.324680+0000","last_active":"2023-10-24T02:03:19.333698+0000","last_peered":"2023-10-24T02:03:19.333698+0000","last_clean":"2023-10-24T02:03:19.333698+0000","last_became_active":"2023-10-24T02:03:19.324367+0000","last_became_peered":"2023-10-24T02:03:19.324367+0000","last_unstale":"2023-10-24T02:03:19.333698+0000","last_undegraded":"2023-10-24T02:03:19.333698+0000","last_fullsized":"2023-10-24T02:03:19.333698+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319331+0000","last_change":"2023-10-24T02:03:18.960459+0000","last_active":"2023-10-24T02:03:19.319331+0000","last_peered":"2023-10-24T02:03:19.319331+0000","last_clean":"2023-10-24T02:03:19.319331+0000","last_became_active":"2023-10-24T02:03:18.959875+0000","last_became_peered":"2023-10-24T02:03:18.959875+0000","last_unstale":"2023-10-24T02:03:19.319331+0000","last_undegraded":"2023-10-24T02:03:19.319331+0000","last_fullsized":"2023-10-24T02:03:19.319331+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333399+0000","last_change":"2023-10-24T02:03:19.331502+0000","last_active":"2023-10-24T02:03:19.333399+0000","last_peered":"2023-10-24T02:03:19.333399+0000","last_clean":"2023-10-24T02:03:19.333399+0000","last_became_active":"2023-10-24T02:03:19.331209+0000","last_became_peered":"2023-10-24T02:03:19.331209+0000","last_unstale":"2023-10-24T02:03:19.333399+0000","last_undegraded":"2023-10-24T02:03:19.333399+0000","last_fullsized":"2023-10-24T02:03:19.333399+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323109+0000","last_change":"2023-10-24T02:03:18.953320+0000","last_active":"2023-10-24T02:03:19.323109+0000","last_peered":"2023-10-24T02:03:19.323109+0000","last_clean":"2023-10-24T02:03:19.323109+0000","last_became_active":"2023-10-24T02:03:18.953054+0000","last_became_peered":"2023-10-24T02:03:18.953054+0000","last_unstale":"2023-10-24T02:03:19.323109+0000","last_undegraded":"2023-10-24T02:03:19.323109+0000","last_fullsized":"2023-10-24T02:03:19.323109+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333969+0000","last_change":"2023-10-24T02:03:19.328383+0000","last_active":"2023-10-24T02:03:19.333969+0000","last_peered":"2023-10-24T02:03:19.333969+0000","last_clean":"2023-10-24T02:03:19.333969+0000","last_became_active":"2023-10-24T02:03:19.328063+0000","last_became_peered":"2023-10-24T02:03:19.328063+0000","last_unstale":"2023-10-24T02:03:19.333969+0000","last_undegraded":"2023-10-24T02:03:19.333969+0000","last_fullsized":"2023-10-24T02:03:19.333969+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335124+0000","last_change":"2023-10-24T02:03:18.957976+0000","last_active":"2023-10-24T02:03:19.335124+0000","last_peered":"2023-10-24T02:03:19.335124+0000","last_clean":"2023-10-24T02:03:19.335124+0000","last_became_active":"2023-10-24T02:03:18.957677+0000","last_became_peered":"2023-10-24T02:03:18.957677+0000","last_unstale":"2023-10-24T02:03:19.335124+0000","last_undegraded":"2023-10-24T02:03:19.335124+0000","last_fullsized":"2023-10-24T02:03:19.335124+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339682+0000","last_change":"2023-10-24T02:03:19.335783+0000","last_active":"2023-10-24T02:03:19.339682+0000","last_peered":"2023-10-24T02:03:19.339682+0000","last_clean":"2023-10-24T02:03:19.339682+0000","last_became_active":"2023-10-24T02:03:19.335468+0000","last_became_peered":"2023-10-24T02:03:19.335468+0000","last_unstale":"2023-10-24T02:03:19.339682+0000","last_undegraded":"2023-10-24T02:03:19.339682+0000","last_fullsized":"2023-10-24T02:03:19.339682+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317323+0000","last_change":"2023-10-24T02:03:18.956247+0000","last_active":"2023-10-24T02:03:19.317323+0000","last_peered":"2023-10-24T02:03:19.317323+0000","last_clean":"2023-10-24T02:03:19.317323+0000","last_became_active":"2023-10-24T02:03:18.955992+0000","last_became_peered":"2023-10-24T02:03:18.955992+0000","last_unstale":"2023-10-24T02:03:19.317323+0000","last_undegraded":"2023-10-24T02:03:19.317323+0000","last_fullsized":"2023-10-24T02:03:19.317323+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339503+0000","last_change":"2023-10-24T02:03:19.336165+0000","last_active":"2023-10-24T02:03:19.339503+0000","last_peered":"2023-10-24T02:03:19.339503+0000","last_clean":"2023-10-24T02:03:19.339503+0000","last_became_active":"2023-10-24T02:03:19.335892+0000","last_became_peered":"2023-10-24T02:03:19.335892+0000","last_unstale":"2023-10-24T02:03:19.339503+0000","last_undegraded":"2023-10-24T02:03:19.339503+0000","last_fullsized":"2023-10-24T02:03:19.339503+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317076+0000","last_change":"2023-10-24T02:03:18.954814+0000","last_active":"2023-10-24T02:03:19.317076+0000","last_peered":"2023-10-24T02:03:19.317076+0000","last_clean":"2023-10-24T02:03:19.317076+0000","last_became_active":"2023-10-24T02:03:18.954573+0000","last_became_peered":"2023-10-24T02:03:18.954573+0000","last_unstale":"2023-10-24T02:03:19.317076+0000","last_undegraded":"2023-10-24T02:03:19.317076+0000","last_fullsized":"2023-10-24T02:03:19.317076+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336026+0000","last_change":"2023-10-24T02:03:19.330751+0000","last_active":"2023-10-24T02:03:19.336026+0000","last_peered":"2023-10-24T02:03:19.336026+0000","last_clean":"2023-10-24T02:03:19.336026+0000","last_became_active":"2023-10-24T02:03:19.330451+0000","last_became_peered":"2023-10-24T02:03:19.330451+0000","last_unstale":"2023-10-24T02:03:19.336026+0000","last_undegraded":"2023-10-24T02:03:19.336026+0000","last_fullsized":"2023-10-24T02:03:19.336026+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.313463+0000","last_change":"2023-10-24T02:03:18.959730+0000","last_active":"2023-10-24T02:03:19.313463+0000","last_peered":"2023-10-24T02:03:19.313463+0000","last_clean":"2023-10-24T02:03:19.313463+0000","last_became_active":"2023-10-24T02:03:18.959495+0000","last_became_peered":"2023-10-24T02:03:18.959495+0000","last_unstale":"2023-10-24T02:03:19.313463+0000","last_undegraded":"2023-10-24T02:03:19.313463+0000","last_fullsized":"2023-10-24T02:03:19.313463+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332952+0000","last_change":"2023-10-24T02:03:19.329340+0000","last_active":"2023-10-24T02:03:19.332952+0000","last_peered":"2023-10-24T02:03:19.332952+0000","last_clean":"2023-10-24T02:03:19.332952+0000","last_became_active":"2023-10-24T02:03:19.329087+0000","last_became_peered":"2023-10-24T02:03:19.329087+0000","last_unstale":"2023-10-24T02:03:19.332952+0000","last_undegraded":"2023-10-24T02:03:19.332952+0000","last_fullsized":"2023-10-24T02:03:19.332952+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317580+0000","last_change":"2023-10-24T02:03:18.960384+0000","last_active":"2023-10-24T02:03:19.317580+0000","last_peered":"2023-10-24T02:03:19.317580+0000","last_clean":"2023-10-24T02:03:19.317580+0000","last_became_active":"2023-10-24T02:03:18.960105+0000","last_became_peered":"2023-10-24T02:03:18.960105+0000","last_unstale":"2023-10-24T02:03:19.317580+0000","last_undegraded":"2023-10-24T02:03:19.317580+0000","last_fullsized":"2023-10-24T02:03:19.317580+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.346077+0000","last_change":"2023-10-24T02:03:19.338036+0000","last_active":"2023-10-24T02:03:19.346077+0000","last_peered":"2023-10-24T02:03:19.346077+0000","last_clean":"2023-10-24T02:03:19.346077+0000","last_became_active":"2023-10-24T02:03:19.337774+0000","last_became_peered":"2023-10-24T02:03:19.337774+0000","last_unstale":"2023-10-24T02:03:19.346077+0000","last_undegraded":"2023-10-24T02:03:19.346077+0000","last_fullsized":"2023-10-24T02:03:19.346077+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"215'3","reported_seq":13,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333285+0000","last_change":"2023-10-24T02:03:18.956077+0000","last_active":"2023-10-24T02:03:19.333285+0000","last_peered":"2023-10-24T02:03:19.333285+0000","last_clean":"2023-10-24T02:03:19.333285+0000","last_became_active":"2023-10-24T02:03:18.955798+0000","last_became_peered":"2023-10-24T02:03:18.955798+0000","last_unstale":"2023-10-24T02:03:19.333285+0000","last_undegraded":"2023-10-24T02:03:19.333285+0000","last_fullsized":"2023-10-24T02:03:19.333285+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343674+0000","last_change":"2023-10-24T02:03:19.337989+0000","last_active":"2023-10-24T02:03:19.343674+0000","last_peered":"2023-10-24T02:03:19.343674+0000","last_clean":"2023-10-24T02:03:19.343674+0000","last_became_active":"2023-10-24T02:03:19.337750+0000","last_became_peered":"2023-10-24T02:03:19.337750+0000","last_unstale":"2023-10-24T02:03:19.343674+0000","last_undegraded":"2023-10-24T02:03:19.343674+0000","last_fullsized":"2023-10-24T02:03:19.343674+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"215'2","reported_seq":12,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336748+0000","last_change":"2023-10-24T02:03:18.957635+0000","last_active":"2023-10-24T02:03:19.336748+0000","last_peered":"2023-10-24T02:03:19.336748+0000","last_clean":"2023-10-24T02:03:19.336748+0000","last_became_active":"2023-10-24T02:03:18.957339+0000","last_became_peered":"2023-10-24T02:03:18.957339+0000","last_unstale":"2023-10-24T02:03:19.336748+0000","last_undegraded":"2023-10-24T02:03:19.336748+0000","last_fullsized":"2023-10-24T02:03:19.336748+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333694+0000","last_change":"2023-10-24T02:03:19.324630+0000","last_active":"2023-10-24T02:03:19.333694+0000","last_peered":"2023-10-24T02:03:19.333694+0000","last_clean":"2023-10-24T02:03:19.333694+0000","last_became_active":"2023-10-24T02:03:19.324336+0000","last_became_peered":"2023-10-24T02:03:19.324336+0000","last_unstale":"2023-10-24T02:03:19.333694+0000","last_undegraded":"2023-10-24T02:03:19.333694+0000","last_fullsized":"2023-10-24T02:03:19.333694+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.341691+0000","last_change":"2023-10-24T02:03:18.958287+0000","last_active":"2023-10-24T02:03:19.341691+0000","last_peered":"2023-10-24T02:03:19.341691+0000","last_clean":"2023-10-24T02:03:19.341691+0000","last_became_active":"2023-10-24T02:03:18.958012+0000","last_became_peered":"2023-10-24T02:03:18.958012+0000","last_unstale":"2023-10-24T02:03:19.341691+0000","last_undegraded":"2023-10-24T02:03:19.341691+0000","last_fullsized":"2023-10-24T02:03:19.341691+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332961+0000","last_change":"2023-10-24T02:03:19.327066+0000","last_active":"2023-10-24T02:03:19.332961+0000","last_peered":"2023-10-24T02:03:19.332961+0000","last_clean":"2023-10-24T02:03:19.332961+0000","last_became_active":"2023-10-24T02:03:19.326824+0000","last_became_peered":"2023-10-24T02:03:19.326824+0000","last_unstale":"2023-10-24T02:03:19.332961+0000","last_undegraded":"2023-10-24T02:03:19.332961+0000","last_fullsized":"2023-10-24T02:03:19.332961+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319224+0000","last_change":"2023-10-24T02:03:18.961603+0000","last_active":"2023-10-24T02:03:19.319224+0000","last_peered":"2023-10-24T02:03:19.319224+0000","last_clean":"2023-10-24T02:03:19.319224+0000","last_became_active":"2023-10-24T02:03:18.961258+0000","last_became_peered":"2023-10-24T02:03:18.961258+0000","last_unstale":"2023-10-24T02:03:19.319224+0000","last_undegraded":"2023-10-24T02:03:19.319224+0000","last_fullsized":"2023-10-24T02:03:19.319224+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334772+0000","last_change":"2023-10-24T02:03:19.327485+0000","last_active":"2023-10-24T02:03:19.334772+0000","last_peered":"2023-10-24T02:03:19.334772+0000","last_clean":"2023-10-24T02:03:19.334772+0000","last_became_active":"2023-10-24T02:03:19.327167+0000","last_became_peered":"2023-10-24T02:03:19.327167+0000","last_unstale":"2023-10-24T02:03:19.334772+0000","last_undegraded":"2023-10-24T02:03:19.334772+0000","last_fullsized":"2023-10-24T02:03:19.334772+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317653+0000","last_change":"2023-10-24T02:03:18.956207+0000","last_active":"2023-10-24T02:03:19.317653+0000","last_peered":"2023-10-24T02:03:19.317653+0000","last_clean":"2023-10-24T02:03:19.317653+0000","last_became_active":"2023-10-24T02:03:18.955935+0000","last_became_peered":"2023-10-24T02:03:18.955935+0000","last_unstale":"2023-10-24T02:03:19.317653+0000","last_undegraded":"2023-10-24T02:03:19.317653+0000","last_fullsized":"2023-10-24T02:03:19.317653+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336955+0000","last_change":"2023-10-24T02:03:19.330873+0000","last_active":"2023-10-24T02:03:19.336955+0000","last_peered":"2023-10-24T02:03:19.336955+0000","last_clean":"2023-10-24T02:03:19.336955+0000","last_became_active":"2023-10-24T02:03:19.330351+0000","last_became_peered":"2023-10-24T02:03:19.330351+0000","last_unstale":"2023-10-24T02:03:19.336955+0000","last_undegraded":"2023-10-24T02:03:19.336955+0000","last_fullsized":"2023-10-24T02:03:19.336955+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"215'4","reported_seq":14,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343999+0000","last_change":"2023-10-24T02:03:18.959527+0000","last_active":"2023-10-24T02:03:19.343999+0000","last_peered":"2023-10-24T02:03:19.343999+0000","last_clean":"2023-10-24T02:03:19.343999+0000","last_became_active":"2023-10-24T02:03:18.959259+0000","last_became_peered":"2023-10-24T02:03:18.959259+0000","last_unstale":"2023-10-24T02:03:19.343999+0000","last_undegraded":"2023-10-24T02:03:19.343999+0000","last_fullsized":"2023-10-24T02:03:19.343999+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333836+0000","last_change":"2023-10-24T02:03:19.327340+0000","last_active":"2023-10-24T02:03:19.333836+0000","last_peered":"2023-10-24T02:03:19.333836+0000","last_clean":"2023-10-24T02:03:19.333836+0000","last_became_active":"2023-10-24T02:03:19.327086+0000","last_became_peered":"2023-10-24T02:03:19.327086+0000","last_unstale":"2023-10-24T02:03:19.333836+0000","last_undegraded":"2023-10-24T02:03:19.333836+0000","last_fullsized":"2023-10-24T02:03:19.333836+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.344236+0000","last_change":"2023-10-24T02:03:18.960234+0000","last_active":"2023-10-24T02:03:19.344236+0000","last_peered":"2023-10-24T02:03:19.344236+0000","last_clean":"2023-10-24T02:03:19.344236+0000","last_became_active":"2023-10-24T02:03:18.959668+0000","last_became_peered":"2023-10-24T02:03:18.959668+0000","last_unstale":"2023-10-24T02:03:19.344236+0000","last_undegraded":"2023-10-24T02:03:19.344236+0000","last_fullsized":"2023-10-24T02:03:19.344236+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333457+0000","last_change":"2023-10-24T02:03:19.331854+0000","last_active":"2023-10-24T02:03:19.333457+0000","last_peered":"2023-10-24T02:03:19.333457+0000","last_clean":"2023-10-24T02:03:19.333457+0000","last_became_active":"2023-10-24T02:03:19.331474+0000","last_became_peered":"2023-10-24T02:03:19.331474+0000","last_unstale":"2023-10-24T02:03:19.333457+0000","last_undegraded":"2023-10-24T02:03:19.333457+0000","last_fullsized":"2023-10-24T02:03:19.333457+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"215'2","reported_seq":12,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335464+0000","last_change":"2023-10-24T02:03:18.957158+0000","last_active":"2023-10-24T02:03:19.335464+0000","last_peered":"2023-10-24T02:03:19.335464+0000","last_clean":"2023-10-24T02:03:19.335464+0000","last_became_active":"2023-10-24T02:03:18.956881+0000","last_became_peered":"2023-10-24T02:03:18.956881+0000","last_unstale":"2023-10-24T02:03:19.335464+0000","last_undegraded":"2023-10-24T02:03:19.335464+0000","last_fullsized":"2023-10-24T02:03:19.335464+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339968+0000","last_change":"2023-10-24T02:03:19.337161+0000","last_active":"2023-10-24T02:03:19.339968+0000","last_peered":"2023-10-24T02:03:19.339968+0000","last_clean":"2023-10-24T02:03:19.339968+0000","last_became_active":"2023-10-24T02:03:19.336504+0000","last_became_peered":"2023-10-24T02:03:19.336504+0000","last_unstale":"2023-10-24T02:03:19.339968+0000","last_undegraded":"2023-10-24T02:03:19.339968+0000","last_fullsized":"2023-10-24T02:03:19.339968+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.323746+0000","last_change":"2023-10-24T02:03:18.952051+0000","last_active":"2023-10-24T02:03:19.323746+0000","last_peered":"2023-10-24T02:03:19.323746+0000","last_clean":"2023-10-24T02:03:19.323746+0000","last_became_active":"2023-10-24T02:03:18.951753+0000","last_became_peered":"2023-10-24T02:03:18.951753+0000","last_unstale":"2023-10-24T02:03:19.323746+0000","last_undegraded":"2023-10-24T02:03:19.323746+0000","last_fullsized":"2023-10-24T02:03:19.323746+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332647+0000","last_change":"2023-10-24T02:03:19.327051+0000","last_active":"2023-10-24T02:03:19.332647+0000","last_peered":"2023-10-24T02:03:19.332647+0000","last_clean":"2023-10-24T02:03:19.332647+0000","last_became_active":"2023-10-24T02:03:19.326751+0000","last_became_peered":"2023-10-24T02:03:19.326751+0000","last_unstale":"2023-10-24T02:03:19.332647+0000","last_undegraded":"2023-10-24T02:03:19.332647+0000","last_fullsized":"2023-10-24T02:03:19.332647+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337834+0000","last_change":"2023-10-24T02:03:18.956970+0000","last_active":"2023-10-24T02:03:19.337834+0000","last_peered":"2023-10-24T02:03:19.337834+0000","last_clean":"2023-10-24T02:03:19.337834+0000","last_became_active":"2023-10-24T02:03:18.956541+0000","last_became_peered":"2023-10-24T02:03:18.956541+0000","last_unstale":"2023-10-24T02:03:19.337834+0000","last_undegraded":"2023-10-24T02:03:19.337834+0000","last_fullsized":"2023-10-24T02:03:19.337834+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330380+0000","last_change":"2023-10-24T02:03:19.321957+0000","last_active":"2023-10-24T02:03:19.330380+0000","last_peered":"2023-10-24T02:03:19.330380+0000","last_clean":"2023-10-24T02:03:19.330380+0000","last_became_active":"2023-10-24T02:03:19.321700+0000","last_became_peered":"2023-10-24T02:03:19.321700+0000","last_unstale":"2023-10-24T02:03:19.330380+0000","last_undegraded":"2023-10-24T02:03:19.330380+0000","last_fullsized":"2023-10-24T02:03:19.330380+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337012+0000","last_change":"2023-10-24T02:03:18.955188+0000","last_active":"2023-10-24T02:03:19.337012+0000","last_peered":"2023-10-24T02:03:19.337012+0000","last_clean":"2023-10-24T02:03:19.337012+0000","last_became_active":"2023-10-24T02:03:18.954463+0000","last_became_peered":"2023-10-24T02:03:18.954463+0000","last_unstale":"2023-10-24T02:03:19.337012+0000","last_undegraded":"2023-10-24T02:03:19.337012+0000","last_fullsized":"2023-10-24T02:03:19.337012+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343755+0000","last_change":"2023-10-24T02:03:19.335596+0000","last_active":"2023-10-24T02:03:19.343755+0000","last_peered":"2023-10-24T02:03:19.343755+0000","last_clean":"2023-10-24T02:03:19.343755+0000","last_became_active":"2023-10-24T02:03:19.335246+0000","last_became_peered":"2023-10-24T02:03:19.335246+0000","last_unstale":"2023-10-24T02:03:19.343755+0000","last_undegraded":"2023-10-24T02:03:19.343755+0000","last_fullsized":"2023-10-24T02:03:19.343755+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317809+0000","last_change":"2023-10-24T02:03:18.958952+0000","last_active":"2023-10-24T02:03:19.317809+0000","last_peered":"2023-10-24T02:03:19.317809+0000","last_clean":"2023-10-24T02:03:19.317809+0000","last_became_active":"2023-10-24T02:03:18.958614+0000","last_became_peered":"2023-10-24T02:03:18.958614+0000","last_unstale":"2023-10-24T02:03:19.317809+0000","last_undegraded":"2023-10-24T02:03:19.317809+0000","last_fullsized":"2023-10-24T02:03:19.317809+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.343784+0000","last_change":"2023-10-24T02:03:19.336425+0000","last_active":"2023-10-24T02:03:19.343784+0000","last_peered":"2023-10-24T02:03:19.343784+0000","last_clean":"2023-10-24T02:03:19.343784+0000","last_became_active":"2023-10-24T02:03:19.336148+0000","last_became_peered":"2023-10-24T02:03:19.336148+0000","last_unstale":"2023-10-24T02:03:19.343784+0000","last_undegraded":"2023-10-24T02:03:19.343784+0000","last_fullsized":"2023-10-24T02:03:19.343784+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319142+0000","last_change":"2023-10-24T02:03:18.949597+0000","last_active":"2023-10-24T02:03:19.319142+0000","last_peered":"2023-10-24T02:03:19.319142+0000","last_clean":"2023-10-24T02:03:19.319142+0000","last_became_active":"2023-10-24T02:03:18.949301+0000","last_became_peered":"2023-10-24T02:03:18.949301+0000","last_unstale":"2023-10-24T02:03:19.319142+0000","last_undegraded":"2023-10-24T02:03:19.319142+0000","last_fullsized":"2023-10-24T02:03:19.319142+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330003+0000","last_change":"2023-10-24T02:03:19.322989+0000","last_active":"2023-10-24T02:03:19.330003+0000","last_peered":"2023-10-24T02:03:19.330003+0000","last_clean":"2023-10-24T02:03:19.330003+0000","last_became_active":"2023-10-24T02:03:19.322759+0000","last_became_peered":"2023-10-24T02:03:19.322759+0000","last_unstale":"2023-10-24T02:03:19.330003+0000","last_undegraded":"2023-10-24T02:03:19.330003+0000","last_fullsized":"2023-10-24T02:03:19.330003+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.321689+0000","last_change":"2023-10-24T02:03:18.953286+0000","last_active":"2023-10-24T02:03:19.321689+0000","last_peered":"2023-10-24T02:03:19.321689+0000","last_clean":"2023-10-24T02:03:19.321689+0000","last_became_active":"2023-10-24T02:03:18.952922+0000","last_became_peered":"2023-10-24T02:03:18.952922+0000","last_unstale":"2023-10-24T02:03:19.321689+0000","last_undegraded":"2023-10-24T02:03:19.321689+0000","last_fullsized":"2023-10-24T02:03:19.321689+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.342830+0000","last_change":"2023-10-24T02:03:19.335827+0000","last_active":"2023-10-24T02:03:19.342830+0000","last_peered":"2023-10-24T02:03:19.342830+0000","last_clean":"2023-10-24T02:03:19.342830+0000","last_became_active":"2023-10-24T02:03:19.335629+0000","last_became_peered":"2023-10-24T02:03:19.335629+0000","last_unstale":"2023-10-24T02:03:19.342830+0000","last_undegraded":"2023-10-24T02:03:19.342830+0000","last_fullsized":"2023-10-24T02:03:19.342830+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"215'2","reported_seq":12,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335273+0000","last_change":"2023-10-24T02:03:18.955515+0000","last_active":"2023-10-24T02:03:19.335273+0000","last_peered":"2023-10-24T02:03:19.335273+0000","last_clean":"2023-10-24T02:03:19.335273+0000","last_became_active":"2023-10-24T02:03:18.955154+0000","last_became_peered":"2023-10-24T02:03:18.955154+0000","last_unstale":"2023-10-24T02:03:19.335273+0000","last_undegraded":"2023-10-24T02:03:19.335273+0000","last_fullsized":"2023-10-24T02:03:19.335273+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.339761+0000","last_change":"2023-10-24T02:03:19.334330+0000","last_active":"2023-10-24T02:03:19.339761+0000","last_peered":"2023-10-24T02:03:19.339761+0000","last_clean":"2023-10-24T02:03:19.339761+0000","last_became_active":"2023-10-24T02:03:19.334028+0000","last_became_peered":"2023-10-24T02:03:19.334028+0000","last_unstale":"2023-10-24T02:03:19.339761+0000","last_undegraded":"2023-10-24T02:03:19.339761+0000","last_fullsized":"2023-10-24T02:03:19.339761+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319553+0000","last_change":"2023-10-24T02:03:18.950142+0000","last_active":"2023-10-24T02:03:19.319553+0000","last_peered":"2023-10-24T02:03:19.319553+0000","last_clean":"2023-10-24T02:03:19.319553+0000","last_became_active":"2023-10-24T02:03:18.949874+0000","last_became_peered":"2023-10-24T02:03:18.949874+0000","last_unstale":"2023-10-24T02:03:19.319553+0000","last_undegraded":"2023-10-24T02:03:19.319553+0000","last_fullsized":"2023-10-24T02:03:19.319553+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336087+0000","last_change":"2023-10-24T02:03:19.330661+0000","last_active":"2023-10-24T02:03:19.336087+0000","last_peered":"2023-10-24T02:03:19.336087+0000","last_clean":"2023-10-24T02:03:19.336087+0000","last_became_active":"2023-10-24T02:03:19.329630+0000","last_became_peered":"2023-10-24T02:03:19.329630+0000","last_unstale":"2023-10-24T02:03:19.336087+0000","last_undegraded":"2023-10-24T02:03:19.336087+0000","last_fullsized":"2023-10-24T02:03:19.336087+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312799+0000","last_change":"2023-10-24T02:03:18.959033+0000","last_active":"2023-10-24T02:03:19.312799+0000","last_peered":"2023-10-24T02:03:19.312799+0000","last_clean":"2023-10-24T02:03:19.312799+0000","last_became_active":"2023-10-24T02:03:18.958731+0000","last_became_peered":"2023-10-24T02:03:18.958731+0000","last_unstale":"2023-10-24T02:03:19.312799+0000","last_undegraded":"2023-10-24T02:03:19.312799+0000","last_fullsized":"2023-10-24T02:03:19.312799+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.342853+0000","last_change":"2023-10-24T02:03:19.336383+0000","last_active":"2023-10-24T02:03:19.342853+0000","last_peered":"2023-10-24T02:03:19.342853+0000","last_clean":"2023-10-24T02:03:19.342853+0000","last_became_active":"2023-10-24T02:03:19.336135+0000","last_became_peered":"2023-10-24T02:03:19.336135+0000","last_unstale":"2023-10-24T02:03:19.342853+0000","last_undegraded":"2023-10-24T02:03:19.342853+0000","last_fullsized":"2023-10-24T02:03:19.342853+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.313502+0000","last_change":"2023-10-24T02:03:18.951834+0000","last_active":"2023-10-24T02:03:19.313502+0000","last_peered":"2023-10-24T02:03:19.313502+0000","last_clean":"2023-10-24T02:03:19.313502+0000","last_became_active":"2023-10-24T02:03:18.949164+0000","last_became_peered":"2023-10-24T02:03:18.949164+0000","last_unstale":"2023-10-24T02:03:19.313502+0000","last_undegraded":"2023-10-24T02:03:19.313502+0000","last_fullsized":"2023-10-24T02:03:19.313502+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334498+0000","last_change":"2023-10-24T02:03:19.326881+0000","last_active":"2023-10-24T02:03:19.334498+0000","last_peered":"2023-10-24T02:03:19.334498+0000","last_clean":"2023-10-24T02:03:19.334498+0000","last_became_active":"2023-10-24T02:03:19.326609+0000","last_became_peered":"2023-10-24T02:03:19.326609+0000","last_unstale":"2023-10-24T02:03:19.334498+0000","last_undegraded":"2023-10-24T02:03:19.334498+0000","last_fullsized":"2023-10-24T02:03:19.334498+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.313871+0000","last_change":"2023-10-24T02:03:18.950503+0000","last_active":"2023-10-24T02:03:19.313871+0000","last_peered":"2023-10-24T02:03:19.313871+0000","last_clean":"2023-10-24T02:03:19.313871+0000","last_became_active":"2023-10-24T02:03:18.950174+0000","last_became_peered":"2023-10-24T02:03:18.950174+0000","last_unstale":"2023-10-24T02:03:19.313871+0000","last_undegraded":"2023-10-24T02:03:19.313871+0000","last_fullsized":"2023-10-24T02:03:19.313871+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.336916+0000","last_change":"2023-10-24T02:03:19.331184+0000","last_active":"2023-10-24T02:03:19.336916+0000","last_peered":"2023-10-24T02:03:19.336916+0000","last_clean":"2023-10-24T02:03:19.336916+0000","last_became_active":"2023-10-24T02:03:19.330854+0000","last_became_peered":"2023-10-24T02:03:19.330854+0000","last_unstale":"2023-10-24T02:03:19.336916+0000","last_undegraded":"2023-10-24T02:03:19.336916+0000","last_fullsized":"2023-10-24T02:03:19.336916+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.313084+0000","last_change":"2023-10-24T02:03:18.947343+0000","last_active":"2023-10-24T02:03:19.313084+0000","last_peered":"2023-10-24T02:03:19.313084+0000","last_clean":"2023-10-24T02:03:19.313084+0000","last_became_active":"2023-10-24T02:03:18.947006+0000","last_became_peered":"2023-10-24T02:03:18.947006+0000","last_unstale":"2023-10-24T02:03:19.313084+0000","last_undegraded":"2023-10-24T02:03:19.313084+0000","last_fullsized":"2023-10-24T02:03:19.313084+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333003+0000","last_change":"2023-10-24T02:03:19.328355+0000","last_active":"2023-10-24T02:03:19.333003+0000","last_peered":"2023-10-24T02:03:19.333003+0000","last_clean":"2023-10-24T02:03:19.333003+0000","last_became_active":"2023-10-24T02:03:19.327574+0000","last_became_peered":"2023-10-24T02:03:19.327574+0000","last_unstale":"2023-10-24T02:03:19.333003+0000","last_undegraded":"2023-10-24T02:03:19.333003+0000","last_fullsized":"2023-10-24T02:03:19.333003+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319231+0000","last_change":"2023-10-24T02:03:18.953817+0000","last_active":"2023-10-24T02:03:19.319231+0000","last_peered":"2023-10-24T02:03:19.319231+0000","last_clean":"2023-10-24T02:03:19.319231+0000","last_became_active":"2023-10-24T02:03:18.953457+0000","last_became_peered":"2023-10-24T02:03:18.953457+0000","last_unstale":"2023-10-24T02:03:19.319231+0000","last_undegraded":"2023-10-24T02:03:19.319231+0000","last_fullsized":"2023-10-24T02:03:19.319231+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334610+0000","last_change":"2023-10-24T02:03:19.329349+0000","last_active":"2023-10-24T02:03:19.334610+0000","last_peered":"2023-10-24T02:03:19.334610+0000","last_clean":"2023-10-24T02:03:19.334610+0000","last_became_active":"2023-10-24T02:03:19.329050+0000","last_became_peered":"2023-10-24T02:03:19.329050+0000","last_unstale":"2023-10-24T02:03:19.334610+0000","last_undegraded":"2023-10-24T02:03:19.334610+0000","last_fullsized":"2023-10-24T02:03:19.334610+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.321841+0000","last_change":"2023-10-24T02:03:18.954146+0000","last_active":"2023-10-24T02:03:19.321841+0000","last_peered":"2023-10-24T02:03:19.321841+0000","last_clean":"2023-10-24T02:03:19.321841+0000","last_became_active":"2023-10-24T02:03:18.953805+0000","last_became_peered":"2023-10-24T02:03:18.953805+0000","last_unstale":"2023-10-24T02:03:19.321841+0000","last_undegraded":"2023-10-24T02:03:19.321841+0000","last_fullsized":"2023-10-24T02:03:19.321841+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335201+0000","last_change":"2023-10-24T02:03:19.328676+0000","last_active":"2023-10-24T02:03:19.335201+0000","last_peered":"2023-10-24T02:03:19.335201+0000","last_clean":"2023-10-24T02:03:19.335201+0000","last_became_active":"2023-10-24T02:03:19.328117+0000","last_became_peered":"2023-10-24T02:03:19.328117+0000","last_unstale":"2023-10-24T02:03:19.335201+0000","last_undegraded":"2023-10-24T02:03:19.335201+0000","last_fullsized":"2023-10-24T02:03:19.335201+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333880+0000","last_change":"2023-10-24T02:03:18.956705+0000","last_active":"2023-10-24T02:03:19.333880+0000","last_peered":"2023-10-24T02:03:19.333880+0000","last_clean":"2023-10-24T02:03:19.333880+0000","last_became_active":"2023-10-24T02:03:18.956408+0000","last_became_peered":"2023-10-24T02:03:18.956408+0000","last_unstale":"2023-10-24T02:03:19.333880+0000","last_undegraded":"2023-10-24T02:03:19.333880+0000","last_fullsized":"2023-10-24T02:03:19.333880+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317061+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:19.317061+0000","last_peered":"2023-10-24T02:03:19.317061+0000","last_clean":"2023-10-24T02:03:19.317061+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:19.317061+0000","last_undegraded":"2023-10-24T02:03:19.317061+0000","last_fullsized":"2023-10-24T02:03:19.317061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334689+0000","last_change":"2023-10-24T02:03:19.331332+0000","last_active":"2023-10-24T02:03:19.334689+0000","last_peered":"2023-10-24T02:03:19.334689+0000","last_clean":"2023-10-24T02:03:19.334689+0000","last_became_active":"2023-10-24T02:03:19.331090+0000","last_became_peered":"2023-10-24T02:03:19.331090+0000","last_unstale":"2023-10-24T02:03:19.334689+0000","last_undegraded":"2023-10-24T02:03:19.334689+0000","last_fullsized":"2023-10-24T02:03:19.334689+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.328220+0000","last_change":"2023-10-24T02:03:18.957336+0000","last_active":"2023-10-24T02:03:19.328220+0000","last_peered":"2023-10-24T02:03:19.328220+0000","last_clean":"2023-10-24T02:03:19.328220+0000","last_became_active":"2023-10-24T02:03:18.957093+0000","last_became_peered":"2023-10-24T02:03:18.957093+0000","last_unstale":"2023-10-24T02:03:19.328220+0000","last_undegraded":"2023-10-24T02:03:19.328220+0000","last_fullsized":"2023-10-24T02:03:19.328220+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335225+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:19.335225+0000","last_peered":"2023-10-24T02:03:19.335225+0000","last_clean":"2023-10-24T02:03:19.335225+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:19.335225+0000","last_undegraded":"2023-10-24T02:03:19.335225+0000","last_fullsized":"2023-10-24T02:03:19.335225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.330425+0000","last_change":"2023-10-24T02:03:19.323492+0000","last_active":"2023-10-24T02:03:19.330425+0000","last_peered":"2023-10-24T02:03:19.330425+0000","last_clean":"2023-10-24T02:03:19.330425+0000","last_became_active":"2023-10-24T02:03:19.323043+0000","last_became_peered":"2023-10-24T02:03:19.323043+0000","last_unstale":"2023-10-24T02:03:19.330425+0000","last_undegraded":"2023-10-24T02:03:19.330425+0000","last_fullsized":"2023-10-24T02:03:19.330425+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317709+0000","last_change":"2023-10-24T02:03:18.963798+0000","last_active":"2023-10-24T02:03:19.317709+0000","last_peered":"2023-10-24T02:03:19.317709+0000","last_clean":"2023-10-24T02:03:19.317709+0000","last_became_active":"2023-10-24T02:03:18.963483+0000","last_became_peered":"2023-10-24T02:03:18.963483+0000","last_unstale":"2023-10-24T02:03:19.317709+0000","last_undegraded":"2023-10-24T02:03:19.317709+0000","last_fullsized":"2023-10-24T02:03:19.317709+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.319318+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:19.319318+0000","last_peered":"2023-10-24T02:03:19.319318+0000","last_clean":"2023-10-24T02:03:19.319318+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:19.319318+0000","last_undegraded":"2023-10-24T02:03:19.319318+0000","last_fullsized":"2023-10-24T02:03:19.319318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.335116+0000","last_change":"2023-10-24T02:03:19.331740+0000","last_active":"2023-10-24T02:03:19.335116+0000","last_peered":"2023-10-24T02:03:19.335116+0000","last_clean":"2023-10-24T02:03:19.335116+0000","last_became_active":"2023-10-24T02:03:19.331202+0000","last_became_peered":"2023-10-24T02:03:19.331202+0000","last_unstale":"2023-10-24T02:03:19.335116+0000","last_undegraded":"2023-10-24T02:03:19.335116+0000","last_fullsized":"2023-10-24T02:03:19.335116+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317265+0000","last_change":"2023-10-24T02:03:18.957250+0000","last_active":"2023-10-24T02:03:19.317265+0000","last_peered":"2023-10-24T02:03:19.317265+0000","last_clean":"2023-10-24T02:03:19.317265+0000","last_became_active":"2023-10-24T02:03:18.957017+0000","last_became_peered":"2023-10-24T02:03:18.957017+0000","last_unstale":"2023-10-24T02:03:19.317265+0000","last_undegraded":"2023-10-24T02:03:19.317265+0000","last_fullsized":"2023-10-24T02:03:19.317265+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.337805+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:19.337805+0000","last_peered":"2023-10-24T02:03:19.337805+0000","last_clean":"2023-10-24T02:03:19.337805+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:19.337805+0000","last_undegraded":"2023-10-24T02:03:19.337805+0000","last_fullsized":"2023-10-24T02:03:19.337805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":209,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312552+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:19.312552+0000","last_peered":"2023-10-24T02:03:19.312552+0000","last_clean":"2023-10-24T02:03:19.312552+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:19.312552+0000","last_undegraded":"2023-10-24T02:03:19.312552+0000","last_fullsized":"2023-10-24T02:03:19.312552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.332656+0000","last_change":"2023-10-24T02:03:19.324465+0000","last_active":"2023-10-24T02:03:19.332656+0000","last_peered":"2023-10-24T02:03:19.332656+0000","last_clean":"2023-10-24T02:03:19.332656+0000","last_became_active":"2023-10-24T02:03:19.324177+0000","last_became_peered":"2023-10-24T02:03:19.324177+0000","last_unstale":"2023-10-24T02:03:19.332656+0000","last_undegraded":"2023-10-24T02:03:19.332656+0000","last_fullsized":"2023-10-24T02:03:19.332656+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312664+0000","last_change":"2023-10-24T02:03:18.954457+0000","last_active":"2023-10-24T02:03:19.312664+0000","last_peered":"2023-10-24T02:03:19.312664+0000","last_clean":"2023-10-24T02:03:19.312664+0000","last_became_active":"2023-10-24T02:03:18.954148+0000","last_became_peered":"2023-10-24T02:03:18.954148+0000","last_unstale":"2023-10-24T02:03:19.312664+0000","last_undegraded":"2023-10-24T02:03:19.312664+0000","last_fullsized":"2023-10-24T02:03:19.312664+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":207,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312643+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:19.312643+0000","last_peered":"2023-10-24T02:03:19.312643+0000","last_clean":"2023-10-24T02:03:19.312643+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:19.312643+0000","last_undegraded":"2023-10-24T02:03:19.312643+0000","last_fullsized":"2023-10-24T02:03:19.312643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.333774+0000","last_change":"2023-10-24T02:03:19.326240+0000","last_active":"2023-10-24T02:03:19.333774+0000","last_peered":"2023-10-24T02:03:19.333774+0000","last_clean":"2023-10-24T02:03:19.333774+0000","last_became_active":"2023-10-24T02:03:19.325944+0000","last_became_peered":"2023-10-24T02:03:19.325944+0000","last_unstale":"2023-10-24T02:03:19.333774+0000","last_undegraded":"2023-10-24T02:03:19.333774+0000","last_fullsized":"2023-10-24T02:03:19.333774+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"215'1","reported_seq":11,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.334582+0000","last_change":"2023-10-24T02:03:18.958703+0000","last_active":"2023-10-24T02:03:19.334582+0000","last_peered":"2023-10-24T02:03:19.334582+0000","last_clean":"2023-10-24T02:03:19.334582+0000","last_became_active":"2023-10-24T02:03:18.958421+0000","last_became_peered":"2023-10-24T02:03:18.958421+0000","last_unstale":"2023-10-24T02:03:19.334582+0000","last_undegraded":"2023-10-24T02:03:19.334582+0000","last_fullsized":"2023-10-24T02:03:19.334582+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":207,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.312700+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:19.312700+0000","last_peered":"2023-10-24T02:03:19.312700+0000","last_clean":"2023-10-24T02:03:19.312700+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:19.312700+0000","last_undegraded":"2023-10-24T02:03:19.312700+0000","last_fullsized":"2023-10-24T02:03:19.312700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.346136+0000","last_change":"2023-10-24T02:03:19.340261+0000","last_active":"2023-10-24T02:03:19.346136+0000","last_peered":"2023-10-24T02:03:19.346136+0000","last_clean":"2023-10-24T02:03:19.346136+0000","last_became_active":"2023-10-24T02:03:19.339824+0000","last_became_peered":"2023-10-24T02:03:19.339824+0000","last_unstale":"2023-10-24T02:03:19.346136+0000","last_undegraded":"2023-10-24T02:03:19.346136+0000","last_fullsized":"2023-10-24T02:03:19.346136+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"215'2","reported_seq":12,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.346496+0000","last_change":"2023-10-24T02:03:18.961237+0000","last_active":"2023-10-24T02:03:19.346496+0000","last_peered":"2023-10-24T02:03:19.346496+0000","last_clean":"2023-10-24T02:03:19.346496+0000","last_became_active":"2023-10-24T02:03:18.960957+0000","last_became_peered":"2023-10-24T02:03:18.960957+0000","last_unstale":"2023-10-24T02:03:19.346496+0000","last_undegraded":"2023-10-24T02:03:19.346496+0000","last_fullsized":"2023-10-24T02:03:19.346496+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.317663+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:19.317663+0000","last_peered":"2023-10-24T02:03:19.317663+0000","last_clean":"2023-10-24T02:03:19.317663+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:19.317663+0000","last_undegraded":"2023-10-24T02:03:19.317663+0000","last_fullsized":"2023-10-24T02:03:19.317663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.341722+0000","last_change":"2023-10-24T02:03:19.337306+0000","last_active":"2023-10-24T02:03:19.341722+0000","last_peered":"2023-10-24T02:03:19.341722+0000","last_clean":"2023-10-24T02:03:19.341722+0000","last_became_active":"2023-10-24T02:03:19.337036+0000","last_became_peered":"2023-10-24T02:03:19.337036+0000","last_unstale":"2023-10-24T02:03:19.341722+0000","last_undegraded":"2023-10-24T02:03:19.341722+0000","last_fullsized":"2023-10-24T02:03:19.341722+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":214,"last_epoch_clean":215,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:18.930100+0000","last_clean_scrub_stamp":"2023-10-24T02:03:18.930100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.325808+0000","last_change":"2023-10-24T02:03:18.955078+0000","last_active":"2023-10-24T02:03:19.325808+0000","last_peered":"2023-10-24T02:03:19.325808+0000","last_clean":"2023-10-24T02:03:19.325808+0000","last_became_active":"2023-10-24T02:03:18.954763+0000","last_became_peered":"2023-10-24T02:03:18.954763+0000","last_unstale":"2023-10-24T02:03:19.325808+0000","last_undegraded":"2023-10-24T02:03:19.325808+0000","last_fullsized":"2023-10-24T02:03:19.325808+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":213,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:17.924681+0000","last_clean_scrub_stamp":"2023-10-24T02:03:17.924681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":175,"reported_epoch":215,"state":"active+clean","last_fresh":"2023-10-24T02:03:19.324314+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:19.324314+0000","last_peered":"2023-10-24T02:03:19.324314+0000","last_clean":"2023-10-24T02:03:19.324314+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:19.324314+0000","last_undegraded":"2023-10-24T02:03:19.324314+0000","last_fullsized":"2023-10-24T02:03:19.324314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543273,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307932,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063908,"statfs":{"total":96636764160,"available":96321441792,"internally_reserved":0,"allocated":2707456,"data_stored":1381576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.379}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.52200000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.59699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.66200000000000003}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.86799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575977,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303832,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068008,"statfs":{"total":96636764160,"available":96325640192,"internally_reserved":0,"allocated":2703360,"data_stored":1381022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.505}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.433},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.52400000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.48699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.58299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575978,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063916,"statfs":{"total":96636764160,"available":96321449984,"internally_reserved":0,"allocated":2699264,"data_stored":1380130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.39600000000000002},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.67700000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.39500000000000002},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.627},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.58399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.439,"15min":0.435},"min":{"1min":0.314,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.56599999999999995,"5min":0.61599999999999999,"15min":0.67600000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64500000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.371}]},{"osd":4,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.46500000000000002,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.622}]},{"osd":5,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.624},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.53100000000000003}]},{"osd":6,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.44,"15min":0.43099999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61499999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.436,"5min":0.433,"15min":0.433},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575978,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1380900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.245},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.33200000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.309},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.22800000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.26400000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.56999999999999995}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.505}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.61699999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543273,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307924,"kb_used_data":2636,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063916,"statfs":{"total":96636764160,"available":96321449984,"internally_reserved":0,"allocated":2699264,"data_stored":1380130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.34599999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.307}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.35699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.505}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.61399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575978,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307928,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063912,"statfs":{"total":96636764160,"available":96321445888,"internally_reserved":0,"allocated":2703360,"data_stored":1380220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.23599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40400000000000003,"15min":0.41599999999999998},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.25700000000000001},"max":{"1min":0.504,"5min":0.60999999999999999,"15min":0.752},"last":0.252}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":0.52100000000000002,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.432,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.53400000000000003,"5min":0.56999999999999995,"15min":0.64600000000000002},"last":0.33900000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.31900000000000001,"5min":0.307,"15min":0.28299999999999997},"max":{"1min":0.499,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.54100000000000004,"5min":0.63,"15min":0.72799999999999998},"last":0.317}]},{"osd":4,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.80300000000000005,"5min":0.93600000000000005,"15min":1.097},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.41699999999999998,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.88600000000000001,"15min":1.167},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":1.056},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.88500000000000001,"15min":1.109},"last":0.52200000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.40999999999999998},"max":{"1min":0.77100000000000002,"5min":0.91700000000000004,"15min":1.083},"last":0.51300000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.437,"15min":0.437},"max":{"1min":0.81599999999999995,"5min":0.92600000000000005,"15min":1.155},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84099999999999997,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575978,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307936,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063904,"statfs":{"total":96636764160,"available":96321437696,"internally_reserved":0,"allocated":2711552,"data_stored":1380808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39900000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55300000000000005}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44900000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.379},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.51300000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543273,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307940,"kb_used_data":2652,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063900,"statfs":{"total":96636764160,"available":96321433600,"internally_reserved":0,"allocated":2715648,"data_stored":1380866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.52600000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.51200000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.625},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.68000000000000005}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:27.057 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-24T02:03:27.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-24T02:03:27.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.210+0000 7f18f4e69700 1 Processor -- start 2023-10-24T02:03:27.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.210+0000 7f18f4e69700 1 -- start start 2023-10-24T02:03:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18f4e69700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18f00a6b10 0x7f18f00a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18f4e69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 0x7f18f0157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18f4e69700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f00659b0 con 0x7f18f0158470 2023-10-24T02:03:27.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18f4e69700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f0158900 con 0x7f18f00a6b10 2023-10-24T02:03:27.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18f4e69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0065e40 con 0x7f18f00a4d30 2023-10-24T02:03:27.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 0x7f18f0157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18ee59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18f00a6b10 0x7f18f00a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 0x7f18f0157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:34186/0 (socket says 172.21.15.148:34186) 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18ee59c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18f00a6b10 0x7f18f00a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:51834/0 (socket says 172.21.15.148:51834) 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18e5d9b700 1 -- 172.21.15.148:0/1590896714 learned_addr learned my addr 172.21.15.148:0/1590896714 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.211+0000 7f18eed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f18f0158470 0x7f18f0154980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:41724/0 (socket says 172.21.15.148:41724) 2023-10-24T02:03:27.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18ee59c700 1 -- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 msgr2=0x7f18f0157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:27.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18ee59c700 1 --2- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 0x7f18f0157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18ee59c700 1 -- 172.21.15.148:0/1590896714 >> v1:172.21.15.150:6789/0 conn(0x7f18f0158470 legacy=0x7f18f0154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18ee59c700 1 -- 172.21.15.148:0/1590896714 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0064da0 con 0x7f18f00a6b10 2023-10-24T02:03:27.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18edd9b700 1 -- 172.21.15.148:0/1590896714 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747510824 0 0) 0x7f18f00659b0 con 0x7f18f0158470 2023-10-24T02:03:27.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18ee59c700 1 --2- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a6b10 0x7f18f00a4840 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f18e0009760 tx=0x7f18e0009060).ready entity=mon.1 client_cookie=2f8de5e8dbab646e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18edd9b700 1 -- 172.21.15.148:0/1590896714 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00090d0 con 0x7f18f00a6b10 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18edd9b700 1 -- 172.21.15.148:0/1590896714 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000f510 con 0x7f18f00a6b10 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18edd9b700 1 -- 172.21.15.148:0/1590896714 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000f890 con 0x7f18f00a6b10 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 -- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a6b10 msgr2=0x7f18f00a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a6b10 0x7f18f00a4840 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f18e0009760 tx=0x7f18e0009060).stop 2023-10-24T02:03:27.217 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 -- 172.21.15.148:0/1590896714 shutdown_connections 2023-10-24T02:03:27.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a6b10 0x7f18f00a4840 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1590896714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f00a4d30 0x7f18f0157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 -- 172.21.15.148:0/1590896714 >> 172.21.15.148:0/1590896714 conn(0x7f18f00c3f60 msgr2=0x7f18f00c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:27.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 -- 172.21.15.148:0/1590896714 shutdown_connections 2023-10-24T02:03:27.218 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.212+0000 7f18f4e69700 1 -- 172.21.15.148:0/1590896714 wait complete. 2023-10-24T02:03:27.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 Processor -- start 2023-10-24T02:03:27.221 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 -- start start 2023-10-24T02:03:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a4d30 0x7f18f00a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f0158470 0x7f18f01552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01489b0 con 0x7f18f00a6b10 2023-10-24T02:03:27.222 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0063100 con 0x7f18f00a4d30 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.214+0000 7f18f4e69700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00633e0 con 0x7f18f0158470 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60822/0 (socket says 172.21.15.148:60822) 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 -- 172.21.15.148:0/1775775269 learned_addr learned my addr 172.21.15.148:0/1775775269 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18eed9d700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f0158470 0x7f18f01552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.223 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18ee59c700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a4d30 0x7f18f00a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 -- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f0158470 msgr2=0x7f18f01552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f0158470 0x7f18f01552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 -- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a4d30 msgr2=0x7f18f00a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a4d30 0x7f18f00a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 -- 172.21.15.148:0/1775775269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00092a0 con 0x7f18f00a6b10 2023-10-24T02:03:27.224 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e5d9b700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f18d800e900 tx=0x7f18d80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8012600 con 0x7f18f00a6b10 2023-10-24T02:03:27.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8012760 con 0x7f18f00a6b10 2023-10-24T02:03:27.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f00636c0 con 0x7f18f00a6b10 2023-10-24T02:03:27.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8012ae0 con 0x7f18f00a6b10 2023-10-24T02:03:27.225 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.215+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f0063d00 con 0x7f18f00a6b10 2023-10-24T02:03:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.216+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f0063e90 con 0x7f18f00a6b10 2023-10-24T02:03:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.217+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f18d801b400 con 0x7f18f00a6b10 2023-10-24T02:03:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.217+0000 7f18e6ffd700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 0x7f18d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.226 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.217+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f18d807a4c0 con 0x7f18f00a6b10 2023-10-24T02:03:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.217+0000 7f18ee59c700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 0x7f18d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.217+0000 7f18ee59c700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 0x7f18d0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f18e0009fd0 tx=0x7f18e0017000).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.227 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.221+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f18d804b700 con 0x7f18f00a6b10 2023-10-24T02:03:27.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.450+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f18f006c6b0 con 0x7f18f00a6b10 2023-10-24T02:03:27.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.454+0000 7f18e6ffd700 1 -- 172.21.15.148:0/1775775269 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v52) v1 ==== 190+0+0 (secure 0 0 0) 0x7f18d8016070 con 0x7f18f00a6b10 2023-10-24T02:03:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 msgr2=0x7f18d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 0x7f18d0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f18e0009fd0 tx=0x7f18e0017000).stop 2023-10-24T02:03:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 msgr2=0x7f18f0154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.457 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f18d800e900 tx=0x7f18d80090f0).stop 2023-10-24T02:03:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 shutdown_connections 2023-10-24T02:03:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18f0158470 0x7f18f01552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f18d005f150 0x7f18d0061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f00a4d30 0x7f18f00a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.458 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 --2- 172.21.15.148:0/1775775269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f00a6b10 0x7f18f0154de0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 >> 172.21.15.148:0/1775775269 conn(0x7f18f00c3f60 msgr2=0x7f18f0149250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 shutdown_connections 2023-10-24T02:03:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.456+0000 7f18f4e69700 1 -- 172.21.15.148:0/1775775269 wait complete. 2023-10-24T02:03:27.459 INFO:teuthology.orchestra.run.smithi148.stderr:updated caps for client.0 2023-10-24T02:03:27.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:27.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.582+0000 7feaf651c700 1 Processor -- start 2023-10-24T02:03:27.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.582+0000 7feaf651c700 1 -- start start 2023-10-24T02:03:27.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf651c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00c6710 0x7feaf00c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf651c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feaf00aa3f0 0x7feaf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf651c700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00aa880 con 0x7feaf00aa010 2023-10-24T02:03:27.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf651c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00c0960 con 0x7feaf00aa3f0 2023-10-24T02:03:27.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf651c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c0c40 con 0x7feaf00c6710 2023-10-24T02:03:27.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaeffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7feaf00aa010 0x7feaf0158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45218/0 (socket says 172.21.15.148:45218) 2023-10-24T02:03:27.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaeffff700 1 -- 172.21.15.148:0/2400266342 learned_addr learned my addr 172.21.15.148:0/2400266342 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:27.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/2400266342 >> v2:172.21.15.150:3300/0 conn(0x7feaf00aa3f0 0x7feaf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaef7fe700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00c6710 0x7feaf00c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaeeffd700 1 -- 172.21.15.148:0/2400266342 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071607527 0 0) 0x7feae0001110 con 0x7feaf00aa010 2023-10-24T02:03:27.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.583+0000 7feaeeffd700 1 -- 172.21.15.148:0/2400266342 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead80033f0 con 0x7feaf00aa010 2023-10-24T02:03:27.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf4ab9700 1 -- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00c6710 msgr2=0x7feaf00c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:27.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00c6710 0x7feaf00c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf4ab9700 1 -- 172.21.15.148:0/2400266342 >> v1:172.21.15.148:6789/0 conn(0x7feaf00aa010 legacy=0x7feaf0158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf4ab9700 1 -- 172.21.15.148:0/2400266342 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00c0f20 con 0x7feaf00aa3f0 2023-10-24T02:03:27.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa3f0 0x7feaf0069d80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7feae8009e60 tx=0x7feae8009780).ready entity=mon.1 client_cookie=b39650f554e3ccde server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaeeffd700 1 -- 172.21.15.148:0/2400266342 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800e070 con 0x7feaf00aa3f0 2023-10-24T02:03:27.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaeeffd700 1 -- 172.21.15.148:0/2400266342 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800bab0 con 0x7feaf00aa3f0 2023-10-24T02:03:27.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaeeffd700 1 -- 172.21.15.148:0/2400266342 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800be30 con 0x7feaf00aa3f0 2023-10-24T02:03:27.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 -- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa3f0 msgr2=0x7feaf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa3f0 0x7feaf0069d80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7feae8009e60 tx=0x7feae8009780).stop 2023-10-24T02:03:27.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 -- 172.21.15.148:0/2400266342 shutdown_connections 2023-10-24T02:03:27.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa3f0 0x7feaf0069d80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 --2- 172.21.15.148:0/2400266342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00c6710 0x7feaf00c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 -- 172.21.15.148:0/2400266342 >> 172.21.15.148:0/2400266342 conn(0x7feaf00caf40 msgr2=0x7feaf00cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:27.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 -- 172.21.15.148:0/2400266342 shutdown_connections 2023-10-24T02:03:27.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.584+0000 7feaf651c700 1 -- 172.21.15.148:0/2400266342 wait complete. 2023-10-24T02:03:27.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 Processor -- start 2023-10-24T02:03:27.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 -- start start 2023-10-24T02:03:27.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa010 0x7feaf0151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00aa3f0 0x7feaf01681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.586+0000 7feaf651c700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0151a50 con 0x7feaf00c6710 2023-10-24T02:03:27.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf651c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf014f930 con 0x7feaf00aa010 2023-10-24T02:03:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf651c700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01504b0 con 0x7feaf00aa3f0 2023-10-24T02:03:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60834/0 (socket says 172.21.15.148:60834) 2023-10-24T02:03:27.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 -- 172.21.15.148:0/931981816 learned_addr learned my addr 172.21.15.148:0/931981816 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:27.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaeffff700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa010 0x7feaf0151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaef7fe700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00aa3f0 0x7feaf01681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 -- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00aa3f0 msgr2=0x7feaf01681d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00aa3f0 0x7feaf01681d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 -- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa010 msgr2=0x7feaf0151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa010 0x7feaf0151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 -- 172.21.15.148:0/931981816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009a20 con 0x7feaf00c6710 2023-10-24T02:03:27.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf4ab9700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7feaf0084230 tx=0x7feaf00c6390).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8012e50 con 0x7feaf00c6710 2023-10-24T02:03:27.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae801d630 con 0x7feaf00c6710 2023-10-24T02:03:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf01686c0 con 0x7feaf00c6710 2023-10-24T02:03:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae801d9f0 con 0x7feaf00c6710 2023-10-24T02:03:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.587+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf014fee0 con 0x7feaf00c6710 2023-10-24T02:03:27.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.588+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf0150260 con 0x7feaf00c6710 2023-10-24T02:03:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.589+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feae8027460 con 0x7feaf00c6710 2023-10-24T02:03:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.589+0000 7fead7fff700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 0x7feadc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.589+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7feae807bf40 con 0x7feaf00c6710 2023-10-24T02:03:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.589+0000 7feaeffff700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 0x7feadc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:27.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.590+0000 7feaeffff700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 0x7feadc061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7feae0001270 tx=0x7feae0007a70).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:27.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.593+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7feae804d180 con 0x7feaf00c6710 2023-10-24T02:03:27.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.795+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaf0150620 con 0x7feaf00c6710 2023-10-24T02:03:27.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.796+0000 7fead7fff700 1 -- 172.21.15.148:0/931981816 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7feae80507a0 con 0x7feaf00c6710 2023-10-24T02:03:27.797 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:27.797 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 msgr2=0x7feadc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 0x7feadc061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7feae0001270 tx=0x7feae0007a70).stop 2023-10-24T02:03:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 msgr2=0x7feaf014a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7feaf0084230 tx=0x7feaf00c6390).stop 2023-10-24T02:03:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 shutdown_connections 2023-10-24T02:03:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf00c6710 0x7feaf014a180 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7feadc05f150 0x7feadc061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feaf00aa010 0x7feaf0151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 --2- 172.21.15.148:0/931981816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feaf00aa3f0 0x7feaf01681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:27.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.797+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 >> 172.21.15.148:0/931981816 conn(0x7feaf00caf40 msgr2=0x7feaf00639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:27.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.798+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 shutdown_connections 2023-10-24T02:03:27.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:27.798+0000 7feaf651c700 1 -- 172.21.15.148:0/931981816 wait complete. 2023-10-24T02:03:27.801 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:28.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-24T02:03:19.306454+0000', 'modified': '2023-10-24T02:03:21.312409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10194': {'gid': 10194, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6836/707171421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 707171421}, {'type': 'v1', 'addr': '172.21.15.150:6836', 'nonce': 707171421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-24T02:03:28.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-24T02:03:28.213 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-24T02:03:28.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.329+0000 7ff4a69c0700 1 Processor -- start 2023-10-24T02:03:28.329 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.329+0000 7ff4a69c0700 1 -- start start 2023-10-24T02:03:28.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff4a014e8b0 0x7ff4a0062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.332 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a0154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4a0155090 0x7ff4a0069270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a00c21a0 con 0x7ff4a0155090 2023-10-24T02:03:28.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a00c2d20 con 0x7ff4a014e8b0 2023-10-24T02:03:28.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a69c0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0062fc0 con 0x7ff4a0062b40 2023-10-24T02:03:28.333 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4a0155090 0x7ff4a0069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff4a0155090 0x7ff4a0069270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60836/0 (socket says 172.21.15.148:60836) 2023-10-24T02:03:28.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3988851445 learned_addr learned my addr 172.21.15.148:0/3988851445 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3988851445 >> v2:172.21.15.150:3300/0 conn(0x7ff4a014e8b0 0x7ff4a0062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a0154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3988851445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 msgr2=0x7ff4a0154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a0154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3988851445 >> v2:172.21.15.150:3300/0 conn(0x7ff4a014e8b0 msgr2=0x7ff4a0062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3988851445 >> v2:172.21.15.150:3300/0 conn(0x7ff4a014e8b0 0x7ff4a0062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3988851445 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00c31b0 con 0x7ff4a0155090 2023-10-24T02:03:28.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a0154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:28.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a0155090 0x7ff4a0069270 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7ff4a0065100 tx=0x7ff498009840).ready entity=mon.0 client_cookie=15d889269ec6b0b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.330+0000 7ff4a49bc700 1 -- 172.21.15.148:0/3988851445 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800e070 con 0x7ff4a0155090 2023-10-24T02:03:28.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a49bc700 1 -- 172.21.15.148:0/3988851445 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49800ba20 con 0x7ff4a0155090 2023-10-24T02:03:28.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a49bc700 1 -- 172.21.15.148:0/3988851445 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800bda0 con 0x7ff4a0155090 2023-10-24T02:03:28.336 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 -- 172.21.15.148:0/3988851445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a0155090 msgr2=0x7ff4a0069270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a0155090 0x7ff4a0069270 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 rx=0x7ff4a0065100 tx=0x7ff498009840).stop 2023-10-24T02:03:28.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 -- 172.21.15.148:0/3988851445 shutdown_connections 2023-10-24T02:03:28.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a0155090 0x7ff4a0069270 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/3988851445 >> v2:172.21.15.150:3300/0 conn(0x7ff4a014e8b0 0x7ff4a0062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/3988851445 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a0154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 -- 172.21.15.148:0/3988851445 >> 172.21.15.148:0/3988851445 conn(0x7ff4a00c7ba0 msgr2=0x7ff4a00c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 -- 172.21.15.148:0/3988851445 shutdown_connections 2023-10-24T02:03:28.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.331+0000 7ff4a69c0700 1 -- 172.21.15.148:0/3988851445 wait complete. 2023-10-24T02:03:28.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.332+0000 7ff4a69c0700 1 Processor -- start 2023-10-24T02:03:28.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.332+0000 7ff4a69c0700 1 -- start start 2023-10-24T02:03:28.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a00c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 0x7ff4a014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00a77b0 con 0x7ff4a014e8b0 2023-10-24T02:03:28.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c10b0 con 0x7ff4a0155090 2023-10-24T02:03:28.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a69c0700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c1390 con 0x7ff4a0062b40 2023-10-24T02:03:28.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a51bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a51bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60840/0 (socket says 172.21.15.148:60840) 2023-10-24T02:03:28.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a51bd700 1 -- 172.21.15.148:0/2191577702 learned_addr learned my addr 172.21.15.148:0/2191577702 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a59be700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a00c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.333+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 0x7ff4a014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 -- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 msgr2=0x7ff4a00c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a00c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 -- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 msgr2=0x7ff4a014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 0x7ff4a014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 -- 172.21.15.148:0/2191577702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498009ae0 con 0x7ff4a014e8b0 2023-10-24T02:03:28.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 0x7ff4a014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:28.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7ff49000d890 tx=0x7ff490008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff495ffb700 1 -- 172.21.15.148:0/2191577702 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490011590 con 0x7ff4a014e8b0 2023-10-24T02:03:28.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff495ffb700 1 -- 172.21.15.148:0/2191577702 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900116f0 con 0x7ff4a014e8b0 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00c1670 con 0x7ff4a014e8b0 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff495ffb700 1 -- 172.21.15.148:0/2191577702 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490011a70 con 0x7ff4a014e8b0 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.334+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a00ac430 con 0x7ff4a014e8b0 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.335+0000 7ff495ffb700 1 -- 172.21.15.148:0/2191577702 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff49001c460 con 0x7ff4a014e8b0 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.336+0000 7ff495ffb700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 0x7ff484061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.336+0000 7ff495ffb700 1 -- 172.21.15.148:0/2191577702 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff490079fc0 con 0x7ff4a014e8b0 2023-10-24T02:03:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.336+0000 7ff4a59be700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 0x7ff484061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.336+0000 7ff4a59be700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 0x7ff484061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff49c009b70 tx=0x7ff49c009060).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.338+0000 7ff4b95bab80 1 Processor -- start 2023-10-24T02:03:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.338+0000 7ff4b95bab80 1 -- start start 2023-10-24T02:03:28.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f4210bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f420c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f41881b0 con 0x5607f42107e0 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f414dcb0 con 0x5607f425b590 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607f4162c90 con 0x5607f4213ff0 2023-10-24T02:03:28.353 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60842/0 (socket says 172.21.15.148:60842) 2023-10-24T02:03:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 -- 172.21.15.148:0/3153553932 learned_addr learned my addr 172.21.15.148:0/3153553932 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f4210bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f420c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.354 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 -- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 msgr2=0x5607f420c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f420c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 -- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 msgr2=0x5607f4210bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f4210bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 -- 172.21.15.148:0/3153553932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607f415be70 con 0x5607f42107e0 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7ff49c011c60 tx=0x7ff49c017000).ready entity=mon.0 client_cookie=4f87f6f090abcb32 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff48affd700 1 -- 172.21.15.148:0/3153553932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0148d0 con 0x5607f42107e0 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff48affd700 1 -- 172.21.15.148:0/3153553932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c014a30 con 0x5607f42107e0 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.339+0000 7ff48affd700 1 -- 172.21.15.148:0/3153553932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c014df0 con 0x5607f42107e0 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3153553932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 msgr2=0x5607f4239bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7ff49c011c60 tx=0x7ff49c017000).stop 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3153553932 shutdown_connections 2023-10-24T02:03:28.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f420c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4239bd0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3153553932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f4210bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3153553932 >> 172.21.15.148:0/3153553932 conn(0x5607f3fcde40 msgr2=0x5607f425a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3153553932 shutdown_connections 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.340+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3153553932 wait complete. 2023-10-24T02:03:28.357 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.341+0000 7ff4b95bab80 1 -- start start 2023-10-24T02:03:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.341+0000 7ff4b95bab80 1 Processor -- start 2023-10-24T02:03:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.341+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f42122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f42127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f4162dd0 con 0x5607f42107e0 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f4163050 con 0x5607f425b590 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607f412e8d0 con 0x5607f4213ff0 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 10 client.0 ll_register_callbacks cb 0x5607f41d1210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60852/0 (socket says 172.21.15.148:60852) 2023-10-24T02:03:28.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 -- 172.21.15.148:0/3251707022 learned_addr learned my addr 172.21.15.148:0/3251707022 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f42127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f42122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 -- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 msgr2=0x5607f42122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f42122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 -- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 msgr2=0x5607f42127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f42127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 -- 172.21.15.148:0/3251707022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0118e0 con 0x5607f42107e0 2023-10-24T02:03:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7ff49c014720 tx=0x7ff49c024000).ready entity=mon.0 client_cookie=cb9c6ec1e7e8ab6c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff47ffff700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T02:03:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c02d070 con 0x5607f42107e0 2023-10-24T02:03:28.361 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff49c01e600 con 0x5607f42107e0 2023-10-24T02:03:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607f4209860 con 0x5607f42107e0 2023-10-24T02:03:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff49c014e80 con 0x5607f42107e0 2023-10-24T02:03:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 10 client.10365 fetch_fsmap learned FSMap version 74 2023-10-24T02:03:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.342+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5607f4157480 con 0x5607f42107e0 2023-10-24T02:03:28.362 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607f4209860 con 0x5607f42107e0 2023-10-24T02:03:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff49c01e9d0 con 0x5607f42107e0 2023-10-24T02:03:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 10 client.10365 fetch_fsmap finished waiting for FSMap version 74 2023-10-24T02:03:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 10 client.10365 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-24T02:03:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 20 client.10365 populate_metadata read hostname 'smithi148' 2023-10-24T02:03:28.363 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f420cb10 0x5607f420cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 4 client.10365 mds_command: new command op to 10194 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 --> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607f41db4b0 con 0x5607f420cb10 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f420cb10 0x5607f420cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff47ffff700 10 client.10365 ms_handle_connect on v2:172.21.15.150:6834/707171421 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.343+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f420cb10 0x5607f420cef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6a861caaeb717ff1 server_cookie=70ec58d695c92d94 in_seq=0 out_seq=0 2023-10-24T02:03:28.364 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff47ffff700 1 -- 172.21.15.148:0/3251707022 <== mds.0 v2:172.21.15.150:6834/707171421 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5607f41db4b0 con 0x5607f420cb10 2023-10-24T02:03:28.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff47ffff700 10 client.10365 handle_command_reply: tid=0 2023-10-24T02:03:28.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 client.10365 shutdown 2023-10-24T02:03:28.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 msgr2=0x5607f4230480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7ff49c014720 tx=0x7ff49c024000).stop 2023-10-24T02:03:28.365 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 shutdown_connections 2023-10-24T02:03:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f420cb10 0x5607f420cef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f425b590 0x5607f42127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff47ffff700 0 client.10365 ms_handle_reset on v2:172.21.15.150:6834/707171421 2023-10-24T02:03:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4230480 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.366 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3251707022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f4213ff0 0x5607f42122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 >> 172.21.15.148:0/3251707022 conn(0x5607f3fcde40 msgr2=0x5607f4255e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 shutdown_connections 2023-10-24T02:03:28.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3251707022 wait complete. 2023-10-24T02:03:28.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.344+0000 7ff4b95bab80 20 client.10365 trim_cache size 0 max 16384 2023-10-24T02:03:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 Processor -- start 2023-10-24T02:03:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 -- start start 2023-10-24T02:03:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 0x5607f425ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f42107e0 0x5607f42322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f4232ca0 con 0x5607f4213ff0 2023-10-24T02:03:28.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f426a200 con 0x5607f420cb10 2023-10-24T02:03:28.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607f425b1d0 con 0x5607f42107e0 2023-10-24T02:03:28.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4a61bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4a61bf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60866/0 (socket says 172.21.15.148:60866) 2023-10-24T02:03:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.361+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3668078529 learned_addr learned my addr 172.21.15.148:0/3668078529 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f42107e0 0x5607f42322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f42107e0 msgr2=0x5607f42322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f42107e0 0x5607f42322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.375 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 0x5607f425ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 msgr2=0x5607f425ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 0x5607f425ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 -- 172.21.15.148:0/3668078529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607f41571d0 con 0x5607f4213ff0 2023-10-24T02:03:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a59be700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 0x5607f425ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:28.376 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7ff4a0068e80 tx=0x7ff498009840).ready entity=mon.0 client_cookie=e952c8cf4eb3ba4d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff48b7fe700 1 -- 172.21.15.148:0/3668078529 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980032f0 con 0x5607f4213ff0 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff48b7fe700 1 -- 172.21.15.148:0/3668078529 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498025040 con 0x5607f4213ff0 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff48b7fe700 1 -- 172.21.15.148:0/3668078529 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49801e970 con 0x5607f4213ff0 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3668078529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 msgr2=0x5607f42327b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7ff4a0068e80 tx=0x7ff498009840).stop 2023-10-24T02:03:28.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3668078529 shutdown_connections 2023-10-24T02:03:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f4213ff0 0x5607f42327b0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f420cb10 0x5607f425ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/3668078529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f42107e0 0x5607f42322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3668078529 >> 172.21.15.148:0/3668078529 conn(0x5607f3fcde40 msgr2=0x5607f4254db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3668078529 shutdown_connections 2023-10-24T02:03:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.362+0000 7ff4b95bab80 1 -- 172.21.15.148:0/3668078529 wait complete. 2023-10-24T02:03:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.363+0000 7ff4b95bab80 1 -- start start 2023-10-24T02:03:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.363+0000 7ff4b95bab80 1 Processor -- start 2023-10-24T02:03:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f420cb10 0x5607f42beb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f4213ff0 0x5607f423dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f4236820 con 0x5607f42107e0 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607f4253cf0 con 0x5607f4213ff0 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607f4268130 con 0x5607f420cb10 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4b95bab80 10 client.0 ll_register_callbacks cb 0x5607f41d1210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-24T02:03:28.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60868/0 (socket says 172.21.15.148:60868) 2023-10-24T02:03:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 -- 172.21.15.148:0/923568278 learned_addr learned my addr 172.21.15.148:0/923568278 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a59be700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f420cb10 0x5607f42beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a61bf700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f4213ff0 0x5607f423dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 -- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f420cb10 msgr2=0x5607f42beb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f420cb10 0x5607f42beb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 -- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f4213ff0 msgr2=0x5607f423dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f4213ff0 0x5607f423dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 -- 172.21.15.148:0/923568278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a00c31b0 con 0x5607f42107e0 2023-10-24T02:03:28.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff4a51bd700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7ff49000d860 tx=0x7ff490056040).ready entity=mon.0 client_cookie=2a96312d2a94ecfd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff47ffff700 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2023-10-24T02:03:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.364+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49004d260 con 0x5607f42107e0 2023-10-24T02:03:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mon.0 v2:172.21.15.148:3300/0 2 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff4900780e0 con 0x5607f42107e0 2023-10-24T02:03:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff49c014a30 con 0x5607f42107e0 2023-10-24T02:03:28.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4900782a0 con 0x5607f42107e0 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 10 client.10371 fetch_fsmap learned FSMap version 74 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5607f3fcef80 con 0x5607f42107e0 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mon.0 v2:172.21.15.148:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c014a30 con 0x5607f42107e0 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mon.0 v2:172.21.15.148:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff49004e3b0 con 0x5607f42107e0 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 10 client.10371 fetch_fsmap finished waiting for FSMap version 74 2023-10-24T02:03:28.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 10 client.10371 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-24T02:03:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 20 client.10371 populate_metadata read hostname 'smithi148' 2023-10-24T02:03:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f425b590 0x5607f4235380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 4 client.10371 mds_command: new command op to 10194 tid=0[{"prefix": "status"}] 2023-10-24T02:03:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 --> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5607f3fc9ca0 con 0x5607f425b590 2023-10-24T02:03:28.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4a59be700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f425b590 0x5607f4235380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff47ffff700 10 client.10371 ms_handle_connect on v2:172.21.15.150:6834/707171421 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.365+0000 7ff4a59be700 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f425b590 0x5607f4235380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c157589d959b8cd6 server_cookie=2d3aa8c31751430f in_seq=0 out_seq=0 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff47ffff700 1 -- 172.21.15.148:0/923568278 <== mds.0 v2:172.21.15.150:6834/707171421 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5607f3fc9ca0 con 0x5607f425b590 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff47ffff700 10 client.10371 handle_command_reply: tid=0 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 client.10371 shutdown 2023-10-24T02:03:28.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 msgr2=0x5607f4253530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7ff49000d860 tx=0x7ff490056040).stop 2023-10-24T02:03:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 shutdown_connections 2023-10-24T02:03:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:6834/707171421,v1:172.21.15.150:6836/707171421] conn(0x5607f425b590 0x5607f4235380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5607f4213ff0 0x5607f423dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x5607f420cb10 0x5607f42beb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff47ffff700 0 client.10371 ms_handle_reset on v2:172.21.15.150:6834/707171421 2023-10-24T02:03:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 --2- 172.21.15.148:0/923568278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5607f42107e0 0x5607f4253530 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 >> 172.21.15.148:0/923568278 conn(0x5607f3fcde40 msgr2=0x5607f425a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 shutdown_connections 2023-10-24T02:03:28.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 1 -- 172.21.15.148:0/923568278 wait complete. 2023-10-24T02:03:28.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4b95bab80 20 client.10371 trim_cache size 0 max 16384 2023-10-24T02:03:28.389 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:28.389 INFO:teuthology.orchestra.run.smithi148.stdout: "cluster_fsid": "6bd5f15c-4d64-43f3-b461-75e4ec9f85f9", 2023-10-24T02:03:28.389 INFO:teuthology.orchestra.run.smithi148.stdout: "whoami": 0, 2023-10-24T02:03:28.389 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 10194, 2023-10-24T02:03:28.390 INFO:teuthology.orchestra.run.smithi148.stdout: "want_state": "up:active", 2023-10-24T02:03:28.390 INFO:teuthology.orchestra.run.smithi148.stdout: "state": "up:active", 2023-10-24T02:03:28.390 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs", 2023-10-24T02:03:28.390 INFO:teuthology.orchestra.run.smithi148.stdout: "rank_uptime": 9.0582946809999996, 2023-10-24T02:03:28.390 INFO:teuthology.orchestra.run.smithi148.stdout: "mdsmap_epoch": 74, 2023-10-24T02:03:28.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch": 216, 2023-10-24T02:03:28.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_epoch_barrier": 216, 2023-10-24T02:03:28.391 INFO:teuthology.orchestra.run.smithi148.stdout: "uptime": 13.544072665 2023-10-24T02:03:28.391 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:28.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 msgr2=0x7ff484061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 0x7ff484061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff49c009b70 tx=0x7ff49c009060).stop 2023-10-24T02:03:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 msgr2=0x7ff4a00c0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7ff49000d890 tx=0x7ff490008040).stop 2023-10-24T02:03:28.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 shutdown_connections 2023-10-24T02:03:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff48405f150 0x7ff484061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff4a0155090 0x7ff4a014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4a0062b40 0x7ff4a00c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 --2- 172.21.15.148:0/2191577702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4a014e8b0 0x7ff4a00c0a20 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.366+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 >> 172.21.15.148:0/2191577702 conn(0x7ff4a00c7ba0 msgr2=0x7ff4a01568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.367+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 shutdown_connections 2023-10-24T02:03:28.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.367+0000 7ff4a69c0700 1 -- 172.21.15.148:0/2191577702 wait complete. 2023-10-24T02:03:28.395 DEBUG:teuthology.orchestra.run.smithi148:> ceph fs ls 2023-10-24T02:03:28.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.496+0000 7ff9972f7700 1 Processor -- start 2023-10-24T02:03:28.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.496+0000 7ff9972f7700 1 -- start start 2023-10-24T02:03:28.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901575e0 0x7ff9900ca920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9901579c0 0x7ff9900ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 0x7ff9900aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900cae10 con 0x7ff9901579c0 2023-10-24T02:03:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900c94c0 con 0x7ff9900aaae0 2023-10-24T02:03:28.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff9972f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900ae140 con 0x7ff9901575e0 2023-10-24T02:03:28.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff994892700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9901579c0 0x7ff9900ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff994892700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff9901579c0 0x7ff9900ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60880/0 (socket says 172.21.15.148:60880) 2023-10-24T02:03:28.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.497+0000 7ff994892700 1 -- 172.21.15.148:0/950586784 learned_addr learned my addr 172.21.15.148:0/950586784 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff995894700 1 --2- 172.21.15.148:0/950586784 >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 0x7ff9900aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 -- 172.21.15.148:0/950586784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901575e0 msgr2=0x7ff9900ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff995093700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901575e0 0x7ff9900ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901575e0 0x7ff9900ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 -- 172.21.15.148:0/950586784 >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 msgr2=0x7ff9900aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:28.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 --2- 172.21.15.148:0/950586784 >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 0x7ff9900aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 -- 172.21.15.148:0/950586784 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900ae6c0 con 0x7ff9901579c0 2023-10-24T02:03:28.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff995894700 1 --2- 172.21.15.148:0/950586784 >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 0x7ff9900aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:28.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff994892700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901579c0 0x7ff9900ad730 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7ff990085950 tx=0x7ff9840090f0).ready entity=mon.0 client_cookie=ce64f1cad0ec29e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff98ffff700 1 -- 172.21.15.148:0/950586784 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400b600 con 0x7ff9901579c0 2023-10-24T02:03:28.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff98ffff700 1 -- 172.21.15.148:0/950586784 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98400b760 con 0x7ff9901579c0 2023-10-24T02:03:28.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff98ffff700 1 -- 172.21.15.148:0/950586784 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bae0 con 0x7ff9901579c0 2023-10-24T02:03:28.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 -- 172.21.15.148:0/950586784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901579c0 msgr2=0x7ff9900ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901579c0 0x7ff9900ad730 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7ff990085950 tx=0x7ff9840090f0).stop 2023-10-24T02:03:28.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 -- 172.21.15.148:0/950586784 shutdown_connections 2023-10-24T02:03:28.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 --2- 172.21.15.148:0/950586784 >> v2:172.21.15.150:3300/0 conn(0x7ff9900aaae0 0x7ff9900aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901575e0 0x7ff9900ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 --2- 172.21.15.148:0/950586784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901579c0 0x7ff9900ad730 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 -- 172.21.15.148:0/950586784 >> 172.21.15.148:0/950586784 conn(0x7ff990094520 msgr2=0x7ff99006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 -- 172.21.15.148:0/950586784 shutdown_connections 2023-10-24T02:03:28.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.498+0000 7ff9972f7700 1 -- 172.21.15.148:0/950586784 wait complete. 2023-10-24T02:03:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.499+0000 7ff9972f7700 1 Processor -- start 2023-10-24T02:03:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 -- start start 2023-10-24T02:03:28.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9900aaae0 0x7ff990153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901579c0 0x7ff99009b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9901542a0 con 0x7ff9901575e0 2023-10-24T02:03:28.510 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990096630 con 0x7ff9900aaae0 2023-10-24T02:03:28.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.500+0000 7ff9972f7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff990095a20 con 0x7ff9901579c0 2023-10-24T02:03:28.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60888/0 (socket says 172.21.15.148:60888) 2023-10-24T02:03:28.511 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 -- 172.21.15.148:0/3098937314 learned_addr learned my addr 172.21.15.148:0/3098937314 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:28.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 -- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901579c0 msgr2=0x7ff99009b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901579c0 0x7ff99009b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:28.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 -- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9900aaae0 msgr2=0x7ff990153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9900aaae0 0x7ff990153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:28.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 -- 172.21.15.148:0/3098937314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984009370 con 0x7ff9901575e0 2023-10-24T02:03:28.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff994892700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff984009130 tx=0x7ff984017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bae0 con 0x7ff9901575e0 2023-10-24T02:03:28.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984000c90 con 0x7ff9901575e0 2023-10-24T02:03:28.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98401c670 con 0x7ff9901575e0 2023-10-24T02:03:28.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff990095d00 con 0x7ff9901575e0 2023-10-24T02:03:28.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.501+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9900962c0 con 0x7ff9901575e0 2023-10-24T02:03:28.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.502+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff990064f90 con 0x7ff9901575e0 2023-10-24T02:03:28.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.502+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff98401c9e0 con 0x7ff9901575e0 2023-10-24T02:03:28.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.503+0000 7ff98d7fa700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 0x7ff97c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:28.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.503+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ff98407bfa0 con 0x7ff9901575e0 2023-10-24T02:03:28.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.503+0000 7ff995093700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 0x7ff97c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:28.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.503+0000 7ff995093700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 0x7ff97c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff98800a880 tx=0x7ff988008040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:28.516 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.507+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff98404d240 con 0x7ff9901575e0 2023-10-24T02:03:28.712 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.712+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9900967a0 con 0x7ff9901575e0 2023-10-24T02:03:28.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.712+0000 7ff98d7fa700 1 -- 172.21.15.148:0/3098937314 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff984050860 con 0x7ff9901575e0 2023-10-24T02:03:28.713 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-24T02:03:28.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 msgr2=0x7ff97c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 0x7ff97c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff98800a880 tx=0x7ff988008040).stop 2023-10-24T02:03:28.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 msgr2=0x7ff9901643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:28.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff984009130 tx=0x7ff984017000).stop 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 shutdown_connections 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9901579c0 0x7ff99009b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff97c05f150 0x7ff97c061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9900aaae0 0x7ff990153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 --2- 172.21.15.148:0/3098937314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff9901575e0 0x7ff9901643a0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:28.716 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 >> 172.21.15.148:0/3098937314 conn(0x7ff990094520 msgr2=0x7ff9900b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:28.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 shutdown_connections 2023-10-24T02:03:28.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:28.714+0000 7ff9972f7700 1 -- 172.21.15.148:0/3098937314 wait complete. 2023-10-24T02:03:28.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-24T02:03:28.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-24T02:03:28.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2023-10-24T02:03:28.726 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-24T02:03:28.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-24T02:03:28.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-24T02:03:28.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-24T02:03:28.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-24T02:03:28.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T02:03:28.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.729 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2023-10-24T02:03:28.744 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-24T02:03:28.744 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-24T02:03:28.744 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:03:28.745 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2023-10-24T02:03:28.746 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:03:28.746 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:03:28.746 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2023-10-24T02:03:28.746 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-24T02:03:28.746 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 36720sec preferred_lft 36720sec 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2023-10-24T02:03:28.747 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::38d5:faff:fe1d:6c5c/64 scope link 2023-10-24T02:03:28.748 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 72:cb:65:4b:62:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::70cb:65ff:fe4b:621d/64 scope link 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-24T02:03:28.749 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 3e:a9:b9:66:c5:ab brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T02:03:28.750 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::3ca9:b9ff:fe66:c5ab/64 scope link 2023-10-24T02:03:28.750 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2023-10-24T02:03:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.751 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-24T02:03:28.807 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-10-24T02:03:28.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.809 DEBUG:teuthology.orchestra.run.smithi148:> route 2023-10-24T02:03:28.864 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2023-10-24T02:03:28.864 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-24T02:03:28.864 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-24T02:03:28.865 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-24T02:03:28.865 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-24T02:03:28.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.866 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2023-10-24T02:03:28.866 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2023-10-24T02:03:28.866 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-24T02:03:28.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-24T02:03:28.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-24T02:03:28.867 DEBUG:teuthology.orchestra.run.smithi148:> ') 2023-10-24T02:03:28.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.965 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T02:03:28.979 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T02:03:28.979 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T02:03:28.979 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-24T02:03:28.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:28.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2023-10-24T02:03:29.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:29.044 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-10-24T02:03:29.098 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-24T02:03:29.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:03:29.177 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:03:29.178 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T02:03:29.203 INFO:teuthology.orchestra.run.smithi148.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-10-24T02:03:29.203 INFO:teuthology.orchestra.run.smithi148.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-10-24T02:03:29.205 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-24T02:03:29.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:29.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-24T02:03:29.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-24T02:03:29.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.424+0000 7fc96279d700 1 Processor -- start 2023-10-24T02:03:29.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.424+0000 7fc96279d700 1 -- start start 2023-10-24T02:03:29.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc96279d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 0x7fc95c062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc96279d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0c21a0 con 0x7fc95c1552b0 2023-10-24T02:03:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc96279d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c0c2d20 con 0x7fc95c062b40 2023-10-24T02:03:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc96279d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c062fc0 con 0x7fc95c14e8b0 2023-10-24T02:03:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc961f9c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc95c1552b0 0x7fc95c15de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45224/0 (socket says 172.21.15.148:45224) 2023-10-24T02:03:29.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.425+0000 7fc961f9c700 1 -- 172.21.15.148:0/669093605 learned_addr learned my addr 172.21.15.148:0/669093605 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc96179b700 1 --2- 172.21.15.148:0/669093605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 0x7fc95c062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941349256 0 0) 0x7fc95c0c21a0 con 0x7fc95c1552b0 2023-10-24T02:03:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9480033f0 con 0x7fc95c1552b0 2023-10-24T02:03:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67856417 0 0) 0x7fc95c0c2d20 con 0x7fc95c062b40 2023-10-24T02:03:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc96179b700 1 -- 172.21.15.148:0/669093605 >> v1:172.21.15.150:6789/0 conn(0x7fc95c062b40 legacy=0x7fc95c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc96179b700 1 -- 172.21.15.148:0/669093605 >> v1:172.21.15.148:6789/0 conn(0x7fc95c1552b0 legacy=0x7fc95c15de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc96179b700 1 -- 172.21.15.148:0/669093605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0c31b0 con 0x7fc95c14e8b0 2023-10-24T02:03:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc96179b700 1 --2- 172.21.15.148:0/669093605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 0x7fc95c062650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc958009790 tx=0x7fc958009060).ready entity=mon.2 client_cookie=46d9178c11cec1bd server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800f510 con 0x7fc95c14e8b0 2023-10-24T02:03:29.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800f670 con 0x7fc95c14e8b0 2023-10-24T02:03:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.426+0000 7fc953fff700 1 -- 172.21.15.148:0/669093605 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800f9f0 con 0x7fc95c14e8b0 2023-10-24T02:03:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 -- 172.21.15.148:0/669093605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 msgr2=0x7fc95c062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 --2- 172.21.15.148:0/669093605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 0x7fc95c062650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fc958009790 tx=0x7fc958009060).stop 2023-10-24T02:03:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 -- 172.21.15.148:0/669093605 shutdown_connections 2023-10-24T02:03:29.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 --2- 172.21.15.148:0/669093605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c14e8b0 0x7fc95c062650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 -- 172.21.15.148:0/669093605 >> 172.21.15.148:0/669093605 conn(0x7fc95c0c7ba0 msgr2=0x7fc95c0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:29.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 -- 172.21.15.148:0/669093605 shutdown_connections 2023-10-24T02:03:29.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.427+0000 7fc96279d700 1 -- 172.21.15.148:0/669093605 wait complete. 2023-10-24T02:03:29.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.428+0000 7fc96279d700 1 Processor -- start 2023-10-24T02:03:29.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.428+0000 7fc96279d700 1 -- start start 2023-10-24T02:03:29.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 0x7fc95c14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c1552b0 0x7fc95c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c065ab0 con 0x7fc95c062b40 2023-10-24T02:03:29.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c066630 con 0x7fc95c14e8b0 2023-10-24T02:03:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96279d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c1656c0 con 0x7fc95c1552b0 2023-10-24T02:03:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60904/0 (socket says 172.21.15.148:60904) 2023-10-24T02:03:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 -- 172.21.15.148:0/3674546473 learned_addr learned my addr 172.21.15.148:0/3674546473 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc961f9c700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c1552b0 0x7fc95c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc960f9a700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 0x7fc95c14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 -- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c1552b0 msgr2=0x7fc95c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c1552b0 0x7fc95c0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 -- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 msgr2=0x7fc95c14c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 0x7fc95c14c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 -- 172.21.15.148:0/3674546473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580092a0 con 0x7fc95c062b40 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc960f9a700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 0x7fc95c14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.429+0000 7fc96179b700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fc958009e30 tx=0x7fc958017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.430+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800f7e0 con 0x7fc95c062b40 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.430+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800f960 con 0x7fc95c062b40 2023-10-24T02:03:29.439 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.430+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c14ce50 con 0x7fc95c062b40 2023-10-24T02:03:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.430+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95801b660 con 0x7fc95c062b40 2023-10-24T02:03:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.430+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c065fe0 con 0x7fc95c062b40 2023-10-24T02:03:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.431+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c066910 con 0x7fc95c062b40 2023-10-24T02:03:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.431+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc95801b9d0 con 0x7fc95c062b40 2023-10-24T02:03:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.431+0000 7fc9517fa700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 0x7fc940061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.431+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7fc95807baf0 con 0x7fc95c062b40 2023-10-24T02:03:29.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.432+0000 7fc960f9a700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 0x7fc940061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.432+0000 7fc960f9a700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 0x7fc940061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc95c0c1c40 tx=0x7fc94c009040).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.436+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc95804cd90 con 0x7fc95c062b40 2023-10-24T02:03:29.623 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.623+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc95c047480 con 0x7fc94005f150 2023-10-24T02:03:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.625+0000 7fc9517fa700 1 -- 172.21.15.148:0/3674546473 <== mgr.8009 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc95c047480 con 0x7fc94005f150 2023-10-24T02:03:29.625 INFO:teuthology.orchestra.run.smithi148.stdout:[ 2023-10-24T02:03:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2023-10-24T02:03:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "cephfs" 2023-10-24T02:03:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: } 2023-10-24T02:03:29.626 INFO:teuthology.orchestra.run.smithi148.stdout:] 2023-10-24T02:03:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.626+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 msgr2=0x7fc940061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.626+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 0x7fc940061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc95c0c1c40 tx=0x7fc94c009040).stop 2023-10-24T02:03:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 msgr2=0x7fc95c1651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7fc958009e30 tx=0x7fc958017000).stop 2023-10-24T02:03:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 shutdown_connections 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc95c1552b0 0x7fc95c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc95c062b40 0x7fc95c1651d0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc94005f150 0x7fc940061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 --2- 172.21.15.148:0/3674546473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc95c14e8b0 0x7fc95c14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 >> 172.21.15.148:0/3674546473 conn(0x7fc95c0c7ba0 msgr2=0x7fc95c14db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:29.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 shutdown_connections 2023-10-24T02:03:29.630 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.627+0000 7fc96279d700 1 -- 172.21.15.148:0/3674546473 wait complete. 2023-10-24T02:03:29.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-24T02:03:29.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.753+0000 7f277e22e700 1 Processor -- start 2023-10-24T02:03:29.754 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.753+0000 7f277e22e700 1 -- start start 2023-10-24T02:03:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f277e22e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 0x7f2778154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f277e22e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27780bffd0 0x7f27780c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f277e22e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780c0970 con 0x7f2778154430 2023-10-24T02:03:29.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f277e22e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780c6a10 con 0x7f27780bffd0 2023-10-24T02:03:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f277e22e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c71d0 con 0x7f2778098bd0 2023-10-24T02:03:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f27777fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2778154430 0x7f27780c6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45240/0 (socket says 172.21.15.148:45240) 2023-10-24T02:03:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f27777fe700 1 -- 172.21.15.148:0/2435458666 learned_addr learned my addr 172.21.15.148:0/2435458666 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:29.757 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2776ffd700 1 --2- 172.21.15.148:0/2435458666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 0x7f2778154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2777fff700 1 --2- 172.21.15.148:0/2435458666 >> v2:172.21.15.150:3300/0 conn(0x7f27780bffd0 0x7f27780c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f27767fc700 1 -- 172.21.15.148:0/2435458666 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847503037 0 0) 0x7f2768001490 con 0x7f2778154430 2023-10-24T02:03:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f27767fc700 1 -- 172.21.15.148:0/2435458666 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27600033f0 con 0x7f2778154430 2023-10-24T02:03:29.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2776ffd700 1 -- 172.21.15.148:0/2435458666 >> v2:172.21.15.150:3300/0 conn(0x7f27780bffd0 msgr2=0x7f27780c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2776ffd700 1 --2- 172.21.15.148:0/2435458666 >> v2:172.21.15.150:3300/0 conn(0x7f27780bffd0 0x7f27780c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2776ffd700 1 -- 172.21.15.148:0/2435458666 >> v1:172.21.15.148:6789/0 conn(0x7f2778154430 legacy=0x7f27780c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.754+0000 7f2776ffd700 1 -- 172.21.15.148:0/2435458666 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780c9410 con 0x7f2778098bd0 2023-10-24T02:03:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f2776ffd700 1 --2- 172.21.15.148:0/2435458666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 0x7f2778154810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f276c009790 tx=0x7f276c009060).ready entity=mon.2 client_cookie=de682a3197b73d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f27767fc700 1 -- 172.21.15.148:0/2435458666 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00d4a0 con 0x7f2778098bd0 2023-10-24T02:03:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f27767fc700 1 -- 172.21.15.148:0/2435458666 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00d600 con 0x7f2778098bd0 2023-10-24T02:03:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f27767fc700 1 -- 172.21.15.148:0/2435458666 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00d980 con 0x7f2778098bd0 2023-10-24T02:03:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 -- 172.21.15.148:0/2435458666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 msgr2=0x7f2778154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 --2- 172.21.15.148:0/2435458666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 0x7f2778154810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f276c009790 tx=0x7f276c009060).stop 2023-10-24T02:03:29.760 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 -- 172.21.15.148:0/2435458666 shutdown_connections 2023-10-24T02:03:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 --2- 172.21.15.148:0/2435458666 >> v2:172.21.15.150:3300/0 conn(0x7f27780bffd0 0x7f27780c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 --2- 172.21.15.148:0/2435458666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778098bd0 0x7f2778154810 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 -- 172.21.15.148:0/2435458666 >> 172.21.15.148:0/2435458666 conn(0x7f27780cb070 msgr2=0x7f27780cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 -- 172.21.15.148:0/2435458666 shutdown_connections 2023-10-24T02:03:29.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.755+0000 7f277e22e700 1 -- 172.21.15.148:0/2435458666 wait complete. 2023-10-24T02:03:29.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.757+0000 7f277e22e700 1 Processor -- start 2023-10-24T02:03:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.757+0000 7f277e22e700 1 -- start start 2023-10-24T02:03:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778098bd0 0x7f2778151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778154430 0x7f27780af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.765 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c5060 con 0x7f27780bffd0 2023-10-24T02:03:29.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c3690 con 0x7f2778098bd0 2023-10-24T02:03:29.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c25f0 con 0x7f2778154430 2023-10-24T02:03:29.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60912/0 (socket says 172.21.15.148:60912) 2023-10-24T02:03:29.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 -- 172.21.15.148:0/938753812 learned_addr learned my addr 172.21.15.148:0/938753812 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:29.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2777fff700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778154430 0x7f27780af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f27777fe700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778098bd0 0x7f2778151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 -- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778154430 msgr2=0x7f27780af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.767 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778154430 0x7f27780af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 -- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778098bd0 msgr2=0x7f2778151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778098bd0 0x7f2778151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 -- 172.21.15.148:0/938753812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0092a0 con 0x7f27780bffd0 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f2776ffd700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f27780c7310 tx=0x7f276c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c000bc0 con 0x7f27780bffd0 2023-10-24T02:03:29.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00d770 con 0x7f27780bffd0 2023-10-24T02:03:29.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780c28d0 con 0x7f27780bffd0 2023-10-24T02:03:29.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c000d20 con 0x7f27780bffd0 2023-10-24T02:03:29.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.758+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780c2e90 con 0x7f27780bffd0 2023-10-24T02:03:29.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.759+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277806c6b0 con 0x7f27780bffd0 2023-10-24T02:03:29.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.760+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 98) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f276c01d8f0 con 0x7f27780bffd0 2023-10-24T02:03:29.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.760+0000 7f275f7fe700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 0x7f2764061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:29.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.760+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f276c07bac0 con 0x7f27780bffd0 2023-10-24T02:03:29.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.760+0000 7f27777fe700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 0x7f2764061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:29.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.761+0000 7f27777fe700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 0x7f2764061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2768007fd0 tx=0x7f2768000f40).ready entity=mgr.8009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:29.770 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.764+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f276c04cd60 con 0x7f27780bffd0 2023-10-24T02:03:29.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:29.971+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f27780612f0 con 0x7f27780bffd0 2023-10-24T02:03:30.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.889+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 99) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f276c079860 con 0x7f27780bffd0 2023-10-24T02:03:30.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.890+0000 7f275f7fe700 1 -- 172.21.15.148:0/938753812 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v99) v1 ==== 92+0+0 (secure 0 0 0) 0x7f276c0429f0 con 0x7f27780bffd0 2023-10-24T02:03:30.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 msgr2=0x7f2764061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:30.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 0x7f2764061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2768007fd0 tx=0x7f2768000f40).stop 2023-10-24T02:03:30.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 msgr2=0x7f27781593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:30.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f27780c7310 tx=0x7f276c016000).stop 2023-10-24T02:03:30.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 shutdown_connections 2023-10-24T02:03:30.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2778154430 0x7f27780af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:30.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f276405f150 0x7f2764061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:30.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778098bd0 0x7f2778151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:30.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 --2- 172.21.15.148:0/938753812 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27780bffd0 0x7f27781593b0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:30.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 >> 172.21.15.148:0/938753812 conn(0x7f27780cb070 msgr2=0x7f27780a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:30.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 shutdown_connections 2023-10-24T02:03:30.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:30.893+0000 7f277e22e700 1 -- 172.21.15.148:0/938753812 wait complete. 2023-10-24T02:03:30.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-24T02:03:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.032+0000 7f992cae8700 1 Processor -- start 2023-10-24T02:03:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.032+0000 7f992cae8700 1 -- start start 2023-10-24T02:03:31.034 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:31.032+0000 7f28dde15680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:31.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.033+0000 7f992cae8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f99280c6d10 0x7f99280c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.033+0000 7f992cae8700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280c6880 con 0x7f9928154300 2023-10-24T02:03:31.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.033+0000 7f992cae8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99280c7670 con 0x7f99281546e0 2023-10-24T02:03:31.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.033+0000 7f992cae8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280c1550 con 0x7f99280c6d10 2023-10-24T02:03:31.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f9926d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f99280c6d10 0x7f99280c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f992659c700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9928154300 0x7f99280a7d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45246/0 (socket says 172.21.15.148:45246) 2023-10-24T02:03:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f992659c700 1 -- 172.21.15.148:0/3200635020 learned_addr learned my addr 172.21.15.148:0/3200635020 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f9926d9d700 1 -- 172.21.15.148:0/3200635020 >> v1:172.21.15.150:6789/0 conn(0x7f99281546e0 legacy=0x7f99280c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f9926d9d700 1 -- 172.21.15.148:0/3200635020 >> v1:172.21.15.148:6789/0 conn(0x7f9928154300 legacy=0x7f99280a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f9926d9d700 1 -- 172.21.15.148:0/3200635020 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280c1270 con 0x7f99280c6d10 2023-10-24T02:03:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f9926d9d700 1 --2- 172.21.15.148:0/3200635020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f99280c7180 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f99280c6830 tx=0x7f9920009780).ready entity=mon.0 client_cookie=afc1d1eafc74b067 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f992559a700 1 -- 172.21.15.148:0/3200635020 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992000e070 con 0x7f99280c6d10 2023-10-24T02:03:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f992559a700 1 -- 172.21.15.148:0/3200635020 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992000bc30 con 0x7f99280c6d10 2023-10-24T02:03:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.034+0000 7f992559a700 1 -- 172.21.15.148:0/3200635020 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920012410 con 0x7f99280c6d10 2023-10-24T02:03:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 -- 172.21.15.148:0/3200635020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 msgr2=0x7f99280c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 --2- 172.21.15.148:0/3200635020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f99280c7180 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f99280c6830 tx=0x7f9920009780).stop 2023-10-24T02:03:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 -- 172.21.15.148:0/3200635020 shutdown_connections 2023-10-24T02:03:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 --2- 172.21.15.148:0/3200635020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f99280c7180 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 -- 172.21.15.148:0/3200635020 >> 172.21.15.148:0/3200635020 conn(0x7f9928084ce0 msgr2=0x7f9928094600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 -- 172.21.15.148:0/3200635020 shutdown_connections 2023-10-24T02:03:31.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.035+0000 7f992cae8700 1 -- 172.21.15.148:0/3200635020 wait complete. 2023-10-24T02:03:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.036+0000 7f992cae8700 1 Processor -- start 2023-10-24T02:03:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.036+0000 7f992cae8700 1 -- start start 2023-10-24T02:03:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928154300 0x7f9928095900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99281546e0 0x7f9928095df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928151660 con 0x7f99280c6d10 2023-10-24T02:03:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928165650 con 0x7f99281546e0 2023-10-24T02:03:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992cae8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9928150790 con 0x7f9928154300 2023-10-24T02:03:31.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60932/0 (socket says 172.21.15.148:60932) 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 -- 172.21.15.148:0/4256687723 learned_addr learned my addr 172.21.15.148:0/4256687723 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f9926d9d700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99281546e0 0x7f9928095df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f9925d9b700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928154300 0x7f9928095900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928154300 msgr2=0x7f9928095900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928154300 0x7f9928095900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99281546e0 msgr2=0x7f9928095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99281546e0 0x7f9928095df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.037+0000 7f992659c700 1 -- 172.21.15.148:0/4256687723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009a20 con 0x7f99280c6d10 2023-10-24T02:03:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f992659c700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f991c00c4f0 tx=0x7f991c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00ce60 con 0x7f99280c6d10 2023-10-24T02:03:31.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c001e90 con 0x7f99280c6d10 2023-10-24T02:03:31.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0074f0 con 0x7f99280c6d10 2023-10-24T02:03:31.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9928150a50 con 0x7f99280c6d10 2023-10-24T02:03:31.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.038+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9928151010 con 0x7f99280c6d10 2023-10-24T02:03:31.047 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f8e66ab2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:31.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 99) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f991c005880 con 0x7f99280c6d10 2023-10-24T02:03:31.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992806c6b0 con 0x7f99280c6d10 2023-10-24T02:03:31.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f99167fc700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 0x7f9908061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f9925d9b700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 msgr2=0x7f9908061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:31.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7f991c079860 con 0x7f99280c6d10 2023-10-24T02:03:31.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.039+0000 7f9925d9b700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 0x7f9908061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:31.049 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.044+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f991c04ab00 con 0x7f99280c6d10 2023-10-24T02:03:31.097 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:31.096+0000 7f28dde15680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:31.122 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:31.121+0000 7f8e66ab2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:31.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.237+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f99280c6230 con 0x7f99280c6d10 2023-10-24T02:03:31.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.240+0000 7f9925d9b700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 msgr2=0x7f9908061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:31.240 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.240+0000 7f9925d9b700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 0x7f9908061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:31.241 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.240+0000 7f99167fc700 1 -- 172.21.15.148:0/4256687723 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v43)=0 v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f991c04e120 con 0x7f99280c6d10 2023-10-24T02:03:31.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 msgr2=0x7f9908061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:31.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 0x7f9908061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 msgr2=0x7f9928148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7f991c00c4f0 tx=0x7f991c007c60).stop 2023-10-24T02:03:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 shutdown_connections 2023-10-24T02:03:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f990805f1a0 0x7f9908061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99281546e0 0x7f9928095df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99280c6d10 0x7f9928148890 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.242+0000 7f992cae8700 1 --2- 172.21.15.148:0/4256687723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9928154300 0x7f9928095900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.243+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 >> 172.21.15.148:0/4256687723 conn(0x7f9928084ce0 msgr2=0x7f99280c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.243+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 shutdown_connections 2023-10-24T02:03:31.245 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.243+0000 7f992cae8700 1 -- 172.21.15.148:0/4256687723 wait complete. 2023-10-24T02:03:31.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:31.256 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-24T02:03:31.275 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-24T02:03:31.372 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:31.371+0000 7f28dde15680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:31.410 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:31.410+0000 7f8e66ab2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:31.437 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.437+0000 7ffb6e1eb700 1 Processor -- start 2023-10-24T02:03:31.438 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.437+0000 7ffb6e1eb700 1 -- start start 2023-10-24T02:03:31.440 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb6e1eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb6e1eb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb68154950 0x7ffb680bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb6e1eb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb68068f20 con 0x7ffb680c2090 2023-10-24T02:03:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb6e1eb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb680691e0 con 0x7ffb68154950 2023-10-24T02:03:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb6e1eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680694c0 con 0x7ffb68150870 2023-10-24T02:03:31.441 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb5effd700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7ffb680c2090 0x7ffb68154240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45248/0 (socket says 172.21.15.148:45248) 2023-10-24T02:03:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb5effd700 1 -- 172.21.15.148:0/3256068653 learned_addr learned my addr 172.21.15.148:0/3256068653 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb67fff700 1 --2- 172.21.15.148:0/3256068653 >> v2:172.21.15.150:3300/0 conn(0x7ffb68154950 0x7ffb680bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb677fe700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.442 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb66ffd700 1 -- 172.21.15.148:0/3256068653 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485099490 0 0) 0x7ffb68068f20 con 0x7ffb680c2090 2023-10-24T02:03:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb66ffd700 1 -- 172.21.15.148:0/3256068653 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb540033f0 con 0x7ffb680c2090 2023-10-24T02:03:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.438+0000 7ffb67fff700 1 -- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 msgr2=0x7ffb680688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb67fff700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb67fff700 1 -- 172.21.15.148:0/3256068653 >> v1:172.21.15.148:6789/0 conn(0x7ffb680c2090 legacy=0x7ffb68154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.443 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb67fff700 1 -- 172.21.15.148:0/3256068653 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680697a0 con 0x7ffb68154950 2023-10-24T02:03:31.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb67fff700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb68154950 0x7ffb680bc1a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7ffb6000af70 tx=0x7ffb6000a890).ready entity=mon.1 client_cookie=9c94e844f5e8df1a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:31.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb66ffd700 1 -- 172.21.15.148:0/3256068653 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000f070 con 0x7ffb68154950 2023-10-24T02:03:31.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb66ffd700 1 -- 172.21.15.148:0/3256068653 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6000a2e0 con 0x7ffb68154950 2023-10-24T02:03:31.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb66ffd700 1 -- 172.21.15.148:0/3256068653 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000cb80 con 0x7ffb68154950 2023-10-24T02:03:31.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb68154950 msgr2=0x7ffb680bc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb68154950 0x7ffb680bc1a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7ffb6000af70 tx=0x7ffb6000a890).stop 2023-10-24T02:03:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/3256068653 shutdown_connections 2023-10-24T02:03:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb68154950 0x7ffb680bc1a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/3256068653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/3256068653 >> 172.21.15.148:0/3256068653 conn(0x7ffb680c3670 msgr2=0x7ffb680c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/3256068653 shutdown_connections 2023-10-24T02:03:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.439+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/3256068653 wait complete. 2023-10-24T02:03:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.440+0000 7ffb6e1eb700 1 Processor -- start 2023-10-24T02:03:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 -- start start 2023-10-24T02:03:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 0x7ffb6814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680be2a0 con 0x7ffb68154950 2023-10-24T02:03:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680bdc70 con 0x7ffb680c2090 2023-10-24T02:03:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.441+0000 7ffb6e1eb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680aa2d0 con 0x7ffb68150870 2023-10-24T02:03:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb677fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 0x7ffb6814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60946/0 (socket says 172.21.15.148:60946) 2023-10-24T02:03:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 -- 172.21.15.148:0/130434589 learned_addr learned my addr 172.21.15.148:0/130434589 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb5effd700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 msgr2=0x7ffb680a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 msgr2=0x7ffb6814c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 0x7ffb6814c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6000ab30 con 0x7ffb68154950 2023-10-24T02:03:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 0x7ffb6814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb67fff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7ffb60011000 tx=0x7ffb6000a890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000c640 con 0x7ffb68154950 2023-10-24T02:03:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60008c80 con 0x7ffb68154950 2023-10-24T02:03:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb680aa5a0 con 0x7ffb68154950 2023-10-24T02:03:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60014420 con 0x7ffb68154950 2023-10-24T02:03:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.442+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb680bdf30 con 0x7ffb68154950 2023-10-24T02:03:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.443+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6806c6b0 con 0x7ffb68154950 2023-10-24T02:03:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.444+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 99) v1 ==== 75463+0+0 (secure 0 0 0) 0x7ffb60003040 con 0x7ffb68154950 2023-10-24T02:03:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.444+0000 7ffb5ffff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.444+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6165+0+0 (secure 0 0 0) 0x7ffb6007b170 con 0x7ffb68154950 2023-10-24T02:03:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.444+0000 7ffb677fe700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.444+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.452+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffb6004c4c0 con 0x7ffb68154950 2023-10-24T02:03:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.645+0000 7ffb677fe700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.645+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:31.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:31.649+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb680bbe40 con 0x7ffb4805f1a0 2023-10-24T02:03:31.985 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:31.983+0000 7f28dde15680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:32.040 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.039+0000 7f8e66ab2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:32.046+0000 7ffb677fe700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:32.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:32.046+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-10-24T02:03:32.057 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.055+0000 7f28dde15680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:32.113 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.112+0000 7f8e66ab2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:32.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.242+0000 7f28dde15680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:32.300 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.300+0000 7f8e66ab2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:32.664 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.663+0000 7f28dde15680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:32.723 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.723+0000 7f8e66ab2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:32.767 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.766+0000 7f28dde15680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:32.827 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.827+0000 7f8e66ab2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:32.847+0000 7ffb677fe700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:32.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:32.847+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-10-24T02:03:32.922 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.920+0000 7f28dde15680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:32.981 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:32.981+0000 7f8e66ab2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:32.997 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:32.996+0000 7f28dde15680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:33.055 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:33.054+0000 7f8e66ab2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:33.064 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:33.063+0000 7f28dde15680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:33.122 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:33.121+0000 7f8e66ab2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:33.321 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:33.320+0000 7f28dde15680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:33.379 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:33.379+0000 7f8e66ab2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:33.506 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:33.505+0000 7f28dde15680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:33.564 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:33.564+0000 7f8e66ab2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:34.162 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.161+0000 7f28dde15680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:34.220 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.220+0000 7f8e66ab2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:34.231 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.230+0000 7f28dde15680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:34.289 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.289+0000 7f8e66ab2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:34.306 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.305+0000 7f28dde15680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:34.365 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.364+0000 7f8e66ab2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:34.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:34.449+0000 7ffb677fe700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:34.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:34.449+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-10-24T02:03:34.453 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.451+0000 7f28dde15680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:34.514 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.513+0000 7f8e66ab2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:34.523 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.521+0000 7f28dde15680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:34.585 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.584+0000 7f8e66ab2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:34.637 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.635+0000 7f28dde15680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:34.700 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.700+0000 7f8e66ab2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:34.745 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:34.744+0000 7f28dde15680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:34.810 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:34.809+0000 7f8e66ab2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:35.040 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.038+0000 7f28dde15680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:35.105 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:35.105+0000 7f8e66ab2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:35.111 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.109+0000 7f28dde15680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:35.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:35.131+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 100) v1 ==== 75287+0+0 (secure 0 0 0) 0x7ffb60078f10 con 0x7ffb68154950 2023-10-24T02:03:35.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:35.131+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb48061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:35.132 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:35.131+0000 7ffb5ffff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb48061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:35.185 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:35.185+0000 7f8e66ab2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:35.201 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f28555a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.201 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f28555a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.201 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f28555a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.201 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f28555a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.202 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f28555a2700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.202 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f285259c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.202 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f285259c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.202 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f285259c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.202 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f285259c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:35.203 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:35.199+0000 7f285259c700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:36.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.133+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7ffb60079290 con 0x7ffb68154950 2023-10-24T02:03:36.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.134+0000 7ffb5ffff700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.134 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.134+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb680bbe40 con 0x7ffb4805f1a0 2023-10-24T02:03:36.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.134+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.135+0000 7ffb677fe700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb480615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb58010c20 tx=0x7ffb58012040).ready entity=mgr.9373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.154 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.154+0000 7ffb5ffff700 1 -- 172.21.15.148:0/130434589 <== mgr.9373 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffb680bbe40 con 0x7ffb4805f1a0 2023-10-24T02:03:36.154 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule set for path snap_test_dir1 2023-10-24T02:03:36.156 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 msgr2=0x7ffb480615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb480615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffb58010c20 tx=0x7ffb58012040).stop 2023-10-24T02:03:36.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 msgr2=0x7ffb6813a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7ffb60011000 tx=0x7ffb6000a890).stop 2023-10-24T02:03:36.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 shutdown_connections 2023-10-24T02:03:36.157 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb68154950 0x7ffb6813a900 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ffb4805f1a0 0x7ffb480615e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb680c2090 0x7ffb6814c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 --2- 172.21.15.148:0/130434589 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb68150870 0x7ffb680a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 >> 172.21.15.148:0/130434589 conn(0x7ffb680c3670 msgr2=0x7ffb680bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.158 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 shutdown_connections 2023-10-24T02:03:36.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.156+0000 7ffb6e1eb700 1 -- 172.21.15.148:0/130434589 wait complete. 2023-10-24T02:03:36.169 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-24T02:03:36.170 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-24T02:03:36.291 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.291+0000 7f8d6e64a700 1 Processor -- start 2023-10-24T02:03:36.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.291+0000 7f8d6e64a700 1 -- start start 2023-10-24T02:03:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6e64a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d68152290 0x7f8d68155710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6e64a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8d680c66c0 0x7f8d680c1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6e64a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68155c00 con 0x7f8d680c6240 2023-10-24T02:03:36.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6e64a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680c8800 con 0x7f8d68152290 2023-10-24T02:03:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6e64a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680c7b80 con 0x7f8d680c66c0 2023-10-24T02:03:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d68152290 0x7f8d68155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8d68152290 0x7f8d68155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46866/0 (socket says 172.21.15.148:46866) 2023-10-24T02:03:36.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 -- 172.21.15.148:0/1717546042 learned_addr learned my addr 172.21.15.148:0/1717546042 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:36.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d6cbe7700 1 --2- 172.21.15.148:0/1717546042 >> v2:172.21.15.150:3300/0 conn(0x7f8d680c66c0 0x7f8d680c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 -- 172.21.15.148:0/1717546042 >> v2:172.21.15.150:3300/0 conn(0x7f8d680c66c0 msgr2=0x7f8d680c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:36.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 --2- 172.21.15.148:0/1717546042 >> v2:172.21.15.150:3300/0 conn(0x7f8d680c66c0 0x7f8d680c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 -- 172.21.15.148:0/1717546042 >> v1:172.21.15.150:6789/0 conn(0x7f8d680c6240 legacy=0x7f8d680c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 -- 172.21.15.148:0/1717546042 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680c7e60 con 0x7f8d68152290 2023-10-24T02:03:36.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d67fff700 1 --2- 172.21.15.148:0/1717546042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d68152290 0x7f8d68155710 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f8d680847f0 tx=0x7f8d5c0090f0).ready entity=mon.0 client_cookie=a27642317a112aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.292+0000 7f8d66ffd700 1 -- 172.21.15.148:0/1717546042 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00b520 con 0x7f8d68152290 2023-10-24T02:03:36.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d66ffd700 1 -- 172.21.15.148:0/1717546042 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c00b680 con 0x7f8d68152290 2023-10-24T02:03:36.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d66ffd700 1 -- 172.21.15.148:0/1717546042 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00ba20 con 0x7f8d68152290 2023-10-24T02:03:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 -- 172.21.15.148:0/1717546042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d68152290 msgr2=0x7f8d68155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/1717546042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d68152290 0x7f8d68155710 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f8d680847f0 tx=0x7f8d5c0090f0).stop 2023-10-24T02:03:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 -- 172.21.15.148:0/1717546042 shutdown_connections 2023-10-24T02:03:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/1717546042 >> v2:172.21.15.150:3300/0 conn(0x7f8d680c66c0 0x7f8d680c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/1717546042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d68152290 0x7f8d68155710 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 -- 172.21.15.148:0/1717546042 >> 172.21.15.148:0/1717546042 conn(0x7f8d680946c0 msgr2=0x7f8d6806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 -- 172.21.15.148:0/1717546042 shutdown_connections 2023-10-24T02:03:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.293+0000 7f8d6e64a700 1 -- 172.21.15.148:0/1717546042 wait complete. 2023-10-24T02:03:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.294+0000 7f8d6e64a700 1 Processor -- start 2023-10-24T02:03:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.294+0000 7f8d6e64a700 1 -- start start 2023-10-24T02:03:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 0x7f8d680b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d68152290 0x7f8d68153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681541d0 con 0x7f8d680c66c0 2023-10-24T02:03:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68168290 con 0x7f8d68152290 2023-10-24T02:03:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6e64a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681679a0 con 0x7f8d680c6240 2023-10-24T02:03:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d677fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46872/0 (socket says 172.21.15.148:46872) 2023-10-24T02:03:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d677fe700 1 -- 172.21.15.148:0/297545740 learned_addr learned my addr 172.21.15.148:0/297545740 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d6cbe7700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d68152290 0x7f8d68153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d67fff700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 0x7f8d680b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.295+0000 7f8d677fe700 1 -- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 msgr2=0x7f8d680b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d677fe700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 0x7f8d680b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d677fe700 1 -- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d68152290 msgr2=0x7f8d68153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d677fe700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d68152290 0x7f8d68153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d677fe700 1 -- 172.21.15.148:0/297545740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c009370 con 0x7f8d680c66c0 2023-10-24T02:03:36.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d67fff700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 0x7f8d680b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:36.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d677fe700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f8d5800c470 tx=0x7f8d58007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58012400 con 0x7f8d680c66c0 2023-10-24T02:03:36.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58012560 con 0x7f8d680c66c0 2023-10-24T02:03:36.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68168720 con 0x7f8d680c66c0 2023-10-24T02:03:36.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58012900 con 0x7f8d680c66c0 2023-10-24T02:03:36.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.296+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68167f20 con 0x7f8d680c66c0 2023-10-24T02:03:36.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.297+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68168420 con 0x7f8d680c66c0 2023-10-24T02:03:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.297+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8d5801b3b0 con 0x7f8d680c66c0 2023-10-24T02:03:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.298+0000 7f8d4ffff700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 0x7f8d54061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.298+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f8d580798d0 con 0x7f8d680c66c0 2023-10-24T02:03:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.298+0000 7f8d67fff700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 0x7f8d54061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.298+0000 7f8d67fff700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 0x7f8d54061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8d680c23e0 tx=0x7f8d5c017000).ready entity=mgr.9373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.309 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.302+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8d5804ac30 con 0x7f8d680c66c0 2023-10-24T02:03:36.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.492+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d680c8140 con 0x7f8d5405f080 2023-10-24T02:03:36.497 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.497+0000 7f8d4ffff700 1 -- 172.21.15.148:0/297545740 <== mgr.9373 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f8d680c8140 con 0x7f8d5405f080 2023-10-24T02:03:36.497 INFO:teuthology.orchestra.run.smithi148.stdout:Retention added to path snap_test_dir1 2023-10-24T02:03:36.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 msgr2=0x7f8d54061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 0x7f8d54061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8d680c23e0 tx=0x7f8d5c017000).stop 2023-10-24T02:03:36.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 msgr2=0x7f8d681537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f8d5800c470 tx=0x7f8d58007db0).stop 2023-10-24T02:03:36.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 shutdown_connections 2023-10-24T02:03:36.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f8d5405f080 0x7f8d54061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d68152290 0x7f8d68153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d680c6240 0x7f8d680b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 --2- 172.21.15.148:0/297545740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d680c66c0 0x7f8d681537f0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 >> 172.21.15.148:0/297545740 conn(0x7f8d680946c0 msgr2=0x7f8d680c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 shutdown_connections 2023-10-24T02:03:36.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.499+0000 7f8d6e64a700 1 -- 172.21.15.148:0/297545740 wait complete. 2023-10-24T02:03:36.511 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-24T02:03:36.515 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-24-02_04_00 in ~24s... 2023-10-24T02:03:36.516 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-24T02:03:36.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-24T02:03:36.633 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.633+0000 7fdf09748700 1 Processor -- start 2023-10-24T02:03:36.634 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.633+0000 7fdf09748700 1 -- start start 2023-10-24T02:03:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf09748700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdf041544b0 0x7fdf040a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.636 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf09748700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf040aa640 0x7fdf040c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf09748700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040c6270 con 0x7fdf040c8290 2023-10-24T02:03:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf09748700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040c60e0 con 0x7fdf040aa640 2023-10-24T02:03:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf09748700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040c0c80 con 0x7fdf041544b0 2023-10-24T02:03:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fdf040aa640 0x7fdf040c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.637 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf027fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdf040c8290 0x7fdf040a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45908/0 (socket says 172.21.15.148:45908) 2023-10-24T02:03:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf027fc700 1 -- 172.21.15.148:0/1767527741 learned_addr learned my addr 172.21.15.148:0/1767527741 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf02ffd700 1 --2- 172.21.15.148:0/1767527741 >> v2:172.21.15.150:3300/0 conn(0x7fdf041544b0 0x7fdf040a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 -- 172.21.15.148:0/1767527741 >> v2:172.21.15.150:3300/0 conn(0x7fdf041544b0 msgr2=0x7fdf040a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 --2- 172.21.15.148:0/1767527741 >> v2:172.21.15.150:3300/0 conn(0x7fdf041544b0 0x7fdf040a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.638 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 -- 172.21.15.148:0/1767527741 >> v1:172.21.15.148:6789/0 conn(0x7fdf040c8290 legacy=0x7fdf040a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf01ffb700 1 -- 172.21.15.148:0/1767527741 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019843490 0 0) 0x7fdf040c6270 con 0x7fdf040c8290 2023-10-24T02:03:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 -- 172.21.15.148:0/1767527741 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040c0f40 con 0x7fdf040aa640 2023-10-24T02:03:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.634+0000 7fdf037fe700 1 --2- 172.21.15.148:0/1767527741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040aa640 0x7fdf040c6700 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fdf04084570 tx=0x7fdefc009780).ready entity=mon.0 client_cookie=69d3c4c4f4e964be server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.639 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf01ffb700 1 -- 172.21.15.148:0/1767527741 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00e070 con 0x7fdf040aa640 2023-10-24T02:03:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf01ffb700 1 -- 172.21.15.148:0/1767527741 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00bc30 con 0x7fdf040aa640 2023-10-24T02:03:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf01ffb700 1 -- 172.21.15.148:0/1767527741 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc012410 con 0x7fdf040aa640 2023-10-24T02:03:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 -- 172.21.15.148:0/1767527741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040aa640 msgr2=0x7fdf040c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.640 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 --2- 172.21.15.148:0/1767527741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040aa640 0x7fdf040c6700 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fdf04084570 tx=0x7fdefc009780).stop 2023-10-24T02:03:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 -- 172.21.15.148:0/1767527741 shutdown_connections 2023-10-24T02:03:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 --2- 172.21.15.148:0/1767527741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040aa640 0x7fdf040c6700 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 --2- 172.21.15.148:0/1767527741 >> v2:172.21.15.150:3300/0 conn(0x7fdf041544b0 0x7fdf040a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 -- 172.21.15.148:0/1767527741 >> 172.21.15.148:0/1767527741 conn(0x7fdf040945d0 msgr2=0x7fdf0406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 -- 172.21.15.148:0/1767527741 shutdown_connections 2023-10-24T02:03:36.642 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.635+0000 7fdf09748700 1 -- 172.21.15.148:0/1767527741 wait complete. 2023-10-24T02:03:36.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.636+0000 7fdf09748700 1 Processor -- start 2023-10-24T02:03:36.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.636+0000 7fdf09748700 1 -- start start 2023-10-24T02:03:36.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf040aa640 0x7fdf0414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf041544b0 0x7fdf040ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040ca7b0 con 0x7fdf040c8290 2023-10-24T02:03:36.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0414d540 con 0x7fdf040aa640 2023-10-24T02:03:36.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf09748700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040aea20 con 0x7fdf041544b0 2023-10-24T02:03:36.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf027fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf027fc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46884/0 (socket says 172.21.15.148:46884) 2023-10-24T02:03:36.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf027fc700 1 -- 172.21.15.148:0/3159719221 learned_addr learned my addr 172.21.15.148:0/3159719221 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:36.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf02ffd700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf040aa640 0x7fdf0414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.637+0000 7fdf037fe700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf041544b0 0x7fdf040ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 -- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf041544b0 msgr2=0x7fdf040ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf041544b0 0x7fdf040ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 -- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf040aa640 msgr2=0x7fdf0414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf040aa640 0x7fdf0414d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 -- 172.21.15.148:0/3159719221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc009a20 con 0x7fdf040c8290 2023-10-24T02:03:36.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf027fc700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7fdef800c4e0 tx=0x7fdef8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800ce90 con 0x7fdf040c8290 2023-10-24T02:03:36.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef80072e0 con 0x7fdf040c8290 2023-10-24T02:03:36.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8007660 con 0x7fdf040c8290 2023-10-24T02:03:36.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf040aaab0 con 0x7fdf040c8290 2023-10-24T02:03:36.649 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.638+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf040aef50 con 0x7fdf040c8290 2023-10-24T02:03:36.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.639+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0406c6b0 con 0x7fdf040c8290 2023-10-24T02:03:36.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.639+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fdef80059b0 con 0x7fdf040c8290 2023-10-24T02:03:36.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.639+0000 7fdeeaffd700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 0x7fdef0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.650 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.640+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fdef8079850 con 0x7fdf040c8290 2023-10-24T02:03:36.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.640+0000 7fdf02ffd700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 0x7fdef0061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.640+0000 7fdf02ffd700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 0x7fdef0061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdef400bb10 tx=0x7fdef4008040).ready entity=mgr.9373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.644+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdef804ab00 con 0x7fdf040c8290 2023-10-24T02:03:36.831 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.830+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf040c1220 con 0x7fdef005f080 2023-10-24T02:03:36.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.833+0000 7fdeeaffd700 1 -- 172.21.15.148:0/3159719221 <== mgr.9373 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fdf040c1220 con 0x7fdef005f080 2023-10-24T02:03:36.833 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:36.834 INFO:teuthology.orchestra.run.smithi148.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-24T02:03:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 msgr2=0x7fdef0061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 0x7fdef0061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdef400bb10 tx=0x7fdef4008040).stop 2023-10-24T02:03:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 msgr2=0x7fdf040c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7fdef800c4e0 tx=0x7fdef8007c70).stop 2023-10-24T02:03:36.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 shutdown_connections 2023-10-24T02:03:36.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf041544b0 0x7fdf040ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fdef005f080 0x7fdef0061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf040aa640 0x7fdf0414d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 --2- 172.21.15.148:0/3159719221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdf040c8290 0x7fdf040c9dd0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 >> 172.21.15.148:0/3159719221 conn(0x7fdf040945d0 msgr2=0x7fdf040c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 shutdown_connections 2023-10-24T02:03:36.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.835+0000 7fdf09748700 1 -- 172.21.15.148:0/3159719221 wait complete. 2023-10-24T02:03:36.847 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-24T02:03:36.848 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-24T02:03:36.848 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-24T02:03:36.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.966+0000 7f009cfee700 1 Processor -- start 2023-10-24T02:03:36.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.966+0000 7f009cfee700 1 -- start start 2023-10-24T02:03:36.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00981544b0 0x7f00980a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f00980c8290 0x7f00980a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.969 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00980aa420 0x7f00980c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980c60e0 con 0x7f00981544b0 2023-10-24T02:03:36.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980c6270 con 0x7f00980c8290 2023-10-24T02:03:36.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009cfee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980aa870 con 0x7f00980aa420 2023-10-24T02:03:36.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00981544b0 0x7f00980a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f00981544b0 0x7f00980a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46898/0 (socket says 172.21.15.148:46898) 2023-10-24T02:03:36.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 -- 172.21.15.148:0/3349056238 learned_addr learned my addr 172.21.15.148:0/3349056238 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:36.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f0096d9d700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00980aa420 0x7f00980c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f008dd9b700 1 --2- 172.21.15.148:0/3349056238 >> v2:172.21.15.150:3300/0 conn(0x7f00980c8290 0x7f00980a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.971 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 -- 172.21.15.148:0/3349056238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00980aa420 msgr2=0x7f00980c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:36.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00980aa420 0x7f00980c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 -- 172.21.15.148:0/3349056238 >> v2:172.21.15.150:3300/0 conn(0x7f00980c8290 msgr2=0x7f00980a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:36.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 --2- 172.21.15.148:0/3349056238 >> v2:172.21.15.150:3300/0 conn(0x7f00980c8290 0x7f00980a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.972 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.967+0000 7f009659c700 1 -- 172.21.15.148:0/3349056238 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980c0c80 con 0x7f00981544b0 2023-10-24T02:03:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009659c700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00981544b0 0x7f00980a7d00 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f00980a9cf0 tx=0x7f00880090f0).ready entity=mon.0 client_cookie=7c071964fc0dcda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f0095d9b700 1 -- 172.21.15.148:0/3349056238 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800b600 con 0x7f00981544b0 2023-10-24T02:03:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f0095d9b700 1 -- 172.21.15.148:0/3349056238 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800b760 con 0x7f00981544b0 2023-10-24T02:03:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f0095d9b700 1 -- 172.21.15.148:0/3349056238 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800bae0 con 0x7f00981544b0 2023-10-24T02:03:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 -- 172.21.15.148:0/3349056238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00981544b0 msgr2=0x7f00980a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00981544b0 0x7f00980a7d00 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f00980a9cf0 tx=0x7f00880090f0).stop 2023-10-24T02:03:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 -- 172.21.15.148:0/3349056238 shutdown_connections 2023-10-24T02:03:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00981544b0 0x7f00980a7d00 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 --2- 172.21.15.148:0/3349056238 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00980aa420 0x7f00980c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 --2- 172.21.15.148:0/3349056238 >> v2:172.21.15.150:3300/0 conn(0x7f00980c8290 0x7f00980a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 -- 172.21.15.148:0/3349056238 >> 172.21.15.148:0/3349056238 conn(0x7f00980945d0 msgr2=0x7f009806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:36.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 -- 172.21.15.148:0/3349056238 shutdown_connections 2023-10-24T02:03:36.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.968+0000 7f009cfee700 1 -- 172.21.15.148:0/3349056238 wait complete. 2023-10-24T02:03:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.969+0000 7f009cfee700 1 Processor -- start 2023-10-24T02:03:36.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.969+0000 7f009cfee700 1 -- start start 2023-10-24T02:03:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 0x7f009814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 0x7f00980ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980abed0 con 0x7f00980aa420 2023-10-24T02:03:36.979 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00980ac1b0 con 0x7f00980c8290 2023-10-24T02:03:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009cfee700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00980ac490 con 0x7f00981544b0 2023-10-24T02:03:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009659c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46900/0 (socket says 172.21.15.148:46900) 2023-10-24T02:03:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.970+0000 7f009659c700 1 -- 172.21.15.148:0/969840858 learned_addr learned my addr 172.21.15.148:0/969840858 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:36.980 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f0096d9d700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 0x7f00980ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f008dd9b700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 0x7f009814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 -- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 msgr2=0x7f00980ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 0x7f00980ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 -- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 msgr2=0x7f009814dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 0x7f009814dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:36.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 -- 172.21.15.148:0/969840858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088009370 con 0x7f00980aa420 2023-10-24T02:03:36.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f0096d9d700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 0x7f00980ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:36.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f008dd9b700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 0x7f009814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:36.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009659c700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f0088009130 tx=0x7f0088017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008800b8d0 con 0x7f00980aa420 2023-10-24T02:03:36.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800ba50 con 0x7f00980aa420 2023-10-24T02:03:36.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00980ac770 con 0x7f00980aa420 2023-10-24T02:03:36.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008801c670 con 0x7f00980aa420 2023-10-24T02:03:36.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.971+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00980ad460 con 0x7f00980aa420 2023-10-24T02:03:36.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.972+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00980acc10 con 0x7f00980aa420 2023-10-24T02:03:36.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.972+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f008801c9e0 con 0x7f00980aa420 2023-10-24T02:03:36.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.973+0000 7f008effd700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 0x7f0078061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:36.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.973+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f008807b8a0 con 0x7f00980aa420 2023-10-24T02:03:36.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.973+0000 7f008dd9b700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 0x7f0078061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:36.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.973+0000 7f008dd9b700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 0x7f0078061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f00980adb60 tx=0x7f0080008040).ready entity=mgr.9373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:36.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:36.977+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f008804cc60 con 0x7f00980aa420 2023-10-24T02:03:37.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.164+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f00980ac320 con 0x7f007805f080 2023-10-24T02:03:37.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.169+0000 7f008effd700 1 -- 172.21.15.148:0/969840858 <== mgr.9373 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f00980ac320 con 0x7f007805f080 2023-10-24T02:03:37.170 INFO:teuthology.orchestra.run.smithi148.stdout:Schedule removed for path snap_test_dir1 2023-10-24T02:03:37.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 msgr2=0x7f0078061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 0x7f0078061540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f00980adb60 tx=0x7f0080008040).stop 2023-10-24T02:03:37.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 msgr2=0x7f00980acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f0088009130 tx=0x7f0088017000).stop 2023-10-24T02:03:37.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 shutdown_connections 2023-10-24T02:03:37.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00981544b0 0x7f00980ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00980aa420 0x7f00980acf70 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f007805f080 0x7f0078061540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 --2- 172.21.15.148:0/969840858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00980c8290 0x7f009814dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 >> 172.21.15.148:0/969840858 conn(0x7f00980945d0 msgr2=0x7f00980a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:37.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 shutdown_connections 2023-10-24T02:03:37.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.171+0000 7f009cfee700 1 -- 172.21.15.148:0/969840858 wait complete. 2023-10-24T02:03:37.183 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-24T02:03:37.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:37.184 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-24T02:03:37.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:37.201 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-24T02:03:37.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-24T02:03:37.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.412+0000 7f29c142f700 1 Processor -- start 2023-10-24T02:03:37.413 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.412+0000 7f29c142f700 1 -- start start 2023-10-24T02:03:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29c142f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc14fbb0 0x7f29bc14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29c142f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29bc153300 0x7f29bc0652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29c142f700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc064e20 con 0x7f29bc0a9100 2023-10-24T02:03:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29c142f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc064210 con 0x7f29bc153300 2023-10-24T02:03:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29c142f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0644f0 con 0x7f29bc14fbb0 2023-10-24T02:03:37.416 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29bb7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f29bc153300 0x7f29bc0652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29b27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f29bc0a9100 0x7f29bc0bbb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45920/0 (socket says 172.21.15.148:45920) 2023-10-24T02:03:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.413+0000 7f29b27fc700 1 -- 172.21.15.148:0/148570999 learned_addr learned my addr 172.21.15.148:0/148570999 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29baffd700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc14fbb0 0x7f29bc14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29bb7fe700 1 -- 172.21.15.148:0/148570999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc14fbb0 msgr2=0x7f29bc14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:37.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29bb7fe700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc14fbb0 0x7f29bc14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29bb7fe700 1 -- 172.21.15.148:0/148570999 >> v1:172.21.15.148:6789/0 conn(0x7f29bc0a9100 legacy=0x7f29bc0bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29bb7fe700 1 -- 172.21.15.148:0/148570999 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0647d0 con 0x7f29bc153300 2023-10-24T02:03:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29ba7fc700 1 -- 172.21.15.148:0/148570999 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996641145 0 0) 0x7f29bc064e20 con 0x7f29bc0a9100 2023-10-24T02:03:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29bb7fe700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0652b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f29b4009e60 tx=0x7f29b4009780).ready entity=mon.0 client_cookie=62dbda1b142bd2c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:37.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29ba7fc700 1 -- 172.21.15.148:0/148570999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400e070 con 0x7f29bc153300 2023-10-24T02:03:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29ba7fc700 1 -- 172.21.15.148:0/148570999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400bc30 con 0x7f29bc153300 2023-10-24T02:03:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.414+0000 7f29ba7fc700 1 -- 172.21.15.148:0/148570999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4012410 con 0x7f29bc153300 2023-10-24T02:03:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 -- 172.21.15.148:0/148570999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 msgr2=0x7f29bc0652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0652b0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 rx=0x7f29b4009e60 tx=0x7f29b4009780).stop 2023-10-24T02:03:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 -- 172.21.15.148:0/148570999 shutdown_connections 2023-10-24T02:03:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0652b0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 --2- 172.21.15.148:0/148570999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc14fbb0 0x7f29bc14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 -- 172.21.15.148:0/148570999 >> 172.21.15.148:0/148570999 conn(0x7f29bc0c6bf0 msgr2=0x7f29bc0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 -- 172.21.15.148:0/148570999 shutdown_connections 2023-10-24T02:03:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.415+0000 7f29c142f700 1 -- 172.21.15.148:0/148570999 wait complete. 2023-10-24T02:03:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.416+0000 7f29c142f700 1 Processor -- start 2023-10-24T02:03:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.416+0000 7f29c142f700 1 -- start start 2023-10-24T02:03:37.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc0a9100 0x7f29bc153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29bc14fbb0 0x7f29bc149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0aae30 con 0x7f29bc153300 2023-10-24T02:03:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0ab7a0 con 0x7f29bc14fbb0 2023-10-24T02:03:37.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0aab50 con 0x7f29bc0a9100 2023-10-24T02:03:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46920/0 (socket says 172.21.15.148:46920) 2023-10-24T02:03:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 -- 172.21.15.148:0/3892588220 learned_addr learned my addr 172.21.15.148:0/3892588220 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29baffd700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc0a9100 0x7f29bc153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29b27fc700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29bc14fbb0 0x7f29bc149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 -- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc0a9100 msgr2=0x7f29bc153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc0a9100 0x7f29bc153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 -- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29bc14fbb0 msgr2=0x7f29bc149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29bc14fbb0 0x7f29bc149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 -- 172.21.15.148:0/3892588220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009a20 con 0x7f29bc153300 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29bb7fe700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f29b400b6c0 tx=0x7f29b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4012410 con 0x7f29bc153300 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400b6f0 con 0x7f29bc153300 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0ab150 con 0x7f29bc153300 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.417+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011cb0 con 0x7f29bc153300 2023-10-24T02:03:37.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.418+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc149b10 con 0x7f29bc153300 2023-10-24T02:03:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.418+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc0aafb0 con 0x7f29bc153300 2023-10-24T02:03:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.419+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 101) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f29b4003040 con 0x7f29bc153300 2023-10-24T02:03:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.419+0000 7f29b37fe700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 0x7f299c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.419+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f29b407c040 con 0x7f29bc153300 2023-10-24T02:03:37.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.419+0000 7f29baffd700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 0x7f299c061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.420+0000 7f29baffd700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 0x7f299c061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f29ac00bbc0 tx=0x7f29ac008040).ready entity=mgr.9373 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:37.429 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.423+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29bc0aafb0 con 0x7f29bc153300 2023-10-24T02:03:37.629 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:37.629+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f29bc0aafb0 con 0x7f29bc153300 2023-10-24T02:03:38.139 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.139+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f29b4079f00 con 0x7f29bc153300 2023-10-24T02:03:38.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.140+0000 7f29b37fe700 1 -- 172.21.15.148:0/3892588220 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v102) v1 ==== 93+0+0 (secure 0 0 0) 0x7f29b4041f70 con 0x7f29bc153300 2023-10-24T02:03:38.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 msgr2=0x7f299c061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 0x7f299c061540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f29ac00bbc0 tx=0x7f29ac008040).stop 2023-10-24T02:03:38.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 msgr2=0x7f29bc0a76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7f29b400b6c0 tx=0x7f29b4009780).stop 2023-10-24T02:03:38.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 shutdown_connections 2023-10-24T02:03:38.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f29bc153300 0x7f29bc0a76a0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29bc0a9100 0x7f29bc153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f299c05f080 0x7f299c061540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 --2- 172.21.15.148:0/3892588220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29bc14fbb0 0x7f29bc149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 >> 172.21.15.148:0/3892588220 conn(0x7f29bc0c6bf0 msgr2=0x7f29bc0c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:38.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 shutdown_connections 2023-10-24T02:03:38.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.142+0000 7f29c142f700 1 -- 172.21.15.148:0/3892588220 wait complete. 2023-10-24T02:03:38.157 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-24T02:03:38.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:38.196 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-24T02:03:38.238 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-24T02:03:38.238 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-24T02:03:38.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-24T02:03:38.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-24T02:03:38.285 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:38.283+0000 7f15d1b05680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:38.286 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:38.284+0000 7eff19fcd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-24T02:03:38.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:03:38.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:38.290 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-24T02:03:38.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:38.350 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:38.348+0000 7eff19fcd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:38.350 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:38.350+0000 7f15d1b05680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-24T02:03:38.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.464+0000 7fc696fc3700 1 Processor -- start 2023-10-24T02:03:38.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.464+0000 7fc696fc3700 1 -- start start 2023-10-24T02:03:38.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc696fc3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc6900bfa50 0x7fc690095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc696fc3700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900bf5c0 con 0x7fc6901543a0 2023-10-24T02:03:38.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc696fc3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900a86d0 con 0x7fc690154780 2023-10-24T02:03:38.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc696fc3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900be9b0 con 0x7fc6900bfa50 2023-10-24T02:03:38.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc694d5f700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc6901543a0 0x7fc6900a7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45938/0 (socket says 172.21.15.148:45938) 2023-10-24T02:03:38.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc694d5f700 1 -- 172.21.15.148:0/1010550152 learned_addr learned my addr 172.21.15.148:0/1010550152 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.465+0000 7fc68ffff700 1 --2- 172.21.15.148:0/1010550152 >> v2:172.21.15.150:3300/0 conn(0x7fc6900bfa50 0x7fc690095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613140513 0 0) 0x7fc6900bf5c0 con 0x7fc6901543a0 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6800033f0 con 0x7fc6901543a0 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242962789 0 0) 0x7fc6900a86d0 con 0x7fc690154780 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6900bf5c0 con 0x7fc690154780 2023-10-24T02:03:38.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2206405456 0 0) 0x7fc6800033f0 con 0x7fc6901543a0 2023-10-24T02:03:38.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68ffff700 1 -- 172.21.15.148:0/1010550152 >> v1:172.21.15.150:6789/0 conn(0x7fc690154780 legacy=0x7fc6900a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68ffff700 1 -- 172.21.15.148:0/1010550152 >> v1:172.21.15.148:6789/0 conn(0x7fc6901543a0 legacy=0x7fc6900a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68ffff700 1 -- 172.21.15.148:0/1010550152 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900bec90 con 0x7fc6900bfa50 2023-10-24T02:03:38.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68ffff700 1 --2- 172.21.15.148:0/1010550152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900bfa50 0x7fc690095de0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc67c009760 tx=0x7fc67c009060).ready entity=mon.1 client_cookie=4aad89d1e3b19fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:38.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684001470 con 0x7fc6900bfa50 2023-10-24T02:03:38.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c011400 con 0x7fc6900bfa50 2023-10-24T02:03:38.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.466+0000 7fc68f7fe700 1 -- 172.21.15.148:0/1010550152 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c011780 con 0x7fc6900bfa50 2023-10-24T02:03:38.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 -- 172.21.15.148:0/1010550152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900bfa50 msgr2=0x7fc690095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1010550152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900bfa50 0x7fc690095de0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fc67c009760 tx=0x7fc67c009060).stop 2023-10-24T02:03:38.471 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 -- 172.21.15.148:0/1010550152 shutdown_connections 2023-10-24T02:03:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1010550152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6900bfa50 0x7fc690095de0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 -- 172.21.15.148:0/1010550152 >> 172.21.15.148:0/1010550152 conn(0x7fc6900630f0 msgr2=0x7fc6900c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 -- 172.21.15.148:0/1010550152 shutdown_connections 2023-10-24T02:03:38.472 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.467+0000 7fc696fc3700 1 -- 172.21.15.148:0/1010550152 wait complete. 2023-10-24T02:03:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.468+0000 7fc696fc3700 1 Processor -- start 2023-10-24T02:03:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.468+0000 7fc696fc3700 1 -- start start 2023-10-24T02:03:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900bfa50 0x7fc690152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690154780 0x7fc6901503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ace50 con 0x7fc6901543a0 2023-10-24T02:03:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901537b0 con 0x7fc690154780 2023-10-24T02:03:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc696fc3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ad0c0 con 0x7fc6900bfa50 2023-10-24T02:03:38.476 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46942/0 (socket says 172.21.15.148:46942) 2023-10-24T02:03:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 -- 172.21.15.148:0/1326554969 learned_addr learned my addr 172.21.15.148:0/1326554969 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc695560700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690154780 0x7fc6901503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc694d5f700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900bfa50 0x7fc690152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900bfa50 msgr2=0x7fc690152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900bfa50 0x7fc690152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690154780 msgr2=0x7fc6901503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690154780 0x7fc6901503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 -- 172.21.15.148:0/1326554969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0092a0 con 0x7fc6901543a0 2023-10-24T02:03:38.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.469+0000 7fc68ffff700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fc67c010000 tx=0x7fc67c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.470+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c010740 con 0x7fc6901543a0 2023-10-24T02:03:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.470+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c0108a0 con 0x7fc6901543a0 2023-10-24T02:03:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.470+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900ad3a0 con 0x7fc6901543a0 2023-10-24T02:03:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.470+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c010c40 con 0x7fc6901543a0 2023-10-24T02:03:38.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.470+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc690153a90 con 0x7fc6901543a0 2023-10-24T02:03:38.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690153c80 con 0x7fc6901543a0 2023-10-24T02:03:38.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc67c027460 con 0x7fc6901543a0 2023-10-24T02:03:38.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc68cff9700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 0x7fc674061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc694d5f700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 msgr2=0x7fc674061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:38.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fc67c07b990 con 0x7fc6901543a0 2023-10-24T02:03:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.471+0000 7fc694d5f700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 0x7fc674061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:38.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.476+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc67c04c920 con 0x7fc6901543a0 2023-10-24T02:03:38.625 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:38.623+0000 7eff19fcd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:38.637 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:38.637+0000 7f15d1b05680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-24T02:03:38.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.672+0000 7fc694d5f700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 msgr2=0x7fc674061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:38.672 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.672+0000 7fc694d5f700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 0x7fc674061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:38.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.688+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6900ad5e0 con 0x7fc6901543a0 2023-10-24T02:03:38.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.689+0000 7fc68cff9700 1 -- 172.21.15.148:0/1326554969 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7fc6900ad5e0 con 0x7fc6901543a0 2023-10-24T02:03:38.690 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:38.690 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:38.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 msgr2=0x7fc674061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:38.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 0x7fc674061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:38.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 msgr2=0x7fc69014eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fc67c010000 tx=0x7fc67c016000).stop 2023-10-24T02:03:38.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 shutdown_connections 2023-10-24T02:03:38.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc67405f2d0 0x7fc674061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc690154780 0x7fc6901503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6900bfa50 0x7fc690152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 --2- 172.21.15.148:0/1326554969 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6901543a0 0x7fc69014eb20 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.691+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 >> 172.21.15.148:0/1326554969 conn(0x7fc6900630f0 msgr2=0x7fc6900c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.692+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 shutdown_connections 2023-10-24T02:03:38.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.692+0000 7fc696fc3700 1 -- 172.21.15.148:0/1326554969 wait complete. 2023-10-24T02:03:38.697 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:38.705 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:38.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.861+0000 7faf2a0bd700 1 Processor -- start 2023-10-24T02:03:38.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.861+0000 7faf2a0bd700 1 -- start start 2023-10-24T02:03:38.863 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf2a0bd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf240c7d20 0x7faf240a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf2a0bd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf2a0bd700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240a6a50 con 0x7faf240c86c0 2023-10-24T02:03:38.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf2a0bd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240bf350 con 0x7faf240c7d20 2023-10-24T02:03:38.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf2a0bd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240a8750 con 0x7faf240a6550 2023-10-24T02:03:38.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7faf240c7d20 0x7faf240a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf237fe700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7faf240c86c0 0x7faf240bec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45940/0 (socket says 172.21.15.148:45940) 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf237fe700 1 -- 172.21.15.148:0/1666125390 learned_addr learned my addr 172.21.15.148:0/1666125390 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf23fff700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 -- 172.21.15.148:0/1666125390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 msgr2=0x7faf240a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 -- 172.21.15.148:0/1666125390 >> v1:172.21.15.148:6789/0 conn(0x7faf240c86c0 legacy=0x7faf240bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 -- 172.21.15.148:0/1666125390 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240a6d30 con 0x7faf240c7d20 2023-10-24T02:03:38.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf227fc700 1 -- 172.21.15.148:0/1666125390 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800066218 0 0) 0x7faf240a6a50 con 0x7faf240c86c0 2023-10-24T02:03:38.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf23fff700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:38.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf22ffd700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c7d20 0x7faf240a7d70 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7faf18009760 tx=0x7faf18009060).ready entity=mon.0 client_cookie=c44fa98202c7df6f server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:38.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf227fc700 1 -- 172.21.15.148:0/1666125390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800b580 con 0x7faf240c7d20 2023-10-24T02:03:38.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf227fc700 1 -- 172.21.15.148:0/1666125390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800b6e0 con 0x7faf240c7d20 2023-10-24T02:03:38.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.862+0000 7faf227fc700 1 -- 172.21.15.148:0/1666125390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800ba60 con 0x7faf240c7d20 2023-10-24T02:03:38.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 -- 172.21.15.148:0/1666125390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c7d20 msgr2=0x7faf240a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c7d20 0x7faf240a7d70 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7faf18009760 tx=0x7faf18009060).stop 2023-10-24T02:03:38.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 -- 172.21.15.148:0/1666125390 shutdown_connections 2023-10-24T02:03:38.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/1666125390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c7d20 0x7faf240a7d70 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 -- 172.21.15.148:0/1666125390 >> 172.21.15.148:0/1666125390 conn(0x7faf24092480 msgr2=0x7faf24062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:38.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 -- 172.21.15.148:0/1666125390 shutdown_connections 2023-10-24T02:03:38.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.863+0000 7faf2a0bd700 1 -- 172.21.15.148:0/1666125390 wait complete. 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.864+0000 7faf2a0bd700 1 Processor -- start 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.864+0000 7faf2a0bd700 1 -- start start 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf240c7d20 0x7faf240adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240a9310 con 0x7faf240c86c0 2023-10-24T02:03:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240c1940 con 0x7faf240c7d20 2023-10-24T02:03:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf2a0bd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240c10a0 con 0x7faf240a6550 2023-10-24T02:03:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf23fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf23fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46956/0 (socket says 172.21.15.148:46956) 2023-10-24T02:03:38.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf23fff700 1 -- 172.21.15.148:0/315762901 learned_addr learned my addr 172.21.15.148:0/315762901 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf237fe700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.865+0000 7faf22ffd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf240c7d20 0x7faf240adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 -- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 msgr2=0x7faf240c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240c0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 -- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf240c7d20 msgr2=0x7faf240adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:38.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf240c7d20 0x7faf240adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 -- 172.21.15.148:0/315762901 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180092a0 con 0x7faf240c86c0 2023-10-24T02:03:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf23fff700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7faf1c007f60 tx=0x7faf1c009950).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00db80 con 0x7faf240c86c0 2023-10-24T02:03:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00f040 con 0x7faf240c86c0 2023-10-24T02:03:38.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf240c1380 con 0x7faf240c86c0 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0133f0 con 0x7faf240c86c0 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.866+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf240a95c0 con 0x7faf240c86c0 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.867+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2406c6b0 con 0x7faf240c86c0 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.867+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7faf1c0137e0 con 0x7faf240c86c0 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.868+0000 7faf0b7fe700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 0x7faf100617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:38.875 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.868+0000 7faf237fe700 1 -- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 msgr2=0x7faf100617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:38.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.868+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7faf1c07ad10 con 0x7faf240c86c0 2023-10-24T02:03:38.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.868+0000 7faf237fe700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 0x7faf100617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:38.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:38.872+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7faf1c04bb90 con 0x7faf240c86c0 2023-10-24T02:03:39.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.043+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf240a7010 con 0x7faf240c86c0 2023-10-24T02:03:39.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.044+0000 7faf0b7fe700 1 -- 172.21.15.148:0/315762901 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+17311 (secure 0 0 0) 0x7faf1c04f1b0 con 0x7faf240c86c0 2023-10-24T02:03:39.044 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:39.045 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":217,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:35.125406+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:6832/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/1638296492":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/2328274838":"2023-10-25T02:03:35.125379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:39.046 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 msgr2=0x7faf100617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:39.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 0x7faf100617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 msgr2=0x7faf2414f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7faf1c007f60 tx=0x7faf1c009950).stop 2023-10-24T02:03:39.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 shutdown_connections 2023-10-24T02:03:39.047 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf240c86c0 0x7faf2414f590 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faf240a6550 0x7faf240c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7faf1005f300 0x7faf100617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 --2- 172.21.15.148:0/315762901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf240c7d20 0x7faf240adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 >> 172.21.15.148:0/315762901 conn(0x7faf24092480 msgr2=0x7faf240be510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 shutdown_connections 2023-10-24T02:03:39.048 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.046+0000 7faf2a0bd700 1 -- 172.21.15.148:0/315762901 wait complete. 2023-10-24T02:03:39.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-24T00:28:44.809617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '207', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-24T00:28:47.085137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-24T02:03:17.866376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '215', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-10-24T02:03:18.314792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '216', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-24T02:03:39.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-24T02:03:39.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.180+0000 7f411baeb700 1 Processor -- start 2023-10-24T02:03:39.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.180+0000 7f411baeb700 1 -- start start 2023-10-24T02:03:39.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411baeb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411baeb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41140c65f0 0x7f41140c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411baeb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4114063760 con 0x7f41140be570 2023-10-24T02:03:39.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411baeb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41140bf110 con 0x7f41140c65f0 2023-10-24T02:03:39.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411baeb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4114154b50 con 0x7f41140c6210 2023-10-24T02:03:39.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f4119086700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f41140c65f0 0x7f41140c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411a088700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f41140be570 0x7f41140bea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45954/0 (socket says 172.21.15.148:45954) 2023-10-24T02:03:39.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f411a088700 1 -- 172.21.15.148:0/3525448884 learned_addr learned my addr 172.21.15.148:0/3525448884 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:39.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.181+0000 7f4119887700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4119086700 1 -- 172.21.15.148:0/3525448884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 msgr2=0x7f41140c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:39.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4119086700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4119086700 1 -- 172.21.15.148:0/3525448884 >> v1:172.21.15.148:6789/0 conn(0x7f41140be570 legacy=0x7f41140bea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4118885700 1 -- 172.21.15.148:0/3525448884 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182829333 0 0) 0x7f4114063760 con 0x7f41140be570 2023-10-24T02:03:39.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4119086700 1 -- 172.21.15.148:0/3525448884 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41140c4be0 con 0x7f41140c65f0 2023-10-24T02:03:39.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4119086700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f41140c46f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f4110009790 tx=0x7f4110009060).ready entity=mon.0 client_cookie=c1750c84d140c2ba server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4118885700 1 -- 172.21.15.148:0/3525448884 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000f510 con 0x7f41140c65f0 2023-10-24T02:03:39.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4118885700 1 -- 172.21.15.148:0/3525448884 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000f670 con 0x7f41140c65f0 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.182+0000 7f4118885700 1 -- 172.21.15.148:0/3525448884 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000f9f0 con 0x7f41140c65f0 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 -- 172.21.15.148:0/3525448884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 msgr2=0x7f41140c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f41140c46f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 rx=0x7f4110009790 tx=0x7f4110009060).stop 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 -- 172.21.15.148:0/3525448884 shutdown_connections 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 --2- 172.21.15.148:0/3525448884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f41140c46f0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 -- 172.21.15.148:0/3525448884 >> 172.21.15.148:0/3525448884 conn(0x7f4114092510 msgr2=0x7f4114062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 -- 172.21.15.148:0/3525448884 shutdown_connections 2023-10-24T02:03:39.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.183+0000 7f411baeb700 1 -- 172.21.15.148:0/3525448884 wait complete. 2023-10-24T02:03:39.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.184+0000 7f411baeb700 1 Processor -- start 2023-10-24T02:03:39.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.184+0000 7f411baeb700 1 -- start start 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 0x7f4114067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c0440 con 0x7f41140c65f0 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c0710 con 0x7f41140be570 2023-10-24T02:03:39.191 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c09f0 con 0x7f41140c6210 2023-10-24T02:03:39.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4119086700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46970/0 (socket says 172.21.15.148:46970) 2023-10-24T02:03:39.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 -- 172.21.15.148:0/1213933378 learned_addr learned my addr 172.21.15.148:0/1213933378 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:39.192 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4119887700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 0x7f4114067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 msgr2=0x7f41140bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 msgr2=0x7f4114067290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 0x7f4114067290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 -- 172.21.15.148:0/1213933378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100092a0 con 0x7f41140c65f0 2023-10-24T02:03:39.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4119887700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 0x7f4114067290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:39.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411a088700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f410c00c810 tx=0x7f410c0014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c005d30 con 0x7f41140c65f0 2023-10-24T02:03:39.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c005e90 con 0x7f41140c65f0 2023-10-24T02:03:39.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41140c0cd0 con 0x7f41140c65f0 2023-10-24T02:03:39.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.185+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0072e0 con 0x7f41140c65f0 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.186+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41140c1290 con 0x7f41140c65f0 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.187+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411406c6b0 con 0x7f41140c65f0 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.187+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f410c007710 con 0x7f41140c65f0 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.188+0000 7f4109ffb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 0x7f40f80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.188+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f410c079fe0 con 0x7f41140c65f0 2023-10-24T02:03:39.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.188+0000 7f4119887700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 msgr2=0x7f40f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:39.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.188+0000 7f4119887700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 0x7f40f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:39.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.192+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f410c04aed0 con 0x7f41140c65f0 2023-10-24T02:03:39.243 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:39.243+0000 7eff19fcd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:39.281 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:39.280+0000 7f15d1b05680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-24T02:03:39.315 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:39.315+0000 7eff19fcd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:39.354 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:39.354+0000 7f15d1b05680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-24T02:03:39.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.389+0000 7f4119887700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 msgr2=0x7f40f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:39.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.389+0000 7f4119887700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 0x7f40f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:39.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.395+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41140612f0 con 0x7f41140c65f0 2023-10-24T02:03:39.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.395+0000 7f4109ffb700 1 -- 172.21.15.148:0/1213933378 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v217) v1 ==== 110+0+10 (secure 0 0 0) 0x7f410c04e4f0 con 0x7f41140c65f0 2023-10-24T02:03:39.396 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2023-10-24T02:03:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 msgr2=0x7f40f80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:39.398 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 0x7f40f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 msgr2=0x7f411414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f410c00c810 tx=0x7f410c0014d0).stop 2023-10-24T02:03:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 shutdown_connections 2023-10-24T02:03:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41140c65f0 0x7f411414bed0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.399 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f40f805f300 0x7f40f80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140be570 0x7f4114067290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 --2- 172.21.15.148:0/1213933378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41140c6210 0x7f41140bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 >> 172.21.15.148:0/1213933378 conn(0x7f4114092510 msgr2=0x7f41140c8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 shutdown_connections 2023-10-24T02:03:39.400 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.397+0000 7f411baeb700 1 -- 172.21.15.148:0/1213933378 wait complete. 2023-10-24T02:03:39.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-24T02:03:39.502 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:39.502+0000 7eff19fcd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:39.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.532+0000 7fe9f11a6700 1 Processor -- start 2023-10-24T02:03:39.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.532+0000 7fe9f11a6700 1 -- start start 2023-10-24T02:03:39.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9f11a6700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9ec150ec0 0x7fe9ec06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9f11a6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe9ec0bd860 0x7fe9ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9f11a6700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec065590 con 0x7fe9ec1512a0 2023-10-24T02:03:39.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9f11a6700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec065290 con 0x7fe9ec150ec0 2023-10-24T02:03:39.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9f11a6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0bdd50 con 0x7fe9ec0bd860 2023-10-24T02:03:39.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9ec150ec0 0x7fe9ec06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fe9ec150ec0 0x7fe9ec06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46972/0 (socket says 172.21.15.148:46972) 2023-10-24T02:03:39.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 -- 172.21.15.148:0/3765252215 learned_addr learned my addr 172.21.15.148:0/3765252215 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:39.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ea59c700 1 --2- 172.21.15.148:0/3765252215 >> v2:172.21.15.150:3300/0 conn(0x7fe9ec0bd860 0x7fe9ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 -- 172.21.15.148:0/3765252215 >> v2:172.21.15.150:3300/0 conn(0x7fe9ec0bd860 msgr2=0x7fe9ec069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:39.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 --2- 172.21.15.148:0/3765252215 >> v2:172.21.15.150:3300/0 conn(0x7fe9ec0bd860 0x7fe9ec069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.533+0000 7fe9ead9d700 1 -- 172.21.15.148:0/3765252215 >> v1:172.21.15.150:6789/0 conn(0x7fe9ec1512a0 legacy=0x7fe9ec0c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9ead9d700 1 -- 172.21.15.148:0/3765252215 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0be030 con 0x7fe9ec150ec0 2023-10-24T02:03:39.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9ead9d700 1 --2- 172.21.15.148:0/3765252215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec06a160 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fe9ec0bed60 tx=0x7fe9dc0090f0).ready entity=mon.0 client_cookie=8062636c75535073 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9e9d9b700 1 -- 172.21.15.148:0/3765252215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00b520 con 0x7fe9ec150ec0 2023-10-24T02:03:39.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9e9d9b700 1 -- 172.21.15.148:0/3765252215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00b680 con 0x7fe9ec150ec0 2023-10-24T02:03:39.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9e9d9b700 1 -- 172.21.15.148:0/3765252215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00ba00 con 0x7fe9ec150ec0 2023-10-24T02:03:39.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 -- 172.21.15.148:0/3765252215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec150ec0 msgr2=0x7fe9ec06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/3765252215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec06a160 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fe9ec0bed60 tx=0x7fe9dc0090f0).stop 2023-10-24T02:03:39.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 -- 172.21.15.148:0/3765252215 shutdown_connections 2023-10-24T02:03:39.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/3765252215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec06a160 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.539 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/3765252215 >> v2:172.21.15.150:3300/0 conn(0x7fe9ec0bd860 0x7fe9ec069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 -- 172.21.15.148:0/3765252215 >> 172.21.15.148:0/3765252215 conn(0x7fe9ec0c7d10 msgr2=0x7fe9ec0c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 -- 172.21.15.148:0/3765252215 shutdown_connections 2023-10-24T02:03:39.540 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.534+0000 7fe9f11a6700 1 -- 172.21.15.148:0/3765252215 wait complete. 2023-10-24T02:03:39.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.536+0000 7fe9f11a6700 1 Processor -- start 2023-10-24T02:03:39.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.536+0000 7fe9f11a6700 1 -- start start 2023-10-24T02:03:39.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.536+0000 7fe9f11a6700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9ec0bd860 0x7fe9ec14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0ac760 con 0x7fe9ec1512a0 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0abb50 con 0x7fe9ec150ec0 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0abe30 con 0x7fe9ec0bd860 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.544 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9ea59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46980/0 (socket says 172.21.15.148:46980) 2023-10-24T02:03:39.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 -- 172.21.15.148:0/82068735 learned_addr learned my addr 172.21.15.148:0/82068735 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:39.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9ead9d700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9ec0bd860 0x7fe9ec14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 -- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9ec0bd860 msgr2=0x7fe9ec14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9ec0bd860 0x7fe9ec14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 -- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 msgr2=0x7fe9ec0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec0ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 -- 172.21.15.148:0/82068735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009370 con 0x7fe9ec1512a0 2023-10-24T02:03:39.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9ea59c700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:39.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9eb59e700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7fe9e400c7c0 tx=0x7fe9e4001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e4a0 con 0x7fe9ec1512a0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400e600 con 0x7fe9ec1512a0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0ac110 con 0x7fe9ec1512a0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e980 con 0x7fe9ec1512a0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.537+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0ab7b0 con 0x7fe9ec1512a0 2023-10-24T02:03:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.538+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec06c6b0 con 0x7fe9ec1512a0 2023-10-24T02:03:39.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.539+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe9e4012400 con 0x7fe9ec1512a0 2023-10-24T02:03:39.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.539+0000 7fe9d2ffd700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 0x7fe9d8061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.539+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fe9e4079b50 con 0x7fe9ec1512a0 2023-10-24T02:03:39.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.539+0000 7fe9ead9d700 1 -- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 msgr2=0x7fe9d8061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:39.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.539+0000 7fe9ead9d700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 0x7fe9d8061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:39.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.543+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe9e4048af0 con 0x7fe9ec1512a0 2023-10-24T02:03:39.552 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:39.552+0000 7f15d1b05680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-24T02:03:39.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.714+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9ec0be310 con 0x7fe9ec1512a0 2023-10-24T02:03:39.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.715+0000 7fe9d2ffd700 1 -- 172.21.15.148:0/82068735 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v217) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9e404ab90 con 0x7fe9ec1512a0 2023-10-24T02:03:39.716 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 8 2023-10-24T02:03:39.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 msgr2=0x7fe9d8061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:39.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 0x7fe9d8061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 msgr2=0x7fe9ec0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.718 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7fe9e400c7c0 tx=0x7fe9e4001560).stop 2023-10-24T02:03:39.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 shutdown_connections 2023-10-24T02:03:39.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9ec1512a0 0x7fe9ec0ad780 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe9ec0bd860 0x7fe9ec14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe9d805f2d0 0x7fe9d8061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:39.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 --2- 172.21.15.148:0/82068735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9ec150ec0 0x7fe9ec0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 >> 172.21.15.148:0/82068735 conn(0x7fe9ec0c7d10 msgr2=0x7fe9ec0a5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 shutdown_connections 2023-10-24T02:03:39.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.717+0000 7fe9f11a6700 1 -- 172.21.15.148:0/82068735 wait complete. 2023-10-24T02:03:39.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-24T02:03:39.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 Processor -- start 2023-10-24T02:03:39.855 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 -- start start 2023-10-24T02:03:39.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0e7c064b30 0x7f0e7c064f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e7c068af0 0x7f0e7c150080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c069de0 con 0x7f0e7c06a270 2023-10-24T02:03:39.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c068f80 con 0x7f0e7c068af0 2023-10-24T02:03:39.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.854+0000 7f0e8169a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0691d0 con 0x7f0e7c064b30 2023-10-24T02:03:39.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f0e7c068af0 0x7f0e7c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7a7fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0e7c06a270 0x7f0e7c154cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45956/0 (socket says 172.21.15.148:45956) 2023-10-24T02:03:39.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7a7fc700 1 -- 172.21.15.148:0/876793382 learned_addr learned my addr 172.21.15.148:0/876793382 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:39.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7affd700 1 --2- 172.21.15.148:0/876793382 >> v2:172.21.15.150:3300/0 conn(0x7f0e7c064b30 0x7f0e7c064f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 -- 172.21.15.148:0/876793382 >> v2:172.21.15.150:3300/0 conn(0x7f0e7c064b30 msgr2=0x7f0e7c064f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 --2- 172.21.15.148:0/876793382 >> v2:172.21.15.150:3300/0 conn(0x7f0e7c064b30 0x7f0e7c064f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 -- 172.21.15.148:0/876793382 >> v1:172.21.15.148:6789/0 conn(0x7f0e7c06a270 legacy=0x7f0e7c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e79ffb700 1 -- 172.21.15.148:0/876793382 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571676726 0 0) 0x7f0e7c069de0 con 0x7f0e7c06a270 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 -- 172.21.15.148:0/876793382 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0694b0 con 0x7f0e7c068af0 2023-10-24T02:03:39.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e7b7fe700 1 --2- 172.21.15.148:0/876793382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c068af0 0x7f0e7c150080 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f0e7c0c6b00 tx=0x7f0e74009780).ready entity=mon.0 client_cookie=2aa67b7a054fce50 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e79ffb700 1 -- 172.21.15.148:0/876793382 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400e070 con 0x7f0e7c068af0 2023-10-24T02:03:39.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e79ffb700 1 -- 172.21.15.148:0/876793382 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400bb60 con 0x7f0e7c068af0 2023-10-24T02:03:39.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.855+0000 7f0e79ffb700 1 -- 172.21.15.148:0/876793382 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74012410 con 0x7f0e7c068af0 2023-10-24T02:03:39.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 -- 172.21.15.148:0/876793382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c068af0 msgr2=0x7f0e7c150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 --2- 172.21.15.148:0/876793382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c068af0 0x7f0e7c150080 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f0e7c0c6b00 tx=0x7f0e74009780).stop 2023-10-24T02:03:39.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 -- 172.21.15.148:0/876793382 shutdown_connections 2023-10-24T02:03:39.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 --2- 172.21.15.148:0/876793382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c068af0 0x7f0e7c150080 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 --2- 172.21.15.148:0/876793382 >> v2:172.21.15.150:3300/0 conn(0x7f0e7c064b30 0x7f0e7c064f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 -- 172.21.15.148:0/876793382 >> 172.21.15.148:0/876793382 conn(0x7f0e7c0c6bf0 msgr2=0x7f0e7c0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:39.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 -- 172.21.15.148:0/876793382 shutdown_connections 2023-10-24T02:03:39.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.856+0000 7f0e8169a700 1 -- 172.21.15.148:0/876793382 wait complete. 2023-10-24T02:03:39.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.857+0000 7f0e8169a700 1 Processor -- start 2023-10-24T02:03:39.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.857+0000 7f0e8169a700 1 -- start start 2023-10-24T02:03:39.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.864 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7c068af0 0x7f0e7c0aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 0x7f0e7c0be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0bdc90 con 0x7f0e7c064b30 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0be250 con 0x7f0e7c0ab040 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e8169a700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0ab610 con 0x7f0e7c068af0 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.865 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46992/0 (socket says 172.21.15.148:46992) 2023-10-24T02:03:39.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e7affd700 1 -- 172.21.15.148:0/844760378 learned_addr learned my addr 172.21.15.148:0/844760378 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:39.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e7b7fe700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 0x7f0e7c0be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.858+0000 7f0e7a7fc700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7c068af0 0x7f0e7c0aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:39.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 -- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7c068af0 msgr2=0x7f0e7c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7c068af0 0x7f0e7c0aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 -- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 msgr2=0x7f0e7c0be6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:39.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 0x7f0e7c0be6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:39.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 -- 172.21.15.148:0/844760378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74009a20 con 0x7f0e7c064b30 2023-10-24T02:03:39.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7b7fe700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 0x7f0e7c0be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:39.867 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e7affd700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f0e6c00e950 tx=0x7f0e6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c009530 con 0x7f0e7c064b30 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c012600 con 0x7f0e7c064b30 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c0ab8f0 con 0x7f0e7c064b30 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c012980 con 0x7f0e7c064b30 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.859+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0ac430 con 0x7f0e7c064b30 2023-10-24T02:03:39.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.860+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c0a8c80 con 0x7f0e7c064b30 2023-10-24T02:03:39.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.861+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0e6c01b400 con 0x7f0e7c064b30 2023-10-24T02:03:39.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.861+0000 7f0e62ffd700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 0x7f0e680617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:39.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.861+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f0e6c07aa60 con 0x7f0e7c064b30 2023-10-24T02:03:39.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.861+0000 7f0e7a7fc700 1 -- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 msgr2=0x7f0e680617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:39.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.861+0000 7f0e7a7fc700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 0x7f0e680617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:39.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:39.866+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0e6c04bb00 con 0x7f0e7c064b30 2023-10-24T02:03:39.928 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:39.928+0000 7eff19fcd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:39.996 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:39.996+0000 7f15d1b05680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-24T02:03:40.033 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.032+0000 7eff19fcd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:40.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.035+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e7c0beff0 con 0x7f0e7c064b30 2023-10-24T02:03:40.036 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.035+0000 7f0e62ffd700 1 -- 172.21.15.148:0/844760378 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v217) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e6c012db0 con 0x7f0e7c064b30 2023-10-24T02:03:40.036 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:03:40.038 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 msgr2=0x7f0e680617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 0x7f0e680617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.039 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 msgr2=0x7f0e7c14e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7f0e6c00e950 tx=0x7f0e6c009060).stop 2023-10-24T02:03:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 shutdown_connections 2023-10-24T02:03:40.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0e6805f300 0x7f0e680617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e7c0ab040 0x7f0e7c0be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0e7c064b30 0x7f0e7c14e860 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 --2- 172.21.15.148:0/844760378 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e7c068af0 0x7f0e7c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.041 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 >> 172.21.15.148:0/844760378 conn(0x7f0e7c0c6bf0 msgr2=0x7f0e7c0c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 shutdown_connections 2023-10-24T02:03:40.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.037+0000 7f0e8169a700 1 -- 172.21.15.148:0/844760378 wait complete. 2023-10-24T02:03:40.050 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-24T02:03:40.106 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.106+0000 7f15d1b05680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:40.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.170+0000 7f0dc5011700 1 Processor -- start 2023-10-24T02:03:40.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.170+0000 7f0dc5011700 1 -- start start 2023-10-24T02:03:40.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dc5011700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 0x7f0dc00c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dc5011700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 0x7f0dc00bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dc5011700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00bcc80 con 0x7f0dc0150f60 2023-10-24T02:03:40.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dc5011700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc006a520 con 0x7f0dc00c3370 2023-10-24T02:03:40.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dc5011700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00c3af0 con 0x7f0dc0069b30 2023-10-24T02:03:40.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 0x7f0dc00c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbf59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 0x7f0dc00bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbed9d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f0dc0150f60 0x7f0dc0069420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56056/0 (socket says 172.21.15.148:56056) 2023-10-24T02:03:40.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbed9d700 1 -- 172.21.15.148:0/3067211470 learned_addr learned my addr 172.21.15.148:0/3067211470 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:40.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbdd9b700 1 -- 172.21.15.148:0/3067211470 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255918191 0 0) 0x7f0dc00bcc80 con 0x7f0dc0150f60 2023-10-24T02:03:40.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbdd9b700 1 -- 172.21.15.148:0/3067211470 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da80033f0 con 0x7f0dc0150f60 2023-10-24T02:03:40.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3067211470 >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 msgr2=0x7f0dc00bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:40.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 --2- 172.21.15.148:0/3067211470 >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 0x7f0dc00bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3067211470 >> v1:172.21.15.150:6789/0 conn(0x7f0dc0150f60 legacy=0x7f0dc0069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3067211470 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00c3dd0 con 0x7f0dc0069b30 2023-10-24T02:03:40.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbf59e700 1 --2- 172.21.15.148:0/3067211470 >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 0x7f0dc00bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.171+0000 7f0dbe59c700 1 --2- 172.21.15.148:0/3067211470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 0x7f0dc00c2e80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f0db4009760 tx=0x7f0db4009060).ready entity=mon.2 client_cookie=7bf0b4f8803140b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dbdd9b700 1 -- 172.21.15.148:0/3067211470 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40090d0 con 0x7f0dc0069b30 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dbdd9b700 1 -- 172.21.15.148:0/3067211470 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400d4a0 con 0x7f0dc0069b30 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dbdd9b700 1 -- 172.21.15.148:0/3067211470 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400d820 con 0x7f0dc0069b30 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 -- 172.21.15.148:0/3067211470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 msgr2=0x7f0dc00c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3067211470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 0x7f0dc00c2e80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f0db4009760 tx=0x7f0db4009060).stop 2023-10-24T02:03:40.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 -- 172.21.15.148:0/3067211470 shutdown_connections 2023-10-24T02:03:40.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3067211470 >> v2:172.21.15.150:3300/0 conn(0x7f0dc00c3370 0x7f0dc00bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3067211470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0069b30 0x7f0dc00c2e80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.178 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 -- 172.21.15.148:0/3067211470 >> 172.21.15.148:0/3067211470 conn(0x7f0dc00c7d20 msgr2=0x7f0dc00c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 -- 172.21.15.148:0/3067211470 shutdown_connections 2023-10-24T02:03:40.179 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.172+0000 7f0dc5011700 1 -- 172.21.15.148:0/3067211470 wait complete. 2023-10-24T02:03:40.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 Processor -- start 2023-10-24T02:03:40.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 -- start start 2023-10-24T02:03:40.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 0x7f0dc00acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 0x7f0dc00bd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00a8310 con 0x7f0dc00c3370 2023-10-24T02:03:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0168610 con 0x7f0dc0069b30 2023-10-24T02:03:40.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.174+0000 7f0dc5011700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc01688f0 con 0x7f0dc0150f60 2023-10-24T02:03:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47002/0 (socket says 172.21.15.148:47002) 2023-10-24T02:03:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3212677539 learned_addr learned my addr 172.21.15.148:0/3212677539 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbf59e700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 0x7f0dc00bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbed9d700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 0x7f0dc00acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 msgr2=0x7f0dc00bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 0x7f0dc00bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 msgr2=0x7f0dc00acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 0x7f0dc00acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 -- 172.21.15.148:0/3212677539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009a20 con 0x7f0dc00c3370 2023-10-24T02:03:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbed9d700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 0x7f0dc00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbf59e700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 0x7f0dc00bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dbe59c700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f0dc00c3c30 tx=0x7f0db4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4006990 con 0x7f0dc00c3370 2023-10-24T02:03:40.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4012920 con 0x7f0dc00c3370 2023-10-24T02:03:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db40092a0 con 0x7f0dc00c3370 2023-10-24T02:03:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4012ca0 con 0x7f0dc00c3370 2023-10-24T02:03:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.175+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc0168eb0 con 0x7f0dc00c3370 2023-10-24T02:03:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.176+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc00a6a70 con 0x7f0dc00c3370 2023-10-24T02:03:40.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.177+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0db401c630 con 0x7f0dc00c3370 2023-10-24T02:03:40.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.177+0000 7f0da6ffd700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 0x7f0dac0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.177+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f0db407b930 con 0x7f0dc00c3370 2023-10-24T02:03:40.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.177+0000 7f0dbed9d700 1 -- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 msgr2=0x7f0dac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:40.187 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.177+0000 7f0dbed9d700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 0x7f0dac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:40.188 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.187+0000 7eff19fcd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:40.188 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.182+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0db404c920 con 0x7f0dc00c3370 2023-10-24T02:03:40.262 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.262+0000 7eff19fcd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:40.268 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.268+0000 7f15d1b05680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:40.330 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.330+0000 7eff19fcd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:40.345 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.345+0000 7f15d1b05680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-24T02:03:40.355 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.355+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dc006c6b0 con 0x7f0dc00c3370 2023-10-24T02:03:40.356 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.355+0000 7f0da6ffd700 1 -- 172.21.15.148:0/3212677539 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v217) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0db404ff40 con 0x7f0dc00c3370 2023-10-24T02:03:40.356 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 64 2023-10-24T02:03:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 msgr2=0x7f0dac0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:40.358 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 0x7f0dac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 msgr2=0x7f0dc013b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f0dc00c3c30 tx=0x7f0db4016000).stop 2023-10-24T02:03:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 shutdown_connections 2023-10-24T02:03:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0dc0150f60 0x7f0dc00bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.359 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0dac05f300 0x7f0dac0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0dc0069b30 0x7f0dc00acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 --2- 172.21.15.148:0/3212677539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dc00c3370 0x7f0dc013b580 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 >> 172.21.15.148:0/3212677539 conn(0x7f0dc00c7d20 msgr2=0x7f0dc00a5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 shutdown_connections 2023-10-24T02:03:40.360 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.357+0000 7f0dc5011700 1 -- 172.21.15.148:0/3212677539 wait complete. 2023-10-24T02:03:40.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:40.418 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.418+0000 7f15d1b05680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-24T02:03:40.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.487+0000 7fd913326700 1 Processor -- start 2023-10-24T02:03:40.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.487+0000 7fd913326700 1 -- start start 2023-10-24T02:03:40.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd913326700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 0x7fd90c0a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd913326700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 0x7fd90c151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd913326700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c06a160 con 0x7fd90c062810 2023-10-24T02:03:40.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd913326700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c0650f0 con 0x7fd90c0a6d50 2023-10-24T02:03:40.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd913326700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c069550 con 0x7fd90c062bf0 2023-10-24T02:03:40.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd912b25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 0x7fd90c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd911b23700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 0x7fd90c0a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd912324700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd90c062810 0x7fd90c1554c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56064/0 (socket says 172.21.15.148:56064) 2023-10-24T02:03:40.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.488+0000 7fd912324700 1 -- 172.21.15.148:0/1360486009 learned_addr learned my addr 172.21.15.148:0/1360486009 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:40.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911322700 1 -- 172.21.15.148:0/1360486009 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047706064 0 0) 0x7fd90c06a160 con 0x7fd90c062810 2023-10-24T02:03:40.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911322700 1 -- 172.21.15.148:0/1360486009 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f80033f0 con 0x7fd90c062810 2023-10-24T02:03:40.492 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911b23700 1 -- 172.21.15.148:0/1360486009 >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 msgr2=0x7fd90c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911b23700 1 --2- 172.21.15.148:0/1360486009 >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 0x7fd90c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911b23700 1 -- 172.21.15.148:0/1360486009 >> v1:172.21.15.150:6789/0 conn(0x7fd90c062810 legacy=0x7fd90c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911b23700 1 -- 172.21.15.148:0/1360486009 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c069830 con 0x7fd90c062bf0 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd912b25700 1 --2- 172.21.15.148:0/1360486009 >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 0x7fd90c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911b23700 1 --2- 172.21.15.148:0/1360486009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 0x7fd90c0a6860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fd908009760 tx=0x7fd908009060).ready entity=mon.2 client_cookie=db6f3f61db9ae9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.493 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911322700 1 -- 172.21.15.148:0/1360486009 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800d4a0 con 0x7fd90c062bf0 2023-10-24T02:03:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911322700 1 -- 172.21.15.148:0/1360486009 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800d600 con 0x7fd90c062bf0 2023-10-24T02:03:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.489+0000 7fd911322700 1 -- 172.21.15.148:0/1360486009 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800d980 con 0x7fd90c062bf0 2023-10-24T02:03:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 -- 172.21.15.148:0/1360486009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 msgr2=0x7fd90c0a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 --2- 172.21.15.148:0/1360486009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 0x7fd90c0a6860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fd908009760 tx=0x7fd908009060).stop 2023-10-24T02:03:40.494 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 -- 172.21.15.148:0/1360486009 shutdown_connections 2023-10-24T02:03:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 --2- 172.21.15.148:0/1360486009 >> v2:172.21.15.150:3300/0 conn(0x7fd90c0a6d50 0x7fd90c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 --2- 172.21.15.148:0/1360486009 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c062bf0 0x7fd90c0a6860 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 -- 172.21.15.148:0/1360486009 >> 172.21.15.148:0/1360486009 conn(0x7fd90c0c7ad0 msgr2=0x7fd90c0c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 -- 172.21.15.148:0/1360486009 shutdown_connections 2023-10-24T02:03:40.495 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.490+0000 7fd913326700 1 -- 172.21.15.148:0/1360486009 wait complete. 2023-10-24T02:03:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.491+0000 7fd913326700 1 Processor -- start 2023-10-24T02:03:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.491+0000 7fd913326700 1 -- start start 2023-10-24T02:03:40.498 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 0x7fd90c168d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 0x7fd90c1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c169260 con 0x7fd90c062bf0 2023-10-24T02:03:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c165ea0 con 0x7fd90c062810 2023-10-24T02:03:40.499 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c165290 con 0x7fd90c0a6d50 2023-10-24T02:03:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd912324700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 0x7fd90c168d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47004/0 (socket says 172.21.15.148:47004) 2023-10-24T02:03:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 -- 172.21.15.148:0/1371486016 learned_addr learned my addr 172.21.15.148:0/1371486016 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:40.500 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd912b25700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 0x7fd90c1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 msgr2=0x7fd90c1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 0x7fd90c1572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 msgr2=0x7fd90c168d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 0x7fd90c168d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.501 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 -- 172.21.15.148:0/1371486016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904009a20 con 0x7fd90c062bf0 2023-10-24T02:03:40.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd912b25700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 0x7fd90c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd912324700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 0x7fd90c168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd911b23700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7fd908011fb0 tx=0x7fd908016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908021070 con 0x7fd90c062bf0 2023-10-24T02:03:40.502 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908000bc0 con 0x7fd90c062bf0 2023-10-24T02:03:40.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800d980 con 0x7fd90c062bf0 2023-10-24T02:03:40.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9080092a0 con 0x7fd90c062bf0 2023-10-24T02:03:40.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.492+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c165850 con 0x7fd90c062bf0 2023-10-24T02:03:40.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.493+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c166070 con 0x7fd90c062bf0 2023-10-24T02:03:40.503 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.494+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd90801d640 con 0x7fd90c062bf0 2023-10-24T02:03:40.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.494+0000 7fd9027fc700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 0x7fd8f00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.494+0000 7fd912324700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 msgr2=0x7fd8f00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:40.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.494+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fd90807baf0 con 0x7fd90c062bf0 2023-10-24T02:03:40.504 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.494+0000 7fd912324700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 0x7fd8f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:40.505 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.498+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd90c166070 con 0x7fd90c062bf0 2023-10-24T02:03:40.592 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.591+0000 7eff19fcd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:40.689 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.688+0000 7f15d1b05680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-24T02:03:40.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.695+0000 7fd912324700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 msgr2=0x7fd8f00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:40.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.695+0000 7fd912324700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 0x7fd8f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:40.710 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.710+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90c166070 con 0x7fd90c062bf0 2023-10-24T02:03:40.711 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.710+0000 7fd9027fc700 1 -- 172.21.15.148:0/1371486016 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7fd90c166070 con 0x7fd90c062bf0 2023-10-24T02:03:40.711 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:40.711 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:40.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.712+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 msgr2=0x7fd8f00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:40.713 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.712+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 0x7fd8f00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.712+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 msgr2=0x7fd90c1679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.712+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7fd908011fb0 tx=0x7fd908016000).stop 2023-10-24T02:03:40.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 shutdown_connections 2023-10-24T02:03:40.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd90c0a6d50 0x7fd90c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd8f005f300 0x7fd8f00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:40.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd90c062810 0x7fd90c168d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 --2- 172.21.15.148:0/1371486016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd90c062bf0 0x7fd90c1679e0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 >> 172.21.15.148:0/1371486016 conn(0x7fd90c0c7ad0 msgr2=0x7fd90c0a4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 shutdown_connections 2023-10-24T02:03:40.715 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.713+0000 7fd913326700 1 -- 172.21.15.148:0/1371486016 wait complete. 2023-10-24T02:03:40.716 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:40.725 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:40.776 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:40.775+0000 7eff19fcd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:40.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.846+0000 7f68baddf700 1 Processor -- start 2023-10-24T02:03:40.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.846+0000 7f68baddf700 1 -- start start 2023-10-24T02:03:40.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.846+0000 7f68baddf700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68b4154540 0x7f68b40640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68baddf700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40a5bd0 con 0x7f68b40645a0 2023-10-24T02:03:40.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68baddf700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b4064ab0 con 0x7f68b40a8480 2023-10-24T02:03:40.849 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68baddf700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4064d90 con 0x7f68b4154540 2023-10-24T02:03:40.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b3fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f68b40645a0 0x7f68b40a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45972/0 (socket says 172.21.15.148:45972) 2023-10-24T02:03:40.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b3fff700 1 -- 172.21.15.148:0/90986413 learned_addr learned my addr 172.21.15.148:0/90986413 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:40.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b8b7b700 1 --2- 172.21.15.148:0/90986413 >> v2:172.21.15.150:3300/0 conn(0x7f68b4154540 0x7f68b40640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b37fe700 1 -- 172.21.15.148:0/90986413 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759081087 0 0) 0x7f68b40a5bd0 con 0x7f68b40645a0 2023-10-24T02:03:40.850 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b37fe700 1 -- 172.21.15.148:0/90986413 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a40033f0 con 0x7f68b40645a0 2023-10-24T02:03:40.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b8b7b700 1 -- 172.21.15.148:0/90986413 >> v1:172.21.15.150:6789/0 conn(0x7f68b40a8480 legacy=0x7f68b40a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b8b7b700 1 -- 172.21.15.148:0/90986413 >> v1:172.21.15.148:6789/0 conn(0x7f68b40645a0 legacy=0x7f68b40a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b8b7b700 1 -- 172.21.15.148:0/90986413 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4065070 con 0x7f68b4154540 2023-10-24T02:03:40.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b8b7b700 1 --2- 172.21.15.148:0/90986413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b4154540 0x7f68b40640b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f68a8006fd0 tx=0x7f68a8006f40).ready entity=mon.1 client_cookie=516298ec7ac293f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.851 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b37fe700 1 -- 172.21.15.148:0/90986413 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8005880 con 0x7f68b4154540 2023-10-24T02:03:40.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b37fe700 1 -- 172.21.15.148:0/90986413 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a80059e0 con 0x7f68b4154540 2023-10-24T02:03:40.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.847+0000 7f68b37fe700 1 -- 172.21.15.148:0/90986413 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8005d60 con 0x7f68b4154540 2023-10-24T02:03:40.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 -- 172.21.15.148:0/90986413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b4154540 msgr2=0x7f68b40640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 --2- 172.21.15.148:0/90986413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b4154540 0x7f68b40640b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f68a8006fd0 tx=0x7f68a8006f40).stop 2023-10-24T02:03:40.852 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 -- 172.21.15.148:0/90986413 shutdown_connections 2023-10-24T02:03:40.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 --2- 172.21.15.148:0/90986413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b4154540 0x7f68b40640b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 -- 172.21.15.148:0/90986413 >> 172.21.15.148:0/90986413 conn(0x7f68b4092480 msgr2=0x7f68b4062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:40.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 -- 172.21.15.148:0/90986413 shutdown_connections 2023-10-24T02:03:40.853 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.848+0000 7f68baddf700 1 -- 172.21.15.148:0/90986413 wait complete. 2023-10-24T02:03:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.850+0000 7f68baddf700 1 Processor -- start 2023-10-24T02:03:40.856 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.851+0000 7f68baddf700 1 -- start start 2023-10-24T02:03:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 0x7f68b40c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b4154540 0x7f68b40c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40c0ed0 con 0x7f68b40645a0 2023-10-24T02:03:40.857 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40a92b0 con 0x7f68b40a8480 2023-10-24T02:03:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68baddf700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40c0bf0 con 0x7f68b4154540 2023-10-24T02:03:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68b8b7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68b8b7b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47018/0 (socket says 172.21.15.148:47018) 2023-10-24T02:03:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68b8b7b700 1 -- 172.21.15.148:0/283916131 learned_addr learned my addr 172.21.15.148:0/283916131 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:40.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68b3fff700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 0x7f68b40c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.852+0000 7f68b937c700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b4154540 0x7f68b40c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 -- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b4154540 msgr2=0x7f68b40c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b4154540 0x7f68b40c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 -- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 msgr2=0x7f68b40c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 0x7f68b40c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:40.859 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 -- 172.21.15.148:0/283916131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009250 con 0x7f68b40645a0 2023-10-24T02:03:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b3fff700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 0x7f68b40c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b8b7b700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f68a8009dd0 tx=0x7f68a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800f720 con 0x7f68b40645a0 2023-10-24T02:03:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800f880 con 0x7f68b40645a0 2023-10-24T02:03:40.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40a8c60 con 0x7f68b40645a0 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800fc00 con 0x7f68b40645a0 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.853+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b4146530 con 0x7f68b40645a0 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.854+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b40a8ac0 con 0x7f68b40645a0 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.854+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f68a8026460 con 0x7f68b40645a0 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.855+0000 7f68b0ff9700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 0x7f68980617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:40.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.855+0000 7f68b3fff700 1 -- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 msgr2=0x7f68980617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:40.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.855+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f68a807b960 con 0x7f68b40645a0 2023-10-24T02:03:40.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.855+0000 7f68b3fff700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 0x7f68980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:40.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:40.859+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f68b40a8ac0 con 0x7f68b40645a0 2023-10-24T02:03:40.886 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:40.886+0000 7f15d1b05680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-24T02:03:41.029 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.029+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b40a8ac0 con 0x7f68b40645a0 2023-10-24T02:03:41.030 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.030+0000 7f68b0ff9700 1 -- 172.21.15.148:0/283916131 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+17311 (secure 0 0 0) 0x7f68b40a8ac0 con 0x7f68b40645a0 2023-10-24T02:03:41.031 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:41.031 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":217,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:35.125406+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:6832/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/1638296492":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/2328274838":"2023-10-25T02:03:35.125379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 msgr2=0x7f68980617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 0x7f68980617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 msgr2=0x7f68b4146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7f68a8009dd0 tx=0x7f68a8016000).stop 2023-10-24T02:03:41.033 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 shutdown_connections 2023-10-24T02:03:41.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b4154540 0x7f68b40c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68b40645a0 0x7f68b4146040 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f689805f300 0x7f68980617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 --2- 172.21.15.148:0/283916131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40a8480 0x7f68b40c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.034 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 >> 172.21.15.148:0/283916131 conn(0x7f68b4092480 msgr2=0x7f68b4151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 shutdown_connections 2023-10-24T02:03:41.035 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.032+0000 7f68baddf700 1 -- 172.21.15.148:0/283916131 wait complete. 2023-10-24T02:03:41.045 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T02:03:41.046 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:41.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.162+0000 7fdeb8579700 1 Processor -- start 2023-10-24T02:03:41.163 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.162+0000 7fdeb8579700 1 -- start start 2023-10-24T02:03:41.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb8579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 0x7fdeb00c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.164 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb8579700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb0155550 con 0x7fdeb0152170 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb8579700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00a7480 con 0x7fdeb0151d90 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb8579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0154960 con 0x7fdeb00c8470 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb6b16700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fdeb0152170 0x7fdeb0157f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45984/0 (socket says 172.21.15.148:45984) 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb6b16700 1 -- 172.21.15.148:0/2300172946 learned_addr learned my addr 172.21.15.148:0/2300172946 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb5b14700 1 --2- 172.21.15.148:0/2300172946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 0x7fdeb00c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.163+0000 7fdeb5313700 1 -- 172.21.15.148:0/2300172946 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033506464 0 0) 0x7fdeb00a7480 con 0x7fdeb0151d90 2023-10-24T02:03:41.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5313700 1 -- 172.21.15.148:0/2300172946 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c0033f0 con 0x7fdeb0151d90 2023-10-24T02:03:41.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5b14700 1 -- 172.21.15.148:0/2300172946 >> v1:172.21.15.150:6789/0 conn(0x7fdeb0151d90 legacy=0x7fdeb00a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5b14700 1 -- 172.21.15.148:0/2300172946 >> v1:172.21.15.148:6789/0 conn(0x7fdeb0152170 legacy=0x7fdeb0157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5b14700 1 -- 172.21.15.148:0/2300172946 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0154c20 con 0x7fdeb00c8470 2023-10-24T02:03:41.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5b14700 1 --2- 172.21.15.148:0/2300172946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 0x7fdeb00c57e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fdeac009790 tx=0x7fdeac009060).ready entity=mon.2 client_cookie=237948c7d14dc7da server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5313700 1 -- 172.21.15.148:0/2300172946 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00d4a0 con 0x7fdeb00c8470 2023-10-24T02:03:41.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5313700 1 -- 172.21.15.148:0/2300172946 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac00d600 con 0x7fdeb00c8470 2023-10-24T02:03:41.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb5313700 1 -- 172.21.15.148:0/2300172946 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00d980 con 0x7fdeb00c8470 2023-10-24T02:03:41.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb8579700 1 -- 172.21.15.148:0/2300172946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 msgr2=0x7fdeb00c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.164+0000 7fdeb8579700 1 --2- 172.21.15.148:0/2300172946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 0x7fdeb00c57e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fdeac009790 tx=0x7fdeac009060).stop 2023-10-24T02:03:41.170 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.165+0000 7fdeb8579700 1 -- 172.21.15.148:0/2300172946 shutdown_connections 2023-10-24T02:03:41.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.165+0000 7fdeb8579700 1 --2- 172.21.15.148:0/2300172946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb00c8470 0x7fdeb00c57e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.165+0000 7fdeb8579700 1 -- 172.21.15.148:0/2300172946 >> 172.21.15.148:0/2300172946 conn(0x7fdeb00641b0 msgr2=0x7fdeb00c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.165+0000 7fdeb8579700 1 -- 172.21.15.148:0/2300172946 shutdown_connections 2023-10-24T02:03:41.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.165+0000 7fdeb8579700 1 -- 172.21.15.148:0/2300172946 wait complete. 2023-10-24T02:03:41.171 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 Processor -- start 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 -- start start 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeb00c8470 0x7fdeb0168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb0151d90 0x7fdeb00bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c0e50 con 0x7fdeb0152170 2023-10-24T02:03:41.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c02d0 con 0x7fdeb00c8470 2023-10-24T02:03:41.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.166+0000 7fdeb8579700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c05b0 con 0x7fdeb0151d90 2023-10-24T02:03:41.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47022/0 (socket says 172.21.15.148:47022) 2023-10-24T02:03:41.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 -- 172.21.15.148:0/3554021495 learned_addr learned my addr 172.21.15.148:0/3554021495 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:41.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6315700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeb00c8470 0x7fdeb0168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb5b14700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb0151d90 0x7fdeb00bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb0151d90 msgr2=0x7fdeb00bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb0151d90 0x7fdeb00bfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeb00c8470 msgr2=0x7fdeb0168e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeb00c8470 0x7fdeb0168e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 -- 172.21.15.148:0/3554021495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0092a0 con 0x7fdeb0152170 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb6b16700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7fdea800c860 tx=0x7fdea8001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8005d30 con 0x7fdeb0152170 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea8005e90 con 0x7fdeb0152170 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00c0890 con 0x7fdeb0152170 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8007320 con 0x7fdeb0152170 2023-10-24T02:03:41.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.167+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00bff00 con 0x7fdeb0152170 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.168+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb006c6b0 con 0x7fdeb0152170 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.168+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fdea80076d0 con 0x7fdeb0152170 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.169+0000 7fdea67fc700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 0x7fde940617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.169+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7fdea807a480 con 0x7fdeb0152170 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.169+0000 7fdeb6315700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 msgr2=0x7fde940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:41.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.169+0000 7fdeb6315700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 0x7fde940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:41.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.173+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdea804b470 con 0x7fdeb0152170 2023-10-24T02:03:41.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.370+0000 7fdeb6315700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 msgr2=0x7fde940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:41.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.370+0000 7fdeb6315700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 0x7fde940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:41.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.385+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdeb00c61f0 con 0x7fdeb0152170 2023-10-24T02:03:41.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.385+0000 7fdea67fc700 1 -- 172.21.15.148:0/3554021495 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7fdea804ea90 con 0x7fdeb0152170 2023-10-24T02:03:41.386 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:41.386 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:41.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 msgr2=0x7fde940617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:41.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 0x7fde940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 msgr2=0x7fdeb01644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.388 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7fdea800c860 tx=0x7fdea8001630).stop 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 shutdown_connections 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdeb0152170 0x7fdeb01644b0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde9405f300 0x7fde940617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdeb00c8470 0x7fdeb0168e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 --2- 172.21.15.148:0/3554021495 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdeb0151d90 0x7fdeb00bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 >> 172.21.15.148:0/3554021495 conn(0x7fdeb00641b0 msgr2=0x7fdeb014b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 shutdown_connections 2023-10-24T02:03:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.387+0000 7fdeb8579700 1 -- 172.21.15.148:0/3554021495 wait complete. 2023-10-24T02:03:41.390 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:41.400 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:03:41.434 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.434+0000 7eff19fcd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:41.504 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.504+0000 7eff19fcd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:41.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.521+0000 7f9d24f04700 1 Processor -- start 2023-10-24T02:03:41.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.521+0000 7f9d24f04700 1 -- start start 2023-10-24T02:03:41.523 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d24f04700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d20095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d24f04700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 0x7f9d200962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d24f04700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200bf5c0 con 0x7f9d201543a0 2023-10-24T02:03:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d24f04700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200967c0 con 0x7f9d20154780 2023-10-24T02:03:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d24f04700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200a86d0 con 0x7f9d200bfa50 2023-10-24T02:03:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d1dd9b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d20095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d1ed9d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 0x7f9d200962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d1e59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9d201543a0 0x7f9d200a7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:56100/0 (socket says 172.21.15.148:56100) 2023-10-24T02:03:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.522+0000 7f9d1e59c700 1 -- 172.21.15.148:0/4207096203 learned_addr learned my addr 172.21.15.148:0/4207096203 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1d59a700 1 -- 172.21.15.148:0/4207096203 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603212714 0 0) 0x7f9d200bf5c0 con 0x7f9d201543a0 2023-10-24T02:03:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1d59a700 1 -- 172.21.15.148:0/4207096203 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d080033f0 con 0x7f9d201543a0 2023-10-24T02:03:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/4207096203 >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 msgr2=0x7f9d200962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1dd9b700 1 --2- 172.21.15.148:0/4207096203 >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 0x7f9d200962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/4207096203 >> v1:172.21.15.150:6789/0 conn(0x7f9d201543a0 legacy=0x7f9d200a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/4207096203 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200be9b0 con 0x7f9d200bfa50 2023-10-24T02:03:41.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1ed9d700 1 --2- 172.21.15.148:0/4207096203 >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 0x7f9d200962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1dd9b700 1 --2- 172.21.15.148:0/4207096203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d20095de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f9d10009760 tx=0x7f9d10009060).ready entity=mon.2 client_cookie=9e8db8f1da9dba22 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1d59a700 1 -- 172.21.15.148:0/4207096203 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000f510 con 0x7f9d200bfa50 2023-10-24T02:03:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1d59a700 1 -- 172.21.15.148:0/4207096203 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000f670 con 0x7f9d200bfa50 2023-10-24T02:03:41.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d1d59a700 1 -- 172.21.15.148:0/4207096203 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000f9f0 con 0x7f9d200bfa50 2023-10-24T02:03:41.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d24f04700 1 -- 172.21.15.148:0/4207096203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 msgr2=0x7f9d20095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.523+0000 7f9d24f04700 1 --2- 172.21.15.148:0/4207096203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d20095de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f9d10009760 tx=0x7f9d10009060).stop 2023-10-24T02:03:41.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 -- 172.21.15.148:0/4207096203 shutdown_connections 2023-10-24T02:03:41.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 --2- 172.21.15.148:0/4207096203 >> v2:172.21.15.150:3300/0 conn(0x7f9d20154780 0x7f9d200962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 --2- 172.21.15.148:0/4207096203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d20095de0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 -- 172.21.15.148:0/4207096203 >> 172.21.15.148:0/4207096203 conn(0x7f9d200630f0 msgr2=0x7f9d200c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 -- 172.21.15.148:0/4207096203 shutdown_connections 2023-10-24T02:03:41.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.524+0000 7f9d24f04700 1 -- 172.21.15.148:0/4207096203 wait complete. 2023-10-24T02:03:41.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.525+0000 7f9d24f04700 1 Processor -- start 2023-10-24T02:03:41.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.525+0000 7f9d24f04700 1 -- start start 2023-10-24T02:03:41.532 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d200acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 0x7f9d200aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2014f480 con 0x7f9d201543a0 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200ad290 con 0x7f9d20154780 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200a9a20 con 0x7f9d200bfa50 2023-10-24T02:03:41.533 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47024/0 (socket says 172.21.15.148:47024) 2023-10-24T02:03:41.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1ed9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 0x7f9d200aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/2590573582 learned_addr learned my addr 172.21.15.148:0/2590573582 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:41.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1e59c700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d200acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.534 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 msgr2=0x7f9d200acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d200acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 msgr2=0x7f9d200aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 0x7f9d200aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 -- 172.21.15.148:0/2590573582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009a20 con 0x7f9d201543a0 2023-10-24T02:03:41.535 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1ed9d700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 0x7f9d200aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d1dd9b700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f9d10009d50 tx=0x7f9d10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000f7e0 con 0x7f9d201543a0 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000f940 con 0x7f9d201543a0 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d100092a0 con 0x7f9d201543a0 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1001b660 con 0x7f9d201543a0 2023-10-24T02:03:41.536 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.526+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d20150b90 con 0x7f9d201543a0 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2006c6b0 con 0x7f9d201543a0 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f9d1001ba50 con 0x7f9d201543a0 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d0e7fc700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 0x7f9d000617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d1e59c700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 msgr2=0x7f9d000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f9d1007bd80 con 0x7f9d201543a0 2023-10-24T02:03:41.537 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.528+0000 7f9d1e59c700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 0x7f9d000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:41.538 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.532+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9d1004cd70 con 0x7f9d201543a0 2023-10-24T02:03:41.575 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:41.575+0000 7f15d1b05680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-24T02:03:41.583 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.582+0000 7eff19fcd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:41.647 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:41.647+0000 7f15d1b05680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-24T02:03:41.726 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:41.725+0000 7f15d1b05680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-24T02:03:41.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.729+0000 7f9d1e59c700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 msgr2=0x7f9d000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:41.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.729+0000 7f9d1e59c700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 0x7f9d000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:41.731 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.731+0000 7eff19fcd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.746+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d200bec90 con 0x7f9d201543a0 2023-10-24T02:03:41.746 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.746+0000 7f9d0e7fc700 1 -- 172.21.15.148:0/2590573582 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4507 (secure 0 0 0) 0x7f9d1007d020 con 0x7f9d201543a0 2023-10-24T02:03:41.747 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:41.747 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-24T02:03:19.306454+0000","modified":"2023-10-24T02:03:21.312409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6836/707171421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":707171421},{"type":"v1","addr":"172.21.15.150:6836","nonce":707171421}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-24T02:03:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 msgr2=0x7f9d000617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 0x7f9d000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 msgr2=0x7f9d201536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.749 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f9d10009d50 tx=0x7f9d10017000).stop 2023-10-24T02:03:41.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 shutdown_connections 2023-10-24T02:03:41.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9d0005f300 0x7f9d000617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:41.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d20154780 0x7f9d200aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d200bfa50 0x7f9d200acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 --2- 172.21.15.148:0/2590573582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d201543a0 0x7f9d201536c0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 >> 172.21.15.148:0/2590573582 conn(0x7f9d200630f0 msgr2=0x7f9d200c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 shutdown_connections 2023-10-24T02:03:41.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.748+0000 7f9d24f04700 1 -- 172.21.15.148:0/2590573582 wait complete. 2023-10-24T02:03:41.751 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 74 2023-10-24T02:03:41.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:41.803 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.802+0000 7eff19fcd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:41.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.880+0000 7f4fc98ab700 1 Processor -- start 2023-10-24T02:03:41.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.880+0000 7f4fc98ab700 1 -- start start 2023-10-24T02:03:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc98ab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc4098700 0x7f4fc4098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc98ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40c5910 con 0x7f4fc40c1b40 2023-10-24T02:03:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc98ab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40c6490 con 0x7f4fc40ca640 2023-10-24T02:03:41.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc98ab700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc4154860 con 0x7f4fc4098700 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f4fc4098700 0x7f4fc4098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc27fc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f4fc40c1b40 0x7f4fc40c6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45994/0 (socket says 172.21.15.148:45994) 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc27fc700 1 -- 172.21.15.148:0/1142582240 learned_addr learned my addr 172.21.15.148:0/1142582240 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116398459 0 0) 0x7f4fc40c6490 con 0x7f4fc40ca640 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac0033f0 con 0x7f4fc40ca640 2023-10-24T02:03:41.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc2ffd700 1 -- 172.21.15.148:0/1142582240 >> v1:172.21.15.150:6789/0 conn(0x7f4fc40ca640 legacy=0x7f4fc40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114580036 0 0) 0x7f4fc40c5910 con 0x7f4fc40c1b40 2023-10-24T02:03:41.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc2ffd700 1 -- 172.21.15.148:0/1142582240 >> v1:172.21.15.148:6789/0 conn(0x7f4fc40c1b40 legacy=0x7f4fc40c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc2ffd700 1 -- 172.21.15.148:0/1142582240 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40c5b60 con 0x7f4fc4098700 2023-10-24T02:03:41.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc2ffd700 1 --2- 172.21.15.148:0/1142582240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc4098700 0x7f4fc4098ae0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f4fb4009760 tx=0x7f4fb4009060).ready entity=mon.0 client_cookie=86064c3bf6d7541 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400f510 con 0x7f4fc4098700 2023-10-24T02:03:41.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400f670 con 0x7f4fc4098700 2023-10-24T02:03:41.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.881+0000 7f4fc1ffb700 1 -- 172.21.15.148:0/1142582240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400f9f0 con 0x7f4fc4098700 2023-10-24T02:03:41.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 -- 172.21.15.148:0/1142582240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc4098700 msgr2=0x7f4fc4098ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/1142582240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc4098700 0x7f4fc4098ae0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f4fb4009760 tx=0x7f4fb4009060).stop 2023-10-24T02:03:41.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 -- 172.21.15.148:0/1142582240 shutdown_connections 2023-10-24T02:03:41.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/1142582240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc4098700 0x7f4fc4098ae0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 -- 172.21.15.148:0/1142582240 >> 172.21.15.148:0/1142582240 conn(0x7f4fc406b380 msgr2=0x7f4fc406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:41.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 -- 172.21.15.148:0/1142582240 shutdown_connections 2023-10-24T02:03:41.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.882+0000 7f4fc98ab700 1 -- 172.21.15.148:0/1142582240 wait complete. 2023-10-24T02:03:41.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.883+0000 7f4fc98ab700 1 Processor -- start 2023-10-24T02:03:41.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.883+0000 7f4fc98ab700 1 -- start start 2023-10-24T02:03:41.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc4098700 0x7f4fc4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc40c1b40 0x7f4fc4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4159800 con 0x7f4fc40ca640 2023-10-24T02:03:41.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4155750 con 0x7f4fc40c1b40 2023-10-24T02:03:41.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc98ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4154b40 con 0x7f4fc4098700 2023-10-24T02:03:41.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47054/0 (socket says 172.21.15.148:47054) 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 -- 172.21.15.148:0/3793859713 learned_addr learned my addr 172.21.15.148:0/3793859713 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc27fc700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc40c1b40 0x7f4fc4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc2ffd700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc4098700 0x7f4fc4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 -- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc4098700 msgr2=0x7f4fc4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc4098700 0x7f4fc4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.884+0000 7f4fc37fe700 1 -- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc40c1b40 msgr2=0x7f4fc4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:41.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4fc37fe700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc40c1b40 0x7f4fc4158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:41.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4fc37fe700 1 -- 172.21.15.148:0/3793859713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40092a0 con 0x7f4fc40ca640 2023-10-24T02:03:41.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4fc37fe700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f4fbc00c7f0 tx=0x7f4fbc00cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:41.892 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f15d1b05680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-24T02:03:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc002020 con 0x7f4fc40ca640 2023-10-24T02:03:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc002180 con 0x7f4fc40ca640 2023-10-24T02:03:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc001590 con 0x7f4fc40ca640 2023-10-24T02:03:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc4154e20 con 0x7f4fc40ca640 2023-10-24T02:03:41.894 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.885+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc41553e0 con 0x7f4fc40ca640 2023-10-24T02:03:41.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.886+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc41558e0 con 0x7f4fc40ca640 2023-10-24T02:03:41.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.886+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4fbc001940 con 0x7f4fc40ca640 2023-10-24T02:03:41.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.887+0000 7f4faaffd700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 0x7f4fb00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:41.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.887+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f4fbc079ac0 con 0x7f4fc40ca640 2023-10-24T02:03:41.895 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.887+0000 7f4fc2ffd700 1 -- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 msgr2=0x7f4fb00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.887+0000 7f4fc2ffd700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 0x7f4fb00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:41.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:41.891+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4fbc047af0 con 0x7f4fc40ca640 2023-10-24T02:03:41.921 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:41.921+0000 7eff19fcd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:41.960 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:41.959+0000 7f15d1b05680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-24T02:03:42.031 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.031+0000 7eff19fcd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:42.063 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.063+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc406c6b0 con 0x7f4fc40ca640 2023-10-24T02:03:42.064 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.064+0000 7f4faaffd700 1 -- 172.21.15.148:0/3793859713 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v217) v1 ==== 74+0+17311 (secure 0 0 0) 0x7f4fbc04aab0 con 0x7f4fc40ca640 2023-10-24T02:03:42.065 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:42.065 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":217,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:35.125406+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-24T02:03:17.866376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"215","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-24T02:03:18.314792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"216","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:6832/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/1638296492":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/2328274838":"2023-10-25T02:03:35.125379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:42.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 msgr2=0x7f4fb00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:42.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 0x7f4fb00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:42.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 msgr2=0x7f4fc4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f4fbc00c7f0 tx=0x7f4fbc00cb00).stop 2023-10-24T02:03:42.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 shutdown_connections 2023-10-24T02:03:42.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4fc40ca640 0x7f4fc4159310 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fc4098700 0x7f4fc4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f4fb005f300 0x7f4fb00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:42.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 --2- 172.21.15.148:0/3793859713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fc40c1b40 0x7f4fc4158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 >> 172.21.15.148:0/3793859713 conn(0x7f4fc406b380 msgr2=0x7f4fc40a9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:42.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 shutdown_connections 2023-10-24T02:03:42.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.066+0000 7f4fc98ab700 1 -- 172.21.15.148:0/3793859713 wait complete. 2023-10-24T02:03:42.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-24T02:03:42.080 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:42.079+0000 7f15d1b05680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-24T02:03:42.196 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:42.196+0000 7f15d1b05680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-24T02:03:42.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.197+0000 7f289e1af700 1 Processor -- start 2023-10-24T02:03:42.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.197+0000 7f289e1af700 1 -- start start 2023-10-24T02:03:42.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f289e1af700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2898154240 0x7f289806a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:42.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f289e1af700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980bcfa0 con 0x7f2898065bc0 2023-10-24T02:03:42.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f289e1af700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980695c0 con 0x7f2898066cc0 2023-10-24T02:03:42.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f289e1af700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980bd280 con 0x7f2898154240 2023-10-24T02:03:42.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f28977fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f2898154240 0x7f289806a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:42.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f288ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f2898065bc0 0x7f28980665b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:45996/0 (socket says 172.21.15.148:45996) 2023-10-24T02:03:42.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f288ffff700 1 -- 172.21.15.148:0/687948487 learned_addr learned my addr 172.21.15.148:0/687948487 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:42.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f28977fe700 1 -- 172.21.15.148:0/687948487 >> v1:172.21.15.150:6789/0 conn(0x7f2898066cc0 legacy=0x7f28980c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f28977fe700 1 -- 172.21.15.148:0/687948487 >> v1:172.21.15.148:6789/0 conn(0x7f2898065bc0 legacy=0x7f28980665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f2896ffd700 1 -- 172.21.15.148:0/687948487 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053620778 0 0) 0x7f28980bcfa0 con 0x7f2898065bc0 2023-10-24T02:03:42.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f28977fe700 1 -- 172.21.15.148:0/687948487 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980698a0 con 0x7f2898154240 2023-10-24T02:03:42.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f28977fe700 1 --2- 172.21.15.148:0/687948487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898154240 0x7f289806a0a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f2888009760 tx=0x7f2888009060).ready entity=mon.0 client_cookie=1c8899bba6280344 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:42.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.198+0000 7f2896ffd700 1 -- 172.21.15.148:0/687948487 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800b580 con 0x7f2898154240 2023-10-24T02:03:42.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f2896ffd700 1 -- 172.21.15.148:0/687948487 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800b6e0 con 0x7f2898154240 2023-10-24T02:03:42.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f2896ffd700 1 -- 172.21.15.148:0/687948487 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800ba60 con 0x7f2898154240 2023-10-24T02:03:42.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 -- 172.21.15.148:0/687948487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898154240 msgr2=0x7f289806a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 --2- 172.21.15.148:0/687948487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898154240 0x7f289806a0a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7f2888009760 tx=0x7f2888009060).stop 2023-10-24T02:03:42.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 -- 172.21.15.148:0/687948487 shutdown_connections 2023-10-24T02:03:42.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 --2- 172.21.15.148:0/687948487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898154240 0x7f289806a0a0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 -- 172.21.15.148:0/687948487 >> 172.21.15.148:0/687948487 conn(0x7f28980c7d10 msgr2=0x7f28980c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:42.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 -- 172.21.15.148:0/687948487 shutdown_connections 2023-10-24T02:03:42.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.199+0000 7f289e1af700 1 -- 172.21.15.148:0/687948487 wait complete. 2023-10-24T02:03:42.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.201+0000 7f289e1af700 1 Processor -- start 2023-10-24T02:03:42.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.201+0000 7f289e1af700 1 -- start start 2023-10-24T02:03:42.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2898065bc0 0x7f2898133720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:42.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:42.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 0x7f289815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289815a8b0 con 0x7f2898066cc0 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289814c3d0 con 0x7f2898065bc0 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f289e1af700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2898133c10 con 0x7f2898154240 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f288ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f288ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47076/0 (socket says 172.21.15.148:47076) 2023-10-24T02:03:42.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.202+0000 7f288ffff700 1 -- 172.21.15.148:0/2948006994 learned_addr learned my addr 172.21.15.148:0/2948006994 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:42.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f28977fe700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2898065bc0 0x7f2898133720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:42.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f2897fff700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 0x7f289815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:42.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 msgr2=0x7f289815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 0x7f289815a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2898065bc0 msgr2=0x7f2898133720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:42.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2898065bc0 0x7f2898133720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:42.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 -- 172.21.15.148:0/2948006994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880092a0 con 0x7f2898066cc0 2023-10-24T02:03:42.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f2897fff700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 0x7f289815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:42.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288ffff700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f288000c4c0 tx=0x7f2880007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:42.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800072e0 con 0x7f2898066cc0 2023-10-24T02:03:42.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880007440 con 0x7f2898066cc0 2023-10-24T02:03:42.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800057a0 con 0x7f2898066cc0 2023-10-24T02:03:42.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289814b7c0 con 0x7f2898066cc0 2023-10-24T02:03:42.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.203+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289814bd80 con 0x7f2898066cc0 2023-10-24T02:03:42.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.204+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 102) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2880005b90 con 0x7f2898066cc0 2023-10-24T02:03:42.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.204+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289814c580 con 0x7f2898066cc0 2023-10-24T02:03:42.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.205+0000 7f288f7fe700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 0x7f28780617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:42.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.205+0000 7f28977fe700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 msgr2=0x7f28780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:42.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.205+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6337+0+0 (secure 0 0 0) 0x7f2880079d30 con 0x7f2898066cc0 2023-10-24T02:03:42.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.205+0000 7f28977fe700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 0x7f28780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-10-24T02:03:42.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.209+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f289814c580 con 0x7f2898066cc0 2023-10-24T02:03:42.327 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.327+0000 7eff19fcd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:42.399 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.399+0000 7eff19fcd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.406+0000 7f28977fe700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 msgr2=0x7f28780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.150:6832/100598 2023-10-24T02:03:42.406 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.406+0000 7f28977fe700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 0x7f28780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-10-24T02:03:42.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.422+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 103) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f2880077820 con 0x7f2898066cc0 2023-10-24T02:03:42.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.422+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 msgr2=0x7f28780617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-24T02:03:42.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.422+0000 7f288f7fe700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 0x7f28780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:42.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:42.427+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f289814c540 con 0x7f2898066cc0 2023-10-24T02:03:42.472 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe96764700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe96764700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe96764700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe96764700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.473 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe96764700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe94760700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe94760700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe94760700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe94760700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.474 INFO:tasks.ceph.mgr.x.smithi150.stderr:2023-10-24T02:03:42.472+0000 7efe94760700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-24T02:03:42.477 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:42.477 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:42.477 INFO:tasks.ceph.mds.b.smithi150.stderr:2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:03:42.480 INFO:tasks.ceph.mds.b.smithi150.stderr: -2326> 2023-10-24T02:03:25.228+0000 7f01e14c6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-24T02:03:42.483 INFO:tasks.ceph.mds.b.smithi150.stderr: -5> 2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:42.483 INFO:tasks.ceph.mds.b.smithi150.stderr: -4> 2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-10-24T02:03:42.483 INFO:tasks.ceph.mds.b.smithi150.stderr: -2> 2023-10-24T02:03:42.476+0000 7f01ddcbf700 -1 MDSIOContextBase: failed with -108, restarting... 2023-10-24T02:03:42.501 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2023-10-24T02:03:42.510 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:42.509+0000 7f15d1b05680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-24T02:03:42.582 INFO:tasks.ceph.mgr.y.smithi148.stderr:2023-10-24T02:03:42.582+0000 7f15d1b05680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-24T02:03:43.416 INFO:tasks.ceph.mon.a.smithi148.stderr:2023-10-24T02:03:43.415+0000 7f79c41cc700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-24T02:03:43.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.418+0000 7f288f7fe700 1 -- 172.21.15.148:0/2948006994 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28800723f0 con 0x7f2898066cc0 2023-10-24T02:03:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 msgr2=0x7f2898159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f288000c4c0 tx=0x7f2880007c10).stop 2023-10-24T02:03:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 shutdown_connections 2023-10-24T02:03:43.421 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2898154240 0x7f289815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f287805f300 0x7f28780617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2898065bc0 0x7f2898133720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 --2- 172.21.15.148:0/2948006994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2898066cc0 0x7f2898159ed0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 >> 172.21.15.148:0/2948006994 conn(0x7f28980c7d10 msgr2=0x7f28980a6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 shutdown_connections 2023-10-24T02:03:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.420+0000 7f289e1af700 1 -- 172.21.15.148:0/2948006994 wait complete. 2023-10-24T02:03:43.423 INFO:teuthology.orchestra.run.smithi148.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-24T02:03:43.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-24T02:03:43.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.550+0000 7fc39a576700 1 Processor -- start 2023-10-24T02:03:43.551 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.550+0000 7fc39a576700 1 -- start start 2023-10-24T02:03:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc39a576700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 0x7fc394154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc39a576700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3940bffd0 0x7fc3940c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc39a576700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940c0970 con 0x7fc394154430 2023-10-24T02:03:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc39a576700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940c6a10 con 0x7fc3940bffd0 2023-10-24T02:03:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc39a576700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940c71d0 con 0x7fc394098bd0 2023-10-24T02:03:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc398b13700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3940bffd0 0x7fc3940c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc398b13700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fc3940bffd0 0x7fc3940c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50766/0 (socket says 172.21.15.148:50766) 2023-10-24T02:03:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.551+0000 7fc398b13700 1 -- 172.21.15.148:0/1353591820 learned_addr learned my addr 172.21.15.148:0/1353591820 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc3937fe700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 0x7fc394154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc398b13700 1 -- 172.21.15.148:0/1353591820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 msgr2=0x7fc394154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc398b13700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 0x7fc394154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc398b13700 1 -- 172.21.15.148:0/1353591820 >> v1:172.21.15.150:6789/0 conn(0x7fc394154430 legacy=0x7fc3940c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc398b13700 1 -- 172.21.15.148:0/1353591820 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940c9410 con 0x7fc3940bffd0 2023-10-24T02:03:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc3937fe700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 0x7fc394154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc398b13700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3940bffd0 0x7fc3940c0480 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fc38c009f50 tx=0x7fc38c009840).ready entity=mon.0 client_cookie=c5a337d926c58af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc392ffd700 1 -- 172.21.15.148:0/1353591820 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00e070 con 0x7fc3940bffd0 2023-10-24T02:03:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc392ffd700 1 -- 172.21.15.148:0/1353591820 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00ba70 con 0x7fc3940bffd0 2023-10-24T02:03:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc392ffd700 1 -- 172.21.15.148:0/1353591820 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00bdf0 con 0x7fc3940bffd0 2023-10-24T02:03:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc39a576700 1 -- 172.21.15.148:0/1353591820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3940bffd0 msgr2=0x7fc3940c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc39a576700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3940bffd0 0x7fc3940c0480 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7fc38c009f50 tx=0x7fc38c009840).stop 2023-10-24T02:03:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc39a576700 1 -- 172.21.15.148:0/1353591820 shutdown_connections 2023-10-24T02:03:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc39a576700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3940bffd0 0x7fc3940c0480 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.552+0000 7fc39a576700 1 --2- 172.21.15.148:0/1353591820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc394098bd0 0x7fc394154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.553+0000 7fc39a576700 1 -- 172.21.15.148:0/1353591820 >> 172.21.15.148:0/1353591820 conn(0x7fc3940cb070 msgr2=0x7fc3940cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.553+0000 7fc39a576700 1 -- 172.21.15.148:0/1353591820 shutdown_connections 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.553+0000 7fc39a576700 1 -- 172.21.15.148:0/1353591820 wait complete. 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.554+0000 7fc39a576700 1 Processor -- start 2023-10-24T02:03:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.554+0000 7fc39a576700 1 -- start start 2023-10-24T02:03:43.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394098bd0 0x7fc3940c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.562 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3940bffd0 0x7fc394147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940c21b0 con 0x7fc394154430 2023-10-24T02:03:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940c3140 con 0x7fc394098bd0 2023-10-24T02:03:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc394152c90 con 0x7fc3940bffd0 2023-10-24T02:03:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50768/0 (socket says 172.21.15.148:50768) 2023-10-24T02:03:43.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 -- 172.21.15.148:0/2061590492 learned_addr learned my addr 172.21.15.148:0/2061590492 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:43.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc3937fe700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3940bffd0 0x7fc394147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc393fff700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394098bd0 0x7fc3940c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.564 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 -- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3940bffd0 msgr2=0x7fc394147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:43.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3940bffd0 0x7fc394147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 -- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394098bd0 msgr2=0x7fc3940c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:43.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394098bd0 0x7fc3940c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:43.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 -- 172.21.15.148:0/2061590492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c009ae0 con 0x7fc394154430 2023-10-24T02:03:43.565 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc398b13700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fc3940c5910 tx=0x7fc38c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c007170 con 0x7fc394154430 2023-10-24T02:03:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0092e0 con 0x7fc394154430 2023-10-24T02:03:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940c2450 con 0x7fc394154430 2023-10-24T02:03:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c01e6c0 con 0x7fc394154430 2023-10-24T02:03:43.566 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.555+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394152f70 con 0x7fc394154430 2023-10-24T02:03:43.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.556+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940c2950 con 0x7fc394154430 2023-10-24T02:03:43.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.557+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 104) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fc38c003040 con 0x7fc394154430 2023-10-24T02:03:43.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.557+0000 7fc37bfff700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 0x7fc3800614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:43.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.557+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6638+0+0 (secure 0 0 0) 0x7fc38c07b760 con 0x7fc394154430 2023-10-24T02:03:43.567 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.557+0000 7fc393fff700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 0x7fc3800614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:43.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.557+0000 7fc393fff700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 0x7fc3800614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc384003860 tx=0x7fc384007d40).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:43.568 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.561+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc38c04cab0 con 0x7fc394154430 2023-10-24T02:03:43.766 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:43.765+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc394062c40 con 0x7fc394154430 2023-10-24T02:03:44.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.443+0000 7fc37bfff700 1 -- 172.21.15.148:0/2061590492 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc38c023020 con 0x7fc394154430 2023-10-24T02:03:44.446 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.445+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 msgr2=0x7fc3800614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.445+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 0x7fc3800614f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc384003860 tx=0x7fc384007d40).stop 2023-10-24T02:03:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 msgr2=0x7fc3940c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:44.447 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7fc3940c5910 tx=0x7fc38c009840).stop 2023-10-24T02:03:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 shutdown_connections 2023-10-24T02:03:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc394154430 0x7fc3940c7be0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc38005f030 0x7fc3800614f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394098bd0 0x7fc3940c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 --2- 172.21.15.148:0/2061590492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3940bffd0 0x7fc394147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 >> 172.21.15.148:0/2061590492 conn(0x7fc3940cb070 msgr2=0x7fc3940648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 shutdown_connections 2023-10-24T02:03:44.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.446+0000 7fc39a576700 1 -- 172.21.15.148:0/2061590492 wait complete. 2023-10-24T02:03:44.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-24T02:03:44.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.576+0000 7fa6df5a8700 1 Processor -- start 2023-10-24T02:03:44.577 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.576+0000 7fa6df5a8700 1 -- start start 2023-10-24T02:03:44.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6df5a8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6d81544b0 0x7fa6d80a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6df5a8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6d80c8290 0x7fa6d80a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6df5a8700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d80c6270 con 0x7fa6d80aa420 2023-10-24T02:03:44.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6df5a8700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d80c60e0 con 0x7fa6d80c8290 2023-10-24T02:03:44.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6df5a8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d80c0c80 con 0x7fa6d81544b0 2023-10-24T02:03:44.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6dcb43700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6d80c8290 0x7fa6d80a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6dcb43700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa6d80c8290 0x7fa6d80a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50772/0 (socket says 172.21.15.148:50772) 2023-10-24T02:03:44.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.577+0000 7fa6dcb43700 1 -- 172.21.15.148:0/4228714749 learned_addr learned my addr 172.21.15.148:0/4228714749 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:44.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dd344700 1 --2- 172.21.15.148:0/4228714749 >> v2:172.21.15.150:3300/0 conn(0x7fa6d81544b0 0x7fa6d80a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dcb43700 1 -- 172.21.15.148:0/4228714749 >> v2:172.21.15.150:3300/0 conn(0x7fa6d81544b0 msgr2=0x7fa6d80a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:44.582 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dcb43700 1 --2- 172.21.15.148:0/4228714749 >> v2:172.21.15.150:3300/0 conn(0x7fa6d81544b0 0x7fa6d80a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dcb43700 1 -- 172.21.15.148:0/4228714749 >> v1:172.21.15.150:6789/0 conn(0x7fa6d80aa420 legacy=0x7fa6d80c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:44.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dcb43700 1 -- 172.21.15.148:0/4228714749 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80c0f40 con 0x7fa6d80c8290 2023-10-24T02:03:44.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6dcb43700 1 --2- 172.21.15.148:0/4228714749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d80c8290 0x7fa6d80a9f30 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7fa6d8084570 tx=0x7fa6c80090f0).ready entity=mon.0 client_cookie=db0fbedfe13d3df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:44.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6cffff700 1 -- 172.21.15.148:0/4228714749 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800b5a0 con 0x7fa6d80c8290 2023-10-24T02:03:44.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6cffff700 1 -- 172.21.15.148:0/4228714749 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800b700 con 0x7fa6d80c8290 2023-10-24T02:03:44.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6cffff700 1 -- 172.21.15.148:0/4228714749 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800ba80 con 0x7fa6d80c8290 2023-10-24T02:03:44.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 -- 172.21.15.148:0/4228714749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d80c8290 msgr2=0x7fa6d80a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:44.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/4228714749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d80c8290 0x7fa6d80a9f30 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7fa6d8084570 tx=0x7fa6c80090f0).stop 2023-10-24T02:03:44.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 -- 172.21.15.148:0/4228714749 shutdown_connections 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/4228714749 >> v2:172.21.15.150:3300/0 conn(0x7fa6d81544b0 0x7fa6d80a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/4228714749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d80c8290 0x7fa6d80a9f30 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.578+0000 7fa6df5a8700 1 -- 172.21.15.148:0/4228714749 >> 172.21.15.148:0/4228714749 conn(0x7fa6d80945d0 msgr2=0x7fa6d806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.579+0000 7fa6df5a8700 1 -- 172.21.15.148:0/4228714749 shutdown_connections 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.579+0000 7fa6df5a8700 1 -- 172.21.15.148:0/4228714749 wait complete. 2023-10-24T02:03:44.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.580+0000 7fa6df5a8700 1 Processor -- start 2023-10-24T02:03:44.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.580+0000 7fa6df5a8700 1 -- start start 2023-10-24T02:03:44.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.580+0000 7fa6df5a8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6d80aa420 0x7fa6d80ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6d80c8290 0x7fa6d80b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8154890 con 0x7fa6d81544b0 2023-10-24T02:03:44.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8155410 con 0x7fa6d80aa420 2023-10-24T02:03:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8154ae0 con 0x7fa6d80c8290 2023-10-24T02:03:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50786/0 (socket says 172.21.15.148:50786) 2023-10-24T02:03:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 -- 172.21.15.148:0/214312021 learned_addr learned my addr 172.21.15.148:0/214312021 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:44.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6dd344700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6d80aa420 0x7fa6d80ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6dcb43700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6d80c8290 0x7fa6d80b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 -- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6d80c8290 msgr2=0x7fa6d80b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6d80c8290 0x7fa6d80b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 -- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6d80aa420 msgr2=0x7fa6d80ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:44.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6d80aa420 0x7fa6d80ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:44.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 -- 172.21.15.148:0/214312021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8009370 con 0x7fa6d81544b0 2023-10-24T02:03:44.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6ddb45700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7fa6d000c4c0 tx=0x7fa6d0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:44.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0002ea0 con 0x7fa6d81544b0 2023-10-24T02:03:44.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00123f0 con 0x7fa6d81544b0 2023-10-24T02:03:44.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d8154dc0 con 0x7fa6d81544b0 2023-10-24T02:03:44.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00127b0 con 0x7fa6d81544b0 2023-10-24T02:03:44.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.581+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d80ad910 con 0x7fa6d81544b0 2023-10-24T02:03:44.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.582+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d81555a0 con 0x7fa6d81544b0 2023-10-24T02:03:44.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.583+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 104) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fa6d0012ba0 con 0x7fa6d81544b0 2023-10-24T02:03:44.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.583+0000 7fa6cd7fa700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 0x7fa6bc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:44.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.583+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(219..219 src has 1..219) v4 ==== 6638+0+0 (secure 0 0 0) 0x7fa6d00794b0 con 0x7fa6d81544b0 2023-10-24T02:03:44.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.583+0000 7fa6dd344700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 0x7fa6bc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:44.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.583+0000 7fa6dd344700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 0x7fa6bc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa6d400f570 tx=0x7fa6d4007750).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:44.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.587+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa6d0047af0 con 0x7fa6d81544b0 2023-10-24T02:03:44.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.750+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6d806c6b0 con 0x7fa6d81544b0 2023-10-24T02:03:44.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:44.891+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa6d0077250 con 0x7fa6d81544b0 2023-10-24T02:03:45.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.448+0000 7fa6cd7fa700 1 -- 172.21.15.148:0/214312021 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v220) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa6d00745c0 con 0x7fa6d81544b0 2023-10-24T02:03:45.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 msgr2=0x7fa6bc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 0x7fa6bc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa6d400f570 tx=0x7fa6d4007750).stop 2023-10-24T02:03:45.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 msgr2=0x7fa6d80ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7fa6d000c4c0 tx=0x7fa6d0007de0).stop 2023-10-24T02:03:45.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 shutdown_connections 2023-10-24T02:03:45.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa6d81544b0 0x7fa6d80ab460 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6bc05f030 0x7fa6bc0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6d80aa420 0x7fa6d80ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 --2- 172.21.15.148:0/214312021 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6d80c8290 0x7fa6d80b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.454 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 >> 172.21.15.148:0/214312021 conn(0x7fa6d80945d0 msgr2=0x7fa6d80c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:45.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 shutdown_connections 2023-10-24T02:03:45.455 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.452+0000 7fa6df5a8700 1 -- 172.21.15.148:0/214312021 wait complete. 2023-10-24T02:03:45.455 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_metadata' removed 2023-10-24T02:03:45.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-24T02:03:45.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.583+0000 7f67647ab700 1 Processor -- start 2023-10-24T02:03:45.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.583+0000 7f67647ab700 1 -- start start 2023-10-24T02:03:45.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f67647ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c1544b0 0x7f675c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f67647ab700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f675c0aa640 0x7f675c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f67647ab700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0c6270 con 0x7f675c0c8290 2023-10-24T02:03:45.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f67647ab700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c0c60e0 con 0x7f675c0aa640 2023-10-24T02:03:45.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f67647ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0c0c80 con 0x7f675c1544b0 2023-10-24T02:03:45.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f6762d48700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f675c0aa640 0x7f675c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f6761d46700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f675c0c8290 0x7f675c0a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47802/0 (socket says 172.21.15.148:47802) 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f6761d46700 1 -- 172.21.15.148:0/357911385 learned_addr learned my addr 172.21.15.148:0/357911385 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.584+0000 7f6762547700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c1544b0 0x7f675c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6762d48700 1 -- 172.21.15.148:0/357911385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c1544b0 msgr2=0x7f675c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6762d48700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c1544b0 0x7f675c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6762d48700 1 -- 172.21.15.148:0/357911385 >> v1:172.21.15.148:6789/0 conn(0x7f675c0c8290 legacy=0x7f675c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6761545700 1 -- 172.21.15.148:0/357911385 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549073228 0 0) 0x7f675c0c6270 con 0x7f675c0c8290 2023-10-24T02:03:45.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6762d48700 1 -- 172.21.15.148:0/357911385 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0c0f40 con 0x7f675c0aa640 2023-10-24T02:03:45.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6762d48700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c6700 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f6754009760 tx=0x7f6754009060).ready entity=mon.0 client_cookie=420c3b4bd9e210ab server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:45.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6761545700 1 -- 172.21.15.148:0/357911385 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400f510 con 0x7f675c0aa640 2023-10-24T02:03:45.589 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6761545700 1 -- 172.21.15.148:0/357911385 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400f670 con 0x7f675c0aa640 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f6761545700 1 -- 172.21.15.148:0/357911385 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400f9f0 con 0x7f675c0aa640 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f67647ab700 1 -- 172.21.15.148:0/357911385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 msgr2=0x7f675c0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.585+0000 7f67647ab700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c6700 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f6754009760 tx=0x7f6754009060).stop 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 -- 172.21.15.148:0/357911385 shutdown_connections 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c6700 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.590 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 --2- 172.21.15.148:0/357911385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c1544b0 0x7f675c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 -- 172.21.15.148:0/357911385 >> 172.21.15.148:0/357911385 conn(0x7f675c0945d0 msgr2=0x7f675c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 -- 172.21.15.148:0/357911385 shutdown_connections 2023-10-24T02:03:45.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.586+0000 7f67647ab700 1 -- 172.21.15.148:0/357911385 wait complete. 2023-10-24T02:03:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 Processor -- start 2023-10-24T02:03:45.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 -- start start 2023-10-24T02:03:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 0x7f675c14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c1544b0 0x7f675c151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0aeb90 con 0x7f675c0aa640 2023-10-24T02:03:45.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0adf80 con 0x7f675c1544b0 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.587+0000 7f67647ab700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0ae260 con 0x7f675c0c8290 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50804/0 (socket says 172.21.15.148:50804) 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 -- 172.21.15.148:0/1341297376 learned_addr learned my addr 172.21.15.148:0/1341297376 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6761d46700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 0x7f675c14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762d48700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c1544b0 0x7f675c151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 -- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 msgr2=0x7f675c14ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 0x7f675c14ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 -- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c1544b0 msgr2=0x7f675c151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:45.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c1544b0 0x7f675c151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:45.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 -- 172.21.15.148:0/1341297376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540092a0 con 0x7f675c0aa640 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6761d46700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 0x7f675c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f6762547700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f6758009e70 tx=0x7f675800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800caa0 con 0x7f675c0aa640 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675800f040 con 0x7f675c0aa640 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c0ae540 con 0x7f675c0aa640 2023-10-24T02:03:45.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800ce10 con 0x7f675c0aa640 2023-10-24T02:03:45.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.588+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c0c9cc0 con 0x7f675c0aa640 2023-10-24T02:03:45.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.589+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c06c6b0 con 0x7f675c0aa640 2023-10-24T02:03:45.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.590+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6758013610 con 0x7f675c0aa640 2023-10-24T02:03:45.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.590+0000 7f67527fc700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 0x7f6740061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:45.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.590+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 6200+0+0 (secure 0 0 0) 0x7f675807a980 con 0x7f675c0aa640 2023-10-24T02:03:45.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.590+0000 7f6761d46700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 0x7f6740061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:45.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.591+0000 7f6761d46700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 0x7f6740061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f675c0c80a0 tx=0x7f674c007bb0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:45.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.594+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f675804bc00 con 0x7f675c0aa640 2023-10-24T02:03:45.758 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:45.758+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f675c0c1220 con 0x7f675c0aa640 2023-10-24T02:03:46.449 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.448+0000 7f67527fc700 1 -- 172.21.15.148:0/1341297376 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v221) v1 ==== 169+0+0 (secure 0 0 0) 0x7f675804f220 con 0x7f675c0aa640 2023-10-24T02:03:46.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.450+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 msgr2=0x7f6740061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.450+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 0x7f6740061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f675c0c80a0 tx=0x7f674c007bb0).stop 2023-10-24T02:03:46.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.450+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 msgr2=0x7f675c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.450+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f6758009e70 tx=0x7f675800b040).stop 2023-10-24T02:03:46.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 shutdown_connections 2023-10-24T02:03:46.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f674005f150 0x7f6740061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c1544b0 0x7f675c151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f675c0aa640 0x7f675c0c97d0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 --2- 172.21.15.148:0/1341297376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f675c0c8290 0x7f675c14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 >> 172.21.15.148:0/1341297376 conn(0x7f675c0945d0 msgr2=0x7f675c063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:46.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 shutdown_connections 2023-10-24T02:03:46.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.451+0000 7f67647ab700 1 -- 172.21.15.148:0/1341297376 wait complete. 2023-10-24T02:03:46.454 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'cephfs_data' removed 2023-10-24T02:03:46.464 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-24T02:03:46.580 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.580+0000 7f1834974700 1 Processor -- start 2023-10-24T02:03:46.581 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.580+0000 7f1834974700 1 -- start start 2023-10-24T02:03:46.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f1834974700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1830154430 0x7f1830154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.583 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f1834974700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18300bffd0 0x7f18300c0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f1834974700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300c71d0 con 0x7f1830098bd0 2023-10-24T02:03:46.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f1834974700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300c6a10 con 0x7f1830154430 2023-10-24T02:03:46.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f1834974700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c9410 con 0x7f18300bffd0 2023-10-24T02:03:46.584 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1830154430 0x7f1830154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1830154430 0x7f1830154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50810/0 (socket says 172.21.15.148:50810) 2023-10-24T02:03:46.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 -- 172.21.15.148:0/3826468493 learned_addr learned my addr 172.21.15.148:0/3826468493 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:46.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 -- 172.21.15.148:0/3826468493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18300bffd0 msgr2=0x7f18300c0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:46.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 --2- 172.21.15.148:0/3826468493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18300bffd0 0x7f18300c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:46.585 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.581+0000 7f182e59c700 1 -- 172.21.15.148:0/3826468493 >> v1:172.21.15.150:6789/0 conn(0x7f1830098bd0 legacy=0x7f18300c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:46.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f182e59c700 1 -- 172.21.15.148:0/3826468493 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300c0950 con 0x7f1830154430 2023-10-24T02:03:46.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f182e59c700 1 --2- 172.21.15.148:0/3826468493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1830154430 0x7f1830154810 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f1824006fd0 tx=0x7f18240090f0).ready entity=mon.0 client_cookie=38670470050d5587 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f182d59a700 1 -- 172.21.15.148:0/3826468493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400b600 con 0x7f1830154430 2023-10-24T02:03:46.586 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f182d59a700 1 -- 172.21.15.148:0/3826468493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400b760 con 0x7f1830154430 2023-10-24T02:03:46.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f182d59a700 1 -- 172.21.15.148:0/3826468493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400bae0 con 0x7f1830154430 2023-10-24T02:03:46.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 -- 172.21.15.148:0/3826468493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1830154430 msgr2=0x7f1830154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 --2- 172.21.15.148:0/3826468493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1830154430 0x7f1830154810 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 rx=0x7f1824006fd0 tx=0x7f18240090f0).stop 2023-10-24T02:03:46.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 -- 172.21.15.148:0/3826468493 shutdown_connections 2023-10-24T02:03:46.587 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 --2- 172.21.15.148:0/3826468493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18300bffd0 0x7f18300c0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:46.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 --2- 172.21.15.148:0/3826468493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1830154430 0x7f1830154810 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 -- 172.21.15.148:0/3826468493 >> 172.21.15.148:0/3826468493 conn(0x7f18300cb070 msgr2=0x7f18300cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:46.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 -- 172.21.15.148:0/3826468493 shutdown_connections 2023-10-24T02:03:46.588 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.582+0000 7f1834974700 1 -- 172.21.15.148:0/3826468493 wait complete. 2023-10-24T02:03:46.591 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.583+0000 7f1834974700 1 Processor -- start 2023-10-24T02:03:46.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.583+0000 7f1834974700 1 -- start start 2023-10-24T02:03:46.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 0x7f18301528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1830154430 0x7f18300ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.592 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301646f0 con 0x7f18300bffd0 2023-10-24T02:03:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830142a20 con 0x7f1830154430 2023-10-24T02:03:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f1834974700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830153b80 con 0x7f1830098bd0 2023-10-24T02:03:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f182dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f182dd9b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50816/0 (socket says 172.21.15.148:50816) 2023-10-24T02:03:46.593 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f182dd9b700 1 -- 172.21.15.148:0/3221197470 learned_addr learned my addr 172.21.15.148:0/3221197470 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:46.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f182ed9d700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1830154430 0x7f18300ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.584+0000 7f182e59c700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 0x7f18301528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 -- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 msgr2=0x7f18301528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 0x7f18301528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 -- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1830154430 msgr2=0x7f18300ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1830154430 0x7f18300ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 -- 172.21.15.148:0/3221197470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009370 con 0x7f18300bffd0 2023-10-24T02:03:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182e59c700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 0x7f18301528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:46.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f182dd9b700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f182000c440 tx=0x7f1820007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000cea0 con 0x7f18300bffd0 2023-10-24T02:03:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000f470 con 0x7f18300bffd0 2023-10-24T02:03:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18301532e0 con 0x7f18300bffd0 2023-10-24T02:03:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000f810 con 0x7f18300bffd0 2023-10-24T02:03:46.596 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.585+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18301538a0 con 0x7f18300bffd0 2023-10-24T02:03:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.586+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830142bb0 con 0x7f18300bffd0 2023-10-24T02:03:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.586+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f182000fc40 con 0x7f18300bffd0 2023-10-24T02:03:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.587+0000 7f181e7fc700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 0x7f1810061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.587+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f18200794c0 con 0x7f18300bffd0 2023-10-24T02:03:46.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.587+0000 7f182e59c700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 0x7f1810061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.587+0000 7f182e59c700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 0x7f1810061640 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1824009130 tx=0x7f1824017000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.591+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1820048af0 con 0x7f18300bffd0 2023-10-24T02:03:46.756 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.755+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f1830062c40 con 0x7f18300bffd0 2023-10-24T02:03:46.759 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.759+0000 7f181e7fc700 1 -- 172.21.15.148:0/3221197470 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7f182004a990 con 0x7f18300bffd0 2023-10-24T02:03:46.761 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 msgr2=0x7f1810061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 0x7f1810061640 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1824009130 tx=0x7f1824017000).stop 2023-10-24T02:03:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 msgr2=0x7f18300ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7f182000c440 tx=0x7f1820007de0).stop 2023-10-24T02:03:46.762 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 shutdown_connections 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f181005f180 0x7f1810061640 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1830154430 0x7f18300ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1830098bd0 0x7f18301528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 --2- 172.21.15.148:0/3221197470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18300bffd0 0x7f18300ae480 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 >> 172.21.15.148:0/3221197470 conn(0x7f18300cb070 msgr2=0x7f18300a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:46.763 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 shutdown_connections 2023-10-24T02:03:46.764 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.761+0000 7f1834974700 1 -- 172.21.15.148:0/3221197470 wait complete. 2023-10-24T02:03:46.773 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-24T02:03:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.893+0000 7fede26e2700 1 Processor -- start 2023-10-24T02:03:46.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.893+0000 7fede26e2700 1 -- start start 2023-10-24T02:03:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede26e2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feddc0a4d10 0x7feddc062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede26e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede26e2700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0bd470 con 0x7feddc1521c0 2023-10-24T02:03:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede26e2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc062fd0 con 0x7feddc0a4d10 2023-10-24T02:03:46.896 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede26e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0a5190 con 0x7feddc062b40 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede0c7f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feddc0a4d10 0x7feddc062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddbfff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7feddc1521c0 0x7feddc066bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34238/0 (socket says 172.21.15.148:34238) 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7feddc0a4d10 0x7feddc062650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:33486/0 (socket says 172.21.15.148:33486) 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddbfff700 1 -- 172.21.15.148:0/3150778947 learned_addr learned my addr 172.21.15.148:0/3150778947 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:46.897 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede0c7f700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:45072/0 (socket says 172.21.15.148:45072) 2023-10-24T02:03:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddaffd700 1 -- 172.21.15.148:0/3150778947 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401613899 0 0) 0x7feddc0bd470 con 0x7feddc1521c0 2023-10-24T02:03:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddaffd700 1 -- 172.21.15.148:0/3150778947 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc40033f0 con 0x7feddc1521c0 2023-10-24T02:03:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 -- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 msgr2=0x7feddc069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.898 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 -- 172.21.15.148:0/3150778947 >> v1:172.21.15.150:6789/0 conn(0x7feddc1521c0 legacy=0x7feddc066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 -- 172.21.15.148:0/3150778947 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc156bc0 con 0x7feddc0a4d10 2023-10-24T02:03:46.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7fede0c7f700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:46.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddb7fe700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc0a4d10 0x7feddc062650 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fedd0009760 tx=0x7fedd0009060).ready entity=mon.1 client_cookie=68714de02b9bd620 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.894+0000 7feddaffd700 1 -- 172.21.15.148:0/3150778947 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00090d0 con 0x7feddc0a4d10 2023-10-24T02:03:46.899 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7feddaffd700 1 -- 172.21.15.148:0/3150778947 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd000d4a0 con 0x7feddc0a4d10 2023-10-24T02:03:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7feddaffd700 1 -- 172.21.15.148:0/3150778947 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000d820 con 0x7feddc0a4d10 2023-10-24T02:03:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 -- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc0a4d10 msgr2=0x7feddc062650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc0a4d10 0x7feddc062650 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fedd0009760 tx=0x7fedd0009060).stop 2023-10-24T02:03:46.900 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 -- 172.21.15.148:0/3150778947 shutdown_connections 2023-10-24T02:03:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc062b40 0x7feddc069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 --2- 172.21.15.148:0/3150778947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc0a4d10 0x7feddc062650 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 -- 172.21.15.148:0/3150778947 >> 172.21.15.148:0/3150778947 conn(0x7feddc0c7d20 msgr2=0x7feddc0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 -- 172.21.15.148:0/3150778947 shutdown_connections 2023-10-24T02:03:46.901 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.895+0000 7fede26e2700 1 -- 172.21.15.148:0/3150778947 wait complete. 2023-10-24T02:03:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.896+0000 7fede26e2700 1 Processor -- start 2023-10-24T02:03:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.896+0000 7fede26e2700 1 -- start start 2023-10-24T02:03:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc062b40 0x7feddc145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.904 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc1521c0 0x7feddc144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc163390 con 0x7feddc0a4d10 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0adb30 con 0x7feddc062b40 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede26e2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc163600 con 0x7feddc1521c0 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7feddb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.905 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7feddb7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50822/0 (socket says 172.21.15.148:50822) 2023-10-24T02:03:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7feddb7fe700 1 -- 172.21.15.148:0/2938659452 learned_addr learned my addr 172.21.15.148:0/2938659452 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7feddbfff700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc062b40 0x7feddc145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.897+0000 7fede0c7f700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc1521c0 0x7feddc144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 -- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc1521c0 msgr2=0x7feddc144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.906 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc1521c0 0x7feddc144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 -- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc062b40 msgr2=0x7feddc145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc062b40 0x7feddc145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 -- 172.21.15.148:0/2938659452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4009a20 con 0x7feddc0a4d10 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7feddb7fe700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7fedd000d940 tx=0x7fedd0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0006990 con 0x7feddc0a4d10 2023-10-24T02:03:46.907 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd0012990 con 0x7feddc0a4d10 2023-10-24T02:03:46.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd00092a0 con 0x7feddc0a4d10 2023-10-24T02:03:46.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0012d10 con 0x7feddc0a4d10 2023-10-24T02:03:46.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.898+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc1629a0 con 0x7feddc0a4d10 2023-10-24T02:03:46.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.899+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc06c6b0 con 0x7feddc0a4d10 2023-10-24T02:03:46.908 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.899+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fedd001c630 con 0x7feddc0a4d10 2023-10-24T02:03:46.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.899+0000 7fedc3fff700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 0x7fedc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:46.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.900+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fedd007b3f0 con 0x7feddc0a4d10 2023-10-24T02:03:46.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.900+0000 7feddbfff700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 0x7fedc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:46.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.900+0000 7feddbfff700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 0x7fedc8061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fedcc005750 tx=0x7fedcc009040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:46.909 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:46.904+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fedd004c810 con 0x7feddc0a4d10 2023-10-24T02:03:47.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.068+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7feddc1630a0 con 0x7feddc0a4d10 2023-10-24T02:03:47.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.072+0000 7fedc3fff700 1 -- 172.21.15.148:0/2938659452 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7feddc1630a0 con 0x7feddc0a4d10 2023-10-24T02:03:47.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 msgr2=0x7fedc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 0x7fedc8061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fedcc005750 tx=0x7fedcc009040).stop 2023-10-24T02:03:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 msgr2=0x7feddc162200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7fedd000d940 tx=0x7fedd0016000).stop 2023-10-24T02:03:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 shutdown_connections 2023-10-24T02:03:47.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7feddc1521c0 0x7feddc144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fedc805f150 0x7fedc8061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feddc062b40 0x7feddc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 --2- 172.21.15.148:0/2938659452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feddc0a4d10 0x7feddc162200 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 >> 172.21.15.148:0/2938659452 conn(0x7feddc0c7d20 msgr2=0x7feddc1468d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 shutdown_connections 2023-10-24T02:03:47.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.074+0000 7fede26e2700 1 -- 172.21.15.148:0/2938659452 wait complete. 2023-10-24T02:03:47.086 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-24T02:03:47.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.199+0000 7f7920331700 1 Processor -- start 2023-10-24T02:03:47.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.199+0000 7f7920331700 1 -- start start 2023-10-24T02:03:47.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.200+0000 7f7920331700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79181543a0 0x7f79180a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:47.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.200+0000 7f7920331700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180bf5c0 con 0x7f79180a84b0 2023-10-24T02:03:47.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f7920331700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180be9b0 con 0x7f79180964f0 2023-10-24T02:03:47.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f7920331700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180bec90 con 0x7f79181543a0 2023-10-24T02:03:47.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79181543a0 0x7f79180a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:47.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d8cc700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f79180a84b0 0x7f7918095de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47810/0 (socket says 172.21.15.148:47810) 2023-10-24T02:03:47.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f79181543a0 0x7f79180a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50824/0 (socket says 172.21.15.148:50824) 2023-10-24T02:03:47.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d8cc700 1 -- 172.21.15.148:0/612923836 learned_addr learned my addr 172.21.15.148:0/612923836 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:47.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 -- 172.21.15.148:0/612923836 >> v1:172.21.15.150:6789/0 conn(0x7f79180964f0 legacy=0x7f79180a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 -- 172.21.15.148:0/612923836 >> v1:172.21.15.148:6789/0 conn(0x7f79180a84b0 legacy=0x7f7918095de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d0cb700 1 -- 172.21.15.148:0/612923836 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007506662 0 0) 0x7f79180bf5c0 con 0x7f79180a84b0 2023-10-24T02:03:47.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 -- 172.21.15.148:0/612923836 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180bef70 con 0x7f79181543a0 2023-10-24T02:03:47.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791e0cd700 1 --2- 172.21.15.148:0/612923836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79181543a0 0x7f79180a7fc0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f7908009e60 tx=0x7f7908009780).ready entity=mon.0 client_cookie=fde5713a4d4780fb server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:47.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d0cb700 1 -- 172.21.15.148:0/612923836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f79181543a0 2023-10-24T02:03:47.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d0cb700 1 -- 172.21.15.148:0/612923836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800bcc0 con 0x7f79181543a0 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.201+0000 7f791d0cb700 1 -- 172.21.15.148:0/612923836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908012620 con 0x7f79181543a0 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 -- 172.21.15.148:0/612923836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79181543a0 msgr2=0x7f79180a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 --2- 172.21.15.148:0/612923836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79181543a0 0x7f79180a7fc0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f7908009e60 tx=0x7f7908009780).stop 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 -- 172.21.15.148:0/612923836 shutdown_connections 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 --2- 172.21.15.148:0/612923836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79181543a0 0x7f79180a7fc0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 -- 172.21.15.148:0/612923836 >> 172.21.15.148:0/612923836 conn(0x7f79180630f0 msgr2=0x7f79180c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:47.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 -- 172.21.15.148:0/612923836 shutdown_connections 2023-10-24T02:03:47.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.202+0000 7f7920331700 1 -- 172.21.15.148:0/612923836 wait complete. 2023-10-24T02:03:47.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.203+0000 7f7920331700 1 Processor -- start 2023-10-24T02:03:47.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.203+0000 7f7920331700 1 -- start start 2023-10-24T02:03:47.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79180964f0 0x7f791814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:47.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:47.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79181543a0 0x7f79180bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918150a60 con 0x7f79180a84b0 2023-10-24T02:03:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180aadf0 con 0x7f79180964f0 2023-10-24T02:03:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180ab0d0 con 0x7f79181543a0 2023-10-24T02:03:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:47.211 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50836/0 (socket says 172.21.15.148:50836) 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 -- 172.21.15.148:0/3873564642 learned_addr learned my addr 172.21.15.148:0/3873564642 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791e0cd700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79180964f0 0x7f791814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791e8ce700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79181543a0 0x7f79180bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 -- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79181543a0 msgr2=0x7f79180bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79181543a0 0x7f79180bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 -- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79180964f0 msgr2=0x7f791814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79180964f0 0x7f791814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 -- 172.21.15.148:0/3873564642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009a20 con 0x7f79180a84b0 2023-10-24T02:03:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f791d8cc700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f790c00c4c0 tx=0x7f790c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0070d0 con 0x7f79180a84b0 2023-10-24T02:03:47.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c007230 con 0x7f79180a84b0 2023-10-24T02:03:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180ab3b0 con 0x7f79180a84b0 2023-10-24T02:03:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0075b0 con 0x7f79180a84b0 2023-10-24T02:03:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.204+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79180c3c60 con 0x7f79180a84b0 2023-10-24T02:03:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.205+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918150830 con 0x7f79180a84b0 2023-10-24T02:03:47.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.206+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f790c0059b0 con 0x7f79180a84b0 2023-10-24T02:03:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.206+0000 7f79167fc700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 0x7f7904061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.206+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f790c079710 con 0x7f79180a84b0 2023-10-24T02:03:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.206+0000 7f791e0cd700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 0x7f7904061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:47.215 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.207+0000 7f791e0cd700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 0x7f7904061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f79080099f0 tx=0x7f7908009780).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:47.216 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.210+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7918150830 con 0x7f79180a84b0 2023-10-24T02:03:47.444 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.443+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f7918150830 con 0x7f79180a84b0 2023-10-24T02:03:47.448 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.448+0000 7f79167fc700 1 -- 172.21.15.148:0/3873564642 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3057) v1 ==== 155+0+0 (secure 0 0 0) 0x7f7918150830 con 0x7f79180a84b0 2023-10-24T02:03:47.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 msgr2=0x7f7904061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 0x7f7904061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f79080099f0 tx=0x7f7908009780).stop 2023-10-24T02:03:47.451 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 msgr2=0x7f79180c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:47.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f790c00c4c0 tx=0x7f790c007c10).stop 2023-10-24T02:03:47.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 shutdown_connections 2023-10-24T02:03:47.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79181543a0 0x7f79180bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f790405f150 0x7f7904061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.452 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79180964f0 0x7f791814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 --2- 172.21.15.148:0/3873564642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79180a84b0 0x7f79180c3770 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:47.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 >> 172.21.15.148:0/3873564642 conn(0x7f79180630f0 msgr2=0x7f7918067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:47.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.450+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 shutdown_connections 2023-10-24T02:03:47.453 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:47.451+0000 7f7920331700 1 -- 172.21.15.148:0/3873564642 wait complete. 2023-10-24T02:03:47.462 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-10-24T02:03:47.463 INFO:tasks.cephfs_test_runner: 2023-10-24T02:03:47.463 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-24T02:03:47.463 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5662.182s 2023-10-24T02:03:47.463 INFO:tasks.cephfs_test_runner: 2023-10-24T02:03:47.464 INFO:tasks.cephfs_test_runner:OK 2023-10-24T02:03:47.464 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-24T02:03:47.475 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-24T02:03:47.501 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-24T02:03:47.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.502 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T02:03:47.517 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-24T02:03:47.517 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-24T02:03:47.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-24T02:03:47.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-24T02:03:47.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-24T02:03:47.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.783 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2023-10-24T02:03:47.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2023-10-24T02:03:47.865 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2023-10-24T02:03:47.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:03:47.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.867 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T02:03:47.886 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-24T02:03:47.886 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-24T02:03:47.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.887 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-24T02:03:47.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:03:47.910 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:03:47.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:47.969 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-24T02:03:48.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:48.071 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-10-24T02:03:48.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:48.169 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-10-24T02:03:48.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-24T02:03:48.185 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-10-24T02:03:48.254 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2023-10-24T02:03:48.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:03:48.256 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-24T02:03:48.265 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-24T02:03:48.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:48.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.378+0000 7fa71b87f700 1 Processor -- start 2023-10-24T02:03:48.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.378+0000 7fa71b87f700 1 -- start start 2023-10-24T02:03:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa7140c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7140c6710 0x7fa7140aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa714158770 0x7fa714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140aa8e0 con 0x7fa7140c6710 2023-10-24T02:03:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140c0960 con 0x7fa714158770 2023-10-24T02:03:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa71b87f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140c0c40 con 0x7fa7140aa010 2023-10-24T02:03:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa718e1a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7140c6710 0x7fa7140aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa718e1a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fa7140c6710 0x7fa7140aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50850/0 (socket says 172.21.15.148:50850) 2023-10-24T02:03:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.379+0000 7fa718e1a700 1 -- 172.21.15.148:0/2004486081 learned_addr learned my addr 172.21.15.148:0/2004486081 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 -- 172.21.15.148:0/2004486081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 msgr2=0x7fa7140c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 --2- 172.21.15.148:0/2004486081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa7140c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 -- 172.21.15.148:0/2004486081 >> v2:172.21.15.150:3300/0 conn(0x7fa714158770 msgr2=0x7fa714069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:48.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 --2- 172.21.15.148:0/2004486081 >> v2:172.21.15.150:3300/0 conn(0x7fa714158770 0x7fa714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 -- 172.21.15.148:0/2004486081 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140c0f20 con 0x7fa7140c6710 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa718e1a700 1 --2- 172.21.15.148:0/2004486081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140aa3f0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fa7140c6b90 tx=0x7fa7040090f0).ready entity=mon.0 client_cookie=c115a1cde2104472 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa70bfff700 1 -- 172.21.15.148:0/2004486081 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400b600 con 0x7fa7140c6710 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa70bfff700 1 -- 172.21.15.148:0/2004486081 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400b760 con 0x7fa7140c6710 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa70bfff700 1 -- 172.21.15.148:0/2004486081 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400bae0 con 0x7fa7140c6710 2023-10-24T02:03:48.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 -- 172.21.15.148:0/2004486081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 msgr2=0x7fa7140aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 --2- 172.21.15.148:0/2004486081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140aa3f0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 rx=0x7fa7140c6b90 tx=0x7fa7040090f0).stop 2023-10-24T02:03:48.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 -- 172.21.15.148:0/2004486081 shutdown_connections 2023-10-24T02:03:48.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 --2- 172.21.15.148:0/2004486081 >> v2:172.21.15.150:3300/0 conn(0x7fa714158770 0x7fa714069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:48.386 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 --2- 172.21.15.148:0/2004486081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa7140c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:48.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 --2- 172.21.15.148:0/2004486081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140aa3f0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 -- 172.21.15.148:0/2004486081 >> 172.21.15.148:0/2004486081 conn(0x7fa7140caf40 msgr2=0x7fa7140cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:48.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 -- 172.21.15.148:0/2004486081 shutdown_connections 2023-10-24T02:03:48.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.380+0000 7fa71b87f700 1 -- 172.21.15.148:0/2004486081 wait complete. 2023-10-24T02:03:48.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 Processor -- start 2023-10-24T02:03:48.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 -- start start 2023-10-24T02:03:48.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa714152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 0x7fa714165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140aec30 con 0x7fa7140c6710 2023-10-24T02:03:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140ae020 con 0x7fa714158770 2023-10-24T02:03:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.382+0000 7fa71b87f700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140ae300 con 0x7fa7140aa010 2023-10-24T02:03:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50858/0 (socket says 172.21.15.148:50858) 2023-10-24T02:03:48.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 -- 172.21.15.148:0/1150691623 learned_addr learned my addr 172.21.15.148:0/1150691623 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa719e1c700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 0x7fa714165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa71961b700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa714152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 -- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 msgr2=0x7fa714152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa714152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 -- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 msgr2=0x7fa714165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 0x7fa714165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 -- 172.21.15.148:0/1150691623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009370 con 0x7fa7140c6710 2023-10-24T02:03:48.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa719e1c700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 0x7fa714165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:48.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa718e1a700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fa704009130 tx=0x7fa704017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400b8d0 con 0x7fa7140c6710 2023-10-24T02:03:48.393 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400ba30 con 0x7fa7140c6710 2023-10-24T02:03:48.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7140ae5e0 con 0x7fa7140c6710 2023-10-24T02:03:48.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70401c670 con 0x7fa7140c6710 2023-10-24T02:03:48.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.383+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7140afe60 con 0x7fa7140c6710 2023-10-24T02:03:48.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.384+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7140aeda0 con 0x7fa7140c6710 2023-10-24T02:03:48.394 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.384+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa70401ca20 con 0x7fa7140c6710 2023-10-24T02:03:48.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.385+0000 7fa7097fa700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 0x7fa6f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.385+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fa70407bdb0 con 0x7fa7140c6710 2023-10-24T02:03:48.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.385+0000 7fa71961b700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 0x7fa6f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.395 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.385+0000 7fa71961b700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 0x7fa6f8061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa710007f30 tx=0x7fa710007420).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.396 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.389+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa70404d1d0 con 0x7fa7140c6710 2023-10-24T02:03:48.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.554+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa71406c6b0 con 0x7fa7140c6710 2023-10-24T02:03:48.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.555+0000 7fa7097fa700 1 -- 172.21.15.148:0/1150691623 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v221) v1 ==== 74+0+14533 (secure 0 0 0) 0x7fa70402a030 con 0x7fa7140c6710 2023-10-24T02:03:48.557 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:48.557 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":221,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:46.444243+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"221","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6836/707171421":"2023-10-25T02:03:42.428453+0000","172.21.15.150:6834/707171421":"2023-10-25T02:03:42.428453+0000","172.21.15.150:0/1822785529":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/2756551396":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/1339128228":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/74765665":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/205949952":"2023-10-25T02:03:42.413453+0000","172.21.15.150:6833/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:6832/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/1638296492":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/2328274838":"2023-10-25T02:03:35.125379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 msgr2=0x7fa6f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 0x7fa6f8061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa710007f30 tx=0x7fa710007420).stop 2023-10-24T02:03:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 msgr2=0x7fa7140c29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.559 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7fa704009130 tx=0x7fa704017000).stop 2023-10-24T02:03:48.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 shutdown_connections 2023-10-24T02:03:48.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa6f805f150 0x7fa6f8061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa714158770 0x7fa714165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7140aa010 0x7fa714152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.560 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 --2- 172.21.15.148:0/1150691623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7140c6710 0x7fa7140c29f0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 >> 172.21.15.148:0/1150691623 conn(0x7fa7140caf40 msgr2=0x7fa714069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 shutdown_connections 2023-10-24T02:03:48.561 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.557+0000 7fa71b87f700 1 -- 172.21.15.148:0/1150691623 wait complete. 2023-10-24T02:03:48.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-24T02:03:48.571 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:48.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.683+0000 7f6cb9cd5700 1 Processor -- start 2023-10-24T02:03:48.685 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.683+0000 7f6cb9cd5700 1 -- start start 2023-10-24T02:03:48.687 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb9cd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb41543a0 0x7f6cb40a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb9cd5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb40a84b0 0x7f6cb4095de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb9cd5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40bf5c0 con 0x7f6cb40bfa50 2023-10-24T02:03:48.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb9cd5700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb40be9b0 con 0x7f6cb40a84b0 2023-10-24T02:03:48.688 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb9cd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40bec90 con 0x7f6cb41543a0 2023-10-24T02:03:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb40a84b0 0x7f6cb4095de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb2ffd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6cb40a84b0 0x7f6cb4095de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50870/0 (socket says 172.21.15.148:50870) 2023-10-24T02:03:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.684+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/2018941504 learned_addr learned my addr 172.21.15.148:0/2018941504 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb37fe700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb41543a0 0x7f6cb40a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/2018941504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb41543a0 msgr2=0x7f6cb40a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:48.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb2ffd700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb41543a0 0x7f6cb40a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/2018941504 >> v1:172.21.15.150:6789/0 conn(0x7f6cb40bfa50 legacy=0x7f6cb4158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/2018941504 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40bef70 con 0x7f6cb40a84b0 2023-10-24T02:03:48.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb2ffd700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40a84b0 0x7f6cb4095de0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f6ca8006fd0 tx=0x7f6ca80090f0).ready entity=mon.0 client_cookie=eb2b226d0d197dde server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb27fc700 1 -- 172.21.15.148:0/2018941504 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800b690 con 0x7f6cb40a84b0 2023-10-24T02:03:48.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb27fc700 1 -- 172.21.15.148:0/2018941504 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800b7f0 con 0x7f6cb40a84b0 2023-10-24T02:03:48.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb27fc700 1 -- 172.21.15.148:0/2018941504 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800bb70 con 0x7f6cb40a84b0 2023-10-24T02:03:48.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/2018941504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40a84b0 msgr2=0x7f6cb4095de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40a84b0 0x7f6cb4095de0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f6ca8006fd0 tx=0x7f6ca80090f0).stop 2023-10-24T02:03:48.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/2018941504 shutdown_connections 2023-10-24T02:03:48.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb41543a0 0x7f6cb40a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/2018941504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40a84b0 0x7f6cb4095de0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/2018941504 >> 172.21.15.148:0/2018941504 conn(0x7f6cb40630f0 msgr2=0x7f6cb40c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:48.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/2018941504 shutdown_connections 2023-10-24T02:03:48.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.685+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/2018941504 wait complete. 2023-10-24T02:03:48.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 Processor -- start 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 -- start start 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb40a84b0 0x7f6cb4164a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cb41543a0 0x7f6cb414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40aee40 con 0x7f6cb40bfa50 2023-10-24T02:03:48.696 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40c0ac0 con 0x7f6cb41543a0 2023-10-24T02:03:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.687+0000 7f6cb9cd5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40aeb60 con 0x7f6cb40a84b0 2023-10-24T02:03:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50882/0 (socket says 172.21.15.148:50882) 2023-10-24T02:03:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb37fe700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb40a84b0 0x7f6cb4164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.697 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/191583528 learned_addr learned my addr 172.21.15.148:0/191583528 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb3fff700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cb41543a0 0x7f6cb414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb40a84b0 msgr2=0x7f6cb4164a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb40a84b0 0x7f6cb4164a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cb41543a0 msgr2=0x7f6cb414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.698 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cb41543a0 0x7f6cb414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 -- 172.21.15.148:0/191583528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009370 con 0x7f6cb40bfa50 2023-10-24T02:03:48.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb2ffd700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f6ca8011000 tx=0x7f6ca8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8006d90 con 0x7f6cb40bfa50 2023-10-24T02:03:48.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800b960 con 0x7f6cb40bfa50 2023-10-24T02:03:48.699 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb40c0470 con 0x7f6cb40bfa50 2023-10-24T02:03:48.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca801c670 con 0x7f6cb40bfa50 2023-10-24T02:03:48.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.688+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb40ac360 con 0x7f6cb40bfa50 2023-10-24T02:03:48.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.689+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40c02d0 con 0x7f6cb40bfa50 2023-10-24T02:03:48.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.689+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6ca801ca60 con 0x7f6cb40bfa50 2023-10-24T02:03:48.700 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.690+0000 7f6c9b7fe700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 0x7f6ca00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.690+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f6ca807bc80 con 0x7f6cb40bfa50 2023-10-24T02:03:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.690+0000 7f6cb37fe700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 0x7f6ca00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.690+0000 7f6cb37fe700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 0x7f6ca00615e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6ca40075a0 tx=0x7f6ca40097b0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.701 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.694+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6cb40c02d0 con 0x7f6cb40bfa50 2023-10-24T02:03:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.853+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cb40c02d0 con 0x7f6ca005f120 2023-10-24T02:03:48.858 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.856+0000 7f6c9b7fe700 1 -- 172.21.15.148:0/191583528 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70884 (secure 0 0 0) 0x7f6cb40c02d0 con 0x7f6ca005f120 2023-10-24T02:03:48.859 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:48.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 msgr2=0x7f6ca00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.860 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 0x7f6ca00615e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6ca40075a0 tx=0x7f6ca40097b0).stop 2023-10-24T02:03:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 msgr2=0x7f6cb40abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f6ca8011000 tx=0x7f6ca8017000).stop 2023-10-24T02:03:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 shutdown_connections 2023-10-24T02:03:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6ca005f120 0x7f6ca00615e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.861 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cb41543a0 0x7f6cb414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cb40a84b0 0x7f6cb4164a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 --2- 172.21.15.148:0/191583528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6cb40bfa50 0x7f6cb40abe70 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 >> 172.21.15.148:0/191583528 conn(0x7f6cb40630f0 msgr2=0x7f6cb40a7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 shutdown_connections 2023-10-24T02:03:48.862 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.858+0000 7f6cb9cd5700 1 -- 172.21.15.148:0/191583528 wait complete. 2023-10-24T02:03:48.863 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:48.872 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2023-10-24T02:03:48.431513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459656,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752515064,"statfs":{"total":773094113280,"available":770575425536,"internally_reserved":0,"allocated":21962752,"data_stored":11216857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12241,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999304"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.187000+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:35.187000+0000","last_peered":"2023-10-24T02:03:35.187000+0000","last_clean":"2023-10-24T02:03:35.187000+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:35.187000+0000","last_undegraded":"2023-10-24T02:03:35.187000+0000","last_fullsized":"2023-10-24T02:03:35.187000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180506+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:35.180506+0000","last_peered":"2023-10-24T02:03:35.180506+0000","last_clean":"2023-10-24T02:03:35.180506+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:35.180506+0000","last_undegraded":"2023-10-24T02:03:35.180506+0000","last_fullsized":"2023-10-24T02:03:35.180506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420722+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:42.420722+0000","last_peered":"2023-10-24T02:03:42.420722+0000","last_clean":"2023-10-24T02:03:42.420722+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:42.420722+0000","last_undegraded":"2023-10-24T02:03:42.420722+0000","last_fullsized":"2023-10-24T02:03:42.420722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180688+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:35.180688+0000","last_peered":"2023-10-24T02:03:35.180688+0000","last_clean":"2023-10-24T02:03:35.180688+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:35.180688+0000","last_undegraded":"2023-10-24T02:03:35.180688+0000","last_fullsized":"2023-10-24T02:03:35.180688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":212,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420229+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:42.420229+0000","last_peered":"2023-10-24T02:03:42.420229+0000","last_clean":"2023-10-24T02:03:42.420229+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:42.420229+0000","last_undegraded":"2023-10-24T02:03:42.420229+0000","last_fullsized":"2023-10-24T02:03:42.420229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420320+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:42.420320+0000","last_peered":"2023-10-24T02:03:42.420320+0000","last_clean":"2023-10-24T02:03:42.420320+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:42.420320+0000","last_undegraded":"2023-10-24T02:03:42.420320+0000","last_fullsized":"2023-10-24T02:03:42.420320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420830+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:42.420830+0000","last_peered":"2023-10-24T02:03:42.420830+0000","last_clean":"2023-10-24T02:03:42.420830+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:42.420830+0000","last_undegraded":"2023-10-24T02:03:42.420830+0000","last_fullsized":"2023-10-24T02:03:42.420830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.188073+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:35.188073+0000","last_peered":"2023-10-24T02:03:35.188073+0000","last_clean":"2023-10-24T02:03:35.188073+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:35.188073+0000","last_undegraded":"2023-10-24T02:03:35.188073+0000","last_fullsized":"2023-10-24T02:03:35.188073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.423826+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:42.423826+0000","last_peered":"2023-10-24T02:03:42.423826+0000","last_clean":"2023-10-24T02:03:42.423826+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:42.423826+0000","last_undegraded":"2023-10-24T02:03:42.423826+0000","last_fullsized":"2023-10-24T02:03:42.423826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1411349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.245}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.371},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.376}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.46200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2752512,"data_stored":1410896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.442},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575981,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307964,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063876,"statfs":{"total":96636764160,"available":96321409024,"internally_reserved":0,"allocated":2740224,"data_stored":1400893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.878,"15min":0.878},"last":0.31},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.53800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50700000000000001,"5min":0.58299999999999996,"15min":0.627},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82899999999999996,"5min":1.004,"15min":1.004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":1.018,"15min":1.018},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45600000000000002},"max":{"1min":0.751,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575981,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063856,"statfs":{"total":96636764160,"available":96321388544,"internally_reserved":0,"allocated":2760704,"data_stored":1402285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.443}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.311}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.56100000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.434},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.50800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1400792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.216},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.29999999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.23799999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.36699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.438},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1387644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":0.436,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.436},{"interface":"front","average":{"1min":0.373,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.752},"last":0.37}]},{"osd":1,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.41299999999999998,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.72799999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.097},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.167},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":1.056},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.88500000000000001,"15min":1.109},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.40999999999999998},"max":{"1min":0.79400000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":1.155},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79300000000000004,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575981,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307972,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063868,"statfs":{"total":96636764160,"available":96321400832,"internally_reserved":0,"allocated":2748416,"data_stored":1401470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.434},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40999999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.373},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.505}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1401528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.29899999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:48.874 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:48.988 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.987+0000 7fde9c4d7700 1 Processor -- start 2023-10-24T02:03:48.989 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.987+0000 7fde9c4d7700 1 -- start start 2023-10-24T02:03:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9c4d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde940aa010 0x7fde940c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9c4d7700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde940c6710 0x7fde940aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:48.991 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9c4d7700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940c0960 con 0x7fde94158770 2023-10-24T02:03:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9c4d7700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde940aa8e0 con 0x7fde940c6710 2023-10-24T02:03:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9c4d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940c0c40 con 0x7fde940aa010 2023-10-24T02:03:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde99a72700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde940c6710 0x7fde940aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9aa74700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fde94158770 0x7fde94069d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47826/0 (socket says 172.21.15.148:47826) 2023-10-24T02:03:48.992 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde99a72700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fde940c6710 0x7fde940aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50888/0 (socket says 172.21.15.148:50888) 2023-10-24T02:03:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9aa74700 1 -- 172.21.15.148:0/696741818 learned_addr learned my addr 172.21.15.148:0/696741818 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde9a273700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde940aa010 0x7fde940c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.988+0000 7fde99a72700 1 -- 172.21.15.148:0/696741818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde940aa010 msgr2=0x7fde940c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99a72700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde940aa010 0x7fde940c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99a72700 1 -- 172.21.15.148:0/696741818 >> v1:172.21.15.148:6789/0 conn(0x7fde94158770 legacy=0x7fde94069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99a72700 1 -- 172.21.15.148:0/696741818 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940c0f20 con 0x7fde940c6710 2023-10-24T02:03:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99271700 1 -- 172.21.15.148:0/696741818 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295344563 0 0) 0x7fde940c0960 con 0x7fde94158770 2023-10-24T02:03:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99a72700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940aa3f0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7fde88009760 tx=0x7fde88009060).ready entity=mon.0 client_cookie=16692df1ccea7698 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99271700 1 -- 172.21.15.148:0/696741818 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800f510 con 0x7fde940c6710 2023-10-24T02:03:48.994 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99271700 1 -- 172.21.15.148:0/696741818 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8800f670 con 0x7fde940c6710 2023-10-24T02:03:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde99271700 1 -- 172.21.15.148:0/696741818 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800f9f0 con 0x7fde940c6710 2023-10-24T02:03:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 -- 172.21.15.148:0/696741818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 msgr2=0x7fde940aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940aa3f0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 rx=0x7fde88009760 tx=0x7fde88009060).stop 2023-10-24T02:03:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 -- 172.21.15.148:0/696741818 shutdown_connections 2023-10-24T02:03:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde940aa010 0x7fde940c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/696741818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940aa3f0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 -- 172.21.15.148:0/696741818 >> 172.21.15.148:0/696741818 conn(0x7fde940caf40 msgr2=0x7fde940cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 -- 172.21.15.148:0/696741818 shutdown_connections 2023-10-24T02:03:48.996 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.989+0000 7fde9c4d7700 1 -- 172.21.15.148:0/696741818 wait complete. 2023-10-24T02:03:48.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.990+0000 7fde9c4d7700 1 Processor -- start 2023-10-24T02:03:48.999 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.990+0000 7fde9c4d7700 1 -- start start 2023-10-24T02:03:49.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde940aa010 0x7fde941687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde94158770 0x7fde94164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.000 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940c2c90 con 0x7fde940c6710 2023-10-24T02:03:49.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94168cd0 con 0x7fde940aa010 2023-10-24T02:03:49.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9c4d7700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940c2080 con 0x7fde94158770 2023-10-24T02:03:49.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde99a72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde99a72700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50898/0 (socket says 172.21.15.148:50898) 2023-10-24T02:03:49.001 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde99a72700 1 -- 172.21.15.148:0/2835945400 learned_addr learned my addr 172.21.15.148:0/2835945400 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9aa74700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde94158770 0x7fde94164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.991+0000 7fde9a273700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde940aa010 0x7fde941687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 -- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde94158770 msgr2=0x7fde94164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde94158770 0x7fde94164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 -- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde940aa010 msgr2=0x7fde941687e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde940aa010 0x7fde941687e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 -- 172.21.15.148:0/2835945400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880092a0 con 0x7fde940c6710 2023-10-24T02:03:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde99a72700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fde94084230 tx=0x7fde88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800fe80 con 0x7fde940c6710 2023-10-24T02:03:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8800f7e0 con 0x7fde940c6710 2023-10-24T02:03:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8801b660 con 0x7fde940c6710 2023-10-24T02:03:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940c2360 con 0x7fde940c6710 2023-10-24T02:03:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.992+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde940c2920 con 0x7fde940c6710 2023-10-24T02:03:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.993+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde940c2e00 con 0x7fde940c6710 2023-10-24T02:03:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.993+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fde8801ba10 con 0x7fde940c6710 2023-10-24T02:03:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.993+0000 7fde927fc700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 0x7fde80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.994+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fde8807b7d0 con 0x7fde940c6710 2023-10-24T02:03:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.994+0000 7fde9a273700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 0x7fde80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.005 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.994+0000 7fde9a273700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 0x7fde80061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fde84009c30 tx=0x7fde84009060).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.006 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:48.998+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fde8804cbf0 con 0x7fde940c6710 2023-10-24T02:03:49.159 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.158+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde9406c6b0 con 0x7fde8005f150 2023-10-24T02:03:49.162 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.161+0000 7fde927fc700 1 -- 172.21.15.148:0/2835945400 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70884 (secure 0 0 0) 0x7fde9406c6b0 con 0x7fde8005f150 2023-10-24T02:03:49.164 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:49.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 msgr2=0x7fde80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 0x7fde80061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fde84009c30 tx=0x7fde84009060).stop 2023-10-24T02:03:49.165 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 msgr2=0x7fde940a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7fde94084230 tx=0x7fde88017000).stop 2023-10-24T02:03:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 shutdown_connections 2023-10-24T02:03:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fde94158770 0x7fde94164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fde8005f150 0x7fde80061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.166 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde940aa010 0x7fde941687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 --2- 172.21.15.148:0/2835945400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde940c6710 0x7fde940a92a0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 >> 172.21.15.148:0/2835945400 conn(0x7fde940caf40 msgr2=0x7fde94069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 shutdown_connections 2023-10-24T02:03:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.163+0000 7fde9c4d7700 1 -- 172.21.15.148:0/2835945400 wait complete. 2023-10-24T02:03:49.167 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:49.176 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2023-10-24T02:03:48.431513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459656,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752515064,"statfs":{"total":773094113280,"available":770575425536,"internally_reserved":0,"allocated":21962752,"data_stored":11216857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12241,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999304"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.187000+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:35.187000+0000","last_peered":"2023-10-24T02:03:35.187000+0000","last_clean":"2023-10-24T02:03:35.187000+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:35.187000+0000","last_undegraded":"2023-10-24T02:03:35.187000+0000","last_fullsized":"2023-10-24T02:03:35.187000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180506+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:35.180506+0000","last_peered":"2023-10-24T02:03:35.180506+0000","last_clean":"2023-10-24T02:03:35.180506+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:35.180506+0000","last_undegraded":"2023-10-24T02:03:35.180506+0000","last_fullsized":"2023-10-24T02:03:35.180506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420722+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:42.420722+0000","last_peered":"2023-10-24T02:03:42.420722+0000","last_clean":"2023-10-24T02:03:42.420722+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:42.420722+0000","last_undegraded":"2023-10-24T02:03:42.420722+0000","last_fullsized":"2023-10-24T02:03:42.420722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180688+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:35.180688+0000","last_peered":"2023-10-24T02:03:35.180688+0000","last_clean":"2023-10-24T02:03:35.180688+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:35.180688+0000","last_undegraded":"2023-10-24T02:03:35.180688+0000","last_fullsized":"2023-10-24T02:03:35.180688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":212,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420229+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:42.420229+0000","last_peered":"2023-10-24T02:03:42.420229+0000","last_clean":"2023-10-24T02:03:42.420229+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:42.420229+0000","last_undegraded":"2023-10-24T02:03:42.420229+0000","last_fullsized":"2023-10-24T02:03:42.420229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420320+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:42.420320+0000","last_peered":"2023-10-24T02:03:42.420320+0000","last_clean":"2023-10-24T02:03:42.420320+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:42.420320+0000","last_undegraded":"2023-10-24T02:03:42.420320+0000","last_fullsized":"2023-10-24T02:03:42.420320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420830+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:42.420830+0000","last_peered":"2023-10-24T02:03:42.420830+0000","last_clean":"2023-10-24T02:03:42.420830+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:42.420830+0000","last_undegraded":"2023-10-24T02:03:42.420830+0000","last_fullsized":"2023-10-24T02:03:42.420830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.188073+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:35.188073+0000","last_peered":"2023-10-24T02:03:35.188073+0000","last_clean":"2023-10-24T02:03:35.188073+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:35.188073+0000","last_undegraded":"2023-10-24T02:03:35.188073+0000","last_fullsized":"2023-10-24T02:03:35.188073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.423826+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:42.423826+0000","last_peered":"2023-10-24T02:03:42.423826+0000","last_clean":"2023-10-24T02:03:42.423826+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:42.423826+0000","last_undegraded":"2023-10-24T02:03:42.423826+0000","last_fullsized":"2023-10-24T02:03:42.423826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1411349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.245}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.371},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.376}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.46200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2752512,"data_stored":1410896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.442},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575981,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307964,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063876,"statfs":{"total":96636764160,"available":96321409024,"internally_reserved":0,"allocated":2740224,"data_stored":1400893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.878,"15min":0.878},"last":0.31},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.53800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50700000000000001,"5min":0.58299999999999996,"15min":0.627},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82899999999999996,"5min":1.004,"15min":1.004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":1.018,"15min":1.018},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45600000000000002},"max":{"1min":0.751,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575981,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063856,"statfs":{"total":96636764160,"available":96321388544,"internally_reserved":0,"allocated":2760704,"data_stored":1402285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.443}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.311}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.56100000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.434},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.50800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1400792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.216},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.29999999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.23799999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.36699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.438},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1387644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":0.436,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.436},{"interface":"front","average":{"1min":0.373,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.752},"last":0.37}]},{"osd":1,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.41299999999999998,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.72799999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.097},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.167},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":1.056},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.88500000000000001,"15min":1.109},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.40999999999999998},"max":{"1min":0.79400000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":1.155},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79300000000000004,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575981,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307972,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063868,"statfs":{"total":96636764160,"available":96321400832,"internally_reserved":0,"allocated":2748416,"data_stored":1401470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.434},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40999999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.373},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.505}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1401528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.29899999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:49.178 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-24T02:03:49.179 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:49.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.290+0000 7f0fe3d0e700 1 Processor -- start 2023-10-24T02:03:49.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.290+0000 7f0fe3d0e700 1 -- start start 2023-10-24T02:03:49.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe3d0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 0x7f0fdc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe3d0e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0c0960 con 0x7f0fdc0aa010 2023-10-24T02:03:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe3d0e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0c0c40 con 0x7f0fdc0c6710 2023-10-24T02:03:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe3d0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0c0f20 con 0x7f0fdc06a490 2023-10-24T02:03:49.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe1aaa700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f0fdc0aa010 0x7f0fdc158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47832/0 (socket says 172.21.15.148:47832) 2023-10-24T02:03:49.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe1aaa700 1 -- 172.21.15.148:0/3498875959 learned_addr learned my addr 172.21.15.148:0/3498875959 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:49.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.291+0000 7f0fe22ab700 1 --2- 172.21.15.148:0/3498875959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 0x7f0fdc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065474576 0 0) 0x7f0fdc0c0960 con 0x7f0fdc0aa010 2023-10-24T02:03:49.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc80033f0 con 0x7f0fdc0aa010 2023-10-24T02:03:49.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629829640 0 0) 0x7f0fdc0c0c40 con 0x7f0fdc0c6710 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc0c0960 con 0x7f0fdc0c6710 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe22ab700 1 -- 172.21.15.148:0/3498875959 >> v1:172.21.15.150:6789/0 conn(0x7f0fdc0c6710 legacy=0x7f0fdc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe22ab700 1 -- 172.21.15.148:0/3498875959 >> v1:172.21.15.148:6789/0 conn(0x7f0fdc0aa010 legacy=0x7f0fdc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe22ab700 1 -- 172.21.15.148:0/3498875959 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0c1200 con 0x7f0fdc06a490 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe22ab700 1 --2- 172.21.15.148:0/3498875959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 0x7f0fdc0c1a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0fd4009790 tx=0x7f0fd4009060).ready entity=mon.2 client_cookie=f85ac4733cc7b4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.297 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400f510 con 0x7f0fdc06a490 2023-10-24T02:03:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd400f670 con 0x7f0fdc06a490 2023-10-24T02:03:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.292+0000 7f0fe0aa8700 1 -- 172.21.15.148:0/3498875959 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400f9f0 con 0x7f0fdc06a490 2023-10-24T02:03:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/3498875959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 msgr2=0x7f0fdc0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.298 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/3498875959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 0x7f0fdc0c1a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0fd4009790 tx=0x7f0fd4009060).stop 2023-10-24T02:03:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/3498875959 shutdown_connections 2023-10-24T02:03:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/3498875959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc06a490 0x7f0fdc0c1a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/3498875959 >> 172.21.15.148:0/3498875959 conn(0x7f0fdc0caf40 msgr2=0x7f0fdc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/3498875959 shutdown_connections 2023-10-24T02:03:49.299 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.293+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/3498875959 wait complete. 2023-10-24T02:03:49.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.294+0000 7f0fe3d0e700 1 Processor -- start 2023-10-24T02:03:49.302 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.294+0000 7f0fe3d0e700 1 -- start start 2023-10-24T02:03:49.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.294+0000 7f0fe3d0e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.294+0000 7f0fe3d0e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fdc0aa010 0x7f0fdc1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc0c6710 0x7f0fdc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc164f20 con 0x7f0fdc06a490 2023-10-24T02:03:49.303 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc164310 con 0x7f0fdc0aa010 2023-10-24T02:03:49.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc1645f0 con 0x7f0fdc0c6710 2023-10-24T02:03:49.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50902/0 (socket says 172.21.15.148:50902) 2023-10-24T02:03:49.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 -- 172.21.15.148:0/2214943872 learned_addr learned my addr 172.21.15.148:0/2214943872 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:49.304 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe22ab700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc0c6710 0x7f0fdc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe12a9700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fdc0aa010 0x7f0fdc1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 -- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc0c6710 msgr2=0x7f0fdc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc0c6710 0x7f0fdc157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 -- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fdc0aa010 msgr2=0x7f0fdc1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.305 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fdc0aa010 0x7f0fdc1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 -- 172.21.15.148:0/2214943872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40092a0 con 0x7f0fdc06a490 2023-10-24T02:03:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe1aaa700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f0fd800c8e0 tx=0x7f0fd8001700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8005d30 con 0x7f0fdc06a490 2023-10-24T02:03:49.306 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd8005e90 con 0x7f0fdc06a490 2023-10-24T02:03:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc1648d0 con 0x7f0fdc06a490 2023-10-24T02:03:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8007320 con 0x7f0fdc06a490 2023-10-24T02:03:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.295+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc0b0490 con 0x7f0fdc06a490 2023-10-24T02:03:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.296+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0b0710 con 0x7f0fdc06a490 2023-10-24T02:03:49.307 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.297+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0fd80076d0 con 0x7f0fdc06a490 2023-10-24T02:03:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.297+0000 7f0fd1ffb700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 0x7f0fc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.297+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f0fd807a060 con 0x7f0fdc06a490 2023-10-24T02:03:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.297+0000 7f0fe12a9700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 0x7f0fc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.297+0000 7f0fe12a9700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 0x7f0fc0061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0fdc153520 tx=0x7f0fcc007bd0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.308 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.301+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0fd804b480 con 0x7f0fdc06a490 2023-10-24T02:03:49.462 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.460+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fdc06c6b0 con 0x7f0fc005f150 2023-10-24T02:03:49.465 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.464+0000 7f0fd1ffb700 1 -- 172.21.15.148:0/2214943872 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70884 (secure 0 0 0) 0x7f0fdc06c6b0 con 0x7f0fc005f150 2023-10-24T02:03:49.466 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:49.467 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 msgr2=0x7f0fc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 0x7f0fc0061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0fdc153520 tx=0x7f0fcc007bd0).stop 2023-10-24T02:03:49.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 msgr2=0x7f0fdc146830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f0fd800c8e0 tx=0x7f0fd8001700).stop 2023-10-24T02:03:49.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 shutdown_connections 2023-10-24T02:03:49.468 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fdc0c6710 0x7f0fdc157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0fdc06a490 0x7f0fdc146830 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f0fc005f150 0x7f0fc0061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 --2- 172.21.15.148:0/2214943872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fdc0aa010 0x7f0fdc1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 >> 172.21.15.148:0/2214943872 conn(0x7f0fdc0caf40 msgr2=0x7f0fdc0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:49.469 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 shutdown_connections 2023-10-24T02:03:49.470 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.466+0000 7f0fe3d0e700 1 -- 172.21.15.148:0/2214943872 wait complete. 2023-10-24T02:03:49.470 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:49.479 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2023-10-24T02:03:48.431513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459656,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752515064,"statfs":{"total":773094113280,"available":770575425536,"internally_reserved":0,"allocated":21962752,"data_stored":11216857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12241,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999304"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.187000+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:35.187000+0000","last_peered":"2023-10-24T02:03:35.187000+0000","last_clean":"2023-10-24T02:03:35.187000+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:35.187000+0000","last_undegraded":"2023-10-24T02:03:35.187000+0000","last_fullsized":"2023-10-24T02:03:35.187000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180506+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:35.180506+0000","last_peered":"2023-10-24T02:03:35.180506+0000","last_clean":"2023-10-24T02:03:35.180506+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:35.180506+0000","last_undegraded":"2023-10-24T02:03:35.180506+0000","last_fullsized":"2023-10-24T02:03:35.180506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420722+0000","last_change":"2023-10-24T00:28:48.807000+0000","last_active":"2023-10-24T02:03:42.420722+0000","last_peered":"2023-10-24T02:03:42.420722+0000","last_clean":"2023-10-24T02:03:42.420722+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:42.420722+0000","last_undegraded":"2023-10-24T02:03:42.420722+0000","last_fullsized":"2023-10-24T02:03:42.420722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.180688+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:35.180688+0000","last_peered":"2023-10-24T02:03:35.180688+0000","last_clean":"2023-10-24T02:03:35.180688+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:35.180688+0000","last_undegraded":"2023-10-24T02:03:35.180688+0000","last_fullsized":"2023-10-24T02:03:35.180688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":212,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420229+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:42.420229+0000","last_peered":"2023-10-24T02:03:42.420229+0000","last_clean":"2023-10-24T02:03:42.420229+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:42.420229+0000","last_undegraded":"2023-10-24T02:03:42.420229+0000","last_fullsized":"2023-10-24T02:03:42.420229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420320+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:42.420320+0000","last_peered":"2023-10-24T02:03:42.420320+0000","last_clean":"2023-10-24T02:03:42.420320+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:42.420320+0000","last_undegraded":"2023-10-24T02:03:42.420320+0000","last_fullsized":"2023-10-24T02:03:42.420320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.420830+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:42.420830+0000","last_peered":"2023-10-24T02:03:42.420830+0000","last_clean":"2023-10-24T02:03:42.420830+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:42.420830+0000","last_undegraded":"2023-10-24T02:03:42.420830+0000","last_fullsized":"2023-10-24T02:03:42.420830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-24T02:03:35.188073+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:35.188073+0000","last_peered":"2023-10-24T02:03:35.188073+0000","last_clean":"2023-10-24T02:03:35.188073+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:35.188073+0000","last_undegraded":"2023-10-24T02:03:35.188073+0000","last_fullsized":"2023-10-24T02:03:35.188073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-24T02:03:42.423826+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:42.423826+0000","last_peered":"2023-10-24T02:03:42.423826+0000","last_clean":"2023-10-24T02:03:42.423826+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:42.423826+0000","last_undegraded":"2023-10-24T02:03:42.423826+0000","last_fullsized":"2023-10-24T02:03:42.423826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1411349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.245}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.437},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.371},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.376}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.39800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.46200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2752512,"data_stored":1410896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36299999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.70099999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.442},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.314},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.77700000000000002,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.47299999999999998,"5min":0.40200000000000002,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.76600000000000001,"15min":0.83999999999999997},"last":0.53600000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.79400000000000004,"15min":0.873},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.76100000000000001,"15min":0.80200000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.318},"max":{"1min":0.66200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.52200000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575981,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307964,"kb_used_data":2676,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063876,"statfs":{"total":96636764160,"available":96321409024,"internally_reserved":0,"allocated":2740224,"data_stored":1400893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.878,"15min":0.878},"last":0.31},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.53800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50700000000000001,"5min":0.58299999999999996,"15min":0.627},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82899999999999996,"5min":1.004,"15min":1.004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.61499999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":1.018,"15min":1.018},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45600000000000002},"max":{"1min":0.751,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575981,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063856,"statfs":{"total":96636764160,"available":96321388544,"internally_reserved":0,"allocated":2760704,"data_stored":1402285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.443}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.34200000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.311}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.627},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.56100000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.434},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.50800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307960,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063880,"statfs":{"total":96636764160,"available":96321413120,"internally_reserved":0,"allocated":2736128,"data_stored":1400792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.313},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.216},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.29999999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.23799999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.36699999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.38500000000000001}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.438},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575981,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063896,"statfs":{"total":96636764160,"available":96321429504,"internally_reserved":0,"allocated":2719744,"data_stored":1387644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":0.436,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.436},{"interface":"front","average":{"1min":0.373,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.752},"last":0.37}]},{"osd":1,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.41299999999999998,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.72799999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.097},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.167},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":1.056},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.88500000000000001,"15min":1.109},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.40999999999999998},"max":{"1min":0.79400000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":1.155},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79300000000000004,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575981,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307972,"kb_used_data":2684,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063868,"statfs":{"total":96636764160,"available":96321400832,"internally_reserved":0,"allocated":2748416,"data_stored":1401470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.25},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.80100000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.29499999999999998},"max":{"1min":0.72599999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.38400000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79500000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.434},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58299999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40999999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45700000000000002,"15min":0.45800000000000002},"min":{"1min":0.33100000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.42099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.66700000000000004,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.373},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.59499999999999997,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.48799999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.45200000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.754,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.441,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.505}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2752512,"data_stored":1401528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.435}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.47099999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.44500000000000001}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.29899999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.31},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:49.481 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-24T02:03:49.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.592+0000 7fa3d28d5700 1 Processor -- start 2023-10-24T02:03:49.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.592+0000 7fa3d28d5700 1 -- start start 2023-10-24T02:03:49.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3d28d5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3cc0c6710 0x7fa3cc0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3d28d5700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0aa820 con 0x7fa3cc0aa010 2023-10-24T02:03:49.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3d28d5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0c0960 con 0x7fa3cc0aa3f0 2023-10-24T02:03:49.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3d28d5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c0c40 con 0x7fa3cc0c6710 2023-10-24T02:03:49.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3cbfff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa3cc0aa010 0x7fa3cc158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47848/0 (socket says 172.21.15.148:47848) 2023-10-24T02:03:49.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3cbfff700 1 -- 172.21.15.148:0/636372193 learned_addr learned my addr 172.21.15.148:0/636372193 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:49.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3cb7fe700 1 --2- 172.21.15.148:0/636372193 >> v2:172.21.15.150:3300/0 conn(0x7fa3cc0c6710 0x7fa3cc0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046842225 0 0) 0x7fa3cc0aa820 con 0x7fa3cc0aa010 2023-10-24T02:03:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.593+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b40033f0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453439055 0 0) 0x7fa3cc0c0960 con 0x7fa3cc0aa3f0 2023-10-24T02:03:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc0aa820 con 0x7fa3cc0aa3f0 2023-10-24T02:03:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424750248 0 0) 0x7fa3b40033f0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3cb7fe700 1 -- 172.21.15.148:0/636372193 >> v1:172.21.15.150:6789/0 conn(0x7fa3cc0aa3f0 legacy=0x7fa3cc069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3cb7fe700 1 -- 172.21.15.148:0/636372193 >> v1:172.21.15.148:6789/0 conn(0x7fa3cc0aa010 legacy=0x7fa3cc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3cb7fe700 1 -- 172.21.15.148:0/636372193 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0c0f20 con 0x7fa3cc0c6710 2023-10-24T02:03:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3cb7fe700 1 --2- 172.21.15.148:0/636372193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0c1a00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fa3c0009760 tx=0x7fa3c0009060).ready entity=mon.1 client_cookie=2bf3adcee661db38 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc001470 con 0x7fa3cc0c6710 2023-10-24T02:03:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0011400 con 0x7fa3cc0c6710 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3caffd700 1 -- 172.21.15.148:0/636372193 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0011780 con 0x7fa3cc0c6710 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3d28d5700 1 -- 172.21.15.148:0/636372193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 msgr2=0x7fa3cc0c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.594+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/636372193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0c1a00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fa3c0009760 tx=0x7fa3c0009060).stop 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.595+0000 7fa3d28d5700 1 -- 172.21.15.148:0/636372193 shutdown_connections 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.595+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/636372193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0c1a00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.595+0000 7fa3d28d5700 1 -- 172.21.15.148:0/636372193 >> 172.21.15.148:0/636372193 conn(0x7fa3cc0caf40 msgr2=0x7fa3cc0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.595+0000 7fa3d28d5700 1 -- 172.21.15.148:0/636372193 shutdown_connections 2023-10-24T02:03:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.595+0000 7fa3d28d5700 1 -- 172.21.15.148:0/636372193 wait complete. 2023-10-24T02:03:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.596+0000 7fa3d28d5700 1 Processor -- start 2023-10-24T02:03:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.596+0000 7fa3d28d5700 1 -- start start 2023-10-24T02:03:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.596+0000 7fa3d28d5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3cc0aa3f0 0x7fa3cc0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc1558b0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc155b90 con 0x7fa3cc0c6710 2023-10-24T02:03:49.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc155e70 con 0x7fa3cc0aa3f0 2023-10-24T02:03:49.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50912/0 (socket says 172.21.15.148:50912) 2023-10-24T02:03:49.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 -- 172.21.15.148:0/2420808862 learned_addr learned my addr 172.21.15.148:0/2420808862 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:49.606 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d0e72700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cb7fe700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3cc0aa3f0 0x7fa3cc0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 -- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3cc0aa3f0 msgr2=0x7fa3cc0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3cc0aa3f0 0x7fa3cc0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 -- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 msgr2=0x7fa3cc0ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.607 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 -- 172.21.15.148:0/2420808862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00092a0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3cbfff700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fa3bc00c5f0 tx=0x7fa3bc001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc007170 con 0x7fa3cc0aa010 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0072f0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc156150 con 0x7fa3cc0aa010 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0048c0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.608 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.597+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc0b07c0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.598+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc0b0a40 con 0x7fa3cc0aa010 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.599+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa3bc004c70 con 0x7fa3cc0aa010 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.599+0000 7fa3b3fff700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 0x7fa3b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.599+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fa3bc079970 con 0x7fa3cc0aa010 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.599+0000 7fa3cb7fe700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 0x7fa3b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.599+0000 7fa3cb7fe700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 0x7fa3b8061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa3c0009760 tx=0x7fa3c0016000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:49.610 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.603+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa3bc04ad90 con 0x7fa3cc0aa010 2023-10-24T02:03:49.768 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.767+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3cc06c6b0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.769 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.767+0000 7fa3b3fff700 1 -- 172.21.15.148:0/2420808862 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v221) v1 ==== 74+0+14533 (secure 0 0 0) 0x7fa3bc04e3b0 con 0x7fa3cc0aa010 2023-10-24T02:03:49.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:49.770 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":221,"fsid":"6bd5f15c-4d64-43f3-b461-75e4ec9f85f9","created":"2023-10-24T00:28:35.903678+0000","modified":"2023-10-24T02:03:46.444243+0000","last_up_change":"2023-10-24T00:28:45.779492+0000","last_in_change":"2023-10-24T00:28:38.362646+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-24T00:28:44.809617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"221","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-24T00:28:47.085137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"22239223-2239-46a9-9afd-3e4748b562cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":87828},{"type":"v1","addr":"172.21.15.148:6801","nonce":87828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":87828},{"type":"v1","addr":"172.21.15.148:6803","nonce":87828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":87828},{"type":"v1","addr":"172.21.15.148:6807","nonce":87828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":87828},{"type":"v1","addr":"172.21.15.148:6805","nonce":87828}]},"public_addr":"172.21.15.148:6801/87828","cluster_addr":"172.21.15.148:6803/87828","heartbeat_back_addr":"172.21.15.148:6807/87828","heartbeat_front_addr":"172.21.15.148:6805/87828","state":["exists","up"]},{"osd":1,"uuid":"e5f408bc-4124-45d0-b456-bf910a591e15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":87851},{"type":"v1","addr":"172.21.15.148:6817","nonce":87851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":87851},{"type":"v1","addr":"172.21.15.148:6819","nonce":87851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":87851},{"type":"v1","addr":"172.21.15.148:6823","nonce":87851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":87851},{"type":"v1","addr":"172.21.15.148:6821","nonce":87851}]},"public_addr":"172.21.15.148:6817/87851","cluster_addr":"172.21.15.148:6819/87851","heartbeat_back_addr":"172.21.15.148:6823/87851","heartbeat_front_addr":"172.21.15.148:6821/87851","state":["exists","up"]},{"osd":2,"uuid":"b041cba0-1b8b-48a1-94f2-bbe77888768c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":87869},{"type":"v1","addr":"172.21.15.148:6825","nonce":87869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":87869},{"type":"v1","addr":"172.21.15.148:6827","nonce":87869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":87869},{"type":"v1","addr":"172.21.15.148:6831","nonce":87869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":87869},{"type":"v1","addr":"172.21.15.148:6829","nonce":87869}]},"public_addr":"172.21.15.148:6825/87869","cluster_addr":"172.21.15.148:6827/87869","heartbeat_back_addr":"172.21.15.148:6831/87869","heartbeat_front_addr":"172.21.15.148:6829/87869","state":["exists","up"]},{"osd":3,"uuid":"83801106-019d-44bd-b8ee-a19b562cef62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":87837},{"type":"v1","addr":"172.21.15.148:6809","nonce":87837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":87837},{"type":"v1","addr":"172.21.15.148:6811","nonce":87837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":87837},{"type":"v1","addr":"172.21.15.148:6815","nonce":87837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":87837},{"type":"v1","addr":"172.21.15.148:6813","nonce":87837}]},"public_addr":"172.21.15.148:6809/87837","cluster_addr":"172.21.15.148:6811/87837","heartbeat_back_addr":"172.21.15.148:6815/87837","heartbeat_front_addr":"172.21.15.148:6813/87837","state":["exists","up"]},{"osd":4,"uuid":"56d29a5f-17af-4ad3-8347-c4a5f011e2b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":88069},{"type":"v1","addr":"172.21.15.150:6801","nonce":88069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":88069},{"type":"v1","addr":"172.21.15.150:6803","nonce":88069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":88069},{"type":"v1","addr":"172.21.15.150:6807","nonce":88069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":88069},{"type":"v1","addr":"172.21.15.150:6805","nonce":88069}]},"public_addr":"172.21.15.150:6801/88069","cluster_addr":"172.21.15.150:6803/88069","heartbeat_back_addr":"172.21.15.150:6807/88069","heartbeat_front_addr":"172.21.15.150:6805/88069","state":["exists","up"]},{"osd":5,"uuid":"0f85c3d2-3722-44ae-86b0-1d1f43eb6065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":88070},{"type":"v1","addr":"172.21.15.150:6809","nonce":88070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":88070},{"type":"v1","addr":"172.21.15.150:6811","nonce":88070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":88070},{"type":"v1","addr":"172.21.15.150:6815","nonce":88070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":88070},{"type":"v1","addr":"172.21.15.150:6813","nonce":88070}]},"public_addr":"172.21.15.150:6809/88070","cluster_addr":"172.21.15.150:6811/88070","heartbeat_back_addr":"172.21.15.150:6815/88070","heartbeat_front_addr":"172.21.15.150:6813/88070","state":["exists","up"]},{"osd":6,"uuid":"564f2578-d5d7-484d-b7c8-8b644552fd04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":88100},{"type":"v1","addr":"172.21.15.150:6825","nonce":88100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":88100},{"type":"v1","addr":"172.21.15.150:6827","nonce":88100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":88100},{"type":"v1","addr":"172.21.15.150:6831","nonce":88100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":88100},{"type":"v1","addr":"172.21.15.150:6829","nonce":88100}]},"public_addr":"172.21.15.150:6825/88100","cluster_addr":"172.21.15.150:6827/88100","heartbeat_back_addr":"172.21.15.150:6831/88100","heartbeat_front_addr":"172.21.15.150:6829/88100","state":["exists","up"]},{"osd":7,"uuid":"91761957-26a3-4c1f-b2aa-9a8cd0f06b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":88101},{"type":"v1","addr":"172.21.15.150:6817","nonce":88101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":88101},{"type":"v1","addr":"172.21.15.150:6819","nonce":88101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":88101},{"type":"v1","addr":"172.21.15.150:6823","nonce":88101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":88101},{"type":"v1","addr":"172.21.15.150:6821","nonce":88101}]},"public_addr":"172.21.15.150:6817/88101","cluster_addr":"172.21.15.150:6819/88101","heartbeat_back_addr":"172.21.15.150:6823/88101","heartbeat_front_addr":"172.21.15.150:6821/88101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.774004+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.534967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.798051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.535249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.529991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.818483+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.562471+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-24T00:28:43.833280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6836/707171421":"2023-10-25T02:03:42.428453+0000","172.21.15.150:6834/707171421":"2023-10-25T02:03:42.428453+0000","172.21.15.150:0/1822785529":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/2756551396":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/1339128228":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/74765665":"2023-10-25T02:03:42.413453+0000","172.21.15.150:0/205949952":"2023-10-25T02:03:42.413453+0000","172.21.15.150:6833/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:6832/100598":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/1638296492":"2023-10-25T02:03:35.125379+0000","172.21.15.150:0/2328274838":"2023-10-25T02:03:35.125379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":39,"length":19},{"begin":95,"length":19}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-24T02:03:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 msgr2=0x7fa3b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.771 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 0x7fa3b8061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa3c0009760 tx=0x7fa3c0016000).stop 2023-10-24T02:03:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 msgr2=0x7fa3cc156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7fa3bc00c5f0 tx=0x7fa3bc001980).stop 2023-10-24T02:03:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 shutdown_connections 2023-10-24T02:03:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa3b805f150 0x7fa3b8061610 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.772 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3cc0c6710 0x7fa3cc0ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3cc0aa010 0x7fa3cc156670 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 --2- 172.21.15.148:0/2420808862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3cc0aa3f0 0x7fa3cc0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:49.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.769+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 >> 172.21.15.148:0/2420808862 conn(0x7fa3cc0caf40 msgr2=0x7fa3cc0cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:49.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.770+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 shutdown_connections 2023-10-24T02:03:49.773 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:49.770+0000 7fa3d28d5700 1 -- 172.21.15.148:0/2420808862 wait complete. 2023-10-24T02:03:50.784 INFO:tasks.ceph:Scrubbing osd.0 2023-10-24T02:03:50.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 Processor -- start 2023-10-24T02:03:50.913 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 -- start start 2023-10-24T02:03:50.916 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0a7d00 0x7ff68c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff68c0aa420 0x7ff68c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c0c6270 con 0x7ff68c1544b0 2023-10-24T02:03:50.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c0c60e0 con 0x7ff68c0aa420 2023-10-24T02:03:50.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.912+0000 7ff692c28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0aa890 con 0x7ff68c0a7d00 2023-10-24T02:03:50.917 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff68c0aa420 0x7ff68c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7ff68c0aa420 0x7ff68c0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50916/0 (socket says 172.21.15.148:50916) 2023-10-24T02:03:50.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 -- 172.21.15.148:0/3718951459 learned_addr learned my addr 172.21.15.148:0/3718951459 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:50.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff68bfff700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0a7d00 0x7ff68c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 -- 172.21.15.148:0/3718951459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0a7d00 msgr2=0x7ff68c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:50.918 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0a7d00 0x7ff68c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 -- 172.21.15.148:0/3718951459 >> v1:172.21.15.150:6789/0 conn(0x7ff68c1544b0 legacy=0x7ff68c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 -- 172.21.15.148:0/3718951459 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0c0c80 con 0x7ff68c0aa420 2023-10-24T02:03:50.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff6911c5700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c0aa420 0x7ff68c0c6700 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7ff684009f20 tx=0x7ff684009840).ready entity=mon.0 client_cookie=cce10c766271a066 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:50.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff68b7fe700 1 -- 172.21.15.148:0/3718951459 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400e070 con 0x7ff68c0aa420 2023-10-24T02:03:50.919 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff68b7fe700 1 -- 172.21.15.148:0/3718951459 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400b9d0 con 0x7ff68c0aa420 2023-10-24T02:03:50.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.913+0000 7ff68b7fe700 1 -- 172.21.15.148:0/3718951459 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400bd50 con 0x7ff68c0aa420 2023-10-24T02:03:50.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 -- 172.21.15.148:0/3718951459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c0aa420 msgr2=0x7ff68c0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c0aa420 0x7ff68c0c6700 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7ff684009f20 tx=0x7ff684009840).stop 2023-10-24T02:03:50.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 -- 172.21.15.148:0/3718951459 shutdown_connections 2023-10-24T02:03:50.920 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c0aa420 0x7ff68c0c6700 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 --2- 172.21.15.148:0/3718951459 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0a7d00 0x7ff68c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 -- 172.21.15.148:0/3718951459 >> 172.21.15.148:0/3718951459 conn(0x7ff68c0945d0 msgr2=0x7ff68c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:50.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 -- 172.21.15.148:0/3718951459 shutdown_connections 2023-10-24T02:03:50.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.914+0000 7ff692c28700 1 -- 172.21.15.148:0/3718951459 wait complete. 2023-10-24T02:03:50.921 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.915+0000 7ff692c28700 1 Processor -- start 2023-10-24T02:03:50.922 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.915+0000 7ff692c28700 1 -- start start 2023-10-24T02:03:50.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff68c0a7d00 0x7ff68c164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0aa420 0x7ff68c1658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.925 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 0x7ff68c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c146570 con 0x7ff68c1544b0 2023-10-24T02:03:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c156530 con 0x7ff68c0a7d00 2023-10-24T02:03:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff692c28700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c156810 con 0x7ff68c0aa420 2023-10-24T02:03:50.926 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff6911c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 0x7ff68c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff6911c5700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 0x7ff68c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50920/0 (socket says 172.21.15.148:50920) 2023-10-24T02:03:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff6911c5700 1 -- 172.21.15.148:0/2825441560 learned_addr learned my addr 172.21.15.148:0/2825441560 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff68bfff700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0aa420 0x7ff68c1658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.916+0000 7ff6909c4700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff68c0a7d00 0x7ff68c164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.927 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 -- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0aa420 msgr2=0x7ff68c1658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0aa420 0x7ff68c1658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 -- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff68c0a7d00 msgr2=0x7ff68c164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff68c0a7d00 0x7ff68c164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.928 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684009ae0 con 0x7ff68c1544b0 2023-10-24T02:03:50.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff68bfff700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff68c0aa420 0x7ff68c1658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:50.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff6911c5700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 0x7ff68c155c00 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7ff68400b610 tx=0x7ff684009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:50.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6840092e0 con 0x7ff68c1544b0 2023-10-24T02:03:50.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68401e470 con 0x7ff68c1544b0 2023-10-24T02:03:50.929 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c156af0 con 0x7ff68c1544b0 2023-10-24T02:03:50.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68401e830 con 0x7ff68c1544b0 2023-10-24T02:03:50.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.917+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c1560f0 con 0x7ff68c1544b0 2023-10-24T02:03:50.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.918+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff68c0c2070 con 0x7ff68c1544b0 2023-10-24T02:03:50.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.918+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff684003040 con 0x7ff68c1544b0 2023-10-24T02:03:50.930 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff688ff9700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff67005f120 0x7ff6700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7ff68407b4b0 con 0x7ff68c1544b0 2023-10-24T02:03:50.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff688ff9700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7ff670065a30 0x7ff670067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:50.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff670068510 con 0x7ff670065a30 2023-10-24T02:03:50.931 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff68407dad0 con 0x7ff68c1544b0 2023-10-24T02:03:50.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff6909c4700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff67005f120 0x7ff6700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff68bfff700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7ff670065a30 0x7ff670067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:50.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff68bfff700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7ff670065a30 0x7ff670067e90 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:50.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.919+0000 7ff6909c4700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff67005f120 0x7ff6700615e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff680003860 tx=0x7ff680007d40).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:50.932 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.920+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== osd.0 v2:172.21.15.148:6800/87828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff670068510 con 0x7ff670065a30 2023-10-24T02:03:50.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 --> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff68c1562e0 con 0x7ff670065a30 2023-10-24T02:03:50.934 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff688ff9700 1 -- 172.21.15.148:0/2825441560 <== osd.0 v2:172.21.15.148:6800/87828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff68c1562e0 con 0x7ff670065a30 2023-10-24T02:03:50.935 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:50.935 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:50.935 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:50.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7ff670065a30 msgr2=0x7ff670067e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.936 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:6800/87828,v1:172.21.15.148:6801/87828] conn(0x7ff670065a30 0x7ff670067e90 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:50.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff67005f120 msgr2=0x7ff6700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7ff67005f120 0x7ff6700615e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff680003860 tx=0x7ff680007d40).stop 2023-10-24T02:03:50.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 msgr2=0x7ff68c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:50.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 --2- 172.21.15.148:0/2825441560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff68c1544b0 0x7ff68c155c00 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7ff68400b610 tx=0x7ff684009840).stop 2023-10-24T02:03:50.937 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff6911c5700 1 -- 172.21.15.148:0/2825441560 reap_dead start 2023-10-24T02:03:50.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 shutdown_connections 2023-10-24T02:03:50.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.933+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 >> 172.21.15.148:0/2825441560 conn(0x7ff68c0945d0 msgr2=0x7ff68c153770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:50.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.934+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 shutdown_connections 2023-10-24T02:03:50.938 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:50.934+0000 7ff692c28700 1 -- 172.21.15.148:0/2825441560 wait complete. 2023-10-24T02:03:50.946 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-24T02:03:51.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 Processor -- start 2023-10-24T02:03:51.060 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 -- start start 2023-10-24T02:03:51.066 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa42c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa42c154e70 0x7fa42c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c06a860 con 0x7fa42c0c0810 2023-10-24T02:03:51.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c9d90 con 0x7fa42c154e70 2023-10-24T02:03:51.067 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.059+0000 7fa42b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c9180 con 0x7fa42c154a90 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa42ad9d700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fa42c0c0810 0x7fa42c0ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47850/0 (socket says 172.21.15.148:47850) 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa42ad9d700 1 -- 172.21.15.148:0/3884331976 learned_addr learned my addr 172.21.15.148:0/3884331976 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa42a59c700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa42c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa421d9b700 1 --2- 172.21.15.148:0/3884331976 >> v2:172.21.15.150:3300/0 conn(0x7fa42c154e70 0x7fa42c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210072389 0 0) 0x7fa42c06a860 con 0x7fa42c0c0810 2023-10-24T02:03:51.068 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4180033f0 con 0x7fa42c0c0810 2023-10-24T02:03:51.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1239741325 0 0) 0x7fa4180033f0 con 0x7fa42c0c0810 2023-10-24T02:03:51.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 msgr2=0x7fa42c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa42c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 >> v2:172.21.15.150:3300/0 conn(0x7fa42c154e70 msgr2=0x7fa42c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.069 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 --2- 172.21.15.148:0/3884331976 >> v2:172.21.15.150:3300/0 conn(0x7fa42c154e70 0x7fa42c1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0c9460 con 0x7fa42c0c0810 2023-10-24T02:03:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fa4240017f0 con 0x7fa42c0c0810 2023-10-24T02:03:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 >> v1:172.21.15.148:6789/0 conn(0x7fa42c0c0810 legacy=0x7fa42c0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4180038e0 0x7fa418003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.070 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa418004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa418005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c9d90 con 0x7fa418004b80 2023-10-24T02:03:51.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c9180 con 0x7fa4180038e0 2023-10-24T02:03:51.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41800b8e0 con 0x7fa42c154a90 2023-10-24T02:03:51.071 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa421d9b700 1 --2- 172.21.15.148:0/3884331976 >> v2:172.21.15.150:3300/0 conn(0x7fa42c154e70 0x7fa42c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:51.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa42ad9d700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa418005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa42a59c700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4180038e0 0x7fa418003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.060+0000 7fa421d9b700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa418004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 -- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 msgr2=0x7fa418004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.072 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c154a90 0x7fa418004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 -- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4180038e0 msgr2=0x7fa418003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4180038e0 0x7fa418003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 -- 172.21.15.148:0/3884331976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180033f0 con 0x7fa418004b80 2023-10-24T02:03:51.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa418005000 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7fa42400c530 tx=0x7fa42c0c9d00).ready entity=mon.0 client_cookie=9be6155c4d72edb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.073 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424007de0 con 0x7fa418004b80 2023-10-24T02:03:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42400ce60 con 0x7fa418004b80 2023-10-24T02:03:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa429d9b700 1 -- 172.21.15.148:0/3884331976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424005d50 con 0x7fa418004b80 2023-10-24T02:03:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 -- 172.21.15.148:0/3884331976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 msgr2=0x7fa418005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.074 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 --2- 172.21.15.148:0/3884331976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa418005000 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7fa42400c530 tx=0x7fa42c0c9d00).stop 2023-10-24T02:03:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42ad9d700 1 -- 172.21.15.148:0/3884331976 reap_dead start 2023-10-24T02:03:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 -- 172.21.15.148:0/3884331976 shutdown_connections 2023-10-24T02:03:51.075 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 -- 172.21.15.148:0/3884331976 >> 172.21.15.148:0/3884331976 conn(0x7fa42c084c20 msgr2=0x7fa42c094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 -- 172.21.15.148:0/3884331976 shutdown_connections 2023-10-24T02:03:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.061+0000 7fa42b59e700 1 -- 172.21.15.148:0/3884331976 wait complete. 2023-10-24T02:03:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 Processor -- start 2023-10-24T02:03:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 -- start start 2023-10-24T02:03:51.076 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 0x7fa42c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa42c097400 0x7fa42c097880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0adad0 con 0x7fa418004b80 2023-10-24T02:03:51.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c097d70 con 0x7fa42c097400 2023-10-24T02:03:51.077 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42b59e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c144690 con 0x7fa42c0ad160 2023-10-24T02:03:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.063+0000 7fa42a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50936/0 (socket says 172.21.15.148:50936) 2023-10-24T02:03:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 -- 172.21.15.148:0/318396501 learned_addr learned my addr 172.21.15.148:0/318396501 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42ad9d700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa42c097400 0x7fa42c097880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.078 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa421d9b700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 0x7fa42c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 -- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 msgr2=0x7fa42c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 0x7fa42c0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 -- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa42c097400 msgr2=0x7fa42c097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.079 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa42c097400 0x7fa42c097880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 -- 172.21.15.148:0/318396501 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0b0080 con 0x7fa418004b80 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa421d9b700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 0x7fa42c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42a59c700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7fa41c0119f0 tx=0x7fa41c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c011ee0 con 0x7fa418004b80 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00f8e0 con 0x7fa418004b80 2023-10-24T02:03:51.080 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0b0360 con 0x7fa418004b80 2023-10-24T02:03:51.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00fca0 con 0x7fa418004b80 2023-10-24T02:03:51.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.064+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0b0920 con 0x7fa418004b80 2023-10-24T02:03:51.081 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.065+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c165850 con 0x7fa418004b80 2023-10-24T02:03:51.082 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.065+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa41c014650 con 0x7fa418004b80 2023-10-24T02:03:51.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.066+0000 7fa422ffd700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 0x7fa40c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.066+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fa41c07ac30 con 0x7fa418004b80 2023-10-24T02:03:51.084 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.066+0000 7fa421d9b700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 0x7fa40c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.066+0000 7fa421d9b700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 0x7fa40c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa414006d50 tx=0x7fa414008040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.085 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.070+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa41c04c050 con 0x7fa418004b80 2023-10-24T02:03:51.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.232+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa42c047480 con 0x7fa40c05f150 2023-10-24T02:03:51.234 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.233+0000 7fa422ffd700 1 -- 172.21.15.148:0/318396501 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa42c047480 con 0x7fa40c05f150 2023-10-24T02:03:51.236 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 msgr2=0x7fa40c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 0x7fa40c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa414006d50 tx=0x7fa414008040).stop 2023-10-24T02:03:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 msgr2=0x7fa42c0af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7fa41c0119f0 tx=0x7fa41c009060).stop 2023-10-24T02:03:51.237 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 shutdown_connections 2023-10-24T02:03:51.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fa40c05f150 0x7fa40c061610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa42c097400 0x7fa42c097880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa418004b80 0x7fa42c0af830 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 --2- 172.21.15.148:0/318396501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa42c0ad160 0x7fa42c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.238 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 >> 172.21.15.148:0/318396501 conn(0x7fa42c084c20 msgr2=0x7fa42c064a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 shutdown_connections 2023-10-24T02:03:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.235+0000 7fa42b59e700 1 -- 172.21.15.148:0/318396501 wait complete. 2023-10-24T02:03:51.239 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 0 to deep-scrub 2023-10-24T02:03:51.248 INFO:tasks.ceph:Scrubbing osd.1 2023-10-24T02:03:51.249 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:51.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.365+0000 7f9ea231e700 1 Processor -- start 2023-10-24T02:03:51.367 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.365+0000 7f9ea231e700 1 -- start start 2023-10-24T02:03:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9ea231e700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.369 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9ea231e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e9c0c8290 0x7f9e9c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9ea231e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0c6270 con 0x7f9e9c0aa420 2023-10-24T02:03:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9ea231e700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c60e0 con 0x7f9e9c1544b0 2023-10-24T02:03:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9ea231e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c0c80 con 0x7f9e9c0c8290 2023-10-24T02:03:51.370 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50944/0 (socket says 172.21.15.148:50944) 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 -- 172.21.15.148:0/1213405119 learned_addr learned my addr 172.21.15.148:0/1213405119 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9b7fe700 1 --2- 172.21.15.148:0/1213405119 >> v2:172.21.15.150:3300/0 conn(0x7f9e9c0c8290 0x7f9e9c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 -- 172.21.15.148:0/1213405119 >> v2:172.21.15.150:3300/0 conn(0x7f9e9c0c8290 msgr2=0x7f9e9c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 --2- 172.21.15.148:0/1213405119 >> v2:172.21.15.150:3300/0 conn(0x7f9e9c0c8290 0x7f9e9c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.371 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 -- 172.21.15.148:0/1213405119 >> v1:172.21.15.150:6789/0 conn(0x7f9e9c0aa420 legacy=0x7f9e9c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.366+0000 7f9e9bfff700 1 -- 172.21.15.148:0/1213405119 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0c0f40 con 0x7f9e9c1544b0 2023-10-24T02:03:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9e9bfff700 1 --2- 172.21.15.148:0/1213405119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f9e9c0a9cf0 tx=0x7f9e8c0090f0).ready entity=mon.0 client_cookie=5fa929f537602a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9e9affd700 1 -- 172.21.15.148:0/1213405119 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00b5a0 con 0x7f9e9c1544b0 2023-10-24T02:03:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9e9affd700 1 -- 172.21.15.148:0/1213405119 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00b700 con 0x7f9e9c1544b0 2023-10-24T02:03:51.372 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9e9affd700 1 -- 172.21.15.148:0/1213405119 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00ba80 con 0x7f9e9c1544b0 2023-10-24T02:03:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 -- 172.21.15.148:0/1213405119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c1544b0 msgr2=0x7f9e9c0a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 --2- 172.21.15.148:0/1213405119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f9e9c0a9cf0 tx=0x7f9e8c0090f0).stop 2023-10-24T02:03:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 -- 172.21.15.148:0/1213405119 shutdown_connections 2023-10-24T02:03:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 --2- 172.21.15.148:0/1213405119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0a7d00 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.373 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 --2- 172.21.15.148:0/1213405119 >> v2:172.21.15.150:3300/0 conn(0x7f9e9c0c8290 0x7f9e9c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 -- 172.21.15.148:0/1213405119 >> 172.21.15.148:0/1213405119 conn(0x7f9e9c0945d0 msgr2=0x7f9e9c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 -- 172.21.15.148:0/1213405119 shutdown_connections 2023-10-24T02:03:51.374 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.367+0000 7f9ea231e700 1 -- 172.21.15.148:0/1213405119 wait complete. 2023-10-24T02:03:51.377 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.368+0000 7f9ea231e700 1 Processor -- start 2023-10-24T02:03:51.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 -- start start 2023-10-24T02:03:51.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 0x7f9e9c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e9c0c8290 0x7f9e9c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.378 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ad600 con 0x7f9e9c0aa420 2023-10-24T02:03:51.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c9580 con 0x7f9e9c1544b0 2023-10-24T02:03:51.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9ea231e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0adf80 con 0x7f9e9c0c8290 2023-10-24T02:03:51.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 0x7f9e9c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.379 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9e9bfff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 0x7f9e9c14df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50954/0 (socket says 172.21.15.148:50954) 2023-10-24T02:03:51.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.369+0000 7f9e9bfff700 1 -- 172.21.15.148:0/2967916431 learned_addr learned my addr 172.21.15.148:0/2967916431 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9b7fe700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e9c0c8290 0x7f9e9c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9ea08bb700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 -- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e9c0c8290 msgr2=0x7f9e9c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.380 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e9c0c8290 0x7f9e9c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 -- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9c1544b0 msgr2=0x7f9e9c0ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e9c1544b0 0x7f9e9c0ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009370 con 0x7f9e9c0aa420 2023-10-24T02:03:51.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e9bfff700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 0x7f9e9c14df00 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f9e8c009130 tx=0x7f9e8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.381 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00b870 con 0x7f9e9c0aa420 2023-10-24T02:03:51.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00b9d0 con 0x7f9e9c0aa420 2023-10-24T02:03:51.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c0ac140 con 0x7f9e9c0aa420 2023-10-24T02:03:51.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c01b660 con 0x7f9e9c0aa420 2023-10-24T02:03:51.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.370+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c0ac700 con 0x7f9e9c0aa420 2023-10-24T02:03:51.382 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.371+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e9c06c6b0 con 0x7f9e9c0aa420 2023-10-24T02:03:51.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.371+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9e8c01b9d0 con 0x7f9e9c0aa420 2023-10-24T02:03:51.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e83fff700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9e8805f150 0x7f9e88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f9e8c07bf00 con 0x7f9e9c0aa420 2023-10-24T02:03:51.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e83fff700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f9e88065a60 0x7f9e88067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.383 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e88068540 con 0x7f9e88065a60 2023-10-24T02:03:51.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e9b7fe700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9e8805f150 0x7f9e88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e8c07c2b0 con 0x7f9e9c0aa420 2023-10-24T02:03:51.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9ea08bb700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f9e88065a60 0x7f9e88067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9e9b7fe700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9e8805f150 0x7f9e88061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9e9c153c60 tx=0x7f9e90008040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.384 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.372+0000 7f9ea08bb700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f9e88065a60 0x7f9e88067ec0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.385 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.373+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== osd.1 v2:172.21.15.148:6816/87851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9e88068540 con 0x7f9e88065a60 2023-10-24T02:03:51.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 --> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e9c0c9860 con 0x7f9e88065a60 2023-10-24T02:03:51.387 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9e83fff700 1 -- 172.21.15.148:0/2967916431 <== osd.1 v2:172.21.15.148:6816/87851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9e9c0c9860 con 0x7f9e88065a60 2023-10-24T02:03:51.388 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:51.388 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:51.388 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:51.389 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f9e88065a60 msgr2=0x7f9e88067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:6816/87851,v1:172.21.15.148:6817/87851] conn(0x7f9e88065a60 0x7f9e88067ec0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9e8805f150 msgr2=0x7f9e88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9e8805f150 0x7f9e88061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9e9c153c60 tx=0x7f9e90008040).stop 2023-10-24T02:03:51.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 msgr2=0x7f9e9c14df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.390 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.386+0000 7f9ea231e700 1 --2- 172.21.15.148:0/2967916431 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e9c0aa420 0x7f9e9c14df00 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f9e8c009130 tx=0x7f9e8c015000).stop 2023-10-24T02:03:51.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.387+0000 7f9ea08bb700 1 -- 172.21.15.148:0/2967916431 reap_dead start 2023-10-24T02:03:51.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.387+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 shutdown_connections 2023-10-24T02:03:51.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.387+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 >> 172.21.15.148:0/2967916431 conn(0x7f9e9c0945d0 msgr2=0x7f9e9c0bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.391 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.387+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 shutdown_connections 2023-10-24T02:03:51.392 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.387+0000 7f9ea231e700 1 -- 172.21.15.148:0/2967916431 wait complete. 2023-10-24T02:03:51.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-24T02:03:51.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.513+0000 7fc769cef700 1 Processor -- start 2023-10-24T02:03:51.515 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.513+0000 7fc769cef700 1 -- start start 2023-10-24T02:03:51.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc769cef700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc764154a90 0x7fc764155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.517 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc769cef700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76406a860 con 0x7fc764154e70 2023-10-24T02:03:51.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc769cef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7640c9d90 con 0x7fc7640c0f20 2023-10-24T02:03:51.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc769cef700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640c9180 con 0x7fc764154a90 2023-10-24T02:03:51.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc763fff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fc764154e70 0x7fc7640c0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47856/0 (socket says 172.21.15.148:47856) 2023-10-24T02:03:51.518 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc763fff700 1 -- 172.21.15.148:0/1120266608 learned_addr learned my addr 172.21.15.148:0/1120266608 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:51.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc768ced700 1 --2- 172.21.15.148:0/1120266608 >> v2:172.21.15.150:3300/0 conn(0x7fc764154a90 0x7fc764155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc7637fe700 1 -- 172.21.15.148:0/1120266608 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077756328 0 0) 0x7fc76406a860 con 0x7fc764154e70 2023-10-24T02:03:51.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.514+0000 7fc7637fe700 1 -- 172.21.15.148:0/1120266608 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7500033f0 con 0x7fc764154e70 2023-10-24T02:03:51.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc768ced700 1 -- 172.21.15.148:0/1120266608 >> v1:172.21.15.150:6789/0 conn(0x7fc7640c0f20 legacy=0x7fc7640ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.519 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc768ced700 1 -- 172.21.15.148:0/1120266608 >> v1:172.21.15.148:6789/0 conn(0x7fc764154e70 legacy=0x7fc7640c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc768ced700 1 -- 172.21.15.148:0/1120266608 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640c9460 con 0x7fc764154a90 2023-10-24T02:03:51.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc768ced700 1 --2- 172.21.15.148:0/1120266608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154a90 0x7fc764155a90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fc75c009e90 tx=0x7fc75c009780).ready entity=mon.1 client_cookie=f81ff0039110fc29 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc7637fe700 1 -- 172.21.15.148:0/1120266608 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00e070 con 0x7fc764154a90 2023-10-24T02:03:51.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc7637fe700 1 -- 172.21.15.148:0/1120266608 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00bb20 con 0x7fc764154a90 2023-10-24T02:03:51.520 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc7637fe700 1 -- 172.21.15.148:0/1120266608 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00bea0 con 0x7fc764154a90 2023-10-24T02:03:51.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 -- 172.21.15.148:0/1120266608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154a90 msgr2=0x7fc764155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 --2- 172.21.15.148:0/1120266608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154a90 0x7fc764155a90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fc75c009e90 tx=0x7fc75c009780).stop 2023-10-24T02:03:51.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 -- 172.21.15.148:0/1120266608 shutdown_connections 2023-10-24T02:03:51.521 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 --2- 172.21.15.148:0/1120266608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154a90 0x7fc764155a90 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 -- 172.21.15.148:0/1120266608 >> 172.21.15.148:0/1120266608 conn(0x7fc764084c20 msgr2=0x7fc764094540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 -- 172.21.15.148:0/1120266608 shutdown_connections 2023-10-24T02:03:51.522 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.515+0000 7fc769cef700 1 -- 172.21.15.148:0/1120266608 wait complete. 2023-10-24T02:03:51.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.517+0000 7fc769cef700 1 Processor -- start 2023-10-24T02:03:51.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.517+0000 7fc769cef700 1 -- start start 2023-10-24T02:03:51.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.517+0000 7fc769cef700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640c0f20 0x7fc764150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.525 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 0x7fc7640a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640a97d0 con 0x7fc764154a90 2023-10-24T02:03:51.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c2270 con 0x7fc764154e70 2023-10-24T02:03:51.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640b07a0 con 0x7fc7640c0f20 2023-10-24T02:03:51.526 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50956/0 (socket says 172.21.15.148:50956) 2023-10-24T02:03:51.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 -- 172.21.15.148:0/3181988989 learned_addr learned my addr 172.21.15.148:0/3181988989 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc7694ee700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 0x7fc7640a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc768ced700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640c0f20 0x7fc764150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.527 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 -- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640c0f20 msgr2=0x7fc764150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640c0f20 0x7fc764150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 -- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 msgr2=0x7fc7640a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 0x7fc7640a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 -- 172.21.15.148:0/3181988989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009a20 con 0x7fc764154a90 2023-10-24T02:03:51.528 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc7694ee700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 0x7fc7640a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc763fff700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7fc75400c420 tx=0x7fc754007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540072e0 con 0x7fc764154a90 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754007440 con 0x7fc764154a90 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7640b0a80 con 0x7fc764154a90 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540057a0 con 0x7fc764154a90 2023-10-24T02:03:51.529 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.518+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640c1f00 con 0x7fc764154a90 2023-10-24T02:03:51.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.519+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc764047480 con 0x7fc764154a90 2023-10-24T02:03:51.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.520+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc754005bd0 con 0x7fc764154a90 2023-10-24T02:03:51.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.520+0000 7fc760ff9700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 0x7fc744061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.520+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fc754079500 con 0x7fc764154a90 2023-10-24T02:03:51.530 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.520+0000 7fc768ced700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 0x7fc744061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.520+0000 7fc768ced700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 0x7fc744061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc75c009e60 tx=0x7fc7640c18d0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.531 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.524+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc75404a920 con 0x7fc764154a90 2023-10-24T02:03:51.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.689+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7640c9740 con 0x7fc74405f150 2023-10-24T02:03:51.691 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.689+0000 7fc760ff9700 1 -- 172.21.15.148:0/3181988989 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7640c9740 con 0x7fc74405f150 2023-10-24T02:03:51.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 msgr2=0x7fc744061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 0x7fc744061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc75c009e60 tx=0x7fc7640c18d0).stop 2023-10-24T02:03:51.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 msgr2=0x7fc7640a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7fc75400c420 tx=0x7fc754007c80).stop 2023-10-24T02:03:51.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 shutdown_connections 2023-10-24T02:03:51.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fc74405f150 0x7fc744061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc764154e70 0x7fc7640a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc7640c0f20 0x7fc764150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 --2- 172.21.15.148:0/3181988989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc764154a90 0x7fc7640a8df0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 >> 172.21.15.148:0/3181988989 conn(0x7fc764084c20 msgr2=0x7fc7640ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 shutdown_connections 2023-10-24T02:03:51.695 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.691+0000 7fc769cef700 1 -- 172.21.15.148:0/3181988989 wait complete. 2023-10-24T02:03:51.696 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 1 to deep-scrub 2023-10-24T02:03:51.704 INFO:tasks.ceph:Scrubbing osd.2 2023-10-24T02:03:51.705 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:51.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.820+0000 7f53ac2f3700 1 Processor -- start 2023-10-24T02:03:51.822 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.820+0000 7f53ac2f3700 1 -- start start 2023-10-24T02:03:51.824 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.821+0000 7f53ac2f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 0x7f53a40a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.821+0000 7f53ac2f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53a40aa640 0x7f53a40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.821+0000 7f53ac2f3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40c6270 con 0x7f53a40c8290 2023-10-24T02:03:51.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.821+0000 7f53ac2f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40c60e0 con 0x7f53a40aa640 2023-10-24T02:03:51.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.821+0000 7f53ac2f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c0c80 con 0x7f53a41544b0 2023-10-24T02:03:51.825 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa08f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 0x7f53a40a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53a40aa640 0x7f53a40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53a40aa640 0x7f53a40c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.148:33630/0 (socket says 172.21.15.148:33630) 2023-10-24T02:03:51.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 -- 172.21.15.148:0/3445627573 learned_addr learned my addr 172.21.15.148:0/3445627573 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.826 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa08f700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 0x7f53a40a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:45276/0 (socket says 172.21.15.148:45276) 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53a988e700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f53a40c8290 0x7f53a40a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34328/0 (socket says 172.21.15.148:34328) 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 -- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 msgr2=0x7f53a40a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 --2- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 0x7f53a40a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 -- 172.21.15.148:0/3445627573 >> v1:172.21.15.150:6789/0 conn(0x7f53a40c8290 legacy=0x7f53a40a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 -- 172.21.15.148:0/3445627573 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40c0f40 con 0x7f53a40aa640 2023-10-24T02:03:51.827 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53a908d700 1 -- 172.21.15.148:0/3445627573 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857952645 0 0) 0x7f53a40c6270 con 0x7f53a40c8290 2023-10-24T02:03:51.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53aa890700 1 --2- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40aa640 0x7f53a40c6700 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f539c006fd0 tx=0x7f539c0090f0).ready entity=mon.1 client_cookie=e941584bdd162b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53a908d700 1 -- 172.21.15.148:0/3445627573 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00b580 con 0x7f53a40aa640 2023-10-24T02:03:51.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53a908d700 1 -- 172.21.15.148:0/3445627573 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c00b6e0 con 0x7f53a40aa640 2023-10-24T02:03:51.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.822+0000 7f53a908d700 1 -- 172.21.15.148:0/3445627573 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00ba60 con 0x7f53a40aa640 2023-10-24T02:03:51.828 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 -- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40aa640 msgr2=0x7f53a40c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40aa640 0x7f53a40c6700 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f539c006fd0 tx=0x7f539c0090f0).stop 2023-10-24T02:03:51.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 -- 172.21.15.148:0/3445627573 shutdown_connections 2023-10-24T02:03:51.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a40aa640 0x7f53a40c6700 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/3445627573 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a41544b0 0x7f53a40a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.829 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 -- 172.21.15.148:0/3445627573 >> 172.21.15.148:0/3445627573 conn(0x7f53a40945d0 msgr2=0x7f53a406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 -- 172.21.15.148:0/3445627573 shutdown_connections 2023-10-24T02:03:51.830 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.823+0000 7f53ac2f3700 1 -- 172.21.15.148:0/3445627573 wait complete. 2023-10-24T02:03:51.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.824+0000 7f53ac2f3700 1 Processor -- start 2023-10-24T02:03:51.833 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.824+0000 7f53ac2f3700 1 -- start start 2023-10-24T02:03:51.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40aa640 0x7f53a40c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 0x7f53a414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a41544b0 0x7f53a4151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40aeb90 con 0x7f53a40c8290 2023-10-24T02:03:51.834 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40adf80 con 0x7f53a41544b0 2023-10-24T02:03:51.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40ae260 con 0x7f53a40aa640 2023-10-24T02:03:51.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 0x7f53a414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 0x7f53a414ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50958/0 (socket says 172.21.15.148:50958) 2023-10-24T02:03:51.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 -- 172.21.15.148:0/1942833081 learned_addr learned my addr 172.21.15.148:0/1942833081 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.835 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53aa08f700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40aa640 0x7f53a40c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53aa890700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a41544b0 0x7f53a4151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 -- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40aa640 msgr2=0x7f53a40c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40aa640 0x7f53a40c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 -- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a41544b0 msgr2=0x7f53a4151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.836 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a41544b0 0x7f53a4151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009370 con 0x7f53a40c8290 2023-10-24T02:03:51.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53a988e700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 0x7f53a414ef30 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f539400c4e0 tx=0x7f5394007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400ce50 con 0x7f53a40c8290 2023-10-24T02:03:51.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940072e0 con 0x7f53a40c8290 2023-10-24T02:03:51.837 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.825+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40ae540 con 0x7f53a40c8290 2023-10-24T02:03:51.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.826+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940056e0 con 0x7f53a40c8290 2023-10-24T02:03:51.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.826+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a40c9cc0 con 0x7f53a40c8290 2023-10-24T02:03:51.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.826+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53a406c6b0 con 0x7f53a40c8290 2023-10-24T02:03:51.838 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5394005ad0 con 0x7f53a40c8290 2023-10-24T02:03:51.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f538805f150 0x7f5388061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f5394079890 con 0x7f53a40c8290 2023-10-24T02:03:51.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f5388065a60 0x7f5388067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5388068540 con 0x7f5388065a60 2023-10-24T02:03:51.839 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7f539407e220 con 0x7f53a40c8290 2023-10-24T02:03:51.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f53aa08f700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f538805f150 0x7f5388061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.827+0000 7f53aa890700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f5388065a60 0x7f5388067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.828+0000 7f53aa890700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f5388065a60 0x7f5388067ec0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.828+0000 7f53aa08f700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f538805f150 0x7f5388061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f53a0009fd0 tx=0x7f53a000b040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.840 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.828+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== osd.2 v2:172.21.15.148:6824/87869 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5388068540 con 0x7f5388065a60 2023-10-24T02:03:51.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.841+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 --> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53a40aecd0 con 0x7f5388065a60 2023-10-24T02:03:51.843 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.841+0000 7f539a7fc700 1 -- 172.21.15.148:0/1942833081 <== osd.2 v2:172.21.15.148:6824/87869 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f53a40aecd0 con 0x7f5388065a60 2023-10-24T02:03:51.843 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:51.843 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:51.844 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:51.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f5388065a60 msgr2=0x7f5388067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:6824/87869,v1:172.21.15.148:6825/87869] conn(0x7f5388065a60 0x7f5388067ec0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f538805f150 msgr2=0x7f5388061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.845 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f538805f150 0x7f5388061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f53a0009fd0 tx=0x7f53a000b040).stop 2023-10-24T02:03:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 msgr2=0x7f53a414ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 --2- 172.21.15.148:0/1942833081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53a40c8290 0x7f53a414ef30 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f539400c4e0 tx=0x7f5394007c60).stop 2023-10-24T02:03:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53aa890700 1 -- 172.21.15.148:0/1942833081 reap_dead start 2023-10-24T02:03:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 shutdown_connections 2023-10-24T02:03:51.846 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 >> 172.21.15.148:0/1942833081 conn(0x7f53a40945d0 msgr2=0x7f53a4063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 shutdown_connections 2023-10-24T02:03:51.847 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.842+0000 7f53ac2f3700 1 -- 172.21.15.148:0/1942833081 wait complete. 2023-10-24T02:03:51.855 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-24T02:03:51.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.968+0000 7eff363b1700 1 Processor -- start 2023-10-24T02:03:51.970 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.968+0000 7eff363b1700 1 -- start start 2023-10-24T02:03:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff363b1700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30154400 0x7eff300c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff363b1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 0x7eff300a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff363b1700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff300c01c0 con 0x7eff300a82c0 2023-10-24T02:03:51.973 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff363b1700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300aa960 con 0x7eff30154400 2023-10-24T02:03:51.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff363b1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300c66f0 con 0x7eff301547e0 2023-10-24T02:03:51.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff2ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30154400 0x7eff300c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff2ffff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7eff30154400 0x7eff300c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50970/0 (socket says 172.21.15.148:50970) 2023-10-24T02:03:51.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.969+0000 7eff2ffff700 1 -- 172.21.15.148:0/2655419689 learned_addr learned my addr 172.21.15.148:0/2655419689 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.974 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2ffff700 1 -- 172.21.15.148:0/2655419689 >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 msgr2=0x7eff300a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2f7fe700 1 --2- 172.21.15.148:0/2655419689 >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 0x7eff300a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2ffff700 1 --2- 172.21.15.148:0/2655419689 >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 0x7eff300a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2ffff700 1 -- 172.21.15.148:0/2655419689 >> v1:172.21.15.150:6789/0 conn(0x7eff300a82c0 legacy=0x7eff300c0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2ffff700 1 -- 172.21.15.148:0/2655419689 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300c6150 con 0x7eff30154400 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2f7fe700 1 --2- 172.21.15.148:0/2655419689 >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 0x7eff300a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:51.975 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2ffff700 1 --2- 172.21.15.148:0/2655419689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30154400 0x7eff300c8310 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7eff30085bc0 tx=0x7eff200090f0).ready entity=mon.0 client_cookie=f212030630c4bc2c server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2effd700 1 -- 172.21.15.148:0/2655419689 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000b5a0 con 0x7eff30154400 2023-10-24T02:03:51.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2effd700 1 -- 172.21.15.148:0/2655419689 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000b700 con 0x7eff30154400 2023-10-24T02:03:51.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff2effd700 1 -- 172.21.15.148:0/2655419689 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000baa0 con 0x7eff30154400 2023-10-24T02:03:51.976 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff363b1700 1 -- 172.21.15.148:0/2655419689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30154400 msgr2=0x7eff300c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.970+0000 7eff363b1700 1 --2- 172.21.15.148:0/2655419689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30154400 0x7eff300c8310 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7eff30085bc0 tx=0x7eff200090f0).stop 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 -- 172.21.15.148:0/2655419689 shutdown_connections 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 --2- 172.21.15.148:0/2655419689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff30154400 0x7eff300c8310 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 --2- 172.21.15.148:0/2655419689 >> v2:172.21.15.150:3300/0 conn(0x7eff301547e0 0x7eff300a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 -- 172.21.15.148:0/2655419689 >> 172.21.15.148:0/2655419689 conn(0x7eff300946a0 msgr2=0x7eff3006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:51.977 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 -- 172.21.15.148:0/2655419689 shutdown_connections 2023-10-24T02:03:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.971+0000 7eff363b1700 1 -- 172.21.15.148:0/2655419689 wait complete. 2023-10-24T02:03:51.978 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.972+0000 7eff363b1700 1 Processor -- start 2023-10-24T02:03:51.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.972+0000 7eff363b1700 1 -- start start 2023-10-24T02:03:51.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30154400 0x7eff30152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff301547e0 0x7eff30164c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.981 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b0280 con 0x7eff300a82c0 2023-10-24T02:03:51.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3014dce0 con 0x7eff30154400 2023-10-24T02:03:51.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b1080 con 0x7eff301547e0 2023-10-24T02:03:51.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.982 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50982/0 (socket says 172.21.15.148:50982) 2023-10-24T02:03:51.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 -- 172.21.15.148:0/2488223349 learned_addr learned my addr 172.21.15.148:0/2488223349 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:51.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2f7fe700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30154400 0x7eff30152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff3494e700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff301547e0 0x7eff30164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 -- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff301547e0 msgr2=0x7eff30164c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.983 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff301547e0 0x7eff30164c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 -- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30154400 msgr2=0x7eff30152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:51.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30154400 0x7eff30152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:51.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 -- 172.21.15.148:0/2488223349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009370 con 0x7eff300a82c0 2023-10-24T02:03:51.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff2ffff700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7eff20006fd0 tx=0x7eff20015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.984 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000b870 con 0x7eff300a82c0 2023-10-24T02:03:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000b9f0 con 0x7eff300a82c0 2023-10-24T02:03:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff300b0470 con 0x7eff300a82c0 2023-10-24T02:03:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2001c670 con 0x7eff300a82c0 2023-10-24T02:03:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.973+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff300b0a30 con 0x7eff300a82c0 2023-10-24T02:03:51.985 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.974+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff30164a60 con 0x7eff300a82c0 2023-10-24T02:03:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.975+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7eff2001ca60 con 0x7eff300a82c0 2023-10-24T02:03:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.975+0000 7eff17fff700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 0x7eff1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.975+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7eff2007baf0 con 0x7eff300a82c0 2023-10-24T02:03:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.975+0000 7eff2f7fe700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 0x7eff1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:51.986 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.976+0000 7eff2f7fe700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 0x7eff1c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7eff30167f20 tx=0x7eff24008040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:51.987 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:51.979+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff2004cf10 con 0x7eff300a82c0 2023-10-24T02:03:52.140 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.139+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7eff300aa3a0 con 0x7eff1c05f150 2023-10-24T02:03:52.141 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.139+0000 7eff17fff700 1 -- 172.21.15.148:0/2488223349 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff300aa3a0 con 0x7eff1c05f150 2023-10-24T02:03:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 msgr2=0x7eff1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 0x7eff1c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7eff30167f20 tx=0x7eff24008040).stop 2023-10-24T02:03:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 msgr2=0x7eff30158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7eff20006fd0 tx=0x7eff20015000).stop 2023-10-24T02:03:52.143 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 shutdown_connections 2023-10-24T02:03:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff301547e0 0x7eff30164c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7eff300a82c0 0x7eff30158240 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7eff1c05f150 0x7eff1c061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 --2- 172.21.15.148:0/2488223349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff30154400 0x7eff30152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.144 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 >> 172.21.15.148:0/2488223349 conn(0x7eff300946a0 msgr2=0x7eff300aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 shutdown_connections 2023-10-24T02:03:52.145 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.141+0000 7eff363b1700 1 -- 172.21.15.148:0/2488223349 wait complete. 2023-10-24T02:03:52.145 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 2 to deep-scrub 2023-10-24T02:03:52.154 INFO:tasks.ceph:Scrubbing osd.3 2023-10-24T02:03:52.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:52.271 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.270+0000 7fd48e71b700 1 Processor -- start 2023-10-24T02:03:52.272 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.270+0000 7fd48e71b700 1 -- start start 2023-10-24T02:03:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd48e71b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4881544b0 0x7fd4880a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd48e71b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd4880c8290 0x7fd4880a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.274 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd48e71b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880c6270 con 0x7fd4880aa420 2023-10-24T02:03:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd48e71b700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880c60e0 con 0x7fd4880c8290 2023-10-24T02:03:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd48e71b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880aa8b0 con 0x7fd4881544b0 2023-10-24T02:03:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd4880c8290 0x7fd4880a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.275 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fd4880c8290 0x7fd4880a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50984/0 (socket says 172.21.15.148:50984) 2023-10-24T02:03:52.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 -- 172.21.15.148:0/2515828293 learned_addr learned my addr 172.21.15.148:0/2515828293 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd487fff700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4881544b0 0x7fd4880a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 -- 172.21.15.148:0/2515828293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4881544b0 msgr2=0x7fd4880a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:52.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4881544b0 0x7fd4880a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.276 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 -- 172.21.15.148:0/2515828293 >> v1:172.21.15.150:6789/0 conn(0x7fd4880aa420 legacy=0x7fd4880c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:52.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.271+0000 7fd4877fe700 1 -- 172.21.15.148:0/2515828293 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880c0c80 con 0x7fd4880c8290 2023-10-24T02:03:52.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd4877fe700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880c8290 0x7fd4880a9f30 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7fd47c006fd0 tx=0x7fd47c0090f0).ready entity=mon.0 client_cookie=abb2ecad30d7ae51 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd486ffd700 1 -- 172.21.15.148:0/2515828293 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00b600 con 0x7fd4880c8290 2023-10-24T02:03:52.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd486ffd700 1 -- 172.21.15.148:0/2515828293 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00b760 con 0x7fd4880c8290 2023-10-24T02:03:52.277 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd486ffd700 1 -- 172.21.15.148:0/2515828293 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00bae0 con 0x7fd4880c8290 2023-10-24T02:03:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 -- 172.21.15.148:0/2515828293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880c8290 msgr2=0x7fd4880a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880c8290 0x7fd4880a9f30 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7fd47c006fd0 tx=0x7fd47c0090f0).stop 2023-10-24T02:03:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 -- 172.21.15.148:0/2515828293 shutdown_connections 2023-10-24T02:03:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4881544b0 0x7fd4880a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.278 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 --2- 172.21.15.148:0/2515828293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880c8290 0x7fd4880a9f30 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 -- 172.21.15.148:0/2515828293 >> 172.21.15.148:0/2515828293 conn(0x7fd4880945d0 msgr2=0x7fd48806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 -- 172.21.15.148:0/2515828293 shutdown_connections 2023-10-24T02:03:52.279 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.272+0000 7fd48e71b700 1 -- 172.21.15.148:0/2515828293 wait complete. 2023-10-24T02:03:52.281 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.273+0000 7fd48e71b700 1 Processor -- start 2023-10-24T02:03:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 -- start start 2023-10-24T02:03:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 0x7fd48814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4880c8290 0x7fd48813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.282 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4881544b0 0x7fd4880ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880abd20 con 0x7fd4880aa420 2023-10-24T02:03:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880ac000 con 0x7fd4881544b0 2023-10-24T02:03:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd48e71b700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880ac2e0 con 0x7fd4880c8290 2023-10-24T02:03:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd487fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 0x7fd48814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.283 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd487fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 0x7fd48814f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50990/0 (socket says 172.21.15.148:50990) 2023-10-24T02:03:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.274+0000 7fd487fff700 1 -- 172.21.15.148:0/576341678 learned_addr learned my addr 172.21.15.148:0/576341678 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 -- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4880c8290 msgr2=0x7fd48813eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4880c8290 0x7fd48813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-24T02:03:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd48ccb8700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4881544b0 0x7fd4880ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.284 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 -- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4881544b0 msgr2=0x7fd4880ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4881544b0 0x7fd4880ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009370 con 0x7fd4880aa420 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd487fff700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 0x7fd48814f8a0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7fd47800c650 tx=0x7fd478008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478010580 con 0x7fd4880aa420 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4780106e0 con 0x7fd4880aa420 2023-10-24T02:03:52.285 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd488151fa0 con 0x7fd4880aa420 2023-10-24T02:03:52.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478010a60 con 0x7fd4880aa420 2023-10-24T02:03:52.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.275+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48813f090 con 0x7fd4880aa420 2023-10-24T02:03:52.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.276+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd488151e10 con 0x7fd4880aa420 2023-10-24T02:03:52.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.276+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd47801b460 con 0x7fd4880aa420 2023-10-24T02:03:52.286 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd46ffff700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd47405f120 0x7fd4740615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fd478079fd0 con 0x7fd4880aa420 2023-10-24T02:03:52.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd46ffff700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7fd474065a30 0x7fd474067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd474068510 con 0x7fd474065a30 2023-10-24T02:03:52.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd47807c5f0 con 0x7fd4880aa420 2023-10-24T02:03:52.287 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd4877fe700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd47405f120 0x7fd4740615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd48ccb8700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7fd474065a30 0x7fd474067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd4877fe700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd47405f120 0x7fd4740615e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd47c006fd0 tx=0x7fd47c017000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.277+0000 7fd48ccb8700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7fd474065a30 0x7fd474067e90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.288 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.278+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== osd.3 v2:172.21.15.148:6808/87837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd474068510 con 0x7fd474065a30 2023-10-24T02:03:52.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 --> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4881521e0 con 0x7fd474065a30 2023-10-24T02:03:52.292 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd46ffff700 1 -- 172.21.15.148:0/576341678 <== osd.3 v2:172.21.15.148:6808/87837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd4881521e0 con 0x7fd474065a30 2023-10-24T02:03:52.293 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:52.293 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:52.294 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7fd474065a30 msgr2=0x7fd474067e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:6808/87837,v1:172.21.15.148:6809/87837] conn(0x7fd474065a30 0x7fd474067e90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd47405f120 msgr2=0x7fd4740615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd47405f120 0x7fd4740615e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd47c006fd0 tx=0x7fd47c017000).stop 2023-10-24T02:03:52.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 msgr2=0x7fd48814f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.295 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 --2- 172.21.15.148:0/576341678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd4880aa420 0x7fd48814f8a0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7fd47800c650 tx=0x7fd478008040).stop 2023-10-24T02:03:52.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48ccb8700 1 -- 172.21.15.148:0/576341678 reap_dead start 2023-10-24T02:03:52.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 shutdown_connections 2023-10-24T02:03:52.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.291+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 >> 172.21.15.148:0/576341678 conn(0x7fd4880945d0 msgr2=0x7fd4880a8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.292+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 shutdown_connections 2023-10-24T02:03:52.296 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.292+0000 7fd48e71b700 1 -- 172.21.15.148:0/576341678 wait complete. 2023-10-24T02:03:52.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-24T02:03:52.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.418+0000 7f504e0a3700 1 Processor -- start 2023-10-24T02:03:52.420 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.418+0000 7f504e0a3700 1 -- start start 2023-10-24T02:03:52.422 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f504e0a3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5048154400 0x7f50480c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f504e0a3700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f50480c0b30 0x7f50480c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f504e0a3700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480c01c0 con 0x7f50481547e0 2023-10-24T02:03:52.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f504e0a3700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480aa960 con 0x7f50480c0b30 2023-10-24T02:03:52.423 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f504e0a3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480c66f0 con 0x7f5048154400 2023-10-24T02:03:52.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f5047fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f50480c0b30 0x7f50480c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f5047fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f50480c0b30 0x7f50480c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50994/0 (socket says 172.21.15.148:50994) 2023-10-24T02:03:52.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.419+0000 7f5047fff700 1 -- 172.21.15.148:0/1788797367 learned_addr learned my addr 172.21.15.148:0/1788797367 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f50477fe700 1 --2- 172.21.15.148:0/1788797367 >> v2:172.21.15.150:3300/0 conn(0x7f5048154400 0x7f50480c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.424 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f5047fff700 1 -- 172.21.15.148:0/1788797367 >> v2:172.21.15.150:3300/0 conn(0x7f5048154400 msgr2=0x7f50480c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:52.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f5047fff700 1 --2- 172.21.15.148:0/1788797367 >> v2:172.21.15.150:3300/0 conn(0x7f5048154400 0x7f50480c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f5047fff700 1 -- 172.21.15.148:0/1788797367 >> v1:172.21.15.150:6789/0 conn(0x7f50481547e0 legacy=0x7f50480a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:52.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f5047fff700 1 -- 172.21.15.148:0/1788797367 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480c6150 con 0x7f50480c0b30 2023-10-24T02:03:52.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f5047fff700 1 --2- 172.21.15.148:0/1788797367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50480c0b30 0x7f50480c0f60 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5048084cf0 tx=0x7f50400090f0).ready entity=mon.0 client_cookie=7ffe8ff943441628 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.425 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f50467fc700 1 -- 172.21.15.148:0/1788797367 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000b5a0 con 0x7f50480c0b30 2023-10-24T02:03:52.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f50467fc700 1 -- 172.21.15.148:0/1788797367 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000b700 con 0x7f50480c0b30 2023-10-24T02:03:52.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f50467fc700 1 -- 172.21.15.148:0/1788797367 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000baa0 con 0x7f50480c0b30 2023-10-24T02:03:52.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 -- 172.21.15.148:0/1788797367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50480c0b30 msgr2=0x7f50480c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.426 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1788797367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50480c0b30 0x7f50480c0f60 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f5048084cf0 tx=0x7f50400090f0).stop 2023-10-24T02:03:52.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 -- 172.21.15.148:0/1788797367 shutdown_connections 2023-10-24T02:03:52.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1788797367 >> v2:172.21.15.150:3300/0 conn(0x7f5048154400 0x7f50480c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1788797367 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f50480c0b30 0x7f50480c0f60 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.420+0000 7f504e0a3700 1 -- 172.21.15.148:0/1788797367 >> 172.21.15.148:0/1788797367 conn(0x7f50480946a0 msgr2=0x7f504806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.427 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.421+0000 7f504e0a3700 1 -- 172.21.15.148:0/1788797367 shutdown_connections 2023-10-24T02:03:52.428 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.421+0000 7f504e0a3700 1 -- 172.21.15.148:0/1788797367 wait complete. 2023-10-24T02:03:52.430 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.422+0000 7f504e0a3700 1 Processor -- start 2023-10-24T02:03:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.422+0000 7f504e0a3700 1 -- start start 2023-10-24T02:03:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.422+0000 7f504e0a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50480c0b30 0x7f50481677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50481547e0 0x7f50480a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c4a50 con 0x7f5048154400 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c3e40 con 0x7f50480c0b30 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c4120 con 0x7f50481547e0 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51010/0 (socket says 172.21.15.148:51010) 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 -- 172.21.15.148:0/1072844744 learned_addr learned my addr 172.21.15.148:0/1072844744 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.432 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f50477fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50480c0b30 0x7f50481677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5047fff700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50481547e0 0x7f50480a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 -- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50481547e0 msgr2=0x7f50480a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50481547e0 0x7f50480a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 -- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50480c0b30 msgr2=0x7f50481677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.433 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50480c0b30 0x7f50481677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 -- 172.21.15.148:0/1072844744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009370 con 0x7f5048154400 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f5046ffd700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f503c009490 tx=0x7f503c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c013460 con 0x7f5048154400 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c013600 con 0x7f5048154400 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0139c0 con 0x7f5048154400 2023-10-24T02:03:52.434 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480c4400 con 0x7f5048154400 2023-10-24T02:03:52.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.423+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048167ca0 con 0x7f5048154400 2023-10-24T02:03:52.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.424+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048153ff0 con 0x7f5048154400 2023-10-24T02:03:52.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.425+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f503c01d3f0 con 0x7f5048154400 2023-10-24T02:03:52.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.425+0000 7f502f7fe700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 0x7f5034061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.435 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.425+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f503c079910 con 0x7f5048154400 2023-10-24T02:03:52.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.425+0000 7f50477fe700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 0x7f5034061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.425+0000 7f50477fe700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 0x7f5034061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5038007640 tx=0x7f5038009850).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.436 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.429+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f503c04acd0 con 0x7f5048154400 2023-10-24T02:03:52.594 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.592+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f50480c4b90 con 0x7f503405f150 2023-10-24T02:03:52.595 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.593+0000 7f502f7fe700 1 -- 172.21.15.148:0/1072844744 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50480c4b90 con 0x7f503405f150 2023-10-24T02:03:52.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 msgr2=0x7f5034061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 0x7f5034061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5038007640 tx=0x7f5038009850).stop 2023-10-24T02:03:52.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 msgr2=0x7f50480ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.597 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f503c009490 tx=0x7f503c006ee0).stop 2023-10-24T02:03:52.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 shutdown_connections 2023-10-24T02:03:52.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50481547e0 0x7f50480a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f503405f150 0x7f5034061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50480c0b30 0x7f50481677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.598 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 --2- 172.21.15.148:0/1072844744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5048154400 0x7f50480ae9b0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 >> 172.21.15.148:0/1072844744 conn(0x7f50480946a0 msgr2=0x7f50481533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 shutdown_connections 2023-10-24T02:03:52.599 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.595+0000 7f504e0a3700 1 -- 172.21.15.148:0/1072844744 wait complete. 2023-10-24T02:03:52.600 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 3 to deep-scrub 2023-10-24T02:03:52.608 INFO:tasks.ceph:Scrubbing osd.4 2023-10-24T02:03:52.609 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:52.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.725+0000 7f9ae2825700 1 Processor -- start 2023-10-24T02:03:52.726 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.725+0000 7f9ae2825700 1 -- start start 2023-10-24T02:03:52.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 0x7f9adc0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.729 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2825700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0c7770 con 0x7f9adc155350 2023-10-24T02:03:52.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2825700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0c1070 con 0x7f9adc0a9f40 2023-10-24T02:03:52.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c79e0 con 0x7f9adc154270 2023-10-24T02:03:52.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae1022700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f9adc155350 0x7f9adc153b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47864/0 (socket says 172.21.15.148:47864) 2023-10-24T02:03:52.730 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae1022700 1 -- 172.21.15.148:0/1631017095 learned_addr learned my addr 172.21.15.148:0/1631017095 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:52.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2024700 1 --2- 172.21.15.148:0/1631017095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 0x7f9adc0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219681197 0 0) 0x7f9adc0c7770 con 0x7f9adc155350 2023-10-24T02:03:52.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac80033f0 con 0x7f9adc155350 2023-10-24T02:03:52.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663262395 0 0) 0x7f9adc0c1070 con 0x7f9adc0a9f40 2023-10-24T02:03:52.731 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc0c7770 con 0x7f9adc0a9f40 2023-10-24T02:03:52.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2024700 1 -- 172.21.15.148:0/1631017095 >> v1:172.21.15.150:6789/0 conn(0x7f9adc0a9f40 legacy=0x7f9adc0c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2024700 1 -- 172.21.15.148:0/1631017095 >> v1:172.21.15.148:6789/0 conn(0x7f9adc155350 legacy=0x7f9adc153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2024700 1 -- 172.21.15.148:0/1631017095 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc0c7cc0 con 0x7f9adc154270 2023-10-24T02:03:52.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.726+0000 7f9ae2024700 1 --2- 172.21.15.148:0/1631017095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 0x7f9adc0aa320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f9ad4009e90 tx=0x7f9ad4009780).ready entity=mon.2 client_cookie=33f2533384a01ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.732 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e070 con 0x7f9adc154270 2023-10-24T02:03:52.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400bab0 con 0x7f9adc154270 2023-10-24T02:03:52.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae0821700 1 -- 172.21.15.148:0/1631017095 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400be30 con 0x7f9adc154270 2023-10-24T02:03:52.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 -- 172.21.15.148:0/1631017095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 msgr2=0x7f9adc0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 --2- 172.21.15.148:0/1631017095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 0x7f9adc0aa320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f9ad4009e90 tx=0x7f9ad4009780).stop 2023-10-24T02:03:52.733 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 -- 172.21.15.148:0/1631017095 shutdown_connections 2023-10-24T02:03:52.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 --2- 172.21.15.148:0/1631017095 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc154270 0x7f9adc0aa320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 -- 172.21.15.148:0/1631017095 >> 172.21.15.148:0/1631017095 conn(0x7f9adc094420 msgr2=0x7f9adc06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 -- 172.21.15.148:0/1631017095 shutdown_connections 2023-10-24T02:03:52.734 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.727+0000 7f9ae2825700 1 -- 172.21.15.148:0/1631017095 wait complete. 2023-10-24T02:03:52.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.728+0000 7f9ae2825700 1 Processor -- start 2023-10-24T02:03:52.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.728+0000 7f9ae2825700 1 -- start start 2023-10-24T02:03:52.737 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc0a9f40 0x7f9adc0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9adc154270 0x7f9adc146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 0x7f9adc0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0ae280 con 0x7f9adc155350 2023-10-24T02:03:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc14f160 con 0x7f9adc154270 2023-10-24T02:03:52.738 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2825700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc14e550 con 0x7f9adc0a9f40 2023-10-24T02:03:52.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2024700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 0x7f9adc0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2024700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 0x7f9adc0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51020/0 (socket says 172.21.15.148:51020) 2023-10-24T02:03:52.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae2024700 1 -- 172.21.15.148:0/1738682411 learned_addr learned my addr 172.21.15.148:0/1738682411 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae1022700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9adc154270 0x7f9adc146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.739 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.729+0000 7f9ae1823700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc0a9f40 0x7f9adc0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 -- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc0a9f40 msgr2=0x7f9adc0add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9adc0a9f40 0x7f9adc0add90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 -- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9adc154270 msgr2=0x7f9adc146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9adc154270 0x7f9adc146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.740 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009a20 con 0x7f9adc155350 2023-10-24T02:03:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2024700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 0x7f9adc0c45f0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f9ad4013ce0 tx=0x7f9ad4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad401d630 con 0x7f9adc155350 2023-10-24T02:03:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad401d790 con 0x7f9adc155350 2023-10-24T02:03:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc14e830 con 0x7f9adc155350 2023-10-24T02:03:52.741 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad401db30 con 0x7f9adc155350 2023-10-24T02:03:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.730+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc14edf0 con 0x7f9adc155350 2023-10-24T02:03:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.731+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9adc047480 con 0x7f9adc155350 2023-10-24T02:03:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.731+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9ad4003040 con 0x7f9adc155350 2023-10-24T02:03:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ad1ffb700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9ac005f150 0x7f9ac0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.742 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f9ad407c980 con 0x7f9adc155350 2023-10-24T02:03:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ad1ffb700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f9ac0065a60 0x7f9ac0067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ac0068540 con 0x7f9ac0065a60 2023-10-24T02:03:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ae1823700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9ac005f150 0x7f9ac0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ad407cd30 con 0x7f9adc155350 2023-10-24T02:03:52.743 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ae1022700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f9ac0065a60 0x7f9ac0067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ae1823700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9ac005f150 0x7f9ac0061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9ad8000c00 tx=0x7f9ad8007ba0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.732+0000 7f9ae1022700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f9ac0065a60 0x7f9ac0067ec0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.744 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.733+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== osd.4 v2:172.21.15.150:6800/88069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9ac0068540 con 0x7f9ac0065a60 2023-10-24T02:03:52.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.746+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 --> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9adc14f2a0 con 0x7f9ac0065a60 2023-10-24T02:03:52.748 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ad1ffb700 1 -- 172.21.15.148:0/1738682411 <== osd.4 v2:172.21.15.150:6800/88069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9acc001930 con 0x7f9ac0065a60 2023-10-24T02:03:52.748 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:52.749 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:52.749 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:52.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f9ac0065a60 msgr2=0x7f9ac0067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.750 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6800/88069,v1:172.21.15.150:6801/88069] conn(0x7f9ac0065a60 0x7f9ac0067ec0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9ac005f150 msgr2=0x7f9ac0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f9ac005f150 0x7f9ac0061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9ad8000c00 tx=0x7f9ad8007ba0).stop 2023-10-24T02:03:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 msgr2=0x7f9adc0c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 --2- 172.21.15.148:0/1738682411 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9adc155350 0x7f9adc0c45f0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f9ad4013ce0 tx=0x7f9ad4009780).stop 2023-10-24T02:03:52.751 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2024700 1 -- 172.21.15.148:0/1738682411 reap_dead start 2023-10-24T02:03:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 shutdown_connections 2023-10-24T02:03:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 >> 172.21.15.148:0/1738682411 conn(0x7f9adc094420 msgr2=0x7f9adc151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 shutdown_connections 2023-10-24T02:03:52.752 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.747+0000 7f9ae2825700 1 -- 172.21.15.148:0/1738682411 wait complete. 2023-10-24T02:03:52.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-24T02:03:52.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.874+0000 7fee65707700 1 Processor -- start 2023-10-24T02:03:52.876 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.874+0000 7fee65707700 1 -- start start 2023-10-24T02:03:52.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee65707700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee60062d60 0x7fee60154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee65707700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee65707700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee600c21a0 con 0x7fee6014e8b0 2023-10-24T02:03:52.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee65707700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600c2d20 con 0x7fee60062d60 2023-10-24T02:03:52.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee65707700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600c31b0 con 0x7fee60155090 2023-10-24T02:03:52.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee64f06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee5f7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fee60062d60 0x7fee60154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee64f06700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:45344/0 (socket says 172.21.15.148:45344) 2023-10-24T02:03:52.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee64f06700 1 -- 172.21.15.148:0/4231395744 learned_addr learned my addr 172.21.15.148:0/4231395744 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.875+0000 7fee5ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fee6014e8b0 0x7fee60062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:34382/0 (socket says 172.21.15.148:34382) 2023-10-24T02:03:52.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee5f7fe700 1 -- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 msgr2=0x7fee6015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:52.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee5f7fe700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee5f7fe700 1 -- 172.21.15.148:0/4231395744 >> v1:172.21.15.150:6789/0 conn(0x7fee6014e8b0 legacy=0x7fee60062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee5f7fe700 1 -- 172.21.15.148:0/4231395744 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600c23f0 con 0x7fee60062d60 2023-10-24T02:03:52.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee64f06700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:52.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.876+0000 7fee5f7fe700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60154ba0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fee50009760 tx=0x7fee50009060).ready entity=mon.1 client_cookie=94bf7c91fc1b1c53 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee5effd700 1 -- 172.21.15.148:0/4231395744 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000f510 con 0x7fee60062d60 2023-10-24T02:03:52.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee5effd700 1 -- 172.21.15.148:0/4231395744 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000f670 con 0x7fee60062d60 2023-10-24T02:03:52.885 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee5effd700 1 -- 172.21.15.148:0/4231395744 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000f9f0 con 0x7fee60062d60 2023-10-24T02:03:52.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 -- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 msgr2=0x7fee60154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60154ba0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fee50009760 tx=0x7fee50009060).stop 2023-10-24T02:03:52.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 -- 172.21.15.148:0/4231395744 shutdown_connections 2023-10-24T02:03:52.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee6015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.886 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 --2- 172.21.15.148:0/4231395744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60154ba0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 -- 172.21.15.148:0/4231395744 >> 172.21.15.148:0/4231395744 conn(0x7fee600c7ba0 msgr2=0x7fee600c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:52.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 -- 172.21.15.148:0/4231395744 shutdown_connections 2023-10-24T02:03:52.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.878+0000 7fee65707700 1 -- 172.21.15.148:0/4231395744 wait complete. 2023-10-24T02:03:52.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.879+0000 7fee65707700 1 Processor -- start 2023-10-24T02:03:52.887 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 -- start start 2023-10-24T02:03:52.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60066f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee60069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600ad570 con 0x7fee6014e8b0 2023-10-24T02:03:52.888 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600aae30 con 0x7fee60062d60 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.880+0000 7fee65707700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600ac960 con 0x7fee60155090 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51024/0 (socket says 172.21.15.148:51024) 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 -- 172.21.15.148:0/3859933216 learned_addr learned my addr 172.21.15.148:0/3859933216 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5ffff700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.889 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee64f06700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee60069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 -- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 msgr2=0x7fee60069d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee60069d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 -- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 msgr2=0x7fee60066f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:52.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60066f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:52.890 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 -- 172.21.15.148:0/3859933216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009ae0 con 0x7fee6014e8b0 2023-10-24T02:03:52.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee64f06700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee60069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:52.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee5f7fe700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fee50011000 tx=0x7fee50017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000f7e0 con 0x7fee6014e8b0 2023-10-24T02:03:52.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000f940 con 0x7fee6014e8b0 2023-10-24T02:03:52.891 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee500092a0 con 0x7fee6014e8b0 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5001b690 con 0x7fee6014e8b0 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.881+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee600acf20 con 0x7fee6014e8b0 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.882+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60047480 con 0x7fee6014e8b0 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.882+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fee5001ba40 con 0x7fee6014e8b0 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.883+0000 7fee47fff700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 0x7fee4c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:52.892 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.883+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fee5007b6f0 con 0x7fee6014e8b0 2023-10-24T02:03:52.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.883+0000 7fee5ffff700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 0x7fee4c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:52.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.883+0000 7fee5ffff700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 0x7fee4c0615e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fee54007fd0 tx=0x7fee54007d30).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:52.893 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:52.887+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fee5004cb10 con 0x7fee6014e8b0 2023-10-24T02:03:53.052 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.051+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee600c26d0 con 0x7fee4c05f120 2023-10-24T02:03:53.053 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.052+0000 7fee47fff700 1 -- 172.21.15.148:0/3859933216 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee600c26d0 con 0x7fee4c05f120 2023-10-24T02:03:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 msgr2=0x7fee4c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.055 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 0x7fee4c0615e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fee54007fd0 tx=0x7fee54007d30).stop 2023-10-24T02:03:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 msgr2=0x7fee60164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7fee50011000 tx=0x7fee50017000).stop 2023-10-24T02:03:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 shutdown_connections 2023-10-24T02:03:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee60155090 0x7fee60069d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.056 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fee4c05f120 0x7fee4c0615e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee60062d60 0x7fee60066f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 --2- 172.21.15.148:0/3859933216 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee6014e8b0 0x7fee60164360 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.053+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 >> 172.21.15.148:0/3859933216 conn(0x7fee600c7ba0 msgr2=0x7fee60155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.054+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 shutdown_connections 2023-10-24T02:03:53.057 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.054+0000 7fee65707700 1 -- 172.21.15.148:0/3859933216 wait complete. 2023-10-24T02:03:53.058 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 4 to deep-scrub 2023-10-24T02:03:53.067 INFO:tasks.ceph:Scrubbing osd.5 2023-10-24T02:03:53.067 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:53.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.183+0000 7fe227137700 1 Processor -- start 2023-10-24T02:03:53.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.183+0000 7fe227137700 1 -- start start 2023-10-24T02:03:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe227137700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe2200a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe227137700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe2200aa640 0x7fe2200c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe227137700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2200c6270 con 0x7fe2200c8290 2023-10-24T02:03:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe227137700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2200c60e0 con 0x7fe2200aa640 2023-10-24T02:03:53.193 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe227137700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200c0c80 con 0x7fe2201544b0 2023-10-24T02:03:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe21ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fe2200c8290 0x7fe2200a9f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:47874/0 (socket says 172.21.15.148:47874) 2023-10-24T02:03:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe21ffff700 1 -- 172.21.15.148:0/1282359491 learned_addr learned my addr 172.21.15.148:0/1282359491 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190122892 0 0) 0x7fe2200c6270 con 0x7fe2200c8290 2023-10-24T02:03:53.194 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.184+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe2200a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe2256d4700 1 --2- 172.21.15.148:0/1282359491 >> v2:172.21.15.150:3300/0 conn(0x7fe2200aa640 0x7fe2200c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2080033f0 con 0x7fe2200c8290 2023-10-24T02:03:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v1:172.21.15.148:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2849802075 0 0) 0x7fe2080033f0 con 0x7fe2200c8290 2023-10-24T02:03:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 msgr2=0x7fe2200a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.195 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe2200a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 >> v2:172.21.15.150:3300/0 conn(0x7fe2200aa640 msgr2=0x7fe2200c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/1282359491 >> v2:172.21.15.150:3300/0 conn(0x7fe2200aa640 0x7fe2200c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 --> v1:172.21.15.148:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200c0f40 con 0x7fe2200c8290 2023-10-24T02:03:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v1:172.21.15.148:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2130265644 0 0) 0x7fe2140017f0 con 0x7fe2200c8290 2023-10-24T02:03:53.196 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 >> v1:172.21.15.148:6789/0 conn(0x7fe2200c8290 legacy=0x7fe2200a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2080038e0 0x7fe208003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe208004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe208004b80 0x7fe208005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200c60e0 con 0x7fe2080038e0 2023-10-24T02:03:53.197 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200c0c80 con 0x7fe208004b80 2023-10-24T02:03:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20800b8e0 con 0x7fe2201544b0 2023-10-24T02:03:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2080038e0 0x7fe208003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe21ffff700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe208004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe2256d4700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe208004b80 0x7fe208005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 -- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 msgr2=0x7fe208004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2201544b0 0x7fe208004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 -- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe208004b80 msgr2=0x7fe208005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe208004b80 0x7fe208005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 -- 172.21.15.148:0/1282359491 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080033f0 con 0x7fe2080038e0 2023-10-24T02:03:53.199 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.185+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2080038e0 0x7fe208003d00 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fe210009a80 tx=0x7fe210009060).ready entity=mon.0 client_cookie=5c728ac456200fba server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210009430 con 0x7fe2080038e0 2023-10-24T02:03:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21000e640 con 0x7fe2080038e0 2023-10-24T02:03:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe21f7fe700 1 -- 172.21.15.148:0/1282359491 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21000e9c0 con 0x7fe2080038e0 2023-10-24T02:03:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 -- 172.21.15.148:0/1282359491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2080038e0 msgr2=0x7fe208003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 --2- 172.21.15.148:0/1282359491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2080038e0 0x7fe208003d00 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7fe210009a80 tx=0x7fe210009060).stop 2023-10-24T02:03:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe2256d4700 1 -- 172.21.15.148:0/1282359491 reap_dead start 2023-10-24T02:03:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 -- 172.21.15.148:0/1282359491 shutdown_connections 2023-10-24T02:03:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 -- 172.21.15.148:0/1282359491 >> 172.21.15.148:0/1282359491 conn(0x7fe2200945d0 msgr2=0x7fe22006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 -- 172.21.15.148:0/1282359491 shutdown_connections 2023-10-24T02:03:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.186+0000 7fe227137700 1 -- 172.21.15.148:0/1282359491 wait complete. 2023-10-24T02:03:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.187+0000 7fe227137700 1 Processor -- start 2023-10-24T02:03:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.187+0000 7fe227137700 1 -- start start 2023-10-24T02:03:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2080038e0 0x7fe22014f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe220152540 0x7fe2200acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 0x7fe2200acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220165910 con 0x7fe2201529c0 2023-10-24T02:03:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200af980 con 0x7fe2080038e0 2023-10-24T02:03:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe227137700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200ad4a0 con 0x7fe220152540 2023-10-24T02:03:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe2256d4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 0x7fe2200acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe2256d4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 0x7fe2200acfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51042/0 (socket says 172.21.15.148:51042) 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe2256d4700 1 -- 172.21.15.148:0/1264625636 learned_addr learned my addr 172.21.15.148:0/1264625636 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe21ffff700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe220152540 0x7fe2200acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.188+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2080038e0 0x7fe22014f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 -- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe220152540 msgr2=0x7fe2200acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.204 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe220152540 0x7fe2200acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 -- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2080038e0 msgr2=0x7fe22014f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2080038e0 0x7fe22014f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2201517e0 con 0x7fe2201529c0 2023-10-24T02:03:53.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2080038e0 0x7fe22014f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:53.205 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe2256d4700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 0x7fe2200acfb0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7fe2200c5ed0 tx=0x7fe218009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800f700 con 0x7fe2201529c0 2023-10-24T02:03:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21800f860 con 0x7fe2201529c0 2023-10-24T02:03:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800fc00 con 0x7fe2201529c0 2023-10-24T02:03:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220165630 con 0x7fe2201529c0 2023-10-24T02:03:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.189+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220151d40 con 0x7fe2201529c0 2023-10-24T02:03:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.190+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe22006c6b0 con 0x7fe2201529c0 2023-10-24T02:03:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.190+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe21801f460 con 0x7fe2201529c0 2023-10-24T02:03:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.190+0000 7fe21cff9700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe20c05f150 0x7fe20c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fe21807a5d0 con 0x7fe2201529c0 2023-10-24T02:03:53.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe20c05f150 0x7fe20c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21cff9700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7fe20c065a60 0x7fe20c067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe20c068540 con 0x7fe20c065a60 2023-10-24T02:03:53.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe21807f220 con 0x7fe2201529c0 2023-10-24T02:03:53.208 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21ffff700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7fe20c065a60 0x7fe20c067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe224ed3700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe20c05f150 0x7fe20c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe210006d50 tx=0x7fe21001a000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.191+0000 7fe21ffff700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7fe20c065a60 0x7fe20c067ec0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.209 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.192+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== osd.5 v2:172.21.15.150:6808/88070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe20c068540 con 0x7fe20c065a60 2023-10-24T02:03:53.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.205+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 --> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2200c1220 con 0x7fe20c065a60 2023-10-24T02:03:53.210 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe21cff9700 1 -- 172.21.15.148:0/1264625636 <== osd.5 v2:172.21.15.150:6808/88070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe2200c1220 con 0x7fe20c065a60 2023-10-24T02:03:53.210 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:53.211 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:53.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7fe20c065a60 msgr2=0x7fe20c067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.212 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6808/88070,v1:172.21.15.150:6809/88070] conn(0x7fe20c065a60 0x7fe20c067ec0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe20c05f150 msgr2=0x7fe20c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fe20c05f150 0x7fe20c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe210006d50 tx=0x7fe21001a000).stop 2023-10-24T02:03:53.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 msgr2=0x7fe2200acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.213 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 --2- 172.21.15.148:0/1264625636 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2201529c0 0x7fe2200acfb0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7fe2200c5ed0 tx=0x7fe218009060).stop 2023-10-24T02:03:53.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe2256d4700 1 -- 172.21.15.148:0/1264625636 reap_dead start 2023-10-24T02:03:53.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 shutdown_connections 2023-10-24T02:03:53.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 >> 172.21.15.148:0/1264625636 conn(0x7fe2200945d0 msgr2=0x7fe2200c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 shutdown_connections 2023-10-24T02:03:53.214 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.206+0000 7fe227137700 1 -- 172.21.15.148:0/1264625636 wait complete. 2023-10-24T02:03:53.219 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-24T02:03:53.334 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.333+0000 7f66de186700 1 Processor -- start 2023-10-24T02:03:53.335 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.333+0000 7f66de186700 1 -- start start 2023-10-24T02:03:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66de186700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f66d8154400 0x7f66d80c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66de186700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.337 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66de186700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d80c01c0 con 0x7f66d81547e0 2023-10-24T02:03:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66de186700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80aa960 con 0x7f66d8154400 2023-10-24T02:03:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66de186700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80c66f0 con 0x7f66d80c0b30 2023-10-24T02:03:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f66d8154400 0x7f66d80c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.338 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f66d8154400 0x7f66d80c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49732/0 (socket says 172.21.15.148:49732) 2023-10-24T02:03:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 -- 172.21.15.148:0/3506085142 learned_addr learned my addr 172.21.15.148:0/3506085142 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d7fff700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 -- 172.21.15.148:0/3506085142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 msgr2=0x7f66d80c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.339 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 -- 172.21.15.148:0/3506085142 >> v1:172.21.15.150:6789/0 conn(0x7f66d81547e0 legacy=0x7f66d80a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 -- 172.21.15.148:0/3506085142 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d80c6150 con 0x7f66d8154400 2023-10-24T02:03:53.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d77fe700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d8154400 0x7f66d80c8310 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f66c8006fd0 tx=0x7f66c80090f0).ready entity=mon.0 client_cookie=cee59139c7b00d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d6ffd700 1 -- 172.21.15.148:0/3506085142 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800b600 con 0x7f66d8154400 2023-10-24T02:03:53.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d6ffd700 1 -- 172.21.15.148:0/3506085142 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800b760 con 0x7f66d8154400 2023-10-24T02:03:53.340 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.334+0000 7f66d6ffd700 1 -- 172.21.15.148:0/3506085142 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800bb00 con 0x7f66d8154400 2023-10-24T02:03:53.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 -- 172.21.15.148:0/3506085142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d8154400 msgr2=0x7f66d80c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d8154400 0x7f66d80c8310 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f66c8006fd0 tx=0x7f66c80090f0).stop 2023-10-24T02:03:53.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 -- 172.21.15.148:0/3506085142 shutdown_connections 2023-10-24T02:03:53.341 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 --2- 172.21.15.148:0/3506085142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d8154400 0x7f66d80c8310 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 -- 172.21.15.148:0/3506085142 >> 172.21.15.148:0/3506085142 conn(0x7f66d80946a0 msgr2=0x7f66d806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 -- 172.21.15.148:0/3506085142 shutdown_connections 2023-10-24T02:03:53.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.335+0000 7f66de186700 1 -- 172.21.15.148:0/3506085142 wait complete. 2023-10-24T02:03:53.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.336+0000 7f66de186700 1 Processor -- start 2023-10-24T02:03:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.336+0000 7f66de186700 1 -- start start 2023-10-24T02:03:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d8154400 0x7f66d814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80b0440 con 0x7f66d81547e0 2023-10-24T02:03:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80afac0 con 0x7f66d8154400 2023-10-24T02:03:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66de186700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80aeeb0 con 0x7f66d80c0b30 2023-10-24T02:03:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.347 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49748/0 (socket says 172.21.15.148:49748) 2023-10-24T02:03:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 -- 172.21.15.148:0/112679070 learned_addr learned my addr 172.21.15.148:0/112679070 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d77fe700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66ceffd700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d8154400 0x7f66d814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 -- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 msgr2=0x7f66d80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.348 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 -- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d8154400 msgr2=0x7f66d814bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d8154400 0x7f66d814bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.337+0000 7f66d7fff700 1 -- 172.21.15.148:0/112679070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009370 con 0x7f66d81547e0 2023-10-24T02:03:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66d7fff700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f66d0009fa0 tx=0x7f66d0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000ebc0 con 0x7f66d81547e0 2023-10-24T02:03:53.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000ed20 con 0x7f66d81547e0 2023-10-24T02:03:53.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d80af190 con 0x7f66d81547e0 2023-10-24T02:03:53.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0014610 con 0x7f66d81547e0 2023-10-24T02:03:53.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.338+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d80af750 con 0x7f66d81547e0 2023-10-24T02:03:53.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.339+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d806c6b0 con 0x7f66d81547e0 2023-10-24T02:03:53.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.339+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f66d001d3b0 con 0x7f66d81547e0 2023-10-24T02:03:53.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.340+0000 7f66cffff700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 0x7f66b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.340+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f66d007a510 con 0x7f66d81547e0 2023-10-24T02:03:53.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.340+0000 7f66d77fe700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 0x7f66b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.340+0000 7f66d77fe700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 0x7f66b8061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f66c800b3c0 tx=0x7f66c8017000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.352 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.344+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f66d004b8d0 con 0x7f66d81547e0 2023-10-24T02:03:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.507+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d80bffa0 con 0x7f66b805f150 2023-10-24T02:03:53.509 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.508+0000 7f66cffff700 1 -- 172.21.15.148:0/112679070 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66d80bffa0 con 0x7f66b805f150 2023-10-24T02:03:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 msgr2=0x7f66b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 0x7f66b8061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f66c800b3c0 tx=0x7f66c8017000).stop 2023-10-24T02:03:53.512 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 msgr2=0x7f66d80aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f66d0009fa0 tx=0x7f66d0009900).stop 2023-10-24T02:03:53.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 shutdown_connections 2023-10-24T02:03:53.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f66d81547e0 0x7f66d80aab90 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f66d80c0b30 0x7f66d80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.513 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f66b805f150 0x7f66b8061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 --2- 172.21.15.148:0/112679070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66d8154400 0x7f66d814bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 >> 172.21.15.148:0/112679070 conn(0x7f66d80946a0 msgr2=0x7f66d81589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 shutdown_connections 2023-10-24T02:03:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.510+0000 7f66de186700 1 -- 172.21.15.148:0/112679070 wait complete. 2023-10-24T02:03:53.514 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 5 to deep-scrub 2023-10-24T02:03:53.523 INFO:tasks.ceph:Scrubbing osd.6 2023-10-24T02:03:53.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.639+0000 7fbfcba10700 1 Processor -- start 2023-10-24T02:03:53.641 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.639+0000 7fbfcba10700 1 -- start start 2023-10-24T02:03:53.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfcba10700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfc4133f20 0x7fbfc4151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfcba10700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfc4155810 0x7fbfc4065430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.643 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfcba10700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc4065d80 con 0x7fbfc4065920 2023-10-24T02:03:53.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfcba10700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40bdad0 con 0x7fbfc4133f20 2023-10-24T02:03:53.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfcba10700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40bca30 con 0x7fbfc4155810 2023-10-24T02:03:53.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfc97ac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfc4133f20 0x7fbfc4151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfc9fad700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7fbfc4065920 0x7fbfc40c21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57546/0 (socket says 172.21.15.148:57546) 2023-10-24T02:03:53.644 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfc97ac700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7fbfc4133f20 0x7fbfc4151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49760/0 (socket says 172.21.15.148:49760) 2023-10-24T02:03:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfc9fad700 1 -- 172.21.15.148:0/205626715 learned_addr learned my addr 172.21.15.148:0/205626715 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.640+0000 7fbfc8fab700 1 --2- 172.21.15.148:0/205626715 >> v2:172.21.15.150:3300/0 conn(0x7fbfc4155810 0x7fbfc4065430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfc97ac700 1 -- 172.21.15.148:0/205626715 >> v2:172.21.15.150:3300/0 conn(0x7fbfc4155810 msgr2=0x7fbfc4065430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfc97ac700 1 --2- 172.21.15.148:0/205626715 >> v2:172.21.15.150:3300/0 conn(0x7fbfc4155810 0x7fbfc4065430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.645 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfc97ac700 1 -- 172.21.15.148:0/205626715 >> v1:172.21.15.148:6789/0 conn(0x7fbfc4065920 legacy=0x7fbfc40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfc97ac700 1 -- 172.21.15.148:0/205626715 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40bcd10 con 0x7fbfc4133f20 2023-10-24T02:03:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfbbfff700 1 -- 172.21.15.148:0/205626715 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774216227 0 0) 0x7fbfc4065d80 con 0x7fbfc4065920 2023-10-24T02:03:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfc97ac700 1 --2- 172.21.15.148:0/205626715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4133f20 0x7fbfc4151ea0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7fbfc4068320 tx=0x7fbfc0009060).ready entity=mon.0 client_cookie=419eb262ad2941e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfbbfff700 1 -- 172.21.15.148:0/205626715 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000f510 con 0x7fbfc4133f20 2023-10-24T02:03:53.646 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfbbfff700 1 -- 172.21.15.148:0/205626715 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc000f670 con 0x7fbfc4133f20 2023-10-24T02:03:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfbbfff700 1 -- 172.21.15.148:0/205626715 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000f9f0 con 0x7fbfc4133f20 2023-10-24T02:03:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfcba10700 1 -- 172.21.15.148:0/205626715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4133f20 msgr2=0x7fbfc4151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.641+0000 7fbfcba10700 1 --2- 172.21.15.148:0/205626715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4133f20 0x7fbfc4151ea0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7fbfc4068320 tx=0x7fbfc0009060).stop 2023-10-24T02:03:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 -- 172.21.15.148:0/205626715 shutdown_connections 2023-10-24T02:03:53.647 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 --2- 172.21.15.148:0/205626715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4133f20 0x7fbfc4151ea0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 --2- 172.21.15.148:0/205626715 >> v2:172.21.15.150:3300/0 conn(0x7fbfc4155810 0x7fbfc4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 -- 172.21.15.148:0/205626715 >> 172.21.15.148:0/205626715 conn(0x7fbfc40c3670 msgr2=0x7fbfc40c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 -- 172.21.15.148:0/205626715 shutdown_connections 2023-10-24T02:03:53.648 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.642+0000 7fbfcba10700 1 -- 172.21.15.148:0/205626715 wait complete. 2023-10-24T02:03:53.651 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.643+0000 7fbfcba10700 1 Processor -- start 2023-10-24T02:03:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.643+0000 7fbfcba10700 1 -- start start 2023-10-24T02:03:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 0x7fbfc40be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfc4133f20 0x7fbfc4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.652 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4155810 0x7fbfc40bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4154460 con 0x7fbfc4065920 2023-10-24T02:03:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40c0ba0 con 0x7fbfc4155810 2023-10-24T02:03:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4168120 con 0x7fbfc4133f20 2023-10-24T02:03:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 0x7fbfc40be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.653 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 0x7fbfc40be5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49762/0 (socket says 172.21.15.148:49762) 2023-10-24T02:03:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 -- 172.21.15.148:0/3663283565 learned_addr learned my addr 172.21.15.148:0/3663283565 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc8fab700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfc4133f20 0x7fbfc4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc9fad700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4155810 0x7fbfc40bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 -- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfc4133f20 msgr2=0x7fbfc4153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.654 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfc4133f20 0x7fbfc4153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 -- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4155810 msgr2=0x7fbfc40bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4155810 0x7fbfc40bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00092a0 con 0x7fbfc4065920 2023-10-24T02:03:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc9fad700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfc4155810 0x7fbfc40bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:53.655 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc8fab700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfc4133f20 0x7fbfc4153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:53.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfc97ac700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 0x7fbfc40be5b0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7fbfc0006df0 tx=0x7fbfc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000f9f0 con 0x7fbfc4065920 2023-10-24T02:03:53.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0000c90 con 0x7fbfc4065920 2023-10-24T02:03:53.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc40c0310 con 0x7fbfc4065920 2023-10-24T02:03:53.656 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc001b660 con 0x7fbfc4065920 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.644+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc40c08c0 con 0x7fbfc4065920 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.645+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfc406c6b0 con 0x7fbfc4065920 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.645+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbfc001b9d0 con 0x7fbfc4065920 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfb97fa700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbfa805f150 0x7fbfa8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fbfc007bb30 con 0x7fbfc4065920 2023-10-24T02:03:53.657 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfb97fa700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7fbfa8065a60 0x7fbfa8067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfc8fab700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbfa805f150 0x7fbfa8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfa8068540 con 0x7fbfa8065a60 2023-10-24T02:03:53.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc0080220 con 0x7fbfc4065920 2023-10-24T02:03:53.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfc9fad700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7fbfa8065a60 0x7fbfa8067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.658 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.646+0000 7fbfc8fab700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbfa805f150 0x7fbfa8061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbfc4069e30 tx=0x7fbfb4008040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.647+0000 7fbfc9fad700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7fbfa8065a60 0x7fbfa8067ec0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.659 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.647+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== osd.6 v2:172.21.15.150:6824/88100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fbfa8068540 con 0x7fbfa8065a60 2023-10-24T02:03:53.661 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.660+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 --> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbfc40bcff0 con 0x7fbfa8065a60 2023-10-24T02:03:53.662 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfb97fa700 1 -- 172.21.15.148:0/3663283565 <== osd.6 v2:172.21.15.150:6824/88100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbfc40bcff0 con 0x7fbfa8065a60 2023-10-24T02:03:53.662 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:53.663 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:53.663 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7fbfa8065a60 msgr2=0x7fbfa8067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6824/88100,v1:172.21.15.150:6825/88100] conn(0x7fbfa8065a60 0x7fbfa8067ec0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbfa805f150 msgr2=0x7fbfa8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fbfa805f150 0x7fbfa8061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbfc4069e30 tx=0x7fbfb4008040).stop 2023-10-24T02:03:53.664 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 msgr2=0x7fbfc40be5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 --2- 172.21.15.148:0/3663283565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc4065920 0x7fbfc40be5b0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 rx=0x7fbfc0006df0 tx=0x7fbfc0017000).stop 2023-10-24T02:03:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfc9fad700 1 -- 172.21.15.148:0/3663283565 reap_dead start 2023-10-24T02:03:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 shutdown_connections 2023-10-24T02:03:53.665 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 >> 172.21.15.148:0/3663283565 conn(0x7fbfc40c3670 msgr2=0x7fbfc4069140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 shutdown_connections 2023-10-24T02:03:53.666 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.661+0000 7fbfcba10700 1 -- 172.21.15.148:0/3663283565 wait complete. 2023-10-24T02:03:53.674 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-24T02:03:53.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.786+0000 7f1216f47700 1 Processor -- start 2023-10-24T02:03:53.788 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.787+0000 7f1216f47700 1 -- start start 2023-10-24T02:03:53.790 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.787+0000 7f1216f47700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f12100631e0 0x7f1210154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.787+0000 7f1216f47700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210158940 con 0x7f12100bde70 2023-10-24T02:03:53.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.787+0000 7f1216f47700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210157d70 con 0x7f1210153e30 2023-10-24T02:03:53.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.787+0000 7f1216f47700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1210158010 con 0x7f12100631e0 2023-10-24T02:03:53.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f12100631e0 0x7f1210154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.791 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12154e4700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f12100bde70 0x7f1210069400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57550/0 (socket says 172.21.15.148:57550) 2023-10-24T02:03:53.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f12100631e0 0x7f1210154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49770/0 (socket says 172.21.15.148:49770) 2023-10-24T02:03:53.792 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12154e4700 1 -- 172.21.15.148:0/3398087024 learned_addr learned my addr 172.21.15.148:0/3398087024 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:53.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 -- 172.21.15.148:0/3398087024 >> v1:172.21.15.150:6789/0 conn(0x7f1210153e30 legacy=0x7f12100c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 -- 172.21.15.148:0/3398087024 >> v1:172.21.15.148:6789/0 conn(0x7f12100bde70 legacy=0x7f1210069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12077fe700 1 -- 172.21.15.148:0/3398087024 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936614274 0 0) 0x7f1210158940 con 0x7f12100bde70 2023-10-24T02:03:53.793 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 -- 172.21.15.148:0/3398087024 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12101582f0 con 0x7f12100631e0 2023-10-24T02:03:53.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f1207fff700 1 --2- 172.21.15.148:0/3398087024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12100631e0 0x7f1210154210 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f1200009760 tx=0x7f1200009060).ready entity=mon.0 client_cookie=3eee301413752747 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12077fe700 1 -- 172.21.15.148:0/3398087024 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000b580 con 0x7f12100631e0 2023-10-24T02:03:53.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12077fe700 1 -- 172.21.15.148:0/3398087024 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120000b6e0 con 0x7f12100631e0 2023-10-24T02:03:53.794 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.788+0000 7f12077fe700 1 -- 172.21.15.148:0/3398087024 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000ba60 con 0x7f12100631e0 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 -- 172.21.15.148:0/3398087024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12100631e0 msgr2=0x7f1210154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 --2- 172.21.15.148:0/3398087024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12100631e0 0x7f1210154210 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f1200009760 tx=0x7f1200009060).stop 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 -- 172.21.15.148:0/3398087024 shutdown_connections 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 --2- 172.21.15.148:0/3398087024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12100631e0 0x7f1210154210 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 -- 172.21.15.148:0/3398087024 >> 172.21.15.148:0/3398087024 conn(0x7f12100c7cf0 msgr2=0x7f12100c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.795 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 -- 172.21.15.148:0/3398087024 shutdown_connections 2023-10-24T02:03:53.796 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.789+0000 7f1216f47700 1 -- 172.21.15.148:0/3398087024 wait complete. 2023-10-24T02:03:53.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.790+0000 7f1216f47700 1 Processor -- start 2023-10-24T02:03:53.798 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.790+0000 7f1216f47700 1 -- start start 2023-10-24T02:03:53.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12100631e0 0x7f1210156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 0x7f1210140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210140d30 con 0x7f1210153e30 2023-10-24T02:03:53.799 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100a77d0 con 0x7f12100631e0 2023-10-24T02:03:53.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100a7a20 con 0x7f12100bde70 2023-10-24T02:03:53.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49780/0 (socket says 172.21.15.148:49780) 2023-10-24T02:03:53.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 -- 172.21.15.148:0/2373121831 learned_addr learned my addr 172.21.15.148:0/2373121831 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:53.800 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1214ce3700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12100631e0 0x7f1210156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1207fff700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 0x7f1210140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 -- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 msgr2=0x7f1210140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 0x7f1210140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 -- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12100631e0 msgr2=0x7f1210156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.801 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12100631e0 0x7f1210156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 -- 172.21.15.148:0/2373121831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000092a0 con 0x7f1210153e30 2023-10-24T02:03:53.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1207fff700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 0x7f1210140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:53.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f12154e4700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f120800c490 tx=0x7f1208007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080072e0 con 0x7f1210153e30 2023-10-24T02:03:53.802 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208007440 con 0x7f1210153e30 2023-10-24T02:03:53.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12100a7d00 con 0x7f1210153e30 2023-10-24T02:03:53.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.791+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080057a0 con 0x7f1210153e30 2023-10-24T02:03:53.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.792+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100a82c0 con 0x7f1210153e30 2023-10-24T02:03:53.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.792+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121006c6b0 con 0x7f1210153e30 2023-10-24T02:03:53.803 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.793+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1208005b90 con 0x7f1210153e30 2023-10-24T02:03:53.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.793+0000 7f1204ff9700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 0x7f11fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:53.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.793+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f1208079920 con 0x7f1210153e30 2023-10-24T02:03:53.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.793+0000 7f1214ce3700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 0x7f11fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:53.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.794+0000 7f1214ce3700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 0x7f11fc061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f120c004290 tx=0x7f120c0014c0).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:53.804 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.797+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f120804ad40 con 0x7f1210153e30 2023-10-24T02:03:53.963 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.962+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f12100be920 con 0x7f11fc05f150 2023-10-24T02:03:53.964 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.962+0000 7f1204ff9700 1 -- 172.21.15.148:0/2373121831 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12100be920 con 0x7f11fc05f150 2023-10-24T02:03:53.965 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 msgr2=0x7f11fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 0x7f11fc061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f120c004290 tx=0x7f120c0014c0).stop 2023-10-24T02:03:53.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 msgr2=0x7f1210140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:53.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f120800c490 tx=0x7f1208007c10).stop 2023-10-24T02:03:53.966 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 shutdown_connections 2023-10-24T02:03:53.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1210153e30 0x7f1210140840 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f11fc05f150 0x7f11fc061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12100631e0 0x7f1210156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 --2- 172.21.15.148:0/2373121831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12100bde70 0x7f1210140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:53.967 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 >> 172.21.15.148:0/2373121831 conn(0x7f12100c7cf0 msgr2=0x7f1210065ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:53.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 shutdown_connections 2023-10-24T02:03:53.968 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:53.964+0000 7f1216f47700 1 -- 172.21.15.148:0/2373121831 wait complete. 2023-10-24T02:03:53.968 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 6 to deep-scrub 2023-10-24T02:03:53.977 INFO:tasks.ceph:Scrubbing osd.7 2023-10-24T02:03:53.977 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-24T02:03:54.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.093+0000 7f8215c7d700 1 Processor -- start 2023-10-24T02:03:54.095 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.093+0000 7f8215c7d700 1 -- start start 2023-10-24T02:03:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.094+0000 7f8215c7d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8210153fd0 0x7f821006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.094+0000 7f8215c7d700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100c6f40 con 0x7f82100c5c50 2023-10-24T02:03:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.094+0000 7f8215c7d700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82100c60e0 con 0x7f82100c9a60 2023-10-24T02:03:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.094+0000 7f8215c7d700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82100c75f0 con 0x7f8210153fd0 2023-10-24T02:03:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.094+0000 7f8214c7b700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f8210153fd0 0x7f821006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820ffff700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f82100c5c50 0x7f82100c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57566/0 (socket says 172.21.15.148:57566) 2023-10-24T02:03:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820ffff700 1 -- 172.21.15.148:0/1319506638 learned_addr learned my addr 172.21.15.148:0/1319506638 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f8214c7b700 1 -- 172.21.15.148:0/1319506638 >> v1:172.21.15.150:6789/0 conn(0x7f82100c9a60 legacy=0x7f82100a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f8214c7b700 1 -- 172.21.15.148:0/1319506638 >> v1:172.21.15.148:6789/0 conn(0x7f82100c5c50 legacy=0x7f82100c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820f7fe700 1 -- 172.21.15.148:0/1319506638 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027206854 0 0) 0x7f82100c6f40 con 0x7f82100c5c50 2023-10-24T02:03:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f8214c7b700 1 -- 172.21.15.148:0/1319506638 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100c6330 con 0x7f8210153fd0 2023-10-24T02:03:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f8214c7b700 1 --2- 172.21.15.148:0/1319506638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8210153fd0 0x7f821006a560 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f8200009760 tx=0x7f8200009060).ready entity=mon.0 client_cookie=75cd5566200fa290 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820f7fe700 1 -- 172.21.15.148:0/1319506638 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000b580 con 0x7f8210153fd0 2023-10-24T02:03:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820f7fe700 1 -- 172.21.15.148:0/1319506638 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820000b6e0 con 0x7f8210153fd0 2023-10-24T02:03:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.095+0000 7f820f7fe700 1 -- 172.21.15.148:0/1319506638 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820000ba60 con 0x7f8210153fd0 2023-10-24T02:03:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 -- 172.21.15.148:0/1319506638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8210153fd0 msgr2=0x7f821006a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 --2- 172.21.15.148:0/1319506638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8210153fd0 0x7f821006a560 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7f8200009760 tx=0x7f8200009060).stop 2023-10-24T02:03:54.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 -- 172.21.15.148:0/1319506638 shutdown_connections 2023-10-24T02:03:54.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 --2- 172.21.15.148:0/1319506638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8210153fd0 0x7f821006a560 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 -- 172.21.15.148:0/1319506638 >> 172.21.15.148:0/1319506638 conn(0x7f8210084b60 msgr2=0x7f8210094480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.101 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 -- 172.21.15.148:0/1319506638 shutdown_connections 2023-10-24T02:03:54.102 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.096+0000 7f8215c7d700 1 -- 172.21.15.148:0/1319506638 wait complete. 2023-10-24T02:03:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.097+0000 7f8215c7d700 1 Processor -- start 2023-10-24T02:03:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.097+0000 7f8215c7d700 1 -- start start 2023-10-24T02:03:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82100c5c50 0x7f82101641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 0x7f82100aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82100c49a0 0x7f82100acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100aadf0 con 0x7f82100c9a60 2023-10-24T02:03:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82100ad900 con 0x7f82100c5c50 2023-10-24T02:03:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8215c7d700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82100ab000 con 0x7f82100c49a0 2023-10-24T02:03:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 0x7f82100aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 0x7f82100aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49802/0 (socket says 172.21.15.148:49802) 2023-10-24T02:03:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 -- 172.21.15.148:0/3792457333 learned_addr learned my addr 172.21.15.148:0/3792457333 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8214c7b700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82100c5c50 0x7f82101641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f821547c700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82100c49a0 0x7f82100acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.107 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 -- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82100c49a0 msgr2=0x7f82100acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82100c49a0 0x7f82100acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 -- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82100c5c50 msgr2=0x7f82101641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82100c5c50 0x7f82101641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000092a0 con 0x7f82100c9a60 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f8214c7b700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82100c5c50 0x7f82101641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:54.108 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.098+0000 7f820ffff700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 0x7f82100aa900 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f820400c810 tx=0x7f8204007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204005d30 con 0x7f82100c9a60 2023-10-24T02:03:54.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204007110 con 0x7f82100c9a60 2023-10-24T02:03:54.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82100ab2e0 con 0x7f82100c9a60 2023-10-24T02:03:54.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040074d0 con 0x7f82100c9a60 2023-10-24T02:03:54.109 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82100ab8a0 con 0x7f82100c9a60 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.099+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8210047480 con 0x7f82100c9a60 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.100+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8204013410 con 0x7f82100c9a60 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.100+0000 7f820cff9700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f81fc05f150 0x7f81fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.100+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f820407a170 con 0x7f82100c9a60 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.100+0000 7f820cff9700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f81fc065a60 0x7f81fc067ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.110 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81fc068540 con 0x7f81fc065a60 2023-10-24T02:03:54.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=221) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820407c790 con 0x7f82100c9a60 2023-10-24T02:03:54.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f8214c7b700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f81fc05f150 0x7f81fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f821547c700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f81fc065a60 0x7f81fc067ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f8214c7b700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f81fc05f150 0x7f81fc061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8210083ee0 tx=0x7f8200017000).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.111 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.101+0000 7f821547c700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f81fc065a60 0x7f81fc067ec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.112 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.102+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== osd.7 v2:172.21.15.150:6816/88101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f81fc068540 con 0x7f81fc065a60 2023-10-24T02:03:54.116 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.115+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 --> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f82100c6610 con 0x7f81fc065a60 2023-10-24T02:03:54.117 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.115+0000 7f820cff9700 1 -- 172.21.15.148:0/3792457333 <== osd.7 v2:172.21.15.150:6816/88101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f82100c6610 con 0x7f81fc065a60 2023-10-24T02:03:54.117 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2023-10-24T02:03:54.117 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-24T02:03:54.118 INFO:teuthology.orchestra.run.smithi148.stdout:} 2023-10-24T02:03:54.118 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f81fc065a60 msgr2=0x7f81fc067ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6816/88101,v1:172.21.15.150:6817/88101] conn(0x7f81fc065a60 0x7f81fc067ec0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f81fc05f150 msgr2=0x7f81fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f81fc05f150 0x7f81fc061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8210083ee0 tx=0x7f8200017000).stop 2023-10-24T02:03:54.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 msgr2=0x7f82100aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.119 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 --2- 172.21.15.148:0/3792457333 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f82100c9a60 0x7f82100aa900 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f820400c810 tx=0x7f8204007f90).stop 2023-10-24T02:03:54.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f821547c700 1 -- 172.21.15.148:0/3792457333 reap_dead start 2023-10-24T02:03:54.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 shutdown_connections 2023-10-24T02:03:54.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 >> 172.21.15.148:0/3792457333 conn(0x7f8210084b60 msgr2=0x7f82100631d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 shutdown_connections 2023-10-24T02:03:54.120 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.116+0000 7f8215c7d700 1 -- 172.21.15.148:0/3792457333 wait complete. 2023-10-24T02:03:54.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-24T02:03:54.242 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.241+0000 7fd343e5e700 1 Processor -- start 2023-10-24T02:03:54.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.241+0000 7fd343e5e700 1 -- start start 2023-10-24T02:03:54.243 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.242+0000 7fd343e5e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.242+0000 7fd343e5e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd33c0c0b30 0x7fd33c0c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.242+0000 7fd343e5e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0c01c0 con 0x7fd33c1547e0 2023-10-24T02:03:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.242+0000 7fd343e5e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c0aa960 con 0x7fd33c0c0b30 2023-10-24T02:03:54.244 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.242+0000 7fd343e5e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0c66f0 con 0x7fd33c154400 2023-10-24T02:03:54.246 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd341bfa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd33c0c0b30 0x7fd33c0c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd341bfa700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.148:40804/0 (socket says 172.21.15.148:40804) 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd341bfa700 1 -- 172.21.15.148:0/520888537 learned_addr learned my addr 172.21.15.148:0/520888537 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3413f9700 1 --1- 172.21.15.148:0/520888537 >> v1:172.21.15.150:6789/0 conn(0x7fd33c1547e0 0x7fd33c0a7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.148:39114/0 (socket says 172.21.15.148:39114) 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 -- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 msgr2=0x7fd33c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:54.247 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 -- 172.21.15.148:0/520888537 >> v1:172.21.15.150:6789/0 conn(0x7fd33c1547e0 legacy=0x7fd33c0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 -- 172.21.15.148:0/520888537 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0c6150 con 0x7fd33c0c0b30 2023-10-24T02:03:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd341bfa700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-24T02:03:54.249 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd3423fb700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c0c0f60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd334009760 tx=0x7fd334009060).ready entity=mon.1 client_cookie=e200dac7c4370e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd340bf8700 1 -- 172.21.15.148:0/520888537 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3340090d0 con 0x7fd33c0c0b30 2023-10-24T02:03:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd340bf8700 1 -- 172.21.15.148:0/520888537 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400f510 con 0x7fd33c0c0b30 2023-10-24T02:03:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.243+0000 7fd340bf8700 1 -- 172.21.15.148:0/520888537 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400f890 con 0x7fd33c0c0b30 2023-10-24T02:03:54.250 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 -- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 msgr2=0x7fd33c0c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c0c0f60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fd334009760 tx=0x7fd334009060).stop 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 -- 172.21.15.148:0/520888537 shutdown_connections 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c0c0f60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 --2- 172.21.15.148:0/520888537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 -- 172.21.15.148:0/520888537 >> 172.21.15.148:0/520888537 conn(0x7fd33c0946a0 msgr2=0x7fd33c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.251 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 -- 172.21.15.148:0/520888537 shutdown_connections 2023-10-24T02:03:54.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.244+0000 7fd343e5e700 1 -- 172.21.15.148:0/520888537 wait complete. 2023-10-24T02:03:54.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.245+0000 7fd343e5e700 1 Processor -- start 2023-10-24T02:03:54.252 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.245+0000 7fd343e5e700 1 -- start start 2023-10-24T02:03:54.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.254 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1558f0 con 0x7fd33c1547e0 2023-10-24T02:03:54.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c154cb0 con 0x7fd33c0c0b30 2023-10-24T02:03:54.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd343e5e700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c154f50 con 0x7fd33c154400 2023-10-24T02:03:54.255 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49808/0 (socket says 172.21.15.148:49808) 2023-10-24T02:03:54.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 -- 172.21.15.148:0/10126034 learned_addr learned my addr 172.21.15.148:0/10126034 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:54.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3413f9700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd341bfa700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.256 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 -- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 msgr2=0x7fd33c167460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c167460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 -- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 msgr2=0x7fd33c164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.246+0000 7fd3423fb700 1 -- 172.21.15.148:0/10126034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009ae0 con 0x7fd33c1547e0 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd3423fb700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fd33c084250 tx=0x7fd334017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.257 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334006970 con 0x7fd33c1547e0 2023-10-24T02:03:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400f680 con 0x7fd33c1547e0 2023-10-24T02:03:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3340092a0 con 0x7fd33c1547e0 2023-10-24T02:03:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33401b410 con 0x7fd33c1547e0 2023-10-24T02:03:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.247+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c155510 con 0x7fd33c1547e0 2023-10-24T02:03:54.258 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.248+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c155a30 con 0x7fd33c1547e0 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.248+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd33401b7c0 con 0x7fd33c1547e0 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.249+0000 7fd331ffb700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 0x7fd320061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.249+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7fd33407b8e0 con 0x7fd33c1547e0 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.249+0000 7fd341bfa700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 0x7fd320061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.249+0000 7fd341bfa700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 0x7fd320061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd3380072d0 tx=0x7fd33800b040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.259 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.253+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd33404cd00 con 0x7fd33c1547e0 2023-10-24T02:03:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.413+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd33c0bffa0 con 0x7fd32005f180 2023-10-24T02:03:54.415 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.413+0000 7fd331ffb700 1 -- 172.21.15.148:0/10126034 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd33c0bffa0 con 0x7fd32005f180 2023-10-24T02:03:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 msgr2=0x7fd320061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 0x7fd320061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd3380072d0 tx=0x7fd33800b040).stop 2023-10-24T02:03:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 msgr2=0x7fd33c0c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.417 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7fd33c084250 tx=0x7fd334017000).stop 2023-10-24T02:03:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 shutdown_connections 2023-10-24T02:03:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd33c1547e0 0x7fd33c0c47b0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7fd32005f180 0x7fd320061640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.418 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd33c0c0b30 0x7fd33c164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 --2- 172.21.15.148:0/10126034 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd33c154400 0x7fd33c167460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 >> 172.21.15.148:0/10126034 conn(0x7fd33c0946a0 msgr2=0x7fd33c153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 shutdown_connections 2023-10-24T02:03:54.419 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.415+0000 7fd343e5e700 1 -- 172.21.15.148:0/10126034 wait complete. 2023-10-24T02:03:54.420 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 7 to deep-scrub 2023-10-24T02:03:54.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:03:54.542 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.541+0000 7f2298bda700 1 Processor -- start 2023-10-24T02:03:54.543 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.541+0000 7f2298bda700 1 -- start start 2023-10-24T02:03:54.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2298bda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 0x7f22940c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2298bda700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22940aa3f0 0x7f2294069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2298bda700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940c0960 con 0x7f22940c6710 2023-10-24T02:03:54.545 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2298bda700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940aa8a0 con 0x7f22940aa3f0 2023-10-24T02:03:54.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2298bda700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c0c40 con 0x7f22940aa010 2023-10-24T02:03:54.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f22940aa3f0 0x7f2294069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2289d9b700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f22940c6710 0x7f2294158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:57582/0 (socket says 172.21.15.148:57582) 2023-10-24T02:03:54.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2289d9b700 1 -- 172.21.15.148:0/975571141 learned_addr learned my addr 172.21.15.148:0/975571141 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:03:54.546 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f229259c700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 0x7f22940c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 -- 172.21.15.148:0/975571141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 msgr2=0x7f22940c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 0x7f22940c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 -- 172.21.15.148:0/975571141 >> v1:172.21.15.148:6789/0 conn(0x7f22940c6710 legacy=0x7f2294158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 -- 172.21.15.148:0/975571141 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940c0f20 con 0x7f22940aa3f0 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2291d9b700 1 -- 172.21.15.148:0/975571141 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389179134 0 0) 0x7f22940c0960 con 0x7f22940c6710 2023-10-24T02:03:54.547 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f229259c700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 0x7f22940c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:03:54.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.542+0000 7f2292d9d700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa3f0 0x7f2294069d80 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f228c009760 tx=0x7f228c009060).ready entity=mon.0 client_cookie=86d20bddf4cc5e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2291d9b700 1 -- 172.21.15.148:0/975571141 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00b580 con 0x7f22940aa3f0 2023-10-24T02:03:54.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2291d9b700 1 -- 172.21.15.148:0/975571141 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00b6e0 con 0x7f22940aa3f0 2023-10-24T02:03:54.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2291d9b700 1 -- 172.21.15.148:0/975571141 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00ba60 con 0x7f22940aa3f0 2023-10-24T02:03:54.548 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 -- 172.21.15.148:0/975571141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa3f0 msgr2=0x7f2294069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa3f0 0x7f2294069d80 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f228c009760 tx=0x7f228c009060).stop 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 -- 172.21.15.148:0/975571141 shutdown_connections 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa3f0 0x7f2294069d80 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 --2- 172.21.15.148:0/975571141 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940aa010 0x7f22940c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 -- 172.21.15.148:0/975571141 >> 172.21.15.148:0/975571141 conn(0x7f22940caf40 msgr2=0x7f22940cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.549 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 -- 172.21.15.148:0/975571141 shutdown_connections 2023-10-24T02:03:54.550 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.543+0000 7f2298bda700 1 -- 172.21.15.148:0/975571141 wait complete. 2023-10-24T02:03:54.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.544+0000 7f2298bda700 1 Processor -- start 2023-10-24T02:03:54.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.544+0000 7f2298bda700 1 -- start start 2023-10-24T02:03:54.552 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 0x7f2294140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940c6710 0x7f2294069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294155750 con 0x7f22940aa010 2023-10-24T02:03:54.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294155a30 con 0x7f22940aa3f0 2023-10-24T02:03:54.553 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f2298bda700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294155d10 con 0x7f22940c6710 2023-10-24T02:03:54.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f229259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f229259c700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49836/0 (socket says 172.21.15.148:49836) 2023-10-24T02:03:54.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.545+0000 7f229259c700 1 -- 172.21.15.148:0/3738783376 learned_addr learned my addr 172.21.15.148:0/3738783376 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:03:54.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f2292d9d700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940c6710 0x7f2294069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.554 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 -- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940c6710 msgr2=0x7f2294069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f2289d9b700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 0x7f2294140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940c6710 0x7f2294069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 -- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 msgr2=0x7f2294140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 0x7f2294140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 -- 172.21.15.148:0/3738783376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0092a0 con 0x7f22940aa010 2023-10-24T02:03:54.555 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f2289d9b700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 0x7f2294140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:03:54.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f229259c700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7f228400d1d0 tx=0x7f2284009a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400de70 con 0x7f22940aa010 2023-10-24T02:03:54.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400f040 con 0x7f22940aa010 2023-10-24T02:03:54.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2294155ff0 con 0x7f22940aa010 2023-10-24T02:03:54.556 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284013600 con 0x7f22940aa010 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.546+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941520d0 con 0x7f22940aa010 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.547+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294156510 con 0x7f22940aa010 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.547+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f22840139f0 con 0x7f22940aa010 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.548+0000 7f228affd700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 0x7f22740615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.548+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f228407a880 con 0x7f22940aa010 2023-10-24T02:03:54.557 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.548+0000 7f2289d9b700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 0x7f22740615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:03:54.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.548+0000 7f2289d9b700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 0x7f22740615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f22940adc70 tx=0x7f227c009040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:03:54.558 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.552+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2294156510 con 0x7f22940aa010 2023-10-24T02:03:54.714 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.712+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2294156510 con 0x7f227405f120 2023-10-24T02:03:54.717 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.716+0000 7f228affd700 1 -- 172.21.15.148:0/3738783376 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71006 (secure 0 0 0) 0x7f2294156510 con 0x7f227405f120 2023-10-24T02:03:54.718 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:03:54.719 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 msgr2=0x7f22740615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 0x7f22740615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f22940adc70 tx=0x7f227c009040).stop 2023-10-24T02:03:54.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 msgr2=0x7f2294151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:03:54.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x7f228400d1d0 tx=0x7f2284009a90).stop 2023-10-24T02:03:54.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 shutdown_connections 2023-10-24T02:03:54.720 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22940c6710 0x7f2294069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22940aa010 0x7f2294151be0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f227405f120 0x7f22740615e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 --2- 172.21.15.148:0/3738783376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22940aa3f0 0x7f2294140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 >> 172.21.15.148:0/3738783376 conn(0x7f22940caf40 msgr2=0x7f22941536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 shutdown_connections 2023-10-24T02:03:54.721 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:03:54.718+0000 7f2298bda700 1 -- 172.21.15.148:0/3738783376 wait complete. 2023-10-24T02:03:54.722 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:03:54.731 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-10-24T02:03:54.432523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459840,"kb_used_data":21632,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752514880,"statfs":{"total":773094113280,"available":770575237120,"internally_reserved":0,"allocated":22151168,"data_stored":11315304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12241,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999304"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.449374+0000","last_change":"2023-10-24T00:28:49.686790+0000","last_active":"2023-10-24T02:03:45.449374+0000","last_peered":"2023-10-24T02:03:45.449374+0000","last_clean":"2023-10-24T02:03:45.449374+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:45.449374+0000","last_undegraded":"2023-10-24T02:03:45.449374+0000","last_fullsized":"2023-10-24T02:03:45.449374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:46.295292+0000","last_change":"2023-10-24T00:28:48.807053+0000","last_active":"2023-10-24T02:03:46.295292+0000","last_peered":"2023-10-24T02:03:46.295292+0000","last_clean":"2023-10-24T02:03:46.295292+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:46.295292+0000","last_undegraded":"2023-10-24T02:03:46.295292+0000","last_fullsized":"2023-10-24T02:03:46.295292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:53.141767+0000","last_change":"2023-10-24T02:03:53.141767+0000","last_active":"2023-10-24T02:03:53.141767+0000","last_peered":"2023-10-24T02:03:53.141767+0000","last_clean":"2023-10-24T02:03:53.141767+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:53.141767+0000","last_undegraded":"2023-10-24T02:03:53.141767+0000","last_fullsized":"2023-10-24T02:03:53.141767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:53.141678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:53.141678+0000","last_clean_scrub_stamp":"2023-10-24T02:03:53.141678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:46.296077+0000","last_change":"2023-10-24T00:28:48.816921+0000","last_active":"2023-10-24T02:03:46.296077+0000","last_peered":"2023-10-24T02:03:46.296077+0000","last_clean":"2023-10-24T02:03:46.296077+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:46.296077+0000","last_undegraded":"2023-10-24T02:03:46.296077+0000","last_fullsized":"2023-10-24T02:03:46.296077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":214,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.446842+0000","last_change":"2023-10-24T00:28:47.693522+0000","last_active":"2023-10-24T02:03:45.446842+0000","last_peered":"2023-10-24T02:03:45.446842+0000","last_clean":"2023-10-24T02:03:45.446842+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:45.446842+0000","last_undegraded":"2023-10-24T02:03:45.446842+0000","last_fullsized":"2023-10-24T02:03:45.446842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:45.779492+0000","last_clean_scrub_stamp":"2023-10-24T00:28:45.779492+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":212,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.447000+0000","last_change":"2023-10-24T00:28:48.806575+0000","last_active":"2023-10-24T02:03:45.447000+0000","last_peered":"2023-10-24T02:03:45.447000+0000","last_clean":"2023-10-24T02:03:45.447000+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:03:45.447000+0000","last_undegraded":"2023-10-24T02:03:45.447000+0000","last_fullsized":"2023-10-24T02:03:45.447000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":212,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.450425+0000","last_change":"2023-10-24T00:28:49.687050+0000","last_active":"2023-10-24T02:03:45.450425+0000","last_peered":"2023-10-24T02:03:45.450425+0000","last_clean":"2023-10-24T02:03:45.450425+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:03:45.450425+0000","last_undegraded":"2023-10-24T02:03:45.450425+0000","last_fullsized":"2023-10-24T02:03:45.450425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.450533+0000","last_change":"2023-10-24T00:28:48.806804+0000","last_active":"2023-10-24T02:03:45.450533+0000","last_peered":"2023-10-24T02:03:45.450533+0000","last_clean":"2023-10-24T02:03:45.450533+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:45.450533+0000","last_undegraded":"2023-10-24T02:03:45.450533+0000","last_fullsized":"2023-10-24T02:03:45.450533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":220,"state":"active+clean","last_fresh":"2023-10-24T02:03:45.527809+0000","last_change":"2023-10-24T00:28:48.806614+0000","last_active":"2023-10-24T02:03:45.527809+0000","last_peered":"2023-10-24T02:03:45.527809+0000","last_clean":"2023-10-24T02:03:45.527809+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:45.527809+0000","last_undegraded":"2023-10-24T02:03:45.527809+0000","last_fullsized":"2023-10-24T02:03:45.527809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T00:28:47.790660+0000","last_clean_scrub_stamp":"2023-10-24T00:28:47.790660+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543278,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53700000000000003,"15min":0.55800000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.84799999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.52100000000000002}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.65800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.77400000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38400000000000001},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":1.032,"15min":1.032},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.51600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83299999999999996,"5min":0.94299999999999995,"15min":1.0609999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.28599999999999998},"max":{"1min":0.67700000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.621},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.308},"max":{"1min":0.67200000000000004,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.29799999999999999},"max":{"1min":0.79900000000000004,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73799999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44400000000000001,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.877},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.873,"15min":0.88100000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575982,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29999999999999999},"max":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54900000000000004,"15min":0.56799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.60999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50700000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.314},"max":{"1min":0.68300000000000005,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.434}]},{"osd":2,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.83999999999999997},"last":0.55700000000000005}]},{"osd":3,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77700000000000002,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.873},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41899999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.318},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.497}]}]},{"osd":1,"up_from":13,"seq":55834575983,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.878,"15min":0.878},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.53800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50700000000000001,"5min":0.58299999999999996,"15min":0.627},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82899999999999996,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.623}]},{"osd":5,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.52000000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":1.018,"15min":1.018},"last":0.47899999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45600000000000002},"max":{"1min":0.751,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575983,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.37,"15min":0.379},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.95699999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.41899999999999998},"min":{"1min":0.28399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.61799999999999999,"5min":0.65000000000000002,"15min":0.79700000000000004},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.437,"15min":0.433},"min":{"1min":0.27800000000000002,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.59899999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.317},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.61199999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.40100000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.749,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.64100000000000001},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65000000000000002},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82199999999999995,"5min":0.90500000000000003,"15min":0.97299999999999998},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.48299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79700000000000004,"5min":0.98999999999999999,"15min":1.008},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63500000000000001,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.53300000000000003,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.91400000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.028},"last":0.70599999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.312,"5min":0.23999999999999999,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.31}]},{"osd":1,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38,"15min":0.39400000000000002},"min":{"1min":0.29599999999999999,"5min":0.26000000000000001,"15min":0.254},"max":{"1min":0.51700000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.432},"min":{"1min":0.35799999999999998,"5min":0.28499999999999998,"15min":0.26200000000000001},"max":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.28899999999999998},"max":{"1min":0.51300000000000001,"5min":0.59099999999999997,"15min":0.68200000000000005},"last":0.377}]},{"osd":4,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60799999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.39800000000000002},"max":{"1min":0.82299999999999995,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95199999999999996},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.63700000000000001},"min":{"1min":0.51500000000000001,"5min":0.43099999999999999,"15min":0.41399999999999998},"max":{"1min":0.76200000000000001,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.623,"15min":0.64000000000000001},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.64900000000000002},"min":{"1min":0.53100000000000003,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.85099999999999998,"5min":0.875,"15min":0.99299999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65400000000000003,"15min":0.67000000000000004},"min":{"1min":0.54700000000000004,"5min":0.42799999999999999,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.68500000000000005},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.45700000000000002},"max":{"1min":0.89500000000000002,"5min":0.99399999999999999,"15min":1.024},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.69699999999999995,"15min":0.71099999999999997},"min":{"1min":0.60799999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.879,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":0.436,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.316},{"interface":"front","average":{"1min":0.373,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.752},"last":0.30499999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.41299999999999998,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.72799999999999998},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.097},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.167},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":1.056},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.88500000000000001,"15min":1.109},"last":0.41199999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.40999999999999998},"max":{"1min":0.79400000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.41999999999999998}]},{"osd":7,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":1.155},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79300000000000004,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.442}]}]},{"osd":4,"up_from":13,"seq":55834575983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.25},"max":{"1min":0.71399999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.498},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.29499999999999998},"max":{"1min":0.71499999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.61599999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.441}]},{"osd":5,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.36099999999999999}]},{"osd":6,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.39000000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.34999999999999998}]}]},{"osd":5,"up_from":14,"seq":60129543278,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.38600000000000001,"5min":0.38,"15min":0.29799999999999999},"max":{"1min":0.74099999999999999,"5min":1.181,"15min":1.181},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":1.157,"15min":1.157},"last":0.49399999999999999}]},{"osd":2,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68600000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.432,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.67600000000000005,"5min":1.167,"15min":1.167},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.43099999999999999,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44,"5min":0.41399999999999998,"15min":0.372},"max":{"1min":0.65300000000000002,"5min":1.212,"15min":1.212},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.45800000000000002,"15min":0.44900000000000001},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.27000000000000002},"max":{"1min":0.65000000000000002,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.309},"max":{"1min":0.68200000000000005,"5min":0.79500000000000004,"15min":0.79700000000000004},"last":0.622}]},{"osd":6,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.77300000000000002,"15min":0.82399999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.439,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":0.72299999999999998,"5min":0.78600000000000003,"15min":0.88800000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Oct 24 02:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.82799999999999996,"15min":0.89700000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.495,"5min":0.39000000000000001,"15min":0.32700000000000001},"max":{"1min":0.755,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:03:54.735 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.735 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.735 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.736 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-24T00:28:45.779492+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.736 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.736 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.736 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.737 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-24T00:28:47.790660+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=0, tm_min=28, tm_sec=47, tm_wday=1, tm_yday=297, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=24, tm_hour=2, tm_min=3, tm_sec=49, tm_wday=1, tm_yday=297, tm_isdst=0) 2023-10-24T02:03:54.737 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-24T02:04:14.738 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-24T02:04:14.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.865+0000 7f1e0ecbd700 1 Processor -- start 2023-10-24T02:04:14.866 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 -- start start 2023-10-24T02:04:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e080c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 0x7f1e080aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e08158770 0x7f1e08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080aa8e0 con 0x7f1e08158770 2023-10-24T02:04:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080c0960 con 0x7f1e080c6710 2023-10-24T02:04:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.866+0000 7f1e0ecbd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080c0c40 con 0x7f1e080aa010 2023-10-24T02:04:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e08158770 0x7f1e08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f1e08158770 0x7f1e08069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50604/0 (socket says 172.21.15.148:50604) 2023-10-24T02:04:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 -- 172.21.15.148:0/873375513 learned_addr learned my addr 172.21.15.148:0/873375513 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:04:14.870 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1dfffff700 1 --2- 172.21.15.148:0/873375513 >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 0x7f1e080aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0ca59700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e080c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 -- 172.21.15.148:0/873375513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 msgr2=0x7f1e080c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:04:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e080c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 -- 172.21.15.148:0/873375513 >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 msgr2=0x7f1e080aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:04:14.871 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 --2- 172.21.15.148:0/873375513 >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 0x7f1e080aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 -- 172.21.15.148:0/873375513 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080c0f20 con 0x7f1e08158770 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1dfffff700 1 --2- 172.21.15.148:0/873375513 >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 0x7f1e080aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1e0d25a700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e08158770 0x7f1e08069d80 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f1e0806c320 tx=0x7f1e00009840).ready entity=mon.0 client_cookie=f293d7acc61da9f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1dff7fe700 1 -- 172.21.15.148:0/873375513 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000e070 con 0x7f1e08158770 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1dff7fe700 1 -- 172.21.15.148:0/873375513 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000ba50 con 0x7f1e08158770 2023-10-24T02:04:14.872 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.867+0000 7f1dff7fe700 1 -- 172.21.15.148:0/873375513 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000bdd0 con 0x7f1e08158770 2023-10-24T02:04:14.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/873375513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e08158770 msgr2=0x7f1e08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:14.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e08158770 0x7f1e08069d80 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f1e0806c320 tx=0x7f1e00009840).stop 2023-10-24T02:04:14.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/873375513 shutdown_connections 2023-10-24T02:04:14.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e08158770 0x7f1e08069d80 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.873 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/873375513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e080c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/873375513 >> v2:172.21.15.150:3300/0 conn(0x7f1e080c6710 0x7f1e080aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/873375513 >> 172.21.15.148:0/873375513 conn(0x7f1e080caf40 msgr2=0x7f1e080cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:14.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/873375513 shutdown_connections 2023-10-24T02:04:14.874 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.868+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/873375513 wait complete. 2023-10-24T02:04:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.869+0000 7f1e0ecbd700 1 Processor -- start 2023-10-24T02:04:14.877 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.869+0000 7f1e0ecbd700 1 -- start start 2023-10-24T02:04:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e08146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 0x7f1e080c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e08146ff0 con 0x7f1e080c6710 2023-10-24T02:04:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080ac3f0 con 0x7f1e08158770 2023-10-24T02:04:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ecbd700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080c5260 con 0x7f1e080aa010 2023-10-24T02:04:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50606/0 (socket says 172.21.15.148:50606) 2023-10-24T02:04:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 -- 172.21.15.148:0/2880987214 learned_addr learned my addr 172.21.15.148:0/2880987214 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:04:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0ca59700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e08146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0d25a700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 0x7f1e080c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 -- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 msgr2=0x7f1e08146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e08146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 -- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 msgr2=0x7f1e080c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 0x7f1e080c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 -- 172.21.15.148:0/2880987214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009ae0 con 0x7f1e080c6710 2023-10-24T02:04:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1e0d25a700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 0x7f1e080c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-24T02:04:14.881 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.870+0000 7f1dfffff700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f1df800c8b0 tx=0x7f1df8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:14.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.871+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8010580 con 0x7f1e080c6710 2023-10-24T02:04:14.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.871+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80106e0 con 0x7f1e080c6710 2023-10-24T02:04:14.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.871+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e080abde0 con 0x7f1e080c6710 2023-10-24T02:04:14.882 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.871+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8010a60 con 0x7f1e080c6710 2023-10-24T02:04:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.871+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e080c4f80 con 0x7f1e080c6710 2023-10-24T02:04:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.872+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e080ac580 con 0x7f1e080c6710 2023-10-24T02:04:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.872+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1df801b460 con 0x7f1e080c6710 2023-10-24T02:04:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.872+0000 7f1dfcff9700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 0x7f1df4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:14.883 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.873+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f1df8079fc0 con 0x7f1e080c6710 2023-10-24T02:04:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.873+0000 7f1e0ca59700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 0x7f1df4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.873+0000 7f1e0ca59700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 0x7f1df4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1e0400ab30 tx=0x7f1e04008040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:14.884 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:14.877+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1df80a8af0 con 0x7f1e080c6710 2023-10-24T02:04:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.036+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 --> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e0806c6b0 con 0x7f1df405f150 2023-10-24T02:04:15.040 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.040+0000 7f1dfcff9700 1 -- 172.21.15.148:0/2880987214 <== mgr.8327 v2:172.21.15.150:6832/100598 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71140 (secure 0 0 0) 0x7f1e0806c6b0 con 0x7f1df405f150 2023-10-24T02:04:15.041 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:04:15.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 msgr2=0x7f1df4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.042 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 0x7f1df4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1e0400ab30 tx=0x7f1e04008040).stop 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 msgr2=0x7f1e08164c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f1df800c8b0 tx=0x7f1df8008040).stop 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 shutdown_connections 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f1df405f150 0x7f1df4061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e08158770 0x7f1e080c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1e080aa010 0x7f1e08146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 --2- 172.21.15.148:0/2880987214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1e080c6710 0x7f1e08164c10 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.041+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 >> 172.21.15.148:0/2880987214 conn(0x7f1e080caf40 msgr2=0x7f1e080cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:15.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.042+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 shutdown_connections 2023-10-24T02:04:15.044 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.042+0000 7f1e0ecbd700 1 -- 172.21.15.148:0/2880987214 wait complete. 2023-10-24T02:04:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2023-10-24T02:04:15.054 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-24T02:04:14.436516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2459840,"kb_used_data":21632,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752514880,"statfs":{"total":773094113280,"available":770575237120,"internally_reserved":0,"allocated":22151168,"data_stored":11315304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12241,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.999304"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:53.454709+0000","last_change":"2023-10-24T02:03:53.454709+0000","last_active":"2023-10-24T02:03:53.454709+0000","last_peered":"2023-10-24T02:03:53.454709+0000","last_clean":"2023-10-24T02:03:53.454709+0000","last_became_active":"2023-10-24T00:28:49.686477+0000","last_became_peered":"2023-10-24T00:28:49.686477+0000","last_unstale":"2023-10-24T02:03:53.454709+0000","last_undegraded":"2023-10-24T02:03:53.454709+0000","last_fullsized":"2023-10-24T02:03:53.454709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:53.454610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:53.454610+0000","last_clean_scrub_stamp":"2023-10-24T02:03:53.454610+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:58.455932+0000","last_change":"2023-10-24T02:03:58.455932+0000","last_active":"2023-10-24T02:03:58.455932+0000","last_peered":"2023-10-24T02:03:58.455932+0000","last_clean":"2023-10-24T02:03:58.455932+0000","last_became_active":"2023-10-24T00:28:48.806795+0000","last_became_peered":"2023-10-24T00:28:48.806795+0000","last_unstale":"2023-10-24T02:03:58.455932+0000","last_undegraded":"2023-10-24T02:03:58.455932+0000","last_fullsized":"2023-10-24T02:03:58.455932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:58.455784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:58.455784+0000","last_clean_scrub_stamp":"2023-10-24T02:03:58.455784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:53.141767+0000","last_change":"2023-10-24T02:03:53.141767+0000","last_active":"2023-10-24T02:03:53.141767+0000","last_peered":"2023-10-24T02:03:53.141767+0000","last_clean":"2023-10-24T02:03:53.141767+0000","last_became_active":"2023-10-24T00:28:48.806752+0000","last_became_peered":"2023-10-24T00:28:48.806752+0000","last_unstale":"2023-10-24T02:03:53.141767+0000","last_undegraded":"2023-10-24T02:03:53.141767+0000","last_fullsized":"2023-10-24T02:03:53.141767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:53.141678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:53.141678+0000","last_clean_scrub_stamp":"2023-10-24T02:03:53.141678+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:59.415944+0000","last_change":"2023-10-24T02:03:59.415944+0000","last_active":"2023-10-24T02:03:59.415944+0000","last_peered":"2023-10-24T02:03:59.415944+0000","last_clean":"2023-10-24T02:03:59.415944+0000","last_became_active":"2023-10-24T00:28:48.816588+0000","last_became_peered":"2023-10-24T00:28:48.816588+0000","last_unstale":"2023-10-24T02:03:59.415944+0000","last_undegraded":"2023-10-24T02:03:59.415944+0000","last_fullsized":"2023-10-24T02:03:59.415944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:59.415822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:59.415822+0000","last_clean_scrub_stamp":"2023-10-24T02:03:59.415822+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":219,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:55.236101+0000","last_change":"2023-10-24T02:03:55.236101+0000","last_active":"2023-10-24T02:03:55.236101+0000","last_peered":"2023-10-24T02:03:55.236101+0000","last_clean":"2023-10-24T02:03:55.236101+0000","last_became_active":"2023-10-24T00:28:47.693221+0000","last_became_peered":"2023-10-24T00:28:47.693221+0000","last_unstale":"2023-10-24T02:03:55.236101+0000","last_undegraded":"2023-10-24T02:03:55.236101+0000","last_fullsized":"2023-10-24T02:03:55.236101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:55.235962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:55.235962+0000","last_clean_scrub_stamp":"2023-10-24T02:03:55.235962+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:04:02.317448+0000","last_change":"2023-10-24T02:04:02.317448+0000","last_active":"2023-10-24T02:04:02.317448+0000","last_peered":"2023-10-24T02:04:02.317448+0000","last_clean":"2023-10-24T02:04:02.317448+0000","last_became_active":"2023-10-24T00:28:48.806128+0000","last_became_peered":"2023-10-24T00:28:48.806128+0000","last_unstale":"2023-10-24T02:04:02.317448+0000","last_undegraded":"2023-10-24T02:04:02.317448+0000","last_fullsized":"2023-10-24T02:04:02.317448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:04:02.317301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:04:02.317301+0000","last_clean_scrub_stamp":"2023-10-24T02:04:02.317301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:04:06.294870+0000","last_change":"2023-10-24T02:04:06.294870+0000","last_active":"2023-10-24T02:04:06.294870+0000","last_peered":"2023-10-24T02:04:06.294870+0000","last_clean":"2023-10-24T02:04:06.294870+0000","last_became_active":"2023-10-24T00:28:49.686711+0000","last_became_peered":"2023-10-24T00:28:49.686711+0000","last_unstale":"2023-10-24T02:04:06.294870+0000","last_undegraded":"2023-10-24T02:04:06.294870+0000","last_fullsized":"2023-10-24T02:04:06.294870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:04:06.294762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:04:06.294762+0000","last_clean_scrub_stamp":"2023-10-24T02:04:06.294762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:58.471646+0000","last_change":"2023-10-24T02:03:58.471646+0000","last_active":"2023-10-24T02:03:58.471646+0000","last_peered":"2023-10-24T02:03:58.471646+0000","last_clean":"2023-10-24T02:03:58.471646+0000","last_became_active":"2023-10-24T00:28:48.806541+0000","last_became_peered":"2023-10-24T00:28:48.806541+0000","last_unstale":"2023-10-24T02:03:58.471646+0000","last_undegraded":"2023-10-24T02:03:58.471646+0000","last_fullsized":"2023-10-24T02:03:58.471646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:58.471502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:58.471502+0000","last_clean_scrub_stamp":"2023-10-24T02:03:58.471502+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":185,"reported_epoch":221,"state":"active+clean","last_fresh":"2023-10-24T02:03:54.372925+0000","last_change":"2023-10-24T02:03:54.372925+0000","last_active":"2023-10-24T02:03:54.372925+0000","last_peered":"2023-10-24T02:03:54.372925+0000","last_clean":"2023-10-24T02:03:54.372925+0000","last_became_active":"2023-10-24T00:28:48.806303+0000","last_became_peered":"2023-10-24T00:28:48.806303+0000","last_unstale":"2023-10-24T02:03:54.372925+0000","last_undegraded":"2023-10-24T02:03:54.372925+0000","last_fullsized":"2023-10-24T02:03:54.372925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-24T02:03:54.372802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-24T02:03:54.372802+0000","last_clean_scrub_stamp":"2023-10-24T02:03:54.372802+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543282,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52800000000000002,"15min":0.55300000000000005},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.72999999999999998,"5min":0.751,"15min":0.83799999999999997},"last":0.627},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.66600000000000004,"5min":0.76800000000000002,"15min":0.81200000000000006},"last":0.47199999999999998}]},{"osd":1,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.33400000000000002},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.79400000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.55400000000000005,"15min":0.57499999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68700000000000006,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.56000000000000005,"15min":0.57899999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.63700000000000001,"5min":0.73199999999999998,"15min":0.82599999999999996},"last":0.64800000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":1.032,"15min":1.032},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77300000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.28599999999999998},"max":{"1min":0.67900000000000005,"5min":0.80100000000000005,"15min":0.83299999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.308},"max":{"1min":0.68200000000000005,"5min":0.79400000000000004,"15min":0.85699999999999998},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.38700000000000001,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.86499999999999999,"15min":0.86599999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.32800000000000001},"max":{"1min":0.73699999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.86499999999999999,"15min":0.877},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86799999999999999,"5min":0.873,"15min":0.88100000000000001},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575986,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29999999999999999},"max":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54900000000000004,"15min":0.56799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33500000000000002},"max":{"1min":0.60999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73299999999999998}]},{"osd":1,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.79800000000000004,"15min":0.83399999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.314},"max":{"1min":0.68300000000000005,"5min":0.85199999999999998,"15min":0.85799999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34899999999999998},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.83999999999999997},"last":0.63}]},{"osd":3,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77700000000000002,"5min":0.82899999999999996,"15min":0.84699999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.873},"last":0.746}]},{"osd":4,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.29699999999999999,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.41999999999999998}]},{"osd":5,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.38600000000000001,"5min":0.33200000000000002,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55200000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.318},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Tue Oct 24 02:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36399999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575987,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.40000000000000002,"15min":0.39200000000000002},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48499999999999999,"5min":0.878,"15min":0.878},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.53800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50700000000000001,"5min":0.58299999999999996,"15min":0.627},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.41999999999999998,"15min":0.42199999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.375}]},{"osd":3,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.432,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.434},{"interface":"front","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.46500000000000002},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42899999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82899999999999996,"5min":1.004,"15min":1.004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.97499999999999998},"last":0.626}]},{"osd":5,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80500000000000005,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.93799999999999994,"15min":0.98299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.64100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84399999999999997,"5min":1.018,"15min":1.018},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Oct 24 02:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45600000000000002},"max":{"1min":0.751,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.52000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575987,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36099999999999999,"15min":0.375},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.498,"5min":0.624,"15min":0.95699999999999996},"last":0.249},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.23899999999999999},"max":{"1min":0.54100000000000004,"5min":0.61799999999999999,"15min":0.79700000000000004},"last":0.34899999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27100000000000002},"max":{"1min":0.60899999999999999,"5min":0.66500000000000004,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55900000000000005,"5min":0.60499999999999998,"15min":0.64900000000000002},"last":0.29099999999999998}]},{"osd":3,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.41099999999999998,"15min":0.42599999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.315},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45000000000000001,"15min":0.46999999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57199999999999995,"5min":0.68400000000000005,"15min":0.78800000000000003},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":0.89000000000000001,"15min":0.96599999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59899999999999998,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.71499999999999997,"5min":0.95099999999999996,"15min":0.97599999999999998},"last":0.45800000000000002}]},{"osd":5,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60199999999999998,"15min":0.63400000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":1.022,"15min":1.022},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.623,"15min":0.64600000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.97299999999999998},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61599999999999999,"15min":0.64900000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82799999999999996,"5min":0.98999999999999999,"15min":1.008},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.89900000000000002,"5min":0.96699999999999997,"15min":0.99199999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Oct 24 02:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.996,"15min":1.0189999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.68200000000000005},"min":{"1min":0.45500000000000002,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.028},"last":0.57099999999999995}]}]},{"osd":2,"up_from":14,"seq":60129543282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35299999999999998,"15min":0.36299999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.47599999999999998,"5min":0.52700000000000002,"15min":0.59099999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38600000000000001,"15min":0.40400000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54900000000000004,"5min":0.61699999999999999,"15min":0.66500000000000004},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.371,"15min":0.38900000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.50900000000000001,"5min":0.58999999999999997,"15min":0.65100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.40699999999999997,"15min":0.42599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.68100000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.434,"15min":0.45100000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55300000000000005,"5min":0.65100000000000002,"15min":0.67100000000000004},"last":0.439},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41099999999999998,"15min":0.43099999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68200000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.61199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71899999999999997,"5min":0.85599999999999998,"15min":0.95199999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85599999999999998,"5min":0.96299999999999997,"15min":0.96999999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.63200000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77000000000000002,"5min":0.91100000000000003,"15min":0.97299999999999998},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61899999999999999,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.371},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96499999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.66000000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.877,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.498}]},{"osd":7,"last update":"Tue Oct 24 02:04:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65400000000000003,"15min":0.67700000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":0.998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.877,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":0.436,"5min":0.51700000000000002,"15min":0.59999999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.752},"last":0.51100000000000001}]},{"osd":1,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.371,"15min":0.38600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.41299999999999998,"5min":0.54700000000000004,"15min":0.68600000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.40999999999999998}]},{"osd":2,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":0.59199999999999997,"15min":0.65600000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60199999999999998,"5min":0.60899999999999999,"15min":0.72799999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.93600000000000005,"15min":1.097},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.60999999999999999,"15min":0.63200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.167},"last":0.68300000000000005}]},{"osd":5,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.79700000000000004,"5min":0.91100000000000003,"15min":1.056},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85799999999999998,"5min":0.88500000000000001,"15min":1.109},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":0.77600000000000002,"5min":0.89600000000000002,"15min":0.98399999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64400000000000002,"15min":0.66300000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.40999999999999998},"max":{"1min":0.79400000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Oct 24 02:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.77400000000000002,"5min":0.92600000000000005,"15min":1.155},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.66300000000000003,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79300000000000004,"5min":0.94899999999999995,"15min":1.1279999999999999},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.25},"max":{"1min":0.71399999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.75700000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.626}]},{"osd":1,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.29499999999999998},"max":{"1min":0.71499999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.72299999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58999999999999997}]},{"osd":2,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73999999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.49399999999999999}]},{"osd":3,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.40999999999999998,"5min":0.39900000000000002,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.496,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.318,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.77200000000000002,"15min":0.80000000000000004},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.85699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.76600000000000001,"15min":0.81799999999999995},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Oct 24 02:03:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.75600000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307992,"kb_used_data":2704,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063848,"statfs":{"total":96636764160,"available":96321380352,"internally_reserved":0,"allocated":2768896,"data_stored":1414413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65900000000000003,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.29999999999999999},"max":{"1min":0.77300000000000002,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":1.181,"15min":1.181},"last":0.624},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.33000000000000002},"max":{"1min":0.60999999999999999,"5min":1.157,"15min":1.157},"last":0.57399999999999995}]},{"osd":2,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.379,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68999999999999995,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.33600000000000002},"max":{"1min":0.61099999999999999,"5min":1.167,"15min":1.167},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.372},"max":{"1min":0.68000000000000005,"5min":1.212,"15min":1.212},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.78500000000000003,"15min":0.82699999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50700000000000001,"15min":0.48899999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.501}]},{"osd":6,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34100000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88800000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Tue Oct 24 02:04:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.31900000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80600000000000005,"15min":0.98799999999999999},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-24T02:04:15.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-24T02:04:15.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.169+0000 7f6df2dcb700 1 Processor -- start 2023-10-24T02:04:15.169 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.169+0000 7f6df2dcb700 1 -- start start 2023-10-24T02:04:15.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df2dcb700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dec0c1050 0x7f6dec0a8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df2dcb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 0x7f6dec15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df2dcb700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec0a9830 con 0x7f6dec154150 2023-10-24T02:04:15.172 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df2dcb700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0a8c20 con 0x7f6dec0c1050 2023-10-24T02:04:15.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df2dcb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0a8f00 con 0x7f6dec0c9e00 2023-10-24T02:04:15.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dec0c1050 0x7f6dec0a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df1dc9700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f6dec154150 0x7f6dec0c0940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44614/0 (socket says 172.21.15.148:44614) 2023-10-24T02:04:15.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f6dec0c1050 0x7f6dec0a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50622/0 (socket says 172.21.15.148:50622) 2023-10-24T02:04:15.173 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df1dc9700 1 -- 172.21.15.148:0/563988037 learned_addr learned my addr 172.21.15.148:0/563988037 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:04:15.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df25ca700 1 --2- 172.21.15.148:0/563988037 >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 0x7f6dec15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 -- 172.21.15.148:0/563988037 >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 msgr2=0x7f6dec15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:04:15.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df0dc7700 1 -- 172.21.15.148:0/563988037 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400612323 0 0) 0x7f6dec0a9830 con 0x7f6dec154150 2023-10-24T02:04:15.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 --2- 172.21.15.148:0/563988037 >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 0x7f6dec15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.174 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 -- 172.21.15.148:0/563988037 >> v1:172.21.15.148:6789/0 conn(0x7f6dec154150 legacy=0x7f6dec0c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 -- 172.21.15.148:0/563988037 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0a91e0 con 0x7f6dec0c1050 2023-10-24T02:04:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df25ca700 1 --2- 172.21.15.148:0/563988037 >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 0x7f6dec15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:04:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df15c8700 1 --2- 172.21.15.148:0/563988037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec0c1050 0x7f6dec0a8640 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f6dec0c0170 tx=0x7f6ddc009060).ready entity=mon.0 client_cookie=5c804f11658e350a server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df0dc7700 1 -- 172.21.15.148:0/563988037 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00b580 con 0x7f6dec0c1050 2023-10-24T02:04:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df0dc7700 1 -- 172.21.15.148:0/563988037 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00b6e0 con 0x7f6dec0c1050 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.170+0000 7f6df0dc7700 1 -- 172.21.15.148:0/563988037 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00ba60 con 0x7f6dec0c1050 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 -- 172.21.15.148:0/563988037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec0c1050 msgr2=0x7f6dec0a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/563988037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec0c1050 0x7f6dec0a8640 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f6dec0c0170 tx=0x7f6ddc009060).stop 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 -- 172.21.15.148:0/563988037 shutdown_connections 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/563988037 >> v2:172.21.15.150:3300/0 conn(0x7f6dec0c9e00 0x7f6dec15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/563988037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec0c1050 0x7f6dec0a8640 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 -- 172.21.15.148:0/563988037 >> 172.21.15.148:0/563988037 conn(0x7f6dec094500 msgr2=0x7f6dec06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:15.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 -- 172.21.15.148:0/563988037 shutdown_connections 2023-10-24T02:04:15.177 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.171+0000 7f6df2dcb700 1 -- 172.21.15.148:0/563988037 wait complete. 2023-10-24T02:04:15.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.172+0000 7f6df2dcb700 1 Processor -- start 2023-10-24T02:04:15.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.172+0000 7f6df2dcb700 1 -- start start 2023-10-24T02:04:15.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dec0c1050 0x7f6dec0ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dec0c9e00 0x7f6dec14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.180 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec167cd0 con 0x7f6dec154150 2023-10-24T02:04:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec14fb20 con 0x7f6dec0c9e00 2023-10-24T02:04:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df2dcb700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0b0e50 con 0x7f6dec0c1050 2023-10-24T02:04:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50626/0 (socket says 172.21.15.148:50626) 2023-10-24T02:04:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 -- 172.21.15.148:0/3411621661 learned_addr learned my addr 172.21.15.148:0/3411621661 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:04:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df1dc9700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dec0c1050 0x7f6dec0ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df15c8700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dec0c9e00 0x7f6dec14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 -- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dec0c1050 msgr2=0x7f6dec0ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dec0c1050 0x7f6dec0ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 -- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dec0c9e00 msgr2=0x7f6dec14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dec0c9e00 0x7f6dec14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 -- 172.21.15.148:0/3411621661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0092a0 con 0x7f6dec154150 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.173+0000 7f6df25ca700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f6de400a380 tx=0x7f6de4007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.174+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400ae10 con 0x7f6dec154150 2023-10-24T02:04:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.174+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400d650 con 0x7f6dec154150 2023-10-24T02:04:15.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.174+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec168190 con 0x7f6dec154150 2023-10-24T02:04:15.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.174+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400d9d0 con 0x7f6dec154150 2023-10-24T02:04:15.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.174+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0b0800 con 0x7f6dec154150 2023-10-24T02:04:15.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.175+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec047480 con 0x7f6dec154150 2023-10-24T02:04:15.184 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.175+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6de4013070 con 0x7f6dec154150 2023-10-24T02:04:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.175+0000 7f6de1ffb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 0x7f6dd00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.176+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f6de407a860 con 0x7f6dec154150 2023-10-24T02:04:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.176+0000 7f6df1dc9700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 0x7f6dd00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.176+0000 7f6df1dc9700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 0x7f6dd00615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6de8002670 tx=0x7f6de8009040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.186 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.180+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6de404bc80 con 0x7f6dec154150 2023-10-24T02:04:15.342 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.341+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6dec0a94c0 con 0x7f6dec154150 2023-10-24T02:04:15.345 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.345+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6de4007a40 con 0x7f6dec154150 2023-10-24T02:04:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.346+0000 7f6de1ffb700 1 -- 172.21.15.148:0/3411621661 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v46)=0 v46) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6de401b070 con 0x7f6dec154150 2023-10-24T02:04:15.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 msgr2=0x7f6dd00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 0x7f6dd00615e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6de8002670 tx=0x7f6de8009040).stop 2023-10-24T02:04:15.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 msgr2=0x7f6dec0c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.349 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f6de400a380 tx=0x7f6de4007900).stop 2023-10-24T02:04:15.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 shutdown_connections 2023-10-24T02:04:15.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dec154150 0x7f6dec0c8d80 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6dec0c1050 0x7f6dec0ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.350 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f6dd005f120 0x7f6dd00615e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 --2- 172.21.15.148:0/3411621661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dec0c9e00 0x7f6dec14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 >> 172.21.15.148:0/3411621661 conn(0x7f6dec094500 msgr2=0x7f6dec0c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:15.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 shutdown_connections 2023-10-24T02:04:15.351 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.348+0000 7f6df2dcb700 1 -- 172.21.15.148:0/3411621661 wait complete. 2023-10-24T02:04:15.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-24T02:04:15.361 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-24T02:04:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.474+0000 7f14607f2700 1 Processor -- start 2023-10-24T02:04:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.474+0000 7f14607f2700 1 -- start start 2023-10-24T02:04:15.477 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.475+0000 7f14607f2700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f14580c6710 0x7f14580c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.475+0000 7f14607f2700 1 --2- >> v2:172.21.15.148:3300/0 conn(0x7f14580aa3f0 0x7f1458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.475+0000 7f14607f2700 1 -- --> v1:172.21.15.148:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14580aa820 con 0x7f14580aa010 2023-10-24T02:04:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.475+0000 7f14607f2700 1 -- --> v2:172.21.15.148:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580c0960 con 0x7f14580aa3f0 2023-10-24T02:04:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.475+0000 7f14607f2700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580c0c40 con 0x7f14580c6710 2023-10-24T02:04:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145e58e700 1 --1- >> v1:172.21.15.148:6789/0 conn(0x7f14580aa010 0x7f1458158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.148:6789/0 says I am v1:172.21.15.148:44630/0 (socket says 172.21.15.148:44630) 2023-10-24T02:04:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145e58e700 1 -- 172.21.15.148:0/3260355918 learned_addr learned my addr 172.21.15.148:0/3260355918 (peer_addr_for_me v1:172.21.15.148:0/0) 2023-10-24T02:04:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 --2- 172.21.15.148:0/3260355918 >> v2:172.21.15.148:3300/0 conn(0x7f14580aa3f0 0x7f1458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145dd8d700 1 --2- 172.21.15.148:0/3260355918 >> v2:172.21.15.150:3300/0 conn(0x7f14580c6710 0x7f14580c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145d58c700 1 -- 172.21.15.148:0/3260355918 <== mon.0 v1:172.21.15.148:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970773616 0 0) 0x7f14580aa820 con 0x7f14580aa010 2023-10-24T02:04:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145d58c700 1 -- 172.21.15.148:0/3260355918 --> v1:172.21.15.148:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14440033f0 con 0x7f14580aa010 2023-10-24T02:04:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 -- 172.21.15.148:0/3260355918 >> v2:172.21.15.150:3300/0 conn(0x7f14580c6710 msgr2=0x7f14580c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-24T02:04:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 --2- 172.21.15.148:0/3260355918 >> v2:172.21.15.150:3300/0 conn(0x7f14580c6710 0x7f14580c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 -- 172.21.15.148:0/3260355918 >> v1:172.21.15.148:6789/0 conn(0x7f14580aa010 legacy=0x7f1458158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 -- 172.21.15.148:0/3260355918 --> v2:172.21.15.148:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580c0f20 con 0x7f14580aa3f0 2023-10-24T02:04:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145ed8f700 1 --2- 172.21.15.148:0/3260355918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f1458069d80 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f1458157d00 tx=0x7f1450009780).ready entity=mon.0 client_cookie=cc1fa3c1b1f4bc4d server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145d58c700 1 -- 172.21.15.148:0/3260355918 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000e070 con 0x7f14580aa3f0 2023-10-24T02:04:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145d58c700 1 -- 172.21.15.148:0/3260355918 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f145000bab0 con 0x7f14580aa3f0 2023-10-24T02:04:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.476+0000 7f145d58c700 1 -- 172.21.15.148:0/3260355918 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000be30 con 0x7f14580aa3f0 2023-10-24T02:04:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 -- 172.21.15.148:0/3260355918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 msgr2=0x7f1458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 --2- 172.21.15.148:0/3260355918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f1458069d80 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f1458157d00 tx=0x7f1450009780).stop 2023-10-24T02:04:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 -- 172.21.15.148:0/3260355918 shutdown_connections 2023-10-24T02:04:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 --2- 172.21.15.148:0/3260355918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f1458069d80 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 --2- 172.21.15.148:0/3260355918 >> v2:172.21.15.150:3300/0 conn(0x7f14580c6710 0x7f14580c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 -- 172.21.15.148:0/3260355918 >> 172.21.15.148:0/3260355918 conn(0x7f14580caf40 msgr2=0x7f14580cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 -- 172.21.15.148:0/3260355918 shutdown_connections 2023-10-24T02:04:15.483 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.477+0000 7f14607f2700 1 -- 172.21.15.148:0/3260355918 wait complete. 2023-10-24T02:04:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.478+0000 7f14607f2700 1 Processor -- start 2023-10-24T02:04:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.478+0000 7f14607f2700 1 -- start start 2023-10-24T02:04:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14580aa010 0x7f1458154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 0x7f1458146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580af880 con 0x7f14580aa3f0 2023-10-24T02:04:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14580ae3c0 con 0x7f14580c6710 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580ae640 con 0x7f14580aa010 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50646/0 (socket says 172.21.15.148:50646) 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 -- 172.21.15.148:0/815319424 learned_addr learned my addr 172.21.15.148:0/815319424 (peer_addr_for_me v2:172.21.15.148:0/0) 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145e58e700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14580aa010 0x7f1458154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.487 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145ed8f700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 0x7f1458146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 -- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14580aa010 msgr2=0x7f1458154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14580aa010 0x7f1458154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 -- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 msgr2=0x7f1458146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 0x7f1458146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 -- 172.21.15.148:0/815319424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450009a20 con 0x7f14580aa3f0 2023-10-24T02:04:15.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145ed8f700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 0x7f1458146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-24T02:04:15.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f145dd8d700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f144800e980 tx=0x7f1448009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800c850 con 0x7f14580aa3f0 2023-10-24T02:04:15.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f144800c9b0 con 0x7f14580aa3f0 2023-10-24T02:04:15.489 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14580ae920 con 0x7f14580aa3f0 2023-10-24T02:04:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.479+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800cd30 con 0x7f14580aa3f0 2023-10-24T02:04:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.480+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14580aeee0 con 0x7f14580aa3f0 2023-10-24T02:04:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.481+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14580afa30 con 0x7f14580aa3f0 2023-10-24T02:04:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.481+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 105) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1448012600 con 0x7f14580aa3f0 2023-10-24T02:04:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.481+0000 7f144e7fc700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 0x7f143c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-24T02:04:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.481+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(221..221 src has 1..221) v4 ==== 5786+0+0 (secure 0 0 0) 0x7f144807a6a0 con 0x7f14580aa3f0 2023-10-24T02:04:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.481+0000 7f145e58e700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 0x7f143c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-24T02:04:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.482+0000 7f145e58e700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 0x7f143c0615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1454005750 tx=0x7f1454009040).ready entity=mgr.8327 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-24T02:04:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.485+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f14580afa30 con 0x7f14580aa3f0 2023-10-24T02:04:15.689 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.689+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14580afa30 con 0x7f14580aa3f0 2023-10-24T02:04:15.690 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.689+0000 7f144e7fc700 1 -- 172.21.15.148:0/815319424 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3543 (secure 0 0 0) 0x7f14580afa30 con 0x7f14580aa3f0 2023-10-24T02:04:15.690 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-10-24T02:04:15.691 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/3152052948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6835","nonce":3152052948},{"type":"v1","addr":"172.21.15.150:6837","nonce":3152052948}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":9568,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6836/4226326681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":4226326681},{"type":"v1","addr":"172.21.15.150:6836","nonce":4226326681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6834/2029568194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":2029568194},{"type":"v1","addr":"172.21.15.148:6834","nonce":2029568194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/3612865699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6833","nonce":3612865699},{"type":"v1","addr":"172.21.15.148:6835","nonce":3612865699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-10-24T02:04:15.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 msgr2=0x7f143c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 0x7f143c0615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1454005750 tx=0x7f1454009040).stop 2023-10-24T02:04:15.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 msgr2=0x7f14580aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-24T02:04:15.692 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 rx=0x7f144800e980 tx=0x7f1448009060).stop 2023-10-24T02:04:15.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 shutdown_connections 2023-10-24T02:04:15.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:6832/100598,v1:172.21.15.150:6833/100598] conn(0x7f143c05f120 0x7f143c0615e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14580c6710 0x7f1458146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14580aa010 0x7f1458154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.693 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 --2- 172.21.15.148:0/815319424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14580aa3f0 0x7f14580aded0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-24T02:04:15.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 >> 172.21.15.148:0/815319424 conn(0x7f14580caf40 msgr2=0x7f1458152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-24T02:04:15.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 shutdown_connections 2023-10-24T02:04:15.694 INFO:teuthology.orchestra.run.smithi148.stderr:2023-10-24T02:04:15.691+0000 7f14607f2700 1 -- 172.21.15.148:0/815319424 wait complete. 2023-10-24T02:04:15.694 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 76 2023-10-24T02:04:15.703 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-24T02:04:15.704 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-24T02:04:15.704 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-24T02:04:15.705 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.712 INFO:tasks.ceph.mds.a:Stopped 2023-10-24T02:04:15.712 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-24T02:04:15.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.761 INFO:tasks.ceph.mds.c:Stopped 2023-10-24T02:04:15.761 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-24T02:04:15.761 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.772 INFO:tasks.ceph.mds.b:Stopped 2023-10-24T02:04:15.773 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-24T02:04:15.773 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.823 INFO:tasks.ceph.mds.d:Stopped 2023-10-24T02:04:15.823 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-24T02:04:15.824 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-24T02:04:15.824 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.848 INFO:tasks.ceph.osd.0:Stopped 2023-10-24T02:04:15.849 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-24T02:04:15.849 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.920 INFO:tasks.ceph.osd.1:Stopped 2023-10-24T02:04:15.920 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-24T02:04:15.921 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:15.991 INFO:tasks.ceph.osd.2:Stopped 2023-10-24T02:04:15.991 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-24T02:04:15.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.059 INFO:tasks.ceph.osd.3:Stopped 2023-10-24T02:04:16.059 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-24T02:04:16.060 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.098 INFO:tasks.ceph.osd.4:Stopped 2023-10-24T02:04:16.099 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-24T02:04:16.099 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.167 INFO:tasks.ceph.osd.5:Stopped 2023-10-24T02:04:16.168 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-24T02:04:16.168 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.236 INFO:tasks.ceph.osd.6:Stopped 2023-10-24T02:04:16.237 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-24T02:04:16.237 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.312 INFO:tasks.ceph.osd.7:Stopped 2023-10-24T02:04:16.312 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-24T02:04:16.313 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-24T02:04:16.313 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.337 INFO:tasks.ceph.mgr.y:Stopped 2023-10-24T02:04:16.337 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-24T02:04:16.337 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.381 INFO:tasks.ceph.mgr.x:Stopped 2023-10-24T02:04:16.381 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-24T02:04:16.382 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-24T02:04:16.382 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.401 INFO:tasks.ceph.mon.a:Stopped 2023-10-24T02:04:16.401 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-24T02:04:16.402 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.440 INFO:tasks.ceph.mon.b:Stopped 2023-10-24T02:04:16.476 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-24T02:04:16.477 INFO:teuthology.orchestra.run:waiting for 300 2023-10-24T02:04:16.499 INFO:tasks.ceph.mon.c:Stopped 2023-10-24T02:04:16.500 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-24T02:04:16.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-24T02:04:16.531 INFO:teuthology.orchestra.run.smithi148.stdout:2023-10-24T00:30:59.780022+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-24T02:04:16.532 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-24T02:04:16.532 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-24T02:04:16.604 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-24T02:04:16.673 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-24T02:04:16.742 INFO:teuthology.orchestra.run.smithi148.stdout:2023-10-24T00:30:59.780022+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-24T02:04:16.742 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:04:16.743 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-24T02:04:17.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:04:17.009 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-24T02:04:17.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:04:17.110 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-24T02:04:17.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:04:17.164 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-24T02:04:17.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T02:04:17.224 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-24T02:04:17.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T02:04:17.413 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-24T02:04:17.491 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T02:04:17.491 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-24T02:04:17.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T02:04:17.569 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-24T02:04:17.642 INFO:tasks.ceph:Archiving mon data... 2023-10-24T02:04:17.644 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/data/mon.a.tgz 2023-10-24T02:04:17.644 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-10-24T02:04:17.660 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.tBi5Hxh2YF 2023-10-24T02:04:17.660 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tBi5Hxh2YF 2023-10-24T02:04:17.993 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:17.996 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:18.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.tBi5Hxh2YF 2023-10-24T02:04:18.237 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.tBi5Hxh2YF is 2MB 2023-10-24T02:04:18.364 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.tBi5Hxh2YF 2023-10-24T02:04:18.379 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/data/mon.b.tgz 2023-10-24T02:04:18.380 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-10-24T02:04:18.395 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.mCFhSmco4m 2023-10-24T02:04:18.396 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mCFhSmco4m 2023-10-24T02:04:18.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.mCFhSmco4m 2023-10-24T02:04:18.966 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.mCFhSmco4m is 2MB 2023-10-24T02:04:19.089 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.mCFhSmco4m 2023-10-24T02:04:19.104 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/data/mon.c.tgz 2023-10-24T02:04:19.105 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-10-24T02:04:19.159 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.lnswdVk8nw 2023-10-24T02:04:19.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lnswdVk8nw 2023-10-24T02:04:19.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.lnswdVk8nw 2023-10-24T02:04:19.707 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.lnswdVk8nw is 2MB 2023-10-24T02:04:19.831 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.lnswdVk8nw 2023-10-24T02:04:19.846 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-24T02:04:19.846 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-24T02:04:19.849 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-24T02:04:19.910 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-24T02:04:19.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-24T02:04:19.915 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-24T02:04:19.940 INFO:teuthology.orchestra.run.smithi148.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-24T02:04:19.975 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-24T02:04:19.981 INFO:tasks.ceph:Archiving crash dumps... 2023-10-24T02:04:19.983 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi148/crash 2023-10-24T02:04:19.984 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-24T02:04:20.012 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi150/crash 2023-10-24T02:04:20.013 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-24T02:04:20.045 INFO:tasks.ceph:Shutting down logrotate 2023-10-24T02:04:20.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:20.059 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:20.151 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:20.175 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-24T02:04:20.200 INFO:tasks.ceph:Compressing logs... 2023-10-24T02:04:20.200 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-24T02:04:20.219 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-24T02:04:20.279 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87929.log 2023-10-24T02:04:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-24T02:04:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87929.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-24T02:04:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-24T02:04:20.280 INFO:teuthology.orchestra.run.smithi150.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87929.log.gz 2023-10-24T02:04:20.280 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91640.log 2023-10-24T02:04:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-24T02:04:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.91640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87755.log 2023-10-24T02:04:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: 87.7%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.91640.log.gz-- 2023-10-24T02:04:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log 2023-10-24T02:04:20.281 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87755.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-24T02:04:20.282 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-24T02:04:20.282 INFO:teuthology.orchestra.run.smithi150.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87755.log.gz 2023-10-24T02:04:20.282 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92045.log 2023-10-24T02:04:20.289 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.92045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92045.log.gz 2023-10-24T02:04:20.289 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-24T02:04:20.290 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-24T02:04:20.290 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87795.log 2023-10-24T02:04:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87795.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87795.log.gz 2023-10-24T02:04:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.92431.log 2023-10-24T02:04:20.291 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.3.92431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.92431.log.gz 2023-10-24T02:04:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-24T02:04:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.6.log: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-24T02:04:20.292 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-24T02:04:20.301 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92073.log 2023-10-24T02:04:20.308 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.92073.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92073.log.gz 2023-10-24T02:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87713.log 2023-10-24T02:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87713.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87713.log.gz 2023-10-24T02:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87887.log 2023-10-24T02:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87887.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87887.log.gz 2023-10-24T02:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87844.log 2023-10-24T02:04:20.379 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87844.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87844.log.gz 2023-10-24T02:04:20.379 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87971.log 2023-10-24T02:04:20.392 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87971.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87971.log.gz 2023-10-24T02:04:20.393 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-24T02:04:20.393 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87671.log 2023-10-24T02:04:20.393 INFO:teuthology.orchestra.run.smithi150.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-24T02:04:20.397 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.87671.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.87671.log.gz 2023-10-24T02:04:20.440 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126542.log 2023-10-24T02:04:20.441 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139733.log 2023-10-24T02:04:20.441 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99950.log 2023-10-24T02:04:20.441 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139733.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.126542.log.gz 2023-10-24T02:04:20.441 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96858.log 2023-10-24T02:04:20.442 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128746.log 2023-10-24T02:04:20.442 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139733.log.gz 2023-10-24T02:04:20.442 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96858.log: 87.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.99950.log.gz--verbose 2023-10-24T02:04:20.442 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.92527.log 2023-10-24T02:04:20.442 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96858.log.gz 2023-10-24T02:04:20.443 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116753.log 2023-10-24T02:04:20.443 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128746.log.gz 2023-10-24T02:04:20.443 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95627.log 2023-10-24T02:04:20.443 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1%/var/log/ceph/ceph-client.admin.116753.log: -- replaced with /var/log/ceph/ceph-client.admin.92527.log.gz 2023-10-24T02:04:20.443 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94945.log 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116753.log.gz 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121535.log 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.94945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120234.log 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95627.log.gz 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121535.log: gzip -5 88.0%--verbose -- /var/log/ceph/ceph-client.admin.96261.log 2023-10-24T02:04:20.444 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94945.log.gz 2023-10-24T02:04:20.445 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121535.log.gz 2023-10-24T02:04:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121711.log 2023-10-24T02:04:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96261.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120234.log.gz 2023-10-24T02:04:20.445 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81547.log 2023-10-24T02:04:20.445 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96261.log.gz 2023-10-24T02:04:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130372.log 2023-10-24T02:04:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.tmp-client.admin.81547.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121711.log.gz 2023-10-24T02:04:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121577.log 2023-10-24T02:04:20.446 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81547.log.gz 2023-10-24T02:04:20.446 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140428.log 2023-10-24T02:04:20.447 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130372.log.gz 2023-10-24T02:04:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105061.log 2023-10-24T02:04:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140428.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121577.log.gz 2023-10-24T02:04:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121921.log 2023-10-24T02:04:20.447 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105061.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140428.log.gz 2023-10-24T02:04:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126777.log 2023-10-24T02:04:20.448 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105061.log.gz 2023-10-24T02:04:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105439.log 2023-10-24T02:04:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139546.log 2023-10-24T02:04:20.448 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126777.log.gz 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128269.log 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.121921.log.gz 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139546.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105439.log.gz 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96219.log 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139546.log.gz 2023-10-24T02:04:20.449 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130764.log 2023-10-24T02:04:20.450 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1%/var/log/ceph/ceph-client.admin.96219.log: -- replaced with /var/log/ceph/ceph-client.admin.128269.log.gz 2023-10-24T02:04:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111358.log 2023-10-24T02:04:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130764.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96219.log.gz 2023-10-24T02:04:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119912.log 2023-10-24T02:04:20.450 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111358.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130764.log.gz 2023-10-24T02:04:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103517.log 2023-10-24T02:04:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119912.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111358.log.gz 2023-10-24T02:04:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126945.log 2023-10-24T02:04:20.451 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111551.log 2023-10-24T02:04:20.451 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119912.log.gz 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120278.log 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103517.log.gz 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111551.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126945.log.gz 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98856.log 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120278.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111551.log.gz 2023-10-24T02:04:20.452 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103827.log 2023-10-24T02:04:20.453 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120278.log.gz 2023-10-24T02:04:20.453 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117681.log 2023-10-24T02:04:20.453 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98856.log.gz 2023-10-24T02:04:20.453 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110454.log 2023-10-24T02:04:20.453 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103827.log.gz 2023-10-24T02:04:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120188.log 2023-10-24T02:04:20.454 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117681.log.gz 2023-10-24T02:04:20.454 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.110454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132936.log 2023-10-24T02:04:20.454 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110454.log.gz 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96488.log 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132936.log: /var/log/ceph/ceph-client.admin.104096.log 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120188.log.gz 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121185.log 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.132936.log.gz 2023-10-24T02:04:20.455 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96488.log.gz 2023-10-24T02:04:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137128.log 2023-10-24T02:04:20.456 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104096.log.gz 2023-10-24T02:04:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100874.log 2023-10-24T02:04:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121185.log.gz 2023-10-24T02:04:20.456 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127777.log 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100874.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137128.log.gz 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137960.log 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127777.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.100874.log.gz 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.121493.log 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8%/var/log/ceph/ceph-client.admin.137960.log: -- replaced with /var/log/ceph/ceph-client.admin.127777.log.gz 2023-10-24T02:04:20.457 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94517.log 2023-10-24T02:04:20.458 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137960.log.gz 2023-10-24T02:04:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118909.log 2023-10-24T02:04:20.458 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.94517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99266.log 2023-10-24T02:04:20.458 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94517.log.gz 2023-10-24T02:04:20.458 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121493.log.gz 2023-10-24T02:04:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139177.log 2023-10-24T02:04:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97332.log 2023-10-24T02:04:20.459 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118909.log.gz 2023-10-24T02:04:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139177.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99266.log.gz 2023-10-24T02:04:20.459 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139261.log 2023-10-24T02:04:20.460 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139177.log.gz 2023-10-24T02:04:20.460 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138516.log 2023-10-24T02:04:20.460 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97332.log.gz 2023-10-24T02:04:20.460 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92821.log 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138516.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139261.log.gz 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93997.log 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138516.log.gz 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91880.log 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93997.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92821.log.gz 2023-10-24T02:04:20.461 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128701.log 2023-10-24T02:04:20.462 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127483.log 2023-10-24T02:04:20.462 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128701.log: gzip 87.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.91880.log.gz-- 2023-10-24T02:04:20.462 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136768.log 2023-10-24T02:04:20.462 INFO:teuthology.orchestra.run.smithi148.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93997.log.gz 2023-10-24T02:04:20.462 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0%/var/log/ceph/ceph-client.admin.127483.log: -- replaced with /var/log/ceph/ceph-client.admin.128701.log.gz 2023-10-24T02:04:20.463 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129023.log 2023-10-24T02:04:20.463 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136768.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127483.log.gz 2023-10-24T02:04:20.463 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121059.log 2023-10-24T02:04:20.463 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136768.log.gz 2023-10-24T02:04:20.463 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139780.log 2023-10-24T02:04:20.464 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129023.log.gz 2023-10-24T02:04:20.464 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95289.log 2023-10-24T02:04:20.464 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127735.log 2023-10-24T02:04:20.464 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139780.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121059.log.gz 2023-10-24T02:04:20.465 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108392.log 2023-10-24T02:04:20.465 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.139780.log.gz 2023-10-24T02:04:20.465 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127735.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95289.log.gz 2023-10-24T02:04:20.466 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115622.log 2023-10-24T02:04:20.466 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108392.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127735.log.gz 2023-10-24T02:04:20.466 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93871.log 2023-10-24T02:04:20.466 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108392.log.gz 2023-10-24T02:04:20.466 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137341.log 2023-10-24T02:04:20.467 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93871.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-24T02:04:20.467 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6%/var/log/ceph/ceph-client.admin.137341.log: -- replaced with /var/log/ceph/ceph-client.admin.93871.log.gz 2023-10-24T02:04:20.467 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112151.log 2023-10-24T02:04:20.467 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.115622.log.gz 2023-10-24T02:04:20.467 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 88.2%--verbose -- /var/log/ceph/ceph-client.admin.104889.log -- replaced with /var/log/ceph/ceph-client.admin.137341.log.gz 2023-10-24T02:04:20.468 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-24T02:04:20.468 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141058.log 2023-10-24T02:04:20.468 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104889.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112151.log.gz 2023-10-24T02:04:20.468 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93577.log 2023-10-24T02:04:20.468 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104889.log.gz 2023-10-24T02:04:20.469 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136903.log 2023-10-24T02:04:20.469 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141058.log.gz 2023-10-24T02:04:20.469 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118206.log 2023-10-24T02:04:20.469 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93577.log.gz 2023-10-24T02:04:20.469 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118080.log 2023-10-24T02:04:20.470 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136903.log.gz 2023-10-24T02:04:20.470 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108616.log 2023-10-24T02:04:20.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118206.log.gz 2023-10-24T02:04:20.470 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116430.log 2023-10-24T02:04:20.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118080.log.gz 2023-10-24T02:04:20.471 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117996.log 2023-10-24T02:04:20.471 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116430.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108616.log.gz 2023-10-24T02:04:20.471 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112795.log 2023-10-24T02:04:20.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116430.log.gz 2023-10-24T02:04:20.472 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95155.log 2023-10-24T02:04:20.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117996.log.gz 2023-10-24T02:04:20.472 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113810.log 2023-10-24T02:04:20.472 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112795.log: /var/log/ceph/ceph-client.admin.95155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96446.log 2023-10-24T02:04:20.472 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112795.log.gz 2023-10-24T02:04:20.473 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127294.log 2023-10-24T02:04:20.473 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95155.log.gz 2023-10-24T02:04:20.473 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6%/var/log/ceph/ceph-client.admin.96446.log: -- replaced with /var/log/ceph/ceph-client.admin.113810.log.gz 2023-10-24T02:04:20.473 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98204.log 2023-10-24T02:04:20.473 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127294.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96446.log.gz 2023-10-24T02:04:20.474 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104561.log 2023-10-24T02:04:20.474 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127294.log.gz 2023-10-24T02:04:20.474 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104721.log 2023-10-24T02:04:20.474 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104561.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98204.log.gz 2023-10-24T02:04:20.475 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137731.log 2023-10-24T02:04:20.475 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104721.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104561.log.gz 2023-10-24T02:04:20.475 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87972.log 2023-10-24T02:04:20.475 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2%/var/log/ceph/ceph-client.admin.137731.log: -- replaced with /var/log/ceph/ceph-client.admin.104721.log.gz 2023-10-24T02:04:20.475 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98246.log 2023-10-24T02:04:20.476 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137731.log.gz 2023-10-24T02:04:20.476 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.87972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130162.log 2023-10-24T02:04:20.476 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120143.log 2023-10-24T02:04:20.476 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87972.log.gz 2023-10-24T02:04:20.476 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98246.log.gz/var/log/ceph/ceph-client.admin.130162.log: 2023-10-24T02:04:20.477 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119773.log 2023-10-24T02:04:20.477 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130162.log.gz 2023-10-24T02:04:20.477 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112501.log 2023-10-24T02:04:20.477 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119773.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.120143.log.gz 2023-10-24T02:04:20.477 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129541.log 2023-10-24T02:04:20.478 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119773.log.gz 2023-10-24T02:04:20.478 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91296.log 2023-10-24T02:04:20.478 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112501.log.gz 2023-10-24T02:04:20.478 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97838.log 2023-10-24T02:04:20.478 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91296.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129541.log.gzgzip 2023-10-24T02:04:20.479 INFO:teuthology.orchestra.run.smithi148.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.112193.log 2023-10-24T02:04:20.479 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91296.log.gz 2023-10-24T02:04:20.479 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105313.log 2023-10-24T02:04:20.479 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97838.log.gz 2023-10-24T02:04:20.479 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92258.log 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112921.log 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105313.log.gz 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100584.log 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92258.log.gz 2023-10-24T02:04:20.480 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130632.log 2023-10-24T02:04:20.481 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100526.log 2023-10-24T02:04:20.481 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100584.log.gz 2023-10-24T02:04:20.481 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130632.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.112921.log.gz 2023-10-24T02:04:20.481 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93283.log 2023-10-24T02:04:20.481 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130632.log.gz 2023-10-24T02:04:20.482 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109108.log 2023-10-24T02:04:20.482 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100526.log: /var/log/ceph/ceph-client.admin.93283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113455.log 2023-10-24T02:04:20.482 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100526.log.gz 2023-10-24T02:04:20.482 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138432.log 2023-10-24T02:04:20.482 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93283.log.gz 2023-10-24T02:04:20.483 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131040.log 2023-10-24T02:04:20.483 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109108.log.gz 2023-10-24T02:04:20.483 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113455.log.gz 2023-10-24T02:04:20.483 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138558.log 2023-10-24T02:04:20.483 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138432.log.gz 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117639.log 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108706.log 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131040.log.gz 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117639.log: gzip -5 87.9%--verbose -- /var/log/ceph/ceph-client.admin.117431.log -- replaced with /var/log/ceph/ceph-client.admin.138558.log.gz 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-24T02:04:20.484 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2%/var/log/ceph/ceph-client.admin.108706.log: -- replaced with /var/log/ceph/ceph-client.admin.117639.log.gz 2023-10-24T02:04:20.485 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137215.log 2023-10-24T02:04:20.485 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108706.log.gz 2023-10-24T02:04:20.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114403.log 2023-10-24T02:04:20.485 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117431.log.gz 2023-10-24T02:04:20.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92132.log 2023-10-24T02:04:20.486 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137215.log.gz 2023-10-24T02:04:20.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116706.log 2023-10-24T02:04:20.486 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114403.log.gz 2023-10-24T02:04:20.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133115.log 2023-10-24T02:04:20.486 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4%/var/log/ceph/ceph-client.admin.116706.log: -- replaced with /var/log/ceph/ceph-client.admin.92132.log.gz 2023-10-24T02:04:20.487 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134889.log 2023-10-24T02:04:20.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116706.log.gz 2023-10-24T02:04:20.487 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111719.log 2023-10-24T02:04:20.487 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.133115.log.gz 2023-10-24T02:04:20.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.134889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120584.log 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.134889.log.gz 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135200.log 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111719.log.gz 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138046.log 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120584.log.gz 2023-10-24T02:04:20.488 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109310.log 2023-10-24T02:04:20.489 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138046.log: 87.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.135200.log.gz--verbose 2023-10-24T02:04:20.489 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.91964.log 2023-10-24T02:04:20.489 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138046.log.gz 2023-10-24T02:04:20.489 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99140.log 2023-10-24T02:04:20.489 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109310.log.gz 2023-10-24T02:04:20.490 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139868.log 2023-10-24T02:04:20.490 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104247.log 2023-10-24T02:04:20.490 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91964.log.gz 2023-10-24T02:04:20.490 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99140.log.gz 2023-10-24T02:04:20.490 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138474.log 2023-10-24T02:04:20.491 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139868.log.gz 2023-10-24T02:04:20.491 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126273.log 2023-10-24T02:04:20.491 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138474.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104247.log.gz 2023-10-24T02:04:20.491 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134565.log 2023-10-24T02:04:20.491 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138474.log.gz 2023-10-24T02:04:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114507.log 2023-10-24T02:04:20.492 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126273.log.gz 2023-10-24T02:04:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112879.log 2023-10-24T02:04:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98972.log 2023-10-24T02:04:20.492 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134565.log.gz 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114507.log.gz 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107976.log 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112879.log.gz 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99350.log 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.107976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113989.log 2023-10-24T02:04:20.493 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98972.log.gz 2023-10-24T02:04:20.494 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107976.log.gz 2023-10-24T02:04:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134523.log 2023-10-24T02:04:20.494 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99350.log.gz 2023-10-24T02:04:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130540.log 2023-10-24T02:04:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113989.log: /var/log/ceph/ceph-client.admin.134523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138642.log 2023-10-24T02:04:20.495 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113989.log.gz 2023-10-24T02:04:20.495 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134523.log.gz 2023-10-24T02:04:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103267.log 2023-10-24T02:04:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91792.log 2023-10-24T02:04:20.496 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130540.log.gz 2023-10-24T02:04:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103267.log: /var/log/ceph/ceph-client.admin.127819.log 2023-10-24T02:04:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97502.log 2023-10-24T02:04:20.496 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103267.log.gz 2023-10-24T02:04:20.496 INFO:teuthology.orchestra.run.smithi148.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.138642.log.gz 2023-10-24T02:04:20.497 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91792.log.gz 2023-10-24T02:04:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121365.log 2023-10-24T02:04:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97502.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.127819.log.gz-5 2023-10-24T02:04:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121323.log 2023-10-24T02:04:20.497 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97502.log.gz 2023-10-24T02:04:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:gzip /var/log/ceph/ceph-client.admin.121365.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98798.log 2023-10-24T02:04:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108528.log 2023-10-24T02:04:20.498 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121365.log.gz 2023-10-24T02:04:20.498 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121323.log.gz 2023-10-24T02:04:20.498 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140932.log 2023-10-24T02:04:20.499 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98798.log.gz 2023-10-24T02:04:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113854.log 2023-10-24T02:04:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127567.log 2023-10-24T02:04:20.499 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108528.log.gz 2023-10-24T02:04:20.499 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140932.log.gz 2023-10-24T02:04:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97460.log 2023-10-24T02:04:20.500 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113854.log.gz 2023-10-24T02:04:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140890.log 2023-10-24T02:04:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97460.log: 88.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.127567.log.gz--verbose 2023-10-24T02:04:20.500 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.114311.log 2023-10-24T02:04:20.501 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97460.log.gz 2023-10-24T02:04:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110088.log 2023-10-24T02:04:20.501 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140890.log.gz 2023-10-24T02:04:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131826.log 2023-10-24T02:04:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110088.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.114311.log.gz--verbose 2023-10-24T02:04:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.110665.log 2023-10-24T02:04:20.502 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110088.log.gz 2023-10-24T02:04:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129247.log 2023-10-24T02:04:20.502 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131826.log.gz 2023-10-24T02:04:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116012.log 2023-10-24T02:04:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121669.log 2023-10-24T02:04:20.503 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110665.log.gz 2023-10-24T02:04:20.503 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129247.log.gz 2023-10-24T02:04:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129331.log 2023-10-24T02:04:20.503 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116012.log.gz 2023-10-24T02:04:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96135.log 2023-10-24T02:04:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129331.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121669.log.gz 2023-10-24T02:04:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132838.log 2023-10-24T02:04:20.504 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129331.log.gz 2023-10-24T02:04:20.504 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95113.log 2023-10-24T02:04:20.505 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96135.log.gz 2023-10-24T02:04:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110538.log 2023-10-24T02:04:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127126.log 2023-10-24T02:04:20.505 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132838.log.gz 2023-10-24T02:04:20.505 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110538.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95113.log.gz 2023-10-24T02:04:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109878.log 2023-10-24T02:04:20.506 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110538.log.gz 2023-10-24T02:04:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111466.log 2023-10-24T02:04:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109878.log: gzip 88.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.127126.log.gz--verbose 2023-10-24T02:04:20.506 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.96051.log 2023-10-24T02:04:20.507 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109878.log.gz 2023-10-24T02:04:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122311.log 2023-10-24T02:04:20.507 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111466.log.gz 2023-10-24T02:04:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138256.log 2023-10-24T02:04:20.507 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104415.log 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96051.log.gz 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122311.log.gz 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118782.log 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138256.log.gz 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138600.log 2023-10-24T02:04:20.508 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95071.log 2023-10-24T02:04:20.509 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104415.log.gz 2023-10-24T02:04:20.509 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118782.log.gz 2023-10-24T02:04:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97282.log 2023-10-24T02:04:20.509 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138600.log.gz 2023-10-24T02:04:20.509 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91539.log 2023-10-24T02:04:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97282.log: gzip -5 88.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.95071.log.gz/var/log/ceph/ceph-client.admin.99014.log 2023-10-24T02:04:20.510 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-24T02:04:20.510 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97282.log.gz 2023-10-24T02:04:20.510 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97026.log 2023-10-24T02:04:20.510 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91539.log.gz 2023-10-24T02:04:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91241.log 2023-10-24T02:04:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97026.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.99014.log.gz--verbose 2023-10-24T02:04:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.97194.log 2023-10-24T02:04:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91241.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.97026.log.gz 2023-10-24T02:04:20.511 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100642.log 2023-10-24T02:04:20.512 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91241.log.gz 2023-10-24T02:04:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141353.log 2023-10-24T02:04:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100642.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.97194.log.gz--verbose 2023-10-24T02:04:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.109186.log 2023-10-24T02:04:20.512 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141353.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100642.log.gz 2023-10-24T02:04:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140722.log 2023-10-24T02:04:20.513 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141353.log.gz 2023-10-24T02:04:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141268.log 2023-10-24T02:04:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140722.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109186.log.gz 2023-10-24T02:04:20.513 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130204.log 2023-10-24T02:04:20.514 INFO:teuthology.orchestra.run.smithi148.stderr: 87.0%/var/log/ceph/ceph-client.admin.141268.log: -- replaced with /var/log/ceph/ceph-client.admin.140722.log.gz 2023-10-24T02:04:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-24T02:04:20.514 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141268.log.gz 2023-10-24T02:04:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112331.log 2023-10-24T02:04:20.514 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.130204.log.gz--verbose 2023-10-24T02:04:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.115015.log 2023-10-24T02:04:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130674.log 2023-10-24T02:04:20.515 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112331.log.gz 2023-10-24T02:04:20.515 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133025.log 2023-10-24T02:04:20.515 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115015.log.gz 2023-10-24T02:04:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113220.log 2023-10-24T02:04:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111901.log 2023-10-24T02:04:20.516 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130674.log.gz 2023-10-24T02:04:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113220.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133025.log.gz 2023-10-24T02:04:20.516 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100294.log 2023-10-24T02:04:20.517 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113220.log.gz 2023-10-24T02:04:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108919.log 2023-10-24T02:04:20.517 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111901.log.gz 2023-10-24T02:04:20.517 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120542.log 2023-10-24T02:04:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100294.log: /var/log/ceph/ceph-client.admin.108919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116571.log 2023-10-24T02:04:20.518 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100294.log.gz 2023-10-24T02:04:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120542.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108919.log.gz 2023-10-24T02:04:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114227.log 2023-10-24T02:04:20.518 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95711.log 2023-10-24T02:04:20.519 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4%/var/log/ceph/ceph-client.admin.116571.log: -- replaced with /var/log/ceph/ceph-client.admin.120542.log.gz 2023-10-24T02:04:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114227.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116571.log.gz 2023-10-24T02:04:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136672.log 2023-10-24T02:04:20.519 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114227.log.gz 2023-10-24T02:04:20.519 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127008.log 2023-10-24T02:04:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95711.log: /var/log/ceph/ceph-client.admin.136672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93493.log 2023-10-24T02:04:20.520 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95711.log.gz 2023-10-24T02:04:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127008.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136672.log.gz 2023-10-24T02:04:20.520 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109658.log 2023-10-24T02:04:20.520 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127008.log.gz 2023-10-24T02:04:20.521 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117248.log 2023-10-24T02:04:20.521 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93493.log.gz 2023-10-24T02:04:20.521 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97374.log 2023-10-24T02:04:20.521 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109658.log: /var/log/ceph/ceph-client.admin.117248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127210.log 2023-10-24T02:04:20.521 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109658.log.gz 2023-10-24T02:04:20.522 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97374.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117248.log.gz 2023-10-24T02:04:20.522 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128790.log 2023-10-24T02:04:20.522 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97374.log.gz 2023-10-24T02:04:20.522 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119000.log 2023-10-24T02:04:20.523 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92401.log 2023-10-24T02:04:20.523 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127210.log.gz 2023-10-24T02:04:20.523 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128790.log.gz 2023-10-24T02:04:20.523 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127609.log 2023-10-24T02:04:20.523 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119000.log.gz 2023-10-24T02:04:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112986.log 2023-10-24T02:04:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92401.log: gzip /var/log/ceph/ceph-client.admin.127609.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.139689.log 2023-10-24T02:04:20.524 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92401.log.gz 2023-10-24T02:04:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112986.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127609.log.gz 2023-10-24T02:04:20.524 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114445.log 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116140.log 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1%/var/log/ceph/ceph-client.admin.139689.log: -- replaced with /var/log/ceph/ceph-client.admin.112986.log.gz 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139689.log.gz 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129289.log 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.114445.log.gz 2023-10-24T02:04:20.525 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97796.log 2023-10-24T02:04:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116140.log: /var/log/ceph/ceph-client.admin.129289.log: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-24T02:04:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108250.log 2023-10-24T02:04:20.526 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116140.log.gz 2023-10-24T02:04:20.526 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97796.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129289.log.gz 2023-10-24T02:04:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111043.log 2023-10-24T02:04:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108250.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97796.log.gz 2023-10-24T02:04:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136716.log 2023-10-24T02:04:20.527 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108250.log.gz 2023-10-24T02:04:20.527 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97238.log 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111043.log.gz 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104373.log 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109522.log 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136716.log.gz 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97238.log.gz 2023-10-24T02:04:20.528 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120752.log 2023-10-24T02:04:20.529 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104373.log.gz 2023-10-24T02:04:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109700.log 2023-10-24T02:04:20.529 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111134.log 2023-10-24T02:04:20.529 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109522.log.gz 2023-10-24T02:04:20.529 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120752.log.gz 2023-10-24T02:04:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121017.log 2023-10-24T02:04:20.530 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109700.log.gz 2023-10-24T02:04:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126227.log 2023-10-24T02:04:20.530 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103872.log 2023-10-24T02:04:20.530 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111134.log.gz 2023-10-24T02:04:20.531 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1%/var/log/ceph/ceph-client.admin.126227.log: -- replaced with /var/log/ceph/ceph-client.admin.121017.log.gz 2023-10-24T02:04:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91416.log 2023-10-24T02:04:20.531 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126227.log.gz 2023-10-24T02:04:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95541.log 2023-10-24T02:04:20.531 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97754.log 2023-10-24T02:04:20.532 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103872.log.gz 2023-10-24T02:04:20.532 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91416.log.gz 2023-10-24T02:04:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126861.log 2023-10-24T02:04:20.532 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95541.log.gz 2023-10-24T02:04:20.532 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95331.log 2023-10-24T02:04:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126861.log: 87.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.97754.log.gz--verbose 2023-10-24T02:04:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.115353.log 2023-10-24T02:04:20.533 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6%/var/log/ceph/ceph-client.admin.95331.log: -- replaced with /var/log/ceph/ceph-client.admin.126861.log.gz 2023-10-24T02:04:20.533 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127993.log 2023-10-24T02:04:20.533 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95331.log.gz 2023-10-24T02:04:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104805.log 2023-10-24T02:04:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116796.log 2023-10-24T02:04:20.534 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.115353.log.gz 2023-10-24T02:04:20.534 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127993.log.gz 2023-10-24T02:04:20.534 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141313.log 2023-10-24T02:04:20.535 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104805.log.gz 2023-10-24T02:04:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87876.log 2023-10-24T02:04:20.535 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138967.log 2023-10-24T02:04:20.535 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116796.log.gz 2023-10-24T02:04:20.535 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141313.log.gz 2023-10-24T02:04:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.87876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109478.log 2023-10-24T02:04:20.536 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87876.log.gz 2023-10-24T02:04:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120053.log 2023-10-24T02:04:20.536 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140045.log 2023-10-24T02:04:20.536 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138967.log.gz 2023-10-24T02:04:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120053.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109478.log.gz 2023-10-24T02:04:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134103.log 2023-10-24T02:04:20.537 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120053.log.gz 2023-10-24T02:04:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121795.log 2023-10-24T02:04:20.537 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134103.log: gzip 88.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.140045.log.gz-- 2023-10-24T02:04:20.538 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96984.log 2023-10-24T02:04:20.538 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.134103.log.gz 2023-10-24T02:04:20.538 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105822.log 2023-10-24T02:04:20.538 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121795.log.gz 2023-10-24T02:04:20.538 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116057.log 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114185.log 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96984.log.gz 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105822.log.gz 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110780.log 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139958.log 2023-10-24T02:04:20.539 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116057.log.gz 2023-10-24T02:04:20.540 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97922.log 2023-10-24T02:04:20.540 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114185.log.gz 2023-10-24T02:04:20.540 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139958.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110780.log.gz 2023-10-24T02:04:20.540 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140129.log 2023-10-24T02:04:20.540 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139958.log.gz 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127168.log 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121753.log 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.97922.log.gz 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127168.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140129.log.gz 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92737.log 2023-10-24T02:04:20.541 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127168.log.gz 2023-10-24T02:04:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127945.log 2023-10-24T02:04:20.542 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121753.log.gz 2023-10-24T02:04:20.542 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124960.log 2023-10-24T02:04:20.542 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92737.log.gz 2023-10-24T02:04:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116266.log 2023-10-24T02:04:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.124960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94545.log 2023-10-24T02:04:20.543 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124960.log.gz 2023-10-24T02:04:20.543 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128842.log 2023-10-24T02:04:20.543 INFO:teuthology.orchestra.run.smithi148.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.127945.log.gz 2023-10-24T02:04:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121229.log 2023-10-24T02:04:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.94545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116266.log.gz 2023-10-24T02:04:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133889.log 2023-10-24T02:04:20.544 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94545.log.gz 2023-10-24T02:04:20.544 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128842.log.gz 2023-10-24T02:04:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141016.log 2023-10-24T02:04:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133889.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121229.log.gz 2023-10-24T02:04:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103685.log 2023-10-24T02:04:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141016.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.133889.log.gz 2023-10-24T02:04:20.545 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114269.log 2023-10-24T02:04:20.546 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141016.log.gz 2023-10-24T02:04:20.546 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140680.log 2023-10-24T02:04:20.546 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137257.log 2023-10-24T02:04:20.546 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103685.log.gz 2023-10-24T02:04:20.546 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114269.log.gz 2023-10-24T02:04:20.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112237.log 2023-10-24T02:04:20.547 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140680.log.gz 2023-10-24T02:04:20.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133805.log 2023-10-24T02:04:20.547 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99056.log 2023-10-24T02:04:20.547 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137257.log.gz 2023-10-24T02:04:20.548 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133805.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112237.log.gz 2023-10-24T02:04:20.548 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114353.log 2023-10-24T02:04:20.548 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.133805.log.gz 2023-10-24T02:04:20.548 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129499.log 2023-10-24T02:04:20.548 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104141.log 2023-10-24T02:04:20.549 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99056.log.gz 2023-10-24T02:04:20.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129499.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114353.log.gz 2023-10-24T02:04:20.549 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118506.log 2023-10-24T02:04:20.549 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129499.log.gz 2023-10-24T02:04:20.549 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127651.log 2023-10-24T02:04:20.550 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109394.log 2023-10-24T02:04:20.550 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104141.log.gz 2023-10-24T02:04:20.550 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127651.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118506.log.gz 2023-10-24T02:04:20.550 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129931.log 2023-10-24T02:04:20.550 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127651.log.gz 2023-10-24T02:04:20.551 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109394.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-24T02:04:20.551 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91624.log 2023-10-24T02:04:20.551 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109394.log.gz 2023-10-24T02:04:20.551 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129931.log.gz 2023-10-24T02:04:20.551 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99908.log 2023-10-24T02:04:20.552 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111983.log 2023-10-24T02:04:20.552 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99908.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91624.log.gz 2023-10-24T02:04:20.552 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118416.log 2023-10-24T02:04:20.552 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7%/var/log/ceph/ceph-client.admin.111983.log: -- replaced with /var/log/ceph/ceph-client.admin.99908.log.gz 2023-10-24T02:04:20.552 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137299.log 2023-10-24T02:04:20.553 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118416.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111983.log.gz 2023-10-24T02:04:20.553 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129202.log 2023-10-24T02:04:20.553 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118416.log.gz 2023-10-24T02:04:20.553 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126452.log 2023-10-24T02:04:20.553 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137299.log: /var/log/ceph/ceph-client.admin.129202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106074.log 2023-10-24T02:04:20.554 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137299.log.gz 2023-10-24T02:04:20.554 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126452.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129202.log.gz 2023-10-24T02:04:20.554 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137425.log 2023-10-24T02:04:20.554 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126452.log.gz 2023-10-24T02:04:20.554 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.106074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112543.log 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106074.log.gz 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.137425.log: -- /var/log/ceph/ceph-client.admin.109836.log 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112543.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137425.log.gz 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105187.log 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112543.log.gz 2023-10-24T02:04:20.555 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134019.log 2023-10-24T02:04:20.556 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109836.log: /var/log/ceph/ceph-client.admin.105187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117870.log 2023-10-24T02:04:20.556 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109836.log.gz 2023-10-24T02:04:20.556 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134019.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105187.log.gz 2023-10-24T02:04:20.556 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105949.log 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134019.log.gz 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127693.log 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134271.log 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117870.log.gz 2023-10-24T02:04:20.557 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105949.log: gzip /var/log/ceph/ceph-client.admin.127693.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99224.log 2023-10-24T02:04:20.558 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.105949.log.gz 2023-10-24T02:04:20.558 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134271.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127693.log.gz 2023-10-24T02:04:20.558 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97416.log 2023-10-24T02:04:20.558 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99224.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134271.log.gz 2023-10-24T02:04:20.558 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139913.log 2023-10-24T02:04:20.559 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99224.log.gz 2023-10-24T02:04:20.559 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105229.log 2023-10-24T02:04:20.559 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92611.log 2023-10-24T02:04:20.559 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97416.log.gz 2023-10-24T02:04:20.559 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105229.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.139913.log.gz 2023-10-24T02:04:20.560 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112415.log 2023-10-24T02:04:20.560 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105229.log.gz 2023-10-24T02:04:20.560 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103781.log 2023-10-24T02:04:20.560 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138172.log 2023-10-24T02:04:20.560 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92611.log.gz 2023-10-24T02:04:20.561 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103781.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112415.log.gz 2023-10-24T02:04:20.561 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126650.log 2023-10-24T02:04:20.561 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103781.log.gz 2023-10-24T02:04:20.561 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93703.log 2023-10-24T02:04:20.561 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106032.log 2023-10-24T02:04:20.562 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138172.log.gz 2023-10-24T02:04:20.562 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93703.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126650.log.gz 2023-10-24T02:04:20.562 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111225.log 2023-10-24T02:04:20.562 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93703.log.gz 2023-10-24T02:04:20.562 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.106032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120458.log 2023-10-24T02:04:20.563 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128227.log 2023-10-24T02:04:20.563 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106032.log.gz 2023-10-24T02:04:20.563 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111225.log.gz 2023-10-24T02:04:20.563 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137173.log 2023-10-24T02:04:20.563 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120458.log.gz 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116224.log 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120975.log 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128227.log.gz 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116224.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137173.log.gz 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93325.log 2023-10-24T02:04:20.564 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116224.log.gz 2023-10-24T02:04:20.565 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121143.log 2023-10-24T02:04:20.565 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133070.log 2023-10-24T02:04:20.565 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120975.log.gz 2023-10-24T02:04:20.565 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121143.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93325.log.gz 2023-10-24T02:04:20.565 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108661.log 2023-10-24T02:04:20.566 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121143.log.gz 2023-10-24T02:04:20.566 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128479.log 2023-10-24T02:04:20.566 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110004.log 2023-10-24T02:04:20.566 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133070.log.gz 2023-10-24T02:04:20.566 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128479.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108661.log.gz 2023-10-24T02:04:20.567 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103640.log 2023-10-24T02:04:20.567 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128479.log.gz 2023-10-24T02:04:20.567 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122161.log 2023-10-24T02:04:20.567 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134187.log 2023-10-24T02:04:20.568 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110004.log.gz 2023-10-24T02:04:20.568 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.122161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103640.log.gz 2023-10-24T02:04:20.568 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122161.log.gz 2023-10-24T02:04:20.568 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140470.log 2023-10-24T02:04:20.568 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138348.log 2023-10-24T02:04:20.569 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140470.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134187.log.gz 2023-10-24T02:04:20.569 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129067.log 2023-10-24T02:04:20.569 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140470.log.gz 2023-10-24T02:04:20.569 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116842.log 2023-10-24T02:04:20.569 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138348.log.gz 2023-10-24T02:04:20.570 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117122.log 2023-10-24T02:04:20.570 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116842.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-24T02:04:20.570 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129067.log.gz 2023-10-24T02:04:20.570 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117122.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116842.log.gz 2023-10-24T02:04:20.570 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118332.log 2023-10-24T02:04:20.571 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117122.log.gz 2023-10-24T02:04:20.571 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98488.log 2023-10-24T02:04:20.571 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128977.log 2023-10-24T02:04:20.571 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98488.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118332.log.gz 2023-10-24T02:04:20.572 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127422.log 2023-10-24T02:04:20.572 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98488.log.gz 2023-10-24T02:04:20.572 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140554.log 2023-10-24T02:04:20.573 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95029.log 2023-10-24T02:04:20.573 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127422.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128977.log.gz 2023-10-24T02:04:20.573 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140554.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127422.log.gz 2023-10-24T02:04:20.574 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111313.log 2023-10-24T02:04:20.574 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95029.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140554.log.gz 2023-10-24T02:04:20.574 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91497.log 2023-10-24T02:04:20.575 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95029.log.gz 2023-10-24T02:04:20.575 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129603.log 2023-10-24T02:04:20.575 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132527.log /var/log/ceph/ceph-client.admin.91497.log: 2023-10-24T02:04:20.576 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111313.log.gz 2023-10-24T02:04:20.576 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129603.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91497.log.gz 2023-10-24T02:04:20.576 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117597.log 2023-10-24T02:04:20.577 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138214.log 2023-10-24T02:04:20.577 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4%/var/log/ceph/ceph-client.admin.132527.log: -- replaced with /var/log/ceph/ceph-client.admin.129603.log.gz 2023-10-24T02:04:20.577 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117597.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132527.log.gz 2023-10-24T02:04:20.578 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120367.log 2023-10-24T02:04:20.578 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96650.log 2023-10-24T02:04:20.579 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138214.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117597.log.gz 2023-10-24T02:04:20.579 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117206.log 2023-10-24T02:04:20.579 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138214.log.gz 2023-10-24T02:04:20.580 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128521.log 2023-10-24T02:04:20.580 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96650.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120367.log.gz 2023-10-24T02:04:20.581 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117206.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96650.log.gz 2023-10-24T02:04:20.581 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140848.log 2023-10-24T02:04:20.581 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138130.log 2023-10-24T02:04:20.582 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128521.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117206.log.gz 2023-10-24T02:04:20.582 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140848.log: 86.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.128521.log.gz-5 2023-10-24T02:04:20.583 INFO:teuthology.orchestra.run.smithi148.stderr:--verbose -- /var/log/ceph/ceph-client.admin.139502.log 2023-10-24T02:04:20.583 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98720.log 2023-10-24T02:04:20.583 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140848.log.gz 2023-10-24T02:04:20.584 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134649.log 2023-10-24T02:04:20.584 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138130.log.gz 2023-10-24T02:04:20.585 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139502.log.gz 2023-10-24T02:04:20.585 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92653.log 2023-10-24T02:04:20.585 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134649.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98720.log.gz 2023-10-24T02:04:20.586 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130078.log 2023-10-24T02:04:20.586 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108437.log 2023-10-24T02:04:20.587 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92653.log: /var/log/ceph/ceph-client.admin.130078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120893.log 2023-10-24T02:04:20.587 INFO:teuthology.orchestra.run.smithi148.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.134649.log.gz 2023-10-24T02:04:20.587 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92653.log.gz 2023-10-24T02:04:20.588 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97586.log 2023-10-24T02:04:20.588 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130078.log.gz 2023-10-24T02:04:20.589 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120893.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108437.log.gz 2023-10-24T02:04:20.589 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98604.log 2023-10-24T02:04:20.589 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120893.log.gz 2023-10-24T02:04:20.590 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108082.log 2023-10-24T02:04:20.590 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97586.log: /var/log/ceph/ceph-client.admin.98604.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97586.log.gz 2023-10-24T02:04:20.591 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95669.log 2023-10-24T02:04:20.591 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108205.log 2023-10-24T02:04:20.591 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108082.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98604.log.gz 2023-10-24T02:04:20.592 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129373.log 2023-10-24T02:04:20.592 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108082.log.gz 2023-10-24T02:04:20.593 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134355.log 88.1% 2023-10-24T02:04:20.593 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95669.log.gz/var/log/ceph/ceph-client.admin.108205.log: 2023-10-24T02:04:20.593 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101182.log 2023-10-24T02:04:20.594 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108205.log.gz 2023-10-24T02:04:20.594 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100352.log 2023-10-24T02:04:20.595 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134355.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129373.log.gz 2023-10-24T02:04:20.595 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.101182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134355.log.gz 2023-10-24T02:04:20.595 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108793.log 2023-10-24T02:04:20.596 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100076.log 2023-10-24T02:04:20.596 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0%/var/log/ceph/ceph-client.admin.100352.log: -- replaced with /var/log/ceph/ceph-client.admin.101182.log.gz 2023-10-24T02:04:20.596 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108793.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100352.log.gz 2023-10-24T02:04:20.597 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122372.log 2023-10-24T02:04:20.597 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115395.log 2023-10-24T02:04:20.598 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100076.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108793.log.gz 2023-10-24T02:04:20.598 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122372.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100076.log.gz 2023-10-24T02:04:20.598 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93367.log 2023-10-24T02:04:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132792.log 2023-10-24T02:04:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115395.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122372.log.gz 2023-10-24T02:04:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93367.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115395.log.gz 2023-10-24T02:04:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99098.log 2023-10-24T02:04:20.600 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93367.log.gz 2023-10-24T02:04:20.601 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135100.log 2023-10-24T02:04:20.601 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132792.log: /var/log/ceph/ceph-client.admin.99098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108961.log 2023-10-24T02:04:20.601 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.132792.log.gz 2023-10-24T02:04:20.602 INFO:teuthology.orchestra.run.smithi148.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.99098.log.gz 2023-10-24T02:04:20.602 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110496.log 2023-10-24T02:04:20.603 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108961.log: gzip 89.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.135100.log.gz-- 2023-10-24T02:04:20.603 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100410.log 2023-10-24T02:04:20.604 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108961.log.gz 2023-10-24T02:04:20.604 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91836.log 2023-10-24T02:04:20.604 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.100410.log: -- /var/log/ceph/ceph-client.admin.126409.log 2023-10-24T02:04:20.605 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110496.log.gz 2023-10-24T02:04:20.605 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91836.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100410.log.gz 2023-10-24T02:04:20.606 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122514.log 2023-10-24T02:04:20.606 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95753.log 2023-10-24T02:04:20.607 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2%/var/log/ceph/ceph-client.admin.126409.log: -- replaced with /var/log/ceph/ceph-client.admin.91836.log.gz 2023-10-24T02:04:20.607 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122514.log: gzip -5 --verbose -- 87.5%/var/log/ceph/ceph-client.admin.110214.log 2023-10-24T02:04:20.607 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126409.log.gz 2023-10-24T02:04:20.608 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121879.log 2023-10-24T02:04:20.608 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122514.log.gz 2023-10-24T02:04:20.609 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95753.log: /var/log/ceph/ceph-client.admin.110214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96177.log 2023-10-24T02:04:20.609 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95753.log.gz 2023-10-24T02:04:20.609 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117353.log 2023-10-24T02:04:20.610 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121879.log: /var/log/ceph/ceph-client.admin.96177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104051.log 2023-10-24T02:04:20.610 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121879.log.gz 2023-10-24T02:04:20.611 INFO:teuthology.orchestra.run.smithi148.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.110214.log.gz 2023-10-24T02:04:20.611 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5%/var/log/ceph/ceph-client.admin.117353.log: -- replaced with /var/log/ceph/ceph-client.admin.96177.log.gz 2023-10-24T02:04:20.611 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140386.log 2023-10-24T02:04:20.612 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92216.log 2023-10-24T02:04:20.612 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117353.log.gz 2023-10-24T02:04:20.613 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104051.log: /var/log/ceph/ceph-client.admin.140386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120413.log 2023-10-24T02:04:20.613 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104051.log.gz 2023-10-24T02:04:20.613 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92216.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140386.log.gz 2023-10-24T02:04:20.614 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126497.log 2023-10-24T02:04:20.614 INFO:teuthology.orchestra.run.smithi148.stderr:gzip 88.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.92216.log.gz-- 2023-10-24T02:04:20.615 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92569.log 2023-10-24T02:04:20.615 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120413.log: /var/log/ceph/ceph-client.admin.126497.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120413.log.gz 2023-10-24T02:04:20.615 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119957.log 2023-10-24T02:04:20.616 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126497.log.gz 2023-10-24T02:04:20.616 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130330.log 2023-10-24T02:04:20.616 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92569.log: /var/log/ceph/ceph-client.admin.119957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127861.log 2023-10-24T02:04:20.617 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92569.log.gz 2023-10-24T02:04:20.617 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130330.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119957.log.gz 2023-10-24T02:04:20.618 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120500.log 2023-10-24T02:04:20.618 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130330.log.gz 2023-10-24T02:04:20.618 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95837.log 2023-10-24T02:04:20.619 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128932.log 2023-10-24T02:04:20.619 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9%/var/log/ceph/ceph-client.admin.120500.log: -- replaced with /var/log/ceph/ceph-client.admin.127861.log.gz 2023-10-24T02:04:20.620 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136949.log 2023-10-24T02:04:20.620 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120500.log.gz 2023-10-24T02:04:20.620 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95837.log.gz 2023-10-24T02:04:20.621 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128932.log: /var/log/ceph/ceph-client.admin.110991.log 2023-10-24T02:04:20.621 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135039.log 2023-10-24T02:04:20.621 INFO:teuthology.orchestra.run.smithi148.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.128932.log.gz 2023-10-24T02:04:20.622 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110991.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136949.log.gz 2023-10-24T02:04:20.622 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115538.log 2023-10-24T02:04:20.622 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110991.log.gz 2023-10-24T02:04:20.623 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141395.log 2023-10-24T02:04:20.623 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137529.log 2023-10-24T02:04:20.623 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115538.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135039.log.gz 2023-10-24T02:04:20.624 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115580.log 2023-10-24T02:04:20.624 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115538.log.gz 2023-10-24T02:04:20.624 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141395.log.gz 2023-10-24T02:04:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138882.log 2023-10-24T02:04:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137529.log: /var/log/ceph/ceph-client.admin.115580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127525.log 2023-10-24T02:04:20.625 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137529.log.gz 2023-10-24T02:04:20.625 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.138882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.138882.log.gz 2023-10-24T02:04:20.626 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115143.log 2023-10-24T02:04:20.626 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115580.log.gz 2023-10-24T02:04:20.626 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119683.log 2023-10-24T02:04:20.627 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115143.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127525.log.gz 2023-10-24T02:04:20.627 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112627.log 2023-10-24T02:04:20.627 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115143.log.gz 2023-10-24T02:04:20.627 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138390.log 2023-10-24T02:04:20.628 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119683.log.gz 2023-10-24T02:04:20.628 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105529.log 2023-10-24T02:04:20.629 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112627.log.gz 2023-10-24T02:04:20.629 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126362.log 2023-10-24T02:04:20.629 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105529.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138390.log.gz 2023-10-24T02:04:20.630 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133415.log 2023-10-24T02:04:20.630 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126362.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105529.log.gz 2023-10-24T02:04:20.630 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128185.log 2023-10-24T02:04:20.631 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126362.log.gz 2023-10-24T02:04:20.631 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137815.log 2023-10-24T02:04:20.631 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.133415.log.gz 2023-10-24T02:04:20.632 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.128185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105103.log 2023-10-24T02:04:20.632 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128185.log.gz 2023-10-24T02:04:20.632 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115454.log 2023-10-24T02:04:20.633 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105103.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137815.log.gz 2023-10-24T02:04:20.633 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141184.log 2023-10-24T02:04:20.633 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93745.log 2023-10-24T02:04:20.633 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115454.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105103.log.gz 2023-10-24T02:04:20.634 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141184.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.115454.log.gz 2023-10-24T02:04:20.634 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139598.log 2023-10-24T02:04:20.635 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134931.log 2023-10-24T02:04:20.635 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.141184.log.gz 2023-10-24T02:04:20.635 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93745.log: /var/log/ceph/ceph-client.admin.139598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114034.log 2023-10-24T02:04:20.636 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93745.log.gz 2023-10-24T02:04:20.636 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97068.log 2023-10-24T02:04:20.637 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139598.log.gz 2023-10-24T02:04:20.637 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116308.log 2023-10-24T02:04:20.637 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.134931.log.gz 2023-10-24T02:04:20.638 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114034.log.gz 2023-10-24T02:04:20.638 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93031.log 2023-10-24T02:04:20.638 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116308.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97068.log.gz 2023-10-24T02:04:20.639 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112067.log 2023-10-24T02:04:20.639 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116308.log.gz 2023-10-24T02:04:20.639 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96387.log 2023-10-24T02:04:20.640 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93031.log.gz 2023-10-24T02:04:20.640 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114709.log 2023-10-24T02:04:20.640 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112067.log.gz 2023-10-24T02:04:20.641 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93535.log 2023-10-24T02:04:20.641 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138004.log 2023-10-24T02:04:20.641 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114709.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96387.log.gz 2023-10-24T02:04:20.642 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93535.log: gzip -5 --verbose 88.2%-- /var/log/ceph/ceph-client.admin.92174.log -- replaced with /var/log/ceph/ceph-client.admin.114709.log.gz 2023-10-24T02:04:20.642 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-24T02:04:20.642 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91581.log 2023-10-24T02:04:20.643 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138004.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93535.log.gz 2023-10-24T02:04:20.643 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136627.log 2023-10-24T02:04:20.643 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138004.log.gz 2023-10-24T02:04:20.644 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114835.log 2023-10-24T02:04:20.644 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91581.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92174.log.gz 2023-10-24T02:04:20.644 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136627.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91581.log.gz 2023-10-24T02:04:20.645 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117828.log 2023-10-24T02:04:20.645 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113178.log 2023-10-24T02:04:20.645 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114835.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136627.log.gz 2023-10-24T02:04:20.646 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113373.log 2023-10-24T02:04:20.646 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114835.log.gz 2023-10-24T02:04:20.647 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.113178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113765.log 2023-10-24T02:04:20.647 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117828.log.gz 2023-10-24T02:04:20.647 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113178.log.gz 2023-10-24T02:04:20.647 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132883.log 2023-10-24T02:04:20.648 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113373.log.gz 2023-10-24T02:04:20.648 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96572.log 2023-10-24T02:04:20.648 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132652.log 2023-10-24T02:04:20.648 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1%/var/log/ceph/ceph-client.admin.132883.log: -- replaced with /var/log/ceph/ceph-client.admin.113765.log.gz 2023-10-24T02:04:20.648 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96572.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.132883.log.gz 2023-10-24T02:04:20.649 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109045.log 2023-10-24T02:04:20.649 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110903.log 2023-10-24T02:04:20.649 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132652.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96572.log.gz 2023-10-24T02:04:20.649 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104763.log 2023-10-24T02:04:20.649 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132652.log.gz 2023-10-24T02:04:20.650 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134973.log 2023-10-24T02:04:20.650 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109045.log.gz 2023-10-24T02:04:20.650 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104763.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110903.log.gz 2023-10-24T02:04:20.650 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102516.log 2023-10-24T02:04:20.650 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96732.log 2023-10-24T02:04:20.651 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104763.log.gz 2023-10-24T02:04:20.651 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134973.log: /var/log/ceph/ceph-client.admin.102516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110130.log 2023-10-24T02:04:20.651 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134973.log.gz 2023-10-24T02:04:20.651 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104457.log 2023-10-24T02:04:20.651 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9%/var/log/ceph/ceph-client.admin.96732.log: -- replaced with /var/log/ceph/ceph-client.admin.102516.log.gz 2023-10-24T02:04:20.652 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110130.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96732.log.gz 2023-10-24T02:04:20.652 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121969.log 2023-10-24T02:04:20.652 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115862.log 2023-10-24T02:04:20.652 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110130.log.gz 2023-10-24T02:04:20.652 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104457.log: /var/log/ceph/ceph-client.admin.121969.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104457.log.gz 2023-10-24T02:04:20.653 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138925.log 2023-10-24T02:04:20.653 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.115862.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121969.log.gz 2023-10-24T02:04:20.653 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137857.log 2023-10-24T02:04:20.653 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115862.log.gz 2023-10-24T02:04:20.653 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108751.log 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137857.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138925.log.gz 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115099.log 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137857.log.gz 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114965.log 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108751.log.gz 2023-10-24T02:04:20.654 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128396.log 2023-10-24T02:04:20.655 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113578.log 88.3% 2023-10-24T02:04:20.655 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115099.log.gz 2023-10-24T02:04:20.655 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114965.log: /var/log/ceph/ceph-client.admin.128396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140512.log 2023-10-24T02:04:20.655 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114965.log.gz 2023-10-24T02:04:20.655 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.113578.log: -- /var/log/ceph/ceph-client.admin.114793.log 2023-10-24T02:04:20.656 INFO:teuthology.orchestra.run.smithi148.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.128396.log.gz 2023-10-24T02:04:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108877.log 2023-10-24T02:04:20.656 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113578.log.gz 2023-10-24T02:04:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112459.log 2023-10-24T02:04:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114793.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.140512.log.gz 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108877.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.114793.log.gz--verbose 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.133160.log 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136415.log 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112459.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108877.log.gz 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104499.log 2023-10-24T02:04:20.657 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112459.log.gz 2023-10-24T02:04:20.658 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126175.log 2023-10-24T02:04:20.658 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6%/var/log/ceph/ceph-client.admin.136415.log: -- replaced with /var/log/ceph/ceph-client.admin.133160.log.gz 2023-10-24T02:04:20.658 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105888.log 2023-10-24T02:04:20.658 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136415.log.gz 2023-10-24T02:04:20.658 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115904.log 2023-10-24T02:04:20.659 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4%/var/log/ceph/ceph-client.admin.126175.log: -- replaced with /var/log/ceph/ceph-client.admin.104499.log.gz 2023-10-24T02:04:20.659 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105888.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126175.log.gz 2023-10-24T02:04:20.659 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109962.log 2023-10-24T02:04:20.659 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133721.log 2023-10-24T02:04:20.659 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105888.log.gz/var/log/ceph/ceph-client.admin.115904.log: 2023-10-24T02:04:20.660 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109962.log: gzip 87.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.115904.log.gz--verbose 2023-10-24T02:04:20.660 INFO:teuthology.orchestra.run.smithi148.stderr:-- /var/log/ceph/ceph-client.admin.115946.log 2023-10-24T02:04:20.660 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100700.log 2023-10-24T02:04:20.660 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133721.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109962.log.gz 2023-10-24T02:04:20.660 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115946.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133721.log.gz 2023-10-24T02:04:20.661 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131106.log 2023-10-24T02:04:20.661 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96816.log 2023-10-24T02:04:20.661 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100700.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115946.log.gz 2023-10-24T02:04:20.661 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137038.log 2023-10-24T02:04:20.661 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100700.log.gz 2023-10-24T02:04:20.662 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95499.log 2023-10-24T02:04:20.662 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.131106.log.gz 2023-10-24T02:04:20.662 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96816.log: /var/log/ceph/ceph-client.admin.137038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113901.log 2023-10-24T02:04:20.662 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96816.log.gz 2023-10-24T02:04:20.662 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2%/var/log/ceph/ceph-client.admin.95499.log: -- replaced with /var/log/ceph/ceph-client.admin.137038.log.gz 2023-10-24T02:04:20.663 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140638.log 2023-10-24T02:04:20.663 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113901.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95499.log.gz 2023-10-24T02:04:20.663 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-24T02:04:20.663 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113901.log.gz 2023-10-24T02:04:20.663 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121273.log 2023-10-24T02:04:20.664 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.3.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140638.log.gz 2023-10-24T02:04:20.664 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93787.log 2023-10-24T02:04:20.664 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100916.log 2023-10-24T02:04:20.664 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121273.log: /var/log/ceph/ceph-client.admin.93787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100168.log 2023-10-24T02:04:20.664 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121273.log.gz 2023-10-24T02:04:20.665 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117080.log 2023-10-24T02:04:20.665 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93787.log.gz 2023-10-24T02:04:20.665 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100916.log.gz 2023-10-24T02:04:20.665 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126735.log 2023-10-24T02:04:20.665 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141100.log 2023-10-24T02:04:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117080.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100168.log.gz 2023-10-24T02:04:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92905.log 2023-10-24T02:04:20.666 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117080.log.gz 2023-10-24T02:04:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141100.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.126735.log.gz 2023-10-24T02:04:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132696.log 2023-10-24T02:04:20.667 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94987.log 2023-10-24T02:04:20.667 INFO:teuthology.orchestra.run.smithi148.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141100.log.gz 2023-10-24T02:04:20.667 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132696.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92905.log.gz 2023-10-24T02:04:20.667 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130582.log 2023-10-24T02:04:20.667 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132696.log.gz 2023-10-24T02:04:20.668 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.94987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108294.log 2023-10-24T02:04:20.668 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130582.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94987.log.gz 2023-10-24T02:04:20.668 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140003.log 2023-10-24T02:04:20.668 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130582.log.gz 2023-10-24T02:04:20.668 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108294.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92485.log 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108294.log.gz 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140003.log.gz 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134397.log 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112281.log 2023-10-24T02:04:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134397.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92485.log.gz 2023-10-24T02:04:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112281.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134397.log.gz 2023-10-24T02:04:20.670 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112281.log.gz 2023-10-24T02:04:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130120.log 2023-10-24T02:04:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140087.log 2023-10-24T02:04:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111823.log 2023-10-24T02:04:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140087.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130120.log.gz 2023-10-24T02:04:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140087.log.gz 2023-10-24T02:04:20.671 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111823.log.gz 2023-10-24T02:04:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93409.log 2023-10-24T02:04:20.671 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92090.log 2023-10-24T02:04:20.672 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114921.log 2023-10-24T02:04:20.672 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92090.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93409.log.gz 2023-10-24T02:04:20.672 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114921.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92090.log.gz 2023-10-24T02:04:20.672 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114921.log.gz 2023-10-24T02:04:20.672 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93073.log 2023-10-24T02:04:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139219.log 2023-10-24T02:04:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136505.log 2023-10-24T02:04:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139219.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93073.log.gz 2023-10-24T02:04:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136505.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139219.log.gz 2023-10-24T02:04:20.673 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117513.log 2023-10-24T02:04:20.674 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136505.log.gz 2023-10-24T02:04:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113944.log 2023-10-24T02:04:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97970.log 2023-10-24T02:04:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113944.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117513.log.gz 2023-10-24T02:04:20.674 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97970.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113944.log.gz 2023-10-24T02:04:20.675 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97970.log.gz 2023-10-24T02:04:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115670.log 2023-10-24T02:04:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100252.log 2023-10-24T02:04:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127336.log 2023-10-24T02:04:20.675 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115670.log.gz 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127336.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.100252.log.gz 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127336.log.gz 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98162.log 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121627.log 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.98162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125002.log 2023-10-24T02:04:20.676 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98162.log.gz 2023-10-24T02:04:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120099.log 2023-10-24T02:04:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.125002.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121627.log.gz 2023-10-24T02:04:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120099.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125002.log.gz 2023-10-24T02:04:20.677 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120099.log.gz 2023-10-24T02:04:20.677 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117038.log 2023-10-24T02:04:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134481.log 2023-10-24T02:04:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93913.log 2023-10-24T02:04:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134481.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117038.log.gz 2023-10-24T02:04:20.678 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93913.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134481.log.gz 2023-10-24T02:04:20.678 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93913.log.gz 2023-10-24T02:04:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112753.log 2023-10-24T02:04:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96009.log 2023-10-24T02:04:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110947.log 2023-10-24T02:04:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96009.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112753.log.gz 2023-10-24T02:04:20.679 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96009.log.gz 2023-10-24T02:04:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101982.log 2023-10-24T02:04:20.680 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110947.log.gz 2023-10-24T02:04:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105763.log 2023-10-24T02:04:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.101982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136859.log 2023-10-24T02:04:20.680 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105763.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101982.log.gz 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136859.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105763.log.gz 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.136859.log.gz 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109744.log 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140764.log 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116475.log 2023-10-24T02:04:20.681 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140764.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109744.log.gz 2023-10-24T02:04:20.682 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116475.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140764.log.gz 2023-10-24T02:04:20.682 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92947.log 2023-10-24T02:04:20.682 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116475.log.gz 2023-10-24T02:04:20.682 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111509.log 2023-10-24T02:04:20.682 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117723.log 2023-10-24T02:04:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111509.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92947.log.gz 2023-10-24T02:04:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98390.log 2023-10-24T02:04:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117723.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111509.log.gz 2023-10-24T02:04:20.683 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129763.log 2023-10-24T02:04:20.683 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117723.log.gz 2023-10-24T02:04:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111635.log 2023-10-24T02:04:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129763.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98390.log.gz 2023-10-24T02:04:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111635.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129763.log.gz 2023-10-24T02:04:20.684 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111635.log.gz 2023-10-24T02:04:20.684 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92342.log 2023-10-24T02:04:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97544.log 2023-10-24T02:04:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92342.log: /var/log/ceph/ceph-client.admin.97544.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92342.log.gz 2023-10-24T02:04:20.685 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97544.log.gz 2023-10-24T02:04:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137082.log 2023-10-24T02:04:20.685 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116887.log 2023-10-24T02:04:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92048.log 2023-10-24T02:04:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116887.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137082.log.gz 2023-10-24T02:04:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118458.log 2023-10-24T02:04:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92048.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116887.log.gz 2023-10-24T02:04:20.686 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117164.log 2023-10-24T02:04:20.687 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92048.log.gz 2023-10-24T02:04:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118248.log 2023-10-24T02:04:20.687 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117164.log: /var/log/ceph/ceph-client.admin.118248.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117164.log.gz 2023-10-24T02:04:20.687 INFO:teuthology.orchestra.run.smithi148.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.118458.log.gz 2023-10-24T02:04:20.687 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118248.log.gz 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111404.log 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139335.log 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130716.log 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92443.log 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111404.log.gz 2023-10-24T02:04:20.688 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130716.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-24T02:04:20.689 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139335.log.gz 2023-10-24T02:04:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92443.log: /var/log/ceph/ceph-mon.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92443.log.gz 2023-10-24T02:04:20.689 INFO:teuthology.orchestra.run.smithi148.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.130716.log.gz 2023-10-24T02:04:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109436.log 2023-10-24T02:04:20.689 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103729.log 2023-10-24T02:04:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109436.log: /var/log/ceph/ceph-client.admin.103729.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109436.log.gz 2023-10-24T02:04:20.690 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103729.log.gz 2023-10-24T02:04:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111677.log 2023-10-24T02:04:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97712.log 2023-10-24T02:04:20.690 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126078.log 2023-10-24T02:04:20.691 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97712.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111677.log.gz 2023-10-24T02:04:20.691 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97712.log.gz 2023-10-24T02:04:20.691 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126078.log.gz 2023-10-24T02:04:20.691 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139823.log 2023-10-24T02:04:20.691 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141142.log 2023-10-24T02:04:20.692 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139823.log: /var/log/ceph/ceph-client.admin.141142.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139823.log.gz 2023-10-24T02:04:20.692 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141142.log.gz 2023-10-24T02:04:20.692 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96900.log 2023-10-24T02:04:20.692 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130017.log 2023-10-24T02:04:20.692 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96900.log: /var/log/ceph/ceph-client.admin.130017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96900.log.gz 2023-10-24T02:04:20.693 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130017.log.gz 2023-10-24T02:04:20.693 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114585.log 2023-10-24T02:04:20.693 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97670.log 2023-10-24T02:04:20.693 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114585.log: /var/log/ceph/ceph-client.admin.97670.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114585.log.gz 2023-10-24T02:04:20.693 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97670.log.gz 2023-10-24T02:04:20.694 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140974.log 2023-10-24T02:04:20.694 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129805.log 2023-10-24T02:04:20.694 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140974.log: /var/log/ceph/ceph-client.admin.129805.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140974.log.gz 2023-10-24T02:04:20.694 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129805.log.gz 2023-10-24T02:04:20.694 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120668.log 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111593.log 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120668.log: /var/log/ceph/ceph-client.admin.111593.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120668.log.gz 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111593.log.gz 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140596.log 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131784.log 2023-10-24T02:04:20.695 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140596.log: /var/log/ceph/ceph-client.admin.131784.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140596.log.gz 2023-10-24T02:04:20.696 INFO:teuthology.orchestra.run.smithi148.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.131784.log.gz 2023-10-24T02:04:20.696 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121101.log 2023-10-24T02:04:20.696 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112837.log 2023-10-24T02:04:20.696 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121101.log: /var/log/ceph/ceph-client.admin.112837.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121101.log.gz 2023-10-24T02:04:20.696 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112837.log.gz 2023-10-24T02:04:20.697 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126819.log 2023-10-24T02:04:20.697 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133457.log 2023-10-24T02:04:20.697 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126819.log: /var/log/ceph/ceph-client.admin.133457.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126819.log.gz 2023-10-24T02:04:20.697 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.133457.log.gz 2023-10-24T02:04:20.697 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2023-10-24T02:04:20.698 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104331.log 2023-10-24T02:04:20.698 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95795.log: /var/log/ceph/ceph-client.admin.104331.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2023-10-24T02:04:20.698 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104331.log.gz 2023-10-24T02:04:20.698 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91666.log 2023-10-24T02:04:20.698 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102266.log 2023-10-24T02:04:20.699 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91666.log: /var/log/ceph/ceph-client.admin.102266.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91666.log.gz 2023-10-24T02:04:20.699 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102266.log.gz 2023-10-24T02:04:20.699 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118740.log 2023-10-24T02:04:20.699 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118038.log 2023-10-24T02:04:20.699 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118740.log: /var/log/ceph/ceph-client.admin.118038.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118740.log.gz 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118038.log.gz 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93451.log 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130956.log 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122203.log 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93451.log: /var/log/ceph/ceph-client.0.130956.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93451.log.gz 2023-10-24T02:04:20.700 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.130956.log.gz 2023-10-24T02:04:20.701 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122203.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122203.log.gz 2023-10-24T02:04:20.701 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93199.log 2023-10-24T02:04:20.701 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109794.log 2023-10-24T02:04:20.701 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93199.log: /var/log/ceph/ceph-client.admin.109794.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93199.log.gz 2023-10-24T02:04:20.701 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109794.log.gz 2023-10-24T02:04:20.702 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115311.log 2023-10-24T02:04:20.702 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105271.log 2023-10-24T02:04:20.702 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129156.log 2023-10-24T02:04:20.702 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105271.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.115311.log.gz 2023-10-24T02:04:20.702 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129156.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105271.log.gz 2023-10-24T02:04:20.703 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.129156.log.gz 2023-10-24T02:04:20.703 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93829.log 2023-10-24T02:04:20.703 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129889.log 2023-10-24T02:04:20.703 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134061.log 2023-10-24T02:04:20.703 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129889.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93829.log.gz 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134061.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.129889.log.gz 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134061.log.gz 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128578.log 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133975.log 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112025.log 2023-10-24T02:04:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133975.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128578.log.gz 2023-10-24T02:04:20.705 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110604.log 2023-10-24T02:04:20.705 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133975.log.gz 2023-10-24T02:04:20.705 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112025.log: /var/log/ceph/ceph-client.admin.110604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112025.log.gz 2023-10-24T02:04:20.705 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110604.log.gz 2023-10-24T02:04:20.705 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104639.log 2023-10-24T02:04:20.706 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120001.log 2023-10-24T02:04:20.706 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115057.log 2023-10-24T02:04:20.706 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120001.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104639.log.gz 2023-10-24T02:04:20.706 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120001.log.gz 2023-10-24T02:04:20.706 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115057.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115057.log.gz 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128888.log 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139644.log 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128888.log: /var/log/ceph/ceph-client.admin.139644.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.128888.log.gz 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103916.log 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139644.log.gz 2023-10-24T02:04:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100034.log 2023-10-24T02:04:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103916.log: /var/log/ceph/ceph-client.admin.100034.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103916.log.gz 2023-10-24T02:04:20.708 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100034.log.gz 2023-10-24T02:04:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134229.log 2023-10-24T02:04:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101714.log 2023-10-24T02:04:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134229.log: /var/log/ceph/ceph-client.admin.101714.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134229.log.gz 2023-10-24T02:04:20.709 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101714.log.gz 2023-10-24T02:04:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132740.log 2023-10-24T02:04:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132740.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132740.log.gz 2023-10-24T02:04:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105019.log 2023-10-24T02:04:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129973.log 2023-10-24T02:04:20.710 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133205.log 2023-10-24T02:04:20.710 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129973.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105019.log.gz 2023-10-24T02:04:20.710 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133205.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129973.log.gz 2023-10-24T02:04:20.710 INFO:teuthology.orchestra.run.smithi148.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133205.log.gz 2023-10-24T02:04:20.710 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92006.log 2023-10-24T02:04:20.711 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130414.log 2023-10-24T02:04:20.711 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92006.log: /var/log/ceph/ceph-client.admin.130414.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92006.log.gz 2023-10-24T02:04:20.711 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130414.log.gz 2023-10-24T02:04:20.711 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133639.log 2023-10-24T02:04:20.711 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95247.log 2023-10-24T02:04:20.712 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116662.log 2023-10-24T02:04:20.712 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95247.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.133639.log.gz 2023-10-24T02:04:20.712 INFO:teuthology.orchestra.run.smithi148.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95247.log.gz 2023-10-24T02:04:20.712 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116662.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116662.log.gz 2023-10-24T02:04:20.712 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115185.log 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137773.log 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115185.log: /var/log/ceph/ceph-client.admin.137773.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115185.log.gz 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137773.log.gz 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126693.log 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117290.log 2023-10-24T02:04:20.713 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115496.log 2023-10-24T02:04:20.714 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126693.log.gz 2023-10-24T02:04:20.714 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115496.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117290.log.gz 2023-10-24T02:04:20.714 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115496.log.gz 2023-10-24T02:04:20.714 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131266.log 2023-10-24T02:04:20.714 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138298.log 2023-10-24T02:04:20.715 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131266.log: /var/log/ceph/ceph-client.admin.138298.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131266.log.gz 2023-10-24T02:04:20.715 INFO:teuthology.orchestra.run.smithi148.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138298.log.gz 2023-10-24T02:04:20.715 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96303.log 2023-10-24T02:04:20.715 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112109.log 2023-10-24T02:04:20.715 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96303.log: /var/log/ceph/ceph-client.admin.112109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96303.log.gz 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112109.log.gz 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139033.log 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120815.log 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139033.log: /var/log/ceph/ceph-client.admin.120815.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139033.log.gz 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120815.log.gz 2023-10-24T02:04:20.716 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137467.log 2023-10-24T02:04:20.717 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120323.log 2023-10-24T02:04:20.717 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137467.log: /var/log/ceph/ceph-client.admin.120323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137467.log.gz 2023-10-24T02:04:20.717 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120323.log.gz 2023-10-24T02:04:20.717 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128335.log 2023-10-24T02:04:20.717 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97628.log 2023-10-24T02:04:20.718 INFO:teuthology.orchestra.run.smithi150.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-24T02:04:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128335.log: /var/log/ceph/ceph-client.admin.97628.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128335.log.gz 2023-10-24T02:04:20.740 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97628.log.gz 2023-10-24T02:04:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133561.log 2023-10-24T02:04:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113623.log 2023-10-24T02:04:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133561.log: /var/log/ceph/ceph-client.admin.113623.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.133561.log.gz 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113623.log.gz 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133247.log 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137899.log 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133247.log: /var/log/ceph/ceph-client.admin.137899.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133247.log.gz 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137899.log.gz 2023-10-24T02:04:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116617.log 2023-10-24T02:04:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114142.log 2023-10-24T02:04:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116617.log: /var/log/ceph/ceph-client.admin.114142.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116617.log.gz 2023-10-24T02:04:20.742 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114142.log.gz 2023-10-24T02:04:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97880.log 2023-10-24T02:04:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109616.log 2023-10-24T02:04:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97880.log: /var/log/ceph/ceph-client.admin.109616.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97880.log.gz 2023-10-24T02:04:20.743 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109616.log.gz 2023-10-24T02:04:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94113.log 2023-10-24T02:04:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99992.log 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.94113.log: /var/log/ceph/ceph-client.admin.99992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94113.log.gz 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99992.log.gz 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117784.log 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117784.log: /var/log/ceph/ceph-osd.0.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117784.log.gz 2023-10-24T02:04:20.744 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99392.log 2023-10-24T02:04:20.745 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134439.log 2023-10-24T02:04:20.745 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99392.log: /var/log/ceph/ceph-client.admin.134439.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99392.log.gz 2023-10-24T02:04:20.745 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134439.log.gz 2023-10-24T02:04:20.745 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133289.log 2023-10-24T02:04:20.745 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127378.log 2023-10-24T02:04:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133289.log: /var/log/ceph/ceph-client.admin.127378.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.133289.log.gz 2023-10-24T02:04:20.746 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127378.log.gz 2023-10-24T02:04:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105145.log 2023-10-24T02:04:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92779.log 2023-10-24T02:04:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105145.log: /var/log/ceph/ceph-client.admin.92779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105145.log.gz 2023-10-24T02:04:20.747 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92779.log.gz 2023-10-24T02:04:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112669.log 2023-10-24T02:04:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115227.log 2023-10-24T02:04:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112669.log: /var/log/ceph/ceph-client.admin.115227.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112669.log.gz 2023-10-24T02:04:20.747 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115227.log.gz 2023-10-24T02:04:20.748 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95373.log 2023-10-24T02:04:20.748 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92695.log 2023-10-24T02:04:20.748 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95373.log: /var/log/ceph/ceph-client.admin.92695.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95373.log.gz 2023-10-24T02:04:20.748 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92695.log.gz 2023-10-24T02:04:20.748 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118698.log 2023-10-24T02:04:20.749 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87573.log 2023-10-24T02:04:20.749 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.118698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118698.log.gz 2023-10-24T02:04:20.749 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.87573.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87573.log.gz 2023-10-24T02:04:20.749 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129847.log 2023-10-24T02:04:20.749 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138088.log 2023-10-24T02:04:20.750 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129847.log: /var/log/ceph/ceph-client.admin.138088.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129847.log.gz 2023-10-24T02:04:20.750 INFO:teuthology.orchestra.run.smithi148.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138088.log.gz 2023-10-24T02:04:20.750 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104931.log 2023-10-24T02:04:20.750 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138690.log 2023-10-24T02:04:20.750 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104931.log: /var/log/ceph/ceph-client.admin.138690.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104931.log.gz 2023-10-24T02:04:20.751 INFO:teuthology.orchestra.run.smithi148.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138690.log.gz 2023-10-24T02:04:20.751 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126123.log 2023-10-24T02:04:20.751 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93955.log 2023-10-24T02:04:20.751 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126123.log: /var/log/ceph/ceph-client.admin.93955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126123.log.gz 2023-10-24T02:04:20.751 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93955.log.gz 2023-10-24T02:04:20.752 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140171.log 2023-10-24T02:04:20.752 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132982.log 2023-10-24T02:04:20.752 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140171.log: /var/log/ceph/ceph-client.admin.132982.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140171.log.gz 2023-10-24T02:04:20.752 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132982.log.gz 2023-10-24T02:04:20.752 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108835.log 2023-10-24T02:04:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101448.log 2023-10-24T02:04:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108835.log: 88.3%/var/log/ceph/ceph-client.admin.101448.log: -- replaced with /var/log/ceph/ceph-client.admin.108835.log.gz 2023-10-24T02:04:20.753 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101448.log.gz 2023-10-24T02:04:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129112.log 2023-10-24T02:04:20.753 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.94903.log 2023-10-24T02:04:20.754 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129112.log: /var/log/ceph/ceph-client.2.94903.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129112.log.gz 2023-10-24T02:04:20.754 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.94903.log.gz 2023-10-24T02:04:20.754 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132155.log 2023-10-24T02:04:20.754 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97110.log 2023-10-24T02:04:20.754 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132155.log: /var/log/ceph/ceph-client.admin.97110.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.132155.log.gz 2023-10-24T02:04:20.755 INFO:teuthology.orchestra.run.smithi148.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97110.log.gz 2023-10-24T02:04:20.755 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110262.log 2023-10-24T02:04:20.755 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92863.log 2023-10-24T02:04:20.755 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110262.log: /var/log/ceph/ceph-client.admin.92863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110262.log.gz 2023-10-24T02:04:20.755 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92863.log.gz 2023-10-24T02:04:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105355.log 2023-10-24T02:04:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132080.log 2023-10-24T02:04:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105355.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105355.log.gz 2023-10-24T02:04:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132080.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.132080.log.gz 2023-10-24T02:04:20.756 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127903.log 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112711.log 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127903.log: /var/log/ceph/ceph-client.admin.112711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127903.log.gz 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112711.log.gz 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93661.log 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100468.log 2023-10-24T02:04:20.757 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93661.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93661.log.gz 2023-10-24T02:04:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100468.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100468.log.gz 2023-10-24T02:04:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126903.log 2023-10-24T02:04:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116932.log 2023-10-24T02:04:20.758 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126903.log: /var/log/ceph/ceph-client.admin.116932.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126903.log.gz 2023-10-24T02:04:20.758 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116932.log.gz 2023-10-24T02:04:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112373.log 2023-10-24T02:04:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133763.log 2023-10-24T02:04:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112373.log: 89.1%/var/log/ceph/ceph-client.admin.133763.log: -- replaced with /var/log/ceph/ceph-client.admin.112373.log.gz 2023-10-24T02:04:20.759 INFO:teuthology.orchestra.run.smithi148.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.133763.log.gz 2023-10-24T02:04:20.759 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117555.log 2023-10-24T02:04:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134607.log 2023-10-24T02:04:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117555.log: 88.5%/var/log/ceph/ceph-client.admin.134607.log: -- replaced with /var/log/ceph/ceph-client.admin.117555.log.gz 2023-10-24T02:04:20.760 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134607.log.gz 2023-10-24T02:04:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133373.log 2023-10-24T02:04:20.760 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log 2023-10-24T02:04:20.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133373.log: /var/log/ceph/ceph-client.admin.118164.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.133373.log.gz 2023-10-24T02:04:20.761 INFO:teuthology.orchestra.run.smithi148.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118164.log.gz 2023-10-24T02:04:20.761 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91338.log 2023-10-24T02:04:20.761 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102767.log 2023-10-24T02:04:20.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91338.log: /var/log/ceph/ceph-client.admin.102767.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91338.log.gz 2023-10-24T02:04:20.762 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102767.log.gz 2023-10-24T02:04:20.762 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141226.log 2023-10-24T02:04:20.762 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103017.log 2023-10-24T02:04:20.762 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141226.log: /var/log/ceph/ceph-client.admin.103017.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141226.log.gz 2023-10-24T02:04:20.762 INFO:teuthology.orchestra.run.smithi148.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103017.log.gz 2023-10-24T02:04:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114751.log 2023-10-24T02:04:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137607.log 2023-10-24T02:04:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114751.log: /var/log/ceph/ceph-client.admin.137607.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114751.log.gz 2023-10-24T02:04:20.763 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137607.log.gz 2023-10-24T02:04:20.763 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96345.log 2023-10-24T02:04:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-24T02:04:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96345.log: /var/log/ceph/ceph-mgr.y.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96345.log.gz 2023-10-24T02:04:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100758.log 2023-10-24T02:04:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100758.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100758.log.gz 2023-10-24T02:04:20.764 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120710.log 2023-10-24T02:04:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120710.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120710.log.gz 2023-10-24T02:04:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100118.log 2023-10-24T02:04:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100118.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100118.log.gz 2023-10-24T02:04:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135242.log 2023-10-24T02:04:20.765 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135242.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135242.log.gz 2023-10-24T02:04:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137383.log 2023-10-24T02:04:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137383.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137383.log.gz 2023-10-24T02:04:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91750.log 2023-10-24T02:04:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91750.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91750.log.gz 2023-10-24T02:04:20.766 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113719.log 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113719.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113719.log.gz 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114079.log 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114079.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114079.log.gz 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129681.log 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129681.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129681.log.gz 2023-10-24T02:04:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136993.log 2023-10-24T02:04:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136993.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136993.log.gz 2023-10-24T02:04:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95457.log 2023-10-24T02:04:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95457.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95457.log.gz 2023-10-24T02:04:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100210.log 2023-10-24T02:04:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100210.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100210.log.gz 2023-10-24T02:04:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122245.log 2023-10-24T02:04:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122245.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122245.log.gz 2023-10-24T02:04:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96942.log 2023-10-24T02:04:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96942.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96942.log.gz 2023-10-24T02:04:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113328.log 2023-10-24T02:04:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113328.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113328.log.gz 2023-10-24T02:04:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120626.log 2023-10-24T02:04:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120626.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120626.log.gz 2023-10-24T02:04:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98914.log 2023-10-24T02:04:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98914.log.gz 2023-10-24T02:04:20.771 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104006.log 2023-10-24T02:04:20.771 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104006.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104006.log.gz 2023-10-24T02:04:20.771 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105481.log 2023-10-24T02:04:20.771 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105481.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.105481.log.gz 2023-10-24T02:04:20.771 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93619.log 2023-10-24T02:04:20.772 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93619.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93619.log.gz 2023-10-24T02:04:20.772 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134697.log 2023-10-24T02:04:20.772 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134697.log.gz 2023-10-24T02:04:20.772 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136814.log 2023-10-24T02:04:20.772 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136814.log.gz 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97152.log 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97152.log.gz 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125956.log 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.125956.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125956.log.gz 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95415.log 2023-10-24T02:04:20.773 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95415.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95415.log.gz 2023-10-24T02:04:20.774 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103963.log 2023-10-24T02:04:20.774 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103963.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103963.log.gz 2023-10-24T02:04:20.774 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95967.log 2023-10-24T02:04:20.774 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95967.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95967.log.gz 2023-10-24T02:04:20.774 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133331.log 2023-10-24T02:04:20.775 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133331.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.133331.log.gz 2023-10-24T02:04:20.775 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129415.log 2023-10-24T02:04:20.775 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129415.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129415.log.gz 2023-10-24T02:04:20.775 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109920.log 2023-10-24T02:04:20.775 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109920.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109920.log.gz 2023-10-24T02:04:20.776 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99308.log 2023-10-24T02:04:20.776 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99308.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99308.log.gz 2023-10-24T02:04:20.776 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114877.log 2023-10-24T02:04:20.776 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114877.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114877.log.gz 2023-10-24T02:04:20.776 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104289.log 2023-10-24T02:04:20.777 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104289.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104289.log.gz 2023-10-24T02:04:20.777 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118848.log 2023-10-24T02:04:20.777 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118848.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.118848.log.gz 2023-10-24T02:04:20.777 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111089.log 2023-10-24T02:04:20.777 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111089.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111089.log.gz 2023-10-24T02:04:20.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131184.log 2023-10-24T02:04:20.778 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131184.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131184.log.gz 2023-10-24T02:04:20.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108571.log 2023-10-24T02:04:20.778 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108571.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108571.log.gz 2023-10-24T02:04:20.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109352.log 2023-10-24T02:04:20.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109352.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109352.log.gz 2023-10-24T02:04:20.779 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100816.log 2023-10-24T02:04:20.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100816.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100816.log.gz 2023-10-24T02:04:20.779 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log 2023-10-24T02:04:20.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109566.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109566.log.gz 2023-10-24T02:04:20.780 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121837.log 2023-10-24T02:04:20.780 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121837.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121837.log.gz 2023-10-24T02:04:20.780 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93241.log 2023-10-24T02:04:20.780 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93241.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93241.log.gz 2023-10-24T02:04:20.780 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111268.log 2023-10-24T02:04:20.781 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111268.log.gz 2023-10-24T02:04:20.781 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139457.log 2023-10-24T02:04:20.781 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139457.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139457.log.gz 2023-10-24T02:04:20.781 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130498.log 2023-10-24T02:04:20.781 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130498.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.130498.log.gz 2023-10-24T02:04:20.782 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95585.log 2023-10-24T02:04:20.782 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95585.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95585.log.gz 2023-10-24T02:04:20.782 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116519.log 2023-10-24T02:04:20.782 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116519.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116519.log.gz 2023-10-24T02:04:20.782 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98662.log 2023-10-24T02:04:20.783 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98662.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.98662.log.gz 2023-10-24T02:04:20.783 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105397.log 2023-10-24T02:04:20.783 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105397.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105397.log.gz 2023-10-24T02:04:20.783 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108481.log 2023-10-24T02:04:20.783 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108481.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108481.log.gz 2023-10-24T02:04:20.784 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113262.log 2023-10-24T02:04:20.784 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113262.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113262.log.gz 2023-10-24T02:04:20.784 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122472.log 2023-10-24T02:04:20.784 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122472.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122472.log.gz 2023-10-24T02:04:20.784 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118290.log 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118290.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118290.log.gz 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140213.log 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140213.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.140213.log.gz 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98312.log 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98312.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98312.log.gz 2023-10-24T02:04:20.785 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130288.log 2023-10-24T02:04:20.786 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130288.log.gz 2023-10-24T02:04:20.786 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96774.log 2023-10-24T02:04:20.786 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96774.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96774.log.gz 2023-10-24T02:04:20.786 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92989.log 2023-10-24T02:04:20.786 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92989.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92989.log.gz 2023-10-24T02:04:20.787 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99182.log 2023-10-24T02:04:20.787 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99182.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99182.log.gz 2023-10-24T02:04:20.787 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134313.log 2023-10-24T02:04:20.787 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134313.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134313.log.gz 2023-10-24T02:04:20.787 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105721.log 2023-10-24T02:04:20.788 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.105721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105721.log.gz 2023-10-24T02:04:20.788 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98546.log 2023-10-24T02:04:20.788 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98546.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98546.log.gz 2023-10-24T02:04:20.788 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104205.log 2023-10-24T02:04:20.788 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104205.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104205.log.gz 2023-10-24T02:04:20.789 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126318.log 2023-10-24T02:04:20.789 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126318.log.gz 2023-10-24T02:04:20.789 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121407.log 2023-10-24T02:04:20.789 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121407.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121407.log.gz 2023-10-24T02:04:20.789 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116996.log 2023-10-24T02:04:20.790 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116996.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116996.log.gz 2023-10-24T02:04:20.790 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133847.log 2023-10-24T02:04:20.790 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133847.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.133847.log.gz 2023-10-24T02:04:20.790 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139094.log 2023-10-24T02:04:20.790 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139094.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139094.log.gz 2023-10-24T02:04:20.791 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130246.log 2023-10-24T02:04:20.791 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130246.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130246.log.gz 2023-10-24T02:04:20.791 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121451.log 2023-10-24T02:04:20.791 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121451.log.gz 2023-10-24T02:04:20.791 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91922.log 2023-10-24T02:04:20.792 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91922.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91922.log.gz 2023-10-24T02:04:20.792 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93157.log 2023-10-24T02:04:20.792 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93157.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93157.log.gz 2023-10-24T02:04:20.792 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130456.log 2023-10-24T02:04:20.792 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130456.log.gz 2023-10-24T02:04:20.793 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92300.log 2023-10-24T02:04:20.793 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92300.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92300.log.gz 2023-10-24T02:04:20.793 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130998.log 2023-10-24T02:04:20.793 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130998.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130998.log.gz 2023-10-24T02:04:20.793 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127252.log 2023-10-24T02:04:20.794 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127252.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127252.log.gz 2023-10-24T02:04:20.794 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109003.log 2023-10-24T02:04:20.794 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109003.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109003.log.gz 2023-10-24T02:04:20.794 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108346.log 2023-10-24T02:04:20.794 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108346.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108346.log.gz 2023-10-24T02:04:20.795 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115269.log 2023-10-24T02:04:20.795 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115269.log.gz 2023-10-24T02:04:20.795 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118374.log 2023-10-24T02:04:20.795 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118374.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118374.log.gz 2023-10-24T02:04:20.795 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114667.log 2023-10-24T02:04:20.796 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114667.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114667.log.gz 2023-10-24T02:04:20.796 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95205.log 2023-10-24T02:04:20.796 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95205.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95205.log.gz 2023-10-24T02:04:20.796 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110046.log 2023-10-24T02:04:20.796 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110046.log.gz 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117954.log 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117954.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117954.log.gz 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113667.log 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113667.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113667.log.gz 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132197.log 2023-10-24T02:04:20.797 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132197.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132197.log.gz 2023-10-24T02:04:20.798 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110172.log 2023-10-24T02:04:20.798 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110172.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110172.log.gz 2023-10-24T02:04:20.798 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126587.log 2023-10-24T02:04:20.798 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126587.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126587.log.gz 2023-10-24T02:04:20.798 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91708.log 2023-10-24T02:04:20.799 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.91708.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91708.log.gz 2023-10-24T02:04:20.799 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129457.log 2023-10-24T02:04:20.799 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129457.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129457.log.gz 2023-10-24T02:04:20.799 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96530.log 2023-10-24T02:04:20.799 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96530.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96530.log.gz 2023-10-24T02:04:20.800 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137689.log 2023-10-24T02:04:20.800 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137689.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137689.log.gz 2023-10-24T02:04:20.800 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93115.log 2023-10-24T02:04:20.800 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93115.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93115.log.gz 2023-10-24T02:04:20.800 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117912.log 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117912.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117912.log.gz 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.2.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111179.log 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111179.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111179.log.gz 2023-10-24T02:04:20.801 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118122.log 2023-10-24T02:04:20.802 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118122.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118122.log.gz 2023-10-24T02:04:20.802 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104847.log 2023-10-24T02:04:20.802 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104847.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104847.log.gz 2023-10-24T02:04:20.802 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140806.log 2023-10-24T02:04:20.802 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140806.log.gz 2023-10-24T02:04:20.803 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133931.log 2023-10-24T02:04:20.803 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.133931.log.gz 2023-10-24T02:04:20.803 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134145.log 2023-10-24T02:04:20.803 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134145.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134145.log.gz 2023-10-24T02:04:20.804 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96093.log 2023-10-24T02:04:20.804 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96093.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96093.log.gz 2023-10-24T02:04:20.804 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112585.log 2023-10-24T02:04:20.804 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112585.log.gz 2023-10-24T02:04:20.804 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109268.log 2023-10-24T02:04:20.805 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109268.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109268.log.gz 2023-10-24T02:04:20.805 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104975.log 2023-10-24T02:04:20.805 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.104975.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104975.log.gz 2023-10-24T02:04:20.805 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111761.log 2023-10-24T02:04:20.805 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111761.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111761.log.gz 2023-10-24T02:04:20.806 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133499.log 2023-10-24T02:04:20.806 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.133499.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.133499.log.gz 2023-10-24T02:04:20.874 INFO:teuthology.orchestra.run.smithi148.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-24T02:04:20.984 INFO:teuthology.orchestra.run.smithi148.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-24T02:04:21.895 INFO:teuthology.orchestra.run.smithi150.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-24T02:04:21.920 INFO:teuthology.orchestra.run.smithi150.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-24T02:04:22.114 INFO:teuthology.orchestra.run.smithi150.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-24T02:04:22.515 INFO:teuthology.orchestra.run.smithi150.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-24T02:04:22.637 INFO:teuthology.orchestra.run.smithi148.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-24T02:04:22.831 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-24T02:04:22.860 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-24T02:04:23.043 INFO:teuthology.orchestra.run.smithi150.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-24T02:04:23.186 INFO:teuthology.orchestra.run.smithi150.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-24T02:04:23.188 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-10-24T02:04:23.188 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m2.925s 2023-10-24T02:04:23.188 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m15.451s 2023-10-24T02:04:23.189 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.573s 2023-10-24T02:04:23.205 INFO:teuthology.orchestra.run.smithi148.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-24T02:04:23.353 INFO:teuthology.orchestra.run.smithi148.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-24T02:04:23.452 INFO:teuthology.orchestra.run.smithi148.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-24T02:04:23.455 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-10-24T02:04:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m3.224s 2023-10-24T02:04:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m14.507s 2023-10-24T02:04:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.888s 2023-10-24T02:04:23.456 INFO:tasks.ceph:Archiving logs... 2023-10-24T02:04:23.456 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi148/log 2023-10-24T02:04:23.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-24T02:04:25.927 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi150/log 2023-10-24T02:04:25.928 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-24T02:04:27.637 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-24T02:04:27.649 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-24T02:04:27.650 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-24T02:04:27.652 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-24T02:04:39.207 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-24T02:04:39.217 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-24T02:04:39.217 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-24T02:04:39.220 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-24T02:04:39.231 INFO:teuthology.orchestra.run.smithi148.stderr:bash: ntpq: command not found 2023-10-24T02:04:39.235 INFO:teuthology.orchestra.run.smithi148.stdout:210 Number of sources = 4 2023-10-24T02:04:39.235 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-24T02:04:39.235 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-10-24T02:04:39.235 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 46 +1431us[+1431us] +/- 97ms 2023-10-24T02:04:39.236 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -391us[ -391us] +/- 64ms 2023-10-24T02:04:39.236 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 104 -681us[ -679us] +/- 83ms 2023-10-24T02:04:39.236 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T02:04:39.237 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2023-10-24T02:04:39.241 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2023-10-24T02:04:39.241 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-24T02:04:39.241 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2023-10-24T02:04:39.241 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 37 +1387us[+1387us] +/- 97ms 2023-10-24T02:04:39.242 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -396us[ -399us] +/- 64ms 2023-10-24T02:04:39.242 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 46 -712us[ -715us] +/- 84ms 2023-10-24T02:04:39.242 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-24T02:04:39.242 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-24T02:04:39.251 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-24T02:04:39.252 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-24T02:04:39.260 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-24T02:04:39.320 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-24T02:04:39.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-24T02:04:39.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:04:39.443 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-24T02:04:39.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:04:39.475 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-24T02:04:39.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-24T02:04:39.493 INFO:teuthology.task.internal:Duration was 6506.513786 seconds 2023-10-24T02:04:39.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-24T02:04:39.503 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-24T02:04:39.503 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-24T02:04:39.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-24T02:04:39.547 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-24T02:04:39.560 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-24T02:04:39.627 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-24T02:04:39.627 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2023-10-24T02:04:39.628 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-24T02:04:39.646 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2023-10-24T02:04:39.647 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-24T02:04:39.666 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-24T02:04:39.666 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-24T02:04:39.689 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-24T02:04:39.746 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-24T02:04:39.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-24T02:04:39.748 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-24T02:04:39.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-24T02:04:39.872 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-24T02:04:39.872 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-24T02:04:39.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-24T02:04:39.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-24T02:04:39.932 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-24T02:04:39.939 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-24T02:04:39.961 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2023-10-24T02:04:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2023-10-24T02:04:39.999 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-24T02:04:40.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:04:40.029 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-24T02:04:40.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-24T02:04:40.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-24T02:04:40.064 INFO:teuthology.task.internal:Transferring archived files... 2023-10-24T02:04:40.065 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi148 2023-10-24T02:04:40.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-24T02:04:40.103 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974/remote/smithi150 2023-10-24T02:04:40.103 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-24T02:04:40.138 INFO:teuthology.task.internal:Removing archive directory... 2023-10-24T02:04:40.139 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-24T02:04:40.141 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-24T02:04:40.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-24T02:04:40.198 INFO:teuthology.task.internal:Not uploading archives. 2023-10-24T02:04:40.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-24T02:04:40.208 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-24T02:04:40.209 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-24T02:04:40.211 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-24T02:04:40.223 INFO:teuthology.orchestra.run.smithi148.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 24 02:04 /home/ubuntu/cephtest 2023-10-24T02:04:40.241 INFO:teuthology.orchestra.run.smithi150.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 24 02:04 /home/ubuntu/cephtest 2023-10-24T02:04:40.242 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-24T02:04:40.252 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-24T02:04:40.280 INFO:teuthology.nuke:Checking targets against current locks 2023-10-24T02:04:40.320 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-24T02:04:40.320 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T02:04:40.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:12.306276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKUvSJx2mV8wRY0mjrjsB2wFIWM0U3RA04/sbTZZ7DVx3jNmuSHIqPuPWl+O9ttksx1eEywYLo2O/mkLZ6hX5Ns='} 2023-10-24T02:04:40.455 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-24T02:04:40.456 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T02:04:40.478 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-24T02:04:40.479 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:40.501 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-24T02:04:42.278 DEBUG:teuthology.nuke:shortname: smithi150 2023-10-24T02:04:42.278 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-24T02:04:44.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/7434974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-24 00:04:12.304638', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7UkzY9I5R+6v0hdWqah4Cxv5hlM06BlVbqL+Rn2biEpxYveWdLWwE2iptGdMMVe53t2WzcOo8nIinJZx9T3/I='} 2023-10-24T02:04:44.502 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:44.611 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-24T02:04:47.806 INFO:teuthology.orchestra.console.smithi150:Power off 2023-10-24T02:04:47.807 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-24T02:04:47.829 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-10-24T02:04:47.829 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:47.853 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-10-24T02:04:48.613 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:48.723 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-24T02:04:51.855 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:51.965 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-10-24T02:04:52.726 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:52.835 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-24T02:04:52.936 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-24T02:04:55.966 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:04:56.075 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-10-24T02:05:00.078 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-24T02:05:00.187 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-10-24T02:05:00.288 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-10-24T02:05:00.395 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6506.513785839081 failure_reason: '"2023-10-24T00:30:59.780022+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-24T02:05:00.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-24T02:05:00.912 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:07.482 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:09.119 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:10.824 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:14.683 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:16.781 ERROR:teuthology.report:POST to https://paddles.front.sepia.ceph.com/runs/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-10-24T02:05:24.668 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run.py", line 414, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run.py", line 288, in report_outcome report.try_push_job_info(config, summary) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/report.py", line 512, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/report.py", line 474, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/report.py", line 299, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7434974' reached maximum tries (11) after waiting for 14.973789666228363 seconds